2024-09-13T02:35:13.941 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-13T02:35:13.964 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-13T02:35:14.068 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-13_02:08:15-upgrade-squid-distro-default-smithi/7903088 branch: squid description: upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7903088' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi meta: - desc: 'setup ceph/quincy ' name: teuthology-2024-09-13_02:08:15-upgrade-squid-distro-default-smithi no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - OSD_DOWN - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy sha1: 7741f7f9ee20524f89b8f61d1609b32fb3b1570a ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 7741f7f9ee20524f89b8f61d1609b32fb3b1570a kclient: syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: ecab7be58963a5bd03910cd73eef66405d7fdd50 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - host.a - client.0 - osd.0 - osd.1 - osd.2 - - host.b - client.1 - osd.3 - osd.4 - osd.5 seed: 3254 sha1: 7741f7f9ee20524f89b8f61d1609b32fb3b1570a sleep_before_teardown: 0 subset: 23/32 suite: upgrade suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_ecab7be58963a5bd03910cd73eef66405d7fdd50/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: ecab7be58963a5bd03910cd73eef66405d7fdd50 targets: smithi089.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC/uidD+39DuWEJOrJEjaM3DhS5Y7kMYD/6zkM5IN3DTWOsWZE1DBkyB2cDGlNm/5tbKXV9XOuBR4A64/zOztk0= smithi131.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBP55o38lUL/7PTFGan3s3xLQRPnvUSdf4Tn7fJ/Pw039DSm2y9uJUfpl1zMn1BzjOWxz1ii7R4pZ+OC8rppT428= tasks: - install: branch: quincy exclude_packages: - ceph-volume - print: '**** done install task...' - cephadm: cephadm_branch: quincy cephadm_git_url: https://github.com/ceph/ceph conf: osd: osd_class_default_list: '*' osd_class_load_list: '*' image: quay.ceph.io/ceph-ci/ceph:quincy roleless: true - print: '**** done end installing quincy cephadm ...' - cephadm.shell: host.a: - ceph config set mgr mgr/cephadm/use_repo_digest true --force - print: '**** done cephadm.shell ceph config set mgr...' - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: host.a: - ceph fs volume create cephfs --placement=4 - ceph fs dump - cephadm.shell: host.a: - ceph fs set cephfs max_mds 2 - cephadm.shell: host.a: - ceph fs set cephfs allow_standby_replay true - cephadm.shell: host.a: - ceph fs set cephfs inline_data false - cephadm.shell: host.a: - ceph fs dump - ceph --format=json fs dump | jq -e ".filesystems | length == 1" - while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done - fs.pre_upgrade_save: null - kclient: null - print: '**** done client' - parallel: - upgrade-tasks - workload-tasks - cephadm.shell: host.a: - ceph fs dump - fs.post_upgrade_checks: null teuthology: fragments_dropped: - /home/teuthology/src/git.ceph.com_ceph_squid/qa/suites/upgrade/cephfs/mds_upgrade_sequence/tasks/3-upgrade-mgr-staggered.yaml meta: {} postmerge: [] variables: fail_fs: false teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-13_02:08:15 tube: smithi upgrade-tasks: sequential: - cephadm.shell: env: - sha1 host.a: - ceph config set mgr mgr/orchestrator/fail_fs false || true - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 host.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done - ceph orch ps - ceph orch upgrade status - ceph health detail - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 workload-tasks: sequential: - workunit: clients: all: - suites/fsstress.sh 2024-09-13T02:35:14.068 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_ecab7be58963a5bd03910cd73eef66405d7fdd50/qa; will attempt to use it 2024-09-13T02:35:14.069 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_ecab7be58963a5bd03910cd73eef66405d7fdd50/qa/tasks 2024-09-13T02:35:14.069 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-13T02:35:14.070 INFO:teuthology.task.internal:Checking packages... 2024-09-13T02:35:14.093 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '7741f7f9ee20524f89b8f61d1609b32fb3b1570a' 2024-09-13T02:35:14.093 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-13T02:35:14.093 INFO:teuthology.packaging:ref: None 2024-09-13T02:35:14.093 INFO:teuthology.packaging:tag: None 2024-09-13T02:35:14.093 INFO:teuthology.packaging:branch: squid 2024-09-13T02:35:14.093 INFO:teuthology.packaging:sha1: 7741f7f9ee20524f89b8f61d1609b32fb3b1570a 2024-09-13T02:35:14.093 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-13T02:35:14.327 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-322.g7741f7f9 2024-09-13T02:35:14.329 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-13T02:35:14.337 INFO:teuthology.task.internal:no buildpackages task found 2024-09-13T02:35:14.338 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-13T02:35:14.384 INFO:teuthology.task.internal:Saving configuration 2024-09-13T02:35:14.403 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-13T02:35:14.437 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-13T02:35:14.458 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi089.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-13_02:08:15-upgrade-squid-distro-default-smithi/7903088', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-13 02:30:14.231856', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBC/uidD+39DuWEJOrJEjaM3DhS5Y7kMYD/6zkM5IN3DTWOsWZE1DBkyB2cDGlNm/5tbKXV9XOuBR4A64/zOztk0='} 2024-09-13T02:35:14.476 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi131.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-13_02:08:15-upgrade-squid-distro-default-smithi/7903088', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-13 02:30:14.234790', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBP55o38lUL/7PTFGan3s3xLQRPnvUSdf4Tn7fJ/Pw039DSm2y9uJUfpl1zMn1BzjOWxz1ii7R4pZ+OC8rppT428='} 2024-09-13T02:35:14.476 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-13T02:35:14.485 INFO:teuthology.task.internal:roles: ubuntu@smithi089.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2'] 2024-09-13T02:35:14.485 INFO:teuthology.task.internal:roles: ubuntu@smithi131.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5'] 2024-09-13T02:35:14.485 INFO:teuthology.run_tasks:Running task console_log... 2024-09-13T02:35:14.586 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f8b6607bac0>, signals=[15]) 2024-09-13T02:35:14.586 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-13T02:35:14.593 INFO:teuthology.task.internal:Opening connections... 2024-09-13T02:35:14.596 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi089.front.sepia.ceph.com 2024-09-13T02:35:14.597 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T02:35:14.675 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi131.front.sepia.ceph.com 2024-09-13T02:35:14.676 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T02:35:14.752 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-13T02:35:14.759 DEBUG:teuthology.orchestra.run.smithi089:> uname -m 2024-09-13T02:35:14.778 INFO:teuthology.orchestra.run.smithi089.stdout:x86_64 2024-09-13T02:35:14.778 DEBUG:teuthology.orchestra.run.smithi089:> cat /etc/os-release 2024-09-13T02:35:14.834 INFO:teuthology.orchestra.run.smithi089.stdout:NAME="CentOS Stream" 2024-09-13T02:35:14.835 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION="9" 2024-09-13T02:35:14.835 INFO:teuthology.orchestra.run.smithi089.stdout:ID="centos" 2024-09-13T02:35:14.835 INFO:teuthology.orchestra.run.smithi089.stdout:ID_LIKE="rhel fedora" 2024-09-13T02:35:14.835 INFO:teuthology.orchestra.run.smithi089.stdout:VERSION_ID="9" 2024-09-13T02:35:14.835 INFO:teuthology.orchestra.run.smithi089.stdout:PLATFORM_ID="platform:el9" 2024-09-13T02:35:14.835 INFO:teuthology.orchestra.run.smithi089.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-13T02:35:14.835 INFO:teuthology.orchestra.run.smithi089.stdout:ANSI_COLOR="0;31" 2024-09-13T02:35:14.835 INFO:teuthology.orchestra.run.smithi089.stdout:LOGO="fedora-logo-icon" 2024-09-13T02:35:14.835 INFO:teuthology.orchestra.run.smithi089.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-13T02:35:14.835 INFO:teuthology.orchestra.run.smithi089.stdout:HOME_URL="https://centos.org/" 2024-09-13T02:35:14.835 INFO:teuthology.orchestra.run.smithi089.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-13T02:35:14.836 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-13T02:35:14.836 INFO:teuthology.orchestra.run.smithi089.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-13T02:35:14.836 INFO:teuthology.lock.ops:Updating smithi089.front.sepia.ceph.com on lock server 2024-09-13T02:35:14.853 DEBUG:teuthology.orchestra.run.smithi131:> uname -m 2024-09-13T02:35:14.871 INFO:teuthology.orchestra.run.smithi131.stdout:x86_64 2024-09-13T02:35:14.872 DEBUG:teuthology.orchestra.run.smithi131:> cat /etc/os-release 2024-09-13T02:35:14.930 INFO:teuthology.orchestra.run.smithi131.stdout:NAME="CentOS Stream" 2024-09-13T02:35:14.930 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION="9" 2024-09-13T02:35:14.930 INFO:teuthology.orchestra.run.smithi131.stdout:ID="centos" 2024-09-13T02:35:14.930 INFO:teuthology.orchestra.run.smithi131.stdout:ID_LIKE="rhel fedora" 2024-09-13T02:35:14.931 INFO:teuthology.orchestra.run.smithi131.stdout:VERSION_ID="9" 2024-09-13T02:35:14.931 INFO:teuthology.orchestra.run.smithi131.stdout:PLATFORM_ID="platform:el9" 2024-09-13T02:35:14.931 INFO:teuthology.orchestra.run.smithi131.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-13T02:35:14.931 INFO:teuthology.orchestra.run.smithi131.stdout:ANSI_COLOR="0;31" 2024-09-13T02:35:14.931 INFO:teuthology.orchestra.run.smithi131.stdout:LOGO="fedora-logo-icon" 2024-09-13T02:35:14.931 INFO:teuthology.orchestra.run.smithi131.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-13T02:35:14.931 INFO:teuthology.orchestra.run.smithi131.stdout:HOME_URL="https://centos.org/" 2024-09-13T02:35:14.931 INFO:teuthology.orchestra.run.smithi131.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-13T02:35:14.931 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-13T02:35:14.931 INFO:teuthology.orchestra.run.smithi131.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-13T02:35:14.932 INFO:teuthology.lock.ops:Updating smithi131.front.sepia.ceph.com on lock server 2024-09-13T02:35:14.953 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-13T02:35:14.962 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-13T02:35:15.001 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-13T02:35:15.001 DEBUG:teuthology.orchestra.run.smithi089:> test '!' -e /home/ubuntu/cephtest 2024-09-13T02:35:15.004 DEBUG:teuthology.orchestra.run.smithi131:> test '!' -e /home/ubuntu/cephtest 2024-09-13T02:35:15.021 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-13T02:35:15.053 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-13T02:35:15.053 DEBUG:teuthology.orchestra.run.smithi089:> test -z $(ls -A /var/lib/ceph) 2024-09-13T02:35:15.061 DEBUG:teuthology.orchestra.run.smithi131:> test -z $(ls -A /var/lib/ceph) 2024-09-13T02:35:15.183 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-13T02:35:15.243 INFO:teuthology.run_tasks:Running task kernel... 2024-09-13T02:35:15.318 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-13T02:35:15.319 INFO:teuthology.task.kernel:config {'host.a': {'kdb': 1, 'sha1': 'distro'}, 'host.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-13T02:35:15.319 DEBUG:teuthology.orchestra.run.smithi089:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-13T02:35:15.319 DEBUG:teuthology.orchestra.run.smithi131:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-13T02:35:15.336 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T02:35:15.337 DEBUG:teuthology.orchestra.run.smithi089:> uname -r 2024-09-13T02:35:15.337 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T02:35:15.338 DEBUG:teuthology.orchestra.run.smithi131:> uname -r 2024-09-13T02:35:15.394 INFO:teuthology.orchestra.run.smithi089.stdout:5.14.0-503.el9.x86_64 2024-09-13T02:35:15.394 INFO:teuthology.task.kernel:Running kernel on smithi089: 5.14.0-503.el9.x86_64 2024-09-13T02:35:15.394 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum install -y kernel 2024-09-13T02:35:15.395 INFO:teuthology.orchestra.run.smithi131.stdout:5.14.0-503.el9.x86_64 2024-09-13T02:35:15.396 INFO:teuthology.task.kernel:Running kernel on smithi131: 5.14.0-503.el9.x86_64 2024-09-13T02:35:15.396 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum install -y kernel 2024-09-13T02:35:17.720 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.2 MB 00:00 2024-09-13T02:35:18.807 INFO:teuthology.orchestra.run.smithi131.stdout:CentOS Stream 9 - BaseOS 5.1 MB/s | 8.2 MB 00:01 2024-09-13T02:35:21.821 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 9 - AppStream 6.9 MB/s | 20 MB 00:02 2024-09-13T02:35:25.988 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 9 - CRB 17 MB/s | 6.5 MB 00:00 2024-09-13T02:35:27.613 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 9 - Extras packages 45 kB/s | 19 kB 00:00 2024-09-13T02:35:28.324 INFO:teuthology.orchestra.run.smithi131.stdout:CentOS Stream 9 - AppStream 2.4 MB/s | 20 MB 00:08 2024-09-13T02:35:28.767 INFO:teuthology.orchestra.run.smithi089.stdout:Extra Packages for Enterprise Linux 22 MB/s | 23 MB 00:01 2024-09-13T02:35:32.799 INFO:teuthology.orchestra.run.smithi131.stdout:CentOS Stream 9 - CRB 11 MB/s | 6.5 MB 00:00 2024-09-13T02:35:34.157 INFO:teuthology.orchestra.run.smithi089.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-13T02:35:34.358 INFO:teuthology.orchestra.run.smithi131.stdout:CentOS Stream 9 - Extras packages 53 kB/s | 19 kB 00:00 2024-09-13T02:35:35.904 INFO:teuthology.orchestra.run.smithi131.stdout:Extra Packages for Enterprise Linux 16 MB/s | 23 MB 00:01 2024-09-13T02:35:36.155 INFO:teuthology.orchestra.run.smithi089.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-13T02:35:36.155 INFO:teuthology.orchestra.run.smithi089.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-13T02:35:36.249 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-09-13T02:35:36.258 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-13T02:35:36.258 INFO:teuthology.orchestra.run.smithi089.stdout: Package Architecture Version Repository Size 2024-09-13T02:35:36.258 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-13T02:35:36.258 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2024-09-13T02:35:36.258 INFO:teuthology.orchestra.run.smithi089.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-13T02:35:36.258 INFO:teuthology.orchestra.run.smithi089.stdout:Installing dependencies: 2024-09-13T02:35:36.258 INFO:teuthology.orchestra.run.smithi089.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-13T02:35:36.258 INFO:teuthology.orchestra.run.smithi089.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-13T02:35:36.258 INFO:teuthology.orchestra.run.smithi089.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-13T02:35:36.259 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:35:36.259 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2024-09-13T02:35:36.259 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-13T02:35:36.259 INFO:teuthology.orchestra.run.smithi089.stdout:Install 4 Packages 2024-09-13T02:35:36.259 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:35:36.259 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 79 M 2024-09-13T02:35:36.260 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 126 M 2024-09-13T02:35:36.260 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2024-09-13T02:35:36.625 INFO:teuthology.orchestra.run.smithi089.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 255 kB/s | 23 kB 00:00 2024-09-13T02:35:36.975 INFO:teuthology.orchestra.run.smithi089.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 36 MB/s | 16 MB 00:00 2024-09-13T02:35:37.384 INFO:teuthology.orchestra.run.smithi089.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 41 MB/s | 35 MB 00:00 2024-09-13T02:35:38.017 INFO:teuthology.orchestra.run.smithi089.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 21 MB/s | 29 MB 00:01 2024-09-13T02:35:38.017 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2024-09-13T02:35:38.017 INFO:teuthology.orchestra.run.smithi089.stdout:Total 45 MB/s | 79 MB 00:01 2024-09-13T02:35:38.697 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2024-09-13T02:35:39.038 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2024-09-13T02:35:39.038 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2024-09-13T02:35:40.003 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2024-09-13T02:35:40.004 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2024-09-13T02:35:41.461 INFO:teuthology.orchestra.run.smithi131.stdout:lab-extras 9.3 kB/s | 1.7 kB 00:00 2024-09-13T02:35:42.435 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2024-09-13T02:35:43.066 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-13T02:35:43.159 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T02:35:43.566 INFO:teuthology.orchestra.run.smithi131.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-13T02:35:43.566 INFO:teuthology.orchestra.run.smithi131.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-13T02:35:43.658 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2024-09-13T02:35:43.666 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-09-13T02:35:43.666 INFO:teuthology.orchestra.run.smithi131.stdout: Package Architecture Version Repository Size 2024-09-13T02:35:43.666 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-09-13T02:35:43.666 INFO:teuthology.orchestra.run.smithi131.stdout:Installing: 2024-09-13T02:35:43.666 INFO:teuthology.orchestra.run.smithi131.stdout: kernel x86_64 5.14.0-505.el9 baseos 23 k 2024-09-13T02:35:43.667 INFO:teuthology.orchestra.run.smithi131.stdout:Installing dependencies: 2024-09-13T02:35:43.667 INFO:teuthology.orchestra.run.smithi131.stdout: kernel-core x86_64 5.14.0-505.el9 baseos 16 M 2024-09-13T02:35:43.667 INFO:teuthology.orchestra.run.smithi131.stdout: kernel-modules x86_64 5.14.0-505.el9 baseos 35 M 2024-09-13T02:35:43.667 INFO:teuthology.orchestra.run.smithi131.stdout: kernel-modules-core x86_64 5.14.0-505.el9 baseos 29 M 2024-09-13T02:35:43.667 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-13T02:35:43.667 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction Summary 2024-09-13T02:35:43.667 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-09-13T02:35:43.667 INFO:teuthology.orchestra.run.smithi131.stdout:Install 4 Packages 2024-09-13T02:35:43.667 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-13T02:35:43.667 INFO:teuthology.orchestra.run.smithi131.stdout:Total download size: 79 M 2024-09-13T02:35:43.667 INFO:teuthology.orchestra.run.smithi131.stdout:Installed size: 126 M 2024-09-13T02:35:43.668 INFO:teuthology.orchestra.run.smithi131.stdout:Downloading Packages: 2024-09-13T02:35:44.028 INFO:teuthology.orchestra.run.smithi131.stdout:(1/4): kernel-5.14.0-505.el9.x86_64.rpm 283 kB/s | 23 kB 00:00 2024-09-13T02:35:44.420 INFO:teuthology.orchestra.run.smithi131.stdout:(2/4): kernel-core-5.14.0-505.el9.x86_64.rpm 33 MB/s | 16 MB 00:00 2024-09-13T02:35:44.837 INFO:teuthology.orchestra.run.smithi131.stdout:(3/4): kernel-modules-5.14.0-505.el9.x86_64.rpm 39 MB/s | 35 MB 00:00 2024-09-13T02:35:45.370 INFO:teuthology.orchestra.run.smithi131.stdout:(4/4): kernel-modules-core-5.14.0-505.el9.x86_6 21 MB/s | 29 MB 00:01 2024-09-13T02:35:45.370 INFO:teuthology.orchestra.run.smithi131.stdout:-------------------------------------------------------------------------------- 2024-09-13T02:35:45.370 INFO:teuthology.orchestra.run.smithi131.stdout:Total 46 MB/s | 79 MB 00:01 2024-09-13T02:35:45.952 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T02:35:46.050 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction check 2024-09-13T02:35:46.088 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T02:35:46.417 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction check succeeded. 2024-09-13T02:35:46.417 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction test 2024-09-13T02:35:47.355 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction test succeeded. 2024-09-13T02:35:47.355 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction 2024-09-13T02:35:49.805 INFO:teuthology.orchestra.run.smithi131.stdout: Preparing : 1/1 2024-09-13T02:35:50.454 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : kernel-modules-core-5.14.0-505.el9.x86_64 1/4 2024-09-13T02:35:50.537 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T02:35:50.892 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T02:35:50.939 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-13T02:35:53.318 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T02:35:53.455 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T02:35:55.755 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T02:35:58.265 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T02:35:58.363 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : kernel-5.14.0-505.el9.x86_64 4/4 2024-09-13T02:36:03.213 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T02:36:33.555 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T02:36:33.594 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-13T02:36:33.922 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-13T02:36:33.922 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-13T02:36:33.923 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T02:36:33.923 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T02:36:34.735 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T02:36:34.735 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:36:34.735 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2024-09-13T02:36:34.735 INFO:teuthology.orchestra.run.smithi089.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-13T02:36:34.735 INFO:teuthology.orchestra.run.smithi089.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-13T02:36:34.735 INFO:teuthology.orchestra.run.smithi089.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-13T02:36:34.735 INFO:teuthology.orchestra.run.smithi089.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-13T02:36:34.735 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:36:34.736 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-09-13T02:36:35.108 DEBUG:teuthology.orchestra.run.smithi089:> rpm -q kernel | sort -rV | head -n 1 2024-09-13T02:36:35.251 INFO:teuthology.orchestra.run.smithi089.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-13T02:36:35.252 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-13T02:36:35.252 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-13T02:36:35.252 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-13T02:36:35.253 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-13T02:36:35.253 INFO:teuthology.task.kernel:Installing distro kernel on host.a... 2024-09-13T02:36:35.253 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi089.front.sepia.ceph.com, path=None, version=distro) 2024-09-13T02:36:35.253 DEBUG:teuthology.orchestra.run.smithi089:> rpm -q kernel | sort -rV | head -n 1 2024-09-13T02:36:35.312 INFO:teuthology.orchestra.run.smithi089.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-13T02:36:35.312 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-13T02:36:35.312 DEBUG:teuthology.orchestra.run.smithi089:> sudo rpm -qi grub2-tools 2024-09-13T02:36:35.344 INFO:teuthology.orchestra.run.smithi089.stdout:Name : grub2-tools 2024-09-13T02:36:35.345 INFO:teuthology.orchestra.run.smithi089.stdout:Epoch : 1 2024-09-13T02:36:35.345 INFO:teuthology.orchestra.run.smithi089.stdout:Version : 2.06 2024-09-13T02:36:35.345 INFO:teuthology.orchestra.run.smithi089.stdout:Release : 82.el9 2024-09-13T02:36:35.345 INFO:teuthology.orchestra.run.smithi089.stdout:Architecture: x86_64 2024-09-13T02:36:35.345 INFO:teuthology.orchestra.run.smithi089.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-13T02:36:35.345 INFO:teuthology.orchestra.run.smithi089.stdout:Group : Unspecified 2024-09-13T02:36:35.345 INFO:teuthology.orchestra.run.smithi089.stdout:Size : 8274670 2024-09-13T02:36:35.345 INFO:teuthology.orchestra.run.smithi089.stdout:License : GPLv3+ 2024-09-13T02:36:35.345 INFO:teuthology.orchestra.run.smithi089.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-13T02:36:35.345 INFO:teuthology.orchestra.run.smithi089.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-13T02:36:35.345 INFO:teuthology.orchestra.run.smithi089.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-13T02:36:35.346 INFO:teuthology.orchestra.run.smithi089.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-13T02:36:35.346 INFO:teuthology.orchestra.run.smithi089.stdout:Packager : builder@centos.org 2024-09-13T02:36:35.346 INFO:teuthology.orchestra.run.smithi089.stdout:Vendor : CentOS 2024-09-13T02:36:35.346 INFO:teuthology.orchestra.run.smithi089.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-13T02:36:35.346 INFO:teuthology.orchestra.run.smithi089.stdout:Summary : Support tools for GRUB. 2024-09-13T02:36:35.346 INFO:teuthology.orchestra.run.smithi089.stdout:Description : 2024-09-13T02:36:35.346 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:36:35.346 INFO:teuthology.orchestra.run.smithi089.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-13T02:36:35.346 INFO:teuthology.orchestra.run.smithi089.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-13T02:36:35.346 INFO:teuthology.orchestra.run.smithi089.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-13T02:36:35.346 INFO:teuthology.orchestra.run.smithi089.stdout:hardware devices. 2024-09-13T02:36:35.346 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:36:35.346 INFO:teuthology.orchestra.run.smithi089.stdout:This subpackage provides tools for support of all platforms. 2024-09-13T02:36:35.347 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-13T02:36:35.347 INFO:teuthology.task.kernel:Updating grub on smithi089 to boot 5.14.0-505.el9.x86_64 2024-09-13T02:36:35.348 DEBUG:teuthology.orchestra.run.smithi089:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-13T02:36:35.948 INFO:teuthology.orchestra.run.smithi089.stderr:Generating grub configuration file ... 2024-09-13T02:36:37.265 INFO:teuthology.orchestra.run.smithi089.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-13T02:36:37.307 INFO:teuthology.orchestra.run.smithi089.stderr:done 2024-09-13T02:36:37.309 DEBUG:teuthology.orchestra.run.smithi089:> mktemp 2024-09-13T02:36:37.324 INFO:teuthology.orchestra.run.smithi089.stdout:/tmp/tmp.KX7PChuNnH 2024-09-13T02:36:37.324 DEBUG:teuthology.orchestra.run.smithi089:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.KX7PChuNnH 2024-09-13T02:36:37.393 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 0666 /tmp/tmp.KX7PChuNnH 2024-09-13T02:36:37.533 DEBUG:teuthology.orchestra.remote:smithi089:/tmp/tmp.KX7PChuNnH is 6KB 2024-09-13T02:36:37.583 DEBUG:teuthology.orchestra.run.smithi089:> rm -fr /tmp/tmp.KX7PChuNnH 2024-09-13T02:36:37.598 DEBUG:teuthology.orchestra.run.smithi089:> sudo /bin/ls /boot/loader/entries || true 2024-09-13T02:36:37.666 INFO:teuthology.orchestra.run.smithi089.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-13T02:36:37.666 INFO:teuthology.orchestra.run.smithi089.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-13T02:36:37.666 INFO:teuthology.orchestra.run.smithi089.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-13T02:36:37.666 INFO:teuthology.orchestra.run.smithi089.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-13T02:36:37.668 DEBUG:teuthology.orchestra.run.smithi089:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-13T02:36:37.814 DEBUG:teuthology.orchestra.run.smithi089:> sudo shutdown -r now 2024-09-13T02:36:41.598 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: kernel-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T02:36:41.637 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: kernel-modules-5.14.0-505.el9.x86_64 4/4 2024-09-13T02:36:41.998 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: kernel-5.14.0-505.el9.x86_64 4/4 2024-09-13T02:36:41.998 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : kernel-5.14.0-505.el9.x86_64 1/4 2024-09-13T02:36:41.998 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : kernel-core-5.14.0-505.el9.x86_64 2/4 2024-09-13T02:36:41.998 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : kernel-modules-5.14.0-505.el9.x86_64 3/4 2024-09-13T02:36:42.841 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : kernel-modules-core-5.14.0-505.el9.x86_64 4/4 2024-09-13T02:36:42.841 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-13T02:36:42.841 INFO:teuthology.orchestra.run.smithi131.stdout:Installed: 2024-09-13T02:36:42.841 INFO:teuthology.orchestra.run.smithi131.stdout: kernel-5.14.0-505.el9.x86_64 2024-09-13T02:36:42.842 INFO:teuthology.orchestra.run.smithi131.stdout: kernel-core-5.14.0-505.el9.x86_64 2024-09-13T02:36:42.842 INFO:teuthology.orchestra.run.smithi131.stdout: kernel-modules-5.14.0-505.el9.x86_64 2024-09-13T02:36:42.842 INFO:teuthology.orchestra.run.smithi131.stdout: kernel-modules-core-5.14.0-505.el9.x86_64 2024-09-13T02:36:42.842 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-13T02:36:42.842 INFO:teuthology.orchestra.run.smithi131.stdout:Complete! 2024-09-13T02:36:43.200 DEBUG:teuthology.orchestra.run.smithi131:> rpm -q kernel | sort -rV | head -n 1 2024-09-13T02:36:43.290 INFO:teuthology.orchestra.run.smithi131.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-13T02:36:43.290 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-13T02:36:43.290 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-505.el9.x86_64 2024-09-13T02:36:43.291 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-13T02:36:43.291 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-13T02:36:43.291 INFO:teuthology.task.kernel:Installing distro kernel on host.b... 2024-09-13T02:36:43.291 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi131.front.sepia.ceph.com, path=None, version=distro) 2024-09-13T02:36:43.291 DEBUG:teuthology.orchestra.run.smithi131:> rpm -q kernel | sort -rV | head -n 1 2024-09-13T02:36:43.351 INFO:teuthology.orchestra.run.smithi131.stdout:kernel-5.14.0-505.el9.x86_64 2024-09-13T02:36:43.351 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-505.el9.x86_64 2024-09-13T02:36:43.351 DEBUG:teuthology.orchestra.run.smithi131:> sudo rpm -qi grub2-tools 2024-09-13T02:36:43.389 INFO:teuthology.orchestra.run.smithi131.stdout:Name : grub2-tools 2024-09-13T02:36:43.390 INFO:teuthology.orchestra.run.smithi131.stdout:Epoch : 1 2024-09-13T02:36:43.390 INFO:teuthology.orchestra.run.smithi131.stdout:Version : 2.06 2024-09-13T02:36:43.390 INFO:teuthology.orchestra.run.smithi131.stdout:Release : 82.el9 2024-09-13T02:36:43.390 INFO:teuthology.orchestra.run.smithi131.stdout:Architecture: x86_64 2024-09-13T02:36:43.390 INFO:teuthology.orchestra.run.smithi131.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-13T02:36:43.390 INFO:teuthology.orchestra.run.smithi131.stdout:Group : Unspecified 2024-09-13T02:36:43.390 INFO:teuthology.orchestra.run.smithi131.stdout:Size : 8274670 2024-09-13T02:36:43.390 INFO:teuthology.orchestra.run.smithi131.stdout:License : GPLv3+ 2024-09-13T02:36:43.391 INFO:teuthology.orchestra.run.smithi131.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-13T02:36:43.391 INFO:teuthology.orchestra.run.smithi131.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-13T02:36:43.391 INFO:teuthology.orchestra.run.smithi131.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-13T02:36:43.391 INFO:teuthology.orchestra.run.smithi131.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-13T02:36:43.391 INFO:teuthology.orchestra.run.smithi131.stdout:Packager : builder@centos.org 2024-09-13T02:36:43.391 INFO:teuthology.orchestra.run.smithi131.stdout:Vendor : CentOS 2024-09-13T02:36:43.391 INFO:teuthology.orchestra.run.smithi131.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-13T02:36:43.391 INFO:teuthology.orchestra.run.smithi131.stdout:Summary : Support tools for GRUB. 2024-09-13T02:36:43.391 INFO:teuthology.orchestra.run.smithi131.stdout:Description : 2024-09-13T02:36:43.391 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-13T02:36:43.391 INFO:teuthology.orchestra.run.smithi131.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-13T02:36:43.391 INFO:teuthology.orchestra.run.smithi131.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-13T02:36:43.391 INFO:teuthology.orchestra.run.smithi131.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-13T02:36:43.391 INFO:teuthology.orchestra.run.smithi131.stdout:hardware devices. 2024-09-13T02:36:43.392 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-13T02:36:43.392 INFO:teuthology.orchestra.run.smithi131.stdout:This subpackage provides tools for support of all platforms. 2024-09-13T02:36:43.392 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-13T02:36:43.393 INFO:teuthology.task.kernel:Updating grub on smithi131 to boot 5.14.0-505.el9.x86_64 2024-09-13T02:36:43.393 DEBUG:teuthology.orchestra.run.smithi131:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-13T02:36:44.066 INFO:teuthology.orchestra.run.smithi131.stderr:Generating grub configuration file ... 2024-09-13T02:36:45.420 INFO:teuthology.orchestra.run.smithi131.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-13T02:36:45.445 INFO:teuthology.orchestra.run.smithi131.stderr:done 2024-09-13T02:36:45.447 DEBUG:teuthology.orchestra.run.smithi131:> mktemp 2024-09-13T02:36:45.463 INFO:teuthology.orchestra.run.smithi131.stdout:/tmp/tmp.HJgiyJaI2b 2024-09-13T02:36:45.463 DEBUG:teuthology.orchestra.run.smithi131:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.HJgiyJaI2b 2024-09-13T02:36:45.530 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 0666 /tmp/tmp.HJgiyJaI2b 2024-09-13T02:36:45.675 DEBUG:teuthology.orchestra.remote:smithi131:/tmp/tmp.HJgiyJaI2b is 6KB 2024-09-13T02:36:45.723 DEBUG:teuthology.orchestra.run.smithi131:> rm -fr /tmp/tmp.HJgiyJaI2b 2024-09-13T02:36:45.738 DEBUG:teuthology.orchestra.run.smithi131:> sudo /bin/ls /boot/loader/entries || true 2024-09-13T02:36:45.801 INFO:teuthology.orchestra.run.smithi131.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-13T02:36:45.801 INFO:teuthology.orchestra.run.smithi131.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-13T02:36:45.801 INFO:teuthology.orchestra.run.smithi131.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-13T02:36:45.802 INFO:teuthology.orchestra.run.smithi131.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64.conf 2024-09-13T02:36:45.803 DEBUG:teuthology.orchestra.run.smithi131:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-505.el9.x86_64 2024-09-13T02:36:45.962 DEBUG:teuthology.orchestra.run.smithi131:> sudo shutdown -r now 2024-09-13T02:37:07.837 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2024-09-13T02:37:07.837 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2024-09-13T02:37:07.838 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T02:37:15.973 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2024-09-13T02:37:15.973 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi131.front.sepia.ceph.com' 2024-09-13T02:37:15.974 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T02:38:07.893 DEBUG:teuthology.orchestra.remote:timed out 2024-09-13T02:38:15.981 DEBUG:teuthology.orchestra.remote:timed out 2024-09-13T02:38:16.896 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2024-09-13T02:38:16.897 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T02:38:17.162 DEBUG:teuthology.orchestra.run.smithi089:> true 2024-09-13T02:38:17.605 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi089.front.sepia.ceph.com' 2024-09-13T02:38:17.605 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "5.14.0-505.el9.x86_64"... 2024-09-13T02:38:17.605 DEBUG:teuthology.orchestra.run.smithi089:> uname -r 2024-09-13T02:38:17.623 INFO:teuthology.orchestra.run.smithi089.stdout:5.14.0-505.el9.x86_64 2024-09-13T02:38:17.624 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-13T02:38:17.624 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-13T02:38:17.624 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-13T02:38:18.625 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2024-09-13T02:38:18.625 DEBUG:teuthology.orchestra.run.smithi089:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-13T02:38:18.697 INFO:teuthology.orchestra.run.smithi089.stdout:ttyS1 2024-09-13T02:38:18.716 DEBUG:teuthology.parallel:result is None 2024-09-13T02:38:24.983 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi131.front.sepia.ceph.com' 2024-09-13T02:38:24.984 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T02:38:25.420 DEBUG:teuthology.orchestra.run.smithi131:> true 2024-09-13T02:38:25.934 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi131.front.sepia.ceph.com' 2024-09-13T02:38:25.934 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "5.14.0-505.el9.x86_64"... 2024-09-13T02:38:25.934 DEBUG:teuthology.orchestra.run.smithi131:> uname -r 2024-09-13T02:38:25.970 INFO:teuthology.orchestra.run.smithi131.stdout:5.14.0-505.el9.x86_64 2024-09-13T02:38:25.970 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-505.el9.x86_64 vs 5.14.0-505.el9.x86_64 2024-09-13T02:38:25.970 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-13T02:38:25.971 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-13T02:38:26.971 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2024-09-13T02:38:26.971 DEBUG:teuthology.orchestra.run.smithi131:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-13T02:38:27.023 INFO:teuthology.orchestra.run.smithi131.stdout:ttyS1 2024-09-13T02:38:27.148 DEBUG:teuthology.parallel:result is None 2024-09-13T02:38:27.148 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-13T02:38:27.157 INFO:teuthology.task.internal:Creating test directory... 2024-09-13T02:38:27.158 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-13T02:38:27.161 DEBUG:teuthology.orchestra.run.smithi131:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-13T02:38:27.176 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-13T02:38:27.194 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-13T02:38:27.240 INFO:teuthology.task.internal:Creating archive directory... 2024-09-13T02:38:27.240 DEBUG:teuthology.orchestra.run.smithi089:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-13T02:38:27.243 DEBUG:teuthology.orchestra.run.smithi131:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-13T02:38:27.287 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-13T02:38:27.293 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-13T02:38:27.294 DEBUG:teuthology.orchestra.run.smithi089:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-13T02:38:27.319 DEBUG:teuthology.orchestra.run.smithi131:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-13T02:38:27.343 INFO:teuthology.orchestra.run.smithi089.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T02:38:27.353 INFO:teuthology.orchestra.run.smithi089.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T02:38:27.357 INFO:teuthology.orchestra.run.smithi131.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T02:38:27.367 INFO:teuthology.orchestra.run.smithi131.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-13T02:38:27.368 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-13T02:38:27.375 INFO:teuthology.task.internal:Configuring sudo... 2024-09-13T02:38:27.375 DEBUG:teuthology.orchestra.run.smithi089:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-13T02:38:27.397 DEBUG:teuthology.orchestra.run.smithi131:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-13T02:38:27.433 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-13T02:38:27.442 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-13T02:38:27.442 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-13T02:38:27.463 DEBUG:teuthology.orchestra.run.smithi131:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-13T02:38:27.485 DEBUG:teuthology.orchestra.run.smithi089:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T02:38:27.561 DEBUG:teuthology.orchestra.run.smithi089:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T02:38:27.613 DEBUG:teuthology.orchestra.run.smithi089:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T02:38:27.699 DEBUG:teuthology.orchestra.run.smithi089:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T02:38:27.735 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-13T02:38:27.736 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-13T02:38:27.800 DEBUG:teuthology.orchestra.run.smithi131:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T02:38:27.843 DEBUG:teuthology.orchestra.run.smithi131:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-13T02:38:27.891 DEBUG:teuthology.orchestra.run.smithi131:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T02:38:27.971 DEBUG:teuthology.orchestra.run.smithi131:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-13T02:38:28.010 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-13T02:38:28.010 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-13T02:38:28.073 DEBUG:teuthology.orchestra.run.smithi089:> sudo service rsyslog restart 2024-09-13T02:38:28.075 DEBUG:teuthology.orchestra.run.smithi131:> sudo service rsyslog restart 2024-09-13T02:38:28.118 INFO:teuthology.orchestra.run.smithi089.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T02:38:28.163 INFO:teuthology.orchestra.run.smithi131.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T02:38:28.664 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-13T02:38:28.673 INFO:teuthology.task.internal:Starting timer... 2024-09-13T02:38:28.673 INFO:teuthology.run_tasks:Running task pcp... 2024-09-13T02:38:28.719 INFO:teuthology.run_tasks:Running task selinux... 2024-09-13T02:38:28.769 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-09-13T02:38:28.769 DEBUG:teuthology.orchestra.run.smithi089:> sudo service auditd rotate 2024-09-13T02:38:28.818 INFO:teuthology.orchestra.run.smithi089.stdout:Rotating logs: 2024-09-13T02:38:28.820 DEBUG:teuthology.orchestra.run.smithi131:> sudo service auditd rotate 2024-09-13T02:38:28.883 INFO:teuthology.orchestra.run.smithi131.stdout:Rotating logs: 2024-09-13T02:38:28.885 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-13T02:38:28.885 DEBUG:teuthology.orchestra.run.smithi089:> /usr/sbin/getenforce 2024-09-13T02:38:28.915 INFO:teuthology.orchestra.run.smithi089.stdout:Permissive 2024-09-13T02:38:28.915 DEBUG:teuthology.orchestra.run.smithi131:> /usr/sbin/getenforce 2024-09-13T02:38:28.965 INFO:teuthology.orchestra.run.smithi131.stdout:Permissive 2024-09-13T02:38:28.965 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi089.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi131.front.sepia.ceph.com': 'permissive'} 2024-09-13T02:38:28.966 DEBUG:teuthology.orchestra.run.smithi089:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-13T02:38:28.992 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T02:38:28.992 DEBUG:teuthology.orchestra.run.smithi131:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-13T02:38:29.018 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T02:38:29.018 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-13T02:38:29.018 DEBUG:teuthology.orchestra.run.smithi089:> sudo /usr/sbin/setenforce permissive 2024-09-13T02:38:29.062 DEBUG:teuthology.orchestra.run.smithi131:> sudo /usr/sbin/setenforce permissive 2024-09-13T02:38:29.091 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-13T02:38:29.102 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-13T02:38:29.118 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-13T02:38:29.120 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi089.front.sepia.ceph.com,smithi131.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-13T02:42:13.208 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi089.front.sepia.ceph.com'), Remote(name='ubuntu@smithi131.front.sepia.ceph.com')] 2024-09-13T02:42:13.209 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi089.front.sepia.ceph.com' 2024-09-13T02:42:13.210 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi089.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T02:42:13.285 DEBUG:teuthology.orchestra.run.smithi089:> true 2024-09-13T02:42:13.368 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi089.front.sepia.ceph.com' 2024-09-13T02:42:13.368 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi131.front.sepia.ceph.com' 2024-09-13T02:42:13.369 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi131.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-13T02:42:13.443 DEBUG:teuthology.orchestra.run.smithi131:> true 2024-09-13T02:42:13.479 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi131.front.sepia.ceph.com' 2024-09-13T02:42:13.480 INFO:teuthology.run_tasks:Running task clock... 2024-09-13T02:42:13.493 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-13T02:42:13.493 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-13T02:42:13.494 DEBUG:teuthology.orchestra.run.smithi089:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T02:42:13.496 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-13T02:42:13.496 DEBUG:teuthology.orchestra.run.smithi131:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T02:42:13.523 INFO:teuthology.orchestra.run.smithi089.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-13T02:42:13.540 INFO:teuthology.orchestra.run.smithi089.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-13T02:42:13.549 INFO:teuthology.orchestra.run.smithi131.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-13T02:42:13.561 INFO:teuthology.orchestra.run.smithi089.stderr:sudo: ntpd: command not found 2024-09-13T02:42:13.564 INFO:teuthology.orchestra.run.smithi131.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-13T02:42:13.573 INFO:teuthology.orchestra.run.smithi089.stdout:506 Cannot talk to daemon 2024-09-13T02:42:13.587 INFO:teuthology.orchestra.run.smithi089.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-13T02:42:13.587 INFO:teuthology.orchestra.run.smithi131.stderr:sudo: ntpd: command not found 2024-09-13T02:42:13.598 INFO:teuthology.orchestra.run.smithi131.stdout:506 Cannot talk to daemon 2024-09-13T02:42:13.601 INFO:teuthology.orchestra.run.smithi089.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-13T02:42:13.612 INFO:teuthology.orchestra.run.smithi131.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-13T02:42:13.627 INFO:teuthology.orchestra.run.smithi131.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-13T02:42:13.659 INFO:teuthology.orchestra.run.smithi089.stderr:bash: line 1: ntpq: command not found 2024-09-13T02:42:13.663 INFO:teuthology.orchestra.run.smithi089.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T02:42:13.663 INFO:teuthology.orchestra.run.smithi089.stdout:=============================================================================== 2024-09-13T02:42:13.663 INFO:teuthology.orchestra.run.smithi089.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T02:42:13.663 INFO:teuthology.orchestra.run.smithi089.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T02:42:13.663 INFO:teuthology.orchestra.run.smithi089.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T02:42:13.663 INFO:teuthology.orchestra.run.smithi089.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T02:42:13.695 INFO:teuthology.orchestra.run.smithi131.stderr:bash: line 1: ntpq: command not found 2024-09-13T02:42:13.699 INFO:teuthology.orchestra.run.smithi131.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T02:42:13.699 INFO:teuthology.orchestra.run.smithi131.stdout:=============================================================================== 2024-09-13T02:42:13.699 INFO:teuthology.orchestra.run.smithi131.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T02:42:13.699 INFO:teuthology.orchestra.run.smithi131.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T02:42:13.699 INFO:teuthology.orchestra.run.smithi131.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T02:42:13.699 INFO:teuthology.orchestra.run.smithi131.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T02:42:13.700 INFO:teuthology.run_tasks:Running task install... 2024-09-13T02:42:13.710 DEBUG:teuthology.task.install:project ceph 2024-09-13T02:42:13.710 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '7741f7f9ee20524f89b8f61d1609b32fb3b1570a'}} 2024-09-13T02:42:13.711 DEBUG:teuthology.task.install:config {'branch': 'quincy', 'exclude_packages': ['ceph-volume'], 'flavor': 'default', 'sha1': '7741f7f9ee20524f89b8f61d1609b32fb3b1570a'} 2024-09-13T02:42:13.711 INFO:teuthology.task.install:Using flavor: default 2024-09-13T02:42:13.716 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-13T02:42:13.716 INFO:teuthology.task.install:extra packages: [] 2024-09-13T02:42:13.717 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'quincy', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '7741f7f9ee20524f89b8f61d1609b32fb3b1570a', 'tag': None, 'wait_for_package': False} 2024-09-13T02:42:13.717 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-13T02:42:13.717 INFO:teuthology.packaging:ref: None 2024-09-13T02:42:13.717 INFO:teuthology.packaging:tag: None 2024-09-13T02:42:13.717 INFO:teuthology.packaging:branch: quincy 2024-09-13T02:42:13.717 INFO:teuthology.packaging:sha1: 7741f7f9ee20524f89b8f61d1609b32fb3b1570a 2024-09-13T02:42:13.718 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-09-13T02:42:13.719 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'quincy', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '7741f7f9ee20524f89b8f61d1609b32fb3b1570a', 'tag': None, 'wait_for_package': False} 2024-09-13T02:42:13.720 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-13T02:42:13.720 INFO:teuthology.packaging:ref: None 2024-09-13T02:42:13.720 INFO:teuthology.packaging:tag: None 2024-09-13T02:42:13.720 INFO:teuthology.packaging:branch: quincy 2024-09-13T02:42:13.720 INFO:teuthology.packaging:sha1: 7741f7f9ee20524f89b8f61d1609b32fb3b1570a 2024-09-13T02:42:13.720 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-09-13T02:42:13.920 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/quincy/bbdadfa31f8fb9afaa389358d138cac49bd69e56/centos/9/flavors/default/ 2024-09-13T02:42:13.920 INFO:teuthology.task.install.rpm:Package version is 17.2.7-1627.gbbdadfa3 2024-09-13T02:42:13.956 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/quincy/bbdadfa31f8fb9afaa389358d138cac49bd69e56/centos/9/flavors/default/ 2024-09-13T02:42:13.957 INFO:teuthology.task.install.rpm:Package version is 17.2.7-1627.gbbdadfa3 2024-09-13T02:42:14.034 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/quincy/bbdadfa31f8fb9afaa389358d138cac49bd69e56/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/quincy/bbdadfa31f8fb9afaa389358d138cac49bd69e56/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/quincy/bbdadfa31f8fb9afaa389358d138cac49bd69e56/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-13T02:42:14.034 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-13T02:42:14.034 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-13T02:42:14.060 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-13T02:42:14.060 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-13T02:42:14.060 INFO:teuthology.packaging:ref: None 2024-09-13T02:42:14.060 INFO:teuthology.packaging:tag: None 2024-09-13T02:42:14.060 INFO:teuthology.packaging:branch: quincy 2024-09-13T02:42:14.060 INFO:teuthology.packaging:sha1: 7741f7f9ee20524f89b8f61d1609b32fb3b1570a 2024-09-13T02:42:14.060 DEBUG:teuthology.orchestra.run.smithi089:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/quincy/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-13T02:42:14.064 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/quincy/bbdadfa31f8fb9afaa389358d138cac49bd69e56/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/quincy/bbdadfa31f8fb9afaa389358d138cac49bd69e56/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/quincy/bbdadfa31f8fb9afaa389358d138cac49bd69e56/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-13T02:42:14.064 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-13T02:42:14.064 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-13T02:42:14.091 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-13T02:42:14.091 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-13T02:42:14.091 INFO:teuthology.packaging:ref: None 2024-09-13T02:42:14.091 INFO:teuthology.packaging:tag: None 2024-09-13T02:42:14.091 INFO:teuthology.packaging:branch: quincy 2024-09-13T02:42:14.091 INFO:teuthology.packaging:sha1: 7741f7f9ee20524f89b8f61d1609b32fb3b1570a 2024-09-13T02:42:14.091 DEBUG:teuthology.orchestra.run.smithi131:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/quincy/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-13T02:42:14.126 DEBUG:teuthology.orchestra.run.smithi089:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-13T02:42:14.157 DEBUG:teuthology.orchestra.run.smithi131:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-13T02:42:14.201 DEBUG:teuthology.orchestra.run.smithi089:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-13T02:42:14.234 DEBUG:teuthology.orchestra.run.smithi131:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-13T02:42:14.265 INFO:teuthology.orchestra.run.smithi089.stdout:check_obsoletes = 1 2024-09-13T02:42:14.267 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum clean all 2024-09-13T02:42:14.298 INFO:teuthology.orchestra.run.smithi131.stdout:check_obsoletes = 1 2024-09-13T02:42:14.300 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum clean all 2024-09-13T02:42:14.500 INFO:teuthology.orchestra.run.smithi089.stdout:45 files removed 2024-09-13T02:42:14.522 INFO:teuthology.orchestra.run.smithi131.stdout:45 files removed 2024-09-13T02:42:14.526 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install ceph-radosgw 2024-09-13T02:42:14.549 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum -y install ceph-radosgw 2024-09-13T02:42:15.067 INFO:teuthology.orchestra.run.smithi089.stdout:ceph packages for x86_64 297 kB/s | 77 kB 00:00 2024-09-13T02:42:15.103 INFO:teuthology.orchestra.run.smithi131.stdout:ceph packages for x86_64 289 kB/s | 77 kB 00:00 2024-09-13T02:42:15.342 INFO:teuthology.orchestra.run.smithi089.stdout:ceph noarch packages 46 kB/s | 11 kB 00:00 2024-09-13T02:42:15.387 INFO:teuthology.orchestra.run.smithi131.stdout:ceph noarch packages 45 kB/s | 11 kB 00:00 2024-09-13T02:42:15.601 INFO:teuthology.orchestra.run.smithi089.stdout:ceph source packages 8.0 kB/s | 1.8 kB 00:00 2024-09-13T02:42:15.663 INFO:teuthology.orchestra.run.smithi131.stdout:ceph source packages 7.5 kB/s | 1.8 kB 00:00 2024-09-13T02:42:17.480 INFO:teuthology.orchestra.run.smithi131.stdout:CentOS Stream 9 - BaseOS 4.6 MB/s | 8.2 MB 00:01 2024-09-13T02:42:17.552 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 9 - BaseOS 4.3 MB/s | 8.2 MB 00:01 2024-09-13T02:42:19.206 INFO:teuthology.orchestra.run.smithi131.stdout:CentOS Stream 9 - AppStream 33 MB/s | 20 MB 00:00 2024-09-13T02:42:19.378 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 9 - AppStream 29 MB/s | 20 MB 00:00 2024-09-13T02:42:23.482 INFO:teuthology.orchestra.run.smithi131.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.5 MB 00:00 2024-09-13T02:42:24.004 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 9 - CRB 9.6 MB/s | 6.5 MB 00:00 2024-09-13T02:42:25.266 INFO:teuthology.orchestra.run.smithi131.stdout:CentOS Stream 9 - Extras packages 43 kB/s | 19 kB 00:00 2024-09-13T02:42:25.555 INFO:teuthology.orchestra.run.smithi089.stdout:CentOS Stream 9 - Extras packages 133 kB/s | 19 kB 00:00 2024-09-13T02:42:26.929 INFO:teuthology.orchestra.run.smithi131.stdout:Extra Packages for Enterprise Linux 15 MB/s | 23 MB 00:01 2024-09-13T02:42:27.084 INFO:teuthology.orchestra.run.smithi089.stdout:Extra Packages for Enterprise Linux 16 MB/s | 23 MB 00:01 2024-09-13T02:42:33.118 INFO:teuthology.orchestra.run.smithi131.stdout:lab-extras 2.2 kB/s | 1.7 kB 00:00 2024-09-13T02:42:33.173 INFO:teuthology.orchestra.run.smithi089.stdout:lab-extras 4.2 kB/s | 1.7 kB 00:00 2024-09-13T02:42:35.476 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2024-09-13T02:42:35.484 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-09-13T02:42:35.484 INFO:teuthology.orchestra.run.smithi131.stdout: Package Arch Version Repository Size 2024-09-13T02:42:35.484 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-09-13T02:42:35.484 INFO:teuthology.orchestra.run.smithi131.stdout:Installing: 2024-09-13T02:42:35.484 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-radosgw x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 14 M 2024-09-13T02:42:35.484 INFO:teuthology.orchestra.run.smithi131.stdout:Upgrading: 2024-09-13T02:42:35.484 INFO:teuthology.orchestra.run.smithi131.stdout: librados2 x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 3.1 M 2024-09-13T02:42:35.485 INFO:teuthology.orchestra.run.smithi131.stdout: librbd1 x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 2.9 M 2024-09-13T02:42:35.485 INFO:teuthology.orchestra.run.smithi131.stdout:Installing dependencies: 2024-09-13T02:42:35.485 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-base x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 5.0 M 2024-09-13T02:42:35.485 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-common x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 22 M 2024-09-13T02:42:35.485 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-selinux x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 25 k 2024-09-13T02:42:35.485 INFO:teuthology.orchestra.run.smithi131.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-13T02:42:35.485 INFO:teuthology.orchestra.run.smithi131.stdout: libcephfs2 x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 637 k 2024-09-13T02:42:35.485 INFO:teuthology.orchestra.run.smithi131.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-13T02:42:35.485 INFO:teuthology.orchestra.run.smithi131.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-13T02:42:35.485 INFO:teuthology.orchestra.run.smithi131.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-13T02:42:35.485 INFO:teuthology.orchestra.run.smithi131.stdout: libradosstriper1 x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 457 k 2024-09-13T02:42:35.485 INFO:teuthology.orchestra.run.smithi131.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-13T02:42:35.486 INFO:teuthology.orchestra.run.smithi131.stdout: librgw2 x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 4.9 M 2024-09-13T02:42:35.486 INFO:teuthology.orchestra.run.smithi131.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-13T02:42:35.486 INFO:teuthology.orchestra.run.smithi131.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-13T02:42:35.486 INFO:teuthology.orchestra.run.smithi131.stdout: python3-ceph-argparse x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 45 k 2024-09-13T02:42:35.486 INFO:teuthology.orchestra.run.smithi131.stdout: python3-ceph-common x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 120 k 2024-09-13T02:42:35.486 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cephfs x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 156 k 2024-09-13T02:42:35.486 INFO:teuthology.orchestra.run.smithi131.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-13T02:42:35.486 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rados x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 320 k 2024-09-13T02:42:35.486 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rbd x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 294 k 2024-09-13T02:42:35.486 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rgw x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 99 k 2024-09-13T02:42:35.486 INFO:teuthology.orchestra.run.smithi131.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-13T02:42:35.486 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-13T02:42:35.486 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction Summary 2024-09-13T02:42:35.487 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-09-13T02:42:35.487 INFO:teuthology.orchestra.run.smithi131.stdout:Install 22 Packages 2024-09-13T02:42:35.487 INFO:teuthology.orchestra.run.smithi131.stdout:Upgrade 2 Packages 2024-09-13T02:42:35.487 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-13T02:42:35.487 INFO:teuthology.orchestra.run.smithi131.stdout:Total download size: 58 M 2024-09-13T02:42:35.488 INFO:teuthology.orchestra.run.smithi131.stdout:Downloading Packages: 2024-09-13T02:42:35.523 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-09-13T02:42:35.536 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-13T02:42:35.536 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repository Size 2024-09-13T02:42:35.536 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-13T02:42:35.536 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2024-09-13T02:42:35.536 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-radosgw x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 14 M 2024-09-13T02:42:35.536 INFO:teuthology.orchestra.run.smithi089.stdout:Upgrading: 2024-09-13T02:42:35.536 INFO:teuthology.orchestra.run.smithi089.stdout: librados2 x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 3.1 M 2024-09-13T02:42:35.536 INFO:teuthology.orchestra.run.smithi089.stdout: librbd1 x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 2.9 M 2024-09-13T02:42:35.536 INFO:teuthology.orchestra.run.smithi089.stdout:Installing dependencies: 2024-09-13T02:42:35.536 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-base x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 5.0 M 2024-09-13T02:42:35.537 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-common x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 22 M 2024-09-13T02:42:35.537 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-selinux x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 25 k 2024-09-13T02:42:35.537 INFO:teuthology.orchestra.run.smithi089.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-13T02:42:35.537 INFO:teuthology.orchestra.run.smithi089.stdout: libcephfs2 x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 637 k 2024-09-13T02:42:35.537 INFO:teuthology.orchestra.run.smithi089.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-13T02:42:35.537 INFO:teuthology.orchestra.run.smithi089.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-13T02:42:35.537 INFO:teuthology.orchestra.run.smithi089.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-13T02:42:35.537 INFO:teuthology.orchestra.run.smithi089.stdout: libradosstriper1 x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 457 k 2024-09-13T02:42:35.537 INFO:teuthology.orchestra.run.smithi089.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-13T02:42:35.537 INFO:teuthology.orchestra.run.smithi089.stdout: librgw2 x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 4.9 M 2024-09-13T02:42:35.537 INFO:teuthology.orchestra.run.smithi089.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-13T02:42:35.537 INFO:teuthology.orchestra.run.smithi089.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-13T02:42:35.537 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ceph-argparse x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 45 k 2024-09-13T02:42:35.538 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ceph-common x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 120 k 2024-09-13T02:42:35.538 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cephfs x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 156 k 2024-09-13T02:42:35.538 INFO:teuthology.orchestra.run.smithi089.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-13T02:42:35.538 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rados x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 320 k 2024-09-13T02:42:35.538 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rbd x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 294 k 2024-09-13T02:42:35.538 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rgw x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 99 k 2024-09-13T02:42:35.538 INFO:teuthology.orchestra.run.smithi089.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-13T02:42:35.538 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:42:35.538 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2024-09-13T02:42:35.538 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-13T02:42:35.538 INFO:teuthology.orchestra.run.smithi089.stdout:Install 22 Packages 2024-09-13T02:42:35.538 INFO:teuthology.orchestra.run.smithi089.stdout:Upgrade 2 Packages 2024-09-13T02:42:35.538 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:42:35.539 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 58 M 2024-09-13T02:42:35.539 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2024-09-13T02:42:36.058 INFO:teuthology.orchestra.run.smithi089.stdout:(1/24): ceph-base-17.2.7-1627.gbbdadfa3.el9.x86 12 MB/s | 5.0 MB 00:00 2024-09-13T02:42:36.188 INFO:teuthology.orchestra.run.smithi089.stdout:(2/24): ceph-selinux-17.2.7-1627.gbbdadfa3.el9. 194 kB/s | 25 kB 00:00 2024-09-13T02:42:36.284 INFO:teuthology.orchestra.run.smithi089.stdout:(3/24): libcephfs2-17.2.7-1627.gbbdadfa3.el9.x8 6.6 MB/s | 637 kB 00:00 2024-09-13T02:42:36.392 INFO:teuthology.orchestra.run.smithi089.stdout:(4/24): libradosstriper1-17.2.7-1627.gbbdadfa3. 4.1 MB/s | 457 kB 00:00 2024-09-13T02:42:36.693 INFO:teuthology.orchestra.run.smithi089.stdout:(5/24): ceph-radosgw-17.2.7-1627.gbbdadfa3.el9. 14 MB/s | 14 MB 00:01 2024-09-13T02:42:36.735 INFO:teuthology.orchestra.run.smithi089.stdout:(6/24): python3-ceph-argparse-17.2.7-1627.gbbda 1.1 MB/s | 45 kB 00:00 2024-09-13T02:42:36.801 INFO:teuthology.orchestra.run.smithi089.stdout:(7/24): librgw2-17.2.7-1627.gbbdadfa3.el9.x86_6 12 MB/s | 4.9 MB 00:00 2024-09-13T02:42:36.827 INFO:teuthology.orchestra.run.smithi089.stdout:(8/24): python3-ceph-common-17.2.7-1627.gbbdadf 1.3 MB/s | 120 kB 00:00 2024-09-13T02:42:36.852 INFO:teuthology.orchestra.run.smithi089.stdout:(9/24): python3-cephfs-17.2.7-1627.gbbdadfa3.el 3.0 MB/s | 156 kB 00:00 2024-09-13T02:42:36.877 INFO:teuthology.orchestra.run.smithi089.stdout:(10/24): python3-rados-17.2.7-1627.gbbdadfa3.el 6.2 MB/s | 320 kB 00:00 2024-09-13T02:42:36.911 INFO:teuthology.orchestra.run.smithi089.stdout:(11/24): python3-rbd-17.2.7-1627.gbbdadfa3.el9. 4.9 MB/s | 294 kB 00:00 2024-09-13T02:42:36.936 INFO:teuthology.orchestra.run.smithi089.stdout:(12/24): python3-rgw-17.2.7-1627.gbbdadfa3.el9. 1.7 MB/s | 99 kB 00:00 2024-09-13T02:42:37.052 INFO:teuthology.orchestra.run.smithi131.stdout:(1/24): ceph-base-17.2.7-1627.gbbdadfa3.el9.x86 4.1 MB/s | 5.0 MB 00:01 2024-09-13T02:42:37.102 INFO:teuthology.orchestra.run.smithi131.stdout:(2/24): ceph-selinux-17.2.7-1627.gbbdadfa3.el9. 506 kB/s | 25 kB 00:00 2024-09-13T02:42:37.153 INFO:teuthology.orchestra.run.smithi089.stdout:(13/24): ceph-common-17.2.7-1627.gbbdadfa3.el9. 15 MB/s | 22 MB 00:01 2024-09-13T02:42:37.186 INFO:teuthology.orchestra.run.smithi131.stdout:(3/24): libcephfs2-17.2.7-1627.gbbdadfa3.el9.x8 7.5 MB/s | 637 kB 00:00 2024-09-13T02:42:37.245 INFO:teuthology.orchestra.run.smithi089.stdout:(14/24): librabbitmq-0.11.0-7.el9.x86_64.rpm 147 kB/s | 45 kB 00:00 2024-09-13T02:42:37.253 INFO:teuthology.orchestra.run.smithi131.stdout:(4/24): libradosstriper1-17.2.7-1627.gbbdadfa3. 6.7 MB/s | 457 kB 00:00 2024-09-13T02:42:37.271 INFO:teuthology.orchestra.run.smithi089.stdout:(15/24): libpmemobj-1.12.1-1.el9.x86_64.rpm 445 kB/s | 160 kB 00:00 2024-09-13T02:42:37.329 INFO:teuthology.orchestra.run.smithi089.stdout:(16/24): python3-prettytable-0.7.2-27.el9.noarc 727 kB/s | 42 kB 00:00 2024-09-13T02:42:37.371 INFO:teuthology.orchestra.run.smithi089.stdout:(17/24): librdkafka-1.6.1-102.el9.x86_64.rpm 3.0 MB/s | 662 kB 00:00 2024-09-13T02:42:37.405 INFO:teuthology.orchestra.run.smithi089.stdout:(18/24): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.8 MB/s | 292 kB 00:00 2024-09-13T02:42:37.439 INFO:teuthology.orchestra.run.smithi089.stdout:(19/24): liboath-2.6.7-2.el9.x86_64.rpm 745 kB/s | 49 kB 00:00 2024-09-13T02:42:37.464 INFO:teuthology.orchestra.run.smithi089.stdout:(20/24): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.2 MB/s | 308 kB 00:00 2024-09-13T02:42:37.489 INFO:teuthology.orchestra.run.smithi089.stdout:(21/24): libunwind-1.6.2-1.el9.x86_64.rpm 821 kB/s | 67 kB 00:00 2024-09-13T02:42:37.545 INFO:teuthology.orchestra.run.smithi131.stdout:(5/24): librgw2-17.2.7-1627.gbbdadfa3.el9.x86_6 17 MB/s | 4.9 MB 00:00 2024-09-13T02:42:37.581 INFO:teuthology.orchestra.run.smithi089.stdout:(22/24): thrift-0.15.0-2.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-09-13T02:42:37.640 INFO:teuthology.orchestra.run.smithi089.stdout:(23/24): librados2-17.2.7-1627.gbbdadfa3.el9.x8 18 MB/s | 3.1 MB 00:00 2024-09-13T02:42:37.690 INFO:teuthology.orchestra.run.smithi089.stdout:(24/24): librbd1-17.2.7-1627.gbbdadfa3.el9.x86_ 15 MB/s | 2.9 MB 00:00 2024-09-13T02:42:37.694 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2024-09-13T02:42:37.694 INFO:teuthology.orchestra.run.smithi089.stdout:Total 27 MB/s | 58 MB 00:02 2024-09-13T02:42:37.695 INFO:teuthology.orchestra.run.smithi131.stdout:(6/24): ceph-radosgw-17.2.7-1627.gbbdadfa3.el9. 7.8 MB/s | 14 MB 00:01 2024-09-13T02:42:37.712 INFO:teuthology.orchestra.run.smithi131.stdout:(7/24): python3-ceph-argparse-17.2.7-1627.gbbda 271 kB/s | 45 kB 00:00 2024-09-13T02:42:37.746 INFO:teuthology.orchestra.run.smithi131.stdout:(8/24): python3-ceph-common-17.2.7-1627.gbbdadf 2.3 MB/s | 120 kB 00:00 2024-09-13T02:42:37.754 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2024-09-13T02:42:37.771 INFO:teuthology.orchestra.run.smithi131.stdout:(9/24): python3-cephfs-17.2.7-1627.gbbdadfa3.el 2.6 MB/s | 156 kB 00:00 2024-09-13T02:42:37.787 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2024-09-13T02:42:37.787 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2024-09-13T02:42:37.804 INFO:teuthology.orchestra.run.smithi131.stdout:(10/24): python3-rados-17.2.7-1627.gbbdadfa3.el 5.4 MB/s | 320 kB 00:00 2024-09-13T02:42:37.830 INFO:teuthology.orchestra.run.smithi131.stdout:(11/24): python3-rbd-17.2.7-1627.gbbdadfa3.el9. 4.9 MB/s | 294 kB 00:00 2024-09-13T02:42:37.872 INFO:teuthology.orchestra.run.smithi131.stdout:(12/24): python3-rgw-17.2.7-1627.gbbdadfa3.el9. 1.5 MB/s | 99 kB 00:00 2024-09-13T02:42:38.072 INFO:teuthology.orchestra.run.smithi131.stdout:(13/24): librabbitmq-0.11.0-7.el9.x86_64.rpm 226 kB/s | 45 kB 00:00 2024-09-13T02:42:38.172 INFO:teuthology.orchestra.run.smithi131.stdout:(14/24): libpmemobj-1.12.1-1.el9.x86_64.rpm 468 kB/s | 160 kB 00:00 2024-09-13T02:42:38.389 INFO:teuthology.orchestra.run.smithi131.stdout:(15/24): lttng-ust-2.12.0-6.el9.x86_64.rpm 1.3 MB/s | 292 kB 00:00 2024-09-13T02:42:38.425 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2024-09-13T02:42:38.425 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2024-09-13T02:42:38.456 INFO:teuthology.orchestra.run.smithi131.stdout:(16/24): librdkafka-1.6.1-102.el9.x86_64.rpm 1.7 MB/s | 662 kB 00:00 2024-09-13T02:42:38.482 INFO:teuthology.orchestra.run.smithi131.stdout:(17/24): python3-prettytable-0.7.2-27.el9.noarc 459 kB/s | 42 kB 00:00 2024-09-13T02:42:38.540 INFO:teuthology.orchestra.run.smithi131.stdout:(18/24): liboath-2.6.7-2.el9.x86_64.rpm 836 kB/s | 49 kB 00:00 2024-09-13T02:42:38.565 INFO:teuthology.orchestra.run.smithi131.stdout:(19/24): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.8 MB/s | 308 kB 00:00 2024-09-13T02:42:38.591 INFO:teuthology.orchestra.run.smithi131.stdout:(20/24): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-13T02:42:38.683 INFO:teuthology.orchestra.run.smithi131.stdout:(21/24): thrift-0.15.0-2.el9.x86_64.rpm 14 MB/s | 1.6 MB 00:00 2024-09-13T02:42:38.841 INFO:teuthology.orchestra.run.smithi131.stdout:(22/24): librados2-17.2.7-1627.gbbdadfa3.el9.x8 12 MB/s | 3.1 MB 00:00 2024-09-13T02:42:38.917 INFO:teuthology.orchestra.run.smithi131.stdout:(23/24): librbd1-17.2.7-1627.gbbdadfa3.el9.x86_ 13 MB/s | 2.9 MB 00:00 2024-09-13T02:42:39.658 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2024-09-13T02:42:40.017 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/26 2024-09-13T02:42:40.076 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : librados2-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2/26 2024-09-13T02:42:40.175 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librados2-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2/26 2024-09-13T02:42:40.255 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-rados-2:17.2.7-1627.gbbdadfa3.el9.x86_64 3/26 2024-09-13T02:42:40.277 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libcephfs2-2:17.2.7-1627.gbbdadfa3.el9.x86_64 4/26 2024-09-13T02:42:40.349 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: libcephfs2-2:17.2.7-1627.gbbdadfa3.el9.x86_64 4/26 2024-09-13T02:42:40.394 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : thrift-0.15.0-2.el9.x86_64 5/26 2024-09-13T02:42:40.441 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/26 2024-09-13T02:42:40.525 INFO:teuthology.orchestra.run.smithi131.stdout:(24/24): ceph-common-17.2.7-1627.gbbdadfa3.el9. 4.8 MB/s | 22 MB 00:04 2024-09-13T02:42:40.531 INFO:teuthology.orchestra.run.smithi131.stdout:-------------------------------------------------------------------------------- 2024-09-13T02:42:40.531 INFO:teuthology.orchestra.run.smithi131.stdout:Total 12 MB/s | 58 MB 00:05 2024-09-13T02:42:40.597 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction check 2024-09-13T02:42:40.630 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction check succeeded. 2024-09-13T02:42:40.630 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction test 2024-09-13T02:42:40.878 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/26 2024-09-13T02:42:40.906 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : librgw2-2:17.2.7-1627.gbbdadfa3.el9.x86_64 8/26 2024-09-13T02:42:40.968 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librgw2-2:17.2.7-1627.gbbdadfa3.el9.x86_64 8/26 2024-09-13T02:42:40.997 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : liboath-2.6.7-2.el9.x86_64 9/26 2024-09-13T02:42:41.039 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-ceph-argparse-2:17.2.7-1627.gbbdadfa3.el9. 10/26 2024-09-13T02:42:41.077 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cephfs-2:17.2.7-1627.gbbdadfa3.el9.x86_64 11/26 2024-09-13T02:42:41.138 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-rgw-2:17.2.7-1627.gbbdadfa3.el9.x86_64 12/26 2024-09-13T02:42:41.166 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libradosstriper1-2:17.2.7-1627.gbbdadfa3.el9.x86_6 13/26 2024-09-13T02:42:41.233 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: libradosstriper1-2:17.2.7-1627.gbbdadfa3.el9.x86_6 13/26 2024-09-13T02:42:41.271 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction test succeeded. 2024-09-13T02:42:41.271 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction 2024-09-13T02:42:41.272 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/26 2024-09-13T02:42:41.317 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/26 2024-09-13T02:42:41.354 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 16/26 2024-09-13T02:42:41.643 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/26 2024-09-13T02:42:41.687 INFO:teuthology.orchestra.run.smithi089.stdout: Upgrading : librbd1-2:17.2.7-1627.gbbdadfa3.el9.x86_64 18/26 2024-09-13T02:42:41.778 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librbd1-2:17.2.7-1627.gbbdadfa3.el9.x86_64 18/26 2024-09-13T02:42:41.851 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-rbd-2:17.2.7-1627.gbbdadfa3.el9.x86_64 19/26 2024-09-13T02:42:41.882 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-ceph-common-2:17.2.7-1627.gbbdadfa3.el9.x8 20/26 2024-09-13T02:42:42.545 INFO:teuthology.orchestra.run.smithi131.stdout: Preparing : 1/1 2024-09-13T02:42:42.936 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/26 2024-09-13T02:42:42.985 INFO:teuthology.orchestra.run.smithi131.stdout: Upgrading : librados2-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2/26 2024-09-13T02:42:43.077 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: librados2-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2/26 2024-09-13T02:42:43.156 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-rados-2:17.2.7-1627.gbbdadfa3.el9.x86_64 3/26 2024-09-13T02:42:43.178 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libcephfs2-2:17.2.7-1627.gbbdadfa3.el9.x86_64 4/26 2024-09-13T02:42:43.258 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: libcephfs2-2:17.2.7-1627.gbbdadfa3.el9.x86_64 4/26 2024-09-13T02:42:43.313 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : thrift-0.15.0-2.el9.x86_64 5/26 2024-09-13T02:42:43.351 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 6/26 2024-09-13T02:42:43.788 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 7/26 2024-09-13T02:42:43.815 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : librgw2-2:17.2.7-1627.gbbdadfa3.el9.x86_64 8/26 2024-09-13T02:42:43.878 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: librgw2-2:17.2.7-1627.gbbdadfa3.el9.x86_64 8/26 2024-09-13T02:42:43.915 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : liboath-2.6.7-2.el9.x86_64 9/26 2024-09-13T02:42:43.958 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-ceph-argparse-2:17.2.7-1627.gbbdadfa3.el9. 10/26 2024-09-13T02:42:43.995 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-cephfs-2:17.2.7-1627.gbbdadfa3.el9.x86_64 11/26 2024-09-13T02:42:44.057 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-rgw-2:17.2.7-1627.gbbdadfa3.el9.x86_64 12/26 2024-09-13T02:42:44.085 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libradosstriper1-2:17.2.7-1627.gbbdadfa3.el9.x86_6 13/26 2024-09-13T02:42:44.151 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: libradosstriper1-2:17.2.7-1627.gbbdadfa3.el9.x86_6 13/26 2024-09-13T02:42:44.190 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 14/26 2024-09-13T02:42:44.226 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 15/26 2024-09-13T02:42:44.260 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 16/26 2024-09-13T02:42:44.335 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-common-2:17.2.7-1627.gbbdadfa3.el9.x86_64 21/26 2024-09-13T02:42:44.371 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-common-2:17.2.7-1627.gbbdadfa3.el9.x86_64 21/26 2024-09-13T02:42:44.556 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 17/26 2024-09-13T02:42:44.606 INFO:teuthology.orchestra.run.smithi131.stdout: Upgrading : librbd1-2:17.2.7-1627.gbbdadfa3.el9.x86_64 18/26 2024-09-13T02:42:44.687 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: librbd1-2:17.2.7-1627.gbbdadfa3.el9.x86_64 18/26 2024-09-13T02:42:44.762 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-rbd-2:17.2.7-1627.gbbdadfa3.el9.x86_64 19/26 2024-09-13T02:42:44.791 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-ceph-common-2:17.2.7-1627.gbbdadfa3.el9.x8 20/26 2024-09-13T02:42:44.909 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-common-2:17.2.7-1627.gbbdadfa3.el9.x86_64 21/26 2024-09-13T02:42:44.949 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-base-2:17.2.7-1627.gbbdadfa3.el9.x86_64 22/26 2024-09-13T02:42:45.049 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-base-2:17.2.7-1627.gbbdadfa3.el9.x86_64 22/26 2024-09-13T02:42:45.049 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-13T02:42:45.049 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-13T02:42:45.049 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:42:45.084 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-selinux-2:17.2.7-1627.gbbdadfa3.el9.x86_64 23/26 2024-09-13T02:42:47.281 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-common-2:17.2.7-1627.gbbdadfa3.el9.x86_64 21/26 2024-09-13T02:42:47.321 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-common-2:17.2.7-1627.gbbdadfa3.el9.x86_64 21/26 2024-09-13T02:42:47.848 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-common-2:17.2.7-1627.gbbdadfa3.el9.x86_64 21/26 2024-09-13T02:42:47.892 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-base-2:17.2.7-1627.gbbdadfa3.el9.x86_64 22/26 2024-09-13T02:42:47.998 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-base-2:17.2.7-1627.gbbdadfa3.el9.x86_64 22/26 2024-09-13T02:42:47.998 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-13T02:42:47.998 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-13T02:42:47.998 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-13T02:42:48.035 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-selinux-2:17.2.7-1627.gbbdadfa3.el9.x86_64 23/26 2024-09-13T02:42:55.162 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-selinux-2:17.2.7-1627.gbbdadfa3.el9.x86_64 23/26 2024-09-13T02:42:55.162 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /sys 2024-09-13T02:42:55.162 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /proc 2024-09-13T02:42:55.162 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /mnt 2024-09-13T02:42:55.162 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /var/tmp 2024-09-13T02:42:55.162 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /home 2024-09-13T02:42:55.162 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /root 2024-09-13T02:42:55.162 INFO:teuthology.orchestra.run.smithi089.stdout:skipping the directory /tmp 2024-09-13T02:42:55.163 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:42:56.463 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-radosgw-2:17.2.7-1627.gbbdadfa3.el9.x86_64 24/26 2024-09-13T02:42:56.543 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-1627.gbbdadfa3.el9.x86_64 24/26 2024-09-13T02:42:56.543 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T02:42:56.543 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-13T02:42:56.543 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T02:42:56.543 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T02:42:56.543 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:42:56.546 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-09-13T02:42:56.620 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-09-13T02:42:56.621 INFO:teuthology.orchestra.run.smithi089.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 26/26 2024-09-13T02:42:57.623 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-selinux-2:17.2.7-1627.gbbdadfa3.el9.x86_64 23/26 2024-09-13T02:42:57.624 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /sys 2024-09-13T02:42:57.624 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /proc 2024-09-13T02:42:57.624 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /mnt 2024-09-13T02:42:57.624 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /var/tmp 2024-09-13T02:42:57.624 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /home 2024-09-13T02:42:57.624 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /root 2024-09-13T02:42:57.624 INFO:teuthology.orchestra.run.smithi131.stdout:skipping the directory /tmp 2024-09-13T02:42:57.624 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-13T02:42:57.932 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 26/26 2024-09-13T02:42:57.932 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-base-2:17.2.7-1627.gbbdadfa3.el9.x86_64 1/26 2024-09-13T02:42:57.932 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-common-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2/26 2024-09-13T02:42:57.933 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-radosgw-2:17.2.7-1627.gbbdadfa3.el9.x86_64 3/26 2024-09-13T02:42:57.933 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-selinux-2:17.2.7-1627.gbbdadfa3.el9.x86_64 4/26 2024-09-13T02:42:57.933 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libcephfs2-2:17.2.7-1627.gbbdadfa3.el9.x86_64 5/26 2024-09-13T02:42:57.933 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libradosstriper1-2:17.2.7-1627.gbbdadfa3.el9.x86_6 6/26 2024-09-13T02:42:57.933 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librgw2-2:17.2.7-1627.gbbdadfa3.el9.x86_64 7/26 2024-09-13T02:42:57.933 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-ceph-argparse-2:17.2.7-1627.gbbdadfa3.el9. 8/26 2024-09-13T02:42:57.933 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-ceph-common-2:17.2.7-1627.gbbdadfa3.el9.x8 9/26 2024-09-13T02:42:57.933 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cephfs-2:17.2.7-1627.gbbdadfa3.el9.x86_64 10/26 2024-09-13T02:42:57.933 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-rados-2:17.2.7-1627.gbbdadfa3.el9.x86_64 11/26 2024-09-13T02:42:57.933 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-rbd-2:17.2.7-1627.gbbdadfa3.el9.x86_64 12/26 2024-09-13T02:42:57.933 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-rgw-2:17.2.7-1627.gbbdadfa3.el9.x86_64 13/26 2024-09-13T02:42:57.933 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 14/26 2024-09-13T02:42:57.934 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 15/26 2024-09-13T02:42:57.934 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 16/26 2024-09-13T02:42:57.934 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 17/26 2024-09-13T02:42:57.934 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 18/26 2024-09-13T02:42:57.934 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 19/26 2024-09-13T02:42:57.934 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 20/26 2024-09-13T02:42:57.934 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 21/26 2024-09-13T02:42:57.934 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 22/26 2024-09-13T02:42:57.934 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librados2-2:17.2.7-1627.gbbdadfa3.el9.x86_64 23/26 2024-09-13T02:42:57.934 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 24/26 2024-09-13T02:42:57.934 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librbd1-2:17.2.7-1627.gbbdadfa3.el9.x86_64 25/26 2024-09-13T02:42:58.740 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 26/26 2024-09-13T02:42:58.740 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:42:58.740 INFO:teuthology.orchestra.run.smithi089.stdout:Upgraded: 2024-09-13T02:42:58.740 INFO:teuthology.orchestra.run.smithi089.stdout: librados2-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:42:58.740 INFO:teuthology.orchestra.run.smithi089.stdout: librbd1-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:42:58.740 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2024-09-13T02:42:58.740 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-base-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:42:58.740 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-common-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:42:58.740 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-radosgw-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:42:58.741 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-selinux-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:42:58.741 INFO:teuthology.orchestra.run.smithi089.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-13T02:42:58.741 INFO:teuthology.orchestra.run.smithi089.stdout: libcephfs2-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:42:58.741 INFO:teuthology.orchestra.run.smithi089.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-13T02:42:58.741 INFO:teuthology.orchestra.run.smithi089.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-13T02:42:58.741 INFO:teuthology.orchestra.run.smithi089.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-13T02:42:58.741 INFO:teuthology.orchestra.run.smithi089.stdout: libradosstriper1-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:42:58.741 INFO:teuthology.orchestra.run.smithi089.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-13T02:42:58.741 INFO:teuthology.orchestra.run.smithi089.stdout: librgw2-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:42:58.741 INFO:teuthology.orchestra.run.smithi089.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-13T02:42:58.741 INFO:teuthology.orchestra.run.smithi089.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-13T02:42:58.741 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ceph-argparse-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:42:58.742 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ceph-common-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:42:58.742 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cephfs-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:42:58.742 INFO:teuthology.orchestra.run.smithi089.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-13T02:42:58.742 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rados-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:42:58.742 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rbd-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:42:58.742 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rgw-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:42:58.742 INFO:teuthology.orchestra.run.smithi089.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-13T02:42:58.742 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:42:58.742 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-09-13T02:42:58.904 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-radosgw-2:17.2.7-1627.gbbdadfa3.el9.x86_64 24/26 2024-09-13T02:42:58.984 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-1627.gbbdadfa3.el9.x86_64 24/26 2024-09-13T02:42:58.984 INFO:teuthology.orchestra.run.smithi131.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T02:42:58.984 INFO:teuthology.orchestra.run.smithi131.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-13T02:42:58.984 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T02:42:58.984 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-13T02:42:58.984 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-13T02:42:58.986 INFO:teuthology.orchestra.run.smithi131.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-09-13T02:42:59.074 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 25/26 2024-09-13T02:42:59.074 INFO:teuthology.orchestra.run.smithi131.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 26/26 2024-09-13T02:42:59.076 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install ceph-test 2024-09-13T02:42:59.661 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:00:26 ago on Fri 13 Sep 2024 02:42:33 AM UTC. 2024-09-13T02:42:59.800 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-09-13T02:42:59.801 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-13T02:42:59.801 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repository Size 2024-09-13T02:42:59.801 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-13T02:42:59.801 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2024-09-13T02:42:59.801 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-test x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 48 M 2024-09-13T02:42:59.801 INFO:teuthology.orchestra.run.smithi089.stdout:Installing dependencies: 2024-09-13T02:42:59.801 INFO:teuthology.orchestra.run.smithi089.stdout: libcephsqlite x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 163 k 2024-09-13T02:42:59.801 INFO:teuthology.orchestra.run.smithi089.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-13T02:42:59.801 INFO:teuthology.orchestra.run.smithi089.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-13T02:42:59.801 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:42:59.801 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2024-09-13T02:42:59.802 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-13T02:42:59.802 INFO:teuthology.orchestra.run.smithi089.stdout:Install 4 Packages 2024-09-13T02:42:59.802 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:42:59.802 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 48 M 2024-09-13T02:42:59.802 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 193 M 2024-09-13T02:42:59.802 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2024-09-13T02:43:00.030 INFO:teuthology.orchestra.run.smithi089.stdout:(1/4): libcephsqlite-17.2.7-1627.gbbdadfa3.el9. 800 kB/s | 163 kB 00:00 2024-09-13T02:43:00.055 INFO:teuthology.orchestra.run.smithi089.stdout:(2/4): socat-1.7.4.1-6.el9.x86_64.rpm 1.3 MB/s | 304 kB 00:00 2024-09-13T02:43:00.080 INFO:teuthology.orchestra.run.smithi089.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-13T02:43:00.430 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 26/26 2024-09-13T02:43:00.430 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-base-2:17.2.7-1627.gbbdadfa3.el9.x86_64 1/26 2024-09-13T02:43:00.431 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-common-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2/26 2024-09-13T02:43:00.431 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-radosgw-2:17.2.7-1627.gbbdadfa3.el9.x86_64 3/26 2024-09-13T02:43:00.431 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-selinux-2:17.2.7-1627.gbbdadfa3.el9.x86_64 4/26 2024-09-13T02:43:00.431 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libcephfs2-2:17.2.7-1627.gbbdadfa3.el9.x86_64 5/26 2024-09-13T02:43:00.431 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libradosstriper1-2:17.2.7-1627.gbbdadfa3.el9.x86_6 6/26 2024-09-13T02:43:00.431 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librgw2-2:17.2.7-1627.gbbdadfa3.el9.x86_64 7/26 2024-09-13T02:43:00.431 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-ceph-argparse-2:17.2.7-1627.gbbdadfa3.el9. 8/26 2024-09-13T02:43:00.431 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-ceph-common-2:17.2.7-1627.gbbdadfa3.el9.x8 9/26 2024-09-13T02:43:00.431 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-cephfs-2:17.2.7-1627.gbbdadfa3.el9.x86_64 10/26 2024-09-13T02:43:00.431 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-rados-2:17.2.7-1627.gbbdadfa3.el9.x86_64 11/26 2024-09-13T02:43:00.431 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-rbd-2:17.2.7-1627.gbbdadfa3.el9.x86_64 12/26 2024-09-13T02:43:00.432 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-rgw-2:17.2.7-1627.gbbdadfa3.el9.x86_64 13/26 2024-09-13T02:43:00.432 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 14/26 2024-09-13T02:43:00.432 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 15/26 2024-09-13T02:43:00.432 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 16/26 2024-09-13T02:43:00.432 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 17/26 2024-09-13T02:43:00.432 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 18/26 2024-09-13T02:43:00.432 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 19/26 2024-09-13T02:43:00.432 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 20/26 2024-09-13T02:43:00.432 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 21/26 2024-09-13T02:43:00.432 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 22/26 2024-09-13T02:43:00.432 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librados2-2:17.2.7-1627.gbbdadfa3.el9.x86_64 23/26 2024-09-13T02:43:00.432 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 24/26 2024-09-13T02:43:00.432 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librbd1-2:17.2.7-1627.gbbdadfa3.el9.x86_64 25/26 2024-09-13T02:43:01.347 INFO:teuthology.orchestra.run.smithi089.stdout:(4/4): ceph-test-17.2.7-1627.gbbdadfa3.el9.x86_ 32 MB/s | 48 MB 00:01 2024-09-13T02:43:01.349 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2024-09-13T02:43:01.350 INFO:teuthology.orchestra.run.smithi089.stdout:Total 31 MB/s | 48 MB 00:01 2024-09-13T02:43:01.378 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2024-09-13T02:43:01.397 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2024-09-13T02:43:01.397 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2024-09-13T02:43:01.426 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 26/26 2024-09-13T02:43:01.426 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-13T02:43:01.426 INFO:teuthology.orchestra.run.smithi131.stdout:Upgraded: 2024-09-13T02:43:01.426 INFO:teuthology.orchestra.run.smithi131.stdout: librados2-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:43:01.426 INFO:teuthology.orchestra.run.smithi131.stdout: librbd1-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:43:01.426 INFO:teuthology.orchestra.run.smithi131.stdout:Installed: 2024-09-13T02:43:01.426 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-base-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:43:01.426 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-common-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:43:01.426 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-radosgw-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:43:01.427 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-selinux-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:43:01.427 INFO:teuthology.orchestra.run.smithi131.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-13T02:43:01.427 INFO:teuthology.orchestra.run.smithi131.stdout: libcephfs2-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:43:01.427 INFO:teuthology.orchestra.run.smithi131.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-13T02:43:01.427 INFO:teuthology.orchestra.run.smithi131.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-13T02:43:01.427 INFO:teuthology.orchestra.run.smithi131.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-13T02:43:01.427 INFO:teuthology.orchestra.run.smithi131.stdout: libradosstriper1-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:43:01.427 INFO:teuthology.orchestra.run.smithi131.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-13T02:43:01.427 INFO:teuthology.orchestra.run.smithi131.stdout: librgw2-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:43:01.427 INFO:teuthology.orchestra.run.smithi131.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-13T02:43:01.427 INFO:teuthology.orchestra.run.smithi131.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-13T02:43:01.427 INFO:teuthology.orchestra.run.smithi131.stdout: python3-ceph-argparse-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:43:01.427 INFO:teuthology.orchestra.run.smithi131.stdout: python3-ceph-common-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:43:01.428 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cephfs-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:43:01.428 INFO:teuthology.orchestra.run.smithi131.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-13T02:43:01.428 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rados-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:43:01.428 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rbd-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:43:01.428 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rgw-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:43:01.428 INFO:teuthology.orchestra.run.smithi131.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-13T02:43:01.428 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-13T02:43:01.428 INFO:teuthology.orchestra.run.smithi131.stdout:Complete! 2024-09-13T02:43:01.763 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2024-09-13T02:43:01.763 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2024-09-13T02:43:01.773 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum -y install ceph-test 2024-09-13T02:43:02.280 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2024-09-13T02:43:02.339 INFO:teuthology.orchestra.run.smithi131.stdout:Last metadata expiration check: 0:00:29 ago on Fri 13 Sep 2024 02:42:33 AM UTC. 2024-09-13T02:43:02.373 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-13T02:43:02.429 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-13T02:43:02.449 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libcephsqlite-2:17.2.7-1627.gbbdadfa3.el9.x86_64 3/4 2024-09-13T02:43:02.478 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2024-09-13T02:43:02.479 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-09-13T02:43:02.479 INFO:teuthology.orchestra.run.smithi131.stdout: Package Arch Version Repository Size 2024-09-13T02:43:02.479 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-09-13T02:43:02.480 INFO:teuthology.orchestra.run.smithi131.stdout:Installing: 2024-09-13T02:43:02.480 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-test x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 48 M 2024-09-13T02:43:02.480 INFO:teuthology.orchestra.run.smithi131.stdout:Installing dependencies: 2024-09-13T02:43:02.480 INFO:teuthology.orchestra.run.smithi131.stdout: libcephsqlite x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 163 k 2024-09-13T02:43:02.480 INFO:teuthology.orchestra.run.smithi131.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-13T02:43:02.480 INFO:teuthology.orchestra.run.smithi131.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-13T02:43:02.480 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-13T02:43:02.480 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction Summary 2024-09-13T02:43:02.480 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-09-13T02:43:02.480 INFO:teuthology.orchestra.run.smithi131.stdout:Install 4 Packages 2024-09-13T02:43:02.480 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-13T02:43:02.481 INFO:teuthology.orchestra.run.smithi131.stdout:Total download size: 48 M 2024-09-13T02:43:02.481 INFO:teuthology.orchestra.run.smithi131.stdout:Installed size: 193 M 2024-09-13T02:43:02.481 INFO:teuthology.orchestra.run.smithi131.stdout:Downloading Packages: 2024-09-13T02:43:02.724 INFO:teuthology.orchestra.run.smithi131.stdout:(1/4): socat-1.7.4.1-6.el9.x86_64.rpm 1.3 MB/s | 304 kB 00:00 2024-09-13T02:43:02.750 INFO:teuthology.orchestra.run.smithi131.stdout:(2/4): libcephsqlite-17.2.7-1627.gbbdadfa3.el9. 658 kB/s | 163 kB 00:00 2024-09-13T02:43:02.774 INFO:teuthology.orchestra.run.smithi131.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-13T02:43:04.060 INFO:teuthology.orchestra.run.smithi131.stdout:(4/4): ceph-test-17.2.7-1627.gbbdadfa3.el9.x86_ 31 MB/s | 48 MB 00:01 2024-09-13T02:43:04.060 INFO:teuthology.orchestra.run.smithi131.stdout:-------------------------------------------------------------------------------- 2024-09-13T02:43:04.061 INFO:teuthology.orchestra.run.smithi131.stdout:Total 31 MB/s | 48 MB 00:01 2024-09-13T02:43:04.089 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction check 2024-09-13T02:43:04.108 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction check succeeded. 2024-09-13T02:43:04.108 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction test 2024-09-13T02:43:04.472 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction test succeeded. 2024-09-13T02:43:04.472 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction 2024-09-13T02:43:05.009 INFO:teuthology.orchestra.run.smithi131.stdout: Preparing : 1/1 2024-09-13T02:43:05.101 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-13T02:43:05.142 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-13T02:43:05.168 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libcephsqlite-2:17.2.7-1627.gbbdadfa3.el9.x86_64 3/4 2024-09-13T02:43:06.816 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: libcephsqlite-2:17.2.7-1627.gbbdadfa3.el9.x86_64 3/4 2024-09-13T02:43:06.889 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-test-2:17.2.7-1627.gbbdadfa3.el9.x86_64 4/4 2024-09-13T02:43:09.180 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-test-2:17.2.7-1627.gbbdadfa3.el9.x86_64 4/4 2024-09-13T02:43:09.180 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-test-2:17.2.7-1627.gbbdadfa3.el9.x86_64 1/4 2024-09-13T02:43:09.180 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libcephsqlite-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2/4 2024-09-13T02:43:09.180 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-13T02:43:09.484 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-13T02:43:09.484 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:43:09.484 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2024-09-13T02:43:09.484 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-test-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:43:09.485 INFO:teuthology.orchestra.run.smithi089.stdout: libcephsqlite-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:43:09.485 INFO:teuthology.orchestra.run.smithi089.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-13T02:43:09.485 INFO:teuthology.orchestra.run.smithi089.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-13T02:43:09.485 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:43:09.485 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-09-13T02:43:09.667 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: libcephsqlite-2:17.2.7-1627.gbbdadfa3.el9.x86_64 3/4 2024-09-13T02:43:09.749 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-test-2:17.2.7-1627.gbbdadfa3.el9.x86_64 4/4 2024-09-13T02:43:09.782 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install ceph 2024-09-13T02:43:10.353 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:00:37 ago on Fri 13 Sep 2024 02:42:33 AM UTC. 2024-09-13T02:43:10.486 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-09-13T02:43:10.489 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-13T02:43:10.489 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repository Size 2024-09-13T02:43:10.489 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-13T02:43:10.489 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2024-09-13T02:43:10.489 INFO:teuthology.orchestra.run.smithi089.stdout: ceph x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 6.5 k 2024-09-13T02:43:10.489 INFO:teuthology.orchestra.run.smithi089.stdout:Installing dependencies: 2024-09-13T02:43:10.490 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mds x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 2.1 M 2024-09-13T02:43:10.490 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 1.4 M 2024-09-13T02:43:10.490 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-modules-core noarch 2:17.2.7-1627.gbbdadfa3.el9 ceph-noarch 240 k 2024-09-13T02:43:10.490 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mon x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 3.9 M 2024-09-13T02:43:10.490 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-osd x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 15 M 2024-09-13T02:43:10.490 INFO:teuthology.orchestra.run.smithi089.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-13T02:43:10.490 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-13T02:43:10.490 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-13T02:43:10.490 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-13T02:43:10.490 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-13T02:43:10.490 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-13T02:43:10.490 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-13T02:43:10.491 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-collections 2024-09-13T02:43:10.491 INFO:teuthology.orchestra.run.smithi089.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-13T02:43:10.491 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-13T02:43:10.491 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-13T02:43:10.491 INFO:teuthology.orchestra.run.smithi089.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-13T02:43:10.491 INFO:teuthology.orchestra.run.smithi089.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-13T02:43:10.491 INFO:teuthology.orchestra.run.smithi089.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-13T02:43:10.491 INFO:teuthology.orchestra.run.smithi089.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-13T02:43:10.491 INFO:teuthology.orchestra.run.smithi089.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-13T02:43:10.491 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-13T02:43:10.491 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-13T02:43:10.491 INFO:teuthology.orchestra.run.smithi089.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-13T02:43:10.491 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-13T02:43:10.492 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-13T02:43:10.492 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-13T02:43:10.492 INFO:teuthology.orchestra.run.smithi089.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-13T02:43:10.492 INFO:teuthology.orchestra.run.smithi089.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-13T02:43:10.492 INFO:teuthology.orchestra.run.smithi089.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-13T02:43:10.492 INFO:teuthology.orchestra.run.smithi089.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-13T02:43:10.492 INFO:teuthology.orchestra.run.smithi089.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-13T02:43:10.492 INFO:teuthology.orchestra.run.smithi089.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-13T02:43:10.492 INFO:teuthology.orchestra.run.smithi089.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-13T02:43:10.492 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:43:10.492 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2024-09-13T02:43:10.492 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-13T02:43:10.493 INFO:teuthology.orchestra.run.smithi089.stdout:Install 34 Packages 2024-09-13T02:43:10.493 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:43:10.493 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 27 M 2024-09-13T02:43:10.493 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 96 M 2024-09-13T02:43:10.493 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2024-09-13T02:43:10.892 INFO:teuthology.orchestra.run.smithi089.stdout:(1/34): ceph-17.2.7-1627.gbbdadfa3.el9.x86_64.r 55 kB/s | 6.5 kB 00:00 2024-09-13T02:43:11.092 INFO:teuthology.orchestra.run.smithi089.stdout:(2/34): ceph-mgr-17.2.7-1627.gbbdadfa3.el9.x86_ 4.4 MB/s | 1.4 MB 00:00 2024-09-13T02:43:11.134 INFO:teuthology.orchestra.run.smithi089.stdout:(3/34): ceph-mds-17.2.7-1627.gbbdadfa3.el9.x86_ 5.8 MB/s | 2.1 MB 00:00 2024-09-13T02:43:11.234 INFO:teuthology.orchestra.run.smithi089.stdout:(4/34): ceph-mon-17.2.7-1627.gbbdadfa3.el9.x86_ 11 MB/s | 3.9 MB 00:00 2024-09-13T02:43:11.259 INFO:teuthology.orchestra.run.smithi089.stdout:(5/34): ceph-mgr-modules-core-17.2.7-1627.gbbda 1.9 MB/s | 240 kB 00:00 2024-09-13T02:43:11.418 INFO:teuthology.orchestra.run.smithi089.stdout:(6/34): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.3 MB/s | 253 kB 00:00 2024-09-13T02:43:11.468 INFO:teuthology.orchestra.run.smithi089.stdout:(7/34): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-13T02:43:11.627 INFO:teuthology.orchestra.run.smithi089.stdout:(8/34): ceph-osd-17.2.7-1627.gbbdadfa3.el9.x86_ 29 MB/s | 15 MB 00:00 2024-09-13T02:43:11.644 INFO:teuthology.orchestra.run.smithi089.stdout:(9/34): python3-pycparser-2.20-6.el9.noarch.rpm 771 kB/s | 135 kB 00:00 2024-09-13T02:43:11.678 INFO:teuthology.orchestra.run.smithi089.stdout:(10/34): python3-cryptography-36.0.1-4.el9.x86_ 2.9 MB/s | 1.2 MB 00:00 2024-09-13T02:43:11.703 INFO:teuthology.orchestra.run.smithi089.stdout:(11/34): python3-urllib3-1.26.5-6.el9.noarch.rp 3.6 MB/s | 215 kB 00:00 2024-09-13T02:43:11.728 INFO:teuthology.orchestra.run.smithi089.stdout:(12/34): python3-mako-1.1.4-6.el9.noarch.rpm 3.3 MB/s | 172 kB 00:00 2024-09-13T02:43:11.754 INFO:teuthology.orchestra.run.smithi089.stdout:(13/34): python3-markupsafe-1.1.1-12.el9.x86_64 687 kB/s | 35 kB 00:00 2024-09-13T02:43:11.779 INFO:teuthology.orchestra.run.smithi089.stdout:(14/34): python3-packaging-20.9-5.el9.noarch.rp 1.5 MB/s | 77 kB 00:00 2024-09-13T02:43:11.813 INFO:teuthology.orchestra.run.smithi089.stdout:(15/34): python3-requests-2.25.1-8.el9.noarch.r 674 kB/s | 125 kB 00:00 2024-09-13T02:43:11.838 INFO:teuthology.orchestra.run.smithi089.stdout:(16/34): python3-pytz-2021.1-5.el9.noarch.rpm 607 kB/s | 51 kB 00:00 2024-09-13T02:43:11.863 INFO:teuthology.orchestra.run.smithi089.stdout:(17/34): python3-toml-0.10.2-6.el9.noarch.rpm 496 kB/s | 42 kB 00:00 2024-09-13T02:43:11.911 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-test-2:17.2.7-1627.gbbdadfa3.el9.x86_64 4/4 2024-09-13T02:43:11.911 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-test-2:17.2.7-1627.gbbdadfa3.el9.x86_64 1/4 2024-09-13T02:43:11.911 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libcephsqlite-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2/4 2024-09-13T02:43:11.911 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-13T02:43:11.913 INFO:teuthology.orchestra.run.smithi089.stdout:(18/34): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 578 kB/s | 43 kB 00:00 2024-09-13T02:43:11.939 INFO:teuthology.orchestra.run.smithi089.stdout:(19/34): python3-jaraco-8.2.1-3.el9.noarch.rpm 460 kB/s | 11 kB 00:00 2024-09-13T02:43:11.964 INFO:teuthology.orchestra.run.smithi089.stdout:(20/34): python3-cheroot-8.6.0-4.el9.noarch.rpm 1.3 MB/s | 172 kB 00:00 2024-09-13T02:43:11.989 INFO:teuthology.orchestra.run.smithi089.stdout:(21/34): python3-jaraco-classes-3.2.1-5.el9.noa 351 kB/s | 18 kB 00:00 2024-09-13T02:43:12.015 INFO:teuthology.orchestra.run.smithi089.stdout:(22/34): python3-jaraco-collections-3.0.0-8.el9 460 kB/s | 23 kB 00:00 2024-09-13T02:43:12.040 INFO:teuthology.orchestra.run.smithi089.stdout:(23/34): python3-jaraco-functools-3.5.0-2.el9.n 386 kB/s | 19 kB 00:00 2024-09-13T02:43:12.057 INFO:teuthology.orchestra.run.smithi089.stdout:(24/34): python3-jaraco-text-3.2.0-6.el9.noarch 469 kB/s | 20 kB 00:00 2024-09-13T02:43:12.082 INFO:teuthology.orchestra.run.smithi089.stdout:(25/34): python3-logutils-0.3.5-21.el9.noarch.r 1.1 MB/s | 46 kB 00:00 2024-09-13T02:43:12.107 INFO:teuthology.orchestra.run.smithi089.stdout:(26/34): python3-more-itertools-8.12.0-2.el9.no 1.5 MB/s | 79 kB 00:00 2024-09-13T02:43:12.141 INFO:teuthology.orchestra.run.smithi089.stdout:(27/34): python3-cherrypy-18.6.1-2.el9.noarch.r 1.3 MB/s | 358 kB 00:00 2024-09-13T02:43:12.158 INFO:teuthology.orchestra.run.smithi089.stdout:(28/34): python3-portend-3.1.0-2.el9.noarch.rpm 326 kB/s | 16 kB 00:00 2024-09-13T02:43:12.184 INFO:teuthology.orchestra.run.smithi089.stdout:(29/34): python3-pyOpenSSL-21.0.0-1.el9.noarch. 2.1 MB/s | 90 kB 00:00 2024-09-13T02:43:12.209 INFO:teuthology.orchestra.run.smithi089.stdout:(30/34): python3-tempora-5.0.0-2.el9.noarch.rpm 711 kB/s | 36 kB 00:00 2024-09-13T02:43:12.223 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-13T02:43:12.223 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-13T02:43:12.223 INFO:teuthology.orchestra.run.smithi131.stdout:Installed: 2024-09-13T02:43:12.223 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-test-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:43:12.223 INFO:teuthology.orchestra.run.smithi131.stdout: libcephsqlite-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:43:12.223 INFO:teuthology.orchestra.run.smithi131.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-13T02:43:12.223 INFO:teuthology.orchestra.run.smithi131.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-13T02:43:12.223 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-13T02:43:12.224 INFO:teuthology.orchestra.run.smithi131.stdout:Complete! 2024-09-13T02:43:12.234 INFO:teuthology.orchestra.run.smithi089.stdout:(31/34): python3-pecan-1.4.2-3.el9.noarch.rpm 1.8 MB/s | 272 kB 00:00 2024-09-13T02:43:12.260 INFO:teuthology.orchestra.run.smithi089.stdout:(32/34): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-13T02:43:12.285 INFO:teuthology.orchestra.run.smithi089.stdout:(33/34): python3-zc-lockfile-2.0-10.el9.noarch. 398 kB/s | 20 kB 00:00 2024-09-13T02:43:12.318 INFO:teuthology.orchestra.run.smithi089.stdout:(34/34): python3-werkzeug-2.0.3-3.el9.1.noarch. 3.8 MB/s | 427 kB 00:00 2024-09-13T02:43:12.322 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2024-09-13T02:43:12.322 INFO:teuthology.orchestra.run.smithi089.stdout:Total 15 MB/s | 27 MB 00:01 2024-09-13T02:43:12.450 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2024-09-13T02:43:12.488 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2024-09-13T02:43:12.488 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2024-09-13T02:43:12.514 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum -y install ceph 2024-09-13T02:43:12.885 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2024-09-13T02:43:12.885 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2024-09-13T02:43:13.085 INFO:teuthology.orchestra.run.smithi131.stdout:Last metadata expiration check: 0:00:40 ago on Fri 13 Sep 2024 02:42:33 AM UTC. 2024-09-13T02:43:13.221 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2024-09-13T02:43:13.224 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-09-13T02:43:13.224 INFO:teuthology.orchestra.run.smithi131.stdout: Package Arch Version Repository Size 2024-09-13T02:43:13.224 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-09-13T02:43:13.224 INFO:teuthology.orchestra.run.smithi131.stdout:Installing: 2024-09-13T02:43:13.224 INFO:teuthology.orchestra.run.smithi131.stdout: ceph x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 6.5 k 2024-09-13T02:43:13.224 INFO:teuthology.orchestra.run.smithi131.stdout:Installing dependencies: 2024-09-13T02:43:13.224 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mds x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 2.1 M 2024-09-13T02:43:13.224 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 1.4 M 2024-09-13T02:43:13.224 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-modules-core noarch 2:17.2.7-1627.gbbdadfa3.el9 ceph-noarch 240 k 2024-09-13T02:43:13.224 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mon x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 3.9 M 2024-09-13T02:43:13.224 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-osd x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 15 M 2024-09-13T02:43:13.224 INFO:teuthology.orchestra.run.smithi131.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-13T02:43:13.225 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-13T02:43:13.225 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-13T02:43:13.225 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-13T02:43:13.225 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-13T02:43:13.225 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-13T02:43:13.225 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-13T02:43:13.225 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco-collections 2024-09-13T02:43:13.225 INFO:teuthology.orchestra.run.smithi131.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-13T02:43:13.225 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-13T02:43:13.225 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-13T02:43:13.225 INFO:teuthology.orchestra.run.smithi131.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-13T02:43:13.226 INFO:teuthology.orchestra.run.smithi131.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-13T02:43:13.226 INFO:teuthology.orchestra.run.smithi131.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-13T02:43:13.226 INFO:teuthology.orchestra.run.smithi131.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-13T02:43:13.226 INFO:teuthology.orchestra.run.smithi131.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-13T02:43:13.226 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-13T02:43:13.226 INFO:teuthology.orchestra.run.smithi131.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-13T02:43:13.226 INFO:teuthology.orchestra.run.smithi131.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-13T02:43:13.226 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-13T02:43:13.226 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-13T02:43:13.226 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-13T02:43:13.226 INFO:teuthology.orchestra.run.smithi131.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-13T02:43:13.226 INFO:teuthology.orchestra.run.smithi131.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-13T02:43:13.226 INFO:teuthology.orchestra.run.smithi131.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-13T02:43:13.227 INFO:teuthology.orchestra.run.smithi131.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-13T02:43:13.227 INFO:teuthology.orchestra.run.smithi131.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-13T02:43:13.227 INFO:teuthology.orchestra.run.smithi131.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-13T02:43:13.227 INFO:teuthology.orchestra.run.smithi131.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-13T02:43:13.227 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-13T02:43:13.227 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction Summary 2024-09-13T02:43:13.227 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-09-13T02:43:13.227 INFO:teuthology.orchestra.run.smithi131.stdout:Install 34 Packages 2024-09-13T02:43:13.227 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-13T02:43:13.228 INFO:teuthology.orchestra.run.smithi131.stdout:Total download size: 27 M 2024-09-13T02:43:13.228 INFO:teuthology.orchestra.run.smithi131.stdout:Installed size: 96 M 2024-09-13T02:43:13.228 INFO:teuthology.orchestra.run.smithi131.stdout:Downloading Packages: 2024-09-13T02:43:13.751 INFO:teuthology.orchestra.run.smithi131.stdout:(1/34): ceph-17.2.7-1627.gbbdadfa3.el9.x86_64.r 52 kB/s | 6.5 kB 00:00 2024-09-13T02:43:13.951 INFO:teuthology.orchestra.run.smithi131.stdout:(2/34): ceph-mgr-17.2.7-1627.gbbdadfa3.el9.x86_ 4.3 MB/s | 1.4 MB 00:00 2024-09-13T02:43:14.010 INFO:teuthology.orchestra.run.smithi131.stdout:(3/34): ceph-mds-17.2.7-1627.gbbdadfa3.el9.x86_ 5.4 MB/s | 2.1 MB 00:00 2024-09-13T02:43:14.077 INFO:teuthology.orchestra.run.smithi131.stdout:(4/34): ceph-mon-17.2.7-1627.gbbdadfa3.el9.x86_ 12 MB/s | 3.9 MB 00:00 2024-09-13T02:43:14.102 INFO:teuthology.orchestra.run.smithi131.stdout:(5/34): ceph-mgr-modules-core-17.2.7-1627.gbbda 2.6 MB/s | 240 kB 00:00 2024-09-13T02:43:14.167 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2024-09-13T02:43:14.219 INFO:teuthology.orchestra.run.smithi131.stdout:(6/34): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.7 MB/s | 253 kB 00:00 2024-09-13T02:43:14.238 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/34 2024-09-13T02:43:14.252 INFO:teuthology.orchestra.run.smithi131.stdout:(7/34): python3-ply-3.11-14.el9.noarch.rpm 3.1 MB/s | 106 kB 00:00 2024-09-13T02:43:14.280 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/34 2024-09-13T02:43:14.303 INFO:teuthology.orchestra.run.smithi131.stdout:(8/34): python3-cryptography-36.0.1-4.el9.x86_6 6.1 MB/s | 1.2 MB 00:00 2024-09-13T02:43:14.312 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/34 2024-09-13T02:43:14.328 INFO:teuthology.orchestra.run.smithi131.stdout:(9/34): python3-pycparser-2.20-6.el9.noarch.rpm 1.8 MB/s | 135 kB 00:00 2024-09-13T02:43:14.353 INFO:teuthology.orchestra.run.smithi131.stdout:(10/34): python3-requests-2.25.1-8.el9.noarch.r 2.4 MB/s | 125 kB 00:00 2024-09-13T02:43:14.378 INFO:teuthology.orchestra.run.smithi131.stdout:(11/34): python3-urllib3-1.26.5-6.el9.noarch.rp 4.2 MB/s | 215 kB 00:00 2024-09-13T02:43:14.406 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/34 2024-09-13T02:43:14.492 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/34 2024-09-13T02:43:14.529 INFO:teuthology.orchestra.run.smithi131.stdout:(12/34): ceph-osd-17.2.7-1627.gbbdadfa3.el9.x86 27 MB/s | 15 MB 00:00 2024-09-13T02:43:14.540 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 6/34 2024-09-13T02:43:14.575 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/34 2024-09-13T02:43:14.605 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 8/34 2024-09-13T02:43:14.640 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 9/34 2024-09-13T02:43:14.674 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 10/34 2024-09-13T02:43:14.724 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 11/34 2024-09-13T02:43:14.729 INFO:teuthology.orchestra.run.smithi131.stdout:(13/34): python3-markupsafe-1.1.1-12.el9.x86_64 99 kB/s | 35 kB 00:00 2024-09-13T02:43:14.776 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 12/34 2024-09-13T02:43:14.813 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 13/34 2024-09-13T02:43:14.884 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 14/34 2024-09-13T02:43:14.905 INFO:teuthology.orchestra.run.smithi131.stdout:(14/34): python3-packaging-20.9-5.el9.noarch.rp 206 kB/s | 77 kB 00:00 2024-09-13T02:43:14.918 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-packaging-20.9-5.el9.noarch 15/34 2024-09-13T02:43:14.930 INFO:teuthology.orchestra.run.smithi131.stdout:(15/34): python3-pytz-2021.1-5.el9.noarch.rpm 254 kB/s | 51 kB 00:00 2024-09-13T02:43:14.980 INFO:teuthology.orchestra.run.smithi131.stdout:(16/34): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 869 kB/s | 43 kB 00:00 2024-09-13T02:43:14.993 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 16/34 2024-09-13T02:43:15.006 INFO:teuthology.orchestra.run.smithi131.stdout:(17/34): python3-mako-1.1.4-6.el9.noarch.rpm 264 kB/s | 172 kB 00:00 2024-09-13T02:43:15.039 INFO:teuthology.orchestra.run.smithi131.stdout:(18/34): python3-cheroot-8.6.0-4.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-09-13T02:43:15.056 INFO:teuthology.orchestra.run.smithi131.stdout:(19/34): python3-jaraco-8.2.1-3.el9.noarch.rpm 718 kB/s | 11 kB 00:00 2024-09-13T02:43:15.073 INFO:teuthology.orchestra.run.smithi131.stdout:(20/34): python3-jaraco-classes-3.2.1-5.el9.noa 1.0 MB/s | 18 kB 00:00 2024-09-13T02:43:15.090 INFO:teuthology.orchestra.run.smithi131.stdout:(21/34): python3-jaraco-collections-3.0.0-8.el9 1.4 MB/s | 23 kB 00:00 2024-09-13T02:43:15.107 INFO:teuthology.orchestra.run.smithi131.stdout:(22/34): python3-toml-0.10.2-6.el9.noarch.rpm 206 kB/s | 42 kB 00:00 2024-09-13T02:43:15.124 INFO:teuthology.orchestra.run.smithi131.stdout:(23/34): python3-jaraco-functools-3.5.0-2.el9.n 580 kB/s | 19 kB 00:00 2024-09-13T02:43:15.129 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 17/34 2024-09-13T02:43:15.157 INFO:teuthology.orchestra.run.smithi131.stdout:(24/34): python3-cherrypy-18.6.1-2.el9.noarch.r 2.3 MB/s | 358 kB 00:00 2024-09-13T02:43:15.183 INFO:teuthology.orchestra.run.smithi131.stdout:(25/34): python3-logutils-0.3.5-21.el9.noarch.r 904 kB/s | 46 kB 00:00 2024-09-13T02:43:15.208 INFO:teuthology.orchestra.run.smithi131.stdout:(26/34): python3-jaraco-text-3.2.0-6.el9.noarch 195 kB/s | 20 kB 00:00 2024-09-13T02:43:15.218 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 18/34 2024-09-13T02:43:15.233 INFO:teuthology.orchestra.run.smithi131.stdout:(27/34): python3-more-itertools-8.12.0-2.el9.no 1.0 MB/s | 79 kB 00:00 2024-09-13T02:43:15.259 INFO:teuthology.orchestra.run.smithi131.stdout:(28/34): python3-portend-3.1.0-2.el9.noarch.rpm 326 kB/s | 16 kB 00:00 2024-09-13T02:43:15.271 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 19/34 2024-09-13T02:43:15.284 INFO:teuthology.orchestra.run.smithi131.stdout:(29/34): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.8 MB/s | 90 kB 00:00 2024-09-13T02:43:15.309 INFO:teuthology.orchestra.run.smithi131.stdout:(30/34): python3-tempora-5.0.0-2.el9.noarch.rpm 714 kB/s | 36 kB 00:00 2024-09-13T02:43:15.310 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 20/34 2024-09-13T02:43:15.343 INFO:teuthology.orchestra.run.smithi131.stdout:(31/34): python3-pecan-1.4.2-3.el9.noarch.rpm 1.7 MB/s | 272 kB 00:00 2024-09-13T02:43:15.367 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-ply-3.11-14.el9.noarch 21/34 2024-09-13T02:43:15.368 INFO:teuthology.orchestra.run.smithi131.stdout:(32/34): python3-webob-1.8.8-2.el9.noarch.rpm 2.7 MB/s | 230 kB 00:00 2024-09-13T02:43:15.393 INFO:teuthology.orchestra.run.smithi131.stdout:(33/34): python3-zc-lockfile-2.0-10.el9.noarch. 400 kB/s | 20 kB 00:00 2024-09-13T02:43:15.423 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 22/34 2024-09-13T02:43:15.427 INFO:teuthology.orchestra.run.smithi131.stdout:(34/34): python3-werkzeug-2.0.3-3.el9.1.noarch. 3.6 MB/s | 427 kB 00:00 2024-09-13T02:43:15.431 INFO:teuthology.orchestra.run.smithi131.stdout:-------------------------------------------------------------------------------- 2024-09-13T02:43:15.431 INFO:teuthology.orchestra.run.smithi131.stdout:Total 12 MB/s | 27 MB 00:02 2024-09-13T02:43:15.565 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction check 2024-09-13T02:43:15.601 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction check succeeded. 2024-09-13T02:43:15.601 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction test 2024-09-13T02:43:15.618 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 23/34 2024-09-13T02:43:15.665 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 24/34 2024-09-13T02:43:15.743 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 25/34 2024-09-13T02:43:15.831 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 26/34 2024-09-13T02:43:15.864 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 27/34 2024-09-13T02:43:15.981 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 28/34 2024-09-13T02:43:16.023 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction test succeeded. 2024-09-13T02:43:16.023 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction 2024-09-13T02:43:16.135 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-1627.gbbdadfa3.el9. 29/34 2024-09-13T02:43:16.167 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-2:17.2.7-1627.gbbdadfa3.el9.x86_64 30/34 2024-09-13T02:43:16.194 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mgr-2:17.2.7-1627.gbbdadfa3.el9.x86_64 30/34 2024-09-13T02:43:16.194 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T02:43:16.194 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-13T02:43:16.194 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T02:43:16.194 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T02:43:16.194 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:43:17.255 INFO:teuthology.orchestra.run.smithi131.stdout: Preparing : 1/1 2024-09-13T02:43:17.321 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/34 2024-09-13T02:43:17.354 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/34 2024-09-13T02:43:17.387 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 3/34 2024-09-13T02:43:17.479 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 4/34 2024-09-13T02:43:17.517 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-osd-2:17.2.7-1627.gbbdadfa3.el9.x86_64 31/34 2024-09-13T02:43:17.545 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-osd-2:17.2.7-1627.gbbdadfa3.el9.x86_64 31/34 2024-09-13T02:43:17.545 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T02:43:17.545 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-13T02:43:17.545 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T02:43:17.545 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T02:43:17.545 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:43:17.557 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 5/34 2024-09-13T02:43:17.597 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 6/34 2024-09-13T02:43:17.641 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 7/34 2024-09-13T02:43:17.671 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 8/34 2024-09-13T02:43:17.705 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 9/34 2024-09-13T02:43:17.742 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 10/34 2024-09-13T02:43:17.783 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 11/34 2024-09-13T02:43:17.818 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 12/34 2024-09-13T02:43:17.852 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 13/34 2024-09-13T02:43:17.901 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 14/34 2024-09-13T02:43:17.918 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mon-2:17.2.7-1627.gbbdadfa3.el9.x86_64 32/34 2024-09-13T02:43:17.933 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-packaging-20.9-5.el9.noarch 15/34 2024-09-13T02:43:17.942 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mon-2:17.2.7-1627.gbbdadfa3.el9.x86_64 32/34 2024-09-13T02:43:17.943 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T02:43:17.943 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-13T02:43:17.943 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T02:43:17.943 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T02:43:17.943 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:43:18.005 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 16/34 2024-09-13T02:43:18.143 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 17/34 2024-09-13T02:43:18.144 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mds-2:17.2.7-1627.gbbdadfa3.el9.x86_64 33/34 2024-09-13T02:43:18.168 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mds-2:17.2.7-1627.gbbdadfa3.el9.x86_64 33/34 2024-09-13T02:43:18.168 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T02:43:18.168 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-13T02:43:18.168 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T02:43:18.168 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T02:43:18.168 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:43:18.232 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 18/34 2024-09-13T02:43:18.233 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-2:17.2.7-1627.gbbdadfa3.el9.x86_64 34/34 2024-09-13T02:43:18.286 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 19/34 2024-09-13T02:43:18.325 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 20/34 2024-09-13T02:43:18.390 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-ply-3.11-14.el9.noarch 21/34 2024-09-13T02:43:18.445 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 22/34 2024-09-13T02:43:18.631 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 23/34 2024-09-13T02:43:18.688 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 24/34 2024-09-13T02:43:18.764 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 25/34 2024-09-13T02:43:18.853 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 26/34 2024-09-13T02:43:18.894 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 27/34 2024-09-13T02:43:19.010 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 28/34 2024-09-13T02:43:19.165 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mgr-modules-core-2:17.2.7-1627.gbbdadfa3.el9. 29/34 2024-09-13T02:43:19.197 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mgr-2:17.2.7-1627.gbbdadfa3.el9.x86_64 30/34 2024-09-13T02:43:19.222 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-mgr-2:17.2.7-1627.gbbdadfa3.el9.x86_64 30/34 2024-09-13T02:43:19.222 INFO:teuthology.orchestra.run.smithi131.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T02:43:19.222 INFO:teuthology.orchestra.run.smithi131.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-13T02:43:19.222 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T02:43:19.222 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-13T02:43:19.223 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-13T02:43:19.953 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-2:17.2.7-1627.gbbdadfa3.el9.x86_64 34/34 2024-09-13T02:43:19.953 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-2:17.2.7-1627.gbbdadfa3.el9.x86_64 1/34 2024-09-13T02:43:19.953 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mds-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2/34 2024-09-13T02:43:19.953 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-2:17.2.7-1627.gbbdadfa3.el9.x86_64 3/34 2024-09-13T02:43:19.953 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mon-2:17.2.7-1627.gbbdadfa3.el9.x86_64 4/34 2024-09-13T02:43:19.953 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-osd-2:17.2.7-1627.gbbdadfa3.el9.x86_64 5/34 2024-09-13T02:43:19.953 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-1627.gbbdadfa3.el9. 6/34 2024-09-13T02:43:19.953 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/34 2024-09-13T02:43:19.953 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/34 2024-09-13T02:43:19.953 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/34 2024-09-13T02:43:19.953 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/34 2024-09-13T02:43:19.954 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/34 2024-09-13T02:43:19.954 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/34 2024-09-13T02:43:19.954 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 13/34 2024-09-13T02:43:19.954 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 14/34 2024-09-13T02:43:19.954 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 15/34 2024-09-13T02:43:19.954 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 16/34 2024-09-13T02:43:19.954 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 17/34 2024-09-13T02:43:19.954 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 18/34 2024-09-13T02:43:19.954 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 19/34 2024-09-13T02:43:19.954 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 20/34 2024-09-13T02:43:19.954 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 21/34 2024-09-13T02:43:19.954 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 22/34 2024-09-13T02:43:19.955 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 23/34 2024-09-13T02:43:19.955 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 24/34 2024-09-13T02:43:19.955 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 25/34 2024-09-13T02:43:19.955 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 26/34 2024-09-13T02:43:19.955 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 27/34 2024-09-13T02:43:19.955 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 28/34 2024-09-13T02:43:19.955 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 29/34 2024-09-13T02:43:19.955 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 30/34 2024-09-13T02:43:19.955 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 31/34 2024-09-13T02:43:19.955 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 32/34 2024-09-13T02:43:19.955 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 33/34 2024-09-13T02:43:20.590 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-osd-2:17.2.7-1627.gbbdadfa3.el9.x86_64 31/34 2024-09-13T02:43:20.618 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-osd-2:17.2.7-1627.gbbdadfa3.el9.x86_64 31/34 2024-09-13T02:43:20.618 INFO:teuthology.orchestra.run.smithi131.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T02:43:20.618 INFO:teuthology.orchestra.run.smithi131.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-13T02:43:20.618 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T02:43:20.618 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-13T02:43:20.619 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-13T02:43:20.762 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 34/34 2024-09-13T02:43:20.762 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:43:20.762 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2024-09-13T02:43:20.762 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:43:20.762 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mds-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:43:20.762 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:43:20.762 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-modules-core-2:17.2.7-1627.gbbdadfa3.el9.noarch 2024-09-13T02:43:20.762 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mon-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:43:20.762 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-osd-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:43:20.762 INFO:teuthology.orchestra.run.smithi089.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-13T02:43:20.763 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-13T02:43:20.763 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-13T02:43:20.763 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-13T02:43:20.763 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-13T02:43:20.763 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-13T02:43:20.763 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-13T02:43:20.763 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-13T02:43:20.763 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-13T02:43:20.763 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-13T02:43:20.763 INFO:teuthology.orchestra.run.smithi089.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-13T02:43:20.763 INFO:teuthology.orchestra.run.smithi089.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-13T02:43:20.763 INFO:teuthology.orchestra.run.smithi089.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-13T02:43:20.763 INFO:teuthology.orchestra.run.smithi089.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-13T02:43:20.763 INFO:teuthology.orchestra.run.smithi089.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-13T02:43:20.764 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-13T02:43:20.764 INFO:teuthology.orchestra.run.smithi089.stdout: python3-ply-3.11-14.el9.noarch 2024-09-13T02:43:20.764 INFO:teuthology.orchestra.run.smithi089.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-13T02:43:20.764 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-13T02:43:20.764 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-13T02:43:20.764 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-13T02:43:20.764 INFO:teuthology.orchestra.run.smithi089.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-13T02:43:20.764 INFO:teuthology.orchestra.run.smithi089.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-13T02:43:20.764 INFO:teuthology.orchestra.run.smithi089.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-13T02:43:20.764 INFO:teuthology.orchestra.run.smithi089.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-13T02:43:20.764 INFO:teuthology.orchestra.run.smithi089.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-13T02:43:20.764 INFO:teuthology.orchestra.run.smithi089.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-13T02:43:20.764 INFO:teuthology.orchestra.run.smithi089.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-13T02:43:20.765 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:43:20.765 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-09-13T02:43:20.996 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mon-2:17.2.7-1627.gbbdadfa3.el9.x86_64 32/34 2024-09-13T02:43:21.020 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-mon-2:17.2.7-1627.gbbdadfa3.el9.x86_64 32/34 2024-09-13T02:43:21.020 INFO:teuthology.orchestra.run.smithi131.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T02:43:21.021 INFO:teuthology.orchestra.run.smithi131.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-13T02:43:21.021 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T02:43:21.021 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-13T02:43:21.021 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-13T02:43:21.165 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install ceph-base 2024-09-13T02:43:21.213 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mds-2:17.2.7-1627.gbbdadfa3.el9.x86_64 33/34 2024-09-13T02:43:21.237 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-mds-2:17.2.7-1627.gbbdadfa3.el9.x86_64 33/34 2024-09-13T02:43:21.237 INFO:teuthology.orchestra.run.smithi131.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T02:43:21.237 INFO:teuthology.orchestra.run.smithi131.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-13T02:43:21.237 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T02:43:21.237 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-13T02:43:21.238 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-13T02:43:21.293 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-2:17.2.7-1627.gbbdadfa3.el9.x86_64 34/34 2024-09-13T02:43:21.730 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:00:48 ago on Fri 13 Sep 2024 02:42:33 AM UTC. 2024-09-13T02:43:21.819 INFO:teuthology.orchestra.run.smithi089.stdout:Package ceph-base-2:17.2.7-1627.gbbdadfa3.el9.x86_64 is already installed. 2024-09-13T02:43:21.860 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-09-13T02:43:21.861 INFO:teuthology.orchestra.run.smithi089.stdout:Nothing to do. 2024-09-13T02:43:21.861 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-09-13T02:43:21.934 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install cephadm 2024-09-13T02:43:22.495 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:00:49 ago on Fri 13 Sep 2024 02:42:33 AM UTC. 2024-09-13T02:43:22.626 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-09-13T02:43:22.627 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-13T02:43:22.627 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repository Size 2024-09-13T02:43:22.627 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-13T02:43:22.627 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2024-09-13T02:43:22.627 INFO:teuthology.orchestra.run.smithi089.stdout: cephadm noarch 2:17.2.7-1627.gbbdadfa3.el9 ceph-noarch 83 k 2024-09-13T02:43:22.628 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:43:22.628 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2024-09-13T02:43:22.628 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-13T02:43:22.628 INFO:teuthology.orchestra.run.smithi089.stdout:Install 1 Package 2024-09-13T02:43:22.628 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:43:22.628 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 83 k 2024-09-13T02:43:22.628 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 375 k 2024-09-13T02:43:22.628 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2024-09-13T02:43:22.827 INFO:teuthology.orchestra.run.smithi089.stdout:cephadm-17.2.7-1627.gbbdadfa3.el9.noarch.rpm 416 kB/s | 83 kB 00:00 2024-09-13T02:43:22.827 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2024-09-13T02:43:22.827 INFO:teuthology.orchestra.run.smithi089.stdout:Total 413 kB/s | 83 kB 00:00 2024-09-13T02:43:22.828 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2024-09-13T02:43:22.833 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2024-09-13T02:43:22.833 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2024-09-13T02:43:22.835 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2024-09-13T02:43:22.835 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2024-09-13T02:43:22.908 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2024-09-13T02:43:22.981 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-2:17.2.7-1627.gbbdadfa3.el9.x86_64 34/34 2024-09-13T02:43:22.981 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-2:17.2.7-1627.gbbdadfa3.el9.x86_64 1/34 2024-09-13T02:43:22.982 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mds-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2/34 2024-09-13T02:43:22.982 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mgr-2:17.2.7-1627.gbbdadfa3.el9.x86_64 3/34 2024-09-13T02:43:22.982 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mon-2:17.2.7-1627.gbbdadfa3.el9.x86_64 4/34 2024-09-13T02:43:22.982 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-osd-2:17.2.7-1627.gbbdadfa3.el9.x86_64 5/34 2024-09-13T02:43:22.982 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-1627.gbbdadfa3.el9. 6/34 2024-09-13T02:43:22.982 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/34 2024-09-13T02:43:22.982 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/34 2024-09-13T02:43:22.982 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/34 2024-09-13T02:43:22.982 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/34 2024-09-13T02:43:22.982 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/34 2024-09-13T02:43:22.982 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/34 2024-09-13T02:43:22.982 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 13/34 2024-09-13T02:43:22.982 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 14/34 2024-09-13T02:43:22.983 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 15/34 2024-09-13T02:43:22.983 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 16/34 2024-09-13T02:43:22.983 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 17/34 2024-09-13T02:43:22.983 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 18/34 2024-09-13T02:43:22.983 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 19/34 2024-09-13T02:43:22.983 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 20/34 2024-09-13T02:43:22.983 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 21/34 2024-09-13T02:43:22.983 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 22/34 2024-09-13T02:43:22.983 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 23/34 2024-09-13T02:43:22.983 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 24/34 2024-09-13T02:43:22.983 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 25/34 2024-09-13T02:43:22.984 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 26/34 2024-09-13T02:43:22.984 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 27/34 2024-09-13T02:43:22.984 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 28/34 2024-09-13T02:43:22.985 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 29/34 2024-09-13T02:43:22.985 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 30/34 2024-09-13T02:43:22.985 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 31/34 2024-09-13T02:43:22.985 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 32/34 2024-09-13T02:43:22.985 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 33/34 2024-09-13T02:43:23.354 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: cephadm-2:17.2.7-1627.gbbdadfa3.el9.noarch 1/1 2024-09-13T02:43:23.441 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : cephadm-2:17.2.7-1627.gbbdadfa3.el9.noarch 1/1 2024-09-13T02:43:23.774 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 34/34 2024-09-13T02:43:23.775 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-13T02:43:23.775 INFO:teuthology.orchestra.run.smithi131.stdout:Installed: 2024-09-13T02:43:23.775 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:43:23.775 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mds-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:43:23.775 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:43:23.775 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-modules-core-2:17.2.7-1627.gbbdadfa3.el9.noarch 2024-09-13T02:43:23.775 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mon-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:43:23.775 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-osd-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:43:23.775 INFO:teuthology.orchestra.run.smithi131.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-13T02:43:23.775 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-13T02:43:23.775 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-13T02:43:23.775 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-13T02:43:23.776 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-13T02:43:23.776 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-13T02:43:23.776 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-13T02:43:23.776 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-13T02:43:23.776 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-13T02:43:23.776 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-13T02:43:23.776 INFO:teuthology.orchestra.run.smithi131.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-13T02:43:23.776 INFO:teuthology.orchestra.run.smithi131.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-13T02:43:23.776 INFO:teuthology.orchestra.run.smithi131.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-13T02:43:23.776 INFO:teuthology.orchestra.run.smithi131.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-13T02:43:23.776 INFO:teuthology.orchestra.run.smithi131.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-13T02:43:23.776 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-13T02:43:23.776 INFO:teuthology.orchestra.run.smithi131.stdout: python3-ply-3.11-14.el9.noarch 2024-09-13T02:43:23.777 INFO:teuthology.orchestra.run.smithi131.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-13T02:43:23.777 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-13T02:43:23.777 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-13T02:43:23.777 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-13T02:43:23.777 INFO:teuthology.orchestra.run.smithi131.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-13T02:43:23.777 INFO:teuthology.orchestra.run.smithi131.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-13T02:43:23.777 INFO:teuthology.orchestra.run.smithi131.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-13T02:43:23.777 INFO:teuthology.orchestra.run.smithi131.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-13T02:43:23.777 INFO:teuthology.orchestra.run.smithi131.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-13T02:43:23.777 INFO:teuthology.orchestra.run.smithi131.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-13T02:43:23.777 INFO:teuthology.orchestra.run.smithi131.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-13T02:43:23.777 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-13T02:43:23.777 INFO:teuthology.orchestra.run.smithi131.stdout:Complete! 2024-09-13T02:43:23.803 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: cephadm-2:17.2.7-1627.gbbdadfa3.el9.noarch 1/1 2024-09-13T02:43:24.047 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : cephadm-2:17.2.7-1627.gbbdadfa3.el9.noarch 1/1 2024-09-13T02:43:24.047 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:43:24.047 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2024-09-13T02:43:24.047 INFO:teuthology.orchestra.run.smithi089.stdout: cephadm-2:17.2.7-1627.gbbdadfa3.el9.noarch 2024-09-13T02:43:24.048 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:43:24.048 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-09-13T02:43:24.151 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum -y install ceph-base 2024-09-13T02:43:24.266 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install ceph-immutable-object-cache 2024-09-13T02:43:24.728 INFO:teuthology.orchestra.run.smithi131.stdout:Last metadata expiration check: 0:00:51 ago on Fri 13 Sep 2024 02:42:33 AM UTC. 2024-09-13T02:43:24.818 INFO:teuthology.orchestra.run.smithi131.stdout:Package ceph-base-2:17.2.7-1627.gbbdadfa3.el9.x86_64 is already installed. 2024-09-13T02:43:24.841 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:00:51 ago on Fri 13 Sep 2024 02:42:33 AM UTC. 2024-09-13T02:43:24.859 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2024-09-13T02:43:24.860 INFO:teuthology.orchestra.run.smithi131.stdout:Nothing to do. 2024-09-13T02:43:24.860 INFO:teuthology.orchestra.run.smithi131.stdout:Complete! 2024-09-13T02:43:24.942 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum -y install cephadm 2024-09-13T02:43:24.976 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-09-13T02:43:24.977 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-13T02:43:24.977 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repo Size 2024-09-13T02:43:24.977 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-13T02:43:24.977 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2024-09-13T02:43:24.977 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 137 k 2024-09-13T02:43:24.977 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:43:24.977 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2024-09-13T02:43:24.978 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-13T02:43:24.978 INFO:teuthology.orchestra.run.smithi089.stdout:Install 1 Package 2024-09-13T02:43:24.978 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:43:24.978 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 137 k 2024-09-13T02:43:24.978 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 379 k 2024-09-13T02:43:24.978 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2024-09-13T02:43:25.187 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-immutable-object-cache-17.2.7-1627.gbbdadf 660 kB/s | 137 kB 00:00 2024-09-13T02:43:25.187 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2024-09-13T02:43:25.187 INFO:teuthology.orchestra.run.smithi089.stdout:Total 654 kB/s | 137 kB 00:00 2024-09-13T02:43:25.188 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2024-09-13T02:43:25.195 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2024-09-13T02:43:25.195 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2024-09-13T02:43:25.251 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2024-09-13T02:43:25.251 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2024-09-13T02:43:25.397 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2024-09-13T02:43:25.488 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-1627.gbbdadfa3. 1/1 2024-09-13T02:43:25.504 INFO:teuthology.orchestra.run.smithi131.stdout:Last metadata expiration check: 0:00:52 ago on Fri 13 Sep 2024 02:42:33 AM UTC. 2024-09-13T02:43:25.515 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-1627.gbbdadfa3. 1/1 2024-09-13T02:43:25.515 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T02:43:25.515 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-13T02:43:25.515 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:43:25.636 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2024-09-13T02:43:25.637 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-09-13T02:43:25.637 INFO:teuthology.orchestra.run.smithi131.stdout: Package Arch Version Repository Size 2024-09-13T02:43:25.637 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-09-13T02:43:25.637 INFO:teuthology.orchestra.run.smithi131.stdout:Installing: 2024-09-13T02:43:25.637 INFO:teuthology.orchestra.run.smithi131.stdout: cephadm noarch 2:17.2.7-1627.gbbdadfa3.el9 ceph-noarch 83 k 2024-09-13T02:43:25.637 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-13T02:43:25.637 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction Summary 2024-09-13T02:43:25.638 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-09-13T02:43:25.638 INFO:teuthology.orchestra.run.smithi131.stdout:Install 1 Package 2024-09-13T02:43:25.638 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-13T02:43:25.638 INFO:teuthology.orchestra.run.smithi131.stdout:Total download size: 83 k 2024-09-13T02:43:25.638 INFO:teuthology.orchestra.run.smithi131.stdout:Installed size: 375 k 2024-09-13T02:43:25.638 INFO:teuthology.orchestra.run.smithi131.stdout:Downloading Packages: 2024-09-13T02:43:25.829 INFO:teuthology.orchestra.run.smithi131.stdout:cephadm-17.2.7-1627.gbbdadfa3.el9.noarch.rpm 431 kB/s | 83 kB 00:00 2024-09-13T02:43:25.830 INFO:teuthology.orchestra.run.smithi131.stdout:-------------------------------------------------------------------------------- 2024-09-13T02:43:25.830 INFO:teuthology.orchestra.run.smithi131.stdout:Total 428 kB/s | 83 kB 00:00 2024-09-13T02:43:25.830 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction check 2024-09-13T02:43:25.835 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction check succeeded. 2024-09-13T02:43:25.835 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction test 2024-09-13T02:43:25.837 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction test succeeded. 2024-09-13T02:43:25.838 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction 2024-09-13T02:43:25.905 INFO:teuthology.orchestra.run.smithi131.stdout: Preparing : 1/1 2024-09-13T02:43:26.387 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: cephadm-2:17.2.7-1627.gbbdadfa3.el9.noarch 1/1 2024-09-13T02:43:26.406 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-1627.gbbdadfa3. 1/1 2024-09-13T02:43:26.406 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:43:26.406 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2024-09-13T02:43:26.406 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-immutable-object-cache-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:43:26.407 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:43:26.407 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-09-13T02:43:26.475 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : cephadm-2:17.2.7-1627.gbbdadfa3.el9.noarch 1/1 2024-09-13T02:43:26.622 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install ceph-mgr 2024-09-13T02:43:26.801 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: cephadm-2:17.2.7-1627.gbbdadfa3.el9.noarch 1/1 2024-09-13T02:43:27.056 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : cephadm-2:17.2.7-1627.gbbdadfa3.el9.noarch 1/1 2024-09-13T02:43:27.056 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-13T02:43:27.056 INFO:teuthology.orchestra.run.smithi131.stdout:Installed: 2024-09-13T02:43:27.056 INFO:teuthology.orchestra.run.smithi131.stdout: cephadm-2:17.2.7-1627.gbbdadfa3.el9.noarch 2024-09-13T02:43:27.057 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-13T02:43:27.057 INFO:teuthology.orchestra.run.smithi131.stdout:Complete! 2024-09-13T02:43:27.194 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:00:54 ago on Fri 13 Sep 2024 02:42:33 AM UTC. 2024-09-13T02:43:27.284 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum -y install ceph-immutable-object-cache 2024-09-13T02:43:27.284 INFO:teuthology.orchestra.run.smithi089.stdout:Package ceph-mgr-2:17.2.7-1627.gbbdadfa3.el9.x86_64 is already installed. 2024-09-13T02:43:27.325 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-09-13T02:43:27.326 INFO:teuthology.orchestra.run.smithi089.stdout:Nothing to do. 2024-09-13T02:43:27.326 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-09-13T02:43:27.399 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install ceph-mgr-dashboard 2024-09-13T02:43:27.862 INFO:teuthology.orchestra.run.smithi131.stdout:Last metadata expiration check: 0:00:54 ago on Fri 13 Sep 2024 02:42:33 AM UTC. 2024-09-13T02:43:27.957 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:00:54 ago on Fri 13 Sep 2024 02:42:33 AM UTC. 2024-09-13T02:43:27.998 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2024-09-13T02:43:27.998 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-09-13T02:43:27.998 INFO:teuthology.orchestra.run.smithi131.stdout: Package Arch Version Repo Size 2024-09-13T02:43:27.999 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-09-13T02:43:27.999 INFO:teuthology.orchestra.run.smithi131.stdout:Installing: 2024-09-13T02:43:27.999 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-immutable-object-cache x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 137 k 2024-09-13T02:43:27.999 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-13T02:43:27.999 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction Summary 2024-09-13T02:43:27.999 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-09-13T02:43:27.999 INFO:teuthology.orchestra.run.smithi131.stdout:Install 1 Package 2024-09-13T02:43:27.999 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-13T02:43:28.000 INFO:teuthology.orchestra.run.smithi131.stdout:Total download size: 137 k 2024-09-13T02:43:28.000 INFO:teuthology.orchestra.run.smithi131.stdout:Installed size: 379 k 2024-09-13T02:43:28.000 INFO:teuthology.orchestra.run.smithi131.stdout:Downloading Packages: 2024-09-13T02:43:28.089 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-09-13T02:43:28.089 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-13T02:43:28.090 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repository Size 2024-09-13T02:43:28.090 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-13T02:43:28.090 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2024-09-13T02:43:28.090 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-dashboard noarch 2:17.2.7-1627.gbbdadfa3.el9 ceph-noarch 3.4 M 2024-09-13T02:43:28.090 INFO:teuthology.orchestra.run.smithi089.stdout:Installing dependencies: 2024-09-13T02:43:28.090 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-grafana-dashboards noarch 2:17.2.7-1627.gbbdadfa3.el9 ceph-noarch 24 k 2024-09-13T02:43:28.090 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-prometheus-alerts noarch 2:17.2.7-1627.gbbdadfa3.el9 ceph-noarch 15 k 2024-09-13T02:43:28.090 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-09-13T02:43:28.090 INFO:teuthology.orchestra.run.smithi089.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-13T02:43:28.090 INFO:teuthology.orchestra.run.smithi089.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-13T02:43:28.090 INFO:teuthology.orchestra.run.smithi089.stdout:Installing weak dependencies: 2024-09-13T02:43:28.090 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-09-13T02:43:28.091 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:43:28.091 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2024-09-13T02:43:28.091 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-13T02:43:28.091 INFO:teuthology.orchestra.run.smithi089.stdout:Install 7 Packages 2024-09-13T02:43:28.091 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:43:28.091 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 3.7 M 2024-09-13T02:43:28.091 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 80 M 2024-09-13T02:43:28.092 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2024-09-13T02:43:28.202 INFO:teuthology.orchestra.run.smithi131.stdout:ceph-immutable-object-cache-17.2.7-1627.gbbdadf 678 kB/s | 137 kB 00:00 2024-09-13T02:43:28.203 INFO:teuthology.orchestra.run.smithi131.stdout:-------------------------------------------------------------------------------- 2024-09-13T02:43:28.203 INFO:teuthology.orchestra.run.smithi131.stdout:Total 674 kB/s | 137 kB 00:00 2024-09-13T02:43:28.203 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction check 2024-09-13T02:43:28.211 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction check succeeded. 2024-09-13T02:43:28.211 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction test 2024-09-13T02:43:28.267 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction test succeeded. 2024-09-13T02:43:28.267 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction 2024-09-13T02:43:28.300 INFO:teuthology.orchestra.run.smithi089.stdout:(1/7): ceph-grafana-dashboards-17.2.7-1627.gbbd 155 kB/s | 24 kB 00:00 2024-09-13T02:43:28.325 INFO:teuthology.orchestra.run.smithi089.stdout:(2/7): ceph-prometheus-alerts-17.2.7-1627.gbbda 80 kB/s | 15 kB 00:00 2024-09-13T02:43:28.367 INFO:teuthology.orchestra.run.smithi089.stdout:(3/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 135 kB/s | 9.0 kB 00:00 2024-09-13T02:43:28.393 INFO:teuthology.orchestra.run.smithi089.stdout:(4/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 1.3 MB/s | 31 kB 00:00 2024-09-13T02:43:28.409 INFO:teuthology.orchestra.run.smithi131.stdout: Preparing : 1/1 2024-09-13T02:43:28.418 INFO:teuthology.orchestra.run.smithi089.stdout:(5/7): python3-jwt-2.4.0-1.el9.noarch.rpm 443 kB/s | 41 kB 00:00 2024-09-13T02:43:28.443 INFO:teuthology.orchestra.run.smithi089.stdout:(6/7): python3-routes-2.5.1-5.el9.noarch.rpm 3.7 MB/s | 188 kB 00:00 2024-09-13T02:43:28.462 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-immutable-object-cache-2:17.2.7-1627.gbbdadfa3. 1/1 2024-09-13T02:43:28.487 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-1627.gbbdadfa3. 1/1 2024-09-13T02:43:28.487 INFO:teuthology.orchestra.run.smithi131.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T02:43:28.487 INFO:teuthology.orchestra.run.smithi131.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-13T02:43:28.487 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-13T02:43:28.743 INFO:teuthology.orchestra.run.smithi089.stdout:(7/7): ceph-mgr-dashboard-17.2.7-1627.gbbdadfa3 5.6 MB/s | 3.4 MB 00:00 2024-09-13T02:43:28.747 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2024-09-13T02:43:28.747 INFO:teuthology.orchestra.run.smithi089.stdout:Total 5.6 MB/s | 3.7 MB 00:00 2024-09-13T02:43:28.747 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2024-09-13T02:43:28.755 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2024-09-13T02:43:28.755 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2024-09-13T02:43:28.839 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2024-09-13T02:43:28.839 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2024-09-13T02:43:29.136 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2024-09-13T02:43:29.203 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2024-09-13T02:43:29.237 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2024-09-13T02:43:29.291 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2024-09-13T02:43:29.324 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2024-09-13T02:43:29.353 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-1627.gbbdadfa3.el9.n 5/7 2024-09-13T02:43:29.408 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-1627.gbbdadfa3. 1/1 2024-09-13T02:43:29.408 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-13T02:43:29.408 INFO:teuthology.orchestra.run.smithi131.stdout:Installed: 2024-09-13T02:43:29.408 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-immutable-object-cache-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:43:29.409 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-13T02:43:29.409 INFO:teuthology.orchestra.run.smithi131.stdout:Complete! 2024-09-13T02:43:29.625 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum -y install ceph-mgr 2024-09-13T02:43:30.202 INFO:teuthology.orchestra.run.smithi131.stdout:Last metadata expiration check: 0:00:57 ago on Fri 13 Sep 2024 02:42:33 AM UTC. 2024-09-13T02:43:30.292 INFO:teuthology.orchestra.run.smithi131.stdout:Package ceph-mgr-2:17.2.7-1627.gbbdadfa3.el9.x86_64 is already installed. 2024-09-13T02:43:30.333 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2024-09-13T02:43:30.334 INFO:teuthology.orchestra.run.smithi131.stdout:Nothing to do. 2024-09-13T02:43:30.334 INFO:teuthology.orchestra.run.smithi131.stdout:Complete! 2024-09-13T02:43:30.339 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-1627.gbbdadfa3.el9. 6/7 2024-09-13T02:43:30.381 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-1627.gbbdadfa3.el9.noarc 7/7 2024-09-13T02:43:30.413 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum -y install ceph-mgr-dashboard 2024-09-13T02:43:30.993 INFO:teuthology.orchestra.run.smithi131.stdout:Last metadata expiration check: 0:00:57 ago on Fri 13 Sep 2024 02:42:33 AM UTC. 2024-09-13T02:43:31.124 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2024-09-13T02:43:31.125 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-09-13T02:43:31.125 INFO:teuthology.orchestra.run.smithi131.stdout: Package Arch Version Repository Size 2024-09-13T02:43:31.125 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-09-13T02:43:31.125 INFO:teuthology.orchestra.run.smithi131.stdout:Installing: 2024-09-13T02:43:31.125 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-dashboard noarch 2:17.2.7-1627.gbbdadfa3.el9 ceph-noarch 3.4 M 2024-09-13T02:43:31.125 INFO:teuthology.orchestra.run.smithi131.stdout:Installing dependencies: 2024-09-13T02:43:31.125 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-grafana-dashboards noarch 2:17.2.7-1627.gbbdadfa3.el9 ceph-noarch 24 k 2024-09-13T02:43:31.125 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-prometheus-alerts noarch 2:17.2.7-1627.gbbdadfa3.el9 ceph-noarch 15 k 2024-09-13T02:43:31.125 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2024-09-13T02:43:31.126 INFO:teuthology.orchestra.run.smithi131.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-13T02:43:31.126 INFO:teuthology.orchestra.run.smithi131.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-13T02:43:31.126 INFO:teuthology.orchestra.run.smithi131.stdout:Installing weak dependencies: 2024-09-13T02:43:31.126 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2024-09-13T02:43:31.126 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-13T02:43:31.126 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction Summary 2024-09-13T02:43:31.126 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-09-13T02:43:31.126 INFO:teuthology.orchestra.run.smithi131.stdout:Install 7 Packages 2024-09-13T02:43:31.126 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-13T02:43:31.127 INFO:teuthology.orchestra.run.smithi131.stdout:Total download size: 3.7 M 2024-09-13T02:43:31.127 INFO:teuthology.orchestra.run.smithi131.stdout:Installed size: 80 M 2024-09-13T02:43:31.127 INFO:teuthology.orchestra.run.smithi131.stdout:Downloading Packages: 2024-09-13T02:43:31.409 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-1627.gbbdadfa3.el9.noarc 7/7 2024-09-13T02:43:31.409 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-1627.gbbdadfa3.el9. 1/7 2024-09-13T02:43:31.409 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-1627.gbbdadfa3.el9.noarc 2/7 2024-09-13T02:43:31.409 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-1627.gbbdadfa3.el9.n 3/7 2024-09-13T02:43:31.409 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2024-09-13T02:43:31.409 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2024-09-13T02:43:31.409 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2024-09-13T02:43:31.648 INFO:teuthology.orchestra.run.smithi131.stdout:(1/7): ceph-grafana-dashboards-17.2.7-1627.gbbd 155 kB/s | 24 kB 00:00 2024-09-13T02:43:31.673 INFO:teuthology.orchestra.run.smithi131.stdout:(2/7): ceph-prometheus-alerts-17.2.7-1627.gbbda 80 kB/s | 15 kB 00:00 2024-09-13T02:43:31.689 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2024-09-13T02:43:31.689 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:43:31.689 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2024-09-13T02:43:31.689 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-grafana-dashboards-2:17.2.7-1627.gbbdadfa3.el9.noarch 2024-09-13T02:43:31.689 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-dashboard-2:17.2.7-1627.gbbdadfa3.el9.noarch 2024-09-13T02:43:31.689 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-prometheus-alerts-2:17.2.7-1627.gbbdadfa3.el9.noarch 2024-09-13T02:43:31.689 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-09-13T02:43:31.689 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-09-13T02:43:31.689 INFO:teuthology.orchestra.run.smithi089.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-13T02:43:31.690 INFO:teuthology.orchestra.run.smithi089.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-13T02:43:31.690 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:43:31.690 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-09-13T02:43:31.723 INFO:teuthology.orchestra.run.smithi131.stdout:(3/7): python3-jwt+crypto-2.4.0-1.el9.noarch.rp 120 kB/s | 9.0 kB 00:00 2024-09-13T02:43:31.757 INFO:teuthology.orchestra.run.smithi131.stdout:(4/7): python3-repoze-lru-0.7-16.el9.noarch.rpm 976 kB/s | 31 kB 00:00 2024-09-13T02:43:31.783 INFO:teuthology.orchestra.run.smithi131.stdout:(5/7): python3-jwt-2.4.0-1.el9.noarch.rpm 375 kB/s | 41 kB 00:00 2024-09-13T02:43:31.808 INFO:teuthology.orchestra.run.smithi131.stdout:(6/7): python3-routes-2.5.1-5.el9.noarch.rpm 3.6 MB/s | 188 kB 00:00 2024-09-13T02:43:31.892 INFO:teuthology.orchestra.run.smithi131.stdout:(7/7): ceph-mgr-dashboard-17.2.7-1627.gbbdadfa3 8.4 MB/s | 3.4 MB 00:00 2024-09-13T02:43:31.895 INFO:teuthology.orchestra.run.smithi131.stdout:-------------------------------------------------------------------------------- 2024-09-13T02:43:31.895 INFO:teuthology.orchestra.run.smithi131.stdout:Total 4.7 MB/s | 3.7 MB 00:00 2024-09-13T02:43:31.895 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction check 2024-09-13T02:43:31.903 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction check succeeded. 2024-09-13T02:43:31.904 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction test 2024-09-13T02:43:31.923 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-13T02:43:31.987 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction test succeeded. 2024-09-13T02:43:31.987 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction 2024-09-13T02:43:32.292 INFO:teuthology.orchestra.run.smithi131.stdout: Preparing : 1/1 2024-09-13T02:43:32.351 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 1/7 2024-09-13T02:43:32.385 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 2/7 2024-09-13T02:43:32.432 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/7 2024-09-13T02:43:32.464 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/7 2024-09-13T02:43:32.480 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:00:59 ago on Fri 13 Sep 2024 02:42:33 AM UTC. 2024-09-13T02:43:32.492 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-prometheus-alerts-2:17.2.7-1627.gbbdadfa3.el9.n 5/7 2024-09-13T02:43:32.614 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-09-13T02:43:32.615 INFO:teuthology.orchestra.run.smithi089.stdout:======================================================================================= 2024-09-13T02:43:32.615 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repository Size 2024-09-13T02:43:32.615 INFO:teuthology.orchestra.run.smithi089.stdout:======================================================================================= 2024-09-13T02:43:32.615 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2024-09-13T02:43:32.615 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-1627.gbbdadfa3.el9 ceph-noarch 7.4 M 2024-09-13T02:43:32.615 INFO:teuthology.orchestra.run.smithi089.stdout:Installing dependencies: 2024-09-13T02:43:32.615 INFO:teuthology.orchestra.run.smithi089.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-13T02:43:32.615 INFO:teuthology.orchestra.run.smithi089.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-13T02:43:32.615 INFO:teuthology.orchestra.run.smithi089.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-13T02:43:32.615 INFO:teuthology.orchestra.run.smithi089.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-13T02:43:32.616 INFO:teuthology.orchestra.run.smithi089.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-13T02:43:32.616 INFO:teuthology.orchestra.run.smithi089.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-13T02:43:32.616 INFO:teuthology.orchestra.run.smithi089.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-13T02:43:32.616 INFO:teuthology.orchestra.run.smithi089.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-13T02:43:32.616 INFO:teuthology.orchestra.run.smithi089.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-13T02:43:32.616 INFO:teuthology.orchestra.run.smithi089.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-13T02:43:32.616 INFO:teuthology.orchestra.run.smithi089.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-13T02:43:32.616 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:43:32.616 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2024-09-13T02:43:32.616 INFO:teuthology.orchestra.run.smithi089.stdout:======================================================================================= 2024-09-13T02:43:32.616 INFO:teuthology.orchestra.run.smithi089.stdout:Install 12 Packages 2024-09-13T02:43:32.616 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:43:32.617 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 38 M 2024-09-13T02:43:32.617 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 212 M 2024-09-13T02:43:32.617 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2024-09-13T02:43:32.953 INFO:teuthology.orchestra.run.smithi089.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 1.1 MB/s | 191 kB 00:00 2024-09-13T02:43:33.003 INFO:teuthology.orchestra.run.smithi089.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 3.6 MB/s | 801 kB 00:00 2024-09-13T02:43:33.245 INFO:teuthology.orchestra.run.smithi089.stdout:(3/12): ceph-mgr-diskprediction-local-17.2.7-16 16 MB/s | 7.4 MB 00:00 2024-09-13T02:43:33.471 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-grafana-dashboards-2:17.2.7-1627.gbbdadfa3.el9. 6/7 2024-09-13T02:43:33.504 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mgr-dashboard-2:17.2.7-1627.gbbdadfa3.el9.noarc 7/7 2024-09-13T02:43:33.603 INFO:teuthology.orchestra.run.smithi089.stdout:(4/12): flexiblas-3.0.4-8.el9.x86_64.rpm 50 kB/s | 33 kB 00:00 2024-09-13T02:43:33.754 INFO:teuthology.orchestra.run.smithi089.stdout:(5/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 36 kB/s | 18 kB 00:00 2024-09-13T02:43:34.179 INFO:teuthology.orchestra.run.smithi089.stdout:(6/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 2.5 MB/s | 3.0 MB 00:01 2024-09-13T02:43:34.212 INFO:teuthology.orchestra.run.smithi089.stdout:(7/12): openblas-0.3.26-2.el9.x86_64.rpm 63 kB/s | 38 kB 00:00 2024-09-13T02:43:34.564 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.7-1627.gbbdadfa3.el9.noarc 7/7 2024-09-13T02:43:34.564 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-grafana-dashboards-2:17.2.7-1627.gbbdadfa3.el9. 1/7 2024-09-13T02:43:34.564 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mgr-dashboard-2:17.2.7-1627.gbbdadfa3.el9.noarc 2/7 2024-09-13T02:43:34.564 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-prometheus-alerts-2:17.2.7-1627.gbbdadfa3.el9.n 3/7 2024-09-13T02:43:34.564 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 4/7 2024-09-13T02:43:34.564 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 5/7 2024-09-13T02:43:34.564 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 6/7 2024-09-13T02:43:34.833 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 7/7 2024-09-13T02:43:34.833 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-13T02:43:34.833 INFO:teuthology.orchestra.run.smithi131.stdout:Installed: 2024-09-13T02:43:34.833 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-grafana-dashboards-2:17.2.7-1627.gbbdadfa3.el9.noarch 2024-09-13T02:43:34.833 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-dashboard-2:17.2.7-1627.gbbdadfa3.el9.noarch 2024-09-13T02:43:34.833 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-prometheus-alerts-2:17.2.7-1627.gbbdadfa3.el9.noarch 2024-09-13T02:43:34.833 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jwt-2.4.0-1.el9.noarch 2024-09-13T02:43:34.833 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2024-09-13T02:43:34.833 INFO:teuthology.orchestra.run.smithi131.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-13T02:43:34.833 INFO:teuthology.orchestra.run.smithi131.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-13T02:43:34.834 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-13T02:43:34.834 INFO:teuthology.orchestra.run.smithi131.stdout:Complete! 2024-09-13T02:43:34.879 INFO:teuthology.orchestra.run.smithi089.stdout:(8/12): openblas-openmp-0.3.26-2.el9.x86_64.rpm 4.4 MB/s | 4.9 MB 00:01 2024-09-13T02:43:35.013 INFO:teuthology.orchestra.run.smithi089.stdout:(9/12): python3-devel-3.9.19-8.el9.x86_64.rpm 294 kB/s | 245 kB 00:00 2024-09-13T02:43:35.070 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-13T02:43:35.627 INFO:teuthology.orchestra.run.smithi131.stdout:Last metadata expiration check: 0:01:02 ago on Fri 13 Sep 2024 02:42:33 AM UTC. 2024-09-13T02:43:35.655 INFO:teuthology.orchestra.run.smithi089.stdout:(10/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 323 kB/s | 250 kB 00:00 2024-09-13T02:43:35.760 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2024-09-13T02:43:35.761 INFO:teuthology.orchestra.run.smithi131.stdout:======================================================================================= 2024-09-13T02:43:35.761 INFO:teuthology.orchestra.run.smithi131.stdout: Package Arch Version Repository Size 2024-09-13T02:43:35.761 INFO:teuthology.orchestra.run.smithi131.stdout:======================================================================================= 2024-09-13T02:43:35.761 INFO:teuthology.orchestra.run.smithi131.stdout:Installing: 2024-09-13T02:43:35.761 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.7-1627.gbbdadfa3.el9 ceph-noarch 7.4 M 2024-09-13T02:43:35.761 INFO:teuthology.orchestra.run.smithi131.stdout:Installing dependencies: 2024-09-13T02:43:35.762 INFO:teuthology.orchestra.run.smithi131.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-13T02:43:35.762 INFO:teuthology.orchestra.run.smithi131.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-13T02:43:35.762 INFO:teuthology.orchestra.run.smithi131.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-13T02:43:35.762 INFO:teuthology.orchestra.run.smithi131.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-13T02:43:35.762 INFO:teuthology.orchestra.run.smithi131.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-13T02:43:35.762 INFO:teuthology.orchestra.run.smithi131.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-13T02:43:35.762 INFO:teuthology.orchestra.run.smithi131.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-13T02:43:35.762 INFO:teuthology.orchestra.run.smithi131.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-13T02:43:35.762 INFO:teuthology.orchestra.run.smithi131.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-13T02:43:35.762 INFO:teuthology.orchestra.run.smithi131.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-13T02:43:35.762 INFO:teuthology.orchestra.run.smithi131.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-13T02:43:35.763 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-13T02:43:35.763 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction Summary 2024-09-13T02:43:35.763 INFO:teuthology.orchestra.run.smithi131.stdout:======================================================================================= 2024-09-13T02:43:35.763 INFO:teuthology.orchestra.run.smithi131.stdout:Install 12 Packages 2024-09-13T02:43:35.763 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-13T02:43:35.763 INFO:teuthology.orchestra.run.smithi131.stdout:Total download size: 38 M 2024-09-13T02:43:35.763 INFO:teuthology.orchestra.run.smithi131.stdout:Installed size: 212 M 2024-09-13T02:43:35.764 INFO:teuthology.orchestra.run.smithi131.stdout:Downloading Packages: 2024-09-13T02:43:35.905 INFO:teuthology.orchestra.run.smithi089.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 3.0 MB/s | 5.1 MB 00:01 2024-09-13T02:43:36.258 INFO:teuthology.orchestra.run.smithi131.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 1.4 MB/s | 191 kB 00:00 2024-09-13T02:43:36.300 INFO:teuthology.orchestra.run.smithi131.stdout:(2/12): libgfortran-11.5.0-2.el9.x86_64.rpm 4.4 MB/s | 801 kB 00:00 2024-09-13T02:43:36.383 INFO:teuthology.orchestra.run.smithi131.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 261 kB/s | 33 kB 00:00 2024-09-13T02:43:36.434 INFO:teuthology.orchestra.run.smithi131.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 363 kB/s | 18 kB 00:00 2024-09-13T02:43:36.484 INFO:teuthology.orchestra.run.smithi131.stdout:(5/12): openblas-0.3.26-2.el9.x86_64.rpm 771 kB/s | 38 kB 00:00 2024-09-13T02:43:36.601 INFO:teuthology.orchestra.run.smithi131.stdout:(6/12): ceph-mgr-diskprediction-local-17.2.7-16 15 MB/s | 7.4 MB 00:00 2024-09-13T02:43:36.818 INFO:teuthology.orchestra.run.smithi131.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 1.1 MB/s | 245 kB 00:00 2024-09-13T02:43:37.277 INFO:teuthology.orchestra.run.smithi131.stdout:(8/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 3.1 MB/s | 3.0 MB 00:00 2024-09-13T02:43:37.435 INFO:teuthology.orchestra.run.smithi131.stdout:(9/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 8.3 MB/s | 5.1 MB 00:00 2024-09-13T02:43:37.460 INFO:teuthology.orchestra.run.smithi131.stdout:(10/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 1.3 MB/s | 250 kB 00:00 2024-09-13T02:43:37.786 INFO:teuthology.orchestra.run.smithi131.stdout:(11/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 46 MB/s | 16 MB 00:00 2024-09-13T02:43:38.052 INFO:teuthology.orchestra.run.smithi131.stdout:(12/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 3.2 MB/s | 4.9 MB 00:01 2024-09-13T02:43:38.053 INFO:teuthology.orchestra.run.smithi131.stdout:-------------------------------------------------------------------------------- 2024-09-13T02:43:38.053 INFO:teuthology.orchestra.run.smithi131.stdout:Total 17 MB/s | 38 MB 00:02 2024-09-13T02:43:38.321 INFO:teuthology.orchestra.run.smithi089.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 4.9 MB/s | 16 MB 00:03 2024-09-13T02:43:38.323 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2024-09-13T02:43:38.323 INFO:teuthology.orchestra.run.smithi089.stdout:Total 6.7 MB/s | 38 MB 00:05 2024-09-13T02:43:38.409 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction check 2024-09-13T02:43:38.435 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction check succeeded. 2024-09-13T02:43:38.435 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction test 2024-09-13T02:43:38.684 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2024-09-13T02:43:38.711 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2024-09-13T02:43:38.711 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2024-09-13T02:43:38.926 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction test succeeded. 2024-09-13T02:43:38.926 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction 2024-09-13T02:43:39.222 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2024-09-13T02:43:39.222 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2024-09-13T02:43:39.695 INFO:teuthology.orchestra.run.smithi131.stdout: Preparing : 1/1 2024-09-13T02:43:39.780 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-13T02:43:39.817 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-13T02:43:39.915 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-13T02:43:39.960 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-13T02:43:39.977 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2024-09-13T02:43:40.047 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-13T02:43:40.095 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-13T02:43:40.144 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-13T02:43:40.184 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-13T02:43:40.194 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-13T02:43:40.238 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-13T02:43:40.260 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-13T02:43:40.423 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-13T02:43:40.453 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-13T02:43:40.530 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-13T02:43:40.908 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-13T02:43:41.021 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-13T02:43:41.173 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-13T02:43:41.284 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-13T02:43:42.267 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-13T02:43:42.543 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-13T02:43:43.298 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-13T02:43:43.326 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-1627.gbbdad 12/12 2024-09-13T02:43:43.587 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-13T02:43:43.631 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.7-1627.gbbdad 12/12 2024-09-13T02:43:45.866 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-1627.gbbdad 12/12 2024-09-13T02:43:45.866 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-1627.gbbdad 1/12 2024-09-13T02:43:45.866 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-13T02:43:45.866 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-13T02:43:45.866 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-13T02:43:45.867 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-13T02:43:45.867 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-13T02:43:45.867 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-13T02:43:45.867 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-13T02:43:45.867 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-13T02:43:45.867 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-13T02:43:45.867 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-13T02:43:46.260 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.7-1627.gbbdad 12/12 2024-09-13T02:43:46.260 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.7-1627.gbbdad 1/12 2024-09-13T02:43:46.260 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-13T02:43:46.260 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-13T02:43:46.260 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-13T02:43:46.260 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-13T02:43:46.261 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-13T02:43:46.261 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-13T02:43:46.261 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-13T02:43:46.261 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-13T02:43:46.261 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-13T02:43:46.261 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-13T02:43:46.286 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-13T02:43:46.286 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-13T02:43:46.286 INFO:teuthology.orchestra.run.smithi131.stdout:Installed: 2024-09-13T02:43:46.286 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-diskprediction-local-2:17.2.7-1627.gbbdadfa3.el9.noarch 2024-09-13T02:43:46.287 INFO:teuthology.orchestra.run.smithi131.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-13T02:43:46.287 INFO:teuthology.orchestra.run.smithi131.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-13T02:43:46.287 INFO:teuthology.orchestra.run.smithi131.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-13T02:43:46.287 INFO:teuthology.orchestra.run.smithi131.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-13T02:43:46.287 INFO:teuthology.orchestra.run.smithi131.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-13T02:43:46.287 INFO:teuthology.orchestra.run.smithi131.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-13T02:43:46.287 INFO:teuthology.orchestra.run.smithi131.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-13T02:43:46.287 INFO:teuthology.orchestra.run.smithi131.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-13T02:43:46.287 INFO:teuthology.orchestra.run.smithi131.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-13T02:43:46.288 INFO:teuthology.orchestra.run.smithi131.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-13T02:43:46.288 INFO:teuthology.orchestra.run.smithi131.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-13T02:43:46.288 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-13T02:43:46.288 INFO:teuthology.orchestra.run.smithi131.stdout:Complete! 2024-09-13T02:43:46.705 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum -y install ceph-mgr-rook 2024-09-13T02:43:46.706 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-13T02:43:46.706 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:43:46.706 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2024-09-13T02:43:46.706 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-diskprediction-local-2:17.2.7-1627.gbbdadfa3.el9.noarch 2024-09-13T02:43:46.706 INFO:teuthology.orchestra.run.smithi089.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-13T02:43:46.706 INFO:teuthology.orchestra.run.smithi089.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-13T02:43:46.706 INFO:teuthology.orchestra.run.smithi089.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-13T02:43:46.706 INFO:teuthology.orchestra.run.smithi089.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-13T02:43:46.706 INFO:teuthology.orchestra.run.smithi089.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-13T02:43:46.707 INFO:teuthology.orchestra.run.smithi089.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-13T02:43:46.707 INFO:teuthology.orchestra.run.smithi089.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-13T02:43:46.707 INFO:teuthology.orchestra.run.smithi089.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-13T02:43:46.707 INFO:teuthology.orchestra.run.smithi089.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-13T02:43:46.707 INFO:teuthology.orchestra.run.smithi089.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-13T02:43:46.707 INFO:teuthology.orchestra.run.smithi089.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-13T02:43:46.707 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:43:46.707 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-09-13T02:43:47.104 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install ceph-mgr-rook 2024-09-13T02:43:47.274 INFO:teuthology.orchestra.run.smithi131.stdout:Last metadata expiration check: 0:01:14 ago on Fri 13 Sep 2024 02:42:33 AM UTC. 2024-09-13T02:43:47.406 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2024-09-13T02:43:47.407 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-09-13T02:43:47.408 INFO:teuthology.orchestra.run.smithi131.stdout: Package Arch Version Repository Size 2024-09-13T02:43:47.408 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-09-13T02:43:47.408 INFO:teuthology.orchestra.run.smithi131.stdout:Installing: 2024-09-13T02:43:47.408 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-rook noarch 2:17.2.7-1627.gbbdadfa3.el9 ceph-noarch 47 k 2024-09-13T02:43:47.408 INFO:teuthology.orchestra.run.smithi131.stdout:Installing dependencies: 2024-09-13T02:43:47.408 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-13T02:43:47.408 INFO:teuthology.orchestra.run.smithi131.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-13T02:43:47.408 INFO:teuthology.orchestra.run.smithi131.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-13T02:43:47.408 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-13T02:43:47.408 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-13T02:43:47.408 INFO:teuthology.orchestra.run.smithi131.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-13T02:43:47.408 INFO:teuthology.orchestra.run.smithi131.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-13T02:43:47.409 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-13T02:43:47.409 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-13T02:43:47.409 INFO:teuthology.orchestra.run.smithi131.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-13T02:43:47.409 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-13T02:43:47.409 INFO:teuthology.orchestra.run.smithi131.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-13T02:43:47.409 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-13T02:43:47.409 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction Summary 2024-09-13T02:43:47.409 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-09-13T02:43:47.409 INFO:teuthology.orchestra.run.smithi131.stdout:Install 13 Packages 2024-09-13T02:43:47.409 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-13T02:43:47.410 INFO:teuthology.orchestra.run.smithi131.stdout:Total download size: 2.2 M 2024-09-13T02:43:47.410 INFO:teuthology.orchestra.run.smithi131.stdout:Installed size: 26 M 2024-09-13T02:43:47.410 INFO:teuthology.orchestra.run.smithi131.stdout:Downloading Packages: 2024-09-13T02:43:47.618 INFO:teuthology.orchestra.run.smithi131.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 173 kB/s | 19 kB 00:00 2024-09-13T02:43:47.644 INFO:teuthology.orchestra.run.smithi131.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 189 kB/s | 26 kB 00:00 2024-09-13T02:43:47.669 INFO:teuthology.orchestra.run.smithi131.stdout:(3/13): ceph-mgr-rook-17.2.7-1627.gbbdadfa3.el9 295 kB/s | 47 kB 00:00 2024-09-13T02:43:47.678 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:01:14 ago on Fri 13 Sep 2024 02:42:33 AM UTC. 2024-09-13T02:43:47.761 INFO:teuthology.orchestra.run.smithi131.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.3 MB/s | 159 kB 00:00 2024-09-13T02:43:47.786 INFO:teuthology.orchestra.run.smithi131.stdout:(5/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 1.3 MB/s | 222 kB 00:00 2024-09-13T02:43:47.811 INFO:teuthology.orchestra.run.smithi131.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 1.0 MB/s | 54 kB 00:00 2024-09-13T02:43:47.812 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-09-13T02:43:47.813 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-13T02:43:47.813 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repository Size 2024-09-13T02:43:47.813 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-13T02:43:47.813 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2024-09-13T02:43:47.813 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-rook noarch 2:17.2.7-1627.gbbdadfa3.el9 ceph-noarch 47 k 2024-09-13T02:43:47.813 INFO:teuthology.orchestra.run.smithi089.stdout:Installing dependencies: 2024-09-13T02:43:47.813 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-13T02:43:47.814 INFO:teuthology.orchestra.run.smithi089.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-13T02:43:47.814 INFO:teuthology.orchestra.run.smithi089.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-13T02:43:47.814 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-13T02:43:47.814 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-13T02:43:47.814 INFO:teuthology.orchestra.run.smithi089.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-13T02:43:47.814 INFO:teuthology.orchestra.run.smithi089.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-13T02:43:47.814 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-13T02:43:47.814 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-13T02:43:47.814 INFO:teuthology.orchestra.run.smithi089.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-13T02:43:47.814 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-13T02:43:47.814 INFO:teuthology.orchestra.run.smithi089.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-13T02:43:47.814 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:43:47.815 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2024-09-13T02:43:47.815 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-13T02:43:47.815 INFO:teuthology.orchestra.run.smithi089.stdout:Install 13 Packages 2024-09-13T02:43:47.815 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:43:47.815 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 2.2 M 2024-09-13T02:43:47.815 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 26 M 2024-09-13T02:43:47.816 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2024-09-13T02:43:47.853 INFO:teuthology.orchestra.run.smithi131.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 481 kB/s | 32 kB 00:00 2024-09-13T02:43:47.887 INFO:teuthology.orchestra.run.smithi131.stdout:(8/13): python3-certifi-2023.05.07-4.el9.noarch 187 kB/s | 14 kB 00:00 2024-09-13T02:43:47.912 INFO:teuthology.orchestra.run.smithi131.stdout:(9/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.1 MB/s | 279 kB 00:00 2024-09-13T02:43:47.945 INFO:teuthology.orchestra.run.smithi131.stdout:(10/13): python3-google-auth-2.34.0-1.el9.noarc 2.4 MB/s | 220 kB 00:00 2024-09-13T02:43:47.980 INFO:teuthology.orchestra.run.smithi131.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 883 kB/s | 59 kB 00:00 2024-09-13T02:43:48.005 INFO:teuthology.orchestra.run.smithi131.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.5 MB/s | 90 kB 00:00 2024-09-13T02:43:48.038 INFO:teuthology.orchestra.run.smithi131.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 6.8 MB/s | 1.0 MB 00:00 2024-09-13T02:43:48.041 INFO:teuthology.orchestra.run.smithi131.stdout:-------------------------------------------------------------------------------- 2024-09-13T02:43:48.041 INFO:teuthology.orchestra.run.smithi131.stdout:Total 3.5 MB/s | 2.2 MB 00:00 2024-09-13T02:43:48.104 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction check 2024-09-13T02:43:48.119 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction check succeeded. 2024-09-13T02:43:48.119 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction test 2024-09-13T02:43:48.206 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction test succeeded. 2024-09-13T02:43:48.206 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction 2024-09-13T02:43:48.383 INFO:teuthology.orchestra.run.smithi089.stdout:(1/13): python3-jsonpointer-2.0-4.el9.noarch.rp 229 kB/s | 19 kB 00:00 2024-09-13T02:43:48.408 INFO:teuthology.orchestra.run.smithi089.stdout:(2/13): python3-jsonpatch-1.21-16.el9.noarch.rp 235 kB/s | 26 kB 00:00 2024-09-13T02:43:48.467 INFO:teuthology.orchestra.run.smithi089.stdout:(3/13): ceph-mgr-rook-17.2.7-1627.gbbdadfa3.el9 283 kB/s | 47 kB 00:00 2024-09-13T02:43:48.493 INFO:teuthology.orchestra.run.smithi089.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.0 MB/s | 222 kB 00:00 2024-09-13T02:43:48.518 INFO:teuthology.orchestra.run.smithi089.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.4 MB/s | 159 kB 00:00 2024-09-13T02:43:48.543 INFO:teuthology.orchestra.run.smithi089.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 1.0 MB/s | 54 kB 00:00 2024-09-13T02:43:48.593 INFO:teuthology.orchestra.run.smithi089.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 427 kB/s | 32 kB 00:00 2024-09-13T02:43:48.619 INFO:teuthology.orchestra.run.smithi089.stdout:(8/13): python3-certifi-2023.05.07-4.el9.noarch 187 kB/s | 14 kB 00:00 2024-09-13T02:43:48.644 INFO:teuthology.orchestra.run.smithi089.stdout:(9/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.5 MB/s | 279 kB 00:00 2024-09-13T02:43:48.669 INFO:teuthology.orchestra.run.smithi089.stdout:(10/13): python3-google-auth-2.34.0-1.el9.noarc 2.8 MB/s | 220 kB 00:00 2024-09-13T02:43:48.711 INFO:teuthology.orchestra.run.smithi089.stdout:(11/13): python3-websocket-client-1.2.3-2.el9.n 2.5 MB/s | 90 kB 00:00 2024-09-13T02:43:48.715 INFO:teuthology.orchestra.run.smithi131.stdout: Preparing : 1/1 2024-09-13T02:43:48.745 INFO:teuthology.orchestra.run.smithi089.stdout:(12/13): python3-kubernetes-26.1.0-2.el9.noarch 8.1 MB/s | 1.0 MB 00:00 2024-09-13T02:43:48.770 INFO:teuthology.orchestra.run.smithi089.stdout:(13/13): python3-rsa-4.9-2.el9.noarch.rpm 470 kB/s | 59 kB 00:00 2024-09-13T02:43:48.773 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2024-09-13T02:43:48.773 INFO:teuthology.orchestra.run.smithi089.stdout:Total 2.3 MB/s | 2.2 MB 00:00 2024-09-13T02:43:48.836 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2024-09-13T02:43:48.852 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2024-09-13T02:43:48.852 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2024-09-13T02:43:48.876 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-13T02:43:48.931 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-13T02:43:48.938 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2024-09-13T02:43:48.939 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2024-09-13T02:43:48.986 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-13T02:43:49.024 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-13T02:43:49.065 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-13T02:43:49.165 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-13T02:43:49.267 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-13T02:43:49.316 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-13T02:43:49.473 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2024-09-13T02:43:49.640 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-13T02:43:49.696 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-13T02:43:49.760 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-13T02:43:49.806 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-13T02:43:49.847 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-13T02:43:49.948 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-13T02:43:50.021 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-13T02:43:50.050 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-13T02:43:50.073 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-13T02:43:50.115 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-13T02:43:50.116 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-13T02:43:50.160 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-13T02:43:50.184 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mgr-rook-2:17.2.7-1627.gbbdadfa3.el9.noarch 13/13 2024-09-13T02:43:50.838 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-13T02:43:50.881 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-13T02:43:50.915 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-13T02:43:50.940 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-1627.gbbdadfa3.el9.noarch 13/13 2024-09-13T02:43:50.940 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mgr-rook-2:17.2.7-1627.gbbdadfa3.el9.noarch 1/13 2024-09-13T02:43:50.940 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-13T02:43:50.940 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-13T02:43:50.940 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-13T02:43:50.940 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-13T02:43:50.940 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-13T02:43:50.941 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-13T02:43:50.941 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-13T02:43:50.941 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-13T02:43:50.941 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-13T02:43:50.941 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-13T02:43:50.941 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-13T02:43:50.960 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-13T02:43:50.984 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-rook-2:17.2.7-1627.gbbdadfa3.el9.noarch 13/13 2024-09-13T02:43:51.278 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-13T02:43:51.278 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-13T02:43:51.278 INFO:teuthology.orchestra.run.smithi131.stdout:Installed: 2024-09-13T02:43:51.279 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-rook-2:17.2.7-1627.gbbdadfa3.el9.noarch 2024-09-13T02:43:51.279 INFO:teuthology.orchestra.run.smithi131.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-13T02:43:51.279 INFO:teuthology.orchestra.run.smithi131.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-13T02:43:51.279 INFO:teuthology.orchestra.run.smithi131.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-13T02:43:51.279 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-13T02:43:51.279 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-13T02:43:51.279 INFO:teuthology.orchestra.run.smithi131.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-13T02:43:51.279 INFO:teuthology.orchestra.run.smithi131.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-13T02:43:51.279 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-13T02:43:51.279 INFO:teuthology.orchestra.run.smithi131.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-13T02:43:51.280 INFO:teuthology.orchestra.run.smithi131.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-13T02:43:51.280 INFO:teuthology.orchestra.run.smithi131.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-13T02:43:51.280 INFO:teuthology.orchestra.run.smithi131.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-13T02:43:51.280 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-13T02:43:51.280 INFO:teuthology.orchestra.run.smithi131.stdout:Complete! 2024-09-13T02:43:51.540 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum -y install ceph-mgr-cephadm 2024-09-13T02:43:51.868 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.7-1627.gbbdadfa3.el9.noarch 13/13 2024-09-13T02:43:51.868 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-rook-2:17.2.7-1627.gbbdadfa3.el9.noarch 1/13 2024-09-13T02:43:51.868 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-13T02:43:51.868 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-13T02:43:51.868 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-13T02:43:51.868 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-13T02:43:51.869 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-13T02:43:51.869 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-13T02:43:51.869 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-13T02:43:51.869 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-13T02:43:51.869 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-13T02:43:51.869 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-13T02:43:51.869 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-13T02:43:52.125 INFO:teuthology.orchestra.run.smithi131.stdout:Last metadata expiration check: 0:01:19 ago on Fri 13 Sep 2024 02:42:33 AM UTC. 2024-09-13T02:43:52.211 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-13T02:43:52.211 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:43:52.211 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2024-09-13T02:43:52.212 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-rook-2:17.2.7-1627.gbbdadfa3.el9.noarch 2024-09-13T02:43:52.212 INFO:teuthology.orchestra.run.smithi089.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-13T02:43:52.212 INFO:teuthology.orchestra.run.smithi089.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-13T02:43:52.212 INFO:teuthology.orchestra.run.smithi089.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-13T02:43:52.212 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-13T02:43:52.212 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-13T02:43:52.212 INFO:teuthology.orchestra.run.smithi089.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-13T02:43:52.212 INFO:teuthology.orchestra.run.smithi089.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-13T02:43:52.212 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-13T02:43:52.212 INFO:teuthology.orchestra.run.smithi089.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-13T02:43:52.212 INFO:teuthology.orchestra.run.smithi089.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-13T02:43:52.212 INFO:teuthology.orchestra.run.smithi089.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-13T02:43:52.213 INFO:teuthology.orchestra.run.smithi089.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-13T02:43:52.213 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:43:52.213 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-09-13T02:43:52.258 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2024-09-13T02:43:52.259 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-09-13T02:43:52.259 INFO:teuthology.orchestra.run.smithi131.stdout: Package Arch Version Repository Size 2024-09-13T02:43:52.260 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-09-13T02:43:52.260 INFO:teuthology.orchestra.run.smithi131.stdout:Installing: 2024-09-13T02:43:52.260 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-cephadm noarch 2:17.2.7-1627.gbbdadfa3.el9 ceph-noarch 124 k 2024-09-13T02:43:52.260 INFO:teuthology.orchestra.run.smithi131.stdout:Installing dependencies: 2024-09-13T02:43:52.260 INFO:teuthology.orchestra.run.smithi131.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-13T02:43:52.260 INFO:teuthology.orchestra.run.smithi131.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-13T02:43:52.260 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-13T02:43:52.260 INFO:teuthology.orchestra.run.smithi131.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-13T02:43:52.260 INFO:teuthology.orchestra.run.smithi131.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-13T02:43:52.260 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-13T02:43:52.260 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction Summary 2024-09-13T02:43:52.260 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-09-13T02:43:52.261 INFO:teuthology.orchestra.run.smithi131.stdout:Install 6 Packages 2024-09-13T02:43:52.261 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-13T02:43:52.261 INFO:teuthology.orchestra.run.smithi131.stdout:Total download size: 7.0 M 2024-09-13T02:43:52.261 INFO:teuthology.orchestra.run.smithi131.stdout:Installed size: 33 M 2024-09-13T02:43:52.261 INFO:teuthology.orchestra.run.smithi131.stdout:Downloading Packages: 2024-09-13T02:43:52.463 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install ceph-mgr-cephadm 2024-09-13T02:43:52.658 INFO:teuthology.orchestra.run.smithi131.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.3 MB/s | 248 kB 00:00 2024-09-13T02:43:52.684 INFO:teuthology.orchestra.run.smithi131.stdout:(2/6): ceph-mgr-cephadm-17.2.7-1627.gbbdadfa3.e 575 kB/s | 124 kB 00:00 2024-09-13T02:43:52.742 INFO:teuthology.orchestra.run.smithi131.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 990 kB/s | 58 kB 00:00 2024-09-13T02:43:52.776 INFO:teuthology.orchestra.run.smithi131.stdout:(4/6): python3-typing-extensions-4.12.2-2.el9.n 2.2 MB/s | 74 kB 00:00 2024-09-13T02:43:52.868 INFO:teuthology.orchestra.run.smithi131.stdout:(5/6): python3-babel-2.9.1-2.el9.noarch.rpm 15 MB/s | 6.0 MB 00:00 2024-09-13T02:43:52.893 INFO:teuthology.orchestra.run.smithi131.stdout:(6/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 2.3 MB/s | 548 kB 00:00 2024-09-13T02:43:52.895 INFO:teuthology.orchestra.run.smithi131.stdout:-------------------------------------------------------------------------------- 2024-09-13T02:43:52.896 INFO:teuthology.orchestra.run.smithi131.stdout:Total 11 MB/s | 7.0 MB 00:00 2024-09-13T02:43:52.965 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction check 2024-09-13T02:43:52.976 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction check succeeded. 2024-09-13T02:43:52.976 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction test 2024-09-13T02:43:53.024 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:01:20 ago on Fri 13 Sep 2024 02:42:33 AM UTC. 2024-09-13T02:43:53.074 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction test succeeded. 2024-09-13T02:43:53.076 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction 2024-09-13T02:43:53.156 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-09-13T02:43:53.156 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-13T02:43:53.156 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repository Size 2024-09-13T02:43:53.157 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-13T02:43:53.157 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2024-09-13T02:43:53.157 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-cephadm noarch 2:17.2.7-1627.gbbdadfa3.el9 ceph-noarch 124 k 2024-09-13T02:43:53.157 INFO:teuthology.orchestra.run.smithi089.stdout:Installing dependencies: 2024-09-13T02:43:53.157 INFO:teuthology.orchestra.run.smithi089.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-13T02:43:53.157 INFO:teuthology.orchestra.run.smithi089.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-13T02:43:53.157 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-13T02:43:53.157 INFO:teuthology.orchestra.run.smithi089.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-13T02:43:53.157 INFO:teuthology.orchestra.run.smithi089.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-13T02:43:53.157 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:43:53.157 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2024-09-13T02:43:53.157 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-13T02:43:53.158 INFO:teuthology.orchestra.run.smithi089.stdout:Install 6 Packages 2024-09-13T02:43:53.158 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:43:53.158 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 7.0 M 2024-09-13T02:43:53.158 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 33 M 2024-09-13T02:43:53.158 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2024-09-13T02:43:53.383 INFO:teuthology.orchestra.run.smithi131.stdout: Preparing : 1/1 2024-09-13T02:43:53.565 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-13T02:43:53.619 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-13T02:43:53.792 INFO:teuthology.orchestra.run.smithi089.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.2 MB/s | 248 kB 00:00 2024-09-13T02:43:53.817 INFO:teuthology.orchestra.run.smithi089.stdout:(2/6): ceph-mgr-cephadm-17.2.7-1627.gbbdadfa3.e 552 kB/s | 124 kB 00:00 2024-09-13T02:43:53.867 INFO:teuthology.orchestra.run.smithi089.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 1.1 MB/s | 58 kB 00:00 2024-09-13T02:43:53.892 INFO:teuthology.orchestra.run.smithi089.stdout:(4/6): python3-typing-extensions-4.12.2-2.el9.n 2.9 MB/s | 74 kB 00:00 2024-09-13T02:43:53.926 INFO:teuthology.orchestra.run.smithi089.stdout:(5/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 4.0 MB/s | 548 kB 00:00 2024-09-13T02:43:54.141 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-13T02:43:54.230 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-13T02:43:54.295 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-13T02:43:54.324 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-1627.gbbdadfa3.el9.noarch 6/6 2024-09-13T02:43:55.080 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-1627.gbbdadfa3.el9.noarch 6/6 2024-09-13T02:43:55.080 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-1627.gbbdadfa3.el9.noarch 1/6 2024-09-13T02:43:55.080 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-13T02:43:55.080 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-13T02:43:55.080 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-13T02:43:55.081 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-13T02:43:55.243 INFO:teuthology.orchestra.run.smithi089.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 3.6 MB/s | 6.0 MB 00:01 2024-09-13T02:43:55.247 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2024-09-13T02:43:55.247 INFO:teuthology.orchestra.run.smithi089.stdout:Total 3.3 MB/s | 7.0 MB 00:02 2024-09-13T02:43:55.319 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2024-09-13T02:43:55.330 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2024-09-13T02:43:55.330 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2024-09-13T02:43:55.337 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-13T02:43:55.337 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-13T02:43:55.337 INFO:teuthology.orchestra.run.smithi131.stdout:Installed: 2024-09-13T02:43:55.338 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-mgr-cephadm-2:17.2.7-1627.gbbdadfa3.el9.noarch 2024-09-13T02:43:55.338 INFO:teuthology.orchestra.run.smithi131.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-13T02:43:55.338 INFO:teuthology.orchestra.run.smithi131.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-13T02:43:55.338 INFO:teuthology.orchestra.run.smithi131.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-13T02:43:55.338 INFO:teuthology.orchestra.run.smithi131.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-13T02:43:55.338 INFO:teuthology.orchestra.run.smithi131.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-13T02:43:55.338 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-13T02:43:55.338 INFO:teuthology.orchestra.run.smithi131.stdout:Complete! 2024-09-13T02:43:55.427 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2024-09-13T02:43:55.427 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2024-09-13T02:43:55.617 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum -y install ceph-fuse 2024-09-13T02:43:55.742 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2024-09-13T02:43:55.917 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-13T02:43:55.969 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-13T02:43:56.181 INFO:teuthology.orchestra.run.smithi131.stdout:Last metadata expiration check: 0:01:23 ago on Fri 13 Sep 2024 02:42:33 AM UTC. 2024-09-13T02:43:56.312 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2024-09-13T02:43:56.313 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-09-13T02:43:56.313 INFO:teuthology.orchestra.run.smithi131.stdout: Package Arch Version Repository Size 2024-09-13T02:43:56.313 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-09-13T02:43:56.313 INFO:teuthology.orchestra.run.smithi131.stdout:Installing: 2024-09-13T02:43:56.313 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-fuse x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 813 k 2024-09-13T02:43:56.313 INFO:teuthology.orchestra.run.smithi131.stdout:Installing dependencies: 2024-09-13T02:43:56.313 INFO:teuthology.orchestra.run.smithi131.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-13T02:43:56.314 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-13T02:43:56.314 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction Summary 2024-09-13T02:43:56.314 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-09-13T02:43:56.314 INFO:teuthology.orchestra.run.smithi131.stdout:Install 2 Packages 2024-09-13T02:43:56.314 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-13T02:43:56.314 INFO:teuthology.orchestra.run.smithi131.stdout:Total download size: 893 k 2024-09-13T02:43:56.314 INFO:teuthology.orchestra.run.smithi131.stdout:Installed size: 2.6 M 2024-09-13T02:43:56.314 INFO:teuthology.orchestra.run.smithi131.stdout:Downloading Packages: 2024-09-13T02:43:56.470 INFO:teuthology.orchestra.run.smithi131.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 730 kB/s | 80 kB 00:00 2024-09-13T02:43:56.491 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-13T02:43:56.582 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-13T02:43:56.612 INFO:teuthology.orchestra.run.smithi131.stdout:(2/2): ceph-fuse-17.2.7-1627.gbbdadfa3.el9.x86_ 3.2 MB/s | 813 kB 00:00 2024-09-13T02:43:56.613 INFO:teuthology.orchestra.run.smithi131.stdout:-------------------------------------------------------------------------------- 2024-09-13T02:43:56.613 INFO:teuthology.orchestra.run.smithi131.stdout:Total 2.9 MB/s | 893 kB 00:00 2024-09-13T02:43:56.624 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction check 2024-09-13T02:43:56.644 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction check succeeded. 2024-09-13T02:43:56.644 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction test 2024-09-13T02:43:56.645 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-13T02:43:56.674 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-mgr-cephadm-2:17.2.7-1627.gbbdadfa3.el9.noarch 6/6 2024-09-13T02:43:56.723 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction test succeeded. 2024-09-13T02:43:56.723 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction 2024-09-13T02:43:56.904 INFO:teuthology.orchestra.run.smithi131.stdout: Preparing : 1/1 2024-09-13T02:43:57.048 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-13T02:43:57.127 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : ceph-fuse-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2/2 2024-09-13T02:43:57.457 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.7-1627.gbbdadfa3.el9.noarch 6/6 2024-09-13T02:43:57.457 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-mgr-cephadm-2:17.2.7-1627.gbbdadfa3.el9.noarch 1/6 2024-09-13T02:43:57.457 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-13T02:43:57.458 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-13T02:43:57.458 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-13T02:43:57.458 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-13T02:43:57.725 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-13T02:43:57.726 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:43:57.726 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2024-09-13T02:43:57.726 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-mgr-cephadm-2:17.2.7-1627.gbbdadfa3.el9.noarch 2024-09-13T02:43:57.726 INFO:teuthology.orchestra.run.smithi089.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-13T02:43:57.726 INFO:teuthology.orchestra.run.smithi089.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-13T02:43:57.726 INFO:teuthology.orchestra.run.smithi089.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-13T02:43:57.726 INFO:teuthology.orchestra.run.smithi089.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-13T02:43:57.726 INFO:teuthology.orchestra.run.smithi089.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-13T02:43:57.726 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:43:57.727 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-09-13T02:43:57.825 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: ceph-fuse-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2/2 2024-09-13T02:43:57.826 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : ceph-fuse-2:17.2.7-1627.gbbdadfa3.el9.x86_64 1/2 2024-09-13T02:43:57.999 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install ceph-fuse 2024-09-13T02:43:58.084 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-13T02:43:58.084 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-13T02:43:58.084 INFO:teuthology.orchestra.run.smithi131.stdout:Installed: 2024-09-13T02:43:58.084 INFO:teuthology.orchestra.run.smithi131.stdout: ceph-fuse-2:17.2.7-1627.gbbdadfa3.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-13T02:43:58.085 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-13T02:43:58.085 INFO:teuthology.orchestra.run.smithi131.stdout:Complete! 2024-09-13T02:43:58.351 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum -y install librados-devel 2024-09-13T02:43:58.556 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:01:25 ago on Fri 13 Sep 2024 02:42:33 AM UTC. 2024-09-13T02:43:58.686 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-09-13T02:43:58.687 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-13T02:43:58.687 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repository Size 2024-09-13T02:43:58.687 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-13T02:43:58.687 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2024-09-13T02:43:58.687 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-fuse x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 813 k 2024-09-13T02:43:58.687 INFO:teuthology.orchestra.run.smithi089.stdout:Installing dependencies: 2024-09-13T02:43:58.687 INFO:teuthology.orchestra.run.smithi089.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-13T02:43:58.687 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:43:58.688 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2024-09-13T02:43:58.688 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-13T02:43:58.688 INFO:teuthology.orchestra.run.smithi089.stdout:Install 2 Packages 2024-09-13T02:43:58.688 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:43:58.688 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 893 k 2024-09-13T02:43:58.689 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 2.6 M 2024-09-13T02:43:58.689 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2024-09-13T02:43:58.887 INFO:teuthology.orchestra.run.smithi089.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 522 kB/s | 80 kB 00:00 2024-09-13T02:43:58.924 INFO:teuthology.orchestra.run.smithi131.stdout:Last metadata expiration check: 0:01:25 ago on Fri 13 Sep 2024 02:42:33 AM UTC. 2024-09-13T02:43:59.029 INFO:teuthology.orchestra.run.smithi089.stdout:(2/2): ceph-fuse-17.2.7-1627.gbbdadfa3.el9.x86_ 2.7 MB/s | 813 kB 00:00 2024-09-13T02:43:59.029 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2024-09-13T02:43:59.030 INFO:teuthology.orchestra.run.smithi089.stdout:Total 2.6 MB/s | 893 kB 00:00 2024-09-13T02:43:59.041 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2024-09-13T02:43:59.061 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2024-09-13T02:43:59.062 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2024-09-13T02:43:59.062 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2024-09-13T02:43:59.063 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-09-13T02:43:59.063 INFO:teuthology.orchestra.run.smithi131.stdout: Package Arch Version Repo Size 2024-09-13T02:43:59.063 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-09-13T02:43:59.063 INFO:teuthology.orchestra.run.smithi131.stdout:Installing: 2024-09-13T02:43:59.064 INFO:teuthology.orchestra.run.smithi131.stdout: librados-devel x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 126 k 2024-09-13T02:43:59.064 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-13T02:43:59.064 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction Summary 2024-09-13T02:43:59.064 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-09-13T02:43:59.064 INFO:teuthology.orchestra.run.smithi131.stdout:Install 1 Package 2024-09-13T02:43:59.064 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-13T02:43:59.064 INFO:teuthology.orchestra.run.smithi131.stdout:Total download size: 126 k 2024-09-13T02:43:59.065 INFO:teuthology.orchestra.run.smithi131.stdout:Installed size: 448 k 2024-09-13T02:43:59.065 INFO:teuthology.orchestra.run.smithi131.stdout:Downloading Packages: 2024-09-13T02:43:59.140 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2024-09-13T02:43:59.140 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2024-09-13T02:43:59.284 INFO:teuthology.orchestra.run.smithi131.stdout:librados-devel-17.2.7-1627.gbbdadfa3.el9.x86_64 574 kB/s | 126 kB 00:00 2024-09-13T02:43:59.284 INFO:teuthology.orchestra.run.smithi131.stdout:-------------------------------------------------------------------------------- 2024-09-13T02:43:59.285 INFO:teuthology.orchestra.run.smithi131.stdout:Total 571 kB/s | 126 kB 00:00 2024-09-13T02:43:59.285 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction check 2024-09-13T02:43:59.290 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction check succeeded. 2024-09-13T02:43:59.290 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction test 2024-09-13T02:43:59.326 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2024-09-13T02:43:59.353 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction test succeeded. 2024-09-13T02:43:59.354 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction 2024-09-13T02:43:59.457 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-13T02:43:59.506 INFO:teuthology.orchestra.run.smithi131.stdout: Preparing : 1/1 2024-09-13T02:43:59.527 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : ceph-fuse-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2/2 2024-09-13T02:43:59.606 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : librados-devel-2:17.2.7-1627.gbbdadfa3.el9.x86_64 1/1 2024-09-13T02:43:59.992 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: librados-devel-2:17.2.7-1627.gbbdadfa3.el9.x86_64 1/1 2024-09-13T02:44:00.130 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: ceph-fuse-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2/2 2024-09-13T02:44:00.130 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : ceph-fuse-2:17.2.7-1627.gbbdadfa3.el9.x86_64 1/2 2024-09-13T02:44:00.234 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : librados-devel-2:17.2.7-1627.gbbdadfa3.el9.x86_64 1/1 2024-09-13T02:44:00.234 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-13T02:44:00.234 INFO:teuthology.orchestra.run.smithi131.stdout:Installed: 2024-09-13T02:44:00.234 INFO:teuthology.orchestra.run.smithi131.stdout: librados-devel-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:44:00.234 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-13T02:44:00.235 INFO:teuthology.orchestra.run.smithi131.stdout:Complete! 2024-09-13T02:44:00.368 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-13T02:44:00.368 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:44:00.368 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2024-09-13T02:44:00.368 INFO:teuthology.orchestra.run.smithi089.stdout: ceph-fuse-2:17.2.7-1627.gbbdadfa3.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-13T02:44:00.368 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:44:00.368 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-09-13T02:44:00.461 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum -y install libcephfs2 2024-09-13T02:44:00.657 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install librados-devel 2024-09-13T02:44:01.036 INFO:teuthology.orchestra.run.smithi131.stdout:Last metadata expiration check: 0:01:28 ago on Fri 13 Sep 2024 02:42:33 AM UTC. 2024-09-13T02:44:01.127 INFO:teuthology.orchestra.run.smithi131.stdout:Package libcephfs2-2:17.2.7-1627.gbbdadfa3.el9.x86_64 is already installed. 2024-09-13T02:44:01.171 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2024-09-13T02:44:01.172 INFO:teuthology.orchestra.run.smithi131.stdout:Nothing to do. 2024-09-13T02:44:01.172 INFO:teuthology.orchestra.run.smithi131.stdout:Complete! 2024-09-13T02:44:01.230 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:01:28 ago on Fri 13 Sep 2024 02:42:33 AM UTC. 2024-09-13T02:44:01.254 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum -y install libcephfs-devel 2024-09-13T02:44:01.365 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-09-13T02:44:01.366 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-13T02:44:01.366 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repo Size 2024-09-13T02:44:01.366 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-13T02:44:01.366 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2024-09-13T02:44:01.366 INFO:teuthology.orchestra.run.smithi089.stdout: librados-devel x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 126 k 2024-09-13T02:44:01.366 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:44:01.366 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2024-09-13T02:44:01.366 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-13T02:44:01.366 INFO:teuthology.orchestra.run.smithi089.stdout:Install 1 Package 2024-09-13T02:44:01.366 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:44:01.367 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 126 k 2024-09-13T02:44:01.367 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 448 k 2024-09-13T02:44:01.367 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2024-09-13T02:44:01.585 INFO:teuthology.orchestra.run.smithi089.stdout:librados-devel-17.2.7-1627.gbbdadfa3.el9.x86_64 578 kB/s | 126 kB 00:00 2024-09-13T02:44:01.586 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2024-09-13T02:44:01.586 INFO:teuthology.orchestra.run.smithi089.stdout:Total 573 kB/s | 126 kB 00:00 2024-09-13T02:44:01.586 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2024-09-13T02:44:01.592 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2024-09-13T02:44:01.592 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2024-09-13T02:44:01.654 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2024-09-13T02:44:01.654 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2024-09-13T02:44:01.800 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2024-09-13T02:44:01.821 INFO:teuthology.orchestra.run.smithi131.stdout:Last metadata expiration check: 0:01:28 ago on Fri 13 Sep 2024 02:42:33 AM UTC. 2024-09-13T02:44:01.916 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : librados-devel-2:17.2.7-1627.gbbdadfa3.el9.x86_64 1/1 2024-09-13T02:44:01.954 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2024-09-13T02:44:01.954 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-09-13T02:44:01.954 INFO:teuthology.orchestra.run.smithi131.stdout: Package Arch Version Repo Size 2024-09-13T02:44:01.954 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-09-13T02:44:01.954 INFO:teuthology.orchestra.run.smithi131.stdout:Installing: 2024-09-13T02:44:01.954 INFO:teuthology.orchestra.run.smithi131.stdout: libcephfs-devel x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 25 k 2024-09-13T02:44:01.954 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-13T02:44:01.955 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction Summary 2024-09-13T02:44:01.955 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-09-13T02:44:01.955 INFO:teuthology.orchestra.run.smithi131.stdout:Install 1 Package 2024-09-13T02:44:01.955 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-13T02:44:01.955 INFO:teuthology.orchestra.run.smithi131.stdout:Total download size: 25 k 2024-09-13T02:44:01.955 INFO:teuthology.orchestra.run.smithi131.stdout:Installed size: 110 k 2024-09-13T02:44:01.955 INFO:teuthology.orchestra.run.smithi131.stdout:Downloading Packages: 2024-09-13T02:44:02.096 INFO:teuthology.orchestra.run.smithi131.stdout:libcephfs-devel-17.2.7-1627.gbbdadfa3.el9.x86_6 177 kB/s | 25 kB 00:00 2024-09-13T02:44:02.097 INFO:teuthology.orchestra.run.smithi131.stdout:-------------------------------------------------------------------------------- 2024-09-13T02:44:02.097 INFO:teuthology.orchestra.run.smithi131.stdout:Total 175 kB/s | 25 kB 00:00 2024-09-13T02:44:02.097 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction check 2024-09-13T02:44:02.101 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction check succeeded. 2024-09-13T02:44:02.101 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction test 2024-09-13T02:44:02.102 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction test succeeded. 2024-09-13T02:44:02.103 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction 2024-09-13T02:44:02.192 INFO:teuthology.orchestra.run.smithi131.stdout: Preparing : 1/1 2024-09-13T02:44:02.293 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : libcephfs-devel-2:17.2.7-1627.gbbdadfa3.el9.x86_64 1/1 2024-09-13T02:44:02.315 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: librados-devel-2:17.2.7-1627.gbbdadfa3.el9.x86_64 1/1 2024-09-13T02:44:02.568 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : librados-devel-2:17.2.7-1627.gbbdadfa3.el9.x86_64 1/1 2024-09-13T02:44:02.568 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:44:02.568 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2024-09-13T02:44:02.569 INFO:teuthology.orchestra.run.smithi089.stdout: librados-devel-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:44:02.569 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:44:02.569 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-09-13T02:44:02.633 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: libcephfs-devel-2:17.2.7-1627.gbbdadfa3.el9.x86_64 1/1 2024-09-13T02:44:02.842 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install libcephfs2 2024-09-13T02:44:02.857 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : libcephfs-devel-2:17.2.7-1627.gbbdadfa3.el9.x86_64 1/1 2024-09-13T02:44:02.857 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-13T02:44:02.857 INFO:teuthology.orchestra.run.smithi131.stdout:Installed: 2024-09-13T02:44:02.857 INFO:teuthology.orchestra.run.smithi131.stdout: libcephfs-devel-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:44:02.857 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-13T02:44:02.857 INFO:teuthology.orchestra.run.smithi131.stdout:Complete! 2024-09-13T02:44:03.035 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum -y install librados2 2024-09-13T02:44:03.416 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:01:30 ago on Fri 13 Sep 2024 02:42:33 AM UTC. 2024-09-13T02:44:03.506 INFO:teuthology.orchestra.run.smithi089.stdout:Package libcephfs2-2:17.2.7-1627.gbbdadfa3.el9.x86_64 is already installed. 2024-09-13T02:44:03.551 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-09-13T02:44:03.552 INFO:teuthology.orchestra.run.smithi089.stdout:Nothing to do. 2024-09-13T02:44:03.552 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-09-13T02:44:03.610 INFO:teuthology.orchestra.run.smithi131.stdout:Last metadata expiration check: 0:01:30 ago on Fri 13 Sep 2024 02:42:33 AM UTC. 2024-09-13T02:44:03.632 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install libcephfs-devel 2024-09-13T02:44:03.702 INFO:teuthology.orchestra.run.smithi131.stdout:Package librados2-2:17.2.7-1627.gbbdadfa3.el9.x86_64 is already installed. 2024-09-13T02:44:03.745 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2024-09-13T02:44:03.746 INFO:teuthology.orchestra.run.smithi131.stdout:Nothing to do. 2024-09-13T02:44:03.746 INFO:teuthology.orchestra.run.smithi131.stdout:Complete! 2024-09-13T02:44:03.825 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum -y install librbd1 2024-09-13T02:44:04.194 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:01:31 ago on Fri 13 Sep 2024 02:42:33 AM UTC. 2024-09-13T02:44:04.326 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-09-13T02:44:04.326 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-13T02:44:04.327 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repo Size 2024-09-13T02:44:04.327 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-13T02:44:04.327 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2024-09-13T02:44:04.327 INFO:teuthology.orchestra.run.smithi089.stdout: libcephfs-devel x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 25 k 2024-09-13T02:44:04.327 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:44:04.327 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2024-09-13T02:44:04.327 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-13T02:44:04.327 INFO:teuthology.orchestra.run.smithi089.stdout:Install 1 Package 2024-09-13T02:44:04.327 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:44:04.327 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 25 k 2024-09-13T02:44:04.327 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 110 k 2024-09-13T02:44:04.327 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2024-09-13T02:44:04.388 INFO:teuthology.orchestra.run.smithi131.stdout:Last metadata expiration check: 0:01:31 ago on Fri 13 Sep 2024 02:42:33 AM UTC. 2024-09-13T02:44:04.473 INFO:teuthology.orchestra.run.smithi089.stdout:libcephfs-devel-17.2.7-1627.gbbdadfa3.el9.x86_6 171 kB/s | 25 kB 00:00 2024-09-13T02:44:04.474 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2024-09-13T02:44:04.474 INFO:teuthology.orchestra.run.smithi089.stdout:Total 169 kB/s | 25 kB 00:00 2024-09-13T02:44:04.474 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2024-09-13T02:44:04.476 INFO:teuthology.orchestra.run.smithi131.stdout:Package librbd1-2:17.2.7-1627.gbbdadfa3.el9.x86_64 is already installed. 2024-09-13T02:44:04.478 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2024-09-13T02:44:04.478 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2024-09-13T02:44:04.479 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2024-09-13T02:44:04.480 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2024-09-13T02:44:04.518 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2024-09-13T02:44:04.520 INFO:teuthology.orchestra.run.smithi131.stdout:Nothing to do. 2024-09-13T02:44:04.520 INFO:teuthology.orchestra.run.smithi131.stdout:Complete! 2024-09-13T02:44:04.563 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2024-09-13T02:44:04.602 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum -y install python3-rados 2024-09-13T02:44:04.662 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : libcephfs-devel-2:17.2.7-1627.gbbdadfa3.el9.x86_64 1/1 2024-09-13T02:44:05.002 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: libcephfs-devel-2:17.2.7-1627.gbbdadfa3.el9.x86_64 1/1 2024-09-13T02:44:05.164 INFO:teuthology.orchestra.run.smithi131.stdout:Last metadata expiration check: 0:01:32 ago on Fri 13 Sep 2024 02:42:33 AM UTC. 2024-09-13T02:44:05.240 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : libcephfs-devel-2:17.2.7-1627.gbbdadfa3.el9.x86_64 1/1 2024-09-13T02:44:05.240 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:44:05.241 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2024-09-13T02:44:05.241 INFO:teuthology.orchestra.run.smithi089.stdout: libcephfs-devel-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:44:05.241 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:44:05.241 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-09-13T02:44:05.254 INFO:teuthology.orchestra.run.smithi131.stdout:Package python3-rados-2:17.2.7-1627.gbbdadfa3.el9.x86_64 is already installed. 2024-09-13T02:44:05.297 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2024-09-13T02:44:05.298 INFO:teuthology.orchestra.run.smithi131.stdout:Nothing to do. 2024-09-13T02:44:05.298 INFO:teuthology.orchestra.run.smithi131.stdout:Complete! 2024-09-13T02:44:05.375 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum -y install python3-rgw 2024-09-13T02:44:05.490 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install librados2 2024-09-13T02:44:05.932 INFO:teuthology.orchestra.run.smithi131.stdout:Last metadata expiration check: 0:01:32 ago on Fri 13 Sep 2024 02:42:33 AM UTC. 2024-09-13T02:44:06.021 INFO:teuthology.orchestra.run.smithi131.stdout:Package python3-rgw-2:17.2.7-1627.gbbdadfa3.el9.x86_64 is already installed. 2024-09-13T02:44:06.062 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:01:33 ago on Fri 13 Sep 2024 02:42:33 AM UTC. 2024-09-13T02:44:06.064 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2024-09-13T02:44:06.064 INFO:teuthology.orchestra.run.smithi131.stdout:Nothing to do. 2024-09-13T02:44:06.065 INFO:teuthology.orchestra.run.smithi131.stdout:Complete! 2024-09-13T02:44:06.142 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum -y install python3-cephfs 2024-09-13T02:44:06.150 INFO:teuthology.orchestra.run.smithi089.stdout:Package librados2-2:17.2.7-1627.gbbdadfa3.el9.x86_64 is already installed. 2024-09-13T02:44:06.193 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-09-13T02:44:06.194 INFO:teuthology.orchestra.run.smithi089.stdout:Nothing to do. 2024-09-13T02:44:06.194 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-09-13T02:44:06.270 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install librbd1 2024-09-13T02:44:06.702 INFO:teuthology.orchestra.run.smithi131.stdout:Last metadata expiration check: 0:01:33 ago on Fri 13 Sep 2024 02:42:33 AM UTC. 2024-09-13T02:44:06.791 INFO:teuthology.orchestra.run.smithi131.stdout:Package python3-cephfs-2:17.2.7-1627.gbbdadfa3.el9.x86_64 is already installed. 2024-09-13T02:44:06.831 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:01:33 ago on Fri 13 Sep 2024 02:42:33 AM UTC. 2024-09-13T02:44:06.834 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2024-09-13T02:44:06.835 INFO:teuthology.orchestra.run.smithi131.stdout:Nothing to do. 2024-09-13T02:44:06.835 INFO:teuthology.orchestra.run.smithi131.stdout:Complete! 2024-09-13T02:44:06.918 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum -y install python3-rbd 2024-09-13T02:44:06.921 INFO:teuthology.orchestra.run.smithi089.stdout:Package librbd1-2:17.2.7-1627.gbbdadfa3.el9.x86_64 is already installed. 2024-09-13T02:44:06.963 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-09-13T02:44:06.964 INFO:teuthology.orchestra.run.smithi089.stdout:Nothing to do. 2024-09-13T02:44:06.964 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-09-13T02:44:07.046 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install python3-rados 2024-09-13T02:44:07.477 INFO:teuthology.orchestra.run.smithi131.stdout:Last metadata expiration check: 0:01:34 ago on Fri 13 Sep 2024 02:42:33 AM UTC. 2024-09-13T02:44:07.566 INFO:teuthology.orchestra.run.smithi131.stdout:Package python3-rbd-2:17.2.7-1627.gbbdadfa3.el9.x86_64 is already installed. 2024-09-13T02:44:07.596 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:01:34 ago on Fri 13 Sep 2024 02:42:33 AM UTC. 2024-09-13T02:44:07.610 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2024-09-13T02:44:07.611 INFO:teuthology.orchestra.run.smithi131.stdout:Nothing to do. 2024-09-13T02:44:07.611 INFO:teuthology.orchestra.run.smithi131.stdout:Complete! 2024-09-13T02:44:07.685 INFO:teuthology.orchestra.run.smithi089.stdout:Package python3-rados-2:17.2.7-1627.gbbdadfa3.el9.x86_64 is already installed. 2024-09-13T02:44:07.692 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum -y install rbd-fuse 2024-09-13T02:44:07.727 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-09-13T02:44:07.728 INFO:teuthology.orchestra.run.smithi089.stdout:Nothing to do. 2024-09-13T02:44:07.728 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-09-13T02:44:07.800 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install python3-rgw 2024-09-13T02:44:08.257 INFO:teuthology.orchestra.run.smithi131.stdout:Last metadata expiration check: 0:01:35 ago on Fri 13 Sep 2024 02:42:33 AM UTC. 2024-09-13T02:44:08.359 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:01:35 ago on Fri 13 Sep 2024 02:42:33 AM UTC. 2024-09-13T02:44:08.388 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2024-09-13T02:44:08.388 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-09-13T02:44:08.388 INFO:teuthology.orchestra.run.smithi131.stdout: Package Architecture Version Repository Size 2024-09-13T02:44:08.388 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-09-13T02:44:08.388 INFO:teuthology.orchestra.run.smithi131.stdout:Installing: 2024-09-13T02:44:08.388 INFO:teuthology.orchestra.run.smithi131.stdout: rbd-fuse x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 82 k 2024-09-13T02:44:08.388 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-13T02:44:08.389 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction Summary 2024-09-13T02:44:08.389 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-09-13T02:44:08.389 INFO:teuthology.orchestra.run.smithi131.stdout:Install 1 Package 2024-09-13T02:44:08.389 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-13T02:44:08.389 INFO:teuthology.orchestra.run.smithi131.stdout:Total download size: 82 k 2024-09-13T02:44:08.389 INFO:teuthology.orchestra.run.smithi131.stdout:Installed size: 222 k 2024-09-13T02:44:08.390 INFO:teuthology.orchestra.run.smithi131.stdout:Downloading Packages: 2024-09-13T02:44:08.448 INFO:teuthology.orchestra.run.smithi089.stdout:Package python3-rgw-2:17.2.7-1627.gbbdadfa3.el9.x86_64 is already installed. 2024-09-13T02:44:08.491 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-09-13T02:44:08.492 INFO:teuthology.orchestra.run.smithi089.stdout:Nothing to do. 2024-09-13T02:44:08.492 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-09-13T02:44:08.570 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install python3-cephfs 2024-09-13T02:44:08.591 INFO:teuthology.orchestra.run.smithi131.stdout:rbd-fuse-17.2.7-1627.gbbdadfa3.el9.x86_64.rpm 406 kB/s | 82 kB 00:00 2024-09-13T02:44:08.591 INFO:teuthology.orchestra.run.smithi131.stdout:-------------------------------------------------------------------------------- 2024-09-13T02:44:08.592 INFO:teuthology.orchestra.run.smithi131.stdout:Total 403 kB/s | 82 kB 00:00 2024-09-13T02:44:08.592 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction check 2024-09-13T02:44:08.598 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction check succeeded. 2024-09-13T02:44:08.599 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction test 2024-09-13T02:44:08.661 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction test succeeded. 2024-09-13T02:44:08.661 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction 2024-09-13T02:44:08.814 INFO:teuthology.orchestra.run.smithi131.stdout: Preparing : 1/1 2024-09-13T02:44:08.913 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : rbd-fuse-2:17.2.7-1627.gbbdadfa3.el9.x86_64 1/1 2024-09-13T02:44:09.132 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:01:36 ago on Fri 13 Sep 2024 02:42:33 AM UTC. 2024-09-13T02:44:09.221 INFO:teuthology.orchestra.run.smithi089.stdout:Package python3-cephfs-2:17.2.7-1627.gbbdadfa3.el9.x86_64 is already installed. 2024-09-13T02:44:09.263 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-09-13T02:44:09.264 INFO:teuthology.orchestra.run.smithi089.stdout:Nothing to do. 2024-09-13T02:44:09.264 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-09-13T02:44:09.276 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: rbd-fuse-2:17.2.7-1627.gbbdadfa3.el9.x86_64 1/1 2024-09-13T02:44:09.346 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install python3-rbd 2024-09-13T02:44:09.534 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : rbd-fuse-2:17.2.7-1627.gbbdadfa3.el9.x86_64 1/1 2024-09-13T02:44:09.534 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-13T02:44:09.534 INFO:teuthology.orchestra.run.smithi131.stdout:Installed: 2024-09-13T02:44:09.534 INFO:teuthology.orchestra.run.smithi131.stdout: rbd-fuse-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:44:09.534 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-13T02:44:09.535 INFO:teuthology.orchestra.run.smithi131.stdout:Complete! 2024-09-13T02:44:09.767 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum -y install rbd-mirror 2024-09-13T02:44:09.907 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:01:36 ago on Fri 13 Sep 2024 02:42:33 AM UTC. 2024-09-13T02:44:09.996 INFO:teuthology.orchestra.run.smithi089.stdout:Package python3-rbd-2:17.2.7-1627.gbbdadfa3.el9.x86_64 is already installed. 2024-09-13T02:44:10.039 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-09-13T02:44:10.040 INFO:teuthology.orchestra.run.smithi089.stdout:Nothing to do. 2024-09-13T02:44:10.040 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-09-13T02:44:10.122 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install rbd-fuse 2024-09-13T02:44:10.340 INFO:teuthology.orchestra.run.smithi131.stdout:Last metadata expiration check: 0:01:37 ago on Fri 13 Sep 2024 02:42:33 AM UTC. 2024-09-13T02:44:10.472 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2024-09-13T02:44:10.473 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-09-13T02:44:10.473 INFO:teuthology.orchestra.run.smithi131.stdout: Package Arch Version Repo Size 2024-09-13T02:44:10.473 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-09-13T02:44:10.473 INFO:teuthology.orchestra.run.smithi131.stdout:Installing: 2024-09-13T02:44:10.473 INFO:teuthology.orchestra.run.smithi131.stdout: rbd-mirror x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 2.9 M 2024-09-13T02:44:10.473 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-13T02:44:10.473 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction Summary 2024-09-13T02:44:10.474 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-09-13T02:44:10.474 INFO:teuthology.orchestra.run.smithi131.stdout:Install 1 Package 2024-09-13T02:44:10.474 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-13T02:44:10.474 INFO:teuthology.orchestra.run.smithi131.stdout:Total download size: 2.9 M 2024-09-13T02:44:10.474 INFO:teuthology.orchestra.run.smithi131.stdout:Installed size: 12 M 2024-09-13T02:44:10.474 INFO:teuthology.orchestra.run.smithi131.stdout:Downloading Packages: 2024-09-13T02:44:10.686 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:01:37 ago on Fri 13 Sep 2024 02:42:33 AM UTC. 2024-09-13T02:44:10.819 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-09-13T02:44:10.820 INFO:teuthology.orchestra.run.smithi131.stdout:rbd-mirror-17.2.7-1627.gbbdadfa3.el9.x86_64.rpm 8.5 MB/s | 2.9 MB 00:00 2024-09-13T02:44:10.820 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-13T02:44:10.820 INFO:teuthology.orchestra.run.smithi089.stdout: Package Architecture Version Repository Size 2024-09-13T02:44:10.820 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-13T02:44:10.821 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2024-09-13T02:44:10.821 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-fuse x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 82 k 2024-09-13T02:44:10.821 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:44:10.821 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2024-09-13T02:44:10.821 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-13T02:44:10.821 INFO:teuthology.orchestra.run.smithi089.stdout:Install 1 Package 2024-09-13T02:44:10.821 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:44:10.821 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 82 k 2024-09-13T02:44:10.821 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 222 k 2024-09-13T02:44:10.821 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2024-09-13T02:44:10.822 INFO:teuthology.orchestra.run.smithi131.stdout:-------------------------------------------------------------------------------- 2024-09-13T02:44:10.822 INFO:teuthology.orchestra.run.smithi131.stdout:Total 8.5 MB/s | 2.9 MB 00:00 2024-09-13T02:44:10.822 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction check 2024-09-13T02:44:10.829 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction check succeeded. 2024-09-13T02:44:10.830 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction test 2024-09-13T02:44:10.908 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction test succeeded. 2024-09-13T02:44:10.909 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction 2024-09-13T02:44:11.011 INFO:teuthology.orchestra.run.smithi089.stdout:rbd-fuse-17.2.7-1627.gbbdadfa3.el9.x86_64.rpm 430 kB/s | 82 kB 00:00 2024-09-13T02:44:11.011 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2024-09-13T02:44:11.011 INFO:teuthology.orchestra.run.smithi089.stdout:Total 427 kB/s | 82 kB 00:00 2024-09-13T02:44:11.011 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2024-09-13T02:44:11.018 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2024-09-13T02:44:11.018 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2024-09-13T02:44:11.082 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2024-09-13T02:44:11.082 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2024-09-13T02:44:11.227 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2024-09-13T02:44:11.314 INFO:teuthology.orchestra.run.smithi131.stdout: Preparing : 1/1 2024-09-13T02:44:11.332 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : rbd-fuse-2:17.2.7-1627.gbbdadfa3.el9.x86_64 1/1 2024-09-13T02:44:11.387 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : rbd-mirror-2:17.2.7-1627.gbbdadfa3.el9.x86_64 1/1 2024-09-13T02:44:11.412 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: rbd-mirror-2:17.2.7-1627.gbbdadfa3.el9.x86_64 1/1 2024-09-13T02:44:11.412 INFO:teuthology.orchestra.run.smithi131.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T02:44:11.412 INFO:teuthology.orchestra.run.smithi131.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-13T02:44:11.412 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T02:44:11.412 INFO:teuthology.orchestra.run.smithi131.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T02:44:11.412 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-13T02:44:11.692 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: rbd-fuse-2:17.2.7-1627.gbbdadfa3.el9.x86_64 1/1 2024-09-13T02:44:11.959 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : rbd-fuse-2:17.2.7-1627.gbbdadfa3.el9.x86_64 1/1 2024-09-13T02:44:11.959 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:44:11.960 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2024-09-13T02:44:11.960 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-fuse-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:44:11.960 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:44:11.960 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-09-13T02:44:12.212 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install rbd-mirror 2024-09-13T02:44:12.529 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : rbd-mirror-2:17.2.7-1627.gbbdadfa3.el9.x86_64 1/1 2024-09-13T02:44:12.530 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-13T02:44:12.530 INFO:teuthology.orchestra.run.smithi131.stdout:Installed: 2024-09-13T02:44:12.530 INFO:teuthology.orchestra.run.smithi131.stdout: rbd-mirror-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:44:12.530 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-13T02:44:12.530 INFO:teuthology.orchestra.run.smithi131.stdout:Complete! 2024-09-13T02:44:12.773 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:01:39 ago on Fri 13 Sep 2024 02:42:33 AM UTC. 2024-09-13T02:44:12.801 DEBUG:teuthology.orchestra.run.smithi131:> sudo yum -y install rbd-nbd 2024-09-13T02:44:12.907 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-09-13T02:44:12.908 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-13T02:44:12.908 INFO:teuthology.orchestra.run.smithi089.stdout: Package Arch Version Repo Size 2024-09-13T02:44:12.908 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-13T02:44:12.908 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2024-09-13T02:44:12.908 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-mirror x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 2.9 M 2024-09-13T02:44:12.908 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:44:12.908 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2024-09-13T02:44:12.908 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-13T02:44:12.909 INFO:teuthology.orchestra.run.smithi089.stdout:Install 1 Package 2024-09-13T02:44:12.909 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:44:12.909 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 2.9 M 2024-09-13T02:44:12.909 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 12 M 2024-09-13T02:44:12.909 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2024-09-13T02:44:13.240 INFO:teuthology.orchestra.run.smithi089.stdout:rbd-mirror-17.2.7-1627.gbbdadfa3.el9.x86_64.rpm 8.9 MB/s | 2.9 MB 00:00 2024-09-13T02:44:13.241 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2024-09-13T02:44:13.241 INFO:teuthology.orchestra.run.smithi089.stdout:Total 8.8 MB/s | 2.9 MB 00:00 2024-09-13T02:44:13.241 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2024-09-13T02:44:13.250 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2024-09-13T02:44:13.250 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2024-09-13T02:44:13.331 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2024-09-13T02:44:13.332 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2024-09-13T02:44:13.389 INFO:teuthology.orchestra.run.smithi131.stdout:Last metadata expiration check: 0:01:40 ago on Fri 13 Sep 2024 02:42:33 AM UTC. 2024-09-13T02:44:13.523 INFO:teuthology.orchestra.run.smithi131.stdout:Dependencies resolved. 2024-09-13T02:44:13.523 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-09-13T02:44:13.523 INFO:teuthology.orchestra.run.smithi131.stdout: Package Architecture Version Repository Size 2024-09-13T02:44:13.523 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-09-13T02:44:13.523 INFO:teuthology.orchestra.run.smithi131.stdout:Installing: 2024-09-13T02:44:13.523 INFO:teuthology.orchestra.run.smithi131.stdout: rbd-nbd x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 165 k 2024-09-13T02:44:13.523 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-13T02:44:13.524 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction Summary 2024-09-13T02:44:13.524 INFO:teuthology.orchestra.run.smithi131.stdout:================================================================================ 2024-09-13T02:44:13.524 INFO:teuthology.orchestra.run.smithi131.stdout:Install 1 Package 2024-09-13T02:44:13.524 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-13T02:44:13.524 INFO:teuthology.orchestra.run.smithi131.stdout:Total download size: 165 k 2024-09-13T02:44:13.524 INFO:teuthology.orchestra.run.smithi131.stdout:Installed size: 477 k 2024-09-13T02:44:13.524 INFO:teuthology.orchestra.run.smithi131.stdout:Downloading Packages: 2024-09-13T02:44:13.741 INFO:teuthology.orchestra.run.smithi131.stdout:rbd-nbd-17.2.7-1627.gbbdadfa3.el9.x86_64.rpm 763 kB/s | 165 kB 00:00 2024-09-13T02:44:13.741 INFO:teuthology.orchestra.run.smithi131.stdout:-------------------------------------------------------------------------------- 2024-09-13T02:44:13.742 INFO:teuthology.orchestra.run.smithi131.stdout:Total 758 kB/s | 165 kB 00:00 2024-09-13T02:44:13.742 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction check 2024-09-13T02:44:13.749 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction check succeeded. 2024-09-13T02:44:13.749 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction test 2024-09-13T02:44:13.782 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2024-09-13T02:44:13.813 INFO:teuthology.orchestra.run.smithi131.stdout:Transaction test succeeded. 2024-09-13T02:44:13.813 INFO:teuthology.orchestra.run.smithi131.stdout:Running transaction 2024-09-13T02:44:13.850 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : rbd-mirror-2:17.2.7-1627.gbbdadfa3.el9.x86_64 1/1 2024-09-13T02:44:13.876 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: rbd-mirror-2:17.2.7-1627.gbbdadfa3.el9.x86_64 1/1 2024-09-13T02:44:13.876 INFO:teuthology.orchestra.run.smithi089.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-13T02:44:13.876 INFO:teuthology.orchestra.run.smithi089.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-13T02:44:13.877 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T02:44:13.877 INFO:teuthology.orchestra.run.smithi089.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-13T02:44:13.877 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:44:13.969 INFO:teuthology.orchestra.run.smithi131.stdout: Preparing : 1/1 2024-09-13T02:44:14.062 INFO:teuthology.orchestra.run.smithi131.stdout: Installing : rbd-nbd-2:17.2.7-1627.gbbdadfa3.el9.x86_64 1/1 2024-09-13T02:44:14.438 INFO:teuthology.orchestra.run.smithi131.stdout: Running scriptlet: rbd-nbd-2:17.2.7-1627.gbbdadfa3.el9.x86_64 1/1 2024-09-13T02:44:14.691 INFO:teuthology.orchestra.run.smithi131.stdout: Verifying : rbd-nbd-2:17.2.7-1627.gbbdadfa3.el9.x86_64 1/1 2024-09-13T02:44:14.691 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-13T02:44:14.691 INFO:teuthology.orchestra.run.smithi131.stdout:Installed: 2024-09-13T02:44:14.691 INFO:teuthology.orchestra.run.smithi131.stdout: rbd-nbd-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:44:14.691 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-13T02:44:14.691 INFO:teuthology.orchestra.run.smithi131.stdout:Complete! 2024-09-13T02:44:14.962 DEBUG:teuthology.parallel:result is None 2024-09-13T02:44:15.021 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : rbd-mirror-2:17.2.7-1627.gbbdadfa3.el9.x86_64 1/1 2024-09-13T02:44:15.021 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:44:15.021 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2024-09-13T02:44:15.022 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-mirror-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:44:15.022 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:44:15.022 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-09-13T02:44:15.293 DEBUG:teuthology.orchestra.run.smithi089:> sudo yum -y install rbd-nbd 2024-09-13T02:44:15.871 INFO:teuthology.orchestra.run.smithi089.stdout:Last metadata expiration check: 0:01:42 ago on Fri 13 Sep 2024 02:42:33 AM UTC. 2024-09-13T02:44:16.008 INFO:teuthology.orchestra.run.smithi089.stdout:Dependencies resolved. 2024-09-13T02:44:16.009 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-13T02:44:16.009 INFO:teuthology.orchestra.run.smithi089.stdout: Package Architecture Version Repository Size 2024-09-13T02:44:16.009 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-13T02:44:16.009 INFO:teuthology.orchestra.run.smithi089.stdout:Installing: 2024-09-13T02:44:16.009 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-nbd x86_64 2:17.2.7-1627.gbbdadfa3.el9 ceph 165 k 2024-09-13T02:44:16.009 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:44:16.009 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction Summary 2024-09-13T02:44:16.010 INFO:teuthology.orchestra.run.smithi089.stdout:================================================================================ 2024-09-13T02:44:16.010 INFO:teuthology.orchestra.run.smithi089.stdout:Install 1 Package 2024-09-13T02:44:16.010 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:44:16.010 INFO:teuthology.orchestra.run.smithi089.stdout:Total download size: 165 k 2024-09-13T02:44:16.010 INFO:teuthology.orchestra.run.smithi089.stdout:Installed size: 477 k 2024-09-13T02:44:16.010 INFO:teuthology.orchestra.run.smithi089.stdout:Downloading Packages: 2024-09-13T02:44:16.221 INFO:teuthology.orchestra.run.smithi089.stdout:rbd-nbd-17.2.7-1627.gbbdadfa3.el9.x86_64.rpm 782 kB/s | 165 kB 00:00 2024-09-13T02:44:16.221 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2024-09-13T02:44:16.222 INFO:teuthology.orchestra.run.smithi089.stdout:Total 777 kB/s | 165 kB 00:00 2024-09-13T02:44:16.222 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction check 2024-09-13T02:44:16.229 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction check succeeded. 2024-09-13T02:44:16.229 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction test 2024-09-13T02:44:16.292 INFO:teuthology.orchestra.run.smithi089.stdout:Transaction test succeeded. 2024-09-13T02:44:16.292 INFO:teuthology.orchestra.run.smithi089.stdout:Running transaction 2024-09-13T02:44:16.458 INFO:teuthology.orchestra.run.smithi089.stdout: Preparing : 1/1 2024-09-13T02:44:16.559 INFO:teuthology.orchestra.run.smithi089.stdout: Installing : rbd-nbd-2:17.2.7-1627.gbbdadfa3.el9.x86_64 1/1 2024-09-13T02:44:16.927 INFO:teuthology.orchestra.run.smithi089.stdout: Running scriptlet: rbd-nbd-2:17.2.7-1627.gbbdadfa3.el9.x86_64 1/1 2024-09-13T02:44:17.181 INFO:teuthology.orchestra.run.smithi089.stdout: Verifying : rbd-nbd-2:17.2.7-1627.gbbdadfa3.el9.x86_64 1/1 2024-09-13T02:44:17.181 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:44:17.181 INFO:teuthology.orchestra.run.smithi089.stdout:Installed: 2024-09-13T02:44:17.181 INFO:teuthology.orchestra.run.smithi089.stdout: rbd-nbd-2:17.2.7-1627.gbbdadfa3.el9.x86_64 2024-09-13T02:44:17.181 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:44:17.181 INFO:teuthology.orchestra.run.smithi089.stdout:Complete! 2024-09-13T02:44:17.475 DEBUG:teuthology.parallel:result is None 2024-09-13T02:44:17.475 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-13T02:44:17.475 INFO:teuthology.packaging:ref: None 2024-09-13T02:44:17.475 INFO:teuthology.packaging:tag: None 2024-09-13T02:44:17.475 INFO:teuthology.packaging:branch: quincy 2024-09-13T02:44:17.475 INFO:teuthology.packaging:sha1: 7741f7f9ee20524f89b8f61d1609b32fb3b1570a 2024-09-13T02:44:17.476 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-09-13T02:44:17.679 DEBUG:teuthology.orchestra.run.smithi089:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-13T02:44:17.701 INFO:teuthology.orchestra.run.smithi089.stdout:17.2.7-1627.gbbdadfa3.el9 2024-09-13T02:44:17.702 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-1627.gbbdadfa3.el9 2024-09-13T02:44:17.702 INFO:teuthology.task.install:The correct ceph version 17.2.7-1627.gbbdadfa3 is installed. 2024-09-13T02:44:17.704 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-13T02:44:17.704 INFO:teuthology.packaging:ref: None 2024-09-13T02:44:17.704 INFO:teuthology.packaging:tag: None 2024-09-13T02:44:17.704 INFO:teuthology.packaging:branch: quincy 2024-09-13T02:44:17.704 INFO:teuthology.packaging:sha1: 7741f7f9ee20524f89b8f61d1609b32fb3b1570a 2024-09-13T02:44:17.705 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=quincy 2024-09-13T02:44:17.915 DEBUG:teuthology.orchestra.run.smithi131:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-13T02:44:17.940 INFO:teuthology.orchestra.run.smithi131.stdout:17.2.7-1627.gbbdadfa3.el9 2024-09-13T02:44:17.940 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-1627.gbbdadfa3.el9 2024-09-13T02:44:17.940 INFO:teuthology.task.install:The correct ceph version 17.2.7-1627.gbbdadfa3 is installed. 2024-09-13T02:44:17.942 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-13T02:44:17.943 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-13T02:44:17.943 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-13T02:44:17.970 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-13T02:44:17.970 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-13T02:44:18.010 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-13T02:44:18.010 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-13T02:44:18.010 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/usr/bin/daemon-helper 2024-09-13T02:44:18.036 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-13T02:44:18.105 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-13T02:44:18.105 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/usr/bin/daemon-helper 2024-09-13T02:44:18.134 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-13T02:44:18.202 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-13T02:44:18.202 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-13T02:44:18.202 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-13T02:44:18.228 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-13T02:44:18.292 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-13T02:44:18.293 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-13T02:44:18.320 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-13T02:44:18.386 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-13T02:44:18.387 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-13T02:44:18.387 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/usr/bin/stdin-killer 2024-09-13T02:44:18.411 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-13T02:44:18.476 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-13T02:44:18.476 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/usr/bin/stdin-killer 2024-09-13T02:44:18.502 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-13T02:44:18.568 INFO:teuthology.run_tasks:Running task print... 2024-09-13T02:44:18.578 INFO:teuthology.task.print:**** done install task... 2024-09-13T02:44:18.578 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-13T02:44:18.718 INFO:tasks.cephadm:Config: {'cephadm_branch': 'quincy', 'cephadm_git_url': 'https://github.com/ceph/ceph', 'conf': {'osd': {'osd_class_default_list': '*', 'osd_class_load_list': '*', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}}, 'image': 'quay.ceph.io/ceph-ci/ceph:quincy', 'roleless': True, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'OSD_DOWN', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy'], 'sha1': '7741f7f9ee20524f89b8f61d1609b32fb3b1570a'} 2024-09-13T02:44:18.719 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:quincy 2024-09-13T02:44:18.719 INFO:tasks.cephadm:Cluster fsid is 12cdb164-717a-11ef-bceb-c7b262605968 2024-09-13T02:44:18.719 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-13T02:44:18.719 INFO:tasks.cephadm:No mon roles; fabricating mons 2024-09-13T02:44:18.719 INFO:tasks.cephadm:Monitor IPs: {'mon.smithi089': '172.21.15.89', 'mon.smithi131': '172.21.15.131'} 2024-09-13T02:44:18.720 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-13T02:44:18.720 DEBUG:teuthology.orchestra.run.smithi089:> sudo hostname $(hostname -s) 2024-09-13T02:44:18.745 DEBUG:teuthology.orchestra.run.smithi131:> sudo hostname $(hostname -s) 2024-09-13T02:44:18.771 INFO:tasks.cephadm:Downloading cephadm (repo https://github.com/ceph/ceph ref quincy)... 2024-09-13T02:44:18.771 DEBUG:teuthology.orchestra.run.smithi089:> curl --silent https://raw.githubusercontent.com/ceph/ceph/quincy/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-13T02:44:18.921 INFO:teuthology.orchestra.run.smithi089.stdout:-rw-r--r--. 1 ubuntu ubuntu 378585 Sep 13 02:44 /home/ubuntu/cephtest/cephadm 2024-09-13T02:44:18.921 DEBUG:teuthology.orchestra.run.smithi131:> curl --silent https://raw.githubusercontent.com/ceph/ceph/quincy/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-13T02:44:19.102 INFO:teuthology.orchestra.run.smithi131.stdout:-rw-r--r--. 1 ubuntu ubuntu 378585 Sep 13 02:44 /home/ubuntu/cephtest/cephadm 2024-09-13T02:44:19.102 DEBUG:teuthology.orchestra.run.smithi089:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-13T02:44:19.118 DEBUG:teuthology.orchestra.run.smithi131:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-13T02:44:19.144 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:quincy on all hosts... 2024-09-13T02:44:19.144 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy pull 2024-09-13T02:44:19.160 DEBUG:teuthology.orchestra.run.smithi131:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy pull 2024-09-13T02:44:20.828 INFO:teuthology.orchestra.run.smithi089.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2024-09-13T02:44:20.863 INFO:teuthology.orchestra.run.smithi131.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2024-09-13T02:44:53.793 INFO:teuthology.orchestra.run.smithi131.stdout:{ 2024-09-13T02:44:53.794 INFO:teuthology.orchestra.run.smithi131.stdout: "ceph_version": "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)", 2024-09-13T02:44:53.794 INFO:teuthology.orchestra.run.smithi131.stdout: "image_id": "a994b00deb3a4a8eeb484a456d3f3207aae0401a31d251b199b2c9dbc1c4036c", 2024-09-13T02:44:53.794 INFO:teuthology.orchestra.run.smithi131.stdout: "repo_digests": [ 2024-09-13T02:44:53.794 INFO:teuthology.orchestra.run.smithi131.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:20745bd452f31fe48c67c092910f9b2c550f9dc62d239ff3e2953415a85590be" 2024-09-13T02:44:53.794 INFO:teuthology.orchestra.run.smithi131.stdout: ] 2024-09-13T02:44:53.794 INFO:teuthology.orchestra.run.smithi131.stdout:} 2024-09-13T02:44:54.692 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-13T02:44:54.692 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph_version": "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)", 2024-09-13T02:44:54.693 INFO:teuthology.orchestra.run.smithi089.stdout: "image_id": "a994b00deb3a4a8eeb484a456d3f3207aae0401a31d251b199b2c9dbc1c4036c", 2024-09-13T02:44:54.693 INFO:teuthology.orchestra.run.smithi089.stdout: "repo_digests": [ 2024-09-13T02:44:54.693 INFO:teuthology.orchestra.run.smithi089.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:20745bd452f31fe48c67c092910f9b2c550f9dc62d239ff3e2953415a85590be" 2024-09-13T02:44:54.693 INFO:teuthology.orchestra.run.smithi089.stdout: ] 2024-09-13T02:44:54.693 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-13T02:44:54.712 DEBUG:teuthology.orchestra.run.smithi089:> sudo mkdir -p /etc/ceph 2024-09-13T02:44:54.769 DEBUG:teuthology.orchestra.run.smithi131:> sudo mkdir -p /etc/ceph 2024-09-13T02:44:54.803 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 777 /etc/ceph 2024-09-13T02:44:54.828 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 777 /etc/ceph 2024-09-13T02:44:54.872 INFO:tasks.cephadm:Writing seed config... 2024-09-13T02:44:54.873 INFO:tasks.cephadm: override: [osd] osd_class_default_list = * 2024-09-13T02:44:54.874 INFO:tasks.cephadm: override: [osd] osd_class_load_list = * 2024-09-13T02:44:54.874 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-09-13T02:44:54.874 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-09-13T02:44:54.874 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-09-13T02:44:54.874 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-13T02:44:54.874 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-13T02:44:54.874 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-09-13T02:44:54.874 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-09-13T02:44:54.874 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-13T02:44:54.874 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-13T02:44:54.874 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-09-13T02:44:54.874 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-13T02:44:54.874 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-13T02:44:54.875 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-13T02:44:54.875 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-13T02:44:54.875 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-13T02:44:54.875 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-09-13T02:44:54.875 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-09-13T02:44:54.875 INFO:tasks.cephadm: override: [client] debug client = 20 2024-09-13T02:44:54.875 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-09-13T02:44:54.875 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-09-13T02:44:54.875 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-09-13T02:44:54.875 INFO:tasks.cephadm: override: [global] mon pg warn min per osd = 0 2024-09-13T02:44:54.875 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-09-13T02:44:54.875 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-09-13T02:44:54.876 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-09-13T02:44:54.876 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-09-13T02:44:54.876 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-09-13T02:44:54.876 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-09-13T02:44:54.876 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-09-13T02:44:54.876 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-09-13T02:44:54.876 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-09-13T02:44:54.876 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-09-13T02:44:54.877 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-13T02:44:54.877 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-13T02:44:54.877 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-13T02:44:54.877 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-13T02:44:54.877 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-13T02:44:54.877 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-13T02:44:54.877 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-13T02:44:54.877 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-09-13T02:44:54.878 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-09-13T02:44:54.878 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-13T02:44:54.878 DEBUG:teuthology.orchestra.run.smithi089:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-13T02:44:54.895 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 12cdb164-717a-11ef-bceb-c7b262605968 mon pg warn min per osd = 0 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true osd_class_default_list = * osd_class_load_list = * bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-09-13T02:44:54.895 DEBUG:teuthology.orchestra.run.smithi089:mon.smithi089> sudo journalctl -f -n 0 -u ceph-12cdb164-717a-11ef-bceb-c7b262605968@mon.smithi089.service 2024-09-13T02:44:54.937 INFO:tasks.cephadm:Bootstrapping... 2024-09-13T02:44:54.937 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy -v bootstrap --fsid 12cdb164-717a-11ef-bceb-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.89 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-13T02:44:55.134 INFO:teuthology.orchestra.run.smithi089.stdout:-------------------------------------------------------------------------------- 2024-09-13T02:44:55.134 INFO:teuthology.orchestra.run.smithi089.stdout:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:quincy', '-v', 'bootstrap', '--fsid', '12cdb164-717a-11ef-bceb-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-ip', '172.21.15.89', '--skip-admin-label'] 2024-09-13T02:44:55.158 INFO:teuthology.orchestra.run.smithi089.stdout:/bin/podman: stdout 5.2.2 2024-09-13T02:44:55.158 INFO:teuthology.orchestra.run.smithi089.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-13T02:44:55.158 INFO:teuthology.orchestra.run.smithi089.stdout:Verifying podman|docker is present... 2024-09-13T02:44:55.186 INFO:teuthology.orchestra.run.smithi089.stdout:/bin/podman: stdout 5.2.2 2024-09-13T02:44:55.186 INFO:teuthology.orchestra.run.smithi089.stdout:Verifying lvm2 is present... 2024-09-13T02:44:55.186 INFO:teuthology.orchestra.run.smithi089.stdout:Verifying time synchronization is in place... 2024-09-13T02:44:55.195 INFO:teuthology.orchestra.run.smithi089.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-13T02:44:55.195 INFO:teuthology.orchestra.run.smithi089.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-13T02:44:55.201 INFO:teuthology.orchestra.run.smithi089.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-13T02:44:55.201 INFO:teuthology.orchestra.run.smithi089.stdout:systemctl: stdout inactive 2024-09-13T02:44:55.208 INFO:teuthology.orchestra.run.smithi089.stdout:systemctl: stdout enabled 2024-09-13T02:44:55.215 INFO:teuthology.orchestra.run.smithi089.stdout:systemctl: stdout active 2024-09-13T02:44:55.215 INFO:teuthology.orchestra.run.smithi089.stdout:Unit chronyd.service is enabled and running 2024-09-13T02:44:55.215 INFO:teuthology.orchestra.run.smithi089.stdout:Repeating the final host check... 2024-09-13T02:44:55.237 INFO:teuthology.orchestra.run.smithi089.stdout:/bin/podman: stdout 5.2.2 2024-09-13T02:44:55.273 INFO:teuthology.orchestra.run.smithi089.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-13T02:44:55.273 INFO:teuthology.orchestra.run.smithi089.stdout:systemctl is present 2024-09-13T02:44:55.273 INFO:teuthology.orchestra.run.smithi089.stdout:lvcreate is present 2024-09-13T02:44:55.276 INFO:teuthology.orchestra.run.smithi089.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-13T02:44:55.276 INFO:teuthology.orchestra.run.smithi089.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-13T02:44:55.276 INFO:teuthology.orchestra.run.smithi089.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-13T02:44:55.277 INFO:teuthology.orchestra.run.smithi089.stdout:systemctl: stdout inactive 2024-09-13T02:44:55.277 INFO:teuthology.orchestra.run.smithi089.stdout:systemctl: stdout enabled 2024-09-13T02:44:55.277 INFO:teuthology.orchestra.run.smithi089.stdout:systemctl: stdout active 2024-09-13T02:44:55.277 INFO:teuthology.orchestra.run.smithi089.stdout:Unit chronyd.service is enabled and running 2024-09-13T02:44:55.277 INFO:teuthology.orchestra.run.smithi089.stdout:Host looks OK 2024-09-13T02:44:55.277 INFO:teuthology.orchestra.run.smithi089.stdout:Cluster fsid: 12cdb164-717a-11ef-bceb-c7b262605968 2024-09-13T02:44:55.277 INFO:teuthology.orchestra.run.smithi089.stdout:Acquiring lock 140438715703648 on /run/cephadm/12cdb164-717a-11ef-bceb-c7b262605968.lock 2024-09-13T02:44:55.277 INFO:teuthology.orchestra.run.smithi089.stdout:Lock 140438715703648 acquired on /run/cephadm/12cdb164-717a-11ef-bceb-c7b262605968.lock 2024-09-13T02:44:55.277 INFO:teuthology.orchestra.run.smithi089.stdout:Verifying IP 172.21.15.89 port 3300 ... 2024-09-13T02:44:55.277 INFO:teuthology.orchestra.run.smithi089.stdout:Verifying IP 172.21.15.89 port 6789 ... 2024-09-13T02:44:55.277 INFO:teuthology.orchestra.run.smithi089.stdout:Base mon IP(s) is [172.21.15.89:3300, 172.21.15.89:6789], mon addrv is [v2:172.21.15.89:3300,v1:172.21.15.89:6789] 2024-09-13T02:44:55.277 INFO:teuthology.orchestra.run.smithi089.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.89 metric 100 2024-09-13T02:44:55.277 INFO:teuthology.orchestra.run.smithi089.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.89 metric 100 2024-09-13T02:44:55.278 INFO:teuthology.orchestra.run.smithi089.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-13T02:44:55.278 INFO:teuthology.orchestra.run.smithi089.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 1024 pref medium 2024-09-13T02:44:55.278 INFO:teuthology.orchestra.run.smithi089.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 pref medium 2024-09-13T02:44:55.278 INFO:teuthology.orchestra.run.smithi089.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-13T02:44:55.278 INFO:teuthology.orchestra.run.smithi089.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-13T02:44:55.278 INFO:teuthology.orchestra.run.smithi089.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-13T02:44:55.278 INFO:teuthology.orchestra.run.smithi089.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-09-13T02:44:55.278 INFO:teuthology.orchestra.run.smithi089.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe8f:d501/64 scope link noprefixroute 2024-09-13T02:44:55.278 INFO:teuthology.orchestra.run.smithi089.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-13T02:44:55.278 INFO:teuthology.orchestra.run.smithi089.stdout:Mon IP `172.21.15.89` is in CIDR network `172.21.0.0/20` 2024-09-13T02:44:55.278 INFO:teuthology.orchestra.run.smithi089.stdout:Mon IP `172.21.15.89` is in CIDR network `172.21.0.0/20` 2024-09-13T02:44:55.278 INFO:teuthology.orchestra.run.smithi089.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-13T02:44:55.278 INFO:teuthology.orchestra.run.smithi089.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-13T02:44:55.279 INFO:teuthology.orchestra.run.smithi089.stdout:Pulling container image quay.ceph.io/ceph-ci/ceph:quincy... 2024-09-13T02:44:57.577 INFO:teuthology.orchestra.run.smithi089.stdout:/bin/podman: stdout a994b00deb3a4a8eeb484a456d3f3207aae0401a31d251b199b2c9dbc1c4036c 2024-09-13T02:44:57.577 INFO:teuthology.orchestra.run.smithi089.stdout:/bin/podman: stderr Trying to pull quay.ceph.io/ceph-ci/ceph:quincy... 2024-09-13T02:44:57.577 INFO:teuthology.orchestra.run.smithi089.stdout:/bin/podman: stderr Getting image source signatures 2024-09-13T02:44:57.578 INFO:teuthology.orchestra.run.smithi089.stdout:/bin/podman: stderr Copying blob sha256:ca308b3f556da579f99cd79db684ebbf678db4c29a649b66aaf6f99bc8124cd6 2024-09-13T02:44:57.578 INFO:teuthology.orchestra.run.smithi089.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-13T02:44:57.578 INFO:teuthology.orchestra.run.smithi089.stdout:/bin/podman: stderr Copying config sha256:a994b00deb3a4a8eeb484a456d3f3207aae0401a31d251b199b2c9dbc1c4036c 2024-09-13T02:44:57.578 INFO:teuthology.orchestra.run.smithi089.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-13T02:44:58.505 INFO:teuthology.orchestra.run.smithi089.stdout:ceph: stdout ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable) 2024-09-13T02:44:58.505 INFO:teuthology.orchestra.run.smithi089.stdout:Ceph version: ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable) 2024-09-13T02:44:58.505 INFO:teuthology.orchestra.run.smithi089.stdout:Extracting ceph user uid/gid from container image... 2024-09-13T02:44:59.369 INFO:teuthology.orchestra.run.smithi089.stdout:stat: stdout 167 167 2024-09-13T02:44:59.369 INFO:teuthology.orchestra.run.smithi089.stdout:Creating initial keys... 2024-09-13T02:45:00.292 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-authtool: stdout AQArp+Nm94YyJxAAud3KZyvokvxF4IhnuoeMxw== 2024-09-13T02:45:01.173 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-authtool: stdout AQAsp+NmHM4JJRAAYGG6qMcjNVFyFe9/TVM4kg== 2024-09-13T02:45:02.203 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph-authtool: stdout AQAtp+NmyrWMHhAACsN7SfHN9k0C6X008finsA== 2024-09-13T02:45:02.204 INFO:teuthology.orchestra.run.smithi089.stdout:Creating initial monmap... 2024-09-13T02:45:03.210 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-13T02:45:03.210 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = octopus 2024-09-13T02:45:03.210 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 12cdb164-717a-11ef-bceb-c7b262605968 2024-09-13T02:45:03.210 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-13T02:45:03.210 INFO:teuthology.orchestra.run.smithi089.stdout:monmaptool for smithi089 [v2:172.21.15.89:3300,v1:172.21.15.89:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-13T02:45:03.210 INFO:teuthology.orchestra.run.smithi089.stdout:setting min_mon_release = octopus 2024-09-13T02:45:03.210 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/monmaptool: set fsid to 12cdb164-717a-11ef-bceb-c7b262605968 2024-09-13T02:45:03.211 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-13T02:45:03.211 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:45:03.211 INFO:teuthology.orchestra.run.smithi089.stdout:Creating mon... 2024-09-13T02:45:04.207 INFO:teuthology.orchestra.run.smithi089.stdout:create mon.smithi089 on 2024-09-13T02:45:04.409 INFO:teuthology.orchestra.run.smithi089.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-13T02:45:04.553 INFO:teuthology.orchestra.run.smithi089.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-13T02:45:04.709 INFO:teuthology.orchestra.run.smithi089.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-12cdb164-717a-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-12cdb164-717a-11ef-bceb-c7b262605968.target. 2024-09-13T02:45:04.709 INFO:teuthology.orchestra.run.smithi089.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-12cdb164-717a-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-12cdb164-717a-11ef-bceb-c7b262605968.target. 2024-09-13T02:45:04.883 INFO:teuthology.orchestra.run.smithi089.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-12cdb164-717a-11ef-bceb-c7b262605968@mon.smithi089 2024-09-13T02:45:04.883 INFO:teuthology.orchestra.run.smithi089.stdout:systemctl: stderr Failed to reset failed state of unit ceph-12cdb164-717a-11ef-bceb-c7b262605968@mon.smithi089.service: Unit ceph-12cdb164-717a-11ef-bceb-c7b262605968@mon.smithi089.service not loaded. 2024-09-13T02:45:05.044 INFO:teuthology.orchestra.run.smithi089.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-12cdb164-717a-11ef-bceb-c7b262605968.target.wants/ceph-12cdb164-717a-11ef-bceb-c7b262605968@mon.smithi089.service → /etc/systemd/system/ceph-12cdb164-717a-11ef-bceb-c7b262605968@.service. 2024-09-13T02:45:05.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:05 smithi089 ceph-mon[27272]: mon.smithi089 is new leader, mons smithi089 in quorum (ranks 0) 2024-09-13T02:45:05.597 INFO:teuthology.orchestra.run.smithi089.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-13T02:45:05.598 INFO:teuthology.orchestra.run.smithi089.stdout:systemctl: stdout disabled 2024-09-13T02:45:05.605 INFO:teuthology.orchestra.run.smithi089.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-13T02:45:05.605 INFO:teuthology.orchestra.run.smithi089.stdout:systemctl: stdout inactive 2024-09-13T02:45:05.605 INFO:teuthology.orchestra.run.smithi089.stdout:firewalld.service is not enabled 2024-09-13T02:45:05.606 INFO:teuthology.orchestra.run.smithi089.stdout:Not possible to enable service . firewalld.service is not available 2024-09-13T02:45:05.606 INFO:teuthology.orchestra.run.smithi089.stdout:Waiting for mon to start... 2024-09-13T02:45:05.606 INFO:teuthology.orchestra.run.smithi089.stdout:Waiting for mon... 2024-09-13T02:45:05.841 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:05 smithi089 bash[27251]: 2f28cbb9e7b675c7a4bb7661ba9d0c92b80dd5b9286cbc478c6a2c634f077fbb 2024-09-13T02:45:05.841 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:05 smithi089 systemd[1]: Started Ceph mon.smithi089 for 12cdb164-717a-11ef-bceb-c7b262605968. 2024-09-13T02:45:06.632 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout cluster: 2024-09-13T02:45:06.633 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout id: 12cdb164-717a-11ef-bceb-c7b262605968 2024-09-13T02:45:06.633 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-13T02:45:06.633 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout 2024-09-13T02:45:06.633 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout services: 2024-09-13T02:45:06.633 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum smithi089 (age 0.565196s) 2024-09-13T02:45:06.633 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-13T02:45:06.633 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-13T02:45:06.633 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout 2024-09-13T02:45:06.633 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout data: 2024-09-13T02:45:06.633 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-13T02:45:06.633 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-13T02:45:06.634 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-13T02:45:06.634 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout pgs: 2024-09-13T02:45:06.634 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout 2024-09-13T02:45:06.634 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:06.017+0000 7f96a3557640 1 Processor -- start 2024-09-13T02:45:06.634 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:06.018+0000 7f96a3557640 1 -- start start 2024-09-13T02:45:06.634 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:06.018+0000 7f96a3557640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f969c070720 0x7f969c100610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:45:06.634 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:06.018+0000 7f96a3557640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f969c070b30 con 0x7f969c070720 2024-09-13T02:45:06.634 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:06.018+0000 7f96a12f3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f969c070720 0x7f969c100610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:45:06.634 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:06.018+0000 7f96a12f3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f969c070720 0x7f969c100610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34610/0 (socket says 172.21.15.89:34610) 2024-09-13T02:45:06.634 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:06.018+0000 7f96a12f3640 1 -- 172.21.15.89:0/1093886565 learned_addr learned my addr 172.21.15.89:0/1093886565 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:45:06.634 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:06.018+0000 7f96a12f3640 1 -- 172.21.15.89:0/1093886565 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f969c070c70 con 0x7f969c070720 2024-09-13T02:45:06.634 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:06.020+0000 7f96a12f3640 1 --2- 172.21.15.89:0/1093886565 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f969c070720 0x7f969c100610 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f9690009840 tx=0x7f96900091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfe43c0582b3e1e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:45:06.634 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:06.021+0000 7f968ffff640 1 -- 172.21.15.89:0/1093886565 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9690032440 con 0x7f969c070720 2024-09-13T02:45:06.635 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:06.021+0000 7f968ffff640 1 -- 172.21.15.89:0/1093886565 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96900325a0 con 0x7f969c070720 2024-09-13T02:45:06.635 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:06.021+0000 7f968ffff640 1 -- 172.21.15.89:0/1093886565 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f96900328d0 con 0x7f969c070720 2024-09-13T02:45:06.635 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:06.021+0000 7f96a3557640 1 -- 172.21.15.89:0/1093886565 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f969c070720 msgr2=0x7f969c100610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:06.635 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:06.021+0000 7f96a3557640 1 --2- 172.21.15.89:0/1093886565 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f969c070720 0x7f969c100610 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f9690009840 tx=0x7f96900091d0 comp rx=0 tx=0).stop 2024-09-13T02:45:06.635 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:06.021+0000 7f96a3557640 1 -- 172.21.15.89:0/1093886565 shutdown_connections 2024-09-13T02:45:06.635 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:06.021+0000 7f96a3557640 1 --2- 172.21.15.89:0/1093886565 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f969c070720 0x7f969c100610 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:06.635 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:06.021+0000 7f96a3557640 1 -- 172.21.15.89:0/1093886565 >> 172.21.15.89:0/1093886565 conn(0x7f969c0fbdf0 msgr2=0x7f969c0fe200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:45:06.635 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:06.021+0000 7f96a3557640 1 -- 172.21.15.89:0/1093886565 shutdown_connections 2024-09-13T02:45:06.635 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:06.021+0000 7f96a3557640 1 -- 172.21.15.89:0/1093886565 wait complete. 2024-09-13T02:45:06.635 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:06.022+0000 7f96a3557640 1 Processor -- start 2024-09-13T02:45:06.635 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:06.022+0000 7f96a3557640 1 -- start start 2024-09-13T02:45:06.635 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:06.022+0000 7f96a3557640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f969c070720 0x7f969c103600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:45:06.635 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:06.022+0000 7f96a3557640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f969c1131e0 con 0x7f969c070720 2024-09-13T02:45:06.636 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:06.022+0000 7f96a12f3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f969c070720 0x7f969c103600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:45:06.636 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:06.022+0000 7f96a12f3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f969c070720 0x7f969c103600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34624/0 (socket says 172.21.15.89:34624) 2024-09-13T02:45:06.636 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:06.022+0000 7f96a12f3640 1 -- 172.21.15.89:0/219915008 learned_addr learned my addr 172.21.15.89:0/219915008 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:45:06.636 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:06.022+0000 7f96a12f3640 1 -- 172.21.15.89:0/219915008 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9690009450 con 0x7f969c070720 2024-09-13T02:45:06.636 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:06.022+0000 7f96a12f3640 1 --2- 172.21.15.89:0/219915008 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f969c070720 0x7f969c103600 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f9690035040 tx=0x7f9690032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:45:06.636 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:06.023+0000 7f968dffb640 1 -- 172.21.15.89:0/219915008 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9690031b60 con 0x7f969c070720 2024-09-13T02:45:06.636 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:06.023+0000 7f968dffb640 1 -- 172.21.15.89:0/219915008 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9690031cc0 con 0x7f969c070720 2024-09-13T02:45:06.636 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:06.023+0000 7f968dffb640 1 -- 172.21.15.89:0/219915008 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f969003b400 con 0x7f969c070720 2024-09-13T02:45:06.636 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:06.023+0000 7f96a3557640 1 -- 172.21.15.89:0/219915008 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f969c113320 con 0x7f969c070720 2024-09-13T02:45:06.636 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:06.023+0000 7f96a3557640 1 -- 172.21.15.89:0/219915008 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f969c113730 con 0x7f969c070720 2024-09-13T02:45:06.636 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:06.023+0000 7f968dffb640 1 -- 172.21.15.89:0/219915008 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f9690039040 con 0x7f969c070720 2024-09-13T02:45:06.636 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:06.023+0000 7f968dffb640 1 -- 172.21.15.89:0/219915008 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f9690041070 con 0x7f969c070720 2024-09-13T02:45:06.637 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:06.024+0000 7f96a3557640 1 -- 172.21.15.89:0/219915008 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f969c04b720 con 0x7f969c070720 2024-09-13T02:45:06.637 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:06.026+0000 7f968dffb640 1 -- 172.21.15.89:0/219915008 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f969004a060 con 0x7f969c070720 2024-09-13T02:45:06.637 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:06.082+0000 7f96a3557640 1 -- 172.21.15.89:0/219915008 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f969c113cc0 con 0x7f969c070720 2024-09-13T02:45:06.637 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:06.083+0000 7f968dffb640 1 -- 172.21.15.89:0/219915008 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+325 (secure 0 0 0) 0x7f9690037070 con 0x7f969c070720 2024-09-13T02:45:06.637 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:06.083+0000 7f96a3557640 1 -- 172.21.15.89:0/219915008 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f969c070720 msgr2=0x7f969c103600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:06.637 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:06.083+0000 7f96a3557640 1 --2- 172.21.15.89:0/219915008 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f969c070720 0x7f969c103600 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f9690035040 tx=0x7f9690032000 comp rx=0 tx=0).stop 2024-09-13T02:45:06.637 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:06.083+0000 7f96a3557640 1 -- 172.21.15.89:0/219915008 shutdown_connections 2024-09-13T02:45:06.637 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:06.084+0000 7f96a3557640 1 --2- 172.21.15.89:0/219915008 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f969c070720 0x7f969c103600 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:06.637 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:06.084+0000 7f96a3557640 1 -- 172.21.15.89:0/219915008 >> 172.21.15.89:0/219915008 conn(0x7f969c0fbdf0 msgr2=0x7f969c105c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:45:06.637 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:06.084+0000 7f96a3557640 1 -- 172.21.15.89:0/219915008 shutdown_connections 2024-09-13T02:45:06.637 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:06.084+0000 7f96a3557640 1 -- 172.21.15.89:0/219915008 wait complete. 2024-09-13T02:45:06.637 INFO:teuthology.orchestra.run.smithi089.stdout:mon is available 2024-09-13T02:45:06.637 INFO:teuthology.orchestra.run.smithi089.stdout:Assimilating anything we can from ceph.conf... 2024-09-13T02:45:06.733 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:06 smithi089 ceph-mon[27272]: mon.smithi089 is new leader, mons smithi089 in quorum (ranks 0) 2024-09-13T02:45:06.733 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:06 smithi089 ceph-mon[27272]: monmap e1: 1 mons at {smithi089=[v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-13T02:45:06.734 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:06 smithi089 ceph-mon[27272]: fsmap 2024-09-13T02:45:06.734 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:06 smithi089 ceph-mon[27272]: osdmap e1: 0 total, 0 up, 0 in 2024-09-13T02:45:06.734 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:06 smithi089 ceph-mon[27272]: mgrmap e1: no daemons active 2024-09-13T02:45:06.734 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:06 smithi089 ceph-mon[27272]: from='client.? 172.21.15.89:0/219915008' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-13T02:45:07.622 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout 2024-09-13T02:45:07.622 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout [global] 2024-09-13T02:45:07.622 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout fsid = 12cdb164-717a-11ef-bceb-c7b262605968 2024-09-13T02:45:07.622 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-13T02:45:07.623 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.89:3300,v1:172.21.15.89:6789] 2024-09-13T02:45:07.623 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-13T02:45:07.623 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-13T02:45:07.623 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-13T02:45:07.623 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-13T02:45:07.623 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout 2024-09-13T02:45:07.623 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-13T02:45:07.623 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-13T02:45:07.623 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout 2024-09-13T02:45:07.623 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout [osd] 2024-09-13T02:45:07.623 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-13T02:45:07.623 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-13T02:45:07.623 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-13T02:45:07.624 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-13T02:45:07.624 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-13T02:45:07.624 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:07.015+0000 7fdfad5c5640 1 Processor -- start 2024-09-13T02:45:07.624 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:07.015+0000 7fdfad5c5640 1 -- start start 2024-09-13T02:45:07.624 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:07.015+0000 7fdfad5c5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdfa8102430 0x7fdfa8102840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:45:07.624 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:07.015+0000 7fdfad5c5640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa8102d80 con 0x7fdfa8102430 2024-09-13T02:45:07.624 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:07.016+0000 7fdfa6ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdfa8102430 0x7fdfa8102840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:45:07.624 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:07.016+0000 7fdfa6ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdfa8102430 0x7fdfa8102840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34638/0 (socket says 172.21.15.89:34638) 2024-09-13T02:45:07.624 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:07.016+0000 7fdfa6ffd640 1 -- 172.21.15.89:0/801649134 learned_addr learned my addr 172.21.15.89:0/801649134 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:45:07.624 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:07.016+0000 7fdfa6ffd640 1 -- 172.21.15.89:0/801649134 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfa8102ec0 con 0x7fdfa8102430 2024-09-13T02:45:07.624 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:07.016+0000 7fdfa6ffd640 1 --2- 172.21.15.89:0/801649134 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdfa8102430 0x7fdfa8102840 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fdf98009840 tx=0x7fdf980091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ab997cc3254ea46 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:45:07.624 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:07.017+0000 7fdfa5ffb640 1 -- 172.21.15.89:0/801649134 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdf98032440 con 0x7fdfa8102430 2024-09-13T02:45:07.625 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:07.017+0000 7fdfa5ffb640 1 -- 172.21.15.89:0/801649134 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf980325a0 con 0x7fdfa8102430 2024-09-13T02:45:07.625 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:07.017+0000 7fdfa5ffb640 1 -- 172.21.15.89:0/801649134 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdf980328d0 con 0x7fdfa8102430 2024-09-13T02:45:07.625 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:07.017+0000 7fdfad5c5640 1 -- 172.21.15.89:0/801649134 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdfa8102430 msgr2=0x7fdfa8102840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:07.625 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:07.017+0000 7fdfad5c5640 1 --2- 172.21.15.89:0/801649134 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdfa8102430 0x7fdfa8102840 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fdf98009840 tx=0x7fdf980091d0 comp rx=0 tx=0).stop 2024-09-13T02:45:07.625 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:07.017+0000 7fdfad5c5640 1 -- 172.21.15.89:0/801649134 shutdown_connections 2024-09-13T02:45:07.625 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:07.017+0000 7fdfad5c5640 1 --2- 172.21.15.89:0/801649134 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdfa8102430 0x7fdfa8102840 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:07.625 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:07.017+0000 7fdfad5c5640 1 -- 172.21.15.89:0/801649134 >> 172.21.15.89:0/801649134 conn(0x7fdfa80fbd90 msgr2=0x7fdfa80fe1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:45:07.625 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:07.017+0000 7fdfad5c5640 1 -- 172.21.15.89:0/801649134 shutdown_connections 2024-09-13T02:45:07.625 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:07.017+0000 7fdfad5c5640 1 -- 172.21.15.89:0/801649134 wait complete. 2024-09-13T02:45:07.625 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:07.018+0000 7fdfad5c5640 1 Processor -- start 2024-09-13T02:45:07.625 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:07.018+0000 7fdfad5c5640 1 -- start start 2024-09-13T02:45:07.625 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:07.018+0000 7fdfad5c5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdfa8102430 0x7fdfa8100c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:45:07.625 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:07.018+0000 7fdfad5c5640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfa81132d0 con 0x7fdfa8102430 2024-09-13T02:45:07.625 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:07.018+0000 7fdfa6ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdfa8102430 0x7fdfa8100c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:45:07.626 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:07.018+0000 7fdfa6ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdfa8102430 0x7fdfa8100c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34640/0 (socket says 172.21.15.89:34640) 2024-09-13T02:45:07.626 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:07.018+0000 7fdfa6ffd640 1 -- 172.21.15.89:0/1395450849 learned_addr learned my addr 172.21.15.89:0/1395450849 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:45:07.626 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:07.019+0000 7fdfa6ffd640 1 -- 172.21.15.89:0/1395450849 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf98009450 con 0x7fdfa8102430 2024-09-13T02:45:07.626 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:07.019+0000 7fdfa6ffd640 1 --2- 172.21.15.89:0/1395450849 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdfa8102430 0x7fdfa8100c00 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fdf9802a700 tx=0x7fdf98032000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:45:07.626 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:07.019+0000 7fdf8f7fe640 1 -- 172.21.15.89:0/1395450849 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdf98031be0 con 0x7fdfa8102430 2024-09-13T02:45:07.626 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:07.019+0000 7fdf8f7fe640 1 -- 172.21.15.89:0/1395450849 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf98031d40 con 0x7fdfa8102430 2024-09-13T02:45:07.626 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:07.019+0000 7fdfad5c5640 1 -- 172.21.15.89:0/1395450849 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfa8113410 con 0x7fdfa8102430 2024-09-13T02:45:07.626 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:07.019+0000 7fdf8f7fe640 1 -- 172.21.15.89:0/1395450849 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fdf9803b5a0 con 0x7fdfa8102430 2024-09-13T02:45:07.626 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:07.019+0000 7fdfad5c5640 1 -- 172.21.15.89:0/1395450849 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfa8113820 con 0x7fdfa8102430 2024-09-13T02:45:07.626 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:07.019+0000 7fdf8f7fe640 1 -- 172.21.15.89:0/1395450849 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7fdf98039040 con 0x7fdfa8102430 2024-09-13T02:45:07.626 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:07.019+0000 7fdf8f7fe640 1 -- 172.21.15.89:0/1395450849 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fdf98041030 con 0x7fdfa8102430 2024-09-13T02:45:07.626 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:07.020+0000 7fdfad5c5640 1 -- 172.21.15.89:0/1395450849 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfa804b720 con 0x7fdfa8102430 2024-09-13T02:45:07.626 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:07.022+0000 7fdf8f7fe640 1 -- 172.21.15.89:0/1395450849 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7fdf98037070 con 0x7fdfa8102430 2024-09-13T02:45:07.627 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:07.076+0000 7fdfad5c5640 1 -- 172.21.15.89:0/1395450849 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7fdfa8101140 con 0x7fdfa8102430 2024-09-13T02:45:07.627 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:07.080+0000 7fdf8f7fe640 1 -- 172.21.15.89:0/1395450849 <== mon.0 v2:172.21.15.89:3300/0 7 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fdf98046c80 con 0x7fdfa8102430 2024-09-13T02:45:07.627 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:07.080+0000 7fdf8f7fe640 1 -- 172.21.15.89:0/1395450849 <== mon.0 v2:172.21.15.89:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+465 (secure 0 0 0) 0x7fdf98054d80 con 0x7fdfa8102430 2024-09-13T02:45:07.627 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:07.081+0000 7fdfad5c5640 1 -- 172.21.15.89:0/1395450849 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdfa8102430 msgr2=0x7fdfa8100c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:07.627 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:07.081+0000 7fdfad5c5640 1 --2- 172.21.15.89:0/1395450849 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdfa8102430 0x7fdfa8100c00 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fdf9802a700 tx=0x7fdf98032000 comp rx=0 tx=0).stop 2024-09-13T02:45:07.627 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:07.081+0000 7fdfad5c5640 1 -- 172.21.15.89:0/1395450849 shutdown_connections 2024-09-13T02:45:07.627 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:07.081+0000 7fdfad5c5640 1 --2- 172.21.15.89:0/1395450849 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdfa8102430 0x7fdfa8100c00 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:07.627 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:07.081+0000 7fdfad5c5640 1 -- 172.21.15.89:0/1395450849 >> 172.21.15.89:0/1395450849 conn(0x7fdfa80fbd90 msgr2=0x7fdfa81039a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:45:07.627 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:07.081+0000 7fdfad5c5640 1 -- 172.21.15.89:0/1395450849 shutdown_connections 2024-09-13T02:45:07.627 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:07.081+0000 7fdfad5c5640 1 -- 172.21.15.89:0/1395450849 wait complete. 2024-09-13T02:45:07.627 INFO:teuthology.orchestra.run.smithi089.stdout:Generating new minimal ceph.conf... 2024-09-13T02:45:07.731 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:07 smithi089 ceph-mon[27272]: from='client.? 172.21.15.89:0/1395450849' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-13T02:45:07.731 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:07 smithi089 ceph-mon[27272]: from='client.? 172.21.15.89:0/1395450849' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-13T02:45:08.636 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:08 smithi089 ceph-mon[27272]: from='client.? 172.21.15.89:0/1566260202' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:45:08.643 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:08.022+0000 7f867221f640 1 Processor -- start 2024-09-13T02:45:08.644 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:08.022+0000 7f867221f640 1 -- start start 2024-09-13T02:45:08.644 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:08.022+0000 7f867221f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f866c076ac0 0x7f866c104ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:45:08.644 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:08.022+0000 7f867221f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f866c076ed0 con 0x7f866c076ac0 2024-09-13T02:45:08.644 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:08.022+0000 7f866b7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f866c076ac0 0x7f866c104ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:45:08.644 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:08.022+0000 7f866b7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f866c076ac0 0x7f866c104ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34644/0 (socket says 172.21.15.89:34644) 2024-09-13T02:45:08.644 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:08.022+0000 7f866b7fe640 1 -- 172.21.15.89:0/509741226 learned_addr learned my addr 172.21.15.89:0/509741226 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:45:08.644 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:08.023+0000 7f866b7fe640 1 -- 172.21.15.89:0/509741226 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f866c1051e0 con 0x7f866c076ac0 2024-09-13T02:45:08.644 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:08.023+0000 7f866b7fe640 1 --2- 172.21.15.89:0/509741226 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f866c076ac0 0x7f866c104ca0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f865c009840 tx=0x7f865c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf5711f37d5e300e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:45:08.644 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:08.024+0000 7f866a7fc640 1 -- 172.21.15.89:0/509741226 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f865c032440 con 0x7f866c076ac0 2024-09-13T02:45:08.644 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:08.024+0000 7f866a7fc640 1 -- 172.21.15.89:0/509741226 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f865c032a00 con 0x7f866c076ac0 2024-09-13T02:45:08.644 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:08.024+0000 7f866a7fc640 1 -- 172.21.15.89:0/509741226 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f865c0319e0 con 0x7f866c076ac0 2024-09-13T02:45:08.644 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:08.024+0000 7f867221f640 1 -- 172.21.15.89:0/509741226 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f866c076ac0 msgr2=0x7f866c104ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:08.645 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:08.024+0000 7f867221f640 1 --2- 172.21.15.89:0/509741226 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f866c076ac0 0x7f866c104ca0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f865c009840 tx=0x7f865c0091d0 comp rx=0 tx=0).stop 2024-09-13T02:45:08.645 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:08.024+0000 7f867221f640 1 -- 172.21.15.89:0/509741226 shutdown_connections 2024-09-13T02:45:08.645 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:08.024+0000 7f867221f640 1 --2- 172.21.15.89:0/509741226 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f866c076ac0 0x7f866c104ca0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:08.645 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:08.024+0000 7f867221f640 1 -- 172.21.15.89:0/509741226 >> 172.21.15.89:0/509741226 conn(0x7f866c0fc730 msgr2=0x7f866c0feb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:45:08.645 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:08.024+0000 7f867221f640 1 -- 172.21.15.89:0/509741226 shutdown_connections 2024-09-13T02:45:08.645 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:08.024+0000 7f867221f640 1 -- 172.21.15.89:0/509741226 wait complete. 2024-09-13T02:45:08.645 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:08.025+0000 7f867221f640 1 Processor -- start 2024-09-13T02:45:08.645 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:08.025+0000 7f867221f640 1 -- start start 2024-09-13T02:45:08.645 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:08.025+0000 7f867221f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f866c076ac0 0x7f866c110e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:45:08.645 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:08.025+0000 7f867221f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f866c111340 con 0x7f866c076ac0 2024-09-13T02:45:08.645 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:08.025+0000 7f866b7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f866c076ac0 0x7f866c110e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:45:08.645 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:08.025+0000 7f866b7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f866c076ac0 0x7f866c110e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34658/0 (socket says 172.21.15.89:34658) 2024-09-13T02:45:08.645 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:08.025+0000 7f866b7fe640 1 -- 172.21.15.89:0/1566260202 learned_addr learned my addr 172.21.15.89:0/1566260202 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:45:08.646 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:08.026+0000 7f866b7fe640 1 -- 172.21.15.89:0/1566260202 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f865c009450 con 0x7f866c076ac0 2024-09-13T02:45:08.646 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:08.026+0000 7f866b7fe640 1 --2- 172.21.15.89:0/1566260202 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f866c076ac0 0x7f866c110e00 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f865c006f00 tx=0x7f865c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:45:08.646 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:08.026+0000 7f8653fff640 1 -- 172.21.15.89:0/1566260202 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f865c031e30 con 0x7f866c076ac0 2024-09-13T02:45:08.646 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:08.026+0000 7f8653fff640 1 -- 172.21.15.89:0/1566260202 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f865c03d8b0 con 0x7f866c076ac0 2024-09-13T02:45:08.646 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:08.026+0000 7f8653fff640 1 -- 172.21.15.89:0/1566260202 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f865c03b8f0 con 0x7f866c076ac0 2024-09-13T02:45:08.646 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:08.026+0000 7f867221f640 1 -- 172.21.15.89:0/1566260202 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f866c111540 con 0x7f866c076ac0 2024-09-13T02:45:08.646 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:08.026+0000 7f867221f640 1 -- 172.21.15.89:0/1566260202 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f866c111f90 con 0x7f866c076ac0 2024-09-13T02:45:08.646 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:08.026+0000 7f8653fff640 1 -- 172.21.15.89:0/1566260202 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f865c039070 con 0x7f866c076ac0 2024-09-13T02:45:08.646 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:08.026+0000 7f8653fff640 1 -- 172.21.15.89:0/1566260202 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f865c046710 con 0x7f866c076ac0 2024-09-13T02:45:08.646 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:08.027+0000 7f867221f640 1 -- 172.21.15.89:0/1566260202 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f866c100390 con 0x7f866c076ac0 2024-09-13T02:45:08.646 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:08.029+0000 7f8653fff640 1 -- 172.21.15.89:0/1566260202 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f865c0657a0 con 0x7f866c076ac0 2024-09-13T02:45:08.646 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:08.084+0000 7f867221f640 1 -- 172.21.15.89:0/1566260202 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f866c105f00 con 0x7f866c076ac0 2024-09-13T02:45:08.646 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:08.084+0000 7f8653fff640 1 -- 172.21.15.89:0/1566260202 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+175 (secure 0 0 0) 0x7f865c054020 con 0x7f866c076ac0 2024-09-13T02:45:08.646 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:08.085+0000 7f867221f640 1 -- 172.21.15.89:0/1566260202 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f866c076ac0 msgr2=0x7f866c110e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:08.647 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:08.085+0000 7f867221f640 1 --2- 172.21.15.89:0/1566260202 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f866c076ac0 0x7f866c110e00 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f865c006f00 tx=0x7f865c008040 comp rx=0 tx=0).stop 2024-09-13T02:45:08.647 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:08.085+0000 7f867221f640 1 -- 172.21.15.89:0/1566260202 shutdown_connections 2024-09-13T02:45:08.647 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:08.085+0000 7f867221f640 1 --2- 172.21.15.89:0/1566260202 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f866c076ac0 0x7f866c110e00 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:08.647 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:08.085+0000 7f867221f640 1 -- 172.21.15.89:0/1566260202 >> 172.21.15.89:0/1566260202 conn(0x7f866c0fc730 msgr2=0x7f866c0fd2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:45:08.647 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:08.085+0000 7f867221f640 1 -- 172.21.15.89:0/1566260202 shutdown_connections 2024-09-13T02:45:08.647 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:08.085+0000 7f867221f640 1 -- 172.21.15.89:0/1566260202 wait complete. 2024-09-13T02:45:08.647 INFO:teuthology.orchestra.run.smithi089.stdout:Restarting the monitor... 2024-09-13T02:45:08.924 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:08 smithi089 systemd[1]: Stopping Ceph mon.smithi089 for 12cdb164-717a-11ef-bceb-c7b262605968... 2024-09-13T02:45:09.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:08 smithi089 ceph-12cdb164-717a-11ef-bceb-c7b262605968-mon-smithi089[27268]: 2024-09-13T02:45:08.922+0000 7eff0a2ef640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi089 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T02:45:09.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:08 smithi089 ceph-12cdb164-717a-11ef-bceb-c7b262605968-mon-smithi089[27268]: 2024-09-13T02:45:08.922+0000 7eff0a2ef640 -1 mon.smithi089@0(leader) e1 *** Got Signal Terminated *** 2024-09-13T02:45:09.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:09 smithi089 podman[27515]: 2024-09-13 02:45:09.065756948 +0000 UTC m=+0.249234152 container died 2f28cbb9e7b675c7a4bb7661ba9d0c92b80dd5b9286cbc478c6a2c634f077fbb (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-mon-smithi089, GIT_BRANCH=HEAD, RELEASE=quincy-bbdadfa, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T02:45:09.724 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:09 smithi089 podman[27515]: 2024-09-13 02:45:09.396704177 +0000 UTC m=+0.580181381 container cleanup 2f28cbb9e7b675c7a4bb7661ba9d0c92b80dd5b9286cbc478c6a2c634f077fbb (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-mon-smithi089, RELEASE=quincy-bbdadfa, ceph=True, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-13T02:45:09.724 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:09 smithi089 bash[27515]: ceph-12cdb164-717a-11ef-bceb-c7b262605968-mon-smithi089 2024-09-13T02:45:09.724 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:09 smithi089 podman[27527]: 2024-09-13 02:45:09.53964624 +0000 UTC m=+0.472253740 container remove 2f28cbb9e7b675c7a4bb7661ba9d0c92b80dd5b9286cbc478c6a2c634f077fbb (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-mon-smithi089, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=quincy-bbdadfa, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0) 2024-09-13T02:45:10.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:09 smithi089 systemd[1]: ceph-12cdb164-717a-11ef-bceb-c7b262605968@mon.smithi089.service: Deactivated successfully. 2024-09-13T02:45:10.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:09 smithi089 systemd[1]: Stopped Ceph mon.smithi089 for 12cdb164-717a-11ef-bceb-c7b262605968. 2024-09-13T02:45:10.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:09 smithi089 systemd[1]: Starting Ceph mon.smithi089 for 12cdb164-717a-11ef-bceb-c7b262605968... 2024-09-13T02:45:10.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:09 smithi089 podman[27620]: 2024-09-13 02:45:09.846229831 +0000 UTC m=+0.015254622 image pull a994b00deb3a4a8eeb484a456d3f3207aae0401a31d251b199b2c9dbc1c4036c quay.ceph.io/ceph-ci/ceph:quincy 2024-09-13T02:45:10.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:09 smithi089 podman[27620]: 2024-09-13 02:45:09.965530899 +0000 UTC m=+0.134555733 container create d2f18141b2afcc73363d47d6b8def4b06204e0940ce706e27df611b6cc808e22 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-mon-smithi089, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=quincy-bbdadfa, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-13T02:45:10.255 INFO:teuthology.orchestra.run.smithi089.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-13T02:45:10.353 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 podman[27620]: 2024-09-13 02:45:10.192614349 +0000 UTC m=+0.361639138 container init d2f18141b2afcc73363d47d6b8def4b06204e0940ce706e27df611b6cc808e22 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-mon-smithi089, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=quincy-bbdadfa, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T02:45:10.353 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 podman[27620]: 2024-09-13 02:45:10.19559498 +0000 UTC m=+0.364619769 container start d2f18141b2afcc73363d47d6b8def4b06204e0940ce706e27df611b6cc808e22 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-mon-smithi089, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, RELEASE=quincy-bbdadfa, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-13T02:45:10.353 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: set uid:gid to 167:167 (ceph:ceph) 2024-09-13T02:45:10.353 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable), process ceph-mon, pid 2 2024-09-13T02:45:10.353 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: pidfile_write: ignore empty --pid-file 2024-09-13T02:45:10.354 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: load: jerasure load: lrc 2024-09-13T02:45:10.354 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: RocksDB version: 6.15.5 2024-09-13T02:45:10.354 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-09-13T02:45:10.354 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Compile date Sep 12 2024 2024-09-13T02:45:10.354 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: DB SUMMARY 2024-09-13T02:45:10.354 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: DB Session ID: ROTZT88WF8NM838TVYAQ 2024-09-13T02:45:10.354 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: CURRENT file: CURRENT 2024-09-13T02:45:10.354 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: IDENTITY file: IDENTITY 2024-09-13T02:45:10.354 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: MANIFEST file: MANIFEST-000009 size: 131 Bytes 2024-09-13T02:45:10.354 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi089/store.db dir, Total Num: 1, files: 000008.sst 2024-09-13T02:45:10.354 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi089/store.db: 000010.log size: 98116 ; 2024-09-13T02:45:10.354 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.error_if_exists: 0 2024-09-13T02:45:10.354 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.create_if_missing: 0 2024-09-13T02:45:10.354 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.paranoid_checks: 1 2024-09-13T02:45:10.355 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-13T02:45:10.355 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.env: 0x55adf99d0440 2024-09-13T02:45:10.355 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.fs: Posix File System 2024-09-13T02:45:10.355 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.info_log: 0x55adfa7430c0 2024-09-13T02:45:10.355 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.max_file_opening_threads: 16 2024-09-13T02:45:10.355 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.statistics: (nil) 2024-09-13T02:45:10.355 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.use_fsync: 0 2024-09-13T02:45:10.355 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.max_log_file_size: 0 2024-09-13T02:45:10.357 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-13T02:45:10.357 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-13T02:45:10.357 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.keep_log_file_num: 1000 2024-09-13T02:45:10.357 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.recycle_log_file_num: 0 2024-09-13T02:45:10.357 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.allow_fallocate: 1 2024-09-13T02:45:10.357 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.allow_mmap_reads: 0 2024-09-13T02:45:10.357 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.allow_mmap_writes: 0 2024-09-13T02:45:10.357 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.use_direct_reads: 0 2024-09-13T02:45:10.357 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-13T02:45:10.357 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.create_missing_column_families: 0 2024-09-13T02:45:10.357 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.db_log_dir: 2024-09-13T02:45:10.357 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi089/store.db 2024-09-13T02:45:10.358 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-13T02:45:10.358 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-13T02:45:10.359 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-13T02:45:10.359 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-13T02:45:10.359 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-13T02:45:10.359 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-13T02:45:10.359 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.advise_random_on_open: 1 2024-09-13T02:45:10.359 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.db_write_buffer_size: 0 2024-09-13T02:45:10.360 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.write_buffer_manager: 0x55adfa800870 2024-09-13T02:45:10.360 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-13T02:45:10.360 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-09-13T02:45:10.361 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-13T02:45:10.361 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-13T02:45:10.361 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.rate_limiter: (nil) 2024-09-13T02:45:10.361 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-13T02:45:10.361 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.wal_recovery_mode: 2 2024-09-13T02:45:10.362 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.enable_thread_tracking: 0 2024-09-13T02:45:10.362 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.enable_pipelined_write: 0 2024-09-13T02:45:10.362 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.unordered_write: 0 2024-09-13T02:45:10.362 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-13T02:45:10.362 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-13T02:45:10.362 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-13T02:45:10.362 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-13T02:45:10.362 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.row_cache: None 2024-09-13T02:45:10.363 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.wal_filter: None 2024-09-13T02:45:10.363 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-13T02:45:10.363 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.allow_ingest_behind: 0 2024-09-13T02:45:10.363 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.preserve_deletes: 0 2024-09-13T02:45:10.363 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.two_write_queues: 0 2024-09-13T02:45:10.363 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.manual_wal_flush: 0 2024-09-13T02:45:10.363 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.atomic_flush: 0 2024-09-13T02:45:10.363 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-13T02:45:10.364 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-13T02:45:10.364 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-13T02:45:10.364 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.log_readahead_size: 0 2024-09-13T02:45:10.364 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-13T02:45:10.364 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.best_efforts_recovery: 0 2024-09-13T02:45:10.364 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-13T02:45:10.364 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-13T02:45:10.364 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.allow_data_in_errors: 0 2024-09-13T02:45:10.365 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.db_host_id: __hostname__ 2024-09-13T02:45:10.365 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.max_background_jobs: 2 2024-09-13T02:45:10.365 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.max_background_compactions: -1 2024-09-13T02:45:10.365 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.max_subcompactions: 1 2024-09-13T02:45:10.365 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-13T02:45:10.365 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-13T02:45:10.365 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-13T02:45:10.365 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.max_total_wal_size: 0 2024-09-13T02:45:10.366 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-13T02:45:10.366 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-13T02:45:10.366 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-13T02:45:10.366 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-13T02:45:10.366 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.max_open_files: -1 2024-09-13T02:45:10.366 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.bytes_per_sync: 0 2024-09-13T02:45:10.366 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-13T02:45:10.366 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-13T02:45:10.366 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.compaction_readahead_size: 0 2024-09-13T02:45:10.367 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.max_background_flushes: -1 2024-09-13T02:45:10.367 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Compression algorithms supported: 2024-09-13T02:45:10.367 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: kZSTD supported: 0 2024-09-13T02:45:10.367 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: kXpressCompression supported: 0 2024-09-13T02:45:10.367 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: kBZip2Compression supported: 0 2024-09-13T02:45:10.367 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-13T02:45:10.367 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: kLZ4Compression supported: 1 2024-09-13T02:45:10.367 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: kZlibCompression supported: 1 2024-09-13T02:45:10.367 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: kLZ4HCCompression supported: 1 2024-09-13T02:45:10.368 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: kSnappyCompression supported: 1 2024-09-13T02:45:10.368 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-13T02:45:10.368 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: [db/version_set.cc:4724] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi089/store.db/MANIFEST-000009 2024-09-13T02:45:10.368 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: [db/column_family.cc:595] --------------- Options for column family [default]: 2024-09-13T02:45:10.368 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-13T02:45:10.368 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.merge_operator: 2024-09-13T02:45:10.368 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.compaction_filter: None 2024-09-13T02:45:10.368 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.compaction_filter_factory: None 2024-09-13T02:45:10.369 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.sst_partitioner_factory: None 2024-09-13T02:45:10.369 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-13T02:45:10.369 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-13T02:45:10.369 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55adfa6e9a38) 2024-09-13T02:45:10.369 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: cache_index_and_filter_blocks: 1 2024-09-13T02:45:10.369 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-13T02:45:10.369 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-13T02:45:10.369 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: pin_top_level_index_and_filter: 1 2024-09-13T02:45:10.369 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: index_type: 0 2024-09-13T02:45:10.370 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: data_block_index_type: 0 2024-09-13T02:45:10.370 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: index_shortening: 1 2024-09-13T02:45:10.370 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-13T02:45:10.370 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: hash_index_allow_collision: 1 2024-09-13T02:45:10.370 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: checksum: 1 2024-09-13T02:45:10.370 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: no_block_cache: 0 2024-09-13T02:45:10.370 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: block_cache: 0x55adfa71f1f0 2024-09-13T02:45:10.370 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: block_cache_name: BinnedLRUCache 2024-09-13T02:45:10.371 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: block_cache_options: 2024-09-13T02:45:10.371 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: capacity : 536870912 2024-09-13T02:45:10.371 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: num_shard_bits : 4 2024-09-13T02:45:10.371 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: strict_capacity_limit : 0 2024-09-13T02:45:10.371 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: high_pri_pool_ratio: 0.000 2024-09-13T02:45:10.371 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: block_cache_compressed: (nil) 2024-09-13T02:45:10.371 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: persistent_cache: (nil) 2024-09-13T02:45:10.371 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: block_size: 4096 2024-09-13T02:45:10.371 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: block_size_deviation: 10 2024-09-13T02:45:10.372 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: block_restart_interval: 16 2024-09-13T02:45:10.372 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: index_block_restart_interval: 1 2024-09-13T02:45:10.372 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: metadata_block_size: 4096 2024-09-13T02:45:10.372 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: partition_filters: 0 2024-09-13T02:45:10.372 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: use_delta_encoding: 1 2024-09-13T02:45:10.372 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2024-09-13T02:45:10.372 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: whole_key_filtering: 1 2024-09-13T02:45:10.372 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: verify_compression: 0 2024-09-13T02:45:10.372 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: read_amp_bytes_per_bit: 0 2024-09-13T02:45:10.373 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: format_version: 4 2024-09-13T02:45:10.373 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: enable_index_compression: 1 2024-09-13T02:45:10.373 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: block_align: 0 2024-09-13T02:45:10.373 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.write_buffer_size: 33554432 2024-09-13T02:45:10.374 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.max_write_buffer_number: 2 2024-09-13T02:45:10.374 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.compression: NoCompression 2024-09-13T02:45:10.374 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.bottommost_compression: Disabled 2024-09-13T02:45:10.374 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.prefix_extractor: nullptr 2024-09-13T02:45:10.375 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-13T02:45:10.375 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.num_levels: 7 2024-09-13T02:45:10.375 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-13T02:45:10.375 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-13T02:45:10.375 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-13T02:45:10.375 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-13T02:45:10.375 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-13T02:45:10.375 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-13T02:45:10.375 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-13T02:45:10.375 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-13T02:45:10.375 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-13T02:45:10.375 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-13T02:45:10.375 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-13T02:45:10.375 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.compression_opts.level: 32767 2024-09-13T02:45:10.376 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.compression_opts.strategy: 0 2024-09-13T02:45:10.376 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-13T02:45:10.376 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-13T02:45:10.376 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-13T02:45:10.376 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.compression_opts.enabled: false 2024-09-13T02:45:10.376 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-13T02:45:10.376 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-13T02:45:10.376 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-13T02:45:10.376 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.target_file_size_base: 67108864 2024-09-13T02:45:10.376 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-13T02:45:10.376 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-13T02:45:10.376 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-13T02:45:10.376 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-13T02:45:10.376 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-13T02:45:10.377 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-13T02:45:10.377 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-13T02:45:10.377 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-13T02:45:10.377 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-13T02:45:10.377 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-13T02:45:10.377 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-13T02:45:10.377 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-13T02:45:10.377 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-13T02:45:10.377 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.arena_block_size: 4194304 2024-09-13T02:45:10.377 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-13T02:45:10.377 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-13T02:45:10.377 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-09-13T02:45:10.377 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.disable_auto_compactions: 0 2024-09-13T02:45:10.377 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-13T02:45:10.378 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-13T02:45:10.378 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-13T02:45:10.378 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-13T02:45:10.378 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-13T02:45:10.378 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-13T02:45:10.378 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-13T02:45:10.378 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-13T02:45:10.378 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-13T02:45:10.378 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-13T02:45:10.378 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-13T02:45:10.378 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.inplace_update_support: 0 2024-09-13T02:45:10.378 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-13T02:45:10.378 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-13T02:45:10.378 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-13T02:45:10.379 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-13T02:45:10.379 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.bloom_locality: 0 2024-09-13T02:45:10.379 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.max_successive_merges: 0 2024-09-13T02:45:10.379 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-13T02:45:10.379 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.paranoid_file_checks: 0 2024-09-13T02:45:10.379 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.force_consistency_checks: 1 2024-09-13T02:45:10.379 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.report_bg_io_stats: 0 2024-09-13T02:45:10.379 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.ttl: 2592000 2024-09-13T02:45:10.379 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-13T02:45:10.379 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.enable_blob_files: false 2024-09-13T02:45:10.379 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.min_blob_size: 0 2024-09-13T02:45:10.379 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.blob_file_size: 268435456 2024-09-13T02:45:10.379 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-13T02:45:10.379 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-13T02:45:10.380 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-13T02:45:10.380 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: [db/version_set.cc:4764] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi089/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 11, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-13T02:45:10.380 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: [db/version_set.cc:4779] Column family [default] (ID 0), log number is 5 2024-09-13T02:45:10.380 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: [db/version_set.cc:4082] Creating manifest 13 2024-09-13T02:45:10.380 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726195510218858, "job": 1, "event": "recovery_started", "wal_files": [10]} 2024-09-13T02:45:10.380 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: [db/db_impl/db_impl_open.cc:845] Recovering log #10 mode 2 2024-09-13T02:45:10.380 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: [table/block_based/filter_policy.cc:991] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2024-09-13T02:45:10.380 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726195510219732, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 14, "file_size": 93348, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 91428, "index_size": 254, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 13564, "raw_average_key_size": 49, "raw_value_size": 84010, "raw_average_value_size": 307, "num_data_blocks": 11, "num_entries": 273, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1726195510, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "e7d314da-89cb-41fd-bf5c-5bb1cc0e184b", "db_session_id": "ROTZT88WF8NM838TVYAQ"}} 2024-09-13T02:45:10.380 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: [db/version_set.cc:4082] Creating manifest 15 2024-09-13T02:45:10.380 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726195510220098, "job": 1, "event": "recovery_finished"} 2024-09-13T02:45:10.380 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: [file/delete_scheduler.cc:69] Deleted file /var/lib/ceph/mon/ceph-smithi089/store.db/000010.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-13T02:45:10.380 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: [db/db_impl/db_impl_open.cc:1700] SstFileManager instance 0x55adfa752700 2024-09-13T02:45:10.380 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: DB pointer 0x55adfa722000 2024-09-13T02:45:10.380 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: [db/db_impl/db_impl.cc:901] ------- DUMPING STATS ------- 2024-09-13T02:45:10.381 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: rocksdb: [db/db_impl/db_impl.cc:903] 2024-09-13T02:45:10.381 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: ** DB Stats ** 2024-09-13T02:45:10.381 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-13T02:45:10.381 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-13T02:45:10.381 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-13T02:45:10.381 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-13T02:45:10.381 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-13T02:45:10.381 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-09-13T02:45:10.381 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-13T02:45:10.381 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: 2024-09-13T02:45:10.381 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: ** Compaction Stats [default] ** 2024-09-13T02:45:10.381 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-09-13T02:45:10.381 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-13T02:45:10.381 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: L0 2/0 92.98 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 148.9 0.00 0.00 1 0.001 0 0 2024-09-13T02:45:10.382 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Sum 2/0 92.98 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 148.9 0.00 0.00 1 0.001 0 0 2024-09-13T02:45:10.382 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 148.9 0.00 0.00 1 0.001 0 0 2024-09-13T02:45:10.382 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: 2024-09-13T02:45:10.382 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: ** Compaction Stats [default] ** 2024-09-13T02:45:10.382 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-09-13T02:45:10.382 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-13T02:45:10.382 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 148.9 0.00 0.00 1 0.001 0 0 2024-09-13T02:45:10.382 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-13T02:45:10.382 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-13T02:45:10.382 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-13T02:45:10.382 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-13T02:45:10.382 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-13T02:45:10.382 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-13T02:45:10.382 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Cumulative compaction: 0.00 GB write, 28.35 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T02:45:10.382 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Interval compaction: 0.00 GB write, 28.35 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T02:45:10.383 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-13T02:45:10.383 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: 2024-09-13T02:45:10.383 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-13T02:45:10.383 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: 2024-09-13T02:45:10.383 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: ** Compaction Stats [default] ** 2024-09-13T02:45:10.383 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-09-13T02:45:10.383 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-13T02:45:10.383 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: L0 2/0 92.98 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 148.9 0.00 0.00 1 0.001 0 0 2024-09-13T02:45:10.383 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Sum 2/0 92.98 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 148.9 0.00 0.00 1 0.001 0 0 2024-09-13T02:45:10.383 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-09-13T02:45:10.383 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: 2024-09-13T02:45:10.383 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: ** Compaction Stats [default] ** 2024-09-13T02:45:10.383 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-09-13T02:45:10.383 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-13T02:45:10.384 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 148.9 0.00 0.00 1 0.001 0 0 2024-09-13T02:45:10.384 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-13T02:45:10.384 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-13T02:45:10.384 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-13T02:45:10.384 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-13T02:45:10.384 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-13T02:45:10.384 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-13T02:45:10.384 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Cumulative compaction: 0.00 GB write, 28.07 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T02:45:10.384 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T02:45:10.384 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-13T02:45:10.384 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: 2024-09-13T02:45:10.384 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-13T02:45:10.384 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: starting mon.smithi089 rank 0 at public addrs [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] at bind addrs [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi089 fsid 12cdb164-717a-11ef-bceb-c7b262605968 2024-09-13T02:45:10.384 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: mon.smithi089@-1(???) e1 preinit fsid 12cdb164-717a-11ef-bceb-c7b262605968 2024-09-13T02:45:10.385 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: mon.smithi089@-1(???).mds e1 new map 2024-09-13T02:45:10.385 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: mon.smithi089@-1(???).mds e1 print_map 2024-09-13T02:45:10.385 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: e1 2024-09-13T02:45:10.385 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T02:45:10.385 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:45:10.385 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: legacy client fscid: -1 2024-09-13T02:45:10.385 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: 2024-09-13T02:45:10.385 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: No filesystems configured 2024-09-13T02:45:10.385 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: mon.smithi089@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-13T02:45:10.385 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: mon.smithi089@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-13T02:45:10.385 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: mon.smithi089@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-13T02:45:10.385 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: mon.smithi089@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-13T02:45:10.385 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: mon.smithi089@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-13T02:45:10.385 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 bash[27620]: d2f18141b2afcc73363d47d6b8def4b06204e0940ce706e27df611b6cc808e22 2024-09-13T02:45:10.385 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 systemd[1]: Started Ceph mon.smithi089 for 12cdb164-717a-11ef-bceb-c7b262605968. 2024-09-13T02:45:10.386 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: mon.smithi089 is new leader, mons smithi089 in quorum (ranks 0) 2024-09-13T02:45:10.386 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: monmap e1: 1 mons at {smithi089=[v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-13T02:45:10.386 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: fsmap 2024-09-13T02:45:10.386 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: osdmap e1: 0 total, 0 up, 0 in 2024-09-13T02:45:10.386 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:10 smithi089 ceph-mon[27639]: mgrmap e1: no daemons active 2024-09-13T02:45:11.266 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:10.690+0000 7f6fe4d3c640 1 Processor -- start 2024-09-13T02:45:11.266 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:10.690+0000 7f6fe4d3c640 1 -- start start 2024-09-13T02:45:11.267 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:10.690+0000 7f6fe4d3c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6fe0102070 0x7f6fe0102480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:45:11.267 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:10.690+0000 7f6fe4d3c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe01029c0 con 0x7f6fe0102070 2024-09-13T02:45:11.267 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:10.691+0000 7f6fde59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6fe0102070 0x7f6fe0102480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:45:11.267 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:10.691+0000 7f6fde59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6fe0102070 0x7f6fe0102480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34670/0 (socket says 172.21.15.89:34670) 2024-09-13T02:45:11.267 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:10.691+0000 7f6fde59c640 1 -- 172.21.15.89:0/1035050526 learned_addr learned my addr 172.21.15.89:0/1035050526 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:45:11.267 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:10.691+0000 7f6fde59c640 1 -- 172.21.15.89:0/1035050526 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fe0102b00 con 0x7f6fe0102070 2024-09-13T02:45:11.267 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:10.693+0000 7f6fde59c640 1 --2- 172.21.15.89:0/1035050526 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6fe0102070 0x7f6fe0102480 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f6fd0009840 tx=0x7f6fd00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce48a39c4cbbc4d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:45:11.267 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:10.693+0000 7f6fdd59a640 1 -- 172.21.15.89:0/1035050526 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6fd0032440 con 0x7f6fe0102070 2024-09-13T02:45:11.267 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:10.693+0000 7f6fdd59a640 1 -- 172.21.15.89:0/1035050526 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f6fd0032a00 con 0x7f6fe0102070 2024-09-13T02:45:11.267 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:10.693+0000 7f6fdd59a640 1 -- 172.21.15.89:0/1035050526 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6fd0031a10 con 0x7f6fe0102070 2024-09-13T02:45:11.267 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:10.694+0000 7f6fe4d3c640 1 -- 172.21.15.89:0/1035050526 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6fe0102070 msgr2=0x7f6fe0102480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:11.267 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:10.694+0000 7f6fe4d3c640 1 --2- 172.21.15.89:0/1035050526 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6fe0102070 0x7f6fe0102480 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f6fd0009840 tx=0x7f6fd00091d0 comp rx=0 tx=0).stop 2024-09-13T02:45:11.268 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:10.694+0000 7f6fe4d3c640 1 -- 172.21.15.89:0/1035050526 shutdown_connections 2024-09-13T02:45:11.268 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:10.694+0000 7f6fe4d3c640 1 --2- 172.21.15.89:0/1035050526 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6fe0102070 0x7f6fe0102480 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:11.268 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:10.694+0000 7f6fe4d3c640 1 -- 172.21.15.89:0/1035050526 >> 172.21.15.89:0/1035050526 conn(0x7f6fe00fd850 msgr2=0x7f6fe00ffc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:45:11.268 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:10.694+0000 7f6fe4d3c640 1 -- 172.21.15.89:0/1035050526 shutdown_connections 2024-09-13T02:45:11.268 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:10.694+0000 7f6fe4d3c640 1 -- 172.21.15.89:0/1035050526 wait complete. 2024-09-13T02:45:11.268 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:10.694+0000 7f6fe4d3c640 1 Processor -- start 2024-09-13T02:45:11.268 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:10.694+0000 7f6fe4d3c640 1 -- start start 2024-09-13T02:45:11.268 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:10.695+0000 7f6fe4d3c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6fe0102070 0x7f6fe0078c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:45:11.268 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:10.695+0000 7f6fe4d3c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fe0079140 con 0x7f6fe0102070 2024-09-13T02:45:11.268 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:10.695+0000 7f6fde59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6fe0102070 0x7f6fe0078c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:45:11.268 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:10.695+0000 7f6fde59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6fe0102070 0x7f6fe0078c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34682/0 (socket says 172.21.15.89:34682) 2024-09-13T02:45:11.268 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:10.695+0000 7f6fde59c640 1 -- 172.21.15.89:0/3024391436 learned_addr learned my addr 172.21.15.89:0/3024391436 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:45:11.268 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:10.695+0000 7f6fde59c640 1 -- 172.21.15.89:0/3024391436 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fd0009450 con 0x7f6fe0102070 2024-09-13T02:45:11.269 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:10.695+0000 7f6fde59c640 1 --2- 172.21.15.89:0/3024391436 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6fe0102070 0x7f6fe0078c00 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f6fd00098a0 tx=0x7f6fd002c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:45:11.269 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:10.695+0000 7f6fceffd640 1 -- 172.21.15.89:0/3024391436 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6fd00327b0 con 0x7f6fe0102070 2024-09-13T02:45:11.269 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:10.695+0000 7f6fceffd640 1 -- 172.21.15.89:0/3024391436 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f6fd003b870 con 0x7f6fe0102070 2024-09-13T02:45:11.269 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:10.695+0000 7f6fe4d3c640 1 -- 172.21.15.89:0/3024391436 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fe00771d0 con 0x7f6fe0102070 2024-09-13T02:45:11.269 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:10.695+0000 7f6fceffd640 1 -- 172.21.15.89:0/3024391436 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6fd003a550 con 0x7f6fe0102070 2024-09-13T02:45:11.269 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:10.695+0000 7f6fe4d3c640 1 -- 172.21.15.89:0/3024391436 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fe0077640 con 0x7f6fe0102070 2024-09-13T02:45:11.269 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:10.696+0000 7f6fceffd640 1 -- 172.21.15.89:0/3024391436 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f6fd0039040 con 0x7f6fe0102070 2024-09-13T02:45:11.269 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:10.696+0000 7f6fceffd640 1 -- 172.21.15.89:0/3024391436 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f6fd00447a0 con 0x7f6fe0102070 2024-09-13T02:45:11.269 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:10.696+0000 7f6fe4d3c640 1 -- 172.21.15.89:0/3024391436 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fe004b720 con 0x7f6fe0102070 2024-09-13T02:45:11.269 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:10.698+0000 7f6fceffd640 1 -- 172.21.15.89:0/3024391436 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f6fd0049060 con 0x7f6fe0102070 2024-09-13T02:45:11.269 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:10.753+0000 7f6fe4d3c640 1 -- 172.21.15.89:0/3024391436 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7f6fe0103cf0 con 0x7f6fe0102070 2024-09-13T02:45:11.269 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:10.758+0000 7f6fceffd640 1 -- 172.21.15.89:0/3024391436 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7f6fe0103cf0 con 0x7f6fe0102070 2024-09-13T02:45:11.269 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:10.759+0000 7f6fe4d3c640 1 -- 172.21.15.89:0/3024391436 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6fe0102070 msgr2=0x7f6fe0078c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:11.270 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:10.759+0000 7f6fe4d3c640 1 --2- 172.21.15.89:0/3024391436 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6fe0102070 0x7f6fe0078c00 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f6fd00098a0 tx=0x7f6fd002c040 comp rx=0 tx=0).stop 2024-09-13T02:45:11.270 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:10.759+0000 7f6fe4d3c640 1 -- 172.21.15.89:0/3024391436 shutdown_connections 2024-09-13T02:45:11.270 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:10.759+0000 7f6fe4d3c640 1 --2- 172.21.15.89:0/3024391436 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6fe0102070 0x7f6fe0078c00 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:11.270 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:10.759+0000 7f6fe4d3c640 1 -- 172.21.15.89:0/3024391436 >> 172.21.15.89:0/3024391436 conn(0x7f6fe00fd850 msgr2=0x7f6fe00fe390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:45:11.270 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:10.759+0000 7f6fe4d3c640 1 -- 172.21.15.89:0/3024391436 shutdown_connections 2024-09-13T02:45:11.270 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:10.759+0000 7f6fe4d3c640 1 -- 172.21.15.89:0/3024391436 wait complete. 2024-09-13T02:45:11.270 INFO:teuthology.orchestra.run.smithi089.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-13T02:45:11.270 INFO:teuthology.orchestra.run.smithi089.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-13T02:45:11.270 INFO:teuthology.orchestra.run.smithi089.stdout:Creating mgr... 2024-09-13T02:45:11.270 INFO:teuthology.orchestra.run.smithi089.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-13T02:45:11.270 INFO:teuthology.orchestra.run.smithi089.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-13T02:45:11.270 INFO:teuthology.orchestra.run.smithi089.stdout:Verifying port 0.0.0.0:8443 ... 2024-09-13T02:45:11.439 INFO:teuthology.orchestra.run.smithi089.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-12cdb164-717a-11ef-bceb-c7b262605968@mgr.smithi089.guohvs 2024-09-13T02:45:11.439 INFO:teuthology.orchestra.run.smithi089.stdout:systemctl: stderr Failed to reset failed state of unit ceph-12cdb164-717a-11ef-bceb-c7b262605968@mgr.smithi089.guohvs.service: Unit ceph-12cdb164-717a-11ef-bceb-c7b262605968@mgr.smithi089.guohvs.service not loaded. 2024-09-13T02:45:11.582 INFO:teuthology.orchestra.run.smithi089.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-12cdb164-717a-11ef-bceb-c7b262605968.target.wants/ceph-12cdb164-717a-11ef-bceb-c7b262605968@mgr.smithi089.guohvs.service → /etc/systemd/system/ceph-12cdb164-717a-11ef-bceb-c7b262605968@.service. 2024-09-13T02:45:11.900 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:11 smithi089 ceph-mon[27639]: from='client.? 172.21.15.89:0/3024391436' entity='client.admin' 2024-09-13T02:45:12.121 INFO:teuthology.orchestra.run.smithi089.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-13T02:45:12.122 INFO:teuthology.orchestra.run.smithi089.stdout:systemctl: stdout disabled 2024-09-13T02:45:12.129 INFO:teuthology.orchestra.run.smithi089.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-13T02:45:12.129 INFO:teuthology.orchestra.run.smithi089.stdout:systemctl: stdout inactive 2024-09-13T02:45:12.129 INFO:teuthology.orchestra.run.smithi089.stdout:firewalld.service is not enabled 2024-09-13T02:45:12.130 INFO:teuthology.orchestra.run.smithi089.stdout:Not possible to enable service . firewalld.service is not available 2024-09-13T02:45:12.138 INFO:teuthology.orchestra.run.smithi089.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-13T02:45:12.138 INFO:teuthology.orchestra.run.smithi089.stdout:systemctl: stdout disabled 2024-09-13T02:45:12.146 INFO:teuthology.orchestra.run.smithi089.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-13T02:45:12.146 INFO:teuthology.orchestra.run.smithi089.stdout:systemctl: stdout inactive 2024-09-13T02:45:12.146 INFO:teuthology.orchestra.run.smithi089.stdout:firewalld.service is not enabled 2024-09-13T02:45:12.146 INFO:teuthology.orchestra.run.smithi089.stdout:Not possible to open ports <[9283, 8765, 8443]>. firewalld.service is not available 2024-09-13T02:45:12.147 INFO:teuthology.orchestra.run.smithi089.stdout:Waiting for mgr to start... 2024-09-13T02:45:12.147 INFO:teuthology.orchestra.run.smithi089.stdout:Waiting for mgr... 2024-09-13T02:45:12.848 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:12 smithi089 ceph-mon[27639]: from='client.? 172.21.15.89:0/3099719592' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-13T02:45:13.185 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout 2024-09-13T02:45:13.185 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout { 2024-09-13T02:45:13.185 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "fsid": "12cdb164-717a-11ef-bceb-c7b262605968", 2024-09-13T02:45:13.185 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "health": { 2024-09-13T02:45:13.185 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-13T02:45:13.185 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-13T02:45:13.185 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-13T02:45:13.185 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout }, 2024-09-13T02:45:13.185 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-13T02:45:13.186 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-13T02:45:13.186 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout 0 2024-09-13T02:45:13.186 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout ], 2024-09-13T02:45:13.186 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-13T02:45:13.186 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "smithi089" 2024-09-13T02:45:13.186 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout ], 2024-09-13T02:45:13.186 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-09-13T02:45:13.186 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-13T02:45:13.186 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T02:45:13.186 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-09-13T02:45:13.186 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-13T02:45:13.186 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout }, 2024-09-13T02:45:13.186 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-13T02:45:13.187 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T02:45:13.187 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-13T02:45:13.187 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-13T02:45:13.187 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-13T02:45:13.194 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-13T02:45:13.195 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-13T02:45:13.195 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-13T02:45:13.195 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout }, 2024-09-13T02:45:13.195 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-13T02:45:13.195 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-13T02:45:13.195 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-13T02:45:13.195 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-13T02:45:13.195 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-13T02:45:13.195 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-13T02:45:13.195 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-13T02:45:13.195 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-13T02:45:13.195 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-13T02:45:13.196 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout }, 2024-09-13T02:45:13.196 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-13T02:45:13.196 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T02:45:13.196 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-13T02:45:13.196 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-13T02:45:13.196 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout }, 2024-09-13T02:45:13.196 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-13T02:45:13.196 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-13T02:45:13.196 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-13T02:45:13.196 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-13T02:45:13.196 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-13T02:45:13.196 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-13T02:45:13.197 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "restful" 2024-09-13T02:45:13.197 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout ], 2024-09-13T02:45:13.197 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-13T02:45:13.197 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout }, 2024-09-13T02:45:13.197 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-13T02:45:13.197 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T02:45:13.197 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "modified": "2024-09-13T02:45:05.519855+0000", 2024-09-13T02:45:13.197 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-13T02:45:13.198 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout }, 2024-09-13T02:45:13.198 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-13T02:45:13.198 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout } 2024-09-13T02:45:13.198 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:12.575+0000 7f12be67a640 1 Processor -- start 2024-09-13T02:45:13.198 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:12.575+0000 7f12be67a640 1 -- start start 2024-09-13T02:45:13.198 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:12.575+0000 7f12be67a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12b8101fa0 0x7f12b81023b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:45:13.198 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:12.575+0000 7f12be67a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12b81028f0 con 0x7f12b8101fa0 2024-09-13T02:45:13.198 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:12.576+0000 7f12b7fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12b8101fa0 0x7f12b81023b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:45:13.198 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:12.576+0000 7f12b7fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12b8101fa0 0x7f12b81023b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40288/0 (socket says 172.21.15.89:40288) 2024-09-13T02:45:13.199 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:12.576+0000 7f12b7fff640 1 -- 172.21.15.89:0/964344342 learned_addr learned my addr 172.21.15.89:0/964344342 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:45:13.199 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:12.576+0000 7f12b7fff640 1 -- 172.21.15.89:0/964344342 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12b8102a30 con 0x7f12b8101fa0 2024-09-13T02:45:13.199 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:12.577+0000 7f12b7fff640 1 --2- 172.21.15.89:0/964344342 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12b8101fa0 0x7f12b81023b0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f12a8009840 tx=0x7f12a80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dabbba1b4a834f4e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:45:13.199 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:12.577+0000 7f12b6ffd640 1 -- 172.21.15.89:0/964344342 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f12a8032440 con 0x7f12b8101fa0 2024-09-13T02:45:13.199 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:12.577+0000 7f12b6ffd640 1 -- 172.21.15.89:0/964344342 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f12a8032a00 con 0x7f12b8101fa0 2024-09-13T02:45:13.199 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:12.577+0000 7f12b6ffd640 1 -- 172.21.15.89:0/964344342 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f12a80319e0 con 0x7f12b8101fa0 2024-09-13T02:45:13.199 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:12.577+0000 7f12be67a640 1 -- 172.21.15.89:0/964344342 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12b8101fa0 msgr2=0x7f12b81023b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:13.199 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:12.577+0000 7f12be67a640 1 --2- 172.21.15.89:0/964344342 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12b8101fa0 0x7f12b81023b0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f12a8009840 tx=0x7f12a80091d0 comp rx=0 tx=0).stop 2024-09-13T02:45:13.199 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:12.577+0000 7f12be67a640 1 -- 172.21.15.89:0/964344342 shutdown_connections 2024-09-13T02:45:13.199 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:12.577+0000 7f12be67a640 1 --2- 172.21.15.89:0/964344342 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12b8101fa0 0x7f12b81023b0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:13.199 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:12.577+0000 7f12be67a640 1 -- 172.21.15.89:0/964344342 >> 172.21.15.89:0/964344342 conn(0x7f12b80fd740 msgr2=0x7f12b80ffb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:45:13.200 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:12.578+0000 7f12be67a640 1 -- 172.21.15.89:0/964344342 shutdown_connections 2024-09-13T02:45:13.200 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:12.578+0000 7f12be67a640 1 -- 172.21.15.89:0/964344342 wait complete. 2024-09-13T02:45:13.200 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:12.578+0000 7f12be67a640 1 Processor -- start 2024-09-13T02:45:13.200 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:12.578+0000 7f12be67a640 1 -- start start 2024-09-13T02:45:13.200 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:12.578+0000 7f12be67a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12b8101fa0 0x7f12b8110df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:45:13.200 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:12.578+0000 7f12be67a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12b8111330 con 0x7f12b8101fa0 2024-09-13T02:45:13.200 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:12.579+0000 7f12b7fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12b8101fa0 0x7f12b8110df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:45:13.200 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:12.579+0000 7f12b7fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12b8101fa0 0x7f12b8110df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40304/0 (socket says 172.21.15.89:40304) 2024-09-13T02:45:13.200 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:12.579+0000 7f12b7fff640 1 -- 172.21.15.89:0/3099719592 learned_addr learned my addr 172.21.15.89:0/3099719592 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:45:13.200 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:12.579+0000 7f12b7fff640 1 -- 172.21.15.89:0/3099719592 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12a8009450 con 0x7f12b8101fa0 2024-09-13T02:45:13.200 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:12.579+0000 7f12b7fff640 1 --2- 172.21.15.89:0/3099719592 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12b8101fa0 0x7f12b8110df0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f12a8000c00 tx=0x7f12a8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:45:13.200 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:12.579+0000 7f12b4ff9640 1 -- 172.21.15.89:0/3099719592 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f12a803d450 con 0x7f12b8101fa0 2024-09-13T02:45:13.201 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:12.579+0000 7f12b4ff9640 1 -- 172.21.15.89:0/3099719592 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f12a803da10 con 0x7f12b8101fa0 2024-09-13T02:45:13.201 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:12.579+0000 7f12be67a640 1 -- 172.21.15.89:0/3099719592 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12b8111530 con 0x7f12b8101fa0 2024-09-13T02:45:13.201 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:12.579+0000 7f12b4ff9640 1 -- 172.21.15.89:0/3099719592 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f12a803b8e0 con 0x7f12b8101fa0 2024-09-13T02:45:13.201 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:12.579+0000 7f12be67a640 1 -- 172.21.15.89:0/3099719592 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12b8111f80 con 0x7f12b8101fa0 2024-09-13T02:45:13.201 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:12.579+0000 7f12b4ff9640 1 -- 172.21.15.89:0/3099719592 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 1) v1 ==== 529+0+0 (secure 0 0 0) 0x7f12a8039070 con 0x7f12b8101fa0 2024-09-13T02:45:13.201 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:12.580+0000 7f12b4ff9640 1 -- 172.21.15.89:0/3099719592 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f12a8046760 con 0x7f12b8101fa0 2024-09-13T02:45:13.201 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:12.580+0000 7f12be67a640 1 -- 172.21.15.89:0/3099719592 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12b8101400 con 0x7f12b8101fa0 2024-09-13T02:45:13.201 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:12.582+0000 7f12b4ff9640 1 -- 172.21.15.89:0/3099719592 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71553 (secure 0 0 0) 0x7f12a80657a0 con 0x7f12b8101fa0 2024-09-13T02:45:13.201 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:12.641+0000 7f12be67a640 1 -- 172.21.15.89:0/3099719592 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f12b8103d50 con 0x7f12b8101fa0 2024-09-13T02:45:13.201 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:12.642+0000 7f12b4ff9640 1 -- 172.21.15.89:0/3099719592 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1248 (secure 0 0 0) 0x7f12a8054020 con 0x7f12b8101fa0 2024-09-13T02:45:13.202 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:12.642+0000 7f12be67a640 1 -- 172.21.15.89:0/3099719592 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12b8101fa0 msgr2=0x7f12b8110df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:13.202 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:12.642+0000 7f12be67a640 1 --2- 172.21.15.89:0/3099719592 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12b8101fa0 0x7f12b8110df0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f12a8000c00 tx=0x7f12a8008040 comp rx=0 tx=0).stop 2024-09-13T02:45:13.202 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:12.642+0000 7f12be67a640 1 -- 172.21.15.89:0/3099719592 shutdown_connections 2024-09-13T02:45:13.202 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:12.642+0000 7f12be67a640 1 --2- 172.21.15.89:0/3099719592 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f12b8101fa0 0x7f12b8110df0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:13.202 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:12.642+0000 7f12be67a640 1 -- 172.21.15.89:0/3099719592 >> 172.21.15.89:0/3099719592 conn(0x7f12b80fd740 msgr2=0x7f12b80fe260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:45:13.202 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:12.643+0000 7f12be67a640 1 -- 172.21.15.89:0/3099719592 shutdown_connections 2024-09-13T02:45:13.202 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:12.643+0000 7f12be67a640 1 -- 172.21.15.89:0/3099719592 wait complete. 2024-09-13T02:45:13.202 INFO:teuthology.orchestra.run.smithi089.stdout:mgr not available, waiting (1/15)... 2024-09-13T02:45:16.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:16 smithi089 ceph-mon[27639]: Activating manager daemon smithi089.guohvs 2024-09-13T02:45:16.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:16 smithi089 ceph-mon[27639]: mgrmap e2: smithi089.guohvs(active, starting, since 0.00305924s) 2024-09-13T02:45:16.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:16 smithi089 ceph-mon[27639]: from='mgr.14100 172.21.15.89:0/1929555316' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T02:45:16.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:16 smithi089 ceph-mon[27639]: from='mgr.14100 172.21.15.89:0/1929555316' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T02:45:16.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:16 smithi089 ceph-mon[27639]: from='mgr.14100 172.21.15.89:0/1929555316' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T02:45:16.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:16 smithi089 ceph-mon[27639]: from='mgr.14100 172.21.15.89:0/1929555316' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mon metadata", "id": "smithi089"}]: dispatch 2024-09-13T02:45:16.786 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:16 smithi089 ceph-mon[27639]: from='mgr.14100 172.21.15.89:0/1929555316' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mgr metadata", "who": "smithi089.guohvs", "id": "smithi089.guohvs"}]: dispatch 2024-09-13T02:45:16.786 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:16 smithi089 ceph-mon[27639]: Manager daemon smithi089.guohvs is now available 2024-09-13T02:45:16.786 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:16 smithi089 ceph-mon[27639]: from='mgr.14100 172.21.15.89:0/1929555316' entity='mgr.smithi089.guohvs' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi089.guohvs/mirror_snapshot_schedule"}]: dispatch 2024-09-13T02:45:16.786 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:16 smithi089 ceph-mon[27639]: from='mgr.14100 172.21.15.89:0/1929555316' entity='mgr.smithi089.guohvs' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi089.guohvs/trash_purge_schedule"}]: dispatch 2024-09-13T02:45:16.786 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:16 smithi089 ceph-mon[27639]: from='mgr.14100 172.21.15.89:0/1929555316' entity='mgr.smithi089.guohvs' 2024-09-13T02:45:16.786 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:16 smithi089 ceph-mon[27639]: from='mgr.14100 172.21.15.89:0/1929555316' entity='mgr.smithi089.guohvs' 2024-09-13T02:45:16.786 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:16 smithi089 ceph-mon[27639]: from='mgr.14100 172.21.15.89:0/1929555316' entity='mgr.smithi089.guohvs' 2024-09-13T02:45:18.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:18 smithi089 ceph-mon[27639]: mgrmap e3: smithi089.guohvs(active, since 1.00633s) 2024-09-13T02:45:18.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:18 smithi089 ceph-mon[27639]: from='client.? 172.21.15.89:0/3492185816' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-13T02:45:19.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:19 smithi089 ceph-mon[27639]: mgrmap e4: smithi089.guohvs(active, since 2s) 2024-09-13T02:45:24.089 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout 2024-09-13T02:45:24.089 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout { 2024-09-13T02:45:24.089 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "fsid": "12cdb164-717a-11ef-bceb-c7b262605968", 2024-09-13T02:45:24.089 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "health": { 2024-09-13T02:45:24.089 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-13T02:45:24.089 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-13T02:45:24.089 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-13T02:45:24.090 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout }, 2024-09-13T02:45:24.090 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-13T02:45:24.090 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-13T02:45:24.090 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout 0 2024-09-13T02:45:24.090 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout ], 2024-09-13T02:45:24.090 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-13T02:45:24.090 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "smithi089" 2024-09-13T02:45:24.090 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout ], 2024-09-13T02:45:24.090 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "quorum_age": 7, 2024-09-13T02:45:24.090 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-13T02:45:24.090 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T02:45:24.090 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "quincy", 2024-09-13T02:45:24.090 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-13T02:45:24.091 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout }, 2024-09-13T02:45:24.091 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-13T02:45:24.091 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T02:45:24.091 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-13T02:45:24.091 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-13T02:45:24.091 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-13T02:45:24.091 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-13T02:45:24.091 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-13T02:45:24.091 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-13T02:45:24.091 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout }, 2024-09-13T02:45:24.091 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-13T02:45:24.091 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-13T02:45:24.091 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-13T02:45:24.091 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-13T02:45:24.092 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-13T02:45:24.092 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-13T02:45:24.092 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-13T02:45:24.092 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-13T02:45:24.092 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-13T02:45:24.092 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout }, 2024-09-13T02:45:24.092 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-13T02:45:24.092 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T02:45:24.092 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-13T02:45:24.092 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-13T02:45:24.092 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout }, 2024-09-13T02:45:24.092 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-13T02:45:24.092 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-13T02:45:24.093 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-13T02:45:24.093 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-13T02:45:24.093 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-13T02:45:24.093 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-13T02:45:24.093 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "restful" 2024-09-13T02:45:24.093 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout ], 2024-09-13T02:45:24.093 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-13T02:45:24.093 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout }, 2024-09-13T02:45:24.093 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-13T02:45:24.093 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-13T02:45:24.093 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "modified": "2024-09-13T02:45:05.519855+0000", 2024-09-13T02:45:24.093 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-13T02:45:24.093 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout }, 2024-09-13T02:45:24.094 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-13T02:45:24.094 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout } 2024-09-13T02:45:24.094 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:17.413+0000 7f22e226d640 1 Processor -- start 2024-09-13T02:45:24.094 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:17.414+0000 7f22e226d640 1 -- start start 2024-09-13T02:45:24.094 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:17.414+0000 7f22e226d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22dc100e90 0x7f22dc1012a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:45:24.094 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:17.414+0000 7f22e226d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22dc1017e0 con 0x7f22dc100e90 2024-09-13T02:45:24.094 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:17.414+0000 7f22dbfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22dc100e90 0x7f22dc1012a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:45:24.094 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:17.414+0000 7f22dbfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22dc100e90 0x7f22dc1012a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40388/0 (socket says 172.21.15.89:40388) 2024-09-13T02:45:24.094 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:17.414+0000 7f22dbfff640 1 -- 172.21.15.89:0/3698287882 learned_addr learned my addr 172.21.15.89:0/3698287882 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:45:24.094 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:17.414+0000 7f22dbfff640 1 -- 172.21.15.89:0/3698287882 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22dc101920 con 0x7f22dc100e90 2024-09-13T02:45:24.094 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:17.415+0000 7f22dbfff640 1 --2- 172.21.15.89:0/3698287882 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22dc100e90 0x7f22dc1012a0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f22cc009840 tx=0x7f22cc0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71d91c1302219384 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:45:24.094 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:17.415+0000 7f22daffd640 1 -- 172.21.15.89:0/3698287882 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f22cc032440 con 0x7f22dc100e90 2024-09-13T02:45:24.094 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:17.415+0000 7f22daffd640 1 -- 172.21.15.89:0/3698287882 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f22cc032a00 con 0x7f22dc100e90 2024-09-13T02:45:24.095 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:17.415+0000 7f22daffd640 1 -- 172.21.15.89:0/3698287882 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f22cc031a10 con 0x7f22dc100e90 2024-09-13T02:45:24.095 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:17.416+0000 7f22e226d640 1 -- 172.21.15.89:0/3698287882 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22dc100e90 msgr2=0x7f22dc1012a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:24.095 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:17.416+0000 7f22e226d640 1 --2- 172.21.15.89:0/3698287882 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22dc100e90 0x7f22dc1012a0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f22cc009840 tx=0x7f22cc0091d0 comp rx=0 tx=0).stop 2024-09-13T02:45:24.095 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:17.416+0000 7f22e226d640 1 -- 172.21.15.89:0/3698287882 shutdown_connections 2024-09-13T02:45:24.095 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:17.416+0000 7f22e226d640 1 --2- 172.21.15.89:0/3698287882 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22dc100e90 0x7f22dc1012a0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:24.095 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:17.416+0000 7f22e226d640 1 -- 172.21.15.89:0/3698287882 >> 172.21.15.89:0/3698287882 conn(0x7f22dc0fc6d0 msgr2=0x7f22dc0feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:45:24.095 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:17.416+0000 7f22e226d640 1 -- 172.21.15.89:0/3698287882 shutdown_connections 2024-09-13T02:45:24.095 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:17.416+0000 7f22e226d640 1 -- 172.21.15.89:0/3698287882 wait complete. 2024-09-13T02:45:24.095 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:17.416+0000 7f22e226d640 1 Processor -- start 2024-09-13T02:45:24.095 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:17.416+0000 7f22e226d640 1 -- start start 2024-09-13T02:45:24.095 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:17.417+0000 7f22e226d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22dc100e90 0x7f22dc076ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:45:24.095 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:17.417+0000 7f22e226d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22dc113a80 con 0x7f22dc100e90 2024-09-13T02:45:24.095 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:17.417+0000 7f22dbfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22dc100e90 0x7f22dc076ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:45:24.096 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:17.417+0000 7f22dbfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22dc100e90 0x7f22dc076ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40396/0 (socket says 172.21.15.89:40396) 2024-09-13T02:45:24.096 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:17.417+0000 7f22dbfff640 1 -- 172.21.15.89:0/3492185816 learned_addr learned my addr 172.21.15.89:0/3492185816 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:45:24.096 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:17.417+0000 7f22dbfff640 1 -- 172.21.15.89:0/3492185816 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22cc009450 con 0x7f22dc100e90 2024-09-13T02:45:24.096 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:17.417+0000 7f22dbfff640 1 --2- 172.21.15.89:0/3492185816 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22dc100e90 0x7f22dc076ae0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f22cc0098a0 tx=0x7f22cc02c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:45:24.096 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:17.417+0000 7f22d8ff9640 1 -- 172.21.15.89:0/3492185816 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f22cc0327b0 con 0x7f22dc100e90 2024-09-13T02:45:24.096 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:17.417+0000 7f22d8ff9640 1 -- 172.21.15.89:0/3492185816 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f22cc03b870 con 0x7f22dc100e90 2024-09-13T02:45:24.096 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:17.417+0000 7f22e226d640 1 -- 172.21.15.89:0/3492185816 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22dc113bc0 con 0x7f22dc100e90 2024-09-13T02:45:24.096 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:17.417+0000 7f22d8ff9640 1 -- 172.21.15.89:0/3492185816 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f22cc03a550 con 0x7f22dc100e90 2024-09-13T02:45:24.096 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:17.417+0000 7f22e226d640 1 -- 172.21.15.89:0/3492185816 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22dc113fd0 con 0x7f22dc100e90 2024-09-13T02:45:24.096 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:17.418+0000 7f22d8ff9640 1 -- 172.21.15.89:0/3492185816 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 3) v1 ==== 45390+0+0 (secure 0 0 0) 0x7f22cc039040 con 0x7f22dc100e90 2024-09-13T02:45:24.096 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:17.418+0000 7f22d8ff9640 1 --2- 172.21.15.89:0/3492185816 >> [v2:172.21.15.89:6800/3982028315,v1:172.21.15.89:6801/3982028315] conn(0x7f22c4039330 0x7f22c403b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:45:24.096 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:17.418+0000 7f22e226d640 1 -- 172.21.15.89:0/3492185816 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22dc04b720 con 0x7f22dc100e90 2024-09-13T02:45:24.096 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:17.419+0000 7f22d8ff9640 1 -- 172.21.15.89:0/3492185816 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f22cc06c6d0 con 0x7f22dc100e90 2024-09-13T02:45:24.097 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:17.419+0000 7f22db7fe640 1 --2- 172.21.15.89:0/3492185816 >> [v2:172.21.15.89:6800/3982028315,v1:172.21.15.89:6801/3982028315] conn(0x7f22c4039330 0x7f22c403b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:45:24.097 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:17.419+0000 7f22db7fe640 1 --2- 172.21.15.89:0/3492185816 >> [v2:172.21.15.89:6800/3982028315,v1:172.21.15.89:6801/3982028315] conn(0x7f22c4039330 0x7f22c403b7e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f22d0006fd0 tx=0x7f22d0006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:45:24.097 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:17.423+0000 7f22d8ff9640 1 -- 172.21.15.89:0/3492185816 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f22cc04c350 con 0x7f22dc100e90 2024-09-13T02:45:24.097 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:17.641+0000 7f22e226d640 1 -- 172.21.15.89:0/3492185816 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f22dc114220 con 0x7f22dc100e90 2024-09-13T02:45:24.097 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:17.641+0000 7f22d8ff9640 1 -- 172.21.15.89:0/3492185816 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1247 (secure 0 0 0) 0x7f22cc03f020 con 0x7f22dc100e90 2024-09-13T02:45:24.097 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:17.643+0000 7f22e226d640 1 -- 172.21.15.89:0/3492185816 >> [v2:172.21.15.89:6800/3982028315,v1:172.21.15.89:6801/3982028315] conn(0x7f22c4039330 msgr2=0x7f22c403b7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:24.097 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:17.643+0000 7f22e226d640 1 --2- 172.21.15.89:0/3492185816 >> [v2:172.21.15.89:6800/3982028315,v1:172.21.15.89:6801/3982028315] conn(0x7f22c4039330 0x7f22c403b7e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f22d0006fd0 tx=0x7f22d0006db0 comp rx=0 tx=0).stop 2024-09-13T02:45:24.097 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:17.643+0000 7f22e226d640 1 -- 172.21.15.89:0/3492185816 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22dc100e90 msgr2=0x7f22dc076ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:24.097 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:17.643+0000 7f22e226d640 1 --2- 172.21.15.89:0/3492185816 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22dc100e90 0x7f22dc076ae0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f22cc0098a0 tx=0x7f22cc02c040 comp rx=0 tx=0).stop 2024-09-13T02:45:24.097 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:17.643+0000 7f22e226d640 1 -- 172.21.15.89:0/3492185816 shutdown_connections 2024-09-13T02:45:24.097 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:17.643+0000 7f22e226d640 1 --2- 172.21.15.89:0/3492185816 >> [v2:172.21.15.89:6800/3982028315,v1:172.21.15.89:6801/3982028315] conn(0x7f22c4039330 0x7f22c403b7e0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:24.097 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:17.643+0000 7f22e226d640 1 --2- 172.21.15.89:0/3492185816 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22dc100e90 0x7f22dc076ae0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:24.097 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:17.643+0000 7f22e226d640 1 -- 172.21.15.89:0/3492185816 >> 172.21.15.89:0/3492185816 conn(0x7f22dc0fc6d0 msgr2=0x7f22dc0fd2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:45:24.098 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:17.643+0000 7f22e226d640 1 -- 172.21.15.89:0/3492185816 shutdown_connections 2024-09-13T02:45:24.098 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:17.643+0000 7f22e226d640 1 -- 172.21.15.89:0/3492185816 wait complete. 2024-09-13T02:45:24.098 INFO:teuthology.orchestra.run.smithi089.stdout:mgr is available 2024-09-13T02:45:27.400 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:27 smithi089 ceph-mon[27639]: from='client.? 172.21.15.89:0/3604903205' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-13T02:45:27.660 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout 2024-09-13T02:45:27.660 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout [global] 2024-09-13T02:45:27.660 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout fsid = 12cdb164-717a-11ef-bceb-c7b262605968 2024-09-13T02:45:27.660 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout mon_cluster_log_file_level = debug 2024-09-13T02:45:27.660 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-13T02:45:27.660 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-13T02:45:27.660 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-13T02:45:27.660 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-13T02:45:27.660 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout 2024-09-13T02:45:27.661 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-13T02:45:27.661 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-13T02:45:27.661 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout 2024-09-13T02:45:27.661 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout [osd] 2024-09-13T02:45:27.661 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-13T02:45:27.661 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-13T02:45:27.661 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-13T02:45:27.661 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-13T02:45:27.661 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-13T02:45:27.661 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:26.929+0000 7f2d73510640 1 Processor -- start 2024-09-13T02:45:27.661 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:26.930+0000 7f2d73510640 1 -- start start 2024-09-13T02:45:27.661 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:26.930+0000 7f2d73510640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d6c100f30 0x7f2d6c101340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:45:27.661 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:26.930+0000 7f2d73510640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d6c101880 con 0x7f2d6c100f30 2024-09-13T02:45:27.662 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:26.930+0000 7f2d712ac640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d6c100f30 0x7f2d6c101340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:45:27.662 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:26.930+0000 7f2d712ac640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d6c100f30 0x7f2d6c101340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:49042/0 (socket says 172.21.15.89:49042) 2024-09-13T02:45:27.662 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:26.930+0000 7f2d712ac640 1 -- 172.21.15.89:0/1148294691 learned_addr learned my addr 172.21.15.89:0/1148294691 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:45:27.662 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:26.931+0000 7f2d712ac640 1 -- 172.21.15.89:0/1148294691 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d6c1019c0 con 0x7f2d6c100f30 2024-09-13T02:45:27.662 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:26.931+0000 7f2d712ac640 1 --2- 172.21.15.89:0/1148294691 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d6c100f30 0x7f2d6c101340 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f2d68009840 tx=0x7f2d680091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ec999176f9e9eb5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:45:27.662 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:26.932+0000 7f2d63fff640 1 -- 172.21.15.89:0/1148294691 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2d68032440 con 0x7f2d6c100f30 2024-09-13T02:45:27.662 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:26.932+0000 7f2d63fff640 1 -- 172.21.15.89:0/1148294691 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f2d68032a00 con 0x7f2d6c100f30 2024-09-13T02:45:27.662 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:26.932+0000 7f2d63fff640 1 -- 172.21.15.89:0/1148294691 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2d680319e0 con 0x7f2d6c100f30 2024-09-13T02:45:27.662 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:26.932+0000 7f2d73510640 1 -- 172.21.15.89:0/1148294691 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d6c100f30 msgr2=0x7f2d6c101340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:27.662 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:26.932+0000 7f2d73510640 1 --2- 172.21.15.89:0/1148294691 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d6c100f30 0x7f2d6c101340 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f2d68009840 tx=0x7f2d680091d0 comp rx=0 tx=0).stop 2024-09-13T02:45:27.662 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:26.932+0000 7f2d73510640 1 -- 172.21.15.89:0/1148294691 shutdown_connections 2024-09-13T02:45:27.662 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:26.932+0000 7f2d73510640 1 --2- 172.21.15.89:0/1148294691 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d6c100f30 0x7f2d6c101340 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:27.662 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:26.932+0000 7f2d73510640 1 -- 172.21.15.89:0/1148294691 >> 172.21.15.89:0/1148294691 conn(0x7f2d6c0fc730 msgr2=0x7f2d6c0feb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:45:27.663 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:26.932+0000 7f2d73510640 1 -- 172.21.15.89:0/1148294691 shutdown_connections 2024-09-13T02:45:27.663 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:26.932+0000 7f2d73510640 1 -- 172.21.15.89:0/1148294691 wait complete. 2024-09-13T02:45:27.663 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:26.933+0000 7f2d73510640 1 Processor -- start 2024-09-13T02:45:27.663 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:26.933+0000 7f2d73510640 1 -- start start 2024-09-13T02:45:27.663 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:26.933+0000 7f2d73510640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d6c100f30 0x7f2d6c1070a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:45:27.663 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:26.933+0000 7f2d73510640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d6c1075e0 con 0x7f2d6c100f30 2024-09-13T02:45:27.663 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:26.933+0000 7f2d712ac640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d6c100f30 0x7f2d6c1070a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:45:27.663 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:26.933+0000 7f2d712ac640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d6c100f30 0x7f2d6c1070a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:49044/0 (socket says 172.21.15.89:49044) 2024-09-13T02:45:27.663 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:26.933+0000 7f2d712ac640 1 -- 172.21.15.89:0/3604903205 learned_addr learned my addr 172.21.15.89:0/3604903205 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:45:27.663 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:26.933+0000 7f2d712ac640 1 -- 172.21.15.89:0/3604903205 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d68009450 con 0x7f2d6c100f30 2024-09-13T02:45:27.663 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:26.934+0000 7f2d712ac640 1 --2- 172.21.15.89:0/3604903205 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d6c100f30 0x7f2d6c1070a0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2d680098a0 tx=0x7f2d68008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:45:27.663 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:26.934+0000 7f2d61ffb640 1 -- 172.21.15.89:0/3604903205 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2d68032880 con 0x7f2d6c100f30 2024-09-13T02:45:27.663 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:26.934+0000 7f2d61ffb640 1 -- 172.21.15.89:0/3604903205 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f2d6803d8b0 con 0x7f2d6c100f30 2024-09-13T02:45:27.664 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:26.934+0000 7f2d73510640 1 -- 172.21.15.89:0/3604903205 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d6c105670 con 0x7f2d6c100f30 2024-09-13T02:45:27.664 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:26.934+0000 7f2d61ffb640 1 -- 172.21.15.89:0/3604903205 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2d6803b910 con 0x7f2d6c100f30 2024-09-13T02:45:27.664 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:26.934+0000 7f2d73510640 1 -- 172.21.15.89:0/3604903205 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d6c105ae0 con 0x7f2d6c100f30 2024-09-13T02:45:27.664 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:26.935+0000 7f2d61ffb640 1 -- 172.21.15.89:0/3604903205 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 4) v1 ==== 45496+0+0 (secure 0 0 0) 0x7f2d68039070 con 0x7f2d6c100f30 2024-09-13T02:45:27.664 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:26.935+0000 7f2d61ffb640 1 --2- 172.21.15.89:0/3604903205 >> [v2:172.21.15.89:6800/3982028315,v1:172.21.15.89:6801/3982028315] conn(0x7f2d58039490 0x7f2d5803b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:45:27.664 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:26.935+0000 7f2d61ffb640 1 -- 172.21.15.89:0/3604903205 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f2d6806d070 con 0x7f2d6c100f30 2024-09-13T02:45:27.664 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:26.935+0000 7f2d73510640 1 -- 172.21.15.89:0/3604903205 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d6c04b720 con 0x7f2d6c100f30 2024-09-13T02:45:27.664 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:26.935+0000 7f2d70aab640 1 --2- 172.21.15.89:0/3604903205 >> [v2:172.21.15.89:6800/3982028315,v1:172.21.15.89:6801/3982028315] conn(0x7f2d58039490 0x7f2d5803b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:45:27.664 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:26.936+0000 7f2d70aab640 1 --2- 172.21.15.89:0/3604903205 >> [v2:172.21.15.89:6800/3982028315,v1:172.21.15.89:6801/3982028315] conn(0x7f2d58039490 0x7f2d5803b940 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c006fd0 tx=0x7f2d5c006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:45:27.664 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:26.940+0000 7f2d61ffb640 1 -- 172.21.15.89:0/3604903205 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f2d68041070 con 0x7f2d6c100f30 2024-09-13T02:45:27.664 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:27.095+0000 7f2d73510640 1 -- 172.21.15.89:0/3604903205 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7f2d6c102bf0 con 0x7f2d6c100f30 2024-09-13T02:45:27.664 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:27.096+0000 7f2d61ffb640 1 -- 172.21.15.89:0/3604903205 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+409 (secure 0 0 0) 0x7f2d68037030 con 0x7f2d6c100f30 2024-09-13T02:45:27.665 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:27.098+0000 7f2d73510640 1 -- 172.21.15.89:0/3604903205 >> [v2:172.21.15.89:6800/3982028315,v1:172.21.15.89:6801/3982028315] conn(0x7f2d58039490 msgr2=0x7f2d5803b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:27.665 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:27.098+0000 7f2d73510640 1 --2- 172.21.15.89:0/3604903205 >> [v2:172.21.15.89:6800/3982028315,v1:172.21.15.89:6801/3982028315] conn(0x7f2d58039490 0x7f2d5803b940 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c006fd0 tx=0x7f2d5c006db0 comp rx=0 tx=0).stop 2024-09-13T02:45:27.665 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:27.098+0000 7f2d73510640 1 -- 172.21.15.89:0/3604903205 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d6c100f30 msgr2=0x7f2d6c1070a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:27.665 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:27.098+0000 7f2d73510640 1 --2- 172.21.15.89:0/3604903205 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d6c100f30 0x7f2d6c1070a0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f2d680098a0 tx=0x7f2d68008040 comp rx=0 tx=0).stop 2024-09-13T02:45:27.665 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:27.098+0000 7f2d73510640 1 -- 172.21.15.89:0/3604903205 shutdown_connections 2024-09-13T02:45:27.665 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:27.098+0000 7f2d73510640 1 --2- 172.21.15.89:0/3604903205 >> [v2:172.21.15.89:6800/3982028315,v1:172.21.15.89:6801/3982028315] conn(0x7f2d58039490 0x7f2d5803b940 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:27.665 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:27.098+0000 7f2d73510640 1 --2- 172.21.15.89:0/3604903205 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2d6c100f30 0x7f2d6c1070a0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:27.665 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:27.098+0000 7f2d73510640 1 -- 172.21.15.89:0/3604903205 >> 172.21.15.89:0/3604903205 conn(0x7f2d6c0fc730 msgr2=0x7f2d6c0fd310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:45:27.665 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:27.098+0000 7f2d73510640 1 -- 172.21.15.89:0/3604903205 shutdown_connections 2024-09-13T02:45:27.665 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:27.098+0000 7f2d73510640 1 -- 172.21.15.89:0/3604903205 wait complete. 2024-09-13T02:45:27.665 INFO:teuthology.orchestra.run.smithi089.stdout:Enabling cephadm module... 2024-09-13T02:45:28.534 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:28 smithi089 ceph-mon[27639]: from='client.? 172.21.15.89:0/1597049412' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-13T02:45:28.899 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:28.025+0000 7fda7bea8640 1 Processor -- start 2024-09-13T02:45:28.899 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:28.025+0000 7fda7bea8640 1 -- start start 2024-09-13T02:45:28.899 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:28.026+0000 7fda7bea8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda74100390 0x7fda741007a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:45:28.899 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:28.026+0000 7fda7bea8640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda74100ce0 con 0x7fda74100390 2024-09-13T02:45:28.899 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:28.026+0000 7fda79c44640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda74100390 0x7fda741007a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:45:28.899 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:28.026+0000 7fda79c44640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda74100390 0x7fda741007a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:49054/0 (socket says 172.21.15.89:49054) 2024-09-13T02:45:28.899 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:28.026+0000 7fda79c44640 1 -- 172.21.15.89:0/2371517482 learned_addr learned my addr 172.21.15.89:0/2371517482 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:45:28.899 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:28.026+0000 7fda79c44640 1 -- 172.21.15.89:0/2371517482 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda74100e20 con 0x7fda74100390 2024-09-13T02:45:28.899 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:28.027+0000 7fda79c44640 1 --2- 172.21.15.89:0/2371517482 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda74100390 0x7fda741007a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fda68009840 tx=0x7fda680091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88d2a449d6f771a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:45:28.900 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:28.027+0000 7fda78c42640 1 -- 172.21.15.89:0/2371517482 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fda68032440 con 0x7fda74100390 2024-09-13T02:45:28.900 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:28.027+0000 7fda78c42640 1 -- 172.21.15.89:0/2371517482 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fda68032a00 con 0x7fda74100390 2024-09-13T02:45:28.900 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:28.027+0000 7fda78c42640 1 -- 172.21.15.89:0/2371517482 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fda680319e0 con 0x7fda74100390 2024-09-13T02:45:28.900 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:28.028+0000 7fda7bea8640 1 -- 172.21.15.89:0/2371517482 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda74100390 msgr2=0x7fda741007a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:28.900 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:28.028+0000 7fda7bea8640 1 --2- 172.21.15.89:0/2371517482 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda74100390 0x7fda741007a0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fda68009840 tx=0x7fda680091d0 comp rx=0 tx=0).stop 2024-09-13T02:45:28.900 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:28.028+0000 7fda7bea8640 1 -- 172.21.15.89:0/2371517482 shutdown_connections 2024-09-13T02:45:28.900 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:28.028+0000 7fda7bea8640 1 --2- 172.21.15.89:0/2371517482 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda74100390 0x7fda741007a0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:28.900 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:28.028+0000 7fda7bea8640 1 -- 172.21.15.89:0/2371517482 >> 172.21.15.89:0/2371517482 conn(0x7fda740fbdd0 msgr2=0x7fda740fe200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:45:28.900 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:28.028+0000 7fda7bea8640 1 -- 172.21.15.89:0/2371517482 shutdown_connections 2024-09-13T02:45:28.900 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:28.028+0000 7fda7bea8640 1 -- 172.21.15.89:0/2371517482 wait complete. 2024-09-13T02:45:28.900 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:28.028+0000 7fda7bea8640 1 Processor -- start 2024-09-13T02:45:28.900 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:28.028+0000 7fda7bea8640 1 -- start start 2024-09-13T02:45:28.900 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:28.028+0000 7fda7bea8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda74100390 0x7fda74102dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:45:28.901 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:28.028+0000 7fda7bea8640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda74103300 con 0x7fda74100390 2024-09-13T02:45:28.901 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:28.029+0000 7fda79c44640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda74100390 0x7fda74102dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:45:28.901 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:28.029+0000 7fda79c44640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda74100390 0x7fda74102dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:49070/0 (socket says 172.21.15.89:49070) 2024-09-13T02:45:28.901 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:28.029+0000 7fda79c44640 1 -- 172.21.15.89:0/1597049412 learned_addr learned my addr 172.21.15.89:0/1597049412 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:45:28.901 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:28.029+0000 7fda79c44640 1 -- 172.21.15.89:0/1597049412 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda68009450 con 0x7fda74100390 2024-09-13T02:45:28.901 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:28.029+0000 7fda79c44640 1 --2- 172.21.15.89:0/1597049412 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda74100390 0x7fda74102dc0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fda680098a0 tx=0x7fda68008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:45:28.901 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:28.029+0000 7fda667fc640 1 -- 172.21.15.89:0/1597049412 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fda68032880 con 0x7fda74100390 2024-09-13T02:45:28.901 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:28.029+0000 7fda667fc640 1 -- 172.21.15.89:0/1597049412 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fda6803d8b0 con 0x7fda74100390 2024-09-13T02:45:28.901 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:28.029+0000 7fda7bea8640 1 -- 172.21.15.89:0/1597049412 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda74101390 con 0x7fda74100390 2024-09-13T02:45:28.901 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:28.029+0000 7fda667fc640 1 -- 172.21.15.89:0/1597049412 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fda6803b910 con 0x7fda74100390 2024-09-13T02:45:28.901 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:28.029+0000 7fda7bea8640 1 -- 172.21.15.89:0/1597049412 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda74101800 con 0x7fda74100390 2024-09-13T02:45:28.901 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:28.030+0000 7fda667fc640 1 -- 172.21.15.89:0/1597049412 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 4) v1 ==== 45496+0+0 (secure 0 0 0) 0x7fda68039070 con 0x7fda74100390 2024-09-13T02:45:28.901 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:28.030+0000 7fda7bea8640 1 -- 172.21.15.89:0/1597049412 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda7404b720 con 0x7fda74100390 2024-09-13T02:45:28.901 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:28.030+0000 7fda667fc640 1 --2- 172.21.15.89:0/1597049412 >> [v2:172.21.15.89:6800/3982028315,v1:172.21.15.89:6801/3982028315] conn(0x7fda60039450 0x7fda6003b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:45:28.902 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:28.030+0000 7fda667fc640 1 -- 172.21.15.89:0/1597049412 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fda6806cf40 con 0x7fda74100390 2024-09-13T02:45:28.902 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:28.030+0000 7fda79443640 1 --2- 172.21.15.89:0/1597049412 >> [v2:172.21.15.89:6800/3982028315,v1:172.21.15.89:6801/3982028315] conn(0x7fda60039450 0x7fda6003b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:45:28.902 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:28.031+0000 7fda79443640 1 --2- 172.21.15.89:0/1597049412 >> [v2:172.21.15.89:6800/3982028315,v1:172.21.15.89:6801/3982028315] conn(0x7fda60039450 0x7fda6003b900 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fda70006fd0 tx=0x7fda70006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:45:28.902 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:28.035+0000 7fda667fc640 1 -- 172.21.15.89:0/1597049412 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fda6803da20 con 0x7fda74100390 2024-09-13T02:45:28.902 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:28.229+0000 7fda7bea8640 1 -- 172.21.15.89:0/1597049412 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7fda74105f00 con 0x7fda74100390 2024-09-13T02:45:28.902 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:28.282+0000 7fda667fc640 1 -- 172.21.15.89:0/1597049412 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mgrmap(e 5) v1 ==== 45507+0+0 (secure 0 0 0) 0x7fda6803cbe0 con 0x7fda74100390 2024-09-13T02:45:28.902 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:28.283+0000 7fda667fc640 1 -- 172.21.15.89:0/1597049412 <== mon.0 v2:172.21.15.89:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7fda680080b0 con 0x7fda74100390 2024-09-13T02:45:28.902 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:28.285+0000 7fda7bea8640 1 -- 172.21.15.89:0/1597049412 >> [v2:172.21.15.89:6800/3982028315,v1:172.21.15.89:6801/3982028315] conn(0x7fda60039450 msgr2=0x7fda6003b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:28.902 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:28.285+0000 7fda7bea8640 1 --2- 172.21.15.89:0/1597049412 >> [v2:172.21.15.89:6800/3982028315,v1:172.21.15.89:6801/3982028315] conn(0x7fda60039450 0x7fda6003b900 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fda70006fd0 tx=0x7fda70006db0 comp rx=0 tx=0).stop 2024-09-13T02:45:28.902 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:28.285+0000 7fda7bea8640 1 -- 172.21.15.89:0/1597049412 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda74100390 msgr2=0x7fda74102dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:28.902 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:28.285+0000 7fda7bea8640 1 --2- 172.21.15.89:0/1597049412 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda74100390 0x7fda74102dc0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7fda680098a0 tx=0x7fda68008040 comp rx=0 tx=0).stop 2024-09-13T02:45:28.902 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:28.285+0000 7fda7bea8640 1 -- 172.21.15.89:0/1597049412 shutdown_connections 2024-09-13T02:45:28.902 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:28.285+0000 7fda7bea8640 1 --2- 172.21.15.89:0/1597049412 >> [v2:172.21.15.89:6800/3982028315,v1:172.21.15.89:6801/3982028315] conn(0x7fda60039450 0x7fda6003b900 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:28.903 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:28.285+0000 7fda7bea8640 1 --2- 172.21.15.89:0/1597049412 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fda74100390 0x7fda74102dc0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:28.903 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:28.285+0000 7fda7bea8640 1 -- 172.21.15.89:0/1597049412 >> 172.21.15.89:0/1597049412 conn(0x7fda740fbdd0 msgr2=0x7fda740fca10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:45:28.903 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:28.286+0000 7fda7bea8640 1 -- 172.21.15.89:0/1597049412 shutdown_connections 2024-09-13T02:45:28.903 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:28.286+0000 7fda7bea8640 1 -- 172.21.15.89:0/1597049412 wait complete. 2024-09-13T02:45:29.483 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:29 smithi089 ceph-mon[27639]: from='client.? 172.21.15.89:0/1597049412' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-13T02:45:29.483 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:29 smithi089 ceph-mon[27639]: mgrmap e5: smithi089.guohvs(active, since 11s) 2024-09-13T02:45:30.131 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout { 2024-09-13T02:45:30.131 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-13T02:45:30.131 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-13T02:45:30.131 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "active_name": "smithi089.guohvs", 2024-09-13T02:45:30.131 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-13T02:45:30.131 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout } 2024-09-13T02:45:30.131 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:29.274+0000 7fa036291640 1 Processor -- start 2024-09-13T02:45:30.131 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:29.274+0000 7fa036291640 1 -- start start 2024-09-13T02:45:30.131 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:29.274+0000 7fa036291640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa030103550 0x7fa030103960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:45:30.132 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:29.274+0000 7fa036291640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa030103ea0 con 0x7fa030103550 2024-09-13T02:45:30.132 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:29.275+0000 7fa02ffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa030103550 0x7fa030103960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:45:30.132 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:29.275+0000 7fa02ffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa030103550 0x7fa030103960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:49092/0 (socket says 172.21.15.89:49092) 2024-09-13T02:45:30.132 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:29.275+0000 7fa02ffff640 1 -- 172.21.15.89:0/2931304699 learned_addr learned my addr 172.21.15.89:0/2931304699 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:45:30.132 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:29.275+0000 7fa02ffff640 1 -- 172.21.15.89:0/2931304699 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa030103fe0 con 0x7fa030103550 2024-09-13T02:45:30.132 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:29.276+0000 7fa02ffff640 1 --2- 172.21.15.89:0/2931304699 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa030103550 0x7fa030103960 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa020009840 tx=0x7fa0200091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f11cc4836ae9864 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:45:30.132 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:29.276+0000 7fa02f7fe640 1 -- 172.21.15.89:0/2931304699 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa020032440 con 0x7fa030103550 2024-09-13T02:45:30.132 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:29.276+0000 7fa02f7fe640 1 -- 172.21.15.89:0/2931304699 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fa020032a00 con 0x7fa030103550 2024-09-13T02:45:30.132 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:29.276+0000 7fa02f7fe640 1 -- 172.21.15.89:0/2931304699 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa0200319e0 con 0x7fa030103550 2024-09-13T02:45:30.132 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:29.277+0000 7fa036291640 1 -- 172.21.15.89:0/2931304699 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa030103550 msgr2=0x7fa030103960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:30.132 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:29.277+0000 7fa036291640 1 --2- 172.21.15.89:0/2931304699 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa030103550 0x7fa030103960 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa020009840 tx=0x7fa0200091d0 comp rx=0 tx=0).stop 2024-09-13T02:45:30.132 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:29.277+0000 7fa036291640 1 -- 172.21.15.89:0/2931304699 shutdown_connections 2024-09-13T02:45:30.132 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:29.277+0000 7fa036291640 1 --2- 172.21.15.89:0/2931304699 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa030103550 0x7fa030103960 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:30.133 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:29.277+0000 7fa036291640 1 -- 172.21.15.89:0/2931304699 >> 172.21.15.89:0/2931304699 conn(0x7fa0300fbd90 msgr2=0x7fa0300fe1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:45:30.133 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:29.277+0000 7fa036291640 1 -- 172.21.15.89:0/2931304699 shutdown_connections 2024-09-13T02:45:30.133 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:29.277+0000 7fa036291640 1 -- 172.21.15.89:0/2931304699 wait complete. 2024-09-13T02:45:30.133 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:29.277+0000 7fa036291640 1 Processor -- start 2024-09-13T02:45:30.133 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:29.277+0000 7fa036291640 1 -- start start 2024-09-13T02:45:30.133 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:29.278+0000 7fa036291640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa030103550 0x7fa030102c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:45:30.133 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:29.278+0000 7fa036291640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0301031a0 con 0x7fa030103550 2024-09-13T02:45:30.133 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:29.278+0000 7fa02ffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa030103550 0x7fa030102c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:45:30.133 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:29.278+0000 7fa02ffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa030103550 0x7fa030102c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:49094/0 (socket says 172.21.15.89:49094) 2024-09-13T02:45:30.133 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:29.278+0000 7fa02ffff640 1 -- 172.21.15.89:0/2685369547 learned_addr learned my addr 172.21.15.89:0/2685369547 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:45:30.133 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:29.278+0000 7fa02ffff640 1 -- 172.21.15.89:0/2685369547 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa020009450 con 0x7fa030103550 2024-09-13T02:45:30.133 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:29.278+0000 7fa02ffff640 1 --2- 172.21.15.89:0/2685369547 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa030103550 0x7fa030102c60 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa0200098a0 tx=0x7fa020008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:45:30.133 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:29.278+0000 7fa02d7fa640 1 -- 172.21.15.89:0/2685369547 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa020032880 con 0x7fa030103550 2024-09-13T02:45:30.134 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:29.278+0000 7fa02d7fa640 1 -- 172.21.15.89:0/2685369547 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fa02003d8b0 con 0x7fa030103550 2024-09-13T02:45:30.134 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:29.278+0000 7fa02d7fa640 1 -- 172.21.15.89:0/2685369547 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa02003b910 con 0x7fa030103550 2024-09-13T02:45:30.134 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:29.278+0000 7fa036291640 1 -- 172.21.15.89:0/2685369547 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa030101230 con 0x7fa030103550 2024-09-13T02:45:30.134 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:29.278+0000 7fa036291640 1 -- 172.21.15.89:0/2685369547 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0301016a0 con 0x7fa030103550 2024-09-13T02:45:30.134 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:29.279+0000 7fa02d7fa640 1 -- 172.21.15.89:0/2685369547 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 45507+0+0 (secure 0 0 0) 0x7fa020039070 con 0x7fa030103550 2024-09-13T02:45:30.134 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:29.279+0000 7fa036291640 1 -- 172.21.15.89:0/2685369547 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa03004b720 con 0x7fa030103550 2024-09-13T02:45:30.134 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:29.280+0000 7fa02d7fa640 1 --2- 172.21.15.89:0/2685369547 >> [v2:172.21.15.89:6800/3982028315,v1:172.21.15.89:6801/3982028315] conn(0x7fa01c0394e0 0x7fa01c03b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:45:30.134 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:29.280+0000 7fa02d7fa640 1 -- 172.21.15.89:0/2685369547 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fa02006d090 con 0x7fa030103550 2024-09-13T02:45:30.134 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:29.280+0000 7fa027fff640 1 -- 172.21.15.89:0/2685369547 >> [v2:172.21.15.89:6800/3982028315,v1:172.21.15.89:6801/3982028315] conn(0x7fa01c0394e0 msgr2=0x7fa01c03b990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.89:6800/3982028315 2024-09-13T02:45:30.134 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:29.280+0000 7fa027fff640 1 --2- 172.21.15.89:0/2685369547 >> [v2:172.21.15.89:6800/3982028315,v1:172.21.15.89:6801/3982028315] conn(0x7fa01c0394e0 0x7fa01c03b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T02:45:30.134 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:29.284+0000 7fa02d7fa640 1 -- 172.21.15.89:0/2685369547 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fa02004e530 con 0x7fa030103550 2024-09-13T02:45:30.134 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:29.481+0000 7fa027fff640 1 -- 172.21.15.89:0/2685369547 >> [v2:172.21.15.89:6800/3982028315,v1:172.21.15.89:6801/3982028315] conn(0x7fa01c0394e0 msgr2=0x7fa01c03b990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.89:6800/3982028315 2024-09-13T02:45:30.134 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:29.481+0000 7fa027fff640 1 --2- 172.21.15.89:0/2685369547 >> [v2:172.21.15.89:6800/3982028315,v1:172.21.15.89:6801/3982028315] conn(0x7fa01c0394e0 0x7fa01c03b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T02:45:30.134 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:29.489+0000 7fa036291640 1 -- 172.21.15.89:0/2685369547 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7fa030101de0 con 0x7fa030103550 2024-09-13T02:45:30.135 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:29.490+0000 7fa02d7fa640 1 -- 172.21.15.89:0/2685369547 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+103 (secure 0 0 0) 0x7fa020041020 con 0x7fa030103550 2024-09-13T02:45:30.135 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:29.492+0000 7fa036291640 1 -- 172.21.15.89:0/2685369547 >> [v2:172.21.15.89:6800/3982028315,v1:172.21.15.89:6801/3982028315] conn(0x7fa01c0394e0 msgr2=0x7fa01c03b990 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T02:45:30.135 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:29.492+0000 7fa036291640 1 --2- 172.21.15.89:0/2685369547 >> [v2:172.21.15.89:6800/3982028315,v1:172.21.15.89:6801/3982028315] conn(0x7fa01c0394e0 0x7fa01c03b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:30.135 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:29.492+0000 7fa036291640 1 -- 172.21.15.89:0/2685369547 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa030103550 msgr2=0x7fa030102c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:30.135 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:29.492+0000 7fa036291640 1 --2- 172.21.15.89:0/2685369547 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa030103550 0x7fa030102c60 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa0200098a0 tx=0x7fa020008040 comp rx=0 tx=0).stop 2024-09-13T02:45:30.135 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:29.492+0000 7fa036291640 1 -- 172.21.15.89:0/2685369547 shutdown_connections 2024-09-13T02:45:30.135 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:29.492+0000 7fa036291640 1 --2- 172.21.15.89:0/2685369547 >> [v2:172.21.15.89:6800/3982028315,v1:172.21.15.89:6801/3982028315] conn(0x7fa01c0394e0 0x7fa01c03b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:30.135 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:29.492+0000 7fa036291640 1 --2- 172.21.15.89:0/2685369547 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa030103550 0x7fa030102c60 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:30.135 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:29.492+0000 7fa036291640 1 -- 172.21.15.89:0/2685369547 >> 172.21.15.89:0/2685369547 conn(0x7fa0300fbd90 msgr2=0x7fa0300fc8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:45:30.135 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:29.492+0000 7fa036291640 1 -- 172.21.15.89:0/2685369547 shutdown_connections 2024-09-13T02:45:30.135 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:29.492+0000 7fa036291640 1 -- 172.21.15.89:0/2685369547 wait complete. 2024-09-13T02:45:30.135 INFO:teuthology.orchestra.run.smithi089.stdout:Waiting for the mgr to restart... 2024-09-13T02:45:30.135 INFO:teuthology.orchestra.run.smithi089.stdout:Waiting for mgr epoch 5... 2024-09-13T02:45:30.400 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:30 smithi089 ceph-mon[27639]: from='client.? 172.21.15.89:0/2685369547' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-13T02:45:33.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:32 smithi089 ceph-mon[27639]: Active manager daemon smithi089.guohvs restarted 2024-09-13T02:45:33.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:32 smithi089 ceph-mon[27639]: Activating manager daemon smithi089.guohvs 2024-09-13T02:45:33.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:32 smithi089 ceph-mon[27639]: osdmap e2: 0 total, 0 up, 0 in 2024-09-13T02:45:33.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:32 smithi089 ceph-mon[27639]: mgrmap e6: smithi089.guohvs(active, starting, since 0.00414249s) 2024-09-13T02:45:33.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:32 smithi089 ceph-mon[27639]: from='mgr.14116 172.21.15.89:0/1844139609' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mon metadata", "id": "smithi089"}]: dispatch 2024-09-13T02:45:33.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:32 smithi089 ceph-mon[27639]: from='mgr.14116 172.21.15.89:0/1844139609' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mgr metadata", "who": "smithi089.guohvs", "id": "smithi089.guohvs"}]: dispatch 2024-09-13T02:45:33.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:32 smithi089 ceph-mon[27639]: from='mgr.14116 172.21.15.89:0/1844139609' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T02:45:33.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:32 smithi089 ceph-mon[27639]: from='mgr.14116 172.21.15.89:0/1844139609' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T02:45:33.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:32 smithi089 ceph-mon[27639]: from='mgr.14116 172.21.15.89:0/1844139609' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T02:45:33.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:32 smithi089 ceph-mon[27639]: Manager daemon smithi089.guohvs is now available 2024-09-13T02:45:33.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:32 smithi089 ceph-mon[27639]: from='mgr.14116 172.21.15.89:0/1844139609' entity='mgr.smithi089.guohvs' 2024-09-13T02:45:33.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:32 smithi089 ceph-mon[27639]: from='mgr.14116 172.21.15.89:0/1844139609' entity='mgr.smithi089.guohvs' 2024-09-13T02:45:33.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:32 smithi089 ceph-mon[27639]: from='mgr.14116 172.21.15.89:0/1844139609' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:45:33.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:32 smithi089 ceph-mon[27639]: from='mgr.14116 172.21.15.89:0/1844139609' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:45:33.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:32 smithi089 ceph-mon[27639]: from='mgr.14116 172.21.15.89:0/1844139609' entity='mgr.smithi089.guohvs' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi089.guohvs/mirror_snapshot_schedule"}]: dispatch 2024-09-13T02:45:33.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:32 smithi089 ceph-mon[27639]: from='mgr.14116 172.21.15.89:0/1844139609' entity='mgr.smithi089.guohvs' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi089.guohvs/trash_purge_schedule"}]: dispatch 2024-09-13T02:45:34.006 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:33 smithi089 ceph-mon[27639]: Found migration_current of "None". Setting to last migration. 2024-09-13T02:45:34.006 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:33 smithi089 ceph-mon[27639]: mgrmap e7: smithi089.guohvs(active, since 1.00558s) 2024-09-13T02:45:34.287 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout { 2024-09-13T02:45:34.287 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-13T02:45:34.287 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-13T02:45:34.287 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout } 2024-09-13T02:45:34.287 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:30.579+0000 7ffa29087640 1 Processor -- start 2024-09-13T02:45:34.287 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:30.579+0000 7ffa29087640 1 -- start start 2024-09-13T02:45:34.287 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:30.579+0000 7ffa29087640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffa24100e90 0x7ffa241012a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:45:34.287 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:30.579+0000 7ffa29087640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa241017e0 con 0x7ffa24100e90 2024-09-13T02:45:34.287 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:30.579+0000 7ffa22d9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffa24100e90 0x7ffa241012a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:45:34.287 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:30.579+0000 7ffa22d9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffa24100e90 0x7ffa241012a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:49096/0 (socket says 172.21.15.89:49096) 2024-09-13T02:45:34.287 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:30.579+0000 7ffa22d9d640 1 -- 172.21.15.89:0/792836195 learned_addr learned my addr 172.21.15.89:0/792836195 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:45:34.288 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:30.579+0000 7ffa22d9d640 1 -- 172.21.15.89:0/792836195 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa24101920 con 0x7ffa24100e90 2024-09-13T02:45:34.288 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:30.580+0000 7ffa22d9d640 1 --2- 172.21.15.89:0/792836195 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffa24100e90 0x7ffa241012a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ffa1400baf0 tx=0x7ffa1400b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54e5ab57111269d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:45:34.288 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:30.580+0000 7ffa21d9b640 1 -- 172.21.15.89:0/792836195 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffa14031790 con 0x7ffa24100e90 2024-09-13T02:45:34.288 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:30.580+0000 7ffa21d9b640 1 -- 172.21.15.89:0/792836195 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7ffa14031d50 con 0x7ffa24100e90 2024-09-13T02:45:34.288 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:30.580+0000 7ffa21d9b640 1 -- 172.21.15.89:0/792836195 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffa14039e10 con 0x7ffa24100e90 2024-09-13T02:45:34.288 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:30.581+0000 7ffa29087640 1 -- 172.21.15.89:0/792836195 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffa24100e90 msgr2=0x7ffa241012a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:34.288 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:30.581+0000 7ffa29087640 1 --2- 172.21.15.89:0/792836195 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffa24100e90 0x7ffa241012a0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7ffa1400baf0 tx=0x7ffa1400b460 comp rx=0 tx=0).stop 2024-09-13T02:45:34.288 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:30.581+0000 7ffa29087640 1 -- 172.21.15.89:0/792836195 shutdown_connections 2024-09-13T02:45:34.288 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:30.581+0000 7ffa29087640 1 --2- 172.21.15.89:0/792836195 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffa24100e90 0x7ffa241012a0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:34.288 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:30.581+0000 7ffa29087640 1 -- 172.21.15.89:0/792836195 >> 172.21.15.89:0/792836195 conn(0x7ffa240fc6d0 msgr2=0x7ffa240feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:45:34.288 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:30.581+0000 7ffa29087640 1 -- 172.21.15.89:0/792836195 shutdown_connections 2024-09-13T02:45:34.288 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:30.581+0000 7ffa29087640 1 -- 172.21.15.89:0/792836195 wait complete. 2024-09-13T02:45:34.289 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:30.581+0000 7ffa29087640 1 Processor -- start 2024-09-13T02:45:34.289 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:30.582+0000 7ffa29087640 1 -- start start 2024-09-13T02:45:34.289 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:30.582+0000 7ffa29087640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffa24100e90 0x7ffa2410eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:45:34.289 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:30.582+0000 7ffa29087640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa2410f0b0 con 0x7ffa24100e90 2024-09-13T02:45:34.289 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:30.582+0000 7ffa22d9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffa24100e90 0x7ffa2410eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:45:34.289 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:30.582+0000 7ffa22d9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffa24100e90 0x7ffa2410eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:49098/0 (socket says 172.21.15.89:49098) 2024-09-13T02:45:34.289 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:30.582+0000 7ffa22d9d640 1 -- 172.21.15.89:0/3297720462 learned_addr learned my addr 172.21.15.89:0/3297720462 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:45:34.289 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:30.582+0000 7ffa22d9d640 1 -- 172.21.15.89:0/3297720462 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa1400b700 con 0x7ffa24100e90 2024-09-13T02:45:34.289 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:30.582+0000 7ffa22d9d640 1 --2- 172.21.15.89:0/3297720462 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffa24100e90 0x7ffa2410eb70 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ffa14003080 tx=0x7ffa1403c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:45:34.289 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:30.582+0000 7ffa0b7fe640 1 -- 172.21.15.89:0/3297720462 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffa1403a5b0 con 0x7ffa24100e90 2024-09-13T02:45:34.289 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:30.582+0000 7ffa0b7fe640 1 -- 172.21.15.89:0/3297720462 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7ffa1403ab70 con 0x7ffa24100e90 2024-09-13T02:45:34.289 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:30.582+0000 7ffa29087640 1 -- 172.21.15.89:0/3297720462 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa2410f2b0 con 0x7ffa24100e90 2024-09-13T02:45:34.289 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:30.582+0000 7ffa0b7fe640 1 -- 172.21.15.89:0/3297720462 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffa14044b20 con 0x7ffa24100e90 2024-09-13T02:45:34.290 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:30.583+0000 7ffa29087640 1 -- 172.21.15.89:0/3297720462 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa2410f720 con 0x7ffa24100e90 2024-09-13T02:45:34.290 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:30.584+0000 7ffa0b7fe640 1 -- 172.21.15.89:0/3297720462 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 5) v1 ==== 45507+0+0 (secure 0 0 0) 0x7ffa140443f0 con 0x7ffa24100e90 2024-09-13T02:45:34.290 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:30.584+0000 7ffa0b7fe640 1 --2- 172.21.15.89:0/3297720462 >> [v2:172.21.15.89:6800/3982028315,v1:172.21.15.89:6801/3982028315] conn(0x7ffa0c0394e0 0x7ffa0c03b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:45:34.290 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:30.584+0000 7ffa0b7fe640 1 -- 172.21.15.89:0/3297720462 --> [v2:172.21.15.89:6800/3982028315,v1:172.21.15.89:6801/3982028315] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7ffa0c03c0a0 con 0x7ffa0c0394e0 2024-09-13T02:45:34.290 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:30.584+0000 7ffa0b7fe640 1 -- 172.21.15.89:0/3297720462 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7ffa14070010 con 0x7ffa24100e90 2024-09-13T02:45:34.290 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:30.584+0000 7ffa2259c640 1 -- 172.21.15.89:0/3297720462 >> [v2:172.21.15.89:6800/3982028315,v1:172.21.15.89:6801/3982028315] conn(0x7ffa0c0394e0 msgr2=0x7ffa0c03b990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.89:6800/3982028315 2024-09-13T02:45:34.290 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:30.584+0000 7ffa2259c640 1 --2- 172.21.15.89:0/3297720462 >> [v2:172.21.15.89:6800/3982028315,v1:172.21.15.89:6801/3982028315] conn(0x7ffa0c0394e0 0x7ffa0c03b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T02:45:34.290 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:30.785+0000 7ffa2259c640 1 -- 172.21.15.89:0/3297720462 >> [v2:172.21.15.89:6800/3982028315,v1:172.21.15.89:6801/3982028315] conn(0x7ffa0c0394e0 msgr2=0x7ffa0c03b990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.89:6800/3982028315 2024-09-13T02:45:34.290 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:30.785+0000 7ffa2259c640 1 --2- 172.21.15.89:0/3297720462 >> [v2:172.21.15.89:6800/3982028315,v1:172.21.15.89:6801/3982028315] conn(0x7ffa0c0394e0 0x7ffa0c03b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T02:45:34.290 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:31.186+0000 7ffa2259c640 1 -- 172.21.15.89:0/3297720462 >> [v2:172.21.15.89:6800/3982028315,v1:172.21.15.89:6801/3982028315] conn(0x7ffa0c0394e0 msgr2=0x7ffa0c03b990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.89:6800/3982028315 2024-09-13T02:45:34.290 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:31.186+0000 7ffa2259c640 1 --2- 172.21.15.89:0/3297720462 >> [v2:172.21.15.89:6800/3982028315,v1:172.21.15.89:6801/3982028315] conn(0x7ffa0c0394e0 0x7ffa0c03b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-13T02:45:34.290 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:31.987+0000 7ffa2259c640 1 -- 172.21.15.89:0/3297720462 >> [v2:172.21.15.89:6800/3982028315,v1:172.21.15.89:6801/3982028315] conn(0x7ffa0c0394e0 msgr2=0x7ffa0c03b990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.89:6800/3982028315 2024-09-13T02:45:34.291 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:31.987+0000 7ffa2259c640 1 --2- 172.21.15.89:0/3297720462 >> [v2:172.21.15.89:6800/3982028315,v1:172.21.15.89:6801/3982028315] conn(0x7ffa0c0394e0 0x7ffa0c03b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-13T02:45:34.291 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:32.670+0000 7ffa0b7fe640 1 -- 172.21.15.89:0/3297720462 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mgrmap(e 6) v1 ==== 45274+0+0 (secure 0 0 0) 0x7ffa14038d30 con 0x7ffa24100e90 2024-09-13T02:45:34.291 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:32.670+0000 7ffa0b7fe640 1 -- 172.21.15.89:0/3297720462 >> [v2:172.21.15.89:6800/3982028315,v1:172.21.15.89:6801/3982028315] conn(0x7ffa0c0394e0 msgr2=0x7ffa0c03b990 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T02:45:34.291 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:32.670+0000 7ffa0b7fe640 1 --2- 172.21.15.89:0/3297720462 >> [v2:172.21.15.89:6800/3982028315,v1:172.21.15.89:6801/3982028315] conn(0x7ffa0c0394e0 0x7ffa0c03b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:34.291 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:33.670+0000 7ffa0b7fe640 1 -- 172.21.15.89:0/3297720462 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mgrmap(e 7) v1 ==== 45401+0+0 (secure 0 0 0) 0x7ffa1403ace0 con 0x7ffa24100e90 2024-09-13T02:45:34.291 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:33.670+0000 7ffa0b7fe640 1 --2- 172.21.15.89:0/3297720462 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7ffa0c03cdf0 0x7ffa0c03f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:45:34.291 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:33.670+0000 7ffa0b7fe640 1 -- 172.21.15.89:0/3297720462 --> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7ffa0c03c0a0 con 0x7ffa0c03cdf0 2024-09-13T02:45:34.291 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:33.671+0000 7ffa2259c640 1 --2- 172.21.15.89:0/3297720462 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7ffa0c03cdf0 0x7ffa0c03f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:45:34.291 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:33.672+0000 7ffa2259c640 1 --2- 172.21.15.89:0/3297720462 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7ffa0c03cdf0 0x7ffa0c03f1d0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7ffa18003940 tx=0x7ffa18009350 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:45:34.291 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:33.672+0000 7ffa0b7fe640 1 -- 172.21.15.89:0/3297720462 <== mgr.14116 v2:172.21.15.89:6800/702640100 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6549 (secure 0 0 0) 0x7ffa0c03c0a0 con 0x7ffa0c03cdf0 2024-09-13T02:45:34.291 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:33.677+0000 7ffa097fa640 1 -- 172.21.15.89:0/3297720462 --> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7ffa2410f720 con 0x7ffa0c03cdf0 2024-09-13T02:45:34.291 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:33.677+0000 7ffa0b7fe640 1 -- 172.21.15.89:0/3297720462 <== mgr.14116 v2:172.21.15.89:6800/702640100 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7ffa2410f720 con 0x7ffa0c03cdf0 2024-09-13T02:45:34.292 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:33.678+0000 7ffa097fa640 1 -- 172.21.15.89:0/3297720462 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7ffa0c03cdf0 msgr2=0x7ffa0c03f1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:34.292 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:33.678+0000 7ffa097fa640 1 --2- 172.21.15.89:0/3297720462 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7ffa0c03cdf0 0x7ffa0c03f1d0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7ffa18003940 tx=0x7ffa18009350 comp rx=0 tx=0).stop 2024-09-13T02:45:34.292 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:33.678+0000 7ffa097fa640 1 -- 172.21.15.89:0/3297720462 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffa24100e90 msgr2=0x7ffa2410eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:34.292 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:33.678+0000 7ffa097fa640 1 --2- 172.21.15.89:0/3297720462 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffa24100e90 0x7ffa2410eb70 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7ffa14003080 tx=0x7ffa1403c040 comp rx=0 tx=0).stop 2024-09-13T02:45:34.292 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:33.678+0000 7ffa097fa640 1 -- 172.21.15.89:0/3297720462 shutdown_connections 2024-09-13T02:45:34.292 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:33.678+0000 7ffa097fa640 1 --2- 172.21.15.89:0/3297720462 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7ffa0c03cdf0 0x7ffa0c03f1d0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:34.292 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:33.678+0000 7ffa097fa640 1 --2- 172.21.15.89:0/3297720462 >> [v2:172.21.15.89:6800/3982028315,v1:172.21.15.89:6801/3982028315] conn(0x7ffa0c0394e0 0x7ffa0c03b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:34.292 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:33.678+0000 7ffa097fa640 1 --2- 172.21.15.89:0/3297720462 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffa24100e90 0x7ffa2410eb70 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:34.292 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:33.678+0000 7ffa097fa640 1 -- 172.21.15.89:0/3297720462 >> 172.21.15.89:0/3297720462 conn(0x7ffa240fc6d0 msgr2=0x7ffa241053d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:45:34.292 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:33.678+0000 7ffa097fa640 1 -- 172.21.15.89:0/3297720462 shutdown_connections 2024-09-13T02:45:34.292 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:33.678+0000 7ffa097fa640 1 -- 172.21.15.89:0/3297720462 wait complete. 2024-09-13T02:45:34.293 INFO:teuthology.orchestra.run.smithi089.stdout:mgr epoch 5 is available 2024-09-13T02:45:34.293 INFO:teuthology.orchestra.run.smithi089.stdout:Setting orchestrator backend to cephadm... 2024-09-13T02:45:35.439 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:35 smithi089 ceph-mon[27639]: from='client.14120 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-13T02:45:35.439 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:35 smithi089 ceph-mon[27639]: from='client.14120 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-13T02:45:35.439 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:35 smithi089 ceph-mon[27639]: [13/Sep/2024:02:45:34] ENGINE Bus STARTING 2024-09-13T02:45:35.439 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:35 smithi089 ceph-mon[27639]: [13/Sep/2024:02:45:34] ENGINE Serving on https://172.21.15.89:7150 2024-09-13T02:45:35.439 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:35 smithi089 ceph-mon[27639]: [13/Sep/2024:02:45:34] ENGINE Bus STARTED 2024-09-13T02:45:35.439 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:35 smithi089 ceph-mon[27639]: [13/Sep/2024:02:45:34] ENGINE Error in HTTPServer.serve 2024-09-13T02:45:35.439 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Traceback (most recent call last): 2024-09-13T02:45:35.439 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T02:45:35.439 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: self._connections.run(self.expiration_interval) 2024-09-13T02:45:35.439 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T02:45:35.439 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: self._run(expiration_interval) 2024-09-13T02:45:35.440 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T02:45:35.440 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T02:45:35.440 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T02:45:35.440 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T02:45:35.440 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T02:45:35.440 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: s = self.context.wrap_socket( 2024-09-13T02:45:35.440 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T02:45:35.440 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: return self.sslsocket_class._create( 2024-09-13T02:45:35.440 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T02:45:35.440 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: self.do_handshake() 2024-09-13T02:45:35.441 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T02:45:35.441 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: self._sslobj.do_handshake() 2024-09-13T02:45:35.441 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T02:45:35.441 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:35 smithi089 ceph-mon[27639]: from='mgr.14116 172.21.15.89:0/1844139609' entity='mgr.smithi089.guohvs' 2024-09-13T02:45:35.441 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:35 smithi089 ceph-mon[27639]: from='mgr.14116 172.21.15.89:0/1844139609' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:45:35.441 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:35 smithi089 ceph-mon[27639]: from='mgr.14116 172.21.15.89:0/1844139609' entity='mgr.smithi089.guohvs' 2024-09-13T02:45:35.441 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:35 smithi089 ceph-mon[27639]: from='mgr.14116 172.21.15.89:0/1844139609' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:45:35.446 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:34.682+0000 7f7409749640 1 Processor -- start 2024-09-13T02:45:35.446 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:34.682+0000 7f7409749640 1 -- start start 2024-09-13T02:45:35.447 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:34.682+0000 7f7409749640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7404100f30 0x7f7404101340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:45:35.447 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:34.682+0000 7f7409749640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7404101880 con 0x7f7404100f30 2024-09-13T02:45:35.447 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:34.682+0000 7f7402ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7404100f30 0x7f7404101340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:45:35.447 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:34.682+0000 7f7402ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7404100f30 0x7f7404101340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:53272/0 (socket says 172.21.15.89:53272) 2024-09-13T02:45:35.447 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:34.682+0000 7f7402ffd640 1 -- 172.21.15.89:0/3031939050 learned_addr learned my addr 172.21.15.89:0/3031939050 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:45:35.447 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:34.682+0000 7f7402ffd640 1 -- 172.21.15.89:0/3031939050 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74041019c0 con 0x7f7404100f30 2024-09-13T02:45:35.447 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:34.683+0000 7f7402ffd640 1 --2- 172.21.15.89:0/3031939050 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7404100f30 0x7f7404101340 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f73f4009840 tx=0x7f73f40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e698056a72c71f server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:45:35.447 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:34.683+0000 7f7401ffb640 1 -- 172.21.15.89:0/3031939050 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f73f4032440 con 0x7f7404100f30 2024-09-13T02:45:35.447 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:34.683+0000 7f7401ffb640 1 -- 172.21.15.89:0/3031939050 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f73f4032a00 con 0x7f7404100f30 2024-09-13T02:45:35.447 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:34.683+0000 7f7401ffb640 1 -- 172.21.15.89:0/3031939050 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f73f40319e0 con 0x7f7404100f30 2024-09-13T02:45:35.447 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:34.684+0000 7f7409749640 1 -- 172.21.15.89:0/3031939050 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7404100f30 msgr2=0x7f7404101340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:35.447 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:34.684+0000 7f7409749640 1 --2- 172.21.15.89:0/3031939050 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7404100f30 0x7f7404101340 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f73f4009840 tx=0x7f73f40091d0 comp rx=0 tx=0).stop 2024-09-13T02:45:35.447 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:34.684+0000 7f7409749640 1 -- 172.21.15.89:0/3031939050 shutdown_connections 2024-09-13T02:45:35.448 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:34.684+0000 7f7409749640 1 --2- 172.21.15.89:0/3031939050 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7404100f30 0x7f7404101340 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:35.448 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:34.684+0000 7f7409749640 1 -- 172.21.15.89:0/3031939050 >> 172.21.15.89:0/3031939050 conn(0x7f74040fc730 msgr2=0x7f74040feb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:45:35.448 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:34.684+0000 7f7409749640 1 -- 172.21.15.89:0/3031939050 shutdown_connections 2024-09-13T02:45:35.448 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:34.684+0000 7f7409749640 1 -- 172.21.15.89:0/3031939050 wait complete. 2024-09-13T02:45:35.448 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:34.684+0000 7f7409749640 1 Processor -- start 2024-09-13T02:45:35.448 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:34.685+0000 7f7409749640 1 -- start start 2024-09-13T02:45:35.448 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:34.685+0000 7f7409749640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7404100f30 0x7f740410eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:45:35.448 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:34.685+0000 7f7409749640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f740410f090 con 0x7f7404100f30 2024-09-13T02:45:35.448 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:34.685+0000 7f7402ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7404100f30 0x7f740410eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:45:35.448 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:34.685+0000 7f7402ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7404100f30 0x7f740410eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:53284/0 (socket says 172.21.15.89:53284) 2024-09-13T02:45:35.448 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:34.685+0000 7f7402ffd640 1 -- 172.21.15.89:0/3090861231 learned_addr learned my addr 172.21.15.89:0/3090861231 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:45:35.448 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:34.685+0000 7f7402ffd640 1 -- 172.21.15.89:0/3090861231 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73f4009450 con 0x7f7404100f30 2024-09-13T02:45:35.449 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:34.685+0000 7f7402ffd640 1 --2- 172.21.15.89:0/3090861231 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7404100f30 0x7f740410eb50 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f73f4000c00 tx=0x7f73f4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:45:35.449 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:34.685+0000 7f73eb7fe640 1 -- 172.21.15.89:0/3090861231 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f73f403d450 con 0x7f7404100f30 2024-09-13T02:45:35.449 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:34.685+0000 7f73eb7fe640 1 -- 172.21.15.89:0/3090861231 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f73f403da10 con 0x7f7404100f30 2024-09-13T02:45:35.449 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:34.685+0000 7f7409749640 1 -- 172.21.15.89:0/3090861231 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f740410f290 con 0x7f7404100f30 2024-09-13T02:45:35.449 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:34.685+0000 7f73eb7fe640 1 -- 172.21.15.89:0/3090861231 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f73f403b8e0 con 0x7f7404100f30 2024-09-13T02:45:35.449 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:34.685+0000 7f7409749640 1 -- 172.21.15.89:0/3090861231 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f740410f700 con 0x7f7404100f30 2024-09-13T02:45:35.449 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:34.686+0000 7f73eb7fe640 1 -- 172.21.15.89:0/3090861231 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 7) v1 ==== 45401+0+0 (secure 0 0 0) 0x7f73f4039070 con 0x7f7404100f30 2024-09-13T02:45:35.449 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:34.686+0000 7f73eb7fe640 1 --2- 172.21.15.89:0/3090861231 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7f73ec03b5d0 0x7f73ec03da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:45:35.449 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:34.686+0000 7f73eb7fe640 1 -- 172.21.15.89:0/3090861231 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f73f406d040 con 0x7f7404100f30 2024-09-13T02:45:35.449 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:34.686+0000 7f7409749640 1 -- 172.21.15.89:0/3090861231 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7404100390 con 0x7f7404100f30 2024-09-13T02:45:35.449 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:34.687+0000 7f74027fc640 1 --2- 172.21.15.89:0/3090861231 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7f73ec03b5d0 0x7f73ec03da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:45:35.449 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:34.687+0000 7f74027fc640 1 --2- 172.21.15.89:0/3090861231 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7f73ec03b5d0 0x7f73ec03da80 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f73f8006fd0 tx=0x7f73f8006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:45:35.449 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:34.691+0000 7f73eb7fe640 1 -- 172.21.15.89:0/3090861231 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f73f4037030 con 0x7f7404100f30 2024-09-13T02:45:35.450 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:34.856+0000 7f7409749640 1 -- 172.21.15.89:0/3090861231 --> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7f740410ff30 con 0x7f73ec03b5d0 2024-09-13T02:45:35.450 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:34.864+0000 7f73eb7fe640 1 -- 172.21.15.89:0/3090861231 <== mgr.14116 v2:172.21.15.89:6800/702640100 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f740410ff30 con 0x7f73ec03b5d0 2024-09-13T02:45:35.450 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:34.866+0000 7f7409749640 1 -- 172.21.15.89:0/3090861231 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7f73ec03b5d0 msgr2=0x7f73ec03da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:35.450 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:34.866+0000 7f7409749640 1 --2- 172.21.15.89:0/3090861231 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7f73ec03b5d0 0x7f73ec03da80 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f73f8006fd0 tx=0x7f73f8006db0 comp rx=0 tx=0).stop 2024-09-13T02:45:35.450 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:34.866+0000 7f7409749640 1 -- 172.21.15.89:0/3090861231 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7404100f30 msgr2=0x7f740410eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:35.450 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:34.866+0000 7f7409749640 1 --2- 172.21.15.89:0/3090861231 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7404100f30 0x7f740410eb50 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f73f4000c00 tx=0x7f73f4008040 comp rx=0 tx=0).stop 2024-09-13T02:45:35.450 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:34.866+0000 7f7409749640 1 -- 172.21.15.89:0/3090861231 shutdown_connections 2024-09-13T02:45:35.450 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:34.866+0000 7f7409749640 1 --2- 172.21.15.89:0/3090861231 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7f73ec03b5d0 0x7f73ec03da80 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:35.450 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:34.866+0000 7f7409749640 1 --2- 172.21.15.89:0/3090861231 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7404100f30 0x7f740410eb50 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:35.450 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:34.866+0000 7f7409749640 1 -- 172.21.15.89:0/3090861231 >> 172.21.15.89:0/3090861231 conn(0x7f74040fc730 msgr2=0x7f74041053b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:45:35.450 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:34.866+0000 7f7409749640 1 -- 172.21.15.89:0/3090861231 shutdown_connections 2024-09-13T02:45:35.450 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:34.866+0000 7f7409749640 1 -- 172.21.15.89:0/3090861231 wait complete. 2024-09-13T02:45:36.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:36 smithi089 ceph-mon[27639]: from='client.14128 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:45:36.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:36 smithi089 ceph-mon[27639]: mgrmap e8: smithi089.guohvs(active, since 2s) 2024-09-13T02:45:36.569 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-13T02:45:36.570 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:35.846+0000 7fe0f7dee640 1 Processor -- start 2024-09-13T02:45:36.570 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:35.847+0000 7fe0f7dee640 1 -- start start 2024-09-13T02:45:36.570 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:35.847+0000 7fe0f7dee640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0f0100ef0 0x7fe0f0101300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:45:36.570 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:35.847+0000 7fe0f7dee640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0f0101840 con 0x7fe0f0100ef0 2024-09-13T02:45:36.570 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:35.847+0000 7fe0f5b8a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0f0100ef0 0x7fe0f0101300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:45:36.570 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:35.847+0000 7fe0f5b8a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0f0100ef0 0x7fe0f0101300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:53298/0 (socket says 172.21.15.89:53298) 2024-09-13T02:45:36.570 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:35.847+0000 7fe0f5b8a640 1 -- 172.21.15.89:0/2740926349 learned_addr learned my addr 172.21.15.89:0/2740926349 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:45:36.570 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:35.847+0000 7fe0f5b8a640 1 -- 172.21.15.89:0/2740926349 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0f0101980 con 0x7fe0f0100ef0 2024-09-13T02:45:36.571 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:35.848+0000 7fe0f5b8a640 1 --2- 172.21.15.89:0/2740926349 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0f0100ef0 0x7fe0f0101300 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe0e4009840 tx=0x7fe0e40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae94b97391e67627 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:45:36.571 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:35.848+0000 7fe0f4b88640 1 -- 172.21.15.89:0/2740926349 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe0e4032440 con 0x7fe0f0100ef0 2024-09-13T02:45:36.571 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:35.848+0000 7fe0f4b88640 1 -- 172.21.15.89:0/2740926349 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fe0e4032a00 con 0x7fe0f0100ef0 2024-09-13T02:45:36.571 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:35.848+0000 7fe0f4b88640 1 -- 172.21.15.89:0/2740926349 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe0e40319e0 con 0x7fe0f0100ef0 2024-09-13T02:45:36.571 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:35.848+0000 7fe0f7dee640 1 -- 172.21.15.89:0/2740926349 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0f0100ef0 msgr2=0x7fe0f0101300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:36.571 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:35.848+0000 7fe0f7dee640 1 --2- 172.21.15.89:0/2740926349 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0f0100ef0 0x7fe0f0101300 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe0e4009840 tx=0x7fe0e40091d0 comp rx=0 tx=0).stop 2024-09-13T02:45:36.571 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:35.849+0000 7fe0f7dee640 1 -- 172.21.15.89:0/2740926349 shutdown_connections 2024-09-13T02:45:36.571 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:35.849+0000 7fe0f7dee640 1 --2- 172.21.15.89:0/2740926349 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0f0100ef0 0x7fe0f0101300 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:36.572 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:35.849+0000 7fe0f7dee640 1 -- 172.21.15.89:0/2740926349 >> 172.21.15.89:0/2740926349 conn(0x7fe0f00fc710 msgr2=0x7fe0f00feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:45:36.572 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:35.849+0000 7fe0f7dee640 1 -- 172.21.15.89:0/2740926349 shutdown_connections 2024-09-13T02:45:36.572 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:35.849+0000 7fe0f7dee640 1 -- 172.21.15.89:0/2740926349 wait complete. 2024-09-13T02:45:36.572 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:35.849+0000 7fe0f7dee640 1 Processor -- start 2024-09-13T02:45:36.572 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:35.849+0000 7fe0f7dee640 1 -- start start 2024-09-13T02:45:36.572 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:35.849+0000 7fe0f7dee640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0f0100ef0 0x7fe0f010fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:45:36.572 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:35.849+0000 7fe0f7dee640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0f01101b0 con 0x7fe0f0100ef0 2024-09-13T02:45:36.573 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:35.849+0000 7fe0f5b8a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0f0100ef0 0x7fe0f010fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:45:36.573 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:35.849+0000 7fe0f5b8a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0f0100ef0 0x7fe0f010fc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:53300/0 (socket says 172.21.15.89:53300) 2024-09-13T02:45:36.573 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:35.849+0000 7fe0f5b8a640 1 -- 172.21.15.89:0/1154896192 learned_addr learned my addr 172.21.15.89:0/1154896192 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:45:36.573 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:35.850+0000 7fe0f5b8a640 1 -- 172.21.15.89:0/1154896192 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0e4009450 con 0x7fe0f0100ef0 2024-09-13T02:45:36.573 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:35.850+0000 7fe0f5b8a640 1 --2- 172.21.15.89:0/1154896192 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0f0100ef0 0x7fe0f010fc70 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe0e4006f00 tx=0x7fe0e4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:45:36.573 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:35.850+0000 7fe0e27fc640 1 -- 172.21.15.89:0/1154896192 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe0e4031e30 con 0x7fe0f0100ef0 2024-09-13T02:45:36.573 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:35.850+0000 7fe0e27fc640 1 -- 172.21.15.89:0/1154896192 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fe0e403d8b0 con 0x7fe0f0100ef0 2024-09-13T02:45:36.574 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:35.850+0000 7fe0f7dee640 1 -- 172.21.15.89:0/1154896192 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0f01103b0 con 0x7fe0f0100ef0 2024-09-13T02:45:36.574 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:35.850+0000 7fe0e27fc640 1 -- 172.21.15.89:0/1154896192 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fe0e403b8f0 con 0x7fe0f0100ef0 2024-09-13T02:45:36.574 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:35.850+0000 7fe0f7dee640 1 -- 172.21.15.89:0/1154896192 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0f0110820 con 0x7fe0f0100ef0 2024-09-13T02:45:36.574 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:35.851+0000 7fe0e27fc640 1 -- 172.21.15.89:0/1154896192 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7fe0e4039070 con 0x7fe0f0100ef0 2024-09-13T02:45:36.574 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:35.851+0000 7fe0e27fc640 1 --2- 172.21.15.89:0/1154896192 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7fe0dc0394e0 0x7fe0dc03b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:45:36.574 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:35.851+0000 7fe0e27fc640 1 -- 172.21.15.89:0/1154896192 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fe0e406d0d0 con 0x7fe0f0100ef0 2024-09-13T02:45:36.574 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:35.851+0000 7fe0f7dee640 1 -- 172.21.15.89:0/1154896192 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0f0100350 con 0x7fe0f0100ef0 2024-09-13T02:45:36.574 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:35.851+0000 7fe0f5389640 1 --2- 172.21.15.89:0/1154896192 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7fe0dc0394e0 0x7fe0dc03b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:45:36.574 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:35.851+0000 7fe0f5389640 1 --2- 172.21.15.89:0/1154896192 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7fe0dc0394e0 0x7fe0dc03b990 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec006fd0 tx=0x7fe0ec006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:45:36.575 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:35.856+0000 7fe0e27fc640 1 -- 172.21.15.89:0/1154896192 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fe0e4041070 con 0x7fe0f0100ef0 2024-09-13T02:45:36.575 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:36.014+0000 7fe0f7dee640 1 -- 172.21.15.89:0/1154896192 --> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7fe0f00fda80 con 0x7fe0dc0394e0 2024-09-13T02:45:36.575 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:36.014+0000 7fe0e27fc640 1 -- 172.21.15.89:0/1154896192 <== mgr.14116 v2:172.21.15.89:6800/702640100 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7fe0f00fda80 con 0x7fe0dc0394e0 2024-09-13T02:45:36.575 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:36.016+0000 7fe0f7dee640 1 -- 172.21.15.89:0/1154896192 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7fe0dc0394e0 msgr2=0x7fe0dc03b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:36.575 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:36.016+0000 7fe0f7dee640 1 --2- 172.21.15.89:0/1154896192 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7fe0dc0394e0 0x7fe0dc03b990 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fe0ec006fd0 tx=0x7fe0ec006db0 comp rx=0 tx=0).stop 2024-09-13T02:45:36.575 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:36.016+0000 7fe0f7dee640 1 -- 172.21.15.89:0/1154896192 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0f0100ef0 msgr2=0x7fe0f010fc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:36.575 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:36.016+0000 7fe0f7dee640 1 --2- 172.21.15.89:0/1154896192 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0f0100ef0 0x7fe0f010fc70 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe0e4006f00 tx=0x7fe0e4008040 comp rx=0 tx=0).stop 2024-09-13T02:45:36.575 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:36.016+0000 7fe0f7dee640 1 -- 172.21.15.89:0/1154896192 shutdown_connections 2024-09-13T02:45:36.576 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:36.016+0000 7fe0f7dee640 1 --2- 172.21.15.89:0/1154896192 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7fe0dc0394e0 0x7fe0dc03b990 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:36.576 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:36.016+0000 7fe0f7dee640 1 --2- 172.21.15.89:0/1154896192 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0f0100ef0 0x7fe0f010fc70 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:36.576 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:36.016+0000 7fe0f7dee640 1 -- 172.21.15.89:0/1154896192 >> 172.21.15.89:0/1154896192 conn(0x7fe0f00fc710 msgr2=0x7fe0f00fd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:45:36.576 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:36.016+0000 7fe0f7dee640 1 -- 172.21.15.89:0/1154896192 shutdown_connections 2024-09-13T02:45:36.576 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:36.016+0000 7fe0f7dee640 1 -- 172.21.15.89:0/1154896192 wait complete. 2024-09-13T02:45:36.576 INFO:teuthology.orchestra.run.smithi089.stdout:Generating ssh key... 2024-09-13T02:45:37.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:37 smithi089 ceph-mon[27639]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:45:37.869 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:36.940+0000 7f2333d23640 1 Processor -- start 2024-09-13T02:45:37.869 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:36.940+0000 7f2333d23640 1 -- start start 2024-09-13T02:45:37.869 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:36.940+0000 7f2333d23640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f232c100e90 0x7f232c1012a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:45:37.869 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:36.941+0000 7f2333d23640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f232c1017e0 con 0x7f232c100e90 2024-09-13T02:45:37.869 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:36.941+0000 7f2331abf640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f232c100e90 0x7f232c1012a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:45:37.870 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:36.941+0000 7f2331abf640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f232c100e90 0x7f232c1012a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:53302/0 (socket says 172.21.15.89:53302) 2024-09-13T02:45:37.870 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:36.941+0000 7f2331abf640 1 -- 172.21.15.89:0/2506150845 learned_addr learned my addr 172.21.15.89:0/2506150845 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:45:37.870 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:36.941+0000 7f2331abf640 1 -- 172.21.15.89:0/2506150845 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f232c101920 con 0x7f232c100e90 2024-09-13T02:45:37.870 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:36.942+0000 7f2331abf640 1 --2- 172.21.15.89:0/2506150845 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f232c100e90 0x7f232c1012a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f231c00d0d0 tx=0x7f231c00ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14e870d07ceba4de server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:45:37.870 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:36.942+0000 7f2330abd640 1 -- 172.21.15.89:0/2506150845 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f231c00b440 con 0x7f232c100e90 2024-09-13T02:45:37.870 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:36.942+0000 7f2330abd640 1 -- 172.21.15.89:0/2506150845 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f231c009a70 con 0x7f232c100e90 2024-09-13T02:45:37.870 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:36.942+0000 7f2330abd640 1 -- 172.21.15.89:0/2506150845 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f231c031af0 con 0x7f232c100e90 2024-09-13T02:45:37.870 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:36.942+0000 7f2333d23640 1 -- 172.21.15.89:0/2506150845 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f232c100e90 msgr2=0x7f232c1012a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:37.870 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:36.942+0000 7f2333d23640 1 --2- 172.21.15.89:0/2506150845 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f232c100e90 0x7f232c1012a0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f231c00d0d0 tx=0x7f231c00ba50 comp rx=0 tx=0).stop 2024-09-13T02:45:37.870 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:36.942+0000 7f2333d23640 1 -- 172.21.15.89:0/2506150845 shutdown_connections 2024-09-13T02:45:37.870 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:36.942+0000 7f2333d23640 1 --2- 172.21.15.89:0/2506150845 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f232c100e90 0x7f232c1012a0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:37.870 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:36.942+0000 7f2333d23640 1 -- 172.21.15.89:0/2506150845 >> 172.21.15.89:0/2506150845 conn(0x7f232c0fc6d0 msgr2=0x7f232c0feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:45:37.871 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:36.943+0000 7f2333d23640 1 -- 172.21.15.89:0/2506150845 shutdown_connections 2024-09-13T02:45:37.871 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:36.943+0000 7f2333d23640 1 -- 172.21.15.89:0/2506150845 wait complete. 2024-09-13T02:45:37.871 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:36.943+0000 7f2333d23640 1 Processor -- start 2024-09-13T02:45:37.871 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:36.943+0000 7f2333d23640 1 -- start start 2024-09-13T02:45:37.871 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:36.943+0000 7f2333d23640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f232c100e90 0x7f232c10eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:45:37.871 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:36.943+0000 7f2333d23640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f232c10f090 con 0x7f232c100e90 2024-09-13T02:45:37.871 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:36.943+0000 7f2331abf640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f232c100e90 0x7f232c10eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:45:37.871 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:36.943+0000 7f2331abf640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f232c100e90 0x7f232c10eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:53306/0 (socket says 172.21.15.89:53306) 2024-09-13T02:45:37.871 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:36.943+0000 7f2331abf640 1 -- 172.21.15.89:0/2468589490 learned_addr learned my addr 172.21.15.89:0/2468589490 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:45:37.871 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:36.944+0000 7f2331abf640 1 -- 172.21.15.89:0/2468589490 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f231c00bcf0 con 0x7f232c100e90 2024-09-13T02:45:37.871 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:36.944+0000 7f2331abf640 1 --2- 172.21.15.89:0/2468589490 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f232c100e90 0x7f232c10eb50 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f231c007030 tx=0x7f231c00ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:45:37.871 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:36.944+0000 7f232a7fc640 1 -- 172.21.15.89:0/2468589490 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f231c0465e0 con 0x7f232c100e90 2024-09-13T02:45:37.871 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:36.944+0000 7f232a7fc640 1 -- 172.21.15.89:0/2468589490 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7f231c03f070 con 0x7f232c100e90 2024-09-13T02:45:37.872 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:36.944+0000 7f2333d23640 1 -- 172.21.15.89:0/2468589490 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f232c10f290 con 0x7f232c100e90 2024-09-13T02:45:37.872 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:36.944+0000 7f232a7fc640 1 -- 172.21.15.89:0/2468589490 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f231c03a960 con 0x7f232c100e90 2024-09-13T02:45:37.872 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:36.944+0000 7f2333d23640 1 -- 172.21.15.89:0/2468589490 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f232c10fe20 con 0x7f232c100e90 2024-09-13T02:45:37.872 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:36.945+0000 7f232a7fc640 1 -- 172.21.15.89:0/2468589490 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f231c03abd0 con 0x7f232c100e90 2024-09-13T02:45:37.872 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:36.945+0000 7f232a7fc640 1 --2- 172.21.15.89:0/2468589490 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7f2314039490 0x7f231403b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:45:37.872 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:36.945+0000 7f2333d23640 1 -- 172.21.15.89:0/2468589490 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f232c1002f0 con 0x7f232c100e90 2024-09-13T02:45:37.872 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:36.945+0000 7f232a7fc640 1 -- 172.21.15.89:0/2468589490 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f231c041070 con 0x7f232c100e90 2024-09-13T02:45:37.872 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:36.945+0000 7f23312be640 1 --2- 172.21.15.89:0/2468589490 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7f2314039490 0x7f231403b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:45:37.872 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:36.945+0000 7f23312be640 1 --2- 172.21.15.89:0/2468589490 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7f2314039490 0x7f231403b940 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2320006fd0 tx=0x7f2320006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:45:37.872 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:36.949+0000 7f232a7fc640 1 -- 172.21.15.89:0/2468589490 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f231c0447f0 con 0x7f232c100e90 2024-09-13T02:45:37.872 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:37.105+0000 7f2333d23640 1 -- 172.21.15.89:0/2468589490 --> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f232c110210 con 0x7f2314039490 2024-09-13T02:45:37.872 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:37.315+0000 7f232a7fc640 1 -- 172.21.15.89:0/2468589490 <== mgr.14116 v2:172.21.15.89:6800/702640100 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f232c110210 con 0x7f2314039490 2024-09-13T02:45:37.872 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:37.317+0000 7f2333d23640 1 -- 172.21.15.89:0/2468589490 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7f2314039490 msgr2=0x7f231403b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:37.873 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:37.317+0000 7f2333d23640 1 --2- 172.21.15.89:0/2468589490 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7f2314039490 0x7f231403b940 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f2320006fd0 tx=0x7f2320006db0 comp rx=0 tx=0).stop 2024-09-13T02:45:37.873 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:37.317+0000 7f2333d23640 1 -- 172.21.15.89:0/2468589490 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f232c100e90 msgr2=0x7f232c10eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:37.873 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:37.317+0000 7f2333d23640 1 --2- 172.21.15.89:0/2468589490 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f232c100e90 0x7f232c10eb50 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f231c007030 tx=0x7f231c00ba50 comp rx=0 tx=0).stop 2024-09-13T02:45:37.873 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:37.317+0000 7f2333d23640 1 -- 172.21.15.89:0/2468589490 shutdown_connections 2024-09-13T02:45:37.873 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:37.317+0000 7f2333d23640 1 --2- 172.21.15.89:0/2468589490 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7f2314039490 0x7f231403b940 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:37.873 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:37.317+0000 7f2333d23640 1 --2- 172.21.15.89:0/2468589490 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f232c100e90 0x7f232c10eb50 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:37.873 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:37.317+0000 7f2333d23640 1 -- 172.21.15.89:0/2468589490 >> 172.21.15.89:0/2468589490 conn(0x7f232c0fc6d0 msgr2=0x7f232c1053d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:45:37.873 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:37.317+0000 7f2333d23640 1 -- 172.21.15.89:0/2468589490 shutdown_connections 2024-09-13T02:45:37.873 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:37.318+0000 7f2333d23640 1 -- 172.21.15.89:0/2468589490 wait complete. 2024-09-13T02:45:38.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:38 smithi089 ceph-mon[27639]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:45:38.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:38 smithi089 ceph-mon[27639]: Generating ssh key... 2024-09-13T02:45:38.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:38 smithi089 ceph-mon[27639]: from='mgr.14116 172.21.15.89:0/1844139609' entity='mgr.smithi089.guohvs' 2024-09-13T02:45:38.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:38 smithi089 ceph-mon[27639]: from='mgr.14116 172.21.15.89:0/1844139609' entity='mgr.smithi089.guohvs' 2024-09-13T02:45:38.967 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDBiTKiZW9FJBHp5yKgTCjgxQMXuvOIG8mw5R/P43vyQGdekePzAeGJee1H3tM8VQUXHNScoJ3dIWS/W1/GTHHWjzSv/qYpxWn4fUJykbynbiRT30cz3cKOec3kVI18Q1mKWLX3t9TfV4L1/243De6FrEdh0824tnZTgvjLC/lOW6BSsy2vfx9pu66ESDtFIMWhAjm+Os7r7sS9IhQCqHQw2DKhbckwWvUcIpbd4byCEdRj59z7y7h23gypIboWGTDOr8KuakAZJohjpX4ydF3g9ppq3npDWWbrVzQI6rvga/e3+WvppLjwOILC9FxGUdW96WJ+MfpimJCC0d+R9mvC8TTo/9307XJRvcCnpdpEMEFPgLSzBkjn/LjkcGbetfD9gyEzOWmTyCERuA2EyJGB2oogkKqtl0nbv6mDQzA4PydormW9aL4fDIXFLZXT4vmjpYIOOic4CImAs7IeNPlveatmUeqQHhshIBj5b6mTdhMUHbjPAoyZhGLbOvF20ik= ceph-12cdb164-717a-11ef-bceb-c7b262605968 2024-09-13T02:45:38.967 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:38.194+0000 7faf073c7640 1 Processor -- start 2024-09-13T02:45:38.967 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:38.195+0000 7faf073c7640 1 -- start start 2024-09-13T02:45:38.967 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:38.195+0000 7faf073c7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf00078b00 0x7faf00077210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:45:38.967 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:38.195+0000 7faf073c7640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf00078fa0 con 0x7faf00078b00 2024-09-13T02:45:38.967 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:38.195+0000 7faf05163640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf00078b00 0x7faf00077210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:45:38.967 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:38.195+0000 7faf05163640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf00078b00 0x7faf00077210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:53314/0 (socket says 172.21.15.89:53314) 2024-09-13T02:45:38.967 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:38.195+0000 7faf05163640 1 -- 172.21.15.89:0/2014557958 learned_addr learned my addr 172.21.15.89:0/2014557958 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:45:38.967 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:38.195+0000 7faf05163640 1 -- 172.21.15.89:0/2014557958 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf000790e0 con 0x7faf00078b00 2024-09-13T02:45:38.968 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:38.196+0000 7faf05163640 1 --2- 172.21.15.89:0/2014557958 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf00078b00 0x7faf00077210 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7faef0009840 tx=0x7faef00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32c6476323d902ff server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:45:38.968 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:38.196+0000 7faef7fff640 1 -- 172.21.15.89:0/2014557958 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faef0032440 con 0x7faf00078b00 2024-09-13T02:45:38.968 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:38.196+0000 7faef7fff640 1 -- 172.21.15.89:0/2014557958 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7faef0032a00 con 0x7faf00078b00 2024-09-13T02:45:38.968 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:38.196+0000 7faef7fff640 1 -- 172.21.15.89:0/2014557958 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faef00319e0 con 0x7faf00078b00 2024-09-13T02:45:38.968 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:38.197+0000 7faf073c7640 1 -- 172.21.15.89:0/2014557958 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf00078b00 msgr2=0x7faf00077210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:38.968 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:38.197+0000 7faf073c7640 1 --2- 172.21.15.89:0/2014557958 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf00078b00 0x7faf00077210 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7faef0009840 tx=0x7faef00091d0 comp rx=0 tx=0).stop 2024-09-13T02:45:38.968 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:38.197+0000 7faf073c7640 1 -- 172.21.15.89:0/2014557958 shutdown_connections 2024-09-13T02:45:38.968 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:38.197+0000 7faf073c7640 1 --2- 172.21.15.89:0/2014557958 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf00078b00 0x7faf00077210 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:38.968 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:38.197+0000 7faf073c7640 1 -- 172.21.15.89:0/2014557958 >> 172.21.15.89:0/2014557958 conn(0x7faf000fd850 msgr2=0x7faf000ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:45:38.968 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:38.197+0000 7faf073c7640 1 -- 172.21.15.89:0/2014557958 shutdown_connections 2024-09-13T02:45:38.968 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:38.197+0000 7faf073c7640 1 -- 172.21.15.89:0/2014557958 wait complete. 2024-09-13T02:45:38.968 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:38.197+0000 7faf073c7640 1 Processor -- start 2024-09-13T02:45:38.968 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:38.197+0000 7faf073c7640 1 -- start start 2024-09-13T02:45:38.969 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:38.198+0000 7faf073c7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf00078b00 0x7faf00112fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:45:38.969 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:38.198+0000 7faf073c7640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf001134e0 con 0x7faf00078b00 2024-09-13T02:45:38.969 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:38.198+0000 7faf05163640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf00078b00 0x7faf00112fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:45:38.969 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:38.198+0000 7faf05163640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf00078b00 0x7faf00112fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:53330/0 (socket says 172.21.15.89:53330) 2024-09-13T02:45:38.969 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:38.198+0000 7faf05163640 1 -- 172.21.15.89:0/1290806012 learned_addr learned my addr 172.21.15.89:0/1290806012 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:45:38.969 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:38.198+0000 7faf05163640 1 -- 172.21.15.89:0/1290806012 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faef0009450 con 0x7faf00078b00 2024-09-13T02:45:38.969 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:38.198+0000 7faf05163640 1 --2- 172.21.15.89:0/1290806012 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf00078b00 0x7faf00112fa0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7faef0006f00 tx=0x7faef0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:45:38.969 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:38.198+0000 7faef5ffb640 1 -- 172.21.15.89:0/1290806012 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faef003b470 con 0x7faf00078b00 2024-09-13T02:45:38.969 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:38.198+0000 7faef5ffb640 1 -- 172.21.15.89:0/1290806012 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7faef003ba30 con 0x7faf00078b00 2024-09-13T02:45:38.969 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:38.198+0000 7faf073c7640 1 -- 172.21.15.89:0/1290806012 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf001136e0 con 0x7faf00078b00 2024-09-13T02:45:38.969 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:38.198+0000 7faef5ffb640 1 -- 172.21.15.89:0/1290806012 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7faef003a820 con 0x7faf00078b00 2024-09-13T02:45:38.969 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:38.198+0000 7faf073c7640 1 -- 172.21.15.89:0/1290806012 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf00113b50 con 0x7faf00078b00 2024-09-13T02:45:38.969 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:38.199+0000 7faef5ffb640 1 -- 172.21.15.89:0/1290806012 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7faef003aa50 con 0x7faf00078b00 2024-09-13T02:45:38.970 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:38.199+0000 7faef5ffb640 1 --2- 172.21.15.89:0/1290806012 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7faeec0394e0 0x7faeec03b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:45:38.970 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:38.199+0000 7faef5ffb640 1 -- 172.21.15.89:0/1290806012 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7faef006c9e0 con 0x7faf00078b00 2024-09-13T02:45:38.970 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:38.200+0000 7faf073c7640 1 -- 172.21.15.89:0/1290806012 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf00101510 con 0x7faf00078b00 2024-09-13T02:45:38.970 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:38.200+0000 7faf04962640 1 --2- 172.21.15.89:0/1290806012 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7faeec0394e0 0x7faeec03b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:45:38.970 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:38.200+0000 7faf04962640 1 --2- 172.21.15.89:0/1290806012 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7faeec0394e0 0x7faeec03b990 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7faefc006fd0 tx=0x7faefc006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:45:38.970 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:38.204+0000 7faef5ffb640 1 -- 172.21.15.89:0/1290806012 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7faef0037030 con 0x7faf00078b00 2024-09-13T02:45:38.970 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:38.363+0000 7faf073c7640 1 -- 172.21.15.89:0/1290806012 --> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7faf000febb0 con 0x7faeec0394e0 2024-09-13T02:45:38.970 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:38.363+0000 7faef5ffb640 1 -- 172.21.15.89:0/1290806012 <== mgr.14116 v2:172.21.15.89:6800/702640100 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7faf000febb0 con 0x7faeec0394e0 2024-09-13T02:45:38.970 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:38.366+0000 7faf073c7640 1 -- 172.21.15.89:0/1290806012 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7faeec0394e0 msgr2=0x7faeec03b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:38.970 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:38.366+0000 7faf073c7640 1 --2- 172.21.15.89:0/1290806012 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7faeec0394e0 0x7faeec03b990 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7faefc006fd0 tx=0x7faefc006db0 comp rx=0 tx=0).stop 2024-09-13T02:45:38.970 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:38.366+0000 7faf073c7640 1 -- 172.21.15.89:0/1290806012 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf00078b00 msgr2=0x7faf00112fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:38.970 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:38.366+0000 7faf073c7640 1 --2- 172.21.15.89:0/1290806012 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf00078b00 0x7faf00112fa0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7faef0006f00 tx=0x7faef0008040 comp rx=0 tx=0).stop 2024-09-13T02:45:38.970 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:38.366+0000 7faf073c7640 1 -- 172.21.15.89:0/1290806012 shutdown_connections 2024-09-13T02:45:38.971 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:38.366+0000 7faf073c7640 1 --2- 172.21.15.89:0/1290806012 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7faeec0394e0 0x7faeec03b990 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:38.971 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:38.366+0000 7faf073c7640 1 --2- 172.21.15.89:0/1290806012 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faf00078b00 0x7faf00112fa0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:38.971 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:38.366+0000 7faf073c7640 1 -- 172.21.15.89:0/1290806012 >> 172.21.15.89:0/1290806012 conn(0x7faf000fd850 msgr2=0x7faf000fe460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:45:38.971 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:38.366+0000 7faf073c7640 1 -- 172.21.15.89:0/1290806012 shutdown_connections 2024-09-13T02:45:38.971 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:38.366+0000 7faf073c7640 1 -- 172.21.15.89:0/1290806012 wait complete. 2024-09-13T02:45:38.971 INFO:teuthology.orchestra.run.smithi089.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-13T02:45:38.971 INFO:teuthology.orchestra.run.smithi089.stdout:Adding key to root@localhost authorized_keys... 2024-09-13T02:45:38.973 INFO:teuthology.orchestra.run.smithi089.stdout:Adding host smithi089... 2024-09-13T02:45:39.531 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:39 smithi089 ceph-mon[27639]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:45:40.573 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:40 smithi089 ceph-mon[27639]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi089", "addr": "172.21.15.89", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:45:41.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:41 smithi089 ceph-mon[27639]: Deploying cephadm binary to smithi089 2024-09-13T02:45:42.826 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout Added host 'smithi089' with addr '172.21.15.89' 2024-09-13T02:45:42.826 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:39.357+0000 7fc4c571f640 1 Processor -- start 2024-09-13T02:45:42.826 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:39.357+0000 7fc4c571f640 1 -- start start 2024-09-13T02:45:42.826 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:39.358+0000 7fc4c571f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4c0076b30 0x7fc4c0104bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:45:42.826 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:39.358+0000 7fc4c571f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c0076f40 con 0x7fc4c0076b30 2024-09-13T02:45:42.827 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:39.358+0000 7fc4beffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4c0076b30 0x7fc4c0104bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:45:42.827 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:39.358+0000 7fc4beffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4c0076b30 0x7fc4c0104bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:53334/0 (socket says 172.21.15.89:53334) 2024-09-13T02:45:42.827 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:39.358+0000 7fc4beffd640 1 -- 172.21.15.89:0/1659580418 learned_addr learned my addr 172.21.15.89:0/1659580418 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:45:42.827 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:39.358+0000 7fc4beffd640 1 -- 172.21.15.89:0/1659580418 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4c0105100 con 0x7fc4c0076b30 2024-09-13T02:45:42.827 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:39.359+0000 7fc4beffd640 1 --2- 172.21.15.89:0/1659580418 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4c0076b30 0x7fc4c0104bc0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc4b0009840 tx=0x7fc4b00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e17c2e13b97c825 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:45:42.827 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:39.359+0000 7fc4bdffb640 1 -- 172.21.15.89:0/1659580418 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc4b0032440 con 0x7fc4c0076b30 2024-09-13T02:45:42.827 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:39.359+0000 7fc4bdffb640 1 -- 172.21.15.89:0/1659580418 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fc4b0032a00 con 0x7fc4c0076b30 2024-09-13T02:45:42.827 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:39.359+0000 7fc4bdffb640 1 -- 172.21.15.89:0/1659580418 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc4b0031a10 con 0x7fc4c0076b30 2024-09-13T02:45:42.827 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:39.359+0000 7fc4c571f640 1 -- 172.21.15.89:0/1659580418 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4c0076b30 msgr2=0x7fc4c0104bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:42.827 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:39.359+0000 7fc4c571f640 1 --2- 172.21.15.89:0/1659580418 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4c0076b30 0x7fc4c0104bc0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc4b0009840 tx=0x7fc4b00091d0 comp rx=0 tx=0).stop 2024-09-13T02:45:42.827 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:39.359+0000 7fc4c571f640 1 -- 172.21.15.89:0/1659580418 shutdown_connections 2024-09-13T02:45:42.827 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:39.359+0000 7fc4c571f640 1 --2- 172.21.15.89:0/1659580418 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4c0076b30 0x7fc4c0104bc0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:42.827 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:39.359+0000 7fc4c571f640 1 -- 172.21.15.89:0/1659580418 >> 172.21.15.89:0/1659580418 conn(0x7fc4c00fc6d0 msgr2=0x7fc4c00feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:45:42.828 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:39.360+0000 7fc4c571f640 1 -- 172.21.15.89:0/1659580418 shutdown_connections 2024-09-13T02:45:42.828 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:39.360+0000 7fc4c571f640 1 -- 172.21.15.89:0/1659580418 wait complete. 2024-09-13T02:45:42.828 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:39.360+0000 7fc4c571f640 1 Processor -- start 2024-09-13T02:45:42.828 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:39.360+0000 7fc4c571f640 1 -- start start 2024-09-13T02:45:42.828 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:39.360+0000 7fc4c571f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4c0076b30 0x7fc4c0110e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:45:42.828 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:39.360+0000 7fc4c571f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4c0111340 con 0x7fc4c0076b30 2024-09-13T02:45:42.828 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:39.360+0000 7fc4beffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4c0076b30 0x7fc4c0110e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:45:42.828 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:39.361+0000 7fc4beffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4c0076b30 0x7fc4c0110e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:53344/0 (socket says 172.21.15.89:53344) 2024-09-13T02:45:42.828 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:39.361+0000 7fc4beffd640 1 -- 172.21.15.89:0/3933808598 learned_addr learned my addr 172.21.15.89:0/3933808598 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:45:42.828 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:39.361+0000 7fc4beffd640 1 -- 172.21.15.89:0/3933808598 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4b0009450 con 0x7fc4c0076b30 2024-09-13T02:45:42.828 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:39.361+0000 7fc4beffd640 1 --2- 172.21.15.89:0/3933808598 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4c0076b30 0x7fc4c0110e00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc4b0006a70 tx=0x7fc4b002c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:45:42.829 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:39.361+0000 7fc4b77fe640 1 -- 172.21.15.89:0/3933808598 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc4b0031d10 con 0x7fc4c0076b30 2024-09-13T02:45:42.829 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:39.361+0000 7fc4b77fe640 1 -- 172.21.15.89:0/3933808598 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fc4b0031e70 con 0x7fc4c0076b30 2024-09-13T02:45:42.829 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:39.361+0000 7fc4c571f640 1 -- 172.21.15.89:0/3933808598 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4c0111540 con 0x7fc4c0076b30 2024-09-13T02:45:42.829 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:39.361+0000 7fc4b77fe640 1 -- 172.21.15.89:0/3933808598 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc4b003b6f0 con 0x7fc4c0076b30 2024-09-13T02:45:42.829 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:39.361+0000 7fc4c571f640 1 -- 172.21.15.89:0/3933808598 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4c0111f90 con 0x7fc4c0076b30 2024-09-13T02:45:42.829 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:39.362+0000 7fc4b77fe640 1 -- 172.21.15.89:0/3933808598 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7fc4b0039070 con 0x7fc4c0076b30 2024-09-13T02:45:42.829 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:39.362+0000 7fc4c571f640 1 -- 172.21.15.89:0/3933808598 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4c01002f0 con 0x7fc4c0076b30 2024-09-13T02:45:42.829 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:39.362+0000 7fc4b77fe640 1 --2- 172.21.15.89:0/3933808598 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7fc4ac039490 0x7fc4ac03b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:45:42.829 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:39.362+0000 7fc4b77fe640 1 -- 172.21.15.89:0/3933808598 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fc4b006cfd0 con 0x7fc4c0076b30 2024-09-13T02:45:42.829 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:39.362+0000 7fc4be7fc640 1 --2- 172.21.15.89:0/3933808598 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7fc4ac039490 0x7fc4ac03b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:45:42.829 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:39.363+0000 7fc4be7fc640 1 --2- 172.21.15.89:0/3933808598 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7fc4ac039490 0x7fc4ac03b940 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc4a8006fd0 tx=0x7fc4a8006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:45:42.830 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:39.367+0000 7fc4b77fe640 1 -- 172.21.15.89:0/3933808598 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fc4b0045540 con 0x7fc4c0076b30 2024-09-13T02:45:42.830 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:39.529+0000 7fc4c571f640 1 -- 172.21.15.89:0/3933808598 --> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi089", "addr": "172.21.15.89", "target": ["mon-mgr", ""]}) v1 -- 0x7fc4c00fdb70 con 0x7fc4ac039490 2024-09-13T02:45:42.830 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:42.240+0000 7fc4b77fe640 1 -- 172.21.15.89:0/3933808598 <== mgr.14116 v2:172.21.15.89:6800/702640100 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+48 (secure 0 0 0) 0x7fc4c00fdb70 con 0x7fc4ac039490 2024-09-13T02:45:42.830 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:42.243+0000 7fc4c571f640 1 -- 172.21.15.89:0/3933808598 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7fc4ac039490 msgr2=0x7fc4ac03b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:42.830 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:42.243+0000 7fc4c571f640 1 --2- 172.21.15.89:0/3933808598 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7fc4ac039490 0x7fc4ac03b940 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fc4a8006fd0 tx=0x7fc4a8006db0 comp rx=0 tx=0).stop 2024-09-13T02:45:42.831 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:42.243+0000 7fc4c571f640 1 -- 172.21.15.89:0/3933808598 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4c0076b30 msgr2=0x7fc4c0110e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:42.831 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:42.243+0000 7fc4c571f640 1 --2- 172.21.15.89:0/3933808598 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4c0076b30 0x7fc4c0110e00 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fc4b0006a70 tx=0x7fc4b002c040 comp rx=0 tx=0).stop 2024-09-13T02:45:42.831 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:42.243+0000 7fc4c571f640 1 -- 172.21.15.89:0/3933808598 shutdown_connections 2024-09-13T02:45:42.831 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:42.243+0000 7fc4c571f640 1 --2- 172.21.15.89:0/3933808598 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7fc4ac039490 0x7fc4ac03b940 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:42.831 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:42.243+0000 7fc4c571f640 1 --2- 172.21.15.89:0/3933808598 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4c0076b30 0x7fc4c0110e00 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:42.831 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:42.243+0000 7fc4c571f640 1 -- 172.21.15.89:0/3933808598 >> 172.21.15.89:0/3933808598 conn(0x7fc4c00fc6d0 msgr2=0x7fc4c00fd380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:45:42.832 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:42.243+0000 7fc4c571f640 1 -- 172.21.15.89:0/3933808598 shutdown_connections 2024-09-13T02:45:42.832 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:42.243+0000 7fc4c571f640 1 -- 172.21.15.89:0/3933808598 wait complete. 2024-09-13T02:45:42.832 INFO:teuthology.orchestra.run.smithi089.stdout:Deploying mon service with default placement... 2024-09-13T02:45:43.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:43 smithi089 ceph-mon[27639]: from='mgr.14116 172.21.15.89:0/1844139609' entity='mgr.smithi089.guohvs' 2024-09-13T02:45:43.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:43 smithi089 ceph-mon[27639]: Added host smithi089 2024-09-13T02:45:43.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:43 smithi089 ceph-mon[27639]: from='mgr.14116 172.21.15.89:0/1844139609' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:45:44.226 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-13T02:45:44.227 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:43.193+0000 7fd3fb319640 1 Processor -- start 2024-09-13T02:45:44.227 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:43.194+0000 7fd3fb319640 1 -- start start 2024-09-13T02:45:44.227 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:43.194+0000 7fd3fb319640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3f4101f90 0x7fd3f41023a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:45:44.227 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:43.194+0000 7fd3fb319640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f41028e0 con 0x7fd3f4101f90 2024-09-13T02:45:44.227 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:43.194+0000 7fd3f90b5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3f4101f90 0x7fd3f41023a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:45:44.227 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:43.194+0000 7fd3f90b5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3f4101f90 0x7fd3f41023a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:45142/0 (socket says 172.21.15.89:45142) 2024-09-13T02:45:44.227 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:43.194+0000 7fd3f90b5640 1 -- 172.21.15.89:0/4174936707 learned_addr learned my addr 172.21.15.89:0/4174936707 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:45:44.227 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:43.194+0000 7fd3f90b5640 1 -- 172.21.15.89:0/4174936707 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3f4102a20 con 0x7fd3f4101f90 2024-09-13T02:45:44.227 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:43.195+0000 7fd3f90b5640 1 --2- 172.21.15.89:0/4174936707 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3f4101f90 0x7fd3f41023a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd3e8009840 tx=0x7fd3e80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f9c6718ebf9635e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:45:44.227 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:43.195+0000 7fd3e7fff640 1 -- 172.21.15.89:0/4174936707 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd3e8032440 con 0x7fd3f4101f90 2024-09-13T02:45:44.227 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:43.195+0000 7fd3e7fff640 1 -- 172.21.15.89:0/4174936707 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fd3e8032a00 con 0x7fd3f4101f90 2024-09-13T02:45:44.227 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:43.195+0000 7fd3e7fff640 1 -- 172.21.15.89:0/4174936707 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd3e80319e0 con 0x7fd3f4101f90 2024-09-13T02:45:44.227 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:43.196+0000 7fd3fb319640 1 -- 172.21.15.89:0/4174936707 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3f4101f90 msgr2=0x7fd3f41023a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:44.228 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:43.196+0000 7fd3fb319640 1 --2- 172.21.15.89:0/4174936707 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3f4101f90 0x7fd3f41023a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fd3e8009840 tx=0x7fd3e80091d0 comp rx=0 tx=0).stop 2024-09-13T02:45:44.228 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:43.196+0000 7fd3fb319640 1 -- 172.21.15.89:0/4174936707 shutdown_connections 2024-09-13T02:45:44.228 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:43.196+0000 7fd3fb319640 1 --2- 172.21.15.89:0/4174936707 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3f4101f90 0x7fd3f41023a0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:44.228 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:43.196+0000 7fd3fb319640 1 -- 172.21.15.89:0/4174936707 >> 172.21.15.89:0/4174936707 conn(0x7fd3f40fd710 msgr2=0x7fd3f40ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:45:44.228 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:43.196+0000 7fd3fb319640 1 -- 172.21.15.89:0/4174936707 shutdown_connections 2024-09-13T02:45:44.228 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:43.196+0000 7fd3fb319640 1 -- 172.21.15.89:0/4174936707 wait complete. 2024-09-13T02:45:44.228 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:43.196+0000 7fd3fb319640 1 Processor -- start 2024-09-13T02:45:44.228 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:43.196+0000 7fd3fb319640 1 -- start start 2024-09-13T02:45:44.228 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:43.197+0000 7fd3fb319640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3f4101f90 0x7fd3f4110ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:45:44.228 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:43.197+0000 7fd3fb319640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3f4111220 con 0x7fd3f4101f90 2024-09-13T02:45:44.228 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:43.197+0000 7fd3f90b5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3f4101f90 0x7fd3f4110ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:45:44.228 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:43.197+0000 7fd3f90b5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3f4101f90 0x7fd3f4110ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:45146/0 (socket says 172.21.15.89:45146) 2024-09-13T02:45:44.228 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:43.197+0000 7fd3f90b5640 1 -- 172.21.15.89:0/3321987296 learned_addr learned my addr 172.21.15.89:0/3321987296 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:45:44.229 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:43.197+0000 7fd3f90b5640 1 -- 172.21.15.89:0/3321987296 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3e8009450 con 0x7fd3f4101f90 2024-09-13T02:45:44.229 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:43.197+0000 7fd3f90b5640 1 --2- 172.21.15.89:0/3321987296 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3f4101f90 0x7fd3f4110ce0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd3e8000c00 tx=0x7fd3e8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:45:44.229 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:43.197+0000 7fd3e5ffb640 1 -- 172.21.15.89:0/3321987296 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd3e803d450 con 0x7fd3f4101f90 2024-09-13T02:45:44.229 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:43.197+0000 7fd3fb319640 1 -- 172.21.15.89:0/3321987296 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3f4111420 con 0x7fd3f4101f90 2024-09-13T02:45:44.229 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:43.197+0000 7fd3e5ffb640 1 -- 172.21.15.89:0/3321987296 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fd3e803da10 con 0x7fd3f4101f90 2024-09-13T02:45:44.229 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:43.197+0000 7fd3e5ffb640 1 -- 172.21.15.89:0/3321987296 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd3e803b8e0 con 0x7fd3f4101f90 2024-09-13T02:45:44.229 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:43.197+0000 7fd3fb319640 1 -- 172.21.15.89:0/3321987296 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3f4111890 con 0x7fd3f4101f90 2024-09-13T02:45:44.229 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:43.198+0000 7fd3e5ffb640 1 -- 172.21.15.89:0/3321987296 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7fd3e8039070 con 0x7fd3f4101f90 2024-09-13T02:45:44.229 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:43.198+0000 7fd3e5ffb640 1 --2- 172.21.15.89:0/3321987296 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7fd3e0039490 0x7fd3e003b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:45:44.229 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:43.198+0000 7fd3fb319640 1 -- 172.21.15.89:0/3321987296 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3f4111890 con 0x7fd3f4101f90 2024-09-13T02:45:44.229 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:43.199+0000 7fd3e5ffb640 1 -- 172.21.15.89:0/3321987296 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fd3e806d230 con 0x7fd3f4101f90 2024-09-13T02:45:44.229 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:43.199+0000 7fd3f88b4640 1 --2- 172.21.15.89:0/3321987296 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7fd3e0039490 0x7fd3e003b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:45:44.229 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:43.199+0000 7fd3f88b4640 1 --2- 172.21.15.89:0/3321987296 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7fd3e0039490 0x7fd3e003b940 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd3f0006fd0 tx=0x7fd3f0006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:45:44.229 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:43.203+0000 7fd3e5ffb640 1 -- 172.21.15.89:0/3321987296 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fd3f4111890 con 0x7fd3f4101f90 2024-09-13T02:45:44.230 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:43.373+0000 7fd3fb319640 1 -- 172.21.15.89:0/3321987296 --> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}) v1 -- 0x7fd3f4111890 con 0x7fd3e0039490 2024-09-13T02:45:44.230 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:43.378+0000 7fd3e5ffb640 1 -- 172.21.15.89:0/3321987296 <== mgr.14116 v2:172.21.15.89:6800/702640100 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fd3f4111890 con 0x7fd3e0039490 2024-09-13T02:45:44.230 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:43.380+0000 7fd3fb319640 1 -- 172.21.15.89:0/3321987296 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7fd3e0039490 msgr2=0x7fd3e003b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:44.230 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:43.380+0000 7fd3fb319640 1 --2- 172.21.15.89:0/3321987296 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7fd3e0039490 0x7fd3e003b940 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fd3f0006fd0 tx=0x7fd3f0006db0 comp rx=0 tx=0).stop 2024-09-13T02:45:44.230 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:43.380+0000 7fd3fb319640 1 -- 172.21.15.89:0/3321987296 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3f4101f90 msgr2=0x7fd3f4110ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:44.230 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:43.380+0000 7fd3fb319640 1 --2- 172.21.15.89:0/3321987296 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3f4101f90 0x7fd3f4110ce0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd3e8000c00 tx=0x7fd3e8008040 comp rx=0 tx=0).stop 2024-09-13T02:45:44.230 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:43.380+0000 7fd3fb319640 1 -- 172.21.15.89:0/3321987296 shutdown_connections 2024-09-13T02:45:44.230 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:43.380+0000 7fd3fb319640 1 --2- 172.21.15.89:0/3321987296 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7fd3e0039490 0x7fd3e003b940 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:44.230 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:43.380+0000 7fd3fb319640 1 --2- 172.21.15.89:0/3321987296 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd3f4101f90 0x7fd3f4110ce0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:44.230 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:43.380+0000 7fd3fb319640 1 -- 172.21.15.89:0/3321987296 >> 172.21.15.89:0/3321987296 conn(0x7fd3f40fd710 msgr2=0x7fd3f40fe260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:45:44.230 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:43.380+0000 7fd3fb319640 1 -- 172.21.15.89:0/3321987296 shutdown_connections 2024-09-13T02:45:44.230 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:43.380+0000 7fd3fb319640 1 -- 172.21.15.89:0/3321987296 wait complete. 2024-09-13T02:45:44.230 INFO:teuthology.orchestra.run.smithi089.stdout:Deploying mgr service with default placement... 2024-09-13T02:45:44.505 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:44 smithi089 ceph-mon[27639]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:45:44.505 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:44 smithi089 ceph-mon[27639]: Saving service mon spec with placement count:5 2024-09-13T02:45:44.505 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:44 smithi089 ceph-mon[27639]: from='mgr.14116 172.21.15.89:0/1844139609' entity='mgr.smithi089.guohvs' 2024-09-13T02:45:46.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:45 smithi089 ceph-mon[27639]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:45:46.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:45 smithi089 ceph-mon[27639]: Saving service mgr spec with placement count:2 2024-09-13T02:45:46.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:45 smithi089 ceph-mon[27639]: from='mgr.14116 172.21.15.89:0/1844139609' entity='mgr.smithi089.guohvs' 2024-09-13T02:45:46.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:45 smithi089 ceph-mon[27639]: from='mgr.14116 172.21.15.89:0/1844139609' entity='mgr.smithi089.guohvs' 2024-09-13T02:45:46.067 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-13T02:45:46.067 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:44.578+0000 7fb286aad640 1 Processor -- start 2024-09-13T02:45:46.067 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:44.578+0000 7fb286aad640 1 -- start start 2024-09-13T02:45:46.068 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:44.578+0000 7fb286aad640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb280076b10 0x7fb280104be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:45:46.068 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:44.578+0000 7fb286aad640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb280076f20 con 0x7fb280076b10 2024-09-13T02:45:46.068 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:44.578+0000 7fb284849640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb280076b10 0x7fb280104be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:45:46.068 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:44.578+0000 7fb284849640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb280076b10 0x7fb280104be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:45156/0 (socket says 172.21.15.89:45156) 2024-09-13T02:45:46.069 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:44.578+0000 7fb284849640 1 -- 172.21.15.89:0/1074476828 learned_addr learned my addr 172.21.15.89:0/1074476828 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:45:46.069 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:44.579+0000 7fb284849640 1 -- 172.21.15.89:0/1074476828 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb280105120 con 0x7fb280076b10 2024-09-13T02:45:46.069 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:44.579+0000 7fb284849640 1 --2- 172.21.15.89:0/1074476828 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb280076b10 0x7fb280104be0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb274009840 tx=0x7fb2740091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ed0e0d6ab711f8a server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:45:46.069 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:44.580+0000 7fb27f7fe640 1 -- 172.21.15.89:0/1074476828 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb274032440 con 0x7fb280076b10 2024-09-13T02:45:46.069 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:44.580+0000 7fb27f7fe640 1 -- 172.21.15.89:0/1074476828 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fb274032a00 con 0x7fb280076b10 2024-09-13T02:45:46.069 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:44.580+0000 7fb27f7fe640 1 -- 172.21.15.89:0/1074476828 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb274031a10 con 0x7fb280076b10 2024-09-13T02:45:46.069 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:44.580+0000 7fb286aad640 1 -- 172.21.15.89:0/1074476828 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb280076b10 msgr2=0x7fb280104be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:46.069 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:44.580+0000 7fb286aad640 1 --2- 172.21.15.89:0/1074476828 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb280076b10 0x7fb280104be0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb274009840 tx=0x7fb2740091d0 comp rx=0 tx=0).stop 2024-09-13T02:45:46.069 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:44.580+0000 7fb286aad640 1 -- 172.21.15.89:0/1074476828 shutdown_connections 2024-09-13T02:45:46.069 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:44.580+0000 7fb286aad640 1 --2- 172.21.15.89:0/1074476828 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb280076b10 0x7fb280104be0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:46.070 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:44.580+0000 7fb286aad640 1 -- 172.21.15.89:0/1074476828 >> 172.21.15.89:0/1074476828 conn(0x7fb2800fc6d0 msgr2=0x7fb2800feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:45:46.070 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:44.580+0000 7fb286aad640 1 -- 172.21.15.89:0/1074476828 shutdown_connections 2024-09-13T02:45:46.070 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:44.580+0000 7fb286aad640 1 -- 172.21.15.89:0/1074476828 wait complete. 2024-09-13T02:45:46.070 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:44.581+0000 7fb286aad640 1 Processor -- start 2024-09-13T02:45:46.070 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:44.581+0000 7fb286aad640 1 -- start start 2024-09-13T02:45:46.070 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:44.581+0000 7fb286aad640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb280076b10 0x7fb280110df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:45:46.070 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:44.581+0000 7fb286aad640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb280111330 con 0x7fb280076b10 2024-09-13T02:45:46.070 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:44.581+0000 7fb284849640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb280076b10 0x7fb280110df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:45:46.070 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:44.581+0000 7fb284849640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb280076b10 0x7fb280110df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:45170/0 (socket says 172.21.15.89:45170) 2024-09-13T02:45:46.070 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:44.581+0000 7fb284849640 1 -- 172.21.15.89:0/597870973 learned_addr learned my addr 172.21.15.89:0/597870973 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:45:46.070 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:44.581+0000 7fb284849640 1 -- 172.21.15.89:0/597870973 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb274009450 con 0x7fb280076b10 2024-09-13T02:45:46.070 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:44.582+0000 7fb284849640 1 --2- 172.21.15.89:0/597870973 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb280076b10 0x7fb280110df0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb274006a70 tx=0x7fb27402c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:45:46.070 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:44.582+0000 7fb27d7fa640 1 -- 172.21.15.89:0/597870973 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb274031d10 con 0x7fb280076b10 2024-09-13T02:45:46.070 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:44.582+0000 7fb27d7fa640 1 -- 172.21.15.89:0/597870973 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1005+0+0 (secure 0 0 0) 0x7fb274031e70 con 0x7fb280076b10 2024-09-13T02:45:46.071 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:44.582+0000 7fb286aad640 1 -- 172.21.15.89:0/597870973 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb280111530 con 0x7fb280076b10 2024-09-13T02:45:46.071 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:44.582+0000 7fb27d7fa640 1 -- 172.21.15.89:0/597870973 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb27403b6f0 con 0x7fb280076b10 2024-09-13T02:45:46.071 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:44.582+0000 7fb286aad640 1 -- 172.21.15.89:0/597870973 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb280111f80 con 0x7fb280076b10 2024-09-13T02:45:46.071 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:44.583+0000 7fb27d7fa640 1 -- 172.21.15.89:0/597870973 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7fb274039070 con 0x7fb280076b10 2024-09-13T02:45:46.071 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:44.583+0000 7fb27d7fa640 1 --2- 172.21.15.89:0/597870973 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7fb2700394e0 0x7fb27003b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:45:46.071 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:44.583+0000 7fb286aad640 1 -- 172.21.15.89:0/597870973 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2801002f0 con 0x7fb280076b10 2024-09-13T02:45:46.071 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:44.583+0000 7fb27d7fa640 1 -- 172.21.15.89:0/597870973 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fb27406cd40 con 0x7fb280076b10 2024-09-13T02:45:46.071 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:44.583+0000 7fb27ffff640 1 --2- 172.21.15.89:0/597870973 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7fb2700394e0 0x7fb27003b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:45:46.071 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:44.583+0000 7fb27ffff640 1 --2- 172.21.15.89:0/597870973 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7fb2700394e0 0x7fb27003b990 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb26c006fd0 tx=0x7fb26c006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:45:46.071 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:44.587+0000 7fb27d7fa640 1 -- 172.21.15.89:0/597870973 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fb274037070 con 0x7fb280076b10 2024-09-13T02:45:46.071 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:44.757+0000 7fb286aad640 1 -- 172.21.15.89:0/597870973 --> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7fb2800fdbe0 con 0x7fb2700394e0 2024-09-13T02:45:46.071 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:44.765+0000 7fb27d7fa640 1 -- 172.21.15.89:0/597870973 <== mgr.14116 v2:172.21.15.89:6800/702640100 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fb2800fdbe0 con 0x7fb2700394e0 2024-09-13T02:45:46.072 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:44.766+0000 7fb286aad640 1 -- 172.21.15.89:0/597870973 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7fb2700394e0 msgr2=0x7fb27003b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:46.072 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:44.766+0000 7fb286aad640 1 --2- 172.21.15.89:0/597870973 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7fb2700394e0 0x7fb27003b990 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fb26c006fd0 tx=0x7fb26c006db0 comp rx=0 tx=0).stop 2024-09-13T02:45:46.072 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:44.766+0000 7fb286aad640 1 -- 172.21.15.89:0/597870973 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb280076b10 msgr2=0x7fb280110df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:46.072 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:44.766+0000 7fb286aad640 1 --2- 172.21.15.89:0/597870973 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb280076b10 0x7fb280110df0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fb274006a70 tx=0x7fb27402c040 comp rx=0 tx=0).stop 2024-09-13T02:45:46.072 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:44.767+0000 7fb286aad640 1 -- 172.21.15.89:0/597870973 shutdown_connections 2024-09-13T02:45:46.072 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:44.767+0000 7fb286aad640 1 --2- 172.21.15.89:0/597870973 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7fb2700394e0 0x7fb27003b990 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:46.072 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:44.767+0000 7fb286aad640 1 --2- 172.21.15.89:0/597870973 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb280076b10 0x7fb280110df0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:46.072 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:44.767+0000 7fb286aad640 1 -- 172.21.15.89:0/597870973 >> 172.21.15.89:0/597870973 conn(0x7fb2800fc6d0 msgr2=0x7fb2800fd410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:45:46.072 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:44.767+0000 7fb286aad640 1 -- 172.21.15.89:0/597870973 shutdown_connections 2024-09-13T02:45:46.072 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:44.767+0000 7fb286aad640 1 -- 172.21.15.89:0/597870973 wait complete. 2024-09-13T02:45:46.073 INFO:teuthology.orchestra.run.smithi089.stdout:Deploying crash service with default placement... 2024-09-13T02:45:47.163 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout Scheduled crash update... 2024-09-13T02:45:47.164 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:46.423+0000 7f1991171640 1 Processor -- start 2024-09-13T02:45:47.164 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:46.423+0000 7f1991171640 1 -- start start 2024-09-13T02:45:47.164 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:46.423+0000 7f1991171640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f198c101f90 0x7f198c1023a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:45:47.164 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:46.423+0000 7f1991171640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f198c1028e0 con 0x7f198c101f90 2024-09-13T02:45:47.164 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:46.424+0000 7f198ad9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f198c101f90 0x7f198c1023a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:45:47.164 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:46.424+0000 7f198ad9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f198c101f90 0x7f198c1023a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:45184/0 (socket says 172.21.15.89:45184) 2024-09-13T02:45:47.164 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:46.424+0000 7f198ad9d640 1 -- 172.21.15.89:0/3717956119 learned_addr learned my addr 172.21.15.89:0/3717956119 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:45:47.164 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:46.424+0000 7f198ad9d640 1 -- 172.21.15.89:0/3717956119 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f198c102a20 con 0x7f198c101f90 2024-09-13T02:45:47.164 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:46.424+0000 7f198ad9d640 1 --2- 172.21.15.89:0/3717956119 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f198c101f90 0x7f198c1023a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f197c009840 tx=0x7f197c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ceaa7886f8fa645 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:45:47.164 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:46.425+0000 7f1989d9b640 1 -- 172.21.15.89:0/3717956119 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f197c032440 con 0x7f198c101f90 2024-09-13T02:45:47.165 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:46.425+0000 7f1989d9b640 1 -- 172.21.15.89:0/3717956119 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f197c032a40 con 0x7f198c101f90 2024-09-13T02:45:47.165 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:46.425+0000 7f1989d9b640 1 -- 172.21.15.89:0/3717956119 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f197c031a70 con 0x7f198c101f90 2024-09-13T02:45:47.165 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:46.425+0000 7f1991171640 1 -- 172.21.15.89:0/3717956119 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f198c101f90 msgr2=0x7f198c1023a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:47.165 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:46.425+0000 7f1991171640 1 --2- 172.21.15.89:0/3717956119 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f198c101f90 0x7f198c1023a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f197c009840 tx=0x7f197c0091d0 comp rx=0 tx=0).stop 2024-09-13T02:45:47.165 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:46.425+0000 7f1991171640 1 -- 172.21.15.89:0/3717956119 shutdown_connections 2024-09-13T02:45:47.165 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:46.425+0000 7f1991171640 1 --2- 172.21.15.89:0/3717956119 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f198c101f90 0x7f198c1023a0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:47.165 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:46.425+0000 7f1991171640 1 -- 172.21.15.89:0/3717956119 >> 172.21.15.89:0/3717956119 conn(0x7f198c0fd710 msgr2=0x7f198c0ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:45:47.165 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:46.425+0000 7f1991171640 1 -- 172.21.15.89:0/3717956119 shutdown_connections 2024-09-13T02:45:47.165 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:46.425+0000 7f1991171640 1 -- 172.21.15.89:0/3717956119 wait complete. 2024-09-13T02:45:47.165 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:46.426+0000 7f1991171640 1 Processor -- start 2024-09-13T02:45:47.165 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:46.426+0000 7f1991171640 1 -- start start 2024-09-13T02:45:47.165 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:46.426+0000 7f1991171640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f198c101f90 0x7f198c110d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:45:47.165 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:46.426+0000 7f1991171640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f198c111260 con 0x7f198c101f90 2024-09-13T02:45:47.166 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:46.426+0000 7f198ad9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f198c101f90 0x7f198c110d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:45:47.166 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:46.426+0000 7f198ad9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f198c101f90 0x7f198c110d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:45188/0 (socket says 172.21.15.89:45188) 2024-09-13T02:45:47.166 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:46.426+0000 7f198ad9d640 1 -- 172.21.15.89:0/4015602157 learned_addr learned my addr 172.21.15.89:0/4015602157 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:45:47.166 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:46.427+0000 7f198ad9d640 1 -- 172.21.15.89:0/4015602157 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f197c009450 con 0x7f198c101f90 2024-09-13T02:45:47.166 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:46.427+0000 7f198ad9d640 1 --2- 172.21.15.89:0/4015602157 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f198c101f90 0x7f198c110d20 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f197c009810 tx=0x7f197c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:45:47.166 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:46.427+0000 7f19737fe640 1 -- 172.21.15.89:0/4015602157 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f197c03c400 con 0x7f198c101f90 2024-09-13T02:45:47.166 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:46.427+0000 7f19737fe640 1 -- 172.21.15.89:0/4015602157 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f197c03ca00 con 0x7f198c101f90 2024-09-13T02:45:47.166 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:46.427+0000 7f1991171640 1 -- 172.21.15.89:0/4015602157 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f198c111460 con 0x7f198c101f90 2024-09-13T02:45:47.166 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:46.427+0000 7f19737fe640 1 -- 172.21.15.89:0/4015602157 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f197c03a870 con 0x7f198c101f90 2024-09-13T02:45:47.166 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:46.427+0000 7f1991171640 1 -- 172.21.15.89:0/4015602157 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f198c1118d0 con 0x7f198c101f90 2024-09-13T02:45:47.166 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:46.428+0000 7f19737fe640 1 -- 172.21.15.89:0/4015602157 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f197c03c560 con 0x7f198c101f90 2024-09-13T02:45:47.166 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:46.428+0000 7f1991171640 1 -- 172.21.15.89:0/4015602157 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f198c04b720 con 0x7f198c101f90 2024-09-13T02:45:47.167 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:46.428+0000 7f19737fe640 1 --2- 172.21.15.89:0/4015602157 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7f1974039490 0x7f197403b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:45:47.167 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:46.428+0000 7f19737fe640 1 -- 172.21.15.89:0/4015602157 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f197c06cd60 con 0x7f198c101f90 2024-09-13T02:45:47.167 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:46.428+0000 7f198a59c640 1 --2- 172.21.15.89:0/4015602157 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7f1974039490 0x7f197403b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:45:47.167 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:46.428+0000 7f198a59c640 1 --2- 172.21.15.89:0/4015602157 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7f1974039490 0x7f197403b940 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1980006fd0 tx=0x7f1980006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:45:47.167 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:46.432+0000 7f19737fe640 1 -- 172.21.15.89:0/4015602157 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f197c030ae0 con 0x7f198c101f90 2024-09-13T02:45:47.167 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:46.603+0000 7f1991171640 1 -- 172.21.15.89:0/4015602157 --> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}) v1 -- 0x7f198c1118d0 con 0x7f1974039490 2024-09-13T02:45:47.167 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:46.611+0000 7f19737fe640 1 -- 172.21.15.89:0/4015602157 <== mgr.14116 v2:172.21.15.89:6800/702640100 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7f198c1118d0 con 0x7f1974039490 2024-09-13T02:45:47.167 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:46.613+0000 7f1991171640 1 -- 172.21.15.89:0/4015602157 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7f1974039490 msgr2=0x7f197403b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:47.167 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:46.613+0000 7f1991171640 1 --2- 172.21.15.89:0/4015602157 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7f1974039490 0x7f197403b940 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f1980006fd0 tx=0x7f1980006db0 comp rx=0 tx=0).stop 2024-09-13T02:45:47.167 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:46.613+0000 7f1991171640 1 -- 172.21.15.89:0/4015602157 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f198c101f90 msgr2=0x7f198c110d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:47.168 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:46.613+0000 7f1991171640 1 --2- 172.21.15.89:0/4015602157 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f198c101f90 0x7f198c110d20 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f197c009810 tx=0x7f197c0091d0 comp rx=0 tx=0).stop 2024-09-13T02:45:47.168 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:46.613+0000 7f1991171640 1 -- 172.21.15.89:0/4015602157 shutdown_connections 2024-09-13T02:45:47.168 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:46.613+0000 7f1991171640 1 --2- 172.21.15.89:0/4015602157 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7f1974039490 0x7f197403b940 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:47.168 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:46.613+0000 7f1991171640 1 --2- 172.21.15.89:0/4015602157 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f198c101f90 0x7f198c110d20 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:47.168 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:46.613+0000 7f1991171640 1 -- 172.21.15.89:0/4015602157 >> 172.21.15.89:0/4015602157 conn(0x7f198c0fd710 msgr2=0x7f198c0fe260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:45:47.168 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:46.613+0000 7f1991171640 1 -- 172.21.15.89:0/4015602157 shutdown_connections 2024-09-13T02:45:47.168 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:46.613+0000 7f1991171640 1 -- 172.21.15.89:0/4015602157 wait complete. 2024-09-13T02:45:47.168 INFO:teuthology.orchestra.run.smithi089.stdout:Deploying prometheus service with default placement... 2024-09-13T02:45:47.709 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:47 smithi089 ceph-mon[27639]: from='mgr.14116 172.21.15.89:0/1844139609' entity='mgr.smithi089.guohvs' 2024-09-13T02:45:47.710 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:47 smithi089 ceph-mon[27639]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:45:47.710 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:47 smithi089 ceph-mon[27639]: Saving service crash spec with placement * 2024-09-13T02:45:47.710 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:47 smithi089 ceph-mon[27639]: from='mgr.14116 172.21.15.89:0/1844139609' entity='mgr.smithi089.guohvs' 2024-09-13T02:45:48.354 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout Scheduled prometheus update... 2024-09-13T02:45:48.354 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:47.521+0000 7fb33d3da640 1 Processor -- start 2024-09-13T02:45:48.354 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:47.521+0000 7fb33d3da640 1 -- start start 2024-09-13T02:45:48.354 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:47.522+0000 7fb33d3da640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb338078c30 0x7fb338077250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:45:48.354 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:47.522+0000 7fb33d3da640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb338079040 con 0x7fb338078c30 2024-09-13T02:45:48.354 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:47.522+0000 7fb336ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb338078c30 0x7fb338077250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:45:48.354 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:47.522+0000 7fb336ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb338078c30 0x7fb338077250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:45202/0 (socket says 172.21.15.89:45202) 2024-09-13T02:45:48.354 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:47.522+0000 7fb336ffd640 1 -- 172.21.15.89:0/3773815261 learned_addr learned my addr 172.21.15.89:0/3773815261 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:45:48.354 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:47.522+0000 7fb336ffd640 1 -- 172.21.15.89:0/3773815261 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb338077790 con 0x7fb338078c30 2024-09-13T02:45:48.354 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:47.523+0000 7fb336ffd640 1 --2- 172.21.15.89:0/3773815261 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb338078c30 0x7fb338077250 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb328009e50 tx=0x7fb328009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=779b0ceb6a700181 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:45:48.354 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:47.523+0000 7fb335ffb640 1 -- 172.21.15.89:0/3773815261 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb328031560 con 0x7fb338078c30 2024-09-13T02:45:48.355 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:47.523+0000 7fb335ffb640 1 -- 172.21.15.89:0/3773815261 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb32802d050 con 0x7fb338078c30 2024-09-13T02:45:48.355 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:47.523+0000 7fb335ffb640 1 -- 172.21.15.89:0/3773815261 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb328007a60 con 0x7fb338078c30 2024-09-13T02:45:48.355 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:47.524+0000 7fb33d3da640 1 -- 172.21.15.89:0/3773815261 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb338078c30 msgr2=0x7fb338077250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:48.355 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:47.524+0000 7fb33d3da640 1 --2- 172.21.15.89:0/3773815261 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb338078c30 0x7fb338077250 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fb328009e50 tx=0x7fb328009840 comp rx=0 tx=0).stop 2024-09-13T02:45:48.355 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:47.524+0000 7fb33d3da640 1 -- 172.21.15.89:0/3773815261 shutdown_connections 2024-09-13T02:45:48.355 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:47.524+0000 7fb33d3da640 1 --2- 172.21.15.89:0/3773815261 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb338078c30 0x7fb338077250 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:48.355 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:47.524+0000 7fb33d3da640 1 -- 172.21.15.89:0/3773815261 >> 172.21.15.89:0/3773815261 conn(0x7fb3380fd790 msgr2=0x7fb3380ffc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:45:48.355 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:47.524+0000 7fb33d3da640 1 -- 172.21.15.89:0/3773815261 shutdown_connections 2024-09-13T02:45:48.355 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:47.524+0000 7fb33d3da640 1 -- 172.21.15.89:0/3773815261 wait complete. 2024-09-13T02:45:48.355 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:47.524+0000 7fb33d3da640 1 Processor -- start 2024-09-13T02:45:48.355 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:47.524+0000 7fb33d3da640 1 -- start start 2024-09-13T02:45:48.355 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:47.525+0000 7fb33d3da640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb338078c30 0x7fb338112f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:45:48.355 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:47.525+0000 7fb33d3da640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3381134d0 con 0x7fb338078c30 2024-09-13T02:45:48.356 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:47.525+0000 7fb336ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb338078c30 0x7fb338112f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:45:48.356 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:47.525+0000 7fb336ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb338078c30 0x7fb338112f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:45212/0 (socket says 172.21.15.89:45212) 2024-09-13T02:45:48.356 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:47.525+0000 7fb336ffd640 1 -- 172.21.15.89:0/1891460372 learned_addr learned my addr 172.21.15.89:0/1891460372 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:45:48.356 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:47.525+0000 7fb336ffd640 1 -- 172.21.15.89:0/1891460372 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb328009ae0 con 0x7fb338078c30 2024-09-13T02:45:48.356 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:47.525+0000 7fb336ffd640 1 --2- 172.21.15.89:0/1891460372 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb338078c30 0x7fb338112f90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb328009560 tx=0x7fb328009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:45:48.356 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:47.525+0000 7fb32f7fe640 1 -- 172.21.15.89:0/1891460372 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb32803b410 con 0x7fb338078c30 2024-09-13T02:45:48.356 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:47.525+0000 7fb32f7fe640 1 -- 172.21.15.89:0/1891460372 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb32803ba10 con 0x7fb338078c30 2024-09-13T02:45:48.356 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:47.525+0000 7fb33d3da640 1 -- 172.21.15.89:0/1891460372 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3381136d0 con 0x7fb338078c30 2024-09-13T02:45:48.356 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:47.525+0000 7fb32f7fe640 1 -- 172.21.15.89:0/1891460372 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb3280456b0 con 0x7fb338078c30 2024-09-13T02:45:48.356 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:47.525+0000 7fb33d3da640 1 -- 172.21.15.89:0/1891460372 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb338113b40 con 0x7fb338078c30 2024-09-13T02:45:48.356 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:47.526+0000 7fb32f7fe640 1 -- 172.21.15.89:0/1891460372 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7fb328038050 con 0x7fb338078c30 2024-09-13T02:45:48.356 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:47.526+0000 7fb32f7fe640 1 --2- 172.21.15.89:0/1891460372 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7fb324039490 0x7fb32403b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:45:48.356 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:47.526+0000 7fb32f7fe640 1 -- 172.21.15.89:0/1891460372 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fb32806cdf0 con 0x7fb338078c30 2024-09-13T02:45:48.356 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:47.527+0000 7fb3367fc640 1 --2- 172.21.15.89:0/1891460372 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7fb324039490 0x7fb32403b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:45:48.357 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:47.527+0000 7fb33d3da640 1 -- 172.21.15.89:0/1891460372 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb338101470 con 0x7fb338078c30 2024-09-13T02:45:48.357 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:47.527+0000 7fb3367fc640 1 --2- 172.21.15.89:0/1891460372 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7fb324039490 0x7fb32403b940 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb320006fd0 tx=0x7fb320006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:45:48.357 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:47.531+0000 7fb32f7fe640 1 -- 172.21.15.89:0/1891460372 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fb328041020 con 0x7fb338078c30 2024-09-13T02:45:48.357 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:47.708+0000 7fb33d3da640 1 -- 172.21.15.89:0/1891460372 --> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}) v1 -- 0x7fb3380feb70 con 0x7fb324039490 2024-09-13T02:45:48.357 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:47.712+0000 7fb32f7fe640 1 -- 172.21.15.89:0/1891460372 <== mgr.14116 v2:172.21.15.89:6800/702640100 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+31 (secure 0 0 0) 0x7fb3380feb70 con 0x7fb324039490 2024-09-13T02:45:48.357 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:47.714+0000 7fb33d3da640 1 -- 172.21.15.89:0/1891460372 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7fb324039490 msgr2=0x7fb32403b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:48.357 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:47.714+0000 7fb33d3da640 1 --2- 172.21.15.89:0/1891460372 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7fb324039490 0x7fb32403b940 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb320006fd0 tx=0x7fb320006db0 comp rx=0 tx=0).stop 2024-09-13T02:45:48.357 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:47.714+0000 7fb33d3da640 1 -- 172.21.15.89:0/1891460372 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb338078c30 msgr2=0x7fb338112f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:48.357 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:47.714+0000 7fb33d3da640 1 --2- 172.21.15.89:0/1891460372 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb338078c30 0x7fb338112f90 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fb328009560 tx=0x7fb328009840 comp rx=0 tx=0).stop 2024-09-13T02:45:48.357 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:47.714+0000 7fb33d3da640 1 -- 172.21.15.89:0/1891460372 shutdown_connections 2024-09-13T02:45:48.357 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:47.714+0000 7fb33d3da640 1 --2- 172.21.15.89:0/1891460372 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7fb324039490 0x7fb32403b940 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:48.357 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:47.714+0000 7fb33d3da640 1 --2- 172.21.15.89:0/1891460372 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb338078c30 0x7fb338112f90 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:48.358 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:47.714+0000 7fb33d3da640 1 -- 172.21.15.89:0/1891460372 >> 172.21.15.89:0/1891460372 conn(0x7fb3380fd790 msgr2=0x7fb3380fe3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:45:48.358 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:47.714+0000 7fb33d3da640 1 -- 172.21.15.89:0/1891460372 shutdown_connections 2024-09-13T02:45:48.358 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:47.714+0000 7fb33d3da640 1 -- 172.21.15.89:0/1891460372 wait complete. 2024-09-13T02:45:48.358 INFO:teuthology.orchestra.run.smithi089.stdout:Deploying grafana service with default placement... 2024-09-13T02:45:49.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:48 smithi089 ceph-mon[27639]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:45:49.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:48 smithi089 ceph-mon[27639]: Saving service prometheus spec with placement count:1 2024-09-13T02:45:49.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:48 smithi089 ceph-mon[27639]: from='mgr.14116 172.21.15.89:0/1844139609' entity='mgr.smithi089.guohvs' 2024-09-13T02:45:49.812 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout Scheduled grafana update... 2024-09-13T02:45:49.812 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:48.731+0000 7fac1dc22640 1 Processor -- start 2024-09-13T02:45:49.812 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:48.731+0000 7fac1dc22640 1 -- start start 2024-09-13T02:45:49.812 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:48.731+0000 7fac1dc22640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac18101f90 0x7fac181023a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:45:49.812 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:48.731+0000 7fac1dc22640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac181028e0 con 0x7fac18101f90 2024-09-13T02:45:49.812 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:48.731+0000 7fac177fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac18101f90 0x7fac181023a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:45:49.813 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:48.731+0000 7fac177fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac18101f90 0x7fac181023a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:45220/0 (socket says 172.21.15.89:45220) 2024-09-13T02:45:49.813 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:48.731+0000 7fac177fe640 1 -- 172.21.15.89:0/2330085732 learned_addr learned my addr 172.21.15.89:0/2330085732 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:45:49.813 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:48.731+0000 7fac177fe640 1 -- 172.21.15.89:0/2330085732 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac18102a20 con 0x7fac18101f90 2024-09-13T02:45:49.813 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:48.732+0000 7fac177fe640 1 --2- 172.21.15.89:0/2330085732 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac18101f90 0x7fac181023a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fac08009840 tx=0x7fac080091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16acc00ff4380d89 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:45:49.813 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:48.732+0000 7fac16ffd640 1 -- 172.21.15.89:0/2330085732 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fac08032440 con 0x7fac18101f90 2024-09-13T02:45:49.813 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:48.732+0000 7fac16ffd640 1 -- 172.21.15.89:0/2330085732 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fac08032a40 con 0x7fac18101f90 2024-09-13T02:45:49.813 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:48.732+0000 7fac16ffd640 1 -- 172.21.15.89:0/2330085732 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fac08031a70 con 0x7fac18101f90 2024-09-13T02:45:49.813 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:48.733+0000 7fac1dc22640 1 -- 172.21.15.89:0/2330085732 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac18101f90 msgr2=0x7fac181023a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:49.813 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:48.733+0000 7fac1dc22640 1 --2- 172.21.15.89:0/2330085732 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac18101f90 0x7fac181023a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fac08009840 tx=0x7fac080091d0 comp rx=0 tx=0).stop 2024-09-13T02:45:49.813 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:48.733+0000 7fac1dc22640 1 -- 172.21.15.89:0/2330085732 shutdown_connections 2024-09-13T02:45:49.813 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:48.733+0000 7fac1dc22640 1 --2- 172.21.15.89:0/2330085732 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac18101f90 0x7fac181023a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:49.813 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:48.733+0000 7fac1dc22640 1 -- 172.21.15.89:0/2330085732 >> 172.21.15.89:0/2330085732 conn(0x7fac180fd710 msgr2=0x7fac180ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:45:49.814 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:48.733+0000 7fac1dc22640 1 -- 172.21.15.89:0/2330085732 shutdown_connections 2024-09-13T02:45:49.814 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:48.733+0000 7fac1dc22640 1 -- 172.21.15.89:0/2330085732 wait complete. 2024-09-13T02:45:49.814 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:48.733+0000 7fac1dc22640 1 Processor -- start 2024-09-13T02:45:49.814 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:48.733+0000 7fac1dc22640 1 -- start start 2024-09-13T02:45:49.814 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:48.733+0000 7fac1dc22640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac18101f90 0x7fac18110d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:45:49.814 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:48.733+0000 7fac1dc22640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac18111260 con 0x7fac18101f90 2024-09-13T02:45:49.814 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:48.734+0000 7fac177fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac18101f90 0x7fac18110d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:45:49.814 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:48.734+0000 7fac177fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac18101f90 0x7fac18110d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:45222/0 (socket says 172.21.15.89:45222) 2024-09-13T02:45:49.814 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:48.734+0000 7fac177fe640 1 -- 172.21.15.89:0/4253462010 learned_addr learned my addr 172.21.15.89:0/4253462010 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:45:49.814 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:48.734+0000 7fac177fe640 1 -- 172.21.15.89:0/4253462010 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac08009450 con 0x7fac18101f90 2024-09-13T02:45:49.814 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:48.734+0000 7fac177fe640 1 --2- 172.21.15.89:0/4253462010 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac18101f90 0x7fac18110d20 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fac08009810 tx=0x7fac080091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:45:49.814 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:48.734+0000 7fac14ff9640 1 -- 172.21.15.89:0/4253462010 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fac0803c400 con 0x7fac18101f90 2024-09-13T02:45:49.814 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:48.734+0000 7fac14ff9640 1 -- 172.21.15.89:0/4253462010 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fac0803ca00 con 0x7fac18101f90 2024-09-13T02:45:49.815 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:48.734+0000 7fac1dc22640 1 -- 172.21.15.89:0/4253462010 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac18111460 con 0x7fac18101f90 2024-09-13T02:45:49.815 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:48.734+0000 7fac14ff9640 1 -- 172.21.15.89:0/4253462010 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fac0803a870 con 0x7fac18101f90 2024-09-13T02:45:49.815 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:48.734+0000 7fac1dc22640 1 -- 172.21.15.89:0/4253462010 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac181118d0 con 0x7fac18101f90 2024-09-13T02:45:49.815 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:48.735+0000 7fac14ff9640 1 -- 172.21.15.89:0/4253462010 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7fac0803c560 con 0x7fac18101f90 2024-09-13T02:45:49.815 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:48.735+0000 7fac1dc22640 1 -- 172.21.15.89:0/4253462010 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac1804b720 con 0x7fac18101f90 2024-09-13T02:45:49.815 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:48.735+0000 7fac14ff9640 1 --2- 172.21.15.89:0/4253462010 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7fac040394e0 0x7fac0403b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:45:49.815 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:48.735+0000 7fac14ff9640 1 -- 172.21.15.89:0/4253462010 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fac0806ccf0 con 0x7fac18101f90 2024-09-13T02:45:49.815 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:48.735+0000 7fac0ffff640 1 --2- 172.21.15.89:0/4253462010 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7fac040394e0 0x7fac0403b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:45:49.815 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:48.736+0000 7fac0ffff640 1 --2- 172.21.15.89:0/4253462010 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7fac040394e0 0x7fac0403b990 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fac00006fd0 tx=0x7fac00006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:45:49.815 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:48.739+0000 7fac14ff9640 1 -- 172.21.15.89:0/4253462010 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fac0803cb70 con 0x7fac18101f90 2024-09-13T02:45:49.815 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:48.908+0000 7fac1dc22640 1 -- 172.21.15.89:0/4253462010 --> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}) v1 -- 0x7fac181118d0 con 0x7fac040394e0 2024-09-13T02:45:49.815 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:48.912+0000 7fac14ff9640 1 -- 172.21.15.89:0/4253462010 <== mgr.14116 v2:172.21.15.89:6800/702640100 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7fac181118d0 con 0x7fac040394e0 2024-09-13T02:45:49.815 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:48.914+0000 7fac1dc22640 1 -- 172.21.15.89:0/4253462010 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7fac040394e0 msgr2=0x7fac0403b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:49.816 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:48.914+0000 7fac1dc22640 1 --2- 172.21.15.89:0/4253462010 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7fac040394e0 0x7fac0403b990 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fac00006fd0 tx=0x7fac00006db0 comp rx=0 tx=0).stop 2024-09-13T02:45:49.816 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:48.914+0000 7fac1dc22640 1 -- 172.21.15.89:0/4253462010 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac18101f90 msgr2=0x7fac18110d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:49.816 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:48.914+0000 7fac1dc22640 1 --2- 172.21.15.89:0/4253462010 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac18101f90 0x7fac18110d20 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fac08009810 tx=0x7fac080091d0 comp rx=0 tx=0).stop 2024-09-13T02:45:49.816 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:48.914+0000 7fac1dc22640 1 -- 172.21.15.89:0/4253462010 shutdown_connections 2024-09-13T02:45:49.816 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:48.914+0000 7fac1dc22640 1 --2- 172.21.15.89:0/4253462010 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7fac040394e0 0x7fac0403b990 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:49.816 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:48.914+0000 7fac1dc22640 1 --2- 172.21.15.89:0/4253462010 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac18101f90 0x7fac18110d20 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:49.816 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:48.914+0000 7fac1dc22640 1 -- 172.21.15.89:0/4253462010 >> 172.21.15.89:0/4253462010 conn(0x7fac180fd710 msgr2=0x7fac180fe260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:45:49.816 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:48.915+0000 7fac1dc22640 1 -- 172.21.15.89:0/4253462010 shutdown_connections 2024-09-13T02:45:49.816 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:48.915+0000 7fac1dc22640 1 -- 172.21.15.89:0/4253462010 wait complete. 2024-09-13T02:45:49.816 INFO:teuthology.orchestra.run.smithi089.stdout:Deploying node-exporter service with default placement... 2024-09-13T02:45:50.107 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:49 smithi089 ceph-mon[27639]: from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:45:50.108 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:49 smithi089 ceph-mon[27639]: Saving service grafana spec with placement count:1 2024-09-13T02:45:50.108 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:49 smithi089 ceph-mon[27639]: from='mgr.14116 172.21.15.89:0/1844139609' entity='mgr.smithi089.guohvs' 2024-09-13T02:45:50.108 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:49 smithi089 ceph-mon[27639]: from='mgr.14116 172.21.15.89:0/1844139609' entity='mgr.smithi089.guohvs' 2024-09-13T02:45:50.985 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout Scheduled node-exporter update... 2024-09-13T02:45:50.985 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:50.180+0000 7f9e88368640 1 Processor -- start 2024-09-13T02:45:50.985 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:50.180+0000 7f9e88368640 1 -- start start 2024-09-13T02:45:50.986 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:50.180+0000 7f9e88368640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9e80101f90 0x7f9e801023a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:45:50.986 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:50.180+0000 7f9e88368640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e801028e0 con 0x7f9e80101f90 2024-09-13T02:45:50.986 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:50.180+0000 7f9e86104640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9e80101f90 0x7f9e801023a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:45:50.986 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:50.180+0000 7f9e86104640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9e80101f90 0x7f9e801023a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:45238/0 (socket says 172.21.15.89:45238) 2024-09-13T02:45:50.986 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:50.180+0000 7f9e86104640 1 -- 172.21.15.89:0/2225073930 learned_addr learned my addr 172.21.15.89:0/2225073930 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:45:50.986 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:50.180+0000 7f9e86104640 1 -- 172.21.15.89:0/2225073930 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e80102a20 con 0x7f9e80101f90 2024-09-13T02:45:50.986 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:50.181+0000 7f9e86104640 1 --2- 172.21.15.89:0/2225073930 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9e80101f90 0x7f9e801023a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c009840 tx=0x7f9e7c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2f62a4792ce8a1c server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:45:50.986 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:50.181+0000 7f9e85102640 1 -- 172.21.15.89:0/2225073930 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9e7c032440 con 0x7f9e80101f90 2024-09-13T02:45:50.986 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:50.181+0000 7f9e85102640 1 -- 172.21.15.89:0/2225073930 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9e7c032a40 con 0x7f9e80101f90 2024-09-13T02:45:50.986 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:50.181+0000 7f9e85102640 1 -- 172.21.15.89:0/2225073930 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9e7c031a70 con 0x7f9e80101f90 2024-09-13T02:45:50.986 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:50.182+0000 7f9e88368640 1 -- 172.21.15.89:0/2225073930 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9e80101f90 msgr2=0x7f9e801023a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:50.987 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:50.182+0000 7f9e88368640 1 --2- 172.21.15.89:0/2225073930 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9e80101f90 0x7f9e801023a0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c009840 tx=0x7f9e7c0091d0 comp rx=0 tx=0).stop 2024-09-13T02:45:50.987 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:50.182+0000 7f9e88368640 1 -- 172.21.15.89:0/2225073930 shutdown_connections 2024-09-13T02:45:50.987 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:50.182+0000 7f9e88368640 1 --2- 172.21.15.89:0/2225073930 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9e80101f90 0x7f9e801023a0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:50.987 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:50.182+0000 7f9e88368640 1 -- 172.21.15.89:0/2225073930 >> 172.21.15.89:0/2225073930 conn(0x7f9e800fd710 msgr2=0x7f9e800ffb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:45:50.987 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:50.182+0000 7f9e88368640 1 -- 172.21.15.89:0/2225073930 shutdown_connections 2024-09-13T02:45:50.987 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:50.182+0000 7f9e88368640 1 -- 172.21.15.89:0/2225073930 wait complete. 2024-09-13T02:45:50.987 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:50.182+0000 7f9e88368640 1 Processor -- start 2024-09-13T02:45:50.987 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:50.182+0000 7f9e88368640 1 -- start start 2024-09-13T02:45:50.987 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:50.183+0000 7f9e88368640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9e80101f90 0x7f9e80110d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:45:50.987 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:50.183+0000 7f9e88368640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e80111260 con 0x7f9e80101f90 2024-09-13T02:45:50.987 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:50.183+0000 7f9e86104640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9e80101f90 0x7f9e80110d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:45:50.987 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:50.183+0000 7f9e86104640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9e80101f90 0x7f9e80110d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:45254/0 (socket says 172.21.15.89:45254) 2024-09-13T02:45:50.987 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:50.183+0000 7f9e86104640 1 -- 172.21.15.89:0/1113691130 learned_addr learned my addr 172.21.15.89:0/1113691130 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:45:50.987 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:50.183+0000 7f9e86104640 1 -- 172.21.15.89:0/1113691130 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e7c009450 con 0x7f9e80101f90 2024-09-13T02:45:50.988 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:50.183+0000 7f9e86104640 1 --2- 172.21.15.89:0/1113691130 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9e80101f90 0x7f9e80110d20 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c006a70 tx=0x7f9e7c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:45:50.988 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:50.183+0000 7f9e72ffd640 1 -- 172.21.15.89:0/1113691130 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9e7c03c400 con 0x7f9e80101f90 2024-09-13T02:45:50.988 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:50.183+0000 7f9e72ffd640 1 -- 172.21.15.89:0/1113691130 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9e7c03ca00 con 0x7f9e80101f90 2024-09-13T02:45:50.988 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:50.183+0000 7f9e88368640 1 -- 172.21.15.89:0/1113691130 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e80111460 con 0x7f9e80101f90 2024-09-13T02:45:50.988 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:50.183+0000 7f9e72ffd640 1 -- 172.21.15.89:0/1113691130 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9e7c03a9a0 con 0x7f9e80101f90 2024-09-13T02:45:50.988 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:50.183+0000 7f9e88368640 1 -- 172.21.15.89:0/1113691130 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e801118d0 con 0x7f9e80101f90 2024-09-13T02:45:50.988 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:50.184+0000 7f9e72ffd640 1 -- 172.21.15.89:0/1113691130 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f9e7c03ac20 con 0x7f9e80101f90 2024-09-13T02:45:50.988 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:50.184+0000 7f9e88368640 1 -- 172.21.15.89:0/1113691130 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e8004b720 con 0x7f9e80101f90 2024-09-13T02:45:50.988 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:50.184+0000 7f9e72ffd640 1 --2- 172.21.15.89:0/1113691130 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7f9e6c039490 0x7f9e6c03b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:45:50.988 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:50.184+0000 7f9e72ffd640 1 -- 172.21.15.89:0/1113691130 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f9e7c06ccc0 con 0x7f9e80101f90 2024-09-13T02:45:50.988 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:50.184+0000 7f9e85903640 1 --2- 172.21.15.89:0/1113691130 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7f9e6c039490 0x7f9e6c03b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:45:50.988 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:50.185+0000 7f9e85903640 1 --2- 172.21.15.89:0/1113691130 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7f9e6c039490 0x7f9e6c03b940 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f9e74006fd0 tx=0x7f9e74006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:45:50.988 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:50.189+0000 7f9e72ffd640 1 -- 172.21.15.89:0/1113691130 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f9e7c03cb70 con 0x7f9e80101f90 2024-09-13T02:45:50.989 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:50.355+0000 7f9e88368640 1 -- 172.21.15.89:0/1113691130 --> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7f9e801118d0 con 0x7f9e6c039490 2024-09-13T02:45:50.989 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:50.362+0000 7f9e72ffd640 1 -- 172.21.15.89:0/1113691130 <== mgr.14116 v2:172.21.15.89:6800/702640100 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7f9e801118d0 con 0x7f9e6c039490 2024-09-13T02:45:50.989 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:50.364+0000 7f9e88368640 1 -- 172.21.15.89:0/1113691130 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7f9e6c039490 msgr2=0x7f9e6c03b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:50.989 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:50.364+0000 7f9e88368640 1 --2- 172.21.15.89:0/1113691130 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7f9e6c039490 0x7f9e6c03b940 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f9e74006fd0 tx=0x7f9e74006db0 comp rx=0 tx=0).stop 2024-09-13T02:45:50.989 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:50.364+0000 7f9e88368640 1 -- 172.21.15.89:0/1113691130 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9e80101f90 msgr2=0x7f9e80110d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:50.989 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:50.364+0000 7f9e88368640 1 --2- 172.21.15.89:0/1113691130 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9e80101f90 0x7f9e80110d20 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f9e7c006a70 tx=0x7f9e7c0091d0 comp rx=0 tx=0).stop 2024-09-13T02:45:50.989 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:50.364+0000 7f9e88368640 1 -- 172.21.15.89:0/1113691130 shutdown_connections 2024-09-13T02:45:50.989 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:50.364+0000 7f9e88368640 1 --2- 172.21.15.89:0/1113691130 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7f9e6c039490 0x7f9e6c03b940 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:50.989 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:50.364+0000 7f9e88368640 1 --2- 172.21.15.89:0/1113691130 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9e80101f90 0x7f9e80110d20 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:50.989 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:50.364+0000 7f9e88368640 1 -- 172.21.15.89:0/1113691130 >> 172.21.15.89:0/1113691130 conn(0x7f9e800fd710 msgr2=0x7f9e800fe260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:45:50.989 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:50.364+0000 7f9e88368640 1 -- 172.21.15.89:0/1113691130 shutdown_connections 2024-09-13T02:45:50.989 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:50.364+0000 7f9e88368640 1 -- 172.21.15.89:0/1113691130 wait complete. 2024-09-13T02:45:50.989 INFO:teuthology.orchestra.run.smithi089.stdout:Deploying alertmanager service with default placement... 2024-09-13T02:45:51.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:51 smithi089 ceph-mon[27639]: from='client.14148 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:45:51.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:51 smithi089 ceph-mon[27639]: Saving service node-exporter spec with placement * 2024-09-13T02:45:51.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:51 smithi089 ceph-mon[27639]: from='mgr.14116 172.21.15.89:0/1844139609' entity='mgr.smithi089.guohvs' 2024-09-13T02:45:51.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:51 smithi089 ceph-mon[27639]: from='mgr.14116 172.21.15.89:0/1844139609' entity='mgr.smithi089.guohvs' 2024-09-13T02:45:52.916 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:52 smithi089 ceph-mon[27639]: from='client.14150 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:45:52.916 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:52 smithi089 ceph-mon[27639]: Saving service alertmanager spec with placement count:1 2024-09-13T02:45:52.916 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:52 smithi089 ceph-mon[27639]: from='mgr.14116 172.21.15.89:0/1844139609' entity='mgr.smithi089.guohvs' 2024-09-13T02:45:52.923 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout Scheduled alertmanager update... 2024-09-13T02:45:52.923 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:51.421+0000 7f0a6b9b4640 1 Processor -- start 2024-09-13T02:45:52.923 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:51.421+0000 7f0a6b9b4640 1 -- start start 2024-09-13T02:45:52.923 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:51.421+0000 7f0a6b9b4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0a64076b30 0x7f0a64107040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:45:52.923 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:51.421+0000 7f0a6b9b4640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a64076f40 con 0x7f0a64076b30 2024-09-13T02:45:52.924 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:51.421+0000 7f0a69750640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0a64076b30 0x7f0a64107040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:45:52.924 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:51.421+0000 7f0a69750640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0a64076b30 0x7f0a64107040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:53294/0 (socket says 172.21.15.89:53294) 2024-09-13T02:45:52.924 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:51.421+0000 7f0a69750640 1 -- 172.21.15.89:0/3150774989 learned_addr learned my addr 172.21.15.89:0/3150774989 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:45:52.924 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:51.422+0000 7f0a69750640 1 -- 172.21.15.89:0/3150774989 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a64102a30 con 0x7f0a64076b30 2024-09-13T02:45:52.924 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:51.422+0000 7f0a69750640 1 --2- 172.21.15.89:0/3150774989 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0a64076b30 0x7f0a64107040 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0a54009e50 tx=0x7f0a54009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3ab38162d34d18e server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:45:52.924 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:51.423+0000 7f0a63fff640 1 -- 172.21.15.89:0/3150774989 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0a54031560 con 0x7f0a64076b30 2024-09-13T02:45:52.924 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:51.423+0000 7f0a63fff640 1 -- 172.21.15.89:0/3150774989 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0a5402d050 con 0x7f0a64076b30 2024-09-13T02:45:52.924 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:51.423+0000 7f0a63fff640 1 -- 172.21.15.89:0/3150774989 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0a54007a60 con 0x7f0a64076b30 2024-09-13T02:45:52.924 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:51.423+0000 7f0a6b9b4640 1 -- 172.21.15.89:0/3150774989 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0a64076b30 msgr2=0x7f0a64107040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:52.924 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:51.423+0000 7f0a6b9b4640 1 --2- 172.21.15.89:0/3150774989 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0a64076b30 0x7f0a64107040 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f0a54009e50 tx=0x7f0a54009840 comp rx=0 tx=0).stop 2024-09-13T02:45:52.924 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:51.423+0000 7f0a6b9b4640 1 -- 172.21.15.89:0/3150774989 shutdown_connections 2024-09-13T02:45:52.924 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:51.423+0000 7f0a6b9b4640 1 --2- 172.21.15.89:0/3150774989 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0a64076b30 0x7f0a64107040 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:52.924 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:51.423+0000 7f0a6b9b4640 1 -- 172.21.15.89:0/3150774989 >> 172.21.15.89:0/3150774989 conn(0x7f0a640fc710 msgr2=0x7f0a640feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:45:52.925 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:51.423+0000 7f0a6b9b4640 1 -- 172.21.15.89:0/3150774989 shutdown_connections 2024-09-13T02:45:52.925 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:51.423+0000 7f0a6b9b4640 1 -- 172.21.15.89:0/3150774989 wait complete. 2024-09-13T02:45:52.925 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:51.424+0000 7f0a6b9b4640 1 Processor -- start 2024-09-13T02:45:52.925 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:51.424+0000 7f0a6b9b4640 1 -- start start 2024-09-13T02:45:52.925 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:51.424+0000 7f0a6b9b4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0a64076b30 0x7f0a64112f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:45:52.925 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:51.424+0000 7f0a6b9b4640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a64113490 con 0x7f0a64076b30 2024-09-13T02:45:52.925 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:51.424+0000 7f0a69750640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0a64076b30 0x7f0a64112f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:45:52.925 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:51.424+0000 7f0a69750640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0a64076b30 0x7f0a64112f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:53304/0 (socket says 172.21.15.89:53304) 2024-09-13T02:45:52.925 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:51.424+0000 7f0a69750640 1 -- 172.21.15.89:0/989090824 learned_addr learned my addr 172.21.15.89:0/989090824 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:45:52.925 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:51.424+0000 7f0a69750640 1 -- 172.21.15.89:0/989090824 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a54009ae0 con 0x7f0a64076b30 2024-09-13T02:45:52.925 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:51.424+0000 7f0a69750640 1 --2- 172.21.15.89:0/989090824 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0a64076b30 0x7f0a64112f50 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0a54009e20 tx=0x7f0a54009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:45:52.925 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:51.424+0000 7f0a61ffb640 1 -- 172.21.15.89:0/989090824 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0a5403b410 con 0x7f0a64076b30 2024-09-13T02:45:52.925 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:51.425+0000 7f0a6b9b4640 1 -- 172.21.15.89:0/989090824 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a64113690 con 0x7f0a64076b30 2024-09-13T02:45:52.925 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:51.425+0000 7f0a61ffb640 1 -- 172.21.15.89:0/989090824 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0a5403ba10 con 0x7f0a64076b30 2024-09-13T02:45:52.926 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:51.425+0000 7f0a61ffb640 1 -- 172.21.15.89:0/989090824 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0a54045770 con 0x7f0a64076b30 2024-09-13T02:45:52.926 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:51.425+0000 7f0a6b9b4640 1 -- 172.21.15.89:0/989090824 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a64113b00 con 0x7f0a64076b30 2024-09-13T02:45:52.926 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:51.425+0000 7f0a61ffb640 1 -- 172.21.15.89:0/989090824 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f0a54038050 con 0x7f0a64076b30 2024-09-13T02:45:52.926 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:51.426+0000 7f0a61ffb640 1 --2- 172.21.15.89:0/989090824 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7f0a4c039490 0x7f0a4c03b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:45:52.926 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:51.426+0000 7f0a6b9b4640 1 -- 172.21.15.89:0/989090824 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a6404b720 con 0x7f0a64076b30 2024-09-13T02:45:52.926 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:51.426+0000 7f0a61ffb640 1 -- 172.21.15.89:0/989090824 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f0a5406cd70 con 0x7f0a64076b30 2024-09-13T02:45:52.926 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:51.426+0000 7f0a68f4f640 1 --2- 172.21.15.89:0/989090824 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7f0a4c039490 0x7f0a4c03b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:45:52.926 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:51.426+0000 7f0a68f4f640 1 --2- 172.21.15.89:0/989090824 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7f0a4c039490 0x7f0a4c03b940 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f0a58006fd0 tx=0x7f0a58006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:45:52.926 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:51.430+0000 7f0a61ffb640 1 -- 172.21.15.89:0/989090824 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f0a54041020 con 0x7f0a64076b30 2024-09-13T02:45:52.926 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:51.613+0000 7f0a6b9b4640 1 -- 172.21.15.89:0/989090824 --> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}) v1 -- 0x7f0a640fda80 con 0x7f0a4c039490 2024-09-13T02:45:52.926 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:51.620+0000 7f0a61ffb640 1 -- 172.21.15.89:0/989090824 <== mgr.14116 v2:172.21.15.89:6800/702640100 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+33 (secure 0 0 0) 0x7f0a640fda80 con 0x7f0a4c039490 2024-09-13T02:45:52.926 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:51.622+0000 7f0a6b9b4640 1 -- 172.21.15.89:0/989090824 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7f0a4c039490 msgr2=0x7f0a4c03b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:52.927 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:51.622+0000 7f0a6b9b4640 1 --2- 172.21.15.89:0/989090824 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7f0a4c039490 0x7f0a4c03b940 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f0a58006fd0 tx=0x7f0a58006db0 comp rx=0 tx=0).stop 2024-09-13T02:45:52.927 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:51.622+0000 7f0a6b9b4640 1 -- 172.21.15.89:0/989090824 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0a64076b30 msgr2=0x7f0a64112f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:52.927 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:51.622+0000 7f0a6b9b4640 1 --2- 172.21.15.89:0/989090824 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0a64076b30 0x7f0a64112f50 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f0a54009e20 tx=0x7f0a54009840 comp rx=0 tx=0).stop 2024-09-13T02:45:52.927 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:51.622+0000 7f0a6b9b4640 1 -- 172.21.15.89:0/989090824 shutdown_connections 2024-09-13T02:45:52.927 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:51.622+0000 7f0a6b9b4640 1 --2- 172.21.15.89:0/989090824 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7f0a4c039490 0x7f0a4c03b940 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:52.927 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:51.622+0000 7f0a6b9b4640 1 --2- 172.21.15.89:0/989090824 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0a64076b30 0x7f0a64112f50 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:52.927 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:51.622+0000 7f0a6b9b4640 1 -- 172.21.15.89:0/989090824 >> 172.21.15.89:0/989090824 conn(0x7f0a640fc710 msgr2=0x7f0a640fd2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:45:52.927 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:51.622+0000 7f0a6b9b4640 1 -- 172.21.15.89:0/989090824 shutdown_connections 2024-09-13T02:45:52.927 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:51.622+0000 7f0a6b9b4640 1 -- 172.21.15.89:0/989090824 wait complete. 2024-09-13T02:45:53.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:53 smithi089 ceph-mon[27639]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:45:53.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:53 smithi089 ceph-mon[27639]: from='client.? 172.21.15.89:0/2417236048' entity='client.admin' 2024-09-13T02:45:53.987 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:53.304+0000 7f5733a75640 1 Processor -- start 2024-09-13T02:45:53.987 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:53.304+0000 7f5733a75640 1 -- start start 2024-09-13T02:45:53.987 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:53.304+0000 7f5733a75640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f572c100f30 0x7f572c101340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:45:53.987 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:53.304+0000 7f5733a75640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f572c101880 con 0x7f572c100f30 2024-09-13T02:45:53.987 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:53.304+0000 7f5731811640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f572c100f30 0x7f572c101340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:45:53.988 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:53.304+0000 7f5731811640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f572c100f30 0x7f572c101340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:53312/0 (socket says 172.21.15.89:53312) 2024-09-13T02:45:53.988 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:53.304+0000 7f5731811640 1 -- 172.21.15.89:0/2024212096 learned_addr learned my addr 172.21.15.89:0/2024212096 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:45:53.988 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:53.305+0000 7f5731811640 1 -- 172.21.15.89:0/2024212096 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f572c1019c0 con 0x7f572c100f30 2024-09-13T02:45:53.988 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:53.305+0000 7f5731811640 1 --2- 172.21.15.89:0/2024212096 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f572c100f30 0x7f572c101340 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5728009840 tx=0x7f57280091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad45debb572f13a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:45:53.988 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:53.305+0000 7f573080f640 1 -- 172.21.15.89:0/2024212096 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5728032440 con 0x7f572c100f30 2024-09-13T02:45:53.988 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:53.305+0000 7f573080f640 1 -- 172.21.15.89:0/2024212096 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f5728032a40 con 0x7f572c100f30 2024-09-13T02:45:53.988 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:53.305+0000 7f573080f640 1 -- 172.21.15.89:0/2024212096 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5728031a70 con 0x7f572c100f30 2024-09-13T02:45:53.988 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:53.306+0000 7f5733a75640 1 -- 172.21.15.89:0/2024212096 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f572c100f30 msgr2=0x7f572c101340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:53.989 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:53.306+0000 7f5733a75640 1 --2- 172.21.15.89:0/2024212096 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f572c100f30 0x7f572c101340 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5728009840 tx=0x7f57280091d0 comp rx=0 tx=0).stop 2024-09-13T02:45:53.989 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:53.306+0000 7f5733a75640 1 -- 172.21.15.89:0/2024212096 shutdown_connections 2024-09-13T02:45:53.989 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:53.306+0000 7f5733a75640 1 --2- 172.21.15.89:0/2024212096 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f572c100f30 0x7f572c101340 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:53.989 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:53.306+0000 7f5733a75640 1 -- 172.21.15.89:0/2024212096 >> 172.21.15.89:0/2024212096 conn(0x7f572c0fc730 msgr2=0x7f572c0feb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:45:53.989 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:53.306+0000 7f5733a75640 1 -- 172.21.15.89:0/2024212096 shutdown_connections 2024-09-13T02:45:53.989 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:53.306+0000 7f5733a75640 1 -- 172.21.15.89:0/2024212096 wait complete. 2024-09-13T02:45:53.989 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:53.307+0000 7f5733a75640 1 Processor -- start 2024-09-13T02:45:53.989 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:53.307+0000 7f5733a75640 1 -- start start 2024-09-13T02:45:53.989 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:53.307+0000 7f5733a75640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f572c100f30 0x7f572c1070e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:45:53.989 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:53.307+0000 7f5733a75640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f572c107620 con 0x7f572c100f30 2024-09-13T02:45:53.989 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:53.307+0000 7f5731811640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f572c100f30 0x7f572c1070e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:45:53.989 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:53.307+0000 7f5731811640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f572c100f30 0x7f572c1070e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:53320/0 (socket says 172.21.15.89:53320) 2024-09-13T02:45:53.989 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:53.307+0000 7f5731811640 1 -- 172.21.15.89:0/2417236048 learned_addr learned my addr 172.21.15.89:0/2417236048 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:45:53.990 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:53.307+0000 7f5731811640 1 -- 172.21.15.89:0/2417236048 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5728009450 con 0x7f572c100f30 2024-09-13T02:45:53.990 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:53.307+0000 7f5731811640 1 --2- 172.21.15.89:0/2417236048 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f572c100f30 0x7f572c1070e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5728009810 tx=0x7f57280091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:45:53.990 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:53.307+0000 7f57227fc640 1 -- 172.21.15.89:0/2417236048 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f572803c400 con 0x7f572c100f30 2024-09-13T02:45:53.990 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:53.307+0000 7f57227fc640 1 -- 172.21.15.89:0/2417236048 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f572803ca00 con 0x7f572c100f30 2024-09-13T02:45:53.990 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:53.307+0000 7f57227fc640 1 -- 172.21.15.89:0/2417236048 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f572803a870 con 0x7f572c100f30 2024-09-13T02:45:53.990 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:53.307+0000 7f5733a75640 1 -- 172.21.15.89:0/2417236048 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f572c1056b0 con 0x7f572c100f30 2024-09-13T02:45:53.990 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:53.308+0000 7f5733a75640 1 -- 172.21.15.89:0/2417236048 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f572c105b20 con 0x7f572c100f30 2024-09-13T02:45:53.990 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:53.308+0000 7f57227fc640 1 -- 172.21.15.89:0/2417236048 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f572803cb70 con 0x7f572c100f30 2024-09-13T02:45:53.990 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:53.308+0000 7f5733a75640 1 -- 172.21.15.89:0/2417236048 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f572c100390 con 0x7f572c100f30 2024-09-13T02:45:53.990 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:53.308+0000 7f57227fc640 1 --2- 172.21.15.89:0/2417236048 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7f57180394e0 0x7f571803b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:45:53.990 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:53.309+0000 7f57227fc640 1 -- 172.21.15.89:0/2417236048 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f572806ce90 con 0x7f572c100f30 2024-09-13T02:45:53.990 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:53.309+0000 7f5731010640 1 --2- 172.21.15.89:0/2417236048 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7f57180394e0 0x7f571803b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:45:53.990 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:53.309+0000 7f5731010640 1 --2- 172.21.15.89:0/2417236048 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7f57180394e0 0x7f571803b990 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f571c006fd0 tx=0x7f571c006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:45:53.991 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:53.313+0000 7f57227fc640 1 -- 172.21.15.89:0/2417236048 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f572803b940 con 0x7f572c100f30 2024-09-13T02:45:53.991 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:53.466+0000 7f5733a75640 1 -- 172.21.15.89:0/2417236048 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7f572c10aab0 con 0x7f572c100f30 2024-09-13T02:45:53.991 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:53.469+0000 7f57227fc640 1 -- 172.21.15.89:0/2417236048 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7f5728037030 con 0x7f572c100f30 2024-09-13T02:45:53.991 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:53.471+0000 7f5733a75640 1 -- 172.21.15.89:0/2417236048 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7f57180394e0 msgr2=0x7f571803b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:53.991 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:53.471+0000 7f5733a75640 1 --2- 172.21.15.89:0/2417236048 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7f57180394e0 0x7f571803b990 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f571c006fd0 tx=0x7f571c006db0 comp rx=0 tx=0).stop 2024-09-13T02:45:53.991 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:53.471+0000 7f5733a75640 1 -- 172.21.15.89:0/2417236048 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f572c100f30 msgr2=0x7f572c1070e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:53.991 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:53.471+0000 7f5733a75640 1 --2- 172.21.15.89:0/2417236048 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f572c100f30 0x7f572c1070e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f5728009810 tx=0x7f57280091d0 comp rx=0 tx=0).stop 2024-09-13T02:45:53.991 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:53.471+0000 7f5733a75640 1 -- 172.21.15.89:0/2417236048 shutdown_connections 2024-09-13T02:45:53.991 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:53.471+0000 7f5733a75640 1 --2- 172.21.15.89:0/2417236048 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7f57180394e0 0x7f571803b990 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:53.991 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:53.471+0000 7f5733a75640 1 --2- 172.21.15.89:0/2417236048 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f572c100f30 0x7f572c1070e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:53.991 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:53.471+0000 7f5733a75640 1 -- 172.21.15.89:0/2417236048 >> 172.21.15.89:0/2417236048 conn(0x7f572c0fc730 msgr2=0x7f572c0fd680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:45:53.991 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:53.472+0000 7f5733a75640 1 -- 172.21.15.89:0/2417236048 shutdown_connections 2024-09-13T02:45:53.991 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:53.472+0000 7f5733a75640 1 -- 172.21.15.89:0/2417236048 wait complete. 2024-09-13T02:45:55.102 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:54.383+0000 7f2eb9de2640 1 Processor -- start 2024-09-13T02:45:55.102 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:54.383+0000 7f2eb9de2640 1 -- start start 2024-09-13T02:45:55.102 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:54.383+0000 7f2eb9de2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2eb4076ab0 0x7f2eb4104cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:45:55.102 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:54.383+0000 7f2eb9de2640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb4076ec0 con 0x7f2eb4076ab0 2024-09-13T02:45:55.102 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:54.383+0000 7f2eb37fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2eb4076ab0 0x7f2eb4104cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:45:55.102 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:54.383+0000 7f2eb37fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2eb4076ab0 0x7f2eb4104cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:53336/0 (socket says 172.21.15.89:53336) 2024-09-13T02:45:55.103 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:54.383+0000 7f2eb37fe640 1 -- 172.21.15.89:0/2154375448 learned_addr learned my addr 172.21.15.89:0/2154375448 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:45:55.103 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:54.383+0000 7f2eb37fe640 1 -- 172.21.15.89:0/2154375448 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2eb4105200 con 0x7f2eb4076ab0 2024-09-13T02:45:55.103 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:54.384+0000 7f2eb37fe640 1 --2- 172.21.15.89:0/2154375448 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2eb4076ab0 0x7f2eb4104cc0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2ea4009840 tx=0x7f2ea40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43a48b5140dc0465 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:45:55.103 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:54.384+0000 7f2eb2ffd640 1 -- 172.21.15.89:0/2154375448 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2ea4032440 con 0x7f2eb4076ab0 2024-09-13T02:45:55.103 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:54.384+0000 7f2eb2ffd640 1 -- 172.21.15.89:0/2154375448 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f2ea4032a40 con 0x7f2eb4076ab0 2024-09-13T02:45:55.103 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:54.384+0000 7f2eb2ffd640 1 -- 172.21.15.89:0/2154375448 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2ea4031aa0 con 0x7f2eb4076ab0 2024-09-13T02:45:55.103 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:54.385+0000 7f2eb9de2640 1 -- 172.21.15.89:0/2154375448 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2eb4076ab0 msgr2=0x7f2eb4104cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:55.103 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:54.385+0000 7f2eb9de2640 1 --2- 172.21.15.89:0/2154375448 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2eb4076ab0 0x7f2eb4104cc0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f2ea4009840 tx=0x7f2ea40091d0 comp rx=0 tx=0).stop 2024-09-13T02:45:55.103 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:54.385+0000 7f2eb9de2640 1 -- 172.21.15.89:0/2154375448 shutdown_connections 2024-09-13T02:45:55.103 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:54.385+0000 7f2eb9de2640 1 --2- 172.21.15.89:0/2154375448 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2eb4076ab0 0x7f2eb4104cc0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:55.103 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:54.385+0000 7f2eb9de2640 1 -- 172.21.15.89:0/2154375448 >> 172.21.15.89:0/2154375448 conn(0x7f2eb40fc790 msgr2=0x7f2eb40feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:45:55.103 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:54.385+0000 7f2eb9de2640 1 -- 172.21.15.89:0/2154375448 shutdown_connections 2024-09-13T02:45:55.103 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:54.385+0000 7f2eb9de2640 1 -- 172.21.15.89:0/2154375448 wait complete. 2024-09-13T02:45:55.104 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:54.386+0000 7f2eb9de2640 1 Processor -- start 2024-09-13T02:45:55.104 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:54.386+0000 7f2eb9de2640 1 -- start start 2024-09-13T02:45:55.104 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:54.386+0000 7f2eb9de2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2eb4076ab0 0x7f2eb41025f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:45:55.104 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:54.386+0000 7f2eb9de2640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2eb4102b30 con 0x7f2eb4076ab0 2024-09-13T02:45:55.104 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:54.386+0000 7f2eb37fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2eb4076ab0 0x7f2eb41025f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:45:55.104 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:54.386+0000 7f2eb37fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2eb4076ab0 0x7f2eb41025f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:53346/0 (socket says 172.21.15.89:53346) 2024-09-13T02:45:55.104 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:54.386+0000 7f2eb37fe640 1 -- 172.21.15.89:0/388757294 learned_addr learned my addr 172.21.15.89:0/388757294 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:45:55.104 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:54.386+0000 7f2eb37fe640 1 -- 172.21.15.89:0/388757294 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ea4009450 con 0x7f2eb4076ab0 2024-09-13T02:45:55.104 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:54.386+0000 7f2eb37fe640 1 --2- 172.21.15.89:0/388757294 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2eb4076ab0 0x7f2eb41025f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2ea4031780 tx=0x7f2ea40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:45:55.104 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:54.386+0000 7f2eb0ff9640 1 -- 172.21.15.89:0/388757294 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2ea40327b0 con 0x7f2eb4076ab0 2024-09-13T02:45:55.104 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:54.386+0000 7f2eb9de2640 1 -- 172.21.15.89:0/388757294 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2eb4100bc0 con 0x7f2eb4076ab0 2024-09-13T02:45:55.104 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:54.386+0000 7f2eb0ff9640 1 -- 172.21.15.89:0/388757294 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f2ea403b8d0 con 0x7f2eb4076ab0 2024-09-13T02:45:55.104 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:54.387+0000 7f2eb0ff9640 1 -- 172.21.15.89:0/388757294 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2ea403a790 con 0x7f2eb4076ab0 2024-09-13T02:45:55.105 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:54.387+0000 7f2eb9de2640 1 -- 172.21.15.89:0/388757294 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2eb4101030 con 0x7f2eb4076ab0 2024-09-13T02:45:55.105 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:54.387+0000 7f2eb0ff9640 1 -- 172.21.15.89:0/388757294 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7f2ea4039040 con 0x7f2eb4076ab0 2024-09-13T02:45:55.105 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:54.388+0000 7f2eb0ff9640 1 --2- 172.21.15.89:0/388757294 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7f2ea0039490 0x7f2ea003b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:45:55.105 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:54.388+0000 7f2eb9de2640 1 -- 172.21.15.89:0/388757294 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2eb404b720 con 0x7f2eb4076ab0 2024-09-13T02:45:55.105 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:54.388+0000 7f2eb0ff9640 1 -- 172.21.15.89:0/388757294 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f2ea406cb30 con 0x7f2eb4076ab0 2024-09-13T02:45:55.105 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:54.388+0000 7f2eabfff640 1 --2- 172.21.15.89:0/388757294 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7f2ea0039490 0x7f2ea003b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:45:55.105 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:54.388+0000 7f2eabfff640 1 --2- 172.21.15.89:0/388757294 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7f2ea0039490 0x7f2ea003b940 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c006fd0 tx=0x7f2e9c006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:45:55.105 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:54.392+0000 7f2eb0ff9640 1 -- 172.21.15.89:0/388757294 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f2ea403b430 con 0x7f2eb4076ab0 2024-09-13T02:45:55.105 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:54.546+0000 7f2eb9de2640 1 -- 172.21.15.89:0/388757294 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7f2eb4105fa0 con 0x7f2eb4076ab0 2024-09-13T02:45:55.105 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:54.549+0000 7f2eb0ff9640 1 -- 172.21.15.89:0/388757294 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7f2ea40370c0 con 0x7f2eb4076ab0 2024-09-13T02:45:55.105 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:54.550+0000 7f2eb9de2640 1 -- 172.21.15.89:0/388757294 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7f2ea0039490 msgr2=0x7f2ea003b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:55.105 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:54.550+0000 7f2eb9de2640 1 --2- 172.21.15.89:0/388757294 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7f2ea0039490 0x7f2ea003b940 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c006fd0 tx=0x7f2e9c006db0 comp rx=0 tx=0).stop 2024-09-13T02:45:55.105 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:54.550+0000 7f2eb9de2640 1 -- 172.21.15.89:0/388757294 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2eb4076ab0 msgr2=0x7f2eb41025f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:55.106 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:54.550+0000 7f2eb9de2640 1 --2- 172.21.15.89:0/388757294 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2eb4076ab0 0x7f2eb41025f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f2ea4031780 tx=0x7f2ea40091d0 comp rx=0 tx=0).stop 2024-09-13T02:45:55.106 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:54.551+0000 7f2eb9de2640 1 -- 172.21.15.89:0/388757294 shutdown_connections 2024-09-13T02:45:55.106 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:54.551+0000 7f2eb9de2640 1 --2- 172.21.15.89:0/388757294 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7f2ea0039490 0x7f2ea003b940 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:55.106 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:54.551+0000 7f2eb9de2640 1 --2- 172.21.15.89:0/388757294 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2eb4076ab0 0x7f2eb41025f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:55.106 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:54.551+0000 7f2eb9de2640 1 -- 172.21.15.89:0/388757294 >> 172.21.15.89:0/388757294 conn(0x7f2eb40fc790 msgr2=0x7f2eb40fd370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:45:55.106 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:54.551+0000 7f2eb9de2640 1 -- 172.21.15.89:0/388757294 shutdown_connections 2024-09-13T02:45:55.106 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:54.551+0000 7f2eb9de2640 1 -- 172.21.15.89:0/388757294 wait complete. 2024-09-13T02:45:55.106 INFO:teuthology.orchestra.run.smithi089.stdout:Enabling the dashboard module... 2024-09-13T02:45:55.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:55 smithi089 ceph-mon[27639]: from='client.? 172.21.15.89:0/388757294' entity='client.admin' 2024-09-13T02:45:55.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:55 smithi089 ceph-mon[27639]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:45:56.820 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:56 smithi089 ceph-mon[27639]: from='client.? 172.21.15.89:0/2919878318' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-13T02:45:57.177 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:55.522+0000 7fa4a8074640 1 Processor -- start 2024-09-13T02:45:57.177 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:55.523+0000 7fa4a8074640 1 -- start start 2024-09-13T02:45:57.177 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:55.523+0000 7fa4a8074640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4a0076c80 0x7fa4a0104b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:45:57.178 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:55.523+0000 7fa4a8074640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a0105070 con 0x7fa4a0076c80 2024-09-13T02:45:57.178 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:55.523+0000 7fa4a5e10640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4a0076c80 0x7fa4a0104b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:45:57.178 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:55.523+0000 7fa4a5e10640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4a0076c80 0x7fa4a0104b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:53352/0 (socket says 172.21.15.89:53352) 2024-09-13T02:45:57.178 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:55.523+0000 7fa4a5e10640 1 -- 172.21.15.89:0/2758204763 learned_addr learned my addr 172.21.15.89:0/2758204763 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:45:57.178 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:55.523+0000 7fa4a5e10640 1 -- 172.21.15.89:0/2758204763 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4a01051b0 con 0x7fa4a0076c80 2024-09-13T02:45:57.178 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:55.524+0000 7fa4a5e10640 1 --2- 172.21.15.89:0/2758204763 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4a0076c80 0x7fa4a0104b30 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa49c009840 tx=0x7fa49c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec5db469466ba5f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:45:57.178 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:55.524+0000 7fa4a4e0e640 1 -- 172.21.15.89:0/2758204763 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa49c032440 con 0x7fa4a0076c80 2024-09-13T02:45:57.178 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:55.524+0000 7fa4a4e0e640 1 -- 172.21.15.89:0/2758204763 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa49c032a40 con 0x7fa4a0076c80 2024-09-13T02:45:57.178 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:55.524+0000 7fa4a4e0e640 1 -- 172.21.15.89:0/2758204763 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa49c031a70 con 0x7fa4a0076c80 2024-09-13T02:45:57.178 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:55.525+0000 7fa4a8074640 1 -- 172.21.15.89:0/2758204763 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4a0076c80 msgr2=0x7fa4a0104b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:57.178 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:55.525+0000 7fa4a8074640 1 --2- 172.21.15.89:0/2758204763 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4a0076c80 0x7fa4a0104b30 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa49c009840 tx=0x7fa49c0091d0 comp rx=0 tx=0).stop 2024-09-13T02:45:57.178 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:55.525+0000 7fa4a8074640 1 -- 172.21.15.89:0/2758204763 shutdown_connections 2024-09-13T02:45:57.178 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:55.525+0000 7fa4a8074640 1 --2- 172.21.15.89:0/2758204763 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4a0076c80 0x7fa4a0104b30 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:57.179 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:55.525+0000 7fa4a8074640 1 -- 172.21.15.89:0/2758204763 >> 172.21.15.89:0/2758204763 conn(0x7fa4a00fc620 msgr2=0x7fa4a00fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:45:57.179 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:55.525+0000 7fa4a8074640 1 -- 172.21.15.89:0/2758204763 shutdown_connections 2024-09-13T02:45:57.179 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:55.525+0000 7fa4a8074640 1 -- 172.21.15.89:0/2758204763 wait complete. 2024-09-13T02:45:57.179 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:55.526+0000 7fa4a8074640 1 Processor -- start 2024-09-13T02:45:57.179 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:55.526+0000 7fa4a8074640 1 -- start start 2024-09-13T02:45:57.179 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:55.526+0000 7fa4a8074640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4a0076c80 0x7fa4a0110e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:45:57.179 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:55.526+0000 7fa4a8074640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a0111390 con 0x7fa4a0076c80 2024-09-13T02:45:57.179 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:55.526+0000 7fa4a5e10640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4a0076c80 0x7fa4a0110e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:45:57.179 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:55.526+0000 7fa4a5e10640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4a0076c80 0x7fa4a0110e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:53364/0 (socket says 172.21.15.89:53364) 2024-09-13T02:45:57.179 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:55.526+0000 7fa4a5e10640 1 -- 172.21.15.89:0/2919878318 learned_addr learned my addr 172.21.15.89:0/2919878318 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:45:57.179 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:55.526+0000 7fa4a5e10640 1 -- 172.21.15.89:0/2919878318 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa49c009450 con 0x7fa4a0076c80 2024-09-13T02:45:57.179 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:55.526+0000 7fa4a5e10640 1 --2- 172.21.15.89:0/2919878318 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4a0076c80 0x7fa4a0110e50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa49c009420 tx=0x7fa49c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:45:57.180 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:55.527+0000 7fa4967fc640 1 -- 172.21.15.89:0/2919878318 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa49c03c400 con 0x7fa4a0076c80 2024-09-13T02:45:57.180 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:55.527+0000 7fa4967fc640 1 -- 172.21.15.89:0/2919878318 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa49c03ca00 con 0x7fa4a0076c80 2024-09-13T02:45:57.180 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:55.527+0000 7fa4a8074640 1 -- 172.21.15.89:0/2919878318 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4a0111590 con 0x7fa4a0076c80 2024-09-13T02:45:57.180 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:55.527+0000 7fa4967fc640 1 -- 172.21.15.89:0/2919878318 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa49c03a920 con 0x7fa4a0076c80 2024-09-13T02:45:57.180 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:55.527+0000 7fa4a8074640 1 -- 172.21.15.89:0/2919878318 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4a0111fe0 con 0x7fa4a0076c80 2024-09-13T02:45:57.180 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:55.528+0000 7fa4967fc640 1 -- 172.21.15.89:0/2919878318 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 8) v1 ==== 45507+0+0 (secure 0 0 0) 0x7fa49c03ab90 con 0x7fa4a0076c80 2024-09-13T02:45:57.180 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:55.528+0000 7fa4a8074640 1 -- 172.21.15.89:0/2919878318 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4a01002a0 con 0x7fa4a0076c80 2024-09-13T02:45:57.180 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:55.528+0000 7fa4967fc640 1 --2- 172.21.15.89:0/2919878318 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7fa48c039490 0x7fa48c03b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:45:57.180 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:55.528+0000 7fa4967fc640 1 -- 172.21.15.89:0/2919878318 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fa49c06cea0 con 0x7fa4a0076c80 2024-09-13T02:45:57.180 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:55.528+0000 7fa4a560f640 1 --2- 172.21.15.89:0/2919878318 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7fa48c039490 0x7fa48c03b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:45:57.180 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:55.528+0000 7fa4a560f640 1 --2- 172.21.15.89:0/2919878318 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7fa48c039490 0x7fa48c03b940 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa490006fd0 tx=0x7fa490006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:45:57.181 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:55.533+0000 7fa4967fc640 1 -- 172.21.15.89:0/2919878318 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fa49c030b20 con 0x7fa4a0076c80 2024-09-13T02:45:57.181 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:55.738+0000 7fa4a8074640 1 -- 172.21.15.89:0/2919878318 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7fa4a004b720 con 0x7fa4a0076c80 2024-09-13T02:45:57.181 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:56.555+0000 7fa4967fc640 1 -- 172.21.15.89:0/2919878318 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mgrmap(e 9) v1 ==== 45520+0+0 (secure 0 0 0) 0x7fa49c030d50 con 0x7fa4a0076c80 2024-09-13T02:45:57.181 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:56.557+0000 7fa4967fc640 1 -- 172.21.15.89:0/2919878318 <== mon.0 v2:172.21.15.89:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7fa49c03b360 con 0x7fa4a0076c80 2024-09-13T02:45:57.181 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:56.559+0000 7fa4a8074640 1 -- 172.21.15.89:0/2919878318 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7fa48c039490 msgr2=0x7fa48c03b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:57.181 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:56.559+0000 7fa4a8074640 1 --2- 172.21.15.89:0/2919878318 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7fa48c039490 0x7fa48c03b940 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fa490006fd0 tx=0x7fa490006db0 comp rx=0 tx=0).stop 2024-09-13T02:45:57.181 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:56.559+0000 7fa4a8074640 1 -- 172.21.15.89:0/2919878318 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4a0076c80 msgr2=0x7fa4a0110e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:57.181 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:56.559+0000 7fa4a8074640 1 --2- 172.21.15.89:0/2919878318 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4a0076c80 0x7fa4a0110e50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fa49c009420 tx=0x7fa49c0091d0 comp rx=0 tx=0).stop 2024-09-13T02:45:57.181 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:56.559+0000 7fa4a8074640 1 -- 172.21.15.89:0/2919878318 shutdown_connections 2024-09-13T02:45:57.181 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:56.559+0000 7fa4a8074640 1 --2- 172.21.15.89:0/2919878318 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7fa48c039490 0x7fa48c03b940 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:57.181 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:56.559+0000 7fa4a8074640 1 --2- 172.21.15.89:0/2919878318 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4a0076c80 0x7fa4a0110e50 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:57.181 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:56.559+0000 7fa4a8074640 1 -- 172.21.15.89:0/2919878318 >> 172.21.15.89:0/2919878318 conn(0x7fa4a00fc620 msgr2=0x7fa4a00fd1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:45:57.181 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:56.559+0000 7fa4a8074640 1 -- 172.21.15.89:0/2919878318 shutdown_connections 2024-09-13T02:45:57.182 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:56.559+0000 7fa4a8074640 1 -- 172.21.15.89:0/2919878318 wait complete. 2024-09-13T02:45:57.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:57 smithi089 ceph-mon[27639]: from='client.? 172.21.15.89:0/2919878318' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-13T02:45:57.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:57 smithi089 ceph-mon[27639]: mgrmap e9: smithi089.guohvs(active, since 23s) 2024-09-13T02:45:58.366 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout { 2024-09-13T02:45:58.366 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-13T02:45:58.367 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-13T02:45:58.367 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "active_name": "smithi089.guohvs", 2024-09-13T02:45:58.367 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-13T02:45:58.367 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout } 2024-09-13T02:45:58.367 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:57.580+0000 7fd7e9d42640 1 Processor -- start 2024-09-13T02:45:58.367 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:57.580+0000 7fd7e9d42640 1 -- start start 2024-09-13T02:45:58.367 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:57.580+0000 7fd7e9d42640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7e4101f90 0x7fd7e41023a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:45:58.367 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:57.580+0000 7fd7e9d42640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e41028e0 con 0x7fd7e4101f90 2024-09-13T02:45:58.367 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:57.580+0000 7fd7e37fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7e4101f90 0x7fd7e41023a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:45:58.367 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:57.580+0000 7fd7e37fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7e4101f90 0x7fd7e41023a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:53390/0 (socket says 172.21.15.89:53390) 2024-09-13T02:45:58.367 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:57.580+0000 7fd7e37fe640 1 -- 172.21.15.89:0/1923931786 learned_addr learned my addr 172.21.15.89:0/1923931786 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:45:58.367 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:57.580+0000 7fd7e37fe640 1 -- 172.21.15.89:0/1923931786 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7e4102a20 con 0x7fd7e4101f90 2024-09-13T02:45:58.367 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:57.581+0000 7fd7e37fe640 1 --2- 172.21.15.89:0/1923931786 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7e4101f90 0x7fd7e41023a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd7d4009840 tx=0x7fd7d40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2c0c8ef528f6847 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:45:58.367 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:57.581+0000 7fd7e27fc640 1 -- 172.21.15.89:0/1923931786 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd7d4032440 con 0x7fd7e4101f90 2024-09-13T02:45:58.368 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:57.581+0000 7fd7e27fc640 1 -- 172.21.15.89:0/1923931786 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd7d4032a40 con 0x7fd7e4101f90 2024-09-13T02:45:58.368 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:57.581+0000 7fd7e27fc640 1 -- 172.21.15.89:0/1923931786 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd7d4031a70 con 0x7fd7e4101f90 2024-09-13T02:45:58.368 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:57.582+0000 7fd7e9d42640 1 -- 172.21.15.89:0/1923931786 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7e4101f90 msgr2=0x7fd7e41023a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:58.368 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:57.582+0000 7fd7e9d42640 1 --2- 172.21.15.89:0/1923931786 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7e4101f90 0x7fd7e41023a0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fd7d4009840 tx=0x7fd7d40091d0 comp rx=0 tx=0).stop 2024-09-13T02:45:58.368 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:57.582+0000 7fd7e9d42640 1 -- 172.21.15.89:0/1923931786 shutdown_connections 2024-09-13T02:45:58.368 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:57.582+0000 7fd7e9d42640 1 --2- 172.21.15.89:0/1923931786 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7e4101f90 0x7fd7e41023a0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:58.368 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:57.582+0000 7fd7e9d42640 1 -- 172.21.15.89:0/1923931786 >> 172.21.15.89:0/1923931786 conn(0x7fd7e40fd730 msgr2=0x7fd7e40ffb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:45:58.368 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:57.582+0000 7fd7e9d42640 1 -- 172.21.15.89:0/1923931786 shutdown_connections 2024-09-13T02:45:58.368 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:57.582+0000 7fd7e9d42640 1 -- 172.21.15.89:0/1923931786 wait complete. 2024-09-13T02:45:58.368 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:57.582+0000 7fd7e9d42640 1 Processor -- start 2024-09-13T02:45:58.368 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:57.583+0000 7fd7e9d42640 1 -- start start 2024-09-13T02:45:58.368 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:57.583+0000 7fd7e9d42640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7e4101f90 0x7fd7e4110e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:45:58.369 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:57.583+0000 7fd7e9d42640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e4111350 con 0x7fd7e4101f90 2024-09-13T02:45:58.369 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:57.583+0000 7fd7e37fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7e4101f90 0x7fd7e4110e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:45:58.369 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:57.583+0000 7fd7e37fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7e4101f90 0x7fd7e4110e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:53400/0 (socket says 172.21.15.89:53400) 2024-09-13T02:45:58.369 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:57.583+0000 7fd7e37fe640 1 -- 172.21.15.89:0/1299597374 learned_addr learned my addr 172.21.15.89:0/1299597374 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:45:58.369 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:57.583+0000 7fd7e37fe640 1 -- 172.21.15.89:0/1299597374 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7d4009450 con 0x7fd7e4101f90 2024-09-13T02:45:58.369 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:57.583+0000 7fd7e37fe640 1 --2- 172.21.15.89:0/1299597374 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7e4101f90 0x7fd7e4110e10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd7d4009810 tx=0x7fd7d40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:45:58.369 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:57.584+0000 7fd7cbfff640 1 -- 172.21.15.89:0/1299597374 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd7d403c400 con 0x7fd7e4101f90 2024-09-13T02:45:58.369 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:57.584+0000 7fd7e9d42640 1 -- 172.21.15.89:0/1299597374 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7e4111550 con 0x7fd7e4101f90 2024-09-13T02:45:58.369 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:57.584+0000 7fd7cbfff640 1 -- 172.21.15.89:0/1299597374 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd7d403ca00 con 0x7fd7e4101f90 2024-09-13T02:45:58.369 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:57.584+0000 7fd7cbfff640 1 -- 172.21.15.89:0/1299597374 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd7d403a870 con 0x7fd7e4101f90 2024-09-13T02:45:58.370 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:57.584+0000 7fd7e9d42640 1 -- 172.21.15.89:0/1299597374 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7e4111fa0 con 0x7fd7e4101f90 2024-09-13T02:45:58.370 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:57.585+0000 7fd7cbfff640 1 -- 172.21.15.89:0/1299597374 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 9) v1 ==== 45520+0+0 (secure 0 0 0) 0x7fd7d403ab30 con 0x7fd7e4101f90 2024-09-13T02:45:58.370 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:57.585+0000 7fd7e9d42640 1 -- 172.21.15.89:0/1299597374 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7e41013f0 con 0x7fd7e4101f90 2024-09-13T02:45:58.370 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:57.585+0000 7fd7cbfff640 1 --2- 172.21.15.89:0/1299597374 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7fd7cc0394e0 0x7fd7cc03b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:45:58.370 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:57.585+0000 7fd7cbfff640 1 -- 172.21.15.89:0/1299597374 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7fd7d406d190 con 0x7fd7e4101f90 2024-09-13T02:45:58.370 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:57.585+0000 7fd7e2ffd640 1 -- 172.21.15.89:0/1299597374 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7fd7cc0394e0 msgr2=0x7fd7cc03b990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.89:6800/702640100 2024-09-13T02:45:58.370 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:57.585+0000 7fd7e2ffd640 1 --2- 172.21.15.89:0/1299597374 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7fd7cc0394e0 0x7fd7cc03b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T02:45:58.370 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:57.593+0000 7fd7cbfff640 1 -- 172.21.15.89:0/1299597374 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fd7d4030b20 con 0x7fd7e4101f90 2024-09-13T02:45:58.370 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:57.786+0000 7fd7e2ffd640 1 -- 172.21.15.89:0/1299597374 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7fd7cc0394e0 msgr2=0x7fd7cc03b990 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.89:6800/702640100 2024-09-13T02:45:58.371 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:57.786+0000 7fd7e2ffd640 1 --2- 172.21.15.89:0/1299597374 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7fd7cc0394e0 0x7fd7cc03b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T02:45:58.371 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:57.797+0000 7fd7e9d42640 1 -- 172.21.15.89:0/1299597374 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7fd7e4112360 con 0x7fd7e4101f90 2024-09-13T02:45:58.371 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:57.797+0000 7fd7cbfff640 1 -- 172.21.15.89:0/1299597374 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+103 (secure 0 0 0) 0x7fd7d4037070 con 0x7fd7e4101f90 2024-09-13T02:45:58.371 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:57.799+0000 7fd7e9d42640 1 -- 172.21.15.89:0/1299597374 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7fd7cc0394e0 msgr2=0x7fd7cc03b990 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T02:45:58.371 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:57.799+0000 7fd7e9d42640 1 --2- 172.21.15.89:0/1299597374 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7fd7cc0394e0 0x7fd7cc03b990 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:58.371 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:57.799+0000 7fd7e9d42640 1 -- 172.21.15.89:0/1299597374 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7e4101f90 msgr2=0x7fd7e4110e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:45:58.371 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:57.799+0000 7fd7e9d42640 1 --2- 172.21.15.89:0/1299597374 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7e4101f90 0x7fd7e4110e10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fd7d4009810 tx=0x7fd7d40091d0 comp rx=0 tx=0).stop 2024-09-13T02:45:58.371 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:57.799+0000 7fd7e9d42640 1 -- 172.21.15.89:0/1299597374 shutdown_connections 2024-09-13T02:45:58.371 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:57.799+0000 7fd7e9d42640 1 --2- 172.21.15.89:0/1299597374 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7fd7cc0394e0 0x7fd7cc03b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:58.371 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:57.799+0000 7fd7e9d42640 1 --2- 172.21.15.89:0/1299597374 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd7e4101f90 0x7fd7e4110e10 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:45:58.371 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:57.799+0000 7fd7e9d42640 1 -- 172.21.15.89:0/1299597374 >> 172.21.15.89:0/1299597374 conn(0x7fd7e40fd730 msgr2=0x7fd7e40fe280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:45:58.371 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:57.799+0000 7fd7e9d42640 1 -- 172.21.15.89:0/1299597374 shutdown_connections 2024-09-13T02:45:58.371 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:57.799+0000 7fd7e9d42640 1 -- 172.21.15.89:0/1299597374 wait complete. 2024-09-13T02:45:58.371 INFO:teuthology.orchestra.run.smithi089.stdout:Waiting for the mgr to restart... 2024-09-13T02:45:58.372 INFO:teuthology.orchestra.run.smithi089.stdout:Waiting for mgr epoch 9... 2024-09-13T02:45:58.678 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:45:58 smithi089 ceph-mon[27639]: from='client.? 172.21.15.89:0/1299597374' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-13T02:46:01.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:01 smithi089 ceph-mon[27639]: Active manager daemon smithi089.guohvs restarted 2024-09-13T02:46:01.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:01 smithi089 ceph-mon[27639]: Activating manager daemon smithi089.guohvs 2024-09-13T02:46:01.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:01 smithi089 ceph-mon[27639]: osdmap e3: 0 total, 0 up, 0 in 2024-09-13T02:46:01.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:01 smithi089 ceph-mon[27639]: mgrmap e10: smithi089.guohvs(active, starting, since 0.00362756s) 2024-09-13T02:46:01.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:01 smithi089 ceph-mon[27639]: from='mgr.14158 172.21.15.89:0/2682144324' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mon metadata", "id": "smithi089"}]: dispatch 2024-09-13T02:46:01.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:01 smithi089 ceph-mon[27639]: from='mgr.14158 172.21.15.89:0/2682144324' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mgr metadata", "who": "smithi089.guohvs", "id": "smithi089.guohvs"}]: dispatch 2024-09-13T02:46:01.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:01 smithi089 ceph-mon[27639]: from='mgr.14158 172.21.15.89:0/2682144324' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T02:46:01.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:01 smithi089 ceph-mon[27639]: from='mgr.14158 172.21.15.89:0/2682144324' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T02:46:01.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:01 smithi089 ceph-mon[27639]: from='mgr.14158 172.21.15.89:0/2682144324' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T02:46:01.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:01 smithi089 ceph-mon[27639]: Manager daemon smithi089.guohvs is now available 2024-09-13T02:46:01.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:01 smithi089 ceph-mon[27639]: from='mgr.14158 172.21.15.89:0/2682144324' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:46:01.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:01 smithi089 ceph-mon[27639]: from='mgr.14158 172.21.15.89:0/2682144324' entity='mgr.smithi089.guohvs' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi089.guohvs/mirror_snapshot_schedule"}]: dispatch 2024-09-13T02:46:01.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:01 smithi089 ceph-mon[27639]: from='mgr.14158 172.21.15.89:0/2682144324' entity='mgr.smithi089.guohvs' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi089.guohvs/trash_purge_schedule"}]: dispatch 2024-09-13T02:46:02.727 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout { 2024-09-13T02:46:02.727 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-13T02:46:02.727 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-13T02:46:02.727 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout } 2024-09-13T02:46:02.727 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:58.752+0000 7f5eae888640 1 Processor -- start 2024-09-13T02:46:02.727 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:58.752+0000 7f5eae888640 1 -- start start 2024-09-13T02:46:02.727 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:58.753+0000 7f5eae888640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ea8100e90 0x7f5ea81012a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:46:02.727 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:58.753+0000 7f5eae888640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea81017e0 con 0x7f5ea8100e90 2024-09-13T02:46:02.727 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:58.753+0000 7f5ea7fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ea8100e90 0x7f5ea81012a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:46:02.727 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:58.753+0000 7f5ea7fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ea8100e90 0x7f5ea81012a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:53408/0 (socket says 172.21.15.89:53408) 2024-09-13T02:46:02.727 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:58.753+0000 7f5ea7fff640 1 -- 172.21.15.89:0/1276869456 learned_addr learned my addr 172.21.15.89:0/1276869456 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:46:02.728 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:58.753+0000 7f5ea7fff640 1 -- 172.21.15.89:0/1276869456 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ea8101920 con 0x7f5ea8100e90 2024-09-13T02:46:02.728 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:58.754+0000 7f5ea7fff640 1 --2- 172.21.15.89:0/1276869456 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ea8100e90 0x7f5ea81012a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5e9800baf0 tx=0x7f5e9800b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fc6a851779016f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:46:02.728 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:58.754+0000 7f5ea77fe640 1 -- 172.21.15.89:0/1276869456 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5e98031790 con 0x7f5ea8100e90 2024-09-13T02:46:02.728 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:58.754+0000 7f5ea77fe640 1 -- 172.21.15.89:0/1276869456 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f5e98031d90 con 0x7f5ea8100e90 2024-09-13T02:46:02.728 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:58.754+0000 7f5ea77fe640 1 -- 172.21.15.89:0/1276869456 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5e98039e60 con 0x7f5ea8100e90 2024-09-13T02:46:02.728 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:58.755+0000 7f5eae888640 1 -- 172.21.15.89:0/1276869456 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ea8100e90 msgr2=0x7f5ea81012a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:46:02.728 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:58.755+0000 7f5eae888640 1 --2- 172.21.15.89:0/1276869456 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ea8100e90 0x7f5ea81012a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f5e9800baf0 tx=0x7f5e9800b460 comp rx=0 tx=0).stop 2024-09-13T02:46:02.728 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:58.755+0000 7f5eae888640 1 -- 172.21.15.89:0/1276869456 shutdown_connections 2024-09-13T02:46:02.728 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:58.755+0000 7f5eae888640 1 --2- 172.21.15.89:0/1276869456 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ea8100e90 0x7f5ea81012a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:46:02.728 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:58.755+0000 7f5eae888640 1 -- 172.21.15.89:0/1276869456 >> 172.21.15.89:0/1276869456 conn(0x7f5ea80fc6d0 msgr2=0x7f5ea80feb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:46:02.728 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:58.755+0000 7f5eae888640 1 -- 172.21.15.89:0/1276869456 shutdown_connections 2024-09-13T02:46:02.728 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:58.755+0000 7f5eae888640 1 -- 172.21.15.89:0/1276869456 wait complete. 2024-09-13T02:46:02.729 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:58.756+0000 7f5eae888640 1 Processor -- start 2024-09-13T02:46:02.729 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:58.756+0000 7f5eae888640 1 -- start start 2024-09-13T02:46:02.729 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:58.756+0000 7f5eae888640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ea8100e90 0x7f5ea810ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:46:02.729 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:58.756+0000 7f5eae888640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea810f110 con 0x7f5ea8100e90 2024-09-13T02:46:02.729 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:58.756+0000 7f5ea7fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ea8100e90 0x7f5ea810ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:46:02.729 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:58.756+0000 7f5ea7fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ea8100e90 0x7f5ea810ebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:53424/0 (socket says 172.21.15.89:53424) 2024-09-13T02:46:02.729 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:58.756+0000 7f5ea7fff640 1 -- 172.21.15.89:0/837987342 learned_addr learned my addr 172.21.15.89:0/837987342 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:46:02.729 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:58.756+0000 7f5ea7fff640 1 -- 172.21.15.89:0/837987342 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e9800b700 con 0x7f5ea8100e90 2024-09-13T02:46:02.729 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:58.757+0000 7f5ea7fff640 1 --2- 172.21.15.89:0/837987342 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ea8100e90 0x7f5ea810ebd0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5e98003080 tx=0x7f5e9803c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:46:02.729 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:58.757+0000 7f5ea57fa640 1 -- 172.21.15.89:0/837987342 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5e9803a660 con 0x7f5ea8100e90 2024-09-13T02:46:02.729 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:58.757+0000 7f5ea57fa640 1 -- 172.21.15.89:0/837987342 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f5e9803ac60 con 0x7f5ea8100e90 2024-09-13T02:46:02.729 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:58.757+0000 7f5eae888640 1 -- 172.21.15.89:0/837987342 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ea810f310 con 0x7f5ea8100e90 2024-09-13T02:46:02.729 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:58.757+0000 7f5eae888640 1 -- 172.21.15.89:0/837987342 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ea810f780 con 0x7f5ea8100e90 2024-09-13T02:46:02.730 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:58.757+0000 7f5ea57fa640 1 -- 172.21.15.89:0/837987342 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5e98044ac0 con 0x7f5ea8100e90 2024-09-13T02:46:02.730 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:58.758+0000 7f5ea57fa640 1 -- 172.21.15.89:0/837987342 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 9) v1 ==== 45520+0+0 (secure 0 0 0) 0x7f5e98044d30 con 0x7f5ea8100e90 2024-09-13T02:46:02.730 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:58.758+0000 7f5ea57fa640 1 --2- 172.21.15.89:0/837987342 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7f5e94039530 0x7f5e9403b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:46:02.730 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:58.758+0000 7f5ea57fa640 1 -- 172.21.15.89:0/837987342 --> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5e9403c0f0 con 0x7f5e94039530 2024-09-13T02:46:02.730 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:58.758+0000 7f5ea57fa640 1 -- 172.21.15.89:0/837987342 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 936+0+0 (secure 0 0 0) 0x7f5e98070160 con 0x7f5ea8100e90 2024-09-13T02:46:02.730 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:58.758+0000 7f5e9ffff640 1 -- 172.21.15.89:0/837987342 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7f5e94039530 msgr2=0x7f5e9403b9e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.89:6800/702640100 2024-09-13T02:46:02.730 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:58.758+0000 7f5e9ffff640 1 --2- 172.21.15.89:0/837987342 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7f5e94039530 0x7f5e9403b9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T02:46:02.730 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:58.959+0000 7f5e9ffff640 1 -- 172.21.15.89:0/837987342 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7f5e94039530 msgr2=0x7f5e9403b9e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.89:6800/702640100 2024-09-13T02:46:02.730 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:58.959+0000 7f5e9ffff640 1 --2- 172.21.15.89:0/837987342 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7f5e94039530 0x7f5e9403b9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T02:46:02.730 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:59.360+0000 7f5e9ffff640 1 -- 172.21.15.89:0/837987342 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7f5e94039530 msgr2=0x7f5e9403b9e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.89:6800/702640100 2024-09-13T02:46:02.730 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:45:59.360+0000 7f5e9ffff640 1 --2- 172.21.15.89:0/837987342 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7f5e94039530 0x7f5e9403b9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-13T02:46:02.730 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:00.161+0000 7f5e9ffff640 1 -- 172.21.15.89:0/837987342 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7f5e94039530 msgr2=0x7f5e9403b9e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.89:6800/702640100 2024-09-13T02:46:02.731 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:00.161+0000 7f5e9ffff640 1 --2- 172.21.15.89:0/837987342 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7f5e94039530 0x7f5e9403b9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-13T02:46:02.731 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:00.951+0000 7f5ea57fa640 1 -- 172.21.15.89:0/837987342 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mgrmap(e 10) v1 ==== 45287+0+0 (secure 0 0 0) 0x7f5e9806f300 con 0x7f5ea8100e90 2024-09-13T02:46:02.731 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:00.951+0000 7f5ea57fa640 1 -- 172.21.15.89:0/837987342 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7f5e94039530 msgr2=0x7f5e9403b9e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T02:46:02.731 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:00.951+0000 7f5ea57fa640 1 --2- 172.21.15.89:0/837987342 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7f5e94039530 0x7f5e9403b9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:46:02.731 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:01.953+0000 7f5ea57fa640 1 -- 172.21.15.89:0/837987342 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mgrmap(e 11) v1 ==== 45414+0+0 (secure 0 0 0) 0x7f5e980536b0 con 0x7f5ea8100e90 2024-09-13T02:46:02.731 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:01.953+0000 7f5ea57fa640 1 --2- 172.21.15.89:0/837987342 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7f5e9403cff0 0x7f5e9403f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:46:02.731 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:01.953+0000 7f5ea57fa640 1 -- 172.21.15.89:0/837987342 --> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5e9403c0f0 con 0x7f5e9403cff0 2024-09-13T02:46:02.731 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:01.954+0000 7f5e9ffff640 1 --2- 172.21.15.89:0/837987342 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7f5e9403cff0 0x7f5e9403f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:46:02.731 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:01.954+0000 7f5e9ffff640 1 --2- 172.21.15.89:0/837987342 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7f5e9403cff0 0x7f5e9403f3d0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f5e90003940 tx=0x7f5e90009350 comp rx=0 tx=0).ready entity=mgr.14158 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:46:02.731 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:01.955+0000 7f5ea57fa640 1 -- 172.21.15.89:0/837987342 <== mgr.14158 v2:172.21.15.89:6800/3169313021 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6549 (secure 0 0 0) 0x7f5e9403c0f0 con 0x7f5e9403cff0 2024-09-13T02:46:02.731 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:01.960+0000 7f5eae888640 1 -- 172.21.15.89:0/837987342 --> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f5ea810f780 con 0x7f5e9403cff0 2024-09-13T02:46:02.731 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:01.960+0000 7f5ea57fa640 1 -- 172.21.15.89:0/837987342 <== mgr.14158 v2:172.21.15.89:6800/3169313021 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7f5ea810f780 con 0x7f5e9403cff0 2024-09-13T02:46:02.731 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:01.960+0000 7f5eae888640 1 -- 172.21.15.89:0/837987342 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7f5e9403cff0 msgr2=0x7f5e9403f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:46:02.732 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:01.960+0000 7f5eae888640 1 --2- 172.21.15.89:0/837987342 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7f5e9403cff0 0x7f5e9403f3d0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7f5e90003940 tx=0x7f5e90009350 comp rx=0 tx=0).stop 2024-09-13T02:46:02.732 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:01.960+0000 7f5eae888640 1 -- 172.21.15.89:0/837987342 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ea8100e90 msgr2=0x7f5ea810ebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:46:02.732 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:01.960+0000 7f5eae888640 1 --2- 172.21.15.89:0/837987342 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ea8100e90 0x7f5ea810ebd0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5e98003080 tx=0x7f5e9803c040 comp rx=0 tx=0).stop 2024-09-13T02:46:02.732 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:01.960+0000 7f5eae888640 1 -- 172.21.15.89:0/837987342 shutdown_connections 2024-09-13T02:46:02.732 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:01.960+0000 7f5eae888640 1 --2- 172.21.15.89:0/837987342 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7f5e9403cff0 0x7f5e9403f3d0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:46:02.732 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:01.960+0000 7f5eae888640 1 --2- 172.21.15.89:0/837987342 >> [v2:172.21.15.89:6800/702640100,v1:172.21.15.89:6801/702640100] conn(0x7f5e94039530 0x7f5e9403b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:46:02.732 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:01.960+0000 7f5eae888640 1 --2- 172.21.15.89:0/837987342 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ea8100e90 0x7f5ea810ebd0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:46:02.732 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:01.960+0000 7f5eae888640 1 -- 172.21.15.89:0/837987342 >> 172.21.15.89:0/837987342 conn(0x7f5ea80fc6d0 msgr2=0x7f5ea8105430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:46:02.732 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:01.960+0000 7f5eae888640 1 -- 172.21.15.89:0/837987342 shutdown_connections 2024-09-13T02:46:02.732 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:01.960+0000 7f5eae888640 1 -- 172.21.15.89:0/837987342 wait complete. 2024-09-13T02:46:02.732 INFO:teuthology.orchestra.run.smithi089.stdout:mgr epoch 9 is available 2024-09-13T02:46:02.732 INFO:teuthology.orchestra.run.smithi089.stdout:Generating a dashboard self-signed certificate... 2024-09-13T02:46:03.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:02 smithi089 ceph-mon[27639]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-13T02:46:03.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:02 smithi089 ceph-mon[27639]: mgrmap e11: smithi089.guohvs(active, since 1.00684s) 2024-09-13T02:46:03.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:02 smithi089 ceph-mon[27639]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-13T02:46:03.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:02 smithi089 ceph-mon[27639]: from='mgr.14158 172.21.15.89:0/2682144324' entity='mgr.smithi089.guohvs' 2024-09-13T02:46:03.826 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-13T02:46:03.827 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:03.114+0000 7f62cefa2640 1 Processor -- start 2024-09-13T02:46:03.827 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:03.114+0000 7f62cefa2640 1 -- start start 2024-09-13T02:46:03.827 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:03.114+0000 7f62cefa2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62c8101f80 0x7f62c8102390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:46:03.827 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:03.114+0000 7f62cefa2640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62c81028d0 con 0x7f62c8101f80 2024-09-13T02:46:03.827 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:03.114+0000 7f62ccd3e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62c8101f80 0x7f62c8102390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:46:03.827 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:03.114+0000 7f62ccd3e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62c8101f80 0x7f62c8102390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:49076/0 (socket says 172.21.15.89:49076) 2024-09-13T02:46:03.827 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:03.114+0000 7f62ccd3e640 1 -- 172.21.15.89:0/900892194 learned_addr learned my addr 172.21.15.89:0/900892194 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:46:03.827 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:03.115+0000 7f62ccd3e640 1 -- 172.21.15.89:0/900892194 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62c8102a10 con 0x7f62c8101f80 2024-09-13T02:46:03.827 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:03.115+0000 7f62ccd3e640 1 --2- 172.21.15.89:0/900892194 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62c8101f80 0x7f62c8102390 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f62bc009840 tx=0x7f62bc0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67561eff70c36699 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:46:03.827 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:03.115+0000 7f62c77fe640 1 -- 172.21.15.89:0/900892194 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f62bc032440 con 0x7f62c8101f80 2024-09-13T02:46:03.827 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:03.116+0000 7f62c77fe640 1 -- 172.21.15.89:0/900892194 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f62bc032a40 con 0x7f62c8101f80 2024-09-13T02:46:03.828 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:03.116+0000 7f62c77fe640 1 -- 172.21.15.89:0/900892194 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f62bc031a70 con 0x7f62c8101f80 2024-09-13T02:46:03.828 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:03.116+0000 7f62cefa2640 1 -- 172.21.15.89:0/900892194 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62c8101f80 msgr2=0x7f62c8102390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:46:03.828 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:03.116+0000 7f62cefa2640 1 --2- 172.21.15.89:0/900892194 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62c8101f80 0x7f62c8102390 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f62bc009840 tx=0x7f62bc0091d0 comp rx=0 tx=0).stop 2024-09-13T02:46:03.828 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:03.116+0000 7f62cefa2640 1 -- 172.21.15.89:0/900892194 shutdown_connections 2024-09-13T02:46:03.828 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:03.116+0000 7f62cefa2640 1 --2- 172.21.15.89:0/900892194 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62c8101f80 0x7f62c8102390 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:46:03.828 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:03.116+0000 7f62cefa2640 1 -- 172.21.15.89:0/900892194 >> 172.21.15.89:0/900892194 conn(0x7f62c80fd7a0 msgr2=0x7f62c80ffbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:46:03.828 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:03.116+0000 7f62cefa2640 1 -- 172.21.15.89:0/900892194 shutdown_connections 2024-09-13T02:46:03.828 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:03.116+0000 7f62cefa2640 1 -- 172.21.15.89:0/900892194 wait complete. 2024-09-13T02:46:03.828 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:03.117+0000 7f62cefa2640 1 Processor -- start 2024-09-13T02:46:03.828 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:03.117+0000 7f62cefa2640 1 -- start start 2024-09-13T02:46:03.828 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:03.117+0000 7f62cefa2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62c8101f80 0x7f62c8078c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:46:03.828 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:03.117+0000 7f62cefa2640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62c8079140 con 0x7f62c8101f80 2024-09-13T02:46:03.829 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:03.117+0000 7f62ccd3e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62c8101f80 0x7f62c8078c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:46:03.829 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:03.117+0000 7f62ccd3e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62c8101f80 0x7f62c8078c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:49086/0 (socket says 172.21.15.89:49086) 2024-09-13T02:46:03.829 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:03.117+0000 7f62ccd3e640 1 -- 172.21.15.89:0/523007652 learned_addr learned my addr 172.21.15.89:0/523007652 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:46:03.829 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:03.118+0000 7f62ccd3e640 1 -- 172.21.15.89:0/523007652 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62bc009450 con 0x7f62c8101f80 2024-09-13T02:46:03.829 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:03.118+0000 7f62ccd3e640 1 --2- 172.21.15.89:0/523007652 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62c8101f80 0x7f62c8078c00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f62bc031670 tx=0x7f62bc0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:46:03.829 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:03.118+0000 7f62c57fa640 1 -- 172.21.15.89:0/523007652 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f62bc03c400 con 0x7f62c8101f80 2024-09-13T02:46:03.829 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:03.118+0000 7f62cefa2640 1 -- 172.21.15.89:0/523007652 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62c80771d0 con 0x7f62c8101f80 2024-09-13T02:46:03.829 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:03.118+0000 7f62c57fa640 1 -- 172.21.15.89:0/523007652 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f62bc03ca00 con 0x7f62c8101f80 2024-09-13T02:46:03.829 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:03.118+0000 7f62c57fa640 1 -- 172.21.15.89:0/523007652 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f62bc03a910 con 0x7f62c8101f80 2024-09-13T02:46:03.829 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:03.118+0000 7f62cefa2640 1 -- 172.21.15.89:0/523007652 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62c8077640 con 0x7f62c8101f80 2024-09-13T02:46:03.829 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:03.119+0000 7f62cefa2640 1 -- 172.21.15.89:0/523007652 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62c804b720 con 0x7f62c8101f80 2024-09-13T02:46:03.829 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:03.119+0000 7f62c57fa640 1 -- 172.21.15.89:0/523007652 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 11) v1 ==== 45414+0+0 (secure 0 0 0) 0x7f62bc03ab00 con 0x7f62c8101f80 2024-09-13T02:46:03.829 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:03.119+0000 7f62c57fa640 1 --2- 172.21.15.89:0/523007652 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7f62b80393d0 0x7f62b803b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:46:03.830 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:03.119+0000 7f62c57fa640 1 -- 172.21.15.89:0/523007652 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f62bc06cfc0 con 0x7f62c8101f80 2024-09-13T02:46:03.830 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:03.119+0000 7f62c7fff640 1 --2- 172.21.15.89:0/523007652 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7f62b80393d0 0x7f62b803b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:46:03.830 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:03.120+0000 7f62c7fff640 1 --2- 172.21.15.89:0/523007652 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7f62b80393d0 0x7f62b803b880 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f62b4006fd0 tx=0x7f62b4006db0 comp rx=0 tx=0).ready entity=mgr.14158 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:46:03.830 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:03.127+0000 7f62c57fa640 1 -- 172.21.15.89:0/523007652 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f62bc030340 con 0x7f62c8101f80 2024-09-13T02:46:03.830 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:03.305+0000 7f62cefa2640 1 -- 172.21.15.89:0/523007652 --> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7f62c8077cc0 con 0x7f62b80393d0 2024-09-13T02:46:03.830 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:03.340+0000 7f62c57fa640 1 -- 172.21.15.89:0/523007652 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mgrmap(e 12) v1 ==== 45520+0+0 (secure 0 0 0) 0x7f62bc046460 con 0x7f62c8101f80 2024-09-13T02:46:03.830 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:03.358+0000 7f62c57fa640 1 -- 172.21.15.89:0/523007652 <== mgr.14158 v2:172.21.15.89:6800/3169313021 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7f62c8077cc0 con 0x7f62b80393d0 2024-09-13T02:46:03.830 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:03.361+0000 7f62cefa2640 1 -- 172.21.15.89:0/523007652 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7f62b80393d0 msgr2=0x7f62b803b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:46:03.830 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:03.361+0000 7f62cefa2640 1 --2- 172.21.15.89:0/523007652 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7f62b80393d0 0x7f62b803b880 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f62b4006fd0 tx=0x7f62b4006db0 comp rx=0 tx=0).stop 2024-09-13T02:46:03.830 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:03.361+0000 7f62cefa2640 1 -- 172.21.15.89:0/523007652 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62c8101f80 msgr2=0x7f62c8078c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:46:03.830 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:03.361+0000 7f62cefa2640 1 --2- 172.21.15.89:0/523007652 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62c8101f80 0x7f62c8078c00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f62bc031670 tx=0x7f62bc0091d0 comp rx=0 tx=0).stop 2024-09-13T02:46:03.830 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:03.361+0000 7f62cefa2640 1 -- 172.21.15.89:0/523007652 shutdown_connections 2024-09-13T02:46:03.831 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:03.361+0000 7f62cefa2640 1 --2- 172.21.15.89:0/523007652 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7f62b80393d0 0x7f62b803b880 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:46:03.831 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:03.361+0000 7f62cefa2640 1 --2- 172.21.15.89:0/523007652 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62c8101f80 0x7f62c8078c00 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:46:03.831 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:03.361+0000 7f62cefa2640 1 -- 172.21.15.89:0/523007652 >> 172.21.15.89:0/523007652 conn(0x7f62c80fd7a0 msgr2=0x7f62c80fe320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:46:03.831 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:03.361+0000 7f62cefa2640 1 -- 172.21.15.89:0/523007652 shutdown_connections 2024-09-13T02:46:03.831 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:03.361+0000 7f62cefa2640 1 -- 172.21.15.89:0/523007652 wait complete. 2024-09-13T02:46:03.831 INFO:teuthology.orchestra.run.smithi089.stdout:Creating initial admin user... 2024-09-13T02:46:04.420 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:04 smithi089 ceph-mon[27639]: from='mgr.14158 172.21.15.89:0/2682144324' entity='mgr.smithi089.guohvs' 2024-09-13T02:46:04.420 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:04 smithi089 ceph-mon[27639]: mgrmap e12: smithi089.guohvs(active, since 2s) 2024-09-13T02:46:04.420 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:04 smithi089 ceph-mon[27639]: from='mgr.14158 172.21.15.89:0/2682144324' entity='mgr.smithi089.guohvs' 2024-09-13T02:46:04.421 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:04 smithi089 ceph-mon[27639]: from='mgr.14158 172.21.15.89:0/2682144324' entity='mgr.smithi089.guohvs' 2024-09-13T02:46:04.421 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:04 smithi089 ceph-mon[27639]: [13/Sep/2024:02:46:03] ENGINE Bus STARTING 2024-09-13T02:46:04.421 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:04 smithi089 ceph-mon[27639]: [13/Sep/2024:02:46:03] ENGINE Serving on https://172.21.15.89:7150 2024-09-13T02:46:04.421 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:04 smithi089 ceph-mon[27639]: [13/Sep/2024:02:46:03] ENGINE Bus STARTED 2024-09-13T02:46:04.421 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:04 smithi089 ceph-mon[27639]: [13/Sep/2024:02:46:03] ENGINE Error in HTTPServer.serve 2024-09-13T02:46:04.421 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Traceback (most recent call last): 2024-09-13T02:46:04.421 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T02:46:04.421 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: self._connections.run(self.expiration_interval) 2024-09-13T02:46:04.421 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T02:46:04.421 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: self._run(expiration_interval) 2024-09-13T02:46:04.422 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T02:46:04.422 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T02:46:04.422 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T02:46:04.422 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T02:46:04.422 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T02:46:04.422 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: s = self.context.wrap_socket( 2024-09-13T02:46:04.422 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T02:46:04.422 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: return self.sslsocket_class._create( 2024-09-13T02:46:04.422 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T02:46:04.422 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: self.do_handshake() 2024-09-13T02:46:04.422 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T02:46:04.423 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: self._sslobj.do_handshake() 2024-09-13T02:46:04.423 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T02:46:04.423 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:04 smithi089 ceph-mon[27639]: from='mgr.14158 172.21.15.89:0/2682144324' entity='mgr.smithi089.guohvs' 2024-09-13T02:46:05.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:05 smithi089 ceph-mon[27639]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:46:05.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:05 smithi089 ceph-mon[27639]: from='mgr.14158 172.21.15.89:0/2682144324' entity='mgr.smithi089.guohvs' 2024-09-13T02:46:05.821 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$Jtc8495PpjA9GZVWqfklv.LDWM6QXh5/PU5QWu6yCY5JCgOUH70o6", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726195564, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-13T02:46:05.821 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:04.262+0000 7fbbc1fa1640 1 Processor -- start 2024-09-13T02:46:05.821 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:04.262+0000 7fbbc1fa1640 1 -- start start 2024-09-13T02:46:05.821 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:04.262+0000 7fbbc1fa1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbbbc102070 0x7fbbbc102480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:46:05.821 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:04.262+0000 7fbbc1fa1640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbbc1029c0 con 0x7fbbbc102070 2024-09-13T02:46:05.821 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:04.262+0000 7fbbbb7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbbbc102070 0x7fbbbc102480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:46:05.821 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:04.262+0000 7fbbbb7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbbbc102070 0x7fbbbc102480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:49100/0 (socket says 172.21.15.89:49100) 2024-09-13T02:46:05.821 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:04.262+0000 7fbbbb7fe640 1 -- 172.21.15.89:0/166235951 learned_addr learned my addr 172.21.15.89:0/166235951 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:46:05.821 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:04.263+0000 7fbbbb7fe640 1 -- 172.21.15.89:0/166235951 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbbc102b00 con 0x7fbbbc102070 2024-09-13T02:46:05.821 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:04.263+0000 7fbbbb7fe640 1 --2- 172.21.15.89:0/166235951 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbbbc102070 0x7fbbbc102480 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fbbac009840 tx=0x7fbbac0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=501d1ca18e1243f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:46:05.821 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:04.263+0000 7fbbba7fc640 1 -- 172.21.15.89:0/166235951 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbbac032440 con 0x7fbbbc102070 2024-09-13T02:46:05.822 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:04.263+0000 7fbbba7fc640 1 -- 172.21.15.89:0/166235951 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fbbac032a40 con 0x7fbbbc102070 2024-09-13T02:46:05.822 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:04.264+0000 7fbbba7fc640 1 -- 172.21.15.89:0/166235951 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbbac031aa0 con 0x7fbbbc102070 2024-09-13T02:46:05.822 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:04.264+0000 7fbbc1fa1640 1 -- 172.21.15.89:0/166235951 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbbbc102070 msgr2=0x7fbbbc102480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:46:05.822 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:04.264+0000 7fbbc1fa1640 1 --2- 172.21.15.89:0/166235951 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbbbc102070 0x7fbbbc102480 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fbbac009840 tx=0x7fbbac0091d0 comp rx=0 tx=0).stop 2024-09-13T02:46:05.822 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:04.264+0000 7fbbc1fa1640 1 -- 172.21.15.89:0/166235951 shutdown_connections 2024-09-13T02:46:05.822 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:04.264+0000 7fbbc1fa1640 1 --2- 172.21.15.89:0/166235951 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbbbc102070 0x7fbbbc102480 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:46:05.822 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:04.264+0000 7fbbc1fa1640 1 -- 172.21.15.89:0/166235951 >> 172.21.15.89:0/166235951 conn(0x7fbbbc0fd850 msgr2=0x7fbbbc0ffc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:46:05.822 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:04.264+0000 7fbbc1fa1640 1 -- 172.21.15.89:0/166235951 shutdown_connections 2024-09-13T02:46:05.822 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:04.264+0000 7fbbc1fa1640 1 -- 172.21.15.89:0/166235951 wait complete. 2024-09-13T02:46:05.822 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:04.265+0000 7fbbc1fa1640 1 Processor -- start 2024-09-13T02:46:05.822 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:04.265+0000 7fbbc1fa1640 1 -- start start 2024-09-13T02:46:05.822 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:04.265+0000 7fbbc1fa1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbbbc102070 0x7fbbbc110de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:46:05.822 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:04.265+0000 7fbbc1fa1640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbbc111320 con 0x7fbbbc102070 2024-09-13T02:46:05.823 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:04.265+0000 7fbbbb7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbbbc102070 0x7fbbbc110de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:46:05.823 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:04.265+0000 7fbbbb7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbbbc102070 0x7fbbbc110de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:49108/0 (socket says 172.21.15.89:49108) 2024-09-13T02:46:05.823 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:04.265+0000 7fbbbb7fe640 1 -- 172.21.15.89:0/2807448883 learned_addr learned my addr 172.21.15.89:0/2807448883 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:46:05.823 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:04.265+0000 7fbbbb7fe640 1 -- 172.21.15.89:0/2807448883 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbac009450 con 0x7fbbbc102070 2024-09-13T02:46:05.823 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:04.265+0000 7fbbbb7fe640 1 --2- 172.21.15.89:0/2807448883 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbbbc102070 0x7fbbbc110de0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbbac009810 tx=0x7fbbac0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:46:05.823 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:04.266+0000 7fbba3fff640 1 -- 172.21.15.89:0/2807448883 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbbac0327b0 con 0x7fbbbc102070 2024-09-13T02:46:05.823 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:04.266+0000 7fbba3fff640 1 -- 172.21.15.89:0/2807448883 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fbbac03b8d0 con 0x7fbbbc102070 2024-09-13T02:46:05.823 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:04.266+0000 7fbba3fff640 1 -- 172.21.15.89:0/2807448883 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbbac03a6f0 con 0x7fbbbc102070 2024-09-13T02:46:05.823 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:04.266+0000 7fbbc1fa1640 1 -- 172.21.15.89:0/2807448883 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbbc111520 con 0x7fbbbc102070 2024-09-13T02:46:05.823 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:04.266+0000 7fbbc1fa1640 1 -- 172.21.15.89:0/2807448883 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbbc111f70 con 0x7fbbbc102070 2024-09-13T02:46:05.823 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:04.266+0000 7fbba3fff640 1 -- 172.21.15.89:0/2807448883 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 12) v1 ==== 45520+0+0 (secure 0 0 0) 0x7fbbac039040 con 0x7fbbbc102070 2024-09-13T02:46:05.823 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:04.267+0000 7fbba3fff640 1 --2- 172.21.15.89:0/2807448883 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7fbba40394e0 0x7fbba403b990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:46:05.823 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:04.267+0000 7fbba3fff640 1 -- 172.21.15.89:0/2807448883 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fbbac06cd60 con 0x7fbbbc102070 2024-09-13T02:46:05.823 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:04.267+0000 7fbbc1fa1640 1 -- 172.21.15.89:0/2807448883 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbbc1014d0 con 0x7fbbbc102070 2024-09-13T02:46:05.824 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:04.267+0000 7fbbbaffd640 1 --2- 172.21.15.89:0/2807448883 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7fbba40394e0 0x7fbba403b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:46:05.824 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:04.267+0000 7fbbbaffd640 1 --2- 172.21.15.89:0/2807448883 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7fbba40394e0 0x7fbba403b990 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fbbb0006fd0 tx=0x7fbbb0006db0 comp rx=0 tx=0).ready entity=mgr.14158 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:46:05.824 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:04.271+0000 7fbba3fff640 1 -- 172.21.15.89:0/2807448883 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fbbac03f030 con 0x7fbbbc102070 2024-09-13T02:46:05.824 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:04.453+0000 7fbbc1fa1640 1 -- 172.21.15.89:0/2807448883 --> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7fbbbc04b720 con 0x7fbba40394e0 2024-09-13T02:46:05.824 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:04.678+0000 7fbba3fff640 1 -- 172.21.15.89:0/2807448883 <== mgr.14158 v2:172.21.15.89:6800/3169313021 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7fbbbc04b720 con 0x7fbba40394e0 2024-09-13T02:46:05.824 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:04.680+0000 7fbbc1fa1640 1 -- 172.21.15.89:0/2807448883 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7fbba40394e0 msgr2=0x7fbba403b990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:46:05.824 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:04.680+0000 7fbbc1fa1640 1 --2- 172.21.15.89:0/2807448883 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7fbba40394e0 0x7fbba403b990 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fbbb0006fd0 tx=0x7fbbb0006db0 comp rx=0 tx=0).stop 2024-09-13T02:46:05.824 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:04.680+0000 7fbbc1fa1640 1 -- 172.21.15.89:0/2807448883 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbbbc102070 msgr2=0x7fbbbc110de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:46:05.824 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:04.680+0000 7fbbc1fa1640 1 --2- 172.21.15.89:0/2807448883 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbbbc102070 0x7fbbbc110de0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbbac009810 tx=0x7fbbac0091d0 comp rx=0 tx=0).stop 2024-09-13T02:46:05.824 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:04.680+0000 7fbbc1fa1640 1 -- 172.21.15.89:0/2807448883 shutdown_connections 2024-09-13T02:46:05.824 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:04.680+0000 7fbbc1fa1640 1 --2- 172.21.15.89:0/2807448883 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7fbba40394e0 0x7fbba403b990 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:46:05.824 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:04.680+0000 7fbbc1fa1640 1 --2- 172.21.15.89:0/2807448883 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbbbc102070 0x7fbbbc110de0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:46:05.824 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:04.680+0000 7fbbc1fa1640 1 -- 172.21.15.89:0/2807448883 >> 172.21.15.89:0/2807448883 conn(0x7fbbbc0fd850 msgr2=0x7fbbbc0fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:46:05.825 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:04.680+0000 7fbbc1fa1640 1 -- 172.21.15.89:0/2807448883 shutdown_connections 2024-09-13T02:46:05.825 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:04.680+0000 7fbbc1fa1640 1 -- 172.21.15.89:0/2807448883 wait complete. 2024-09-13T02:46:05.825 INFO:teuthology.orchestra.run.smithi089.stdout:Fetching dashboard port number... 2024-09-13T02:46:06.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:06 smithi089 ceph-mon[27639]: from='client.? 172.21.15.89:0/1715173650' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-13T02:46:07.069 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stdout 8443 2024-09-13T02:46:07.069 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:06.281+0000 7fec41d6b640 1 Processor -- start 2024-09-13T02:46:07.069 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:06.281+0000 7fec41d6b640 1 -- start start 2024-09-13T02:46:07.069 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:06.281+0000 7fec41d6b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fec3c076af0 0x7fec3c104c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:46:07.069 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:06.281+0000 7fec41d6b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec3c076f00 con 0x7fec3c076af0 2024-09-13T02:46:07.069 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:06.281+0000 7fec3b7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fec3c076af0 0x7fec3c104c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:46:07.069 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:06.281+0000 7fec3b7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fec3c076af0 0x7fec3c104c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:49118/0 (socket says 172.21.15.89:49118) 2024-09-13T02:46:07.070 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:06.281+0000 7fec3b7fe640 1 -- 172.21.15.89:0/3289028346 learned_addr learned my addr 172.21.15.89:0/3289028346 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:46:07.070 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:06.281+0000 7fec3b7fe640 1 -- 172.21.15.89:0/3289028346 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec3c1051c0 con 0x7fec3c076af0 2024-09-13T02:46:07.070 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:06.282+0000 7fec3b7fe640 1 --2- 172.21.15.89:0/3289028346 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fec3c076af0 0x7fec3c104c80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fec2c009840 tx=0x7fec2c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f35df8ce6f7f62f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:46:07.070 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:06.282+0000 7fec3a7fc640 1 -- 172.21.15.89:0/3289028346 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fec2c032440 con 0x7fec3c076af0 2024-09-13T02:46:07.070 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:06.282+0000 7fec3a7fc640 1 -- 172.21.15.89:0/3289028346 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fec2c032a40 con 0x7fec3c076af0 2024-09-13T02:46:07.070 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:06.282+0000 7fec3a7fc640 1 -- 172.21.15.89:0/3289028346 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fec2c031aa0 con 0x7fec3c076af0 2024-09-13T02:46:07.070 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:06.283+0000 7fec41d6b640 1 -- 172.21.15.89:0/3289028346 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fec3c076af0 msgr2=0x7fec3c104c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:46:07.070 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:06.283+0000 7fec41d6b640 1 --2- 172.21.15.89:0/3289028346 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fec3c076af0 0x7fec3c104c80 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fec2c009840 tx=0x7fec2c0091d0 comp rx=0 tx=0).stop 2024-09-13T02:46:07.070 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:06.283+0000 7fec41d6b640 1 -- 172.21.15.89:0/3289028346 shutdown_connections 2024-09-13T02:46:07.070 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:06.283+0000 7fec41d6b640 1 --2- 172.21.15.89:0/3289028346 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fec3c076af0 0x7fec3c104c80 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:46:07.071 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:06.283+0000 7fec41d6b640 1 -- 172.21.15.89:0/3289028346 >> 172.21.15.89:0/3289028346 conn(0x7fec3c0fc790 msgr2=0x7fec3c0feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:46:07.071 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:06.283+0000 7fec41d6b640 1 -- 172.21.15.89:0/3289028346 shutdown_connections 2024-09-13T02:46:07.071 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:06.283+0000 7fec41d6b640 1 -- 172.21.15.89:0/3289028346 wait complete. 2024-09-13T02:46:07.071 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:06.283+0000 7fec41d6b640 1 Processor -- start 2024-09-13T02:46:07.071 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:06.284+0000 7fec41d6b640 1 -- start start 2024-09-13T02:46:07.071 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:06.284+0000 7fec41d6b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fec3c076af0 0x7fec3c110e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:46:07.071 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:06.284+0000 7fec41d6b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec3c111340 con 0x7fec3c076af0 2024-09-13T02:46:07.072 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:06.284+0000 7fec3b7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fec3c076af0 0x7fec3c110e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:46:07.072 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:06.284+0000 7fec3b7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fec3c076af0 0x7fec3c110e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:49132/0 (socket says 172.21.15.89:49132) 2024-09-13T02:46:07.072 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:06.284+0000 7fec3b7fe640 1 -- 172.21.15.89:0/1715173650 learned_addr learned my addr 172.21.15.89:0/1715173650 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:46:07.072 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:06.284+0000 7fec3b7fe640 1 -- 172.21.15.89:0/1715173650 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec2c009450 con 0x7fec3c076af0 2024-09-13T02:46:07.072 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:06.284+0000 7fec3b7fe640 1 --2- 172.21.15.89:0/1715173650 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fec3c076af0 0x7fec3c110e00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fec2c031780 tx=0x7fec2c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:46:07.072 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:06.284+0000 7fec23fff640 1 -- 172.21.15.89:0/1715173650 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fec2c0327b0 con 0x7fec3c076af0 2024-09-13T02:46:07.072 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:06.284+0000 7fec23fff640 1 -- 172.21.15.89:0/1715173650 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fec2c03b8d0 con 0x7fec3c076af0 2024-09-13T02:46:07.072 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:06.284+0000 7fec41d6b640 1 -- 172.21.15.89:0/1715173650 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec3c1115a0 con 0x7fec3c076af0 2024-09-13T02:46:07.072 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:06.284+0000 7fec23fff640 1 -- 172.21.15.89:0/1715173650 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fec2c03a790 con 0x7fec3c076af0 2024-09-13T02:46:07.072 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:06.285+0000 7fec41d6b640 1 -- 172.21.15.89:0/1715173650 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec3c111f90 con 0x7fec3c076af0 2024-09-13T02:46:07.072 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:06.285+0000 7fec23fff640 1 -- 172.21.15.89:0/1715173650 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 12) v1 ==== 45520+0+0 (secure 0 0 0) 0x7fec2c039040 con 0x7fec3c076af0 2024-09-13T02:46:07.072 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:06.285+0000 7fec23fff640 1 --2- 172.21.15.89:0/1715173650 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7fec24039530 0x7fec2403b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:46:07.073 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:06.285+0000 7fec41d6b640 1 -- 172.21.15.89:0/1715173650 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec3c1003f0 con 0x7fec3c076af0 2024-09-13T02:46:07.073 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:06.286+0000 7fec23fff640 1 -- 172.21.15.89:0/1715173650 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fec2c06cbd0 con 0x7fec3c076af0 2024-09-13T02:46:07.073 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:06.286+0000 7fec3affd640 1 --2- 172.21.15.89:0/1715173650 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7fec24039530 0x7fec2403b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:46:07.073 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:06.286+0000 7fec3affd640 1 --2- 172.21.15.89:0/1715173650 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7fec24039530 0x7fec2403b9e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fec30006fd0 tx=0x7fec30006db0 comp rx=0 tx=0).ready entity=mgr.14158 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:46:07.073 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:06.290+0000 7fec23fff640 1 -- 172.21.15.89:0/1715173650 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fec2c04bae0 con 0x7fec3c076af0 2024-09-13T02:46:07.073 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:06.445+0000 7fec41d6b640 1 -- 172.21.15.89:0/1715173650 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7fec3c04b720 con 0x7fec3c076af0 2024-09-13T02:46:07.073 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:06.445+0000 7fec23fff640 1 -- 172.21.15.89:0/1715173650 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7fec2c03f070 con 0x7fec3c076af0 2024-09-13T02:46:07.073 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:06.447+0000 7fec41d6b640 1 -- 172.21.15.89:0/1715173650 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7fec24039530 msgr2=0x7fec2403b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:46:07.073 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:06.447+0000 7fec41d6b640 1 --2- 172.21.15.89:0/1715173650 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7fec24039530 0x7fec2403b9e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fec30006fd0 tx=0x7fec30006db0 comp rx=0 tx=0).stop 2024-09-13T02:46:07.073 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:06.447+0000 7fec41d6b640 1 -- 172.21.15.89:0/1715173650 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fec3c076af0 msgr2=0x7fec3c110e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:46:07.073 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:06.447+0000 7fec41d6b640 1 --2- 172.21.15.89:0/1715173650 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fec3c076af0 0x7fec3c110e00 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fec2c031780 tx=0x7fec2c0091d0 comp rx=0 tx=0).stop 2024-09-13T02:46:07.073 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:06.447+0000 7fec41d6b640 1 -- 172.21.15.89:0/1715173650 shutdown_connections 2024-09-13T02:46:07.074 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:06.447+0000 7fec41d6b640 1 --2- 172.21.15.89:0/1715173650 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7fec24039530 0x7fec2403b9e0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:46:07.074 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:06.447+0000 7fec41d6b640 1 --2- 172.21.15.89:0/1715173650 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fec3c076af0 0x7fec3c110e00 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:46:07.074 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:06.447+0000 7fec41d6b640 1 -- 172.21.15.89:0/1715173650 >> 172.21.15.89:0/1715173650 conn(0x7fec3c0fc790 msgr2=0x7fec3c0fd370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:46:07.074 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:06.448+0000 7fec41d6b640 1 -- 172.21.15.89:0/1715173650 shutdown_connections 2024-09-13T02:46:07.074 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:06.448+0000 7fec41d6b640 1 -- 172.21.15.89:0/1715173650 wait complete. 2024-09-13T02:46:07.075 INFO:teuthology.orchestra.run.smithi089.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-13T02:46:07.075 INFO:teuthology.orchestra.run.smithi089.stdout:systemctl: stdout disabled 2024-09-13T02:46:07.083 INFO:teuthology.orchestra.run.smithi089.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-13T02:46:07.083 INFO:teuthology.orchestra.run.smithi089.stdout:systemctl: stdout inactive 2024-09-13T02:46:07.083 INFO:teuthology.orchestra.run.smithi089.stdout:firewalld.service is not enabled 2024-09-13T02:46:07.083 INFO:teuthology.orchestra.run.smithi089.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-13T02:46:07.084 INFO:teuthology.orchestra.run.smithi089.stdout:Ceph Dashboard is now available at: 2024-09-13T02:46:07.084 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:46:07.084 INFO:teuthology.orchestra.run.smithi089.stdout: URL: https://smithi089.front.sepia.ceph.com:8443/ 2024-09-13T02:46:07.084 INFO:teuthology.orchestra.run.smithi089.stdout: User: admin 2024-09-13T02:46:07.084 INFO:teuthology.orchestra.run.smithi089.stdout: Password: 1qng3t1whd 2024-09-13T02:46:07.085 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:46:07.085 INFO:teuthology.orchestra.run.smithi089.stdout:Saving cluster configuration to /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/config directory 2024-09-13T02:46:07.085 INFO:teuthology.orchestra.run.smithi089.stdout:Enabling autotune for osd_memory_target 2024-09-13T02:46:08.260 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:07.507+0000 7f64571ea640 1 Processor -- start 2024-09-13T02:46:08.260 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:07.507+0000 7f64571ea640 1 -- start start 2024-09-13T02:46:08.260 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:07.507+0000 7f64571ea640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6450100300 0x7f6450100710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:46:08.261 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:07.507+0000 7f64571ea640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6450100c50 con 0x7f6450100300 2024-09-13T02:46:08.261 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:07.508+0000 7f6454f86640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6450100300 0x7f6450100710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:46:08.261 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:07.508+0000 7f6454f86640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6450100300 0x7f6450100710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:49144/0 (socket says 172.21.15.89:49144) 2024-09-13T02:46:08.261 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:07.508+0000 7f6454f86640 1 -- 172.21.15.89:0/4010015820 learned_addr learned my addr 172.21.15.89:0/4010015820 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:46:08.261 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:07.508+0000 7f6454f86640 1 -- 172.21.15.89:0/4010015820 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6450100d90 con 0x7f6450100300 2024-09-13T02:46:08.261 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:07.508+0000 7f6454f86640 1 --2- 172.21.15.89:0/4010015820 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6450100300 0x7f6450100710 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6444009840 tx=0x7f64440091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38c9a293987b36af server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:46:08.261 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:07.509+0000 7f644f7fe640 1 -- 172.21.15.89:0/4010015820 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6444032440 con 0x7f6450100300 2024-09-13T02:46:08.261 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:07.509+0000 7f644f7fe640 1 -- 172.21.15.89:0/4010015820 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f6444032a40 con 0x7f6450100300 2024-09-13T02:46:08.261 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:07.509+0000 7f644f7fe640 1 -- 172.21.15.89:0/4010015820 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6444031a70 con 0x7f6450100300 2024-09-13T02:46:08.261 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:07.509+0000 7f64571ea640 1 -- 172.21.15.89:0/4010015820 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6450100300 msgr2=0x7f6450100710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:46:08.261 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:07.509+0000 7f64571ea640 1 --2- 172.21.15.89:0/4010015820 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6450100300 0x7f6450100710 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6444009840 tx=0x7f64440091d0 comp rx=0 tx=0).stop 2024-09-13T02:46:08.261 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:07.509+0000 7f64571ea640 1 -- 172.21.15.89:0/4010015820 shutdown_connections 2024-09-13T02:46:08.261 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:07.509+0000 7f64571ea640 1 --2- 172.21.15.89:0/4010015820 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6450100300 0x7f6450100710 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:46:08.261 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:07.509+0000 7f64571ea640 1 -- 172.21.15.89:0/4010015820 >> 172.21.15.89:0/4010015820 conn(0x7f64500fbdc0 msgr2=0x7f64500fe1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:46:08.262 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:07.509+0000 7f64571ea640 1 -- 172.21.15.89:0/4010015820 shutdown_connections 2024-09-13T02:46:08.262 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:07.509+0000 7f64571ea640 1 -- 172.21.15.89:0/4010015820 wait complete. 2024-09-13T02:46:08.262 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:07.510+0000 7f64571ea640 1 Processor -- start 2024-09-13T02:46:08.262 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:07.510+0000 7f64571ea640 1 -- start start 2024-09-13T02:46:08.262 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:07.510+0000 7f64571ea640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6450100300 0x7f6450102d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:46:08.262 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:07.510+0000 7f64571ea640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6450103270 con 0x7f6450100300 2024-09-13T02:46:08.262 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:07.510+0000 7f6454f86640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6450100300 0x7f6450102d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:46:08.262 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:07.510+0000 7f6454f86640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6450100300 0x7f6450102d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:49160/0 (socket says 172.21.15.89:49160) 2024-09-13T02:46:08.262 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:07.510+0000 7f6454f86640 1 -- 172.21.15.89:0/2934798029 learned_addr learned my addr 172.21.15.89:0/2934798029 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:46:08.262 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:07.511+0000 7f6454f86640 1 -- 172.21.15.89:0/2934798029 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6444009450 con 0x7f6450100300 2024-09-13T02:46:08.262 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:07.511+0000 7f6454f86640 1 --2- 172.21.15.89:0/2934798029 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6450100300 0x7f6450102d30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6444009810 tx=0x7f64440091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:46:08.262 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:07.511+0000 7f644d7fa640 1 -- 172.21.15.89:0/2934798029 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f644403c400 con 0x7f6450100300 2024-09-13T02:46:08.262 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:07.511+0000 7f644d7fa640 1 -- 172.21.15.89:0/2934798029 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f644403ca00 con 0x7f6450100300 2024-09-13T02:46:08.263 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:07.511+0000 7f64571ea640 1 -- 172.21.15.89:0/2934798029 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6450101300 con 0x7f6450100300 2024-09-13T02:46:08.263 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:07.511+0000 7f644d7fa640 1 -- 172.21.15.89:0/2934798029 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f644403a870 con 0x7f6450100300 2024-09-13T02:46:08.263 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:07.511+0000 7f64571ea640 1 -- 172.21.15.89:0/2934798029 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6450101770 con 0x7f6450100300 2024-09-13T02:46:08.263 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:07.512+0000 7f644d7fa640 1 -- 172.21.15.89:0/2934798029 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 13) v1 ==== 45563+0+0 (secure 0 0 0) 0x7f644403ab30 con 0x7f6450100300 2024-09-13T02:46:08.263 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:07.512+0000 7f64571ea640 1 -- 172.21.15.89:0/2934798029 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6450105f40 con 0x7f6450100300 2024-09-13T02:46:08.263 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:07.512+0000 7f644d7fa640 1 --2- 172.21.15.89:0/2934798029 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7f6440039580 0x7f644003ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:46:08.263 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:07.512+0000 7f644d7fa640 1 -- 172.21.15.89:0/2934798029 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f644406d1c0 con 0x7f6450100300 2024-09-13T02:46:08.263 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:07.512+0000 7f644ffff640 1 --2- 172.21.15.89:0/2934798029 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7f6440039580 0x7f644003ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:46:08.263 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:07.513+0000 7f644ffff640 1 --2- 172.21.15.89:0/2934798029 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7f6440039580 0x7f644003ba30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f643c006fd0 tx=0x7f643c006db0 comp rx=0 tx=0).ready entity=mgr.14158 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:46:08.263 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:07.517+0000 7f644d7fa640 1 -- 172.21.15.89:0/2934798029 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f6444030b20 con 0x7f6450100300 2024-09-13T02:46:08.263 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:07.670+0000 7f64571ea640 1 -- 172.21.15.89:0/2934798029 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7f6450101ed0 con 0x7f6450100300 2024-09-13T02:46:08.263 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:07.671+0000 7f644d7fa640 1 -- 172.21.15.89:0/2934798029 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7f6444037030 con 0x7f6450100300 2024-09-13T02:46:08.263 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:07.673+0000 7f64571ea640 1 -- 172.21.15.89:0/2934798029 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7f6440039580 msgr2=0x7f644003ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:46:08.263 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:07.673+0000 7f64571ea640 1 --2- 172.21.15.89:0/2934798029 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7f6440039580 0x7f644003ba30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f643c006fd0 tx=0x7f643c006db0 comp rx=0 tx=0).stop 2024-09-13T02:46:08.264 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:07.673+0000 7f64571ea640 1 -- 172.21.15.89:0/2934798029 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6450100300 msgr2=0x7f6450102d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:46:08.264 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:07.673+0000 7f64571ea640 1 --2- 172.21.15.89:0/2934798029 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6450100300 0x7f6450102d30 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6444009810 tx=0x7f64440091d0 comp rx=0 tx=0).stop 2024-09-13T02:46:08.264 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:07.673+0000 7f64571ea640 1 -- 172.21.15.89:0/2934798029 shutdown_connections 2024-09-13T02:46:08.264 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:07.673+0000 7f64571ea640 1 --2- 172.21.15.89:0/2934798029 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7f6440039580 0x7f644003ba30 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:46:08.264 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:07.673+0000 7f64571ea640 1 --2- 172.21.15.89:0/2934798029 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6450100300 0x7f6450102d30 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:46:08.264 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:07.673+0000 7f64571ea640 1 -- 172.21.15.89:0/2934798029 >> 172.21.15.89:0/2934798029 conn(0x7f64500fbdc0 msgr2=0x7f64500fca00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:46:08.264 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:07.673+0000 7f64571ea640 1 -- 172.21.15.89:0/2934798029 shutdown_connections 2024-09-13T02:46:08.264 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:07.673+0000 7f64571ea640 1 -- 172.21.15.89:0/2934798029 wait complete. 2024-09-13T02:46:08.671 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:08 smithi089 ceph-mon[27639]: mgrmap e13: smithi089.guohvs(active, since 6s) 2024-09-13T02:46:09.493 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:08.669+0000 7f37a3c87640 1 Processor -- start 2024-09-13T02:46:09.493 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:08.669+0000 7f37a3c87640 1 -- start start 2024-09-13T02:46:09.493 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:08.669+0000 7f37a3c87640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f379c1046e0 0x7f379c104af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:46:09.493 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:08.669+0000 7f37a3c87640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f379c1050c0 con 0x7f379c1046e0 2024-09-13T02:46:09.493 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:08.670+0000 7f37a1a23640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f379c1046e0 0x7f379c104af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:46:09.493 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:08.670+0000 7f37a1a23640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f379c1046e0 0x7f379c104af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:49174/0 (socket says 172.21.15.89:49174) 2024-09-13T02:46:09.493 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:08.670+0000 7f37a1a23640 1 -- 172.21.15.89:0/413291919 learned_addr learned my addr 172.21.15.89:0/413291919 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:46:09.493 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:08.670+0000 7f37a1a23640 1 -- 172.21.15.89:0/413291919 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f379c105200 con 0x7f379c1046e0 2024-09-13T02:46:09.493 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:08.671+0000 7f37a1a23640 1 --2- 172.21.15.89:0/413291919 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f379c1046e0 0x7f379c104af0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3794009e50 tx=0x7f3794009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3637f0da4ca5dc8 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:46:09.494 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:08.671+0000 7f37a0a21640 1 -- 172.21.15.89:0/413291919 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3794031560 con 0x7f379c1046e0 2024-09-13T02:46:09.494 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:08.671+0000 7f37a0a21640 1 -- 172.21.15.89:0/413291919 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f379402d050 con 0x7f379c1046e0 2024-09-13T02:46:09.494 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:08.671+0000 7f37a0a21640 1 -- 172.21.15.89:0/413291919 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3794007a60 con 0x7f379c1046e0 2024-09-13T02:46:09.494 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:08.671+0000 7f37a3c87640 1 -- 172.21.15.89:0/413291919 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f379c1046e0 msgr2=0x7f379c104af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:46:09.494 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:08.671+0000 7f37a3c87640 1 --2- 172.21.15.89:0/413291919 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f379c1046e0 0x7f379c104af0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3794009e50 tx=0x7f3794009840 comp rx=0 tx=0).stop 2024-09-13T02:46:09.494 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:08.671+0000 7f37a3c87640 1 -- 172.21.15.89:0/413291919 shutdown_connections 2024-09-13T02:46:09.494 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:08.671+0000 7f37a3c87640 1 --2- 172.21.15.89:0/413291919 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f379c1046e0 0x7f379c104af0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:46:09.494 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:08.671+0000 7f37a3c87640 1 -- 172.21.15.89:0/413291919 >> 172.21.15.89:0/413291919 conn(0x7f379c077900 msgr2=0x7f379c077d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:46:09.494 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:08.672+0000 7f37a3c87640 1 -- 172.21.15.89:0/413291919 shutdown_connections 2024-09-13T02:46:09.494 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:08.672+0000 7f37a3c87640 1 -- 172.21.15.89:0/413291919 wait complete. 2024-09-13T02:46:09.494 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:08.672+0000 7f37a3c87640 1 Processor -- start 2024-09-13T02:46:09.494 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:08.672+0000 7f37a3c87640 1 -- start start 2024-09-13T02:46:09.494 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:08.672+0000 7f37a3c87640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f379c1046e0 0x7f379c112f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:46:09.495 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:08.672+0000 7f37a3c87640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f379c1134c0 con 0x7f379c1046e0 2024-09-13T02:46:09.495 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:08.672+0000 7f37a1a23640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f379c1046e0 0x7f379c112f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:46:09.495 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:08.672+0000 7f37a1a23640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f379c1046e0 0x7f379c112f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:49180/0 (socket says 172.21.15.89:49180) 2024-09-13T02:46:09.495 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:08.672+0000 7f37a1a23640 1 -- 172.21.15.89:0/226318870 learned_addr learned my addr 172.21.15.89:0/226318870 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:46:09.495 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:08.673+0000 7f37a1a23640 1 -- 172.21.15.89:0/226318870 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3794009ae0 con 0x7f379c1046e0 2024-09-13T02:46:09.495 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:08.673+0000 7f37a1a23640 1 --2- 172.21.15.89:0/226318870 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f379c1046e0 0x7f379c112f80 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3794009560 tx=0x7f3794009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:46:09.495 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:08.673+0000 7f379a7fc640 1 -- 172.21.15.89:0/226318870 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f379403a400 con 0x7f379c1046e0 2024-09-13T02:46:09.495 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:08.673+0000 7f379a7fc640 1 -- 172.21.15.89:0/226318870 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f379403aa00 con 0x7f379c1046e0 2024-09-13T02:46:09.495 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:08.673+0000 7f379a7fc640 1 -- 172.21.15.89:0/226318870 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3794044740 con 0x7f379c1046e0 2024-09-13T02:46:09.495 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:08.673+0000 7f37a3c87640 1 -- 172.21.15.89:0/226318870 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f379c1136c0 con 0x7f379c1046e0 2024-09-13T02:46:09.496 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:08.673+0000 7f37a3c87640 1 -- 172.21.15.89:0/226318870 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f379c113b30 con 0x7f379c1046e0 2024-09-13T02:46:09.496 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:08.674+0000 7f379a7fc640 1 -- 172.21.15.89:0/226318870 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 13) v1 ==== 45563+0+0 (secure 0 0 0) 0x7f3794038040 con 0x7f379c1046e0 2024-09-13T02:46:09.496 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:08.674+0000 7f37a3c87640 1 -- 172.21.15.89:0/226318870 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f379c04b720 con 0x7f379c1046e0 2024-09-13T02:46:09.496 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:08.674+0000 7f379a7fc640 1 --2- 172.21.15.89:0/226318870 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7f3784039580 0x7f378403ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:46:09.496 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:08.674+0000 7f379a7fc640 1 -- 172.21.15.89:0/226318870 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f3794040030 con 0x7f379c1046e0 2024-09-13T02:46:09.496 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:08.674+0000 7f37a1222640 1 --2- 172.21.15.89:0/226318870 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7f3784039580 0x7f378403ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:46:09.496 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:08.675+0000 7f37a1222640 1 --2- 172.21.15.89:0/226318870 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7f3784039580 0x7f378403ba30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3790006fd0 tx=0x7f3790006db0 comp rx=0 tx=0).ready entity=mgr.14158 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:46:09.496 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:08.679+0000 7f379a7fc640 1 -- 172.21.15.89:0/226318870 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f379403ab70 con 0x7f379c1046e0 2024-09-13T02:46:09.496 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:08.917+0000 7f37a3c87640 1 -- 172.21.15.89:0/226318870 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7f379c114550 con 0x7f379c1046e0 2024-09-13T02:46:09.496 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:08.920+0000 7f379a7fc640 1 -- 172.21.15.89:0/226318870 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v33)=0 set mgr/dashboard/cluster/status v33) v1 ==== 153+0+0 (secure 0 0 0) 0x7f3794036070 con 0x7f379c1046e0 2024-09-13T02:46:09.496 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-13T02:46:09.496 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:08.922+0000 7f37a3c87640 1 -- 172.21.15.89:0/226318870 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7f3784039580 msgr2=0x7f378403ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:46:09.496 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:08.922+0000 7f37a3c87640 1 --2- 172.21.15.89:0/226318870 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7f3784039580 0x7f378403ba30 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3790006fd0 tx=0x7f3790006db0 comp rx=0 tx=0).stop 2024-09-13T02:46:09.497 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:08.922+0000 7f37a3c87640 1 -- 172.21.15.89:0/226318870 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f379c1046e0 msgr2=0x7f379c112f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:46:09.497 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:08.922+0000 7f37a3c87640 1 --2- 172.21.15.89:0/226318870 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f379c1046e0 0x7f379c112f80 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f3794009560 tx=0x7f3794009840 comp rx=0 tx=0).stop 2024-09-13T02:46:09.497 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:08.922+0000 7f37a3c87640 1 -- 172.21.15.89:0/226318870 shutdown_connections 2024-09-13T02:46:09.497 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:08.922+0000 7f37a3c87640 1 --2- 172.21.15.89:0/226318870 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7f3784039580 0x7f378403ba30 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:46:09.497 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:08.922+0000 7f37a3c87640 1 --2- 172.21.15.89:0/226318870 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f379c1046e0 0x7f379c112f80 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:46:09.497 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:08.922+0000 7f37a3c87640 1 -- 172.21.15.89:0/226318870 >> 172.21.15.89:0/226318870 conn(0x7f379c077900 msgr2=0x7f379c102520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:46:09.497 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:08.922+0000 7f37a3c87640 1 -- 172.21.15.89:0/226318870 shutdown_connections 2024-09-13T02:46:09.497 INFO:teuthology.orchestra.run.smithi089.stdout:/usr/bin/ceph: stderr 2024-09-13T02:46:08.922+0000 7f37a3c87640 1 -- 172.21.15.89:0/226318870 wait complete. 2024-09-13T02:46:09.497 INFO:teuthology.orchestra.run.smithi089.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-13T02:46:09.497 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:46:09.497 INFO:teuthology.orchestra.run.smithi089.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-13T02:46:09.497 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:46:09.497 INFO:teuthology.orchestra.run.smithi089.stdout:Or, if you are only running a single cluster on this host: 2024-09-13T02:46:09.498 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:46:09.498 INFO:teuthology.orchestra.run.smithi089.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-13T02:46:09.498 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:46:09.498 INFO:teuthology.orchestra.run.smithi089.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-13T02:46:09.498 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:46:09.498 INFO:teuthology.orchestra.run.smithi089.stdout: ceph telemetry on 2024-09-13T02:46:09.498 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:46:09.498 INFO:teuthology.orchestra.run.smithi089.stdout:For more information see: 2024-09-13T02:46:09.498 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:46:09.498 INFO:teuthology.orchestra.run.smithi089.stdout: https://docs.ceph.com/docs/master/mgr/telemetry/ 2024-09-13T02:46:09.498 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:46:09.498 INFO:teuthology.orchestra.run.smithi089.stdout:Bootstrap complete. 2024-09-13T02:46:09.526 INFO:tasks.cephadm:Fetching config... 2024-09-13T02:46:09.526 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-13T02:46:09.526 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-13T02:46:09.542 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-13T02:46:09.542 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-13T02:46:09.543 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-13T02:46:09.599 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-13T02:46:09.599 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-13T02:46:09.599 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/mon.smithi089/keyring of=/dev/stdout 2024-09-13T02:46:09.664 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-13T02:46:09.665 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-13T02:46:09.665 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-13T02:46:09.720 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-13T02:46:09.721 DEBUG:teuthology.orchestra.run.smithi089:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDBiTKiZW9FJBHp5yKgTCjgxQMXuvOIG8mw5R/P43vyQGdekePzAeGJee1H3tM8VQUXHNScoJ3dIWS/W1/GTHHWjzSv/qYpxWn4fUJykbynbiRT30cz3cKOec3kVI18Q1mKWLX3t9TfV4L1/243De6FrEdh0824tnZTgvjLC/lOW6BSsy2vfx9pu66ESDtFIMWhAjm+Os7r7sS9IhQCqHQw2DKhbckwWvUcIpbd4byCEdRj59z7y7h23gypIboWGTDOr8KuakAZJohjpX4ydF3g9ppq3npDWWbrVzQI6rvga/e3+WvppLjwOILC9FxGUdW96WJ+MfpimJCC0d+R9mvC8TTo/9307XJRvcCnpdpEMEFPgLSzBkjn/LjkcGbetfD9gyEzOWmTyCERuA2EyJGB2oogkKqtl0nbv6mDQzA4PydormW9aL4fDIXFLZXT4vmjpYIOOic4CImAs7IeNPlveatmUeqQHhshIBj5b6mTdhMUHbjPAoyZhGLbOvF20ik= ceph-12cdb164-717a-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-13T02:46:09.803 INFO:teuthology.orchestra.run.smithi089.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDBiTKiZW9FJBHp5yKgTCjgxQMXuvOIG8mw5R/P43vyQGdekePzAeGJee1H3tM8VQUXHNScoJ3dIWS/W1/GTHHWjzSv/qYpxWn4fUJykbynbiRT30cz3cKOec3kVI18Q1mKWLX3t9TfV4L1/243De6FrEdh0824tnZTgvjLC/lOW6BSsy2vfx9pu66ESDtFIMWhAjm+Os7r7sS9IhQCqHQw2DKhbckwWvUcIpbd4byCEdRj59z7y7h23gypIboWGTDOr8KuakAZJohjpX4ydF3g9ppq3npDWWbrVzQI6rvga/e3+WvppLjwOILC9FxGUdW96WJ+MfpimJCC0d+R9mvC8TTo/9307XJRvcCnpdpEMEFPgLSzBkjn/LjkcGbetfD9gyEzOWmTyCERuA2EyJGB2oogkKqtl0nbv6mDQzA4PydormW9aL4fDIXFLZXT4vmjpYIOOic4CImAs7IeNPlveatmUeqQHhshIBj5b6mTdhMUHbjPAoyZhGLbOvF20ik= ceph-12cdb164-717a-11ef-bceb-c7b262605968 2024-09-13T02:46:09.816 DEBUG:teuthology.orchestra.run.smithi131:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDBiTKiZW9FJBHp5yKgTCjgxQMXuvOIG8mw5R/P43vyQGdekePzAeGJee1H3tM8VQUXHNScoJ3dIWS/W1/GTHHWjzSv/qYpxWn4fUJykbynbiRT30cz3cKOec3kVI18Q1mKWLX3t9TfV4L1/243De6FrEdh0824tnZTgvjLC/lOW6BSsy2vfx9pu66ESDtFIMWhAjm+Os7r7sS9IhQCqHQw2DKhbckwWvUcIpbd4byCEdRj59z7y7h23gypIboWGTDOr8KuakAZJohjpX4ydF3g9ppq3npDWWbrVzQI6rvga/e3+WvppLjwOILC9FxGUdW96WJ+MfpimJCC0d+R9mvC8TTo/9307XJRvcCnpdpEMEFPgLSzBkjn/LjkcGbetfD9gyEzOWmTyCERuA2EyJGB2oogkKqtl0nbv6mDQzA4PydormW9aL4fDIXFLZXT4vmjpYIOOic4CImAs7IeNPlveatmUeqQHhshIBj5b6mTdhMUHbjPAoyZhGLbOvF20ik= ceph-12cdb164-717a-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-13T02:46:09.935 INFO:teuthology.orchestra.run.smithi131.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDBiTKiZW9FJBHp5yKgTCjgxQMXuvOIG8mw5R/P43vyQGdekePzAeGJee1H3tM8VQUXHNScoJ3dIWS/W1/GTHHWjzSv/qYpxWn4fUJykbynbiRT30cz3cKOec3kVI18Q1mKWLX3t9TfV4L1/243De6FrEdh0824tnZTgvjLC/lOW6BSsy2vfx9pu66ESDtFIMWhAjm+Os7r7sS9IhQCqHQw2DKhbckwWvUcIpbd4byCEdRj59z7y7h23gypIboWGTDOr8KuakAZJohjpX4ydF3g9ppq3npDWWbrVzQI6rvga/e3+WvppLjwOILC9FxGUdW96WJ+MfpimJCC0d+R9mvC8TTo/9307XJRvcCnpdpEMEFPgLSzBkjn/LjkcGbetfD9gyEzOWmTyCERuA2EyJGB2oogkKqtl0nbv6mDQzA4PydormW9aL4fDIXFLZXT4vmjpYIOOic4CImAs7IeNPlveatmUeqQHhshIBj5b6mTdhMUHbjPAoyZhGLbOvF20ik= ceph-12cdb164-717a-11ef-bceb-c7b262605968 2024-09-13T02:46:09.948 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-13T02:46:10.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:09 smithi089 ceph-mon[27639]: from='client.? 172.21.15.89:0/226318870' entity='client.admin' 2024-09-13T02:46:10.200 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T02:46:12.367 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:12.362+0000 7f210d940640 1 -- 172.21.15.89:0/4025339755 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f21080660e0 msgr2=0x7f21080fede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:46:12.367 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:12.362+0000 7f210d940640 1 --2- 172.21.15.89:0/4025339755 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f21080660e0 0x7f21080fede0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f20f8004850 tx=0x7f20f8009da0 comp rx=0 tx=0).stop 2024-09-13T02:46:12.368 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:12.362+0000 7f210d940640 1 -- 172.21.15.89:0/4025339755 shutdown_connections 2024-09-13T02:46:12.368 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:12.362+0000 7f210d940640 1 --2- 172.21.15.89:0/4025339755 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f21080660e0 0x7f21080fede0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:46:12.368 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:12.362+0000 7f210d940640 1 -- 172.21.15.89:0/4025339755 >> 172.21.15.89:0/4025339755 conn(0x7f21080f6850 msgr2=0x7f21080f8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:46:12.368 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:12.362+0000 7f210d940640 1 -- 172.21.15.89:0/4025339755 shutdown_connections 2024-09-13T02:46:12.368 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:12.362+0000 7f210d940640 1 -- 172.21.15.89:0/4025339755 wait complete. 2024-09-13T02:46:12.368 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:12.363+0000 7f210d940640 1 Processor -- start 2024-09-13T02:46:12.368 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:12.363+0000 7f210d940640 1 -- start start 2024-09-13T02:46:12.369 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:12.363+0000 7f210d940640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f21080660e0 0x7f21080fc710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:46:12.369 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:12.363+0000 7f210d940640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21080fcc50 con 0x7f21080660e0 2024-09-13T02:46:12.369 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:12.363+0000 7f2106ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f21080660e0 0x7f21080fc710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:46:12.369 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:12.363+0000 7f2106ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f21080660e0 0x7f21080fc710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36618/0 (socket says 172.21.15.89:36618) 2024-09-13T02:46:12.369 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:12.363+0000 7f2106ffd640 1 -- 172.21.15.89:0/3122413851 learned_addr learned my addr 172.21.15.89:0/3122413851 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:46:12.369 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:12.363+0000 7f2106ffd640 1 -- 172.21.15.89:0/3122413851 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20f8005040 con 0x7f21080660e0 2024-09-13T02:46:12.369 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:12.363+0000 7f2106ffd640 1 --2- 172.21.15.89:0/3122413851 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f21080660e0 0x7f21080fc710 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f20f80041d0 tx=0x7f20f8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:46:12.369 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:12.363+0000 7f20ff7fe640 1 -- 172.21.15.89:0/3122413851 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f20f8007a20 con 0x7f21080660e0 2024-09-13T02:46:12.369 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:12.363+0000 7f20ff7fe640 1 -- 172.21.15.89:0/3122413851 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f20f80328e0 con 0x7f21080660e0 2024-09-13T02:46:12.369 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:12.363+0000 7f210d940640 1 -- 172.21.15.89:0/3122413851 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21080face0 con 0x7f21080660e0 2024-09-13T02:46:12.369 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:12.363+0000 7f20ff7fe640 1 -- 172.21.15.89:0/3122413851 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f20f80339f0 con 0x7f21080660e0 2024-09-13T02:46:12.370 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:12.363+0000 7f210d940640 1 -- 172.21.15.89:0/3122413851 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21080fb070 con 0x7f21080660e0 2024-09-13T02:46:12.370 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:12.364+0000 7f20ff7fe640 1 -- 172.21.15.89:0/3122413851 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 13) v1 ==== 45563+0+0 (secure 0 0 0) 0x7f20f8030020 con 0x7f21080660e0 2024-09-13T02:46:12.370 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:12.364+0000 7f20ff7fe640 1 --2- 172.21.15.89:0/3122413851 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7f20f4039580 0x7f20f403ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:46:12.370 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:12.364+0000 7f20ff7fe640 1 -- 172.21.15.89:0/3122413851 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f20f806c0d0 con 0x7f21080660e0 2024-09-13T02:46:12.370 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:12.365+0000 7f210d940640 1 -- 172.21.15.89:0/3122413851 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f210805ed70 con 0x7f21080660e0 2024-09-13T02:46:12.370 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:12.365+0000 7f20fffff640 1 --2- 172.21.15.89:0/3122413851 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7f20f4039580 0x7f20f403ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:46:12.370 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:12.365+0000 7f20fffff640 1 --2- 172.21.15.89:0/3122413851 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7f20f4039580 0x7f20f403ba30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f20f0006fd0 tx=0x7f20f0006db0 comp rx=0 tx=0).ready entity=mgr.14158 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:46:12.371 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:12.369+0000 7f20ff7fe640 1 -- 172.21.15.89:0/3122413851 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f20f8033b50 con 0x7f21080660e0 2024-09-13T02:46:12.530 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:12.528+0000 7f210d940640 1 -- 172.21.15.89:0/3122413851 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7f210804b720 con 0x7f21080660e0 2024-09-13T02:46:12.533 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:12.531+0000 7f20ff7fe640 1 -- 172.21.15.89:0/3122413851 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7f20f8043ac0 con 0x7f21080660e0 2024-09-13T02:46:12.536 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:12.533+0000 7f210d940640 1 -- 172.21.15.89:0/3122413851 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7f20f4039580 msgr2=0x7f20f403ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:46:12.536 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:12.533+0000 7f210d940640 1 --2- 172.21.15.89:0/3122413851 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7f20f4039580 0x7f20f403ba30 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f20f0006fd0 tx=0x7f20f0006db0 comp rx=0 tx=0).stop 2024-09-13T02:46:12.536 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:12.533+0000 7f210d940640 1 -- 172.21.15.89:0/3122413851 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f21080660e0 msgr2=0x7f21080fc710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:46:12.536 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:12.533+0000 7f210d940640 1 --2- 172.21.15.89:0/3122413851 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f21080660e0 0x7f21080fc710 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f20f80041d0 tx=0x7f20f8009da0 comp rx=0 tx=0).stop 2024-09-13T02:46:12.536 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:12.534+0000 7f210d940640 1 -- 172.21.15.89:0/3122413851 shutdown_connections 2024-09-13T02:46:12.537 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:12.534+0000 7f210d940640 1 --2- 172.21.15.89:0/3122413851 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7f20f4039580 0x7f20f403ba30 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:46:12.537 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:12.534+0000 7f210d940640 1 --2- 172.21.15.89:0/3122413851 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f21080660e0 0x7f21080fc710 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:46:12.537 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:12.534+0000 7f210d940640 1 -- 172.21.15.89:0/3122413851 >> 172.21.15.89:0/3122413851 conn(0x7f21080f6850 msgr2=0x7f21080f70a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:46:12.537 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:12.534+0000 7f210d940640 1 -- 172.21.15.89:0/3122413851 shutdown_connections 2024-09-13T02:46:12.537 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:12.534+0000 7f210d940640 1 -- 172.21.15.89:0/3122413851 wait complete. 2024-09-13T02:46:13.173 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-13T02:46:13.173 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-13T02:46:13.719 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:13 smithi089 ceph-mon[27639]: from='client.? 172.21.15.89:0/3122413851' entity='client.admin' 2024-09-13T02:46:13.842 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T02:46:14.850 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:14 smithi089 ceph-mon[27639]: from='mgr.14158 172.21.15.89:0/2682144324' entity='mgr.smithi089.guohvs' 2024-09-13T02:46:14.851 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:14 smithi089 ceph-mon[27639]: from='mgr.14158 172.21.15.89:0/2682144324' entity='mgr.smithi089.guohvs' 2024-09-13T02:46:14.851 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:14 smithi089 ceph-mon[27639]: from='mgr.14158 172.21.15.89:0/2682144324' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config rm", "who": "osd/host:smithi089", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:46:14.851 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:14 smithi089 ceph-mon[27639]: from='mgr.14158 172.21.15.89:0/2682144324' entity='mgr.smithi089.guohvs' 2024-09-13T02:46:14.851 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:14 smithi089 ceph-mon[27639]: from='mgr.14158 172.21.15.89:0/2682144324' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi089", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T02:46:14.851 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:14 smithi089 ceph-mon[27639]: from='mgr.14158 172.21.15.89:0/2682144324' entity='mgr.smithi089.guohvs' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi089", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-09-13T02:46:14.851 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:14 smithi089 ceph-mon[27639]: from='mgr.14158 172.21.15.89:0/2682144324' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:46:14.851 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:14 smithi089 ceph-mon[27639]: Deploying daemon crash.smithi089 on smithi089 2024-09-13T02:46:15.899 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:15.896+0000 7f34b2229640 1 -- 172.21.15.89:0/640650005 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34ac0fd820 msgr2=0x7f34ac0fdc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:46:15.899 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:15.896+0000 7f34b2229640 1 --2- 172.21.15.89:0/640650005 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34ac0fd820 0x7f34ac0fdc30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f349c004850 tx=0x7f349c009da0 comp rx=0 tx=0).stop 2024-09-13T02:46:15.899 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:15.896+0000 7f34b2229640 1 -- 172.21.15.89:0/640650005 shutdown_connections 2024-09-13T02:46:15.900 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:15.896+0000 7f34b2229640 1 --2- 172.21.15.89:0/640650005 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34ac0fd820 0x7f34ac0fdc30 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:46:15.900 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:15.896+0000 7f34b2229640 1 -- 172.21.15.89:0/640650005 >> 172.21.15.89:0/640650005 conn(0x7f34ac0f6040 msgr2=0x7f34ac0f8450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:46:15.900 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:15.896+0000 7f34b2229640 1 -- 172.21.15.89:0/640650005 shutdown_connections 2024-09-13T02:46:15.900 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:15.896+0000 7f34b2229640 1 -- 172.21.15.89:0/640650005 wait complete. 2024-09-13T02:46:15.900 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:15.896+0000 7f34b2229640 1 Processor -- start 2024-09-13T02:46:15.900 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:15.897+0000 7f34b2229640 1 -- start start 2024-09-13T02:46:15.900 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:15.897+0000 7f34b2229640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34ac0fd820 0x7f34ac0fcf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:46:15.900 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:15.897+0000 7f34b2229640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34ac0fd470 con 0x7f34ac0fd820 2024-09-13T02:46:15.900 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:15.897+0000 7f34ab7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34ac0fd820 0x7f34ac0fcf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:46:15.900 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:15.897+0000 7f34ab7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34ac0fd820 0x7f34ac0fcf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36640/0 (socket says 172.21.15.89:36640) 2024-09-13T02:46:15.900 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:15.897+0000 7f34ab7fe640 1 -- 172.21.15.89:0/4002480331 learned_addr learned my addr 172.21.15.89:0/4002480331 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:46:15.900 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:15.897+0000 7f34ab7fe640 1 -- 172.21.15.89:0/4002480331 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f349c005040 con 0x7f34ac0fd820 2024-09-13T02:46:15.901 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:15.898+0000 7f34ab7fe640 1 --2- 172.21.15.89:0/4002480331 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34ac0fd820 0x7f34ac0fcf30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f349c02a6d0 tx=0x7f349c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:46:15.901 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:15.898+0000 7f34a3fff640 1 -- 172.21.15.89:0/4002480331 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f349c033630 con 0x7f34ac0fd820 2024-09-13T02:46:15.901 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:15.898+0000 7f34a3fff640 1 -- 172.21.15.89:0/4002480331 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f349c033c30 con 0x7f34ac0fd820 2024-09-13T02:46:15.901 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:15.898+0000 7f34b2229640 1 -- 172.21.15.89:0/4002480331 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34ac0fb500 con 0x7f34ac0fd820 2024-09-13T02:46:15.901 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:15.898+0000 7f34a3fff640 1 -- 172.21.15.89:0/4002480331 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f349c03dc00 con 0x7f34ac0fd820 2024-09-13T02:46:15.901 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:15.898+0000 7f34b2229640 1 -- 172.21.15.89:0/4002480331 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34ac0fb970 con 0x7f34ac0fd820 2024-09-13T02:46:15.902 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:15.899+0000 7f34a3fff640 1 -- 172.21.15.89:0/4002480331 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 13) v1 ==== 45563+0+0 (secure 0 0 0) 0x7f349c030020 con 0x7f34ac0fd820 2024-09-13T02:46:15.902 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:15.899+0000 7f34a3fff640 1 --2- 172.21.15.89:0/4002480331 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7f34980395d0 0x7f349803ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:46:15.902 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:15.899+0000 7f34a3fff640 1 -- 172.21.15.89:0/4002480331 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f349c06cb10 con 0x7f34ac0fd820 2024-09-13T02:46:15.902 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:15.899+0000 7f34b2229640 1 -- 172.21.15.89:0/4002480331 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34ac102600 con 0x7f34ac0fd820 2024-09-13T02:46:15.902 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:15.899+0000 7f34aaffd640 1 --2- 172.21.15.89:0/4002480331 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7f34980395d0 0x7f349803ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:46:15.902 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:15.899+0000 7f34aaffd640 1 --2- 172.21.15.89:0/4002480331 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7f34980395d0 0x7f349803ba80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3494006fd0 tx=0x7f3494006db0 comp rx=0 tx=0).ready entity=mgr.14158 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:46:15.904 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:15.903+0000 7f34a3fff640 1 -- 172.21.15.89:0/4002480331 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f349c047440 con 0x7f34ac0fd820 2024-09-13T02:46:16.067 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:16.066+0000 7f34b2229640 1 -- 172.21.15.89:0/4002480331 --> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7f34ac0fbc70 con 0x7f34980395d0 2024-09-13T02:46:16.070 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:16.069+0000 7f34a3fff640 1 -- 172.21.15.89:0/4002480331 <== mgr.14158 v2:172.21.15.89:6800/3169313021 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f34ac0fbc70 con 0x7f34980395d0 2024-09-13T02:46:16.073 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:16.071+0000 7f34b2229640 1 -- 172.21.15.89:0/4002480331 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7f34980395d0 msgr2=0x7f349803ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:46:16.073 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:16.071+0000 7f34b2229640 1 --2- 172.21.15.89:0/4002480331 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7f34980395d0 0x7f349803ba80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f3494006fd0 tx=0x7f3494006db0 comp rx=0 tx=0).stop 2024-09-13T02:46:16.073 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:16.071+0000 7f34b2229640 1 -- 172.21.15.89:0/4002480331 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34ac0fd820 msgr2=0x7f34ac0fcf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:46:16.073 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:16.071+0000 7f34b2229640 1 --2- 172.21.15.89:0/4002480331 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34ac0fd820 0x7f34ac0fcf30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f349c02a6d0 tx=0x7f349c009da0 comp rx=0 tx=0).stop 2024-09-13T02:46:16.073 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:16.071+0000 7f34b2229640 1 -- 172.21.15.89:0/4002480331 shutdown_connections 2024-09-13T02:46:16.073 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:16.071+0000 7f34b2229640 1 --2- 172.21.15.89:0/4002480331 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7f34980395d0 0x7f349803ba80 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:46:16.073 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:16.071+0000 7f34b2229640 1 --2- 172.21.15.89:0/4002480331 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34ac0fd820 0x7f34ac0fcf30 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:46:16.073 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:16.071+0000 7f34b2229640 1 -- 172.21.15.89:0/4002480331 >> 172.21.15.89:0/4002480331 conn(0x7f34ac0f6040 msgr2=0x7f34ac0f6850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:46:16.074 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:16.071+0000 7f34b2229640 1 -- 172.21.15.89:0/4002480331 shutdown_connections 2024-09-13T02:46:16.074 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:16.071+0000 7f34b2229640 1 -- 172.21.15.89:0/4002480331 wait complete. 2024-09-13T02:46:17.013 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi131 2024-09-13T02:46:17.013 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-13T02:46:17.013 DEBUG:teuthology.orchestra.run.smithi131:> dd of=/etc/ceph/ceph.conf 2024-09-13T02:46:17.033 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-13T02:46:17.033 DEBUG:teuthology.orchestra.run.smithi131:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-13T02:46:17.091 INFO:tasks.cephadm:Adding host smithi131 to orchestrator... 2024-09-13T02:46:17.091 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -- ceph orch host add smithi131 2024-09-13T02:46:17.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:17 smithi089 ceph-mon[27639]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:46:17.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:17 smithi089 ceph-mon[27639]: from='mgr.14158 172.21.15.89:0/2682144324' entity='mgr.smithi089.guohvs' 2024-09-13T02:46:17.551 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T02:46:18.905 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:18 smithi089 ceph-mon[27639]: from='mgr.14158 172.21.15.89:0/2682144324' entity='mgr.smithi089.guohvs' 2024-09-13T02:46:18.905 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:18 smithi089 ceph-mon[27639]: from='mgr.14158 172.21.15.89:0/2682144324' entity='mgr.smithi089.guohvs' 2024-09-13T02:46:18.905 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:18 smithi089 ceph-mon[27639]: from='mgr.14158 172.21.15.89:0/2682144324' entity='mgr.smithi089.guohvs' 2024-09-13T02:46:18.905 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:18 smithi089 ceph-mon[27639]: from='mgr.14158 172.21.15.89:0/2682144324' entity='mgr.smithi089.guohvs' 2024-09-13T02:46:18.905 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:18 smithi089 ceph-mon[27639]: Deploying daemon node-exporter.smithi089 on smithi089 2024-09-13T02:46:19.119 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:19.113+0000 7fcc12f69640 1 -- 172.21.15.89:0/3320895615 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcc0c0fc1b0 msgr2=0x7fcc0c0fc5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:46:19.119 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:19.113+0000 7fcc12f69640 1 --2- 172.21.15.89:0/3320895615 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcc0c0fc1b0 0x7fcc0c0fc5c0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc004850 tx=0x7fcbfc009da0 comp rx=0 tx=0).stop 2024-09-13T02:46:19.119 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:19.113+0000 7fcc12f69640 1 -- 172.21.15.89:0/3320895615 shutdown_connections 2024-09-13T02:46:19.119 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:19.113+0000 7fcc12f69640 1 --2- 172.21.15.89:0/3320895615 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcc0c0fc1b0 0x7fcc0c0fc5c0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:46:19.119 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:19.113+0000 7fcc12f69640 1 -- 172.21.15.89:0/3320895615 >> 172.21.15.89:0/3320895615 conn(0x7fcc0c0f7990 msgr2=0x7fcc0c0f9da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:46:19.119 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:19.113+0000 7fcc12f69640 1 -- 172.21.15.89:0/3320895615 shutdown_connections 2024-09-13T02:46:19.119 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:19.113+0000 7fcc12f69640 1 -- 172.21.15.89:0/3320895615 wait complete. 2024-09-13T02:46:19.119 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:19.113+0000 7fcc12f69640 1 Processor -- start 2024-09-13T02:46:19.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:19.114+0000 7fcc12f69640 1 -- start start 2024-09-13T02:46:19.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:19.114+0000 7fcc12f69640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcc0c0fc1b0 0x7fcc0c071490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:46:19.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:19.114+0000 7fcc12f69640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc0c0719d0 con 0x7fcc0c0fc1b0 2024-09-13T02:46:19.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:19.114+0000 7fcc10d05640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcc0c0fc1b0 0x7fcc0c071490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:46:19.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:19.114+0000 7fcc10d05640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcc0c0fc1b0 0x7fcc0c071490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36680/0 (socket says 172.21.15.89:36680) 2024-09-13T02:46:19.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:19.114+0000 7fcc10d05640 1 -- 172.21.15.89:0/1271513904 learned_addr learned my addr 172.21.15.89:0/1271513904 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:46:19.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:19.114+0000 7fcc10d05640 1 -- 172.21.15.89:0/1271513904 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbfc005040 con 0x7fcc0c0fc1b0 2024-09-13T02:46:19.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:19.114+0000 7fcc10d05640 1 --2- 172.21.15.89:0/1271513904 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcc0c0fc1b0 0x7fcc0c071490 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc02a6d0 tx=0x7fcbfc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:46:19.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:19.114+0000 7fcc097fa640 1 -- 172.21.15.89:0/1271513904 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcbfc033630 con 0x7fcc0c0fc1b0 2024-09-13T02:46:19.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:19.114+0000 7fcc097fa640 1 -- 172.21.15.89:0/1271513904 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fcbfc033c30 con 0x7fcc0c0fc1b0 2024-09-13T02:46:19.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:19.115+0000 7fcc12f69640 1 -- 172.21.15.89:0/1271513904 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc0c06fa60 con 0x7fcc0c0fc1b0 2024-09-13T02:46:19.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:19.115+0000 7fcc097fa640 1 -- 172.21.15.89:0/1271513904 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcbfc03dc00 con 0x7fcc0c0fc1b0 2024-09-13T02:46:19.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:19.115+0000 7fcc12f69640 1 -- 172.21.15.89:0/1271513904 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc0c06fed0 con 0x7fcc0c0fc1b0 2024-09-13T02:46:19.121 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:19.115+0000 7fcc097fa640 1 -- 172.21.15.89:0/1271513904 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 13) v1 ==== 45563+0+0 (secure 0 0 0) 0x7fcbfc030020 con 0x7fcc0c0fc1b0 2024-09-13T02:46:19.121 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:19.116+0000 7fcc12f69640 1 -- 172.21.15.89:0/1271513904 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc0c1025d0 con 0x7fcc0c0fc1b0 2024-09-13T02:46:19.121 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:19.116+0000 7fcc097fa640 1 --2- 172.21.15.89:0/1271513904 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7fcbf8039580 0x7fcbf803ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:46:19.121 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:19.116+0000 7fcc097fa640 1 -- 172.21.15.89:0/1271513904 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fcbfc06caf0 con 0x7fcc0c0fc1b0 2024-09-13T02:46:19.121 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:19.116+0000 7fcc0bfff640 1 --2- 172.21.15.89:0/1271513904 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7fcbf8039580 0x7fcbf803ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:46:19.121 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:19.116+0000 7fcc0bfff640 1 --2- 172.21.15.89:0/1271513904 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7fcbf8039580 0x7fcbf803ba30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fcbf4006fd0 tx=0x7fcbf4006db0 comp rx=0 tx=0).ready entity=mgr.14158 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:46:19.121 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:19.120+0000 7fcc097fa640 1 -- 172.21.15.89:0/1271513904 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fcbfc045800 con 0x7fcc0c0fc1b0 2024-09-13T02:46:19.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:19.293+0000 7fcc12f69640 1 -- 172.21.15.89:0/1271513904 --> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi131", "target": ["mon-mgr", ""]}) v1 -- 0x7fcc0c070110 con 0x7fcbf8039580 2024-09-13T02:46:20.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:19 smithi089 ceph-mon[27639]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi131", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:46:21.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:20 smithi089 ceph-mon[27639]: Deploying cephadm binary to smithi131 2024-09-13T02:46:22.038 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:22.036+0000 7fcc097fa640 1 -- 172.21.15.89:0/1271513904 <== mgr.14158 v2:172.21.15.89:6800/3169313021 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7fcc0c070110 con 0x7fcbf8039580 2024-09-13T02:46:22.038 INFO:teuthology.orchestra.run.smithi089.stdout:Added host 'smithi131' with addr '172.21.15.131' 2024-09-13T02:46:22.040 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:22.039+0000 7fcc12f69640 1 -- 172.21.15.89:0/1271513904 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7fcbf8039580 msgr2=0x7fcbf803ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:46:22.040 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:22.039+0000 7fcc12f69640 1 --2- 172.21.15.89:0/1271513904 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7fcbf8039580 0x7fcbf803ba30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fcbf4006fd0 tx=0x7fcbf4006db0 comp rx=0 tx=0).stop 2024-09-13T02:46:22.040 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:22.039+0000 7fcc12f69640 1 -- 172.21.15.89:0/1271513904 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcc0c0fc1b0 msgr2=0x7fcc0c071490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:46:22.040 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:22.039+0000 7fcc12f69640 1 --2- 172.21.15.89:0/1271513904 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcc0c0fc1b0 0x7fcc0c071490 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc02a6d0 tx=0x7fcbfc009da0 comp rx=0 tx=0).stop 2024-09-13T02:46:22.041 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:22.039+0000 7fcc12f69640 1 -- 172.21.15.89:0/1271513904 shutdown_connections 2024-09-13T02:46:22.041 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:22.039+0000 7fcc12f69640 1 --2- 172.21.15.89:0/1271513904 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7fcbf8039580 0x7fcbf803ba30 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:46:22.041 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:22.039+0000 7fcc12f69640 1 --2- 172.21.15.89:0/1271513904 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcc0c0fc1b0 0x7fcc0c071490 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:46:22.041 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:22.039+0000 7fcc12f69640 1 -- 172.21.15.89:0/1271513904 >> 172.21.15.89:0/1271513904 conn(0x7fcc0c0f7990 msgr2=0x7fcc0c0f8220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:46:22.041 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:22.039+0000 7fcc12f69640 1 -- 172.21.15.89:0/1271513904 shutdown_connections 2024-09-13T02:46:22.041 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:22.039+0000 7fcc12f69640 1 -- 172.21.15.89:0/1271513904 wait complete. 2024-09-13T02:46:22.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:21 smithi089 ceph-mon[27639]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:46:22.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:21 smithi089 ceph-mon[27639]: from='mgr.14158 172.21.15.89:0/2682144324' entity='mgr.smithi089.guohvs' 2024-09-13T02:46:22.660 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-13T02:46:22.918 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T02:46:23.268 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:23 smithi089 ceph-mon[27639]: from='mgr.14158 172.21.15.89:0/2682144324' entity='mgr.smithi089.guohvs' 2024-09-13T02:46:23.268 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:23 smithi089 ceph-mon[27639]: from='mgr.14158 172.21.15.89:0/2682144324' entity='mgr.smithi089.guohvs' 2024-09-13T02:46:23.268 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:23 smithi089 ceph-mon[27639]: from='mgr.14158 172.21.15.89:0/2682144324' entity='mgr.smithi089.guohvs' 2024-09-13T02:46:23.268 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:23 smithi089 ceph-mon[27639]: from='mgr.14158 172.21.15.89:0/2682144324' entity='mgr.smithi089.guohvs' 2024-09-13T02:46:23.268 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:23 smithi089 ceph-mon[27639]: Deploying daemon alertmanager.smithi089 on smithi089 2024-09-13T02:46:23.268 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:23 smithi089 ceph-mon[27639]: from='mgr.14158 172.21.15.89:0/2682144324' entity='mgr.smithi089.guohvs' 2024-09-13T02:46:23.268 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:23 smithi089 ceph-mon[27639]: Added host smithi131 2024-09-13T02:46:24.243 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:24 smithi089 ceph-mon[27639]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:46:25.127 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:25.085+0000 7fb3ebf7b640 1 -- 172.21.15.89:0/445944804 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3e40fd820 msgr2=0x7fb3e40fdc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:46:25.127 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:25.085+0000 7fb3ebf7b640 1 --2- 172.21.15.89:0/445944804 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3e40fd820 0x7fb3e40fdc30 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc004850 tx=0x7fb3dc009da0 comp rx=0 tx=0).stop 2024-09-13T02:46:25.127 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:25.085+0000 7fb3ebf7b640 1 -- 172.21.15.89:0/445944804 shutdown_connections 2024-09-13T02:46:25.127 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:25.085+0000 7fb3ebf7b640 1 --2- 172.21.15.89:0/445944804 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3e40fd820 0x7fb3e40fdc30 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:46:25.127 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:25.085+0000 7fb3ebf7b640 1 -- 172.21.15.89:0/445944804 >> 172.21.15.89:0/445944804 conn(0x7fb3e40f6040 msgr2=0x7fb3e40f8450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:46:25.127 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:25.085+0000 7fb3ebf7b640 1 -- 172.21.15.89:0/445944804 shutdown_connections 2024-09-13T02:46:25.127 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:25.085+0000 7fb3ebf7b640 1 -- 172.21.15.89:0/445944804 wait complete. 2024-09-13T02:46:25.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:25.086+0000 7fb3ebf7b640 1 Processor -- start 2024-09-13T02:46:25.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:25.086+0000 7fb3ebf7b640 1 -- start start 2024-09-13T02:46:25.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:25.086+0000 7fb3ebf7b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3e40fd820 0x7fb3e410c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:46:25.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:25.086+0000 7fb3ebf7b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3e410cc20 con 0x7fb3e40fd820 2024-09-13T02:46:25.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:25.086+0000 7fb3e9d17640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3e40fd820 0x7fb3e410c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:46:25.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:25.086+0000 7fb3e9d17640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3e40fd820 0x7fb3e410c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:38488/0 (socket says 172.21.15.89:38488) 2024-09-13T02:46:25.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:25.086+0000 7fb3e9d17640 1 -- 172.21.15.89:0/1040996469 learned_addr learned my addr 172.21.15.89:0/1040996469 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:46:25.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:25.086+0000 7fb3e9d17640 1 -- 172.21.15.89:0/1040996469 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3dc005040 con 0x7fb3e40fd820 2024-09-13T02:46:25.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:25.086+0000 7fb3e9d17640 1 --2- 172.21.15.89:0/1040996469 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3e40fd820 0x7fb3e410c6e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc02a6d0 tx=0x7fb3dc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:46:25.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:25.087+0000 7fb3e27fc640 1 -- 172.21.15.89:0/1040996469 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb3dc033630 con 0x7fb3e40fd820 2024-09-13T02:46:25.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:25.087+0000 7fb3e27fc640 1 -- 172.21.15.89:0/1040996469 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb3dc033c30 con 0x7fb3e40fd820 2024-09-13T02:46:25.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:25.087+0000 7fb3ebf7b640 1 -- 172.21.15.89:0/1040996469 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3e410ce20 con 0x7fb3e40fd820 2024-09-13T02:46:25.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:25.087+0000 7fb3e27fc640 1 -- 172.21.15.89:0/1040996469 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb3dc03dc00 con 0x7fb3e40fd820 2024-09-13T02:46:25.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:25.087+0000 7fb3ebf7b640 1 -- 172.21.15.89:0/1040996469 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3e410d290 con 0x7fb3e40fd820 2024-09-13T02:46:25.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:25.087+0000 7fb3e27fc640 1 -- 172.21.15.89:0/1040996469 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 13) v1 ==== 45563+0+0 (secure 0 0 0) 0x7fb3dc030020 con 0x7fb3e40fd820 2024-09-13T02:46:25.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:25.088+0000 7fb3ebf7b640 1 -- 172.21.15.89:0/1040996469 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3e405ed70 con 0x7fb3e40fd820 2024-09-13T02:46:25.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:25.088+0000 7fb3e27fc640 1 --2- 172.21.15.89:0/1040996469 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7fb3cc039580 0x7fb3cc03ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:46:25.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:25.088+0000 7fb3e27fc640 1 -- 172.21.15.89:0/1040996469 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fb3dc06c8c0 con 0x7fb3e40fd820 2024-09-13T02:46:25.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:25.088+0000 7fb3e9516640 1 --2- 172.21.15.89:0/1040996469 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7fb3cc039580 0x7fb3cc03ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:46:25.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:25.088+0000 7fb3e9516640 1 --2- 172.21.15.89:0/1040996469 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7fb3cc039580 0x7fb3cc03ba30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb3d8006fd0 tx=0x7fb3d8006db0 comp rx=0 tx=0).ready entity=mgr.14158 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:46:25.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:25.092+0000 7fb3e27fc640 1 -- 172.21.15.89:0/1040996469 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fb3dc045800 con 0x7fb3e40fd820 2024-09-13T02:46:25.255 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:25.253+0000 7fb3ebf7b640 1 -- 172.21.15.89:0/1040996469 --> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb3e410d290 con 0x7fb3cc039580 2024-09-13T02:46:25.255 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:25.254+0000 7fb3e27fc640 1 -- 172.21.15.89:0/1040996469 <== mgr.14158 v2:172.21.15.89:6800/3169313021 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+160 (secure 0 0 0) 0x7fb3e410d290 con 0x7fb3cc039580 2024-09-13T02:46:25.256 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:46:25.256 INFO:teuthology.orchestra.run.smithi089.stdout:[{"addr": "172.21.15.89", "hostname": "smithi089", "labels": [], "status": ""}, {"addr": "172.21.15.131", "hostname": "smithi131", "labels": [], "status": ""}] 2024-09-13T02:46:25.258 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:25.256+0000 7fb3ebf7b640 1 -- 172.21.15.89:0/1040996469 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7fb3cc039580 msgr2=0x7fb3cc03ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:46:25.258 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:25.256+0000 7fb3ebf7b640 1 --2- 172.21.15.89:0/1040996469 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7fb3cc039580 0x7fb3cc03ba30 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fb3d8006fd0 tx=0x7fb3d8006db0 comp rx=0 tx=0).stop 2024-09-13T02:46:25.258 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:25.256+0000 7fb3ebf7b640 1 -- 172.21.15.89:0/1040996469 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3e40fd820 msgr2=0x7fb3e410c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:46:25.258 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:25.256+0000 7fb3ebf7b640 1 --2- 172.21.15.89:0/1040996469 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3e40fd820 0x7fb3e410c6e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc02a6d0 tx=0x7fb3dc009da0 comp rx=0 tx=0).stop 2024-09-13T02:46:25.258 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:25.256+0000 7fb3ebf7b640 1 -- 172.21.15.89:0/1040996469 shutdown_connections 2024-09-13T02:46:25.258 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:25.256+0000 7fb3ebf7b640 1 --2- 172.21.15.89:0/1040996469 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7fb3cc039580 0x7fb3cc03ba30 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:46:25.258 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:25.256+0000 7fb3ebf7b640 1 --2- 172.21.15.89:0/1040996469 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3e40fd820 0x7fb3e410c6e0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:46:25.258 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:25.256+0000 7fb3ebf7b640 1 -- 172.21.15.89:0/1040996469 >> 172.21.15.89:0/1040996469 conn(0x7fb3e40f6040 msgr2=0x7fb3e40f68d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:46:25.259 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:25.257+0000 7fb3ebf7b640 1 -- 172.21.15.89:0/1040996469 shutdown_connections 2024-09-13T02:46:25.259 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:25.257+0000 7fb3ebf7b640 1 -- 172.21.15.89:0/1040996469 wait complete. 2024-09-13T02:46:26.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:26 smithi089 ceph-mon[27639]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:46:26.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:26 smithi089 ceph-mon[27639]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T02:46:26.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:26 smithi089 ceph-mon[27639]: from='mgr.14158 172.21.15.89:0/2682144324' entity='mgr.smithi089.guohvs' 2024-09-13T02:46:26.701 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-13T02:46:26.702 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -- ceph osd crush tunables default 2024-09-13T02:46:26.979 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T02:46:28.258 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:28 smithi089 ceph-mon[27639]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:46:30.197 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:30 smithi089 ceph-mon[27639]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:46:31.210 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:31.187+0000 7f62d8af1640 1 -- 172.21.15.89:0/95735175 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62d40fd7f0 msgr2=0x7f62d40fdc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:46:31.210 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:31.187+0000 7f62d8af1640 1 --2- 172.21.15.89:0/95735175 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62d40fd7f0 0x7f62d40fdc00 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f62c4004850 tx=0x7f62c4009da0 comp rx=0 tx=0).stop 2024-09-13T02:46:31.211 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:31.187+0000 7f62d8af1640 1 -- 172.21.15.89:0/95735175 shutdown_connections 2024-09-13T02:46:31.211 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:31.187+0000 7f62d8af1640 1 --2- 172.21.15.89:0/95735175 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62d40fd7f0 0x7f62d40fdc00 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:46:31.211 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:31.187+0000 7f62d8af1640 1 -- 172.21.15.89:0/95735175 >> 172.21.15.89:0/95735175 conn(0x7f62d40f6010 msgr2=0x7f62d40f8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:46:31.211 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:31.187+0000 7f62d8af1640 1 -- 172.21.15.89:0/95735175 shutdown_connections 2024-09-13T02:46:31.211 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:31.187+0000 7f62d8af1640 1 -- 172.21.15.89:0/95735175 wait complete. 2024-09-13T02:46:31.211 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:31.188+0000 7f62d8af1640 1 Processor -- start 2024-09-13T02:46:31.211 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:31.188+0000 7f62d8af1640 1 -- start start 2024-09-13T02:46:31.211 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:31.188+0000 7f62d8af1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62d40fd7f0 0x7f62d410c730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:46:31.212 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:31.188+0000 7f62d8af1640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62d410cc70 con 0x7f62d40fd7f0 2024-09-13T02:46:31.212 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:31.188+0000 7f62d259c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62d40fd7f0 0x7f62d410c730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:46:31.212 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:31.188+0000 7f62d259c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62d40fd7f0 0x7f62d410c730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:38504/0 (socket says 172.21.15.89:38504) 2024-09-13T02:46:31.212 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:31.188+0000 7f62d259c640 1 -- 172.21.15.89:0/2518565349 learned_addr learned my addr 172.21.15.89:0/2518565349 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:46:31.212 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:31.188+0000 7f62d259c640 1 -- 172.21.15.89:0/2518565349 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62c4005040 con 0x7f62d40fd7f0 2024-09-13T02:46:31.212 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:31.188+0000 7f62d259c640 1 --2- 172.21.15.89:0/2518565349 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62d40fd7f0 0x7f62d410c730 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f62c402a6d0 tx=0x7f62c4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:46:31.212 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:31.189+0000 7f62c2ffd640 1 -- 172.21.15.89:0/2518565349 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f62c4033630 con 0x7f62d40fd7f0 2024-09-13T02:46:31.212 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:31.189+0000 7f62c2ffd640 1 -- 172.21.15.89:0/2518565349 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f62c4033c30 con 0x7f62d40fd7f0 2024-09-13T02:46:31.212 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:31.189+0000 7f62d8af1640 1 -- 172.21.15.89:0/2518565349 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62d410ce70 con 0x7f62d40fd7f0 2024-09-13T02:46:31.212 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:31.189+0000 7f62c2ffd640 1 -- 172.21.15.89:0/2518565349 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f62c403dc00 con 0x7f62d40fd7f0 2024-09-13T02:46:31.212 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:31.189+0000 7f62d8af1640 1 -- 172.21.15.89:0/2518565349 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62d410d2e0 con 0x7f62d40fd7f0 2024-09-13T02:46:31.212 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:31.190+0000 7f62c2ffd640 1 -- 172.21.15.89:0/2518565349 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 13) v1 ==== 45563+0+0 (secure 0 0 0) 0x7f62c4030020 con 0x7f62d40fd7f0 2024-09-13T02:46:31.212 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:31.190+0000 7f62c2ffd640 1 --2- 172.21.15.89:0/2518565349 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7f62bc039580 0x7f62bc03ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:46:31.213 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:31.190+0000 7f62c2ffd640 1 -- 172.21.15.89:0/2518565349 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f62c406cb20 con 0x7f62d40fd7f0 2024-09-13T02:46:31.213 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:31.190+0000 7f62d1d9b640 1 --2- 172.21.15.89:0/2518565349 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7f62bc039580 0x7f62bc03ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:46:31.213 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:31.190+0000 7f62d8af1640 1 -- 172.21.15.89:0/2518565349 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62d41025d0 con 0x7f62d40fd7f0 2024-09-13T02:46:31.213 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:31.190+0000 7f62d1d9b640 1 --2- 172.21.15.89:0/2518565349 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7f62bc039580 0x7f62bc03ba30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f62c8006fd0 tx=0x7f62c8006db0 comp rx=0 tx=0).ready entity=mgr.14158 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:46:31.213 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:31.195+0000 7f62c2ffd640 1 -- 172.21.15.89:0/2518565349 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f62c403bb50 con 0x7f62d40fd7f0 2024-09-13T02:46:31.365 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:31.362+0000 7f62d8af1640 1 -- 172.21.15.89:0/2518565349 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f62d4101f80 con 0x7f62d40fd7f0 2024-09-13T02:46:32.050 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:32.048+0000 7f62c2ffd640 1 -- 172.21.15.89:0/2518565349 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7f62c4042210 con 0x7f62d40fd7f0 2024-09-13T02:46:32.050 INFO:teuthology.orchestra.run.smithi089.stderr:adjusted tunables profile to default 2024-09-13T02:46:32.052 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:32.050+0000 7f62d8af1640 1 -- 172.21.15.89:0/2518565349 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7f62bc039580 msgr2=0x7f62bc03ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:46:32.052 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:32.050+0000 7f62d8af1640 1 --2- 172.21.15.89:0/2518565349 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7f62bc039580 0x7f62bc03ba30 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f62c8006fd0 tx=0x7f62c8006db0 comp rx=0 tx=0).stop 2024-09-13T02:46:32.052 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:32.050+0000 7f62d8af1640 1 -- 172.21.15.89:0/2518565349 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62d40fd7f0 msgr2=0x7f62d410c730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:46:32.052 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:32.050+0000 7f62d8af1640 1 --2- 172.21.15.89:0/2518565349 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62d40fd7f0 0x7f62d410c730 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f62c402a6d0 tx=0x7f62c4009da0 comp rx=0 tx=0).stop 2024-09-13T02:46:32.052 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:32.050+0000 7f62d8af1640 1 -- 172.21.15.89:0/2518565349 shutdown_connections 2024-09-13T02:46:32.052 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:32.050+0000 7f62d8af1640 1 --2- 172.21.15.89:0/2518565349 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7f62bc039580 0x7f62bc03ba30 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:46:32.052 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:32.050+0000 7f62d8af1640 1 --2- 172.21.15.89:0/2518565349 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f62d40fd7f0 0x7f62d410c730 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:46:32.052 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:32.050+0000 7f62d8af1640 1 -- 172.21.15.89:0/2518565349 >> 172.21.15.89:0/2518565349 conn(0x7f62d40f6010 msgr2=0x7f62d40f6880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:46:32.052 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:32.050+0000 7f62d8af1640 1 -- 172.21.15.89:0/2518565349 shutdown_connections 2024-09-13T02:46:32.052 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:46:32.050+0000 7f62d8af1640 1 -- 172.21.15.89:0/2518565349 wait complete. 2024-09-13T02:46:32.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:32 smithi089 ceph-mon[27639]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:46:32.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:32 smithi089 ceph-mon[27639]: from='client.? 172.21.15.89:0/2518565349' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-13T02:46:32.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:32 smithi089 ceph-mon[27639]: from='mgr.14158 172.21.15.89:0/2682144324' entity='mgr.smithi089.guohvs' 2024-09-13T02:46:32.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:32 smithi089 ceph-mon[27639]: from='mgr.14158 172.21.15.89:0/2682144324' entity='mgr.smithi089.guohvs' 2024-09-13T02:46:32.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:32 smithi089 ceph-mon[27639]: from='mgr.14158 172.21.15.89:0/2682144324' entity='mgr.smithi089.guohvs' 2024-09-13T02:46:32.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:32 smithi089 ceph-mon[27639]: from='mgr.14158 172.21.15.89:0/2682144324' entity='mgr.smithi089.guohvs' 2024-09-13T02:46:32.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:32 smithi089 ceph-mon[27639]: from='mgr.14158 172.21.15.89:0/2682144324' entity='mgr.smithi089.guohvs' 2024-09-13T02:46:32.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:32 smithi089 ceph-mon[27639]: from='mgr.14158 172.21.15.89:0/2682144324' entity='mgr.smithi089.guohvs' 2024-09-13T02:46:32.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:32 smithi089 ceph-mon[27639]: from='mgr.14158 172.21.15.89:0/2682144324' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-13T02:46:32.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:32 smithi089 ceph-mon[27639]: from='mgr.14158 172.21.15.89:0/2682144324' entity='mgr.smithi089.guohvs' 2024-09-13T02:46:32.897 INFO:tasks.cephadm:Adding mon.smithi089 on smithi089 2024-09-13T02:46:32.897 INFO:tasks.cephadm:Adding mon.smithi131 on smithi131 2024-09-13T02:46:32.898 DEBUG:teuthology.orchestra.run.smithi131:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -- ceph orch apply mon '2;smithi089:172.21.15.89=smithi089;smithi131:172.21.15.131=smithi131' 2024-09-13T02:46:33.141 INFO:teuthology.orchestra.run.smithi131.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T02:46:33.203 INFO:teuthology.orchestra.run.smithi131.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T02:46:33.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:33 smithi089 ceph-mon[27639]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-13T02:46:33.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:33 smithi089 ceph-mon[27639]: Deploying daemon grafana.smithi089 on smithi089 2024-09-13T02:46:33.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:33 smithi089 ceph-mon[27639]: from='client.? 172.21.15.89:0/2518565349' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-13T02:46:33.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:33 smithi089 ceph-mon[27639]: osdmap e4: 0 total, 0 up, 0 in 2024-09-13T02:46:34.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:34 smithi089 ceph-mon[27639]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:46:34.660 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:34.659+0000 7facdb898640 1 -- 172.21.15.131:0/4002911763 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7facd40fb2e0 msgr2=0x7facd40fb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:46:34.661 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:34.659+0000 7facdb898640 1 --2- 172.21.15.131:0/4002911763 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7facd40fb2e0 0x7facd40fb6f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7facc4009bd0 tx=0x7facc4004d10 comp rx=0 tx=0).stop 2024-09-13T02:46:34.661 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:34.659+0000 7facdb898640 1 -- 172.21.15.131:0/4002911763 shutdown_connections 2024-09-13T02:46:34.661 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:34.659+0000 7facdb898640 1 --2- 172.21.15.131:0/4002911763 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7facd40fb2e0 0x7facd40fb6f0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:46:34.661 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:34.659+0000 7facdb898640 1 -- 172.21.15.131:0/4002911763 >> 172.21.15.131:0/4002911763 conn(0x7facd40f6ac0 msgr2=0x7facd40f8ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:46:34.661 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:34.659+0000 7facdb898640 1 -- 172.21.15.131:0/4002911763 shutdown_connections 2024-09-13T02:46:34.661 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:34.659+0000 7facdb898640 1 -- 172.21.15.131:0/4002911763 wait complete. 2024-09-13T02:46:34.662 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:34.660+0000 7facdb898640 1 Processor -- start 2024-09-13T02:46:34.663 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:34.660+0000 7facdb898640 1 -- start start 2024-09-13T02:46:34.663 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:34.660+0000 7facdb898640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7facd40fb2e0 0x7facd40654d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:46:34.663 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:34.660+0000 7facdb898640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facd410f660 con 0x7facd40fb2e0 2024-09-13T02:46:34.663 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:34.660+0000 7facd9634640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7facd40fb2e0 0x7facd40654d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:46:34.663 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:34.660+0000 7facd9634640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7facd40fb2e0 0x7facd40654d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.131:55460/0 (socket says 172.21.15.131:55460) 2024-09-13T02:46:34.663 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:34.660+0000 7facd9634640 1 -- 172.21.15.131:0/2826191469 learned_addr learned my addr 172.21.15.131:0/2826191469 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-09-13T02:46:34.663 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:34.661+0000 7facd9634640 1 -- 172.21.15.131:0/2826191469 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facc40098b0 con 0x7facd40fb2e0 2024-09-13T02:46:34.663 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:34.661+0000 7facd9634640 1 --2- 172.21.15.131:0/2826191469 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7facd40fb2e0 0x7facd40654d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7facc4003400 tx=0x7facc4004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:46:34.663 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:34.661+0000 7facd1ffb640 1 -- 172.21.15.131:0/2826191469 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7facc4032910 con 0x7facd40fb2e0 2024-09-13T02:46:34.663 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:34.661+0000 7facdb898640 1 -- 172.21.15.131:0/2826191469 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facd410f7a0 con 0x7facd40fb2e0 2024-09-13T02:46:34.663 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:34.661+0000 7facd1ffb640 1 -- 172.21.15.131:0/2826191469 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7facc403d420 con 0x7facd40fb2e0 2024-09-13T02:46:34.663 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:34.661+0000 7facd1ffb640 1 -- 172.21.15.131:0/2826191469 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7facc4031590 con 0x7facd40fb2e0 2024-09-13T02:46:34.664 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:34.661+0000 7facdb898640 1 -- 172.21.15.131:0/2826191469 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facd410fc10 con 0x7facd40fb2e0 2024-09-13T02:46:34.664 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:34.662+0000 7facd1ffb640 1 -- 172.21.15.131:0/2826191469 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 13) v1 ==== 45563+0+0 (secure 0 0 0) 0x7facc402f030 con 0x7facd40fb2e0 2024-09-13T02:46:34.665 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:34.662+0000 7facdb898640 1 -- 172.21.15.131:0/2826191469 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facd405ed70 con 0x7facd40fb2e0 2024-09-13T02:46:34.665 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:34.662+0000 7facd1ffb640 1 --2- 172.21.15.131:0/2826191469 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7facbc039580 0x7facbc03ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:46:34.665 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:34.662+0000 7facd1ffb640 1 -- 172.21.15.131:0/2826191469 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7facc406d740 con 0x7facd40fb2e0 2024-09-13T02:46:34.665 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:34.663+0000 7facd8e33640 1 --2- 172.21.15.131:0/2826191469 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7facbc039580 0x7facbc03ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:46:34.665 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:34.663+0000 7facd8e33640 1 --2- 172.21.15.131:0/2826191469 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7facbc039580 0x7facbc03ba30 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7facc8006fd0 tx=0x7facc8006db0 comp rx=0 tx=0).ready entity=mgr.14158 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:46:34.668 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:34.667+0000 7facd1ffb640 1 -- 172.21.15.131:0/2826191469 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7facc4032a70 con 0x7facd40fb2e0 2024-09-13T02:46:34.833 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:34.831+0000 7facdb898640 1 -- 172.21.15.131:0/2826191469 --> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi089:172.21.15.89=smithi089;smithi131:172.21.15.131=smithi131", "target": ["mon-mgr", ""]}) v1 -- 0x7facd4000980 con 0x7facbc039580 2024-09-13T02:46:34.838 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:34.836+0000 7facd1ffb640 1 -- 172.21.15.131:0/2826191469 <== mgr.14158 v2:172.21.15.89:6800/3169313021 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7facd4000980 con 0x7facbc039580 2024-09-13T02:46:34.838 INFO:teuthology.orchestra.run.smithi131.stdout:Scheduled mon update... 2024-09-13T02:46:34.840 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:34.838+0000 7facdb898640 1 -- 172.21.15.131:0/2826191469 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7facbc039580 msgr2=0x7facbc03ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:46:34.840 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:34.838+0000 7facdb898640 1 --2- 172.21.15.131:0/2826191469 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7facbc039580 0x7facbc03ba30 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7facc8006fd0 tx=0x7facc8006db0 comp rx=0 tx=0).stop 2024-09-13T02:46:34.840 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:34.838+0000 7facdb898640 1 -- 172.21.15.131:0/2826191469 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7facd40fb2e0 msgr2=0x7facd40654d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:46:34.840 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:34.838+0000 7facdb898640 1 --2- 172.21.15.131:0/2826191469 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7facd40fb2e0 0x7facd40654d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7facc4003400 tx=0x7facc4004d10 comp rx=0 tx=0).stop 2024-09-13T02:46:34.840 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:34.839+0000 7facdb898640 1 -- 172.21.15.131:0/2826191469 shutdown_connections 2024-09-13T02:46:34.840 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:34.839+0000 7facdb898640 1 --2- 172.21.15.131:0/2826191469 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7facbc039580 0x7facbc03ba30 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:46:34.840 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:34.839+0000 7facdb898640 1 --2- 172.21.15.131:0/2826191469 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7facd40fb2e0 0x7facd40654d0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:46:34.841 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:34.839+0000 7facdb898640 1 -- 172.21.15.131:0/2826191469 >> 172.21.15.131:0/2826191469 conn(0x7facd40f6ac0 msgr2=0x7facd40f7350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:46:34.841 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:34.839+0000 7facdb898640 1 -- 172.21.15.131:0/2826191469 shutdown_connections 2024-09-13T02:46:34.841 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:34.839+0000 7facdb898640 1 -- 172.21.15.131:0/2826191469 wait complete. 2024-09-13T02:46:35.400 DEBUG:teuthology.orchestra.run.smithi131:mon.smithi131> sudo journalctl -f -n 0 -u ceph-12cdb164-717a-11ef-bceb-c7b262605968@mon.smithi131.service 2024-09-13T02:46:35.403 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T02:46:35.403 DEBUG:teuthology.orchestra.run.smithi131:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T02:46:35.673 INFO:teuthology.orchestra.run.smithi131.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T02:46:35.728 INFO:teuthology.orchestra.run.smithi131.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T02:46:36.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:35 smithi089 ceph-mon[27639]: from='client.14190 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi089:172.21.15.89=smithi089;smithi131:172.21.15.131=smithi131", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:46:36.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:35 smithi089 ceph-mon[27639]: Saving service mon spec with placement smithi089:172.21.15.89=smithi089;smithi131:172.21.15.131=smithi131;count:2 2024-09-13T02:46:36.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:35 smithi089 ceph-mon[27639]: from='mgr.14158 172.21.15.89:0/2682144324' entity='mgr.smithi089.guohvs' 2024-09-13T02:46:36.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:35 smithi089 ceph-mon[27639]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:46:37.116 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:37.108+0000 7f0c2bf52640 1 -- 172.21.15.131:0/1101625147 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c240fc1b0 msgr2=0x7f0c240fc5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:46:37.117 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:37.108+0000 7f0c2bf52640 1 --2- 172.21.15.131:0/1101625147 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c240fc1b0 0x7f0c240fc5c0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0c20004850 tx=0x7f0c20009da0 comp rx=0 tx=0).stop 2024-09-13T02:46:37.117 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:37.108+0000 7f0c2bf52640 1 -- 172.21.15.131:0/1101625147 shutdown_connections 2024-09-13T02:46:37.117 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:37.108+0000 7f0c2bf52640 1 --2- 172.21.15.131:0/1101625147 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c240fc1b0 0x7f0c240fc5c0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:46:37.117 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:37.108+0000 7f0c2bf52640 1 -- 172.21.15.131:0/1101625147 >> 172.21.15.131:0/1101625147 conn(0x7f0c240f7990 msgr2=0x7f0c240f9da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:46:37.117 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:37.108+0000 7f0c2bf52640 1 -- 172.21.15.131:0/1101625147 shutdown_connections 2024-09-13T02:46:37.118 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:37.108+0000 7f0c2bf52640 1 -- 172.21.15.131:0/1101625147 wait complete. 2024-09-13T02:46:37.118 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:37.109+0000 7f0c2bf52640 1 Processor -- start 2024-09-13T02:46:37.118 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:37.109+0000 7f0c2bf52640 1 -- start start 2024-09-13T02:46:37.118 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:37.109+0000 7f0c2bf52640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c240fc1b0 0x7f0c2410c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:46:37.118 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:37.109+0000 7f0c2bf52640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c2410cc30 con 0x7f0c240fc1b0 2024-09-13T02:46:37.118 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:37.109+0000 7f0c29cee640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c240fc1b0 0x7f0c2410c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:46:37.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:37.109+0000 7f0c29cee640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c240fc1b0 0x7f0c2410c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.131:55484/0 (socket says 172.21.15.131:55484) 2024-09-13T02:46:37.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:37.109+0000 7f0c29cee640 1 -- 172.21.15.131:0/2488402326 learned_addr learned my addr 172.21.15.131:0/2488402326 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-09-13T02:46:37.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:37.110+0000 7f0c29cee640 1 -- 172.21.15.131:0/2488402326 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c20005040 con 0x7f0c240fc1b0 2024-09-13T02:46:37.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:37.110+0000 7f0c29cee640 1 --2- 172.21.15.131:0/2488402326 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c240fc1b0 0x7f0c2410c6f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0c2002a6d0 tx=0x7f0c20009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:46:37.119 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:37.110+0000 7f0c1a7fc640 1 -- 172.21.15.131:0/2488402326 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0c20033630 con 0x7f0c240fc1b0 2024-09-13T02:46:37.120 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:37.110+0000 7f0c1a7fc640 1 -- 172.21.15.131:0/2488402326 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0c20033c30 con 0x7f0c240fc1b0 2024-09-13T02:46:37.120 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:37.110+0000 7f0c1a7fc640 1 -- 172.21.15.131:0/2488402326 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0c2003dc00 con 0x7f0c240fc1b0 2024-09-13T02:46:37.120 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:37.110+0000 7f0c2bf52640 1 -- 172.21.15.131:0/2488402326 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c2410ce30 con 0x7f0c240fc1b0 2024-09-13T02:46:37.120 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:37.110+0000 7f0c2bf52640 1 -- 172.21.15.131:0/2488402326 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c2410d2a0 con 0x7f0c240fc1b0 2024-09-13T02:46:37.121 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:37.111+0000 7f0c1a7fc640 1 -- 172.21.15.131:0/2488402326 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 13) v1 ==== 45563+0+0 (secure 0 0 0) 0x7f0c20030020 con 0x7f0c240fc1b0 2024-09-13T02:46:37.121 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:37.111+0000 7f0c2bf52640 1 -- 172.21.15.131:0/2488402326 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c2405ed70 con 0x7f0c240fc1b0 2024-09-13T02:46:37.121 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:37.111+0000 7f0c1a7fc640 1 --2- 172.21.15.131:0/2488402326 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7f0c10039580 0x7f0c1003ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:46:37.121 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:37.111+0000 7f0c1a7fc640 1 -- 172.21.15.131:0/2488402326 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f0c2006ca60 con 0x7f0c240fc1b0 2024-09-13T02:46:37.121 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:37.112+0000 7f0c294ed640 1 --2- 172.21.15.131:0/2488402326 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7f0c10039580 0x7f0c1003ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:46:37.121 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:37.112+0000 7f0c294ed640 1 --2- 172.21.15.131:0/2488402326 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7f0c10039580 0x7f0c1003ba30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f0c14006fd0 tx=0x7f0c14006db0 comp rx=0 tx=0).ready entity=mgr.14158 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:46:37.122 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:37.116+0000 7f0c1a7fc640 1 -- 172.21.15.131:0/2488402326 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f0c2003bb00 con 0x7f0c240fc1b0 2024-09-13T02:46:37.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:37 smithi089 ceph-mon[27639]: from='mgr.14158 172.21.15.89:0/2682144324' entity='mgr.smithi089.guohvs' 2024-09-13T02:46:37.331 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:37.329+0000 7f0c2bf52640 1 -- 172.21.15.131:0/2488402326 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f0c2404b720 con 0x7f0c240fc1b0 2024-09-13T02:46:37.331 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:37.330+0000 7f0c1a7fc640 1 -- 172.21.15.131:0/2488402326 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f0c2003b370 con 0x7f0c240fc1b0 2024-09-13T02:46:37.332 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-13T02:46:37.332 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":1,"fsid":"12cdb164-717a-11ef-bceb-c7b262605968","modified":"2024-09-13T02:45:02.514381Z","created":"2024-09-13T02:45:02.514381Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi089","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:3300","nonce":0},{"type":"v1","addr":"172.21.15.89:6789","nonce":0}]},"addr":"172.21.15.89:6789/0","public_addr":"172.21.15.89:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T02:46:37.332 INFO:teuthology.orchestra.run.smithi131.stderr:dumped monmap epoch 1 2024-09-13T02:46:37.333 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:37.332+0000 7f0c2bf52640 1 -- 172.21.15.131:0/2488402326 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7f0c10039580 msgr2=0x7f0c1003ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:46:37.333 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:37.332+0000 7f0c2bf52640 1 --2- 172.21.15.131:0/2488402326 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7f0c10039580 0x7f0c1003ba30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f0c14006fd0 tx=0x7f0c14006db0 comp rx=0 tx=0).stop 2024-09-13T02:46:37.333 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:37.332+0000 7f0c2bf52640 1 -- 172.21.15.131:0/2488402326 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c240fc1b0 msgr2=0x7f0c2410c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:46:37.333 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:37.332+0000 7f0c2bf52640 1 --2- 172.21.15.131:0/2488402326 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c240fc1b0 0x7f0c2410c6f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f0c2002a6d0 tx=0x7f0c20009da0 comp rx=0 tx=0).stop 2024-09-13T02:46:37.334 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:37.332+0000 7f0c2bf52640 1 -- 172.21.15.131:0/2488402326 shutdown_connections 2024-09-13T02:46:37.334 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:37.332+0000 7f0c2bf52640 1 --2- 172.21.15.131:0/2488402326 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7f0c10039580 0x7f0c1003ba30 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:46:37.334 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:37.332+0000 7f0c2bf52640 1 --2- 172.21.15.131:0/2488402326 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c240fc1b0 0x7f0c2410c6f0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:46:37.334 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:37.332+0000 7f0c2bf52640 1 -- 172.21.15.131:0/2488402326 >> 172.21.15.131:0/2488402326 conn(0x7f0c240f7990 msgr2=0x7f0c240f8200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:46:37.334 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:37.332+0000 7f0c2bf52640 1 -- 172.21.15.131:0/2488402326 shutdown_connections 2024-09-13T02:46:37.334 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:37.332+0000 7f0c2bf52640 1 -- 172.21.15.131:0/2488402326 wait complete. 2024-09-13T02:46:38.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:38 smithi089 ceph-mon[27639]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:46:38.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:38 smithi089 ceph-mon[27639]: from='client.? 172.21.15.131:0/2488402326' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T02:46:38.939 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T02:46:38.939 DEBUG:teuthology.orchestra.run.smithi131:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T02:46:39.181 INFO:teuthology.orchestra.run.smithi131.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T02:46:39.226 INFO:teuthology.orchestra.run.smithi131.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T02:46:40.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:40 smithi089 ceph-mon[27639]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:46:40.645 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:40.622+0000 7ff98999c640 1 -- 172.21.15.131:0/3147832722 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9840fc1b0 msgr2=0x7ff9840fc5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:46:40.645 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:40.622+0000 7ff98999c640 1 --2- 172.21.15.131:0/3147832722 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9840fc1b0 0x7ff9840fc5c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7ff974004850 tx=0x7ff974009da0 comp rx=0 tx=0).stop 2024-09-13T02:46:40.645 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:40.622+0000 7ff98999c640 1 -- 172.21.15.131:0/3147832722 shutdown_connections 2024-09-13T02:46:40.645 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:40.622+0000 7ff98999c640 1 --2- 172.21.15.131:0/3147832722 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9840fc1b0 0x7ff9840fc5c0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:46:40.645 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:40.622+0000 7ff98999c640 1 -- 172.21.15.131:0/3147832722 >> 172.21.15.131:0/3147832722 conn(0x7ff9840f7990 msgr2=0x7ff9840f9da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:46:40.645 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:40.622+0000 7ff98999c640 1 -- 172.21.15.131:0/3147832722 shutdown_connections 2024-09-13T02:46:40.645 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:40.622+0000 7ff98999c640 1 -- 172.21.15.131:0/3147832722 wait complete. 2024-09-13T02:46:40.645 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:40.622+0000 7ff98999c640 1 Processor -- start 2024-09-13T02:46:40.645 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:40.623+0000 7ff98999c640 1 -- start start 2024-09-13T02:46:40.646 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:40.623+0000 7ff98999c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9840fc1b0 0x7ff98410c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:46:40.646 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:40.623+0000 7ff98999c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff98410cc30 con 0x7ff9840fc1b0 2024-09-13T02:46:40.646 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:40.623+0000 7ff982ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9840fc1b0 0x7ff98410c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:46:40.646 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:40.623+0000 7ff982ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9840fc1b0 0x7ff98410c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.131:55510/0 (socket says 172.21.15.131:55510) 2024-09-13T02:46:40.646 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:40.623+0000 7ff982ffd640 1 -- 172.21.15.131:0/2297881388 learned_addr learned my addr 172.21.15.131:0/2297881388 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-09-13T02:46:40.646 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:40.623+0000 7ff982ffd640 1 -- 172.21.15.131:0/2297881388 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff974005040 con 0x7ff9840fc1b0 2024-09-13T02:46:40.646 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:40.624+0000 7ff982ffd640 1 --2- 172.21.15.131:0/2297881388 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9840fc1b0 0x7ff98410c6f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff974009920 tx=0x7ff974009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:46:40.646 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:40.624+0000 7ff97b7fe640 1 -- 172.21.15.131:0/2297881388 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff974033630 con 0x7ff9840fc1b0 2024-09-13T02:46:40.646 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:40.624+0000 7ff97b7fe640 1 -- 172.21.15.131:0/2297881388 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff974033c30 con 0x7ff9840fc1b0 2024-09-13T02:46:40.646 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:40.624+0000 7ff98999c640 1 -- 172.21.15.131:0/2297881388 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff98410ce30 con 0x7ff9840fc1b0 2024-09-13T02:46:40.646 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:40.624+0000 7ff97b7fe640 1 -- 172.21.15.131:0/2297881388 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff97403dc40 con 0x7ff9840fc1b0 2024-09-13T02:46:40.646 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:40.624+0000 7ff98999c640 1 -- 172.21.15.131:0/2297881388 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff98410d2a0 con 0x7ff9840fc1b0 2024-09-13T02:46:40.646 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:40.625+0000 7ff97b7fe640 1 -- 172.21.15.131:0/2297881388 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 13) v1 ==== 45563+0+0 (secure 0 0 0) 0x7ff974030020 con 0x7ff9840fc1b0 2024-09-13T02:46:40.647 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:40.625+0000 7ff97b7fe640 1 --2- 172.21.15.131:0/2297881388 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7ff970039580 0x7ff97003ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:46:40.647 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:40.625+0000 7ff98999c640 1 -- 172.21.15.131:0/2297881388 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff98405ed70 con 0x7ff9840fc1b0 2024-09-13T02:46:40.647 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:40.625+0000 7ff97b7fe640 1 -- 172.21.15.131:0/2297881388 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7ff97406c9c0 con 0x7ff9840fc1b0 2024-09-13T02:46:40.647 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:40.625+0000 7ff97bfff640 1 --2- 172.21.15.131:0/2297881388 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7ff970039580 0x7ff97003ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:46:40.647 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:40.626+0000 7ff97bfff640 1 --2- 172.21.15.131:0/2297881388 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7ff970039580 0x7ff97003ba30 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff96c006fd0 tx=0x7ff96c006db0 comp rx=0 tx=0).ready entity=mgr.14158 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:46:40.647 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:40.630+0000 7ff97b7fe640 1 -- 172.21.15.131:0/2297881388 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7ff97403bb50 con 0x7ff9840fc1b0 2024-09-13T02:46:40.844 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:40.843+0000 7ff98999c640 1 -- 172.21.15.131:0/2297881388 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7ff98404b720 con 0x7ff9840fc1b0 2024-09-13T02:46:40.845 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:40.843+0000 7ff97b7fe640 1 -- 172.21.15.131:0/2297881388 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7ff974042210 con 0x7ff9840fc1b0 2024-09-13T02:46:40.845 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-13T02:46:40.845 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":1,"fsid":"12cdb164-717a-11ef-bceb-c7b262605968","modified":"2024-09-13T02:45:02.514381Z","created":"2024-09-13T02:45:02.514381Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi089","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:3300","nonce":0},{"type":"v1","addr":"172.21.15.89:6789","nonce":0}]},"addr":"172.21.15.89:6789/0","public_addr":"172.21.15.89:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T02:46:40.846 INFO:teuthology.orchestra.run.smithi131.stderr:dumped monmap epoch 1 2024-09-13T02:46:40.847 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:40.845+0000 7ff98999c640 1 -- 172.21.15.131:0/2297881388 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7ff970039580 msgr2=0x7ff97003ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:46:40.847 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:40.845+0000 7ff98999c640 1 --2- 172.21.15.131:0/2297881388 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7ff970039580 0x7ff97003ba30 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7ff96c006fd0 tx=0x7ff96c006db0 comp rx=0 tx=0).stop 2024-09-13T02:46:40.847 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:40.845+0000 7ff98999c640 1 -- 172.21.15.131:0/2297881388 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9840fc1b0 msgr2=0x7ff98410c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:46:40.847 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:40.845+0000 7ff98999c640 1 --2- 172.21.15.131:0/2297881388 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9840fc1b0 0x7ff98410c6f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff974009920 tx=0x7ff974009da0 comp rx=0 tx=0).stop 2024-09-13T02:46:40.847 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:40.845+0000 7ff98999c640 1 -- 172.21.15.131:0/2297881388 shutdown_connections 2024-09-13T02:46:40.847 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:40.845+0000 7ff98999c640 1 --2- 172.21.15.131:0/2297881388 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7ff970039580 0x7ff97003ba30 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:46:40.847 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:40.845+0000 7ff98999c640 1 --2- 172.21.15.131:0/2297881388 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9840fc1b0 0x7ff98410c6f0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:46:40.847 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:40.845+0000 7ff98999c640 1 -- 172.21.15.131:0/2297881388 >> 172.21.15.131:0/2297881388 conn(0x7ff9840f7990 msgr2=0x7ff9840f8220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:46:40.848 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:40.846+0000 7ff98999c640 1 -- 172.21.15.131:0/2297881388 shutdown_connections 2024-09-13T02:46:40.848 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:40.846+0000 7ff98999c640 1 -- 172.21.15.131:0/2297881388 wait complete. 2024-09-13T02:46:41.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:41 smithi089 ceph-mon[27639]: from='client.? 172.21.15.131:0/2297881388' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T02:46:42.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:42 smithi089 ceph-mon[27639]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:46:42.325 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T02:46:42.326 DEBUG:teuthology.orchestra.run.smithi131:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T02:46:42.569 INFO:teuthology.orchestra.run.smithi131.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T02:46:42.613 INFO:teuthology.orchestra.run.smithi131.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T02:46:44.049 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:44.042+0000 7f24a9d6c640 1 -- 172.21.15.131:0/2725940337 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f24a40fb0d0 msgr2=0x7f24a40fb4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:46:44.049 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:44.042+0000 7f24a9d6c640 1 --2- 172.21.15.131:0/2725940337 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f24a40fb0d0 0x7f24a40fb4e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f2494004850 tx=0x7f2494009da0 comp rx=0 tx=0).stop 2024-09-13T02:46:44.049 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:44.042+0000 7f24a9d6c640 1 -- 172.21.15.131:0/2725940337 shutdown_connections 2024-09-13T02:46:44.049 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:44.042+0000 7f24a9d6c640 1 --2- 172.21.15.131:0/2725940337 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f24a40fb0d0 0x7f24a40fb4e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:46:44.049 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:44.042+0000 7f24a9d6c640 1 -- 172.21.15.131:0/2725940337 >> 172.21.15.131:0/2725940337 conn(0x7f24a40f6890 msgr2=0x7f24a40f8cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:46:44.050 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:44.042+0000 7f24a9d6c640 1 -- 172.21.15.131:0/2725940337 shutdown_connections 2024-09-13T02:46:44.050 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:44.042+0000 7f24a9d6c640 1 -- 172.21.15.131:0/2725940337 wait complete. 2024-09-13T02:46:44.050 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:44.043+0000 7f24a9d6c640 1 Processor -- start 2024-09-13T02:46:44.050 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:44.043+0000 7f24a9d6c640 1 -- start start 2024-09-13T02:46:44.050 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:44.043+0000 7f24a9d6c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f24a40fb0d0 0x7f24a40f8800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:46:44.050 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:44.043+0000 7f24a9d6c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24a40f8d40 con 0x7f24a40fb0d0 2024-09-13T02:46:44.050 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:44.043+0000 7f24a37fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f24a40fb0d0 0x7f24a40f8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:46:44.050 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:44.043+0000 7f24a37fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f24a40fb0d0 0x7f24a40f8800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.131:34332/0 (socket says 172.21.15.131:34332) 2024-09-13T02:46:44.050 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:44.043+0000 7f24a37fe640 1 -- 172.21.15.131:0/1789815870 learned_addr learned my addr 172.21.15.131:0/1789815870 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-09-13T02:46:44.050 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:44.044+0000 7f24a37fe640 1 -- 172.21.15.131:0/1789815870 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2494005040 con 0x7f24a40fb0d0 2024-09-13T02:46:44.050 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:44.044+0000 7f24a37fe640 1 --2- 172.21.15.131:0/1789815870 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f24a40fb0d0 0x7f24a40f8800 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f249402a6d0 tx=0x7f2494009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:46:44.050 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:44.044+0000 7f248bfff640 1 -- 172.21.15.131:0/1789815870 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2494033630 con 0x7f24a40fb0d0 2024-09-13T02:46:44.050 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:44.044+0000 7f24a9d6c640 1 -- 172.21.15.131:0/1789815870 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24a40f6dd0 con 0x7f24a40fb0d0 2024-09-13T02:46:44.051 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:44.044+0000 7f248bfff640 1 -- 172.21.15.131:0/1789815870 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f2494033c30 con 0x7f24a40fb0d0 2024-09-13T02:46:44.051 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:44.044+0000 7f24a9d6c640 1 -- 172.21.15.131:0/1789815870 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24a40f7240 con 0x7f24a40fb0d0 2024-09-13T02:46:44.051 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:44.044+0000 7f248bfff640 1 -- 172.21.15.131:0/1789815870 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f249403dc10 con 0x7f24a40fb0d0 2024-09-13T02:46:44.051 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:44.045+0000 7f248bfff640 1 -- 172.21.15.131:0/1789815870 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 13) v1 ==== 45563+0+0 (secure 0 0 0) 0x7f2494030020 con 0x7f24a40fb0d0 2024-09-13T02:46:44.051 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:44.045+0000 7f24a9d6c640 1 -- 172.21.15.131:0/1789815870 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24a405ed70 con 0x7f24a40fb0d0 2024-09-13T02:46:44.051 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:44.045+0000 7f248bfff640 1 --2- 172.21.15.131:0/1789815870 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7f248c039580 0x7f248c03ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:46:44.051 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:44.045+0000 7f248bfff640 1 -- 172.21.15.131:0/1789815870 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f249406caf0 con 0x7f24a40fb0d0 2024-09-13T02:46:44.051 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:44.045+0000 7f24a2ffd640 1 --2- 172.21.15.131:0/1789815870 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7f248c039580 0x7f248c03ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:46:44.051 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:44.046+0000 7f24a2ffd640 1 --2- 172.21.15.131:0/1789815870 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7f248c039580 0x7f248c03ba30 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f2498006fd0 tx=0x7f2498006db0 comp rx=0 tx=0).ready entity=mgr.14158 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:46:44.051 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:44.050+0000 7f248bfff640 1 -- 172.21.15.131:0/1789815870 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f2494045800 con 0x7f24a40fb0d0 2024-09-13T02:46:44.194 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:44 smithi089 ceph-mon[27639]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:46:44.194 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:44 smithi089 ceph-mon[27639]: from='mgr.14158 172.21.15.89:0/2682144324' entity='mgr.smithi089.guohvs' 2024-09-13T02:46:44.195 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:44 smithi089 ceph-mon[27639]: from='mgr.14158 172.21.15.89:0/2682144324' entity='mgr.smithi089.guohvs' 2024-09-13T02:46:44.195 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:44 smithi089 ceph-mon[27639]: from='mgr.14158 172.21.15.89:0/2682144324' entity='mgr.smithi089.guohvs' 2024-09-13T02:46:44.195 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:44 smithi089 ceph-mon[27639]: from='mgr.14158 172.21.15.89:0/2682144324' entity='mgr.smithi089.guohvs' 2024-09-13T02:46:44.195 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:44 smithi089 ceph-mon[27639]: from='mgr.14158 172.21.15.89:0/2682144324' entity='mgr.smithi089.guohvs' 2024-09-13T02:46:44.195 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:44 smithi089 ceph-mon[27639]: from='mgr.14158 172.21.15.89:0/2682144324' entity='mgr.smithi089.guohvs' 2024-09-13T02:46:44.264 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:44.263+0000 7f24a9d6c640 1 -- 172.21.15.131:0/1789815870 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f24a404b720 con 0x7f24a40fb0d0 2024-09-13T02:46:44.264 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:44.263+0000 7f248bfff640 1 -- 172.21.15.131:0/1789815870 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f24940432b0 con 0x7f24a40fb0d0 2024-09-13T02:46:44.265 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-13T02:46:44.265 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":1,"fsid":"12cdb164-717a-11ef-bceb-c7b262605968","modified":"2024-09-13T02:45:02.514381Z","created":"2024-09-13T02:45:02.514381Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi089","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:3300","nonce":0},{"type":"v1","addr":"172.21.15.89:6789","nonce":0}]},"addr":"172.21.15.89:6789/0","public_addr":"172.21.15.89:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T02:46:44.265 INFO:teuthology.orchestra.run.smithi131.stderr:dumped monmap epoch 1 2024-09-13T02:46:44.266 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:44.265+0000 7f24a9d6c640 1 -- 172.21.15.131:0/1789815870 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7f248c039580 msgr2=0x7f248c03ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:46:44.266 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:44.265+0000 7f24a9d6c640 1 --2- 172.21.15.131:0/1789815870 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7f248c039580 0x7f248c03ba30 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f2498006fd0 tx=0x7f2498006db0 comp rx=0 tx=0).stop 2024-09-13T02:46:44.266 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:44.265+0000 7f24a9d6c640 1 -- 172.21.15.131:0/1789815870 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f24a40fb0d0 msgr2=0x7f24a40f8800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:46:44.266 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:44.265+0000 7f24a9d6c640 1 --2- 172.21.15.131:0/1789815870 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f24a40fb0d0 0x7f24a40f8800 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f249402a6d0 tx=0x7f2494009da0 comp rx=0 tx=0).stop 2024-09-13T02:46:44.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:44.265+0000 7f24a9d6c640 1 -- 172.21.15.131:0/1789815870 shutdown_connections 2024-09-13T02:46:44.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:44.265+0000 7f24a9d6c640 1 --2- 172.21.15.131:0/1789815870 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7f248c039580 0x7f248c03ba30 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:46:44.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:44.265+0000 7f24a9d6c640 1 --2- 172.21.15.131:0/1789815870 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f24a40fb0d0 0x7f24a40f8800 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:46:44.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:44.265+0000 7f24a9d6c640 1 -- 172.21.15.131:0/1789815870 >> 172.21.15.131:0/1789815870 conn(0x7f24a40f6890 msgr2=0x7f24a40654e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:46:44.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:44.265+0000 7f24a9d6c640 1 -- 172.21.15.131:0/1789815870 shutdown_connections 2024-09-13T02:46:44.267 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:44.265+0000 7f24a9d6c640 1 -- 172.21.15.131:0/1789815870 wait complete. 2024-09-13T02:46:45.263 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:45 smithi089 ceph-mon[27639]: Deploying daemon prometheus.smithi089 on smithi089 2024-09-13T02:46:45.263 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:45 smithi089 ceph-mon[27639]: from='client.? 172.21.15.131:0/1789815870' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T02:46:45.827 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T02:46:45.827 DEBUG:teuthology.orchestra.run.smithi131:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T02:46:46.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:46 smithi089 ceph-mon[27639]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:46:46.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:46 smithi089 ceph-mon[27639]: from='mgr.14158 172.21.15.89:0/2682144324' entity='mgr.smithi089.guohvs' 2024-09-13T02:46:46.070 INFO:teuthology.orchestra.run.smithi131.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T02:46:46.114 INFO:teuthology.orchestra.run.smithi131.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T02:46:47.513 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:47.511+0000 7ff2a77e2640 1 -- 172.21.15.131:0/2861739215 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff2a00fa610 msgr2=0x7ff2a00faa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:46:47.513 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:47.511+0000 7ff2a77e2640 1 --2- 172.21.15.131:0/2861739215 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff2a00fa610 0x7ff2a00faa20 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff29c004850 tx=0x7ff29c009da0 comp rx=0 tx=0).stop 2024-09-13T02:46:47.513 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:47.511+0000 7ff2a77e2640 1 -- 172.21.15.131:0/2861739215 shutdown_connections 2024-09-13T02:46:47.513 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:47.511+0000 7ff2a77e2640 1 --2- 172.21.15.131:0/2861739215 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff2a00fa610 0x7ff2a00faa20 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:46:47.513 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:47.511+0000 7ff2a77e2640 1 -- 172.21.15.131:0/2861739215 >> 172.21.15.131:0/2861739215 conn(0x7ff2a00f6010 msgr2=0x7ff2a00f8440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:46:47.513 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:47.511+0000 7ff2a77e2640 1 -- 172.21.15.131:0/2861739215 shutdown_connections 2024-09-13T02:46:47.513 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:47.511+0000 7ff2a77e2640 1 -- 172.21.15.131:0/2861739215 wait complete. 2024-09-13T02:46:47.513 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:47.511+0000 7ff2a77e2640 1 Processor -- start 2024-09-13T02:46:47.513 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:47.511+0000 7ff2a77e2640 1 -- start start 2024-09-13T02:46:47.513 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:47.512+0000 7ff2a77e2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff2a00fa610 0x7ff2a010c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:46:47.513 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:47.512+0000 7ff2a77e2640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2a010ccd0 con 0x7ff2a00fa610 2024-09-13T02:46:47.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:47.512+0000 7ff2a557e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff2a00fa610 0x7ff2a010c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:46:47.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:47.512+0000 7ff2a557e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff2a00fa610 0x7ff2a010c790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.131:34358/0 (socket says 172.21.15.131:34358) 2024-09-13T02:46:47.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:47.512+0000 7ff2a557e640 1 -- 172.21.15.131:0/1118780137 learned_addr learned my addr 172.21.15.131:0/1118780137 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-09-13T02:46:47.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:47.512+0000 7ff2a557e640 1 -- 172.21.15.131:0/1118780137 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff29c005040 con 0x7ff2a00fa610 2024-09-13T02:46:47.515 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:47.512+0000 7ff2a557e640 1 --2- 172.21.15.131:0/1118780137 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff2a00fa610 0x7ff2a010c790 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff29c02a6d0 tx=0x7ff29c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:46:47.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:47.512+0000 7ff295ffb640 1 -- 172.21.15.131:0/1118780137 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff29c033630 con 0x7ff2a00fa610 2024-09-13T02:46:47.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:47.512+0000 7ff295ffb640 1 -- 172.21.15.131:0/1118780137 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff29c033c30 con 0x7ff2a00fa610 2024-09-13T02:46:47.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:47.512+0000 7ff2a77e2640 1 -- 172.21.15.131:0/1118780137 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2a010ced0 con 0x7ff2a00fa610 2024-09-13T02:46:47.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:47.513+0000 7ff295ffb640 1 -- 172.21.15.131:0/1118780137 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff29c03dc30 con 0x7ff2a00fa610 2024-09-13T02:46:47.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:47.513+0000 7ff2a77e2640 1 -- 172.21.15.131:0/1118780137 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2a010d340 con 0x7ff2a00fa610 2024-09-13T02:46:47.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:47.513+0000 7ff295ffb640 1 -- 172.21.15.131:0/1118780137 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 13) v1 ==== 45563+0+0 (secure 0 0 0) 0x7ff29c030020 con 0x7ff2a00fa610 2024-09-13T02:46:47.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:47.514+0000 7ff2a77e2640 1 -- 172.21.15.131:0/1118780137 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2a005ed70 con 0x7ff2a00fa610 2024-09-13T02:46:47.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:47.514+0000 7ff295ffb640 1 --2- 172.21.15.131:0/1118780137 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7ff28c039580 0x7ff28c03ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:46:47.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:47.514+0000 7ff295ffb640 1 -- 172.21.15.131:0/1118780137 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7ff29c06c860 con 0x7ff2a00fa610 2024-09-13T02:46:47.516 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:47.514+0000 7ff2a4d7d640 1 --2- 172.21.15.131:0/1118780137 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7ff28c039580 0x7ff28c03ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:46:47.517 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:47.514+0000 7ff2a4d7d640 1 --2- 172.21.15.131:0/1118780137 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7ff28c039580 0x7ff28c03ba30 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff290006fd0 tx=0x7ff290006db0 comp rx=0 tx=0).ready entity=mgr.14158 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:46:47.519 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:47.518+0000 7ff295ffb640 1 -- 172.21.15.131:0/1118780137 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7ff29c045800 con 0x7ff2a00fa610 2024-09-13T02:46:47.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:47.731+0000 7ff2a77e2640 1 -- 172.21.15.131:0/1118780137 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7ff2a004b720 con 0x7ff2a00fa610 2024-09-13T02:46:47.733 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:47.732+0000 7ff295ffb640 1 -- 172.21.15.131:0/1118780137 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7ff29c045800 con 0x7ff2a00fa610 2024-09-13T02:46:47.734 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-13T02:46:47.734 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":1,"fsid":"12cdb164-717a-11ef-bceb-c7b262605968","modified":"2024-09-13T02:45:02.514381Z","created":"2024-09-13T02:45:02.514381Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi089","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:3300","nonce":0},{"type":"v1","addr":"172.21.15.89:6789","nonce":0}]},"addr":"172.21.15.89:6789/0","public_addr":"172.21.15.89:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T02:46:47.734 INFO:teuthology.orchestra.run.smithi131.stderr:dumped monmap epoch 1 2024-09-13T02:46:47.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:47.734+0000 7ff2a77e2640 1 -- 172.21.15.131:0/1118780137 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7ff28c039580 msgr2=0x7ff28c03ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:46:47.735 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:47.734+0000 7ff2a77e2640 1 --2- 172.21.15.131:0/1118780137 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7ff28c039580 0x7ff28c03ba30 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7ff290006fd0 tx=0x7ff290006db0 comp rx=0 tx=0).stop 2024-09-13T02:46:47.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:47.734+0000 7ff2a77e2640 1 -- 172.21.15.131:0/1118780137 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff2a00fa610 msgr2=0x7ff2a010c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:46:47.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:47.734+0000 7ff2a77e2640 1 --2- 172.21.15.131:0/1118780137 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff2a00fa610 0x7ff2a010c790 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff29c02a6d0 tx=0x7ff29c009da0 comp rx=0 tx=0).stop 2024-09-13T02:46:47.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:47.734+0000 7ff2a77e2640 1 -- 172.21.15.131:0/1118780137 shutdown_connections 2024-09-13T02:46:47.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:47.734+0000 7ff2a77e2640 1 --2- 172.21.15.131:0/1118780137 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7ff28c039580 0x7ff28c03ba30 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:46:47.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:47.734+0000 7ff2a77e2640 1 --2- 172.21.15.131:0/1118780137 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff2a00fa610 0x7ff2a010c790 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:46:47.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:47.734+0000 7ff2a77e2640 1 -- 172.21.15.131:0/1118780137 >> 172.21.15.131:0/1118780137 conn(0x7ff2a00f6010 msgr2=0x7ff2a00f68d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:46:47.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:47.734+0000 7ff2a77e2640 1 -- 172.21.15.131:0/1118780137 shutdown_connections 2024-09-13T02:46:47.736 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:47.734+0000 7ff2a77e2640 1 -- 172.21.15.131:0/1118780137 wait complete. 2024-09-13T02:46:48.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:48 smithi089 ceph-mon[27639]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:46:48.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:48 smithi089 ceph-mon[27639]: from='client.? 172.21.15.131:0/1118780137' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T02:46:49.288 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T02:46:49.289 DEBUG:teuthology.orchestra.run.smithi131:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T02:46:49.544 INFO:teuthology.orchestra.run.smithi131.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T02:46:49.588 INFO:teuthology.orchestra.run.smithi131.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T02:46:50.284 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:50 smithi089 ceph-mon[27639]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:46:50.956 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:50.953+0000 7f8bd2340640 1 -- 172.21.15.131:0/4278316171 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8bcc0fb2e0 msgr2=0x7f8bcc0fb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:46:50.956 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:50.953+0000 7f8bd2340640 1 --2- 172.21.15.131:0/4278316171 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8bcc0fb2e0 0x7f8bcc0fb6f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f8bbc004850 tx=0x7f8bbc009da0 comp rx=0 tx=0).stop 2024-09-13T02:46:50.956 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:50.953+0000 7f8bd2340640 1 -- 172.21.15.131:0/4278316171 shutdown_connections 2024-09-13T02:46:50.956 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:50.953+0000 7f8bd2340640 1 --2- 172.21.15.131:0/4278316171 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8bcc0fb2e0 0x7f8bcc0fb6f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:46:50.956 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:50.953+0000 7f8bd2340640 1 -- 172.21.15.131:0/4278316171 >> 172.21.15.131:0/4278316171 conn(0x7f8bcc0f6ac0 msgr2=0x7f8bcc0f8ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:46:50.957 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:50.953+0000 7f8bd2340640 1 -- 172.21.15.131:0/4278316171 shutdown_connections 2024-09-13T02:46:50.957 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:50.953+0000 7f8bd2340640 1 -- 172.21.15.131:0/4278316171 wait complete. 2024-09-13T02:46:50.957 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:50.954+0000 7f8bd2340640 1 Processor -- start 2024-09-13T02:46:50.957 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:50.954+0000 7f8bd2340640 1 -- start start 2024-09-13T02:46:50.957 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:50.954+0000 7f8bd2340640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8bcc0fb2e0 0x7f8bcc0654f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:46:50.957 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:50.954+0000 7f8bd2340640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bcc10f640 con 0x7f8bcc0fb2e0 2024-09-13T02:46:50.957 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:50.955+0000 7f8bcbfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8bcc0fb2e0 0x7f8bcc0654f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:46:50.957 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:50.955+0000 7f8bcbfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8bcc0fb2e0 0x7f8bcc0654f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.131:34386/0 (socket says 172.21.15.131:34386) 2024-09-13T02:46:50.957 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:50.955+0000 7f8bcbfff640 1 -- 172.21.15.131:0/3808373293 learned_addr learned my addr 172.21.15.131:0/3808373293 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-09-13T02:46:50.957 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:50.955+0000 7f8bcbfff640 1 -- 172.21.15.131:0/3808373293 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bbc005040 con 0x7f8bcc0fb2e0 2024-09-13T02:46:50.957 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:50.955+0000 7f8bcbfff640 1 --2- 172.21.15.131:0/3808373293 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8bcc0fb2e0 0x7f8bcc0654f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8bbc02a6d0 tx=0x7f8bbc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:46:50.958 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:50.955+0000 7f8bc8ff9640 1 -- 172.21.15.131:0/3808373293 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8bbc033630 con 0x7f8bcc0fb2e0 2024-09-13T02:46:50.959 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:50.955+0000 7f8bc8ff9640 1 -- 172.21.15.131:0/3808373293 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f8bbc033c30 con 0x7f8bcc0fb2e0 2024-09-13T02:46:50.959 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:50.955+0000 7f8bd2340640 1 -- 172.21.15.131:0/3808373293 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bcc10f780 con 0x7f8bcc0fb2e0 2024-09-13T02:46:50.959 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:50.955+0000 7f8bc8ff9640 1 -- 172.21.15.131:0/3808373293 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8bbc03dc00 con 0x7f8bcc0fb2e0 2024-09-13T02:46:50.959 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:50.955+0000 7f8bd2340640 1 -- 172.21.15.131:0/3808373293 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bcc10fbf0 con 0x7f8bcc0fb2e0 2024-09-13T02:46:50.959 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:50.956+0000 7f8bd2340640 1 -- 172.21.15.131:0/3808373293 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bcc05ed70 con 0x7f8bcc0fb2e0 2024-09-13T02:46:50.959 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:50.956+0000 7f8bc8ff9640 1 -- 172.21.15.131:0/3808373293 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 13) v1 ==== 45563+0+0 (secure 0 0 0) 0x7f8bbc030020 con 0x7f8bcc0fb2e0 2024-09-13T02:46:50.959 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:50.957+0000 7f8bc8ff9640 1 --2- 172.21.15.131:0/3808373293 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7f8bb8039580 0x7f8bb803ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:46:50.959 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:50.957+0000 7f8bc8ff9640 1 -- 172.21.15.131:0/3808373293 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f8bbc06caa0 con 0x7f8bcc0fb2e0 2024-09-13T02:46:50.959 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:50.957+0000 7f8bcb7fe640 1 --2- 172.21.15.131:0/3808373293 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7f8bb8039580 0x7f8bb803ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:46:50.959 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:50.957+0000 7f8bcb7fe640 1 --2- 172.21.15.131:0/3808373293 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7f8bb8039580 0x7f8bb803ba30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f8bb4006fd0 tx=0x7f8bb4006db0 comp rx=0 tx=0).ready entity=mgr.14158 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:46:50.963 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:50.962+0000 7f8bc8ff9640 1 -- 172.21.15.131:0/3808373293 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f8bbc045800 con 0x7f8bcc0fb2e0 2024-09-13T02:46:51.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:51.174+0000 7f8bd2340640 1 -- 172.21.15.131:0/3808373293 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f8bcc04b720 con 0x7f8bcc0fb2e0 2024-09-13T02:46:51.176 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:51.175+0000 7f8bc8ff9640 1 -- 172.21.15.131:0/3808373293 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f8bbc045800 con 0x7f8bcc0fb2e0 2024-09-13T02:46:51.177 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-13T02:46:51.177 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":1,"fsid":"12cdb164-717a-11ef-bceb-c7b262605968","modified":"2024-09-13T02:45:02.514381Z","created":"2024-09-13T02:45:02.514381Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi089","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:3300","nonce":0},{"type":"v1","addr":"172.21.15.89:6789","nonce":0}]},"addr":"172.21.15.89:6789/0","public_addr":"172.21.15.89:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T02:46:51.177 INFO:teuthology.orchestra.run.smithi131.stderr:dumped monmap epoch 1 2024-09-13T02:46:51.178 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:51.177+0000 7f8bd2340640 1 -- 172.21.15.131:0/3808373293 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7f8bb8039580 msgr2=0x7f8bb803ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:46:51.178 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:51.177+0000 7f8bd2340640 1 --2- 172.21.15.131:0/3808373293 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7f8bb8039580 0x7f8bb803ba30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f8bb4006fd0 tx=0x7f8bb4006db0 comp rx=0 tx=0).stop 2024-09-13T02:46:51.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:51.177+0000 7f8bd2340640 1 -- 172.21.15.131:0/3808373293 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8bcc0fb2e0 msgr2=0x7f8bcc0654f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:46:51.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:51.177+0000 7f8bd2340640 1 --2- 172.21.15.131:0/3808373293 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8bcc0fb2e0 0x7f8bcc0654f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f8bbc02a6d0 tx=0x7f8bbc009da0 comp rx=0 tx=0).stop 2024-09-13T02:46:51.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:51.177+0000 7f8bd2340640 1 -- 172.21.15.131:0/3808373293 shutdown_connections 2024-09-13T02:46:51.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:51.177+0000 7f8bd2340640 1 --2- 172.21.15.131:0/3808373293 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7f8bb8039580 0x7f8bb803ba30 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:46:51.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:51.177+0000 7f8bd2340640 1 --2- 172.21.15.131:0/3808373293 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8bcc0fb2e0 0x7f8bcc0654f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:46:51.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:51.177+0000 7f8bd2340640 1 -- 172.21.15.131:0/3808373293 >> 172.21.15.131:0/3808373293 conn(0x7f8bcc0f6ac0 msgr2=0x7f8bcc0f7350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:46:51.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:51.177+0000 7f8bd2340640 1 -- 172.21.15.131:0/3808373293 shutdown_connections 2024-09-13T02:46:51.179 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:51.177+0000 7f8bd2340640 1 -- 172.21.15.131:0/3808373293 wait complete. 2024-09-13T02:46:52.288 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:52 smithi089 ceph-mon[27639]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:46:52.289 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:52 smithi089 ceph-mon[27639]: from='client.? 172.21.15.131:0/3808373293' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T02:46:52.726 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T02:46:52.727 DEBUG:teuthology.orchestra.run.smithi131:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T02:46:52.968 INFO:teuthology.orchestra.run.smithi131.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T02:46:53.013 INFO:teuthology.orchestra.run.smithi131.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T02:46:54.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:54.432+0000 7fa6fa41d640 1 -- 172.21.15.131:0/3437965915 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6f40fc1d0 msgr2=0x7fa6f40fc5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:46:54.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:54.432+0000 7fa6fa41d640 1 --2- 172.21.15.131:0/3437965915 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6f40fc1d0 0x7fa6f40fc5e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa6e4004850 tx=0x7fa6e4009da0 comp rx=0 tx=0).stop 2024-09-13T02:46:54.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:54.432+0000 7fa6fa41d640 1 -- 172.21.15.131:0/3437965915 shutdown_connections 2024-09-13T02:46:54.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:54.432+0000 7fa6fa41d640 1 --2- 172.21.15.131:0/3437965915 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6f40fc1d0 0x7fa6f40fc5e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:46:54.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:54.432+0000 7fa6fa41d640 1 -- 172.21.15.131:0/3437965915 >> 172.21.15.131:0/3437965915 conn(0x7fa6f40f79b0 msgr2=0x7fa6f40f9dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:46:54.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:54.432+0000 7fa6fa41d640 1 -- 172.21.15.131:0/3437965915 shutdown_connections 2024-09-13T02:46:54.450 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:54.432+0000 7fa6fa41d640 1 -- 172.21.15.131:0/3437965915 wait complete. 2024-09-13T02:46:54.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:54.433+0000 7fa6fa41d640 1 Processor -- start 2024-09-13T02:46:54.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:54.433+0000 7fa6fa41d640 1 -- start start 2024-09-13T02:46:54.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:54.433+0000 7fa6fa41d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6f40fc1d0 0x7fa6f410c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:46:54.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:54.433+0000 7fa6fa41d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6f410cc10 con 0x7fa6f40fc1d0 2024-09-13T02:46:54.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:54.433+0000 7fa6f3fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6f40fc1d0 0x7fa6f410c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:46:54.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:54.433+0000 7fa6f3fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6f40fc1d0 0x7fa6f410c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.131:36152/0 (socket says 172.21.15.131:36152) 2024-09-13T02:46:54.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:54.433+0000 7fa6f3fff640 1 -- 172.21.15.131:0/984715189 learned_addr learned my addr 172.21.15.131:0/984715189 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-09-13T02:46:54.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:54.433+0000 7fa6f3fff640 1 -- 172.21.15.131:0/984715189 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6e4005040 con 0x7fa6f40fc1d0 2024-09-13T02:46:54.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:54.433+0000 7fa6f3fff640 1 --2- 172.21.15.131:0/984715189 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6f40fc1d0 0x7fa6f410c6d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa6e402a6d0 tx=0x7fa6e4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:46:54.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:54.434+0000 7fa6f17fa640 1 -- 172.21.15.131:0/984715189 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa6e4033630 con 0x7fa6f40fc1d0 2024-09-13T02:46:54.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:54.434+0000 7fa6f17fa640 1 -- 172.21.15.131:0/984715189 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa6e4033c30 con 0x7fa6f40fc1d0 2024-09-13T02:46:54.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:54.434+0000 7fa6fa41d640 1 -- 172.21.15.131:0/984715189 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6f410ce10 con 0x7fa6f40fc1d0 2024-09-13T02:46:54.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:54.434+0000 7fa6f17fa640 1 -- 172.21.15.131:0/984715189 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa6e403dc00 con 0x7fa6f40fc1d0 2024-09-13T02:46:54.451 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:54.434+0000 7fa6fa41d640 1 -- 172.21.15.131:0/984715189 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6f410d280 con 0x7fa6f40fc1d0 2024-09-13T02:46:54.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:54.435+0000 7fa6f17fa640 1 -- 172.21.15.131:0/984715189 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 13) v1 ==== 45563+0+0 (secure 0 0 0) 0x7fa6e4030020 con 0x7fa6f40fc1d0 2024-09-13T02:46:54.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:54.435+0000 7fa6fa41d640 1 -- 172.21.15.131:0/984715189 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6f405ed70 con 0x7fa6f40fc1d0 2024-09-13T02:46:54.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:54.435+0000 7fa6f17fa640 1 --2- 172.21.15.131:0/984715189 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7fa6e0039580 0x7fa6e003ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:46:54.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:54.435+0000 7fa6f17fa640 1 -- 172.21.15.131:0/984715189 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7fa6e406c980 con 0x7fa6f40fc1d0 2024-09-13T02:46:54.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:54.435+0000 7fa6ebfff640 1 --2- 172.21.15.131:0/984715189 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7fa6e0039580 0x7fa6e003ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:46:54.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:54.435+0000 7fa6ebfff640 1 --2- 172.21.15.131:0/984715189 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7fa6e0039580 0x7fa6e003ba30 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa6dc006fd0 tx=0x7fa6dc006db0 comp rx=0 tx=0).ready entity=mgr.14158 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:46:54.452 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:54.439+0000 7fa6f17fa640 1 -- 172.21.15.131:0/984715189 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fa6e4033790 con 0x7fa6f40fc1d0 2024-09-13T02:46:54.624 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:54.620+0000 7fa6f17fa640 1 -- 172.21.15.131:0/984715189 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mgrmap(e 14) v1 ==== 45577+0+0 (secure 0 0 0) 0x7fa6e4043d70 con 0x7fa6f40fc1d0 2024-09-13T02:46:54.644 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:54.642+0000 7fa6ebfff640 1 -- 172.21.15.131:0/984715189 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7fa6e0039580 msgr2=0x7fa6e003ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 16 2024-09-13T02:46:54.644 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:54.642+0000 7fa6ebfff640 1 -- 172.21.15.131:0/984715189 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7fa6e0039580 msgr2=0x7fa6e003ba30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-13T02:46:54.644 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:54.642+0000 7fa6ebfff640 1 --2- 172.21.15.131:0/984715189 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7fa6e0039580 0x7fa6e003ba30 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa6dc006fd0 tx=0x7fa6dc006db0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-09-13T02:46:54.646 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:54.642+0000 7fa6ebfff640 1 --2- 172.21.15.131:0/984715189 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7fa6e0039580 0x7fa6e003ba30 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fa6dc006fd0 tx=0x7fa6dc006db0 comp rx=0 tx=0).stop 2024-09-13T02:46:54.646 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:54.642+0000 7fa6f17fa640 1 -- 172.21.15.131:0/984715189 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7fa6e0039580 msgr2=0x7fa6e003ba30 unknown :-1 s=STATE_CLOSED l=1).mark_down 2024-09-13T02:46:54.646 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:54.642+0000 7fa6f17fa640 1 --2- 172.21.15.131:0/984715189 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7fa6e0039580 0x7fa6e003ba30 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:46:54.662 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:54.660+0000 7fa6fa41d640 1 -- 172.21.15.131:0/984715189 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fa6d80050c0 con 0x7fa6f40fc1d0 2024-09-13T02:46:54.662 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:54.660+0000 7fa6f17fa640 1 -- 172.21.15.131:0/984715189 <== mon.0 v2:172.21.15.89:3300/0 8 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7fa6e4032cb0 con 0x7fa6f40fc1d0 2024-09-13T02:46:54.662 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-13T02:46:54.662 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":1,"fsid":"12cdb164-717a-11ef-bceb-c7b262605968","modified":"2024-09-13T02:45:02.514381Z","created":"2024-09-13T02:45:02.514381Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi089","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:3300","nonce":0},{"type":"v1","addr":"172.21.15.89:6789","nonce":0}]},"addr":"172.21.15.89:6789/0","public_addr":"172.21.15.89:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T02:46:54.662 INFO:teuthology.orchestra.run.smithi131.stderr:dumped monmap epoch 1 2024-09-13T02:46:54.664 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:54.663+0000 7fa6fa41d640 1 -- 172.21.15.131:0/984715189 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6f40fc1d0 msgr2=0x7fa6f410c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:46:54.664 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:54.663+0000 7fa6fa41d640 1 --2- 172.21.15.131:0/984715189 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6f40fc1d0 0x7fa6f410c6d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fa6e402a6d0 tx=0x7fa6e4009da0 comp rx=0 tx=0).stop 2024-09-13T02:46:54.664 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:54.663+0000 7fa6fa41d640 1 -- 172.21.15.131:0/984715189 shutdown_connections 2024-09-13T02:46:54.664 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:54.663+0000 7fa6fa41d640 1 --2- 172.21.15.131:0/984715189 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7fa6e0039580 0x7fa6e003ba30 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:46:54.664 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:54.663+0000 7fa6fa41d640 1 --2- 172.21.15.131:0/984715189 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6f40fc1d0 0x7fa6f410c6d0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:46:54.665 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:54.663+0000 7fa6fa41d640 1 -- 172.21.15.131:0/984715189 >> 172.21.15.131:0/984715189 conn(0x7fa6f40f79b0 msgr2=0x7fa6f40f81c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:46:54.665 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:54.663+0000 7fa6fa41d640 1 -- 172.21.15.131:0/984715189 shutdown_connections 2024-09-13T02:46:54.665 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:54.663+0000 7fa6fa41d640 1 -- 172.21.15.131:0/984715189 wait complete. 2024-09-13T02:46:54.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:54 smithi089 ceph-mon[27639]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:46:54.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:54 smithi089 ceph-mon[27639]: from='mgr.14158 172.21.15.89:0/2682144324' entity='mgr.smithi089.guohvs' 2024-09-13T02:46:54.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:54 smithi089 ceph-mon[27639]: from='mgr.14158 172.21.15.89:0/2682144324' entity='mgr.smithi089.guohvs' 2024-09-13T02:46:54.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:54 smithi089 ceph-mon[27639]: from='mgr.14158 172.21.15.89:0/2682144324' entity='mgr.smithi089.guohvs' 2024-09-13T02:46:54.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:54 smithi089 ceph-mon[27639]: from='mgr.14158 172.21.15.89:0/2682144324' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-09-13T02:46:55.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:55 smithi089 ceph-mon[27639]: from='mgr.14158 172.21.15.89:0/2682144324' entity='mgr.smithi089.guohvs' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-09-13T02:46:55.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:55 smithi089 ceph-mon[27639]: mgrmap e14: smithi089.guohvs(active, since 53s) 2024-09-13T02:46:55.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:55 smithi089 ceph-mon[27639]: from='client.? 172.21.15.131:0/984715189' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T02:46:56.228 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T02:46:56.228 DEBUG:teuthology.orchestra.run.smithi131:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T02:46:56.472 INFO:teuthology.orchestra.run.smithi131.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T02:46:56.518 INFO:teuthology.orchestra.run.smithi131.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T02:46:57.798 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:57.795+0000 7f6f55ad7640 1 -- 172.21.15.131:0/3426589991 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6f500fd820 msgr2=0x7f6f500fdc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:46:57.798 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:57.795+0000 7f6f55ad7640 1 --2- 172.21.15.131:0/3426589991 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6f500fd820 0x7f6f500fdc30 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f6f40004850 tx=0x7f6f40009da0 comp rx=0 tx=0).stop 2024-09-13T02:46:57.798 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:57.795+0000 7f6f55ad7640 1 -- 172.21.15.131:0/3426589991 shutdown_connections 2024-09-13T02:46:57.798 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:57.795+0000 7f6f55ad7640 1 --2- 172.21.15.131:0/3426589991 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6f500fd820 0x7f6f500fdc30 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:46:57.798 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:57.795+0000 7f6f55ad7640 1 -- 172.21.15.131:0/3426589991 >> 172.21.15.131:0/3426589991 conn(0x7f6f500f6040 msgr2=0x7f6f500f8450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:46:57.798 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:57.795+0000 7f6f55ad7640 1 -- 172.21.15.131:0/3426589991 shutdown_connections 2024-09-13T02:46:57.798 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:57.795+0000 7f6f55ad7640 1 -- 172.21.15.131:0/3426589991 wait complete. 2024-09-13T02:46:57.798 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:57.795+0000 7f6f55ad7640 1 Processor -- start 2024-09-13T02:46:57.799 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:57.795+0000 7f6f55ad7640 1 -- start start 2024-09-13T02:46:57.799 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:57.796+0000 7f6f55ad7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6f500fd820 0x7f6f5010c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:46:57.799 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:57.796+0000 7f6f55ad7640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f5010cc20 con 0x7f6f500fd820 2024-09-13T02:46:57.799 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:57.796+0000 7f6f4f7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6f500fd820 0x7f6f5010c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:46:57.799 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:57.796+0000 7f6f4f7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6f500fd820 0x7f6f5010c6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.131:36170/0 (socket says 172.21.15.131:36170) 2024-09-13T02:46:57.799 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:57.796+0000 7f6f4f7fe640 1 -- 172.21.15.131:0/3487036240 learned_addr learned my addr 172.21.15.131:0/3487036240 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-09-13T02:46:57.799 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:57.796+0000 7f6f4f7fe640 1 -- 172.21.15.131:0/3487036240 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f40005040 con 0x7f6f500fd820 2024-09-13T02:46:57.799 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:57.796+0000 7f6f4f7fe640 1 --2- 172.21.15.131:0/3487036240 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6f500fd820 0x7f6f5010c6e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6f4002a6d0 tx=0x7f6f40009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:46:57.799 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:57.796+0000 7f6f4cff9640 1 -- 172.21.15.131:0/3487036240 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6f40033630 con 0x7f6f500fd820 2024-09-13T02:46:57.799 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:57.796+0000 7f6f55ad7640 1 -- 172.21.15.131:0/3487036240 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f5010ce20 con 0x7f6f500fd820 2024-09-13T02:46:57.799 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:57.796+0000 7f6f4cff9640 1 -- 172.21.15.131:0/3487036240 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f6f40033c30 con 0x7f6f500fd820 2024-09-13T02:46:57.799 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:57.796+0000 7f6f4cff9640 1 -- 172.21.15.131:0/3487036240 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6f4003dc00 con 0x7f6f500fd820 2024-09-13T02:46:57.799 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:57.797+0000 7f6f55ad7640 1 -- 172.21.15.131:0/3487036240 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f5010d290 con 0x7f6f500fd820 2024-09-13T02:46:57.800 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:57.798+0000 7f6f4cff9640 1 -- 172.21.15.131:0/3487036240 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 14) v1 ==== 45577+0+0 (secure 0 0 0) 0x7f6f40030020 con 0x7f6f500fd820 2024-09-13T02:46:57.800 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:57.798+0000 7f6f55ad7640 1 -- 172.21.15.131:0/3487036240 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f5005ed70 con 0x7f6f500fd820 2024-09-13T02:46:57.800 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:57.798+0000 7f6f4cff9640 1 --2- 172.21.15.131:0/3487036240 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7f6f3c0395d0 0x7f6f3c03ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:46:57.801 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:57.798+0000 7f6f4cff9640 1 -- 172.21.15.131:0/3487036240 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1151+0+0 (secure 0 0 0) 0x7f6f4006c8f0 con 0x7f6f500fd820 2024-09-13T02:46:57.801 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:57.798+0000 7f6f47fff640 1 -- 172.21.15.131:0/3487036240 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7f6f3c0395d0 msgr2=0x7f6f3c03ba80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.89:6800/3169313021 2024-09-13T02:46:57.801 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:57.798+0000 7f6f47fff640 1 --2- 172.21.15.131:0/3487036240 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7f6f3c0395d0 0x7f6f3c03ba80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T02:46:57.803 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:57.802+0000 7f6f4cff9640 1 -- 172.21.15.131:0/3487036240 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f6f40033790 con 0x7f6f500fd820 2024-09-13T02:46:58.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:57.999+0000 7f6f47fff640 1 -- 172.21.15.131:0/3487036240 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7f6f3c0395d0 msgr2=0x7f6f3c03ba80 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.89:6800/3169313021 2024-09-13T02:46:58.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:57.999+0000 7f6f47fff640 1 --2- 172.21.15.131:0/3487036240 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7f6f3c0395d0 0x7f6f3c03ba80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-13T02:46:58.022 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:58.020+0000 7f6f55ad7640 1 -- 172.21.15.131:0/3487036240 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f6f5004b720 con 0x7f6f500fd820 2024-09-13T02:46:58.022 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:58.021+0000 7f6f4cff9640 1 -- 172.21.15.131:0/3487036240 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f6f40045390 con 0x7f6f500fd820 2024-09-13T02:46:58.023 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-13T02:46:58.023 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":1,"fsid":"12cdb164-717a-11ef-bceb-c7b262605968","modified":"2024-09-13T02:45:02.514381Z","created":"2024-09-13T02:45:02.514381Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi089","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:3300","nonce":0},{"type":"v1","addr":"172.21.15.89:6789","nonce":0}]},"addr":"172.21.15.89:6789/0","public_addr":"172.21.15.89:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T02:46:58.023 INFO:teuthology.orchestra.run.smithi131.stderr:dumped monmap epoch 1 2024-09-13T02:46:58.024 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:58.023+0000 7f6f55ad7640 1 -- 172.21.15.131:0/3487036240 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7f6f3c0395d0 msgr2=0x7f6f3c03ba80 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T02:46:58.025 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:58.023+0000 7f6f55ad7640 1 --2- 172.21.15.131:0/3487036240 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7f6f3c0395d0 0x7f6f3c03ba80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:46:58.025 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:58.023+0000 7f6f55ad7640 1 -- 172.21.15.131:0/3487036240 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6f500fd820 msgr2=0x7f6f5010c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:46:58.025 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:58.023+0000 7f6f55ad7640 1 --2- 172.21.15.131:0/3487036240 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6f500fd820 0x7f6f5010c6e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f6f4002a6d0 tx=0x7f6f40009da0 comp rx=0 tx=0).stop 2024-09-13T02:46:58.025 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:58.023+0000 7f6f55ad7640 1 -- 172.21.15.131:0/3487036240 shutdown_connections 2024-09-13T02:46:58.025 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:58.023+0000 7f6f55ad7640 1 --2- 172.21.15.131:0/3487036240 >> [v2:172.21.15.89:6800/3169313021,v1:172.21.15.89:6801/3169313021] conn(0x7f6f3c0395d0 0x7f6f3c03ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:46:58.025 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:58.023+0000 7f6f55ad7640 1 --2- 172.21.15.131:0/3487036240 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6f500fd820 0x7f6f5010c6e0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:46:58.025 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:58.023+0000 7f6f55ad7640 1 -- 172.21.15.131:0/3487036240 >> 172.21.15.131:0/3487036240 conn(0x7f6f500f6040 msgr2=0x7f6f500f6850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:46:58.025 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:58.023+0000 7f6f55ad7640 1 -- 172.21.15.131:0/3487036240 shutdown_connections 2024-09-13T02:46:58.025 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:46:58.023+0000 7f6f55ad7640 1 -- 172.21.15.131:0/3487036240 wait complete. 2024-09-13T02:46:58.146 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:58 smithi089 ceph-mon[27639]: from='client.? 172.21.15.131:0/3487036240' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T02:46:59.190 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:59 smithi089 ceph-mon[27639]: Active manager daemon smithi089.guohvs restarted 2024-09-13T02:46:59.191 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:59 smithi089 ceph-mon[27639]: Activating manager daemon smithi089.guohvs 2024-09-13T02:46:59.191 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:59 smithi089 ceph-mon[27639]: osdmap e5: 0 total, 0 up, 0 in 2024-09-13T02:46:59.191 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:59 smithi089 ceph-mon[27639]: mgrmap e15: smithi089.guohvs(active, starting, since 0.00326001s) 2024-09-13T02:46:59.191 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:59 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mon metadata", "id": "smithi089"}]: dispatch 2024-09-13T02:46:59.191 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:59 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mgr metadata", "who": "smithi089.guohvs", "id": "smithi089.guohvs"}]: dispatch 2024-09-13T02:46:59.191 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:59 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T02:46:59.191 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:59 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T02:46:59.192 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:59 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T02:46:59.192 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:59 smithi089 ceph-mon[27639]: Manager daemon smithi089.guohvs is now available 2024-09-13T02:46:59.192 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:59 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:46:59.192 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:59 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:46:59.192 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:59 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:46:59.192 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:59 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi089.guohvs/mirror_snapshot_schedule"}]: dispatch 2024-09-13T02:46:59.192 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:46:59 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi089.guohvs/trash_purge_schedule"}]: dispatch 2024-09-13T02:46:59.573 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T02:46:59.574 DEBUG:teuthology.orchestra.run.smithi131:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T02:46:59.815 INFO:teuthology.orchestra.run.smithi131.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T02:46:59.865 INFO:teuthology.orchestra.run.smithi131.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T02:47:01.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:00 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:01.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:00 smithi089 ceph-mon[27639]: mgrmap e16: smithi089.guohvs(active, since 1.00564s) 2024-09-13T02:47:01.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:00 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:01.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:00 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:01.304 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:01.302+0000 7f1c84d52640 1 -- 172.21.15.131:0/1724940970 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1c80065e80 msgr2=0x7f1c800fee30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:01.304 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:01.302+0000 7f1c84d52640 1 --2- 172.21.15.131:0/1724940970 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1c80065e80 0x7f1c800fee30 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f1c70004850 tx=0x7f1c70009da0 comp rx=0 tx=0).stop 2024-09-13T02:47:01.304 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:01.302+0000 7f1c84d52640 1 -- 172.21.15.131:0/1724940970 shutdown_connections 2024-09-13T02:47:01.304 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:01.302+0000 7f1c84d52640 1 --2- 172.21.15.131:0/1724940970 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1c80065e80 0x7f1c800fee30 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:01.304 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:01.302+0000 7f1c84d52640 1 -- 172.21.15.131:0/1724940970 >> 172.21.15.131:0/1724940970 conn(0x7f1c800f6880 msgr2=0x7f1c800f8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:47:01.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:01.303+0000 7f1c84d52640 1 -- 172.21.15.131:0/1724940970 shutdown_connections 2024-09-13T02:47:01.305 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:01.303+0000 7f1c84d52640 1 -- 172.21.15.131:0/1724940970 wait complete. 2024-09-13T02:47:01.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:01.303+0000 7f1c84d52640 1 Processor -- start 2024-09-13T02:47:01.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:01.303+0000 7f1c84d52640 1 -- start start 2024-09-13T02:47:01.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:01.304+0000 7f1c84d52640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1c80065e80 0x7f1c8010c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:47:01.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:01.304+0000 7f1c84d52640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c8010ccc0 con 0x7f1c80065e80 2024-09-13T02:47:01.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:01.304+0000 7f1c7e59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1c80065e80 0x7f1c8010c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:47:01.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:01.304+0000 7f1c7e59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1c80065e80 0x7f1c8010c780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.131:36180/0 (socket says 172.21.15.131:36180) 2024-09-13T02:47:01.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:01.304+0000 7f1c7e59c640 1 -- 172.21.15.131:0/2779829343 learned_addr learned my addr 172.21.15.131:0/2779829343 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-09-13T02:47:01.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:01.304+0000 7f1c7e59c640 1 -- 172.21.15.131:0/2779829343 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c70005040 con 0x7f1c80065e80 2024-09-13T02:47:01.306 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:01.304+0000 7f1c7e59c640 1 --2- 172.21.15.131:0/2779829343 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1c80065e80 0x7f1c8010c780 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f1c700041d0 tx=0x7f1c70009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:47:01.307 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:01.304+0000 7f1c777fe640 1 -- 172.21.15.131:0/2779829343 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1c70007a20 con 0x7f1c80065e80 2024-09-13T02:47:01.307 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:01.304+0000 7f1c777fe640 1 -- 172.21.15.131:0/2779829343 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f1c700328e0 con 0x7f1c80065e80 2024-09-13T02:47:01.307 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:01.304+0000 7f1c84d52640 1 -- 172.21.15.131:0/2779829343 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c8010cec0 con 0x7f1c80065e80 2024-09-13T02:47:01.307 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:01.304+0000 7f1c777fe640 1 -- 172.21.15.131:0/2779829343 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1c700339f0 con 0x7f1c80065e80 2024-09-13T02:47:01.307 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:01.304+0000 7f1c84d52640 1 -- 172.21.15.131:0/2779829343 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c8010d250 con 0x7f1c80065e80 2024-09-13T02:47:01.308 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:01.305+0000 7f1c84d52640 1 -- 172.21.15.131:0/2779829343 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c8005ed70 con 0x7f1c80065e80 2024-09-13T02:47:01.308 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:01.306+0000 7f1c777fe640 1 -- 172.21.15.131:0/2779829343 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 16) v1 ==== 45428+0+0 (secure 0 0 0) 0x7f1c70030020 con 0x7f1c80065e80 2024-09-13T02:47:01.308 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:01.306+0000 7f1c777fe640 1 --2- 172.21.15.131:0/2779829343 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f1c6c039420 0x7f1c6c03b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:47:01.308 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:01.306+0000 7f1c777fe640 1 -- 172.21.15.131:0/2779829343 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f1c7006c0e0 con 0x7f1c80065e80 2024-09-13T02:47:01.308 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:01.306+0000 7f1c75d9b640 1 --2- 172.21.15.131:0/2779829343 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f1c6c039420 0x7f1c6c03b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:47:01.308 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:01.307+0000 7f1c75d9b640 1 --2- 172.21.15.131:0/2779829343 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f1c6c039420 0x7f1c6c03b8d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f1c68006fd0 tx=0x7f1c68006db0 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:47:01.312 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:01.311+0000 7f1c777fe640 1 -- 172.21.15.131:0/2779829343 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f1c70033b50 con 0x7f1c80065e80 2024-09-13T02:47:01.537 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:01.536+0000 7f1c84d52640 1 -- 172.21.15.131:0/2779829343 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f1c8004b720 con 0x7f1c80065e80 2024-09-13T02:47:01.538 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:01.537+0000 7f1c777fe640 1 -- 172.21.15.131:0/2779829343 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f1c70043540 con 0x7f1c80065e80 2024-09-13T02:47:01.538 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-13T02:47:01.538 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":1,"fsid":"12cdb164-717a-11ef-bceb-c7b262605968","modified":"2024-09-13T02:45:02.514381Z","created":"2024-09-13T02:45:02.514381Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi089","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:3300","nonce":0},{"type":"v1","addr":"172.21.15.89:6789","nonce":0}]},"addr":"172.21.15.89:6789/0","public_addr":"172.21.15.89:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T02:47:01.539 INFO:teuthology.orchestra.run.smithi131.stderr:dumped monmap epoch 1 2024-09-13T02:47:01.540 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:01.539+0000 7f1c84d52640 1 -- 172.21.15.131:0/2779829343 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f1c6c039420 msgr2=0x7f1c6c03b8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:01.540 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:01.539+0000 7f1c84d52640 1 --2- 172.21.15.131:0/2779829343 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f1c6c039420 0x7f1c6c03b8d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f1c68006fd0 tx=0x7f1c68006db0 comp rx=0 tx=0).stop 2024-09-13T02:47:01.540 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:01.539+0000 7f1c84d52640 1 -- 172.21.15.131:0/2779829343 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1c80065e80 msgr2=0x7f1c8010c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:01.540 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:01.539+0000 7f1c84d52640 1 --2- 172.21.15.131:0/2779829343 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1c80065e80 0x7f1c8010c780 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f1c700041d0 tx=0x7f1c70009da0 comp rx=0 tx=0).stop 2024-09-13T02:47:01.540 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:01.539+0000 7f1c84d52640 1 -- 172.21.15.131:0/2779829343 shutdown_connections 2024-09-13T02:47:01.540 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:01.539+0000 7f1c84d52640 1 --2- 172.21.15.131:0/2779829343 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f1c6c039420 0x7f1c6c03b8d0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:01.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:01.539+0000 7f1c84d52640 1 --2- 172.21.15.131:0/2779829343 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1c80065e80 0x7f1c8010c780 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:01.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:01.539+0000 7f1c84d52640 1 -- 172.21.15.131:0/2779829343 >> 172.21.15.131:0/2779829343 conn(0x7f1c800f6880 msgr2=0x7f1c800f7530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:47:01.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:01.539+0000 7f1c84d52640 1 -- 172.21.15.131:0/2779829343 shutdown_connections 2024-09-13T02:47:01.541 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:01.539+0000 7f1c84d52640 1 -- 172.21.15.131:0/2779829343 wait complete. 2024-09-13T02:47:01.950 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:01 smithi089 ceph-mon[27639]: [13/Sep/2024:02:47:00] ENGINE Bus STARTING 2024-09-13T02:47:01.951 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:01 smithi089 ceph-mon[27639]: [13/Sep/2024:02:47:00] ENGINE Serving on https://172.21.15.89:7150 2024-09-13T02:47:01.951 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:01 smithi089 ceph-mon[27639]: [13/Sep/2024:02:47:00] ENGINE Bus STARTED 2024-09-13T02:47:01.951 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:01 smithi089 ceph-mon[27639]: [13/Sep/2024:02:47:00] ENGINE Error in HTTPServer.serve 2024-09-13T02:47:01.951 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Traceback (most recent call last): 2024-09-13T02:47:01.951 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T02:47:01.951 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: self._connections.run(self.expiration_interval) 2024-09-13T02:47:01.951 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T02:47:01.951 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: self._run(expiration_interval) 2024-09-13T02:47:01.951 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T02:47:01.951 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T02:47:01.951 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T02:47:01.951 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T02:47:01.951 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T02:47:01.952 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: s = self.context.wrap_socket( 2024-09-13T02:47:01.952 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T02:47:01.952 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: return self.sslsocket_class._create( 2024-09-13T02:47:01.952 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T02:47:01.952 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: self.do_handshake() 2024-09-13T02:47:01.952 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T02:47:01.952 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: self._sslobj.do_handshake() 2024-09-13T02:47:01.952 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T02:47:01.952 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:01 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:01.952 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:01 smithi089 ceph-mon[27639]: from='client.? 172.21.15.131:0/2779829343' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T02:47:03.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:02 smithi089 ceph-mon[27639]: mgrmap e17: smithi089.guohvs(active, since 2s) 2024-09-13T02:47:03.149 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T02:47:03.149 DEBUG:teuthology.orchestra.run.smithi131:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T02:47:03.470 INFO:teuthology.orchestra.run.smithi131.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T02:47:03.524 INFO:teuthology.orchestra.run.smithi131.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-13T02:47:04.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:04 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:04.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:04 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:04.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:04 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:04.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:04 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:04.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:04 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config rm", "who": "osd/host:smithi089", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:47:05.132 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:05.130+0000 7f7a5f8dc640 1 -- 172.21.15.131:0/3537913884 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a58065590 msgr2=0x7f7a580ff0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:05.132 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:05.130+0000 7f7a5f8dc640 1 --2- 172.21.15.131:0/3537913884 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a58065590 0x7f7a580ff0b0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f7a54004850 tx=0x7f7a54009da0 comp rx=0 tx=0).stop 2024-09-13T02:47:05.132 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:05.130+0000 7f7a5f8dc640 1 -- 172.21.15.131:0/3537913884 shutdown_connections 2024-09-13T02:47:05.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:05.130+0000 7f7a5f8dc640 1 --2- 172.21.15.131:0/3537913884 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a58065590 0x7f7a580ff0b0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:05.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:05.130+0000 7f7a5f8dc640 1 -- 172.21.15.131:0/3537913884 >> 172.21.15.131:0/3537913884 conn(0x7f7a580f6ac0 msgr2=0x7f7a580f8ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:47:05.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:05.130+0000 7f7a5f8dc640 1 -- 172.21.15.131:0/3537913884 shutdown_connections 2024-09-13T02:47:05.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:05.130+0000 7f7a5f8dc640 1 -- 172.21.15.131:0/3537913884 wait complete. 2024-09-13T02:47:05.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:05.131+0000 7f7a5f8dc640 1 Processor -- start 2024-09-13T02:47:05.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:05.131+0000 7f7a5f8dc640 1 -- start start 2024-09-13T02:47:05.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:05.131+0000 7f7a5f8dc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a58065590 0x7f7a5810c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:47:05.133 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:05.131+0000 7f7a5f8dc640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a5810cee0 con 0x7f7a58065590 2024-09-13T02:47:05.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:05.131+0000 7f7a5d678640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a58065590 0x7f7a5810c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:47:05.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:05.131+0000 7f7a5d678640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a58065590 0x7f7a5810c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.131:56870/0 (socket says 172.21.15.131:56870) 2024-09-13T02:47:05.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:05.131+0000 7f7a5d678640 1 -- 172.21.15.131:0/2554064922 learned_addr learned my addr 172.21.15.131:0/2554064922 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-09-13T02:47:05.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:05.132+0000 7f7a5d678640 1 -- 172.21.15.131:0/2554064922 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a54005040 con 0x7f7a58065590 2024-09-13T02:47:05.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:05.132+0000 7f7a5d678640 1 --2- 172.21.15.131:0/2554064922 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a58065590 0x7f7a5810c9a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7a5402a6d0 tx=0x7f7a54009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:47:05.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:05.132+0000 7f7a4dffb640 1 -- 172.21.15.131:0/2554064922 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7a54033630 con 0x7f7a58065590 2024-09-13T02:47:05.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:05.132+0000 7f7a5f8dc640 1 -- 172.21.15.131:0/2554064922 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a5810d0e0 con 0x7f7a58065590 2024-09-13T02:47:05.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:05.132+0000 7f7a4dffb640 1 -- 172.21.15.131:0/2554064922 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f7a54033c30 con 0x7f7a58065590 2024-09-13T02:47:05.135 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:05.132+0000 7f7a5f8dc640 1 -- 172.21.15.131:0/2554064922 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a5810d550 con 0x7f7a58065590 2024-09-13T02:47:05.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:05.132+0000 7f7a4dffb640 1 -- 172.21.15.131:0/2554064922 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7a5403dc40 con 0x7f7a58065590 2024-09-13T02:47:05.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:05.133+0000 7f7a4dffb640 1 -- 172.21.15.131:0/2554064922 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 17) v1 ==== 45620+0+0 (secure 0 0 0) 0x7f7a54030020 con 0x7f7a58065590 2024-09-13T02:47:05.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:05.133+0000 7f7a5f8dc640 1 -- 172.21.15.131:0/2554064922 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a5805ed70 con 0x7f7a58065590 2024-09-13T02:47:05.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:05.133+0000 7f7a4dffb640 1 --2- 172.21.15.131:0/2554064922 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f7a44039670 0x7f7a4403bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:47:05.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:05.133+0000 7f7a4dffb640 1 -- 172.21.15.131:0/2554064922 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f7a5406cb00 con 0x7f7a58065590 2024-09-13T02:47:05.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:05.134+0000 7f7a5ce77640 1 --2- 172.21.15.131:0/2554064922 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f7a44039670 0x7f7a4403bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:47:05.136 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:05.134+0000 7f7a5ce77640 1 --2- 172.21.15.131:0/2554064922 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f7a44039670 0x7f7a4403bb20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f7a48006fd0 tx=0x7f7a48006db0 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:47:05.140 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:05.139+0000 7f7a4dffb640 1 -- 172.21.15.131:0/2554064922 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f7a5406ee60 con 0x7f7a58065590 2024-09-13T02:47:05.359 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:05.358+0000 7f7a5f8dc640 1 -- 172.21.15.131:0/2554064922 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f7a5804b720 con 0x7f7a58065590 2024-09-13T02:47:05.360 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:05.359+0000 7f7a4dffb640 1 -- 172.21.15.131:0/2554064922 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f7a54045800 con 0x7f7a58065590 2024-09-13T02:47:05.361 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-13T02:47:05.361 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":1,"fsid":"12cdb164-717a-11ef-bceb-c7b262605968","modified":"2024-09-13T02:45:02.514381Z","created":"2024-09-13T02:45:02.514381Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi089","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:3300","nonce":0},{"type":"v1","addr":"172.21.15.89:6789","nonce":0}]},"addr":"172.21.15.89:6789/0","public_addr":"172.21.15.89:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T02:47:05.361 INFO:teuthology.orchestra.run.smithi131.stderr:dumped monmap epoch 1 2024-09-13T02:47:05.362 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:05.361+0000 7f7a5f8dc640 1 -- 172.21.15.131:0/2554064922 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f7a44039670 msgr2=0x7f7a4403bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:05.363 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:05.361+0000 7f7a5f8dc640 1 --2- 172.21.15.131:0/2554064922 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f7a44039670 0x7f7a4403bb20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f7a48006fd0 tx=0x7f7a48006db0 comp rx=0 tx=0).stop 2024-09-13T02:47:05.363 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:05.361+0000 7f7a5f8dc640 1 -- 172.21.15.131:0/2554064922 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a58065590 msgr2=0x7f7a5810c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:05.363 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:05.361+0000 7f7a5f8dc640 1 --2- 172.21.15.131:0/2554064922 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a58065590 0x7f7a5810c9a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f7a5402a6d0 tx=0x7f7a54009da0 comp rx=0 tx=0).stop 2024-09-13T02:47:05.363 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:05.361+0000 7f7a5f8dc640 1 -- 172.21.15.131:0/2554064922 shutdown_connections 2024-09-13T02:47:05.363 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:05.361+0000 7f7a5f8dc640 1 --2- 172.21.15.131:0/2554064922 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f7a44039670 0x7f7a4403bb20 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:05.363 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:05.361+0000 7f7a5f8dc640 1 --2- 172.21.15.131:0/2554064922 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7a58065590 0x7f7a5810c9a0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:05.363 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:05.361+0000 7f7a5f8dc640 1 -- 172.21.15.131:0/2554064922 >> 172.21.15.131:0/2554064922 conn(0x7f7a580f6ac0 msgr2=0x7f7a580f7350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:47:05.363 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:05.361+0000 7f7a5f8dc640 1 -- 172.21.15.131:0/2554064922 shutdown_connections 2024-09-13T02:47:05.363 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:05.361+0000 7f7a5f8dc640 1 -- 172.21.15.131:0/2554064922 wait complete. 2024-09-13T02:47:05.784 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:05 smithi089 ceph-mon[27639]: from='client.? 172.21.15.131:0/2554064922' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T02:47:07.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:06 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:07.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:06 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:07.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:06 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:07.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:06 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:07.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:06 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config rm", "who": "osd/host:smithi131", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:47:07.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:06 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:47:07.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:06 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:47:07.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:06 smithi089 ceph-mon[27639]: Updating smithi089:/etc/ceph/ceph.conf 2024-09-13T02:47:07.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:06 smithi089 ceph-mon[27639]: Updating smithi131:/etc/ceph/ceph.conf 2024-09-13T02:47:07.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:06 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:07.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:06 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:07.271 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T02:47:07.271 DEBUG:teuthology.orchestra.run.smithi131:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T02:47:07.612 INFO:teuthology.orchestra.run.smithi131.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T02:47:08.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:07 smithi089 ceph-mon[27639]: Updating smithi131:/var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T02:47:08.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:07 smithi089 ceph-mon[27639]: Updating smithi089:/var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T02:47:08.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:07 smithi089 ceph-mon[27639]: Updating smithi131:/etc/ceph/ceph.client.admin.keyring 2024-09-13T02:47:08.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:07 smithi089 ceph-mon[27639]: Updating smithi089:/etc/ceph/ceph.client.admin.keyring 2024-09-13T02:47:08.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:07 smithi089 ceph-mon[27639]: Updating smithi131:/var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T02:47:08.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:07 smithi089 ceph-mon[27639]: Updating smithi089:/var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T02:47:08.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:07 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:08.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:07 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:08.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:07 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:08.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:07 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi131", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T02:47:08.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:07 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi131", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-09-13T02:47:08.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:07 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:47:08.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:07 smithi089 ceph-mon[27639]: Deploying daemon crash.smithi131 on smithi131 2024-09-13T02:47:09.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:09.582+0000 7f4155542640 1 -- 172.21.15.131:0/1330222163 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4150102200 msgr2=0x7f41501025d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:09.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:09.582+0000 7f4155542640 1 --2- 172.21.15.131:0/1330222163 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4150102200 0x7f41501025d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4148009bd0 tx=0x7f4148004d10 comp rx=0 tx=0).stop 2024-09-13T02:47:09.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:09.582+0000 7f4155542640 1 -- 172.21.15.131:0/1330222163 shutdown_connections 2024-09-13T02:47:09.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:09.582+0000 7f4155542640 1 --2- 172.21.15.131:0/1330222163 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4150102200 0x7f41501025d0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:09.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:09.582+0000 7f4155542640 1 -- 172.21.15.131:0/1330222163 >> 172.21.15.131:0/1330222163 conn(0x7f41500f7dd0 msgr2=0x7f41500fa1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:47:09.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:09.582+0000 7f4155542640 1 -- 172.21.15.131:0/1330222163 shutdown_connections 2024-09-13T02:47:09.584 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:09.582+0000 7f4155542640 1 -- 172.21.15.131:0/1330222163 wait complete. 2024-09-13T02:47:09.585 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:09.583+0000 7f4155542640 1 Processor -- start 2024-09-13T02:47:09.585 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:09.583+0000 7f4155542640 1 -- start start 2024-09-13T02:47:09.585 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:09.583+0000 7f4155542640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4150102200 0x7f4150112760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:47:09.585 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:09.583+0000 7f4155542640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4150112ca0 con 0x7f4150102200 2024-09-13T02:47:09.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:09.583+0000 7f414effd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4150102200 0x7f4150112760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:47:09.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:09.583+0000 7f414effd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4150102200 0x7f4150112760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.131:56888/0 (socket says 172.21.15.131:56888) 2024-09-13T02:47:09.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:09.583+0000 7f414effd640 1 -- 172.21.15.131:0/140683060 learned_addr learned my addr 172.21.15.131:0/140683060 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-09-13T02:47:09.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:09.584+0000 7f414effd640 1 -- 172.21.15.131:0/140683060 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41480098b0 con 0x7f4150102200 2024-09-13T02:47:09.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:09.584+0000 7f414effd640 1 --2- 172.21.15.131:0/140683060 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4150102200 0x7f4150112760 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4148009ba0 tx=0x7f4148004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:47:09.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:09.584+0000 7f41377fe640 1 -- 172.21.15.131:0/140683060 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f41480327a0 con 0x7f4150102200 2024-09-13T02:47:09.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:09.584+0000 7f4155542640 1 -- 172.21.15.131:0/140683060 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4150112ea0 con 0x7f4150102200 2024-09-13T02:47:09.586 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:09.584+0000 7f41377fe640 1 -- 172.21.15.131:0/140683060 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4148032da0 con 0x7f4150102200 2024-09-13T02:47:09.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:09.584+0000 7f41377fe640 1 -- 172.21.15.131:0/140683060 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f414803dd80 con 0x7f4150102200 2024-09-13T02:47:09.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:09.584+0000 7f4155542640 1 -- 172.21.15.131:0/140683060 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4150113370 con 0x7f4150102200 2024-09-13T02:47:09.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:09.585+0000 7f41377fe640 1 -- 172.21.15.131:0/140683060 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 17) v1 ==== 45620+0+0 (secure 0 0 0) 0x7f414802f030 con 0x7f4150102200 2024-09-13T02:47:09.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:09.585+0000 7f4155542640 1 -- 172.21.15.131:0/140683060 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41500fd970 con 0x7f4150102200 2024-09-13T02:47:09.587 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:09.585+0000 7f41377fe640 1 --2- 172.21.15.131:0/140683060 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f4138039620 0x7f413803bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:47:09.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:09.585+0000 7f41377fe640 1 -- 172.21.15.131:0/140683060 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f414806d800 con 0x7f4150102200 2024-09-13T02:47:09.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:09.586+0000 7f414e7fc640 1 --2- 172.21.15.131:0/140683060 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f4138039620 0x7f413803bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:47:09.588 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:09.586+0000 7f414e7fc640 1 --2- 172.21.15.131:0/140683060 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f4138039620 0x7f413803bad0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4144006fd0 tx=0x7f4144006db0 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:47:09.591 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:09.590+0000 7f41377fe640 1 -- 172.21.15.131:0/140683060 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f4148032900 con 0x7f4150102200 2024-09-13T02:47:09.814 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:09.813+0000 7f4155542640 1 -- 172.21.15.131:0/140683060 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f4150113370 con 0x7f4150102200 2024-09-13T02:47:09.814 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:09.813+0000 7f41377fe640 1 -- 172.21.15.131:0/140683060 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f4150113370 con 0x7f4150102200 2024-09-13T02:47:09.815 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-13T02:47:09.815 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":1,"fsid":"12cdb164-717a-11ef-bceb-c7b262605968","modified":"2024-09-13T02:45:02.514381Z","created":"2024-09-13T02:45:02.514381Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi089","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:3300","nonce":0},{"type":"v1","addr":"172.21.15.89:6789","nonce":0}]},"addr":"172.21.15.89:6789/0","public_addr":"172.21.15.89:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T02:47:09.815 INFO:teuthology.orchestra.run.smithi131.stderr:dumped monmap epoch 1 2024-09-13T02:47:09.816 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:09.815+0000 7f4155542640 1 -- 172.21.15.131:0/140683060 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f4138039620 msgr2=0x7f413803bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:09.817 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:09.815+0000 7f4155542640 1 --2- 172.21.15.131:0/140683060 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f4138039620 0x7f413803bad0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4144006fd0 tx=0x7f4144006db0 comp rx=0 tx=0).stop 2024-09-13T02:47:09.817 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:09.815+0000 7f4155542640 1 -- 172.21.15.131:0/140683060 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4150102200 msgr2=0x7f4150112760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:09.817 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:09.815+0000 7f4155542640 1 --2- 172.21.15.131:0/140683060 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4150102200 0x7f4150112760 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f4148009ba0 tx=0x7f4148004d10 comp rx=0 tx=0).stop 2024-09-13T02:47:09.817 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:09.815+0000 7f4155542640 1 -- 172.21.15.131:0/140683060 shutdown_connections 2024-09-13T02:47:09.817 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:09.815+0000 7f4155542640 1 --2- 172.21.15.131:0/140683060 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f4138039620 0x7f413803bad0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:09.817 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:09.815+0000 7f4155542640 1 --2- 172.21.15.131:0/140683060 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4150102200 0x7f4150112760 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:09.817 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:09.815+0000 7f4155542640 1 -- 172.21.15.131:0/140683060 >> 172.21.15.131:0/140683060 conn(0x7f41500f7dd0 msgr2=0x7f41500f9580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:47:09.817 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:09.815+0000 7f4155542640 1 -- 172.21.15.131:0/140683060 shutdown_connections 2024-09-13T02:47:09.817 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:09.815+0000 7f4155542640 1 -- 172.21.15.131:0/140683060 wait complete. 2024-09-13T02:47:10.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:09 smithi089 ceph-mon[27639]: from='client.? 172.21.15.131:0/140683060' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T02:47:11.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:11 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:11.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:11 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:11.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:11 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:11.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:11 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:11.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:11 smithi089 ceph-mon[27639]: Deploying daemon node-exporter.smithi131 on smithi131 2024-09-13T02:47:11.583 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T02:47:11.583 DEBUG:teuthology.orchestra.run.smithi131:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T02:47:11.828 INFO:teuthology.orchestra.run.smithi131.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T02:47:14.570 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:14.561+0000 7f4b5c673640 1 -- 172.21.15.131:0/3656101992 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b541010d0 msgr2=0x7f4b541014a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:14.570 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:14.561+0000 7f4b5c673640 1 --2- 172.21.15.131:0/3656101992 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b541010d0 0x7f4b541014a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4b44004850 tx=0x7f4b44009da0 comp rx=0 tx=0).stop 2024-09-13T02:47:14.570 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:14.561+0000 7f4b5c673640 1 -- 172.21.15.131:0/3656101992 shutdown_connections 2024-09-13T02:47:14.570 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:14.561+0000 7f4b5c673640 1 --2- 172.21.15.131:0/3656101992 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b541010d0 0x7f4b541014a0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:14.570 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:14.561+0000 7f4b5c673640 1 -- 172.21.15.131:0/3656101992 >> 172.21.15.131:0/3656101992 conn(0x7f4b540f6ca0 msgr2=0x7f4b540f90b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:47:14.570 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:14.561+0000 7f4b5c673640 1 -- 172.21.15.131:0/3656101992 shutdown_connections 2024-09-13T02:47:14.570 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:14.561+0000 7f4b5c673640 1 -- 172.21.15.131:0/3656101992 wait complete. 2024-09-13T02:47:14.570 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:14.562+0000 7f4b5c673640 1 Processor -- start 2024-09-13T02:47:14.570 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:14.562+0000 7f4b5c673640 1 -- start start 2024-09-13T02:47:14.571 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:14.562+0000 7f4b5c673640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b541010d0 0x7f4b54111670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:47:14.571 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:14.562+0000 7f4b5c673640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b54111bb0 con 0x7f4b541010d0 2024-09-13T02:47:14.571 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:14.562+0000 7f4b5a40f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b541010d0 0x7f4b54111670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:47:14.571 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:14.562+0000 7f4b5a40f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b541010d0 0x7f4b54111670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.131:37496/0 (socket says 172.21.15.131:37496) 2024-09-13T02:47:14.571 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:14.562+0000 7f4b5a40f640 1 -- 172.21.15.131:0/759834573 learned_addr learned my addr 172.21.15.131:0/759834573 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-09-13T02:47:14.571 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:14.563+0000 7f4b5a40f640 1 -- 172.21.15.131:0/759834573 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b44005040 con 0x7f4b541010d0 2024-09-13T02:47:14.571 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:14.563+0000 7f4b5a40f640 1 --2- 172.21.15.131:0/759834573 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b541010d0 0x7f4b54111670 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f4b44004820 tx=0x7f4b44009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:47:14.571 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:14.563+0000 7f4b4affd640 1 -- 172.21.15.131:0/759834573 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4b44033630 con 0x7f4b541010d0 2024-09-13T02:47:14.571 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:14.563+0000 7f4b4affd640 1 -- 172.21.15.131:0/759834573 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4b44033c30 con 0x7f4b541010d0 2024-09-13T02:47:14.571 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:14.563+0000 7f4b5c673640 1 -- 172.21.15.131:0/759834573 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b54111db0 con 0x7f4b541010d0 2024-09-13T02:47:14.571 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:14.563+0000 7f4b4affd640 1 -- 172.21.15.131:0/759834573 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4b4403dcc0 con 0x7f4b541010d0 2024-09-13T02:47:14.571 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:14.563+0000 7f4b5c673640 1 -- 172.21.15.131:0/759834573 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b54112220 con 0x7f4b541010d0 2024-09-13T02:47:14.572 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:14.564+0000 7f4b5c673640 1 -- 172.21.15.131:0/759834573 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b540fc840 con 0x7f4b541010d0 2024-09-13T02:47:14.572 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:14.564+0000 7f4b4affd640 1 -- 172.21.15.131:0/759834573 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 17) v1 ==== 45620+0+0 (secure 0 0 0) 0x7f4b44030020 con 0x7f4b541010d0 2024-09-13T02:47:14.572 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:14.564+0000 7f4b4affd640 1 --2- 172.21.15.131:0/759834573 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f4b40039670 0x7f4b4003bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:47:14.572 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:14.564+0000 7f4b4affd640 1 -- 172.21.15.131:0/759834573 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f4b4406cac0 con 0x7f4b541010d0 2024-09-13T02:47:14.572 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:14.565+0000 7f4b59c0e640 1 --2- 172.21.15.131:0/759834573 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f4b40039670 0x7f4b4003bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:47:14.572 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:14.565+0000 7f4b59c0e640 1 --2- 172.21.15.131:0/759834573 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f4b40039670 0x7f4b4003bb20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f4b50006fd0 tx=0x7f4b50006db0 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:47:14.572 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:14.570+0000 7f4b4affd640 1 -- 172.21.15.131:0/759834573 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f4b44033da0 con 0x7f4b541010d0 2024-09-13T02:47:14.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:14.805+0000 7f4b5c673640 1 -- 172.21.15.131:0/759834573 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f4b5405ed70 con 0x7f4b541010d0 2024-09-13T02:47:14.807 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:14.805+0000 7f4b4affd640 1 -- 172.21.15.131:0/759834573 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f4b4406ce60 con 0x7f4b541010d0 2024-09-13T02:47:14.808 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-13T02:47:14.808 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":1,"fsid":"12cdb164-717a-11ef-bceb-c7b262605968","modified":"2024-09-13T02:45:02.514381Z","created":"2024-09-13T02:45:02.514381Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi089","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:3300","nonce":0},{"type":"v1","addr":"172.21.15.89:6789","nonce":0}]},"addr":"172.21.15.89:6789/0","public_addr":"172.21.15.89:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T02:47:14.808 INFO:teuthology.orchestra.run.smithi131.stderr:dumped monmap epoch 1 2024-09-13T02:47:14.810 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:14.808+0000 7f4b5c673640 1 -- 172.21.15.131:0/759834573 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f4b40039670 msgr2=0x7f4b4003bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:14.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:14.808+0000 7f4b5c673640 1 --2- 172.21.15.131:0/759834573 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f4b40039670 0x7f4b4003bb20 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f4b50006fd0 tx=0x7f4b50006db0 comp rx=0 tx=0).stop 2024-09-13T02:47:14.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:14.808+0000 7f4b5c673640 1 -- 172.21.15.131:0/759834573 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b541010d0 msgr2=0x7f4b54111670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:14.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:14.808+0000 7f4b5c673640 1 --2- 172.21.15.131:0/759834573 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b541010d0 0x7f4b54111670 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f4b44004820 tx=0x7f4b44009da0 comp rx=0 tx=0).stop 2024-09-13T02:47:14.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:14.808+0000 7f4b5c673640 1 -- 172.21.15.131:0/759834573 shutdown_connections 2024-09-13T02:47:14.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:14.808+0000 7f4b5c673640 1 --2- 172.21.15.131:0/759834573 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f4b40039670 0x7f4b4003bb20 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:14.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:14.808+0000 7f4b5c673640 1 --2- 172.21.15.131:0/759834573 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b541010d0 0x7f4b54111670 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:14.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:14.808+0000 7f4b5c673640 1 -- 172.21.15.131:0/759834573 >> 172.21.15.131:0/759834573 conn(0x7f4b540f6ca0 msgr2=0x7f4b540f8510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:47:14.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:14.808+0000 7f4b5c673640 1 -- 172.21.15.131:0/759834573 shutdown_connections 2024-09-13T02:47:14.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:14.808+0000 7f4b5c673640 1 -- 172.21.15.131:0/759834573 wait complete. 2024-09-13T02:47:15.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:14 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:15.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:14 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:47:15.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:14 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:15.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:14 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:15.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:14 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:15.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:14 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:15.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:14 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi131.aunbqd", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T02:47:15.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:14 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi131.aunbqd", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-13T02:47:15.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:14 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T02:47:15.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:14 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:47:15.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:14 smithi089 ceph-mon[27639]: Deploying daemon mgr.smithi131.aunbqd on smithi131 2024-09-13T02:47:15.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:14 smithi089 ceph-mon[27639]: from='client.? 172.21.15.131:0/759834573' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T02:47:16.802 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T02:47:16.804 DEBUG:teuthology.orchestra.run.smithi131:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T02:47:17.135 INFO:teuthology.orchestra.run.smithi131.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T02:47:18.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:18 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:18.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:18 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:18.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:18 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:18.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:18 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:18.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:18 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T02:47:18.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:18 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:47:18.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:18 smithi089 ceph-mon[27639]: Deploying daemon mon.smithi131 on smithi131 2024-09-13T02:47:18.654 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:18.647+0000 7f9385129640 1 -- 172.21.15.131:0/1277845436 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93801021e0 msgr2=0x7f93801025b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:18.654 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:18.647+0000 7f9385129640 1 --2- 172.21.15.131:0/1277845436 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93801021e0 0x7f93801025b0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f9370004850 tx=0x7f9370009da0 comp rx=0 tx=0).stop 2024-09-13T02:47:18.654 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:18.647+0000 7f9385129640 1 -- 172.21.15.131:0/1277845436 shutdown_connections 2024-09-13T02:47:18.654 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:18.647+0000 7f9385129640 1 --2- 172.21.15.131:0/1277845436 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93801021e0 0x7f93801025b0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:18.654 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:18.647+0000 7f9385129640 1 -- 172.21.15.131:0/1277845436 >> 172.21.15.131:0/1277845436 conn(0x7f93800f7d90 msgr2=0x7f93800fa1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:47:18.654 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:18.647+0000 7f9385129640 1 -- 172.21.15.131:0/1277845436 shutdown_connections 2024-09-13T02:47:18.654 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:18.647+0000 7f9385129640 1 -- 172.21.15.131:0/1277845436 wait complete. 2024-09-13T02:47:18.655 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:18.648+0000 7f9385129640 1 Processor -- start 2024-09-13T02:47:18.655 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:18.648+0000 7f9385129640 1 -- start start 2024-09-13T02:47:18.655 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:18.648+0000 7f9385129640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93801021e0 0x7f9380112780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:47:18.655 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:18.648+0000 7f9385129640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9380112cc0 con 0x7f93801021e0 2024-09-13T02:47:18.655 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:18.649+0000 7f937ed9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93801021e0 0x7f9380112780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:47:18.655 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:18.649+0000 7f937ed9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93801021e0 0x7f9380112780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.131:37538/0 (socket says 172.21.15.131:37538) 2024-09-13T02:47:18.655 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:18.649+0000 7f937ed9d640 1 -- 172.21.15.131:0/2250773815 learned_addr learned my addr 172.21.15.131:0/2250773815 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-09-13T02:47:18.655 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:18.649+0000 7f937ed9d640 1 -- 172.21.15.131:0/2250773815 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9370005040 con 0x7f93801021e0 2024-09-13T02:47:18.655 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:18.649+0000 7f937ed9d640 1 --2- 172.21.15.131:0/2250773815 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93801021e0 0x7f9380112780 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f937002a6d0 tx=0x7f9370009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:47:18.655 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:18.649+0000 7f93677fe640 1 -- 172.21.15.131:0/2250773815 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f937002cf10 con 0x7f93801021e0 2024-09-13T02:47:18.655 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:18.650+0000 7f9385129640 1 -- 172.21.15.131:0/2250773815 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9380112ec0 con 0x7f93801021e0 2024-09-13T02:47:18.655 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:18.650+0000 7f93677fe640 1 -- 172.21.15.131:0/2250773815 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9370033ad0 con 0x7f93801021e0 2024-09-13T02:47:18.655 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:18.650+0000 7f93677fe640 1 -- 172.21.15.131:0/2250773815 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f937003ebb0 con 0x7f93801021e0 2024-09-13T02:47:18.656 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:18.650+0000 7f9385129640 1 -- 172.21.15.131:0/2250773815 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9380113390 con 0x7f93801021e0 2024-09-13T02:47:18.656 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:18.650+0000 7f93677fe640 1 -- 172.21.15.131:0/2250773815 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 17) v1 ==== 45620+0+0 (secure 0 0 0) 0x7f9370030020 con 0x7f93801021e0 2024-09-13T02:47:18.656 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:18.650+0000 7f9385129640 1 -- 172.21.15.131:0/2250773815 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93800fd950 con 0x7f93801021e0 2024-09-13T02:47:18.656 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:18.651+0000 7f93677fe640 1 --2- 172.21.15.131:0/2250773815 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f9368039670 0x7f936803bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:47:18.656 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:18.651+0000 7f93677fe640 1 -- 172.21.15.131:0/2250773815 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f937006d5c0 con 0x7f93801021e0 2024-09-13T02:47:18.656 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:18.651+0000 7f937e59c640 1 --2- 172.21.15.131:0/2250773815 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f9368039670 0x7f936803bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:47:18.656 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:18.651+0000 7f937e59c640 1 --2- 172.21.15.131:0/2250773815 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f9368039670 0x7f936803bb20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9374006fd0 tx=0x7f9374006db0 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:47:18.657 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:18.656+0000 7f93677fe640 1 -- 172.21.15.131:0/2250773815 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f937003c930 con 0x7f93801021e0 2024-09-13T02:47:18.886 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:18.884+0000 7f9385129640 1 -- 172.21.15.131:0/2250773815 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f9380113390 con 0x7f93801021e0 2024-09-13T02:47:18.886 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:18.885+0000 7f93677fe640 1 -- 172.21.15.131:0/2250773815 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7f9380113390 con 0x7f93801021e0 2024-09-13T02:47:18.887 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-13T02:47:18.887 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":1,"fsid":"12cdb164-717a-11ef-bceb-c7b262605968","modified":"2024-09-13T02:45:02.514381Z","created":"2024-09-13T02:45:02.514381Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi089","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:3300","nonce":0},{"type":"v1","addr":"172.21.15.89:6789","nonce":0}]},"addr":"172.21.15.89:6789/0","public_addr":"172.21.15.89:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T02:47:18.887 INFO:teuthology.orchestra.run.smithi131.stderr:dumped monmap epoch 1 2024-09-13T02:47:18.889 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:18.887+0000 7f9385129640 1 -- 172.21.15.131:0/2250773815 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f9368039670 msgr2=0x7f936803bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:18.889 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:18.887+0000 7f9385129640 1 --2- 172.21.15.131:0/2250773815 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f9368039670 0x7f936803bb20 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f9374006fd0 tx=0x7f9374006db0 comp rx=0 tx=0).stop 2024-09-13T02:47:18.889 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:18.887+0000 7f9385129640 1 -- 172.21.15.131:0/2250773815 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93801021e0 msgr2=0x7f9380112780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:18.889 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:18.887+0000 7f9385129640 1 --2- 172.21.15.131:0/2250773815 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93801021e0 0x7f9380112780 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f937002a6d0 tx=0x7f9370009da0 comp rx=0 tx=0).stop 2024-09-13T02:47:18.889 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:18.888+0000 7f9385129640 1 -- 172.21.15.131:0/2250773815 shutdown_connections 2024-09-13T02:47:18.889 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:18.888+0000 7f9385129640 1 --2- 172.21.15.131:0/2250773815 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f9368039670 0x7f936803bb20 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:18.889 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:18.888+0000 7f9385129640 1 --2- 172.21.15.131:0/2250773815 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f93801021e0 0x7f9380112780 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:18.889 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:18.888+0000 7f9385129640 1 -- 172.21.15.131:0/2250773815 >> 172.21.15.131:0/2250773815 conn(0x7f93800f7d90 msgr2=0x7f93800f95a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:47:18.889 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:18.888+0000 7f9385129640 1 -- 172.21.15.131:0/2250773815 shutdown_connections 2024-09-13T02:47:18.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:18.888+0000 7f9385129640 1 -- 172.21.15.131:0/2250773815 wait complete. 2024-09-13T02:47:19.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:19 smithi089 ceph-mon[27639]: from='client.? 172.21.15.131:0/2250773815' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T02:47:19.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:19 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:20.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:20 smithi089 ceph-mon[27639]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:47:20.995 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T02:47:20.996 DEBUG:teuthology.orchestra.run.smithi131:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T02:47:21.580 INFO:teuthology.orchestra.run.smithi131.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/mon.smithi131/config 2024-09-13T02:47:22.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:22 smithi089 ceph-mon[27639]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:47:22.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:22 smithi089 ceph-mon[27639]: Standby manager daemon smithi131.aunbqd started 2024-09-13T02:47:22.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:22 smithi089 ceph-mon[27639]: from='mgr.? 172.21.15.131:0/2713434061' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi131.aunbqd/crt"}]: dispatch 2024-09-13T02:47:22.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:22 smithi089 ceph-mon[27639]: from='mgr.? 172.21.15.131:0/2713434061' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T02:47:22.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:22 smithi089 ceph-mon[27639]: from='mgr.? 172.21.15.131:0/2713434061' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi131.aunbqd/key"}]: dispatch 2024-09-13T02:47:22.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:22 smithi089 ceph-mon[27639]: from='mgr.? 172.21.15.131:0/2713434061' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T02:47:23.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:23.183+0000 7fba89c58640 1 -- 172.21.15.131:0/2701085180 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fba841022f0 msgr2=0x7fba841026c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:23.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:23.183+0000 7fba89c58640 1 --2- 172.21.15.131:0/2701085180 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fba841022f0 0x7fba841026c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fba74004850 tx=0x7fba74009da0 comp rx=0 tx=0).stop 2024-09-13T02:47:23.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:23.183+0000 7fba89c58640 1 -- 172.21.15.131:0/2701085180 shutdown_connections 2024-09-13T02:47:23.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:23.183+0000 7fba89c58640 1 --2- 172.21.15.131:0/2701085180 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fba841022f0 0x7fba841026c0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:23.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:23.183+0000 7fba89c58640 1 -- 172.21.15.131:0/2701085180 >> 172.21.15.131:0/2701085180 conn(0x7fba840f7ec0 msgr2=0x7fba840fa2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:47:23.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:23.183+0000 7fba89c58640 1 -- 172.21.15.131:0/2701085180 shutdown_connections 2024-09-13T02:47:23.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:23.183+0000 7fba89c58640 1 -- 172.21.15.131:0/2701085180 wait complete. 2024-09-13T02:47:23.185 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:23.183+0000 7fba89c58640 1 Processor -- start 2024-09-13T02:47:23.186 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:23.184+0000 7fba89c58640 1 -- start start 2024-09-13T02:47:23.190 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:23.184+0000 7fba89c58640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fba841022f0 0x7fba841128a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:47:23.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:23.184+0000 7fba89c58640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba84112de0 con 0x7fba841022f0 2024-09-13T02:47:23.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:23.184+0000 7fba837fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fba841022f0 0x7fba841128a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:47:23.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:23.184+0000 7fba837fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fba841022f0 0x7fba841128a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.131:48570/0 (socket says 172.21.15.131:48570) 2024-09-13T02:47:23.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:23.184+0000 7fba837fe640 1 -- 172.21.15.131:0/3528026699 learned_addr learned my addr 172.21.15.131:0/3528026699 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-09-13T02:47:23.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:23.184+0000 7fba837fe640 1 -- 172.21.15.131:0/3528026699 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba74005040 con 0x7fba841022f0 2024-09-13T02:47:23.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:23.184+0000 7fba837fe640 1 --2- 172.21.15.131:0/3528026699 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fba841022f0 0x7fba841128a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fba7402a6d0 tx=0x7fba74009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:47:23.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:23.185+0000 7fba6bfff640 1 -- 172.21.15.131:0/3528026699 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fba7402cf10 con 0x7fba841022f0 2024-09-13T02:47:23.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:23.185+0000 7fba89c58640 1 -- 172.21.15.131:0/3528026699 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba84112fe0 con 0x7fba841022f0 2024-09-13T02:47:23.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:23.185+0000 7fba6bfff640 1 -- 172.21.15.131:0/3528026699 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fba74033ad0 con 0x7fba841022f0 2024-09-13T02:47:23.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:23.185+0000 7fba6bfff640 1 -- 172.21.15.131:0/3528026699 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fba7403ebb0 con 0x7fba841022f0 2024-09-13T02:47:23.191 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:23.185+0000 7fba89c58640 1 -- 172.21.15.131:0/3528026699 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba841134b0 con 0x7fba841022f0 2024-09-13T02:47:23.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:23.186+0000 7fba89c58640 1 -- 172.21.15.131:0/3528026699 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba840fda60 con 0x7fba841022f0 2024-09-13T02:47:23.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:23.186+0000 7fba6bfff640 1 -- 172.21.15.131:0/3528026699 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 18) v1 ==== 90811+0+0 (secure 0 0 0) 0x7fba74030020 con 0x7fba841022f0 2024-09-13T02:47:23.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:23.187+0000 7fba6bfff640 1 --2- 172.21.15.131:0/3528026699 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fba6c06eca0 0x7fba6c071150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:47:23.192 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:23.187+0000 7fba6bfff640 1 -- 172.21.15.131:0/3528026699 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7fba740ad9c0 con 0x7fba841022f0 2024-09-13T02:47:23.194 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:23.187+0000 7fba82ffd640 1 --2- 172.21.15.131:0/3528026699 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fba6c06eca0 0x7fba6c071150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:47:23.194 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:23.187+0000 7fba82ffd640 1 --2- 172.21.15.131:0/3528026699 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fba6c06eca0 0x7fba6c071150 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fba78006fd0 tx=0x7fba78006db0 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:47:23.195 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:23.190+0000 7fba6bfff640 1 -- 172.21.15.131:0/3528026699 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fba7407bba0 con 0x7fba841022f0 2024-09-13T02:47:23.418 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:23.417+0000 7fba89c58640 1 -- 172.21.15.131:0/3528026699 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fba841134b0 con 0x7fba841022f0 2024-09-13T02:47:23.419 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:23.418+0000 7fba6bfff640 1 -- 172.21.15.131:0/3528026699 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+739 (secure 0 0 0) 0x7fba841134b0 con 0x7fba841022f0 2024-09-13T02:47:23.420 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-13T02:47:23.420 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":1,"fsid":"12cdb164-717a-11ef-bceb-c7b262605968","modified":"2024-09-13T02:45:02.514381Z","created":"2024-09-13T02:45:02.514381Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi089","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:3300","nonce":0},{"type":"v1","addr":"172.21.15.89:6789","nonce":0}]},"addr":"172.21.15.89:6789/0","public_addr":"172.21.15.89:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-13T02:47:23.420 INFO:teuthology.orchestra.run.smithi131.stderr:dumped monmap epoch 1 2024-09-13T02:47:23.421 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:23.420+0000 7fba89c58640 1 -- 172.21.15.131:0/3528026699 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fba6c06eca0 msgr2=0x7fba6c071150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:23.421 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:23.420+0000 7fba89c58640 1 --2- 172.21.15.131:0/3528026699 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fba6c06eca0 0x7fba6c071150 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fba78006fd0 tx=0x7fba78006db0 comp rx=0 tx=0).stop 2024-09-13T02:47:23.421 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:23.420+0000 7fba89c58640 1 -- 172.21.15.131:0/3528026699 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fba841022f0 msgr2=0x7fba841128a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:23.421 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:23.420+0000 7fba89c58640 1 --2- 172.21.15.131:0/3528026699 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fba841022f0 0x7fba841128a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fba7402a6d0 tx=0x7fba74009da0 comp rx=0 tx=0).stop 2024-09-13T02:47:23.421 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:23.420+0000 7fba89c58640 1 -- 172.21.15.131:0/3528026699 shutdown_connections 2024-09-13T02:47:23.421 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:23.420+0000 7fba89c58640 1 --2- 172.21.15.131:0/3528026699 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fba6c06eca0 0x7fba6c071150 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:23.422 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:23.420+0000 7fba89c58640 1 --2- 172.21.15.131:0/3528026699 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fba841022f0 0x7fba841128a0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:23.422 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:23.420+0000 7fba89c58640 1 -- 172.21.15.131:0/3528026699 >> 172.21.15.131:0/3528026699 conn(0x7fba840f7ec0 msgr2=0x7fba840f9730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:47:23.422 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:23.420+0000 7fba89c58640 1 -- 172.21.15.131:0/3528026699 shutdown_connections 2024-09-13T02:47:23.422 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:23.420+0000 7fba89c58640 1 -- 172.21.15.131:0/3528026699 wait complete. 2024-09-13T02:47:23.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:23 smithi089 ceph-mon[27639]: mgrmap e18: smithi089.guohvs(active, since 23s), standbys: smithi131.aunbqd 2024-09-13T02:47:23.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:23 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mgr metadata", "who": "smithi131.aunbqd", "id": "smithi131.aunbqd"}]: dispatch 2024-09-13T02:47:24.158 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: mon.smithi131@-1(???) e0 preinit fsid 12cdb164-717a-11ef-bceb-c7b262605968 2024-09-13T02:47:24.158 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: mon.smithi131@-1(synchronizing).mds e1 new map 2024-09-13T02:47:24.158 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: mon.smithi131@-1(synchronizing).mds e1 print_map 2024-09-13T02:47:24.158 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: e1 2024-09-13T02:47:24.159 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T02:47:24.159 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:47:24.159 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: legacy client fscid: -1 2024-09-13T02:47:24.159 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: 2024-09-13T02:47:24.159 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: No filesystems configured 2024-09-13T02:47:24.159 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: mon.smithi131@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-13T02:47:24.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: mon.smithi131@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-13T02:47:24.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: mon.smithi131@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-13T02:47:24.435 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: mon.smithi131@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-13T02:47:24.435 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: mon.smithi131@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-13T02:47:24.435 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: mon.smithi131@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-13T02:47:24.435 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: mon.smithi131@-1(synchronizing).osd e5 e5: 0 total, 0 up, 0 in 2024-09-13T02:47:24.435 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: mon.smithi131@-1(synchronizing).osd e5 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-13T02:47:24.435 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: mon.smithi131@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-09-13T02:47:24.435 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: mon.smithi131@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-09-13T02:47:24.435 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: mon.smithi131@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-09-13T02:47:24.435 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: from='mgr.14158 172.21.15.89:0/2682144324' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:24.435 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: from='mgr.14158 172.21.15.89:0/2682144324' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:24.435 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: from='mgr.14158 172.21.15.89:0/2682144324' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:24.435 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: from='mgr.14158 172.21.15.89:0/2682144324' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:24.435 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: Deploying daemon alertmanager.smithi089 on smithi089 2024-09-13T02:47:24.436 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: from='mgr.14158 172.21.15.89:0/2682144324' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:24.436 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: Added host smithi131 2024-09-13T02:47:24.436 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:47:24.436 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:47:24.436 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T02:47:24.436 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: from='mgr.14158 172.21.15.89:0/2682144324' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:24.436 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:47:24.436 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:47:24.436 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:47:24.436 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: from='client.? 172.21.15.89:0/2518565349' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-13T02:47:24.436 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: from='mgr.14158 172.21.15.89:0/2682144324' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:24.436 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: from='mgr.14158 172.21.15.89:0/2682144324' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:24.437 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: from='mgr.14158 172.21.15.89:0/2682144324' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:24.437 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: from='mgr.14158 172.21.15.89:0/2682144324' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:24.437 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: from='mgr.14158 172.21.15.89:0/2682144324' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:24.437 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: from='mgr.14158 172.21.15.89:0/2682144324' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:24.437 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: from='mgr.14158 172.21.15.89:0/2682144324' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-13T02:47:24.437 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: from='mgr.14158 172.21.15.89:0/2682144324' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:24.437 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-09-13T02:47:24.437 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: Deploying daemon grafana.smithi089 on smithi089 2024-09-13T02:47:24.437 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: from='client.? 172.21.15.89:0/2518565349' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-13T02:47:24.437 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: osdmap e4: 0 total, 0 up, 0 in 2024-09-13T02:47:24.437 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:47:24.437 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: from='client.14190 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi089:172.21.15.89=smithi089;smithi131:172.21.15.131=smithi131", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:47:24.437 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: Saving service mon spec with placement smithi089:172.21.15.89=smithi089;smithi131:172.21.15.131=smithi131;count:2 2024-09-13T02:47:24.438 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: from='mgr.14158 172.21.15.89:0/2682144324' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:24.438 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:47:24.438 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: from='mgr.14158 172.21.15.89:0/2682144324' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:24.438 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:47:24.438 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: from='client.? 172.21.15.131:0/2488402326' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T02:47:24.438 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:47:24.438 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: from='client.? 172.21.15.131:0/2297881388' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T02:47:24.438 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:47:24.438 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:47:24.438 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: from='mgr.14158 172.21.15.89:0/2682144324' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:24.438 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: from='mgr.14158 172.21.15.89:0/2682144324' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:24.438 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: from='mgr.14158 172.21.15.89:0/2682144324' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:24.438 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: from='mgr.14158 172.21.15.89:0/2682144324' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:24.438 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: from='mgr.14158 172.21.15.89:0/2682144324' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:24.439 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: from='mgr.14158 172.21.15.89:0/2682144324' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:24.439 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: Deploying daemon prometheus.smithi089 on smithi089 2024-09-13T02:47:24.439 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: from='client.? 172.21.15.131:0/1789815870' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T02:47:24.439 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:47:24.439 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: from='mgr.14158 172.21.15.89:0/2682144324' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:24.439 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:47:24.439 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: from='client.? 172.21.15.131:0/1118780137' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T02:47:24.439 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:47:24.439 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:47:24.439 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: from='client.? 172.21.15.131:0/3808373293' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T02:47:24.439 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:47:24.439 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: from='mgr.14158 172.21.15.89:0/2682144324' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:24.440 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:24 smithi089 ceph-mon[27639]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:47:24.440 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:24 smithi089 ceph-mon[27639]: from='client.? 172.21.15.131:0/3528026699' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T02:47:24.441 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: from='mgr.14158 172.21.15.89:0/2682144324' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:24.441 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: from='mgr.14158 172.21.15.89:0/2682144324' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:24.441 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: from='mgr.14158 172.21.15.89:0/2682144324' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-09-13T02:47:24.441 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: from='mgr.14158 172.21.15.89:0/2682144324' entity='mgr.smithi089.guohvs' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-09-13T02:47:24.441 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: mgrmap e14: smithi089.guohvs(active, since 53s) 2024-09-13T02:47:24.441 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: from='client.? 172.21.15.131:0/984715189' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T02:47:24.441 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: from='client.? 172.21.15.131:0/3487036240' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T02:47:24.441 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: Active manager daemon smithi089.guohvs restarted 2024-09-13T02:47:24.441 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: Activating manager daemon smithi089.guohvs 2024-09-13T02:47:24.441 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: osdmap e5: 0 total, 0 up, 0 in 2024-09-13T02:47:24.441 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: mgrmap e15: smithi089.guohvs(active, starting, since 0.00326001s) 2024-09-13T02:47:24.441 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mon metadata", "id": "smithi089"}]: dispatch 2024-09-13T02:47:24.442 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mgr metadata", "who": "smithi089.guohvs", "id": "smithi089.guohvs"}]: dispatch 2024-09-13T02:47:24.442 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T02:47:24.442 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T02:47:24.442 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T02:47:24.442 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: Manager daemon smithi089.guohvs is now available 2024-09-13T02:47:24.442 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:47:24.442 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:24.442 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:47:24.442 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi089.guohvs/mirror_snapshot_schedule"}]: dispatch 2024-09-13T02:47:24.442 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi089.guohvs/trash_purge_schedule"}]: dispatch 2024-09-13T02:47:24.442 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:24.442 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: mgrmap e16: smithi089.guohvs(active, since 1.00564s) 2024-09-13T02:47:24.442 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:24.442 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:24.443 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: [13/Sep/2024:02:47:00] ENGINE Bus STARTING 2024-09-13T02:47:24.443 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: [13/Sep/2024:02:47:00] ENGINE Serving on https://172.21.15.89:7150 2024-09-13T02:47:24.443 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: [13/Sep/2024:02:47:00] ENGINE Bus STARTED 2024-09-13T02:47:24.443 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: [13/Sep/2024:02:47:00] ENGINE Error in HTTPServer.serve 2024-09-13T02:47:24.443 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: Traceback (most recent call last): 2024-09-13T02:47:24.443 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T02:47:24.443 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: self._connections.run(self.expiration_interval) 2024-09-13T02:47:24.443 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T02:47:24.443 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: self._run(expiration_interval) 2024-09-13T02:47:24.443 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T02:47:24.443 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T02:47:24.443 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T02:47:24.443 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T02:47:24.443 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T02:47:24.444 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: s = self.context.wrap_socket( 2024-09-13T02:47:24.444 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T02:47:24.444 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: return self.sslsocket_class._create( 2024-09-13T02:47:24.444 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T02:47:24.444 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: self.do_handshake() 2024-09-13T02:47:24.444 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T02:47:24.444 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: self._sslobj.do_handshake() 2024-09-13T02:47:24.444 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T02:47:24.444 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:24.444 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: from='client.? 172.21.15.131:0/2779829343' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T02:47:24.444 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: mgrmap e17: smithi089.guohvs(active, since 2s) 2024-09-13T02:47:24.444 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:24.444 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:24.444 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:24.445 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:24.445 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config rm", "who": "osd/host:smithi089", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:47:24.445 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: from='client.? 172.21.15.131:0/2554064922' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T02:47:24.445 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:24.445 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:24.445 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:24.445 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:24.445 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config rm", "who": "osd/host:smithi131", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:47:24.445 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:47:24.445 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:47:24.445 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: Updating smithi089:/etc/ceph/ceph.conf 2024-09-13T02:47:24.445 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: Updating smithi131:/etc/ceph/ceph.conf 2024-09-13T02:47:24.445 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:24.446 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:24.446 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: Updating smithi131:/var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T02:47:24.446 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: Updating smithi089:/var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T02:47:24.446 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: Updating smithi131:/etc/ceph/ceph.client.admin.keyring 2024-09-13T02:47:24.446 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: Updating smithi089:/etc/ceph/ceph.client.admin.keyring 2024-09-13T02:47:24.446 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: Updating smithi131:/var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T02:47:24.446 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: Updating smithi089:/var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T02:47:24.446 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:24.446 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:24.446 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:24.446 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi131", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T02:47:24.446 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi131", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-09-13T02:47:24.446 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:47:24.446 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: Deploying daemon crash.smithi131 on smithi131 2024-09-13T02:47:24.447 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: from='client.? 172.21.15.131:0/140683060' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T02:47:24.447 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:24.447 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:24.447 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:24.447 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:24.447 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: Deploying daemon node-exporter.smithi131 on smithi131 2024-09-13T02:47:24.447 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:24.447 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:47:24.447 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:24.447 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:24.447 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:24.447 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:24.447 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi131.aunbqd", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T02:47:24.447 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi131.aunbqd", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-13T02:47:24.447 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T02:47:24.448 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:47:24.448 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: Deploying daemon mgr.smithi131.aunbqd on smithi131 2024-09-13T02:47:24.448 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: from='client.? 172.21.15.131:0/759834573' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T02:47:24.448 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:24.448 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:24.448 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:24.448 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:24.448 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T02:47:24.448 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:47:24.448 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: Deploying daemon mon.smithi131 on smithi131 2024-09-13T02:47:24.448 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: from='client.? 172.21.15.131:0/2250773815' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T02:47:24.448 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:24.448 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:47:24.448 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:47:24.449 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: Standby manager daemon smithi131.aunbqd started 2024-09-13T02:47:24.449 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: from='mgr.? 172.21.15.131:0/2713434061' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi131.aunbqd/crt"}]: dispatch 2024-09-13T02:47:24.449 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: from='mgr.? 172.21.15.131:0/2713434061' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T02:47:24.449 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: from='mgr.? 172.21.15.131:0/2713434061' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi131.aunbqd/key"}]: dispatch 2024-09-13T02:47:24.449 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: from='mgr.? 172.21.15.131:0/2713434061' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T02:47:24.449 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: mgrmap e18: smithi089.guohvs(active, since 23s), standbys: smithi131.aunbqd 2024-09-13T02:47:24.449 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mgr metadata", "who": "smithi131.aunbqd", "id": "smithi131.aunbqd"}]: dispatch 2024-09-13T02:47:24.449 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:47:24.449 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: from='client.? 172.21.15.131:0/3528026699' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T02:47:24.449 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 ceph-mon[34689]: mon.smithi131@-1(synchronizing).paxosservice(auth 1..6) refresh upgraded, format 0 -> 3 2024-09-13T02:47:24.449 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 bash[34633]: 1191e59dc7a0fe16e6e1dbad0a9a713065d35efd57f8a5ab8c88082e891424e8 2024-09-13T02:47:24.449 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:24 smithi131 systemd[1]: Started Ceph mon.smithi131 for 12cdb164-717a-11ef-bceb-c7b262605968. 2024-09-13T02:47:25.015 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-09-13T02:47:25.015 DEBUG:teuthology.orchestra.run.smithi131:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-13T02:47:25.266 INFO:teuthology.orchestra.run.smithi131.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/mon.smithi131/config 2024-09-13T02:47:29.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:29 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mon metadata", "id": "smithi089"}]: dispatch 2024-09-13T02:47:29.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:29 smithi089 ceph-mon[27639]: mon.smithi089 calling monitor election 2024-09-13T02:47:29.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:29 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mon metadata", "id": "smithi131"}]: dispatch 2024-09-13T02:47:29.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:29 smithi089 ceph-mon[27639]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:47:29.536 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:29 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mon metadata", "id": "smithi131"}]: dispatch 2024-09-13T02:47:29.536 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:29 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mon metadata", "id": "smithi131"}]: dispatch 2024-09-13T02:47:29.536 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:29 smithi089 ceph-mon[27639]: mon.smithi131 calling monitor election 2024-09-13T02:47:29.536 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:29 smithi089 ceph-mon[27639]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:47:29.536 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:29 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mon metadata", "id": "smithi131"}]: dispatch 2024-09-13T02:47:29.536 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:29 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mon metadata", "id": "smithi131"}]: dispatch 2024-09-13T02:47:29.536 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:29 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:47:29.536 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:29 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mon metadata", "id": "smithi131"}]: dispatch 2024-09-13T02:47:29.536 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:29 smithi089 ceph-mon[27639]: mon.smithi089 is new leader, mons smithi089,smithi131 in quorum (ranks 0,1) 2024-09-13T02:47:29.536 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:29 smithi089 ceph-mon[27639]: monmap e2: 2 mons at {smithi089=[v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0],smithi131=[v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-13T02:47:29.536 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:29 smithi089 ceph-mon[27639]: fsmap 2024-09-13T02:47:29.536 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:29 smithi089 ceph-mon[27639]: osdmap e5: 0 total, 0 up, 0 in 2024-09-13T02:47:29.536 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:29 smithi089 ceph-mon[27639]: mgrmap e18: smithi089.guohvs(active, since 30s), standbys: smithi131.aunbqd 2024-09-13T02:47:29.537 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:29 smithi089 ceph-mon[27639]: overall HEALTH_OK 2024-09-13T02:47:29.537 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:29 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:29.537 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:29 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:29.537 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:29 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:29.537 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:29 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:29.537 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:29 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:29.662 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:29.659+0000 7f616cc9c640 1 -- 172.21.15.131:0/1007116502 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f61500034f0 msgr2=0x7f6150005970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:29.662 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:29.659+0000 7f616cc9c640 1 --2- 172.21.15.131:0/1007116502 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f61500034f0 0x7f6150005970 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f6168073200 tx=0x7f6158009040 comp rx=0 tx=0).stop 2024-09-13T02:47:29.662 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:29.659+0000 7f616cc9c640 1 -- 172.21.15.131:0/1007116502 shutdown_connections 2024-09-13T02:47:29.662 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:29.659+0000 7f616cc9c640 1 --2- 172.21.15.131:0/1007116502 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f61500034f0 0x7f6150005970 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:29.662 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:29.659+0000 7f616cc9c640 1 -- 172.21.15.131:0/1007116502 >> 172.21.15.131:0/1007116502 conn(0x7f61680711c0 msgr2=0x7f61680715c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:47:29.662 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:29.659+0000 7f616cc9c640 1 -- 172.21.15.131:0/1007116502 shutdown_connections 2024-09-13T02:47:29.662 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:29.659+0000 7f616cc9c640 1 -- 172.21.15.131:0/1007116502 wait complete. 2024-09-13T02:47:29.662 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:29.660+0000 7f616cc9c640 1 Processor -- start 2024-09-13T02:47:29.662 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:29.660+0000 7f616cc9c640 1 -- start start 2024-09-13T02:47:29.663 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:29.660+0000 7f616cc9c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f61500034f0 0x7f6168112a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:47:29.663 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:29.660+0000 7f616cc9c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6168112f80 0x7f616810c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:47:29.663 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:29.660+0000 7f616cc9c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6168113540 con 0x7f61500034f0 2024-09-13T02:47:29.663 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:29.660+0000 7f616cc9c640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6168113680 con 0x7f6168112f80 2024-09-13T02:47:29.663 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:29 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mon metadata", "id": "smithi089"}]: dispatch 2024-09-13T02:47:29.663 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:29 smithi131 ceph-mon[34689]: mon.smithi089 calling monitor election 2024-09-13T02:47:29.663 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:29 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mon metadata", "id": "smithi131"}]: dispatch 2024-09-13T02:47:29.663 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:29 smithi131 ceph-mon[34689]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:47:29.663 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:29 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mon metadata", "id": "smithi131"}]: dispatch 2024-09-13T02:47:29.663 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:29 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mon metadata", "id": "smithi131"}]: dispatch 2024-09-13T02:47:29.663 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:29 smithi131 ceph-mon[34689]: mon.smithi131 calling monitor election 2024-09-13T02:47:29.663 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:29 smithi131 ceph-mon[34689]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:47:29.664 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:29 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mon metadata", "id": "smithi131"}]: dispatch 2024-09-13T02:47:29.664 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:29 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mon metadata", "id": "smithi131"}]: dispatch 2024-09-13T02:47:29.664 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:29 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:47:29.664 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:29 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mon metadata", "id": "smithi131"}]: dispatch 2024-09-13T02:47:29.664 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:29 smithi131 ceph-mon[34689]: mon.smithi089 is new leader, mons smithi089,smithi131 in quorum (ranks 0,1) 2024-09-13T02:47:29.664 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:29 smithi131 ceph-mon[34689]: monmap e2: 2 mons at {smithi089=[v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0],smithi131=[v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-09-13T02:47:29.664 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:29 smithi131 ceph-mon[34689]: fsmap 2024-09-13T02:47:29.664 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:29 smithi131 ceph-mon[34689]: osdmap e5: 0 total, 0 up, 0 in 2024-09-13T02:47:29.664 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:29 smithi131 ceph-mon[34689]: mgrmap e18: smithi089.guohvs(active, since 30s), standbys: smithi131.aunbqd 2024-09-13T02:47:29.664 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:29 smithi131 ceph-mon[34689]: overall HEALTH_OK 2024-09-13T02:47:29.664 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:29 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:29.664 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:29 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:29.664 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:29 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:29.664 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:29 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:29.665 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:29 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:29.666 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:29.660+0000 7f6165d9b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6168112f80 0x7f616810c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:47:29.667 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:29.661+0000 7f6165d9b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6168112f80 0x7f616810c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:50332/0 (socket says 172.21.15.131:50332) 2024-09-13T02:47:29.667 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:29.661+0000 7f6165d9b640 1 -- 172.21.15.131:0/1390635238 learned_addr learned my addr 172.21.15.131:0/1390635238 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-09-13T02:47:29.667 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:29.661+0000 7f6165d9b640 1 -- 172.21.15.131:0/1390635238 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6168112f80 msgr2=0x7f616810c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-13T02:47:29.667 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:29.661+0000 7f6165d9b640 1 -- 172.21.15.131:0/1390635238 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6168112f80 msgr2=0x7f616810c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-13T02:47:29.667 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:29.661+0000 7f6165d9b640 1 --2- 172.21.15.131:0/1390635238 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6168112f80 0x7f616810c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-09-13T02:47:29.667 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:29.661+0000 7f616659c640 1 --2- 172.21.15.131:0/1390635238 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f61500034f0 0x7f6168112a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:47:29.667 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:29.661+0000 7f6165d9b640 1 --2- 172.21.15.131:0/1390635238 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6168112f80 0x7f616810c9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-13T02:47:29.667 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:29.661+0000 7f616659c640 1 -- 172.21.15.131:0/1390635238 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6168112f80 msgr2=0x7f616810c9e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-13T02:47:29.667 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:29.661+0000 7f616659c640 1 --2- 172.21.15.131:0/1390635238 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6168112f80 0x7f616810c9e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:29.667 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:29.661+0000 7f616659c640 1 -- 172.21.15.131:0/1390635238 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6158007950 con 0x7f61500034f0 2024-09-13T02:47:29.667 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:29.661+0000 7f616659c640 1 --2- 172.21.15.131:0/1390635238 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f61500034f0 0x7f6168112a40 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f6168073200 tx=0x7f6158009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:47:29.667 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:29.661+0000 7f6156ffd640 1 -- 172.21.15.131:0/1390635238 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6158038780 con 0x7f61500034f0 2024-09-13T02:47:29.667 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:29.662+0000 7f6156ffd640 1 -- 172.21.15.131:0/1390635238 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f615803c070 con 0x7f61500034f0 2024-09-13T02:47:29.667 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:29.662+0000 7f616cc9c640 1 -- 172.21.15.131:0/1390635238 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f616810cfe0 con 0x7f61500034f0 2024-09-13T02:47:29.668 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:29.662+0000 7f6156ffd640 1 -- 172.21.15.131:0/1390635238 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6158041670 con 0x7f61500034f0 2024-09-13T02:47:29.668 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:29.662+0000 7f616cc9c640 1 -- 172.21.15.131:0/1390635238 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f616810d500 con 0x7f61500034f0 2024-09-13T02:47:29.668 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:29.663+0000 7f616cc9c640 1 -- 172.21.15.131:0/1390635238 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61680fda60 con 0x7f61500034f0 2024-09-13T02:47:29.668 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:29.663+0000 7f6156ffd640 1 -- 172.21.15.131:0/1390635238 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 18) v1 ==== 90811+0+0 (secure 0 0 0) 0x7f615803e030 con 0x7f61500034f0 2024-09-13T02:47:29.668 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:29.664+0000 7f6156ffd640 1 --2- 172.21.15.131:0/1390635238 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f614806edc0 0x7f6148071270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:47:29.668 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:29.664+0000 7f6156ffd640 1 -- 172.21.15.131:0/1390635238 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f6158033030 con 0x7f61500034f0 2024-09-13T02:47:29.668 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:29.664+0000 7f6165d9b640 1 --2- 172.21.15.131:0/1390635238 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f614806edc0 0x7f6148071270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:47:29.668 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:29.664+0000 7f6165d9b640 1 --2- 172.21.15.131:0/1390635238 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f614806edc0 0x7f6148071270 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f615c006fd0 tx=0x7f615c008040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:47:29.669 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:29.668+0000 7f6156ffd640 1 -- 172.21.15.131:0/1390635238 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f615807cee0 con 0x7f61500034f0 2024-09-13T02:47:29.890 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:29.889+0000 7f616cc9c640 1 -- 172.21.15.131:0/1390635238 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f616804b720 con 0x7f61500034f0 2024-09-13T02:47:29.891 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:29.890+0000 7f6156ffd640 1 -- 172.21.15.131:0/1390635238 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1017 (secure 0 0 0) 0x7f615807c880 con 0x7f61500034f0 2024-09-13T02:47:29.891 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-13T02:47:29.891 INFO:teuthology.orchestra.run.smithi131.stdout:{"epoch":2,"fsid":"12cdb164-717a-11ef-bceb-c7b262605968","modified":"2024-09-13T02:47:24.164531Z","created":"2024-09-13T02:45:02.514381Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"smithi089","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:3300","nonce":0},{"type":"v1","addr":"172.21.15.89:6789","nonce":0}]},"addr":"172.21.15.89:6789/0","public_addr":"172.21.15.89:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"smithi131","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:3300","nonce":0},{"type":"v1","addr":"172.21.15.131:6789","nonce":0}]},"addr":"172.21.15.131:6789/0","public_addr":"172.21.15.131:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-13T02:47:29.892 INFO:teuthology.orchestra.run.smithi131.stderr:dumped monmap epoch 2 2024-09-13T02:47:29.893 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:29.892+0000 7f616cc9c640 1 -- 172.21.15.131:0/1390635238 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f614806edc0 msgr2=0x7f6148071270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:29.893 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:29.892+0000 7f616cc9c640 1 --2- 172.21.15.131:0/1390635238 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f614806edc0 0x7f6148071270 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f615c006fd0 tx=0x7f615c008040 comp rx=0 tx=0).stop 2024-09-13T02:47:29.893 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:29.892+0000 7f616cc9c640 1 -- 172.21.15.131:0/1390635238 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f61500034f0 msgr2=0x7f6168112a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:29.893 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:29.892+0000 7f616cc9c640 1 --2- 172.21.15.131:0/1390635238 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f61500034f0 0x7f6168112a40 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f6168073200 tx=0x7f6158009040 comp rx=0 tx=0).stop 2024-09-13T02:47:29.893 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:29.892+0000 7f616cc9c640 1 -- 172.21.15.131:0/1390635238 shutdown_connections 2024-09-13T02:47:29.893 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:29.892+0000 7f616cc9c640 1 --2- 172.21.15.131:0/1390635238 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f614806edc0 0x7f6148071270 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:29.894 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:29.892+0000 7f616cc9c640 1 --2- 172.21.15.131:0/1390635238 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6168112f80 0x7f616810c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:29.894 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:29.892+0000 7f616cc9c640 1 --2- 172.21.15.131:0/1390635238 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f61500034f0 0x7f6168112a40 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:29.894 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:29.892+0000 7f616cc9c640 1 -- 172.21.15.131:0/1390635238 >> 172.21.15.131:0/1390635238 conn(0x7f61680711c0 msgr2=0x7f61681016e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:47:29.894 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:29.892+0000 7f616cc9c640 1 -- 172.21.15.131:0/1390635238 shutdown_connections 2024-09-13T02:47:29.894 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:47:29.892+0000 7f616cc9c640 1 -- 172.21.15.131:0/1390635238 wait complete. 2024-09-13T02:47:30.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:30 smithi089 ceph-mon[27639]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:47:30.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:30 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:47:30.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:30 smithi089 ceph-mon[27639]: from='client.? 172.21.15.131:0/1390635238' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T02:47:30.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:30 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mon metadata", "id": "smithi131"}]: dispatch 2024-09-13T02:47:30.564 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:30 smithi131 ceph-mon[34689]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:47:30.565 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:30 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:47:30.565 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:30 smithi131 ceph-mon[34689]: from='client.? 172.21.15.131:0/1390635238' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-13T02:47:30.565 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:30 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mon metadata", "id": "smithi131"}]: dispatch 2024-09-13T02:47:30.863 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-13T02:47:30.863 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -- ceph config generate-minimal-conf 2024-09-13T02:47:31.117 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T02:47:32.669 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:32 smithi089 ceph-mon[27639]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:47:32.669 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:32 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:32.669 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:32 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:32.669 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:32 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:47:32.669 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:32 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:47:32.669 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:32 smithi089 ceph-mon[27639]: Updating smithi089:/etc/ceph/ceph.conf 2024-09-13T02:47:32.669 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:32 smithi089 ceph-mon[27639]: Updating smithi131:/etc/ceph/ceph.conf 2024-09-13T02:47:32.669 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:32 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:32.669 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:32 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:32.670 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:32 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:32.670 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:32 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:32.670 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:32 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:32.670 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:32 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T02:47:32.670 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:32 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T02:47:32.670 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:32 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:47:32.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:32 smithi131 ceph-mon[34689]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:47:32.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:32 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:32.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:32 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:32.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:32 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:47:32.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:32 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:47:32.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:32 smithi131 ceph-mon[34689]: Updating smithi089:/etc/ceph/ceph.conf 2024-09-13T02:47:32.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:32 smithi131 ceph-mon[34689]: Updating smithi131:/etc/ceph/ceph.conf 2024-09-13T02:47:32.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:32 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:32.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:32 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:32.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:32 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:32.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:32 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:32.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:32 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:32.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:32 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T02:47:32.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:32 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T02:47:32.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:32 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:47:33.473 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:47:33.465+0000 7f7070cd7640 1 -- 172.21.15.89:0/1500880123 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f706c1010e0 msgr2=0x7f706c1014b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:33.473 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:47:33.465+0000 7f7070cd7640 1 --2- 172.21.15.89:0/1500880123 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f706c1010e0 0x7f706c1014b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f705c004850 tx=0x7f705c009da0 comp rx=0 tx=0).stop 2024-09-13T02:47:33.474 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:47:33.465+0000 7f7070cd7640 1 -- 172.21.15.89:0/1500880123 shutdown_connections 2024-09-13T02:47:33.474 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:47:33.465+0000 7f7070cd7640 1 --2- 172.21.15.89:0/1500880123 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f706c1010e0 0x7f706c1014b0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:33.474 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:47:33.465+0000 7f7070cd7640 1 -- 172.21.15.89:0/1500880123 >> 172.21.15.89:0/1500880123 conn(0x7f706c0f6cf0 msgr2=0x7f706c0f9100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:47:33.474 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:47:33.465+0000 7f7070cd7640 1 -- 172.21.15.89:0/1500880123 shutdown_connections 2024-09-13T02:47:33.474 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:47:33.465+0000 7f7070cd7640 1 -- 172.21.15.89:0/1500880123 wait complete. 2024-09-13T02:47:33.474 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:47:33.466+0000 7f7070cd7640 1 Processor -- start 2024-09-13T02:47:33.474 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:47:33.466+0000 7f7070cd7640 1 -- start start 2024-09-13T02:47:33.474 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:47:33.466+0000 7f7070cd7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f706c1010e0 0x7f706c114b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:47:33.474 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:47:33.466+0000 7f7070cd7640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f706c1150b0 0x7f706c10eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:47:33.474 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:47:33.466+0000 7f7070cd7640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f706c115670 con 0x7f706c1010e0 2024-09-13T02:47:33.474 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:47:33.466+0000 7f7070cd7640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f706c1157b0 con 0x7f706c1150b0 2024-09-13T02:47:33.474 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:47:33.466+0000 7f706a59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f706c1010e0 0x7f706c114b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:47:33.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:47:33.466+0000 7f706a59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f706c1010e0 0x7f706c114b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:50804/0 (socket says 172.21.15.89:50804) 2024-09-13T02:47:33.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:47:33.466+0000 7f706a59c640 1 -- 172.21.15.89:0/1393115885 learned_addr learned my addr 172.21.15.89:0/1393115885 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:47:33.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:47:33.466+0000 7f706a59c640 1 -- 172.21.15.89:0/1393115885 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f706c1150b0 msgr2=0x7f706c10eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:33.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:47:33.466+0000 7f706a59c640 1 --2- 172.21.15.89:0/1393115885 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f706c1150b0 0x7f706c10eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:33.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:47:33.466+0000 7f706a59c640 1 -- 172.21.15.89:0/1393115885 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f705c005040 con 0x7f706c1010e0 2024-09-13T02:47:33.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:47:33.467+0000 7f706a59c640 1 --2- 172.21.15.89:0/1393115885 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f706c1010e0 0x7f706c114b70 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f705c003080 tx=0x7f705c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:47:33.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:47:33.467+0000 7f705affd640 1 -- 172.21.15.89:0/1393115885 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f705c038070 con 0x7f706c1010e0 2024-09-13T02:47:33.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:47:33.467+0000 7f705affd640 1 -- 172.21.15.89:0/1393115885 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f705c032b50 con 0x7f706c1010e0 2024-09-13T02:47:33.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:47:33.467+0000 7f7070cd7640 1 -- 172.21.15.89:0/1393115885 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f706c10f110 con 0x7f706c1010e0 2024-09-13T02:47:33.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:47:33.467+0000 7f705affd640 1 -- 172.21.15.89:0/1393115885 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f705c03ec00 con 0x7f706c1010e0 2024-09-13T02:47:33.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:47:33.467+0000 7f7070cd7640 1 -- 172.21.15.89:0/1393115885 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f706c10f630 con 0x7f706c1010e0 2024-09-13T02:47:33.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:47:33.468+0000 7f7070cd7640 1 -- 172.21.15.89:0/1393115885 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f706c0fc850 con 0x7f706c1010e0 2024-09-13T02:47:33.476 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:47:33.468+0000 7f705affd640 1 -- 172.21.15.89:0/1393115885 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 18) v1 ==== 90811+0+0 (secure 0 0 0) 0x7f705c030020 con 0x7f706c1010e0 2024-09-13T02:47:33.476 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:47:33.469+0000 7f705affd640 1 --2- 172.21.15.89:0/1393115885 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f705406edd0 0x7f7054071280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:47:33.476 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:47:33.469+0000 7f705affd640 1 -- 172.21.15.89:0/1393115885 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f705c0ad5c0 con 0x7f706c1010e0 2024-09-13T02:47:33.476 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:47:33.469+0000 7f7069d9b640 1 --2- 172.21.15.89:0/1393115885 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f705406edd0 0x7f7054071280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:47:33.476 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:47:33.469+0000 7f7069d9b640 1 --2- 172.21.15.89:0/1393115885 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f705406edd0 0x7f7054071280 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f7060006fd0 tx=0x7f7060006d50 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:47:33.476 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:47:33.474+0000 7f705affd640 1 -- 172.21.15.89:0/1393115885 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f705c07b7c0 con 0x7f706c1010e0 2024-09-13T02:47:33.637 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:47:33.636+0000 7f7070cd7640 1 -- 172.21.15.89:0/1393115885 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f706c04b720 con 0x7f706c1010e0 2024-09-13T02:47:33.638 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:47:33.636+0000 7f705affd640 1 -- 172.21.15.89:0/1393115885 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v10) v1 ==== 76+0+225 (secure 0 0 0) 0x7f705c0acd70 con 0x7f706c1010e0 2024-09-13T02:47:33.638 INFO:teuthology.orchestra.run.smithi089.stdout:# minimal ceph.conf for 12cdb164-717a-11ef-bceb-c7b262605968 2024-09-13T02:47:33.638 INFO:teuthology.orchestra.run.smithi089.stdout:[global] 2024-09-13T02:47:33.638 INFO:teuthology.orchestra.run.smithi089.stdout: fsid = 12cdb164-717a-11ef-bceb-c7b262605968 2024-09-13T02:47:33.638 INFO:teuthology.orchestra.run.smithi089.stdout: mon_host = [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] 2024-09-13T02:47:33.640 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:47:33.638+0000 7f7070cd7640 1 -- 172.21.15.89:0/1393115885 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f705406edd0 msgr2=0x7f7054071280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:33.640 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:47:33.638+0000 7f7070cd7640 1 --2- 172.21.15.89:0/1393115885 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f705406edd0 0x7f7054071280 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f7060006fd0 tx=0x7f7060006d50 comp rx=0 tx=0).stop 2024-09-13T02:47:33.640 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:47:33.638+0000 7f7070cd7640 1 -- 172.21.15.89:0/1393115885 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f706c1010e0 msgr2=0x7f706c114b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:33.640 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:47:33.638+0000 7f7070cd7640 1 --2- 172.21.15.89:0/1393115885 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f706c1010e0 0x7f706c114b70 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f705c003080 tx=0x7f705c009da0 comp rx=0 tx=0).stop 2024-09-13T02:47:33.640 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:47:33.638+0000 7f7070cd7640 1 -- 172.21.15.89:0/1393115885 shutdown_connections 2024-09-13T02:47:33.640 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:47:33.638+0000 7f7070cd7640 1 --2- 172.21.15.89:0/1393115885 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f705406edd0 0x7f7054071280 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:33.640 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:47:33.638+0000 7f7070cd7640 1 --2- 172.21.15.89:0/1393115885 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f706c1150b0 0x7f706c10eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:33.641 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:47:33.638+0000 7f7070cd7640 1 --2- 172.21.15.89:0/1393115885 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f706c1010e0 0x7f706c114b70 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:33.641 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:47:33.638+0000 7f7070cd7640 1 -- 172.21.15.89:0/1393115885 >> 172.21.15.89:0/1393115885 conn(0x7f706c0f6cf0 msgr2=0x7f706c0658a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:47:33.641 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:47:33.639+0000 7f7070cd7640 1 -- 172.21.15.89:0/1393115885 shutdown_connections 2024-09-13T02:47:33.641 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:47:33.639+0000 7f7070cd7640 1 -- 172.21.15.89:0/1393115885 wait complete. 2024-09-13T02:47:33.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:33 smithi089 ceph-mon[27639]: Updating smithi089:/var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T02:47:33.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:33 smithi089 ceph-mon[27639]: Updating smithi131:/var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T02:47:33.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:33 smithi089 ceph-mon[27639]: Reconfiguring mon.smithi089 (unknown last config time)... 2024-09-13T02:47:33.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:33 smithi089 ceph-mon[27639]: Reconfiguring daemon mon.smithi089 on smithi089 2024-09-13T02:47:33.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:33 smithi131 ceph-mon[34689]: Updating smithi089:/var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T02:47:33.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:33 smithi131 ceph-mon[34689]: Updating smithi131:/var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T02:47:33.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:33 smithi131 ceph-mon[34689]: Reconfiguring mon.smithi089 (unknown last config time)... 2024-09-13T02:47:33.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:33 smithi131 ceph-mon[34689]: Reconfiguring daemon mon.smithi089 on smithi089 2024-09-13T02:47:34.562 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-13T02:47:34.562 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-13T02:47:34.563 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/etc/ceph/ceph.conf 2024-09-13T02:47:34.590 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-13T02:47:34.590 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-13T02:47:34.655 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-13T02:47:34.655 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/etc/ceph/ceph.conf 2024-09-13T02:47:34.688 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-13T02:47:34.688 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-13T02:47:34.756 INFO:tasks.cephadm:Deploying OSDs... 2024-09-13T02:47:34.756 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-13T02:47:34.757 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/scratch_devs of=/dev/stdout 2024-09-13T02:47:34.773 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-13T02:47:34.773 DEBUG:teuthology.orchestra.run.smithi089:> stat /dev/vg_nvme/lv_1 2024-09-13T02:47:34.830 INFO:teuthology.orchestra.run.smithi089.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-13T02:47:34.830 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T02:47:34.830 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-13T02:47:34.830 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T02:47:34.831 INFO:teuthology.orchestra.run.smithi089.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T02:47:34.831 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 2024-09-13 02:46:52.941004314 +0000 2024-09-13T02:47:34.831 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2024-09-13 02:41:53.021278236 +0000 2024-09-13T02:47:34.831 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2024-09-13 02:41:53.021278236 +0000 2024-09-13T02:47:34.831 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: 2024-09-13 02:41:53.021278236 +0000 2024-09-13T02:47:34.831 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-13T02:47:34.871 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:34 smithi089 ceph-mon[27639]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:47:34.871 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:34 smithi089 ceph-mon[27639]: from='client.? 172.21.15.89:0/1393115885' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:47:34.871 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:34 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:34.871 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:34 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:34.872 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:34 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi089.guohvs", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T02:47:34.872 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:34 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T02:47:34.872 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:34 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:47:34.872 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:34 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:34.899 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records in 2024-09-13T02:47:34.899 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records out 2024-09-13T02:47:34.900 INFO:teuthology.orchestra.run.smithi089.stderr:512 bytes copied, 0.000215539 s, 2.4 MB/s 2024-09-13T02:47:34.901 DEBUG:teuthology.orchestra.run.smithi089:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-13T02:47:34.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:34 smithi131 ceph-mon[34689]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:47:34.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:34 smithi131 ceph-mon[34689]: from='client.? 172.21.15.89:0/1393115885' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:47:34.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:34 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:34.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:34 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:34.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:34 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi089.guohvs", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T02:47:34.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:34 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T02:47:34.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:34 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:47:34.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:34 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:34.960 DEBUG:teuthology.orchestra.run.smithi089:> stat /dev/vg_nvme/lv_2 2024-09-13T02:47:35.016 INFO:teuthology.orchestra.run.smithi089.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-13T02:47:35.016 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T02:47:35.016 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-09-13T02:47:35.016 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T02:47:35.016 INFO:teuthology.orchestra.run.smithi089.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T02:47:35.016 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 2024-09-13 02:46:52.941004314 +0000 2024-09-13T02:47:35.016 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2024-09-13 02:41:53.343271023 +0000 2024-09-13T02:47:35.016 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2024-09-13 02:41:53.343271023 +0000 2024-09-13T02:47:35.016 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: 2024-09-13 02:41:53.343271023 +0000 2024-09-13T02:47:35.017 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-13T02:47:35.080 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records in 2024-09-13T02:47:35.080 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records out 2024-09-13T02:47:35.080 INFO:teuthology.orchestra.run.smithi089.stderr:512 bytes copied, 0.000192524 s, 2.7 MB/s 2024-09-13T02:47:35.081 DEBUG:teuthology.orchestra.run.smithi089:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-13T02:47:35.137 DEBUG:teuthology.orchestra.run.smithi089:> stat /dev/vg_nvme/lv_3 2024-09-13T02:47:35.192 INFO:teuthology.orchestra.run.smithi089.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-13T02:47:35.192 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T02:47:35.192 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-13T02:47:35.192 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T02:47:35.193 INFO:teuthology.orchestra.run.smithi089.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T02:47:35.193 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 2024-09-13 02:46:52.942004292 +0000 2024-09-13T02:47:35.193 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2024-09-13 02:41:53.670263699 +0000 2024-09-13T02:47:35.193 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2024-09-13 02:41:53.670263699 +0000 2024-09-13T02:47:35.193 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: 2024-09-13 02:41:53.670263699 +0000 2024-09-13T02:47:35.193 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-13T02:47:35.260 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records in 2024-09-13T02:47:35.260 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records out 2024-09-13T02:47:35.260 INFO:teuthology.orchestra.run.smithi089.stderr:512 bytes copied, 0.000184796 s, 2.8 MB/s 2024-09-13T02:47:35.261 DEBUG:teuthology.orchestra.run.smithi089:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-13T02:47:35.318 DEBUG:teuthology.orchestra.run.smithi089:> stat /dev/vg_nvme/lv_4 2024-09-13T02:47:35.374 INFO:teuthology.orchestra.run.smithi089.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-13T02:47:35.374 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T02:47:35.374 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-13T02:47:35.374 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T02:47:35.374 INFO:teuthology.orchestra.run.smithi089.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T02:47:35.374 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 2024-09-13 02:46:52.942004292 +0000 2024-09-13T02:47:35.374 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2024-09-13 02:41:54.002256263 +0000 2024-09-13T02:47:35.374 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2024-09-13 02:41:54.002256263 +0000 2024-09-13T02:47:35.374 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: 2024-09-13 02:41:54.002256263 +0000 2024-09-13T02:47:35.375 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-13T02:47:35.437 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records in 2024-09-13T02:47:35.438 INFO:teuthology.orchestra.run.smithi089.stderr:1+0 records out 2024-09-13T02:47:35.438 INFO:teuthology.orchestra.run.smithi089.stderr:512 bytes copied, 0.000190609 s, 2.7 MB/s 2024-09-13T02:47:35.439 DEBUG:teuthology.orchestra.run.smithi089:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-13T02:47:35.496 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-13T02:47:35.496 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/scratch_devs of=/dev/stdout 2024-09-13T02:47:35.515 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-13T02:47:35.516 DEBUG:teuthology.orchestra.run.smithi131:> stat /dev/vg_nvme/lv_1 2024-09-13T02:47:35.575 INFO:teuthology.orchestra.run.smithi131.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-13T02:47:35.575 INFO:teuthology.orchestra.run.smithi131.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T02:47:35.575 INFO:teuthology.orchestra.run.smithi131.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-13T02:47:35.576 INFO:teuthology.orchestra.run.smithi131.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T02:47:35.576 INFO:teuthology.orchestra.run.smithi131.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T02:47:35.576 INFO:teuthology.orchestra.run.smithi131.stdout:Access: 2024-09-13 02:47:21.788744648 +0000 2024-09-13T02:47:35.576 INFO:teuthology.orchestra.run.smithi131.stdout:Modify: 2024-09-13 02:41:53.029533743 +0000 2024-09-13T02:47:35.576 INFO:teuthology.orchestra.run.smithi131.stdout:Change: 2024-09-13 02:41:53.029533743 +0000 2024-09-13T02:47:35.576 INFO:teuthology.orchestra.run.smithi131.stdout: Birth: 2024-09-13 02:41:53.029533743 +0000 2024-09-13T02:47:35.576 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-13T02:47:35.642 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records in 2024-09-13T02:47:35.643 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records out 2024-09-13T02:47:35.643 INFO:teuthology.orchestra.run.smithi131.stderr:512 bytes copied, 0.000236774 s, 2.2 MB/s 2024-09-13T02:47:35.644 DEBUG:teuthology.orchestra.run.smithi131:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-13T02:47:35.703 DEBUG:teuthology.orchestra.run.smithi131:> stat /dev/vg_nvme/lv_2 2024-09-13T02:47:35.760 INFO:teuthology.orchestra.run.smithi131.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-13T02:47:35.761 INFO:teuthology.orchestra.run.smithi131.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T02:47:35.761 INFO:teuthology.orchestra.run.smithi131.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-13T02:47:35.761 INFO:teuthology.orchestra.run.smithi131.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T02:47:35.761 INFO:teuthology.orchestra.run.smithi131.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T02:47:35.761 INFO:teuthology.orchestra.run.smithi131.stdout:Access: 2024-09-13 02:47:21.789744625 +0000 2024-09-13T02:47:35.761 INFO:teuthology.orchestra.run.smithi131.stdout:Modify: 2024-09-13 02:41:53.360526364 +0000 2024-09-13T02:47:35.761 INFO:teuthology.orchestra.run.smithi131.stdout:Change: 2024-09-13 02:41:53.360526364 +0000 2024-09-13T02:47:35.762 INFO:teuthology.orchestra.run.smithi131.stdout: Birth: 2024-09-13 02:41:53.360526364 +0000 2024-09-13T02:47:35.762 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-13T02:47:35.825 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:35 smithi131 ceph-mon[34689]: Reconfiguring mgr.smithi089.guohvs (unknown last config time)... 2024-09-13T02:47:35.825 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:35 smithi131 ceph-mon[34689]: Reconfiguring daemon mgr.smithi089.guohvs on smithi089 2024-09-13T02:47:35.827 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records in 2024-09-13T02:47:35.828 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records out 2024-09-13T02:47:35.828 INFO:teuthology.orchestra.run.smithi131.stderr:512 bytes copied, 0.000214854 s, 2.4 MB/s 2024-09-13T02:47:35.829 DEBUG:teuthology.orchestra.run.smithi131:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-13T02:47:35.887 DEBUG:teuthology.orchestra.run.smithi131:> stat /dev/vg_nvme/lv_3 2024-09-13T02:47:35.945 INFO:teuthology.orchestra.run.smithi131.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-13T02:47:35.945 INFO:teuthology.orchestra.run.smithi131.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T02:47:35.945 INFO:teuthology.orchestra.run.smithi131.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-09-13T02:47:35.946 INFO:teuthology.orchestra.run.smithi131.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T02:47:35.946 INFO:teuthology.orchestra.run.smithi131.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T02:47:35.946 INFO:teuthology.orchestra.run.smithi131.stdout:Access: 2024-09-13 02:47:21.789744625 +0000 2024-09-13T02:47:35.946 INFO:teuthology.orchestra.run.smithi131.stdout:Modify: 2024-09-13 02:41:53.689519028 +0000 2024-09-13T02:47:35.946 INFO:teuthology.orchestra.run.smithi131.stdout:Change: 2024-09-13 02:41:53.689519028 +0000 2024-09-13T02:47:35.946 INFO:teuthology.orchestra.run.smithi131.stdout: Birth: 2024-09-13 02:41:53.689519028 +0000 2024-09-13T02:47:35.946 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-13T02:47:36.010 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records in 2024-09-13T02:47:36.011 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records out 2024-09-13T02:47:36.011 INFO:teuthology.orchestra.run.smithi131.stderr:512 bytes copied, 0.000207248 s, 2.5 MB/s 2024-09-13T02:47:36.012 DEBUG:teuthology.orchestra.run.smithi131:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-13T02:47:36.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:35 smithi089 ceph-mon[27639]: Reconfiguring mgr.smithi089.guohvs (unknown last config time)... 2024-09-13T02:47:36.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:35 smithi089 ceph-mon[27639]: Reconfiguring daemon mgr.smithi089.guohvs on smithi089 2024-09-13T02:47:36.069 DEBUG:teuthology.orchestra.run.smithi131:> stat /dev/vg_nvme/lv_4 2024-09-13T02:47:36.126 INFO:teuthology.orchestra.run.smithi131.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-13T02:47:36.126 INFO:teuthology.orchestra.run.smithi131.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-13T02:47:36.126 INFO:teuthology.orchestra.run.smithi131.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-13T02:47:36.127 INFO:teuthology.orchestra.run.smithi131.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T02:47:36.127 INFO:teuthology.orchestra.run.smithi131.stdout:Context: system_u:object_r:device_t:s0 2024-09-13T02:47:36.127 INFO:teuthology.orchestra.run.smithi131.stdout:Access: 2024-09-13 02:47:21.789744625 +0000 2024-09-13T02:47:36.127 INFO:teuthology.orchestra.run.smithi131.stdout:Modify: 2024-09-13 02:41:54.015511760 +0000 2024-09-13T02:47:36.127 INFO:teuthology.orchestra.run.smithi131.stdout:Change: 2024-09-13 02:41:54.015511760 +0000 2024-09-13T02:47:36.127 INFO:teuthology.orchestra.run.smithi131.stdout: Birth: 2024-09-13 02:41:54.015511760 +0000 2024-09-13T02:47:36.127 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-13T02:47:36.190 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records in 2024-09-13T02:47:36.190 INFO:teuthology.orchestra.run.smithi131.stderr:1+0 records out 2024-09-13T02:47:36.191 INFO:teuthology.orchestra.run.smithi131.stderr:512 bytes copied, 0.000228313 s, 2.2 MB/s 2024-09-13T02:47:36.192 DEBUG:teuthology.orchestra.run.smithi131:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-13T02:47:36.248 INFO:tasks.cephadm:Deploying osd.0 on smithi089 with /dev/vg_nvme/lv_4... 2024-09-13T02:47:36.249 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-13T02:47:36.754 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T02:47:36.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:36 smithi089 ceph-mon[27639]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:47:36.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:36 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:36.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:36 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:36.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:36 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi089", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T02:47:36.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:36 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:47:36.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:36 smithi131 ceph-mon[34689]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:47:36.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:36 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:36.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:36 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:36.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:36 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi089", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T02:47:36.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:36 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:47:37.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:37 smithi089 ceph-mon[27639]: Reconfiguring crash.smithi089 (monmap changed)... 2024-09-13T02:47:37.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:37 smithi089 ceph-mon[27639]: Reconfiguring daemon crash.smithi089 on smithi089 2024-09-13T02:47:37.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:37 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:37.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:37 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:37.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:37 smithi131 ceph-mon[34689]: Reconfiguring crash.smithi089 (monmap changed)... 2024-09-13T02:47:37.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:37 smithi131 ceph-mon[34689]: Reconfiguring daemon crash.smithi089 on smithi089 2024-09-13T02:47:37.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:37 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:37.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:37 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:38.933 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:38 smithi131 ceph-mon[34689]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:47:38.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:38 smithi131 ceph-mon[34689]: Reconfiguring alertmanager.smithi089 (dependencies changed)... 2024-09-13T02:47:38.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:38 smithi131 ceph-mon[34689]: Reconfiguring daemon alertmanager.smithi089 on smithi089 2024-09-13T02:47:39.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:38 smithi089 ceph-mon[27639]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:47:39.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:38 smithi089 ceph-mon[27639]: Reconfiguring alertmanager.smithi089 (dependencies changed)... 2024-09-13T02:47:39.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:38 smithi089 ceph-mon[27639]: Reconfiguring daemon alertmanager.smithi089 on smithi089 2024-09-13T02:47:40.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:40 smithi089 ceph-mon[27639]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:47:40.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:40 smithi131 ceph-mon[34689]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:47:42.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:42 smithi089 ceph-mon[27639]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:47:42.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:42 smithi131 ceph-mon[34689]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:47:44.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:43 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:44.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:43 smithi089 ceph-mon[27639]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:47:44.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:43 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:44.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:43 smithi089 ceph-mon[27639]: Reconfiguring grafana.smithi089 (dependencies changed)... 2024-09-13T02:47:44.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:43 smithi089 ceph-mon[27639]: Reconfiguring daemon grafana.smithi089 on smithi089 2024-09-13T02:47:44.345 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:47:44.363 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi089:vg_nvme/lv_4 2024-09-13T02:47:44.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:43 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:44.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:43 smithi131 ceph-mon[34689]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:47:44.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:43 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:44.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:43 smithi131 ceph-mon[34689]: Reconfiguring grafana.smithi089 (dependencies changed)... 2024-09-13T02:47:44.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:43 smithi131 ceph-mon[34689]: Reconfiguring daemon grafana.smithi089 on smithi089 2024-09-13T02:47:45.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:44 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:47:45.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:44 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:47:46.169 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T02:47:46.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:45 smithi089 ceph-mon[27639]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:47:46.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:45 smithi131 ceph-mon[34689]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:47:48.084 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:47:48.081+0000 7f5a1f4d1640 1 -- 172.21.15.89:0/201799524 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a180fd810 msgr2=0x7f5a180fdc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:48.084 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:47:48.081+0000 7f5a1f4d1640 1 --2- 172.21.15.89:0/201799524 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a180fd810 0x7f5a180fdc80 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f5a140048d0 tx=0x7f5a14009da0 comp rx=0 tx=0).stop 2024-09-13T02:47:48.084 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:47:48.081+0000 7f5a1f4d1640 1 -- 172.21.15.89:0/201799524 shutdown_connections 2024-09-13T02:47:48.084 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:47:48.081+0000 7f5a1f4d1640 1 --2- 172.21.15.89:0/201799524 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a180fd810 0x7f5a180fdc80 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:48.084 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:47:48.081+0000 7f5a1f4d1640 1 --2- 172.21.15.89:0/201799524 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5a180fc540 0x7f5a180fc950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:48.084 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:47:48.081+0000 7f5a1f4d1640 1 -- 172.21.15.89:0/201799524 >> 172.21.15.89:0/201799524 conn(0x7f5a180f7ce0 msgr2=0x7f5a180fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:47:48.084 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:47:48.081+0000 7f5a1f4d1640 1 -- 172.21.15.89:0/201799524 shutdown_connections 2024-09-13T02:47:48.084 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:47:48.081+0000 7f5a1f4d1640 1 -- 172.21.15.89:0/201799524 wait complete. 2024-09-13T02:47:48.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:47:48.081+0000 7f5a1f4d1640 1 Processor -- start 2024-09-13T02:47:48.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:47:48.081+0000 7f5a1f4d1640 1 -- start start 2024-09-13T02:47:48.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:47:48.082+0000 7f5a1f4d1640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5a180fc540 0x7f5a1810d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:47:48.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:47:48.082+0000 7f5a1f4d1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a180fd810 0x7f5a1810d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:47:48.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:47:48.082+0000 7f5a1f4d1640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a1810e4a0 con 0x7f5a180fd810 2024-09-13T02:47:48.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:47:48.082+0000 7f5a1f4d1640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a1810e610 con 0x7f5a180fc540 2024-09-13T02:47:48.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:47:48.082+0000 7f5a1ca6c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a180fd810 0x7f5a1810d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:47:48.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:47:48.082+0000 7f5a1ca6c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a180fd810 0x7f5a1810d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:42824/0 (socket says 172.21.15.89:42824) 2024-09-13T02:47:48.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:47:48.082+0000 7f5a1ca6c640 1 -- 172.21.15.89:0/3685011766 learned_addr learned my addr 172.21.15.89:0/3685011766 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:47:48.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:47:48.082+0000 7f5a1d26d640 1 --2- 172.21.15.89:0/3685011766 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5a180fc540 0x7f5a1810d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:47:48.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:47:48.082+0000 7f5a1ca6c640 1 -- 172.21.15.89:0/3685011766 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5a180fc540 msgr2=0x7f5a1810d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:47:48.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:47:48.082+0000 7f5a1ca6c640 1 --2- 172.21.15.89:0/3685011766 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5a180fc540 0x7f5a1810d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:47:48.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:47:48.082+0000 7f5a1ca6c640 1 -- 172.21.15.89:0/3685011766 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a14005040 con 0x7f5a180fd810 2024-09-13T02:47:48.086 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:47:48.082+0000 7f5a1d26d640 1 --2- 172.21.15.89:0/3685011766 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5a180fc540 0x7f5a1810d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T02:47:48.086 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:47:48.082+0000 7f5a1ca6c640 1 --2- 172.21.15.89:0/3685011766 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a180fd810 0x7f5a1810d630 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5a14003080 tx=0x7f5a14009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:47:48.086 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:47:48.082+0000 7f5a0dffb640 1 -- 172.21.15.89:0/3685011766 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5a14038070 con 0x7f5a180fd810 2024-09-13T02:47:48.086 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:47:48.082+0000 7f5a0dffb640 1 -- 172.21.15.89:0/3685011766 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f5a1402abd0 con 0x7f5a180fd810 2024-09-13T02:47:48.086 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:47:48.082+0000 7f5a1f4d1640 1 -- 172.21.15.89:0/3685011766 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a1810e890 con 0x7f5a180fd810 2024-09-13T02:47:48.086 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:47:48.082+0000 7f5a0dffb640 1 -- 172.21.15.89:0/3685011766 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5a1403e670 con 0x7f5a180fd810 2024-09-13T02:47:48.086 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:47:48.083+0000 7f5a1f4d1640 1 -- 172.21.15.89:0/3685011766 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a1810edb0 con 0x7f5a180fd810 2024-09-13T02:47:48.087 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:47:48.084+0000 7f5a1f4d1640 1 -- 172.21.15.89:0/3685011766 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a180fb9a0 con 0x7f5a180fd810 2024-09-13T02:47:48.087 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:47:48.084+0000 7f5a0dffb640 1 -- 172.21.15.89:0/3685011766 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 18) v1 ==== 90811+0+0 (secure 0 0 0) 0x7f5a14030020 con 0x7f5a180fd810 2024-09-13T02:47:48.087 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:47:48.085+0000 7f5a0dffb640 1 --2- 172.21.15.89:0/3685011766 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f5a0406ecc0 0x7f5a04071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:47:48.087 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:47:48.085+0000 7f5a0dffb640 1 -- 172.21.15.89:0/3685011766 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1366+0+0 (secure 0 0 0) 0x7f5a140ad3a0 con 0x7f5a180fd810 2024-09-13T02:47:48.087 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:47:48.085+0000 7f5a1d26d640 1 --2- 172.21.15.89:0/3685011766 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f5a0406ecc0 0x7f5a04071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:47:48.087 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:47:48.085+0000 7f5a1d26d640 1 --2- 172.21.15.89:0/3685011766 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f5a0406ecc0 0x7f5a04071170 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f5a08009a80 tx=0x7f5a08008040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:47:48.090 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:47:48.089+0000 7f5a0dffb640 1 -- 172.21.15.89:0/3685011766 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f5a1407b620 con 0x7f5a180fd810 2024-09-13T02:47:48.242 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:47 smithi089 ceph-mon[27639]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:47:48.268 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:47:48.266+0000 7f5a1f4d1640 1 -- 172.21.15.89:0/3685011766 --> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi089:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f5a1810f020 con 0x7f5a0406ecc0 2024-09-13T02:47:48.433 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:47 smithi131 ceph-mon[34689]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:47:49.218 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:48 smithi089 ceph-mon[27639]: from='client.14238 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi089:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:47:49.218 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:48 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T02:47:49.218 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:48 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T02:47:49.218 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:48 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:47:49.433 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:48 smithi131 ceph-mon[34689]: from='client.14238 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi089:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:47:49.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:48 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T02:47:49.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:48 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T02:47:49.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:48 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:47:50.046 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:49 smithi089 ceph-mon[27639]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:47:50.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:49 smithi131 ceph-mon[34689]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:47:51.665 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:51 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:51.665 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:51 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:51.665 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:51 smithi089 ceph-mon[27639]: Reconfiguring prometheus.smithi089 (dependencies changed)... 2024-09-13T02:47:51.665 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:51 smithi089 ceph-mon[27639]: Reconfiguring daemon prometheus.smithi089 on smithi089 2024-09-13T02:47:51.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:51 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:51.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:51 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:47:51.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:51 smithi131 ceph-mon[34689]: Reconfiguring prometheus.smithi089 (dependencies changed)... 2024-09-13T02:47:51.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:51 smithi131 ceph-mon[34689]: Reconfiguring daemon prometheus.smithi089 on smithi089 2024-09-13T02:47:52.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:52 smithi131 ceph-mon[34689]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:47:52.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:52 smithi131 ceph-mon[34689]: from='client.? 172.21.15.89:0/3277301256' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "35210318-1c6c-4541-a94a-f9842c6bceba"}]: dispatch 2024-09-13T02:47:52.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:52 smithi131 ceph-mon[34689]: from='client.? 172.21.15.89:0/3277301256' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "35210318-1c6c-4541-a94a-f9842c6bceba"}]': finished 2024-09-13T02:47:52.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:52 smithi131 ceph-mon[34689]: osdmap e6: 1 total, 0 up, 1 in 2024-09-13T02:47:52.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:52 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T02:47:52.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:52 smithi131 ceph-mon[34689]: from='client.? 172.21.15.89:0/1787698705' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T02:47:52.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:52 smithi089 ceph-mon[27639]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:47:52.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:52 smithi089 ceph-mon[27639]: from='client.? 172.21.15.89:0/3277301256' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "35210318-1c6c-4541-a94a-f9842c6bceba"}]: dispatch 2024-09-13T02:47:52.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:52 smithi089 ceph-mon[27639]: from='client.? 172.21.15.89:0/3277301256' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "35210318-1c6c-4541-a94a-f9842c6bceba"}]': finished 2024-09-13T02:47:52.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:52 smithi089 ceph-mon[27639]: osdmap e6: 1 total, 0 up, 1 in 2024-09-13T02:47:52.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:52 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T02:47:52.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:52 smithi089 ceph-mon[27639]: from='client.? 172.21.15.89:0/1787698705' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T02:47:54.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:54 smithi131 ceph-mon[34689]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:47:54.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:54 smithi089 ceph-mon[27639]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:47:56.530 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:56 smithi089 ceph-mon[27639]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:47:56.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:56 smithi131 ceph-mon[34689]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:47:58.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:58 smithi089 ceph-mon[27639]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:47:58.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:58 smithi131 ceph-mon[34689]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:47:59.685 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:47:59 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:47:59.788 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:47:59 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:48:00.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:00 smithi089 ceph-mon[27639]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:48:00.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:00 smithi131 ceph-mon[34689]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:48:02.394 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:02 smithi089 ceph-mon[27639]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:48:02.394 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:02 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:48:02.395 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:02 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:48:02.395 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:02 smithi089 ceph-mon[27639]: Reconfiguring crash.smithi131 (monmap changed)... 2024-09-13T02:48:02.395 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:02 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi131", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T02:48:02.395 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:02 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:48:02.395 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:02 smithi089 ceph-mon[27639]: Reconfiguring daemon crash.smithi131 on smithi131 2024-09-13T02:48:02.524 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:02 smithi131 ceph-mon[34689]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:48:02.524 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:02 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:48:02.524 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:02 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:48:02.524 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:02 smithi131 ceph-mon[34689]: Reconfiguring crash.smithi131 (monmap changed)... 2024-09-13T02:48:02.524 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:02 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi131", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T02:48:02.525 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:02 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:48:02.525 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:02 smithi131 ceph-mon[34689]: Reconfiguring daemon crash.smithi131 on smithi131 2024-09-13T02:48:03.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:03 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-13T02:48:03.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:03 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:48:03.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:03 smithi089 ceph-mon[27639]: Deploying daemon osd.0 on smithi089 2024-09-13T02:48:03.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:03 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:48:03.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:03 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:48:03.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:03 smithi089 ceph-mon[27639]: Reconfiguring mgr.smithi131.aunbqd (monmap changed)... 2024-09-13T02:48:03.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:03 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi131.aunbqd", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T02:48:03.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:03 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T02:48:03.536 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:03 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:48:03.536 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:03 smithi089 ceph-mon[27639]: Reconfiguring daemon mgr.smithi131.aunbqd on smithi131 2024-09-13T02:48:03.629 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:03 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-13T02:48:03.629 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:03 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:48:03.629 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:03 smithi131 ceph-mon[34689]: Deploying daemon osd.0 on smithi089 2024-09-13T02:48:03.630 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:03 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:48:03.630 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:03 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:48:03.630 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:03 smithi131 ceph-mon[34689]: Reconfiguring mgr.smithi131.aunbqd (monmap changed)... 2024-09-13T02:48:03.630 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:03 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi131.aunbqd", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T02:48:03.630 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:03 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T02:48:03.630 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:03 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:48:03.630 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:03 smithi131 ceph-mon[34689]: Reconfiguring daemon mgr.smithi131.aunbqd on smithi131 2024-09-13T02:48:04.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:04 smithi131 ceph-mon[34689]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:48:04.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:04 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:48:04.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:04 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:48:04.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:04 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T02:48:04.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:04 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T02:48:04.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:04 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:48:05.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:04 smithi089 ceph-mon[27639]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:48:05.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:04 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:48:05.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:04 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:48:05.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:04 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T02:48:05.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:04 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T02:48:05.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:04 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:48:05.862 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:05 smithi089 ceph-mon[27639]: Reconfiguring mon.smithi131 (monmap changed)... 2024-09-13T02:48:05.862 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:05 smithi089 ceph-mon[27639]: Reconfiguring daemon mon.smithi131 on smithi131 2024-09-13T02:48:05.862 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:05 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:48:05.862 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:05 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:48:05.862 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:05 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-13T02:48:05.862 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:05 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi089.front.sepia.ceph.com:9093"}]: dispatch 2024-09-13T02:48:05.862 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:05 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:48:05.862 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:05 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-13T02:48:05.863 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:05 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi089.front.sepia.ceph.com:3000"}]: dispatch 2024-09-13T02:48:05.863 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:05 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:48:05.863 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:05 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T02:48:05.863 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:05 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi089.front.sepia.ceph.com:9095"}]: dispatch 2024-09-13T02:48:05.863 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:05 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:48:05.863 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:05 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:48:05.881 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:05 smithi131 ceph-mon[34689]: Reconfiguring mon.smithi131 (monmap changed)... 2024-09-13T02:48:05.881 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:05 smithi131 ceph-mon[34689]: Reconfiguring daemon mon.smithi131 on smithi131 2024-09-13T02:48:05.881 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:05 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:48:05.881 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:05 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:48:05.881 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:05 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-13T02:48:05.881 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:05 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi089.front.sepia.ceph.com:9093"}]: dispatch 2024-09-13T02:48:05.881 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:05 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:48:05.881 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:05 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-13T02:48:05.881 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:05 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi089.front.sepia.ceph.com:3000"}]: dispatch 2024-09-13T02:48:05.882 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:05 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:48:05.882 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:05 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T02:48:05.882 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:05 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi089.front.sepia.ceph.com:9095"}]: dispatch 2024-09-13T02:48:05.882 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:05 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:48:05.882 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:05 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:48:06.644 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:06 smithi089 ceph-mon[27639]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:48:06.644 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:06 smithi089 ceph-mon[27639]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-13T02:48:06.644 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:06 smithi089 ceph-mon[27639]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi089.front.sepia.ceph.com:9093"}]: dispatch 2024-09-13T02:48:06.644 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:06 smithi089 ceph-mon[27639]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-13T02:48:06.644 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:06 smithi089 ceph-mon[27639]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi089.front.sepia.ceph.com:3000"}]: dispatch 2024-09-13T02:48:06.644 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:06 smithi089 ceph-mon[27639]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T02:48:06.644 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:06 smithi089 ceph-mon[27639]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi089.front.sepia.ceph.com:9095"}]: dispatch 2024-09-13T02:48:06.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:06 smithi131 ceph-mon[34689]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:48:06.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:06 smithi131 ceph-mon[34689]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-13T02:48:06.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:06 smithi131 ceph-mon[34689]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi089.front.sepia.ceph.com:9093"}]: dispatch 2024-09-13T02:48:06.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:06 smithi131 ceph-mon[34689]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-13T02:48:06.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:06 smithi131 ceph-mon[34689]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi089.front.sepia.ceph.com:3000"}]: dispatch 2024-09-13T02:48:06.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:06 smithi131 ceph-mon[34689]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T02:48:06.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:06 smithi131 ceph-mon[34689]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi089.front.sepia.ceph.com:9095"}]: dispatch 2024-09-13T02:48:08.406 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:08 smithi089 ceph-mon[27639]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:48:08.406 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:08 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:48:08.407 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:08 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:48:08.407 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:08 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:48:08.407 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:08 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:48:08.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:08 smithi131 ceph-mon[34689]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:48:08.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:08 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:48:08.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:08 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:48:08.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:08 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:48:08.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:08 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:48:10.140 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:10 smithi089 ceph-mon[27639]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:48:10.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:10 smithi131 ceph-mon[34689]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:48:11.316 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:48:11.315+0000 7f5a0dffb640 1 -- 172.21.15.89:0/3685011766 <== mgr.14204 v2:172.21.15.89:6800/1506060926 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f5a1810f020 con 0x7f5a0406ecc0 2024-09-13T02:48:11.317 INFO:teuthology.orchestra.run.smithi089.stdout:Created osd(s) 0 on host 'smithi089' 2024-09-13T02:48:11.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:48:11.317+0000 7f5a1f4d1640 1 -- 172.21.15.89:0/3685011766 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f5a0406ecc0 msgr2=0x7f5a04071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:11.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:48:11.317+0000 7f5a1f4d1640 1 --2- 172.21.15.89:0/3685011766 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f5a0406ecc0 0x7f5a04071170 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f5a08009a80 tx=0x7f5a08008040 comp rx=0 tx=0).stop 2024-09-13T02:48:11.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:48:11.317+0000 7f5a1f4d1640 1 -- 172.21.15.89:0/3685011766 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a180fd810 msgr2=0x7f5a1810d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:11.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:48:11.317+0000 7f5a1f4d1640 1 --2- 172.21.15.89:0/3685011766 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a180fd810 0x7f5a1810d630 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5a14003080 tx=0x7f5a14009da0 comp rx=0 tx=0).stop 2024-09-13T02:48:11.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:48:11.317+0000 7f5a1f4d1640 1 -- 172.21.15.89:0/3685011766 shutdown_connections 2024-09-13T02:48:11.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:48:11.317+0000 7f5a1f4d1640 1 --2- 172.21.15.89:0/3685011766 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5a180fd810 0x7f5a1810d630 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:11.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:48:11.317+0000 7f5a1f4d1640 1 --2- 172.21.15.89:0/3685011766 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f5a0406ecc0 0x7f5a04071170 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:11.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:48:11.317+0000 7f5a1f4d1640 1 --2- 172.21.15.89:0/3685011766 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5a180fc540 0x7f5a1810d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:11.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:48:11.318+0000 7f5a1f4d1640 1 -- 172.21.15.89:0/3685011766 >> 172.21.15.89:0/3685011766 conn(0x7f5a180f7ce0 msgr2=0x7f5a180f94b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:48:11.320 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:48:11.318+0000 7f5a1f4d1640 1 -- 172.21.15.89:0/3685011766 shutdown_connections 2024-09-13T02:48:11.320 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:48:11.318+0000 7f5a1f4d1640 1 -- 172.21.15.89:0/3685011766 wait complete. 2024-09-13T02:48:12.011 DEBUG:teuthology.orchestra.run.smithi089:osd.0> sudo journalctl -f -n 0 -u ceph-12cdb164-717a-11ef-bceb-c7b262605968@osd.0.service 2024-09-13T02:48:12.013 INFO:tasks.cephadm:Deploying osd.1 on smithi089 with /dev/vg_nvme/lv_3... 2024-09-13T02:48:12.013 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-13T02:48:12.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:12 smithi131 ceph-mon[34689]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:48:12.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:12 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:48:12.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:12 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:48:12.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:12 smithi131 ceph-mon[34689]: from='osd.0 [v2:172.21.15.89:6802/768220523,v1:172.21.15.89:6803/768220523]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-13T02:48:12.709 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T02:48:12.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:12 smithi089 ceph-mon[27639]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:48:12.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:12 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:48:12.786 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:12 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:48:12.786 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:12 smithi089 ceph-mon[27639]: from='osd.0 [v2:172.21.15.89:6802/768220523,v1:172.21.15.89:6803/768220523]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-13T02:48:13.487 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:13 smithi089 ceph-mon[27639]: from='osd.0 [v2:172.21.15.89:6802/768220523,v1:172.21.15.89:6803/768220523]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-13T02:48:13.487 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:13 smithi089 ceph-mon[27639]: osdmap e7: 1 total, 0 up, 1 in 2024-09-13T02:48:13.487 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:13 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T02:48:13.487 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:13 smithi089 ceph-mon[27639]: from='osd.0 [v2:172.21.15.89:6802/768220523,v1:172.21.15.89:6803/768220523]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-09-13T02:48:13.487 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 02:48:13 smithi089 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-0[46234]: 2024-09-13T02:48:13.321+0000 7fdc70b6a640 -1 osd.0 0 waiting for initial osdmap 2024-09-13T02:48:13.487 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 02:48:13 smithi089 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-0[46234]: 2024-09-13T02:48:13.325+0000 7fdc6d9a5640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T02:48:13.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:13 smithi131 ceph-mon[34689]: from='osd.0 [v2:172.21.15.89:6802/768220523,v1:172.21.15.89:6803/768220523]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-13T02:48:13.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:13 smithi131 ceph-mon[34689]: osdmap e7: 1 total, 0 up, 1 in 2024-09-13T02:48:13.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:13 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T02:48:13.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:13 smithi131 ceph-mon[34689]: from='osd.0 [v2:172.21.15.89:6802/768220523,v1:172.21.15.89:6803/768220523]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-09-13T02:48:14.441 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:14 smithi089 ceph-mon[27639]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:48:14.442 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:14 smithi089 ceph-mon[27639]: from='osd.0 [v2:172.21.15.89:6802/768220523,v1:172.21.15.89:6803/768220523]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]': finished 2024-09-13T02:48:14.442 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:14 smithi089 ceph-mon[27639]: osdmap e8: 1 total, 0 up, 1 in 2024-09-13T02:48:14.442 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:14 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T02:48:14.442 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:14 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T02:48:14.442 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:14 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:48:14.442 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:14 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:48:14.442 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:14 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:48:14.442 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:14 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T02:48:14.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:14 smithi131 ceph-mon[34689]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:48:14.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:14 smithi131 ceph-mon[34689]: from='osd.0 [v2:172.21.15.89:6802/768220523,v1:172.21.15.89:6803/768220523]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]': finished 2024-09-13T02:48:14.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:14 smithi131 ceph-mon[34689]: osdmap e8: 1 total, 0 up, 1 in 2024-09-13T02:48:14.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:14 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T02:48:14.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:14 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T02:48:14.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:14 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:48:14.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:14 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:48:14.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:14 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:48:14.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:14 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T02:48:15.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:15 smithi089 ceph-mon[27639]: purged_snaps scrub starts 2024-09-13T02:48:15.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:15 smithi089 ceph-mon[27639]: purged_snaps scrub ok 2024-09-13T02:48:15.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:15 smithi089 ceph-mon[27639]: osd.0 [v2:172.21.15.89:6802/768220523,v1:172.21.15.89:6803/768220523] boot 2024-09-13T02:48:15.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:15 smithi089 ceph-mon[27639]: osdmap e9: 1 total, 1 up, 1 in 2024-09-13T02:48:15.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:15 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T02:48:15.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:15 smithi131 ceph-mon[34689]: purged_snaps scrub starts 2024-09-13T02:48:15.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:15 smithi131 ceph-mon[34689]: purged_snaps scrub ok 2024-09-13T02:48:15.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:15 smithi131 ceph-mon[34689]: osd.0 [v2:172.21.15.89:6802/768220523,v1:172.21.15.89:6803/768220523] boot 2024-09-13T02:48:15.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:15 smithi131 ceph-mon[34689]: osdmap e9: 1 total, 1 up, 1 in 2024-09-13T02:48:15.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:15 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T02:48:15.906 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:48:15.926 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi089:vg_nvme/lv_3 2024-09-13T02:48:16.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:16 smithi089 ceph-mon[27639]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:48:16.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:16 smithi089 ceph-mon[27639]: osdmap e10: 1 total, 1 up, 1 in 2024-09-13T02:48:16.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:16 smithi131 ceph-mon[34689]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-13T02:48:16.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:16 smithi131 ceph-mon[34689]: osdmap e10: 1 total, 1 up, 1 in 2024-09-13T02:48:17.284 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T02:48:18.652 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:18 smithi089 ceph-mon[27639]: pgmap v37: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T02:48:18.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:18 smithi131 ceph-mon[34689]: pgmap v37: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T02:48:18.852 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:48:18.846+0000 7f38118d7640 1 -- 172.21.15.89:0/667541723 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f380c0fd820 msgr2=0x7f380c0fdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:18.852 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:48:18.846+0000 7f38118d7640 1 --2- 172.21.15.89:0/667541723 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f380c0fd820 0x7f380c0fdc90 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f38000048d0 tx=0x7f3800009da0 comp rx=0 tx=0).stop 2024-09-13T02:48:18.852 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:48:18.846+0000 7f38118d7640 1 -- 172.21.15.89:0/667541723 shutdown_connections 2024-09-13T02:48:18.852 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:48:18.846+0000 7f38118d7640 1 --2- 172.21.15.89:0/667541723 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f380c0fd820 0x7f380c0fdc90 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:18.852 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:48:18.846+0000 7f38118d7640 1 --2- 172.21.15.89:0/667541723 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f380c0fc550 0x7f380c0fc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:18.852 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:48:18.846+0000 7f38118d7640 1 -- 172.21.15.89:0/667541723 >> 172.21.15.89:0/667541723 conn(0x7f380c0f7d30 msgr2=0x7f380c0fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:48:18.852 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:48:18.846+0000 7f38118d7640 1 -- 172.21.15.89:0/667541723 shutdown_connections 2024-09-13T02:48:18.852 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:48:18.846+0000 7f38118d7640 1 -- 172.21.15.89:0/667541723 wait complete. 2024-09-13T02:48:18.853 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:48:18.847+0000 7f38118d7640 1 Processor -- start 2024-09-13T02:48:18.853 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:48:18.847+0000 7f38118d7640 1 -- start start 2024-09-13T02:48:18.853 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:48:18.847+0000 7f38118d7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f380c0fc550 0x7f380c071570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:48:18.853 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:48:18.847+0000 7f38118d7640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f380c0fd820 0x7f380c06fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:48:18.853 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:48:18.847+0000 7f38118d7640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f380c06fff0 con 0x7f380c0fc550 2024-09-13T02:48:18.853 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:48:18.847+0000 7f38118d7640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f380c070130 con 0x7f380c0fd820 2024-09-13T02:48:18.853 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:48:18.847+0000 7f380affd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f380c0fc550 0x7f380c071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:48:18.853 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:48:18.847+0000 7f380affd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f380c0fc550 0x7f380c071570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:56998/0 (socket says 172.21.15.89:56998) 2024-09-13T02:48:18.853 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:48:18.847+0000 7f380affd640 1 -- 172.21.15.89:0/4049283836 learned_addr learned my addr 172.21.15.89:0/4049283836 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:48:18.853 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:48:18.847+0000 7f380affd640 1 -- 172.21.15.89:0/4049283836 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f380c0fd820 msgr2=0x7f380c06fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:18.853 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:48:18.847+0000 7f380affd640 1 --2- 172.21.15.89:0/4049283836 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f380c0fd820 0x7f380c06fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:18.853 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:48:18.847+0000 7f380affd640 1 -- 172.21.15.89:0/4049283836 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3800005040 con 0x7f380c0fc550 2024-09-13T02:48:18.854 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:48:18.847+0000 7f380affd640 1 --2- 172.21.15.89:0/4049283836 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f380c0fc550 0x7f380c071570 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f37fc00c830 tx=0x7f37fc004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:48:18.854 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:48:18.848+0000 7f37f37fe640 1 -- 172.21.15.89:0/4049283836 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f37fc00a850 con 0x7f380c0fc550 2024-09-13T02:48:18.854 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:48:18.848+0000 7f37f37fe640 1 -- 172.21.15.89:0/4049283836 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f37fc00ae50 con 0x7f380c0fc550 2024-09-13T02:48:18.854 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:48:18.848+0000 7f38118d7640 1 -- 172.21.15.89:0/4049283836 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f380c070410 con 0x7f380c0fc550 2024-09-13T02:48:18.854 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:48:18.848+0000 7f37f37fe640 1 -- 172.21.15.89:0/4049283836 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f37fc0113a0 con 0x7f380c0fc550 2024-09-13T02:48:18.854 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:48:18.848+0000 7f38118d7640 1 -- 172.21.15.89:0/4049283836 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f380c1150e0 con 0x7f380c0fc550 2024-09-13T02:48:18.854 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:48:18.849+0000 7f38118d7640 1 -- 172.21.15.89:0/4049283836 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f380c0fb9b0 con 0x7f380c0fc550 2024-09-13T02:48:18.854 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:48:18.849+0000 7f37f37fe640 1 -- 172.21.15.89:0/4049283836 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 18) v1 ==== 90811+0+0 (secure 0 0 0) 0x7f37fc012400 con 0x7f380c0fc550 2024-09-13T02:48:18.854 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:48:18.850+0000 7f37f37fe640 1 --2- 172.21.15.89:0/4049283836 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f37f406ecc0 0x7f37f4071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:48:18.854 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:48:18.850+0000 7f37f37fe640 1 -- 172.21.15.89:0/4049283836 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1978+0+0 (secure 0 0 0) 0x7f37fc08d500 con 0x7f380c0fc550 2024-09-13T02:48:18.854 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:48:18.850+0000 7f380a7fc640 1 --2- 172.21.15.89:0/4049283836 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f37f406ecc0 0x7f37f4071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:48:18.854 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:48:18.850+0000 7f380a7fc640 1 --2- 172.21.15.89:0/4049283836 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f37f406ecc0 0x7f37f4071170 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f380002a530 tx=0x7f3800009da0 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:48:18.855 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:48:18.854+0000 7f37f37fe640 1 -- 172.21.15.89:0/4049283836 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f37fc05b520 con 0x7f380c0fc550 2024-09-13T02:48:19.020 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:48:19.018+0000 7f38118d7640 1 -- 172.21.15.89:0/4049283836 --> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi089:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f380c101c40 con 0x7f37f406ecc0 2024-09-13T02:48:19.662 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:19 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T02:48:19.663 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:19 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T02:48:19.663 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:19 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:48:19.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:19 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T02:48:19.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:19 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T02:48:19.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:19 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:48:20.629 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:20 smithi089 ceph-mon[27639]: pgmap v38: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T02:48:20.630 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:20 smithi089 ceph-mon[27639]: from='client.14256 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi089:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:48:20.630 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:20 smithi089 ceph-mon[27639]: Detected new or changed devices on smithi089 2024-09-13T02:48:20.630 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:20 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:48:20.630 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:20 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:48:20.630 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:20 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:48:20.630 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:20 smithi089 ceph-mon[27639]: Adjusting osd_memory_target on smithi089 to 12863M 2024-09-13T02:48:20.630 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:20 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:48:20.630 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:20 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:48:20.630 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:20 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:48:20.631 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:20 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:48:20.631 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:20 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:48:20.757 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:20 smithi131 ceph-mon[34689]: pgmap v38: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T02:48:20.757 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:20 smithi131 ceph-mon[34689]: from='client.14256 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi089:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:48:20.757 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:20 smithi131 ceph-mon[34689]: Detected new or changed devices on smithi089 2024-09-13T02:48:20.758 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:20 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:48:20.758 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:20 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:48:20.758 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:20 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:48:20.758 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:20 smithi131 ceph-mon[34689]: Adjusting osd_memory_target on smithi089 to 12863M 2024-09-13T02:48:20.758 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:20 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:48:20.758 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:20 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:48:20.758 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:20 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:48:20.758 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:20 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:48:20.758 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:20 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:48:22.490 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:22 smithi089 ceph-mon[27639]: pgmap v39: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T02:48:22.490 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:22 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:48:22.490 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:22 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:48:22.491 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:22 smithi089 ceph-mon[27639]: from='client.? 172.21.15.89:0/2510638542' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "19f1a315-6f5b-41d9-9cc3-04b7d3eaf4d6"}]: dispatch 2024-09-13T02:48:22.491 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:22 smithi089 ceph-mon[27639]: from='client.? 172.21.15.89:0/2510638542' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "19f1a315-6f5b-41d9-9cc3-04b7d3eaf4d6"}]': finished 2024-09-13T02:48:22.491 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:22 smithi089 ceph-mon[27639]: osdmap e11: 2 total, 1 up, 2 in 2024-09-13T02:48:22.491 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:22 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T02:48:22.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:22 smithi131 ceph-mon[34689]: pgmap v39: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T02:48:22.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:22 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:48:22.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:22 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:48:22.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:22 smithi131 ceph-mon[34689]: from='client.? 172.21.15.89:0/2510638542' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "19f1a315-6f5b-41d9-9cc3-04b7d3eaf4d6"}]: dispatch 2024-09-13T02:48:22.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:22 smithi131 ceph-mon[34689]: from='client.? 172.21.15.89:0/2510638542' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "19f1a315-6f5b-41d9-9cc3-04b7d3eaf4d6"}]': finished 2024-09-13T02:48:22.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:22 smithi131 ceph-mon[34689]: osdmap e11: 2 total, 1 up, 2 in 2024-09-13T02:48:22.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:22 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T02:48:23.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:23 smithi089 ceph-mon[27639]: from='client.? 172.21.15.89:0/2799922938' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T02:48:23.683 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:23 smithi131 ceph-mon[34689]: from='client.? 172.21.15.89:0/2799922938' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T02:48:24.637 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:24 smithi089 ceph-mon[27639]: pgmap v41: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T02:48:24.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:24 smithi131 ceph-mon[34689]: pgmap v41: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T02:48:26.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:25 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:48:26.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:25 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:48:26.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:25 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:48:26.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:25 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:48:26.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:25 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:48:26.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:25 smithi131 ceph-mon[34689]: pgmap v42: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T02:48:26.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:25 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:48:26.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:25 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:48:26.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:25 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:48:26.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:25 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:48:26.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:25 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:48:26.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:25 smithi089 ceph-mon[27639]: pgmap v42: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T02:48:28.148 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:28 smithi089 ceph-mon[27639]: pgmap v43: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T02:48:28.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:28 smithi131 ceph-mon[34689]: pgmap v43: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T02:48:29.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:29 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:48:29.433 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:29 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:48:30.127 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:30 smithi089 ceph-mon[27639]: pgmap v44: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T02:48:30.127 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:30 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-13T02:48:30.127 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:30 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:48:30.127 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:30 smithi089 ceph-mon[27639]: Deploying daemon osd.1 on smithi089 2024-09-13T02:48:30.433 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:30 smithi131 ceph-mon[34689]: pgmap v44: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T02:48:30.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:30 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-13T02:48:30.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:30 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:48:30.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:30 smithi131 ceph-mon[34689]: Deploying daemon osd.1 on smithi089 2024-09-13T02:48:32.158 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:32 smithi089 ceph-mon[27639]: pgmap v45: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T02:48:32.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:32 smithi131 ceph-mon[34689]: pgmap v45: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T02:48:34.186 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:34 smithi089 ceph-mon[27639]: pgmap v46: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T02:48:34.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:34 smithi131 ceph-mon[34689]: pgmap v46: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T02:48:35.090 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:35 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:48:35.090 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:35 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:48:35.091 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:35 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:48:35.309 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:35 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:48:35.310 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:35 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:48:35.310 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:35 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:48:36.673 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:36 smithi089 ceph-mon[27639]: pgmap v47: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T02:48:36.673 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:36 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:48:36.673 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:36 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:48:36.683 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:36 smithi131 ceph-mon[34689]: pgmap v47: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T02:48:36.683 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:36 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:48:36.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:36 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:48:38.184 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:48:38.182+0000 7f37f37fe640 1 -- 172.21.15.89:0/4049283836 <== mgr.14204 v2:172.21.15.89:6800/1506060926 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f380c101c40 con 0x7f37f406ecc0 2024-09-13T02:48:38.184 INFO:teuthology.orchestra.run.smithi089.stdout:Created osd(s) 1 on host 'smithi089' 2024-09-13T02:48:38.185 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:48:38.184+0000 7f38118d7640 1 -- 172.21.15.89:0/4049283836 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f37f406ecc0 msgr2=0x7f37f4071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:38.185 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:48:38.184+0000 7f38118d7640 1 --2- 172.21.15.89:0/4049283836 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f37f406ecc0 0x7f37f4071170 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f380002a530 tx=0x7f3800009da0 comp rx=0 tx=0).stop 2024-09-13T02:48:38.185 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:48:38.184+0000 7f38118d7640 1 -- 172.21.15.89:0/4049283836 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f380c0fc550 msgr2=0x7f380c071570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:38.185 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:48:38.184+0000 7f38118d7640 1 --2- 172.21.15.89:0/4049283836 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f380c0fc550 0x7f380c071570 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f37fc00c830 tx=0x7f37fc004430 comp rx=0 tx=0).stop 2024-09-13T02:48:38.186 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:48:38.184+0000 7f38118d7640 1 -- 172.21.15.89:0/4049283836 shutdown_connections 2024-09-13T02:48:38.186 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:48:38.184+0000 7f38118d7640 1 --2- 172.21.15.89:0/4049283836 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f37f406ecc0 0x7f37f4071170 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:38.186 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:48:38.184+0000 7f38118d7640 1 --2- 172.21.15.89:0/4049283836 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f380c0fd820 0x7f380c06fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:38.186 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:48:38.184+0000 7f38118d7640 1 --2- 172.21.15.89:0/4049283836 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f380c0fc550 0x7f380c071570 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:38.186 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:48:38.184+0000 7f38118d7640 1 -- 172.21.15.89:0/4049283836 >> 172.21.15.89:0/4049283836 conn(0x7f380c0f7d30 msgr2=0x7f380c0f9490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:48:38.186 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:48:38.184+0000 7f38118d7640 1 -- 172.21.15.89:0/4049283836 shutdown_connections 2024-09-13T02:48:38.186 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:48:38.184+0000 7f38118d7640 1 -- 172.21.15.89:0/4049283836 wait complete. 2024-09-13T02:48:38.685 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:38 smithi131 ceph-mon[34689]: pgmap v48: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T02:48:38.685 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:38 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:48:38.685 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:38 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:48:38.685 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:38 smithi131 ceph-mon[34689]: from='osd.1 [v2:172.21.15.89:6810/3034426190,v1:172.21.15.89:6811/3034426190]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-13T02:48:38.760 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:38 smithi089 ceph-mon[27639]: pgmap v48: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T02:48:38.760 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:38 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:48:38.760 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:38 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:48:38.760 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:38 smithi089 ceph-mon[27639]: from='osd.1 [v2:172.21.15.89:6810/3034426190,v1:172.21.15.89:6811/3034426190]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-13T02:48:38.785 DEBUG:teuthology.orchestra.run.smithi089:osd.1> sudo journalctl -f -n 0 -u ceph-12cdb164-717a-11ef-bceb-c7b262605968@osd.1.service 2024-09-13T02:48:38.787 INFO:tasks.cephadm:Deploying osd.2 on smithi089 with /dev/vg_nvme/lv_2... 2024-09-13T02:48:38.787 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-13T02:48:39.546 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T02:48:40.361 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:40 smithi089 ceph-mon[27639]: pgmap v49: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T02:48:40.361 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:40 smithi089 ceph-mon[27639]: from='osd.1 [v2:172.21.15.89:6810/3034426190,v1:172.21.15.89:6811/3034426190]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-13T02:48:40.361 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:40 smithi089 ceph-mon[27639]: osdmap e12: 2 total, 1 up, 2 in 2024-09-13T02:48:40.361 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:40 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T02:48:40.362 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:40 smithi089 ceph-mon[27639]: from='osd.1 [v2:172.21.15.89:6810/3034426190,v1:172.21.15.89:6811/3034426190]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-09-13T02:48:40.362 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 02:48:40 smithi089 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-1[53258]: 2024-09-13T02:48:40.191+0000 7f3070ee7640 -1 osd.1 0 waiting for initial osdmap 2024-09-13T02:48:40.362 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 02:48:40 smithi089 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-1[53258]: 2024-09-13T02:48:40.196+0000 7f30694f7640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T02:48:40.485 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:40 smithi131 ceph-mon[34689]: pgmap v49: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T02:48:40.485 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:40 smithi131 ceph-mon[34689]: from='osd.1 [v2:172.21.15.89:6810/3034426190,v1:172.21.15.89:6811/3034426190]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-13T02:48:40.485 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:40 smithi131 ceph-mon[34689]: osdmap e12: 2 total, 1 up, 2 in 2024-09-13T02:48:40.485 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:40 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T02:48:40.485 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:40 smithi131 ceph-mon[34689]: from='osd.1 [v2:172.21.15.89:6810/3034426190,v1:172.21.15.89:6811/3034426190]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-09-13T02:48:41.391 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:41 smithi089 ceph-mon[27639]: from='osd.1 [v2:172.21.15.89:6810/3034426190,v1:172.21.15.89:6811/3034426190]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]': finished 2024-09-13T02:48:41.392 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:41 smithi089 ceph-mon[27639]: osdmap e13: 2 total, 1 up, 2 in 2024-09-13T02:48:41.392 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:41 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T02:48:41.392 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:41 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T02:48:41.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:41 smithi131 ceph-mon[34689]: from='osd.1 [v2:172.21.15.89:6810/3034426190,v1:172.21.15.89:6811/3034426190]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]': finished 2024-09-13T02:48:41.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:41 smithi131 ceph-mon[34689]: osdmap e13: 2 total, 1 up, 2 in 2024-09-13T02:48:41.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:41 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T02:48:41.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:41 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T02:48:42.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:42 smithi089 ceph-mon[27639]: purged_snaps scrub starts 2024-09-13T02:48:42.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:42 smithi089 ceph-mon[27639]: purged_snaps scrub ok 2024-09-13T02:48:42.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:42 smithi089 ceph-mon[27639]: pgmap v52: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T02:48:42.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:42 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T02:48:42.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:42 smithi089 ceph-mon[27639]: osd.1 [v2:172.21.15.89:6810/3034426190,v1:172.21.15.89:6811/3034426190] boot 2024-09-13T02:48:42.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:42 smithi089 ceph-mon[27639]: osdmap e14: 2 total, 2 up, 2 in 2024-09-13T02:48:42.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:42 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T02:48:42.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:42 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:48:42.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:42 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:48:42.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:42 smithi131 ceph-mon[34689]: purged_snaps scrub starts 2024-09-13T02:48:42.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:42 smithi131 ceph-mon[34689]: purged_snaps scrub ok 2024-09-13T02:48:42.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:42 smithi131 ceph-mon[34689]: pgmap v52: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-09-13T02:48:42.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:42 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T02:48:42.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:42 smithi131 ceph-mon[34689]: osd.1 [v2:172.21.15.89:6810/3034426190,v1:172.21.15.89:6811/3034426190] boot 2024-09-13T02:48:42.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:42 smithi131 ceph-mon[34689]: osdmap e14: 2 total, 2 up, 2 in 2024-09-13T02:48:42.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:42 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T02:48:42.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:42 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:48:42.685 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:42 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:48:43.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:43 smithi089 ceph-mon[27639]: osdmap e15: 2 total, 2 up, 2 in 2024-09-13T02:48:43.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:43 smithi131 ceph-mon[34689]: osdmap e15: 2 total, 2 up, 2 in 2024-09-13T02:48:43.747 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:48:43.769 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi089:vg_nvme/lv_2 2024-09-13T02:48:44.531 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:44 smithi089 ceph-mon[27639]: pgmap v55: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T02:48:44.531 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:44 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:48:44.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:44 smithi131 ceph-mon[34689]: pgmap v55: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T02:48:44.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:44 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:48:44.729 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T02:48:46.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:46 smithi089 ceph-mon[27639]: pgmap v56: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T02:48:46.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:46 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:48:46.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:46 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:48:46.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:46 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:48:46.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:46 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:48:46.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:46 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:48:46.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:46 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:48:46.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:46 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:48:46.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:46 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:48:46.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:46 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:48:46.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:46 smithi131 ceph-mon[34689]: pgmap v56: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T02:48:46.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:46 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:48:46.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:46 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:48:46.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:46 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:48:46.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:46 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:48:46.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:46 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:48:46.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:46 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:48:46.685 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:46 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:48:46.685 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:46 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:48:46.685 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:46 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:48:46.912 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:48:46.909+0000 7ff998ad2640 1 -- 172.21.15.89:0/2972812945 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9940fc700 msgr2=0x7ff9940fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:46.912 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:48:46.909+0000 7ff998ad2640 1 --2- 172.21.15.89:0/2972812945 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9940fc700 0x7ff9940fcb70 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7ff97c0048d0 tx=0x7ff97c009da0 comp rx=0 tx=0).stop 2024-09-13T02:48:46.912 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:48:46.909+0000 7ff998ad2640 1 -- 172.21.15.89:0/2972812945 shutdown_connections 2024-09-13T02:48:46.912 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:48:46.909+0000 7ff998ad2640 1 --2- 172.21.15.89:0/2972812945 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9940fc700 0x7ff9940fcb70 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:46.912 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:48:46.909+0000 7ff998ad2640 1 --2- 172.21.15.89:0/2972812945 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff9940fb430 0x7ff9940fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:46.912 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:48:46.909+0000 7ff998ad2640 1 -- 172.21.15.89:0/2972812945 >> 172.21.15.89:0/2972812945 conn(0x7ff9940f6c10 msgr2=0x7ff9940f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:48:46.912 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:48:46.909+0000 7ff998ad2640 1 -- 172.21.15.89:0/2972812945 shutdown_connections 2024-09-13T02:48:46.912 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:48:46.909+0000 7ff998ad2640 1 -- 172.21.15.89:0/2972812945 wait complete. 2024-09-13T02:48:46.913 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:48:46.909+0000 7ff998ad2640 1 Processor -- start 2024-09-13T02:48:46.913 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:48:46.909+0000 7ff998ad2640 1 -- start start 2024-09-13T02:48:46.913 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:48:46.909+0000 7ff998ad2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9940fb430 0x7ff99410d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:48:46.913 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:48:46.909+0000 7ff998ad2640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff9940fc700 0x7ff99410d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:48:46.913 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:48:46.909+0000 7ff998ad2640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff99410dbd0 con 0x7ff9940fb430 2024-09-13T02:48:46.913 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:48:46.909+0000 7ff998ad2640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff99410e3f0 con 0x7ff9940fc700 2024-09-13T02:48:46.913 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:48:46.909+0000 7ff99259c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9940fb430 0x7ff99410d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:48:46.913 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:48:46.909+0000 7ff99259c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9940fb430 0x7ff99410d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36888/0 (socket says 172.21.15.89:36888) 2024-09-13T02:48:46.913 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:48:46.909+0000 7ff99259c640 1 -- 172.21.15.89:0/2335276839 learned_addr learned my addr 172.21.15.89:0/2335276839 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:48:46.913 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:48:46.910+0000 7ff98bfff640 1 --2- 172.21.15.89:0/2335276839 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff9940fc700 0x7ff99410d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:48:46.913 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:48:46.910+0000 7ff99259c640 1 -- 172.21.15.89:0/2335276839 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff9940fc700 msgr2=0x7ff99410d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:48:46.913 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:48:46.910+0000 7ff99259c640 1 --2- 172.21.15.89:0/2335276839 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff9940fc700 0x7ff99410d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:48:46.914 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:48:46.910+0000 7ff99259c640 1 -- 172.21.15.89:0/2335276839 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff97c005040 con 0x7ff9940fb430 2024-09-13T02:48:46.914 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:48:46.910+0000 7ff99259c640 1 --2- 172.21.15.89:0/2335276839 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9940fb430 0x7ff99410d040 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff98400c810 tx=0x7ff9840043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:48:46.914 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:48:46.910+0000 7ff98affd640 1 -- 172.21.15.89:0/2335276839 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff98400a820 con 0x7ff9940fb430 2024-09-13T02:48:46.914 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:48:46.910+0000 7ff98affd640 1 -- 172.21.15.89:0/2335276839 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff98400ae20 con 0x7ff9940fb430 2024-09-13T02:48:46.914 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:48:46.910+0000 7ff98affd640 1 -- 172.21.15.89:0/2335276839 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff9840115c0 con 0x7ff9940fb430 2024-09-13T02:48:46.914 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:48:46.910+0000 7ff998ad2640 1 -- 172.21.15.89:0/2335276839 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff99410e680 con 0x7ff9940fb430 2024-09-13T02:48:46.914 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:48:46.910+0000 7ff998ad2640 1 -- 172.21.15.89:0/2335276839 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff99410ec20 con 0x7ff9940fb430 2024-09-13T02:48:46.915 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:48:46.911+0000 7ff998ad2640 1 -- 172.21.15.89:0/2335276839 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9940fa890 con 0x7ff9940fb430 2024-09-13T02:48:46.915 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:48:46.912+0000 7ff98affd640 1 -- 172.21.15.89:0/2335276839 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 18) v1 ==== 90811+0+0 (secure 0 0 0) 0x7ff984012840 con 0x7ff9940fb430 2024-09-13T02:48:46.915 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:48:46.912+0000 7ff98affd640 1 --2- 172.21.15.89:0/2335276839 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7ff98006ecc0 0x7ff980071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:48:46.915 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:48:46.912+0000 7ff98affd640 1 -- 172.21.15.89:0/2335276839 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2410+0+0 (secure 0 0 0) 0x7ff98408d950 con 0x7ff9940fb430 2024-09-13T02:48:46.915 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:48:46.912+0000 7ff98bfff640 1 --2- 172.21.15.89:0/2335276839 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7ff98006ecc0 0x7ff980071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:48:46.915 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:48:46.913+0000 7ff98bfff640 1 --2- 172.21.15.89:0/2335276839 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7ff98006ecc0 0x7ff980071170 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff97c007ac0 tx=0x7ff97c035040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:48:46.917 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:48:46.916+0000 7ff98affd640 1 -- 172.21.15.89:0/2335276839 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7ff98405b7c0 con 0x7ff9940fb430 2024-09-13T02:48:47.087 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:48:47.086+0000 7ff998ad2640 1 -- 172.21.15.89:0/2335276839 --> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi089:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7ff99410eef0 con 0x7ff98006ecc0 2024-09-13T02:48:47.360 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:47 smithi089 ceph-mon[27639]: Detected new or changed devices on smithi089 2024-09-13T02:48:47.360 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:47 smithi089 ceph-mon[27639]: Adjusting osd_memory_target on smithi089 to 6431M 2024-09-13T02:48:47.361 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:47 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T02:48:47.361 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:47 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T02:48:47.361 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:47 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:48:47.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:47 smithi131 ceph-mon[34689]: Detected new or changed devices on smithi089 2024-09-13T02:48:47.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:47 smithi131 ceph-mon[34689]: Adjusting osd_memory_target on smithi089 to 6431M 2024-09-13T02:48:47.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:47 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T02:48:47.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:47 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T02:48:47.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:47 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:48:48.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:48 smithi089 ceph-mon[27639]: pgmap v57: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T02:48:48.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:48 smithi089 ceph-mon[27639]: from='client.14274 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi089:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:48:48.683 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:48 smithi131 ceph-mon[34689]: pgmap v57: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T02:48:48.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:48 smithi131 ceph-mon[34689]: from='client.14274 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi089:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:48:50.429 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:50 smithi089 ceph-mon[27639]: pgmap v58: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T02:48:50.683 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:50 smithi131 ceph-mon[34689]: pgmap v58: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T02:48:52.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:52 smithi089 ceph-mon[27639]: pgmap v59: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T02:48:52.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:52 smithi089 ceph-mon[27639]: from='client.? 172.21.15.89:0/2547516266' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4032071a-32a2-46af-9c08-b01ae52359d5"}]: dispatch 2024-09-13T02:48:52.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:52 smithi089 ceph-mon[27639]: from='client.? 172.21.15.89:0/2547516266' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4032071a-32a2-46af-9c08-b01ae52359d5"}]': finished 2024-09-13T02:48:52.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:52 smithi089 ceph-mon[27639]: osdmap e16: 3 total, 2 up, 3 in 2024-09-13T02:48:52.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:52 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T02:48:52.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:52 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:48:52.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:52 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:48:52.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:52 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:48:52.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:52 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:48:52.536 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:52 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:48:52.536 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:52 smithi089 ceph-mon[27639]: from='client.? 172.21.15.89:0/526920716' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T02:48:52.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:52 smithi131 ceph-mon[34689]: pgmap v59: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T02:48:52.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:52 smithi131 ceph-mon[34689]: from='client.? 172.21.15.89:0/2547516266' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4032071a-32a2-46af-9c08-b01ae52359d5"}]: dispatch 2024-09-13T02:48:52.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:52 smithi131 ceph-mon[34689]: from='client.? 172.21.15.89:0/2547516266' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4032071a-32a2-46af-9c08-b01ae52359d5"}]': finished 2024-09-13T02:48:52.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:52 smithi131 ceph-mon[34689]: osdmap e16: 3 total, 2 up, 3 in 2024-09-13T02:48:52.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:52 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T02:48:52.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:52 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:48:52.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:52 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:48:52.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:52 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:48:52.685 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:52 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:48:52.685 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:52 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:48:52.685 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:52 smithi131 ceph-mon[34689]: from='client.? 172.21.15.89:0/526920716' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T02:48:54.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:54 smithi089 ceph-mon[27639]: pgmap v61: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T02:48:54.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:54 smithi131 ceph-mon[34689]: pgmap v61: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T02:48:56.520 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:56 smithi089 ceph-mon[27639]: pgmap v62: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T02:48:56.683 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:56 smithi131 ceph-mon[34689]: pgmap v62: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T02:48:58.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:58 smithi089 ceph-mon[27639]: pgmap v63: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T02:48:58.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:58 smithi131 ceph-mon[34689]: pgmap v63: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T02:48:59.538 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:59 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-13T02:48:59.553 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:59 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:48:59.553 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:59 smithi089 ceph-mon[27639]: Deploying daemon osd.2 on smithi089 2024-09-13T02:48:59.553 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:48:59 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:48:59.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:59 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-13T02:48:59.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:59 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:48:59.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:59 smithi131 ceph-mon[34689]: Deploying daemon osd.2 on smithi089 2024-09-13T02:48:59.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:48:59 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:49:00.534 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:00 smithi089 ceph-mon[27639]: pgmap v64: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T02:49:00.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:00 smithi131 ceph-mon[34689]: pgmap v64: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T02:49:02.519 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:02 smithi089 ceph-mon[27639]: pgmap v65: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T02:49:02.683 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:02 smithi131 ceph-mon[34689]: pgmap v65: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T02:49:04.479 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:04 smithi089 ceph-mon[27639]: pgmap v66: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T02:49:04.479 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:04 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:49:04.479 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:04 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:49:04.479 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:04 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:49:04.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:04 smithi131 ceph-mon[34689]: pgmap v66: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T02:49:04.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:04 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:49:04.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:04 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:49:04.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:04 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:49:06.471 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:06 smithi089 ceph-mon[27639]: pgmap v67: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T02:49:06.683 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:06 smithi131 ceph-mon[34689]: pgmap v67: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T02:49:07.588 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:49:07.585+0000 7ff98affd640 1 -- 172.21.15.89:0/2335276839 <== mgr.14204 v2:172.21.15.89:6800/1506060926 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7ff99410eef0 con 0x7ff98006ecc0 2024-09-13T02:49:07.588 INFO:teuthology.orchestra.run.smithi089.stdout:Created osd(s) 2 on host 'smithi089' 2024-09-13T02:49:07.591 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:49:07.588+0000 7ff998ad2640 1 -- 172.21.15.89:0/2335276839 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7ff98006ecc0 msgr2=0x7ff980071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:07.591 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:49:07.588+0000 7ff998ad2640 1 --2- 172.21.15.89:0/2335276839 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7ff98006ecc0 0x7ff980071170 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff97c007ac0 tx=0x7ff97c035040 comp rx=0 tx=0).stop 2024-09-13T02:49:07.591 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:49:07.589+0000 7ff998ad2640 1 -- 172.21.15.89:0/2335276839 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9940fb430 msgr2=0x7ff99410d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:07.591 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:49:07.589+0000 7ff998ad2640 1 --2- 172.21.15.89:0/2335276839 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9940fb430 0x7ff99410d040 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff98400c810 tx=0x7ff9840043c0 comp rx=0 tx=0).stop 2024-09-13T02:49:07.591 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:49:07.589+0000 7ff998ad2640 1 -- 172.21.15.89:0/2335276839 shutdown_connections 2024-09-13T02:49:07.591 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:49:07.589+0000 7ff998ad2640 1 --2- 172.21.15.89:0/2335276839 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7ff98006ecc0 0x7ff980071170 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:07.591 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:49:07.589+0000 7ff998ad2640 1 --2- 172.21.15.89:0/2335276839 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff9940fc700 0x7ff99410d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:07.592 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:49:07.589+0000 7ff998ad2640 1 --2- 172.21.15.89:0/2335276839 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9940fb430 0x7ff99410d040 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:07.592 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:49:07.589+0000 7ff998ad2640 1 -- 172.21.15.89:0/2335276839 >> 172.21.15.89:0/2335276839 conn(0x7ff9940f6c10 msgr2=0x7ff9940655e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:49:07.592 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:49:07.589+0000 7ff998ad2640 1 -- 172.21.15.89:0/2335276839 shutdown_connections 2024-09-13T02:49:07.592 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:49:07.589+0000 7ff998ad2640 1 -- 172.21.15.89:0/2335276839 wait complete. 2024-09-13T02:49:08.807 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:08 smithi089 ceph-mon[27639]: pgmap v68: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T02:49:08.807 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:08 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:49:08.807 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:08 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:49:08.807 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:08 smithi089 ceph-mon[27639]: from='osd.2 [v2:172.21.15.89:6818/2876061357,v1:172.21.15.89:6819/2876061357]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-13T02:49:08.832 DEBUG:teuthology.orchestra.run.smithi089:osd.2> sudo journalctl -f -n 0 -u ceph-12cdb164-717a-11ef-bceb-c7b262605968@osd.2.service 2024-09-13T02:49:08.835 INFO:tasks.cephadm:Deploying osd.3 on smithi131 with /dev/vg_nvme/lv_4... 2024-09-13T02:49:08.835 DEBUG:teuthology.orchestra.run.smithi131:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-13T02:49:08.863 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:08 smithi131 ceph-mon[34689]: pgmap v68: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T02:49:08.863 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:08 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:49:08.864 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:08 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:49:08.864 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:08 smithi131 ceph-mon[34689]: from='osd.2 [v2:172.21.15.89:6818/2876061357,v1:172.21.15.89:6819/2876061357]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-13T02:49:09.088 INFO:teuthology.orchestra.run.smithi131.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/mon.smithi131/config 2024-09-13T02:49:09.867 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:09 smithi131 ceph-mon[34689]: from='osd.2 [v2:172.21.15.89:6818/2876061357,v1:172.21.15.89:6819/2876061357]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-13T02:49:09.868 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:09 smithi131 ceph-mon[34689]: osdmap e17: 3 total, 2 up, 3 in 2024-09-13T02:49:09.868 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:09 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T02:49:09.868 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:09 smithi131 ceph-mon[34689]: from='osd.2 [v2:172.21.15.89:6818/2876061357,v1:172.21.15.89:6819/2876061357]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-09-13T02:49:09.899 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:09 smithi089 ceph-mon[27639]: from='osd.2 [v2:172.21.15.89:6818/2876061357,v1:172.21.15.89:6819/2876061357]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-13T02:49:09.900 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:09 smithi089 ceph-mon[27639]: osdmap e17: 3 total, 2 up, 3 in 2024-09-13T02:49:09.900 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:09 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T02:49:09.900 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:09 smithi089 ceph-mon[27639]: from='osd.2 [v2:172.21.15.89:6818/2876061357,v1:172.21.15.89:6819/2876061357]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-09-13T02:49:09.900 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 02:49:09 smithi089 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-2[60601]: 2024-09-13T02:49:09.591+0000 7fb787038640 -1 osd.2 0 waiting for initial osdmap 2024-09-13T02:49:09.900 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 02:49:09 smithi089 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-2[60601]: 2024-09-13T02:49:09.596+0000 7fb780e6d640 -1 osd.2 18 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T02:49:10.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:10 smithi131 ceph-mon[34689]: pgmap v70: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T02:49:10.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:10 smithi131 ceph-mon[34689]: from='osd.2 [v2:172.21.15.89:6818/2876061357,v1:172.21.15.89:6819/2876061357]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]': finished 2024-09-13T02:49:10.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:10 smithi131 ceph-mon[34689]: osdmap e18: 3 total, 2 up, 3 in 2024-09-13T02:49:10.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:10 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T02:49:10.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:10 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T02:49:10.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:10 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:49:10.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:10 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:49:10.925 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:10 smithi089 ceph-mon[27639]: pgmap v70: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T02:49:10.926 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:10 smithi089 ceph-mon[27639]: from='osd.2 [v2:172.21.15.89:6818/2876061357,v1:172.21.15.89:6819/2876061357]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]': finished 2024-09-13T02:49:10.926 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:10 smithi089 ceph-mon[27639]: osdmap e18: 3 total, 2 up, 3 in 2024-09-13T02:49:10.926 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:10 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T02:49:10.926 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:10 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T02:49:10.926 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:10 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:49:10.926 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:10 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:49:11.488 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-13T02:49:11.508 DEBUG:teuthology.orchestra.run.smithi131:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi131:vg_nvme/lv_4 2024-09-13T02:49:11.638 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:11 smithi089 ceph-mon[27639]: purged_snaps scrub starts 2024-09-13T02:49:11.638 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:11 smithi089 ceph-mon[27639]: purged_snaps scrub ok 2024-09-13T02:49:11.638 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:11 smithi089 ceph-mon[27639]: osd.2 [v2:172.21.15.89:6818/2876061357,v1:172.21.15.89:6819/2876061357] boot 2024-09-13T02:49:11.638 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:11 smithi089 ceph-mon[27639]: osdmap e19: 3 total, 3 up, 3 in 2024-09-13T02:49:11.638 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:11 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T02:49:11.639 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:11 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-09-13T02:49:11.776 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:11 smithi131 ceph-mon[34689]: purged_snaps scrub starts 2024-09-13T02:49:11.777 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:11 smithi131 ceph-mon[34689]: purged_snaps scrub ok 2024-09-13T02:49:11.777 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:11 smithi131 ceph-mon[34689]: osd.2 [v2:172.21.15.89:6818/2876061357,v1:172.21.15.89:6819/2876061357] boot 2024-09-13T02:49:11.777 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:11 smithi131 ceph-mon[34689]: osdmap e19: 3 total, 3 up, 3 in 2024-09-13T02:49:11.777 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:11 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T02:49:11.777 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:11 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-09-13T02:49:11.801 INFO:teuthology.orchestra.run.smithi131.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/mon.smithi131/config 2024-09-13T02:49:12.882 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:12 smithi131 ceph-mon[34689]: pgmap v73: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T02:49:12.882 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:12 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-09-13T02:49:12.882 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:12 smithi131 ceph-mon[34689]: osdmap e20: 3 total, 3 up, 3 in 2024-09-13T02:49:12.882 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:12 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-13T02:49:12.970 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:12 smithi089 ceph-mon[27639]: pgmap v73: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-09-13T02:49:12.970 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:12 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-09-13T02:49:12.970 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:12 smithi089 ceph-mon[27639]: osdmap e20: 3 total, 3 up, 3 in 2024-09-13T02:49:12.971 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:12 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-13T02:49:13.282 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 02:49:13 smithi089 sudo[64858]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-13T02:49:13.282 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 02:49:13 smithi089 sudo[64858]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T02:49:13.282 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 02:49:13 smithi089 sudo[64858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T02:49:13.282 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 02:49:13 smithi089 sudo[64858]: pam_unix(sudo:session): session closed for user root 2024-09-13T02:49:13.377 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:49:13.358+0000 7fe9dcb72640 1 -- 172.21.15.131:0/2254762234 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe9d80fb420 msgr2=0x7fe9d80fb830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:13.377 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:49:13.358+0000 7fe9dcb72640 1 --2- 172.21.15.131:0/2254762234 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe9d80fb420 0x7fe9d80fb830 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fe9c80048d0 tx=0x7fe9c8009da0 comp rx=0 tx=0).stop 2024-09-13T02:49:13.377 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:49:13.358+0000 7fe9dcb72640 1 -- 172.21.15.131:0/2254762234 shutdown_connections 2024-09-13T02:49:13.377 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:49:13.358+0000 7fe9dcb72640 1 --2- 172.21.15.131:0/2254762234 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe9d80fc6f0 0x7fe9d80fcb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:13.377 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:49:13.358+0000 7fe9dcb72640 1 --2- 172.21.15.131:0/2254762234 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe9d80fb420 0x7fe9d80fb830 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:13.377 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:49:13.358+0000 7fe9dcb72640 1 -- 172.21.15.131:0/2254762234 >> 172.21.15.131:0/2254762234 conn(0x7fe9d80f6c00 msgr2=0x7fe9d80f9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:49:13.377 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:49:13.358+0000 7fe9dcb72640 1 -- 172.21.15.131:0/2254762234 shutdown_connections 2024-09-13T02:49:13.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:49:13.358+0000 7fe9dcb72640 1 -- 172.21.15.131:0/2254762234 wait complete. 2024-09-13T02:49:13.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:49:13.359+0000 7fe9dcb72640 1 Processor -- start 2024-09-13T02:49:13.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:49:13.359+0000 7fe9dcb72640 1 -- start start 2024-09-13T02:49:13.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:49:13.359+0000 7fe9dcb72640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe9d80fb420 0x7fe9d810fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:13.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:49:13.359+0000 7fe9dcb72640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe9d80fc6f0 0x7fe9d8112300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:13.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:49:13.359+0000 7fe9dcb72640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d80664f0 con 0x7fe9d80fb420 2024-09-13T02:49:13.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:49:13.359+0000 7fe9dcb72640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d8066660 con 0x7fe9d80fc6f0 2024-09-13T02:49:13.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:49:13.359+0000 7fe9d5d9b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe9d80fc6f0 0x7fe9d8112300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:13.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:49:13.359+0000 7fe9d5d9b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe9d80fc6f0 0x7fe9d8112300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:56038/0 (socket says 172.21.15.131:56038) 2024-09-13T02:49:13.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:49:13.359+0000 7fe9d5d9b640 1 -- 172.21.15.131:0/781547859 learned_addr learned my addr 172.21.15.131:0/781547859 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-09-13T02:49:13.378 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:49:13.359+0000 7fe9d659c640 1 --2- 172.21.15.131:0/781547859 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe9d80fb420 0x7fe9d810fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:13.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:49:13.359+0000 7fe9d5d9b640 1 -- 172.21.15.131:0/781547859 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe9d80fb420 msgr2=0x7fe9d810fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:13.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:49:13.359+0000 7fe9d5d9b640 1 --2- 172.21.15.131:0/781547859 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe9d80fb420 0x7fe9d810fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:13.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:49:13.359+0000 7fe9d5d9b640 1 -- 172.21.15.131:0/781547859 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9c8005040 con 0x7fe9d80fc6f0 2024-09-13T02:49:13.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:49:13.359+0000 7fe9d5d9b640 1 --2- 172.21.15.131:0/781547859 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe9d80fc6f0 0x7fe9d8112300 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc00eb70 tx=0x7fe9cc00b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:49:13.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:49:13.359+0000 7fe9c6ffd640 1 -- 172.21.15.131:0/781547859 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe9cc007c30 con 0x7fe9d80fc6f0 2024-09-13T02:49:13.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:49:13.359+0000 7fe9c6ffd640 1 -- 172.21.15.131:0/781547859 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe9cc00f040 con 0x7fe9d80fc6f0 2024-09-13T02:49:13.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:49:13.359+0000 7fe9dcb72640 1 -- 172.21.15.131:0/781547859 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9d8112840 con 0x7fe9d80fc6f0 2024-09-13T02:49:13.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:49:13.360+0000 7fe9c6ffd640 1 -- 172.21.15.131:0/781547859 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe9cc00ca60 con 0x7fe9d80fc6f0 2024-09-13T02:49:13.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:49:13.360+0000 7fe9dcb72640 1 -- 172.21.15.131:0/781547859 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9d8112db0 con 0x7fe9d80fc6f0 2024-09-13T02:49:13.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:49:13.361+0000 7fe9dcb72640 1 -- 172.21.15.131:0/781547859 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9d80fa880 con 0x7fe9d80fc6f0 2024-09-13T02:49:13.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:49:13.361+0000 7fe9c6ffd640 1 -- 172.21.15.131:0/781547859 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 18) v1 ==== 90811+0+0 (secure 0 0 0) 0x7fe9cc00cbc0 con 0x7fe9d80fc6f0 2024-09-13T02:49:13.379 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:49:13.361+0000 7fe9c6ffd640 1 --2- 172.21.15.131:0/781547859 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fe9c006ecc0 0x7fe9c0071170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:13.380 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:49:13.361+0000 7fe9c6ffd640 1 -- 172.21.15.131:0/781547859 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3228+0+0 (secure 0 0 0) 0x7fe9cc08d470 con 0x7fe9d80fc6f0 2024-09-13T02:49:13.380 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:49:13.362+0000 7fe9d659c640 1 --2- 172.21.15.131:0/781547859 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fe9c006ecc0 0x7fe9c0071170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:13.380 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:49:13.362+0000 7fe9d659c640 1 --2- 172.21.15.131:0/781547859 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fe9c006ecc0 0x7fe9c0071170 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe9c8000c00 tx=0x7fe9c8035040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:49:13.380 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:49:13.366+0000 7fe9c6ffd640 1 -- 172.21.15.131:0/781547859 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fe9cc05b0a0 con 0x7fe9d80fc6f0 2024-09-13T02:49:13.535 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 02:49:13 smithi089 sudo[64893]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-13T02:49:13.535 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 02:49:13 smithi089 sudo[64893]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T02:49:13.535 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 02:49:13 smithi089 sudo[64893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T02:49:13.535 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 02:49:13 smithi089 sudo[64893]: pam_unix(sudo:session): session closed for user root 2024-09-13T02:49:13.540 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:49:13.539+0000 7fe9dcb72640 1 -- 172.21.15.131:0/781547859 --> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi131:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7fe9d8100b00 con 0x7fe9c006ecc0 2024-09-13T02:49:13.620 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:49:13.618+0000 7fe9c6ffd640 1 -- 172.21.15.131:0/781547859 <== mon.1 v2:172.21.15.131:3300/0 7 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fe9cc057600 con 0x7fe9d80fc6f0 2024-09-13T02:49:13.830 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 02:49:13 smithi089 sudo[64983]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-13T02:49:13.830 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 02:49:13 smithi089 sudo[64983]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T02:49:13.830 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 02:49:13 smithi089 sudo[64983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T02:49:13.830 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 02:49:13 smithi089 sudo[64983]: pam_unix(sudo:session): session closed for user root 2024-09-13T02:49:13.830 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:13 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-13T02:49:13.830 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:13 smithi089 ceph-mon[27639]: osdmap e21: 3 total, 3 up, 3 in 2024-09-13T02:49:13.830 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:13 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:49:13.830 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:13 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:49:13.831 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:13 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:49:13.831 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:13 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:49:13.831 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:13 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:49:13.831 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:13 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:49:13.831 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:13 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:49:13.831 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:13 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:49:13.831 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:13 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:49:13.831 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:13 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:49:13.831 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:13 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:49:13.831 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:13 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T02:49:13.831 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:13 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T02:49:13.831 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:13 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:49:13.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:13 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-13T02:49:13.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:13 smithi131 ceph-mon[34689]: osdmap e21: 3 total, 3 up, 3 in 2024-09-13T02:49:13.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:13 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:49:13.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:13 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:49:13.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:13 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:49:13.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:13 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:49:13.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:13 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:49:13.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:13 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:49:13.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:13 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:49:13.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:13 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:49:13.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:13 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:49:13.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:13 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:49:13.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:13 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:49:13.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:13 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T02:49:13.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:13 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T02:49:13.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:13 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:49:14.083 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 02:49:13 smithi089 sudo[65049]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-13T02:49:14.084 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 02:49:13 smithi089 sudo[65049]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T02:49:14.084 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 02:49:13 smithi089 sudo[65049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T02:49:14.084 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 02:49:13 smithi089 sudo[65049]: pam_unix(sudo:session): session closed for user root 2024-09-13T02:49:14.347 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 02:49:14 smithi089 sudo[65069]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-13T02:49:14.347 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 02:49:14 smithi089 sudo[65069]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T02:49:14.347 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 02:49:14 smithi089 sudo[65069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T02:49:14.347 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 02:49:14 smithi089 sudo[65069]: pam_unix(sudo:session): session closed for user root 2024-09-13T02:49:14.603 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 02:49:14 smithi089 sudo[65094]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-13T02:49:14.603 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 02:49:14 smithi089 sudo[65094]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T02:49:14.603 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 02:49:14 smithi089 sudo[65094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T02:49:14.603 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 02:49:14 smithi089 sudo[65094]: pam_unix(sudo:session): session closed for user root 2024-09-13T02:49:14.860 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:14 smithi089 sudo[65156]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-13T02:49:14.860 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:14 smithi089 sudo[65156]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T02:49:14.860 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:14 smithi089 sudo[65156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T02:49:14.860 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:14 smithi089 sudo[65156]: pam_unix(sudo:session): session closed for user root 2024-09-13T02:49:15.131 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:14 smithi131 ceph-mon[34689]: pgmap v76: 1 pgs: 1 creating+peering; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-09-13T02:49:15.131 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:14 smithi131 ceph-mon[34689]: Detected new or changed devices on smithi089 2024-09-13T02:49:15.131 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:14 smithi131 ceph-mon[34689]: Adjusting osd_memory_target on smithi089 to 4287M 2024-09-13T02:49:15.131 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:14 smithi131 ceph-mon[34689]: from='client.24127 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi131:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:49:15.131 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:14 smithi131 ceph-mon[34689]: osdmap e22: 3 total, 3 up, 3 in 2024-09-13T02:49:15.131 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:14 smithi131 ceph-mon[34689]: mgrmap e19: smithi089.guohvs(active, since 2m), standbys: smithi131.aunbqd 2024-09-13T02:49:15.131 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:14 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:49:15.131 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:14 smithi131 ceph-mon[34689]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-13T02:49:15.131 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:15 smithi131 sudo[38027]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-13T02:49:15.131 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:15 smithi131 sudo[38027]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T02:49:15.131 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:15 smithi131 sudo[38027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T02:49:15.131 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:15 smithi131 sudo[38027]: pam_unix(sudo:session): session closed for user root 2024-09-13T02:49:15.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:14 smithi089 sudo[65178]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-13T02:49:15.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:14 smithi089 sudo[65178]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T02:49:15.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:14 smithi089 sudo[65178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T02:49:15.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:14 smithi089 sudo[65178]: pam_unix(sudo:session): session closed for user root 2024-09-13T02:49:15.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:14 smithi089 ceph-mon[27639]: pgmap v76: 1 pgs: 1 creating+peering; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-09-13T02:49:15.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:14 smithi089 ceph-mon[27639]: Detected new or changed devices on smithi089 2024-09-13T02:49:15.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:14 smithi089 ceph-mon[27639]: Adjusting osd_memory_target on smithi089 to 4287M 2024-09-13T02:49:15.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:14 smithi089 ceph-mon[27639]: from='client.24127 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi131:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:49:15.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:14 smithi089 ceph-mon[27639]: osdmap e22: 3 total, 3 up, 3 in 2024-09-13T02:49:15.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:14 smithi089 ceph-mon[27639]: mgrmap e19: smithi089.guohvs(active, since 2m), standbys: smithi131.aunbqd 2024-09-13T02:49:15.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:14 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:49:15.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:14 smithi089 ceph-mon[27639]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-13T02:49:15.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:15 smithi131 sudo[38038]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-13T02:49:15.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:15 smithi131 sudo[38038]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-13T02:49:15.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:15 smithi131 sudo[38038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-13T02:49:15.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:15 smithi131 sudo[38038]: pam_unix(sudo:session): session closed for user root 2024-09-13T02:49:16.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:15 smithi131 ceph-mon[34689]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-13T02:49:16.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:15 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mon metadata", "id": "smithi089"}]: dispatch 2024-09-13T02:49:16.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:15 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mon metadata", "id": "smithi131"}]: dispatch 2024-09-13T02:49:16.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:15 smithi131 ceph-mon[34689]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-13T02:49:16.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:15 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mon metadata", "id": "smithi089"}]: dispatch 2024-09-13T02:49:16.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:15 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mon metadata", "id": "smithi131"}]: dispatch 2024-09-13T02:49:16.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:15 smithi131 ceph-mon[34689]: pgmap v78: 1 pgs: 1 creating+peering; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-09-13T02:49:16.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:15 smithi131 ceph-mon[34689]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-13T02:49:16.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:15 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:49:16.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:15 smithi131 ceph-mon[34689]: from='client.? 172.21.15.131:0/2475992857' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9f04f440-e9b7-422d-9b56-1cee78aa76a3"}]: dispatch 2024-09-13T02:49:16.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:15 smithi131 ceph-mon[34689]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9f04f440-e9b7-422d-9b56-1cee78aa76a3"}]: dispatch 2024-09-13T02:49:16.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:15 smithi131 ceph-mon[34689]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9f04f440-e9b7-422d-9b56-1cee78aa76a3"}]': finished 2024-09-13T02:49:16.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:15 smithi131 ceph-mon[34689]: osdmap e23: 4 total, 3 up, 4 in 2024-09-13T02:49:16.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:15 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T02:49:16.248 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:15 smithi089 ceph-mon[27639]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-13T02:49:16.248 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:15 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mon metadata", "id": "smithi089"}]: dispatch 2024-09-13T02:49:16.249 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:15 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mon metadata", "id": "smithi131"}]: dispatch 2024-09-13T02:49:16.249 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:15 smithi089 ceph-mon[27639]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-13T02:49:16.249 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:15 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mon metadata", "id": "smithi089"}]: dispatch 2024-09-13T02:49:16.249 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:15 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mon metadata", "id": "smithi131"}]: dispatch 2024-09-13T02:49:16.249 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:15 smithi089 ceph-mon[27639]: pgmap v78: 1 pgs: 1 creating+peering; 0 B data, 872 MiB used, 267 GiB / 268 GiB avail 2024-09-13T02:49:16.249 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:15 smithi089 ceph-mon[27639]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-13T02:49:16.249 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:15 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:49:16.249 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:15 smithi089 ceph-mon[27639]: from='client.? 172.21.15.131:0/2475992857' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9f04f440-e9b7-422d-9b56-1cee78aa76a3"}]: dispatch 2024-09-13T02:49:16.249 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:15 smithi089 ceph-mon[27639]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9f04f440-e9b7-422d-9b56-1cee78aa76a3"}]: dispatch 2024-09-13T02:49:16.249 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:15 smithi089 ceph-mon[27639]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9f04f440-e9b7-422d-9b56-1cee78aa76a3"}]': finished 2024-09-13T02:49:16.249 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:15 smithi089 ceph-mon[27639]: osdmap e23: 4 total, 3 up, 4 in 2024-09-13T02:49:16.249 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:15 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T02:49:17.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:16 smithi089 ceph-mon[27639]: from='client.? 172.21.15.131:0/977261045' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T02:49:17.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:16 smithi131 ceph-mon[34689]: from='client.? 172.21.15.131:0/977261045' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T02:49:18.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:18 smithi131 ceph-mon[34689]: pgmap v80: 1 pgs: 1 creating+peering; 0 B data, 873 MiB used, 267 GiB / 268 GiB avail 2024-09-13T02:49:18.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:18 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:49:18.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:18 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:49:18.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:18 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:49:18.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:18 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:49:18.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:18 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:49:18.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:18 smithi089 ceph-mon[27639]: pgmap v80: 1 pgs: 1 creating+peering; 0 B data, 873 MiB used, 267 GiB / 268 GiB avail 2024-09-13T02:49:18.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:18 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:49:18.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:18 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:49:18.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:18 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:49:18.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:18 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:49:18.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:18 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:49:20.652 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:20 smithi131 ceph-mon[34689]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-13T02:49:20.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:20 smithi089 ceph-mon[27639]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-13T02:49:22.640 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:22 smithi131 ceph-mon[34689]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-13T02:49:22.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:22 smithi089 ceph-mon[27639]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-13T02:49:23.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:23 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-13T02:49:23.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:23 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:49:23.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:23 smithi131 ceph-mon[34689]: Deploying daemon osd.3 on smithi131 2024-09-13T02:49:23.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:23 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-13T02:49:23.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:23 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:49:23.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:23 smithi089 ceph-mon[27639]: Deploying daemon osd.3 on smithi131 2024-09-13T02:49:24.387 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:24 smithi131 ceph-mon[34689]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-13T02:49:24.686 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:24 smithi089 ceph-mon[27639]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-13T02:49:26.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:26 smithi089 ceph-mon[27639]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-13T02:49:26.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:26 smithi131 ceph-mon[34689]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-13T02:49:27.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:27 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:49:27.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:27 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:49:27.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:27 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:49:27.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:27 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:49:27.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:27 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:49:27.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:27 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:49:28.672 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:28 smithi131 ceph-mon[34689]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-13T02:49:28.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:28 smithi089 ceph-mon[27639]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-13T02:49:29.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:29 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:49:29.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:29 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:49:30.660 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:30 smithi131 ceph-mon[34689]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-13T02:49:30.697 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:49:30.694+0000 7fe9c6ffd640 1 -- 172.21.15.131:0/781547859 <== mgr.14204 v2:172.21.15.89:6800/1506060926 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fe9d8100b00 con 0x7fe9c006ecc0 2024-09-13T02:49:30.697 INFO:teuthology.orchestra.run.smithi131.stdout:Created osd(s) 3 on host 'smithi131' 2024-09-13T02:49:30.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:49:30.697+0000 7fe9dcb72640 1 -- 172.21.15.131:0/781547859 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fe9c006ecc0 msgr2=0x7fe9c0071170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:30.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:49:30.697+0000 7fe9dcb72640 1 --2- 172.21.15.131:0/781547859 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fe9c006ecc0 0x7fe9c0071170 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe9c8000c00 tx=0x7fe9c8035040 comp rx=0 tx=0).stop 2024-09-13T02:49:30.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:49:30.697+0000 7fe9dcb72640 1 -- 172.21.15.131:0/781547859 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe9d80fc6f0 msgr2=0x7fe9d8112300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:30.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:49:30.697+0000 7fe9dcb72640 1 --2- 172.21.15.131:0/781547859 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe9d80fc6f0 0x7fe9d8112300 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc00eb70 tx=0x7fe9cc00b040 comp rx=0 tx=0).stop 2024-09-13T02:49:30.699 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:49:30.697+0000 7fe9dcb72640 1 -- 172.21.15.131:0/781547859 shutdown_connections 2024-09-13T02:49:30.700 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:49:30.697+0000 7fe9dcb72640 1 --2- 172.21.15.131:0/781547859 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fe9c006ecc0 0x7fe9c0071170 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:30.700 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:49:30.697+0000 7fe9dcb72640 1 --2- 172.21.15.131:0/781547859 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe9d80fc6f0 0x7fe9d8112300 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:30.700 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:49:30.697+0000 7fe9dcb72640 1 --2- 172.21.15.131:0/781547859 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe9d80fb420 0x7fe9d810fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:30.700 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:49:30.697+0000 7fe9dcb72640 1 -- 172.21.15.131:0/781547859 >> 172.21.15.131:0/781547859 conn(0x7fe9d80f6c00 msgr2=0x7fe9d80f83a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:49:30.700 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:49:30.697+0000 7fe9dcb72640 1 -- 172.21.15.131:0/781547859 shutdown_connections 2024-09-13T02:49:30.700 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:49:30.697+0000 7fe9dcb72640 1 -- 172.21.15.131:0/781547859 wait complete. 2024-09-13T02:49:30.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:30 smithi089 ceph-mon[27639]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-13T02:49:31.331 DEBUG:teuthology.orchestra.run.smithi131:osd.3> sudo journalctl -f -n 0 -u ceph-12cdb164-717a-11ef-bceb-c7b262605968@osd.3.service 2024-09-13T02:49:31.333 INFO:tasks.cephadm:Deploying osd.4 on smithi131 with /dev/vg_nvme/lv_3... 2024-09-13T02:49:31.334 DEBUG:teuthology.orchestra.run.smithi131:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-13T02:49:31.700 INFO:teuthology.orchestra.run.smithi131.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/mon.smithi131/config 2024-09-13T02:49:31.946 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:31 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:49:31.946 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:31 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:49:31.946 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:31 smithi131 ceph-mon[34689]: from='osd.3 [v2:172.21.15.131:6800/2299999552,v1:172.21.15.131:6801/2299999552]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-13T02:49:31.947 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:31 smithi131 ceph-mon[34689]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-13T02:49:32.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:31 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:49:32.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:31 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:49:32.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:31 smithi089 ceph-mon[27639]: from='osd.3 [v2:172.21.15.131:6800/2299999552,v1:172.21.15.131:6801/2299999552]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-13T02:49:32.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:31 smithi089 ceph-mon[27639]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-13T02:49:32.846 INFO:journalctl@ceph.osd.3.smithi131.stdout:Sep 13 02:49:32 smithi131 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-3[40147]: 2024-09-13T02:49:32.711+0000 7efc2816b640 -1 osd.3 0 waiting for initial osdmap 2024-09-13T02:49:32.846 INFO:journalctl@ceph.osd.3.smithi131.stdout:Sep 13 02:49:32 smithi131 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-3[40147]: 2024-09-13T02:49:32.718+0000 7efc22fa2640 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T02:49:32.846 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:32 smithi131 ceph-mon[34689]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-13T02:49:32.846 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:32 smithi131 ceph-mon[34689]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-13T02:49:32.847 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:32 smithi131 ceph-mon[34689]: osdmap e24: 4 total, 3 up, 4 in 2024-09-13T02:49:32.847 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:32 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T02:49:32.847 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:32 smithi131 ceph-mon[34689]: from='osd.3 [v2:172.21.15.131:6800/2299999552,v1:172.21.15.131:6801/2299999552]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]: dispatch 2024-09-13T02:49:32.847 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:32 smithi131 ceph-mon[34689]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]: dispatch 2024-09-13T02:49:32.847 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:32 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:49:32.847 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:32 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:49:33.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:32 smithi089 ceph-mon[27639]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-13T02:49:33.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:32 smithi089 ceph-mon[27639]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-13T02:49:33.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:32 smithi089 ceph-mon[27639]: osdmap e24: 4 total, 3 up, 4 in 2024-09-13T02:49:33.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:32 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T02:49:33.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:32 smithi089 ceph-mon[27639]: from='osd.3 [v2:172.21.15.131:6800/2299999552,v1:172.21.15.131:6801/2299999552]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]: dispatch 2024-09-13T02:49:33.037 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:32 smithi089 ceph-mon[27639]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]: dispatch 2024-09-13T02:49:33.037 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:32 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:49:33.037 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:32 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:49:34.011 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:33 smithi131 ceph-mon[34689]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]': finished 2024-09-13T02:49:34.011 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:33 smithi131 ceph-mon[34689]: osdmap e25: 4 total, 3 up, 4 in 2024-09-13T02:49:34.011 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:33 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T02:49:34.011 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:33 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T02:49:34.012 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:33 smithi131 ceph-mon[34689]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-13T02:49:34.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:33 smithi089 ceph-mon[27639]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]': finished 2024-09-13T02:49:34.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:33 smithi089 ceph-mon[27639]: osdmap e25: 4 total, 3 up, 4 in 2024-09-13T02:49:34.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:33 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T02:49:34.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:33 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T02:49:34.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:33 smithi089 ceph-mon[27639]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 874 MiB used, 267 GiB / 268 GiB avail 2024-09-13T02:49:34.806 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:34 smithi131 ceph-mon[34689]: purged_snaps scrub starts 2024-09-13T02:49:34.806 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:34 smithi131 ceph-mon[34689]: purged_snaps scrub ok 2024-09-13T02:49:34.806 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:34 smithi131 ceph-mon[34689]: osd.3 [v2:172.21.15.131:6800/2299999552,v1:172.21.15.131:6801/2299999552] boot 2024-09-13T02:49:34.806 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:34 smithi131 ceph-mon[34689]: osdmap e26: 4 total, 4 up, 4 in 2024-09-13T02:49:34.806 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:34 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T02:49:34.811 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-13T02:49:34.831 DEBUG:teuthology.orchestra.run.smithi131:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi131:vg_nvme/lv_3 2024-09-13T02:49:35.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:34 smithi089 ceph-mon[27639]: purged_snaps scrub starts 2024-09-13T02:49:35.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:34 smithi089 ceph-mon[27639]: purged_snaps scrub ok 2024-09-13T02:49:35.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:34 smithi089 ceph-mon[27639]: osd.3 [v2:172.21.15.131:6800/2299999552,v1:172.21.15.131:6801/2299999552] boot 2024-09-13T02:49:35.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:34 smithi089 ceph-mon[27639]: osdmap e26: 4 total, 4 up, 4 in 2024-09-13T02:49:35.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:34 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T02:49:35.396 INFO:teuthology.orchestra.run.smithi131.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/mon.smithi131/config 2024-09-13T02:49:35.805 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:35 smithi131 ceph-mon[34689]: osdmap e27: 4 total, 4 up, 4 in 2024-09-13T02:49:35.805 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:35 smithi131 ceph-mon[34689]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-13T02:49:36.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:35 smithi089 ceph-mon[27639]: osdmap e27: 4 total, 4 up, 4 in 2024-09-13T02:49:36.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:35 smithi089 ceph-mon[27639]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-13T02:49:37.018 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:36 smithi131 ceph-mon[34689]: osdmap e28: 4 total, 4 up, 4 in 2024-09-13T02:49:37.018 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:36 smithi131 ceph-mon[34689]: Detected new or changed devices on smithi131 2024-09-13T02:49:37.018 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:36 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:49:37.018 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:36 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:49:37.018 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:36 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:49:37.018 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:36 smithi131 ceph-mon[34689]: Adjusting osd_memory_target on smithi131 to 15936M 2024-09-13T02:49:37.018 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:36 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:49:37.018 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:36 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:49:37.019 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:36 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:49:37.019 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:36 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:49:37.019 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:36 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:49:37.019 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:36 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:49:37.019 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:36 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:49:37.019 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:36 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:49:37.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:36 smithi089 ceph-mon[27639]: osdmap e28: 4 total, 4 up, 4 in 2024-09-13T02:49:37.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:36 smithi089 ceph-mon[27639]: Detected new or changed devices on smithi131 2024-09-13T02:49:37.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:36 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:49:37.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:36 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:49:37.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:36 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:49:37.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:36 smithi089 ceph-mon[27639]: Adjusting osd_memory_target on smithi131 to 15936M 2024-09-13T02:49:37.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:36 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:49:37.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:36 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:49:37.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:36 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:49:37.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:36 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:49:37.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:36 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:49:37.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:36 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:49:37.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:36 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:49:37.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:36 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:49:37.650 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:49:37.644+0000 7f3429a5e640 1 -- 172.21.15.131:0/1301847779 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f34240fd820 msgr2=0x7f34240fdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:37.650 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:49:37.644+0000 7f3429a5e640 1 --2- 172.21.15.131:0/1301847779 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f34240fd820 0x7f34240fdc90 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f340c0048d0 tx=0x7f340c009da0 comp rx=0 tx=0).stop 2024-09-13T02:49:37.650 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:49:37.644+0000 7f3429a5e640 1 -- 172.21.15.131:0/1301847779 shutdown_connections 2024-09-13T02:49:37.650 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:49:37.644+0000 7f3429a5e640 1 --2- 172.21.15.131:0/1301847779 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f34240fd820 0x7f34240fdc90 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:37.650 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:49:37.644+0000 7f3429a5e640 1 --2- 172.21.15.131:0/1301847779 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34240fc550 0x7f34240fc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:37.650 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:49:37.644+0000 7f3429a5e640 1 -- 172.21.15.131:0/1301847779 >> 172.21.15.131:0/1301847779 conn(0x7f34240f7d30 msgr2=0x7f34240fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:49:37.650 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:49:37.644+0000 7f3429a5e640 1 -- 172.21.15.131:0/1301847779 shutdown_connections 2024-09-13T02:49:37.650 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:49:37.644+0000 7f3429a5e640 1 -- 172.21.15.131:0/1301847779 wait complete. 2024-09-13T02:49:37.650 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:49:37.645+0000 7f3429a5e640 1 Processor -- start 2024-09-13T02:49:37.650 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:49:37.645+0000 7f3429a5e640 1 -- start start 2024-09-13T02:49:37.651 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:49:37.645+0000 7f3429a5e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34240fc550 0x7f342410d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:37.651 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:49:37.645+0000 7f3429a5e640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f34240fd820 0x7f342410d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:37.651 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:49:37.645+0000 7f3429a5e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f342410dc00 con 0x7f34240fc550 2024-09-13T02:49:37.651 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:49:37.645+0000 7f3429a5e640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f342410e420 con 0x7f34240fd820 2024-09-13T02:49:37.651 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:49:37.645+0000 7f341bfff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f34240fd820 0x7f342410d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:37.651 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:49:37.645+0000 7f341bfff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f34240fd820 0x7f342410d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:53274/0 (socket says 172.21.15.131:53274) 2024-09-13T02:49:37.651 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:49:37.645+0000 7f341bfff640 1 -- 172.21.15.131:0/1550819931 learned_addr learned my addr 172.21.15.131:0/1550819931 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-09-13T02:49:37.651 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:49:37.645+0000 7f3422ffd640 1 --2- 172.21.15.131:0/1550819931 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34240fc550 0x7f342410d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:37.651 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:49:37.645+0000 7f341bfff640 1 -- 172.21.15.131:0/1550819931 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34240fc550 msgr2=0x7f342410d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:37.651 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:49:37.645+0000 7f341bfff640 1 --2- 172.21.15.131:0/1550819931 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34240fc550 0x7f342410d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:37.651 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:49:37.645+0000 7f341bfff640 1 -- 172.21.15.131:0/1550819931 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f340c005040 con 0x7f34240fd820 2024-09-13T02:49:37.651 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:49:37.645+0000 7f341bfff640 1 --2- 172.21.15.131:0/1550819931 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f34240fd820 0x7f342410d5b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f340c0043d0 tx=0x7f340c009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:49:37.652 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:49:37.646+0000 7f341b7fe640 1 -- 172.21.15.131:0/1550819931 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f340c038070 con 0x7f34240fd820 2024-09-13T02:49:37.652 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:49:37.646+0000 7f341b7fe640 1 -- 172.21.15.131:0/1550819931 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f340c02ae90 con 0x7f34240fd820 2024-09-13T02:49:37.652 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:49:37.646+0000 7f3429a5e640 1 -- 172.21.15.131:0/1550819931 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f342410e650 con 0x7f34240fd820 2024-09-13T02:49:37.652 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:49:37.646+0000 7f341b7fe640 1 -- 172.21.15.131:0/1550819931 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f340c03e670 con 0x7f34240fd820 2024-09-13T02:49:37.652 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:49:37.646+0000 7f3429a5e640 1 -- 172.21.15.131:0/1550819931 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f342410ebf0 con 0x7f34240fd820 2024-09-13T02:49:37.652 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:49:37.647+0000 7f3429a5e640 1 -- 172.21.15.131:0/1550819931 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34240fb9b0 con 0x7f34240fd820 2024-09-13T02:49:37.652 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:49:37.647+0000 7f341b7fe640 1 -- 172.21.15.131:0/1550819931 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f340c030020 con 0x7f34240fd820 2024-09-13T02:49:37.652 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:49:37.648+0000 7f341b7fe640 1 --2- 172.21.15.131:0/1550819931 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f341006ed60 0x7f3410071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:49:37.652 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:49:37.648+0000 7f341b7fe640 1 -- 172.21.15.131:0/1550819931 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 3770+0+0 (secure 0 0 0) 0x7f340c0adc10 con 0x7f34240fd820 2024-09-13T02:49:37.652 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:49:37.648+0000 7f3422ffd640 1 --2- 172.21.15.131:0/1550819931 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f341006ed60 0x7f3410071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:49:37.652 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:49:37.649+0000 7f3422ffd640 1 --2- 172.21.15.131:0/1550819931 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f341006ed60 0x7f3410071210 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3414004eb0 tx=0x7f341400b040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:49:37.653 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:49:37.652+0000 7f341b7fe640 1 -- 172.21.15.131:0/1550819931 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f340c07b500 con 0x7f34240fd820 2024-09-13T02:49:37.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:37 smithi089 ceph-mon[27639]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-13T02:49:37.818 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:49:37.816+0000 7f3429a5e640 1 -- 172.21.15.131:0/1550819931 --> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi131:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f342410ef70 con 0x7f341006ed60 2024-09-13T02:49:38.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:37 smithi131 ceph-mon[34689]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-13T02:49:38.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:38 smithi131 ceph-mon[34689]: from='client.24147 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi131:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:49:38.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:38 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T02:49:38.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:38 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T02:49:38.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:38 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:49:39.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:38 smithi089 ceph-mon[27639]: from='client.24147 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi131:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:49:39.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:38 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T02:49:39.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:38 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T02:49:39.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:38 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:49:40.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:39 smithi089 ceph-mon[27639]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-13T02:49:40.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:39 smithi131 ceph-mon[34689]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-13T02:49:41.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:40 smithi089 ceph-mon[27639]: from='client.? 172.21.15.131:0/2028496146' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c7fcc566-b36d-4f22-ad23-784464e91d2c"}]: dispatch 2024-09-13T02:49:41.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:40 smithi089 ceph-mon[27639]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c7fcc566-b36d-4f22-ad23-784464e91d2c"}]: dispatch 2024-09-13T02:49:41.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:40 smithi089 ceph-mon[27639]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c7fcc566-b36d-4f22-ad23-784464e91d2c"}]': finished 2024-09-13T02:49:41.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:40 smithi089 ceph-mon[27639]: osdmap e29: 5 total, 4 up, 5 in 2024-09-13T02:49:41.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:40 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T02:49:41.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:40 smithi089 ceph-mon[27639]: from='client.? 172.21.15.131:0/2717669642' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T02:49:41.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:40 smithi131 ceph-mon[34689]: from='client.? 172.21.15.131:0/2028496146' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c7fcc566-b36d-4f22-ad23-784464e91d2c"}]: dispatch 2024-09-13T02:49:41.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:40 smithi131 ceph-mon[34689]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c7fcc566-b36d-4f22-ad23-784464e91d2c"}]: dispatch 2024-09-13T02:49:41.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:40 smithi131 ceph-mon[34689]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c7fcc566-b36d-4f22-ad23-784464e91d2c"}]': finished 2024-09-13T02:49:41.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:40 smithi131 ceph-mon[34689]: osdmap e29: 5 total, 4 up, 5 in 2024-09-13T02:49:41.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:40 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T02:49:41.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:40 smithi131 ceph-mon[34689]: from='client.? 172.21.15.131:0/2717669642' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T02:49:42.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:41 smithi089 ceph-mon[27639]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-09-13T02:49:42.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:41 smithi131 ceph-mon[34689]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 92 KiB/s, 0 objects/s recovering 2024-09-13T02:49:44.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:44 smithi131 ceph-mon[34689]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-13T02:49:44.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:44 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:49:44.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:44 smithi089 ceph-mon[27639]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-13T02:49:44.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:44 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:49:46.170 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:46 smithi131 ceph-mon[34689]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-13T02:49:46.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:46 smithi089 ceph-mon[27639]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 62 KiB/s, 0 objects/s recovering 2024-09-13T02:49:48.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:48 smithi089 ceph-mon[27639]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-13T02:49:48.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:48 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-13T02:49:48.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:48 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:49:48.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:48 smithi089 ceph-mon[27639]: Deploying daemon osd.4 on smithi131 2024-09-13T02:49:48.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:48 smithi131 ceph-mon[34689]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-13T02:49:48.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:48 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-13T02:49:48.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:48 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:49:48.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:48 smithi131 ceph-mon[34689]: Deploying daemon osd.4 on smithi131 2024-09-13T02:49:50.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:50 smithi131 ceph-mon[34689]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-13T02:49:50.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:50 smithi089 ceph-mon[27639]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-13T02:49:52.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:52 smithi131 ceph-mon[34689]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-13T02:49:52.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:52 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:49:52.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:52 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:49:52.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:52 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:49:52.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:52 smithi089 ceph-mon[27639]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-13T02:49:52.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:52 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:49:52.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:52 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:49:52.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:52 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:49:54.128 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:54 smithi131 ceph-mon[34689]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-13T02:49:54.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:54 smithi089 ceph-mon[27639]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-13T02:49:54.532 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:49:54.531+0000 7f341b7fe640 1 -- 172.21.15.131:0/1550819931 <== mgr.14204 v2:172.21.15.89:6800/1506060926 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f342410ef70 con 0x7f341006ed60 2024-09-13T02:49:54.532 INFO:teuthology.orchestra.run.smithi131.stdout:Created osd(s) 4 on host 'smithi131' 2024-09-13T02:49:54.534 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:49:54.533+0000 7f3429a5e640 1 -- 172.21.15.131:0/1550819931 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f341006ed60 msgr2=0x7f3410071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:54.534 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:49:54.533+0000 7f3429a5e640 1 --2- 172.21.15.131:0/1550819931 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f341006ed60 0x7f3410071210 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f3414004eb0 tx=0x7f341400b040 comp rx=0 tx=0).stop 2024-09-13T02:49:54.534 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:49:54.533+0000 7f3429a5e640 1 -- 172.21.15.131:0/1550819931 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f34240fd820 msgr2=0x7f342410d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:49:54.534 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:49:54.533+0000 7f3429a5e640 1 --2- 172.21.15.131:0/1550819931 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f34240fd820 0x7f342410d5b0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f340c0043d0 tx=0x7f340c009da0 comp rx=0 tx=0).stop 2024-09-13T02:49:54.534 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:49:54.533+0000 7f3429a5e640 1 -- 172.21.15.131:0/1550819931 shutdown_connections 2024-09-13T02:49:54.534 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:49:54.533+0000 7f3429a5e640 1 --2- 172.21.15.131:0/1550819931 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f341006ed60 0x7f3410071210 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:54.535 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:49:54.533+0000 7f3429a5e640 1 --2- 172.21.15.131:0/1550819931 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f34240fd820 0x7f342410d5b0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:54.535 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:49:54.533+0000 7f3429a5e640 1 --2- 172.21.15.131:0/1550819931 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f34240fc550 0x7f342410d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:49:54.535 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:49:54.533+0000 7f3429a5e640 1 -- 172.21.15.131:0/1550819931 >> 172.21.15.131:0/1550819931 conn(0x7f34240f7d30 msgr2=0x7f34240f9480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:49:54.535 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:49:54.533+0000 7f3429a5e640 1 -- 172.21.15.131:0/1550819931 shutdown_connections 2024-09-13T02:49:54.535 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:49:54.533+0000 7f3429a5e640 1 -- 172.21.15.131:0/1550819931 wait complete. 2024-09-13T02:49:55.141 DEBUG:teuthology.orchestra.run.smithi131:osd.4> sudo journalctl -f -n 0 -u ceph-12cdb164-717a-11ef-bceb-c7b262605968@osd.4.service 2024-09-13T02:49:55.143 INFO:tasks.cephadm:Deploying osd.5 on smithi131 with /dev/vg_nvme/lv_2... 2024-09-13T02:49:55.144 DEBUG:teuthology.orchestra.run.smithi131:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-13T02:49:55.667 INFO:teuthology.orchestra.run.smithi131.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/mon.smithi131/config 2024-09-13T02:49:55.683 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:55 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:49:55.683 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:55 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:49:55.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:55 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:49:55.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:55 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:49:56.122 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 13 02:49:55 smithi131 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-4[46513]: 2024-09-13T02:49:55.818+0000 7fe720f86440 -1 osd.4 0 log_to_monitors true 2024-09-13T02:49:56.928 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:56 smithi131 ceph-mon[34689]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-13T02:49:56.928 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:56 smithi131 ceph-mon[34689]: from='osd.4 [v2:172.21.15.131:6808/3134834192,v1:172.21.15.131:6809/3134834192]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T02:49:56.928 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:56 smithi131 ceph-mon[34689]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T02:49:57.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:56 smithi089 ceph-mon[27639]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-13T02:49:57.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:56 smithi089 ceph-mon[27639]: from='osd.4 [v2:172.21.15.131:6808/3134834192,v1:172.21.15.131:6809/3134834192]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T02:49:57.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:56 smithi089 ceph-mon[27639]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T02:49:57.766 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 13 02:49:57 smithi131 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-4[46513]: 2024-09-13T02:49:57.547+0000 7fe71c6f8640 -1 osd.4 0 waiting for initial osdmap 2024-09-13T02:49:57.766 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 13 02:49:57 smithi131 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-4[46513]: 2024-09-13T02:49:57.555+0000 7fe71752f640 -1 osd.4 31 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T02:49:57.767 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:57 smithi131 ceph-mon[34689]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-13T02:49:57.767 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:57 smithi131 ceph-mon[34689]: osdmap e30: 5 total, 4 up, 5 in 2024-09-13T02:49:57.767 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:57 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T02:49:57.767 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:57 smithi131 ceph-mon[34689]: from='osd.4 [v2:172.21.15.131:6808/3134834192,v1:172.21.15.131:6809/3134834192]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]: dispatch 2024-09-13T02:49:57.767 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:57 smithi131 ceph-mon[34689]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]: dispatch 2024-09-13T02:49:57.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:57 smithi089 ceph-mon[27639]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-13T02:49:57.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:57 smithi089 ceph-mon[27639]: osdmap e30: 5 total, 4 up, 5 in 2024-09-13T02:49:57.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:57 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T02:49:57.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:57 smithi089 ceph-mon[27639]: from='osd.4 [v2:172.21.15.131:6808/3134834192,v1:172.21.15.131:6809/3134834192]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]: dispatch 2024-09-13T02:49:57.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:57 smithi089 ceph-mon[27639]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]: dispatch 2024-09-13T02:49:58.701 INFO:teuthology.orchestra.run.smithi131.stdout: 2024-09-13T02:49:58.720 DEBUG:teuthology.orchestra.run.smithi131:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi131:vg_nvme/lv_2 2024-09-13T02:49:58.744 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:58 smithi131 ceph-mon[34689]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-13T02:49:58.745 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:58 smithi131 ceph-mon[34689]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]': finished 2024-09-13T02:49:58.745 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:58 smithi131 ceph-mon[34689]: osdmap e31: 5 total, 4 up, 5 in 2024-09-13T02:49:58.745 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:58 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T02:49:58.745 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:58 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T02:49:58.745 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:58 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:49:58.745 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:58 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:49:59.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:58 smithi089 ceph-mon[27639]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-09-13T02:49:59.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:58 smithi089 ceph-mon[27639]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]': finished 2024-09-13T02:49:59.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:58 smithi089 ceph-mon[27639]: osdmap e31: 5 total, 4 up, 5 in 2024-09-13T02:49:59.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:58 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T02:49:59.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:58 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T02:49:59.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:58 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:49:59.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:58 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:49:59.777 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:59 smithi131 ceph-mon[34689]: purged_snaps scrub starts 2024-09-13T02:49:59.777 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:59 smithi131 ceph-mon[34689]: purged_snaps scrub ok 2024-09-13T02:49:59.778 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:59 smithi131 ceph-mon[34689]: osd.4 [v2:172.21.15.131:6808/3134834192,v1:172.21.15.131:6809/3134834192] boot 2024-09-13T02:49:59.778 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:59 smithi131 ceph-mon[34689]: osdmap e32: 5 total, 5 up, 5 in 2024-09-13T02:49:59.778 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:59 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T02:49:59.778 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:49:59 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:49:59.811 INFO:teuthology.orchestra.run.smithi131.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/mon.smithi131/config 2024-09-13T02:50:00.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:59 smithi089 ceph-mon[27639]: purged_snaps scrub starts 2024-09-13T02:50:00.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:59 smithi089 ceph-mon[27639]: purged_snaps scrub ok 2024-09-13T02:50:00.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:59 smithi089 ceph-mon[27639]: osd.4 [v2:172.21.15.131:6808/3134834192,v1:172.21.15.131:6809/3134834192] boot 2024-09-13T02:50:00.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:59 smithi089 ceph-mon[27639]: osdmap e32: 5 total, 5 up, 5 in 2024-09-13T02:50:00.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:59 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T02:50:00.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:49:59 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:50:00.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:00 smithi131 ceph-mon[34689]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-13T02:50:00.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:00 smithi131 ceph-mon[34689]: osdmap e33: 5 total, 5 up, 5 in 2024-09-13T02:50:00.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:00 smithi131 ceph-mon[34689]: overall HEALTH_OK 2024-09-13T02:50:01.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:00 smithi089 ceph-mon[27639]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-13T02:50:01.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:00 smithi089 ceph-mon[27639]: osdmap e33: 5 total, 5 up, 5 in 2024-09-13T02:50:01.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:00 smithi089 ceph-mon[27639]: overall HEALTH_OK 2024-09-13T02:50:02.463 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:50:02.441+0000 7fdd542fd640 1 -- 172.21.15.131:0/1861746447 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdd4c0fb450 msgr2=0x7fdd4c0fb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:02.463 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:50:02.441+0000 7fdd542fd640 1 --2- 172.21.15.131:0/1861746447 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdd4c0fb450 0x7fdd4c0fb860 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fdd480048d0 tx=0x7fdd48009da0 comp rx=0 tx=0).stop 2024-09-13T02:50:02.463 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:50:02.441+0000 7fdd542fd640 1 -- 172.21.15.131:0/1861746447 shutdown_connections 2024-09-13T02:50:02.463 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:50:02.441+0000 7fdd542fd640 1 --2- 172.21.15.131:0/1861746447 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdd4c0fc720 0x7fdd4c0fcb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:02.463 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:50:02.441+0000 7fdd542fd640 1 --2- 172.21.15.131:0/1861746447 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdd4c0fb450 0x7fdd4c0fb860 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:02.464 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:50:02.441+0000 7fdd542fd640 1 -- 172.21.15.131:0/1861746447 >> 172.21.15.131:0/1861746447 conn(0x7fdd4c0f6c10 msgr2=0x7fdd4c0f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:50:02.464 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:50:02.441+0000 7fdd542fd640 1 -- 172.21.15.131:0/1861746447 shutdown_connections 2024-09-13T02:50:02.464 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:50:02.441+0000 7fdd542fd640 1 -- 172.21.15.131:0/1861746447 wait complete. 2024-09-13T02:50:02.464 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:50:02.442+0000 7fdd542fd640 1 Processor -- start 2024-09-13T02:50:02.464 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:50:02.442+0000 7fdd542fd640 1 -- start start 2024-09-13T02:50:02.464 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:50:02.442+0000 7fdd542fd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdd4c0fb450 0x7fdd4c10d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:02.464 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:50:02.442+0000 7fdd542fd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdd4c0fc720 0x7fdd4c10d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:02.464 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:50:02.442+0000 7fdd542fd640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd4c10dd30 con 0x7fdd4c0fc720 2024-09-13T02:50:02.464 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:50:02.442+0000 7fdd542fd640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd4c10e4b0 con 0x7fdd4c0fb450 2024-09-13T02:50:02.464 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:50:02.442+0000 7fdd52099640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdd4c0fb450 0x7fdd4c10d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:02.464 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:50:02.442+0000 7fdd52099640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdd4c0fb450 0x7fdd4c10d1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:47986/0 (socket says 172.21.15.131:47986) 2024-09-13T02:50:02.464 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:50:02.442+0000 7fdd52099640 1 -- 172.21.15.131:0/1377945985 learned_addr learned my addr 172.21.15.131:0/1377945985 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-09-13T02:50:02.465 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:50:02.442+0000 7fdd51898640 1 --2- 172.21.15.131:0/1377945985 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdd4c0fc720 0x7fdd4c10d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:02.465 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:50:02.442+0000 7fdd52099640 1 -- 172.21.15.131:0/1377945985 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdd4c0fc720 msgr2=0x7fdd4c10d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:02.465 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:50:02.442+0000 7fdd52099640 1 --2- 172.21.15.131:0/1377945985 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdd4c0fc720 0x7fdd4c10d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:02.465 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:50:02.442+0000 7fdd52099640 1 -- 172.21.15.131:0/1377945985 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd48005040 con 0x7fdd4c0fb450 2024-09-13T02:50:02.465 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:50:02.443+0000 7fdd52099640 1 --2- 172.21.15.131:0/1377945985 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdd4c0fb450 0x7fdd4c10d1a0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fdd480043d0 tx=0x7fdd48009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:50:02.465 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:50:02.443+0000 7fdd3effd640 1 -- 172.21.15.131:0/1377945985 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd48038070 con 0x7fdd4c0fb450 2024-09-13T02:50:02.465 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:50:02.443+0000 7fdd3effd640 1 -- 172.21.15.131:0/1377945985 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fdd4802ae90 con 0x7fdd4c0fb450 2024-09-13T02:50:02.465 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:50:02.443+0000 7fdd542fd640 1 -- 172.21.15.131:0/1377945985 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd4c10e6e0 con 0x7fdd4c0fb450 2024-09-13T02:50:02.465 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:50:02.443+0000 7fdd3effd640 1 -- 172.21.15.131:0/1377945985 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd4803e670 con 0x7fdd4c0fb450 2024-09-13T02:50:02.465 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:50:02.443+0000 7fdd542fd640 1 -- 172.21.15.131:0/1377945985 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd4c10ec80 con 0x7fdd4c0fb450 2024-09-13T02:50:02.465 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:50:02.444+0000 7fdd542fd640 1 -- 172.21.15.131:0/1377945985 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd4c0fa8b0 con 0x7fdd4c0fb450 2024-09-13T02:50:02.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:50:02.444+0000 7fdd3effd640 1 -- 172.21.15.131:0/1377945985 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fdd48030020 con 0x7fdd4c0fb450 2024-09-13T02:50:02.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:50:02.445+0000 7fdd3effd640 1 --2- 172.21.15.131:0/1377945985 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fdd3806ed60 0x7fdd38071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:02.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:50:02.445+0000 7fdd3effd640 1 -- 172.21.15.131:0/1377945985 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 4202+0+0 (secure 0 0 0) 0x7fdd480add50 con 0x7fdd4c0fb450 2024-09-13T02:50:02.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:50:02.445+0000 7fdd51898640 1 --2- 172.21.15.131:0/1377945985 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fdd3806ed60 0x7fdd38071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:02.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:50:02.445+0000 7fdd51898640 1 --2- 172.21.15.131:0/1377945985 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fdd3806ed60 0x7fdd38071210 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c10cf50 tx=0x7fdd4000b040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:50:02.466 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:50:02.449+0000 7fdd3effd640 1 -- 172.21.15.131:0/1377945985 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fdd4807b490 con 0x7fdd4c0fb450 2024-09-13T02:50:02.615 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:50:02.614+0000 7fdd542fd640 1 -- 172.21.15.131:0/1377945985 --> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi131:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7fdd4c10eef0 con 0x7fdd3806ed60 2024-09-13T02:50:02.933 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:02 smithi131 ceph-mon[34689]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-13T02:50:02.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:02 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:50:02.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:02 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:50:02.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:02 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:50:02.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:02 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:50:02.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:02 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:50:02.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:02 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:50:02.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:02 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:50:02.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:02 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:50:02.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:02 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:50:02.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:02 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:50:02.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:02 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:50:02.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:02 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:50:03.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:02 smithi089 ceph-mon[27639]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-13T02:50:03.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:02 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:50:03.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:02 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:50:03.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:02 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:50:03.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:02 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:50:03.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:02 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:50:03.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:02 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:50:03.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:02 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:50:03.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:02 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:50:03.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:02 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:50:03.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:02 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:50:03.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:02 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:50:03.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:02 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:50:03.928 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:03 smithi131 ceph-mon[34689]: Detected new or changed devices on smithi131 2024-09-13T02:50:03.929 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:03 smithi131 ceph-mon[34689]: Adjusting osd_memory_target on smithi131 to 7968M 2024-09-13T02:50:03.929 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:03 smithi131 ceph-mon[34689]: from='client.24165 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi131:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:50:03.929 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:03 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T02:50:03.929 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:03 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T02:50:03.929 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:03 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:50:04.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:03 smithi089 ceph-mon[27639]: Detected new or changed devices on smithi131 2024-09-13T02:50:04.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:03 smithi089 ceph-mon[27639]: Adjusting osd_memory_target on smithi131 to 7968M 2024-09-13T02:50:04.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:03 smithi089 ceph-mon[27639]: from='client.24165 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi131:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:50:04.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:03 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-13T02:50:04.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:03 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-13T02:50:04.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:03 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:50:04.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:04 smithi131 ceph-mon[34689]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-13T02:50:05.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:04 smithi089 ceph-mon[27639]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-13T02:50:05.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:05 smithi131 ceph-mon[34689]: from='client.? 172.21.15.131:0/3443453204' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a1b629b9-9946-42d0-ae1b-d093ea4cadbf"}]: dispatch 2024-09-13T02:50:05.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:05 smithi131 ceph-mon[34689]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a1b629b9-9946-42d0-ae1b-d093ea4cadbf"}]: dispatch 2024-09-13T02:50:05.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:05 smithi131 ceph-mon[34689]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a1b629b9-9946-42d0-ae1b-d093ea4cadbf"}]': finished 2024-09-13T02:50:05.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:05 smithi131 ceph-mon[34689]: osdmap e34: 6 total, 5 up, 6 in 2024-09-13T02:50:05.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:05 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T02:50:05.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:05 smithi131 ceph-mon[34689]: from='client.? 172.21.15.131:0/218447534' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T02:50:06.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:05 smithi089 ceph-mon[27639]: from='client.? 172.21.15.131:0/3443453204' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a1b629b9-9946-42d0-ae1b-d093ea4cadbf"}]: dispatch 2024-09-13T02:50:06.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:05 smithi089 ceph-mon[27639]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a1b629b9-9946-42d0-ae1b-d093ea4cadbf"}]: dispatch 2024-09-13T02:50:06.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:05 smithi089 ceph-mon[27639]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a1b629b9-9946-42d0-ae1b-d093ea4cadbf"}]': finished 2024-09-13T02:50:06.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:05 smithi089 ceph-mon[27639]: osdmap e34: 6 total, 5 up, 6 in 2024-09-13T02:50:06.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:05 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T02:50:06.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:05 smithi089 ceph-mon[27639]: from='client.? 172.21.15.131:0/218447534' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-13T02:50:06.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:06 smithi131 ceph-mon[34689]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-13T02:50:07.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:06 smithi089 ceph-mon[27639]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-13T02:50:08.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:08 smithi131 ceph-mon[34689]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-13T02:50:09.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:08 smithi089 ceph-mon[27639]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-13T02:50:10.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:10 smithi131 ceph-mon[34689]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-13T02:50:11.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:10 smithi089 ceph-mon[27639]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-13T02:50:12.892 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:12 smithi131 ceph-mon[34689]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-13T02:50:12.892 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:12 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-13T02:50:12.893 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:12 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:50:12.893 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:12 smithi131 ceph-mon[34689]: Deploying daemon osd.5 on smithi131 2024-09-13T02:50:13.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:12 smithi089 ceph-mon[27639]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-13T02:50:13.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:12 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-13T02:50:13.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:12 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:50:13.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:12 smithi089 ceph-mon[27639]: Deploying daemon osd.5 on smithi131 2024-09-13T02:50:14.895 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:14 smithi131 ceph-mon[34689]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-13T02:50:14.895 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:14 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:50:15.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:14 smithi089 ceph-mon[27639]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-13T02:50:15.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:14 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:50:16.856 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:16 smithi131 ceph-mon[34689]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-13T02:50:16.856 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:16 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:50:16.856 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:16 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:50:16.856 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:16 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:50:17.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:16 smithi089 ceph-mon[27639]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-13T02:50:17.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:16 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:50:17.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:16 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:50:17.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:16 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:50:18.700 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:18 smithi131 ceph-mon[34689]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-13T02:50:19.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:18 smithi089 ceph-mon[27639]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-13T02:50:19.808 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:50:19.807+0000 7fdd3effd640 1 -- 172.21.15.131:0/1377945985 <== mgr.14204 v2:172.21.15.89:6800/1506060926 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7fdd4c10eef0 con 0x7fdd3806ed60 2024-09-13T02:50:19.808 INFO:teuthology.orchestra.run.smithi131.stdout:Created osd(s) 5 on host 'smithi131' 2024-09-13T02:50:19.810 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:50:19.809+0000 7fdd542fd640 1 -- 172.21.15.131:0/1377945985 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fdd3806ed60 msgr2=0x7fdd38071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:19.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:50:19.809+0000 7fdd542fd640 1 --2- 172.21.15.131:0/1377945985 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fdd3806ed60 0x7fdd38071210 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c10cf50 tx=0x7fdd4000b040 comp rx=0 tx=0).stop 2024-09-13T02:50:19.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:50:19.809+0000 7fdd542fd640 1 -- 172.21.15.131:0/1377945985 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdd4c0fb450 msgr2=0x7fdd4c10d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:19.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:50:19.809+0000 7fdd542fd640 1 --2- 172.21.15.131:0/1377945985 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdd4c0fb450 0x7fdd4c10d1a0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fdd480043d0 tx=0x7fdd48009da0 comp rx=0 tx=0).stop 2024-09-13T02:50:19.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:50:19.809+0000 7fdd542fd640 1 -- 172.21.15.131:0/1377945985 shutdown_connections 2024-09-13T02:50:19.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:50:19.809+0000 7fdd542fd640 1 --2- 172.21.15.131:0/1377945985 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdd4c0fc720 0x7fdd4c10d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:19.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:50:19.809+0000 7fdd542fd640 1 --2- 172.21.15.131:0/1377945985 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fdd3806ed60 0x7fdd38071210 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:19.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:50:19.809+0000 7fdd542fd640 1 --2- 172.21.15.131:0/1377945985 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdd4c0fb450 0x7fdd4c10d1a0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:19.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:50:19.809+0000 7fdd542fd640 1 -- 172.21.15.131:0/1377945985 >> 172.21.15.131:0/1377945985 conn(0x7fdd4c0f6c10 msgr2=0x7fdd4c066110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:50:19.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:50:19.809+0000 7fdd542fd640 1 -- 172.21.15.131:0/1377945985 shutdown_connections 2024-09-13T02:50:19.811 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:50:19.809+0000 7fdd542fd640 1 -- 172.21.15.131:0/1377945985 wait complete. 2024-09-13T02:50:20.412 DEBUG:teuthology.orchestra.run.smithi131:osd.5> sudo journalctl -f -n 0 -u ceph-12cdb164-717a-11ef-bceb-c7b262605968@osd.5.service 2024-09-13T02:50:20.454 INFO:tasks.cephadm:Waiting for 6 OSDs to come up... 2024-09-13T02:50:20.455 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-13T02:50:20.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:20 smithi131 ceph-mon[34689]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-13T02:50:20.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:20 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:50:20.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:20 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:50:20.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:20 smithi131 ceph-mon[34689]: from='osd.5 [v2:172.21.15.131:6816/2725649505,v1:172.21.15.131:6817/2725649505]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T02:50:20.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:20 smithi131 ceph-mon[34689]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T02:50:20.719 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T02:50:20.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:20 smithi089 ceph-mon[27639]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-13T02:50:20.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:20 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:50:20.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:20 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:50:20.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:20 smithi089 ceph-mon[27639]: from='osd.5 [v2:172.21.15.131:6816/2725649505,v1:172.21.15.131:6817/2725649505]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T02:50:20.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:20 smithi089 ceph-mon[27639]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T02:50:21.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:21 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:50:21.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:21 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:50:21.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:21 smithi131 ceph-mon[34689]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-13T02:50:21.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:21 smithi131 ceph-mon[34689]: osdmap e35: 6 total, 5 up, 6 in 2024-09-13T02:50:21.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:21 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T02:50:21.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:21 smithi131 ceph-mon[34689]: from='osd.5 [v2:172.21.15.131:6816/2725649505,v1:172.21.15.131:6817/2725649505]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]: dispatch 2024-09-13T02:50:21.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:21 smithi131 ceph-mon[34689]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]: dispatch 2024-09-13T02:50:21.925 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:21 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:50:21.926 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:21 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:50:21.926 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:21 smithi089 ceph-mon[27639]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-13T02:50:21.926 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:21 smithi089 ceph-mon[27639]: osdmap e35: 6 total, 5 up, 6 in 2024-09-13T02:50:21.926 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:21 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T02:50:21.926 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:21 smithi089 ceph-mon[27639]: from='osd.5 [v2:172.21.15.131:6816/2725649505,v1:172.21.15.131:6817/2725649505]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]: dispatch 2024-09-13T02:50:21.926 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:21 smithi089 ceph-mon[27639]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]: dispatch 2024-09-13T02:50:22.184 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 02:50:21 smithi131 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-5[53065]: 2024-09-13T02:50:21.815+0000 7f90ca4cf640 -1 osd.5 0 waiting for initial osdmap 2024-09-13T02:50:22.184 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 02:50:21 smithi131 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-5[53065]: 2024-09-13T02:50:21.822+0000 7f90c3b03640 -1 osd.5 36 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T02:50:22.435 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:22.432+0000 7f7ea6714640 1 -- 172.21.15.89:0/3392496010 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7ea00fb430 msgr2=0x7f7ea00fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:22.435 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:22.432+0000 7f7ea6714640 1 --2- 172.21.15.89:0/3392496010 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7ea00fb430 0x7f7ea00fb840 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7e900048d0 tx=0x7f7e90009da0 comp rx=0 tx=0).stop 2024-09-13T02:50:22.435 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:22.432+0000 7f7ea6714640 1 -- 172.21.15.89:0/3392496010 shutdown_connections 2024-09-13T02:50:22.436 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:22.432+0000 7f7ea6714640 1 --2- 172.21.15.89:0/3392496010 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7ea00fc700 0x7f7ea00fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:22.436 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:22.432+0000 7f7ea6714640 1 --2- 172.21.15.89:0/3392496010 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7ea00fb430 0x7f7ea00fb840 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:22.436 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:22.432+0000 7f7ea6714640 1 -- 172.21.15.89:0/3392496010 >> 172.21.15.89:0/3392496010 conn(0x7f7ea00f6c10 msgr2=0x7f7ea00f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:50:22.436 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:22.432+0000 7f7ea6714640 1 -- 172.21.15.89:0/3392496010 shutdown_connections 2024-09-13T02:50:22.436 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:22.432+0000 7f7ea6714640 1 -- 172.21.15.89:0/3392496010 wait complete. 2024-09-13T02:50:22.436 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:22.433+0000 7f7ea6714640 1 Processor -- start 2024-09-13T02:50:22.436 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:22.433+0000 7f7ea6714640 1 -- start start 2024-09-13T02:50:22.436 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:22.433+0000 7f7ea6714640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7ea00fb430 0x7f7ea010f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:22.436 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:22.433+0000 7f7ea6714640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7ea00fc700 0x7f7ea010f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:22.436 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:22.433+0000 7f7ea6714640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea010fe20 con 0x7f7ea00fc700 2024-09-13T02:50:22.436 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:22.433+0000 7f7ea6714640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ea0110640 con 0x7f7ea00fb430 2024-09-13T02:50:22.436 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:22.433+0000 7f7e97fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7ea00fc700 0x7f7ea010f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:22.437 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:22.433+0000 7f7e97fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7ea00fc700 0x7f7ea010f7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:41956/0 (socket says 172.21.15.89:41956) 2024-09-13T02:50:22.437 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:22.433+0000 7f7e97fff640 1 -- 172.21.15.89:0/269211658 learned_addr learned my addr 172.21.15.89:0/269211658 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:50:22.437 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:22.433+0000 7f7e9ffff640 1 --2- 172.21.15.89:0/269211658 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7ea00fb430 0x7f7ea010f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:22.437 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:22.433+0000 7f7e97fff640 1 -- 172.21.15.89:0/269211658 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7ea00fb430 msgr2=0x7f7ea010f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:22.437 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:22.433+0000 7f7e97fff640 1 --2- 172.21.15.89:0/269211658 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7ea00fb430 0x7f7ea010f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:22.437 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:22.433+0000 7f7e97fff640 1 -- 172.21.15.89:0/269211658 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e90005040 con 0x7f7ea00fc700 2024-09-13T02:50:22.437 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:22.433+0000 7f7e97fff640 1 --2- 172.21.15.89:0/269211658 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7ea00fc700 0x7f7ea010f7d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7e8800eb70 tx=0x7f7e8800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:50:22.437 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:22.434+0000 7f7e9d7fa640 1 -- 172.21.15.89:0/269211658 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e88007c30 con 0x7f7ea00fc700 2024-09-13T02:50:22.437 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:22.434+0000 7f7e9d7fa640 1 -- 172.21.15.89:0/269211658 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f7e8800f040 con 0x7f7ea00fc700 2024-09-13T02:50:22.437 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:22.434+0000 7f7e9d7fa640 1 -- 172.21.15.89:0/269211658 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e8800ca60 con 0x7f7ea00fc700 2024-09-13T02:50:22.437 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:22.434+0000 7f7ea6714640 1 -- 172.21.15.89:0/269211658 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ea0110870 con 0x7f7ea00fc700 2024-09-13T02:50:22.437 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:22.434+0000 7f7ea6714640 1 -- 172.21.15.89:0/269211658 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ea0110e10 con 0x7f7ea00fc700 2024-09-13T02:50:22.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:22.435+0000 7f7ea6714640 1 -- 172.21.15.89:0/269211658 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ea00fa890 con 0x7f7ea00fc700 2024-09-13T02:50:22.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:22.435+0000 7f7e9d7fa640 1 -- 172.21.15.89:0/269211658 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f7e8800cbc0 con 0x7f7ea00fc700 2024-09-13T02:50:22.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:22.436+0000 7f7e9d7fa640 1 --2- 172.21.15.89:0/269211658 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f7e8c06ed60 0x7f7e8c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:22.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:22.436+0000 7f7e9d7fa640 1 -- 172.21.15.89:0/269211658 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 4354+0+0 (secure 0 0 0) 0x7f7e8808da00 con 0x7f7ea00fc700 2024-09-13T02:50:22.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:22.436+0000 7f7e9ffff640 1 --2- 172.21.15.89:0/269211658 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f7e8c06ed60 0x7f7e8c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:22.439 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:22.436+0000 7f7e9ffff640 1 --2- 172.21.15.89:0/269211658 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f7e8c06ed60 0x7f7e8c071210 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7e90004540 tx=0x7f7e90035040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:50:22.441 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:22.440+0000 7f7e9d7fa640 1 -- 172.21.15.89:0/269211658 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f7e8805b0e0 con 0x7f7ea00fc700 2024-09-13T02:50:22.597 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:22.596+0000 7f7ea6714640 1 -- 172.21.15.89:0/269211658 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f7ea0103f50 con 0x7f7ea00fc700 2024-09-13T02:50:22.597 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:22.596+0000 7f7e9d7fa640 1 -- 172.21.15.89:0/269211658 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v36) v1 ==== 74+0+130 (secure 0 0 0) 0x7f7e88019090 con 0x7f7ea00fc700 2024-09-13T02:50:22.598 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:50:22.599 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:22.598+0000 7f7ea6714640 1 -- 172.21.15.89:0/269211658 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f7e8c06ed60 msgr2=0x7f7e8c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:22.599 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:22.598+0000 7f7ea6714640 1 --2- 172.21.15.89:0/269211658 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f7e8c06ed60 0x7f7e8c071210 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7e90004540 tx=0x7f7e90035040 comp rx=0 tx=0).stop 2024-09-13T02:50:22.599 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:22.598+0000 7f7ea6714640 1 -- 172.21.15.89:0/269211658 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7ea00fc700 msgr2=0x7f7ea010f7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:22.600 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:22.598+0000 7f7ea6714640 1 --2- 172.21.15.89:0/269211658 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7ea00fc700 0x7f7ea010f7d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7e8800eb70 tx=0x7f7e8800b040 comp rx=0 tx=0).stop 2024-09-13T02:50:22.600 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:22.598+0000 7f7ea6714640 1 -- 172.21.15.89:0/269211658 shutdown_connections 2024-09-13T02:50:22.600 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:22.598+0000 7f7ea6714640 1 --2- 172.21.15.89:0/269211658 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7ea00fc700 0x7f7ea010f7d0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:22.600 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:22.598+0000 7f7ea6714640 1 --2- 172.21.15.89:0/269211658 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f7e8c06ed60 0x7f7e8c071210 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:22.600 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:22.598+0000 7f7ea6714640 1 --2- 172.21.15.89:0/269211658 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7ea00fb430 0x7f7ea010f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:22.600 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:22.598+0000 7f7ea6714640 1 -- 172.21.15.89:0/269211658 >> 172.21.15.89:0/269211658 conn(0x7f7ea00f6c10 msgr2=0x7f7ea00655f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:50:22.600 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:22.598+0000 7f7ea6714640 1 -- 172.21.15.89:0/269211658 shutdown_connections 2024-09-13T02:50:22.600 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:22.598+0000 7f7ea6714640 1 -- 172.21.15.89:0/269211658 wait complete. 2024-09-13T02:50:22.925 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:22 smithi089 ceph-mon[27639]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-13T02:50:22.926 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:22 smithi089 ceph-mon[27639]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]': finished 2024-09-13T02:50:22.926 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:22 smithi089 ceph-mon[27639]: osdmap e36: 6 total, 5 up, 6 in 2024-09-13T02:50:22.926 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:22 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T02:50:22.926 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:22 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T02:50:22.926 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:22 smithi089 ceph-mon[27639]: from='client.? 172.21.15.89:0/269211658' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-13T02:50:22.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:22 smithi131 ceph-mon[34689]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-13T02:50:22.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:22 smithi131 ceph-mon[34689]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]': finished 2024-09-13T02:50:22.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:22 smithi131 ceph-mon[34689]: osdmap e36: 6 total, 5 up, 6 in 2024-09-13T02:50:22.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:22 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T02:50:22.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:22 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T02:50:22.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:22 smithi131 ceph-mon[34689]: from='client.? 172.21.15.89:0/269211658' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-13T02:50:23.264 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":36,"num_osds":6,"num_up_osds":5,"osd_up_since":1726195798,"num_in_osds":6,"osd_in_since":1726195804,"num_remapped_pgs":0} 2024-09-13T02:50:23.928 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:23 smithi131 ceph-mon[34689]: purged_snaps scrub starts 2024-09-13T02:50:23.928 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:23 smithi131 ceph-mon[34689]: purged_snaps scrub ok 2024-09-13T02:50:23.928 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:23 smithi131 ceph-mon[34689]: osd.5 [v2:172.21.15.131:6816/2725649505,v1:172.21.15.131:6817/2725649505] boot 2024-09-13T02:50:23.928 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:23 smithi131 ceph-mon[34689]: osdmap e37: 6 total, 6 up, 6 in 2024-09-13T02:50:23.928 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:23 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T02:50:23.928 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:23 smithi131 ceph-mon[34689]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-13T02:50:24.266 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-13T02:50:24.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:23 smithi089 ceph-mon[27639]: purged_snaps scrub starts 2024-09-13T02:50:24.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:23 smithi089 ceph-mon[27639]: purged_snaps scrub ok 2024-09-13T02:50:24.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:23 smithi089 ceph-mon[27639]: osd.5 [v2:172.21.15.131:6816/2725649505,v1:172.21.15.131:6817/2725649505] boot 2024-09-13T02:50:24.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:23 smithi089 ceph-mon[27639]: osdmap e37: 6 total, 6 up, 6 in 2024-09-13T02:50:24.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:23 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T02:50:24.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:23 smithi089 ceph-mon[27639]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-09-13T02:50:24.542 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T02:50:25.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:24 smithi131 ceph-mon[34689]: osdmap e38: 6 total, 6 up, 6 in 2024-09-13T02:50:25.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:24 smithi131 ceph-mon[34689]: Detected new or changed devices on smithi131 2024-09-13T02:50:25.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:24 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:50:25.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:24 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:50:25.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:24 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:50:25.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:24 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:50:25.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:24 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:50:25.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:24 smithi131 ceph-mon[34689]: Adjusting osd_memory_target on smithi131 to 5312M 2024-09-13T02:50:25.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:24 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:50:25.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:24 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:50:25.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:24 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:50:25.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:24 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:50:25.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:24 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:50:25.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:24 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:50:25.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:24 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:50:25.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:24 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:50:25.254 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:24 smithi089 ceph-mon[27639]: osdmap e38: 6 total, 6 up, 6 in 2024-09-13T02:50:25.254 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:24 smithi089 ceph-mon[27639]: Detected new or changed devices on smithi131 2024-09-13T02:50:25.255 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:24 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:50:25.255 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:24 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:50:25.255 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:24 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:50:25.255 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:24 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:50:25.255 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:24 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:50:25.255 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:24 smithi089 ceph-mon[27639]: Adjusting osd_memory_target on smithi131 to 5312M 2024-09-13T02:50:25.255 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:24 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:50:25.255 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:24 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:50:25.255 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:24 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:50:25.255 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:24 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:50:25.255 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:24 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:50:25.255 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:24 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:50:25.255 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:24 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:50:25.256 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:24 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:50:26.050 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:26.033+0000 7f8c2f2c1640 1 -- 172.21.15.89:0/2627854517 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8c28065c40 msgr2=0x7f8c280ff0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:26.050 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:26.033+0000 7f8c2f2c1640 1 --2- 172.21.15.89:0/2627854517 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8c28065c40 0x7f8c280ff0f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f8c240048d0 tx=0x7f8c24009da0 comp rx=0 tx=0).stop 2024-09-13T02:50:26.050 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:26.033+0000 7f8c2f2c1640 1 -- 172.21.15.89:0/2627854517 shutdown_connections 2024-09-13T02:50:26.050 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:26.033+0000 7f8c2f2c1640 1 --2- 172.21.15.89:0/2627854517 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c280ff630 0x7f8c28101a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:26.050 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:26.033+0000 7f8c2f2c1640 1 --2- 172.21.15.89:0/2627854517 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8c28065c40 0x7f8c280ff0f0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:26.050 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:26.033+0000 7f8c2f2c1640 1 -- 172.21.15.89:0/2627854517 >> 172.21.15.89:0/2627854517 conn(0x7f8c280f6b80 msgr2=0x7f8c280f8fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:50:26.051 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:26.033+0000 7f8c2f2c1640 1 -- 172.21.15.89:0/2627854517 shutdown_connections 2024-09-13T02:50:26.051 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:26.033+0000 7f8c2f2c1640 1 -- 172.21.15.89:0/2627854517 wait complete. 2024-09-13T02:50:26.051 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:26.034+0000 7f8c2f2c1640 1 Processor -- start 2024-09-13T02:50:26.051 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:26.034+0000 7f8c2f2c1640 1 -- start start 2024-09-13T02:50:26.051 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:26.034+0000 7f8c2f2c1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8c28065c40 0x7f8c280fcb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:26.051 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:26.034+0000 7f8c2f2c1640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c280ff630 0x7f8c280faff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:26.051 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:26.034+0000 7f8c2f2c1640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c280fb610 con 0x7f8c28065c40 2024-09-13T02:50:26.051 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:26.034+0000 7f8c2f2c1640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c280fb750 con 0x7f8c280ff630 2024-09-13T02:50:26.051 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:26.034+0000 7f8c2d05d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8c28065c40 0x7f8c280fcb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:26.052 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:26.034+0000 7f8c2d05d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8c28065c40 0x7f8c280fcb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:41974/0 (socket says 172.21.15.89:41974) 2024-09-13T02:50:26.052 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:26.034+0000 7f8c2d05d640 1 -- 172.21.15.89:0/3251504056 learned_addr learned my addr 172.21.15.89:0/3251504056 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:50:26.052 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:26.034+0000 7f8c2c85c640 1 --2- 172.21.15.89:0/3251504056 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c280ff630 0x7f8c280faff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:26.052 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:26.034+0000 7f8c2d05d640 1 -- 172.21.15.89:0/3251504056 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c280ff630 msgr2=0x7f8c280faff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:26.052 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:26.034+0000 7f8c2d05d640 1 --2- 172.21.15.89:0/3251504056 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c280ff630 0x7f8c280faff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:26.052 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:26.034+0000 7f8c2d05d640 1 -- 172.21.15.89:0/3251504056 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c24005040 con 0x7f8c28065c40 2024-09-13T02:50:26.052 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:26.034+0000 7f8c2d05d640 1 --2- 172.21.15.89:0/3251504056 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8c28065c40 0x7f8c280fcb00 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8c240048a0 tx=0x7f8c24009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:50:26.052 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:26.035+0000 7f8c1dffb640 1 -- 172.21.15.89:0/3251504056 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c24038070 con 0x7f8c28065c40 2024-09-13T02:50:26.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:26.035+0000 7f8c1dffb640 1 -- 172.21.15.89:0/3251504056 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f8c2402abd0 con 0x7f8c28065c40 2024-09-13T02:50:26.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:26.035+0000 7f8c2f2c1640 1 -- 172.21.15.89:0/3251504056 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c280fb9d0 con 0x7f8c28065c40 2024-09-13T02:50:26.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:26.035+0000 7f8c1dffb640 1 -- 172.21.15.89:0/3251504056 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c24033640 con 0x7f8c28065c40 2024-09-13T02:50:26.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:26.035+0000 7f8c2f2c1640 1 -- 172.21.15.89:0/3251504056 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c281150b0 con 0x7f8c28065c40 2024-09-13T02:50:26.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:26.036+0000 7f8c2f2c1640 1 -- 172.21.15.89:0/3251504056 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c2805ed70 con 0x7f8c28065c40 2024-09-13T02:50:26.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:26.036+0000 7f8c1dffb640 1 -- 172.21.15.89:0/3251504056 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f8c24030020 con 0x7f8c28065c40 2024-09-13T02:50:26.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:26.037+0000 7f8c1dffb640 1 --2- 172.21.15.89:0/3251504056 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f8c1406ed50 0x7f8c14071200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:26.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:26.037+0000 7f8c1dffb640 1 -- 172.21.15.89:0/3251504056 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f8c240ae1b0 con 0x7f8c28065c40 2024-09-13T02:50:26.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:26.037+0000 7f8c2c85c640 1 --2- 172.21.15.89:0/3251504056 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f8c1406ed50 0x7f8c14071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:26.054 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:26.037+0000 7f8c2c85c640 1 --2- 172.21.15.89:0/3251504056 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f8c1406ed50 0x7f8c14071200 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8c18006fd0 tx=0x7f8c18008040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:50:26.054 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:26.041+0000 7f8c1dffb640 1 -- 172.21.15.89:0/3251504056 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f8c2407b610 con 0x7f8c28065c40 2024-09-13T02:50:26.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:25 smithi131 ceph-mon[34689]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:50:26.197 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:26.196+0000 7f8c2f2c1640 1 -- 172.21.15.89:0/3251504056 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7f8c2804b720 con 0x7f8c28065c40 2024-09-13T02:50:26.197 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:25 smithi089 ceph-mon[27639]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:50:26.197 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:26.196+0000 7f8c1dffb640 1 -- 172.21.15.89:0/3251504056 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v38) v1 ==== 74+0+130 (secure 0 0 0) 0x7f8c2407afb0 con 0x7f8c28065c40 2024-09-13T02:50:26.198 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:50:26.199 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:26.198+0000 7f8c2f2c1640 1 -- 172.21.15.89:0/3251504056 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f8c1406ed50 msgr2=0x7f8c14071200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:26.200 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:26.198+0000 7f8c2f2c1640 1 --2- 172.21.15.89:0/3251504056 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f8c1406ed50 0x7f8c14071200 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f8c18006fd0 tx=0x7f8c18008040 comp rx=0 tx=0).stop 2024-09-13T02:50:26.200 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:26.198+0000 7f8c2f2c1640 1 -- 172.21.15.89:0/3251504056 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8c28065c40 msgr2=0x7f8c280fcb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:26.200 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:26.198+0000 7f8c2f2c1640 1 --2- 172.21.15.89:0/3251504056 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8c28065c40 0x7f8c280fcb00 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f8c240048a0 tx=0x7f8c24009da0 comp rx=0 tx=0).stop 2024-09-13T02:50:26.200 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:26.198+0000 7f8c2f2c1640 1 -- 172.21.15.89:0/3251504056 shutdown_connections 2024-09-13T02:50:26.200 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:26.198+0000 7f8c2f2c1640 1 --2- 172.21.15.89:0/3251504056 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f8c1406ed50 0x7f8c14071200 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:26.200 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:26.198+0000 7f8c2f2c1640 1 --2- 172.21.15.89:0/3251504056 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8c280ff630 0x7f8c280faff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:26.200 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:26.198+0000 7f8c2f2c1640 1 --2- 172.21.15.89:0/3251504056 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8c28065c40 0x7f8c280fcb00 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:26.200 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:26.198+0000 7f8c2f2c1640 1 -- 172.21.15.89:0/3251504056 >> 172.21.15.89:0/3251504056 conn(0x7f8c280f6b80 msgr2=0x7f8c280f6fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:50:26.200 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:26.198+0000 7f8c2f2c1640 1 -- 172.21.15.89:0/3251504056 shutdown_connections 2024-09-13T02:50:26.200 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:26.198+0000 7f8c2f2c1640 1 -- 172.21.15.89:0/3251504056 wait complete. 2024-09-13T02:50:26.761 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":38,"num_osds":6,"num_up_osds":6,"osd_up_since":1726195822,"num_in_osds":6,"osd_in_since":1726195804,"num_remapped_pgs":0} 2024-09-13T02:50:26.762 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-13T02:50:27.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:26 smithi089 ceph-mon[27639]: from='client.? 172.21.15.89:0/3251504056' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-13T02:50:27.046 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T02:50:27.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:26 smithi131 ceph-mon[34689]: from='client.? 172.21.15.89:0/3251504056' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-13T02:50:28.176 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:27 smithi089 ceph-mon[27639]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:50:28.183 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:27 smithi131 ceph-mon[34689]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:50:28.680 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:28.678+0000 7f7374a2e640 1 -- 172.21.15.89:0/1497571098 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f73700fcf80 msgr2=0x7f73700fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:28.680 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:28.678+0000 7f7374a2e640 1 --2- 172.21.15.89:0/1497571098 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f73700fcf80 0x7f73700fd3d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f73580048d0 tx=0x7f7358009da0 comp rx=0 tx=0).stop 2024-09-13T02:50:28.681 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:28.679+0000 7f7374a2e640 1 -- 172.21.15.89:0/1497571098 shutdown_connections 2024-09-13T02:50:28.681 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:28.679+0000 7f7374a2e640 1 --2- 172.21.15.89:0/1497571098 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f73700fcf80 0x7f73700fd3d0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:28.681 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:28.679+0000 7f7374a2e640 1 --2- 172.21.15.89:0/1497571098 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f73700fb810 0x7f73700fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:28.681 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:28.679+0000 7f7374a2e640 1 -- 172.21.15.89:0/1497571098 >> 172.21.15.89:0/1497571098 conn(0x7f73700723b0 msgr2=0x7f73700727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:50:28.681 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:28.679+0000 7f7374a2e640 1 -- 172.21.15.89:0/1497571098 shutdown_connections 2024-09-13T02:50:28.681 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:28.679+0000 7f7374a2e640 1 -- 172.21.15.89:0/1497571098 wait complete. 2024-09-13T02:50:28.681 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:28.679+0000 7f7374a2e640 1 Processor -- start 2024-09-13T02:50:28.681 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:28.679+0000 7f7374a2e640 1 -- start start 2024-09-13T02:50:28.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:28.680+0000 7f7374a2e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f73700fb810 0x7f7370112140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:28.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:28.680+0000 7f7374a2e640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f73700fcf80 0x7f7370112680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:28.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:28.680+0000 7f7374a2e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7370112d10 con 0x7f73700fb810 2024-09-13T02:50:28.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:28.680+0000 7f7374a2e640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f737010c100 con 0x7f73700fcf80 2024-09-13T02:50:28.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:28.680+0000 7f736e59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f73700fb810 0x7f7370112140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:28.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:28.680+0000 7f736e59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f73700fb810 0x7f7370112140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:41994/0 (socket says 172.21.15.89:41994) 2024-09-13T02:50:28.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:28.680+0000 7f736e59c640 1 -- 172.21.15.89:0/1383482986 learned_addr learned my addr 172.21.15.89:0/1383482986 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:50:28.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:28.680+0000 7f736dd9b640 1 --2- 172.21.15.89:0/1383482986 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f73700fcf80 0x7f7370112680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:28.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:28.680+0000 7f736e59c640 1 -- 172.21.15.89:0/1383482986 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f73700fcf80 msgr2=0x7f7370112680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:28.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:28.680+0000 7f736e59c640 1 --2- 172.21.15.89:0/1383482986 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f73700fcf80 0x7f7370112680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:28.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:28.680+0000 7f736e59c640 1 -- 172.21.15.89:0/1383482986 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7358005040 con 0x7f73700fb810 2024-09-13T02:50:28.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:28.680+0000 7f736e59c640 1 --2- 172.21.15.89:0/1383482986 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f73700fb810 0x7f7370112140 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f736000bbb0 tx=0x7f7360009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:50:28.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:28.680+0000 7f7366ffd640 1 -- 172.21.15.89:0/1383482986 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f736000c940 con 0x7f73700fb810 2024-09-13T02:50:28.684 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:28.680+0000 7f7374a2e640 1 -- 172.21.15.89:0/1383482986 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f737010c3e0 con 0x7f73700fb810 2024-09-13T02:50:28.684 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:28.680+0000 7f7366ffd640 1 -- 172.21.15.89:0/1383482986 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f73600092e0 con 0x7f73700fb810 2024-09-13T02:50:28.684 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:28.680+0000 7f7366ffd640 1 -- 172.21.15.89:0/1383482986 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7360007640 con 0x7f73700fb810 2024-09-13T02:50:28.684 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:28.680+0000 7f7374a2e640 1 -- 172.21.15.89:0/1383482986 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f737010c8d0 con 0x7f73700fb810 2024-09-13T02:50:28.684 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:28.681+0000 7f7374a2e640 1 -- 172.21.15.89:0/1383482986 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73700fcbc0 con 0x7f73700fb810 2024-09-13T02:50:28.685 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:28.682+0000 7f7366ffd640 1 -- 172.21.15.89:0/1383482986 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f7360012070 con 0x7f73700fb810 2024-09-13T02:50:28.685 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:28.683+0000 7f7366ffd640 1 --2- 172.21.15.89:0/1383482986 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f735c06ed60 0x7f735c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:28.685 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:28.683+0000 7f7366ffd640 1 -- 172.21.15.89:0/1383482986 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f736008def0 con 0x7f73700fb810 2024-09-13T02:50:28.685 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:28.683+0000 7f736dd9b640 1 --2- 172.21.15.89:0/1383482986 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f735c06ed60 0x7f735c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:28.685 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:28.683+0000 7f736dd9b640 1 --2- 172.21.15.89:0/1383482986 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f735c06ed60 0x7f735c071210 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7358009ac0 tx=0x7f7358035040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:50:28.688 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:28.686+0000 7f7366ffd640 1 -- 172.21.15.89:0/1383482986 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f736005b350 con 0x7f73700fb810 2024-09-13T02:50:28.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:28.842+0000 7f7374a2e640 1 -- 172.21.15.89:0/1383482986 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7370072ec0 con 0x7f73700fb810 2024-09-13T02:50:28.844 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:28.842+0000 7f7366ffd640 1 -- 172.21.15.89:0/1383482986 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+11078 (secure 0 0 0) 0x7f736005acf0 con 0x7f73700fb810 2024-09-13T02:50:28.844 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:50:28.844 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":38,"fsid":"12cdb164-717a-11ef-bceb-c7b262605968","created":"2024-09-13T02:45:05.519433+0000","modified":"2024-09-13T02:50:23.815280+0000","last_up_change":"2024-09-13T02:50:22.813558+0000","last_in_change":"2024-09-13T02:50:04.816334+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T02:49:11.235489+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"35210318-1c6c-4541-a94a-f9842c6bceba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":768220523},{"type":"v1","addr":"172.21.15.89:6803","nonce":768220523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":768220523},{"type":"v1","addr":"172.21.15.89:6805","nonce":768220523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":768220523},{"type":"v1","addr":"172.21.15.89:6809","nonce":768220523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":768220523},{"type":"v1","addr":"172.21.15.89:6807","nonce":768220523}]},"public_addr":"172.21.15.89:6803/768220523","cluster_addr":"172.21.15.89:6805/768220523","heartbeat_back_addr":"172.21.15.89:6809/768220523","heartbeat_front_addr":"172.21.15.89:6807/768220523","state":["exists","up"]},{"osd":1,"uuid":"19f1a315-6f5b-41d9-9cc3-04b7d3eaf4d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":3034426190},{"type":"v1","addr":"172.21.15.89:6811","nonce":3034426190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":3034426190},{"type":"v1","addr":"172.21.15.89:6813","nonce":3034426190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":3034426190},{"type":"v1","addr":"172.21.15.89:6817","nonce":3034426190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":3034426190},{"type":"v1","addr":"172.21.15.89:6815","nonce":3034426190}]},"public_addr":"172.21.15.89:6811/3034426190","cluster_addr":"172.21.15.89:6813/3034426190","heartbeat_back_addr":"172.21.15.89:6817/3034426190","heartbeat_front_addr":"172.21.15.89:6815/3034426190","state":["exists","up"]},{"osd":2,"uuid":"4032071a-32a2-46af-9c08-b01ae52359d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":2876061357},{"type":"v1","addr":"172.21.15.89:6819","nonce":2876061357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":2876061357},{"type":"v1","addr":"172.21.15.89:6821","nonce":2876061357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":2876061357},{"type":"v1","addr":"172.21.15.89:6825","nonce":2876061357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":2876061357},{"type":"v1","addr":"172.21.15.89:6823","nonce":2876061357}]},"public_addr":"172.21.15.89:6819/2876061357","cluster_addr":"172.21.15.89:6821/2876061357","heartbeat_back_addr":"172.21.15.89:6825/2876061357","heartbeat_front_addr":"172.21.15.89:6823/2876061357","state":["exists","up"]},{"osd":3,"uuid":"9f04f440-e9b7-422d-9b56-1cee78aa76a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":2299999552},{"type":"v1","addr":"172.21.15.131:6801","nonce":2299999552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":2299999552},{"type":"v1","addr":"172.21.15.131:6803","nonce":2299999552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":2299999552},{"type":"v1","addr":"172.21.15.131:6807","nonce":2299999552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":2299999552},{"type":"v1","addr":"172.21.15.131:6805","nonce":2299999552}]},"public_addr":"172.21.15.131:6801/2299999552","cluster_addr":"172.21.15.131:6803/2299999552","heartbeat_back_addr":"172.21.15.131:6807/2299999552","heartbeat_front_addr":"172.21.15.131:6805/2299999552","state":["exists","up"]},{"osd":4,"uuid":"c7fcc566-b36d-4f22-ad23-784464e91d2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":3134834192},{"type":"v1","addr":"172.21.15.131:6809","nonce":3134834192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":3134834192},{"type":"v1","addr":"172.21.15.131:6811","nonce":3134834192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":3134834192},{"type":"v1","addr":"172.21.15.131:6815","nonce":3134834192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":3134834192},{"type":"v1","addr":"172.21.15.131:6813","nonce":3134834192}]},"public_addr":"172.21.15.131:6809/3134834192","cluster_addr":"172.21.15.131:6811/3134834192","heartbeat_back_addr":"172.21.15.131:6815/3134834192","heartbeat_front_addr":"172.21.15.131:6813/3134834192","state":["exists","up"]},{"osd":5,"uuid":"a1b629b9-9946-42d0-ae1b-d093ea4cadbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2725649505},{"type":"v1","addr":"172.21.15.131:6817","nonce":2725649505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":2725649505},{"type":"v1","addr":"172.21.15.131:6819","nonce":2725649505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":2725649505},{"type":"v1","addr":"172.21.15.131:6823","nonce":2725649505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":2725649505},{"type":"v1","addr":"172.21.15.131:6821","nonce":2725649505}]},"public_addr":"172.21.15.131:6817/2725649505","cluster_addr":"172.21.15.131:6819/2725649505","heartbeat_back_addr":"172.21.15.131:6823/2725649505","heartbeat_front_addr":"172.21.15.131:6821/2725649505","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T02:48:12.912627+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T02:48:39.359413+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T02:49:08.617586+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T02:49:32.244261+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T02:49:56.840787+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T02:50:21.057167+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.89:6800/3169313021":"2024-09-14T02:46:58.936239+0000","172.21.15.89:6800/3982028315":"2024-09-14T02:45:32.668116+0000","172.21.15.89:0/507534695":"2024-09-14T02:45:32.668116+0000","172.21.15.89:0/1261668205":"2024-09-14T02:45:32.668116+0000","172.21.15.89:0/1988451185":"2024-09-14T02:45:32.668116+0000","172.21.15.89:6801/3982028315":"2024-09-14T02:45:32.668116+0000","172.21.15.89:0/3043630910":"2024-09-14T02:46:00.949227+0000","172.21.15.89:6801/3169313021":"2024-09-14T02:46:58.936239+0000","172.21.15.89:0/1545508492":"2024-09-14T02:46:58.936239+0000","172.21.15.89:0/431063769":"2024-09-14T02:46:58.936239+0000","172.21.15.89:0/541675685":"2024-09-14T02:46:00.949227+0000","172.21.15.89:0/833000689":"2024-09-14T02:46:00.949227+0000","172.21.15.89:6800/702640100":"2024-09-14T02:46:00.949227+0000","172.21.15.89:6801/702640100":"2024-09-14T02:46:00.949227+0000","172.21.15.89:0/293445085":"2024-09-14T02:46:58.936239+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T02:50:28.846 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:28.844+0000 7f7374a2e640 1 -- 172.21.15.89:0/1383482986 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f735c06ed60 msgr2=0x7f735c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:28.846 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:28.844+0000 7f7374a2e640 1 --2- 172.21.15.89:0/1383482986 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f735c06ed60 0x7f735c071210 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f7358009ac0 tx=0x7f7358035040 comp rx=0 tx=0).stop 2024-09-13T02:50:28.846 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:28.844+0000 7f7374a2e640 1 -- 172.21.15.89:0/1383482986 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f73700fb810 msgr2=0x7f7370112140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:28.846 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:28.844+0000 7f7374a2e640 1 --2- 172.21.15.89:0/1383482986 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f73700fb810 0x7f7370112140 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f736000bbb0 tx=0x7f7360009840 comp rx=0 tx=0).stop 2024-09-13T02:50:28.846 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:28.844+0000 7f7374a2e640 1 -- 172.21.15.89:0/1383482986 shutdown_connections 2024-09-13T02:50:28.846 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:28.844+0000 7f7374a2e640 1 --2- 172.21.15.89:0/1383482986 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f735c06ed60 0x7f735c071210 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:28.846 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:28.844+0000 7f7374a2e640 1 --2- 172.21.15.89:0/1383482986 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f73700fcf80 0x7f7370112680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:28.846 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:28.844+0000 7f7374a2e640 1 --2- 172.21.15.89:0/1383482986 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f73700fb810 0x7f7370112140 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:28.846 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:28.844+0000 7f7374a2e640 1 -- 172.21.15.89:0/1383482986 >> 172.21.15.89:0/1383482986 conn(0x7f73700723b0 msgr2=0x7f73700fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:50:28.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:28.844+0000 7f7374a2e640 1 -- 172.21.15.89:0/1383482986 shutdown_connections 2024-09-13T02:50:28.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:28.844+0000 7f7374a2e640 1 -- 172.21.15.89:0/1383482986 wait complete. 2024-09-13T02:50:29.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:28 smithi131 ceph-mon[34689]: from='client.? 172.21.15.89:0/1383482986' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T02:50:29.199 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:28 smithi089 ceph-mon[27639]: from='client.? 172.21.15.89:0/1383482986' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T02:50:29.631 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-13T02:49:11.235489+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2024-09-13T02:50:29.632 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-13T02:50:29.875 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T02:50:30.169 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:29 smithi089 ceph-mon[27639]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:50:30.169 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:29 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:50:30.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:29 smithi131 ceph-mon[34689]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:50:30.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:29 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:50:31.419 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:31.397+0000 7f22b9671640 1 -- 172.21.15.89:0/3372075048 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22b4102ef0 msgr2=0x7f22b40fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:31.420 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:31.397+0000 7f22b9671640 1 --2- 172.21.15.89:0/3372075048 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22b4102ef0 0x7f22b40fc5b0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f22a80048d0 tx=0x7f22a8009da0 comp rx=0 tx=0).stop 2024-09-13T02:50:31.420 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:31.397+0000 7f22b9671640 1 -- 172.21.15.89:0/3372075048 shutdown_connections 2024-09-13T02:50:31.420 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:31.397+0000 7f22b9671640 1 --2- 172.21.15.89:0/3372075048 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22b4102ef0 0x7f22b40fc5b0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:31.420 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:31.397+0000 7f22b9671640 1 --2- 172.21.15.89:0/3372075048 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f22b4102550 0x7f22b4102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:31.420 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:31.397+0000 7f22b9671640 1 -- 172.21.15.89:0/3372075048 >> 172.21.15.89:0/3372075048 conn(0x7f22b40f80f0 msgr2=0x7f22b40fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:50:31.420 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:31.397+0000 7f22b9671640 1 -- 172.21.15.89:0/3372075048 shutdown_connections 2024-09-13T02:50:31.420 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:31.397+0000 7f22b9671640 1 -- 172.21.15.89:0/3372075048 wait complete. 2024-09-13T02:50:31.420 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:31.398+0000 7f22b9671640 1 Processor -- start 2024-09-13T02:50:31.420 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:31.398+0000 7f22b9671640 1 -- start start 2024-09-13T02:50:31.420 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:31.398+0000 7f22b9671640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f22b4102550 0x7f22b4113520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:31.420 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:31.398+0000 7f22b9671640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22b4102ef0 0x7f22b4113a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:31.421 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:31.398+0000 7f22b9671640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22b41140b0 con 0x7f22b4102ef0 2024-09-13T02:50:31.421 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:31.398+0000 7f22b9671640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22b410d4c0 con 0x7f22b4102550 2024-09-13T02:50:31.421 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:31.398+0000 7f22b27fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22b4102ef0 0x7f22b4113a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:31.421 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:31.398+0000 7f22b27fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22b4102ef0 0x7f22b4113a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:33126/0 (socket says 172.21.15.89:33126) 2024-09-13T02:50:31.421 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:31.398+0000 7f22b27fc640 1 -- 172.21.15.89:0/3957932990 learned_addr learned my addr 172.21.15.89:0/3957932990 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:50:31.421 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:31.398+0000 7f22b2ffd640 1 --2- 172.21.15.89:0/3957932990 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f22b4102550 0x7f22b4113520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:31.421 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:31.398+0000 7f22b27fc640 1 -- 172.21.15.89:0/3957932990 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f22b4102550 msgr2=0x7f22b4113520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:31.421 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:31.398+0000 7f22b27fc640 1 --2- 172.21.15.89:0/3957932990 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f22b4102550 0x7f22b4113520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:31.421 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:31.398+0000 7f22b27fc640 1 -- 172.21.15.89:0/3957932990 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22a8005040 con 0x7f22b4102ef0 2024-09-13T02:50:31.421 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:31.399+0000 7f22b27fc640 1 --2- 172.21.15.89:0/3957932990 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22b4102ef0 0x7f22b4113a60 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f22a8003080 tx=0x7f22a8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:50:31.421 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:31.399+0000 7f229b7fe640 1 -- 172.21.15.89:0/3957932990 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f22a8038070 con 0x7f22b4102ef0 2024-09-13T02:50:31.422 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:31.399+0000 7f22b9671640 1 -- 172.21.15.89:0/3957932990 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22b410d740 con 0x7f22b4102ef0 2024-09-13T02:50:31.422 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:31.399+0000 7f229b7fe640 1 -- 172.21.15.89:0/3957932990 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f22a8009760 con 0x7f22b4102ef0 2024-09-13T02:50:31.422 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:31.399+0000 7f229b7fe640 1 -- 172.21.15.89:0/3957932990 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f22a803d420 con 0x7f22b4102ef0 2024-09-13T02:50:31.422 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:31.399+0000 7f22b9671640 1 -- 172.21.15.89:0/3957932990 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22b410dc80 con 0x7f22b4102ef0 2024-09-13T02:50:31.422 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:31.400+0000 7f22b9671640 1 -- 172.21.15.89:0/3957932990 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22b40fdcd0 con 0x7f22b4102ef0 2024-09-13T02:50:31.422 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:31.400+0000 7f229b7fe640 1 -- 172.21.15.89:0/3957932990 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f22a8030020 con 0x7f22b4102ef0 2024-09-13T02:50:31.422 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:31.401+0000 7f229b7fe640 1 --2- 172.21.15.89:0/3957932990 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f229c06ed50 0x7f229c071200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:31.422 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:31.401+0000 7f229b7fe640 1 -- 172.21.15.89:0/3957932990 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f22a80ae360 con 0x7f22b4102ef0 2024-09-13T02:50:31.422 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:31.401+0000 7f22b2ffd640 1 --2- 172.21.15.89:0/3957932990 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f229c06ed50 0x7f229c071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:31.422 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:31.401+0000 7f22b2ffd640 1 --2- 172.21.15.89:0/3957932990 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f229c06ed50 0x7f229c071200 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f22a40041d0 tx=0x7f22a4009040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:50:31.422 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:31.405+0000 7f229b7fe640 1 -- 172.21.15.89:0/3957932990 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f22a807b7c0 con 0x7f22b4102ef0 2024-09-13T02:50:31.565 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:31.564+0000 7f22b9671640 1 -- 172.21.15.89:0/3957932990 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f22b40fbd50 con 0x7f22b4102ef0 2024-09-13T02:50:31.566 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:31.564+0000 7f229b7fe640 1 -- 172.21.15.89:0/3957932990 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v38) v1 ==== 93+0+10 (secure 0 0 0) 0x7f22a807b160 con 0x7f22b4102ef0 2024-09-13T02:50:31.566 INFO:teuthology.orchestra.run.smithi089.stdout:pg_num: 1 2024-09-13T02:50:31.568 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:31.566+0000 7f22b9671640 1 -- 172.21.15.89:0/3957932990 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f229c06ed50 msgr2=0x7f229c071200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:31.568 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:31.566+0000 7f22b9671640 1 --2- 172.21.15.89:0/3957932990 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f229c06ed50 0x7f229c071200 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f22a40041d0 tx=0x7f22a4009040 comp rx=0 tx=0).stop 2024-09-13T02:50:31.568 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:31.566+0000 7f22b9671640 1 -- 172.21.15.89:0/3957932990 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22b4102ef0 msgr2=0x7f22b4113a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:31.568 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:31.566+0000 7f22b9671640 1 --2- 172.21.15.89:0/3957932990 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22b4102ef0 0x7f22b4113a60 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f22a8003080 tx=0x7f22a8009da0 comp rx=0 tx=0).stop 2024-09-13T02:50:31.568 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:31.567+0000 7f22b9671640 1 -- 172.21.15.89:0/3957932990 shutdown_connections 2024-09-13T02:50:31.568 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:31.567+0000 7f22b9671640 1 --2- 172.21.15.89:0/3957932990 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f22b4102ef0 0x7f22b4113a60 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:31.568 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:31.567+0000 7f22b9671640 1 --2- 172.21.15.89:0/3957932990 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f229c06ed50 0x7f229c071200 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:31.568 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:31.567+0000 7f22b9671640 1 --2- 172.21.15.89:0/3957932990 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f22b4102550 0x7f22b4113520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:31.569 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:31.567+0000 7f22b9671640 1 -- 172.21.15.89:0/3957932990 >> 172.21.15.89:0/3957932990 conn(0x7f22b40f80f0 msgr2=0x7f22b40f9150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:50:31.569 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:31.567+0000 7f22b9671640 1 -- 172.21.15.89:0/3957932990 shutdown_connections 2024-09-13T02:50:31.569 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:31.567+0000 7f22b9671640 1 -- 172.21.15.89:0/3957932990 wait complete. 2024-09-13T02:50:32.237 INFO:tasks.cephadm:Setting up client nodes... 2024-09-13T02:50:32.237 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-13T02:50:32.263 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:32 smithi089 ceph-mon[27639]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:50:32.263 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:32 smithi089 ceph-mon[27639]: from='client.? 172.21.15.89:0/3957932990' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T02:50:32.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:32 smithi131 ceph-mon[34689]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:50:32.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:32 smithi131 ceph-mon[34689]: from='client.? 172.21.15.89:0/3957932990' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-13T02:50:32.487 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T02:50:34.213 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:34.210+0000 7f5158edc640 1 -- 172.21.15.89:0/824109999 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f515406ffe0 msgr2=0x7f5154070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:34.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:34.210+0000 7f5158edc640 1 --2- 172.21.15.89:0/824109999 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f515406ffe0 0x7f5154070450 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f513c0048d0 tx=0x7f513c009da0 comp rx=0 tx=0).stop 2024-09-13T02:50:34.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:34.210+0000 7f5158edc640 1 -- 172.21.15.89:0/824109999 shutdown_connections 2024-09-13T02:50:34.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:34.210+0000 7f5158edc640 1 --2- 172.21.15.89:0/824109999 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f515406ffe0 0x7f5154070450 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:34.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:34.210+0000 7f5158edc640 1 --2- 172.21.15.89:0/824109999 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5154071570 0x7f515406faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:34.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:34.210+0000 7f5158edc640 1 -- 172.21.15.89:0/824109999 >> 172.21.15.89:0/824109999 conn(0x7f51540f7d10 msgr2=0x7f51540fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:50:34.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:34.210+0000 7f5158edc640 1 -- 172.21.15.89:0/824109999 shutdown_connections 2024-09-13T02:50:34.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:34.210+0000 7f5158edc640 1 -- 172.21.15.89:0/824109999 wait complete. 2024-09-13T02:50:34.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:34.210+0000 7f5158edc640 1 Processor -- start 2024-09-13T02:50:34.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:34.210+0000 7f5158edc640 1 -- start start 2024-09-13T02:50:34.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:34.211+0000 7f5158edc640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f515406ffe0 0x7f515410f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:34.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:34.211+0000 7f5158edc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5154071570 0x7f515410f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:34.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:34.211+0000 7f5158edc640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51541106a0 con 0x7f5154071570 2024-09-13T02:50:34.215 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:34.211+0000 7f5158edc640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5154110810 con 0x7f515406ffe0 2024-09-13T02:50:34.215 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:34.211+0000 7f5151d9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5154071570 0x7f515410f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:34.215 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:34.211+0000 7f5151d9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5154071570 0x7f515410f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:33148/0 (socket says 172.21.15.89:33148) 2024-09-13T02:50:34.215 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:34.211+0000 7f5151d9b640 1 -- 172.21.15.89:0/3211936155 learned_addr learned my addr 172.21.15.89:0/3211936155 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:50:34.215 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:34.211+0000 7f515259c640 1 --2- 172.21.15.89:0/3211936155 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f515406ffe0 0x7f515410f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:34.215 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:34.211+0000 7f5151d9b640 1 -- 172.21.15.89:0/3211936155 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f515406ffe0 msgr2=0x7f515410f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:34.215 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:34.211+0000 7f5151d9b640 1 --2- 172.21.15.89:0/3211936155 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f515406ffe0 0x7f515410f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:34.215 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:34.211+0000 7f5151d9b640 1 -- 172.21.15.89:0/3211936155 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f513c005040 con 0x7f5154071570 2024-09-13T02:50:34.215 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:34.211+0000 7f5151d9b640 1 --2- 172.21.15.89:0/3211936155 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5154071570 0x7f515410f830 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f513c003080 tx=0x7f513c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:50:34.215 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:34.211+0000 7f514affd640 1 -- 172.21.15.89:0/3211936155 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f513c038070 con 0x7f5154071570 2024-09-13T02:50:34.215 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:34.211+0000 7f5158edc640 1 -- 172.21.15.89:0/3211936155 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5154110a90 con 0x7f5154071570 2024-09-13T02:50:34.215 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:34.211+0000 7f514affd640 1 -- 172.21.15.89:0/3211936155 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f513c02abd0 con 0x7f5154071570 2024-09-13T02:50:34.215 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:34.211+0000 7f514affd640 1 -- 172.21.15.89:0/3211936155 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f513c03e670 con 0x7f5154071570 2024-09-13T02:50:34.216 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:34.211+0000 7f5158edc640 1 -- 172.21.15.89:0/3211936155 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5154110fb0 con 0x7f5154071570 2024-09-13T02:50:34.216 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:34.212+0000 7f5158edc640 1 -- 172.21.15.89:0/3211936155 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51540fb990 con 0x7f5154071570 2024-09-13T02:50:34.216 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:34.213+0000 7f514affd640 1 -- 172.21.15.89:0/3211936155 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f513c030020 con 0x7f5154071570 2024-09-13T02:50:34.216 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:34.213+0000 7f514affd640 1 --2- 172.21.15.89:0/3211936155 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f514006ed60 0x7f5140071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:34.217 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:34.214+0000 7f514affd640 1 -- 172.21.15.89:0/3211936155 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f513c0ae250 con 0x7f5154071570 2024-09-13T02:50:34.217 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:34.214+0000 7f515259c640 1 --2- 172.21.15.89:0/3211936155 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f514006ed60 0x7f5140071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:34.217 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:34.214+0000 7f515259c640 1 --2- 172.21.15.89:0/3211936155 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f514006ed60 0x7f5140071210 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f51540712d0 tx=0x7f5144009620 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:50:34.218 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:34.217+0000 7f514affd640 1 -- 172.21.15.89:0/3211936155 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f513c07b6b0 con 0x7f5154071570 2024-09-13T02:50:34.284 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:34 smithi089 ceph-mon[27639]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:50:34.432 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:34.431+0000 7f5158edc640 1 -- 172.21.15.89:0/3211936155 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f515404b720 con 0x7f5154071570 2024-09-13T02:50:34.433 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:34 smithi131 ceph-mon[34689]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:50:34.435 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:34.434+0000 7f514affd640 1 -- 172.21.15.89:0/3211936155 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v14) v1 ==== 170+0+59 (secure 0 0 0) 0x7f513c07b050 con 0x7f5154071570 2024-09-13T02:50:34.436 INFO:teuthology.orchestra.run.smithi089.stdout:[client.0] 2024-09-13T02:50:34.436 INFO:teuthology.orchestra.run.smithi089.stdout: key = AQB6qONmsY3EGRAAbdqN55n7/ulGD+NrbXPARw== 2024-09-13T02:50:34.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:34.436+0000 7f5158edc640 1 -- 172.21.15.89:0/3211936155 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f514006ed60 msgr2=0x7f5140071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:34.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:34.436+0000 7f5158edc640 1 --2- 172.21.15.89:0/3211936155 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f514006ed60 0x7f5140071210 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f51540712d0 tx=0x7f5144009620 comp rx=0 tx=0).stop 2024-09-13T02:50:34.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:34.436+0000 7f5158edc640 1 -- 172.21.15.89:0/3211936155 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5154071570 msgr2=0x7f515410f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:34.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:34.436+0000 7f5158edc640 1 --2- 172.21.15.89:0/3211936155 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5154071570 0x7f515410f830 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f513c003080 tx=0x7f513c009da0 comp rx=0 tx=0).stop 2024-09-13T02:50:34.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:34.436+0000 7f5158edc640 1 -- 172.21.15.89:0/3211936155 shutdown_connections 2024-09-13T02:50:34.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:34.436+0000 7f5158edc640 1 --2- 172.21.15.89:0/3211936155 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5154071570 0x7f515410f830 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:34.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:34.436+0000 7f5158edc640 1 --2- 172.21.15.89:0/3211936155 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f514006ed60 0x7f5140071210 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:34.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:34.436+0000 7f5158edc640 1 --2- 172.21.15.89:0/3211936155 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f515406ffe0 0x7f515410f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:34.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:34.436+0000 7f5158edc640 1 -- 172.21.15.89:0/3211936155 >> 172.21.15.89:0/3211936155 conn(0x7f51540f7d10 msgr2=0x7f51540f94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:50:34.438 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:34.436+0000 7f5158edc640 1 -- 172.21.15.89:0/3211936155 shutdown_connections 2024-09-13T02:50:34.439 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:34.436+0000 7f5158edc640 1 -- 172.21.15.89:0/3211936155 wait complete. 2024-09-13T02:50:35.157 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-13T02:50:35.157 DEBUG:teuthology.orchestra.run.smithi089:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-13T02:50:35.157 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-13T02:50:35.234 DEBUG:teuthology.orchestra.run.smithi131:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-13T02:50:35.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:35 smithi089 ceph-mon[27639]: from='client.? 172.21.15.89:0/3211936155' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-13T02:50:35.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:35 smithi089 ceph-mon[27639]: from='client.? 172.21.15.89:0/3211936155' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-13T02:50:35.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:35 smithi131 ceph-mon[34689]: from='client.? 172.21.15.89:0/3211936155' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-13T02:50:35.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:35 smithi131 ceph-mon[34689]: from='client.? 172.21.15.89:0/3211936155' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-13T02:50:35.495 INFO:teuthology.orchestra.run.smithi131.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/mon.smithi131/config 2024-09-13T02:50:36.696 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:36 smithi131 ceph-mon[34689]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:50:36.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:36 smithi089 ceph-mon[27639]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:50:36.997 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:50:36.994+0000 7f515188d640 1 -- 172.21.15.131:0/2262415285 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f514c0fc720 msgr2=0x7f514c0fcb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:36.997 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:50:36.994+0000 7f515188d640 1 --2- 172.21.15.131:0/2262415285 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f514c0fc720 0x7f514c0fcb90 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f51340048d0 tx=0x7f5134009da0 comp rx=0 tx=0).stop 2024-09-13T02:50:36.997 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:50:36.994+0000 7f515188d640 1 -- 172.21.15.131:0/2262415285 shutdown_connections 2024-09-13T02:50:36.997 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:50:36.994+0000 7f515188d640 1 --2- 172.21.15.131:0/2262415285 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f514c0fc720 0x7f514c0fcb90 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:36.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:50:36.994+0000 7f515188d640 1 --2- 172.21.15.131:0/2262415285 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f514c0fb450 0x7f514c0fb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:36.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:50:36.994+0000 7f515188d640 1 -- 172.21.15.131:0/2262415285 >> 172.21.15.131:0/2262415285 conn(0x7f514c0f6c10 msgr2=0x7f514c0f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:50:36.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:50:36.994+0000 7f515188d640 1 -- 172.21.15.131:0/2262415285 shutdown_connections 2024-09-13T02:50:36.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:50:36.994+0000 7f515188d640 1 -- 172.21.15.131:0/2262415285 wait complete. 2024-09-13T02:50:36.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:50:36.995+0000 7f515188d640 1 Processor -- start 2024-09-13T02:50:36.998 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:50:36.995+0000 7f515188d640 1 -- start start 2024-09-13T02:50:36.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:50:36.995+0000 7f515188d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f514c0fb450 0x7f514c10fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:36.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:50:36.995+0000 7f515188d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f514c0fc720 0x7f514c112340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:36.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:50:36.995+0000 7f515188d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f514c0667c0 con 0x7f514c0fc720 2024-09-13T02:50:36.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:50:36.995+0000 7f515188d640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f514c066930 con 0x7f514c0fb450 2024-09-13T02:50:36.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:50:36.995+0000 7f514affd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f514c0fb450 0x7f514c10fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:36.999 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:50:36.995+0000 7f514affd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f514c0fb450 0x7f514c10fdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.131:60402/0 (socket says 172.21.15.131:60402) 2024-09-13T02:50:37.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:50:36.995+0000 7f514affd640 1 -- 172.21.15.131:0/2875419701 learned_addr learned my addr 172.21.15.131:0/2875419701 (peer_addr_for_me v2:172.21.15.131:0/0) 2024-09-13T02:50:37.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:50:36.995+0000 7f5143fff640 1 --2- 172.21.15.131:0/2875419701 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f514c0fc720 0x7f514c112340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:37.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:50:36.995+0000 7f514affd640 1 -- 172.21.15.131:0/2875419701 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f514c0fc720 msgr2=0x7f514c112340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:37.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:50:36.995+0000 7f514affd640 1 --2- 172.21.15.131:0/2875419701 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f514c0fc720 0x7f514c112340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:37.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:50:36.995+0000 7f514affd640 1 -- 172.21.15.131:0/2875419701 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5134005040 con 0x7f514c0fb450 2024-09-13T02:50:37.000 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:50:36.995+0000 7f514affd640 1 --2- 172.21.15.131:0/2875419701 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f514c0fb450 0x7f514c10fdf0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f513c00b790 tx=0x7f513c0091d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:50:37.001 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:50:36.995+0000 7f51437fe640 1 -- 172.21.15.131:0/2875419701 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f513c00c700 con 0x7f514c0fb450 2024-09-13T02:50:37.001 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:50:36.995+0000 7f51437fe640 1 -- 172.21.15.131:0/2875419701 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f513c00cd00 con 0x7f514c0fb450 2024-09-13T02:50:37.001 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:50:36.995+0000 7f515188d640 1 -- 172.21.15.131:0/2875419701 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f514c112940 con 0x7f514c0fb450 2024-09-13T02:50:37.001 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:50:36.996+0000 7f51437fe640 1 -- 172.21.15.131:0/2875419701 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f513c015e80 con 0x7f514c0fb450 2024-09-13T02:50:37.001 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:50:36.996+0000 7f515188d640 1 -- 172.21.15.131:0/2875419701 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f514c112e60 con 0x7f514c0fb450 2024-09-13T02:50:37.003 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:50:36.996+0000 7f515188d640 1 -- 172.21.15.131:0/2875419701 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f514c0fa8b0 con 0x7f514c0fb450 2024-09-13T02:50:37.003 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:50:36.997+0000 7f51437fe640 1 -- 172.21.15.131:0/2875419701 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f513c012070 con 0x7f514c0fb450 2024-09-13T02:50:37.003 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:50:36.997+0000 7f51437fe640 1 --2- 172.21.15.131:0/2875419701 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f513806ed50 0x7f5138071200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:37.003 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:50:36.997+0000 7f51437fe640 1 -- 172.21.15.131:0/2875419701 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f513c08d670 con 0x7f514c0fb450 2024-09-13T02:50:37.003 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:50:36.998+0000 7f5143fff640 1 --2- 172.21.15.131:0/2875419701 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f513806ed50 0x7f5138071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:37.004 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:50:36.999+0000 7f5143fff640 1 --2- 172.21.15.131:0/2875419701 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f513806ed50 0x7f5138071200 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5134000c00 tx=0x7f5134035040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:50:37.004 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:50:37.002+0000 7f51437fe640 1 -- 172.21.15.131:0/2875419701 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f513c05ab50 con 0x7f514c0fb450 2024-09-13T02:50:37.220 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:50:37.216+0000 7f515188d640 1 -- 172.21.15.131:0/2875419701 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f514c04b720 con 0x7f514c0fb450 2024-09-13T02:50:37.222 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:50:37.221+0000 7f51437fe640 1 -- 172.21.15.131:0/2875419701 <== mon.1 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v15) v1 ==== 170+0+59 (secure 0 0 0) 0x7f513c05a4f0 con 0x7f514c0fb450 2024-09-13T02:50:37.222 INFO:teuthology.orchestra.run.smithi131.stdout:[client.1] 2024-09-13T02:50:37.222 INFO:teuthology.orchestra.run.smithi131.stdout: key = AQB9qONmreP6DBAAgyH6A/QVjjgQSntFMNdvNA== 2024-09-13T02:50:37.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:50:37.223+0000 7f515188d640 1 -- 172.21.15.131:0/2875419701 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f513806ed50 msgr2=0x7f5138071200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:37.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:50:37.223+0000 7f515188d640 1 --2- 172.21.15.131:0/2875419701 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f513806ed50 0x7f5138071200 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f5134000c00 tx=0x7f5134035040 comp rx=0 tx=0).stop 2024-09-13T02:50:37.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:50:37.223+0000 7f515188d640 1 -- 172.21.15.131:0/2875419701 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f514c0fb450 msgr2=0x7f514c10fdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:37.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:50:37.223+0000 7f515188d640 1 --2- 172.21.15.131:0/2875419701 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f514c0fb450 0x7f514c10fdf0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f513c00b790 tx=0x7f513c0091d0 comp rx=0 tx=0).stop 2024-09-13T02:50:37.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:50:37.223+0000 7f515188d640 1 -- 172.21.15.131:0/2875419701 shutdown_connections 2024-09-13T02:50:37.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:50:37.223+0000 7f515188d640 1 --2- 172.21.15.131:0/2875419701 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f514c0fc720 0x7f514c112340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:37.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:50:37.223+0000 7f515188d640 1 --2- 172.21.15.131:0/2875419701 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f513806ed50 0x7f5138071200 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:37.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:50:37.223+0000 7f515188d640 1 --2- 172.21.15.131:0/2875419701 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f514c0fb450 0x7f514c10fdf0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:37.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:50:37.223+0000 7f515188d640 1 -- 172.21.15.131:0/2875419701 >> 172.21.15.131:0/2875419701 conn(0x7f514c0f6c10 msgr2=0x7f514c0f8390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:50:37.225 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:50:37.223+0000 7f515188d640 1 -- 172.21.15.131:0/2875419701 shutdown_connections 2024-09-13T02:50:37.226 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:50:37.223+0000 7f515188d640 1 -- 172.21.15.131:0/2875419701 wait complete. 2024-09-13T02:50:37.614 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:37 smithi131 ceph-mon[34689]: from='client.? 172.21.15.131:0/2875419701' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-13T02:50:37.614 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:37 smithi131 ceph-mon[34689]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-13T02:50:37.614 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:37 smithi131 ceph-mon[34689]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-13T02:50:37.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:37 smithi089 ceph-mon[27639]: from='client.? 172.21.15.131:0/2875419701' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-13T02:50:37.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:37 smithi089 ceph-mon[27639]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-13T02:50:37.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:37 smithi089 ceph-mon[27639]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-13T02:50:37.822 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-13T02:50:37.822 DEBUG:teuthology.orchestra.run.smithi131:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-09-13T02:50:37.822 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-13T02:50:37.860 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-13T02:50:37.860 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-13T02:50:37.860 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -- ceph mgr dump --format=json 2024-09-13T02:50:38.114 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T02:50:38.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:38 smithi089 ceph-mon[27639]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:50:38.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:38 smithi131 ceph-mon[34689]: pgmap v135: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:50:39.713 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:39.687+0000 7ff4bcf05640 1 -- 172.21.15.89:0/1850551001 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff4b8064fc0 msgr2=0x7ff4b8065430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:39.713 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:39.687+0000 7ff4bcf05640 1 --2- 172.21.15.89:0/1850551001 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff4b8064fc0 0x7ff4b8065430 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac0048d0 tx=0x7ff4ac009da0 comp rx=0 tx=0).stop 2024-09-13T02:50:39.713 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:39.687+0000 7ff4bcf05640 1 -- 172.21.15.89:0/1850551001 shutdown_connections 2024-09-13T02:50:39.713 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:39.687+0000 7ff4bcf05640 1 --2- 172.21.15.89:0/1850551001 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff4b8064fc0 0x7ff4b8065430 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:39.714 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:39.687+0000 7ff4bcf05640 1 --2- 172.21.15.89:0/1850551001 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff4b80fe460 0x7ff4b80fe830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:39.714 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:39.687+0000 7ff4bcf05640 1 -- 172.21.15.89:0/1850551001 >> 172.21.15.89:0/1850551001 conn(0x7ff4b80723b0 msgr2=0x7ff4b80727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:50:39.714 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:39.687+0000 7ff4bcf05640 1 -- 172.21.15.89:0/1850551001 shutdown_connections 2024-09-13T02:50:39.714 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:39.687+0000 7ff4bcf05640 1 -- 172.21.15.89:0/1850551001 wait complete. 2024-09-13T02:50:39.714 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:39.687+0000 7ff4bcf05640 1 Processor -- start 2024-09-13T02:50:39.714 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:39.687+0000 7ff4bcf05640 1 -- start start 2024-09-13T02:50:39.714 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:39.688+0000 7ff4bcf05640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff4b8064fc0 0x7ff4b81131d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:39.714 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:39.688+0000 7ff4bcf05640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff4b80fe460 0x7ff4b8113710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:39.714 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:39.688+0000 7ff4bcf05640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b8113d10 con 0x7ff4b80fe460 2024-09-13T02:50:39.714 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:39.688+0000 7ff4bcf05640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4b810d1a0 con 0x7ff4b8064fc0 2024-09-13T02:50:39.714 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:39.688+0000 7ff4b5d9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff4b80fe460 0x7ff4b8113710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:39.714 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:39.688+0000 7ff4b5d9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff4b80fe460 0x7ff4b8113710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:33170/0 (socket says 172.21.15.89:33170) 2024-09-13T02:50:39.715 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:39.688+0000 7ff4b5d9b640 1 -- 172.21.15.89:0/3898357834 learned_addr learned my addr 172.21.15.89:0/3898357834 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:50:39.715 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:39.688+0000 7ff4b659c640 1 --2- 172.21.15.89:0/3898357834 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff4b8064fc0 0x7ff4b81131d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:39.715 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:39.688+0000 7ff4b5d9b640 1 -- 172.21.15.89:0/3898357834 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff4b8064fc0 msgr2=0x7ff4b81131d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:39.715 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:39.688+0000 7ff4b5d9b640 1 --2- 172.21.15.89:0/3898357834 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff4b8064fc0 0x7ff4b81131d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:39.715 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:39.688+0000 7ff4b5d9b640 1 -- 172.21.15.89:0/3898357834 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4ac005040 con 0x7ff4b80fe460 2024-09-13T02:50:39.715 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:39.688+0000 7ff4b5d9b640 1 --2- 172.21.15.89:0/3898357834 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff4b80fe460 0x7ff4b8113710 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac003080 tx=0x7ff4ac009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:50:39.715 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:39.688+0000 7ff4a6ffd640 1 -- 172.21.15.89:0/3898357834 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff4ac038070 con 0x7ff4b80fe460 2024-09-13T02:50:39.715 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:39.688+0000 7ff4bcf05640 1 -- 172.21.15.89:0/3898357834 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4b810d420 con 0x7ff4b80fe460 2024-09-13T02:50:39.715 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:39.688+0000 7ff4a6ffd640 1 -- 172.21.15.89:0/3898357834 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff4ac0097e0 con 0x7ff4b80fe460 2024-09-13T02:50:39.715 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:39.688+0000 7ff4a6ffd640 1 -- 172.21.15.89:0/3898357834 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff4ac03d420 con 0x7ff4b80fe460 2024-09-13T02:50:39.715 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:39.688+0000 7ff4bcf05640 1 -- 172.21.15.89:0/3898357834 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4b810d960 con 0x7ff4b80fe460 2024-09-13T02:50:39.715 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:39.689+0000 7ff4bcf05640 1 -- 172.21.15.89:0/3898357834 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4b80fdcf0 con 0x7ff4b80fe460 2024-09-13T02:50:39.715 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:39.690+0000 7ff4a6ffd640 1 -- 172.21.15.89:0/3898357834 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7ff4ac030020 con 0x7ff4b80fe460 2024-09-13T02:50:39.716 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:39.690+0000 7ff4a6ffd640 1 --2- 172.21.15.89:0/3898357834 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7ff4a006ed60 0x7ff4a0071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:39.716 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:39.690+0000 7ff4a6ffd640 1 -- 172.21.15.89:0/3898357834 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7ff4ac0ae470 con 0x7ff4b80fe460 2024-09-13T02:50:39.716 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:39.690+0000 7ff4b659c640 1 --2- 172.21.15.89:0/3898357834 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7ff4a006ed60 0x7ff4a0071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:39.716 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:39.691+0000 7ff4b659c640 1 --2- 172.21.15.89:0/3898357834 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7ff4a006ed60 0x7ff4a0071210 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff4a80041d0 tx=0x7ff4a8009040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:50:39.716 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:39.695+0000 7ff4a6ffd640 1 -- 172.21.15.89:0/3898357834 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7ff4ac07b8d0 con 0x7ff4b80fe460 2024-09-13T02:50:39.891 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:39.889+0000 7ff4bcf05640 1 -- 172.21.15.89:0/3898357834 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7ff4b810e840 con 0x7ff4b80fe460 2024-09-13T02:50:39.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:39.892+0000 7ff4a6ffd640 1 -- 172.21.15.89:0/3898357834 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v19) v1 ==== 74+0+176712 (secure 0 0 0) 0x7ff4ac07b270 con 0x7ff4b80fe460 2024-09-13T02:50:39.896 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:50:39.898 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:39.894+0000 7ff4bcf05640 1 -- 172.21.15.89:0/3898357834 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7ff4a006ed60 msgr2=0x7ff4a0071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:39.898 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:39.894+0000 7ff4bcf05640 1 --2- 172.21.15.89:0/3898357834 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7ff4a006ed60 0x7ff4a0071210 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff4a80041d0 tx=0x7ff4a8009040 comp rx=0 tx=0).stop 2024-09-13T02:50:39.898 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:39.894+0000 7ff4bcf05640 1 -- 172.21.15.89:0/3898357834 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff4b80fe460 msgr2=0x7ff4b8113710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:39.898 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:39.894+0000 7ff4bcf05640 1 --2- 172.21.15.89:0/3898357834 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff4b80fe460 0x7ff4b8113710 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac003080 tx=0x7ff4ac009da0 comp rx=0 tx=0).stop 2024-09-13T02:50:39.898 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:39.894+0000 7ff4bcf05640 1 -- 172.21.15.89:0/3898357834 shutdown_connections 2024-09-13T02:50:39.898 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:39.894+0000 7ff4bcf05640 1 --2- 172.21.15.89:0/3898357834 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff4b80fe460 0x7ff4b8113710 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:39.899 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:39.894+0000 7ff4bcf05640 1 --2- 172.21.15.89:0/3898357834 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7ff4a006ed60 0x7ff4a0071210 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:39.899 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:39.894+0000 7ff4bcf05640 1 --2- 172.21.15.89:0/3898357834 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff4b8064fc0 0x7ff4b81131d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:39.899 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:39.894+0000 7ff4bcf05640 1 -- 172.21.15.89:0/3898357834 >> 172.21.15.89:0/3898357834 conn(0x7ff4b80723b0 msgr2=0x7ff4b81053f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:50:39.899 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:39.894+0000 7ff4bcf05640 1 -- 172.21.15.89:0/3898357834 shutdown_connections 2024-09-13T02:50:39.899 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:39.894+0000 7ff4bcf05640 1 -- 172.21.15.89:0/3898357834 wait complete. 2024-09-13T02:50:40.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:40 smithi089 ceph-mon[27639]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:50:40.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:40 smithi089 ceph-mon[27639]: from='client.? 172.21.15.89:0/3898357834' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-13T02:50:40.568 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":19,"flags":0,"active_gid":14204,"active_name":"smithi089.guohvs","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6800","nonce":1506060926},{"type":"v1","addr":"172.21.15.89:6801","nonce":1506060926}]},"active_addr":"172.21.15.89:6801/1506060926","active_change":"2024-09-13T02:46:58.936352+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":14222,"name":"smithi131.aunbqd","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.89:8443/","prometheus":"http://172.21.15.89:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.89:0","nonce":3491543082}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.89:0","nonce":559661592}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.89:0","nonce":1584789409}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.89:0","nonce":4150204320}]}]} 2024-09-13T02:50:40.574 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-13T02:50:40.574 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-13T02:50:40.574 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-13T02:50:40.736 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:40 smithi131 ceph-mon[34689]: pgmap v136: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:50:40.736 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:40 smithi131 ceph-mon[34689]: from='client.? 172.21.15.89:0/3898357834' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-13T02:50:40.820 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T02:50:42.395 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:42.378+0000 7fa6e131b640 1 -- 172.21.15.89:0/3134909554 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6dc0fe460 msgr2=0x7fa6dc0fe830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:42.396 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:42.378+0000 7fa6e131b640 1 --2- 172.21.15.89:0/3134909554 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6dc0fe460 0x7fa6dc0fe830 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc009c50 tx=0x7fa6cc004d10 comp rx=0 tx=0).stop 2024-09-13T02:50:42.396 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:42.379+0000 7fa6e131b640 1 -- 172.21.15.89:0/3134909554 shutdown_connections 2024-09-13T02:50:42.396 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:42.379+0000 7fa6e131b640 1 --2- 172.21.15.89:0/3134909554 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6dc064fc0 0x7fa6dc065430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:42.396 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:42.379+0000 7fa6e131b640 1 --2- 172.21.15.89:0/3134909554 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6dc0fe460 0x7fa6dc0fe830 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:42.396 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:42.379+0000 7fa6e131b640 1 -- 172.21.15.89:0/3134909554 >> 172.21.15.89:0/3134909554 conn(0x7fa6dc0723b0 msgr2=0x7fa6dc0727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:50:42.396 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:42.379+0000 7fa6e131b640 1 -- 172.21.15.89:0/3134909554 shutdown_connections 2024-09-13T02:50:42.396 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:42.379+0000 7fa6e131b640 1 -- 172.21.15.89:0/3134909554 wait complete. 2024-09-13T02:50:42.396 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:42.379+0000 7fa6e131b640 1 Processor -- start 2024-09-13T02:50:42.396 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:42.379+0000 7fa6e131b640 1 -- start start 2024-09-13T02:50:42.396 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:42.380+0000 7fa6e131b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6dc064fc0 0x7fa6dc113190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:42.396 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:42.380+0000 7fa6e131b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6dc0fe460 0x7fa6dc1136d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:42.397 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:42.380+0000 7fa6e131b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6dc113cd0 con 0x7fa6dc0fe460 2024-09-13T02:50:42.397 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:42.380+0000 7fa6e131b640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6dc10d110 con 0x7fa6dc064fc0 2024-09-13T02:50:42.397 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:42.380+0000 7fa6da7fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6dc0fe460 0x7fa6dc1136d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:42.397 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:42.380+0000 7fa6da7fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6dc0fe460 0x7fa6dc1136d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:52294/0 (socket says 172.21.15.89:52294) 2024-09-13T02:50:42.397 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:42.380+0000 7fa6da7fc640 1 -- 172.21.15.89:0/3344953472 learned_addr learned my addr 172.21.15.89:0/3344953472 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:50:42.397 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:42.380+0000 7fa6daffd640 1 --2- 172.21.15.89:0/3344953472 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6dc064fc0 0x7fa6dc113190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:42.397 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:42.380+0000 7fa6da7fc640 1 -- 172.21.15.89:0/3344953472 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6dc064fc0 msgr2=0x7fa6dc113190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:42.397 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:42.380+0000 7fa6da7fc640 1 --2- 172.21.15.89:0/3344953472 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6dc064fc0 0x7fa6dc113190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:42.397 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:42.380+0000 7fa6da7fc640 1 -- 172.21.15.89:0/3344953472 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6cc0098b0 con 0x7fa6dc0fe460 2024-09-13T02:50:42.398 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:42.380+0000 7fa6da7fc640 1 --2- 172.21.15.89:0/3344953472 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6dc0fe460 0x7fa6dc1136d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa6d0002a80 tx=0x7fa6d0004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:50:42.398 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:42.380+0000 7fa6c37fe640 1 -- 172.21.15.89:0/3344953472 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa6d0007c30 con 0x7fa6dc0fe460 2024-09-13T02:50:42.398 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:42.380+0000 7fa6e131b640 1 -- 172.21.15.89:0/3344953472 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6dc10d3f0 con 0x7fa6dc0fe460 2024-09-13T02:50:42.398 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:42.380+0000 7fa6c37fe640 1 -- 172.21.15.89:0/3344953472 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa6d000f040 con 0x7fa6dc0fe460 2024-09-13T02:50:42.398 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:42.380+0000 7fa6c37fe640 1 -- 172.21.15.89:0/3344953472 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa6d0009530 con 0x7fa6dc0fe460 2024-09-13T02:50:42.398 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:42.380+0000 7fa6e131b640 1 -- 172.21.15.89:0/3344953472 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6dc10d910 con 0x7fa6dc0fe460 2024-09-13T02:50:42.398 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:42.381+0000 7fa6e131b640 1 -- 172.21.15.89:0/3344953472 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6dc0fdcf0 con 0x7fa6dc0fe460 2024-09-13T02:50:42.398 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:42.382+0000 7fa6c37fe640 1 -- 172.21.15.89:0/3344953472 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fa6d00097a0 con 0x7fa6dc0fe460 2024-09-13T02:50:42.398 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:42.382+0000 7fa6c37fe640 1 --2- 172.21.15.89:0/3344953472 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fa6c406ed60 0x7fa6c4071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:42.398 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:42.382+0000 7fa6c37fe640 1 -- 172.21.15.89:0/3344953472 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fa6d008d800 con 0x7fa6dc0fe460 2024-09-13T02:50:42.399 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:42.382+0000 7fa6daffd640 1 --2- 172.21.15.89:0/3344953472 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fa6c406ed60 0x7fa6c4071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:42.399 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:42.383+0000 7fa6daffd640 1 --2- 172.21.15.89:0/3344953472 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fa6c406ed60 0x7fa6c4071210 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc004a30 tx=0x7fa6cc004d10 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:50:42.399 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:42.386+0000 7fa6c37fe640 1 -- 172.21.15.89:0/3344953472 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fa6d004d2a0 con 0x7fa6dc0fe460 2024-09-13T02:50:42.551 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:42.549+0000 7fa6e131b640 1 -- 172.21.15.89:0/3344953472 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa6dc10e830 con 0x7fa6dc0fe460 2024-09-13T02:50:42.551 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:42.550+0000 7fa6c37fe640 1 -- 172.21.15.89:0/3344953472 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+11078 (secure 0 0 0) 0x7fa6d005ac60 con 0x7fa6dc0fe460 2024-09-13T02:50:42.552 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:50:42.552 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":38,"fsid":"12cdb164-717a-11ef-bceb-c7b262605968","created":"2024-09-13T02:45:05.519433+0000","modified":"2024-09-13T02:50:23.815280+0000","last_up_change":"2024-09-13T02:50:22.813558+0000","last_in_change":"2024-09-13T02:50:04.816334+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T02:49:11.235489+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"35210318-1c6c-4541-a94a-f9842c6bceba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":768220523},{"type":"v1","addr":"172.21.15.89:6803","nonce":768220523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":768220523},{"type":"v1","addr":"172.21.15.89:6805","nonce":768220523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":768220523},{"type":"v1","addr":"172.21.15.89:6809","nonce":768220523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":768220523},{"type":"v1","addr":"172.21.15.89:6807","nonce":768220523}]},"public_addr":"172.21.15.89:6803/768220523","cluster_addr":"172.21.15.89:6805/768220523","heartbeat_back_addr":"172.21.15.89:6809/768220523","heartbeat_front_addr":"172.21.15.89:6807/768220523","state":["exists","up"]},{"osd":1,"uuid":"19f1a315-6f5b-41d9-9cc3-04b7d3eaf4d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":3034426190},{"type":"v1","addr":"172.21.15.89:6811","nonce":3034426190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":3034426190},{"type":"v1","addr":"172.21.15.89:6813","nonce":3034426190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":3034426190},{"type":"v1","addr":"172.21.15.89:6817","nonce":3034426190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":3034426190},{"type":"v1","addr":"172.21.15.89:6815","nonce":3034426190}]},"public_addr":"172.21.15.89:6811/3034426190","cluster_addr":"172.21.15.89:6813/3034426190","heartbeat_back_addr":"172.21.15.89:6817/3034426190","heartbeat_front_addr":"172.21.15.89:6815/3034426190","state":["exists","up"]},{"osd":2,"uuid":"4032071a-32a2-46af-9c08-b01ae52359d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":2876061357},{"type":"v1","addr":"172.21.15.89:6819","nonce":2876061357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":2876061357},{"type":"v1","addr":"172.21.15.89:6821","nonce":2876061357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":2876061357},{"type":"v1","addr":"172.21.15.89:6825","nonce":2876061357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":2876061357},{"type":"v1","addr":"172.21.15.89:6823","nonce":2876061357}]},"public_addr":"172.21.15.89:6819/2876061357","cluster_addr":"172.21.15.89:6821/2876061357","heartbeat_back_addr":"172.21.15.89:6825/2876061357","heartbeat_front_addr":"172.21.15.89:6823/2876061357","state":["exists","up"]},{"osd":3,"uuid":"9f04f440-e9b7-422d-9b56-1cee78aa76a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":2299999552},{"type":"v1","addr":"172.21.15.131:6801","nonce":2299999552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":2299999552},{"type":"v1","addr":"172.21.15.131:6803","nonce":2299999552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":2299999552},{"type":"v1","addr":"172.21.15.131:6807","nonce":2299999552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":2299999552},{"type":"v1","addr":"172.21.15.131:6805","nonce":2299999552}]},"public_addr":"172.21.15.131:6801/2299999552","cluster_addr":"172.21.15.131:6803/2299999552","heartbeat_back_addr":"172.21.15.131:6807/2299999552","heartbeat_front_addr":"172.21.15.131:6805/2299999552","state":["exists","up"]},{"osd":4,"uuid":"c7fcc566-b36d-4f22-ad23-784464e91d2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":3134834192},{"type":"v1","addr":"172.21.15.131:6809","nonce":3134834192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":3134834192},{"type":"v1","addr":"172.21.15.131:6811","nonce":3134834192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":3134834192},{"type":"v1","addr":"172.21.15.131:6815","nonce":3134834192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":3134834192},{"type":"v1","addr":"172.21.15.131:6813","nonce":3134834192}]},"public_addr":"172.21.15.131:6809/3134834192","cluster_addr":"172.21.15.131:6811/3134834192","heartbeat_back_addr":"172.21.15.131:6815/3134834192","heartbeat_front_addr":"172.21.15.131:6813/3134834192","state":["exists","up"]},{"osd":5,"uuid":"a1b629b9-9946-42d0-ae1b-d093ea4cadbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2725649505},{"type":"v1","addr":"172.21.15.131:6817","nonce":2725649505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":2725649505},{"type":"v1","addr":"172.21.15.131:6819","nonce":2725649505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":2725649505},{"type":"v1","addr":"172.21.15.131:6823","nonce":2725649505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":2725649505},{"type":"v1","addr":"172.21.15.131:6821","nonce":2725649505}]},"public_addr":"172.21.15.131:6817/2725649505","cluster_addr":"172.21.15.131:6819/2725649505","heartbeat_back_addr":"172.21.15.131:6823/2725649505","heartbeat_front_addr":"172.21.15.131:6821/2725649505","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T02:48:12.912627+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T02:48:39.359413+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T02:49:08.617586+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T02:49:32.244261+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T02:49:56.840787+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T02:50:21.057167+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.89:6800/3169313021":"2024-09-14T02:46:58.936239+0000","172.21.15.89:6800/3982028315":"2024-09-14T02:45:32.668116+0000","172.21.15.89:0/507534695":"2024-09-14T02:45:32.668116+0000","172.21.15.89:0/1261668205":"2024-09-14T02:45:32.668116+0000","172.21.15.89:0/1988451185":"2024-09-14T02:45:32.668116+0000","172.21.15.89:6801/3982028315":"2024-09-14T02:45:32.668116+0000","172.21.15.89:0/3043630910":"2024-09-14T02:46:00.949227+0000","172.21.15.89:6801/3169313021":"2024-09-14T02:46:58.936239+0000","172.21.15.89:0/1545508492":"2024-09-14T02:46:58.936239+0000","172.21.15.89:0/431063769":"2024-09-14T02:46:58.936239+0000","172.21.15.89:0/541675685":"2024-09-14T02:46:00.949227+0000","172.21.15.89:0/833000689":"2024-09-14T02:46:00.949227+0000","172.21.15.89:6800/702640100":"2024-09-14T02:46:00.949227+0000","172.21.15.89:6801/702640100":"2024-09-14T02:46:00.949227+0000","172.21.15.89:0/293445085":"2024-09-14T02:46:58.936239+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T02:50:42.554 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:42.552+0000 7fa6e131b640 1 -- 172.21.15.89:0/3344953472 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fa6c406ed60 msgr2=0x7fa6c4071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:42.554 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:42.552+0000 7fa6e131b640 1 --2- 172.21.15.89:0/3344953472 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fa6c406ed60 0x7fa6c4071210 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa6cc004a30 tx=0x7fa6cc004d10 comp rx=0 tx=0).stop 2024-09-13T02:50:42.554 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:42.552+0000 7fa6e131b640 1 -- 172.21.15.89:0/3344953472 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6dc0fe460 msgr2=0x7fa6dc1136d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:42.554 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:42.552+0000 7fa6e131b640 1 --2- 172.21.15.89:0/3344953472 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6dc0fe460 0x7fa6dc1136d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fa6d0002a80 tx=0x7fa6d0004600 comp rx=0 tx=0).stop 2024-09-13T02:50:42.554 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:42.552+0000 7fa6e131b640 1 -- 172.21.15.89:0/3344953472 shutdown_connections 2024-09-13T02:50:42.555 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:42.552+0000 7fa6e131b640 1 --2- 172.21.15.89:0/3344953472 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6dc0fe460 0x7fa6dc1136d0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:42.555 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:42.552+0000 7fa6e131b640 1 --2- 172.21.15.89:0/3344953472 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fa6c406ed60 0x7fa6c4071210 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:42.555 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:42.552+0000 7fa6e131b640 1 --2- 172.21.15.89:0/3344953472 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6dc064fc0 0x7fa6dc113190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:42.555 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:42.552+0000 7fa6e131b640 1 -- 172.21.15.89:0/3344953472 >> 172.21.15.89:0/3344953472 conn(0x7fa6dc0723b0 msgr2=0x7fa6dc105410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:50:42.555 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:42.552+0000 7fa6e131b640 1 -- 172.21.15.89:0/3344953472 shutdown_connections 2024-09-13T02:50:42.555 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:42.552+0000 7fa6e131b640 1 -- 172.21.15.89:0/3344953472 wait complete. 2024-09-13T02:50:42.563 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:42 smithi089 ceph-mon[27639]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:50:42.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:42 smithi131 ceph-mon[34689]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:50:43.259 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-13T02:50:43.260 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-13T02:50:43.503 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T02:50:43.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:43 smithi089 ceph-mon[27639]: from='client.? 172.21.15.89:0/3344953472' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T02:50:43.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:43 smithi131 ceph-mon[34689]: from='client.? 172.21.15.89:0/3344953472' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T02:50:44.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:44 smithi089 ceph-mon[27639]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:50:44.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:44 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:50:44.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:44 smithi131 ceph-mon[34689]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:50:44.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:44 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:50:45.192 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:45.189+0000 7f6a40620640 1 -- 172.21.15.89:0/2577863366 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a380fac80 msgr2=0x7f6a380fb0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:45.192 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:45.189+0000 7f6a40620640 1 --2- 172.21.15.89:0/2577863366 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a380fac80 0x7f6a380fb0d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f6a280048d0 tx=0x7f6a28009da0 comp rx=0 tx=0).stop 2024-09-13T02:50:45.192 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:45.189+0000 7f6a40620640 1 -- 172.21.15.89:0/2577863366 shutdown_connections 2024-09-13T02:50:45.193 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:45.189+0000 7f6a40620640 1 --2- 172.21.15.89:0/2577863366 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a380fac80 0x7f6a380fb0d0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:45.193 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:45.189+0000 7f6a40620640 1 --2- 172.21.15.89:0/2577863366 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6a38102660 0x7f6a38102a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:45.193 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:45.189+0000 7f6a40620640 1 -- 172.21.15.89:0/2577863366 >> 172.21.15.89:0/2577863366 conn(0x7f6a38070ce0 msgr2=0x7f6a380710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:50:45.193 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:45.189+0000 7f6a40620640 1 -- 172.21.15.89:0/2577863366 shutdown_connections 2024-09-13T02:50:45.193 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:45.189+0000 7f6a40620640 1 -- 172.21.15.89:0/2577863366 wait complete. 2024-09-13T02:50:45.193 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:45.190+0000 7f6a40620640 1 Processor -- start 2024-09-13T02:50:45.193 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:45.190+0000 7f6a40620640 1 -- start start 2024-09-13T02:50:45.193 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:45.190+0000 7f6a40620640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6a380fac80 0x7f6a38113190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:45.193 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:45.190+0000 7f6a40620640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a38102660 0x7f6a381136d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:45.193 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:45.190+0000 7f6a40620640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a38113cd0 con 0x7f6a38102660 2024-09-13T02:50:45.193 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:45.190+0000 7f6a40620640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a38113e40 con 0x7f6a380fac80 2024-09-13T02:50:45.193 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:45.190+0000 7f6a3dbbb640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a38102660 0x7f6a381136d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:45.194 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:45.190+0000 7f6a3dbbb640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a38102660 0x7f6a381136d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:52310/0 (socket says 172.21.15.89:52310) 2024-09-13T02:50:45.194 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:45.190+0000 7f6a3dbbb640 1 -- 172.21.15.89:0/3570681950 learned_addr learned my addr 172.21.15.89:0/3570681950 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:50:45.194 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:45.190+0000 7f6a3e3bc640 1 --2- 172.21.15.89:0/3570681950 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6a380fac80 0x7f6a38113190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:45.194 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:45.190+0000 7f6a3dbbb640 1 -- 172.21.15.89:0/3570681950 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6a380fac80 msgr2=0x7f6a38113190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:45.194 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:45.190+0000 7f6a3dbbb640 1 --2- 172.21.15.89:0/3570681950 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6a380fac80 0x7f6a38113190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:45.194 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:45.190+0000 7f6a3dbbb640 1 -- 172.21.15.89:0/3570681950 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a28005040 con 0x7f6a38102660 2024-09-13T02:50:45.194 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:45.190+0000 7f6a3e3bc640 1 --2- 172.21.15.89:0/3570681950 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6a380fac80 0x7f6a38113190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T02:50:45.194 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:45.190+0000 7f6a3dbbb640 1 --2- 172.21.15.89:0/3570681950 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a38102660 0x7f6a381136d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f6a28003080 tx=0x7f6a28009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:50:45.194 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:45.191+0000 7f6a2effd640 1 -- 172.21.15.89:0/3570681950 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a28038070 con 0x7f6a38102660 2024-09-13T02:50:45.194 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:45.191+0000 7f6a2effd640 1 -- 172.21.15.89:0/3570681950 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f6a280097e0 con 0x7f6a38102660 2024-09-13T02:50:45.194 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:45.191+0000 7f6a40620640 1 -- 172.21.15.89:0/3570681950 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a3810d260 con 0x7f6a38102660 2024-09-13T02:50:45.194 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:45.191+0000 7f6a2effd640 1 -- 172.21.15.89:0/3570681950 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a2803d420 con 0x7f6a38102660 2024-09-13T02:50:45.194 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:45.191+0000 7f6a40620640 1 -- 172.21.15.89:0/3570681950 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a3810d7a0 con 0x7f6a38102660 2024-09-13T02:50:45.195 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:45.192+0000 7f6a40620640 1 -- 172.21.15.89:0/3570681950 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a380657d0 con 0x7f6a38102660 2024-09-13T02:50:45.195 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:45.192+0000 7f6a2effd640 1 -- 172.21.15.89:0/3570681950 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f6a28030020 con 0x7f6a38102660 2024-09-13T02:50:45.196 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:45.193+0000 7f6a2effd640 1 --2- 172.21.15.89:0/3570681950 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f6a2406ed60 0x7f6a24071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:45.196 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:45.193+0000 7f6a2effd640 1 -- 172.21.15.89:0/3570681950 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f6a280ae470 con 0x7f6a38102660 2024-09-13T02:50:45.196 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:45.193+0000 7f6a3e3bc640 1 --2- 172.21.15.89:0/3570681950 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f6a2406ed60 0x7f6a24071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:45.196 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:45.193+0000 7f6a3e3bc640 1 --2- 172.21.15.89:0/3570681950 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f6a2406ed60 0x7f6a24071210 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6a34004e60 tx=0x7f6a34009040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:50:45.198 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:45.197+0000 7f6a2effd640 1 -- 172.21.15.89:0/3570681950 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f6a2807b8d0 con 0x7f6a38102660 2024-09-13T02:50:45.353 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:45.352+0000 7f6a40620640 1 -- 172.21.15.89:0/3570681950 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6a38109600 con 0x7f6a38102660 2024-09-13T02:50:45.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:45.352+0000 7f6a2effd640 1 -- 172.21.15.89:0/3570681950 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+11078 (secure 0 0 0) 0x7f6a2807b270 con 0x7f6a38102660 2024-09-13T02:50:45.354 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:50:45.354 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":38,"fsid":"12cdb164-717a-11ef-bceb-c7b262605968","created":"2024-09-13T02:45:05.519433+0000","modified":"2024-09-13T02:50:23.815280+0000","last_up_change":"2024-09-13T02:50:22.813558+0000","last_in_change":"2024-09-13T02:50:04.816334+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-13T02:49:11.235489+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"35210318-1c6c-4541-a94a-f9842c6bceba","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6802","nonce":768220523},{"type":"v1","addr":"172.21.15.89:6803","nonce":768220523}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6804","nonce":768220523},{"type":"v1","addr":"172.21.15.89:6805","nonce":768220523}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6808","nonce":768220523},{"type":"v1","addr":"172.21.15.89:6809","nonce":768220523}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6806","nonce":768220523},{"type":"v1","addr":"172.21.15.89:6807","nonce":768220523}]},"public_addr":"172.21.15.89:6803/768220523","cluster_addr":"172.21.15.89:6805/768220523","heartbeat_back_addr":"172.21.15.89:6809/768220523","heartbeat_front_addr":"172.21.15.89:6807/768220523","state":["exists","up"]},{"osd":1,"uuid":"19f1a315-6f5b-41d9-9cc3-04b7d3eaf4d6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6810","nonce":3034426190},{"type":"v1","addr":"172.21.15.89:6811","nonce":3034426190}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6812","nonce":3034426190},{"type":"v1","addr":"172.21.15.89:6813","nonce":3034426190}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6816","nonce":3034426190},{"type":"v1","addr":"172.21.15.89:6817","nonce":3034426190}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6814","nonce":3034426190},{"type":"v1","addr":"172.21.15.89:6815","nonce":3034426190}]},"public_addr":"172.21.15.89:6811/3034426190","cluster_addr":"172.21.15.89:6813/3034426190","heartbeat_back_addr":"172.21.15.89:6817/3034426190","heartbeat_front_addr":"172.21.15.89:6815/3034426190","state":["exists","up"]},{"osd":2,"uuid":"4032071a-32a2-46af-9c08-b01ae52359d5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6818","nonce":2876061357},{"type":"v1","addr":"172.21.15.89:6819","nonce":2876061357}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6820","nonce":2876061357},{"type":"v1","addr":"172.21.15.89:6821","nonce":2876061357}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6824","nonce":2876061357},{"type":"v1","addr":"172.21.15.89:6825","nonce":2876061357}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6822","nonce":2876061357},{"type":"v1","addr":"172.21.15.89:6823","nonce":2876061357}]},"public_addr":"172.21.15.89:6819/2876061357","cluster_addr":"172.21.15.89:6821/2876061357","heartbeat_back_addr":"172.21.15.89:6825/2876061357","heartbeat_front_addr":"172.21.15.89:6823/2876061357","state":["exists","up"]},{"osd":3,"uuid":"9f04f440-e9b7-422d-9b56-1cee78aa76a3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6800","nonce":2299999552},{"type":"v1","addr":"172.21.15.131:6801","nonce":2299999552}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6802","nonce":2299999552},{"type":"v1","addr":"172.21.15.131:6803","nonce":2299999552}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6806","nonce":2299999552},{"type":"v1","addr":"172.21.15.131:6807","nonce":2299999552}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6804","nonce":2299999552},{"type":"v1","addr":"172.21.15.131:6805","nonce":2299999552}]},"public_addr":"172.21.15.131:6801/2299999552","cluster_addr":"172.21.15.131:6803/2299999552","heartbeat_back_addr":"172.21.15.131:6807/2299999552","heartbeat_front_addr":"172.21.15.131:6805/2299999552","state":["exists","up"]},{"osd":4,"uuid":"c7fcc566-b36d-4f22-ad23-784464e91d2c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6808","nonce":3134834192},{"type":"v1","addr":"172.21.15.131:6809","nonce":3134834192}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6810","nonce":3134834192},{"type":"v1","addr":"172.21.15.131:6811","nonce":3134834192}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6814","nonce":3134834192},{"type":"v1","addr":"172.21.15.131:6815","nonce":3134834192}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6812","nonce":3134834192},{"type":"v1","addr":"172.21.15.131:6813","nonce":3134834192}]},"public_addr":"172.21.15.131:6809/3134834192","cluster_addr":"172.21.15.131:6811/3134834192","heartbeat_back_addr":"172.21.15.131:6815/3134834192","heartbeat_front_addr":"172.21.15.131:6813/3134834192","state":["exists","up"]},{"osd":5,"uuid":"a1b629b9-9946-42d0-ae1b-d093ea4cadbf","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6816","nonce":2725649505},{"type":"v1","addr":"172.21.15.131:6817","nonce":2725649505}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6818","nonce":2725649505},{"type":"v1","addr":"172.21.15.131:6819","nonce":2725649505}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6822","nonce":2725649505},{"type":"v1","addr":"172.21.15.131:6823","nonce":2725649505}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6820","nonce":2725649505},{"type":"v1","addr":"172.21.15.131:6821","nonce":2725649505}]},"public_addr":"172.21.15.131:6817/2725649505","cluster_addr":"172.21.15.131:6819/2725649505","heartbeat_back_addr":"172.21.15.131:6823/2725649505","heartbeat_front_addr":"172.21.15.131:6821/2725649505","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T02:48:12.912627+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T02:48:39.359413+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T02:49:08.617586+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T02:49:32.244261+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T02:49:56.840787+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-09-13T02:50:21.057167+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.89:6800/3169313021":"2024-09-14T02:46:58.936239+0000","172.21.15.89:6800/3982028315":"2024-09-14T02:45:32.668116+0000","172.21.15.89:0/507534695":"2024-09-14T02:45:32.668116+0000","172.21.15.89:0/1261668205":"2024-09-14T02:45:32.668116+0000","172.21.15.89:0/1988451185":"2024-09-14T02:45:32.668116+0000","172.21.15.89:6801/3982028315":"2024-09-14T02:45:32.668116+0000","172.21.15.89:0/3043630910":"2024-09-14T02:46:00.949227+0000","172.21.15.89:6801/3169313021":"2024-09-14T02:46:58.936239+0000","172.21.15.89:0/1545508492":"2024-09-14T02:46:58.936239+0000","172.21.15.89:0/431063769":"2024-09-14T02:46:58.936239+0000","172.21.15.89:0/541675685":"2024-09-14T02:46:00.949227+0000","172.21.15.89:0/833000689":"2024-09-14T02:46:00.949227+0000","172.21.15.89:6800/702640100":"2024-09-14T02:46:00.949227+0000","172.21.15.89:6801/702640100":"2024-09-14T02:46:00.949227+0000","172.21.15.89:0/293445085":"2024-09-14T02:46:58.936239+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-13T02:50:45.356 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:45.354+0000 7f6a40620640 1 -- 172.21.15.89:0/3570681950 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f6a2406ed60 msgr2=0x7f6a24071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:45.356 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:45.354+0000 7f6a40620640 1 --2- 172.21.15.89:0/3570681950 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f6a2406ed60 0x7f6a24071210 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6a34004e60 tx=0x7f6a34009040 comp rx=0 tx=0).stop 2024-09-13T02:50:45.356 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:45.354+0000 7f6a40620640 1 -- 172.21.15.89:0/3570681950 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a38102660 msgr2=0x7f6a381136d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:45.356 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:45.354+0000 7f6a40620640 1 --2- 172.21.15.89:0/3570681950 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a38102660 0x7f6a381136d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f6a28003080 tx=0x7f6a28009da0 comp rx=0 tx=0).stop 2024-09-13T02:50:45.356 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:45.354+0000 7f6a40620640 1 -- 172.21.15.89:0/3570681950 shutdown_connections 2024-09-13T02:50:45.356 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:45.354+0000 7f6a40620640 1 --2- 172.21.15.89:0/3570681950 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6a38102660 0x7f6a381136d0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:45.356 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:45.354+0000 7f6a40620640 1 --2- 172.21.15.89:0/3570681950 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f6a2406ed60 0x7f6a24071210 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:45.356 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:45.354+0000 7f6a40620640 1 --2- 172.21.15.89:0/3570681950 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6a380fac80 0x7f6a38113190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:45.356 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:45.354+0000 7f6a40620640 1 -- 172.21.15.89:0/3570681950 >> 172.21.15.89:0/3570681950 conn(0x7f6a38070ce0 msgr2=0x7f6a380fa0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:50:45.356 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:45.354+0000 7f6a40620640 1 -- 172.21.15.89:0/3570681950 shutdown_connections 2024-09-13T02:50:45.357 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:45.354+0000 7f6a40620640 1 -- 172.21.15.89:0/3570681950 wait complete. 2024-09-13T02:50:45.709 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:45 smithi089 ceph-mon[27639]: from='client.? 172.21.15.89:0/3570681950' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T02:50:45.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:45 smithi131 ceph-mon[34689]: from='client.? 172.21.15.89:0/3570681950' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-13T02:50:46.088 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-13T02:50:46.088 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-13T02:50:46.089 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-13T02:50:46.089 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-13T02:50:46.090 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-13T02:50:46.090 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-13T02:50:46.411 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T02:50:46.415 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T02:50:46.781 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:46 smithi089 ceph-mon[27639]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:50:46.933 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:46 smithi131 ceph-mon[34689]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:50:47.719 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T02:50:48.391 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T02:50:48.392 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T02:50:48.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:48 smithi089 ceph-mon[27639]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:50:48.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:48 smithi131 ceph-mon[34689]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:50:50.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:50 smithi089 ceph-mon[27639]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:50:50.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:50 smithi131 ceph-mon[34689]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:50:51.407 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T02:50:52.726 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:52 smithi089 ceph-mon[27639]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:50:52.933 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:52 smithi131 ceph-mon[34689]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:50:53.879 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.877+0000 7f0056b6f640 1 -- 172.21.15.89:0/3021427744 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f00500fcf80 msgr2=0x7f00500fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:53.879 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.877+0000 7f0056b6f640 1 --2- 172.21.15.89:0/3021427744 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f00500fcf80 0x7f00500fd3d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f003c0048d0 tx=0x7f003c009da0 comp rx=0 tx=0).stop 2024-09-13T02:50:53.879 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.877+0000 7f0056b6f640 1 -- 172.21.15.89:0/3021427744 shutdown_connections 2024-09-13T02:50:53.879 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.877+0000 7f0056b6f640 1 --2- 172.21.15.89:0/3021427744 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f00500fcf80 0x7f00500fd3d0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:53.879 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.877+0000 7f0056b6f640 1 --2- 172.21.15.89:0/3021427744 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f00500fb810 0x7f00500fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:53.880 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.877+0000 7f0056b6f640 1 -- 172.21.15.89:0/3021427744 >> 172.21.15.89:0/3021427744 conn(0x7f00500723b0 msgr2=0x7f00500727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:50:53.880 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.877+0000 7f0056b6f640 1 -- 172.21.15.89:0/3021427744 shutdown_connections 2024-09-13T02:50:53.880 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.877+0000 7f0056b6f640 1 -- 172.21.15.89:0/3021427744 wait complete. 2024-09-13T02:50:53.880 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.878+0000 7f0056b6f640 1 Processor -- start 2024-09-13T02:50:53.880 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.878+0000 7f0056b6f640 1 -- start start 2024-09-13T02:50:53.882 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.878+0000 7f0056b6f640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f00500fb810 0x7f005010e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:53.882 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.878+0000 7f0056b6f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f00500fcf80 0x7f005010e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:53.882 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.878+0000 7f0056b6f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f005010ed30 con 0x7f00500fcf80 2024-09-13T02:50:53.882 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.878+0000 7f0056b6f640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f005010eea0 con 0x7f00500fb810 2024-09-13T02:50:53.882 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.878+0000 7f004ffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f00500fcf80 0x7f005010e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:53.882 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.878+0000 7f004ffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f00500fcf80 0x7f005010e7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34714/0 (socket says 172.21.15.89:34714) 2024-09-13T02:50:53.882 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.878+0000 7f004ffff640 1 -- 172.21.15.89:0/1561900097 learned_addr learned my addr 172.21.15.89:0/1561900097 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:50:53.882 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.879+0000 7f005490b640 1 --2- 172.21.15.89:0/1561900097 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f00500fb810 0x7f005010e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:53.882 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.879+0000 7f004ffff640 1 -- 172.21.15.89:0/1561900097 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f00500fb810 msgr2=0x7f005010e2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:53.882 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.879+0000 7f004ffff640 1 --2- 172.21.15.89:0/1561900097 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f00500fb810 0x7f005010e2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:53.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.879+0000 7f004ffff640 1 -- 172.21.15.89:0/1561900097 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f003c005040 con 0x7f00500fcf80 2024-09-13T02:50:53.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.879+0000 7f005490b640 1 --2- 172.21.15.89:0/1561900097 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f00500fb810 0x7f005010e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T02:50:53.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.879+0000 7f004ffff640 1 --2- 172.21.15.89:0/1561900097 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f00500fcf80 0x7f005010e7f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f003c003080 tx=0x7f003c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:50:53.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.879+0000 7f004d7fa640 1 -- 172.21.15.89:0/1561900097 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f003c038070 con 0x7f00500fcf80 2024-09-13T02:50:53.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.879+0000 7f004d7fa640 1 -- 172.21.15.89:0/1561900097 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f003c0097e0 con 0x7f00500fcf80 2024-09-13T02:50:53.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.879+0000 7f0056b6f640 1 -- 172.21.15.89:0/1561900097 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0050117180 con 0x7f00500fcf80 2024-09-13T02:50:53.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.879+0000 7f004d7fa640 1 -- 172.21.15.89:0/1561900097 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f003c03d420 con 0x7f00500fcf80 2024-09-13T02:50:53.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.879+0000 7f0056b6f640 1 -- 172.21.15.89:0/1561900097 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0050117640 con 0x7f00500fcf80 2024-09-13T02:50:53.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.880+0000 7f0056b6f640 1 -- 172.21.15.89:0/1561900097 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f00500fae90 con 0x7f00500fcf80 2024-09-13T02:50:53.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.881+0000 7f004d7fa640 1 -- 172.21.15.89:0/1561900097 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f003c030020 con 0x7f00500fcf80 2024-09-13T02:50:53.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.881+0000 7f004d7fa640 1 --2- 172.21.15.89:0/1561900097 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f004006ed60 0x7f0040071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:53.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.881+0000 7f004d7fa640 1 -- 172.21.15.89:0/1561900097 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f003c0ae370 con 0x7f00500fcf80 2024-09-13T02:50:53.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.881+0000 7f005490b640 1 --2- 172.21.15.89:0/1561900097 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f004006ed60 0x7f0040071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:53.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.881+0000 7f004d7fa640 1 --2- 172.21.15.89:0/1561900097 >> [v2:172.21.15.89:6810/3034426190,v1:172.21.15.89:6811/3034426190] conn(0x7f0040074ae0 0x7f0040076ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:53.884 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.881+0000 7f004d7fa640 1 -- 172.21.15.89:0/1561900097 --> [v2:172.21.15.89:6810/3034426190,v1:172.21.15.89:6811/3034426190] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f00400775a0 con 0x7f0040074ae0 2024-09-13T02:50:53.885 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.881+0000 7f004d7fa640 1 -- 172.21.15.89:0/1561900097 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f003c0b0960 con 0x7f00500fcf80 2024-09-13T02:50:53.885 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.882+0000 7f005510c640 1 --2- 172.21.15.89:0/1561900097 >> [v2:172.21.15.89:6810/3034426190,v1:172.21.15.89:6811/3034426190] conn(0x7f0040074ae0 0x7f0040076ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:53.885 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.882+0000 7f005490b640 1 --2- 172.21.15.89:0/1561900097 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f004006ed60 0x7f0040071210 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0044004c60 tx=0x7f0044009040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:50:53.885 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.882+0000 7f005510c640 1 --2- 172.21.15.89:0/1561900097 >> [v2:172.21.15.89:6810/3034426190,v1:172.21.15.89:6811/3034426190] conn(0x7f0040074ae0 0x7f0040076ef0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:50:53.885 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.883+0000 7f004d7fa640 1 -- 172.21.15.89:0/1561900097 <== osd.1 v2:172.21.15.89:6810/3034426190 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f00400775a0 con 0x7f0040074ae0 2024-09-13T02:50:53.899 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.897+0000 7f0056b6f640 1 -- 172.21.15.89:0/1561900097 --> [v2:172.21.15.89:6810/3034426190,v1:172.21.15.89:6811/3034426190] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f00500fcbc0 con 0x7f0040074ae0 2024-09-13T02:50:53.899 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.898+0000 7f004d7fa640 1 -- 172.21.15.89:0/1561900097 <== osd.1 v2:172.21.15.89:6810/3034426190 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f00500fcbc0 con 0x7f0040074ae0 2024-09-13T02:50:53.900 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.898+0000 7f0056b6f640 1 -- 172.21.15.89:0/1561900097 >> [v2:172.21.15.89:6810/3034426190,v1:172.21.15.89:6811/3034426190] conn(0x7f0040074ae0 msgr2=0x7f0040076ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:53.900 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.898+0000 7f0056b6f640 1 --2- 172.21.15.89:0/1561900097 >> [v2:172.21.15.89:6810/3034426190,v1:172.21.15.89:6811/3034426190] conn(0x7f0040074ae0 0x7f0040076ef0 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:53.900 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.898+0000 7f0056b6f640 1 -- 172.21.15.89:0/1561900097 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f004006ed60 msgr2=0x7f0040071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:53.900 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.898+0000 7f0056b6f640 1 --2- 172.21.15.89:0/1561900097 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f004006ed60 0x7f0040071210 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0044004c60 tx=0x7f0044009040 comp rx=0 tx=0).stop 2024-09-13T02:50:53.900 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.898+0000 7f0056b6f640 1 -- 172.21.15.89:0/1561900097 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f00500fcf80 msgr2=0x7f005010e7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:53.900 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.898+0000 7f0056b6f640 1 --2- 172.21.15.89:0/1561900097 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f00500fcf80 0x7f005010e7f0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f003c003080 tx=0x7f003c009da0 comp rx=0 tx=0).stop 2024-09-13T02:50:53.900 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.898+0000 7f0056b6f640 1 -- 172.21.15.89:0/1561900097 shutdown_connections 2024-09-13T02:50:53.900 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.898+0000 7f0056b6f640 1 --2- 172.21.15.89:0/1561900097 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f00500fcf80 0x7f005010e7f0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:53.900 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.898+0000 7f0056b6f640 1 --2- 172.21.15.89:0/1561900097 >> [v2:172.21.15.89:6810/3034426190,v1:172.21.15.89:6811/3034426190] conn(0x7f0040074ae0 0x7f0040076ef0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:53.900 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.898+0000 7f0056b6f640 1 --2- 172.21.15.89:0/1561900097 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f004006ed60 0x7f0040071210 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:53.900 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.898+0000 7f0056b6f640 1 --2- 172.21.15.89:0/1561900097 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f00500fb810 0x7f005010e2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:53.901 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.898+0000 7f0056b6f640 1 -- 172.21.15.89:0/1561900097 >> 172.21.15.89:0/1561900097 conn(0x7f00500723b0 msgr2=0x7f00500fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:50:53.901 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.898+0000 7f0056b6f640 1 -- 172.21.15.89:0/1561900097 shutdown_connections 2024-09-13T02:50:53.901 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.898+0000 7f0056b6f640 1 -- 172.21.15.89:0/1561900097 wait complete. 2024-09-13T02:50:54.480 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.754+0000 7f49abcec640 1 -- 172.21.15.89:0/2665477205 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49a4102530 msgr2=0x7f49a4102900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:54.480 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.754+0000 7f49abcec640 1 --2- 172.21.15.89:0/2665477205 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49a4102530 0x7f49a4102900 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f4994009c50 tx=0x7f4994004d10 comp rx=0 tx=0).stop 2024-09-13T02:50:54.481 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.754+0000 7f49abcec640 1 -- 172.21.15.89:0/2665477205 shutdown_connections 2024-09-13T02:50:54.481 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.754+0000 7f49abcec640 1 --2- 172.21.15.89:0/2665477205 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f49a4102ed0 0x7f49a40fc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:54.481 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.754+0000 7f49abcec640 1 --2- 172.21.15.89:0/2665477205 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49a4102530 0x7f49a4102900 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:54.481 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.754+0000 7f49abcec640 1 -- 172.21.15.89:0/2665477205 >> 172.21.15.89:0/2665477205 conn(0x7f49a40f80f0 msgr2=0x7f49a40fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:50:54.481 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.754+0000 7f49abcec640 1 -- 172.21.15.89:0/2665477205 shutdown_connections 2024-09-13T02:50:54.481 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.754+0000 7f49abcec640 1 -- 172.21.15.89:0/2665477205 wait complete. 2024-09-13T02:50:54.481 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.754+0000 7f49abcec640 1 Processor -- start 2024-09-13T02:50:54.481 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.754+0000 7f49abcec640 1 -- start start 2024-09-13T02:50:54.481 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.754+0000 7f49abcec640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f49a4102530 0x7f49a4113210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:54.481 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.754+0000 7f49abcec640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49a4102ed0 0x7f49a4113750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:54.481 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.754+0000 7f49abcec640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49a4113d50 con 0x7f49a4102ed0 2024-09-13T02:50:54.481 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.754+0000 7f49abcec640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49a410d190 con 0x7f49a4102530 2024-09-13T02:50:54.481 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.755+0000 7f49a9287640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49a4102ed0 0x7f49a4113750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:54.482 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.755+0000 7f49a9287640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49a4102ed0 0x7f49a4113750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34690/0 (socket says 172.21.15.89:34690) 2024-09-13T02:50:54.482 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.755+0000 7f49a9287640 1 -- 172.21.15.89:0/2143842329 learned_addr learned my addr 172.21.15.89:0/2143842329 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:50:54.482 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.755+0000 7f49a9a88640 1 --2- 172.21.15.89:0/2143842329 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f49a4102530 0x7f49a4113210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:54.482 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.755+0000 7f49a9287640 1 -- 172.21.15.89:0/2143842329 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f49a4102530 msgr2=0x7f49a4113210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:54.482 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.755+0000 7f49a9287640 1 --2- 172.21.15.89:0/2143842329 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f49a4102530 0x7f49a4113210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:54.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.755+0000 7f49a9287640 1 -- 172.21.15.89:0/2143842329 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49940098b0 con 0x7f49a4102ed0 2024-09-13T02:50:54.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.755+0000 7f49a9a88640 1 --2- 172.21.15.89:0/2143842329 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f49a4102530 0x7f49a4113210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T02:50:54.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.755+0000 7f49a9287640 1 --2- 172.21.15.89:0/2143842329 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49a4102ed0 0x7f49a4113750 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f499800c740 tx=0x7f49980043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:50:54.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.755+0000 7f49a27fc640 1 -- 172.21.15.89:0/2143842329 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4998012810 con 0x7f49a4102ed0 2024-09-13T02:50:54.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.755+0000 7f49a27fc640 1 -- 172.21.15.89:0/2143842329 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4998012e10 con 0x7f49a4102ed0 2024-09-13T02:50:54.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.755+0000 7f49a27fc640 1 -- 172.21.15.89:0/2143842329 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f499800a370 con 0x7f49a4102ed0 2024-09-13T02:50:54.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.755+0000 7f49abcec640 1 -- 172.21.15.89:0/2143842329 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49a410d470 con 0x7f49a4102ed0 2024-09-13T02:50:54.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.755+0000 7f49abcec640 1 -- 172.21.15.89:0/2143842329 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49a410da10 con 0x7f49a4102ed0 2024-09-13T02:50:54.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.756+0000 7f49abcec640 1 -- 172.21.15.89:0/2143842329 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f49a410dfa0 con 0x7f49a4102ed0 2024-09-13T02:50:54.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.757+0000 7f49a27fc640 1 -- 172.21.15.89:0/2143842329 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f4998011380 con 0x7f49a4102ed0 2024-09-13T02:50:54.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.757+0000 7f49a27fc640 1 --2- 172.21.15.89:0/2143842329 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f498c06ed60 0x7f498c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:54.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.757+0000 7f49a27fc640 1 -- 172.21.15.89:0/2143842329 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f499808e2f0 con 0x7f49a4102ed0 2024-09-13T02:50:54.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.757+0000 7f49a9a88640 1 --2- 172.21.15.89:0/2143842329 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f498c06ed60 0x7f498c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:54.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.757+0000 7f49a27fc640 1 --2- 172.21.15.89:0/2143842329 >> [v2:172.21.15.131:6808/3134834192,v1:172.21.15.131:6809/3134834192] conn(0x7f498c074ae0 0x7f498c076ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:54.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.757+0000 7f49a27fc640 1 -- 172.21.15.89:0/2143842329 --> [v2:172.21.15.131:6808/3134834192,v1:172.21.15.131:6809/3134834192] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f498c0775a0 con 0x7f498c074ae0 2024-09-13T02:50:54.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.757+0000 7f49a27fc640 1 -- 172.21.15.89:0/2143842329 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f49980908e0 con 0x7f49a4102ed0 2024-09-13T02:50:54.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.758+0000 7f49aa289640 1 --2- 172.21.15.89:0/2143842329 >> [v2:172.21.15.131:6808/3134834192,v1:172.21.15.131:6809/3134834192] conn(0x7f498c074ae0 0x7f498c076ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:54.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.758+0000 7f49a9a88640 1 --2- 172.21.15.89:0/2143842329 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f498c06ed60 0x7f498c071210 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4994004a30 tx=0x7f4994004d10 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:50:54.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.758+0000 7f49aa289640 1 --2- 172.21.15.89:0/2143842329 >> [v2:172.21.15.131:6808/3134834192,v1:172.21.15.131:6809/3134834192] conn(0x7f498c074ae0 0x7f498c076ef0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:50:54.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.759+0000 7f49a27fc640 1 -- 172.21.15.89:0/2143842329 <== osd.4 v2:172.21.15.131:6808/3134834192 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7f498c0775a0 con 0x7f498c074ae0 2024-09-13T02:50:54.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.771+0000 7f49abcec640 1 -- 172.21.15.89:0/2143842329 --> [v2:172.21.15.131:6808/3134834192,v1:172.21.15.131:6809/3134834192] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f49a40f9a50 con 0x7f498c074ae0 2024-09-13T02:50:54.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.772+0000 7f49a27fc640 1 -- 172.21.15.89:0/2143842329 <== osd.4 v2:172.21.15.131:6808/3134834192 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f49a40f9a50 con 0x7f498c074ae0 2024-09-13T02:50:54.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.772+0000 7f49abcec640 1 -- 172.21.15.89:0/2143842329 >> [v2:172.21.15.131:6808/3134834192,v1:172.21.15.131:6809/3134834192] conn(0x7f498c074ae0 msgr2=0x7f498c076ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:54.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.772+0000 7f49abcec640 1 --2- 172.21.15.89:0/2143842329 >> [v2:172.21.15.131:6808/3134834192,v1:172.21.15.131:6809/3134834192] conn(0x7f498c074ae0 0x7f498c076ef0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:54.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.772+0000 7f49abcec640 1 -- 172.21.15.89:0/2143842329 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f498c06ed60 msgr2=0x7f498c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:54.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.772+0000 7f49abcec640 1 --2- 172.21.15.89:0/2143842329 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f498c06ed60 0x7f498c071210 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f4994004a30 tx=0x7f4994004d10 comp rx=0 tx=0).stop 2024-09-13T02:50:54.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.772+0000 7f49abcec640 1 -- 172.21.15.89:0/2143842329 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49a4102ed0 msgr2=0x7f49a4113750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:54.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.772+0000 7f49abcec640 1 --2- 172.21.15.89:0/2143842329 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49a4102ed0 0x7f49a4113750 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f499800c740 tx=0x7f49980043c0 comp rx=0 tx=0).stop 2024-09-13T02:50:54.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.772+0000 7f49abcec640 1 -- 172.21.15.89:0/2143842329 shutdown_connections 2024-09-13T02:50:54.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.772+0000 7f49abcec640 1 --2- 172.21.15.89:0/2143842329 >> [v2:172.21.15.131:6808/3134834192,v1:172.21.15.131:6809/3134834192] conn(0x7f498c074ae0 0x7f498c076ef0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:54.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.772+0000 7f49abcec640 1 --2- 172.21.15.89:0/2143842329 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49a4102ed0 0x7f49a4113750 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:54.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.772+0000 7f49abcec640 1 --2- 172.21.15.89:0/2143842329 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f498c06ed60 0x7f498c071210 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:54.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.772+0000 7f49abcec640 1 --2- 172.21.15.89:0/2143842329 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f49a4102530 0x7f49a4113210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:54.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.772+0000 7f49abcec640 1 -- 172.21.15.89:0/2143842329 >> 172.21.15.89:0/2143842329 conn(0x7f49a40f80f0 msgr2=0x7f49a40f9100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:50:54.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.772+0000 7f49abcec640 1 -- 172.21.15.89:0/2143842329 shutdown_connections 2024-09-13T02:50:54.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:53.772+0000 7f49abcec640 1 -- 172.21.15.89:0/2143842329 wait complete. 2024-09-13T02:50:54.784 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:54 smithi089 ceph-mon[27639]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:50:54.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:54 smithi131 ceph-mon[34689]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:50:55.041 INFO:teuthology.orchestra.run.smithi089.stdout:137438953486 2024-09-13T02:50:55.042 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-13T02:50:55.520 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.489+0000 7fd6db7f2640 1 -- 172.21.15.89:0/1711172136 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6d40fe450 msgr2=0x7fd6d40fe820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:55.520 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.489+0000 7fd6db7f2640 1 --2- 172.21.15.89:0/1711172136 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6d40fe450 0x7fd6d40fe820 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd6d00048d0 tx=0x7fd6d0009da0 comp rx=0 tx=0).stop 2024-09-13T02:50:55.521 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.489+0000 7fd6db7f2640 1 -- 172.21.15.89:0/1711172136 shutdown_connections 2024-09-13T02:50:55.521 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.489+0000 7fd6db7f2640 1 --2- 172.21.15.89:0/1711172136 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd6d4064fe0 0x7fd6d4065430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:55.521 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.489+0000 7fd6db7f2640 1 --2- 172.21.15.89:0/1711172136 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6d40fe450 0x7fd6d40fe820 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:55.521 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.489+0000 7fd6db7f2640 1 -- 172.21.15.89:0/1711172136 >> 172.21.15.89:0/1711172136 conn(0x7fd6d40723b0 msgr2=0x7fd6d40727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:50:55.521 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.489+0000 7fd6db7f2640 1 -- 172.21.15.89:0/1711172136 shutdown_connections 2024-09-13T02:50:55.521 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.489+0000 7fd6db7f2640 1 -- 172.21.15.89:0/1711172136 wait complete. 2024-09-13T02:50:55.521 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.490+0000 7fd6db7f2640 1 Processor -- start 2024-09-13T02:50:55.521 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.490+0000 7fd6db7f2640 1 -- start start 2024-09-13T02:50:55.521 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.490+0000 7fd6db7f2640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd6d4064fe0 0x7fd6d40fb560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:55.521 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.490+0000 7fd6db7f2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6d40fe450 0x7fd6d40fbaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:55.521 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.490+0000 7fd6db7f2640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d40fc070 con 0x7fd6d40fe450 2024-09-13T02:50:55.521 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.490+0000 7fd6db7f2640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6d40fc1e0 con 0x7fd6d4064fe0 2024-09-13T02:50:55.521 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.490+0000 7fd6d8d8d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6d40fe450 0x7fd6d40fbaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:55.522 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.490+0000 7fd6d8d8d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6d40fe450 0x7fd6d40fbaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34722/0 (socket says 172.21.15.89:34722) 2024-09-13T02:50:55.522 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.490+0000 7fd6d8d8d640 1 -- 172.21.15.89:0/1759569477 learned_addr learned my addr 172.21.15.89:0/1759569477 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:50:55.522 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.490+0000 7fd6d958e640 1 --2- 172.21.15.89:0/1759569477 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd6d4064fe0 0x7fd6d40fb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:55.522 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.490+0000 7fd6d8d8d640 1 -- 172.21.15.89:0/1759569477 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd6d4064fe0 msgr2=0x7fd6d40fb560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:55.522 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.490+0000 7fd6d8d8d640 1 --2- 172.21.15.89:0/1759569477 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd6d4064fe0 0x7fd6d40fb560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:55.522 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.490+0000 7fd6d8d8d640 1 -- 172.21.15.89:0/1759569477 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6d0005040 con 0x7fd6d40fe450 2024-09-13T02:50:55.522 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.490+0000 7fd6d8d8d640 1 --2- 172.21.15.89:0/1759569477 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6d40fe450 0x7fd6d40fbaa0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd6c400b790 tx=0x7fd6c40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:50:55.522 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.490+0000 7fd6c9ffb640 1 -- 172.21.15.89:0/1759569477 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6c400c700 con 0x7fd6d40fe450 2024-09-13T02:50:55.522 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.491+0000 7fd6c9ffb640 1 -- 172.21.15.89:0/1759569477 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd6c400cd00 con 0x7fd6d40fe450 2024-09-13T02:50:55.522 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.491+0000 7fd6db7f2640 1 -- 172.21.15.89:0/1759569477 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6d4119570 con 0x7fd6d40fe450 2024-09-13T02:50:55.522 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.491+0000 7fd6c9ffb640 1 -- 172.21.15.89:0/1759569477 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6c4015e70 con 0x7fd6d40fe450 2024-09-13T02:50:55.522 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.491+0000 7fd6db7f2640 1 -- 172.21.15.89:0/1759569477 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6d41199b0 con 0x7fd6d40fe450 2024-09-13T02:50:55.522 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.491+0000 7fd6db7f2640 1 -- 172.21.15.89:0/1759569477 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fd6d40faca0 con 0x7fd6d40fe450 2024-09-13T02:50:55.523 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.492+0000 7fd6c9ffb640 1 -- 172.21.15.89:0/1759569477 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fd6c4012070 con 0x7fd6d40fe450 2024-09-13T02:50:55.523 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.492+0000 7fd6c9ffb640 1 --2- 172.21.15.89:0/1759569477 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fd6c006ed60 0x7fd6c0071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:55.523 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.493+0000 7fd6c9ffb640 1 -- 172.21.15.89:0/1759569477 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fd6c408d990 con 0x7fd6d40fe450 2024-09-13T02:50:55.523 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.493+0000 7fd6d958e640 1 --2- 172.21.15.89:0/1759569477 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fd6c006ed60 0x7fd6c0071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:55.523 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.493+0000 7fd6c9ffb640 1 --2- 172.21.15.89:0/1759569477 >> [v2:172.21.15.89:6802/768220523,v1:172.21.15.89:6803/768220523] conn(0x7fd6c0074ae0 0x7fd6c0076ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:55.523 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.493+0000 7fd6c9ffb640 1 -- 172.21.15.89:0/1759569477 --> [v2:172.21.15.89:6802/768220523,v1:172.21.15.89:6803/768220523] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fd6c00775a0 con 0x7fd6c0074ae0 2024-09-13T02:50:55.523 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.493+0000 7fd6c9ffb640 1 -- 172.21.15.89:0/1759569477 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd6c4092220 con 0x7fd6d40fe450 2024-09-13T02:50:55.523 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.493+0000 7fd6d9d8f640 1 --2- 172.21.15.89:0/1759569477 >> [v2:172.21.15.89:6802/768220523,v1:172.21.15.89:6803/768220523] conn(0x7fd6c0074ae0 0x7fd6c0076ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:55.524 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.493+0000 7fd6d958e640 1 --2- 172.21.15.89:0/1759569477 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fd6c006ed60 0x7fd6c0071210 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd6d0009ac0 tx=0x7fd6d0035040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:50:55.524 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.493+0000 7fd6d9d8f640 1 --2- 172.21.15.89:0/1759569477 >> [v2:172.21.15.89:6802/768220523,v1:172.21.15.89:6803/768220523] conn(0x7fd6c0074ae0 0x7fd6c0076ef0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:50:55.524 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.494+0000 7fd6c9ffb640 1 -- 172.21.15.89:0/1759569477 <== osd.0 v2:172.21.15.89:6802/768220523 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fd6c00775a0 con 0x7fd6c0074ae0 2024-09-13T02:50:55.524 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.506+0000 7fd6db7f2640 1 -- 172.21.15.89:0/1759569477 --> [v2:172.21.15.89:6802/768220523,v1:172.21.15.89:6803/768220523] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fd6d40fdce0 con 0x7fd6c0074ae0 2024-09-13T02:50:55.524 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.506+0000 7fd6c9ffb640 1 -- 172.21.15.89:0/1759569477 <== osd.0 v2:172.21.15.89:6802/768220523 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fd6d40fdce0 con 0x7fd6c0074ae0 2024-09-13T02:50:55.524 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.506+0000 7fd6db7f2640 1 -- 172.21.15.89:0/1759569477 >> [v2:172.21.15.89:6802/768220523,v1:172.21.15.89:6803/768220523] conn(0x7fd6c0074ae0 msgr2=0x7fd6c0076ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:55.524 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.506+0000 7fd6db7f2640 1 --2- 172.21.15.89:0/1759569477 >> [v2:172.21.15.89:6802/768220523,v1:172.21.15.89:6803/768220523] conn(0x7fd6c0074ae0 0x7fd6c0076ef0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:55.524 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.506+0000 7fd6db7f2640 1 -- 172.21.15.89:0/1759569477 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fd6c006ed60 msgr2=0x7fd6c0071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:55.524 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.506+0000 7fd6db7f2640 1 --2- 172.21.15.89:0/1759569477 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fd6c006ed60 0x7fd6c0071210 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fd6d0009ac0 tx=0x7fd6d0035040 comp rx=0 tx=0).stop 2024-09-13T02:50:55.524 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.506+0000 7fd6db7f2640 1 -- 172.21.15.89:0/1759569477 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6d40fe450 msgr2=0x7fd6d40fbaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:55.525 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.506+0000 7fd6db7f2640 1 --2- 172.21.15.89:0/1759569477 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6d40fe450 0x7fd6d40fbaa0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd6c400b790 tx=0x7fd6c40091d0 comp rx=0 tx=0).stop 2024-09-13T02:50:55.525 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.507+0000 7fd6db7f2640 1 -- 172.21.15.89:0/1759569477 shutdown_connections 2024-09-13T02:50:55.525 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.507+0000 7fd6db7f2640 1 --2- 172.21.15.89:0/1759569477 >> [v2:172.21.15.89:6802/768220523,v1:172.21.15.89:6803/768220523] conn(0x7fd6c0074ae0 0x7fd6c0076ef0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:55.525 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.507+0000 7fd6db7f2640 1 --2- 172.21.15.89:0/1759569477 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6d40fe450 0x7fd6d40fbaa0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:55.525 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.507+0000 7fd6db7f2640 1 --2- 172.21.15.89:0/1759569477 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fd6c006ed60 0x7fd6c0071210 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:55.525 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.507+0000 7fd6db7f2640 1 --2- 172.21.15.89:0/1759569477 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd6d4064fe0 0x7fd6d40fb560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:55.525 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.507+0000 7fd6db7f2640 1 -- 172.21.15.89:0/1759569477 >> 172.21.15.89:0/1759569477 conn(0x7fd6d40723b0 msgr2=0x7fd6d40fa290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:50:55.525 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.507+0000 7fd6db7f2640 1 -- 172.21.15.89:0/1759569477 shutdown_connections 2024-09-13T02:50:55.525 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.507+0000 7fd6db7f2640 1 -- 172.21.15.89:0/1759569477 wait complete. 2024-09-13T02:50:55.891 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.889+0000 7fe84c0ee640 1 -- 172.21.15.89:0/1712813404 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe844102530 msgr2=0x7fe844102900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:55.892 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.889+0000 7fe84c0ee640 1 --2- 172.21.15.89:0/1712813404 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe844102530 0x7fe844102900 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe8400048d0 tx=0x7fe840009da0 comp rx=0 tx=0).stop 2024-09-13T02:50:55.892 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.889+0000 7fe84c0ee640 1 -- 172.21.15.89:0/1712813404 shutdown_connections 2024-09-13T02:50:55.892 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.889+0000 7fe84c0ee640 1 --2- 172.21.15.89:0/1712813404 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe844102ed0 0x7fe8440fc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:55.892 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.889+0000 7fe84c0ee640 1 --2- 172.21.15.89:0/1712813404 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe844102530 0x7fe844102900 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:55.892 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.889+0000 7fe84c0ee640 1 -- 172.21.15.89:0/1712813404 >> 172.21.15.89:0/1712813404 conn(0x7fe8440f8110 msgr2=0x7fe8440fa520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:50:55.892 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.889+0000 7fe84c0ee640 1 -- 172.21.15.89:0/1712813404 shutdown_connections 2024-09-13T02:50:55.892 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.889+0000 7fe84c0ee640 1 -- 172.21.15.89:0/1712813404 wait complete. 2024-09-13T02:50:55.892 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.890+0000 7fe84c0ee640 1 Processor -- start 2024-09-13T02:50:55.892 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.890+0000 7fe84c0ee640 1 -- start start 2024-09-13T02:50:55.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.890+0000 7fe84c0ee640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe844102530 0x7fe844113270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:55.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.890+0000 7fe84c0ee640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe844102ed0 0x7fe8441137b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:55.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.890+0000 7fe84c0ee640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe844113e40 con 0x7fe844102ed0 2024-09-13T02:50:55.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.890+0000 7fe84c0ee640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe84410d1f0 con 0x7fe844102530 2024-09-13T02:50:55.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.890+0000 7fe849689640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe844102ed0 0x7fe8441137b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:55.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.890+0000 7fe849689640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe844102ed0 0x7fe8441137b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34728/0 (socket says 172.21.15.89:34728) 2024-09-13T02:50:55.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.890+0000 7fe849689640 1 -- 172.21.15.89:0/882437770 learned_addr learned my addr 172.21.15.89:0/882437770 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:50:55.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.891+0000 7fe849e8a640 1 --2- 172.21.15.89:0/882437770 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe844102530 0x7fe844113270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:55.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.891+0000 7fe849689640 1 -- 172.21.15.89:0/882437770 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe844102530 msgr2=0x7fe844113270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:55.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.891+0000 7fe849689640 1 --2- 172.21.15.89:0/882437770 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe844102530 0x7fe844113270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:55.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.891+0000 7fe849689640 1 -- 172.21.15.89:0/882437770 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe840005040 con 0x7fe844102ed0 2024-09-13T02:50:55.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.891+0000 7fe849e8a640 1 --2- 172.21.15.89:0/882437770 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe844102530 0x7fe844113270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T02:50:55.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.891+0000 7fe849689640 1 --2- 172.21.15.89:0/882437770 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe844102ed0 0x7fe8441137b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe83400b540 tx=0x7fe8340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:50:55.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.891+0000 7fe83a7fc640 1 -- 172.21.15.89:0/882437770 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe83400f6f0 con 0x7fe844102ed0 2024-09-13T02:50:55.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.891+0000 7fe84c0ee640 1 -- 172.21.15.89:0/882437770 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe84410d4d0 con 0x7fe844102ed0 2024-09-13T02:50:55.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.891+0000 7fe83a7fc640 1 -- 172.21.15.89:0/882437770 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe83400fcf0 con 0x7fe844102ed0 2024-09-13T02:50:55.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.891+0000 7fe83a7fc640 1 -- 172.21.15.89:0/882437770 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe8340103a0 con 0x7fe844102ed0 2024-09-13T02:50:55.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.892+0000 7fe84c0ee640 1 -- 172.21.15.89:0/882437770 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe84410d9f0 con 0x7fe844102ed0 2024-09-13T02:50:55.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.893+0000 7fe84c0ee640 1 -- 172.21.15.89:0/882437770 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe84410df80 con 0x7fe844102ed0 2024-09-13T02:50:55.897 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.893+0000 7fe83a7fc640 1 -- 172.21.15.89:0/882437770 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fe83400f850 con 0x7fe844102ed0 2024-09-13T02:50:55.897 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.894+0000 7fe83a7fc640 1 --2- 172.21.15.89:0/882437770 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fe83006ed60 0x7fe830071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:55.897 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.894+0000 7fe83a7fc640 1 -- 172.21.15.89:0/882437770 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fe83408dc90 con 0x7fe844102ed0 2024-09-13T02:50:55.897 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.894+0000 7fe849e8a640 1 --2- 172.21.15.89:0/882437770 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fe83006ed60 0x7fe830071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:55.897 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.894+0000 7fe83a7fc640 1 --2- 172.21.15.89:0/882437770 >> [v2:172.21.15.131:6800/2299999552,v1:172.21.15.131:6801/2299999552] conn(0x7fe830074ae0 0x7fe830076ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:55.897 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.894+0000 7fe83a7fc640 1 -- 172.21.15.89:0/882437770 --> [v2:172.21.15.131:6800/2299999552,v1:172.21.15.131:6801/2299999552] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe8300775a0 con 0x7fe830074ae0 2024-09-13T02:50:55.897 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.894+0000 7fe83a7fc640 1 -- 172.21.15.89:0/882437770 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe834090300 con 0x7fe844102ed0 2024-09-13T02:50:55.897 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.894+0000 7fe849e8a640 1 --2- 172.21.15.89:0/882437770 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fe83006ed60 0x7fe830071210 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe840009ac0 tx=0x7fe840035040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:50:55.897 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.894+0000 7fe84a68b640 1 --2- 172.21.15.89:0/882437770 >> [v2:172.21.15.131:6800/2299999552,v1:172.21.15.131:6801/2299999552] conn(0x7fe830074ae0 0x7fe830076ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:55.897 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.895+0000 7fe84a68b640 1 --2- 172.21.15.89:0/882437770 >> [v2:172.21.15.131:6800/2299999552,v1:172.21.15.131:6801/2299999552] conn(0x7fe830074ae0 0x7fe830076ef0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:50:55.898 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.896+0000 7fe83a7fc640 1 -- 172.21.15.89:0/882437770 <== osd.3 v2:172.21.15.131:6800/2299999552 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fe8300775a0 con 0x7fe830074ae0 2024-09-13T02:50:55.911 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.910+0000 7fe84c0ee640 1 -- 172.21.15.89:0/882437770 --> [v2:172.21.15.131:6800/2299999552,v1:172.21.15.131:6801/2299999552] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe8440f9b60 con 0x7fe830074ae0 2024-09-13T02:50:55.912 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.911+0000 7fe83a7fc640 1 -- 172.21.15.89:0/882437770 <== osd.3 v2:172.21.15.131:6800/2299999552 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7fe8440f9b60 con 0x7fe830074ae0 2024-09-13T02:50:55.913 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.912+0000 7fe84c0ee640 1 -- 172.21.15.89:0/882437770 >> [v2:172.21.15.131:6800/2299999552,v1:172.21.15.131:6801/2299999552] conn(0x7fe830074ae0 msgr2=0x7fe830076ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:55.913 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.912+0000 7fe84c0ee640 1 --2- 172.21.15.89:0/882437770 >> [v2:172.21.15.131:6800/2299999552,v1:172.21.15.131:6801/2299999552] conn(0x7fe830074ae0 0x7fe830076ef0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:55.913 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.912+0000 7fe84c0ee640 1 -- 172.21.15.89:0/882437770 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fe83006ed60 msgr2=0x7fe830071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:55.914 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.912+0000 7fe84c0ee640 1 --2- 172.21.15.89:0/882437770 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fe83006ed60 0x7fe830071210 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe840009ac0 tx=0x7fe840035040 comp rx=0 tx=0).stop 2024-09-13T02:50:55.914 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.912+0000 7fe84c0ee640 1 -- 172.21.15.89:0/882437770 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe844102ed0 msgr2=0x7fe8441137b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:55.914 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.912+0000 7fe84c0ee640 1 --2- 172.21.15.89:0/882437770 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe844102ed0 0x7fe8441137b0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe83400b540 tx=0x7fe8340091a0 comp rx=0 tx=0).stop 2024-09-13T02:50:55.914 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.912+0000 7fe84c0ee640 1 -- 172.21.15.89:0/882437770 shutdown_connections 2024-09-13T02:50:55.914 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.912+0000 7fe84c0ee640 1 --2- 172.21.15.89:0/882437770 >> [v2:172.21.15.131:6800/2299999552,v1:172.21.15.131:6801/2299999552] conn(0x7fe830074ae0 0x7fe830076ef0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:55.914 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.912+0000 7fe84c0ee640 1 --2- 172.21.15.89:0/882437770 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe844102ed0 0x7fe8441137b0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:55.914 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.912+0000 7fe84c0ee640 1 --2- 172.21.15.89:0/882437770 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fe83006ed60 0x7fe830071210 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:55.915 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.912+0000 7fe84c0ee640 1 --2- 172.21.15.89:0/882437770 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe844102530 0x7fe844113270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:55.915 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.912+0000 7fe84c0ee640 1 -- 172.21.15.89:0/882437770 >> 172.21.15.89:0/882437770 conn(0x7fe8440f8110 msgr2=0x7fe8440f91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:50:55.915 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.912+0000 7fe84c0ee640 1 -- 172.21.15.89:0/882437770 shutdown_connections 2024-09-13T02:50:55.915 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:55.912+0000 7fe84c0ee640 1 -- 172.21.15.89:0/882437770 wait complete. 2024-09-13T02:50:56.441 INFO:teuthology.orchestra.run.smithi089.stdout:60129542174 2024-09-13T02:50:56.442 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-13T02:50:56.631 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T02:50:56.735 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:56 smithi089 ceph-mon[27639]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:50:56.933 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:56 smithi131 ceph-mon[34689]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:50:57.574 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.571+0000 7fef4e2b1640 1 -- 172.21.15.89:0/3627232842 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef480fbc60 msgr2=0x7fef481089c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:57.575 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.571+0000 7fef4e2b1640 1 --2- 172.21.15.89:0/3627232842 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef480fbc60 0x7fef481089c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fef300048d0 tx=0x7fef30009da0 comp rx=0 tx=0).stop 2024-09-13T02:50:57.575 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.571+0000 7fef4e2b1640 1 -- 172.21.15.89:0/3627232842 shutdown_connections 2024-09-13T02:50:57.575 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.571+0000 7fef4e2b1640 1 --2- 172.21.15.89:0/3627232842 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef480fbc60 0x7fef481089c0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:57.575 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.571+0000 7fef4e2b1640 1 --2- 172.21.15.89:0/3627232842 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fef480fb350 0x7fef480fb720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:57.575 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.571+0000 7fef4e2b1640 1 -- 172.21.15.89:0/3627232842 >> 172.21.15.89:0/3627232842 conn(0x7fef480f7060 msgr2=0x7fef480f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:50:57.575 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.571+0000 7fef4e2b1640 1 -- 172.21.15.89:0/3627232842 shutdown_connections 2024-09-13T02:50:57.575 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.571+0000 7fef4e2b1640 1 -- 172.21.15.89:0/3627232842 wait complete. 2024-09-13T02:50:57.575 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.572+0000 7fef4e2b1640 1 Processor -- start 2024-09-13T02:50:57.575 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.572+0000 7fef4e2b1640 1 -- start start 2024-09-13T02:50:57.576 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.572+0000 7fef4e2b1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef480fb350 0x7fef4806ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:57.576 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.572+0000 7fef4e2b1640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fef480fbc60 0x7fef4806f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:57.576 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.572+0000 7fef4e2b1640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef48069d20 con 0x7fef480fb350 2024-09-13T02:50:57.576 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.572+0000 7fef4e2b1640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef48069e60 con 0x7fef480fbc60 2024-09-13T02:50:57.576 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.572+0000 7fef47fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef480fb350 0x7fef4806ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:57.576 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.572+0000 7fef47fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef480fb350 0x7fef4806ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34756/0 (socket says 172.21.15.89:34756) 2024-09-13T02:50:57.576 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.572+0000 7fef47fff640 1 -- 172.21.15.89:0/2552396383 learned_addr learned my addr 172.21.15.89:0/2552396383 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:50:57.576 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.573+0000 7fef3ffff640 1 --2- 172.21.15.89:0/2552396383 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fef480fbc60 0x7fef4806f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:57.576 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.573+0000 7fef47fff640 1 -- 172.21.15.89:0/2552396383 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fef480fbc60 msgr2=0x7fef4806f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:57.576 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.573+0000 7fef47fff640 1 --2- 172.21.15.89:0/2552396383 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fef480fbc60 0x7fef4806f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:57.576 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.573+0000 7fef47fff640 1 -- 172.21.15.89:0/2552396383 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef30005040 con 0x7fef480fb350 2024-09-13T02:50:57.576 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.573+0000 7fef47fff640 1 --2- 172.21.15.89:0/2552396383 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef480fb350 0x7fef4806ed40 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fef3800b560 tx=0x7fef380090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:50:57.576 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.573+0000 7fef457fa640 1 -- 172.21.15.89:0/2552396383 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef3800f6f0 con 0x7fef480fb350 2024-09-13T02:50:57.577 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.573+0000 7fef457fa640 1 -- 172.21.15.89:0/2552396383 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fef3800fcf0 con 0x7fef480fb350 2024-09-13T02:50:57.577 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.573+0000 7fef457fa640 1 -- 172.21.15.89:0/2552396383 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef38011e70 con 0x7fef480fb350 2024-09-13T02:50:57.577 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.573+0000 7fef4e2b1640 1 -- 172.21.15.89:0/2552396383 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef4806a140 con 0x7fef480fb350 2024-09-13T02:50:57.577 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.573+0000 7fef4e2b1640 1 -- 172.21.15.89:0/2552396383 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef4806a690 con 0x7fef480fb350 2024-09-13T02:50:57.578 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.574+0000 7fef4e2b1640 1 -- 172.21.15.89:0/2552396383 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fef480662f0 con 0x7fef480fb350 2024-09-13T02:50:57.578 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.575+0000 7fef457fa640 1 -- 172.21.15.89:0/2552396383 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fef38011620 con 0x7fef480fb350 2024-09-13T02:50:57.578 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.576+0000 7fef457fa640 1 --2- 172.21.15.89:0/2552396383 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fef3406ed60 0x7fef34071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:57.578 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.576+0000 7fef3ffff640 1 --2- 172.21.15.89:0/2552396383 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fef3406ed60 0x7fef34071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:57.578 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.576+0000 7fef457fa640 1 -- 172.21.15.89:0/2552396383 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fef3808da40 con 0x7fef480fb350 2024-09-13T02:50:57.578 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.576+0000 7fef457fa640 1 --2- 172.21.15.89:0/2552396383 >> [v2:172.21.15.89:6818/2876061357,v1:172.21.15.89:6819/2876061357] conn(0x7fef34074ae0 0x7fef34076ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:57.579 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.576+0000 7fef457fa640 1 -- 172.21.15.89:0/2552396383 --> [v2:172.21.15.89:6818/2876061357,v1:172.21.15.89:6819/2876061357] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fef340775a0 con 0x7fef34074ae0 2024-09-13T02:50:57.579 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.576+0000 7fef457fa640 1 -- 172.21.15.89:0/2552396383 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7fef38092220 con 0x7fef480fb350 2024-09-13T02:50:57.579 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.576+0000 7fef4c84e640 1 --2- 172.21.15.89:0/2552396383 >> [v2:172.21.15.89:6818/2876061357,v1:172.21.15.89:6819/2876061357] conn(0x7fef34074ae0 0x7fef34076ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:57.579 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.576+0000 7fef3ffff640 1 --2- 172.21.15.89:0/2552396383 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fef3406ed60 0x7fef34071210 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fef4806b610 tx=0x7fef30035040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:50:57.579 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.577+0000 7fef4c84e640 1 --2- 172.21.15.89:0/2552396383 >> [v2:172.21.15.89:6818/2876061357,v1:172.21.15.89:6819/2876061357] conn(0x7fef34074ae0 0x7fef34076ef0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:50:57.579 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.578+0000 7fef457fa640 1 -- 172.21.15.89:0/2552396383 <== osd.2 v2:172.21.15.89:6818/2876061357 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7fef340775a0 con 0x7fef34074ae0 2024-09-13T02:50:57.594 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.592+0000 7fef4e2b1640 1 -- 172.21.15.89:0/2552396383 --> [v2:172.21.15.89:6818/2876061357,v1:172.21.15.89:6819/2876061357] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fef480fac60 con 0x7fef34074ae0 2024-09-13T02:50:57.594 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.593+0000 7fef457fa640 1 -- 172.21.15.89:0/2552396383 <== osd.2 v2:172.21.15.89:6818/2876061357 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fef480fac60 con 0x7fef34074ae0 2024-09-13T02:50:57.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.593+0000 7fef4e2b1640 1 -- 172.21.15.89:0/2552396383 >> [v2:172.21.15.89:6818/2876061357,v1:172.21.15.89:6819/2876061357] conn(0x7fef34074ae0 msgr2=0x7fef34076ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:57.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.593+0000 7fef4e2b1640 1 --2- 172.21.15.89:0/2552396383 >> [v2:172.21.15.89:6818/2876061357,v1:172.21.15.89:6819/2876061357] conn(0x7fef34074ae0 0x7fef34076ef0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:57.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.593+0000 7fef4e2b1640 1 -- 172.21.15.89:0/2552396383 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fef3406ed60 msgr2=0x7fef34071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:57.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.593+0000 7fef4e2b1640 1 --2- 172.21.15.89:0/2552396383 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fef3406ed60 0x7fef34071210 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fef4806b610 tx=0x7fef30035040 comp rx=0 tx=0).stop 2024-09-13T02:50:57.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.593+0000 7fef4e2b1640 1 -- 172.21.15.89:0/2552396383 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef480fb350 msgr2=0x7fef4806ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:57.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.593+0000 7fef4e2b1640 1 --2- 172.21.15.89:0/2552396383 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef480fb350 0x7fef4806ed40 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fef3800b560 tx=0x7fef380090f0 comp rx=0 tx=0).stop 2024-09-13T02:50:57.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.593+0000 7fef4e2b1640 1 -- 172.21.15.89:0/2552396383 shutdown_connections 2024-09-13T02:50:57.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.593+0000 7fef4e2b1640 1 --2- 172.21.15.89:0/2552396383 >> [v2:172.21.15.89:6818/2876061357,v1:172.21.15.89:6819/2876061357] conn(0x7fef34074ae0 0x7fef34076ef0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:57.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.593+0000 7fef4e2b1640 1 --2- 172.21.15.89:0/2552396383 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fef3406ed60 0x7fef34071210 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:57.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.593+0000 7fef4e2b1640 1 --2- 172.21.15.89:0/2552396383 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fef480fbc60 0x7fef4806f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:57.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.593+0000 7fef4e2b1640 1 --2- 172.21.15.89:0/2552396383 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef480fb350 0x7fef4806ed40 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:57.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.593+0000 7fef4e2b1640 1 -- 172.21.15.89:0/2552396383 >> 172.21.15.89:0/2552396383 conn(0x7fef480f7060 msgr2=0x7fef480f76e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:50:57.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.593+0000 7fef4e2b1640 1 -- 172.21.15.89:0/2552396383 shutdown_connections 2024-09-13T02:50:57.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.593+0000 7fef4e2b1640 1 -- 172.21.15.89:0/2552396383 wait complete. 2024-09-13T02:50:58.122 INFO:teuthology.orchestra.run.smithi089.stdout:111669149714 2024-09-13T02:50:58.122 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-13T02:50:58.197 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.451+0000 7eff5bc7f640 1 -- 172.21.15.89:0/2657191468 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff540fcf80 msgr2=0x7eff540fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:58.197 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.451+0000 7eff5bc7f640 1 --2- 172.21.15.89:0/2657191468 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff540fcf80 0x7eff540fd3d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7eff480048d0 tx=0x7eff48009da0 comp rx=0 tx=0).stop 2024-09-13T02:50:58.197 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.451+0000 7eff5bc7f640 1 -- 172.21.15.89:0/2657191468 shutdown_connections 2024-09-13T02:50:58.197 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.451+0000 7eff5bc7f640 1 --2- 172.21.15.89:0/2657191468 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff540fcf80 0x7eff540fd3d0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:58.197 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.451+0000 7eff5bc7f640 1 --2- 172.21.15.89:0/2657191468 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7eff540fb810 0x7eff540fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:58.197 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.451+0000 7eff5bc7f640 1 -- 172.21.15.89:0/2657191468 >> 172.21.15.89:0/2657191468 conn(0x7eff540723b0 msgr2=0x7eff540727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:50:58.197 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.452+0000 7eff5bc7f640 1 -- 172.21.15.89:0/2657191468 shutdown_connections 2024-09-13T02:50:58.198 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.452+0000 7eff5bc7f640 1 -- 172.21.15.89:0/2657191468 wait complete. 2024-09-13T02:50:58.198 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.452+0000 7eff5bc7f640 1 Processor -- start 2024-09-13T02:50:58.198 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.452+0000 7eff5bc7f640 1 -- start start 2024-09-13T02:50:58.198 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.452+0000 7eff5bc7f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff540fb810 0x7eff54112140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:58.198 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.452+0000 7eff5bc7f640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7eff540fcf80 0x7eff54112680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:58.198 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.452+0000 7eff5bc7f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff54112d10 con 0x7eff540fb810 2024-09-13T02:50:58.198 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.452+0000 7eff5bc7f640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff5410c100 con 0x7eff540fcf80 2024-09-13T02:50:58.198 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.452+0000 7eff59a1b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff540fb810 0x7eff54112140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:58.199 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.452+0000 7eff59a1b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff540fb810 0x7eff54112140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34742/0 (socket says 172.21.15.89:34742) 2024-09-13T02:50:58.199 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.452+0000 7eff59a1b640 1 -- 172.21.15.89:0/1719753609 learned_addr learned my addr 172.21.15.89:0/1719753609 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:50:58.199 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.453+0000 7eff5921a640 1 --2- 172.21.15.89:0/1719753609 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7eff540fcf80 0x7eff54112680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:58.199 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.453+0000 7eff59a1b640 1 -- 172.21.15.89:0/1719753609 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7eff540fcf80 msgr2=0x7eff54112680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:58.199 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.453+0000 7eff59a1b640 1 --2- 172.21.15.89:0/1719753609 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7eff540fcf80 0x7eff54112680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:58.199 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.453+0000 7eff59a1b640 1 -- 172.21.15.89:0/1719753609 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff48005040 con 0x7eff540fb810 2024-09-13T02:50:58.199 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.453+0000 7eff5921a640 1 --2- 172.21.15.89:0/1719753609 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7eff540fcf80 0x7eff54112680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T02:50:58.199 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.453+0000 7eff59a1b640 1 --2- 172.21.15.89:0/1719753609 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff540fb810 0x7eff54112140 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7eff4400bbb0 tx=0x7eff44009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:50:58.199 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.453+0000 7eff527fc640 1 -- 172.21.15.89:0/1719753609 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff4400c9c0 con 0x7eff540fb810 2024-09-13T02:50:58.200 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.453+0000 7eff527fc640 1 -- 172.21.15.89:0/1719753609 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7eff440092e0 con 0x7eff540fb810 2024-09-13T02:50:58.200 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.453+0000 7eff5bc7f640 1 -- 172.21.15.89:0/1719753609 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff5410c3e0 con 0x7eff540fb810 2024-09-13T02:50:58.200 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.453+0000 7eff527fc640 1 -- 172.21.15.89:0/1719753609 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff44007640 con 0x7eff540fb810 2024-09-13T02:50:58.200 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.453+0000 7eff5bc7f640 1 -- 172.21.15.89:0/1719753609 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff5410c900 con 0x7eff540fb810 2024-09-13T02:50:58.200 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.454+0000 7eff5bc7f640 1 -- 172.21.15.89:0/1719753609 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7eff5410ce20 con 0x7eff540fb810 2024-09-13T02:50:58.200 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.455+0000 7eff527fc640 1 -- 172.21.15.89:0/1719753609 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7eff44012070 con 0x7eff540fb810 2024-09-13T02:50:58.200 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.455+0000 7eff527fc640 1 --2- 172.21.15.89:0/1719753609 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7eff3c06ed60 0x7eff3c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:58.200 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.455+0000 7eff5921a640 1 --2- 172.21.15.89:0/1719753609 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7eff3c06ed60 0x7eff3c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:58.200 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.455+0000 7eff527fc640 1 -- 172.21.15.89:0/1719753609 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7eff4408dfd0 con 0x7eff540fb810 2024-09-13T02:50:58.200 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.455+0000 7eff527fc640 1 --2- 172.21.15.89:0/1719753609 >> [v2:172.21.15.131:6816/2725649505,v1:172.21.15.131:6817/2725649505] conn(0x7eff3c074ae0 0x7eff3c076ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:50:58.200 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.455+0000 7eff527fc640 1 -- 172.21.15.89:0/1719753609 --> [v2:172.21.15.131:6816/2725649505,v1:172.21.15.131:6817/2725649505] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7eff3c0775a0 con 0x7eff3c074ae0 2024-09-13T02:50:58.200 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.455+0000 7eff527fc640 1 -- 172.21.15.89:0/1719753609 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7eff44090560 con 0x7eff540fb810 2024-09-13T02:50:58.200 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.455+0000 7eff5a21c640 1 --2- 172.21.15.89:0/1719753609 >> [v2:172.21.15.131:6816/2725649505,v1:172.21.15.131:6817/2725649505] conn(0x7eff3c074ae0 0x7eff3c076ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:50:58.201 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.455+0000 7eff5921a640 1 --2- 172.21.15.89:0/1719753609 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7eff3c06ed60 0x7eff3c071210 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7eff5410da40 tx=0x7eff48035040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:50:58.201 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.456+0000 7eff5a21c640 1 --2- 172.21.15.89:0/1719753609 >> [v2:172.21.15.131:6816/2725649505,v1:172.21.15.131:6817/2725649505] conn(0x7eff3c074ae0 0x7eff3c076ef0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:50:58.201 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.457+0000 7eff527fc640 1 -- 172.21.15.89:0/1719753609 <== osd.5 v2:172.21.15.131:6816/2725649505 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (crc 0 0 0) 0x7eff3c0775a0 con 0x7eff3c074ae0 2024-09-13T02:50:58.201 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.469+0000 7eff5bc7f640 1 -- 172.21.15.89:0/1719753609 --> [v2:172.21.15.131:6816/2725649505,v1:172.21.15.131:6817/2725649505] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7eff540fcbc0 con 0x7eff3c074ae0 2024-09-13T02:50:58.201 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.470+0000 7eff527fc640 1 -- 172.21.15.89:0/1719753609 <== osd.5 v2:172.21.15.131:6816/2725649505 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7eff540fcbc0 con 0x7eff3c074ae0 2024-09-13T02:50:58.201 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.470+0000 7eff5bc7f640 1 -- 172.21.15.89:0/1719753609 >> [v2:172.21.15.131:6816/2725649505,v1:172.21.15.131:6817/2725649505] conn(0x7eff3c074ae0 msgr2=0x7eff3c076ef0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:58.201 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.470+0000 7eff5bc7f640 1 --2- 172.21.15.89:0/1719753609 >> [v2:172.21.15.131:6816/2725649505,v1:172.21.15.131:6817/2725649505] conn(0x7eff3c074ae0 0x7eff3c076ef0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:58.201 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.470+0000 7eff5bc7f640 1 -- 172.21.15.89:0/1719753609 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7eff3c06ed60 msgr2=0x7eff3c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:58.201 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.470+0000 7eff5bc7f640 1 --2- 172.21.15.89:0/1719753609 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7eff3c06ed60 0x7eff3c071210 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7eff5410da40 tx=0x7eff48035040 comp rx=0 tx=0).stop 2024-09-13T02:50:58.201 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.470+0000 7eff5bc7f640 1 -- 172.21.15.89:0/1719753609 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff540fb810 msgr2=0x7eff54112140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:50:58.201 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.470+0000 7eff5bc7f640 1 --2- 172.21.15.89:0/1719753609 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff540fb810 0x7eff54112140 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7eff4400bbb0 tx=0x7eff44009840 comp rx=0 tx=0).stop 2024-09-13T02:50:58.201 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.470+0000 7eff5bc7f640 1 -- 172.21.15.89:0/1719753609 shutdown_connections 2024-09-13T02:50:58.202 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.470+0000 7eff5bc7f640 1 --2- 172.21.15.89:0/1719753609 >> [v2:172.21.15.131:6816/2725649505,v1:172.21.15.131:6817/2725649505] conn(0x7eff3c074ae0 0x7eff3c076ef0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:58.202 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.470+0000 7eff5bc7f640 1 --2- 172.21.15.89:0/1719753609 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7eff3c06ed60 0x7eff3c071210 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:58.202 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.470+0000 7eff5bc7f640 1 --2- 172.21.15.89:0/1719753609 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7eff540fcf80 0x7eff54112680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:58.202 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.470+0000 7eff5bc7f640 1 --2- 172.21.15.89:0/1719753609 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff540fb810 0x7eff54112140 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:50:58.202 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.470+0000 7eff5bc7f640 1 -- 172.21.15.89:0/1719753609 >> 172.21.15.89:0/1719753609 conn(0x7eff540723b0 msgr2=0x7eff540fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:50:58.202 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.470+0000 7eff5bc7f640 1 -- 172.21.15.89:0/1719753609 shutdown_connections 2024-09-13T02:50:58.202 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:50:57.470+0000 7eff5bc7f640 1 -- 172.21.15.89:0/1719753609 wait complete. 2024-09-13T02:50:58.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:58 smithi089 ceph-mon[27639]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:50:58.769 INFO:teuthology.orchestra.run.smithi089.stdout:158913789962 2024-09-13T02:50:58.770 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-13T02:50:58.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:58 smithi131 ceph-mon[34689]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:50:59.589 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:50:59 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:50:59.613 INFO:teuthology.orchestra.run.smithi089.stdout:38654705700 2024-09-13T02:50:59.613 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-13T02:50:59.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:50:59 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:51:00.183 INFO:teuthology.orchestra.run.smithi089.stdout:81604378649 2024-09-13T02:51:00.184 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-13T02:51:00.186 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T02:51:00.770 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:00 smithi089 ceph-mon[27639]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:51:00.895 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T02:51:00.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:00 smithi131 ceph-mon[34689]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:51:01.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:01.668+0000 7fc1a3aa4640 1 -- 172.21.15.89:0/559207080 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc19c0fabd0 msgr2=0x7fc19c0fb040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:01.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:01.668+0000 7fc1a3aa4640 1 --2- 172.21.15.89:0/559207080 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc19c0fabd0 0x7fc19c0fb040 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fc1900048d0 tx=0x7fc190009da0 comp rx=0 tx=0).stop 2024-09-13T02:51:01.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:01.668+0000 7fc1a3aa4640 1 -- 172.21.15.89:0/559207080 shutdown_connections 2024-09-13T02:51:01.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:01.668+0000 7fc1a3aa4640 1 --2- 172.21.15.89:0/559207080 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc19c0fabd0 0x7fc19c0fb040 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:01.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:01.668+0000 7fc1a3aa4640 1 --2- 172.21.15.89:0/559207080 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc19c102680 0x7fc19c102a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:01.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:01.668+0000 7fc1a3aa4640 1 -- 172.21.15.89:0/559207080 >> 172.21.15.89:0/559207080 conn(0x7fc19c071ac0 msgr2=0x7fc19c071ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:51:01.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:01.668+0000 7fc1a3aa4640 1 -- 172.21.15.89:0/559207080 shutdown_connections 2024-09-13T02:51:01.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:01.668+0000 7fc1a3aa4640 1 -- 172.21.15.89:0/559207080 wait complete. 2024-09-13T02:51:01.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:01.669+0000 7fc1a3aa4640 1 Processor -- start 2024-09-13T02:51:01.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:01.669+0000 7fc1a3aa4640 1 -- start start 2024-09-13T02:51:01.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:01.669+0000 7fc1a3aa4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc19c0fabd0 0x7fc19c1132e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:01.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:01.669+0000 7fc1a3aa4640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc19c102680 0x7fc19c113820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:01.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:01.669+0000 7fc1a3aa4640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc19c113eb0 con 0x7fc19c0fabd0 2024-09-13T02:51:01.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:01.669+0000 7fc1a3aa4640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc19c10d260 con 0x7fc19c102680 2024-09-13T02:51:01.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:01.669+0000 7fc1a1840640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc19c0fabd0 0x7fc19c1132e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:01.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:01.669+0000 7fc1a1840640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc19c0fabd0 0x7fc19c1132e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:50960/0 (socket says 172.21.15.89:50960) 2024-09-13T02:51:01.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:01.669+0000 7fc1a1840640 1 -- 172.21.15.89:0/2890369288 learned_addr learned my addr 172.21.15.89:0/2890369288 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:51:01.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:01.669+0000 7fc1a103f640 1 --2- 172.21.15.89:0/2890369288 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc19c102680 0x7fc19c113820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:01.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:01.669+0000 7fc1a1840640 1 -- 172.21.15.89:0/2890369288 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc19c102680 msgr2=0x7fc19c113820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:01.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:01.669+0000 7fc1a1840640 1 --2- 172.21.15.89:0/2890369288 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc19c102680 0x7fc19c113820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:01.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:01.670+0000 7fc1a1840640 1 -- 172.21.15.89:0/2890369288 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc190005040 con 0x7fc19c0fabd0 2024-09-13T02:51:01.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:01.670+0000 7fc1a1840640 1 --2- 172.21.15.89:0/2890369288 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc19c0fabd0 0x7fc19c1132e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc19400bbb0 tx=0x7fc194009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:51:01.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:01.670+0000 7fc19a7fc640 1 -- 172.21.15.89:0/2890369288 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc19400c940 con 0x7fc19c0fabd0 2024-09-13T02:51:01.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:01.670+0000 7fc1a3aa4640 1 -- 172.21.15.89:0/2890369288 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc19c10d540 con 0x7fc19c0fabd0 2024-09-13T02:51:01.699 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:01.670+0000 7fc19a7fc640 1 -- 172.21.15.89:0/2890369288 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc1940092e0 con 0x7fc19c0fabd0 2024-09-13T02:51:01.699 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:01.670+0000 7fc19a7fc640 1 -- 172.21.15.89:0/2890369288 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc194007640 con 0x7fc19c0fabd0 2024-09-13T02:51:01.699 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:01.670+0000 7fc1a3aa4640 1 -- 172.21.15.89:0/2890369288 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc19c10da30 con 0x7fc19c0fabd0 2024-09-13T02:51:01.699 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:01.671+0000 7fc1a3aa4640 1 -- 172.21.15.89:0/2890369288 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc19c0725d0 con 0x7fc19c0fabd0 2024-09-13T02:51:01.699 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:01.671+0000 7fc19a7fc640 1 -- 172.21.15.89:0/2890369288 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fc194012070 con 0x7fc19c0fabd0 2024-09-13T02:51:01.699 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:01.672+0000 7fc19a7fc640 1 --2- 172.21.15.89:0/2890369288 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fc18406ed60 0x7fc184071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:01.699 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:01.672+0000 7fc1a103f640 1 --2- 172.21.15.89:0/2890369288 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fc18406ed60 0x7fc184071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:01.699 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:01.672+0000 7fc19a7fc640 1 -- 172.21.15.89:0/2890369288 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fc19408dee0 con 0x7fc19c0fabd0 2024-09-13T02:51:01.699 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:01.672+0000 7fc1a103f640 1 --2- 172.21.15.89:0/2890369288 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fc18406ed60 0x7fc184071210 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc190009ac0 tx=0x7fc190035040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:51:01.699 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:01.676+0000 7fc19a7fc640 1 -- 172.21.15.89:0/2890369288 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fc19405b340 con 0x7fc19c0fabd0 2024-09-13T02:51:01.738 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T02:51:01.846 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:01.845+0000 7fc1a3aa4640 1 -- 172.21.15.89:0/2890369288 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fc19c0ff070 con 0x7fc19c0fabd0 2024-09-13T02:51:01.846 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:01.845+0000 7fc19a7fc640 1 -- 172.21.15.89:0/2890369288 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fc19405ace0 con 0x7fc19c0fabd0 2024-09-13T02:51:01.846 INFO:teuthology.orchestra.run.smithi089.stdout:137438953487 2024-09-13T02:51:01.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:01.847+0000 7fc1a3aa4640 1 -- 172.21.15.89:0/2890369288 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fc18406ed60 msgr2=0x7fc184071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:01.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:01.847+0000 7fc1a3aa4640 1 --2- 172.21.15.89:0/2890369288 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fc18406ed60 0x7fc184071210 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc190009ac0 tx=0x7fc190035040 comp rx=0 tx=0).stop 2024-09-13T02:51:01.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:01.847+0000 7fc1a3aa4640 1 -- 172.21.15.89:0/2890369288 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc19c0fabd0 msgr2=0x7fc19c1132e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:01.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:01.847+0000 7fc1a3aa4640 1 --2- 172.21.15.89:0/2890369288 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc19c0fabd0 0x7fc19c1132e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fc19400bbb0 tx=0x7fc194009840 comp rx=0 tx=0).stop 2024-09-13T02:51:01.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:01.847+0000 7fc1a3aa4640 1 -- 172.21.15.89:0/2890369288 shutdown_connections 2024-09-13T02:51:01.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:01.847+0000 7fc1a3aa4640 1 --2- 172.21.15.89:0/2890369288 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fc18406ed60 0x7fc184071210 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:01.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:01.847+0000 7fc1a3aa4640 1 --2- 172.21.15.89:0/2890369288 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc19c102680 0x7fc19c113820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:01.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:01.847+0000 7fc1a3aa4640 1 --2- 172.21.15.89:0/2890369288 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc19c0fabd0 0x7fc19c1132e0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:01.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:01.847+0000 7fc1a3aa4640 1 -- 172.21.15.89:0/2890369288 >> 172.21.15.89:0/2890369288 conn(0x7fc19c071ac0 msgr2=0x7fc19c105350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:51:01.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:01.847+0000 7fc1a3aa4640 1 -- 172.21.15.89:0/2890369288 shutdown_connections 2024-09-13T02:51:01.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:01.847+0000 7fc1a3aa4640 1 -- 172.21.15.89:0/2890369288 wait complete. 2024-09-13T02:51:02.775 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:02 smithi089 ceph-mon[27639]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:51:02.775 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:02 smithi089 ceph-mon[27639]: from='client.? 172.21.15.89:0/2890369288' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-13T02:51:02.808 INFO:tasks.cephadm.ceph_manager.ceph:need seq 137438953486 got 137438953487 for osd.4 2024-09-13T02:51:02.809 DEBUG:teuthology.parallel:result is None 2024-09-13T02:51:02.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:02 smithi131 ceph-mon[34689]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:51:02.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:02 smithi131 ceph-mon[34689]: from='client.? 172.21.15.89:0/2890369288' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-13T02:51:03.039 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T02:51:03.040 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T02:51:03.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:03.847+0000 7f21a6923640 1 -- 172.21.15.89:0/304425333 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f21a00fdf20 msgr2=0x7f21a01065f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:03.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:03.847+0000 7f21a6923640 1 --2- 172.21.15.89:0/304425333 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f21a00fdf20 0x7f21a01065f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2188004900 tx=0x7f2188009da0 comp rx=0 tx=0).stop 2024-09-13T02:51:03.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:03.847+0000 7f21a6923640 1 -- 172.21.15.89:0/304425333 shutdown_connections 2024-09-13T02:51:03.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:03.847+0000 7f21a6923640 1 --2- 172.21.15.89:0/304425333 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f21a00fdf20 0x7f21a01065f0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:03.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:03.847+0000 7f21a6923640 1 --2- 172.21.15.89:0/304425333 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f21a00fd580 0x7f21a00fd950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:03.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:03.847+0000 7f21a6923640 1 -- 172.21.15.89:0/304425333 >> 172.21.15.89:0/304425333 conn(0x7f21a00f7020 msgr2=0x7f21a00f9430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:51:03.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:03.847+0000 7f21a6923640 1 -- 172.21.15.89:0/304425333 shutdown_connections 2024-09-13T02:51:03.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:03.847+0000 7f21a6923640 1 -- 172.21.15.89:0/304425333 wait complete. 2024-09-13T02:51:03.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:03.847+0000 7f21a6923640 1 Processor -- start 2024-09-13T02:51:03.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:03.847+0000 7f21a6923640 1 -- start start 2024-09-13T02:51:03.850 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:03.847+0000 7f21a6923640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f21a00fd580 0x7f21a01132b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:03.850 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:03.847+0000 7f21a6923640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f21a00fdf20 0x7f21a01137f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:03.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:03.847+0000 7f21a6923640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21a0113df0 con 0x7f21a00fd580 2024-09-13T02:51:03.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:03.847+0000 7f21a6923640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21a010d230 con 0x7f21a00fdf20 2024-09-13T02:51:03.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:03.848+0000 7f219ffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f21a00fd580 0x7f21a01132b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:03.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:03.848+0000 7f219ffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f21a00fd580 0x7f21a01132b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:50982/0 (socket says 172.21.15.89:50982) 2024-09-13T02:51:03.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:03.848+0000 7f219ffff640 1 -- 172.21.15.89:0/102582440 learned_addr learned my addr 172.21.15.89:0/102582440 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:51:03.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:03.848+0000 7f2197fff640 1 --2- 172.21.15.89:0/102582440 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f21a00fdf20 0x7f21a01137f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:03.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:03.848+0000 7f219ffff640 1 -- 172.21.15.89:0/102582440 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f21a00fdf20 msgr2=0x7f21a01137f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:03.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:03.848+0000 7f219ffff640 1 --2- 172.21.15.89:0/102582440 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f21a00fdf20 0x7f21a01137f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:03.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:03.848+0000 7f219ffff640 1 -- 172.21.15.89:0/102582440 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2188005040 con 0x7f21a00fd580 2024-09-13T02:51:03.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:03.848+0000 7f219ffff640 1 --2- 172.21.15.89:0/102582440 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f21a00fd580 0x7f21a01132b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2190002a50 tx=0x7f2190004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:51:03.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:03.848+0000 7f219d7fa640 1 -- 172.21.15.89:0/102582440 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2190007c30 con 0x7f21a00fd580 2024-09-13T02:51:03.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:03.848+0000 7f219d7fa640 1 -- 172.21.15.89:0/102582440 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f219000f040 con 0x7f21a00fd580 2024-09-13T02:51:03.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:03.848+0000 7f21a6923640 1 -- 172.21.15.89:0/102582440 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21a010d510 con 0x7f21a00fd580 2024-09-13T02:51:03.852 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:03.848+0000 7f219d7fa640 1 -- 172.21.15.89:0/102582440 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f219000da90 con 0x7f21a00fd580 2024-09-13T02:51:03.852 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:03.848+0000 7f21a6923640 1 -- 172.21.15.89:0/102582440 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21a010da30 con 0x7f21a00fd580 2024-09-13T02:51:03.852 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:03.849+0000 7f21a6923640 1 -- 172.21.15.89:0/102582440 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21a00662d0 con 0x7f21a00fd580 2024-09-13T02:51:03.852 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:03.850+0000 7f219d7fa640 1 -- 172.21.15.89:0/102582440 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f219000dd00 con 0x7f21a00fd580 2024-09-13T02:51:03.853 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:03.850+0000 7f219d7fa640 1 --2- 172.21.15.89:0/102582440 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f218c06ed60 0x7f218c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:03.853 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:03.850+0000 7f219d7fa640 1 -- 172.21.15.89:0/102582440 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f219008d700 con 0x7f21a00fd580 2024-09-13T02:51:03.853 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:03.850+0000 7f2197fff640 1 --2- 172.21.15.89:0/102582440 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f218c06ed60 0x7f218c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:03.853 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:03.851+0000 7f2197fff640 1 --2- 172.21.15.89:0/102582440 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f218c06ed60 0x7f218c071210 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2188004540 tx=0x7f2188009da0 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:51:03.855 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:03.854+0000 7f219d7fa640 1 -- 172.21.15.89:0/102582440 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f219004d2a0 con 0x7f21a00fd580 2024-09-13T02:51:04.017 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:04.015+0000 7f21a6923640 1 -- 172.21.15.89:0/102582440 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f21a004b780 con 0x7f21a00fd580 2024-09-13T02:51:04.017 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:04.016+0000 7f219d7fa640 1 -- 172.21.15.89:0/102582440 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f219005ab60 con 0x7f21a00fd580 2024-09-13T02:51:04.017 INFO:teuthology.orchestra.run.smithi089.stdout:158913789963 2024-09-13T02:51:04.019 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:04.017+0000 7f21a6923640 1 -- 172.21.15.89:0/102582440 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f218c06ed60 msgr2=0x7f218c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:04.019 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:04.017+0000 7f21a6923640 1 --2- 172.21.15.89:0/102582440 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f218c06ed60 0x7f218c071210 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f2188004540 tx=0x7f2188009da0 comp rx=0 tx=0).stop 2024-09-13T02:51:04.019 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:04.017+0000 7f21a6923640 1 -- 172.21.15.89:0/102582440 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f21a00fd580 msgr2=0x7f21a01132b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:04.019 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:04.017+0000 7f21a6923640 1 --2- 172.21.15.89:0/102582440 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f21a00fd580 0x7f21a01132b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f2190002a50 tx=0x7f2190004600 comp rx=0 tx=0).stop 2024-09-13T02:51:04.019 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:04.018+0000 7f21a6923640 1 -- 172.21.15.89:0/102582440 shutdown_connections 2024-09-13T02:51:04.019 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:04.018+0000 7f21a6923640 1 --2- 172.21.15.89:0/102582440 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f218c06ed60 0x7f218c071210 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:04.019 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:04.018+0000 7f21a6923640 1 --2- 172.21.15.89:0/102582440 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f21a00fdf20 0x7f21a01137f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:04.020 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:04.018+0000 7f21a6923640 1 --2- 172.21.15.89:0/102582440 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f21a00fd580 0x7f21a01132b0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:04.020 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:04.018+0000 7f21a6923640 1 -- 172.21.15.89:0/102582440 >> 172.21.15.89:0/102582440 conn(0x7f21a00f7020 msgr2=0x7f21a00f8560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:51:04.020 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:04.018+0000 7f21a6923640 1 -- 172.21.15.89:0/102582440 shutdown_connections 2024-09-13T02:51:04.020 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:04.018+0000 7f21a6923640 1 -- 172.21.15.89:0/102582440 wait complete. 2024-09-13T02:51:04.689 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:04 smithi089 ceph-mon[27639]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:51:04.689 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:04 smithi089 ceph-mon[27639]: from='client.? 172.21.15.89:0/102582440' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-13T02:51:04.933 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:04 smithi131 ceph-mon[34689]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:51:04.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:04 smithi131 ceph-mon[34689]: from='client.? 172.21.15.89:0/102582440' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-13T02:51:05.915 INFO:tasks.cephadm.ceph_manager.ceph:need seq 158913789962 got 158913789963 for osd.5 2024-09-13T02:51:05.915 DEBUG:teuthology.parallel:result is None 2024-09-13T02:51:06.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:06 smithi089 ceph-mon[27639]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:51:06.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:06 smithi131 ceph-mon[34689]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:51:08.765 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:08 smithi089 ceph-mon[27639]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:51:08.855 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:08.840+0000 7fe585a36640 1 -- 172.21.15.89:0/459280073 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe580102550 msgr2=0x7fe580102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:08.855 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:08.840+0000 7fe585a36640 1 --2- 172.21.15.89:0/459280073 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe580102550 0x7fe580102920 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fe5700048d0 tx=0x7fe570009da0 comp rx=0 tx=0).stop 2024-09-13T02:51:08.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:08.841+0000 7fe585a36640 1 -- 172.21.15.89:0/459280073 shutdown_connections 2024-09-13T02:51:08.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:08.841+0000 7fe585a36640 1 --2- 172.21.15.89:0/459280073 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe580102ef0 0x7fe5800fc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:08.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:08.841+0000 7fe585a36640 1 --2- 172.21.15.89:0/459280073 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe580102550 0x7fe580102920 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:08.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:08.841+0000 7fe585a36640 1 -- 172.21.15.89:0/459280073 >> 172.21.15.89:0/459280073 conn(0x7fe5800f80f0 msgr2=0x7fe5800fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:51:08.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:08.841+0000 7fe585a36640 1 -- 172.21.15.89:0/459280073 shutdown_connections 2024-09-13T02:51:08.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:08.841+0000 7fe585a36640 1 -- 172.21.15.89:0/459280073 wait complete. 2024-09-13T02:51:08.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:08.841+0000 7fe585a36640 1 Processor -- start 2024-09-13T02:51:08.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:08.841+0000 7fe585a36640 1 -- start start 2024-09-13T02:51:08.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:08.842+0000 7fe585a36640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe580102550 0x7fe5801135b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:08.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:08.842+0000 7fe585a36640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe580102ef0 0x7fe580113af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:08.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:08.842+0000 7fe585a36640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5801141d0 con 0x7fe580102550 2024-09-13T02:51:08.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:08.842+0000 7fe585a36640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe58010d550 con 0x7fe580102ef0 2024-09-13T02:51:08.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:08.842+0000 7fe57effd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe580102550 0x7fe5801135b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:08.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:08.842+0000 7fe57effd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe580102550 0x7fe5801135b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:50988/0 (socket says 172.21.15.89:50988) 2024-09-13T02:51:08.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:08.842+0000 7fe57effd640 1 -- 172.21.15.89:0/2106402640 learned_addr learned my addr 172.21.15.89:0/2106402640 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:51:08.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:08.842+0000 7fe57e7fc640 1 --2- 172.21.15.89:0/2106402640 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe580102ef0 0x7fe580113af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:08.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:08.842+0000 7fe57effd640 1 -- 172.21.15.89:0/2106402640 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe580102ef0 msgr2=0x7fe580113af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:08.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:08.842+0000 7fe57effd640 1 --2- 172.21.15.89:0/2106402640 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe580102ef0 0x7fe580113af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:08.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:08.842+0000 7fe57effd640 1 -- 172.21.15.89:0/2106402640 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe570005040 con 0x7fe580102550 2024-09-13T02:51:08.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:08.842+0000 7fe57effd640 1 --2- 172.21.15.89:0/2106402640 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe580102550 0x7fe5801135b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe570000c00 tx=0x7fe570009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:51:08.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:08.842+0000 7fe5777fe640 1 -- 172.21.15.89:0/2106402640 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe570038070 con 0x7fe580102550 2024-09-13T02:51:08.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:08.842+0000 7fe5777fe640 1 -- 172.21.15.89:0/2106402640 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe57003daf0 con 0x7fe580102550 2024-09-13T02:51:08.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:08.842+0000 7fe585a36640 1 -- 172.21.15.89:0/2106402640 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe58010d780 con 0x7fe580102550 2024-09-13T02:51:08.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:08.842+0000 7fe5777fe640 1 -- 172.21.15.89:0/2106402640 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe570033b20 con 0x7fe580102550 2024-09-13T02:51:08.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:08.842+0000 7fe585a36640 1 -- 172.21.15.89:0/2106402640 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe58010dca0 con 0x7fe580102550 2024-09-13T02:51:08.858 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:08.843+0000 7fe585a36640 1 -- 172.21.15.89:0/2106402640 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5800fdcd0 con 0x7fe580102550 2024-09-13T02:51:08.858 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:08.844+0000 7fe5777fe640 1 -- 172.21.15.89:0/2106402640 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fe570030020 con 0x7fe580102550 2024-09-13T02:51:08.858 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:08.844+0000 7fe5777fe640 1 --2- 172.21.15.89:0/2106402640 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fe56c06ed60 0x7fe56c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:08.858 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:08.844+0000 7fe57e7fc640 1 --2- 172.21.15.89:0/2106402640 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fe56c06ed60 0x7fe56c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:08.858 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:08.845+0000 7fe5777fe640 1 -- 172.21.15.89:0/2106402640 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fe5700ae0f0 con 0x7fe580102550 2024-09-13T02:51:08.858 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:08.845+0000 7fe57e7fc640 1 --2- 172.21.15.89:0/2106402640 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fe56c06ed60 0x7fe56c071210 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe58010e830 tx=0x7fe568008040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:51:08.858 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:08.849+0000 7fe5777fe640 1 -- 172.21.15.89:0/2106402640 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fe57007b550 con 0x7fe580102550 2024-09-13T02:51:08.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:08 smithi131 ceph-mon[34689]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:51:09.010 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:09.009+0000 7fe585a36640 1 -- 172.21.15.89:0/2106402640 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fe58010ec20 con 0x7fe580102550 2024-09-13T02:51:09.010 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:09.009+0000 7fe5777fe640 1 -- 172.21.15.89:0/2106402640 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fe5700ace60 con 0x7fe580102550 2024-09-13T02:51:09.011 INFO:teuthology.orchestra.run.smithi089.stdout:111669149716 2024-09-13T02:51:09.013 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:09.011+0000 7fe585a36640 1 -- 172.21.15.89:0/2106402640 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fe56c06ed60 msgr2=0x7fe56c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:09.013 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:09.011+0000 7fe585a36640 1 --2- 172.21.15.89:0/2106402640 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fe56c06ed60 0x7fe56c071210 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fe58010e830 tx=0x7fe568008040 comp rx=0 tx=0).stop 2024-09-13T02:51:09.013 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:09.011+0000 7fe585a36640 1 -- 172.21.15.89:0/2106402640 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe580102550 msgr2=0x7fe5801135b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:09.013 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:09.011+0000 7fe585a36640 1 --2- 172.21.15.89:0/2106402640 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe580102550 0x7fe5801135b0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fe570000c00 tx=0x7fe570009da0 comp rx=0 tx=0).stop 2024-09-13T02:51:09.013 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:09.011+0000 7fe585a36640 1 -- 172.21.15.89:0/2106402640 shutdown_connections 2024-09-13T02:51:09.013 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:09.011+0000 7fe585a36640 1 --2- 172.21.15.89:0/2106402640 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fe56c06ed60 0x7fe56c071210 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:09.013 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:09.011+0000 7fe585a36640 1 --2- 172.21.15.89:0/2106402640 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe580102ef0 0x7fe580113af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:09.013 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:09.011+0000 7fe585a36640 1 --2- 172.21.15.89:0/2106402640 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe580102550 0x7fe5801135b0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:09.013 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:09.011+0000 7fe585a36640 1 -- 172.21.15.89:0/2106402640 >> 172.21.15.89:0/2106402640 conn(0x7fe5800f80f0 msgr2=0x7fe5800f9180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:51:09.013 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:09.011+0000 7fe585a36640 1 -- 172.21.15.89:0/2106402640 shutdown_connections 2024-09-13T02:51:09.013 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:09.011+0000 7fe585a36640 1 -- 172.21.15.89:0/2106402640 wait complete. 2024-09-13T02:51:09.048 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:09.034+0000 7f0467ea6640 1 -- 172.21.15.89:0/3814071951 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f04600fcf80 msgr2=0x7f04600fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:09.048 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:09.034+0000 7f0467ea6640 1 --2- 172.21.15.89:0/3814071951 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f04600fcf80 0x7f04600fd3d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f04500048d0 tx=0x7f0450009da0 comp rx=0 tx=0).stop 2024-09-13T02:51:09.048 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:09.034+0000 7f0467ea6640 1 -- 172.21.15.89:0/3814071951 shutdown_connections 2024-09-13T02:51:09.048 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:09.034+0000 7f0467ea6640 1 --2- 172.21.15.89:0/3814071951 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f04600fcf80 0x7f04600fd3d0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:09.048 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:09.034+0000 7f0467ea6640 1 --2- 172.21.15.89:0/3814071951 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f04600fb810 0x7f04600fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:09.048 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:09.034+0000 7f0467ea6640 1 -- 172.21.15.89:0/3814071951 >> 172.21.15.89:0/3814071951 conn(0x7f04600723b0 msgr2=0x7f04600727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:51:09.049 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:09.034+0000 7f0467ea6640 1 -- 172.21.15.89:0/3814071951 shutdown_connections 2024-09-13T02:51:09.049 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:09.034+0000 7f0467ea6640 1 -- 172.21.15.89:0/3814071951 wait complete. 2024-09-13T02:51:09.049 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:09.034+0000 7f0467ea6640 1 Processor -- start 2024-09-13T02:51:09.049 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:09.035+0000 7f0467ea6640 1 -- start start 2024-09-13T02:51:09.049 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:09.035+0000 7f0467ea6640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f04600fb810 0x7f0460113180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:09.049 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:09.035+0000 7f0467ea6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f04600fcf80 0x7f04601136c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:09.049 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:09.035+0000 7f0467ea6640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0460113cc0 con 0x7f04600fcf80 2024-09-13T02:51:09.049 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:09.035+0000 7f0467ea6640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f046010d150 con 0x7f04600fb810 2024-09-13T02:51:09.049 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:09.035+0000 7f0465441640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f04600fcf80 0x7f04601136c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:09.049 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:09.035+0000 7f0465441640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f04600fcf80 0x7f04601136c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:51012/0 (socket says 172.21.15.89:51012) 2024-09-13T02:51:09.049 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:09.035+0000 7f0465441640 1 -- 172.21.15.89:0/785015675 learned_addr learned my addr 172.21.15.89:0/785015675 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:51:09.049 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:09.035+0000 7f0465c42640 1 --2- 172.21.15.89:0/785015675 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f04600fb810 0x7f0460113180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:09.049 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:09.035+0000 7f0465441640 1 -- 172.21.15.89:0/785015675 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f04600fb810 msgr2=0x7f0460113180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:09.050 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:09.035+0000 7f0465441640 1 --2- 172.21.15.89:0/785015675 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f04600fb810 0x7f0460113180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:09.050 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:09.035+0000 7f0465441640 1 -- 172.21.15.89:0/785015675 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0450005040 con 0x7f04600fcf80 2024-09-13T02:51:09.050 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:09.035+0000 7f0465441640 1 --2- 172.21.15.89:0/785015675 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f04600fcf80 0x7f04601136c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0450000c00 tx=0x7f0450009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:51:09.050 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:09.036+0000 7f04567fc640 1 -- 172.21.15.89:0/785015675 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0450038070 con 0x7f04600fcf80 2024-09-13T02:51:09.050 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:09.036+0000 7f04567fc640 1 -- 172.21.15.89:0/785015675 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f045002ade0 con 0x7f04600fcf80 2024-09-13T02:51:09.050 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:09.036+0000 7f0467ea6640 1 -- 172.21.15.89:0/785015675 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f046010d3d0 con 0x7f04600fcf80 2024-09-13T02:51:09.050 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:09.036+0000 7f04567fc640 1 -- 172.21.15.89:0/785015675 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f045002c7b0 con 0x7f04600fcf80 2024-09-13T02:51:09.050 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:09.036+0000 7f0467ea6640 1 -- 172.21.15.89:0/785015675 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f046010d910 con 0x7f04600fcf80 2024-09-13T02:51:09.050 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:09.037+0000 7f0467ea6640 1 -- 172.21.15.89:0/785015675 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04600fcbc0 con 0x7f04600fcf80 2024-09-13T02:51:09.050 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:09.037+0000 7f04567fc640 1 -- 172.21.15.89:0/785015675 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f0450030020 con 0x7f04600fcf80 2024-09-13T02:51:09.050 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:09.038+0000 7f04567fc640 1 --2- 172.21.15.89:0/785015675 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f044c06ed50 0x7f044c071200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:09.050 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:09.038+0000 7f04567fc640 1 -- 172.21.15.89:0/785015675 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f04500ae160 con 0x7f04600fcf80 2024-09-13T02:51:09.050 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:09.038+0000 7f0465c42640 1 --2- 172.21.15.89:0/785015675 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f044c06ed50 0x7f044c071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:09.051 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:09.039+0000 7f0465c42640 1 --2- 172.21.15.89:0/785015675 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f044c06ed50 0x7f044c071200 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f045c009af0 tx=0x7f045c00b040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:51:09.051 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:09.042+0000 7f04567fc640 1 -- 172.21.15.89:0/785015675 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f045007b640 con 0x7f04600fcf80 2024-09-13T02:51:09.208 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:09.207+0000 7f0467ea6640 1 -- 172.21.15.89:0/785015675 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f046010e7f0 con 0x7f04600fcf80 2024-09-13T02:51:09.209 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:09.207+0000 7f04567fc640 1 -- 172.21.15.89:0/785015675 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f045007afe0 con 0x7f04600fcf80 2024-09-13T02:51:09.209 INFO:teuthology.orchestra.run.smithi089.stdout:81604378651 2024-09-13T02:51:09.211 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:09.209+0000 7f0467ea6640 1 -- 172.21.15.89:0/785015675 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f044c06ed50 msgr2=0x7f044c071200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:09.211 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:09.209+0000 7f0467ea6640 1 --2- 172.21.15.89:0/785015675 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f044c06ed50 0x7f044c071200 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f045c009af0 tx=0x7f045c00b040 comp rx=0 tx=0).stop 2024-09-13T02:51:09.211 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:09.209+0000 7f0467ea6640 1 -- 172.21.15.89:0/785015675 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f04600fcf80 msgr2=0x7f04601136c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:09.211 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:09.209+0000 7f0467ea6640 1 --2- 172.21.15.89:0/785015675 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f04600fcf80 0x7f04601136c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0450000c00 tx=0x7f0450009da0 comp rx=0 tx=0).stop 2024-09-13T02:51:09.211 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:09.209+0000 7f0467ea6640 1 -- 172.21.15.89:0/785015675 shutdown_connections 2024-09-13T02:51:09.211 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:09.209+0000 7f0467ea6640 1 --2- 172.21.15.89:0/785015675 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f04600fcf80 0x7f04601136c0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:09.211 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:09.209+0000 7f0467ea6640 1 --2- 172.21.15.89:0/785015675 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f044c06ed50 0x7f044c071200 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:09.211 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:09.209+0000 7f0467ea6640 1 --2- 172.21.15.89:0/785015675 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f04600fb810 0x7f0460113180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:09.211 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:09.209+0000 7f0467ea6640 1 -- 172.21.15.89:0/785015675 >> 172.21.15.89:0/785015675 conn(0x7f04600723b0 msgr2=0x7f0460104530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:51:09.212 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:09.209+0000 7f0467ea6640 1 -- 172.21.15.89:0/785015675 shutdown_connections 2024-09-13T02:51:09.212 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:09.209+0000 7f0467ea6640 1 -- 172.21.15.89:0/785015675 wait complete. 2024-09-13T02:51:09.711 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:09 smithi089 ceph-mon[27639]: from='client.? 172.21.15.89:0/2106402640' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-13T02:51:09.711 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:09 smithi089 ceph-mon[27639]: from='client.? 172.21.15.89:0/785015675' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-13T02:51:09.735 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149714 got 111669149716 for osd.3 2024-09-13T02:51:09.736 DEBUG:teuthology.parallel:result is None 2024-09-13T02:51:09.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:09 smithi131 ceph-mon[34689]: from='client.? 172.21.15.89:0/2106402640' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-13T02:51:09.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:09 smithi131 ceph-mon[34689]: from='client.? 172.21.15.89:0/785015675' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-13T02:51:10.449 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:10.442+0000 7ff763bea640 1 -- 172.21.15.89:0/3622982957 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff75c102570 msgr2=0x7ff75c102940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:10.450 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:10.442+0000 7ff763bea640 1 --2- 172.21.15.89:0/3622982957 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff75c102570 0x7ff75c102940 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ff7580048d0 tx=0x7ff758009da0 comp rx=0 tx=0).stop 2024-09-13T02:51:10.450 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:10.442+0000 7ff763bea640 1 -- 172.21.15.89:0/3622982957 shutdown_connections 2024-09-13T02:51:10.450 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:10.442+0000 7ff763bea640 1 --2- 172.21.15.89:0/3622982957 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff75c102f10 0x7ff75c0fac60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:10.450 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:10.442+0000 7ff763bea640 1 --2- 172.21.15.89:0/3622982957 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff75c102570 0x7ff75c102940 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:10.450 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:10.442+0000 7ff763bea640 1 -- 172.21.15.89:0/3622982957 >> 172.21.15.89:0/3622982957 conn(0x7ff75c070c80 msgr2=0x7ff75c071080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:51:10.450 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:10.442+0000 7ff763bea640 1 -- 172.21.15.89:0/3622982957 shutdown_connections 2024-09-13T02:51:10.450 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:10.442+0000 7ff763bea640 1 -- 172.21.15.89:0/3622982957 wait complete. 2024-09-13T02:51:10.450 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:10.442+0000 7ff763bea640 1 Processor -- start 2024-09-13T02:51:10.450 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:10.442+0000 7ff763bea640 1 -- start start 2024-09-13T02:51:10.450 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:10.442+0000 7ff763bea640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff75c102570 0x7ff75c1131d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:10.450 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:10.442+0000 7ff763bea640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff75c102f10 0x7ff75c113710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:10.451 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:10.442+0000 7ff763bea640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff75c113d10 con 0x7ff75c102f10 2024-09-13T02:51:10.451 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:10.442+0000 7ff763bea640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff75c10d150 con 0x7ff75c102570 2024-09-13T02:51:10.451 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:10.443+0000 7ff761185640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff75c102f10 0x7ff75c113710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:10.451 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:10.443+0000 7ff761185640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff75c102f10 0x7ff75c113710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:51026/0 (socket says 172.21.15.89:51026) 2024-09-13T02:51:10.451 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:10.443+0000 7ff761185640 1 -- 172.21.15.89:0/2666878246 learned_addr learned my addr 172.21.15.89:0/2666878246 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:51:10.451 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:10.443+0000 7ff761986640 1 --2- 172.21.15.89:0/2666878246 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff75c102570 0x7ff75c1131d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:10.451 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:10.443+0000 7ff761185640 1 -- 172.21.15.89:0/2666878246 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff75c102570 msgr2=0x7ff75c1131d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:10.451 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:10.443+0000 7ff761185640 1 --2- 172.21.15.89:0/2666878246 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff75c102570 0x7ff75c1131d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:10.451 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:10.443+0000 7ff761185640 1 -- 172.21.15.89:0/2666878246 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff758005040 con 0x7ff75c102f10 2024-09-13T02:51:10.451 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:10.443+0000 7ff761185640 1 --2- 172.21.15.89:0/2666878246 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff75c102f10 0x7ff75c113710 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ff74c00c740 tx=0x7ff74c0043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:51:10.451 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:10.443+0000 7ff7527fc640 1 -- 172.21.15.89:0/2666878246 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff74c012810 con 0x7ff75c102f10 2024-09-13T02:51:10.451 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:10.443+0000 7ff7527fc640 1 -- 172.21.15.89:0/2666878246 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff74c012e10 con 0x7ff75c102f10 2024-09-13T02:51:10.451 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:10.443+0000 7ff7527fc640 1 -- 172.21.15.89:0/2666878246 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff74c00a2f0 con 0x7ff75c102f10 2024-09-13T02:51:10.452 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:10.443+0000 7ff763bea640 1 -- 172.21.15.89:0/2666878246 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff75c10d430 con 0x7ff75c102f10 2024-09-13T02:51:10.452 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:10.443+0000 7ff763bea640 1 -- 172.21.15.89:0/2666878246 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff75c10d9d0 con 0x7ff75c102f10 2024-09-13T02:51:10.452 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:10.444+0000 7ff763bea640 1 -- 172.21.15.89:0/2666878246 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff75c065800 con 0x7ff75c102f10 2024-09-13T02:51:10.452 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:10.445+0000 7ff7527fc640 1 -- 172.21.15.89:0/2666878246 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7ff74c011380 con 0x7ff75c102f10 2024-09-13T02:51:10.452 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:10.445+0000 7ff7527fc640 1 --2- 172.21.15.89:0/2666878246 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7ff74806ed50 0x7ff748071200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:10.452 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:10.445+0000 7ff7527fc640 1 -- 172.21.15.89:0/2666878246 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7ff74c08e200 con 0x7ff75c102f10 2024-09-13T02:51:10.452 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:10.445+0000 7ff761986640 1 --2- 172.21.15.89:0/2666878246 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7ff74806ed50 0x7ff748071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:10.452 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:10.446+0000 7ff761986640 1 --2- 172.21.15.89:0/2666878246 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7ff74806ed50 0x7ff748071200 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff758009ac0 tx=0x7ff758035040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:51:10.452 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:10.449+0000 7ff7527fc640 1 -- 172.21.15.89:0/2666878246 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7ff74c05b6e0 con 0x7ff75c102f10 2024-09-13T02:51:10.610 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:10.608+0000 7ff763bea640 1 -- 172.21.15.89:0/2666878246 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7ff75c1095f0 con 0x7ff75c102f10 2024-09-13T02:51:10.610 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:10.609+0000 7ff7527fc640 1 -- 172.21.15.89:0/2666878246 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff74c05b080 con 0x7ff75c102f10 2024-09-13T02:51:10.610 INFO:teuthology.orchestra.run.smithi089.stdout:60129542177 2024-09-13T02:51:10.612 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:10.610+0000 7ff763bea640 1 -- 172.21.15.89:0/2666878246 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7ff74806ed50 msgr2=0x7ff748071200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:10.612 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:10.610+0000 7ff763bea640 1 --2- 172.21.15.89:0/2666878246 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7ff74806ed50 0x7ff748071200 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7ff758009ac0 tx=0x7ff758035040 comp rx=0 tx=0).stop 2024-09-13T02:51:10.612 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:10.610+0000 7ff763bea640 1 -- 172.21.15.89:0/2666878246 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff75c102f10 msgr2=0x7ff75c113710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:10.612 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:10.610+0000 7ff763bea640 1 --2- 172.21.15.89:0/2666878246 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff75c102f10 0x7ff75c113710 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ff74c00c740 tx=0x7ff74c0043c0 comp rx=0 tx=0).stop 2024-09-13T02:51:10.612 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:10.610+0000 7ff763bea640 1 -- 172.21.15.89:0/2666878246 shutdown_connections 2024-09-13T02:51:10.612 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:10.610+0000 7ff763bea640 1 --2- 172.21.15.89:0/2666878246 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff75c102f10 0x7ff75c113710 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:10.613 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:10.610+0000 7ff763bea640 1 --2- 172.21.15.89:0/2666878246 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7ff74806ed50 0x7ff748071200 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:10.613 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:10.611+0000 7ff763bea640 1 --2- 172.21.15.89:0/2666878246 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff75c102570 0x7ff75c1131d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:10.613 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:10.611+0000 7ff763bea640 1 -- 172.21.15.89:0/2666878246 >> 172.21.15.89:0/2666878246 conn(0x7ff75c070c80 msgr2=0x7ff75c105330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:51:10.613 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:10.611+0000 7ff763bea640 1 -- 172.21.15.89:0/2666878246 shutdown_connections 2024-09-13T02:51:10.613 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:10.611+0000 7ff763bea640 1 -- 172.21.15.89:0/2666878246 wait complete. 2024-09-13T02:51:10.621 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:10 smithi089 ceph-mon[27639]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:51:10.835 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:10 smithi131 ceph-mon[34689]: pgmap v151: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:51:10.892 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378649 got 81604378651 for osd.2 2024-09-13T02:51:10.893 DEBUG:teuthology.parallel:result is None 2024-09-13T02:51:11.063 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:11.061+0000 7f36b12b4640 1 -- 172.21.15.89:0/13981215 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f36ac102ef0 msgr2=0x7f36ac0fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:11.063 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:11.061+0000 7f36b12b4640 1 --2- 172.21.15.89:0/13981215 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f36ac102ef0 0x7f36ac0fc5b0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f36a00048d0 tx=0x7f36a0009da0 comp rx=0 tx=0).stop 2024-09-13T02:51:11.063 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:11.061+0000 7f36b12b4640 1 -- 172.21.15.89:0/13981215 shutdown_connections 2024-09-13T02:51:11.063 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:11.061+0000 7f36b12b4640 1 --2- 172.21.15.89:0/13981215 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f36ac102ef0 0x7f36ac0fc5b0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:11.063 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:11.061+0000 7f36b12b4640 1 --2- 172.21.15.89:0/13981215 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f36ac102550 0x7f36ac102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:11.063 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:11.061+0000 7f36b12b4640 1 -- 172.21.15.89:0/13981215 >> 172.21.15.89:0/13981215 conn(0x7f36ac0f80f0 msgr2=0x7f36ac0fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:51:11.063 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:11.061+0000 7f36b12b4640 1 -- 172.21.15.89:0/13981215 shutdown_connections 2024-09-13T02:51:11.064 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:11.061+0000 7f36b12b4640 1 -- 172.21.15.89:0/13981215 wait complete. 2024-09-13T02:51:11.065 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:11.062+0000 7f36b12b4640 1 Processor -- start 2024-09-13T02:51:11.065 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:11.062+0000 7f36b12b4640 1 -- start start 2024-09-13T02:51:11.065 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:11.062+0000 7f36b12b4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f36ac102550 0x7f36ac113520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:11.066 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:11.062+0000 7f36b12b4640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f36ac102ef0 0x7f36ac113a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:11.066 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:11.062+0000 7f36b12b4640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36ac1140b0 con 0x7f36ac102550 2024-09-13T02:51:11.066 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:11.062+0000 7f36b12b4640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36ac10d4c0 con 0x7f36ac102ef0 2024-09-13T02:51:11.066 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:11.062+0000 7f36aaffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f36ac102550 0x7f36ac113520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:11.066 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:11.062+0000 7f36aaffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f36ac102550 0x7f36ac113520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:51042/0 (socket says 172.21.15.89:51042) 2024-09-13T02:51:11.066 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:11.062+0000 7f36aaffd640 1 -- 172.21.15.89:0/3574068061 learned_addr learned my addr 172.21.15.89:0/3574068061 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:51:11.066 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:11.063+0000 7f36aa7fc640 1 --2- 172.21.15.89:0/3574068061 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f36ac102ef0 0x7f36ac113a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:11.066 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:11.063+0000 7f36aaffd640 1 -- 172.21.15.89:0/3574068061 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f36ac102ef0 msgr2=0x7f36ac113a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:11.066 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:11.063+0000 7f36aaffd640 1 --2- 172.21.15.89:0/3574068061 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f36ac102ef0 0x7f36ac113a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:11.066 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:11.063+0000 7f36aaffd640 1 -- 172.21.15.89:0/3574068061 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36a0005040 con 0x7f36ac102550 2024-09-13T02:51:11.066 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:11.063+0000 7f36aaffd640 1 --2- 172.21.15.89:0/3574068061 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f36ac102550 0x7f36ac113520 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f369c002a50 tx=0x7f369c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:51:11.066 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:11.063+0000 7f36937fe640 1 -- 172.21.15.89:0/3574068061 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f369c007c30 con 0x7f36ac102550 2024-09-13T02:51:11.066 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:11.063+0000 7f36b12b4640 1 -- 172.21.15.89:0/3574068061 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36ac10d7a0 con 0x7f36ac102550 2024-09-13T02:51:11.067 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:11.063+0000 7f36937fe640 1 -- 172.21.15.89:0/3574068061 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f369c00f040 con 0x7f36ac102550 2024-09-13T02:51:11.067 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:11.063+0000 7f36b12b4640 1 -- 172.21.15.89:0/3574068061 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36ac10dd10 con 0x7f36ac102550 2024-09-13T02:51:11.067 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:11.063+0000 7f36937fe640 1 -- 172.21.15.89:0/3574068061 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f369c00da10 con 0x7f36ac102550 2024-09-13T02:51:11.067 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:11.064+0000 7f36b12b4640 1 -- 172.21.15.89:0/3574068061 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36ac0fdcd0 con 0x7f36ac102550 2024-09-13T02:51:11.067 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:11.065+0000 7f36937fe640 1 -- 172.21.15.89:0/3574068061 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f369c00dc50 con 0x7f36ac102550 2024-09-13T02:51:11.067 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:11.065+0000 7f36937fe640 1 --2- 172.21.15.89:0/3574068061 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f369406ed60 0x7f3694071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:11.068 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:11.065+0000 7f36937fe640 1 -- 172.21.15.89:0/3574068061 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f369c08d520 con 0x7f36ac102550 2024-09-13T02:51:11.068 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:11.065+0000 7f36aa7fc640 1 --2- 172.21.15.89:0/3574068061 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f369406ed60 0x7f3694071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:11.068 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:11.065+0000 7f36aa7fc640 1 --2- 172.21.15.89:0/3574068061 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f369406ed60 0x7f3694071210 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f36a00048a0 tx=0x7f36a0035040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:51:11.070 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:11.069+0000 7f36937fe640 1 -- 172.21.15.89:0/3574068061 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f369c04d2a0 con 0x7f36ac102550 2024-09-13T02:51:11.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:11.229+0000 7f36b12b4640 1 -- 172.21.15.89:0/3574068061 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f36ac04b750 con 0x7f36ac102550 2024-09-13T02:51:11.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:11.229+0000 7f36937fe640 1 -- 172.21.15.89:0/3574068061 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f369c05aab0 con 0x7f36ac102550 2024-09-13T02:51:11.231 INFO:teuthology.orchestra.run.smithi089.stdout:38654705702 2024-09-13T02:51:11.233 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:11.231+0000 7f36b12b4640 1 -- 172.21.15.89:0/3574068061 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f369406ed60 msgr2=0x7f3694071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:11.233 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:11.231+0000 7f36b12b4640 1 --2- 172.21.15.89:0/3574068061 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f369406ed60 0x7f3694071210 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f36a00048a0 tx=0x7f36a0035040 comp rx=0 tx=0).stop 2024-09-13T02:51:11.233 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:11.231+0000 7f36b12b4640 1 -- 172.21.15.89:0/3574068061 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f36ac102550 msgr2=0x7f36ac113520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:11.233 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:11.231+0000 7f36b12b4640 1 --2- 172.21.15.89:0/3574068061 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f36ac102550 0x7f36ac113520 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f369c002a50 tx=0x7f369c004600 comp rx=0 tx=0).stop 2024-09-13T02:51:11.233 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:11.231+0000 7f36b12b4640 1 -- 172.21.15.89:0/3574068061 shutdown_connections 2024-09-13T02:51:11.233 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:11.231+0000 7f36b12b4640 1 --2- 172.21.15.89:0/3574068061 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f369406ed60 0x7f3694071210 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:11.233 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:11.231+0000 7f36b12b4640 1 --2- 172.21.15.89:0/3574068061 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f36ac102ef0 0x7f36ac113a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:11.233 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:11.231+0000 7f36b12b4640 1 --2- 172.21.15.89:0/3574068061 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f36ac102550 0x7f36ac113520 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:11.233 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:11.231+0000 7f36b12b4640 1 -- 172.21.15.89:0/3574068061 >> 172.21.15.89:0/3574068061 conn(0x7f36ac0f80f0 msgr2=0x7f36ac0f9150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:51:11.233 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:11.231+0000 7f36b12b4640 1 -- 172.21.15.89:0/3574068061 shutdown_connections 2024-09-13T02:51:11.233 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:11.231+0000 7f36b12b4640 1 -- 172.21.15.89:0/3574068061 wait complete. 2024-09-13T02:51:11.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:11 smithi089 ceph-mon[27639]: from='client.? 172.21.15.89:0/2666878246' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-13T02:51:11.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:11 smithi089 ceph-mon[27639]: from='client.? 172.21.15.89:0/3574068061' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-13T02:51:11.841 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542174 got 60129542177 for osd.1 2024-09-13T02:51:11.841 DEBUG:teuthology.parallel:result is None 2024-09-13T02:51:11.933 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:11 smithi131 ceph-mon[34689]: from='client.? 172.21.15.89:0/2666878246' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-13T02:51:11.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:11 smithi131 ceph-mon[34689]: from='client.? 172.21.15.89:0/3574068061' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-13T02:51:12.592 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705700 got 38654705702 for osd.0 2024-09-13T02:51:12.592 DEBUG:teuthology.parallel:result is None 2024-09-13T02:51:12.593 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-13T02:51:12.593 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-13T02:51:12.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:12 smithi089 ceph-mon[27639]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:51:12.839 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T02:51:12.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:12 smithi131 ceph-mon[34689]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:51:14.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:14.498+0000 7f00e5de6640 1 -- 172.21.15.89:0/2868061882 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f00e006fa30 msgr2=0x7f00e006fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:14.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:14.498+0000 7f00e5de6640 1 --2- 172.21.15.89:0/2868061882 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f00e006fa30 0x7f00e006fe00 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f00d00048d0 tx=0x7f00d0009da0 comp rx=0 tx=0).stop 2024-09-13T02:51:14.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:14.498+0000 7f00e5de6640 1 -- 172.21.15.89:0/2868061882 shutdown_connections 2024-09-13T02:51:14.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:14.498+0000 7f00e5de6640 1 --2- 172.21.15.89:0/2868061882 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f00e0070340 0x7f00e0108910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:14.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:14.498+0000 7f00e5de6640 1 --2- 172.21.15.89:0/2868061882 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f00e006fa30 0x7f00e006fe00 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:14.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:14.498+0000 7f00e5de6640 1 -- 172.21.15.89:0/2868061882 >> 172.21.15.89:0/2868061882 conn(0x7f00e00f80f0 msgr2=0x7f00e00fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:51:14.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:14.498+0000 7f00e5de6640 1 -- 172.21.15.89:0/2868061882 shutdown_connections 2024-09-13T02:51:14.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:14.498+0000 7f00e5de6640 1 -- 172.21.15.89:0/2868061882 wait complete. 2024-09-13T02:51:14.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:14.499+0000 7f00e5de6640 1 Processor -- start 2024-09-13T02:51:14.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:14.499+0000 7f00e5de6640 1 -- start start 2024-09-13T02:51:14.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:14.499+0000 7f00e5de6640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f00e006fa30 0x7f00e0115730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:14.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:14.499+0000 7f00e5de6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f00e0070340 0x7f00e0115c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:14.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:14.499+0000 7f00e5de6640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00e01162c0 con 0x7f00e0070340 2024-09-13T02:51:14.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:14.499+0000 7f00e5de6640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00e010f720 con 0x7f00e006fa30 2024-09-13T02:51:14.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:14.499+0000 7f00deffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f00e0070340 0x7f00e0115c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:14.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:14.499+0000 7f00deffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f00e0070340 0x7f00e0115c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:37432/0 (socket says 172.21.15.89:37432) 2024-09-13T02:51:14.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:14.499+0000 7f00deffd640 1 -- 172.21.15.89:0/2340378224 learned_addr learned my addr 172.21.15.89:0/2340378224 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:51:14.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:14.500+0000 7f00df7fe640 1 --2- 172.21.15.89:0/2340378224 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f00e006fa30 0x7f00e0115730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:14.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:14.500+0000 7f00deffd640 1 -- 172.21.15.89:0/2340378224 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f00e006fa30 msgr2=0x7f00e0115730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:14.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:14.500+0000 7f00deffd640 1 --2- 172.21.15.89:0/2340378224 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f00e006fa30 0x7f00e0115730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:14.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:14.500+0000 7f00deffd640 1 -- 172.21.15.89:0/2340378224 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00d0005040 con 0x7f00e0070340 2024-09-13T02:51:14.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:14.500+0000 7f00deffd640 1 --2- 172.21.15.89:0/2340378224 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f00e0070340 0x7f00e0115c70 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f00d4002a50 tx=0x7f00d4004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:51:14.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:14.500+0000 7f00c7fff640 1 -- 172.21.15.89:0/2340378224 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f00d4007c30 con 0x7f00e0070340 2024-09-13T02:51:14.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:14.500+0000 7f00e5de6640 1 -- 172.21.15.89:0/2340378224 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00e010fa00 con 0x7f00e0070340 2024-09-13T02:51:14.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:14.500+0000 7f00c7fff640 1 -- 172.21.15.89:0/2340378224 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f00d400f040 con 0x7f00e0070340 2024-09-13T02:51:14.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:14.500+0000 7f00c7fff640 1 -- 172.21.15.89:0/2340378224 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f00d400da10 con 0x7f00e0070340 2024-09-13T02:51:14.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:14.500+0000 7f00e5de6640 1 -- 172.21.15.89:0/2340378224 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00e010ff20 con 0x7f00e0070340 2024-09-13T02:51:14.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:14.501+0000 7f00e5de6640 1 -- 172.21.15.89:0/2340378224 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00e0071170 con 0x7f00e0070340 2024-09-13T02:51:14.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:14.502+0000 7f00c7fff640 1 -- 172.21.15.89:0/2340378224 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f00d400dc80 con 0x7f00e0070340 2024-09-13T02:51:14.511 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:14.502+0000 7f00c7fff640 1 --2- 172.21.15.89:0/2340378224 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f00c806ed60 0x7f00c8071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:14.511 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:14.502+0000 7f00c7fff640 1 -- 172.21.15.89:0/2340378224 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f00d408d600 con 0x7f00e0070340 2024-09-13T02:51:14.511 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:14.502+0000 7f00df7fe640 1 --2- 172.21.15.89:0/2340378224 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f00c806ed60 0x7f00c8071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:14.511 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:14.503+0000 7f00df7fe640 1 --2- 172.21.15.89:0/2340378224 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f00c806ed60 0x7f00c8071210 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f00d0009ac0 tx=0x7f00d0035040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:51:14.511 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:14.506+0000 7f00c7fff640 1 -- 172.21.15.89:0/2340378224 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f00d404d2a0 con 0x7f00e0070340 2024-09-13T02:51:14.660 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:14.658+0000 7f00e5de6640 1 -- 172.21.15.89:0/2340378224 --> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f00e010b780 con 0x7f00c806ed60 2024-09-13T02:51:14.660 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:14 smithi089 ceph-mon[27639]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:51:14.660 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:14 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:51:14.661 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:14.660+0000 7f00c7fff640 1 -- 172.21.15.89:0/2340378224 <== mgr.14204 v2:172.21.15.89:6800/1506060926 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+27889 (secure 0 0 0) 0x7f00e010b780 con 0x7f00c806ed60 2024-09-13T02:51:14.661 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:51:14.662 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-09-13T02:51:14.663 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:14.662+0000 7f00e5de6640 1 -- 172.21.15.89:0/2340378224 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f00c806ed60 msgr2=0x7f00c8071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:14.663 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:14.662+0000 7f00e5de6640 1 --2- 172.21.15.89:0/2340378224 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f00c806ed60 0x7f00c8071210 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f00d0009ac0 tx=0x7f00d0035040 comp rx=0 tx=0).stop 2024-09-13T02:51:14.663 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:14.662+0000 7f00e5de6640 1 -- 172.21.15.89:0/2340378224 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f00e0070340 msgr2=0x7f00e0115c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:14.663 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:14.662+0000 7f00e5de6640 1 --2- 172.21.15.89:0/2340378224 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f00e0070340 0x7f00e0115c70 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f00d4002a50 tx=0x7f00d4004600 comp rx=0 tx=0).stop 2024-09-13T02:51:14.664 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:14.662+0000 7f00e5de6640 1 -- 172.21.15.89:0/2340378224 shutdown_connections 2024-09-13T02:51:14.664 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:14.662+0000 7f00e5de6640 1 --2- 172.21.15.89:0/2340378224 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f00e0070340 0x7f00e0115c70 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:14.664 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:14.662+0000 7f00e5de6640 1 --2- 172.21.15.89:0/2340378224 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f00c806ed60 0x7f00c8071210 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:14.664 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:14.662+0000 7f00e5de6640 1 --2- 172.21.15.89:0/2340378224 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f00e006fa30 0x7f00e0115730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:14.664 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:14.662+0000 7f00e5de6640 1 -- 172.21.15.89:0/2340378224 >> 172.21.15.89:0/2340378224 conn(0x7f00e00f80f0 msgr2=0x7f00e00f96c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:51:14.664 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:14.662+0000 7f00e5de6640 1 -- 172.21.15.89:0/2340378224 shutdown_connections 2024-09-13T02:51:14.664 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:14.662+0000 7f00e5de6640 1 -- 172.21.15.89:0/2340378224 wait complete. 2024-09-13T02:51:14.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:14 smithi131 ceph-mon[34689]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:51:14.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:14 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:51:15.318 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":153,"stamp":"2024-09-13T02:51:12.982988+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":1787920,"kb_used_data":3776,"kb_used_omap":9,"kb_used_meta":1784054,"kb_avail":560682992,"statfs":{"total":575970213888,"available":574139383808,"internally_reserved":0,"allocated":3866624,"data_stored":2557486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10224,"internal_metadata":1826871312},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002058"},"pg_stats":[{"pgid":"1.0","version":"22'72","reported_seq":129,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T02:50:21.812448+0000","last_change":"2024-09-13T02:49:58.547155+0000","last_active":"2024-09-13T02:50:21.812448+0000","last_peered":"2024-09-13T02:50:21.812448+0000","last_clean":"2024-09-13T02:50:21.812448+0000","last_became_active":"2024-09-13T02:49:58.546716+0000","last_became_peered":"2024-09-13T02:49:58.546716+0000","last_unstale":"2024-09-13T02:50:21.812448+0000","last_undegraded":"2024-09-13T02:50:21.812448+0000","last_fullsized":"2024-09-13T02:50:21.812448+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T02:49:11.600483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T02:49:11.600483+0000","last_clean_scrub_stamp":"2024-09-13T02:49:11.600483+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:34:24.152755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":37,"seq":158913789965,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297696,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447456,"statfs":{"total":95995035648,"available":95690194944,"internally_reserved":0,"allocated":348160,"data_stored":131166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.317}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32900000000000001}]}]},{"osd":4,"up_from":32,"seq":137438953489,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297696,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447456,"statfs":{"total":95995035648,"available":95690194944,"internally_reserved":0,"allocated":348160,"data_stored":131166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 02:51:00 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.42799999999999999}]},{"osd":1,"last update":"Fri Sep 13 02:51:00 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.438},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.36699999999999999}]},{"osd":2,"last update":"Fri Sep 13 02:51:00 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.40899999999999997}]},{"osd":3,"last update":"Fri Sep 13 02:51:00 2024","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.504,"5min":0.504,"15min":0.504},"last":0.28000000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29699999999999999}]}]},{"osd":3,"up_from":26,"seq":111669149717,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298276,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446876,"statfs":{"total":95995035648,"available":95689601024,"internally_reserved":0,"allocated":942080,"data_stored":721534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 02:50:34 2024","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.48499999999999999}]},{"osd":1,"last update":"Fri Sep 13 02:50:34 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.57799999999999996}]},{"osd":2,"last update":"Fri Sep 13 02:50:34 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.50900000000000001}]},{"osd":4,"last update":"Fri Sep 13 02:51:02 2024","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.60199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64000000000000001}]}]},{"osd":2,"up_from":19,"seq":81604378652,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297696,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447456,"statfs":{"total":95995035648,"available":95690194944,"internally_reserved":0,"allocated":348160,"data_stored":131166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 02:50:11 2024","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"min":{"1min":0.17399999999999999,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"last":0.27400000000000002}]},{"osd":1,"last update":"Fri Sep 13 02:50:11 2024","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.5,"5min":0.5,"15min":0.5},"last":0.34599999999999997}]},{"osd":3,"last update":"Fri Sep 13 02:50:35 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.58899999999999997}]},{"osd":4,"last update":"Fri Sep 13 02:51:03 2024","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.52700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]}]},{"osd":1,"up_from":14,"seq":60129542178,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298280,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446872,"statfs":{"total":95995035648,"available":95689596928,"internally_reserved":0,"allocated":937984,"data_stored":720920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 02:50:44 2024","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.32500000000000001,"15min":0.317},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.37,"5min":0.33100000000000002,"15min":0.32500000000000001},"min":{"1min":0.26300000000000001,"5min":0.222,"15min":0.222},"max":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"last":0.35999999999999999}]},{"osd":2,"last update":"Fri Sep 13 02:50:14 2024","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.377}]},{"osd":3,"last update":"Fri Sep 13 02:50:36 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.57999999999999996}]},{"osd":4,"last update":"Fri Sep 13 02:51:00 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.59299999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]}]},{"osd":0,"up_from":9,"seq":38654705703,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298276,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446876,"statfs":{"total":95995035648,"available":95689601024,"internally_reserved":0,"allocated":942080,"data_stored":721534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 02:50:44 2024","interfaces":[{"interface":"back","average":{"1min":0.318,"5min":0.312,"15min":0.311},"min":{"1min":0.16500000000000001,"5min":0.16500000000000001,"15min":0.16500000000000001},"max":{"1min":0.498,"5min":0.498,"15min":0.498},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.318,"5min":0.317,"15min":0.317},"min":{"1min":0.23400000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"last":0.245}]},{"osd":2,"last update":"Fri Sep 13 02:50:14 2024","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"last":0.23300000000000001},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"last":0.27300000000000002}]},{"osd":3,"last update":"Fri Sep 13 02:50:34 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.45900000000000002}]},{"osd":4,"last update":"Fri Sep 13 02:51:01 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.436}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T02:51:15.319 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-13T02:51:15.564 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T02:51:15.684 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:15 smithi089 ceph-mon[27639]: from='client.14418 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T02:51:15.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:15 smithi131 ceph-mon[34689]: from='client.14418 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T02:51:16.726 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:16 smithi089 ceph-mon[27639]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:51:16.933 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:16 smithi131 ceph-mon[34689]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:51:17.246 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:17.210+0000 7f6e5bffd640 1 -- 172.21.15.89:0/2260688081 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e540fcf80 msgr2=0x7f6e540fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:17.246 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:17.210+0000 7f6e5bffd640 1 --2- 172.21.15.89:0/2260688081 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e540fcf80 0x7f6e540fd3d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f6e440048d0 tx=0x7f6e44009da0 comp rx=0 tx=0).stop 2024-09-13T02:51:17.246 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:17.210+0000 7f6e5bffd640 1 -- 172.21.15.89:0/2260688081 shutdown_connections 2024-09-13T02:51:17.246 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:17.210+0000 7f6e5bffd640 1 --2- 172.21.15.89:0/2260688081 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e540fcf80 0x7f6e540fd3d0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:17.246 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:17.210+0000 7f6e5bffd640 1 --2- 172.21.15.89:0/2260688081 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e540fb810 0x7f6e540fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:17.247 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:17.210+0000 7f6e5bffd640 1 -- 172.21.15.89:0/2260688081 >> 172.21.15.89:0/2260688081 conn(0x7f6e540723b0 msgr2=0x7f6e540727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:51:17.247 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:17.211+0000 7f6e5bffd640 1 -- 172.21.15.89:0/2260688081 shutdown_connections 2024-09-13T02:51:17.247 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:17.211+0000 7f6e5bffd640 1 -- 172.21.15.89:0/2260688081 wait complete. 2024-09-13T02:51:17.247 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:17.211+0000 7f6e5bffd640 1 Processor -- start 2024-09-13T02:51:17.247 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:17.211+0000 7f6e5bffd640 1 -- start start 2024-09-13T02:51:17.247 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:17.211+0000 7f6e5bffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e540fb810 0x7f6e54113210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:17.248 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:17.211+0000 7f6e5bffd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e540fcf80 0x7f6e54113750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:17.248 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:17.211+0000 7f6e5bffd640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e54113de0 con 0x7f6e540fb810 2024-09-13T02:51:17.248 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:17.211+0000 7f6e5bffd640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e5410d190 con 0x7f6e540fcf80 2024-09-13T02:51:17.248 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:17.211+0000 7f6e59d99640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e540fb810 0x7f6e54113210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:17.248 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:17.211+0000 7f6e59d99640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e540fb810 0x7f6e54113210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:37462/0 (socket says 172.21.15.89:37462) 2024-09-13T02:51:17.249 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:17.211+0000 7f6e59d99640 1 -- 172.21.15.89:0/580729307 learned_addr learned my addr 172.21.15.89:0/580729307 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:51:17.249 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:17.212+0000 7f6e59598640 1 --2- 172.21.15.89:0/580729307 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e540fcf80 0x7f6e54113750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:17.249 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:17.212+0000 7f6e59d99640 1 -- 172.21.15.89:0/580729307 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e540fcf80 msgr2=0x7f6e54113750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:17.249 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:17.212+0000 7f6e59d99640 1 --2- 172.21.15.89:0/580729307 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e540fcf80 0x7f6e54113750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:17.249 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:17.212+0000 7f6e59d99640 1 -- 172.21.15.89:0/580729307 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e44005040 con 0x7f6e540fb810 2024-09-13T02:51:17.249 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:17.212+0000 7f6e59d99640 1 --2- 172.21.15.89:0/580729307 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e540fb810 0x7f6e54113210 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6e5000b790 tx=0x7f6e500091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:51:17.250 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:17.212+0000 7f6e4a7fc640 1 -- 172.21.15.89:0/580729307 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e5000c700 con 0x7f6e540fb810 2024-09-13T02:51:17.250 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:17.212+0000 7f6e4a7fc640 1 -- 172.21.15.89:0/580729307 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f6e5000cd00 con 0x7f6e540fb810 2024-09-13T02:51:17.250 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:17.212+0000 7f6e5bffd640 1 -- 172.21.15.89:0/580729307 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e5410d470 con 0x7f6e540fb810 2024-09-13T02:51:17.250 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:17.212+0000 7f6e4a7fc640 1 -- 172.21.15.89:0/580729307 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e50015e70 con 0x7f6e540fb810 2024-09-13T02:51:17.250 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:17.212+0000 7f6e5bffd640 1 -- 172.21.15.89:0/580729307 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e5410d960 con 0x7f6e540fb810 2024-09-13T02:51:17.251 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:17.213+0000 7f6e5bffd640 1 -- 172.21.15.89:0/580729307 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e540fcbc0 con 0x7f6e540fb810 2024-09-13T02:51:17.251 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:17.213+0000 7f6e4a7fc640 1 -- 172.21.15.89:0/580729307 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f6e50012070 con 0x7f6e540fb810 2024-09-13T02:51:17.251 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:17.214+0000 7f6e4a7fc640 1 --2- 172.21.15.89:0/580729307 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f6e4006ed60 0x7f6e40071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:17.251 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:17.214+0000 7f6e59598640 1 --2- 172.21.15.89:0/580729307 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f6e4006ed60 0x7f6e40071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:17.251 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:17.214+0000 7f6e4a7fc640 1 -- 172.21.15.89:0/580729307 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f6e5008d9c0 con 0x7f6e540fb810 2024-09-13T02:51:17.252 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:17.214+0000 7f6e59598640 1 --2- 172.21.15.89:0/580729307 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f6e4006ed60 0x7f6e40071210 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6e54101280 tx=0x7f6e44035040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:51:17.252 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:17.218+0000 7f6e4a7fc640 1 -- 172.21.15.89:0/580729307 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f6e5005ae20 con 0x7f6e540fb810 2024-09-13T02:51:17.380 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:17.376+0000 7f6e5bffd640 1 -- 172.21.15.89:0/580729307 --> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6e5404b7b0 con 0x7f6e4006ed60 2024-09-13T02:51:17.380 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:17.378+0000 7f6e4a7fc640 1 -- 172.21.15.89:0/580729307 <== mgr.14204 v2:172.21.15.89:6800/1506060926 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+27951 (secure 0 0 0) 0x7f6e5404b7b0 con 0x7f6e4006ed60 2024-09-13T02:51:17.381 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:51:17.381 INFO:teuthology.orchestra.run.smithi089.stderr:dumped all 2024-09-13T02:51:17.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:17.379+0000 7f6e5bffd640 1 -- 172.21.15.89:0/580729307 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f6e4006ed60 msgr2=0x7f6e40071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:17.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:17.380+0000 7f6e5bffd640 1 --2- 172.21.15.89:0/580729307 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f6e4006ed60 0x7f6e40071210 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6e54101280 tx=0x7f6e44035040 comp rx=0 tx=0).stop 2024-09-13T02:51:17.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:17.380+0000 7f6e5bffd640 1 -- 172.21.15.89:0/580729307 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e540fb810 msgr2=0x7f6e54113210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:17.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:17.380+0000 7f6e5bffd640 1 --2- 172.21.15.89:0/580729307 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e540fb810 0x7f6e54113210 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f6e5000b790 tx=0x7f6e500091d0 comp rx=0 tx=0).stop 2024-09-13T02:51:17.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:17.380+0000 7f6e5bffd640 1 -- 172.21.15.89:0/580729307 shutdown_connections 2024-09-13T02:51:17.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:17.380+0000 7f6e5bffd640 1 --2- 172.21.15.89:0/580729307 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f6e4006ed60 0x7f6e40071210 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:17.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:17.380+0000 7f6e5bffd640 1 --2- 172.21.15.89:0/580729307 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e540fcf80 0x7f6e54113750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:17.382 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:17.380+0000 7f6e5bffd640 1 --2- 172.21.15.89:0/580729307 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e540fb810 0x7f6e54113210 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:17.383 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:17.380+0000 7f6e5bffd640 1 -- 172.21.15.89:0/580729307 >> 172.21.15.89:0/580729307 conn(0x7f6e540723b0 msgr2=0x7f6e540fa860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:51:17.383 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:17.380+0000 7f6e5bffd640 1 -- 172.21.15.89:0/580729307 shutdown_connections 2024-09-13T02:51:17.383 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:17.380+0000 7f6e5bffd640 1 -- 172.21.15.89:0/580729307 wait complete. 2024-09-13T02:51:18.132 INFO:teuthology.orchestra.run.smithi089.stdout:{"pg_ready":true,"pg_map":{"version":155,"stamp":"2024-09-13T02:51:16.983721+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":1787920,"kb_used_data":3776,"kb_used_omap":9,"kb_used_meta":1784054,"kb_avail":560682992,"statfs":{"total":575970213888,"available":574139383808,"internally_reserved":0,"allocated":3866624,"data_stored":2557486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":10224,"internal_metadata":1826871312},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001955"},"pg_stats":[{"pgid":"1.0","version":"22'72","reported_seq":129,"reported_epoch":36,"state":"active+clean","last_fresh":"2024-09-13T02:50:21.812448+0000","last_change":"2024-09-13T02:49:58.547155+0000","last_active":"2024-09-13T02:50:21.812448+0000","last_peered":"2024-09-13T02:50:21.812448+0000","last_clean":"2024-09-13T02:50:21.812448+0000","last_became_active":"2024-09-13T02:49:58.546716+0000","last_became_peered":"2024-09-13T02:49:58.546716+0000","last_unstale":"2024-09-13T02:50:21.812448+0000","last_undegraded":"2024-09-13T02:50:21.812448+0000","last_fullsized":"2024-09-13T02:50:21.812448+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-13T02:49:11.600483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-13T02:49:11.600483+0000","last_clean_scrub_stamp":"2024-09-13T02:49:11.600483+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-14T12:34:24.152755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":37,"seq":158913789966,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297696,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447456,"statfs":{"total":95995035648,"available":95690194944,"internally_reserved":0,"allocated":348160,"data_stored":131166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.249}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33300000000000002}]}]},{"osd":4,"up_from":32,"seq":137438953490,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297696,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447456,"statfs":{"total":95995035648,"available":95690194944,"internally_reserved":0,"allocated":348160,"data_stored":131166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 02:51:00 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.38400000000000001}]},{"osd":1,"last update":"Fri Sep 13 02:51:00 2024","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56499999999999995,"15min":0.56499999999999995},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":0.90900000000000003},"last":0.373}]},{"osd":2,"last update":"Fri Sep 13 02:51:00 2024","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"last":0.40100000000000002}]},{"osd":3,"last update":"Fri Sep 13 02:51:00 2024","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"last":0.311},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.504,"5min":0.504,"15min":0.504},"last":0.27700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29199999999999998}]}]},{"osd":3,"up_from":26,"seq":111669149718,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298276,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446876,"statfs":{"total":95995035648,"available":95689601024,"internally_reserved":0,"allocated":942080,"data_stored":721534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 02:50:34 2024","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.499,"15min":0.499},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.497,"5min":0.497,"15min":0.497},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.60699999999999998}]},{"osd":1,"last update":"Fri Sep 13 02:50:34 2024","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.504,"5min":0.504,"15min":0.504},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.58899999999999997}]},{"osd":2,"last update":"Fri Sep 13 02:50:34 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.68200000000000005,"5min":0.68200000000000005,"15min":0.68200000000000005},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.61599999999999999}]},{"osd":4,"last update":"Fri Sep 13 02:51:02 2024","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.375,"15min":0.375},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.63800000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"last":0.40100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]}]},{"osd":2,"up_from":19,"seq":81604378653,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297696,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93447456,"statfs":{"total":95995035648,"available":95690194944,"internally_reserved":0,"allocated":348160,"data_stored":131166,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 02:51:13 2024","interfaces":[{"interface":"back","average":{"1min":0.318,"5min":0.33200000000000002,"15min":0.33400000000000002},"min":{"1min":0.20899999999999999,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":0.44500000000000001,"5min":0.46200000000000002,"15min":0.46200000000000002},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.35899999999999999,"15min":0.36099999999999999},"min":{"1min":0.23300000000000001,"5min":0.219,"15min":0.219},"max":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"last":0.28999999999999998}]},{"osd":1,"last update":"Fri Sep 13 02:51:13 2024","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.35199999999999998,"15min":0.35499999999999998},"min":{"1min":0.23000000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.36399999999999999,"15min":0.36599999999999999},"min":{"1min":0.22500000000000001,"5min":0.214,"15min":0.214},"max":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"last":0.32100000000000001}]},{"osd":3,"last update":"Fri Sep 13 02:50:35 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.42399999999999999,"5min":0.42399999999999999,"15min":0.42399999999999999},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.623},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.68000000000000005,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.63500000000000001}]},{"osd":4,"last update":"Fri Sep 13 02:51:03 2024","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.59899999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52800000000000002}]}]},{"osd":1,"up_from":14,"seq":60129542178,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298280,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446872,"statfs":{"total":95995035648,"available":95689596928,"internally_reserved":0,"allocated":937984,"data_stored":720920,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Sep 13 02:50:44 2024","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.32500000000000001,"15min":0.317},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.37,"5min":0.33100000000000002,"15min":0.32500000000000001},"min":{"1min":0.26300000000000001,"5min":0.222,"15min":0.222},"max":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"last":0.35999999999999999}]},{"osd":2,"last update":"Fri Sep 13 02:50:14 2024","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.46300000000000002,"5min":0.46300000000000002,"15min":0.46300000000000002},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.377}]},{"osd":3,"last update":"Fri Sep 13 02:50:36 2024","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.69299999999999995,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.67900000000000005,"5min":0.67900000000000005,"15min":0.67900000000000005},"last":0.57999999999999996}]},{"osd":4,"last update":"Fri Sep 13 02:51:00 2024","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.59299999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]}]},{"osd":0,"up_from":9,"seq":38654705704,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":298276,"kb_used_data":920,"kb_used_omap":1,"kb_used_meta":297342,"kb_avail":93446876,"statfs":{"total":95995035648,"available":95689601024,"internally_reserved":0,"allocated":942080,"data_stored":721534,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1704,"internal_metadata":304478552},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Sep 13 02:50:44 2024","interfaces":[{"interface":"back","average":{"1min":0.318,"5min":0.312,"15min":0.311},"min":{"1min":0.16500000000000001,"5min":0.16500000000000001,"15min":0.16500000000000001},"max":{"1min":0.498,"5min":0.498,"15min":0.498},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.318,"5min":0.317,"15min":0.317},"min":{"1min":0.23400000000000001,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"last":0.245}]},{"osd":2,"last update":"Fri Sep 13 02:50:14 2024","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"last":0.23300000000000001},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"last":0.27300000000000002}]},{"osd":3,"last update":"Fri Sep 13 02:50:34 2024","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.45900000000000002}]},{"osd":4,"last update":"Fri Sep 13 02:51:01 2024","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.436}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-13T02:51:18.133 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-13T02:51:18.133 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-13T02:51:18.133 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-13T02:51:18.133 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -- ceph health --format=json 2024-09-13T02:51:18.375 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T02:51:18.777 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:18 smithi089 ceph-mon[27639]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:51:18.778 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:18 smithi089 ceph-mon[27639]: from='client.14422 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T02:51:18.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:18 smithi131 ceph-mon[34689]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:51:18.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:18 smithi131 ceph-mon[34689]: from='client.14422 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-13T02:51:19.797 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:19.796+0000 7f0b68b3f640 1 -- 172.21.15.89:0/1642332259 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0b640fb810 msgr2=0x7f0b640fbbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:19.797 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:19.796+0000 7f0b68b3f640 1 --2- 172.21.15.89:0/1642332259 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0b640fb810 0x7f0b640fbbe0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c0048d0 tx=0x7f0b5c009da0 comp rx=0 tx=0).stop 2024-09-13T02:51:19.797 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:19.796+0000 7f0b68b3f640 1 -- 172.21.15.89:0/1642332259 shutdown_connections 2024-09-13T02:51:19.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:19.796+0000 7f0b68b3f640 1 --2- 172.21.15.89:0/1642332259 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0b640fcf80 0x7f0b640fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:19.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:19.796+0000 7f0b68b3f640 1 --2- 172.21.15.89:0/1642332259 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0b640fb810 0x7f0b640fbbe0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:19.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:19.796+0000 7f0b68b3f640 1 -- 172.21.15.89:0/1642332259 >> 172.21.15.89:0/1642332259 conn(0x7f0b640723b0 msgr2=0x7f0b640727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:51:19.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:19.796+0000 7f0b68b3f640 1 -- 172.21.15.89:0/1642332259 shutdown_connections 2024-09-13T02:51:19.798 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:19.796+0000 7f0b68b3f640 1 -- 172.21.15.89:0/1642332259 wait complete. 2024-09-13T02:51:19.800 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:19.796+0000 7f0b68b3f640 1 Processor -- start 2024-09-13T02:51:19.800 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:19.796+0000 7f0b68b3f640 1 -- start start 2024-09-13T02:51:19.800 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:19.797+0000 7f0b68b3f640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0b640fb810 0x7f0b64112100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:19.800 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:19.797+0000 7f0b68b3f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0b640fcf80 0x7f0b64112640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:19.800 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:19.797+0000 7f0b68b3f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b64112cd0 con 0x7f0b640fcf80 2024-09-13T02:51:19.800 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:19.797+0000 7f0b68b3f640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6410c080 con 0x7f0b640fb810 2024-09-13T02:51:19.800 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:19.797+0000 7f0b61d9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0b640fcf80 0x7f0b64112640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:19.800 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:19.797+0000 7f0b61d9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0b640fcf80 0x7f0b64112640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:37480/0 (socket says 172.21.15.89:37480) 2024-09-13T02:51:19.800 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:19.797+0000 7f0b61d9b640 1 -- 172.21.15.89:0/2580805293 learned_addr learned my addr 172.21.15.89:0/2580805293 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:51:19.800 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:19.797+0000 7f0b6259c640 1 --2- 172.21.15.89:0/2580805293 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0b640fb810 0x7f0b64112100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:19.800 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:19.797+0000 7f0b61d9b640 1 -- 172.21.15.89:0/2580805293 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0b640fb810 msgr2=0x7f0b64112100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:19.801 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:19.797+0000 7f0b61d9b640 1 --2- 172.21.15.89:0/2580805293 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0b640fb810 0x7f0b64112100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:19.801 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:19.797+0000 7f0b61d9b640 1 -- 172.21.15.89:0/2580805293 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b5c005040 con 0x7f0b640fcf80 2024-09-13T02:51:19.801 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:19.797+0000 7f0b61d9b640 1 --2- 172.21.15.89:0/2580805293 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0b640fcf80 0x7f0b64112640 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f0b5800bbb0 tx=0x7f0b58009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:51:19.801 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:19.797+0000 7f0b52ffd640 1 -- 172.21.15.89:0/2580805293 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b5800c9c0 con 0x7f0b640fcf80 2024-09-13T02:51:19.801 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:19.797+0000 7f0b52ffd640 1 -- 172.21.15.89:0/2580805293 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0b580092e0 con 0x7f0b640fcf80 2024-09-13T02:51:19.801 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:19.798+0000 7f0b68b3f640 1 -- 172.21.15.89:0/2580805293 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b6410c360 con 0x7f0b640fcf80 2024-09-13T02:51:19.801 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:19.798+0000 7f0b52ffd640 1 -- 172.21.15.89:0/2580805293 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b58007640 con 0x7f0b640fcf80 2024-09-13T02:51:19.801 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:19.798+0000 7f0b68b3f640 1 -- 172.21.15.89:0/2580805293 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b6410c880 con 0x7f0b640fcf80 2024-09-13T02:51:19.801 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:19.799+0000 7f0b68b3f640 1 -- 172.21.15.89:0/2580805293 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b640fcbc0 con 0x7f0b640fcf80 2024-09-13T02:51:19.802 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:19.799+0000 7f0b52ffd640 1 -- 172.21.15.89:0/2580805293 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f0b58012070 con 0x7f0b640fcf80 2024-09-13T02:51:19.802 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:19.799+0000 7f0b52ffd640 1 --2- 172.21.15.89:0/2580805293 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f0b4c06ed60 0x7f0b4c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:19.802 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:19.799+0000 7f0b52ffd640 1 -- 172.21.15.89:0/2580805293 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f0b5808dfe0 con 0x7f0b640fcf80 2024-09-13T02:51:19.802 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:19.799+0000 7f0b6259c640 1 --2- 172.21.15.89:0/2580805293 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f0b4c06ed60 0x7f0b4c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:19.802 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:19.800+0000 7f0b6259c640 1 --2- 172.21.15.89:0/2580805293 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f0b4c06ed60 0x7f0b4c071210 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c009ac0 tx=0x7f0b5c035040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:51:19.804 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:19.803+0000 7f0b52ffd640 1 -- 172.21.15.89:0/2580805293 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f0b5805b440 con 0x7f0b640fcf80 2024-09-13T02:51:19.993 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:19.992+0000 7f0b68b3f640 1 -- 172.21.15.89:0/2580805293 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f0b6410d770 con 0x7f0b640fcf80 2024-09-13T02:51:19.993 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:19.992+0000 7f0b52ffd640 1 -- 172.21.15.89:0/2580805293 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f0b5805ade0 con 0x7f0b640fcf80 2024-09-13T02:51:19.994 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:51:19.994 INFO:teuthology.orchestra.run.smithi089.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-13T02:51:19.995 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:19.994+0000 7f0b68b3f640 1 -- 172.21.15.89:0/2580805293 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f0b4c06ed60 msgr2=0x7f0b4c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:19.995 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:19.994+0000 7f0b68b3f640 1 --2- 172.21.15.89:0/2580805293 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f0b4c06ed60 0x7f0b4c071210 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0b5c009ac0 tx=0x7f0b5c035040 comp rx=0 tx=0).stop 2024-09-13T02:51:19.996 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:19.994+0000 7f0b68b3f640 1 -- 172.21.15.89:0/2580805293 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0b640fcf80 msgr2=0x7f0b64112640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:19.996 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:19.994+0000 7f0b68b3f640 1 --2- 172.21.15.89:0/2580805293 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0b640fcf80 0x7f0b64112640 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f0b5800bbb0 tx=0x7f0b58009840 comp rx=0 tx=0).stop 2024-09-13T02:51:19.996 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:19.994+0000 7f0b68b3f640 1 -- 172.21.15.89:0/2580805293 shutdown_connections 2024-09-13T02:51:19.996 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:19.994+0000 7f0b68b3f640 1 --2- 172.21.15.89:0/2580805293 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0b640fcf80 0x7f0b64112640 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:19.996 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:19.994+0000 7f0b68b3f640 1 --2- 172.21.15.89:0/2580805293 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f0b4c06ed60 0x7f0b4c071210 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:19.996 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:19.994+0000 7f0b68b3f640 1 --2- 172.21.15.89:0/2580805293 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0b640fb810 0x7f0b64112100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:19.996 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:19.994+0000 7f0b68b3f640 1 -- 172.21.15.89:0/2580805293 >> 172.21.15.89:0/2580805293 conn(0x7f0b640723b0 msgr2=0x7f0b640fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:51:19.996 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:19.994+0000 7f0b68b3f640 1 -- 172.21.15.89:0/2580805293 shutdown_connections 2024-09-13T02:51:19.996 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:19.994+0000 7f0b68b3f640 1 -- 172.21.15.89:0/2580805293 wait complete. 2024-09-13T02:51:20.535 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-13T02:51:20.535 INFO:tasks.cephadm:Setup complete, yielding 2024-09-13T02:51:20.535 INFO:teuthology.run_tasks:Running task print... 2024-09-13T02:51:20.544 INFO:teuthology.task.print:**** done end installing quincy cephadm ... 2024-09-13T02:51:20.544 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-13T02:51:20.585 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi089.front.sepia.ceph.com 2024-09-13T02:51:20.586 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest true --force' 2024-09-13T02:51:20.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:20 smithi089 ceph-mon[27639]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:51:20.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:20 smithi089 ceph-mon[27639]: from='client.? 172.21.15.89:0/2580805293' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-13T02:51:20.826 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T02:51:20.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:20 smithi131 ceph-mon[34689]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:51:20.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:20 smithi131 ceph-mon[34689]: from='client.? 172.21.15.89:0/2580805293' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-13T02:51:22.449 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:22.445+0000 7ff303a57640 1 -- 172.21.15.89:0/4153094139 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff2fc0fd3b0 msgr2=0x7ff2fc0fb7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:22.449 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:22.445+0000 7ff303a57640 1 --2- 172.21.15.89:0/4153094139 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff2fc0fd3b0 0x7ff2fc0fb7e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ff2f80048d0 tx=0x7ff2f8009da0 comp rx=0 tx=0).stop 2024-09-13T02:51:22.449 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:22.445+0000 7ff303a57640 1 -- 172.21.15.89:0/4153094139 shutdown_connections 2024-09-13T02:51:22.449 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:22.445+0000 7ff303a57640 1 --2- 172.21.15.89:0/4153094139 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff2fc0fd3b0 0x7ff2fc0fb7e0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:22.450 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:22.445+0000 7ff303a57640 1 --2- 172.21.15.89:0/4153094139 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff2fc0fca60 0x7ff2fc0fce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:22.450 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:22.445+0000 7ff303a57640 1 -- 172.21.15.89:0/4153094139 >> 172.21.15.89:0/4153094139 conn(0x7ff2fc0f63a0 msgr2=0x7ff2fc0f87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:51:22.450 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:22.445+0000 7ff303a57640 1 -- 172.21.15.89:0/4153094139 shutdown_connections 2024-09-13T02:51:22.450 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:22.445+0000 7ff303a57640 1 -- 172.21.15.89:0/4153094139 wait complete. 2024-09-13T02:51:22.450 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:22.445+0000 7ff303a57640 1 Processor -- start 2024-09-13T02:51:22.450 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:22.445+0000 7ff303a57640 1 -- start start 2024-09-13T02:51:22.450 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:22.446+0000 7ff303a57640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff2fc0fca60 0x7ff2fc10fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:22.450 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:22.446+0000 7ff303a57640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff2fc0fd3b0 0x7ff2fc112350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:22.450 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:22.446+0000 7ff303a57640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2fc0fb440 con 0x7ff2fc0fd3b0 2024-09-13T02:51:22.450 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:22.446+0000 7ff303a57640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2fc0fb5b0 con 0x7ff2fc0fca60 2024-09-13T02:51:22.450 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:22.446+0000 7ff300ff2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff2fc0fd3b0 0x7ff2fc112350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:22.451 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:22.446+0000 7ff300ff2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff2fc0fd3b0 0x7ff2fc112350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:56592/0 (socket says 172.21.15.89:56592) 2024-09-13T02:51:22.451 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:22.446+0000 7ff300ff2640 1 -- 172.21.15.89:0/1441647182 learned_addr learned my addr 172.21.15.89:0/1441647182 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:51:22.451 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:22.446+0000 7ff3017f3640 1 --2- 172.21.15.89:0/1441647182 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff2fc0fca60 0x7ff2fc10fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:22.451 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:22.446+0000 7ff300ff2640 1 -- 172.21.15.89:0/1441647182 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff2fc0fca60 msgr2=0x7ff2fc10fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:22.451 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:22.446+0000 7ff300ff2640 1 --2- 172.21.15.89:0/1441647182 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff2fc0fca60 0x7ff2fc10fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:22.451 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:22.446+0000 7ff300ff2640 1 -- 172.21.15.89:0/1441647182 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2f8005040 con 0x7ff2fc0fd3b0 2024-09-13T02:51:22.451 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:22.446+0000 7ff300ff2640 1 --2- 172.21.15.89:0/1441647182 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff2fc0fd3b0 0x7ff2fc112350 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff2f8003080 tx=0x7ff2f8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:51:22.451 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:22.446+0000 7ff2f1ffb640 1 -- 172.21.15.89:0/1441647182 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2f8038070 con 0x7ff2fc0fd3b0 2024-09-13T02:51:22.451 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:22.446+0000 7ff303a57640 1 -- 172.21.15.89:0/1441647182 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2fc112950 con 0x7ff2fc0fd3b0 2024-09-13T02:51:22.451 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:22.446+0000 7ff2f1ffb640 1 -- 172.21.15.89:0/1441647182 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff2f802abd0 con 0x7ff2fc0fd3b0 2024-09-13T02:51:22.451 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:22.446+0000 7ff2f1ffb640 1 -- 172.21.15.89:0/1441647182 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2f803e670 con 0x7ff2fc0fd3b0 2024-09-13T02:51:22.451 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:22.447+0000 7ff303a57640 1 -- 172.21.15.89:0/1441647182 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2fc112e70 con 0x7ff2fc0fd3b0 2024-09-13T02:51:22.452 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:22.447+0000 7ff303a57640 1 -- 172.21.15.89:0/1441647182 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2fc0fa040 con 0x7ff2fc0fd3b0 2024-09-13T02:51:22.452 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:22.448+0000 7ff2f1ffb640 1 -- 172.21.15.89:0/1441647182 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7ff2f8030020 con 0x7ff2fc0fd3b0 2024-09-13T02:51:22.452 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:22.448+0000 7ff2f1ffb640 1 --2- 172.21.15.89:0/1441647182 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7ff2e806ed60 0x7ff2e8071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:22.452 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:22.448+0000 7ff2f1ffb640 1 -- 172.21.15.89:0/1441647182 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7ff2f80ae2b0 con 0x7ff2fc0fd3b0 2024-09-13T02:51:22.452 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:22.449+0000 7ff3017f3640 1 --2- 172.21.15.89:0/1441647182 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7ff2e806ed60 0x7ff2e8071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:22.453 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:22.449+0000 7ff3017f3640 1 --2- 172.21.15.89:0/1441647182 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7ff2e806ed60 0x7ff2e8071210 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec006fd0 tx=0x7ff2ec008040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:51:22.455 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:22.453+0000 7ff2f1ffb640 1 -- 172.21.15.89:0/1441647182 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7ff2f807b6b0 con 0x7ff2fc0fd3b0 2024-09-13T02:51:22.611 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:22.609+0000 7ff303a57640 1 -- 172.21.15.89:0/1441647182 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/use_repo_digest}] v 0) v1 -- 0x7ff2fc113120 con 0x7ff2fc0fd3b0 2024-09-13T02:51:22.616 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:22.613+0000 7ff2f1ffb640 1 -- 172.21.15.89:0/1441647182 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/use_repo_digest}]=0 v20)=0 v20) v1 ==== 143+0+0 (secure 0 0 0) 0x7ff2f807b050 con 0x7ff2fc0fd3b0 2024-09-13T02:51:22.618 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:22.615+0000 7ff303a57640 1 -- 172.21.15.89:0/1441647182 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7ff2e806ed60 msgr2=0x7ff2e8071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:22.618 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:22.615+0000 7ff303a57640 1 --2- 172.21.15.89:0/1441647182 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7ff2e806ed60 0x7ff2e8071210 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7ff2ec006fd0 tx=0x7ff2ec008040 comp rx=0 tx=0).stop 2024-09-13T02:51:22.618 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:22.615+0000 7ff303a57640 1 -- 172.21.15.89:0/1441647182 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff2fc0fd3b0 msgr2=0x7ff2fc112350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:22.618 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:22.615+0000 7ff303a57640 1 --2- 172.21.15.89:0/1441647182 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff2fc0fd3b0 0x7ff2fc112350 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff2f8003080 tx=0x7ff2f8009da0 comp rx=0 tx=0).stop 2024-09-13T02:51:22.618 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:22.615+0000 7ff303a57640 1 -- 172.21.15.89:0/1441647182 shutdown_connections 2024-09-13T02:51:22.618 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:22.615+0000 7ff303a57640 1 --2- 172.21.15.89:0/1441647182 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff2fc0fd3b0 0x7ff2fc112350 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:22.618 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:22.615+0000 7ff303a57640 1 --2- 172.21.15.89:0/1441647182 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7ff2e806ed60 0x7ff2e8071210 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:22.618 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:22.615+0000 7ff303a57640 1 --2- 172.21.15.89:0/1441647182 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff2fc0fca60 0x7ff2fc10fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:22.618 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:22.615+0000 7ff303a57640 1 -- 172.21.15.89:0/1441647182 >> 172.21.15.89:0/1441647182 conn(0x7ff2fc0f63a0 msgr2=0x7ff2fc0f7b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:51:22.618 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:22.615+0000 7ff303a57640 1 -- 172.21.15.89:0/1441647182 shutdown_connections 2024-09-13T02:51:22.618 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:22.615+0000 7ff303a57640 1 -- 172.21.15.89:0/1441647182 wait complete. 2024-09-13T02:51:22.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:22 smithi089 ceph-mon[27639]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:51:22.933 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:22 smithi131 ceph-mon[34689]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:51:23.218 INFO:teuthology.run_tasks:Running task print... 2024-09-13T02:51:23.227 INFO:teuthology.task.print:**** done cephadm.shell ceph config set mgr... 2024-09-13T02:51:23.227 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-13T02:51:23.267 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi089.front.sepia.ceph.com 2024-09-13T02:51:23.268 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -- bash -c 'ceph orch status' 2024-09-13T02:51:23.525 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T02:51:23.772 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:23 smithi089 ceph-mon[27639]: from='client.? 172.21.15.89:0/1441647182' entity='client.admin' 2024-09-13T02:51:23.772 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:23 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:51:23.772 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:23 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:51:23.773 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:23 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:51:23.773 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:23 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:51:23.936 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:23 smithi131 ceph-mon[34689]: from='client.? 172.21.15.89:0/1441647182' entity='client.admin' 2024-09-13T02:51:23.937 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:23 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:51:23.937 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:23 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:51:23.937 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:23 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:51:23.937 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:23 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:51:24.871 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:24 smithi089 ceph-mon[27639]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:51:24.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:24 smithi131 ceph-mon[34689]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:51:25.215 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:25.199+0000 7f5eae05a640 1 -- 172.21.15.89:0/2123772428 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ea80fc520 msgr2=0x7f5ea80fc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:25.215 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:25.199+0000 7f5eae05a640 1 --2- 172.21.15.89:0/2123772428 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ea80fc520 0x7f5ea80fc930 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f5e980048d0 tx=0x7f5e98009da0 comp rx=0 tx=0).stop 2024-09-13T02:51:25.215 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:25.199+0000 7f5eae05a640 1 -- 172.21.15.89:0/2123772428 shutdown_connections 2024-09-13T02:51:25.215 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:25.199+0000 7f5eae05a640 1 --2- 172.21.15.89:0/2123772428 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ea80fd7f0 0x7f5ea80fdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:25.215 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:25.199+0000 7f5eae05a640 1 --2- 172.21.15.89:0/2123772428 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ea80fc520 0x7f5ea80fc930 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:25.215 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:25.199+0000 7f5eae05a640 1 -- 172.21.15.89:0/2123772428 >> 172.21.15.89:0/2123772428 conn(0x7f5ea80f7ce0 msgr2=0x7f5ea80fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:51:25.216 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:25.199+0000 7f5eae05a640 1 -- 172.21.15.89:0/2123772428 shutdown_connections 2024-09-13T02:51:25.216 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:25.199+0000 7f5eae05a640 1 -- 172.21.15.89:0/2123772428 wait complete. 2024-09-13T02:51:25.216 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:25.200+0000 7f5eae05a640 1 Processor -- start 2024-09-13T02:51:25.216 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:25.200+0000 7f5eae05a640 1 -- start start 2024-09-13T02:51:25.216 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:25.200+0000 7f5eae05a640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ea80fc520 0x7f5ea810d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:25.216 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:25.200+0000 7f5eae05a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ea80fd7f0 0x7f5ea810d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:25.216 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:25.200+0000 7f5eae05a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea810dc40 con 0x7f5ea80fd7f0 2024-09-13T02:51:25.216 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:25.200+0000 7f5eae05a640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea810e460 con 0x7f5ea80fc520 2024-09-13T02:51:25.216 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:25.200+0000 7f5e9ffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ea80fd7f0 0x7f5ea810d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:25.216 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:25.200+0000 7f5e9ffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ea80fd7f0 0x7f5ea810d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:56618/0 (socket says 172.21.15.89:56618) 2024-09-13T02:51:25.216 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:25.200+0000 7f5e9ffff640 1 -- 172.21.15.89:0/368969442 learned_addr learned my addr 172.21.15.89:0/368969442 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:51:25.216 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:25.200+0000 7f5ea77fe640 1 --2- 172.21.15.89:0/368969442 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ea80fc520 0x7f5ea810d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:25.216 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:25.200+0000 7f5e9ffff640 1 -- 172.21.15.89:0/368969442 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ea80fc520 msgr2=0x7f5ea810d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:25.217 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:25.200+0000 7f5e9ffff640 1 --2- 172.21.15.89:0/368969442 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ea80fc520 0x7f5ea810d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:25.217 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:25.200+0000 7f5e9ffff640 1 -- 172.21.15.89:0/368969442 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e98005040 con 0x7f5ea80fd7f0 2024-09-13T02:51:25.217 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:25.201+0000 7f5e9ffff640 1 --2- 172.21.15.89:0/368969442 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ea80fd7f0 0x7f5ea810d5f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5e90002a50 tx=0x7f5e90004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:51:25.217 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:25.201+0000 7f5ea4ff9640 1 -- 172.21.15.89:0/368969442 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e90007c30 con 0x7f5ea80fd7f0 2024-09-13T02:51:25.217 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:25.201+0000 7f5ea4ff9640 1 -- 172.21.15.89:0/368969442 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f5e9000f040 con 0x7f5ea80fd7f0 2024-09-13T02:51:25.217 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:25.201+0000 7f5eae05a640 1 -- 172.21.15.89:0/368969442 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ea810e6f0 con 0x7f5ea80fd7f0 2024-09-13T02:51:25.217 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:25.201+0000 7f5ea4ff9640 1 -- 172.21.15.89:0/368969442 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5e9000da10 con 0x7f5ea80fd7f0 2024-09-13T02:51:25.217 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:25.201+0000 7f5eae05a640 1 -- 172.21.15.89:0/368969442 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ea810ec90 con 0x7f5ea80fd7f0 2024-09-13T02:51:25.217 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:25.202+0000 7f5eae05a640 1 -- 172.21.15.89:0/368969442 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ea80fb980 con 0x7f5ea80fd7f0 2024-09-13T02:51:25.217 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:25.202+0000 7f5ea4ff9640 1 -- 172.21.15.89:0/368969442 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f5e9000dc80 con 0x7f5ea80fd7f0 2024-09-13T02:51:25.217 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:25.203+0000 7f5ea4ff9640 1 --2- 172.21.15.89:0/368969442 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f5e9406ed60 0x7f5e94071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:25.217 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:25.203+0000 7f5ea4ff9640 1 -- 172.21.15.89:0/368969442 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f5e9008d600 con 0x7f5ea80fd7f0 2024-09-13T02:51:25.218 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:25.203+0000 7f5ea77fe640 1 --2- 172.21.15.89:0/368969442 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f5e9406ed60 0x7f5e94071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:25.218 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:25.203+0000 7f5ea77fe640 1 --2- 172.21.15.89:0/368969442 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f5e9406ed60 0x7f5e94071210 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5e9800b020 tx=0x7f5e98035040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:51:25.218 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:25.207+0000 7f5ea4ff9640 1 -- 172.21.15.89:0/368969442 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f5e9004d2a0 con 0x7f5ea80fd7f0 2024-09-13T02:51:25.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:25.373+0000 7f5eae05a640 1 -- 172.21.15.89:0/368969442 --> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5ea810efc0 con 0x7f5e9406ed60 2024-09-13T02:51:25.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:25.375+0000 7f5ea4ff9640 1 -- 172.21.15.89:0/368969442 <== mgr.14204 v2:172.21.15.89:6800/1506060926 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f5ea810efc0 con 0x7f5e9406ed60 2024-09-13T02:51:25.377 INFO:teuthology.orchestra.run.smithi089.stdout:Backend: cephadm 2024-09-13T02:51:25.377 INFO:teuthology.orchestra.run.smithi089.stdout:Available: Yes 2024-09-13T02:51:25.377 INFO:teuthology.orchestra.run.smithi089.stdout:Paused: No 2024-09-13T02:51:25.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:25.376+0000 7f5eae05a640 1 -- 172.21.15.89:0/368969442 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f5e9406ed60 msgr2=0x7f5e94071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:25.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:25.376+0000 7f5eae05a640 1 --2- 172.21.15.89:0/368969442 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f5e9406ed60 0x7f5e94071210 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5e9800b020 tx=0x7f5e98035040 comp rx=0 tx=0).stop 2024-09-13T02:51:25.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:25.376+0000 7f5eae05a640 1 -- 172.21.15.89:0/368969442 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ea80fd7f0 msgr2=0x7f5ea810d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:25.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:25.376+0000 7f5eae05a640 1 --2- 172.21.15.89:0/368969442 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ea80fd7f0 0x7f5ea810d5f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f5e90002a50 tx=0x7f5e90004600 comp rx=0 tx=0).stop 2024-09-13T02:51:25.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:25.377+0000 7f5eae05a640 1 -- 172.21.15.89:0/368969442 shutdown_connections 2024-09-13T02:51:25.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:25.377+0000 7f5eae05a640 1 --2- 172.21.15.89:0/368969442 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ea80fd7f0 0x7f5ea810d5f0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:25.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:25.377+0000 7f5eae05a640 1 --2- 172.21.15.89:0/368969442 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f5e9406ed60 0x7f5e94071210 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:25.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:25.377+0000 7f5eae05a640 1 --2- 172.21.15.89:0/368969442 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ea80fc520 0x7f5ea810d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:25.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:25.377+0000 7f5eae05a640 1 -- 172.21.15.89:0/368969442 >> 172.21.15.89:0/368969442 conn(0x7f5ea80f7ce0 msgr2=0x7f5ea80f9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:51:25.380 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:25.377+0000 7f5eae05a640 1 -- 172.21.15.89:0/368969442 shutdown_connections 2024-09-13T02:51:25.380 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:25.377+0000 7f5eae05a640 1 -- 172.21.15.89:0/368969442 wait complete. 2024-09-13T02:51:26.136 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-13T02:51:26.383 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T02:51:26.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:26 smithi089 ceph-mon[27639]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:51:26.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:26 smithi089 ceph-mon[27639]: from='client.14434 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:51:26.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:26 smithi131 ceph-mon[34689]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:51:26.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:26 smithi131 ceph-mon[34689]: from='client.14434 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:51:28.058 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:28.050+0000 7f549540d640 1 -- 172.21.15.89:0/2582144856 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54900fc720 msgr2=0x7f54900fcb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:28.058 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:28.050+0000 7f549540d640 1 --2- 172.21.15.89:0/2582144856 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54900fc720 0x7f54900fcb90 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f54780048d0 tx=0x7f5478009da0 comp rx=0 tx=0).stop 2024-09-13T02:51:28.059 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:28.050+0000 7f549540d640 1 -- 172.21.15.89:0/2582144856 shutdown_connections 2024-09-13T02:51:28.059 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:28.050+0000 7f549540d640 1 --2- 172.21.15.89:0/2582144856 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54900fc720 0x7f54900fcb90 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:28.059 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:28.050+0000 7f549540d640 1 --2- 172.21.15.89:0/2582144856 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f54900fb450 0x7f54900fb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:28.059 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:28.050+0000 7f549540d640 1 -- 172.21.15.89:0/2582144856 >> 172.21.15.89:0/2582144856 conn(0x7f54900f6c10 msgr2=0x7f54900f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:51:28.059 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:28.050+0000 7f549540d640 1 -- 172.21.15.89:0/2582144856 shutdown_connections 2024-09-13T02:51:28.059 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:28.050+0000 7f549540d640 1 -- 172.21.15.89:0/2582144856 wait complete. 2024-09-13T02:51:28.059 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:28.050+0000 7f549540d640 1 Processor -- start 2024-09-13T02:51:28.059 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:28.051+0000 7f549540d640 1 -- start start 2024-09-13T02:51:28.059 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:28.051+0000 7f549540d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f54900fb450 0x7f549010fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:28.059 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:28.051+0000 7f549540d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54900fc720 0x7f5490112410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:28.059 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:28.051+0000 7f549540d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54900667c0 con 0x7f54900fc720 2024-09-13T02:51:28.059 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:28.051+0000 7f549540d640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5490066930 con 0x7f54900fb450 2024-09-13T02:51:28.059 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:28.051+0000 7f54867fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54900fc720 0x7f5490112410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:28.060 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:28.051+0000 7f54867fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54900fc720 0x7f5490112410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:56630/0 (socket says 172.21.15.89:56630) 2024-09-13T02:51:28.060 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:28.051+0000 7f54867fc640 1 -- 172.21.15.89:0/1203598301 learned_addr learned my addr 172.21.15.89:0/1203598301 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:51:28.060 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:28.051+0000 7f548effd640 1 --2- 172.21.15.89:0/1203598301 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f54900fb450 0x7f549010fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:28.060 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:28.051+0000 7f54867fc640 1 -- 172.21.15.89:0/1203598301 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f54900fb450 msgr2=0x7f549010fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:28.060 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:28.051+0000 7f54867fc640 1 --2- 172.21.15.89:0/1203598301 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f54900fb450 0x7f549010fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:28.060 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:28.051+0000 7f54867fc640 1 -- 172.21.15.89:0/1203598301 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5478005040 con 0x7f54900fc720 2024-09-13T02:51:28.060 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:28.051+0000 7f54867fc640 1 --2- 172.21.15.89:0/1203598301 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54900fc720 0x7f5490112410 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f5478000c00 tx=0x7f5478009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:51:28.060 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:28.052+0000 7f5487fff640 1 -- 172.21.15.89:0/1203598301 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5478038070 con 0x7f54900fc720 2024-09-13T02:51:28.060 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:28.052+0000 7f5487fff640 1 -- 172.21.15.89:0/1203598301 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f547802ae90 con 0x7f54900fc720 2024-09-13T02:51:28.060 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:28.052+0000 7f549540d640 1 -- 172.21.15.89:0/1203598301 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54901129b0 con 0x7f54900fc720 2024-09-13T02:51:28.060 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:28.052+0000 7f5487fff640 1 -- 172.21.15.89:0/1203598301 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f547803d420 con 0x7f54900fc720 2024-09-13T02:51:28.060 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:28.052+0000 7f549540d640 1 -- 172.21.15.89:0/1203598301 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5490112ed0 con 0x7f54900fc720 2024-09-13T02:51:28.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:28.053+0000 7f549540d640 1 -- 172.21.15.89:0/1203598301 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54900fa8b0 con 0x7f54900fc720 2024-09-13T02:51:28.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:28.053+0000 7f5487fff640 1 -- 172.21.15.89:0/1203598301 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f5478030020 con 0x7f54900fc720 2024-09-13T02:51:28.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:28.053+0000 7f5487fff640 1 --2- 172.21.15.89:0/1203598301 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f547c06ed60 0x7f547c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:28.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:28.054+0000 7f5487fff640 1 -- 172.21.15.89:0/1203598301 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f54780ae580 con 0x7f54900fc720 2024-09-13T02:51:28.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:28.054+0000 7f548effd640 1 --2- 172.21.15.89:0/1203598301 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f547c06ed60 0x7f547c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:28.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:28.054+0000 7f548effd640 1 --2- 172.21.15.89:0/1203598301 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f547c06ed60 0x7f547c071210 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5490066420 tx=0x7f5480009120 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:51:28.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:28.058+0000 7f5487fff640 1 -- 172.21.15.89:0/1203598301 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f547807b9e0 con 0x7f54900fc720 2024-09-13T02:51:28.220 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:28.219+0000 7f549540d640 1 -- 172.21.15.89:0/1203598301 --> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f5490100bd0 con 0x7f547c06ed60 2024-09-13T02:51:28.228 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:28.227+0000 7f5487fff640 1 -- 172.21.15.89:0/1203598301 <== mgr.14204 v2:172.21.15.89:6800/1506060926 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+2790 (secure 0 0 0) 0x7f5490100bd0 con 0x7f547c06ed60 2024-09-13T02:51:28.228 INFO:teuthology.orchestra.run.smithi089.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T02:51:28.228 INFO:teuthology.orchestra.run.smithi089.stdout:alertmanager.smithi089 smithi089 *:9093,9094 running (3m) 2m ago 4m 25.7M - 0.25.0 c8568f914cd2 e0d15812dfa4 2024-09-13T02:51:28.228 INFO:teuthology.orchestra.run.smithi089.stdout:crash.smithi089 smithi089 running (5m) 2m ago 5m 6895k - 17.2.7-1627-gbbdadfa3 a994b00deb3a e8994cd5600e 2024-09-13T02:51:28.228 INFO:teuthology.orchestra.run.smithi089.stdout:crash.smithi131 smithi131 running (4m) 67s ago 4m 6895k - 17.2.7-1627-gbbdadfa3 a994b00deb3a dcbb0a9d5261 2024-09-13T02:51:28.228 INFO:teuthology.orchestra.run.smithi089.stdout:grafana.smithi089 smithi089 *:3000 running (3m) 2m ago 4m 77.0M - 9.4.7 954c08fa6188 bb04115ceb76 2024-09-13T02:51:28.229 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.smithi089.guohvs smithi089 *:9283,8765,8443 running (6m) 2m ago 6m 440M - 17.2.7-1627-gbbdadfa3 a994b00deb3a 32ceefe7e647 2024-09-13T02:51:28.229 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.smithi131.aunbqd smithi131 *:8443,9283 running (4m) 67s ago 4m 400M - 17.2.7-1627-gbbdadfa3 a994b00deb3a a950da375271 2024-09-13T02:51:28.229 INFO:teuthology.orchestra.run.smithi089.stdout:mon.smithi089 smithi089 running (6m) 2m ago 6m 41.6M 2048M 17.2.7-1627-gbbdadfa3 a994b00deb3a d2f18141b2af 2024-09-13T02:51:28.229 INFO:teuthology.orchestra.run.smithi089.stdout:mon.smithi131 smithi131 running (4m) 67s ago 4m 41.1M 2048M 17.2.7-1627-gbbdadfa3 a994b00deb3a 1191e59dc7a0 2024-09-13T02:51:28.229 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.smithi089 smithi089 *:9100 running (5m) 2m ago 5m 16.3M - 1.5.0 0da6a335fe13 c5dbf820b035 2024-09-13T02:51:28.229 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.smithi131 smithi131 *:9100 running (4m) 67s ago 4m 16.5M - 1.5.0 0da6a335fe13 c3309019f407 2024-09-13T02:51:28.229 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0 smithi089 running (3m) 2m ago 3m 41.1M 4287M 17.2.7-1627-gbbdadfa3 a994b00deb3a b9404e2bc82c 2024-09-13T02:51:28.229 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1 smithi089 running (2m) 2m ago 2m 43.3M 4287M 17.2.7-1627-gbbdadfa3 a994b00deb3a af6538730e42 2024-09-13T02:51:28.229 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2 smithi089 running (2m) 2m ago 2m 39.9M 4287M 17.2.7-1627-gbbdadfa3 a994b00deb3a 447cf103114b 2024-09-13T02:51:28.229 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3 smithi131 running (2m) 67s ago 2m 41.2M 5312M 17.2.7-1627-gbbdadfa3 a994b00deb3a 0b80a4dea862 2024-09-13T02:51:28.229 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4 smithi131 running (96s) 67s ago 96s 37.3M 5312M 17.2.7-1627-gbbdadfa3 a994b00deb3a 06ec44680b00 2024-09-13T02:51:28.229 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5 smithi131 running (72s) 67s ago 72s 13.5M 5312M 17.2.7-1627-gbbdadfa3 a994b00deb3a ace4b45e5873 2024-09-13T02:51:28.229 INFO:teuthology.orchestra.run.smithi089.stdout:prometheus.smithi089 smithi089 *:9095 running (3m) 2m ago 4m 37.5M - 2.43.0 a07b618ecd1d 003f13763491 2024-09-13T02:51:28.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:28.229+0000 7f549540d640 1 -- 172.21.15.89:0/1203598301 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f547c06ed60 msgr2=0x7f547c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:28.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:28.229+0000 7f549540d640 1 --2- 172.21.15.89:0/1203598301 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f547c06ed60 0x7f547c071210 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f5490066420 tx=0x7f5480009120 comp rx=0 tx=0).stop 2024-09-13T02:51:28.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:28.229+0000 7f549540d640 1 -- 172.21.15.89:0/1203598301 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54900fc720 msgr2=0x7f5490112410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:28.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:28.229+0000 7f549540d640 1 --2- 172.21.15.89:0/1203598301 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54900fc720 0x7f5490112410 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f5478000c00 tx=0x7f5478009da0 comp rx=0 tx=0).stop 2024-09-13T02:51:28.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:28.229+0000 7f549540d640 1 -- 172.21.15.89:0/1203598301 shutdown_connections 2024-09-13T02:51:28.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:28.229+0000 7f549540d640 1 --2- 172.21.15.89:0/1203598301 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54900fc720 0x7f5490112410 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:28.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:28.229+0000 7f549540d640 1 --2- 172.21.15.89:0/1203598301 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f547c06ed60 0x7f547c071210 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:28.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:28.229+0000 7f549540d640 1 --2- 172.21.15.89:0/1203598301 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f54900fb450 0x7f549010fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:28.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:28.229+0000 7f549540d640 1 -- 172.21.15.89:0/1203598301 >> 172.21.15.89:0/1203598301 conn(0x7f54900f6c10 msgr2=0x7f54900f8480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:51:28.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:28.229+0000 7f549540d640 1 -- 172.21.15.89:0/1203598301 shutdown_connections 2024-09-13T02:51:28.232 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:28.229+0000 7f549540d640 1 -- 172.21.15.89:0/1203598301 wait complete. 2024-09-13T02:51:28.883 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:28 smithi089 ceph-mon[27639]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:51:28.885 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-13T02:51:28.933 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:28 smithi131 ceph-mon[34689]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:51:29.129 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T02:51:29.868 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:29 smithi089 ceph-mon[27639]: from='client.14438 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:51:29.868 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:29 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:51:29.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:29 smithi131 ceph-mon[34689]: from='client.14438 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:51:29.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:29 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:51:30.613 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:30.588+0000 7f8d28368640 1 -- 172.21.15.89:0/787910171 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d200fd7f0 msgr2=0x7f8d200fdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:30.614 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:30.588+0000 7f8d28368640 1 --2- 172.21.15.89:0/787910171 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d200fd7f0 0x7f8d200fdc60 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c0048d0 tx=0x7f8d1c009da0 comp rx=0 tx=0).stop 2024-09-13T02:51:30.614 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:30.588+0000 7f8d28368640 1 -- 172.21.15.89:0/787910171 shutdown_connections 2024-09-13T02:51:30.614 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:30.588+0000 7f8d28368640 1 --2- 172.21.15.89:0/787910171 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d200fd7f0 0x7f8d200fdc60 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:30.614 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:30.588+0000 7f8d28368640 1 --2- 172.21.15.89:0/787910171 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8d200fc520 0x7f8d200fc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:30.614 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:30.588+0000 7f8d28368640 1 -- 172.21.15.89:0/787910171 >> 172.21.15.89:0/787910171 conn(0x7f8d200f7ce0 msgr2=0x7f8d200fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:51:30.614 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:30.588+0000 7f8d28368640 1 -- 172.21.15.89:0/787910171 shutdown_connections 2024-09-13T02:51:30.614 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:30.588+0000 7f8d28368640 1 -- 172.21.15.89:0/787910171 wait complete. 2024-09-13T02:51:30.615 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:30.588+0000 7f8d28368640 1 Processor -- start 2024-09-13T02:51:30.615 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:30.588+0000 7f8d28368640 1 -- start start 2024-09-13T02:51:30.615 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:30.589+0000 7f8d28368640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8d200fc520 0x7f8d2010d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:30.615 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:30.589+0000 7f8d28368640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d200fd7f0 0x7f8d2010d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:30.615 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:30.589+0000 7f8d28368640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d2010dc10 con 0x7f8d200fd7f0 2024-09-13T02:51:30.615 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:30.589+0000 7f8d28368640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d2010e430 con 0x7f8d200fc520 2024-09-13T02:51:30.615 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:30.589+0000 7f8d25903640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d200fd7f0 0x7f8d2010d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:30.615 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:30.589+0000 7f8d25903640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d200fd7f0 0x7f8d2010d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:56650/0 (socket says 172.21.15.89:56650) 2024-09-13T02:51:30.615 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:30.589+0000 7f8d25903640 1 -- 172.21.15.89:0/2283087597 learned_addr learned my addr 172.21.15.89:0/2283087597 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:51:30.615 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:30.589+0000 7f8d26104640 1 --2- 172.21.15.89:0/2283087597 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8d200fc520 0x7f8d2010d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:30.615 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:30.589+0000 7f8d25903640 1 -- 172.21.15.89:0/2283087597 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8d200fc520 msgr2=0x7f8d2010d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:30.615 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:30.589+0000 7f8d25903640 1 --2- 172.21.15.89:0/2283087597 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8d200fc520 0x7f8d2010d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:30.616 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:30.589+0000 7f8d25903640 1 -- 172.21.15.89:0/2283087597 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d1c005040 con 0x7f8d200fd7f0 2024-09-13T02:51:30.616 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:30.589+0000 7f8d25903640 1 --2- 172.21.15.89:0/2283087597 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d200fd7f0 0x7f8d2010d5c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c003080 tx=0x7f8d1c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:51:30.616 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:30.589+0000 7f8d16ffd640 1 -- 172.21.15.89:0/2283087597 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d1c038070 con 0x7f8d200fd7f0 2024-09-13T02:51:30.616 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:30.589+0000 7f8d16ffd640 1 -- 172.21.15.89:0/2283087597 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f8d1c02abd0 con 0x7f8d200fd7f0 2024-09-13T02:51:30.616 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:30.589+0000 7f8d28368640 1 -- 172.21.15.89:0/2283087597 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d2010e660 con 0x7f8d200fd7f0 2024-09-13T02:51:30.616 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:30.589+0000 7f8d16ffd640 1 -- 172.21.15.89:0/2283087597 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d1c03e670 con 0x7f8d200fd7f0 2024-09-13T02:51:30.616 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:30.589+0000 7f8d28368640 1 -- 172.21.15.89:0/2283087597 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d2010ec00 con 0x7f8d200fd7f0 2024-09-13T02:51:30.616 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:30.590+0000 7f8d28368640 1 -- 172.21.15.89:0/2283087597 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d200fb980 con 0x7f8d200fd7f0 2024-09-13T02:51:30.616 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:30.591+0000 7f8d16ffd640 1 -- 172.21.15.89:0/2283087597 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f8d1c030020 con 0x7f8d200fd7f0 2024-09-13T02:51:30.616 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:30.591+0000 7f8d16ffd640 1 --2- 172.21.15.89:0/2283087597 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f8d0c06ed60 0x7f8d0c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:30.616 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:30.591+0000 7f8d26104640 1 --2- 172.21.15.89:0/2283087597 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f8d0c06ed60 0x7f8d0c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:30.616 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:30.591+0000 7f8d16ffd640 1 -- 172.21.15.89:0/2283087597 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f8d1c0ae190 con 0x7f8d200fd7f0 2024-09-13T02:51:30.616 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:30.592+0000 7f8d26104640 1 --2- 172.21.15.89:0/2283087597 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f8d0c06ed60 0x7f8d0c071210 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8d100041d0 tx=0x7f8d10009040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:51:30.617 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:30.595+0000 7f8d16ffd640 1 -- 172.21.15.89:0/2283087597 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f8d1c07b670 con 0x7f8d200fd7f0 2024-09-13T02:51:30.760 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:30.759+0000 7f8d28368640 1 -- 172.21.15.89:0/2283087597 --> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f8d2010ef10 con 0x7f8d0c06ed60 2024-09-13T02:51:30.761 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:30 smithi089 ceph-mon[27639]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:51:30.764 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:30.763+0000 7f8d16ffd640 1 -- 172.21.15.89:0/2283087597 <== mgr.14204 v2:172.21.15.89:6800/1506060926 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+1170 (secure 0 0 0) 0x7f8d2010ef10 con 0x7f8d0c06ed60 2024-09-13T02:51:30.764 INFO:teuthology.orchestra.run.smithi089.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-13T02:51:30.764 INFO:teuthology.orchestra.run.smithi089.stdout:alertmanager ?:9093,9094 1/1 2m ago 5m count:1 2024-09-13T02:51:30.764 INFO:teuthology.orchestra.run.smithi089.stdout:crash 2/2 2m ago 5m * 2024-09-13T02:51:30.765 INFO:teuthology.orchestra.run.smithi089.stdout:grafana ?:3000 1/1 2m ago 5m count:1 2024-09-13T02:51:30.765 INFO:teuthology.orchestra.run.smithi089.stdout:mgr 2/2 2m ago 5m count:2 2024-09-13T02:51:30.765 INFO:teuthology.orchestra.run.smithi089.stdout:mon 2/2 2m ago 4m smithi089:172.21.15.89=smithi089;smithi131:172.21.15.131=smithi131;count:2 2024-09-13T02:51:30.765 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter ?:9100 2/2 2m ago 5m * 2024-09-13T02:51:30.765 INFO:teuthology.orchestra.run.smithi089.stdout:osd 6 2m ago - 2024-09-13T02:51:30.765 INFO:teuthology.orchestra.run.smithi089.stdout:prometheus ?:9095 1/1 2m ago 5m count:1 2024-09-13T02:51:30.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:30.765+0000 7f8d28368640 1 -- 172.21.15.89:0/2283087597 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f8d0c06ed60 msgr2=0x7f8d0c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:30.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:30.765+0000 7f8d28368640 1 --2- 172.21.15.89:0/2283087597 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f8d0c06ed60 0x7f8d0c071210 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8d100041d0 tx=0x7f8d10009040 comp rx=0 tx=0).stop 2024-09-13T02:51:30.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:30.765+0000 7f8d28368640 1 -- 172.21.15.89:0/2283087597 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d200fd7f0 msgr2=0x7f8d2010d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:30.766 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:30.765+0000 7f8d28368640 1 --2- 172.21.15.89:0/2283087597 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d200fd7f0 0x7f8d2010d5c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c003080 tx=0x7f8d1c009da0 comp rx=0 tx=0).stop 2024-09-13T02:51:30.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:30.765+0000 7f8d28368640 1 -- 172.21.15.89:0/2283087597 shutdown_connections 2024-09-13T02:51:30.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:30.765+0000 7f8d28368640 1 --2- 172.21.15.89:0/2283087597 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8d200fd7f0 0x7f8d2010d5c0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:30.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:30.765+0000 7f8d28368640 1 --2- 172.21.15.89:0/2283087597 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f8d0c06ed60 0x7f8d0c071210 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:30.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:30.765+0000 7f8d28368640 1 --2- 172.21.15.89:0/2283087597 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8d200fc520 0x7f8d2010d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:30.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:30.765+0000 7f8d28368640 1 -- 172.21.15.89:0/2283087597 >> 172.21.15.89:0/2283087597 conn(0x7f8d200f7ce0 msgr2=0x7f8d200f9460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:51:30.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:30.765+0000 7f8d28368640 1 -- 172.21.15.89:0/2283087597 shutdown_connections 2024-09-13T02:51:30.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:30.765+0000 7f8d28368640 1 -- 172.21.15.89:0/2283087597 wait complete. 2024-09-13T02:51:30.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:30 smithi131 ceph-mon[34689]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:51:31.501 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-13T02:51:31.745 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T02:51:32.905 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:32 smithi089 ceph-mon[27639]: from='client.14442 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:51:32.905 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:32 smithi089 ceph-mon[27639]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:51:32.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:32 smithi131 ceph-mon[34689]: from='client.14442 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:51:32.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:32 smithi131 ceph-mon[34689]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:51:33.415 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:33.374+0000 7f82426bc640 1 -- 172.21.15.89:0/4110203340 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f823c0fd840 msgr2=0x7f823c0fdcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:33.415 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:33.374+0000 7f82426bc640 1 --2- 172.21.15.89:0/4110203340 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f823c0fd840 0x7f823c0fdcb0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f82240048d0 tx=0x7f8224009da0 comp rx=0 tx=0).stop 2024-09-13T02:51:33.415 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:33.374+0000 7f82426bc640 1 -- 172.21.15.89:0/4110203340 shutdown_connections 2024-09-13T02:51:33.415 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:33.374+0000 7f82426bc640 1 --2- 172.21.15.89:0/4110203340 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f823c0fd840 0x7f823c0fdcb0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:33.415 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:33.374+0000 7f82426bc640 1 --2- 172.21.15.89:0/4110203340 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f823c0fc570 0x7f823c0fc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:33.415 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:33.374+0000 7f82426bc640 1 -- 172.21.15.89:0/4110203340 >> 172.21.15.89:0/4110203340 conn(0x7f823c0f7d30 msgr2=0x7f823c0fa160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:51:33.416 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:33.374+0000 7f82426bc640 1 -- 172.21.15.89:0/4110203340 shutdown_connections 2024-09-13T02:51:33.416 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:33.374+0000 7f82426bc640 1 -- 172.21.15.89:0/4110203340 wait complete. 2024-09-13T02:51:33.416 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:33.374+0000 7f82426bc640 1 Processor -- start 2024-09-13T02:51:33.416 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:33.374+0000 7f82426bc640 1 -- start start 2024-09-13T02:51:33.416 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:33.375+0000 7f82426bc640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f823c0fc570 0x7f823c10d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:33.416 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:33.375+0000 7f82426bc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f823c0fd840 0x7f823c10d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:33.416 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:33.375+0000 7f82426bc640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f823c10e4a0 con 0x7f823c0fd840 2024-09-13T02:51:33.416 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:33.375+0000 7f82426bc640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f823c10e610 con 0x7f823c0fc570 2024-09-13T02:51:33.416 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:33.375+0000 7f8233fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f823c0fd840 0x7f823c10d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:33.416 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:33.375+0000 7f8233fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f823c0fd840 0x7f823c10d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:59380/0 (socket says 172.21.15.89:59380) 2024-09-13T02:51:33.416 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:33.375+0000 7f8233fff640 1 -- 172.21.15.89:0/1494956053 learned_addr learned my addr 172.21.15.89:0/1494956053 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:51:33.416 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:33.375+0000 7f823bfff640 1 --2- 172.21.15.89:0/1494956053 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f823c0fc570 0x7f823c10d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:33.417 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:33.375+0000 7f8233fff640 1 -- 172.21.15.89:0/1494956053 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f823c0fc570 msgr2=0x7f823c10d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:33.417 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:33.375+0000 7f8233fff640 1 --2- 172.21.15.89:0/1494956053 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f823c0fc570 0x7f823c10d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:33.417 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:33.375+0000 7f8233fff640 1 -- 172.21.15.89:0/1494956053 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8224005040 con 0x7f823c0fd840 2024-09-13T02:51:33.417 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:33.375+0000 7f8233fff640 1 --2- 172.21.15.89:0/1494956053 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f823c0fd840 0x7f823c10d630 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f8224003080 tx=0x7f8224009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:51:33.417 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:33.375+0000 7f82397fa640 1 -- 172.21.15.89:0/1494956053 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8224038070 con 0x7f823c0fd840 2024-09-13T02:51:33.417 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:33.375+0000 7f82397fa640 1 -- 172.21.15.89:0/1494956053 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f822402abd0 con 0x7f823c0fd840 2024-09-13T02:51:33.417 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:33.375+0000 7f82397fa640 1 -- 172.21.15.89:0/1494956053 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f822403e670 con 0x7f823c0fd840 2024-09-13T02:51:33.417 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:33.375+0000 7f82426bc640 1 -- 172.21.15.89:0/1494956053 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f823c10e890 con 0x7f823c0fd840 2024-09-13T02:51:33.417 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:33.375+0000 7f82426bc640 1 -- 172.21.15.89:0/1494956053 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f823c10edb0 con 0x7f823c0fd840 2024-09-13T02:51:33.417 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:33.376+0000 7f82426bc640 1 -- 172.21.15.89:0/1494956053 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f823c0fb9d0 con 0x7f823c0fd840 2024-09-13T02:51:33.417 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:33.377+0000 7f82397fa640 1 -- 172.21.15.89:0/1494956053 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f8224030020 con 0x7f823c0fd840 2024-09-13T02:51:33.417 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:33.377+0000 7f82397fa640 1 --2- 172.21.15.89:0/1494956053 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f822806ed60 0x7f8228071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:33.417 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:33.378+0000 7f82397fa640 1 -- 172.21.15.89:0/1494956053 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f82240ae190 con 0x7f823c0fd840 2024-09-13T02:51:33.418 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:33.378+0000 7f823bfff640 1 --2- 172.21.15.89:0/1494956053 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f822806ed60 0x7f8228071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:33.418 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:33.378+0000 7f823bfff640 1 --2- 172.21.15.89:0/1494956053 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f822806ed60 0x7f8228071210 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f822c00a900 tx=0x7f822c008040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:51:33.418 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:33.381+0000 7f82397fa640 1 -- 172.21.15.89:0/1494956053 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f822407b670 con 0x7f823c0fd840 2024-09-13T02:51:33.546 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:33.545+0000 7f82426bc640 1 -- 172.21.15.89:0/1494956053 --> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f823c10f020 con 0x7f822806ed60 2024-09-13T02:51:33.547 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:33.546+0000 7f82397fa640 1 -- 172.21.15.89:0/1494956053 <== mgr.14204 v2:172.21.15.89:6800/1506060926 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+148 (secure 0 0 0) 0x7f823c10f020 con 0x7f822806ed60 2024-09-13T02:51:33.548 INFO:teuthology.orchestra.run.smithi089.stdout:HOST ADDR LABELS STATUS 2024-09-13T02:51:33.548 INFO:teuthology.orchestra.run.smithi089.stdout:smithi089 172.21.15.89 2024-09-13T02:51:33.548 INFO:teuthology.orchestra.run.smithi089.stdout:smithi131 172.21.15.131 2024-09-13T02:51:33.548 INFO:teuthology.orchestra.run.smithi089.stdout:2 hosts in cluster 2024-09-13T02:51:33.550 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:33.548+0000 7f82426bc640 1 -- 172.21.15.89:0/1494956053 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f822806ed60 msgr2=0x7f8228071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:33.550 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:33.548+0000 7f82426bc640 1 --2- 172.21.15.89:0/1494956053 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f822806ed60 0x7f8228071210 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f822c00a900 tx=0x7f822c008040 comp rx=0 tx=0).stop 2024-09-13T02:51:33.550 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:33.548+0000 7f82426bc640 1 -- 172.21.15.89:0/1494956053 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f823c0fd840 msgr2=0x7f823c10d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:33.550 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:33.548+0000 7f82426bc640 1 --2- 172.21.15.89:0/1494956053 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f823c0fd840 0x7f823c10d630 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f8224003080 tx=0x7f8224009da0 comp rx=0 tx=0).stop 2024-09-13T02:51:33.550 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:33.548+0000 7f82426bc640 1 -- 172.21.15.89:0/1494956053 shutdown_connections 2024-09-13T02:51:33.550 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:33.548+0000 7f82426bc640 1 --2- 172.21.15.89:0/1494956053 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f823c0fd840 0x7f823c10d630 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:33.550 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:33.548+0000 7f82426bc640 1 --2- 172.21.15.89:0/1494956053 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f822806ed60 0x7f8228071210 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:33.550 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:33.548+0000 7f82426bc640 1 --2- 172.21.15.89:0/1494956053 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f823c0fc570 0x7f823c10d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:33.550 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:33.548+0000 7f82426bc640 1 -- 172.21.15.89:0/1494956053 >> 172.21.15.89:0/1494956053 conn(0x7f823c0f7d30 msgr2=0x7f823c0f94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:51:33.550 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:33.548+0000 7f82426bc640 1 -- 172.21.15.89:0/1494956053 shutdown_connections 2024-09-13T02:51:33.551 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:33.548+0000 7f82426bc640 1 -- 172.21.15.89:0/1494956053 wait complete. 2024-09-13T02:51:34.242 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-13T02:51:34.494 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T02:51:34.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:34 smithi089 ceph-mon[27639]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:51:34.888 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:34 smithi089 ceph-mon[27639]: from='client.14446 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:51:34.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:34 smithi131 ceph-mon[34689]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:51:34.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:34 smithi131 ceph-mon[34689]: from='client.14446 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:51:36.116 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:36.113+0000 7fe4e96c5640 1 -- 172.21.15.89:0/3310326234 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe4e4065c40 msgr2=0x7fe4e40ff140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:36.116 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:36.113+0000 7fe4e96c5640 1 --2- 172.21.15.89:0/3310326234 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe4e4065c40 0x7fe4e40ff140 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe4d4009c50 tx=0x7fe4d4004d10 comp rx=0 tx=0).stop 2024-09-13T02:51:36.116 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:36.113+0000 7fe4e96c5640 1 -- 172.21.15.89:0/3310326234 shutdown_connections 2024-09-13T02:51:36.116 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:36.113+0000 7fe4e96c5640 1 --2- 172.21.15.89:0/3310326234 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe4e40ff680 0x7fe4e4101a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:36.116 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:36.113+0000 7fe4e96c5640 1 --2- 172.21.15.89:0/3310326234 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe4e4065c40 0x7fe4e40ff140 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:36.116 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:36.113+0000 7fe4e96c5640 1 -- 172.21.15.89:0/3310326234 >> 172.21.15.89:0/3310326234 conn(0x7fe4e40f6c10 msgr2=0x7fe4e40f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:51:36.116 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:36.114+0000 7fe4e96c5640 1 -- 172.21.15.89:0/3310326234 shutdown_connections 2024-09-13T02:51:36.117 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:36.114+0000 7fe4e96c5640 1 -- 172.21.15.89:0/3310326234 wait complete. 2024-09-13T02:51:36.117 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:36.114+0000 7fe4e96c5640 1 Processor -- start 2024-09-13T02:51:36.117 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:36.114+0000 7fe4e96c5640 1 -- start start 2024-09-13T02:51:36.117 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:36.114+0000 7fe4e96c5640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe4e4065c40 0x7fe4e410d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:36.117 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:36.114+0000 7fe4e96c5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe4e40ff680 0x7fe4e410d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:36.117 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:36.114+0000 7fe4e96c5640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e410dc80 con 0x7fe4e40ff680 2024-09-13T02:51:36.117 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:36.114+0000 7fe4e96c5640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4e410e450 con 0x7fe4e4065c40 2024-09-13T02:51:36.117 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:36.115+0000 7fe4e27fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe4e40ff680 0x7fe4e410d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:36.117 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:36.115+0000 7fe4e27fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe4e40ff680 0x7fe4e410d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:59392/0 (socket says 172.21.15.89:59392) 2024-09-13T02:51:36.117 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:36.115+0000 7fe4e27fc640 1 -- 172.21.15.89:0/2792979473 learned_addr learned my addr 172.21.15.89:0/2792979473 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:51:36.117 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:36.115+0000 7fe4e2ffd640 1 --2- 172.21.15.89:0/2792979473 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe4e4065c40 0x7fe4e410d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:36.117 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:36.115+0000 7fe4e27fc640 1 -- 172.21.15.89:0/2792979473 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe4e4065c40 msgr2=0x7fe4e410d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:36.117 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:36.115+0000 7fe4e27fc640 1 --2- 172.21.15.89:0/2792979473 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe4e4065c40 0x7fe4e410d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:36.118 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:36.115+0000 7fe4e27fc640 1 -- 172.21.15.89:0/2792979473 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4d40098b0 con 0x7fe4e40ff680 2024-09-13T02:51:36.119 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:36.115+0000 7fe4e27fc640 1 --2- 172.21.15.89:0/2792979473 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe4e40ff680 0x7fe4e410d630 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc00c810 tx=0x7fe4cc0043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:51:36.119 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:36.115+0000 7fe4db7fe640 1 -- 172.21.15.89:0/2792979473 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe4cc00a820 con 0x7fe4e40ff680 2024-09-13T02:51:36.119 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:36.115+0000 7fe4db7fe640 1 -- 172.21.15.89:0/2792979473 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe4cc00ae20 con 0x7fe4e40ff680 2024-09-13T02:51:36.119 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:36.115+0000 7fe4e96c5640 1 -- 172.21.15.89:0/2792979473 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4e410e6e0 con 0x7fe4e40ff680 2024-09-13T02:51:36.119 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:36.115+0000 7fe4db7fe640 1 -- 172.21.15.89:0/2792979473 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe4cc0115c0 con 0x7fe4e40ff680 2024-09-13T02:51:36.119 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:36.115+0000 7fe4e96c5640 1 -- 172.21.15.89:0/2792979473 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4e410ec80 con 0x7fe4e40ff680 2024-09-13T02:51:36.119 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:36.116+0000 7fe4e96c5640 1 -- 172.21.15.89:0/2792979473 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4e40fa890 con 0x7fe4e40ff680 2024-09-13T02:51:36.119 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:36.117+0000 7fe4db7fe640 1 -- 172.21.15.89:0/2792979473 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fe4cc012840 con 0x7fe4e40ff680 2024-09-13T02:51:36.119 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:36.117+0000 7fe4db7fe640 1 --2- 172.21.15.89:0/2792979473 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fe4d006ed60 0x7fe4d0071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:36.119 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:36.117+0000 7fe4e2ffd640 1 --2- 172.21.15.89:0/2792979473 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fe4d006ed60 0x7fe4d0071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:36.119 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:36.117+0000 7fe4db7fe640 1 -- 172.21.15.89:0/2792979473 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7fe4cc08e280 con 0x7fe4e40ff680 2024-09-13T02:51:36.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:36.118+0000 7fe4e2ffd640 1 --2- 172.21.15.89:0/2792979473 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fe4d006ed60 0x7fe4d0071210 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe4d4003400 tx=0x7fe4d4004d10 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:51:36.122 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:36.121+0000 7fe4db7fe640 1 -- 172.21.15.89:0/2792979473 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fe4cc05b2e0 con 0x7fe4e40ff680 2024-09-13T02:51:36.286 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:36.285+0000 7fe4e96c5640 1 -- 172.21.15.89:0/2792979473 --> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fe4e410f060 con 0x7fe4d006ed60 2024-09-13T02:51:36.288 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:36.286+0000 7fe4db7fe640 1 -- 172.21.15.89:0/2792979473 <== mgr.14204 v2:172.21.15.89:6800/1506060926 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+399 (secure 0 0 0) 0x7fe4e410f060 con 0x7fe4d006ed60 2024-09-13T02:51:36.288 INFO:teuthology.orchestra.run.smithi089.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-13T02:51:36.288 INFO:teuthology.orchestra.run.smithi089.stdout:smithi089 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT62040126400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-13T02:51:36.288 INFO:teuthology.orchestra.run.smithi089.stdout:smithi131 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300N4400BGN 372G No 72s ago Has a FileSystem, LVM detected 2024-09-13T02:51:36.290 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:36.289+0000 7fe4e96c5640 1 -- 172.21.15.89:0/2792979473 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fe4d006ed60 msgr2=0x7fe4d0071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:36.290 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:36.289+0000 7fe4e96c5640 1 --2- 172.21.15.89:0/2792979473 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fe4d006ed60 0x7fe4d0071210 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe4d4003400 tx=0x7fe4d4004d10 comp rx=0 tx=0).stop 2024-09-13T02:51:36.290 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:36.289+0000 7fe4e96c5640 1 -- 172.21.15.89:0/2792979473 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe4e40ff680 msgr2=0x7fe4e410d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:36.290 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:36.289+0000 7fe4e96c5640 1 --2- 172.21.15.89:0/2792979473 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe4e40ff680 0x7fe4e410d630 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fe4cc00c810 tx=0x7fe4cc0043c0 comp rx=0 tx=0).stop 2024-09-13T02:51:36.290 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:36.289+0000 7fe4e96c5640 1 -- 172.21.15.89:0/2792979473 shutdown_connections 2024-09-13T02:51:36.290 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:36.289+0000 7fe4e96c5640 1 --2- 172.21.15.89:0/2792979473 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe4e40ff680 0x7fe4e410d630 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:36.290 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:36.289+0000 7fe4e96c5640 1 --2- 172.21.15.89:0/2792979473 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fe4d006ed60 0x7fe4d0071210 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:36.291 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:36.289+0000 7fe4e96c5640 1 --2- 172.21.15.89:0/2792979473 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe4e4065c40 0x7fe4e410d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:36.291 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:36.289+0000 7fe4e96c5640 1 -- 172.21.15.89:0/2792979473 >> 172.21.15.89:0/2792979473 conn(0x7fe4e40f6c10 msgr2=0x7fe4e40f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:51:36.291 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:36.289+0000 7fe4e96c5640 1 -- 172.21.15.89:0/2792979473 shutdown_connections 2024-09-13T02:51:36.291 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:36.289+0000 7fe4e96c5640 1 -- 172.21.15.89:0/2792979473 wait complete. 2024-09-13T02:51:36.891 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:36 smithi089 ceph-mon[27639]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:51:36.916 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-13T02:51:36.926 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi089.front.sepia.ceph.com 2024-09-13T02:51:36.927 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -- bash -c 'ceph fs volume create cephfs --placement=4' 2024-09-13T02:51:36.933 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:36 smithi131 ceph-mon[34689]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:51:37.172 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T02:51:37.889 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:37 smithi089 ceph-mon[27639]: from='client.14450 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:51:37.933 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:37 smithi131 ceph-mon[34689]: from='client.14450 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:51:38.659 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:38.629+0000 7f390c448640 1 -- 172.21.15.89:0/2195745909 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39040fc700 msgr2=0x7f39040fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:38.659 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:38.629+0000 7f390c448640 1 --2- 172.21.15.89:0/2195745909 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39040fc700 0x7f39040fcb70 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f38f40048d0 tx=0x7f38f4009da0 comp rx=0 tx=0).stop 2024-09-13T02:51:38.659 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:38.629+0000 7f390c448640 1 -- 172.21.15.89:0/2195745909 shutdown_connections 2024-09-13T02:51:38.659 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:38.629+0000 7f390c448640 1 --2- 172.21.15.89:0/2195745909 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39040fc700 0x7f39040fcb70 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:38.659 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:38.629+0000 7f390c448640 1 --2- 172.21.15.89:0/2195745909 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f39040fb430 0x7f39040fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:38.659 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:38.629+0000 7f390c448640 1 -- 172.21.15.89:0/2195745909 >> 172.21.15.89:0/2195745909 conn(0x7f39040f6c10 msgr2=0x7f39040f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:51:38.659 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:38.629+0000 7f390c448640 1 -- 172.21.15.89:0/2195745909 shutdown_connections 2024-09-13T02:51:38.660 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:38.629+0000 7f390c448640 1 -- 172.21.15.89:0/2195745909 wait complete. 2024-09-13T02:51:38.660 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:38.629+0000 7f390c448640 1 Processor -- start 2024-09-13T02:51:38.660 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:38.630+0000 7f390c448640 1 -- start start 2024-09-13T02:51:38.660 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:38.630+0000 7f390c448640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f39040fb430 0x7f390410fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:38.660 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:38.630+0000 7f390c448640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39040fc700 0x7f39041122d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:38.660 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:38.630+0000 7f390c448640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3904065c60 con 0x7f39040fc700 2024-09-13T02:51:38.660 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:38.630+0000 7f390c448640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3904065dd0 con 0x7f39040fb430 2024-09-13T02:51:38.660 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:38.630+0000 7f39099e3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39040fc700 0x7f39041122d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:38.660 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:38.630+0000 7f39099e3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39040fc700 0x7f39041122d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:59404/0 (socket says 172.21.15.89:59404) 2024-09-13T02:51:38.660 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:38.630+0000 7f39099e3640 1 -- 172.21.15.89:0/2112111452 learned_addr learned my addr 172.21.15.89:0/2112111452 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:51:38.660 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:38.630+0000 7f390a1e4640 1 --2- 172.21.15.89:0/2112111452 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f39040fb430 0x7f390410fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:38.660 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:38.630+0000 7f39099e3640 1 -- 172.21.15.89:0/2112111452 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f39040fb430 msgr2=0x7f390410fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:38.660 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:38.630+0000 7f39099e3640 1 --2- 172.21.15.89:0/2112111452 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f39040fb430 0x7f390410fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:38.660 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:38.630+0000 7f39099e3640 1 -- 172.21.15.89:0/2112111452 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38f4005040 con 0x7f39040fc700 2024-09-13T02:51:38.661 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:38.630+0000 7f39099e3640 1 --2- 172.21.15.89:0/2112111452 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39040fc700 0x7f39041122d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f38f4003080 tx=0x7f38f4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:51:38.661 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:38.630+0000 7f38faffd640 1 -- 172.21.15.89:0/2112111452 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f38f4038070 con 0x7f39040fc700 2024-09-13T02:51:38.661 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:38.630+0000 7f390c448640 1 -- 172.21.15.89:0/2112111452 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3904112810 con 0x7f39040fc700 2024-09-13T02:51:38.661 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:38.630+0000 7f38faffd640 1 -- 172.21.15.89:0/2112111452 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f38f402abd0 con 0x7f39040fc700 2024-09-13T02:51:38.661 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:38.630+0000 7f38faffd640 1 -- 172.21.15.89:0/2112111452 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f38f403e670 con 0x7f39040fc700 2024-09-13T02:51:38.661 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:38.631+0000 7f390c448640 1 -- 172.21.15.89:0/2112111452 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3904112d80 con 0x7f39040fc700 2024-09-13T02:51:38.661 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:38.631+0000 7f390c448640 1 -- 172.21.15.89:0/2112111452 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39040fa890 con 0x7f39040fc700 2024-09-13T02:51:38.661 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:38.632+0000 7f38faffd640 1 -- 172.21.15.89:0/2112111452 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f38f4030020 con 0x7f39040fc700 2024-09-13T02:51:38.661 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:38.632+0000 7f38faffd640 1 --2- 172.21.15.89:0/2112111452 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f38f006ed60 0x7f38f0071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:38.661 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:38.632+0000 7f38faffd640 1 -- 172.21.15.89:0/2112111452 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4634+0+0 (secure 0 0 0) 0x7f38f40ae250 con 0x7f39040fc700 2024-09-13T02:51:38.661 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:38.632+0000 7f390a1e4640 1 --2- 172.21.15.89:0/2112111452 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f38f006ed60 0x7f38f0071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:38.661 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:38.633+0000 7f390a1e4640 1 --2- 172.21.15.89:0/2112111452 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f38f006ed60 0x7f38f0071210 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f39000041d0 tx=0x7f3900009040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:51:38.661 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:38.636+0000 7f38faffd640 1 -- 172.21.15.89:0/2112111452 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f38f407b6b0 con 0x7f39040fc700 2024-09-13T02:51:38.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:38 smithi089 ceph-mon[27639]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:51:38.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:38.815+0000 7f390c448640 1 -- 172.21.15.89:0/2112111452 --> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f3904100bb0 con 0x7f38f006ed60 2024-09-13T02:51:38.933 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:38 smithi131 ceph-mon[34689]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:51:39.933 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:39 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-09-13T02:51:40.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:39 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-09-13T02:51:40.682 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:40.681+0000 7f38faffd640 1 -- 172.21.15.89:0/2112111452 <== mgr.14204 v2:172.21.15.89:6800/1506060926 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f3904100bb0 con 0x7f38f006ed60 2024-09-13T02:51:40.685 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:40.683+0000 7f390c448640 1 -- 172.21.15.89:0/2112111452 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f38f006ed60 msgr2=0x7f38f0071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:40.685 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:40.683+0000 7f390c448640 1 --2- 172.21.15.89:0/2112111452 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f38f006ed60 0x7f38f0071210 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f39000041d0 tx=0x7f3900009040 comp rx=0 tx=0).stop 2024-09-13T02:51:40.685 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:40.683+0000 7f390c448640 1 -- 172.21.15.89:0/2112111452 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39040fc700 msgr2=0x7f39041122d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:40.685 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:40.683+0000 7f390c448640 1 --2- 172.21.15.89:0/2112111452 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39040fc700 0x7f39041122d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f38f4003080 tx=0x7f38f4009da0 comp rx=0 tx=0).stop 2024-09-13T02:51:40.685 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:40.683+0000 7f390c448640 1 -- 172.21.15.89:0/2112111452 shutdown_connections 2024-09-13T02:51:40.685 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:40.683+0000 7f390c448640 1 --2- 172.21.15.89:0/2112111452 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39040fc700 0x7f39041122d0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:40.685 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:40.683+0000 7f390c448640 1 --2- 172.21.15.89:0/2112111452 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f38f006ed60 0x7f38f0071210 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:40.685 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:40.683+0000 7f390c448640 1 --2- 172.21.15.89:0/2112111452 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f39040fb430 0x7f390410fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:40.685 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:40.683+0000 7f390c448640 1 -- 172.21.15.89:0/2112111452 >> 172.21.15.89:0/2112111452 conn(0x7f39040f6c10 msgr2=0x7f39040f83b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:51:40.686 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:40.683+0000 7f390c448640 1 -- 172.21.15.89:0/2112111452 shutdown_connections 2024-09-13T02:51:40.686 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:40.683+0000 7f390c448640 1 -- 172.21.15.89:0/2112111452 wait complete. 2024-09-13T02:51:40.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:40 smithi131 ceph-mon[34689]: from='client.14454 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:51:40.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:40 smithi131 ceph-mon[34689]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:51:40.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:40 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-09-13T02:51:40.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:40 smithi131 ceph-mon[34689]: osdmap e39: 6 total, 6 up, 6 in 2024-09-13T02:51:40.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:40 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-09-13T02:51:40.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:40 smithi089 ceph-mon[27639]: from='client.14454 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:51:40.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:40 smithi089 ceph-mon[27639]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:51:40.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:40 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-09-13T02:51:40.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:40 smithi089 ceph-mon[27639]: osdmap e39: 6 total, 6 up, 6 in 2024-09-13T02:51:40.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:40 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-09-13T02:51:40.996 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:40 smithi089 ceph-12cdb164-717a-11ef-bceb-c7b262605968-mon-smithi089[27635]: 2024-09-13T02:51:40.657+0000 7ff2c6a8e640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T02:51:41.387 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-13T02:51:41.644 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T02:51:41.919 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:41 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-09-13T02:51:41.920 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:41 smithi089 ceph-mon[27639]: osdmap e40: 6 total, 6 up, 6 in 2024-09-13T02:51:41.920 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:41 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-09-13T02:51:41.920 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:41 smithi089 ceph-mon[27639]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T02:51:41.920 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:41 smithi089 ceph-mon[27639]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-13T02:51:41.920 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:41 smithi089 ceph-mon[27639]: osdmap e41: 6 total, 6 up, 6 in 2024-09-13T02:51:41.920 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:41 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-09-13T02:51:41.920 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:41 smithi089 ceph-mon[27639]: fsmap cephfs:0 2024-09-13T02:51:41.920 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:41 smithi089 ceph-mon[27639]: Saving service mds.cephfs spec with placement count:4 2024-09-13T02:51:41.920 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:41 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:51:41.920 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:41 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:51:41.920 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:41 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:51:41.921 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:41 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:51:41.921 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:41 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:51:41.921 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:41 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi089.qjoitb", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T02:51:41.921 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:41 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi089.qjoitb", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T02:51:41.921 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:41 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:51:41.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:41 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-09-13T02:51:41.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:41 smithi131 ceph-mon[34689]: osdmap e40: 6 total, 6 up, 6 in 2024-09-13T02:51:41.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:41 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-09-13T02:51:41.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:41 smithi131 ceph-mon[34689]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T02:51:41.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:41 smithi131 ceph-mon[34689]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-13T02:51:41.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:41 smithi131 ceph-mon[34689]: osdmap e41: 6 total, 6 up, 6 in 2024-09-13T02:51:41.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:41 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-09-13T02:51:41.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:41 smithi131 ceph-mon[34689]: fsmap cephfs:0 2024-09-13T02:51:41.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:41 smithi131 ceph-mon[34689]: Saving service mds.cephfs spec with placement count:4 2024-09-13T02:51:41.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:41 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:51:41.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:41 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:51:41.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:41 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:51:41.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:41 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:51:41.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:41 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:51:41.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:41 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi089.qjoitb", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T02:51:41.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:41 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi089.qjoitb", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T02:51:41.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:41 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:51:42.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:42 smithi131 ceph-mon[34689]: pgmap v170: 65 pgs: 3 creating+peering, 61 unknown, 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:51:42.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:42 smithi131 ceph-mon[34689]: Deploying daemon mds.cephfs.smithi089.qjoitb on smithi089 2024-09-13T02:51:42.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:42 smithi131 ceph-mon[34689]: osdmap e42: 6 total, 6 up, 6 in 2024-09-13T02:51:42.948 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:42 smithi089 ceph-mon[27639]: pgmap v170: 65 pgs: 3 creating+peering, 61 unknown, 1 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:51:42.949 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:42 smithi089 ceph-mon[27639]: Deploying daemon mds.cephfs.smithi089.qjoitb on smithi089 2024-09-13T02:51:42.949 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:42 smithi089 ceph-mon[27639]: osdmap e42: 6 total, 6 up, 6 in 2024-09-13T02:51:43.316 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:43.307+0000 7f16506b2640 1 -- 172.21.15.89:0/853821831 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16480ff720 msgr2=0x7f1648101b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:43.316 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:43.307+0000 7f16506b2640 1 --2- 172.21.15.89:0/853821831 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16480ff720 0x7f1648101b00 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f16380048d0 tx=0x7f1638009da0 comp rx=0 tx=0).stop 2024-09-13T02:51:43.316 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:43.307+0000 7f16506b2640 1 -- 172.21.15.89:0/853821831 shutdown_connections 2024-09-13T02:51:43.316 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:43.307+0000 7f16506b2640 1 --2- 172.21.15.89:0/853821831 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16480ff720 0x7f1648101b00 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:43.316 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:43.307+0000 7f16506b2640 1 --2- 172.21.15.89:0/853821831 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f16480666b0 0x7f16480ff1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:43.317 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:43.307+0000 7f16506b2640 1 -- 172.21.15.89:0/853821831 >> 172.21.15.89:0/853821831 conn(0x7f16480f6c10 msgr2=0x7f16480f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:51:43.317 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:43.307+0000 7f16506b2640 1 -- 172.21.15.89:0/853821831 shutdown_connections 2024-09-13T02:51:43.317 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:43.307+0000 7f16506b2640 1 -- 172.21.15.89:0/853821831 wait complete. 2024-09-13T02:51:43.317 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:43.307+0000 7f16506b2640 1 Processor -- start 2024-09-13T02:51:43.317 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:43.308+0000 7f16506b2640 1 -- start start 2024-09-13T02:51:43.317 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:43.308+0000 7f16506b2640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f16480666b0 0x7f164810d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:43.317 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:43.308+0000 7f16506b2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16480ff720 0x7f164810d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:43.317 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:43.308+0000 7f16506b2640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f164810dc40 con 0x7f16480ff720 2024-09-13T02:51:43.317 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:43.308+0000 7f16506b2640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f164810e460 con 0x7f16480666b0 2024-09-13T02:51:43.317 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:43.308+0000 7f164dc4d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16480ff720 0x7f164810d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:43.317 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:43.308+0000 7f164dc4d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16480ff720 0x7f164810d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:50616/0 (socket says 172.21.15.89:50616) 2024-09-13T02:51:43.317 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:43.308+0000 7f164dc4d640 1 -- 172.21.15.89:0/4052385444 learned_addr learned my addr 172.21.15.89:0/4052385444 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:51:43.317 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:43.308+0000 7f164dc4d640 1 -- 172.21.15.89:0/4052385444 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f16480666b0 msgr2=0x7f164810d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:43.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:43.308+0000 7f164e44e640 1 --2- 172.21.15.89:0/4052385444 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f16480666b0 0x7f164810d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:43.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:43.308+0000 7f164dc4d640 1 --2- 172.21.15.89:0/4052385444 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f16480666b0 0x7f164810d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:43.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:43.308+0000 7f164dc4d640 1 -- 172.21.15.89:0/4052385444 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1638005040 con 0x7f16480ff720 2024-09-13T02:51:43.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:43.308+0000 7f164e44e640 1 --2- 172.21.15.89:0/4052385444 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f16480666b0 0x7f164810d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T02:51:43.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:43.308+0000 7f164dc4d640 1 --2- 172.21.15.89:0/4052385444 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16480ff720 0x7f164810d5f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f16380048a0 tx=0x7f1638009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:51:43.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:43.308+0000 7f163effd640 1 -- 172.21.15.89:0/4052385444 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1638038070 con 0x7f16480ff720 2024-09-13T02:51:43.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:43.308+0000 7f163effd640 1 -- 172.21.15.89:0/4052385444 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f163802abd0 con 0x7f16480ff720 2024-09-13T02:51:43.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:43.308+0000 7f16506b2640 1 -- 172.21.15.89:0/4052385444 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f164810e690 con 0x7f16480ff720 2024-09-13T02:51:43.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:43.308+0000 7f163effd640 1 -- 172.21.15.89:0/4052385444 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1638033640 con 0x7f16480ff720 2024-09-13T02:51:43.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:43.309+0000 7f16506b2640 1 -- 172.21.15.89:0/4052385444 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f164810ec30 con 0x7f16480ff720 2024-09-13T02:51:43.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:43.310+0000 7f16506b2640 1 -- 172.21.15.89:0/4052385444 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16480fa8b0 con 0x7f16480ff720 2024-09-13T02:51:43.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:43.310+0000 7f163effd640 1 -- 172.21.15.89:0/4052385444 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f1638030020 con 0x7f16480ff720 2024-09-13T02:51:43.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:43.310+0000 7f163effd640 1 --2- 172.21.15.89:0/4052385444 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f163406ed60 0x7f1634071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:43.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:43.311+0000 7f163effd640 1 -- 172.21.15.89:0/4052385444 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f16380ae4f0 con 0x7f16480ff720 2024-09-13T02:51:43.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:43.311+0000 7f164e44e640 1 --2- 172.21.15.89:0/4052385444 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f163406ed60 0x7f1634071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:43.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:43.311+0000 7f164e44e640 1 --2- 172.21.15.89:0/4052385444 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f163406ed60 0x7f1634071210 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f16440041d0 tx=0x7f1644009040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:51:43.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:43.315+0000 7f163effd640 1 -- 172.21.15.89:0/4052385444 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f163807b610 con 0x7f16480ff720 2024-09-13T02:51:43.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:43.506+0000 7f16506b2640 1 -- 172.21.15.89:0/4052385444 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f164804b720 con 0x7f16480ff720 2024-09-13T02:51:43.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:43.506+0000 7f163effd640 1 -- 172.21.15.89:0/4052385444 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 2 v2) v1 ==== 75+0+1076 (secure 0 0 0) 0x7f163807afb0 con 0x7f16480ff720 2024-09-13T02:51:43.508 INFO:teuthology.orchestra.run.smithi089.stdout:e2 2024-09-13T02:51:43.508 INFO:teuthology.orchestra.run.smithi089.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T02:51:43.508 INFO:teuthology.orchestra.run.smithi089.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:51:43.508 INFO:teuthology.orchestra.run.smithi089.stdout:legacy client fscid: 1 2024-09-13T02:51:43.508 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:51:43.508 INFO:teuthology.orchestra.run.smithi089.stdout:Filesystem 'cephfs' (1) 2024-09-13T02:51:43.509 INFO:teuthology.orchestra.run.smithi089.stdout:fs_name cephfs 2024-09-13T02:51:43.509 INFO:teuthology.orchestra.run.smithi089.stdout:epoch 2 2024-09-13T02:51:43.509 INFO:teuthology.orchestra.run.smithi089.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-13T02:51:43.509 INFO:teuthology.orchestra.run.smithi089.stdout:created 2024-09-13T02:51:40.657817+0000 2024-09-13T02:51:43.509 INFO:teuthology.orchestra.run.smithi089.stdout:modified 2024-09-13T02:51:40.657889+0000 2024-09-13T02:51:43.509 INFO:teuthology.orchestra.run.smithi089.stdout:tableserver 0 2024-09-13T02:51:43.509 INFO:teuthology.orchestra.run.smithi089.stdout:root 0 2024-09-13T02:51:43.509 INFO:teuthology.orchestra.run.smithi089.stdout:session_timeout 60 2024-09-13T02:51:43.509 INFO:teuthology.orchestra.run.smithi089.stdout:session_autoclose 300 2024-09-13T02:51:43.509 INFO:teuthology.orchestra.run.smithi089.stdout:max_file_size 1099511627776 2024-09-13T02:51:43.509 INFO:teuthology.orchestra.run.smithi089.stdout:required_client_features {} 2024-09-13T02:51:43.509 INFO:teuthology.orchestra.run.smithi089.stdout:last_failure 0 2024-09-13T02:51:43.509 INFO:teuthology.orchestra.run.smithi089.stdout:last_failure_osd_epoch 0 2024-09-13T02:51:43.509 INFO:teuthology.orchestra.run.smithi089.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:51:43.510 INFO:teuthology.orchestra.run.smithi089.stdout:max_mds 1 2024-09-13T02:51:43.510 INFO:teuthology.orchestra.run.smithi089.stdout:in 2024-09-13T02:51:43.510 INFO:teuthology.orchestra.run.smithi089.stdout:up {} 2024-09-13T02:51:43.510 INFO:teuthology.orchestra.run.smithi089.stdout:failed 2024-09-13T02:51:43.510 INFO:teuthology.orchestra.run.smithi089.stdout:damaged 2024-09-13T02:51:43.510 INFO:teuthology.orchestra.run.smithi089.stdout:stopped 2024-09-13T02:51:43.510 INFO:teuthology.orchestra.run.smithi089.stdout:data_pools [3] 2024-09-13T02:51:43.510 INFO:teuthology.orchestra.run.smithi089.stdout:metadata_pool 2 2024-09-13T02:51:43.510 INFO:teuthology.orchestra.run.smithi089.stdout:inline_data disabled 2024-09-13T02:51:43.510 INFO:teuthology.orchestra.run.smithi089.stdout:balancer 2024-09-13T02:51:43.510 INFO:teuthology.orchestra.run.smithi089.stdout:standby_count_wanted 0 2024-09-13T02:51:43.510 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:51:43.510 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:51:43.511 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 2 2024-09-13T02:51:43.511 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:43.508+0000 7f16506b2640 1 -- 172.21.15.89:0/4052385444 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f163406ed60 msgr2=0x7f1634071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:43.511 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:43.508+0000 7f16506b2640 1 --2- 172.21.15.89:0/4052385444 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f163406ed60 0x7f1634071210 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f16440041d0 tx=0x7f1644009040 comp rx=0 tx=0).stop 2024-09-13T02:51:43.511 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:43.508+0000 7f16506b2640 1 -- 172.21.15.89:0/4052385444 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16480ff720 msgr2=0x7f164810d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:43.511 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:43.508+0000 7f16506b2640 1 --2- 172.21.15.89:0/4052385444 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16480ff720 0x7f164810d5f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f16380048a0 tx=0x7f1638009da0 comp rx=0 tx=0).stop 2024-09-13T02:51:43.511 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:43.509+0000 7f16506b2640 1 -- 172.21.15.89:0/4052385444 shutdown_connections 2024-09-13T02:51:43.512 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:43.509+0000 7f16506b2640 1 --2- 172.21.15.89:0/4052385444 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f16480ff720 0x7f164810d5f0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:43.512 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:43.509+0000 7f16506b2640 1 --2- 172.21.15.89:0/4052385444 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f163406ed60 0x7f1634071210 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:43.512 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:43.509+0000 7f16506b2640 1 --2- 172.21.15.89:0/4052385444 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f16480666b0 0x7f164810d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:43.512 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:43.509+0000 7f16506b2640 1 -- 172.21.15.89:0/4052385444 >> 172.21.15.89:0/4052385444 conn(0x7f16480f6c10 msgr2=0x7f16480f7030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:51:43.512 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:43.509+0000 7f16506b2640 1 -- 172.21.15.89:0/4052385444 shutdown_connections 2024-09-13T02:51:43.512 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:43.509+0000 7f16506b2640 1 -- 172.21.15.89:0/4052385444 wait complete. 2024-09-13T02:51:43.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:43 smithi089 ceph-mon[27639]: osdmap e43: 6 total, 6 up, 6 in 2024-09-13T02:51:43.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:43 smithi089 ceph-mon[27639]: from='client.? 172.21.15.89:0/4052385444' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T02:51:43.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:43 smithi131 ceph-mon[34689]: osdmap e43: 6 total, 6 up, 6 in 2024-09-13T02:51:43.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:43 smithi131 ceph-mon[34689]: from='client.? 172.21.15.89:0/4052385444' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T02:51:44.211 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-13T02:51:44.221 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi089.front.sepia.ceph.com 2024-09-13T02:51:44.221 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -- bash -c 'ceph fs set cephfs max_mds 2' 2024-09-13T02:51:44.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:44 smithi131 ceph-mon[34689]: pgmap v173: 65 pgs: 7 creating+peering, 40 unknown, 18 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:51:44.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:44 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:51:44.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:44 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:51:44.975 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:44 smithi089 ceph-mon[27639]: pgmap v173: 65 pgs: 7 creating+peering, 40 unknown, 18 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:51:44.976 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:44 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:51:44.976 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:44 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:51:45.111 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T02:51:46.568 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:46.547+0000 7fe88cfc8640 1 -- 172.21.15.89:0/2099192533 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe8880fd380 msgr2=0x7fe8880fb7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:46.569 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:46.547+0000 7fe88cfc8640 1 --2- 172.21.15.89:0/2099192533 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe8880fd380 0x7fe8880fb7b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe87c0048d0 tx=0x7fe87c009da0 comp rx=0 tx=0).stop 2024-09-13T02:51:46.569 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:46.547+0000 7fe88cfc8640 1 -- 172.21.15.89:0/2099192533 shutdown_connections 2024-09-13T02:51:46.569 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:46.547+0000 7fe88cfc8640 1 --2- 172.21.15.89:0/2099192533 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe8880fd380 0x7fe8880fb7b0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:46.569 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:46.547+0000 7fe88cfc8640 1 --2- 172.21.15.89:0/2099192533 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe8880fca30 0x7fe8880fce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:46.569 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:46.547+0000 7fe88cfc8640 1 -- 172.21.15.89:0/2099192533 >> 172.21.15.89:0/2099192533 conn(0x7fe8880f6390 msgr2=0x7fe8880f87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:51:46.569 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:46.547+0000 7fe88cfc8640 1 -- 172.21.15.89:0/2099192533 shutdown_connections 2024-09-13T02:51:46.569 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:46.547+0000 7fe88cfc8640 1 -- 172.21.15.89:0/2099192533 wait complete. 2024-09-13T02:51:46.569 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:46.548+0000 7fe88cfc8640 1 Processor -- start 2024-09-13T02:51:46.569 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:46.548+0000 7fe88cfc8640 1 -- start start 2024-09-13T02:51:46.569 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:46.548+0000 7fe88cfc8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe8880fca30 0x7fe88810bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:46.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:46.548+0000 7fe88cfc8640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe8880fd380 0x7fe88810c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:46.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:46.548+0000 7fe88cfc8640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe88810cb10 con 0x7fe8880fca30 2024-09-13T02:51:46.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:46.548+0000 7fe88cfc8640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe88810d330 con 0x7fe8880fd380 2024-09-13T02:51:46.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:46.548+0000 7fe88659c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe8880fca30 0x7fe88810bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:46.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:46.548+0000 7fe88659c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe8880fca30 0x7fe88810bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:50628/0 (socket says 172.21.15.89:50628) 2024-09-13T02:51:46.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:46.548+0000 7fe88659c640 1 -- 172.21.15.89:0/2104656296 learned_addr learned my addr 172.21.15.89:0/2104656296 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:51:46.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:46.549+0000 7fe88659c640 1 -- 172.21.15.89:0/2104656296 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe8880fd380 msgr2=0x7fe88810c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:46.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:46.549+0000 7fe885d9b640 1 --2- 172.21.15.89:0/2104656296 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe8880fd380 0x7fe88810c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:46.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:46.549+0000 7fe88659c640 1 --2- 172.21.15.89:0/2104656296 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe8880fd380 0x7fe88810c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:46.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:46.549+0000 7fe88659c640 1 -- 172.21.15.89:0/2104656296 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe87c005040 con 0x7fe8880fca30 2024-09-13T02:51:46.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:46.549+0000 7fe88659c640 1 --2- 172.21.15.89:0/2104656296 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe8880fca30 0x7fe88810bf80 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe87800c790 tx=0x7fe8780043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:51:46.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:46.549+0000 7fe876ffd640 1 -- 172.21.15.89:0/2104656296 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe87800a820 con 0x7fe8880fca30 2024-09-13T02:51:46.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:46.549+0000 7fe876ffd640 1 -- 172.21.15.89:0/2104656296 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe87800ae20 con 0x7fe8880fca30 2024-09-13T02:51:46.571 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:46.549+0000 7fe88cfc8640 1 -- 172.21.15.89:0/2104656296 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe88810d5c0 con 0x7fe8880fca30 2024-09-13T02:51:46.571 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:46.549+0000 7fe876ffd640 1 -- 172.21.15.89:0/2104656296 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe8780113a0 con 0x7fe8880fca30 2024-09-13T02:51:46.571 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:46.549+0000 7fe88cfc8640 1 -- 172.21.15.89:0/2104656296 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe88810db60 con 0x7fe8880fca30 2024-09-13T02:51:46.571 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:46.550+0000 7fe88cfc8640 1 -- 172.21.15.89:0/2104656296 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8880fa010 con 0x7fe8880fca30 2024-09-13T02:51:46.571 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:46.550+0000 7fe876ffd640 1 -- 172.21.15.89:0/2104656296 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fe878012400 con 0x7fe8880fca30 2024-09-13T02:51:46.571 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:46.551+0000 7fe876ffd640 1 --2- 172.21.15.89:0/2104656296 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fe87006ed60 0x7fe870071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:46.571 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:46.551+0000 7fe885d9b640 1 --2- 172.21.15.89:0/2104656296 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fe87006ed60 0x7fe870071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:46.571 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:46.551+0000 7fe876ffd640 1 -- 172.21.15.89:0/2104656296 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7fe87808e300 con 0x7fe8880fca30 2024-09-13T02:51:46.571 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:46.551+0000 7fe885d9b640 1 --2- 172.21.15.89:0/2104656296 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fe87006ed60 0x7fe870071210 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe87c000c00 tx=0x7fe87c009da0 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:51:46.571 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:46.555+0000 7fe876ffd640 1 -- 172.21.15.89:0/2104656296 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fe87805b4a0 con 0x7fe8880fca30 2024-09-13T02:51:46.756 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:46.754+0000 7fe88cfc8640 1 -- 172.21.15.89:0/2104656296 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"} v 0) v1 -- 0x7fe888103e50 con 0x7fe8880fca30 2024-09-13T02:51:46.814 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:46 smithi089 ceph-mon[27639]: pgmap v174: 65 pgs: 7 creating+peering, 6 unknown, 52 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:51:46.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:46 smithi131 ceph-mon[34689]: pgmap v174: 65 pgs: 7 creating+peering, 6 unknown, 52 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:51:47.690 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:47.688+0000 7fe876ffd640 1 -- 172.21.15.89:0/2104656296 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]=0 v3) v1 ==== 105+0+0 (secure 0 0 0) 0x7fe87805ae40 con 0x7fe8880fca30 2024-09-13T02:51:47.692 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:47.691+0000 7fe88cfc8640 1 -- 172.21.15.89:0/2104656296 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fe87006ed60 msgr2=0x7fe870071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:47.692 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:47.691+0000 7fe88cfc8640 1 --2- 172.21.15.89:0/2104656296 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fe87006ed60 0x7fe870071210 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe87c000c00 tx=0x7fe87c009da0 comp rx=0 tx=0).stop 2024-09-13T02:51:47.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:47.691+0000 7fe88cfc8640 1 -- 172.21.15.89:0/2104656296 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe8880fca30 msgr2=0x7fe88810bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:47.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:47.691+0000 7fe88cfc8640 1 --2- 172.21.15.89:0/2104656296 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe8880fca30 0x7fe88810bf80 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fe87800c790 tx=0x7fe8780043c0 comp rx=0 tx=0).stop 2024-09-13T02:51:47.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:47.691+0000 7fe88cfc8640 1 -- 172.21.15.89:0/2104656296 shutdown_connections 2024-09-13T02:51:47.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:47.691+0000 7fe88cfc8640 1 --2- 172.21.15.89:0/2104656296 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fe87006ed60 0x7fe870071210 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:47.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:47.691+0000 7fe88cfc8640 1 --2- 172.21.15.89:0/2104656296 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe8880fd380 0x7fe88810c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:47.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:47.691+0000 7fe88cfc8640 1 --2- 172.21.15.89:0/2104656296 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe8880fca30 0x7fe88810bf80 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:47.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:47.691+0000 7fe88cfc8640 1 -- 172.21.15.89:0/2104656296 >> 172.21.15.89:0/2104656296 conn(0x7fe8880f6390 msgr2=0x7fe8880f7b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:51:47.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:47.691+0000 7fe88cfc8640 1 -- 172.21.15.89:0/2104656296 shutdown_connections 2024-09-13T02:51:47.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:47.691+0000 7fe88cfc8640 1 -- 172.21.15.89:0/2104656296 wait complete. 2024-09-13T02:51:47.729 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:47 smithi131 ceph-mon[34689]: from='client.? 172.21.15.89:0/2104656296' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-09-13T02:51:47.729 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:47 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:51:47.729 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:47 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:51:47.729 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:47 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:51:47.729 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:47 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi131.uasrkg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T02:51:47.729 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:47 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi131.uasrkg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T02:51:47.729 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:47 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:51:47.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:47 smithi089 ceph-mon[27639]: from='client.? 172.21.15.89:0/2104656296' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-09-13T02:51:47.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:47 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:51:47.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:47 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:51:47.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:47 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:51:47.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:47 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi131.uasrkg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T02:51:47.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:47 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi131.uasrkg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T02:51:47.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:47 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:51:48.318 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-13T02:51:48.328 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi089.front.sepia.ceph.com 2024-09-13T02:51:48.328 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -- bash -c 'ceph fs set cephfs allow_standby_replay true' 2024-09-13T02:51:48.579 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T02:51:48.951 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:48 smithi131 ceph-mon[34689]: pgmap v175: 65 pgs: 65 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:51:49.035 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:48 smithi131 ceph-mon[34689]: Deploying daemon mds.cephfs.smithi131.uasrkg on smithi131 2024-09-13T02:51:49.035 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:48 smithi131 ceph-mon[34689]: from='client.? 172.21.15.89:0/2104656296' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-09-13T02:51:49.035 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:48 smithi131 ceph-mon[34689]: mds.? [v2:172.21.15.89:6826/3243844531,v1:172.21.15.89:6827/3243844531] up:boot 2024-09-13T02:51:49.035 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:48 smithi131 ceph-mon[34689]: daemon mds.cephfs.smithi089.qjoitb assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-09-13T02:51:49.035 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:48 smithi131 ceph-mon[34689]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-13T02:51:49.035 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:48 smithi131 ceph-mon[34689]: fsmap cephfs:0 1 up:standby 2024-09-13T02:51:49.035 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:48 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi089.qjoitb"}]: dispatch 2024-09-13T02:51:49.035 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:48 smithi131 ceph-mon[34689]: fsmap cephfs:1 {0=cephfs.smithi089.qjoitb=up:creating} 2024-09-13T02:51:49.035 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:48 smithi131 ceph-mon[34689]: daemon mds.cephfs.smithi089.qjoitb is now active in filesystem cephfs as rank 0 2024-09-13T02:51:49.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:48 smithi089 ceph-mon[27639]: pgmap v175: 65 pgs: 65 active+clean; 577 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-09-13T02:51:49.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:48 smithi089 ceph-mon[27639]: Deploying daemon mds.cephfs.smithi131.uasrkg on smithi131 2024-09-13T02:51:49.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:48 smithi089 ceph-mon[27639]: from='client.? 172.21.15.89:0/2104656296' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-09-13T02:51:49.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:48 smithi089 ceph-mon[27639]: mds.? [v2:172.21.15.89:6826/3243844531,v1:172.21.15.89:6827/3243844531] up:boot 2024-09-13T02:51:49.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:48 smithi089 ceph-mon[27639]: daemon mds.cephfs.smithi089.qjoitb assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-09-13T02:51:49.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:48 smithi089 ceph-mon[27639]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-13T02:51:49.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:48 smithi089 ceph-mon[27639]: fsmap cephfs:0 1 up:standby 2024-09-13T02:51:49.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:48 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi089.qjoitb"}]: dispatch 2024-09-13T02:51:49.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:48 smithi089 ceph-mon[27639]: fsmap cephfs:1 {0=cephfs.smithi089.qjoitb=up:creating} 2024-09-13T02:51:49.037 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:48 smithi089 ceph-mon[27639]: daemon mds.cephfs.smithi089.qjoitb is now active in filesystem cephfs as rank 0 2024-09-13T02:51:49.911 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:49 smithi089 ceph-mon[27639]: mds.? [v2:172.21.15.89:6826/3243844531,v1:172.21.15.89:6827/3243844531] up:active 2024-09-13T02:51:49.912 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:49 smithi089 ceph-mon[27639]: fsmap cephfs:1 {0=cephfs.smithi089.qjoitb=up:active} 2024-09-13T02:51:49.912 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:49 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:51:49.912 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:49 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:51:49.912 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:49 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:51:49.912 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:49 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi089.rarddb", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T02:51:49.912 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:49 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi089.rarddb", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T02:51:49.912 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:49 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:51:50.124 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:50.122+0000 7ff0d629c640 1 -- 172.21.15.89:0/343668593 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0d0065be0 msgr2=0x7ff0d00ff1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:50.124 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:50.122+0000 7ff0d629c640 1 --2- 172.21.15.89:0/343668593 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0d0065be0 0x7ff0d00ff1a0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff0c00048d0 tx=0x7ff0c0009da0 comp rx=0 tx=0).stop 2024-09-13T02:51:50.125 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:50.122+0000 7ff0d629c640 1 -- 172.21.15.89:0/343668593 shutdown_connections 2024-09-13T02:51:50.125 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:50.122+0000 7ff0d629c640 1 --2- 172.21.15.89:0/343668593 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff0d00ff6e0 0x7ff0d0101ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:50.125 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:50.122+0000 7ff0d629c640 1 --2- 172.21.15.89:0/343668593 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0d0065be0 0x7ff0d00ff1a0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:50.125 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:50.122+0000 7ff0d629c640 1 -- 172.21.15.89:0/343668593 >> 172.21.15.89:0/343668593 conn(0x7ff0d00f6c10 msgr2=0x7ff0d00f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:51:50.125 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:50.122+0000 7ff0d629c640 1 -- 172.21.15.89:0/343668593 shutdown_connections 2024-09-13T02:51:50.125 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:50.122+0000 7ff0d629c640 1 -- 172.21.15.89:0/343668593 wait complete. 2024-09-13T02:51:50.125 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:50.122+0000 7ff0d629c640 1 Processor -- start 2024-09-13T02:51:50.125 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:50.123+0000 7ff0d629c640 1 -- start start 2024-09-13T02:51:50.125 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:50.123+0000 7ff0d629c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0d0065be0 0x7ff0d00fcb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:50.125 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:50.123+0000 7ff0d629c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff0d00ff6e0 0x7ff0d00fb0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:50.125 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:50.123+0000 7ff0d629c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d00fb5e0 con 0x7ff0d0065be0 2024-09-13T02:51:50.125 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:50.123+0000 7ff0d629c640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d00fb720 con 0x7ff0d00ff6e0 2024-09-13T02:51:50.125 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:50.123+0000 7ff0cffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0d0065be0 0x7ff0d00fcb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:50.126 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:50.123+0000 7ff0cffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0d0065be0 0x7ff0d00fcb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:50664/0 (socket says 172.21.15.89:50664) 2024-09-13T02:51:50.126 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:50.123+0000 7ff0cffff640 1 -- 172.21.15.89:0/304149925 learned_addr learned my addr 172.21.15.89:0/304149925 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:51:50.126 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:50.123+0000 7ff0c7fff640 1 --2- 172.21.15.89:0/304149925 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff0d00ff6e0 0x7ff0d00fb0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:50.126 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:50.123+0000 7ff0cffff640 1 -- 172.21.15.89:0/304149925 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff0d00ff6e0 msgr2=0x7ff0d00fb0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:50.126 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:50.123+0000 7ff0cffff640 1 --2- 172.21.15.89:0/304149925 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff0d00ff6e0 0x7ff0d00fb0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:50.126 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:50.123+0000 7ff0cffff640 1 -- 172.21.15.89:0/304149925 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0c0005040 con 0x7ff0d0065be0 2024-09-13T02:51:50.126 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:50.123+0000 7ff0cffff640 1 --2- 172.21.15.89:0/304149925 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0d0065be0 0x7ff0d00fcb60 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff0c0000c00 tx=0x7ff0c0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:51:50.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:50.123+0000 7ff0cd7fa640 1 -- 172.21.15.89:0/304149925 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff0c0038070 con 0x7ff0d0065be0 2024-09-13T02:51:50.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:50.123+0000 7ff0cd7fa640 1 -- 172.21.15.89:0/304149925 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff0c0032d30 con 0x7ff0d0065be0 2024-09-13T02:51:50.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:50.124+0000 7ff0cd7fa640 1 -- 172.21.15.89:0/304149925 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff0c003dbc0 con 0x7ff0d0065be0 2024-09-13T02:51:50.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:50.124+0000 7ff0d629c640 1 -- 172.21.15.89:0/304149925 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0d00fb9a0 con 0x7ff0d0065be0 2024-09-13T02:51:50.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:50.124+0000 7ff0d629c640 1 -- 172.21.15.89:0/304149925 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0d00fbeb0 con 0x7ff0d0065be0 2024-09-13T02:51:50.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:50.124+0000 7ff0d629c640 1 -- 172.21.15.89:0/304149925 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0d00fa890 con 0x7ff0d0065be0 2024-09-13T02:51:50.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:50.125+0000 7ff0cd7fa640 1 -- 172.21.15.89:0/304149925 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7ff0c0030020 con 0x7ff0d0065be0 2024-09-13T02:51:50.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:50.125+0000 7ff0cd7fa640 1 --2- 172.21.15.89:0/304149925 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7ff0bc06ed50 0x7ff0bc071200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:50.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:50.126+0000 7ff0c7fff640 1 --2- 172.21.15.89:0/304149925 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7ff0bc06ed50 0x7ff0bc071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:50.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:50.126+0000 7ff0cd7fa640 1 -- 172.21.15.89:0/304149925 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7ff0c00aeaa0 con 0x7ff0d0065be0 2024-09-13T02:51:50.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:50.126+0000 7ff0c7fff640 1 --2- 172.21.15.89:0/304149925 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7ff0bc06ed50 0x7ff0bc071200 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff0b8004eb0 tx=0x7ff0b800b040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:51:50.130 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:50.130+0000 7ff0cd7fa640 1 -- 172.21.15.89:0/304149925 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7ff0c007bc40 con 0x7ff0d0065be0 2024-09-13T02:51:50.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:49 smithi131 ceph-mon[34689]: mds.? [v2:172.21.15.89:6826/3243844531,v1:172.21.15.89:6827/3243844531] up:active 2024-09-13T02:51:50.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:49 smithi131 ceph-mon[34689]: fsmap cephfs:1 {0=cephfs.smithi089.qjoitb=up:active} 2024-09-13T02:51:50.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:49 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:51:50.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:49 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:51:50.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:49 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:51:50.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:49 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi089.rarddb", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T02:51:50.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:49 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi089.rarddb", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T02:51:50.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:49 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:51:50.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:50.325+0000 7ff0d629c640 1 -- 172.21.15.89:0/304149925 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) v1 -- 0x7ff0d004b720 con 0x7ff0d0065be0 2024-09-13T02:51:50.712 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:50.711+0000 7ff0cd7fa640 1 -- 172.21.15.89:0/304149925 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v8) v1 ==== 121+0+0 (secure 0 0 0) 0x7ff0c007b5e0 con 0x7ff0d0065be0 2024-09-13T02:51:50.714 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:50.713+0000 7ff0d629c640 1 -- 172.21.15.89:0/304149925 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7ff0bc06ed50 msgr2=0x7ff0bc071200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:50.714 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:50.713+0000 7ff0d629c640 1 --2- 172.21.15.89:0/304149925 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7ff0bc06ed50 0x7ff0bc071200 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff0b8004eb0 tx=0x7ff0b800b040 comp rx=0 tx=0).stop 2024-09-13T02:51:50.714 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:50.713+0000 7ff0d629c640 1 -- 172.21.15.89:0/304149925 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0d0065be0 msgr2=0x7ff0d00fcb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:50.714 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:50.713+0000 7ff0d629c640 1 --2- 172.21.15.89:0/304149925 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0d0065be0 0x7ff0d00fcb60 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff0c0000c00 tx=0x7ff0c0009da0 comp rx=0 tx=0).stop 2024-09-13T02:51:50.715 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:50.713+0000 7ff0d629c640 1 -- 172.21.15.89:0/304149925 shutdown_connections 2024-09-13T02:51:50.715 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:50.713+0000 7ff0d629c640 1 --2- 172.21.15.89:0/304149925 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7ff0bc06ed50 0x7ff0bc071200 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:50.715 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:50.713+0000 7ff0d629c640 1 --2- 172.21.15.89:0/304149925 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff0d00ff6e0 0x7ff0d00fb0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:50.715 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:50.713+0000 7ff0d629c640 1 --2- 172.21.15.89:0/304149925 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0d0065be0 0x7ff0d00fcb60 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:50.715 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:50.713+0000 7ff0d629c640 1 -- 172.21.15.89:0/304149925 >> 172.21.15.89:0/304149925 conn(0x7ff0d00f6c10 msgr2=0x7ff0d00f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:51:50.715 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:50.713+0000 7ff0d629c640 1 -- 172.21.15.89:0/304149925 shutdown_connections 2024-09-13T02:51:50.715 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:50.713+0000 7ff0d629c640 1 -- 172.21.15.89:0/304149925 wait complete. 2024-09-13T02:51:51.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:50 smithi089 ceph-mon[27639]: pgmap v176: 65 pgs: 65 active+clean; 578 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 2 op/s 2024-09-13T02:51:51.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:50 smithi089 ceph-mon[27639]: Deploying daemon mds.cephfs.smithi089.rarddb on smithi089 2024-09-13T02:51:51.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:50 smithi089 ceph-mon[27639]: mds.? [v2:172.21.15.131:6824/260493836,v1:172.21.15.131:6825/260493836] up:boot 2024-09-13T02:51:51.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:50 smithi089 ceph-mon[27639]: daemon mds.cephfs.smithi131.uasrkg assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-13T02:51:51.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:50 smithi089 ceph-mon[27639]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-09-13T02:51:51.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:50 smithi089 ceph-mon[27639]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-13T02:51:51.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:50 smithi089 ceph-mon[27639]: fsmap cephfs:1 {0=cephfs.smithi089.qjoitb=up:active} 1 up:standby 2024-09-13T02:51:51.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:50 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi131.uasrkg"}]: dispatch 2024-09-13T02:51:51.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:50 smithi089 ceph-mon[27639]: fsmap cephfs:2 {0=cephfs.smithi089.qjoitb=up:active,1=cephfs.smithi131.uasrkg=up:creating} 2024-09-13T02:51:51.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:50 smithi089 ceph-mon[27639]: daemon mds.cephfs.smithi131.uasrkg is now active in filesystem cephfs as rank 1 2024-09-13T02:51:51.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:50 smithi089 ceph-mon[27639]: from='client.? 172.21.15.89:0/304149925' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-13T02:51:51.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:50 smithi131 ceph-mon[34689]: pgmap v176: 65 pgs: 65 active+clean; 578 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 2 op/s 2024-09-13T02:51:51.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:50 smithi131 ceph-mon[34689]: Deploying daemon mds.cephfs.smithi089.rarddb on smithi089 2024-09-13T02:51:51.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:50 smithi131 ceph-mon[34689]: mds.? [v2:172.21.15.131:6824/260493836,v1:172.21.15.131:6825/260493836] up:boot 2024-09-13T02:51:51.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:50 smithi131 ceph-mon[34689]: daemon mds.cephfs.smithi131.uasrkg assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-13T02:51:51.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:50 smithi131 ceph-mon[34689]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-09-13T02:51:51.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:50 smithi131 ceph-mon[34689]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-13T02:51:51.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:50 smithi131 ceph-mon[34689]: fsmap cephfs:1 {0=cephfs.smithi089.qjoitb=up:active} 1 up:standby 2024-09-13T02:51:51.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:50 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi131.uasrkg"}]: dispatch 2024-09-13T02:51:51.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:50 smithi131 ceph-mon[34689]: fsmap cephfs:2 {0=cephfs.smithi089.qjoitb=up:active,1=cephfs.smithi131.uasrkg=up:creating} 2024-09-13T02:51:51.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:50 smithi131 ceph-mon[34689]: daemon mds.cephfs.smithi131.uasrkg is now active in filesystem cephfs as rank 1 2024-09-13T02:51:51.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:50 smithi131 ceph-mon[34689]: from='client.? 172.21.15.89:0/304149925' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-13T02:51:51.446 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-13T02:51:51.457 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi089.front.sepia.ceph.com 2024-09-13T02:51:51.457 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -- bash -c 'ceph fs set cephfs inline_data false' 2024-09-13T02:51:52.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:51 smithi089 ceph-mon[27639]: mds.? [v2:172.21.15.131:6824/260493836,v1:172.21.15.131:6825/260493836] up:active 2024-09-13T02:51:52.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:51 smithi089 ceph-mon[27639]: from='client.? 172.21.15.89:0/304149925' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-13T02:51:52.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:51 smithi089 ceph-mon[27639]: fsmap cephfs:2 {0=cephfs.smithi089.qjoitb=up:active,1=cephfs.smithi131.uasrkg=up:active} 2024-09-13T02:51:52.048 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T02:51:52.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:51 smithi131 ceph-mon[34689]: mds.? [v2:172.21.15.131:6824/260493836,v1:172.21.15.131:6825/260493836] up:active 2024-09-13T02:51:52.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:51 smithi131 ceph-mon[34689]: from='client.? 172.21.15.89:0/304149925' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-13T02:51:52.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:51 smithi131 ceph-mon[34689]: fsmap cephfs:2 {0=cephfs.smithi089.qjoitb=up:active,1=cephfs.smithi131.uasrkg=up:active} 2024-09-13T02:51:52.972 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:52 smithi089 ceph-mon[27639]: pgmap v177: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s wr, 2 op/s 2024-09-13T02:51:53.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:52 smithi131 ceph-mon[34689]: pgmap v177: 65 pgs: 65 active+clean; 579 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s wr, 2 op/s 2024-09-13T02:51:53.800 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:53 smithi089 ceph-mon[27639]: pgmap v178: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s wr, 5 op/s 2024-09-13T02:51:53.892 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:53.880+0000 7f50798ed640 1 -- 172.21.15.89:0/2720967939 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5074066790 msgr2=0x7f50740ff160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:53.892 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:53.880+0000 7f50798ed640 1 --2- 172.21.15.89:0/2720967939 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5074066790 0x7f50740ff160 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f50640048d0 tx=0x7f5064009da0 comp rx=0 tx=0).stop 2024-09-13T02:51:53.892 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:53.880+0000 7f50798ed640 1 -- 172.21.15.89:0/2720967939 shutdown_connections 2024-09-13T02:51:53.892 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:53.880+0000 7f50798ed640 1 --2- 172.21.15.89:0/2720967939 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f50740ff6a0 0x7f5074101a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:53.892 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:53.880+0000 7f50798ed640 1 --2- 172.21.15.89:0/2720967939 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5074066790 0x7f50740ff160 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:53.893 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:53.880+0000 7f50798ed640 1 -- 172.21.15.89:0/2720967939 >> 172.21.15.89:0/2720967939 conn(0x7f50740f6c10 msgr2=0x7f50740f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:51:53.893 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:53.880+0000 7f50798ed640 1 -- 172.21.15.89:0/2720967939 shutdown_connections 2024-09-13T02:51:53.893 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:53.880+0000 7f50798ed640 1 -- 172.21.15.89:0/2720967939 wait complete. 2024-09-13T02:51:53.893 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:53.880+0000 7f50798ed640 1 Processor -- start 2024-09-13T02:51:53.893 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:53.881+0000 7f50798ed640 1 -- start start 2024-09-13T02:51:53.893 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:53.881+0000 7f50798ed640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5074066790 0x7f50740fcb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:53.893 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:53.881+0000 7f50798ed640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f50740ff6a0 0x7f50740fb060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:53.893 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:53.881+0000 7f50798ed640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50740fb630 con 0x7f50740ff6a0 2024-09-13T02:51:53.893 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:53.881+0000 7f50798ed640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50740fb770 con 0x7f5074066790 2024-09-13T02:51:53.893 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:53.881+0000 7f506bfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f50740ff6a0 0x7f50740fb060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:53.893 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:53.881+0000 7f506bfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f50740ff6a0 0x7f50740fb060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:43314/0 (socket says 172.21.15.89:43314) 2024-09-13T02:51:53.893 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:53.881+0000 7f506bfff640 1 -- 172.21.15.89:0/2617230918 learned_addr learned my addr 172.21.15.89:0/2617230918 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:51:53.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:53.881+0000 7f506bfff640 1 -- 172.21.15.89:0/2617230918 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5074066790 msgr2=0x7f50740fcb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:53.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:53.881+0000 7f506bfff640 1 --2- 172.21.15.89:0/2617230918 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5074066790 0x7f50740fcb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:53.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:53.881+0000 7f506bfff640 1 -- 172.21.15.89:0/2617230918 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5064005040 con 0x7f50740ff6a0 2024-09-13T02:51:53.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:53.881+0000 7f506bfff640 1 --2- 172.21.15.89:0/2617230918 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f50740ff6a0 0x7f50740fb060 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f505c00b790 tx=0x7f505c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:51:53.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:53.881+0000 7f506b7fe640 1 -- 172.21.15.89:0/2617230918 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f505c00c700 con 0x7f50740ff6a0 2024-09-13T02:51:53.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:53.881+0000 7f506b7fe640 1 -- 172.21.15.89:0/2617230918 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f505c00cd00 con 0x7f50740ff6a0 2024-09-13T02:51:53.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:53.881+0000 7f50798ed640 1 -- 172.21.15.89:0/2617230918 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50740fba50 con 0x7f50740ff6a0 2024-09-13T02:51:53.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:53.881+0000 7f506b7fe640 1 -- 172.21.15.89:0/2617230918 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f505c015e70 con 0x7f50740ff6a0 2024-09-13T02:51:53.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:53.882+0000 7f50798ed640 1 -- 172.21.15.89:0/2617230918 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50741151d0 con 0x7f50740ff6a0 2024-09-13T02:51:53.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:53.883+0000 7f50798ed640 1 -- 172.21.15.89:0/2617230918 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50740fa8b0 con 0x7f50740ff6a0 2024-09-13T02:51:53.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:53.883+0000 7f506b7fe640 1 -- 172.21.15.89:0/2617230918 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f505c012070 con 0x7f50740ff6a0 2024-09-13T02:51:53.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:53.883+0000 7f506b7fe640 1 --2- 172.21.15.89:0/2617230918 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f506006ed60 0x7f5060071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:53.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:53.884+0000 7f506b7fe640 1 -- 172.21.15.89:0/2617230918 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f505c08dd00 con 0x7f50740ff6a0 2024-09-13T02:51:53.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:53.884+0000 7f5072ffd640 1 --2- 172.21.15.89:0/2617230918 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f506006ed60 0x7f5060071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:53.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:53.884+0000 7f5072ffd640 1 --2- 172.21.15.89:0/2617230918 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f506006ed60 0x7f5060071210 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f506402a530 tx=0x7f5064009da0 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:51:53.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:53.888+0000 7f506b7fe640 1 -- 172.21.15.89:0/2617230918 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f505c091030 con 0x7f50740ff6a0 2024-09-13T02:51:54.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:54.084+0000 7f50798ed640 1 -- 172.21.15.89:0/2617230918 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"} v 0) v1 -- 0x7f507404b720 con 0x7f50740ff6a0 2024-09-13T02:51:54.183 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:53 smithi131 ceph-mon[34689]: pgmap v178: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s wr, 5 op/s 2024-09-13T02:51:55.022 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:55.020+0000 7f506b7fe640 1 -- 172.21.15.89:0/2617230918 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]=0 inline data disabled v9) v1 ==== 133+0+0 (secure 0 0 0) 0x7f505c05ae20 con 0x7f50740ff6a0 2024-09-13T02:51:55.023 INFO:teuthology.orchestra.run.smithi089.stderr:inline data disabled 2024-09-13T02:51:55.025 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:55.023+0000 7f50798ed640 1 -- 172.21.15.89:0/2617230918 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f506006ed60 msgr2=0x7f5060071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:55.025 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:55.023+0000 7f50798ed640 1 --2- 172.21.15.89:0/2617230918 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f506006ed60 0x7f5060071210 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f506402a530 tx=0x7f5064009da0 comp rx=0 tx=0).stop 2024-09-13T02:51:55.025 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:55.023+0000 7f50798ed640 1 -- 172.21.15.89:0/2617230918 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f50740ff6a0 msgr2=0x7f50740fb060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:55.025 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:55.023+0000 7f50798ed640 1 --2- 172.21.15.89:0/2617230918 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f50740ff6a0 0x7f50740fb060 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f505c00b790 tx=0x7f505c0091d0 comp rx=0 tx=0).stop 2024-09-13T02:51:55.025 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:55.023+0000 7f50798ed640 1 -- 172.21.15.89:0/2617230918 shutdown_connections 2024-09-13T02:51:55.025 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:55.023+0000 7f50798ed640 1 --2- 172.21.15.89:0/2617230918 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f50740ff6a0 0x7f50740fb060 secure :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f505c00b790 tx=0x7f505c0091d0 comp rx=0 tx=0).stop 2024-09-13T02:51:55.025 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:55.023+0000 7f50798ed640 1 --2- 172.21.15.89:0/2617230918 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f506006ed60 0x7f5060071210 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:55.025 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:55.023+0000 7f50798ed640 1 --2- 172.21.15.89:0/2617230918 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5074066790 0x7f50740fcb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:55.026 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:55.023+0000 7f50798ed640 1 -- 172.21.15.89:0/2617230918 >> 172.21.15.89:0/2617230918 conn(0x7f50740f6c10 msgr2=0x7f50740f7030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:51:55.026 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:55.023+0000 7f50798ed640 1 -- 172.21.15.89:0/2617230918 shutdown_connections 2024-09-13T02:51:55.026 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:55.023+0000 7f50798ed640 1 -- 172.21.15.89:0/2617230918 wait complete. 2024-09-13T02:51:55.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:55 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:51:55.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:55 smithi131 ceph-mon[34689]: from='client.? 172.21.15.89:0/2617230918' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2024-09-13T02:51:55.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:55 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:51:55.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:55 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:51:55.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:55 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:51:55.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:55 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi131.rbovzc", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T02:51:55.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:55 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi131.rbovzc", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T02:51:55.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:55 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:51:55.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:55 smithi131 ceph-mon[34689]: Deploying daemon mds.cephfs.smithi131.rbovzc on smithi131 2024-09-13T02:51:55.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:55 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:51:55.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:55 smithi089 ceph-mon[27639]: from='client.? 172.21.15.89:0/2617230918' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2024-09-13T02:51:55.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:55 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:51:55.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:55 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:51:55.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:55 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:51:55.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:55 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi131.rbovzc", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T02:51:55.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:55 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi131.rbovzc", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-13T02:51:55.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:55 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:51:55.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:55 smithi089 ceph-mon[27639]: Deploying daemon mds.cephfs.smithi131.rbovzc on smithi131 2024-09-13T02:51:55.620 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-13T02:51:55.631 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi089.front.sepia.ceph.com 2024-09-13T02:51:55.631 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-13T02:51:55.884 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T02:51:56.267 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:56 smithi089 ceph-mon[27639]: pgmap v179: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s wr, 6 op/s 2024-09-13T02:51:56.267 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:56 smithi089 ceph-mon[27639]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-09-13T02:51:56.267 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:56 smithi089 ceph-mon[27639]: Cluster is now healthy 2024-09-13T02:51:56.268 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:56 smithi089 ceph-mon[27639]: mds.? [v2:172.21.15.89:6828/1561365213,v1:172.21.15.89:6829/1561365213] up:boot 2024-09-13T02:51:56.268 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:56 smithi089 ceph-mon[27639]: from='client.? 172.21.15.89:0/2617230918' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]': finished 2024-09-13T02:51:56.268 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:56 smithi089 ceph-mon[27639]: fsmap cephfs:2 {0=cephfs.smithi089.qjoitb=up:active,1=cephfs.smithi131.uasrkg=up:active} 1 up:standby 2024-09-13T02:51:56.268 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:56 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi089.rarddb"}]: dispatch 2024-09-13T02:51:56.268 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:56 smithi089 ceph-mon[27639]: fsmap cephfs:2 {0=cephfs.smithi089.qjoitb=up:active,1=cephfs.smithi131.uasrkg=up:active} 1 up:standby-replay 2024-09-13T02:51:56.297 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:56 smithi131 ceph-mon[34689]: pgmap v179: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s wr, 6 op/s 2024-09-13T02:51:56.297 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:56 smithi131 ceph-mon[34689]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-09-13T02:51:56.298 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:56 smithi131 ceph-mon[34689]: Cluster is now healthy 2024-09-13T02:51:56.299 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:56 smithi131 ceph-mon[34689]: mds.? [v2:172.21.15.89:6828/1561365213,v1:172.21.15.89:6829/1561365213] up:boot 2024-09-13T02:51:56.300 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:56 smithi131 ceph-mon[34689]: from='client.? 172.21.15.89:0/2617230918' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]': finished 2024-09-13T02:51:56.300 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:56 smithi131 ceph-mon[34689]: fsmap cephfs:2 {0=cephfs.smithi089.qjoitb=up:active,1=cephfs.smithi131.uasrkg=up:active} 1 up:standby 2024-09-13T02:51:56.300 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:56 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi089.rarddb"}]: dispatch 2024-09-13T02:51:56.300 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:56 smithi131 ceph-mon[34689]: fsmap cephfs:2 {0=cephfs.smithi089.qjoitb=up:active,1=cephfs.smithi131.uasrkg=up:active} 1 up:standby-replay 2024-09-13T02:51:57.482 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:57.457+0000 7f8fb9c9c640 1 -- 172.21.15.89:0/3936971222 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8fb40fc720 msgr2=0x7f8fb40fcb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:57.482 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:57.457+0000 7f8fb9c9c640 1 --2- 172.21.15.89:0/3936971222 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8fb40fc720 0x7f8fb40fcb90 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f8fa80048d0 tx=0x7f8fa8009da0 comp rx=0 tx=0).stop 2024-09-13T02:51:57.482 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:57.457+0000 7f8fb9c9c640 1 -- 172.21.15.89:0/3936971222 shutdown_connections 2024-09-13T02:51:57.482 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:57.457+0000 7f8fb9c9c640 1 --2- 172.21.15.89:0/3936971222 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8fb40fc720 0x7f8fb40fcb90 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:57.482 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:57.457+0000 7f8fb9c9c640 1 --2- 172.21.15.89:0/3936971222 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8fb40fb450 0x7f8fb40fb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:57.482 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:57.457+0000 7f8fb9c9c640 1 -- 172.21.15.89:0/3936971222 >> 172.21.15.89:0/3936971222 conn(0x7f8fb40f6c10 msgr2=0x7f8fb40f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:51:57.482 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:57.457+0000 7f8fb9c9c640 1 -- 172.21.15.89:0/3936971222 shutdown_connections 2024-09-13T02:51:57.482 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:57.457+0000 7f8fb9c9c640 1 -- 172.21.15.89:0/3936971222 wait complete. 2024-09-13T02:51:57.482 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:57.458+0000 7f8fb9c9c640 1 Processor -- start 2024-09-13T02:51:57.482 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:57.458+0000 7f8fb9c9c640 1 -- start start 2024-09-13T02:51:57.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:57.458+0000 7f8fb9c9c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8fb40fb450 0x7f8fb410fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:57.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:57.458+0000 7f8fb9c9c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8fb40fc720 0x7f8fb4112300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:57.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:57.458+0000 7f8fb9c9c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb4066750 con 0x7f8fb40fb450 2024-09-13T02:51:57.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:57.458+0000 7f8fb9c9c640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb40668c0 con 0x7f8fb40fc720 2024-09-13T02:51:57.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:57.458+0000 7f8fb37fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8fb40fb450 0x7f8fb410fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:57.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:57.458+0000 7f8fb37fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8fb40fb450 0x7f8fb410fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:43344/0 (socket says 172.21.15.89:43344) 2024-09-13T02:51:57.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:57.458+0000 7f8fb37fe640 1 -- 172.21.15.89:0/725428265 learned_addr learned my addr 172.21.15.89:0/725428265 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:51:57.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:57.458+0000 7f8fb2ffd640 1 --2- 172.21.15.89:0/725428265 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8fb40fc720 0x7f8fb4112300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:57.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:57.458+0000 7f8fb37fe640 1 -- 172.21.15.89:0/725428265 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8fb40fc720 msgr2=0x7f8fb4112300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:57.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:57.458+0000 7f8fb37fe640 1 --2- 172.21.15.89:0/725428265 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8fb40fc720 0x7f8fb4112300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:57.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:57.458+0000 7f8fb37fe640 1 -- 172.21.15.89:0/725428265 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fa8005040 con 0x7f8fb40fb450 2024-09-13T02:51:57.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:57.458+0000 7f8fb37fe640 1 --2- 172.21.15.89:0/725428265 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8fb40fb450 0x7f8fb410fdb0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f8fa4002a50 tx=0x7f8fa4004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:51:57.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:57.459+0000 7f8f9bfff640 1 -- 172.21.15.89:0/725428265 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8fa4007c30 con 0x7f8fb40fb450 2024-09-13T02:51:57.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:57.459+0000 7f8f9bfff640 1 -- 172.21.15.89:0/725428265 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f8fa400f040 con 0x7f8fb40fb450 2024-09-13T02:51:57.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:57.459+0000 7f8fb9c9c640 1 -- 172.21.15.89:0/725428265 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fb41128a0 con 0x7f8fb40fb450 2024-09-13T02:51:57.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:57.459+0000 7f8f9bfff640 1 -- 172.21.15.89:0/725428265 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8fa400da10 con 0x7f8fb40fb450 2024-09-13T02:51:57.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:57.459+0000 7f8fb9c9c640 1 -- 172.21.15.89:0/725428265 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fb4112e10 con 0x7f8fb40fb450 2024-09-13T02:51:57.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:57.460+0000 7f8fb9c9c640 1 -- 172.21.15.89:0/725428265 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fb40fa8b0 con 0x7f8fb40fb450 2024-09-13T02:51:57.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:57.460+0000 7f8f9bfff640 1 -- 172.21.15.89:0/725428265 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f8fa400dbb0 con 0x7f8fb40fb450 2024-09-13T02:51:57.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:57.461+0000 7f8f9bfff640 1 --2- 172.21.15.89:0/725428265 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f8f9c06ed60 0x7f8f9c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:51:57.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:57.461+0000 7f8f9bfff640 1 -- 172.21.15.89:0/725428265 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5464+0+0 (secure 0 0 0) 0x7f8fa408d870 con 0x7f8fb40fb450 2024-09-13T02:51:57.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:57.461+0000 7f8fb2ffd640 1 --2- 172.21.15.89:0/725428265 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f8f9c06ed60 0x7f8f9c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:51:57.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:57.461+0000 7f8fb2ffd640 1 --2- 172.21.15.89:0/725428265 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f8f9c06ed60 0x7f8f9c071210 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8fa800b020 tx=0x7f8fa8035040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:51:57.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:57.465+0000 7f8f9bfff640 1 -- 172.21.15.89:0/725428265 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f8fa404d2a0 con 0x7f8fb40fb450 2024-09-13T02:51:57.529 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:57 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:51:57.530 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:57 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:51:57.530 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:57 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:51:57.530 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:57 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:51:57.530 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:57 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:51:57.530 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:57 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:51:57.530 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:57 smithi089 ceph-mon[27639]: mds.? [v2:172.21.15.131:6826/665579373,v1:172.21.15.131:6827/665579373] up:boot 2024-09-13T02:51:57.530 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:57 smithi089 ceph-mon[27639]: fsmap cephfs:2 {0=cephfs.smithi089.qjoitb=up:active,1=cephfs.smithi131.uasrkg=up:active} 1 up:standby-replay 1 up:standby 2024-09-13T02:51:57.530 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:57 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi131.rbovzc"}]: dispatch 2024-09-13T02:51:57.530 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:57 smithi089 ceph-mon[27639]: fsmap cephfs:2 {0=cephfs.smithi089.qjoitb=up:active,1=cephfs.smithi131.uasrkg=up:active} 2 up:standby-replay 2024-09-13T02:51:57.671 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:57.669+0000 7f8fb9c9c640 1 -- 172.21.15.89:0/725428265 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f8fb41131e0 con 0x7f8fb40fb450 2024-09-13T02:51:57.671 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:57.669+0000 7f8f9bfff640 1 -- 172.21.15.89:0/725428265 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 12 v12) v1 ==== 76+0+1777 (secure 0 0 0) 0x7f8fa405ab80 con 0x7f8fb40fb450 2024-09-13T02:51:57.671 INFO:teuthology.orchestra.run.smithi089.stdout:e12 2024-09-13T02:51:57.671 INFO:teuthology.orchestra.run.smithi089.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T02:51:57.671 INFO:teuthology.orchestra.run.smithi089.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:51:57.671 INFO:teuthology.orchestra.run.smithi089.stdout:legacy client fscid: 1 2024-09-13T02:51:57.671 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:51:57.671 INFO:teuthology.orchestra.run.smithi089.stdout:Filesystem 'cephfs' (1) 2024-09-13T02:51:57.672 INFO:teuthology.orchestra.run.smithi089.stdout:fs_name cephfs 2024-09-13T02:51:57.672 INFO:teuthology.orchestra.run.smithi089.stdout:epoch 12 2024-09-13T02:51:57.672 INFO:teuthology.orchestra.run.smithi089.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T02:51:57.672 INFO:teuthology.orchestra.run.smithi089.stdout:created 2024-09-13T02:51:40.657817+0000 2024-09-13T02:51:57.672 INFO:teuthology.orchestra.run.smithi089.stdout:modified 2024-09-13T02:51:57.027344+0000 2024-09-13T02:51:57.672 INFO:teuthology.orchestra.run.smithi089.stdout:tableserver 0 2024-09-13T02:51:57.672 INFO:teuthology.orchestra.run.smithi089.stdout:root 0 2024-09-13T02:51:57.672 INFO:teuthology.orchestra.run.smithi089.stdout:session_timeout 60 2024-09-13T02:51:57.672 INFO:teuthology.orchestra.run.smithi089.stdout:session_autoclose 300 2024-09-13T02:51:57.672 INFO:teuthology.orchestra.run.smithi089.stdout:max_file_size 1099511627776 2024-09-13T02:51:57.672 INFO:teuthology.orchestra.run.smithi089.stdout:required_client_features {} 2024-09-13T02:51:57.672 INFO:teuthology.orchestra.run.smithi089.stdout:last_failure 0 2024-09-13T02:51:57.672 INFO:teuthology.orchestra.run.smithi089.stdout:last_failure_osd_epoch 0 2024-09-13T02:51:57.673 INFO:teuthology.orchestra.run.smithi089.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:51:57.673 INFO:teuthology.orchestra.run.smithi089.stdout:max_mds 2 2024-09-13T02:51:57.673 INFO:teuthology.orchestra.run.smithi089.stdout:in 0,1 2024-09-13T02:51:57.673 INFO:teuthology.orchestra.run.smithi089.stdout:up {0=14466,1=24257} 2024-09-13T02:51:57.673 INFO:teuthology.orchestra.run.smithi089.stdout:failed 2024-09-13T02:51:57.673 INFO:teuthology.orchestra.run.smithi089.stdout:damaged 2024-09-13T02:51:57.673 INFO:teuthology.orchestra.run.smithi089.stdout:stopped 2024-09-13T02:51:57.673 INFO:teuthology.orchestra.run.smithi089.stdout:data_pools [3] 2024-09-13T02:51:57.673 INFO:teuthology.orchestra.run.smithi089.stdout:metadata_pool 2 2024-09-13T02:51:57.673 INFO:teuthology.orchestra.run.smithi089.stdout:inline_data disabled 2024-09-13T02:51:57.673 INFO:teuthology.orchestra.run.smithi089.stdout:balancer 2024-09-13T02:51:57.673 INFO:teuthology.orchestra.run.smithi089.stdout:standby_count_wanted 1 2024-09-13T02:51:57.673 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi089.qjoitb{0:14466} state up:active seq 2 addr [v2:172.21.15.89:6826/3243844531,v1:172.21.15.89:6827/3243844531] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:51:57.673 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi089.rarddb{0:14480} state up:standby-replay seq 1 addr [v2:172.21.15.89:6828/1561365213,v1:172.21.15.89:6829/1561365213] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:51:57.674 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi131.uasrkg{1:24257} state up:active seq 2 addr [v2:172.21.15.131:6824/260493836,v1:172.21.15.131:6825/260493836] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:51:57.674 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi131.rbovzc{1:24265} state up:standby-replay seq 1 addr [v2:172.21.15.131:6826/665579373,v1:172.21.15.131:6827/665579373] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:51:57.674 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:51:57.674 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:51:57.674 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 12 2024-09-13T02:51:57.674 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:57.671+0000 7f8fb9c9c640 1 -- 172.21.15.89:0/725428265 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f8f9c06ed60 msgr2=0x7f8f9c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:57.675 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:57.671+0000 7f8fb9c9c640 1 --2- 172.21.15.89:0/725428265 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f8f9c06ed60 0x7f8f9c071210 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f8fa800b020 tx=0x7f8fa8035040 comp rx=0 tx=0).stop 2024-09-13T02:51:57.675 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:57.671+0000 7f8fb9c9c640 1 -- 172.21.15.89:0/725428265 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8fb40fb450 msgr2=0x7f8fb410fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:51:57.675 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:57.671+0000 7f8fb9c9c640 1 --2- 172.21.15.89:0/725428265 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8fb40fb450 0x7f8fb410fdb0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f8fa4002a50 tx=0x7f8fa4004600 comp rx=0 tx=0).stop 2024-09-13T02:51:57.675 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:57.671+0000 7f8fb9c9c640 1 -- 172.21.15.89:0/725428265 shutdown_connections 2024-09-13T02:51:57.675 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:57.671+0000 7f8fb9c9c640 1 --2- 172.21.15.89:0/725428265 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f8f9c06ed60 0x7f8f9c071210 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:57.675 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:57.671+0000 7f8fb9c9c640 1 --2- 172.21.15.89:0/725428265 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8fb40fc720 0x7f8fb4112300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:57.675 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:57.671+0000 7f8fb9c9c640 1 --2- 172.21.15.89:0/725428265 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8fb40fb450 0x7f8fb410fdb0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:51:57.676 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:57.671+0000 7f8fb9c9c640 1 -- 172.21.15.89:0/725428265 >> 172.21.15.89:0/725428265 conn(0x7f8fb40f6c10 msgr2=0x7f8fb40f83b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:51:57.676 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:57.671+0000 7f8fb9c9c640 1 -- 172.21.15.89:0/725428265 shutdown_connections 2024-09-13T02:51:57.676 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:51:57.671+0000 7f8fb9c9c640 1 -- 172.21.15.89:0/725428265 wait complete. 2024-09-13T02:51:57.801 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:57 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:51:57.801 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:57 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:51:57.801 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:57 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:51:57.801 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:57 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:51:57.802 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:57 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:51:57.802 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:57 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:51:57.802 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:57 smithi131 ceph-mon[34689]: mds.? [v2:172.21.15.131:6826/665579373,v1:172.21.15.131:6827/665579373] up:boot 2024-09-13T02:51:57.802 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:57 smithi131 ceph-mon[34689]: fsmap cephfs:2 {0=cephfs.smithi089.qjoitb=up:active,1=cephfs.smithi131.uasrkg=up:active} 1 up:standby-replay 1 up:standby 2024-09-13T02:51:57.802 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:57 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi131.rbovzc"}]: dispatch 2024-09-13T02:51:57.802 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:57 smithi131 ceph-mon[34689]: fsmap cephfs:2 {0=cephfs.smithi089.qjoitb=up:active,1=cephfs.smithi131.uasrkg=up:active} 2 up:standby-replay 2024-09-13T02:51:58.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:58 smithi089 ceph-mon[27639]: pgmap v180: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s rd, 2.0 KiB/s wr, 7 op/s 2024-09-13T02:51:58.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:58 smithi089 ceph-mon[27639]: from='client.? 172.21.15.89:0/725428265' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T02:51:58.815 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -- bash -c 'ceph --format=json fs dump | jq -e ".filesystems | length == 1"' 2024-09-13T02:51:58.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:58 smithi131 ceph-mon[34689]: pgmap v180: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s rd, 2.0 KiB/s wr, 7 op/s 2024-09-13T02:51:58.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:58 smithi131 ceph-mon[34689]: from='client.? 172.21.15.89:0/725428265' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T02:51:59.567 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T02:51:59.808 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:59 smithi089 ceph-mon[27639]: mds.? [v2:172.21.15.131:6824/260493836,v1:172.21.15.131:6825/260493836] up:active 2024-09-13T02:51:59.809 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:59 smithi089 ceph-mon[27639]: mds.? [v2:172.21.15.89:6828/1561365213,v1:172.21.15.89:6829/1561365213] up:standby-replay 2024-09-13T02:51:59.809 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:59 smithi089 ceph-mon[27639]: Dropping low affinity active daemon mds.cephfs.smithi089.qjoitb in favor of higher affinity standby. 2024-09-13T02:51:59.809 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:59 smithi089 ceph-mon[27639]: Replacing daemon mds.cephfs.smithi089.qjoitb as rank 0 with standby daemon mds.cephfs.smithi089.rarddb 2024-09-13T02:51:59.809 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:59 smithi089 ceph-mon[27639]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-13T02:51:59.809 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:59 smithi089 ceph-mon[27639]: fsmap cephfs:2 {0=cephfs.smithi089.qjoitb=up:active,1=cephfs.smithi131.uasrkg=up:active} 2 up:standby-replay 2024-09-13T02:51:59.809 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:59 smithi089 ceph-mon[27639]: osdmap e44: 6 total, 6 up, 6 in 2024-09-13T02:51:59.809 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:59 smithi089 ceph-mon[27639]: fsmap cephfs:2/2 {0=cephfs.smithi089.rarddb=up:replay,1=cephfs.smithi131.uasrkg=up:active} 1 up:standby-replay 2024-09-13T02:51:59.809 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:59 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:51:59.809 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:59 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:51:59.809 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:59 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:51:59.809 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:59 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:51:59.809 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:51:59 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:51:59.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:59 smithi131 ceph-mon[34689]: mds.? [v2:172.21.15.131:6824/260493836,v1:172.21.15.131:6825/260493836] up:active 2024-09-13T02:51:59.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:59 smithi131 ceph-mon[34689]: mds.? [v2:172.21.15.89:6828/1561365213,v1:172.21.15.89:6829/1561365213] up:standby-replay 2024-09-13T02:51:59.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:59 smithi131 ceph-mon[34689]: Dropping low affinity active daemon mds.cephfs.smithi089.qjoitb in favor of higher affinity standby. 2024-09-13T02:51:59.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:59 smithi131 ceph-mon[34689]: Replacing daemon mds.cephfs.smithi089.qjoitb as rank 0 with standby daemon mds.cephfs.smithi089.rarddb 2024-09-13T02:51:59.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:59 smithi131 ceph-mon[34689]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-13T02:51:59.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:59 smithi131 ceph-mon[34689]: fsmap cephfs:2 {0=cephfs.smithi089.qjoitb=up:active,1=cephfs.smithi131.uasrkg=up:active} 2 up:standby-replay 2024-09-13T02:51:59.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:59 smithi131 ceph-mon[34689]: osdmap e44: 6 total, 6 up, 6 in 2024-09-13T02:51:59.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:59 smithi131 ceph-mon[34689]: fsmap cephfs:2/2 {0=cephfs.smithi089.rarddb=up:replay,1=cephfs.smithi131.uasrkg=up:active} 1 up:standby-replay 2024-09-13T02:51:59.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:59 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:51:59.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:59 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:51:59.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:59 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:51:59.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:59 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:51:59.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:51:59 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:52:00.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:52:00 smithi089 ceph-mon[27639]: pgmap v182: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 2.0 KiB/s wr, 9 op/s 2024-09-13T02:52:00.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:52:00 smithi089 ceph-mon[27639]: mds.? [v2:172.21.15.89:6826/1464393547,v1:172.21.15.89:6827/1464393547] up:boot 2024-09-13T02:52:00.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:52:00 smithi089 ceph-mon[27639]: mds.? [v2:172.21.15.89:6828/1561365213,v1:172.21.15.89:6829/1561365213] up:resolve 2024-09-13T02:52:00.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:52:00 smithi089 ceph-mon[27639]: fsmap cephfs:2/2 {0=cephfs.smithi089.rarddb=up:resolve,1=cephfs.smithi131.uasrkg=up:active} 1 up:standby-replay 1 up:standby 2024-09-13T02:52:00.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:52:00 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi089.qjoitb"}]: dispatch 2024-09-13T02:52:00.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:52:00 smithi131 ceph-mon[34689]: pgmap v182: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 2.0 KiB/s wr, 9 op/s 2024-09-13T02:52:00.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:52:00 smithi131 ceph-mon[34689]: mds.? [v2:172.21.15.89:6826/1464393547,v1:172.21.15.89:6827/1464393547] up:boot 2024-09-13T02:52:00.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:52:00 smithi131 ceph-mon[34689]: mds.? [v2:172.21.15.89:6828/1561365213,v1:172.21.15.89:6829/1561365213] up:resolve 2024-09-13T02:52:00.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:52:00 smithi131 ceph-mon[34689]: fsmap cephfs:2/2 {0=cephfs.smithi089.rarddb=up:resolve,1=cephfs.smithi131.uasrkg=up:active} 1 up:standby-replay 1 up:standby 2024-09-13T02:52:00.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:52:00 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi089.qjoitb"}]: dispatch 2024-09-13T02:52:01.582 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:52:01 smithi089 ceph-mon[27639]: mds.? [v2:172.21.15.89:6828/1561365213,v1:172.21.15.89:6829/1561365213] up:reconnect 2024-09-13T02:52:01.582 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:52:01 smithi089 ceph-mon[27639]: mds.? [v2:172.21.15.131:6826/665579373,v1:172.21.15.131:6827/665579373] up:standby-replay 2024-09-13T02:52:01.583 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:52:01 smithi089 ceph-mon[27639]: fsmap cephfs:2/2 {0=cephfs.smithi089.rarddb=up:reconnect,1=cephfs.smithi131.uasrkg=up:active} 1 up:standby-replay 1 up:standby 2024-09-13T02:52:01.790 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:01.765+0000 7feb5d4bf640 1 -- 172.21.15.89:0/2106115559 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feb580666b0 msgr2=0x7feb580ff1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:01.790 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:01.765+0000 7feb5d4bf640 1 --2- 172.21.15.89:0/2106115559 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feb580666b0 0x7feb580ff1e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7feb480048d0 tx=0x7feb48009da0 comp rx=0 tx=0).stop 2024-09-13T02:52:01.790 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:01.765+0000 7feb5d4bf640 1 -- 172.21.15.89:0/2106115559 shutdown_connections 2024-09-13T02:52:01.790 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:01.765+0000 7feb5d4bf640 1 --2- 172.21.15.89:0/2106115559 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb580ff720 0x7feb58101b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:01.790 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:01.765+0000 7feb5d4bf640 1 --2- 172.21.15.89:0/2106115559 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feb580666b0 0x7feb580ff1e0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:01.791 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:01.765+0000 7feb5d4bf640 1 -- 172.21.15.89:0/2106115559 >> 172.21.15.89:0/2106115559 conn(0x7feb580f6c10 msgr2=0x7feb580f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:52:01.791 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:01.765+0000 7feb5d4bf640 1 -- 172.21.15.89:0/2106115559 shutdown_connections 2024-09-13T02:52:01.791 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:01.765+0000 7feb5d4bf640 1 -- 172.21.15.89:0/2106115559 wait complete. 2024-09-13T02:52:01.791 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:01.766+0000 7feb5d4bf640 1 Processor -- start 2024-09-13T02:52:01.791 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:01.766+0000 7feb5d4bf640 1 -- start start 2024-09-13T02:52:01.791 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:01.766+0000 7feb5d4bf640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb580666b0 0x7feb5810d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:01.791 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:01.766+0000 7feb5d4bf640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feb580ff720 0x7feb5810d690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:01.791 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:01.766+0000 7feb5d4bf640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb5810dce0 con 0x7feb580ff720 2024-09-13T02:52:01.791 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:01.766+0000 7feb5d4bf640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb5810e4b0 con 0x7feb580666b0 2024-09-13T02:52:01.791 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:01.766+0000 7feb4ffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feb580ff720 0x7feb5810d690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:01.791 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:01.766+0000 7feb4ffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feb580ff720 0x7feb5810d690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:58524/0 (socket says 172.21.15.89:58524) 2024-09-13T02:52:01.791 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:01.766+0000 7feb4ffff640 1 -- 172.21.15.89:0/2060925037 learned_addr learned my addr 172.21.15.89:0/2060925037 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:52:01.792 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:01.766+0000 7feb56ffd640 1 --2- 172.21.15.89:0/2060925037 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb580666b0 0x7feb5810d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:01.792 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:01.766+0000 7feb4ffff640 1 -- 172.21.15.89:0/2060925037 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb580666b0 msgr2=0x7feb5810d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:01.792 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:01.766+0000 7feb4ffff640 1 --2- 172.21.15.89:0/2060925037 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb580666b0 0x7feb5810d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:01.792 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:01.766+0000 7feb4ffff640 1 -- 172.21.15.89:0/2060925037 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb48005040 con 0x7feb580ff720 2024-09-13T02:52:01.792 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:01.766+0000 7feb56ffd640 1 --2- 172.21.15.89:0/2060925037 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb580666b0 0x7feb5810d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T02:52:01.792 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:01.767+0000 7feb4ffff640 1 --2- 172.21.15.89:0/2060925037 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feb580ff720 0x7feb5810d690 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7feb40002870 tx=0x7feb40004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:52:01.792 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:01.767+0000 7feb4f7fe640 1 -- 172.21.15.89:0/2060925037 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feb40007c30 con 0x7feb580ff720 2024-09-13T02:52:01.792 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:01.767+0000 7feb4f7fe640 1 -- 172.21.15.89:0/2060925037 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7feb4000f040 con 0x7feb580ff720 2024-09-13T02:52:01.792 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:01.767+0000 7feb5d4bf640 1 -- 172.21.15.89:0/2060925037 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb5810e740 con 0x7feb580ff720 2024-09-13T02:52:01.792 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:01.767+0000 7feb4f7fe640 1 -- 172.21.15.89:0/2060925037 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feb400095b0 con 0x7feb580ff720 2024-09-13T02:52:01.792 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:01.767+0000 7feb5d4bf640 1 -- 172.21.15.89:0/2060925037 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb5810ece0 con 0x7feb580ff720 2024-09-13T02:52:01.792 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:01.768+0000 7feb5d4bf640 1 -- 172.21.15.89:0/2060925037 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb580fa8b0 con 0x7feb580ff720 2024-09-13T02:52:01.792 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:01.768+0000 7feb4f7fe640 1 -- 172.21.15.89:0/2060925037 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7feb40009710 con 0x7feb580ff720 2024-09-13T02:52:01.793 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:01.769+0000 7feb4f7fe640 1 --2- 172.21.15.89:0/2060925037 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7feb4406ed60 0x7feb44071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:01.793 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:01.769+0000 7feb56ffd640 1 --2- 172.21.15.89:0/2060925037 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7feb4406ed60 0x7feb44071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:01.793 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:01.769+0000 7feb4f7fe640 1 -- 172.21.15.89:0/2060925037 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7feb4008d900 con 0x7feb580ff720 2024-09-13T02:52:01.793 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:01.769+0000 7feb56ffd640 1 --2- 172.21.15.89:0/2060925037 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7feb4406ed60 0x7feb44071210 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7feb4800b020 tx=0x7feb48009da0 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:52:01.793 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:01.773+0000 7feb4f7fe640 1 -- 172.21.15.89:0/2060925037 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7feb4004d2a0 con 0x7feb580ff720 2024-09-13T02:52:01.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:52:01 smithi131 ceph-mon[34689]: mds.? [v2:172.21.15.89:6828/1561365213,v1:172.21.15.89:6829/1561365213] up:reconnect 2024-09-13T02:52:01.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:52:01 smithi131 ceph-mon[34689]: mds.? [v2:172.21.15.131:6826/665579373,v1:172.21.15.131:6827/665579373] up:standby-replay 2024-09-13T02:52:01.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:52:01 smithi131 ceph-mon[34689]: fsmap cephfs:2/2 {0=cephfs.smithi089.rarddb=up:reconnect,1=cephfs.smithi131.uasrkg=up:active} 1 up:standby-replay 1 up:standby 2024-09-13T02:52:01.964 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:01.963+0000 7feb5d4bf640 1 -- 172.21.15.89:0/2060925037 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feb5804b720 con 0x7feb580ff720 2024-09-13T02:52:01.965 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:01.964+0000 7feb4f7fe640 1 -- 172.21.15.89:0/2060925037 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4711 (secure 0 0 0) 0x7feb4005aa50 con 0x7feb580ff720 2024-09-13T02:52:01.965 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 17 2024-09-13T02:52:01.967 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:01.966+0000 7feb5d4bf640 1 -- 172.21.15.89:0/2060925037 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7feb4406ed60 msgr2=0x7feb44071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:01.967 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:01.966+0000 7feb5d4bf640 1 --2- 172.21.15.89:0/2060925037 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7feb4406ed60 0x7feb44071210 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7feb4800b020 tx=0x7feb48009da0 comp rx=0 tx=0).stop 2024-09-13T02:52:01.967 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:01.966+0000 7feb5d4bf640 1 -- 172.21.15.89:0/2060925037 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feb580ff720 msgr2=0x7feb5810d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:01.967 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:01.966+0000 7feb5d4bf640 1 --2- 172.21.15.89:0/2060925037 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feb580ff720 0x7feb5810d690 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7feb40002870 tx=0x7feb40004600 comp rx=0 tx=0).stop 2024-09-13T02:52:01.968 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:01.966+0000 7feb5d4bf640 1 -- 172.21.15.89:0/2060925037 shutdown_connections 2024-09-13T02:52:01.968 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:01.966+0000 7feb5d4bf640 1 --2- 172.21.15.89:0/2060925037 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7feb580ff720 0x7feb5810d690 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:01.968 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:01.966+0000 7feb5d4bf640 1 --2- 172.21.15.89:0/2060925037 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7feb4406ed60 0x7feb44071210 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:01.968 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:01.966+0000 7feb5d4bf640 1 --2- 172.21.15.89:0/2060925037 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7feb580666b0 0x7feb5810d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:01.968 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:01.966+0000 7feb5d4bf640 1 -- 172.21.15.89:0/2060925037 >> 172.21.15.89:0/2060925037 conn(0x7feb580f6c10 msgr2=0x7feb580f7030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:52:01.968 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:01.966+0000 7feb5d4bf640 1 -- 172.21.15.89:0/2060925037 shutdown_connections 2024-09-13T02:52:01.968 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:01.966+0000 7feb5d4bf640 1 -- 172.21.15.89:0/2060925037 wait complete. 2024-09-13T02:52:01.976 INFO:teuthology.orchestra.run.smithi089.stdout:true 2024-09-13T02:52:02.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:52:02 smithi131 ceph-mon[34689]: pgmap v183: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 1.3 KiB/s wr, 8 op/s 2024-09-13T02:52:02.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:52:02 smithi131 ceph-mon[34689]: mds.? [v2:172.21.15.89:6828/1561365213,v1:172.21.15.89:6829/1561365213] up:rejoin 2024-09-13T02:52:02.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:52:02 smithi131 ceph-mon[34689]: fsmap cephfs:2/2 {0=cephfs.smithi089.rarddb=up:rejoin,1=cephfs.smithi131.uasrkg=up:active} 1 up:standby-replay 1 up:standby 2024-09-13T02:52:02.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:52:02 smithi131 ceph-mon[34689]: daemon mds.cephfs.smithi089.rarddb is now active in filesystem cephfs as rank 0 2024-09-13T02:52:02.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:52:02 smithi131 ceph-mon[34689]: from='client.? 172.21.15.89:0/2060925037' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T02:52:02.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:52:02 smithi089 ceph-mon[27639]: pgmap v183: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 1.3 KiB/s wr, 8 op/s 2024-09-13T02:52:02.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:52:02 smithi089 ceph-mon[27639]: mds.? [v2:172.21.15.89:6828/1561365213,v1:172.21.15.89:6829/1561365213] up:rejoin 2024-09-13T02:52:02.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:52:02 smithi089 ceph-mon[27639]: fsmap cephfs:2/2 {0=cephfs.smithi089.rarddb=up:rejoin,1=cephfs.smithi131.uasrkg=up:active} 1 up:standby-replay 1 up:standby 2024-09-13T02:52:02.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:52:02 smithi089 ceph-mon[27639]: daemon mds.cephfs.smithi089.rarddb is now active in filesystem cephfs as rank 0 2024-09-13T02:52:02.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:52:02 smithi089 ceph-mon[27639]: from='client.? 172.21.15.89:0/2060925037' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T02:52:03.021 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -- bash -c 'while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done' 2024-09-13T02:52:03.744 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T02:52:03.865 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:52:03 smithi089 ceph-mon[27639]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-13T02:52:03.865 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:52:03 smithi089 ceph-mon[27639]: Cluster is now healthy 2024-09-13T02:52:03.865 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:52:03 smithi089 ceph-mon[27639]: mds.? [v2:172.21.15.89:6828/1561365213,v1:172.21.15.89:6829/1561365213] up:active 2024-09-13T02:52:03.866 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:52:03 smithi089 ceph-mon[27639]: fsmap cephfs:2 {0=cephfs.smithi089.rarddb=up:active,1=cephfs.smithi131.uasrkg=up:active} 1 up:standby-replay 1 up:standby 2024-09-13T02:52:03.866 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:52:03 smithi089 ceph-mon[27639]: fsmap cephfs:2 {0=cephfs.smithi089.rarddb=up:active,1=cephfs.smithi131.uasrkg=up:active} 2 up:standby-replay 2024-09-13T02:52:03.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:52:03 smithi131 ceph-mon[34689]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-13T02:52:03.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:52:03 smithi131 ceph-mon[34689]: Cluster is now healthy 2024-09-13T02:52:03.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:52:03 smithi131 ceph-mon[34689]: mds.? [v2:172.21.15.89:6828/1561365213,v1:172.21.15.89:6829/1561365213] up:active 2024-09-13T02:52:03.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:52:03 smithi131 ceph-mon[34689]: fsmap cephfs:2 {0=cephfs.smithi089.rarddb=up:active,1=cephfs.smithi131.uasrkg=up:active} 1 up:standby-replay 1 up:standby 2024-09-13T02:52:03.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:52:03 smithi131 ceph-mon[34689]: fsmap cephfs:2 {0=cephfs.smithi089.rarddb=up:active,1=cephfs.smithi131.uasrkg=up:active} 2 up:standby-replay 2024-09-13T02:52:04.849 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:52:04 smithi089 ceph-mon[27639]: pgmap v184: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.3 KiB/s rd, 716 B/s wr, 5 op/s 2024-09-13T02:52:04.849 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:52:04 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:52:04.849 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:52:04 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:52:04.849 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:52:04 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:52:04.849 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:52:04 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:52:04.849 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:52:04 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:52:04.849 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:52:04 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:52:04.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:52:04 smithi131 ceph-mon[34689]: pgmap v184: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.3 KiB/s rd, 716 B/s wr, 5 op/s 2024-09-13T02:52:04.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:52:04 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:52:04.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:52:04 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:52:04.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:52:04 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:52:04.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:52:04 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:52:04.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:52:04 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:52:04.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:52:04 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:52:05.361 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:05.352+0000 7f18d3f89640 1 -- 172.21.15.89:0/1881423949 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f18cc065b80 msgr2=0x7f18cc0ff200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:05.361 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:05.352+0000 7f18d3f89640 1 --2- 172.21.15.89:0/1881423949 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f18cc065b80 0x7f18cc0ff200 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f18c80048d0 tx=0x7f18c8009da0 comp rx=0 tx=0).stop 2024-09-13T02:52:05.361 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:05.353+0000 7f18d3f89640 1 -- 172.21.15.89:0/1881423949 shutdown_connections 2024-09-13T02:52:05.361 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:05.353+0000 7f18d3f89640 1 --2- 172.21.15.89:0/1881423949 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f18cc0ff740 0x7f18cc101b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:05.361 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:05.353+0000 7f18d3f89640 1 --2- 172.21.15.89:0/1881423949 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f18cc065b80 0x7f18cc0ff200 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:05.361 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:05.353+0000 7f18d3f89640 1 -- 172.21.15.89:0/1881423949 >> 172.21.15.89:0/1881423949 conn(0x7f18cc0f6c10 msgr2=0x7f18cc0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:52:05.361 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:05.353+0000 7f18d3f89640 1 -- 172.21.15.89:0/1881423949 shutdown_connections 2024-09-13T02:52:05.361 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:05.353+0000 7f18d3f89640 1 -- 172.21.15.89:0/1881423949 wait complete. 2024-09-13T02:52:05.361 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:05.353+0000 7f18d3f89640 1 Processor -- start 2024-09-13T02:52:05.362 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:05.353+0000 7f18d3f89640 1 -- start start 2024-09-13T02:52:05.362 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:05.353+0000 7f18d3f89640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f18cc065b80 0x7f18cc10d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:05.362 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:05.353+0000 7f18d3f89640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f18cc0ff740 0x7f18cc10d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:05.362 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:05.353+0000 7f18d3f89640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18cc10dc40 con 0x7f18cc0ff740 2024-09-13T02:52:05.362 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:05.353+0000 7f18d3f89640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18cc10e410 con 0x7f18cc065b80 2024-09-13T02:52:05.362 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:05.353+0000 7f18d1524640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f18cc0ff740 0x7f18cc10d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:05.362 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:05.353+0000 7f18d1524640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f18cc0ff740 0x7f18cc10d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:58538/0 (socket says 172.21.15.89:58538) 2024-09-13T02:52:05.362 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:05.353+0000 7f18d1524640 1 -- 172.21.15.89:0/3465058378 learned_addr learned my addr 172.21.15.89:0/3465058378 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:52:05.362 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:05.354+0000 7f18d1d25640 1 --2- 172.21.15.89:0/3465058378 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f18cc065b80 0x7f18cc10d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:05.362 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:05.354+0000 7f18d1524640 1 -- 172.21.15.89:0/3465058378 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f18cc065b80 msgr2=0x7f18cc10d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:05.362 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:05.354+0000 7f18d1524640 1 --2- 172.21.15.89:0/3465058378 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f18cc065b80 0x7f18cc10d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:05.362 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:05.354+0000 7f18d1524640 1 -- 172.21.15.89:0/3465058378 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18c8005040 con 0x7f18cc0ff740 2024-09-13T02:52:05.363 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:05.354+0000 7f18d1d25640 1 --2- 172.21.15.89:0/3465058378 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f18cc065b80 0x7f18cc10d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T02:52:05.363 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:05.354+0000 7f18d1524640 1 --2- 172.21.15.89:0/3465058378 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f18cc0ff740 0x7f18cc10d5f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f18bc00c790 tx=0x7f18bc0043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:52:05.363 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:05.354+0000 7f18c27fc640 1 -- 172.21.15.89:0/3465058378 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f18bc00a820 con 0x7f18cc0ff740 2024-09-13T02:52:05.363 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:05.354+0000 7f18c27fc640 1 -- 172.21.15.89:0/3465058378 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f18bc00ae20 con 0x7f18cc0ff740 2024-09-13T02:52:05.363 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:05.354+0000 7f18d3f89640 1 -- 172.21.15.89:0/3465058378 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18cc10e6a0 con 0x7f18cc0ff740 2024-09-13T02:52:05.363 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:05.354+0000 7f18c27fc640 1 -- 172.21.15.89:0/3465058378 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f18bc0113a0 con 0x7f18cc0ff740 2024-09-13T02:52:05.363 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:05.354+0000 7f18d3f89640 1 -- 172.21.15.89:0/3465058378 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18cc10ec40 con 0x7f18cc0ff740 2024-09-13T02:52:05.363 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:05.355+0000 7f18d3f89640 1 -- 172.21.15.89:0/3465058378 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18cc0fa890 con 0x7f18cc0ff740 2024-09-13T02:52:05.363 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:05.356+0000 7f18c27fc640 1 -- 172.21.15.89:0/3465058378 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f18bc012400 con 0x7f18cc0ff740 2024-09-13T02:52:05.363 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:05.356+0000 7f18c27fc640 1 --2- 172.21.15.89:0/3465058378 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f18b806ed60 0x7f18b8071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:05.363 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:05.356+0000 7f18c27fc640 1 -- 172.21.15.89:0/3465058378 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f18bc08e280 con 0x7f18cc0ff740 2024-09-13T02:52:05.363 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:05.356+0000 7f18d1d25640 1 --2- 172.21.15.89:0/3465058378 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f18b806ed60 0x7f18b8071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:05.364 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:05.357+0000 7f18d1d25640 1 --2- 172.21.15.89:0/3465058378 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f18b806ed60 0x7f18b8071210 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f18c800b020 tx=0x7f18c8009da0 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:52:05.364 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:05.360+0000 7f18c27fc640 1 -- 172.21.15.89:0/3465058378 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f18bc05b470 con 0x7f18cc0ff740 2024-09-13T02:52:05.589 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:05.587+0000 7f18d3f89640 1 -- 172.21.15.89:0/3465058378 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "mds versions", "format": "json"} v 0) v1 -- 0x7f18cc04b720 con 0x7f18cc0ff740 2024-09-13T02:52:05.589 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:05.588+0000 7f18c27fc640 1 -- 172.21.15.89:0/3465058378 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "mds versions", "format": "json"}]=0 v19) v1 ==== 78+0+100 (secure 0 0 0) 0x7f18bc05ae10 con 0x7f18cc0ff740 2024-09-13T02:52:05.591 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:05.590+0000 7f18d3f89640 1 -- 172.21.15.89:0/3465058378 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f18b806ed60 msgr2=0x7f18b8071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:05.591 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:05.590+0000 7f18d3f89640 1 --2- 172.21.15.89:0/3465058378 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f18b806ed60 0x7f18b8071210 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f18c800b020 tx=0x7f18c8009da0 comp rx=0 tx=0).stop 2024-09-13T02:52:05.591 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:05.590+0000 7f18d3f89640 1 -- 172.21.15.89:0/3465058378 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f18cc0ff740 msgr2=0x7f18cc10d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:05.591 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:05.590+0000 7f18d3f89640 1 --2- 172.21.15.89:0/3465058378 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f18cc0ff740 0x7f18cc10d5f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f18bc00c790 tx=0x7f18bc0043c0 comp rx=0 tx=0).stop 2024-09-13T02:52:05.591 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:05.590+0000 7f18d3f89640 1 -- 172.21.15.89:0/3465058378 shutdown_connections 2024-09-13T02:52:05.591 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:05.590+0000 7f18d3f89640 1 --2- 172.21.15.89:0/3465058378 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f18cc0ff740 0x7f18cc10d5f0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:05.591 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:05.590+0000 7f18d3f89640 1 --2- 172.21.15.89:0/3465058378 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f18b806ed60 0x7f18b8071210 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:05.591 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:05.590+0000 7f18d3f89640 1 --2- 172.21.15.89:0/3465058378 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f18cc065b80 0x7f18cc10d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:05.592 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:05.590+0000 7f18d3f89640 1 -- 172.21.15.89:0/3465058378 >> 172.21.15.89:0/3465058378 conn(0x7f18cc0f6c10 msgr2=0x7f18cc0f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:52:05.592 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:05.590+0000 7f18d3f89640 1 -- 172.21.15.89:0/3465058378 shutdown_connections 2024-09-13T02:52:05.592 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:05.590+0000 7f18d3f89640 1 -- 172.21.15.89:0/3465058378 wait complete. 2024-09-13T02:52:05.600 INFO:teuthology.orchestra.run.smithi089.stdout:true 2024-09-13T02:52:05.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:52:05 smithi089 ceph-mon[27639]: from='client.? 172.21.15.89:0/3465058378' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-09-13T02:52:05.933 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:52:05 smithi131 ceph-mon[34689]: from='client.? 172.21.15.89:0/3465058378' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-09-13T02:52:06.618 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:52:06 smithi089 ceph-mon[27639]: pgmap v185: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-13T02:52:06.619 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:52:06 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:52:06.619 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:52:06 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:52:06.643 INFO:teuthology.run_tasks:Running task fs.pre_upgrade_save... 2024-09-13T02:52:06.656 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-13T02:52:06.936 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:52:06 smithi131 ceph-mon[34689]: pgmap v185: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.9 KiB/s rd, 0 B/s wr, 6 op/s 2024-09-13T02:52:06.936 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:52:06 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:52:06.936 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:52:06 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:52:07.303 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T02:52:08.933 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:52:08 smithi131 ceph-mon[34689]: pgmap v186: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 7.3 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-13T02:52:09.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:52:08 smithi089 ceph-mon[27639]: pgmap v186: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 7.3 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-13T02:52:09.521 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:09.489+0000 7f1e11315640 1 -- 172.21.15.89:0/2103236867 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1e0c101560 msgr2=0x7f1e0c101930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:09.521 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:09.489+0000 7f1e11315640 1 --2- 172.21.15.89:0/2103236867 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1e0c101560 0x7f1e0c101930 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc0048d0 tx=0x7f1dfc009da0 comp rx=0 tx=0).stop 2024-09-13T02:52:09.521 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:09.489+0000 7f1e11315640 1 -- 172.21.15.89:0/2103236867 shutdown_connections 2024-09-13T02:52:09.521 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:09.489+0000 7f1e11315640 1 --2- 172.21.15.89:0/2103236867 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1e0c0fbe00 0x7f1e0c0fc270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:09.521 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:09.489+0000 7f1e11315640 1 --2- 172.21.15.89:0/2103236867 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1e0c101560 0x7f1e0c101930 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:09.522 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:09.489+0000 7f1e11315640 1 -- 172.21.15.89:0/2103236867 >> 172.21.15.89:0/2103236867 conn(0x7f1e0c070d50 msgr2=0x7f1e0c071150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:52:09.522 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:09.489+0000 7f1e11315640 1 -- 172.21.15.89:0/2103236867 shutdown_connections 2024-09-13T02:52:09.522 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:09.489+0000 7f1e11315640 1 -- 172.21.15.89:0/2103236867 wait complete. 2024-09-13T02:52:09.522 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:09.490+0000 7f1e11315640 1 Processor -- start 2024-09-13T02:52:09.522 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:09.490+0000 7f1e11315640 1 -- start start 2024-09-13T02:52:09.522 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:09.490+0000 7f1e11315640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1e0c0fbe00 0x7f1e0c113210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:09.522 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:09.490+0000 7f1e11315640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1e0c101560 0x7f1e0c113750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:09.522 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:09.490+0000 7f1e11315640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e0c113de0 con 0x7f1e0c101560 2024-09-13T02:52:09.522 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:09.490+0000 7f1e11315640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e0c10d190 con 0x7f1e0c0fbe00 2024-09-13T02:52:09.522 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:09.490+0000 7f1e027fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1e0c101560 0x7f1e0c113750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:09.522 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:09.490+0000 7f1e027fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1e0c101560 0x7f1e0c113750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:58558/0 (socket says 172.21.15.89:58558) 2024-09-13T02:52:09.522 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:09.490+0000 7f1e027fc640 1 -- 172.21.15.89:0/66135215 learned_addr learned my addr 172.21.15.89:0/66135215 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:52:09.523 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:09.490+0000 7f1e0affd640 1 --2- 172.21.15.89:0/66135215 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1e0c0fbe00 0x7f1e0c113210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:09.523 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:09.490+0000 7f1e027fc640 1 -- 172.21.15.89:0/66135215 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1e0c0fbe00 msgr2=0x7f1e0c113210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:09.523 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:09.490+0000 7f1e027fc640 1 --2- 172.21.15.89:0/66135215 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1e0c0fbe00 0x7f1e0c113210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:09.523 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:09.490+0000 7f1e027fc640 1 -- 172.21.15.89:0/66135215 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dfc005040 con 0x7f1e0c101560 2024-09-13T02:52:09.523 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:09.490+0000 7f1e0affd640 1 --2- 172.21.15.89:0/66135215 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1e0c0fbe00 0x7f1e0c113210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T02:52:09.523 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:09.491+0000 7f1e027fc640 1 --2- 172.21.15.89:0/66135215 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1e0c101560 0x7f1e0c113750 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f1df400b790 tx=0x7f1df40091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:52:09.523 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:09.491+0000 7f1e03fff640 1 -- 172.21.15.89:0/66135215 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1df400c700 con 0x7f1e0c101560 2024-09-13T02:52:09.523 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:09.491+0000 7f1e11315640 1 -- 172.21.15.89:0/66135215 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e0c10d470 con 0x7f1e0c101560 2024-09-13T02:52:09.523 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:09.491+0000 7f1e03fff640 1 -- 172.21.15.89:0/66135215 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f1df400cd00 con 0x7f1e0c101560 2024-09-13T02:52:09.523 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:09.491+0000 7f1e03fff640 1 -- 172.21.15.89:0/66135215 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1df4015e70 con 0x7f1e0c101560 2024-09-13T02:52:09.523 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:09.491+0000 7f1e11315640 1 -- 172.21.15.89:0/66135215 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e0c10d990 con 0x7f1e0c101560 2024-09-13T02:52:09.523 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:09.492+0000 7f1e11315640 1 -- 172.21.15.89:0/66135215 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e0c0fce10 con 0x7f1e0c101560 2024-09-13T02:52:09.523 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:09.493+0000 7f1e03fff640 1 -- 172.21.15.89:0/66135215 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f1df4012070 con 0x7f1e0c101560 2024-09-13T02:52:09.524 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:09.494+0000 7f1e03fff640 1 --2- 172.21.15.89:0/66135215 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f1df806ed60 0x7f1df8071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:09.524 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:09.494+0000 7f1e03fff640 1 -- 172.21.15.89:0/66135215 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f1df408dd50 con 0x7f1e0c101560 2024-09-13T02:52:09.524 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:09.494+0000 7f1e0affd640 1 --2- 172.21.15.89:0/66135215 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f1df806ed60 0x7f1df8071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:09.524 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:09.494+0000 7f1e0affd640 1 --2- 172.21.15.89:0/66135215 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f1df806ed60 0x7f1df8071210 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc007ac0 tx=0x7f1dfc035040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:52:09.524 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:09.500+0000 7f1e03fff640 1 -- 172.21.15.89:0/66135215 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f1df405ae20 con 0x7f1e0c101560 2024-09-13T02:52:09.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:09.693+0000 7f1e11315640 1 -- 172.21.15.89:0/66135215 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1e0c074c70 con 0x7f1e0c101560 2024-09-13T02:52:09.696 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:09.694+0000 7f1e03fff640 1 -- 172.21.15.89:0/66135215 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4719 (secure 0 0 0) 0x7f1df405a7c0 con 0x7f1e0c101560 2024-09-13T02:52:09.696 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:52:09.697 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":19,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T02:51:40.657817+0000","modified":"2024-09-13T02:52:02.591108+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":44,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14480,"mds_1":24257},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14480":{"gid":14480,"name":"cephfs.smithi089.rarddb","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.89:6829/1561365213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1561365213},{"type":"v1","addr":"172.21.15.89:6829","nonce":1561365213}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14488":{"gid":14488,"name":"cephfs.smithi089.qjoitb","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.89:6827/1464393547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1464393547},{"type":"v1","addr":"172.21.15.89:6827","nonce":1464393547}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24257":{"gid":24257,"name":"cephfs.smithi131.uasrkg","rank":1,"incarnation":7,"state":"up:active","state_seq":4,"addr":"172.21.15.131:6825/260493836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":260493836},{"type":"v1","addr":"172.21.15.131:6825","nonce":260493836}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24265":{"gid":24265,"name":"cephfs.smithi131.rbovzc","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":2,"addr":"172.21.15.131:6827/665579373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":665579373},{"type":"v1","addr":"172.21.15.131:6827","nonce":665579373}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2024-09-13T02:52:09.697 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 19 2024-09-13T02:52:09.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:09.696+0000 7f1e11315640 1 -- 172.21.15.89:0/66135215 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f1df806ed60 msgr2=0x7f1df8071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:09.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:09.696+0000 7f1e11315640 1 --2- 172.21.15.89:0/66135215 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f1df806ed60 0x7f1df8071210 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc007ac0 tx=0x7f1dfc035040 comp rx=0 tx=0).stop 2024-09-13T02:52:09.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:09.696+0000 7f1e11315640 1 -- 172.21.15.89:0/66135215 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1e0c101560 msgr2=0x7f1e0c113750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:09.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:09.696+0000 7f1e11315640 1 --2- 172.21.15.89:0/66135215 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1e0c101560 0x7f1e0c113750 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f1df400b790 tx=0x7f1df40091d0 comp rx=0 tx=0).stop 2024-09-13T02:52:09.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:09.696+0000 7f1e11315640 1 -- 172.21.15.89:0/66135215 shutdown_connections 2024-09-13T02:52:09.699 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:09.696+0000 7f1e11315640 1 --2- 172.21.15.89:0/66135215 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1e0c101560 0x7f1e0c113750 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:09.699 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:09.696+0000 7f1e11315640 1 --2- 172.21.15.89:0/66135215 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f1df806ed60 0x7f1df8071210 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:09.699 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:09.696+0000 7f1e11315640 1 --2- 172.21.15.89:0/66135215 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1e0c0fbe00 0x7f1e0c113210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:09.699 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:09.696+0000 7f1e11315640 1 -- 172.21.15.89:0/66135215 >> 172.21.15.89:0/66135215 conn(0x7f1e0c070d50 msgr2=0x7f1e0c100650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:52:09.699 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:09.696+0000 7f1e11315640 1 -- 172.21.15.89:0/66135215 shutdown_connections 2024-09-13T02:52:09.699 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:09.696+0000 7f1e11315640 1 -- 172.21.15.89:0/66135215 wait complete. 2024-09-13T02:52:10.541 DEBUG:tasks.fs:fs fscid=1,name=cephfs state = {'epoch': 19, 'max_mds': 2, 'flags': 50} 2024-09-13T02:52:10.541 INFO:teuthology.run_tasks:Running task kclient... 2024-09-13T02:52:10.570 INFO:tasks.kclient:Mounting kernel clients... 2024-09-13T02:52:10.570 INFO:tasks.kclient:config is {'client.0': {}, 'client.1': {}} 2024-09-13T02:52:10.570 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T02:52:10.570 DEBUG:teuthology.orchestra.run.smithi089:> ip netns list 2024-09-13T02:52:10.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T02:52:10.588 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link delete ceph-brx 2024-09-13T02:52:10.657 INFO:teuthology.orchestra.run.smithi089.stderr:Cannot find device "ceph-brx" 2024-09-13T02:52:10.658 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T02:52:10.658 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T02:52:10.658 DEBUG:teuthology.orchestra.run.smithi131:> ip netns list 2024-09-13T02:52:10.678 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T02:52:10.679 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link delete ceph-brx 2024-09-13T02:52:10.754 INFO:teuthology.orchestra.run.smithi131.stderr:Cannot find device "ceph-brx" 2024-09-13T02:52:10.755 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T02:52:10.755 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2024-09-13T02:52:10.756 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-13T02:52:10.756 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T02:52:10.756 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-13T02:52:10.777 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:52:10 smithi089 ceph-mon[27639]: pgmap v187: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 8.0 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-13T02:52:10.778 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:52:10 smithi089 ceph-mon[27639]: from='client.? 172.21.15.89:0/66135215' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T02:52:10.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:52:10 smithi131 ceph-mon[34689]: pgmap v187: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 8.0 KiB/s rd, 0 B/s wr, 9 op/s 2024-09-13T02:52:10.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:52:10 smithi131 ceph-mon[34689]: from='client.? 172.21.15.89:0/66135215' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T02:52:11.355 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T02:52:12.710 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:52:12 smithi089 ceph-mon[27639]: pgmap v188: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 5.7 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-13T02:52:12.710 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:52:12 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:52:12.710 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:52:12 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:52:12.710 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:52:12 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:52:12.710 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:52:12 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:52:12.710 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:52:12 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:52:12.931 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:12.899+0000 7face09fc640 1 -- 172.21.15.89:0/1220089210 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7facdc0fb810 msgr2=0x7facdc0fbbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:12.931 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:12.899+0000 7face09fc640 1 --2- 172.21.15.89:0/1220089210 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7facdc0fb810 0x7facdc0fbbe0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7faccc0048d0 tx=0x7faccc009da0 comp rx=0 tx=0).stop 2024-09-13T02:52:12.931 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:12.899+0000 7face09fc640 1 -- 172.21.15.89:0/1220089210 shutdown_connections 2024-09-13T02:52:12.932 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:12.899+0000 7face09fc640 1 --2- 172.21.15.89:0/1220089210 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7facdc0fcf80 0x7facdc0fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:12.932 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:12.899+0000 7face09fc640 1 --2- 172.21.15.89:0/1220089210 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7facdc0fb810 0x7facdc0fbbe0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:12.932 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:12.899+0000 7face09fc640 1 -- 172.21.15.89:0/1220089210 >> 172.21.15.89:0/1220089210 conn(0x7facdc0723b0 msgr2=0x7facdc0727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:52:12.932 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:12.899+0000 7face09fc640 1 -- 172.21.15.89:0/1220089210 shutdown_connections 2024-09-13T02:52:12.932 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:12.899+0000 7face09fc640 1 -- 172.21.15.89:0/1220089210 wait complete. 2024-09-13T02:52:12.932 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:12.899+0000 7face09fc640 1 Processor -- start 2024-09-13T02:52:12.932 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:12.899+0000 7face09fc640 1 -- start start 2024-09-13T02:52:12.932 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:12.900+0000 7face09fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7facdc0fb810 0x7facdc10e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:12.932 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:12.900+0000 7face09fc640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7facdc0fcf80 0x7facdc10e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:12.932 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:12.900+0000 7face09fc640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facdc10ed30 con 0x7facdc0fb810 2024-09-13T02:52:12.932 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:12.900+0000 7face09fc640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facdc10eea0 con 0x7facdc0fcf80 2024-09-13T02:52:12.932 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:12.900+0000 7facda59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7facdc0fb810 0x7facdc10e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:12.932 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:12.900+0000 7facda59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7facdc0fb810 0x7facdc10e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36960/0 (socket says 172.21.15.89:36960) 2024-09-13T02:52:12.933 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:12.900+0000 7facda59c640 1 -- 172.21.15.89:0/156079830 learned_addr learned my addr 172.21.15.89:0/156079830 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:52:12.933 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:12.900+0000 7facd9d9b640 1 --2- 172.21.15.89:0/156079830 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7facdc0fcf80 0x7facdc10e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:12.933 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:12.900+0000 7facda59c640 1 -- 172.21.15.89:0/156079830 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7facdc0fcf80 msgr2=0x7facdc10e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:12.933 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:12.900+0000 7facda59c640 1 --2- 172.21.15.89:0/156079830 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7facdc0fcf80 0x7facdc10e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:12.933 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:12.900+0000 7facda59c640 1 -- 172.21.15.89:0/156079830 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faccc005040 con 0x7facdc0fb810 2024-09-13T02:52:12.933 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:12.900+0000 7facd9d9b640 1 --2- 172.21.15.89:0/156079830 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7facdc0fcf80 0x7facdc10e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T02:52:12.933 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:12.900+0000 7facda59c640 1 --2- 172.21.15.89:0/156079830 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7facdc0fb810 0x7facdc10e2b0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7faccc003080 tx=0x7faccc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:52:12.933 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:12.900+0000 7facd2ffd640 1 -- 172.21.15.89:0/156079830 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faccc038070 con 0x7facdc0fb810 2024-09-13T02:52:12.933 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:12.900+0000 7facd2ffd640 1 -- 172.21.15.89:0/156079830 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7faccc0097e0 con 0x7facdc0fb810 2024-09-13T02:52:12.933 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:12.900+0000 7face09fc640 1 -- 172.21.15.89:0/156079830 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facdc117180 con 0x7facdc0fb810 2024-09-13T02:52:12.933 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:12.900+0000 7facd2ffd640 1 -- 172.21.15.89:0/156079830 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faccc03d420 con 0x7facdc0fb810 2024-09-13T02:52:12.933 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:12.900+0000 7face09fc640 1 -- 172.21.15.89:0/156079830 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facdc117640 con 0x7facdc0fb810 2024-09-13T02:52:12.933 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:12.901+0000 7face09fc640 1 -- 172.21.15.89:0/156079830 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facdc0fcbc0 con 0x7facdc0fb810 2024-09-13T02:52:12.934 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:12.902+0000 7facd2ffd640 1 -- 172.21.15.89:0/156079830 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7faccc030020 con 0x7facdc0fb810 2024-09-13T02:52:12.934 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:12.902+0000 7facd2ffd640 1 --2- 172.21.15.89:0/156079830 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7facc806ed60 0x7facc8071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:12.934 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:12.902+0000 7facd9d9b640 1 --2- 172.21.15.89:0/156079830 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7facc806ed60 0x7facc8071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:12.934 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:12.902+0000 7facd2ffd640 1 -- 172.21.15.89:0/156079830 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7faccc0ae700 con 0x7facdc0fb810 2024-09-13T02:52:12.934 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:12.903+0000 7facd9d9b640 1 --2- 172.21.15.89:0/156079830 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7facc806ed60 0x7facc8071210 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7facdc0659e0 tx=0x7facc4009040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:52:12.934 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:12.906+0000 7facd2ffd640 1 -- 172.21.15.89:0/156079830 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7faccc07b850 con 0x7facdc0fb810 2024-09-13T02:52:12.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:52:12 smithi131 ceph-mon[34689]: pgmap v188: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 5.7 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-13T02:52:12.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:52:12 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:52:12.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:52:12 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:52:12.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:52:12 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:52:12.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:52:12 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:52:12.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:52:12 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:52:13.098 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:13.097+0000 7face09fc640 1 -- 172.21.15.89:0/156079830 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7facdc072ec0 con 0x7facdc0fb810 2024-09-13T02:52:13.098 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:13.097+0000 7facd2ffd640 1 -- 172.21.15.89:0/156079830 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v19) v1 ==== 53+0+83 (secure 0 0 0) 0x7faccc07b1f0 con 0x7facdc0fb810 2024-09-13T02:52:13.098 INFO:teuthology.orchestra.run.smithi089.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-09-13T02:52:13.100 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:13.099+0000 7face09fc640 1 -- 172.21.15.89:0/156079830 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7facc806ed60 msgr2=0x7facc8071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:13.100 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:13.099+0000 7face09fc640 1 --2- 172.21.15.89:0/156079830 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7facc806ed60 0x7facc8071210 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7facdc0659e0 tx=0x7facc4009040 comp rx=0 tx=0).stop 2024-09-13T02:52:13.100 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:13.099+0000 7face09fc640 1 -- 172.21.15.89:0/156079830 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7facdc0fb810 msgr2=0x7facdc10e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:13.100 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:13.099+0000 7face09fc640 1 --2- 172.21.15.89:0/156079830 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7facdc0fb810 0x7facdc10e2b0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7faccc003080 tx=0x7faccc009da0 comp rx=0 tx=0).stop 2024-09-13T02:52:13.101 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:13.099+0000 7face09fc640 1 -- 172.21.15.89:0/156079830 shutdown_connections 2024-09-13T02:52:13.101 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:13.099+0000 7face09fc640 1 --2- 172.21.15.89:0/156079830 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7facc806ed60 0x7facc8071210 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:13.101 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:13.099+0000 7face09fc640 1 --2- 172.21.15.89:0/156079830 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7facdc0fcf80 0x7facdc10e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:13.101 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:13.099+0000 7face09fc640 1 --2- 172.21.15.89:0/156079830 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7facdc0fb810 0x7facdc10e2b0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:13.101 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:13.099+0000 7face09fc640 1 -- 172.21.15.89:0/156079830 >> 172.21.15.89:0/156079830 conn(0x7facdc0723b0 msgr2=0x7facdc0fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:52:13.101 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:13.099+0000 7face09fc640 1 -- 172.21.15.89:0/156079830 shutdown_connections 2024-09-13T02:52:13.101 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:13.099+0000 7face09fc640 1 -- 172.21.15.89:0/156079830 wait complete. 2024-09-13T02:52:13.652 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:52:13 smithi089 ceph-mon[27639]: from='client.? 172.21.15.89:0/156079830' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-13T02:52:13.674 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T02:52:13.674 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T02:52:13.674 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi089.front.sepia.ceph.com 2024-09-13T02:52:13.674 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-13T02:52:13.675 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-13T02:52:13.675 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T02:52:13.675 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T02:52:13.675 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T02:52:13.675 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-13T02:52:13.675 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T02:52:13.675 DEBUG:teuthology.orchestra.run.smithi089:> ip addr 2024-09-13T02:52:13.730 INFO:teuthology.orchestra.run.smithi089.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T02:52:13.730 INFO:teuthology.orchestra.run.smithi089.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T02:52:13.730 INFO:teuthology.orchestra.run.smithi089.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T02:52:13.730 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2024-09-13T02:52:13.730 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 ::1/128 scope host 2024-09-13T02:52:13.730 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2024-09-13T02:52:13.730 INFO:teuthology.orchestra.run.smithi089.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T02:52:13.730 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:d8:a4:c6 brd ff:ff:ff:ff:ff:ff 2024-09-13T02:52:13.731 INFO:teuthology.orchestra.run.smithi089.stdout: altname enp7s0f0 2024-09-13T02:52:13.731 INFO:teuthology.orchestra.run.smithi089.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T02:52:13.731 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:d8:a4:c7 brd ff:ff:ff:ff:ff:ff 2024-09-13T02:52:13.731 INFO:teuthology.orchestra.run.smithi089.stdout: altname enp7s0f1 2024-09-13T02:52:13.731 INFO:teuthology.orchestra.run.smithi089.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T02:52:13.731 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:8f:d5:00 brd ff:ff:ff:ff:ff:ff 2024-09-13T02:52:13.731 INFO:teuthology.orchestra.run.smithi089.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T02:52:13.731 INFO:teuthology.orchestra.run.smithi089.stdout: link/ether 0c:c4:7a:8f:d5:01 brd ff:ff:ff:ff:ff:ff 2024-09-13T02:52:13.731 INFO:teuthology.orchestra.run.smithi089.stdout: inet 172.21.15.89/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-13T02:52:13.731 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft 42364sec preferred_lft 42364sec 2024-09-13T02:52:13.731 INFO:teuthology.orchestra.run.smithi089.stdout: inet6 fe80::ec4:7aff:fe8f:d501/64 scope link noprefixroute 2024-09-13T02:52:13.731 INFO:teuthology.orchestra.run.smithi089.stdout: valid_lft forever preferred_lft forever 2024-09-13T02:52:13.732 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-13T02:52:13.732 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-13T02:52:13.732 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2024-09-13T02:52:13.732 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link add name ceph-brx type bridge 2024-09-13T02:52:13.732 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip addr flush dev ceph-brx 2024-09-13T02:52:13.732 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link set ceph-brx up 2024-09-13T02:52:13.732 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-13T02:52:13.732 DEBUG:teuthology.orchestra.run.smithi089:> ') 2024-09-13T02:52:13.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:13 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-13T02:52:13.930 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:13 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T02:52:13.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:52:13 smithi131 ceph-mon[34689]: from='client.? 172.21.15.89:0/156079830' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-13T02:52:13.936 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T02:52:13.936 DEBUG:teuthology.orchestra.run.smithi089:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T02:52:13.961 INFO:teuthology.orchestra.run.smithi089.stdout:1 2024-09-13T02:52:13.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T02:52:13.963 DEBUG:teuthology.orchestra.run.smithi089:> route 2024-09-13T02:52:14.034 INFO:teuthology.orchestra.run.smithi089.stdout:Kernel IP routing table 2024-09-13T02:52:14.034 INFO:teuthology.orchestra.run.smithi089.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T02:52:14.034 INFO:teuthology.orchestra.run.smithi089.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T02:52:14.034 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-13T02:52:14.034 INFO:teuthology.orchestra.run.smithi089.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T02:52:14.035 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-13T02:52:14.035 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2024-09-13T02:52:14.035 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T02:52:14.035 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T02:52:14.035 DEBUG:teuthology.orchestra.run.smithi089:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T02:52:14.035 DEBUG:teuthology.orchestra.run.smithi089:> ') 2024-09-13T02:52:14.122 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-13T02:52:14.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T02:52:14.330 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T02:52:14.330 DEBUG:teuthology.orchestra.run.smithi089:> ip netns list 2024-09-13T02:52:14.346 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T02:52:14.346 DEBUG:teuthology.orchestra.run.smithi089:> ip netns list-id 2024-09-13T02:52:14.401 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-13T02:52:14.401 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2024-09-13T02:52:14.401 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T02:52:14.401 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-13T02:52:14.402 DEBUG:teuthology.orchestra.run.smithi089:> ') 2024-09-13T02:52:14.488 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-13T02:52:14.511 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T02:52:14.517 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-13T02:52:14.518 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-13T02:52:14.518 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2024-09-13T02:52:14.518 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-13T02:52:14.518 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-13T02:52:14.518 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-13T02:52:14.518 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-13T02:52:14.518 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-13T02:52:14.518 DEBUG:teuthology.orchestra.run.smithi089:> ') 2024-09-13T02:52:14.566 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-13T02:52:14.655 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T02:52:14.661 DEBUG:teuthology.orchestra.run.smithi089:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-13T02:52:14.661 DEBUG:teuthology.orchestra.run.smithi089:> set -e 2024-09-13T02:52:14.661 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link set brx.0 up 2024-09-13T02:52:14.661 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link set dev brx.0 master ceph-brx 2024-09-13T02:52:14.661 DEBUG:teuthology.orchestra.run.smithi089:> ') 2024-09-13T02:52:14.709 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:14 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-13T02:52:14.731 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:14 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T02:52:14.738 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T02:52:14.738 DEBUG:teuthology.orchestra.run.smithi089:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-13T02:52:14.753 INFO:teuthology.orchestra.run.smithi089.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-13T02:52:14.753 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T02:52:14.753 DEBUG:teuthology.orchestra.run.smithi089:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-13T02:52:14.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:52:14 smithi089 ceph-mon[27639]: pgmap v189: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 5.7 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-13T02:52:14.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:52:14 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:52:14.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:52:14 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:52:14.800 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-13T02:52:14.800 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T02:52:14.800 DEBUG:teuthology.orchestra.run.smithi089:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-13T02:52:14.899 INFO:teuthology.orchestra.run.smithi089.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-13T02:52:14.899 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-13T02:52:14.899 INFO:teuthology.orchestra.run.smithi089.stdout:invalid new device string format 2024-09-13T02:52:14.933 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:52:14 smithi131 ceph-mon[34689]: pgmap v189: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 5.7 KiB/s rd, 0 B/s wr, 7 op/s 2024-09-13T02:52:14.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:52:14 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:52:14.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:52:14 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:52:15.024 INFO:teuthology.orchestra.run.smithi089.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-13T02:52:15.024 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-13T02:52:15.024 INFO:teuthology.orchestra.run.smithi089.stdout:invalid new device string format 2024-09-13T02:52:15.024 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: resolved to: "172.21.15.89:3300,172.21.15.131:3300" 2024-09-13T02:52:15.024 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-13T02:52:15.034 INFO:teuthology.orchestra.run.smithi089.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2024-09-13T02:52:15.034 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2024-09-13T02:52:15.034 INFO:teuthology.orchestra.run.smithi089.stdout:invalid new device string format 2024-09-13T02:52:15.034 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: resolved to: "172.21.15.89:3300,172.21.15.131:3300" 2024-09-13T02:52:15.034 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-13T02:52:15.034 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: resolved to: "172.21.15.89:6789,172.21.15.131:6789" 2024-09-13T02:52:15.034 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.89:6789,172.21.15.131:6789:/ 2024-09-13T02:52:15.034 INFO:teuthology.orchestra.run.smithi089.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=12cdb164-717a-11ef-bceb-c7b262605968" will pass to kernel 2024-09-13T02:52:15.035 INFO:teuthology.orchestra.run.smithi089.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-09-13T02:52:15.035 INFO:teuthology.orchestra.run.smithi089.stdout: You just mounted a file system that supports labels which does not 2024-09-13T02:52:15.035 INFO:teuthology.orchestra.run.smithi089.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-13T02:52:15.035 INFO:teuthology.orchestra.run.smithi089.stdout: applications will generate AVC messages and not be allowed access to 2024-09-13T02:52:15.035 INFO:teuthology.orchestra.run.smithi089.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-13T02:52:15.037 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T02:52:15.037 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T02:52:15.037 DEBUG:teuthology.orchestra.run.smithi089:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-13T02:52:15.065 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T02:52:15.155 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:15 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-13T02:52:15.160 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T02:52:15.167 INFO:teuthology.orchestra.run.smithi089.stdout:client14506 2024-09-13T02:52:15.168 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-13T02:52:15.168 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T02:52:15.186 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T02:52:15.275 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:15 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-13T02:52:15.280 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T02:52:15.285 INFO:teuthology.orchestra.run.smithi089.stdout:client14506 2024-09-13T02:52:15.286 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T02:52:15.334 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:15 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-13T02:52:15.339 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T02:52:15.345 INFO:teuthology.orchestra.run.smithi089.stdout:client14506 2024-09-13T02:52:15.345 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/12cdb164-717a-11ef-bceb-c7b262605968.client14506/status') 2024-09-13T02:52:15.394 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:15 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-13T02:52:15.406 INFO:teuthology.orchestra.run.smithi089.stdout:instance: client.14506 (3)192.168.0.1:0/3576310256 2024-09-13T02:52:15.406 INFO:teuthology.orchestra.run.smithi089.stdout:blocklisted: false 2024-09-13T02:52:15.406 INFO:teuthology.orchestra.run.smithi089.stderr:0+1 records in 2024-09-13T02:52:15.406 INFO:teuthology.orchestra.run.smithi089.stderr:0+1 records out 2024-09-13T02:52:15.406 INFO:teuthology.orchestra.run.smithi089.stderr:70 bytes copied, 2.3664e-05 s, 3.0 MB/s 2024-09-13T02:52:15.407 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:15 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T02:52:15.413 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2024-09-13T02:52:15.413 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-13T02:52:15.414 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-13T02:52:15.414 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-13T02:52:15.662 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T02:52:16.886 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:52:16 smithi089 ceph-mon[27639]: pgmap v190: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 6.3 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-13T02:52:16.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:52:16 smithi131 ceph-mon[34689]: pgmap v190: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 6.3 KiB/s rd, 0 B/s wr, 8 op/s 2024-09-13T02:52:17.222 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:17.214+0000 7f390650c640 1 -- 172.21.15.89:0/2600290829 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39001014c0 msgr2=0x7f3900101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:17.222 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:17.214+0000 7f390650c640 1 --2- 172.21.15.89:0/2600290829 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39001014c0 0x7f3900101890 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f38f00048d0 tx=0x7f38f0009da0 comp rx=0 tx=0).stop 2024-09-13T02:52:17.222 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:17.214+0000 7f390650c640 1 -- 172.21.15.89:0/2600290829 shutdown_connections 2024-09-13T02:52:17.222 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:17.214+0000 7f390650c640 1 --2- 172.21.15.89:0/2600290829 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f39000fb480 0x7f39000fb8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:17.222 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:17.214+0000 7f390650c640 1 --2- 172.21.15.89:0/2600290829 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39001014c0 0x7f3900101890 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:17.223 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:17.214+0000 7f390650c640 1 -- 172.21.15.89:0/2600290829 >> 172.21.15.89:0/2600290829 conn(0x7f39000f7000 msgr2=0x7f39000f9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:52:17.223 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:17.215+0000 7f390650c640 1 -- 172.21.15.89:0/2600290829 shutdown_connections 2024-09-13T02:52:17.223 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:17.215+0000 7f390650c640 1 -- 172.21.15.89:0/2600290829 wait complete. 2024-09-13T02:52:17.223 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:17.215+0000 7f390650c640 1 Processor -- start 2024-09-13T02:52:17.223 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:17.215+0000 7f390650c640 1 -- start start 2024-09-13T02:52:17.223 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:17.215+0000 7f390650c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39000fb480 0x7f39001131b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:17.223 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:17.215+0000 7f390650c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f39001014c0 0x7f39001136f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:17.223 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:17.215+0000 7f390650c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3900113cf0 con 0x7f39000fb480 2024-09-13T02:52:17.223 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:17.215+0000 7f390650c640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f390010d130 con 0x7f39001014c0 2024-09-13T02:52:17.223 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:17.215+0000 7f38fffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39000fb480 0x7f39001131b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:17.223 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:17.216+0000 7f38fffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39000fb480 0x7f39001131b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36980/0 (socket says 172.21.15.89:36980) 2024-09-13T02:52:17.223 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:17.216+0000 7f38fffff640 1 -- 172.21.15.89:0/510941965 learned_addr learned my addr 172.21.15.89:0/510941965 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:52:17.224 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:17.216+0000 7f38ff7fe640 1 --2- 172.21.15.89:0/510941965 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f39001014c0 0x7f39001136f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:17.224 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:17.216+0000 7f38fffff640 1 -- 172.21.15.89:0/510941965 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f39001014c0 msgr2=0x7f39001136f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:17.224 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:17.216+0000 7f38fffff640 1 --2- 172.21.15.89:0/510941965 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f39001014c0 0x7f39001136f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:17.224 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:17.216+0000 7f38fffff640 1 -- 172.21.15.89:0/510941965 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38f0005040 con 0x7f39000fb480 2024-09-13T02:52:17.224 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:17.216+0000 7f38ff7fe640 1 --2- 172.21.15.89:0/510941965 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f39001014c0 0x7f39001136f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T02:52:17.224 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:17.216+0000 7f38fffff640 1 --2- 172.21.15.89:0/510941965 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39000fb480 0x7f39001131b0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f38f0003080 tx=0x7f38f0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:52:17.224 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:17.216+0000 7f38fcff9640 1 -- 172.21.15.89:0/510941965 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f38f0038070 con 0x7f39000fb480 2024-09-13T02:52:17.224 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:17.216+0000 7f38fcff9640 1 -- 172.21.15.89:0/510941965 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f38f00097e0 con 0x7f39000fb480 2024-09-13T02:52:17.224 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:17.216+0000 7f38fcff9640 1 -- 172.21.15.89:0/510941965 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f38f003d420 con 0x7f39000fb480 2024-09-13T02:52:17.224 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:17.216+0000 7f390650c640 1 -- 172.21.15.89:0/510941965 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f390010d3b0 con 0x7f39000fb480 2024-09-13T02:52:17.224 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:17.216+0000 7f390650c640 1 -- 172.21.15.89:0/510941965 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f390010d8f0 con 0x7f39000fb480 2024-09-13T02:52:17.224 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:17.217+0000 7f390650c640 1 -- 172.21.15.89:0/510941965 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39000fcbc0 con 0x7f39000fb480 2024-09-13T02:52:17.224 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:17.218+0000 7f38fcff9640 1 -- 172.21.15.89:0/510941965 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f38f0030020 con 0x7f39000fb480 2024-09-13T02:52:17.225 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:17.218+0000 7f38fcff9640 1 --2- 172.21.15.89:0/510941965 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f38e806ed60 0x7f38e8071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:17.225 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:17.218+0000 7f38fcff9640 1 -- 172.21.15.89:0/510941965 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f38f00ae700 con 0x7f39000fb480 2024-09-13T02:52:17.225 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:17.218+0000 7f38ff7fe640 1 --2- 172.21.15.89:0/510941965 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f38e806ed60 0x7f38e8071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:17.225 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:17.219+0000 7f38ff7fe640 1 --2- 172.21.15.89:0/510941965 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f38e806ed60 0x7f38e8071210 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f390010ea70 tx=0x7f38f4009040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:52:17.225 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:17.222+0000 7f38fcff9640 1 -- 172.21.15.89:0/510941965 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f38f007b850 con 0x7f39000fb480 2024-09-13T02:52:17.415 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:17.413+0000 7f390650c640 1 -- 172.21.15.89:0/510941965 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f390004b720 con 0x7f39000fb480 2024-09-13T02:52:17.415 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:17.414+0000 7f38fcff9640 1 -- 172.21.15.89:0/510941965 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v19) v1 ==== 53+0+83 (secure 0 0 0) 0x7f38f007b1f0 con 0x7f39000fb480 2024-09-13T02:52:17.415 INFO:teuthology.orchestra.run.smithi089.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-09-13T02:52:17.417 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:17.415+0000 7f390650c640 1 -- 172.21.15.89:0/510941965 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f38e806ed60 msgr2=0x7f38e8071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:17.417 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:17.415+0000 7f390650c640 1 --2- 172.21.15.89:0/510941965 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f38e806ed60 0x7f38e8071210 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f390010ea70 tx=0x7f38f4009040 comp rx=0 tx=0).stop 2024-09-13T02:52:17.417 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:17.415+0000 7f390650c640 1 -- 172.21.15.89:0/510941965 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39000fb480 msgr2=0x7f39001131b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:17.417 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:17.415+0000 7f390650c640 1 --2- 172.21.15.89:0/510941965 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39000fb480 0x7f39001131b0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f38f0003080 tx=0x7f38f0009da0 comp rx=0 tx=0).stop 2024-09-13T02:52:17.417 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:17.416+0000 7f390650c640 1 -- 172.21.15.89:0/510941965 shutdown_connections 2024-09-13T02:52:17.417 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:17.416+0000 7f390650c640 1 --2- 172.21.15.89:0/510941965 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f38e806ed60 0x7f38e8071210 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:17.417 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:17.416+0000 7f390650c640 1 --2- 172.21.15.89:0/510941965 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f39001014c0 0x7f39001136f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:17.418 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:17.416+0000 7f390650c640 1 --2- 172.21.15.89:0/510941965 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39000fb480 0x7f39001131b0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:17.418 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:17.416+0000 7f390650c640 1 -- 172.21.15.89:0/510941965 >> 172.21.15.89:0/510941965 conn(0x7f39000f7000 msgr2=0x7f39000f73d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:52:17.418 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:17.416+0000 7f390650c640 1 -- 172.21.15.89:0/510941965 shutdown_connections 2024-09-13T02:52:17.418 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:17.416+0000 7f390650c640 1 -- 172.21.15.89:0/510941965 wait complete. 2024-09-13T02:52:17.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:52:17 smithi089 ceph-mon[27639]: from='client.? 172.21.15.89:0/510941965' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-13T02:52:17.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:52:17 smithi131 ceph-mon[34689]: from='client.? 172.21.15.89:0/510941965' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-13T02:52:17.991 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-13T02:52:17.991 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-13T02:52:17.991 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi131.front.sepia.ceph.com 2024-09-13T02:52:17.991 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-13T02:52:17.992 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-13T02:52:17.992 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-13T02:52:17.992 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-13T02:52:17.992 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-13T02:52:17.992 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-13T02:52:17.992 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T02:52:17.992 DEBUG:teuthology.orchestra.run.smithi131:> ip addr 2024-09-13T02:52:18.012 INFO:teuthology.orchestra.run.smithi131.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-13T02:52:18.012 INFO:teuthology.orchestra.run.smithi131.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-13T02:52:18.012 INFO:teuthology.orchestra.run.smithi131.stdout: inet 127.0.0.1/8 scope host lo 2024-09-13T02:52:18.012 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-09-13T02:52:18.012 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 ::1/128 scope host 2024-09-13T02:52:18.012 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-09-13T02:52:18.012 INFO:teuthology.orchestra.run.smithi131.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T02:52:18.012 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:d8:fb:18 brd ff:ff:ff:ff:ff:ff 2024-09-13T02:52:18.012 INFO:teuthology.orchestra.run.smithi131.stdout: altname enp7s0f0 2024-09-13T02:52:18.013 INFO:teuthology.orchestra.run.smithi131.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T02:52:18.013 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:d8:fb:19 brd ff:ff:ff:ff:ff:ff 2024-09-13T02:52:18.013 INFO:teuthology.orchestra.run.smithi131.stdout: altname enp7s0f1 2024-09-13T02:52:18.013 INFO:teuthology.orchestra.run.smithi131.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-13T02:52:18.013 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:88:72:f8 brd ff:ff:ff:ff:ff:ff 2024-09-13T02:52:18.013 INFO:teuthology.orchestra.run.smithi131.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-13T02:52:18.013 INFO:teuthology.orchestra.run.smithi131.stdout: link/ether 0c:c4:7a:88:72:f9 brd ff:ff:ff:ff:ff:ff 2024-09-13T02:52:18.013 INFO:teuthology.orchestra.run.smithi131.stdout: inet 172.21.15.131/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-13T02:52:18.013 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft 42358sec preferred_lft 42358sec 2024-09-13T02:52:18.013 INFO:teuthology.orchestra.run.smithi131.stdout: inet6 fe80::ec4:7aff:fe88:72f9/64 scope link noprefixroute 2024-09-13T02:52:18.013 INFO:teuthology.orchestra.run.smithi131.stdout: valid_lft forever preferred_lft forever 2024-09-13T02:52:18.014 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-13T02:52:18.014 DEBUG:teuthology.orchestra.run.smithi131:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-13T02:52:18.014 DEBUG:teuthology.orchestra.run.smithi131:> set -e 2024-09-13T02:52:18.014 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link add name ceph-brx type bridge 2024-09-13T02:52:18.014 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip addr flush dev ceph-brx 2024-09-13T02:52:18.014 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link set ceph-brx up 2024-09-13T02:52:18.014 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-13T02:52:18.014 DEBUG:teuthology.orchestra.run.smithi131:> ') 2024-09-13T02:52:18.107 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:52:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-13T02:52:18.228 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:52:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T02:52:18.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T02:52:18.235 DEBUG:teuthology.orchestra.run.smithi131:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-13T02:52:18.259 INFO:teuthology.orchestra.run.smithi131.stdout:1 2024-09-13T02:52:18.261 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T02:52:18.261 DEBUG:teuthology.orchestra.run.smithi131:> route 2024-09-13T02:52:18.328 INFO:teuthology.orchestra.run.smithi131.stdout:Kernel IP routing table 2024-09-13T02:52:18.328 INFO:teuthology.orchestra.run.smithi131.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-13T02:52:18.328 INFO:teuthology.orchestra.run.smithi131.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-13T02:52:18.329 INFO:teuthology.orchestra.run.smithi131.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-13T02:52:18.329 INFO:teuthology.orchestra.run.smithi131.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-13T02:52:18.329 DEBUG:teuthology.orchestra.run.smithi131:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-13T02:52:18.329 DEBUG:teuthology.orchestra.run.smithi131:> set -e 2024-09-13T02:52:18.329 DEBUG:teuthology.orchestra.run.smithi131:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-13T02:52:18.329 DEBUG:teuthology.orchestra.run.smithi131:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-13T02:52:18.329 DEBUG:teuthology.orchestra.run.smithi131:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-13T02:52:18.329 DEBUG:teuthology.orchestra.run.smithi131:> ') 2024-09-13T02:52:18.416 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:52:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-13T02:52:18.605 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:52:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T02:52:18.612 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T02:52:18.612 DEBUG:teuthology.orchestra.run.smithi131:> ip netns list 2024-09-13T02:52:18.628 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T02:52:18.628 DEBUG:teuthology.orchestra.run.smithi131:> ip netns list-id 2024-09-13T02:52:18.684 DEBUG:teuthology.orchestra.run.smithi131:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-13T02:52:18.684 DEBUG:teuthology.orchestra.run.smithi131:> set -e 2024-09-13T02:52:18.684 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T02:52:18.684 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-13T02:52:18.684 DEBUG:teuthology.orchestra.run.smithi131:> ') 2024-09-13T02:52:18.685 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:52:18 smithi131 ceph-mon[34689]: pgmap v191: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.2 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-13T02:52:18.772 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:52:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-13T02:52:18.796 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:52:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T02:52:18.801 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-13T02:52:18.801 DEBUG:teuthology.orchestra.run.smithi131:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-13T02:52:18.801 DEBUG:teuthology.orchestra.run.smithi131:> set -e 2024-09-13T02:52:18.801 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-13T02:52:18.801 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-13T02:52:18.801 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-13T02:52:18.801 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-13T02:52:18.801 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-13T02:52:18.802 DEBUG:teuthology.orchestra.run.smithi131:> ') 2024-09-13T02:52:18.849 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:52:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-13T02:52:18.918 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:52:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T02:52:18.924 DEBUG:teuthology.orchestra.run.smithi131:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-13T02:52:18.924 DEBUG:teuthology.orchestra.run.smithi131:> set -e 2024-09-13T02:52:18.924 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link set brx.0 up 2024-09-13T02:52:18.925 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link set dev brx.0 master ceph-brx 2024-09-13T02:52:18.925 DEBUG:teuthology.orchestra.run.smithi131:> ') 2024-09-13T02:52:18.972 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:52:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-13T02:52:18.994 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:52:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T02:52:19.002 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T02:52:19.002 DEBUG:teuthology.orchestra.run.smithi131:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-13T02:52:19.017 INFO:teuthology.orchestra.run.smithi131.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-13T02:52:19.017 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-13T02:52:19.018 DEBUG:teuthology.orchestra.run.smithi131:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-13T02:52:19.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:52:18 smithi089 ceph-mon[27639]: pgmap v191: 65 pgs: 65 active+clean; 580 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.2 KiB/s rd, 0 B/s wr, 5 op/s 2024-09-13T02:52:19.074 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2024-09-13T02:52:19.074 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T02:52:19.074 DEBUG:teuthology.orchestra.run.smithi131:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-13T02:52:19.165 INFO:teuthology.orchestra.run.smithi131.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-13T02:52:19.165 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-13T02:52:19.165 INFO:teuthology.orchestra.run.smithi131.stdout:invalid new device string format 2024-09-13T02:52:19.289 INFO:teuthology.orchestra.run.smithi131.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-13T02:52:19.289 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-13T02:52:19.289 INFO:teuthology.orchestra.run.smithi131.stdout:invalid new device string format 2024-09-13T02:52:19.289 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: resolved to: "172.21.15.89:3300,172.21.15.131:3300" 2024-09-13T02:52:19.289 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-13T02:52:19.293 INFO:teuthology.orchestra.run.smithi131.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2024-09-13T02:52:19.293 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2024-09-13T02:52:19.293 INFO:teuthology.orchestra.run.smithi131.stdout:invalid new device string format 2024-09-13T02:52:19.294 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: resolved to: "172.21.15.89:3300,172.21.15.131:3300" 2024-09-13T02:52:19.294 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: switching to using v1 address with old syntax 2024-09-13T02:52:19.294 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: resolved to: "172.21.15.89:6789,172.21.15.131:6789" 2024-09-13T02:52:19.294 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.89:6789,172.21.15.131:6789:/ 2024-09-13T02:52:19.294 INFO:teuthology.orchestra.run.smithi131.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=12cdb164-717a-11ef-bceb-c7b262605968" will pass to kernel 2024-09-13T02:52:19.294 INFO:teuthology.orchestra.run.smithi131.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2024-09-13T02:52:19.295 INFO:teuthology.orchestra.run.smithi131.stdout: You just mounted a file system that supports labels which does not 2024-09-13T02:52:19.295 INFO:teuthology.orchestra.run.smithi131.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-09-13T02:52:19.295 INFO:teuthology.orchestra.run.smithi131.stdout: applications will generate AVC messages and not be allowed access to 2024-09-13T02:52:19.295 INFO:teuthology.orchestra.run.smithi131.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-09-13T02:52:19.296 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-09-13T02:52:19.296 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T02:52:19.296 DEBUG:teuthology.orchestra.run.smithi131:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-13T02:52:19.322 DEBUG:teuthology.orchestra.run.smithi131:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T02:52:19.412 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:52:19 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-13T02:52:19.414 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:52:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T02:52:19.420 INFO:teuthology.orchestra.run.smithi131.stdout:client14512 2024-09-13T02:52:19.420 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-13T02:52:19.420 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T02:52:19.437 DEBUG:teuthology.orchestra.run.smithi131:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T02:52:19.525 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:52:19 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-13T02:52:19.527 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:52:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T02:52:19.533 INFO:teuthology.orchestra.run.smithi131.stdout:client14512 2024-09-13T02:52:19.533 DEBUG:teuthology.orchestra.run.smithi131:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-09-13T02:52:19.581 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:52:19 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-13T02:52:19.582 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:52:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T02:52:19.588 INFO:teuthology.orchestra.run.smithi131.stdout:client14512 2024-09-13T02:52:19.588 DEBUG:teuthology.orchestra.run.smithi131:> (cd /home/ubuntu/cephtest/mnt.1 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/12cdb164-717a-11ef-bceb-c7b262605968.client14512/status') 2024-09-13T02:52:19.637 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:52:19 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-13T02:52:19.647 INFO:teuthology.orchestra.run.smithi131.stdout:instance: client.14512 (3)172.21.15.131:0/4197080413 2024-09-13T02:52:19.647 INFO:teuthology.orchestra.run.smithi131.stdout:blocklisted: false 2024-09-13T02:52:19.647 INFO:teuthology.orchestra.run.smithi131.stderr:0+1 records in 2024-09-13T02:52:19.647 INFO:teuthology.orchestra.run.smithi131.stderr:0+1 records out 2024-09-13T02:52:19.647 INFO:teuthology.orchestra.run.smithi131.stderr:72 bytes copied, 2.1768e-05 s, 3.3 MB/s 2024-09-13T02:52:19.648 INFO:teuthology.orchestra.run.smithi131.stderr:2024-09-13T02:52:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-13T02:52:19.654 INFO:teuthology.run_tasks:Running task print... 2024-09-13T02:52:19.664 INFO:teuthology.task.print:**** done client 2024-09-13T02:52:19.664 INFO:teuthology.run_tasks:Running task parallel... 2024-09-13T02:52:19.747 INFO:teuthology.task.parallel:starting parallel... 2024-09-13T02:52:19.748 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-09-13T02:52:19.748 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-13T02:52:19.749 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi089.front.sepia.ceph.com 2024-09-13T02:52:19.749 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -e sha1=7741f7f9ee20524f89b8f61d1609b32fb3b1570a -- bash -c 'ceph config set mgr mgr/orchestrator/fail_fs false || true' 2024-09-13T02:52:19.750 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-09-13T02:52:19.750 INFO:teuthology.task.sequential:In sequential, running task workunit... 2024-09-13T02:52:19.755 INFO:tasks.workunit:Pulling workunits from ref ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T02:52:19.755 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-13T02:52:19.755 INFO:tasks.workunit:timeout=3h 2024-09-13T02:52:19.755 INFO:tasks.workunit:cleanup=True 2024-09-13T02:52:19.756 DEBUG:teuthology.orchestra.run.smithi089:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-13T02:52:19.777 INFO:teuthology.orchestra.run.smithi089.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-13T02:52:19.777 INFO:teuthology.orchestra.run.smithi089.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-09-13T02:52:19.777 INFO:teuthology.orchestra.run.smithi089.stdout:Device: 7ah/122d Inode: 1 Links: 2 2024-09-13T02:52:19.777 INFO:teuthology.orchestra.run.smithi089.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T02:52:19.777 INFO:teuthology.orchestra.run.smithi089.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-13T02:52:19.777 INFO:teuthology.orchestra.run.smithi089.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-13T02:52:19.778 INFO:teuthology.orchestra.run.smithi089.stdout:Modify: 2024-09-13 02:51:47.694327991 +0000 2024-09-13T02:52:19.778 INFO:teuthology.orchestra.run.smithi089.stdout:Change: 2024-09-13 02:52:15.059787556 +0000 2024-09-13T02:52:19.778 INFO:teuthology.orchestra.run.smithi089.stdout: Birth: 2024-09-13 02:51:47.694327991 +0000 2024-09-13T02:52:19.778 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-13T02:52:19.778 DEBUG:teuthology.orchestra.run.smithi089:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-13T02:52:19.852 DEBUG:teuthology.orchestra.run.smithi131:> stat -- /home/ubuntu/cephtest/mnt.1 2024-09-13T02:52:19.868 INFO:teuthology.orchestra.run.smithi131.stdout: File: /home/ubuntu/cephtest/mnt.1 2024-09-13T02:52:19.868 INFO:teuthology.orchestra.run.smithi131.stdout: Size: 1 Blocks: 0 IO Block: 65536 directory 2024-09-13T02:52:19.868 INFO:teuthology.orchestra.run.smithi131.stdout:Device: 75h/117d Inode: 1 Links: 3 2024-09-13T02:52:19.869 INFO:teuthology.orchestra.run.smithi131.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-13T02:52:19.869 INFO:teuthology.orchestra.run.smithi131.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-09-13T02:52:19.869 INFO:teuthology.orchestra.run.smithi131.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-09-13T02:52:19.869 INFO:teuthology.orchestra.run.smithi131.stdout:Modify: 2024-09-13 02:52:19.845680140 +0000 2024-09-13T02:52:19.869 INFO:teuthology.orchestra.run.smithi131.stdout:Change: 2024-09-13 02:52:19.845680140 +0000 2024-09-13T02:52:19.869 INFO:teuthology.orchestra.run.smithi131.stdout: Birth: 2024-09-13 02:51:47.694327991 +0000 2024-09-13T02:52:19.869 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2024-09-13T02:52:19.869 DEBUG:teuthology.orchestra.run.smithi131:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2024-09-13T02:52:19.938 DEBUG:teuthology.orchestra.run.smithi089:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T02:52:19.938 DEBUG:teuthology.orchestra.run.smithi131:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout ecab7be58963a5bd03910cd73eef66405d7fdd50 2024-09-13T02:52:19.955 INFO:tasks.workunit.client.0.smithi089.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-13T02:52:19.995 INFO:tasks.workunit.client.1.smithi131.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2024-09-13T02:52:20.019 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T02:52:20.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:52:20 smithi089 ceph-mon[27639]: pgmap v192: 65 pgs: 65 active+clean; 581 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.0 KiB/s rd, 341 B/s wr, 5 op/s 2024-09-13T02:52:20.933 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:52:20 smithi131 ceph-mon[34689]: pgmap v192: 65 pgs: 65 active+clean; 581 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.0 KiB/s rd, 341 B/s wr, 5 op/s 2024-09-13T02:52:21.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:21.591+0000 7f1f8b5b6640 1 -- 172.21.15.89:0/400785281 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1f840666f0 msgr2=0x7f1f840ff1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:21.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:21.591+0000 7f1f8b5b6640 1 --2- 172.21.15.89:0/400785281 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1f840666f0 0x7f1f840ff1c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f1f74009c50 tx=0x7f1f74004d10 comp rx=0 tx=0).stop 2024-09-13T02:52:21.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:21.591+0000 7f1f8b5b6640 1 -- 172.21.15.89:0/400785281 shutdown_connections 2024-09-13T02:52:21.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:21.591+0000 7f1f8b5b6640 1 --2- 172.21.15.89:0/400785281 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1f840ff700 0x7f1f84101ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:21.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:21.591+0000 7f1f8b5b6640 1 --2- 172.21.15.89:0/400785281 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1f840666f0 0x7f1f840ff1c0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:21.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:21.591+0000 7f1f8b5b6640 1 -- 172.21.15.89:0/400785281 >> 172.21.15.89:0/400785281 conn(0x7f1f840f6c30 msgr2=0x7f1f840f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:52:21.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:21.591+0000 7f1f8b5b6640 1 -- 172.21.15.89:0/400785281 shutdown_connections 2024-09-13T02:52:21.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:21.591+0000 7f1f8b5b6640 1 -- 172.21.15.89:0/400785281 wait complete. 2024-09-13T02:52:21.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:21.591+0000 7f1f8b5b6640 1 Processor -- start 2024-09-13T02:52:21.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:21.591+0000 7f1f8b5b6640 1 -- start start 2024-09-13T02:52:21.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:21.591+0000 7f1f8b5b6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1f840666f0 0x7f1f8410d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:21.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:21.591+0000 7f1f8b5b6640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1f840ff700 0x7f1f8410d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:21.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:21.591+0000 7f1f8b5b6640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f8410dc80 con 0x7f1f840666f0 2024-09-13T02:52:21.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:21.591+0000 7f1f8b5b6640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f8410e4a0 con 0x7f1f840ff700 2024-09-13T02:52:21.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:21.592+0000 7f1f89352640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1f840666f0 0x7f1f8410d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:21.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:21.592+0000 7f1f89352640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1f840666f0 0x7f1f8410d0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:48702/0 (socket says 172.21.15.89:48702) 2024-09-13T02:52:21.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:21.592+0000 7f1f89352640 1 -- 172.21.15.89:0/1867926986 learned_addr learned my addr 172.21.15.89:0/1867926986 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:52:21.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:21.592+0000 7f1f88b51640 1 --2- 172.21.15.89:0/1867926986 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1f840ff700 0x7f1f8410d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:21.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:21.592+0000 7f1f89352640 1 -- 172.21.15.89:0/1867926986 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1f840ff700 msgr2=0x7f1f8410d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:21.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:21.592+0000 7f1f89352640 1 --2- 172.21.15.89:0/1867926986 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1f840ff700 0x7f1f8410d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:21.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:21.592+0000 7f1f89352640 1 -- 172.21.15.89:0/1867926986 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f740098b0 con 0x7f1f840666f0 2024-09-13T02:52:21.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:21.592+0000 7f1f89352640 1 --2- 172.21.15.89:0/1867926986 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1f840666f0 0x7f1f8410d0f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f1f74000f80 tx=0x7f1f74004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:52:21.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:21.592+0000 7f1f81ffb640 1 -- 172.21.15.89:0/1867926986 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f74032a60 con 0x7f1f840666f0 2024-09-13T02:52:21.597 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:21.592+0000 7f1f81ffb640 1 -- 172.21.15.89:0/1867926986 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f1f74032bc0 con 0x7f1f840666f0 2024-09-13T02:52:21.597 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:21.592+0000 7f1f8b5b6640 1 -- 172.21.15.89:0/1867926986 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f8410e6d0 con 0x7f1f840666f0 2024-09-13T02:52:21.597 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:21.592+0000 7f1f81ffb640 1 -- 172.21.15.89:0/1867926986 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f740313d0 con 0x7f1f840666f0 2024-09-13T02:52:21.597 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:21.593+0000 7f1f8b5b6640 1 -- 172.21.15.89:0/1867926986 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f8410ec70 con 0x7f1f840666f0 2024-09-13T02:52:21.597 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:21.594+0000 7f1f8b5b6640 1 -- 172.21.15.89:0/1867926986 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f840fa8b0 con 0x7f1f840666f0 2024-09-13T02:52:21.597 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:21.594+0000 7f1f81ffb640 1 -- 172.21.15.89:0/1867926986 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f1f7402f030 con 0x7f1f840666f0 2024-09-13T02:52:21.598 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:21.594+0000 7f1f81ffb640 1 --2- 172.21.15.89:0/1867926986 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f1f6c06ed60 0x7f1f6c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:21.598 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:21.595+0000 7f1f81ffb640 1 -- 172.21.15.89:0/1867926986 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f1f740af670 con 0x7f1f840666f0 2024-09-13T02:52:21.598 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:21.595+0000 7f1f88b51640 1 --2- 172.21.15.89:0/1867926986 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f1f6c06ed60 0x7f1f6c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:21.598 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:21.595+0000 7f1f88b51640 1 --2- 172.21.15.89:0/1867926986 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f1f6c06ed60 0x7f1f6c071210 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1f8410cea0 tx=0x7f1f78009040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:52:21.599 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:21.598+0000 7f1f81ffb640 1 -- 172.21.15.89:0/1867926986 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f1f7407c7c0 con 0x7f1f840666f0 2024-09-13T02:52:21.760 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:21.758+0000 7f1f8b5b6640 1 -- 172.21.15.89:0/1867926986 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command([{prefix=config set, name=mgr/orchestrator/fail_fs}] v 0) v1 -- 0x7f1f8404b720 con 0x7f1f840666f0 2024-09-13T02:52:21.760 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:21.759+0000 7f1f81ffb640 1 -- 172.21.15.89:0/1867926986 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/orchestrator/fail_fs}]=-22 unrecognized config option 'mgr/orchestrator/fail_fs' v21)=-22 unrecognized config option 'mgr/orchestrator/fail_fs' v21) v1 ==== 179+0+0 (secure 0 0 0) 0x7f1f740480c0 con 0x7f1f840666f0 2024-09-13T02:52:21.760 INFO:teuthology.orchestra.run.smithi089.stderr:Error EINVAL: unrecognized config option 'mgr/orchestrator/fail_fs' 2024-09-13T02:52:22.338 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-13T02:52:22.339 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi089.front.sepia.ceph.com 2024-09-13T02:52:22.339 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -e sha1=7741f7f9ee20524f89b8f61d1609b32fb3b1570a -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-09-13T02:52:22.623 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T02:52:22.882 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:52:22 smithi089 ceph-mon[27639]: pgmap v193: 65 pgs: 65 active+clean; 581 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-09-13T02:52:22.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:52:22 smithi131 ceph-mon[34689]: pgmap v193: 65 pgs: 65 active+clean; 581 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-09-13T02:52:24.159 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:24.138+0000 7ff9a89ce640 1 -- 172.21.15.89:0/580605633 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9a40fdba0 msgr2=0x7ff9a40fdfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:24.159 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:24.138+0000 7ff9a89ce640 1 --2- 172.21.15.89:0/580605633 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9a40fdba0 0x7ff9a40fdfb0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ff9940048d0 tx=0x7ff994009da0 comp rx=0 tx=0).stop 2024-09-13T02:52:24.159 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:24.138+0000 7ff9a89ce640 1 -- 172.21.15.89:0/580605633 shutdown_connections 2024-09-13T02:52:24.160 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:24.138+0000 7ff9a89ce640 1 --2- 172.21.15.89:0/580605633 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff9a40fe4f0 0x7ff9a40fa650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:24.160 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:24.138+0000 7ff9a89ce640 1 --2- 172.21.15.89:0/580605633 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9a40fdba0 0x7ff9a40fdfb0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:24.160 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:24.138+0000 7ff9a89ce640 1 -- 172.21.15.89:0/580605633 >> 172.21.15.89:0/580605633 conn(0x7ff9a40f63a0 msgr2=0x7ff9a40f87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:52:24.160 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:24.138+0000 7ff9a89ce640 1 -- 172.21.15.89:0/580605633 shutdown_connections 2024-09-13T02:52:24.160 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:24.138+0000 7ff9a89ce640 1 -- 172.21.15.89:0/580605633 wait complete. 2024-09-13T02:52:24.160 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:24.139+0000 7ff9a89ce640 1 Processor -- start 2024-09-13T02:52:24.160 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:24.139+0000 7ff9a89ce640 1 -- start start 2024-09-13T02:52:24.160 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:24.139+0000 7ff9a89ce640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff9a40fdba0 0x7ff9a410d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:24.160 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:24.139+0000 7ff9a89ce640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9a40fe4f0 0x7ff9a410d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:24.160 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:24.139+0000 7ff9a89ce640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a410dc80 con 0x7ff9a40fe4f0 2024-09-13T02:52:24.160 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:24.139+0000 7ff9a89ce640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a410e450 con 0x7ff9a40fdba0 2024-09-13T02:52:24.160 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:24.139+0000 7ff9a1d9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9a40fe4f0 0x7ff9a410d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:24.160 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:24.139+0000 7ff9a1d9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9a40fe4f0 0x7ff9a410d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:48720/0 (socket says 172.21.15.89:48720) 2024-09-13T02:52:24.161 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:24.139+0000 7ff9a1d9b640 1 -- 172.21.15.89:0/2414631157 learned_addr learned my addr 172.21.15.89:0/2414631157 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:52:24.161 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:24.139+0000 7ff9a259c640 1 --2- 172.21.15.89:0/2414631157 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff9a40fdba0 0x7ff9a410d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:24.161 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:24.139+0000 7ff9a1d9b640 1 -- 172.21.15.89:0/2414631157 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff9a40fdba0 msgr2=0x7ff9a410d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:24.161 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:24.139+0000 7ff9a1d9b640 1 --2- 172.21.15.89:0/2414631157 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff9a40fdba0 0x7ff9a410d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:24.161 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:24.139+0000 7ff9a1d9b640 1 -- 172.21.15.89:0/2414631157 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff994005040 con 0x7ff9a40fe4f0 2024-09-13T02:52:24.161 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:24.139+0000 7ff9a259c640 1 --2- 172.21.15.89:0/2414631157 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff9a40fdba0 0x7ff9a410d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T02:52:24.161 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:24.139+0000 7ff9a1d9b640 1 --2- 172.21.15.89:0/2414631157 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9a40fe4f0 0x7ff9a410d630 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ff998002870 tx=0x7ff998004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:52:24.161 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:24.140+0000 7ff992ffd640 1 -- 172.21.15.89:0/2414631157 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff998007c30 con 0x7ff9a40fe4f0 2024-09-13T02:52:24.161 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:24.140+0000 7ff992ffd640 1 -- 172.21.15.89:0/2414631157 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff99800f040 con 0x7ff9a40fe4f0 2024-09-13T02:52:24.161 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:24.140+0000 7ff9a89ce640 1 -- 172.21.15.89:0/2414631157 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9a410e6e0 con 0x7ff9a40fe4f0 2024-09-13T02:52:24.161 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:24.140+0000 7ff992ffd640 1 -- 172.21.15.89:0/2414631157 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff9980095b0 con 0x7ff9a40fe4f0 2024-09-13T02:52:24.161 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:24.140+0000 7ff9a89ce640 1 -- 172.21.15.89:0/2414631157 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9a410ec80 con 0x7ff9a40fe4f0 2024-09-13T02:52:24.161 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:24.141+0000 7ff9a89ce640 1 -- 172.21.15.89:0/2414631157 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9a40fa040 con 0x7ff9a40fe4f0 2024-09-13T02:52:24.161 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:24.141+0000 7ff992ffd640 1 -- 172.21.15.89:0/2414631157 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7ff998009710 con 0x7ff9a40fe4f0 2024-09-13T02:52:24.162 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:24.142+0000 7ff992ffd640 1 --2- 172.21.15.89:0/2414631157 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7ff98c06ed60 0x7ff98c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:24.162 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:24.142+0000 7ff9a259c640 1 --2- 172.21.15.89:0/2414631157 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7ff98c06ed60 0x7ff98c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:24.162 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:24.142+0000 7ff992ffd640 1 -- 172.21.15.89:0/2414631157 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7ff99808da60 con 0x7ff9a40fe4f0 2024-09-13T02:52:24.162 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:24.142+0000 7ff9a259c640 1 --2- 172.21.15.89:0/2414631157 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7ff98c06ed60 0x7ff98c071210 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff99400b020 tx=0x7ff994009da0 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:52:24.162 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:24.146+0000 7ff992ffd640 1 -- 172.21.15.89:0/2414631157 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7ff99804d2a0 con 0x7ff9a40fe4f0 2024-09-13T02:52:24.312 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:24.310+0000 7ff9a89ce640 1 -- 172.21.15.89:0/2414631157 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7ff9a410ef40 con 0x7ff9a40fe4f0 2024-09-13T02:52:24.312 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:24.311+0000 7ff992ffd640 1 -- 172.21.15.89:0/2414631157 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v21)=0 v21) v1 ==== 155+0+0 (secure 0 0 0) 0x7ff99805a610 con 0x7ff9a40fe4f0 2024-09-13T02:52:24.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:24.313+0000 7ff9a89ce640 1 -- 172.21.15.89:0/2414631157 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7ff98c06ed60 msgr2=0x7ff98c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:24.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:24.313+0000 7ff9a89ce640 1 --2- 172.21.15.89:0/2414631157 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7ff98c06ed60 0x7ff98c071210 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff99400b020 tx=0x7ff994009da0 comp rx=0 tx=0).stop 2024-09-13T02:52:24.314 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:24.313+0000 7ff9a89ce640 1 -- 172.21.15.89:0/2414631157 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9a40fe4f0 msgr2=0x7ff9a410d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:24.315 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:24.313+0000 7ff9a89ce640 1 --2- 172.21.15.89:0/2414631157 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9a40fe4f0 0x7ff9a410d630 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7ff998002870 tx=0x7ff998004600 comp rx=0 tx=0).stop 2024-09-13T02:52:24.315 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:24.313+0000 7ff9a89ce640 1 -- 172.21.15.89:0/2414631157 shutdown_connections 2024-09-13T02:52:24.315 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:24.313+0000 7ff9a89ce640 1 --2- 172.21.15.89:0/2414631157 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9a40fe4f0 0x7ff9a410d630 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:24.315 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:24.313+0000 7ff9a89ce640 1 --2- 172.21.15.89:0/2414631157 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7ff98c06ed60 0x7ff98c071210 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:24.315 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:24.313+0000 7ff9a89ce640 1 --2- 172.21.15.89:0/2414631157 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff9a40fdba0 0x7ff9a410d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:24.315 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:24.313+0000 7ff9a89ce640 1 -- 172.21.15.89:0/2414631157 >> 172.21.15.89:0/2414631157 conn(0x7ff9a40f63a0 msgr2=0x7ff9a40f7b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:52:24.315 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:24.313+0000 7ff9a89ce640 1 -- 172.21.15.89:0/2414631157 shutdown_connections 2024-09-13T02:52:24.315 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:24.313+0000 7ff9a89ce640 1 -- 172.21.15.89:0/2414631157 wait complete. 2024-09-13T02:52:24.896 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:52:24 smithi089 ceph-mon[27639]: pgmap v194: 65 pgs: 65 active+clean; 581 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 341 B/s wr, 4 op/s 2024-09-13T02:52:24.921 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -e sha1=7741f7f9ee20524f89b8f61d1609b32fb3b1570a -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-09-13T02:52:24.933 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:52:24 smithi131 ceph-mon[34689]: pgmap v194: 65 pgs: 65 active+clean; 581 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 341 B/s wr, 4 op/s 2024-09-13T02:52:25.168 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T02:52:26.689 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:26.685+0000 7f4bac7b8640 1 -- 172.21.15.89:0/1885744686 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ba40ff6d0 msgr2=0x7f4ba4101ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:26.689 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:26.685+0000 7f4bac7b8640 1 --2- 172.21.15.89:0/1885744686 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ba40ff6d0 0x7f4ba4101ab0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f4b980048d0 tx=0x7f4b98009da0 comp rx=0 tx=0).stop 2024-09-13T02:52:26.689 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:26.685+0000 7f4bac7b8640 1 -- 172.21.15.89:0/1885744686 shutdown_connections 2024-09-13T02:52:26.689 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:26.685+0000 7f4bac7b8640 1 --2- 172.21.15.89:0/1885744686 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ba40ff6d0 0x7f4ba4101ab0 secure :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f4b980048d0 tx=0x7f4b98009da0 comp rx=0 tx=0).stop 2024-09-13T02:52:26.689 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:26.685+0000 7f4bac7b8640 1 --2- 172.21.15.89:0/1885744686 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4ba4066710 0x7f4ba40ff190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:26.689 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:26.685+0000 7f4bac7b8640 1 -- 172.21.15.89:0/1885744686 >> 172.21.15.89:0/1885744686 conn(0x7f4ba40f6c40 msgr2=0x7f4ba40f9070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:52:26.689 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:26.685+0000 7f4bac7b8640 1 -- 172.21.15.89:0/1885744686 shutdown_connections 2024-09-13T02:52:26.690 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:26.685+0000 7f4bac7b8640 1 -- 172.21.15.89:0/1885744686 wait complete. 2024-09-13T02:52:26.690 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:26.686+0000 7f4bac7b8640 1 Processor -- start 2024-09-13T02:52:26.690 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:26.686+0000 7f4bac7b8640 1 -- start start 2024-09-13T02:52:26.690 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:26.686+0000 7f4bac7b8640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4ba4066710 0x7f4ba410d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:26.690 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:26.686+0000 7f4bac7b8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ba410d7c0 0x7f4ba410e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:26.690 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:26.686+0000 7f4bac7b8640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba410dc80 con 0x7f4ba410d7c0 2024-09-13T02:52:26.690 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:26.686+0000 7f4bac7b8640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ba410ddc0 con 0x7f4ba4066710 2024-09-13T02:52:26.690 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:26.686+0000 7f4ba9d53640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ba410d7c0 0x7f4ba410e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:26.690 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:26.686+0000 7f4ba9d53640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ba410d7c0 0x7f4ba410e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:48740/0 (socket says 172.21.15.89:48740) 2024-09-13T02:52:26.690 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:26.686+0000 7f4ba9d53640 1 -- 172.21.15.89:0/1617837976 learned_addr learned my addr 172.21.15.89:0/1617837976 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:52:26.690 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:26.686+0000 7f4baa554640 1 --2- 172.21.15.89:0/1617837976 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4ba4066710 0x7f4ba410d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:26.690 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:26.686+0000 7f4ba9d53640 1 -- 172.21.15.89:0/1617837976 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4ba4066710 msgr2=0x7f4ba410d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:26.690 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:26.686+0000 7f4ba9d53640 1 --2- 172.21.15.89:0/1617837976 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4ba4066710 0x7f4ba410d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:26.691 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:26.686+0000 7f4ba9d53640 1 -- 172.21.15.89:0/1617837976 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b98005040 con 0x7f4ba410d7c0 2024-09-13T02:52:26.691 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:26.687+0000 7f4ba9d53640 1 --2- 172.21.15.89:0/1617837976 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ba410d7c0 0x7f4ba410e5e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f4b98009040 tx=0x7f4b98009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:52:26.691 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:26.687+0000 7f4ba2ffd640 1 -- 172.21.15.89:0/1617837976 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b98038070 con 0x7f4ba410d7c0 2024-09-13T02:52:26.691 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:26.687+0000 7f4ba2ffd640 1 -- 172.21.15.89:0/1617837976 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4b98004290 con 0x7f4ba410d7c0 2024-09-13T02:52:26.691 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:26.687+0000 7f4ba2ffd640 1 -- 172.21.15.89:0/1617837976 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b9802c830 con 0x7f4ba410d7c0 2024-09-13T02:52:26.691 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:26.687+0000 7f4bac7b8640 1 -- 172.21.15.89:0/1617837976 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ba410eb80 con 0x7f4ba410d7c0 2024-09-13T02:52:26.691 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:26.687+0000 7f4bac7b8640 1 -- 172.21.15.89:0/1617837976 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ba410f0c0 con 0x7f4ba410d7c0 2024-09-13T02:52:26.691 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:26.688+0000 7f4bac7b8640 1 -- 172.21.15.89:0/1617837976 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ba40fa8e0 con 0x7f4ba410d7c0 2024-09-13T02:52:26.692 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:26.688+0000 7f4ba2ffd640 1 -- 172.21.15.89:0/1617837976 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f4b98030020 con 0x7f4ba410d7c0 2024-09-13T02:52:26.692 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:26.689+0000 7f4ba2ffd640 1 --2- 172.21.15.89:0/1617837976 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f4b8c06ed60 0x7f4b8c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:26.692 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:26.689+0000 7f4baa554640 1 --2- 172.21.15.89:0/1617837976 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f4b8c06ed60 0x7f4b8c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:26.692 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:26.689+0000 7f4ba2ffd640 1 -- 172.21.15.89:0/1617837976 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f4b980ae6f0 con 0x7f4ba410d7c0 2024-09-13T02:52:26.692 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:26.689+0000 7f4baa554640 1 --2- 172.21.15.89:0/1617837976 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f4b8c06ed60 0x7f4b8c071210 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4ba4066470 tx=0x7f4b9c00b040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:52:26.694 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:26.693+0000 7f4ba2ffd640 1 -- 172.21.15.89:0/1617837976 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f4b9807b7c0 con 0x7f4ba410d7c0 2024-09-13T02:52:26.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:52:26 smithi089 ceph-mon[27639]: pgmap v195: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.2 KiB/s rd, 1023 B/s wr, 5 op/s 2024-09-13T02:52:26.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:26.848+0000 7f4bac7b8640 1 -- 172.21.15.89:0/1617837976 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7f4ba404b720 con 0x7f4ba410d7c0 2024-09-13T02:52:26.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:26.848+0000 7f4ba2ffd640 1 -- 172.21.15.89:0/1617837976 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v21)=0 v21) v1 ==== 163+0+0 (secure 0 0 0) 0x7f4ba404b720 con 0x7f4ba410d7c0 2024-09-13T02:52:26.852 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:26.850+0000 7f4bac7b8640 1 -- 172.21.15.89:0/1617837976 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f4b8c06ed60 msgr2=0x7f4b8c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:26.852 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:26.850+0000 7f4bac7b8640 1 --2- 172.21.15.89:0/1617837976 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f4b8c06ed60 0x7f4b8c071210 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f4ba4066470 tx=0x7f4b9c00b040 comp rx=0 tx=0).stop 2024-09-13T02:52:26.852 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:26.850+0000 7f4bac7b8640 1 -- 172.21.15.89:0/1617837976 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ba410d7c0 msgr2=0x7f4ba410e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:26.852 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:26.850+0000 7f4bac7b8640 1 --2- 172.21.15.89:0/1617837976 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ba410d7c0 0x7f4ba410e5e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f4b98009040 tx=0x7f4b98009da0 comp rx=0 tx=0).stop 2024-09-13T02:52:26.852 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:26.850+0000 7f4bac7b8640 1 -- 172.21.15.89:0/1617837976 shutdown_connections 2024-09-13T02:52:26.852 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:26.850+0000 7f4bac7b8640 1 --2- 172.21.15.89:0/1617837976 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ba410d7c0 0x7f4ba410e5e0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:26.852 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:26.850+0000 7f4bac7b8640 1 --2- 172.21.15.89:0/1617837976 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f4b8c06ed60 0x7f4b8c071210 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:26.852 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:26.850+0000 7f4bac7b8640 1 --2- 172.21.15.89:0/1617837976 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4ba4066710 0x7f4ba410d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:26.852 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:26.850+0000 7f4bac7b8640 1 -- 172.21.15.89:0/1617837976 >> 172.21.15.89:0/1617837976 conn(0x7f4ba40f6c40 msgr2=0x7f4ba40f7060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:52:26.852 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:26.850+0000 7f4bac7b8640 1 -- 172.21.15.89:0/1617837976 shutdown_connections 2024-09-13T02:52:26.853 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:26.850+0000 7f4bac7b8640 1 -- 172.21.15.89:0/1617837976 wait complete. 2024-09-13T02:52:26.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:52:26 smithi131 ceph-mon[34689]: pgmap v195: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.2 KiB/s rd, 1023 B/s wr, 5 op/s 2024-09-13T02:52:27.450 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -e sha1=7741f7f9ee20524f89b8f61d1609b32fb3b1570a -- bash -c 'ceph config set global log_to_journald false --force' 2024-09-13T02:52:27.702 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T02:52:28.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:52:28 smithi089 ceph-mon[27639]: pgmap v196: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 1023 B/s wr, 4 op/s 2024-09-13T02:52:28.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:52:28 smithi131 ceph-mon[34689]: pgmap v196: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.4 KiB/s rd, 1023 B/s wr, 4 op/s 2024-09-13T02:52:29.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:29.314+0000 7f10f47be640 1 -- 172.21.15.89:0/3735386410 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10ec0fc570 msgr2=0x7f10ec0fc980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:29.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:29.314+0000 7f10f47be640 1 --2- 172.21.15.89:0/3735386410 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10ec0fc570 0x7f10ec0fc980 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f10e80048d0 tx=0x7f10e8009da0 comp rx=0 tx=0).stop 2024-09-13T02:52:29.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:29.314+0000 7f10f47be640 1 -- 172.21.15.89:0/3735386410 shutdown_connections 2024-09-13T02:52:29.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:29.314+0000 7f10f47be640 1 --2- 172.21.15.89:0/3735386410 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10ec0fd840 0x7f10ec0fdcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:29.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:29.314+0000 7f10f47be640 1 --2- 172.21.15.89:0/3735386410 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10ec0fc570 0x7f10ec0fc980 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:29.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:29.314+0000 7f10f47be640 1 -- 172.21.15.89:0/3735386410 >> 172.21.15.89:0/3735386410 conn(0x7f10ec0f7d30 msgr2=0x7f10ec0fa160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:52:29.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:29.314+0000 7f10f47be640 1 -- 172.21.15.89:0/3735386410 shutdown_connections 2024-09-13T02:52:29.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:29.314+0000 7f10f47be640 1 -- 172.21.15.89:0/3735386410 wait complete. 2024-09-13T02:52:29.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:29.314+0000 7f10f47be640 1 Processor -- start 2024-09-13T02:52:29.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:29.314+0000 7f10f47be640 1 -- start start 2024-09-13T02:52:29.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:29.314+0000 7f10f47be640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10ec0fc570 0x7f10ec10d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:29.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:29.314+0000 7f10f47be640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10ec0fd840 0x7f10ec10d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:29.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:29.314+0000 7f10f47be640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10ec10dc00 con 0x7f10ec0fd840 2024-09-13T02:52:29.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:29.314+0000 7f10f47be640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10ec10e420 con 0x7f10ec0fc570 2024-09-13T02:52:29.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:29.315+0000 7f10f1d59640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10ec0fd840 0x7f10ec10d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:29.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:29.315+0000 7f10f1d59640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10ec0fd840 0x7f10ec10d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:48754/0 (socket says 172.21.15.89:48754) 2024-09-13T02:52:29.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:29.315+0000 7f10f1d59640 1 -- 172.21.15.89:0/3830540941 learned_addr learned my addr 172.21.15.89:0/3830540941 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:52:29.320 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:29.315+0000 7f10f255a640 1 --2- 172.21.15.89:0/3830540941 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10ec0fc570 0x7f10ec10d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:29.320 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:29.315+0000 7f10f1d59640 1 -- 172.21.15.89:0/3830540941 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10ec0fc570 msgr2=0x7f10ec10d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:29.320 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:29.315+0000 7f10f1d59640 1 --2- 172.21.15.89:0/3830540941 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10ec0fc570 0x7f10ec10d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:29.320 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:29.315+0000 7f10f1d59640 1 -- 172.21.15.89:0/3830540941 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10e8005040 con 0x7f10ec0fd840 2024-09-13T02:52:29.320 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:29.315+0000 7f10f1d59640 1 --2- 172.21.15.89:0/3830540941 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10ec0fd840 0x7f10ec10d5b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f10dc00c830 tx=0x7f10dc004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:52:29.320 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:29.315+0000 7f10e2ffd640 1 -- 172.21.15.89:0/3830540941 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f10dc00a7d0 con 0x7f10ec0fd840 2024-09-13T02:52:29.320 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:29.315+0000 7f10e2ffd640 1 -- 172.21.15.89:0/3830540941 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f10dc00add0 con 0x7f10ec0fd840 2024-09-13T02:52:29.320 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:29.315+0000 7f10f47be640 1 -- 172.21.15.89:0/3830540941 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10ec10e6b0 con 0x7f10ec0fd840 2024-09-13T02:52:29.320 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:29.315+0000 7f10e2ffd640 1 -- 172.21.15.89:0/3830540941 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f10dc0113a0 con 0x7f10ec0fd840 2024-09-13T02:52:29.320 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:29.315+0000 7f10f47be640 1 -- 172.21.15.89:0/3830540941 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10ec10ec50 con 0x7f10ec0fd840 2024-09-13T02:52:29.320 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:29.316+0000 7f10f47be640 1 -- 172.21.15.89:0/3830540941 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10ec0fb9d0 con 0x7f10ec0fd840 2024-09-13T02:52:29.320 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:29.317+0000 7f10e2ffd640 1 -- 172.21.15.89:0/3830540941 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f10dc012400 con 0x7f10ec0fd840 2024-09-13T02:52:29.321 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:29.318+0000 7f10e2ffd640 1 --2- 172.21.15.89:0/3830540941 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f10d806ed60 0x7f10d8071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:29.321 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:29.318+0000 7f10f255a640 1 --2- 172.21.15.89:0/3830540941 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f10d806ed60 0x7f10d8071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:29.321 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:29.318+0000 7f10e2ffd640 1 -- 172.21.15.89:0/3830540941 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f10dc08e240 con 0x7f10ec0fd840 2024-09-13T02:52:29.321 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:29.318+0000 7f10f255a640 1 --2- 172.21.15.89:0/3830540941 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f10d806ed60 0x7f10d8071210 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f10e8000c00 tx=0x7f10e8035040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:52:29.323 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:29.322+0000 7f10e2ffd640 1 -- 172.21.15.89:0/3830540941 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f10dc05b4f0 con 0x7f10ec0fd840 2024-09-13T02:52:29.480 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:29.478+0000 7f10f47be640 1 -- 172.21.15.89:0/3830540941 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7f10ec04b720 con 0x7f10ec0fd840 2024-09-13T02:52:29.480 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:29.479+0000 7f10e2ffd640 1 -- 172.21.15.89:0/3830540941 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v21)=0 v21) v1 ==== 135+0+0 (secure 0 0 0) 0x7f10dc05ae90 con 0x7f10ec0fd840 2024-09-13T02:52:29.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:29.481+0000 7f10f47be640 1 -- 172.21.15.89:0/3830540941 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f10d806ed60 msgr2=0x7f10d8071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:29.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:29.481+0000 7f10f47be640 1 --2- 172.21.15.89:0/3830540941 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f10d806ed60 0x7f10d8071210 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f10e8000c00 tx=0x7f10e8035040 comp rx=0 tx=0).stop 2024-09-13T02:52:29.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:29.481+0000 7f10f47be640 1 -- 172.21.15.89:0/3830540941 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10ec0fd840 msgr2=0x7f10ec10d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:29.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:29.481+0000 7f10f47be640 1 --2- 172.21.15.89:0/3830540941 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10ec0fd840 0x7f10ec10d5b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f10dc00c830 tx=0x7f10dc004430 comp rx=0 tx=0).stop 2024-09-13T02:52:29.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:29.481+0000 7f10f47be640 1 -- 172.21.15.89:0/3830540941 shutdown_connections 2024-09-13T02:52:29.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:29.481+0000 7f10f47be640 1 --2- 172.21.15.89:0/3830540941 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f10ec0fd840 0x7f10ec10d5b0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:29.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:29.481+0000 7f10f47be640 1 --2- 172.21.15.89:0/3830540941 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f10d806ed60 0x7f10d8071210 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:29.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:29.481+0000 7f10f47be640 1 --2- 172.21.15.89:0/3830540941 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f10ec0fc570 0x7f10ec10d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:29.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:29.481+0000 7f10f47be640 1 -- 172.21.15.89:0/3830540941 >> 172.21.15.89:0/3830540941 conn(0x7f10ec0f7d30 msgr2=0x7f10ec0f94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:52:29.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:29.481+0000 7f10f47be640 1 -- 172.21.15.89:0/3830540941 shutdown_connections 2024-09-13T02:52:29.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:29.481+0000 7f10f47be640 1 -- 172.21.15.89:0/3830540941 wait complete. 2024-09-13T02:52:29.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:52:29 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:52:29.933 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:52:29 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:52:30.204 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -e sha1=7741f7f9ee20524f89b8f61d1609b32fb3b1570a -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2024-09-13T02:52:30.449 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T02:52:30.901 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:52:30 smithi089 ceph-mon[27639]: pgmap v197: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.2 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-13T02:52:30.933 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:52:30 smithi131 ceph-mon[34689]: pgmap v197: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.2 KiB/s rd, 1.2 KiB/s wr, 6 op/s 2024-09-13T02:52:32.082 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:32.079+0000 7f1342dda640 1 -- 172.21.15.89:0/3221589680 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f133c0fb450 msgr2=0x7f133c0fb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:32.082 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:32.079+0000 7f1342dda640 1 --2- 172.21.15.89:0/3221589680 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f133c0fb450 0x7f133c0fb860 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f13300048d0 tx=0x7f1330009da0 comp rx=0 tx=0).stop 2024-09-13T02:52:32.082 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:32.079+0000 7f1342dda640 1 -- 172.21.15.89:0/3221589680 shutdown_connections 2024-09-13T02:52:32.082 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:32.079+0000 7f1342dda640 1 --2- 172.21.15.89:0/3221589680 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f133c0fc720 0x7f133c0fcb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:32.083 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:32.079+0000 7f1342dda640 1 --2- 172.21.15.89:0/3221589680 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f133c0fb450 0x7f133c0fb860 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:32.083 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:32.079+0000 7f1342dda640 1 -- 172.21.15.89:0/3221589680 >> 172.21.15.89:0/3221589680 conn(0x7f133c0f6c10 msgr2=0x7f133c0f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:52:32.083 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:32.079+0000 7f1342dda640 1 -- 172.21.15.89:0/3221589680 shutdown_connections 2024-09-13T02:52:32.083 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:32.079+0000 7f1342dda640 1 -- 172.21.15.89:0/3221589680 wait complete. 2024-09-13T02:52:32.083 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:32.080+0000 7f1342dda640 1 Processor -- start 2024-09-13T02:52:32.083 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:32.080+0000 7f1342dda640 1 -- start start 2024-09-13T02:52:32.083 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:32.080+0000 7f1342dda640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f133c0fb450 0x7f133c0ff520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:32.083 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:32.080+0000 7f1342dda640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f133c0fc720 0x7f133c0fda60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:32.083 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:32.080+0000 7f1342dda640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f133c0fe030 con 0x7f133c0fc720 2024-09-13T02:52:32.083 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:32.080+0000 7f1342dda640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f133c0fe170 con 0x7f133c0fb450 2024-09-13T02:52:32.083 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:32.080+0000 7f133bfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f133c0fc720 0x7f133c0fda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:32.083 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:32.080+0000 7f133bfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f133c0fc720 0x7f133c0fda60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36624/0 (socket says 172.21.15.89:36624) 2024-09-13T02:52:32.083 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:32.080+0000 7f133bfff640 1 -- 172.21.15.89:0/1867834093 learned_addr learned my addr 172.21.15.89:0/1867834093 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:52:32.084 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:32.080+0000 7f1340b76640 1 --2- 172.21.15.89:0/1867834093 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f133c0fb450 0x7f133c0ff520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:32.084 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:32.080+0000 7f133bfff640 1 -- 172.21.15.89:0/1867834093 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f133c0fb450 msgr2=0x7f133c0ff520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:32.084 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:32.080+0000 7f133bfff640 1 --2- 172.21.15.89:0/1867834093 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f133c0fb450 0x7f133c0ff520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:32.084 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:32.080+0000 7f133bfff640 1 -- 172.21.15.89:0/1867834093 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1330005040 con 0x7f133c0fc720 2024-09-13T02:52:32.084 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:32.081+0000 7f133bfff640 1 --2- 172.21.15.89:0/1867834093 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f133c0fc720 0x7f133c0fda60 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f132800b790 tx=0x7f13280091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:52:32.084 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:32.081+0000 7f13397fa640 1 -- 172.21.15.89:0/1867834093 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f132800c700 con 0x7f133c0fc720 2024-09-13T02:52:32.084 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:32.081+0000 7f1342dda640 1 -- 172.21.15.89:0/1867834093 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f133c0fe450 con 0x7f133c0fc720 2024-09-13T02:52:32.084 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:32.081+0000 7f13397fa640 1 -- 172.21.15.89:0/1867834093 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f132800cd00 con 0x7f133c0fc720 2024-09-13T02:52:32.084 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:32.081+0000 7f13397fa640 1 -- 172.21.15.89:0/1867834093 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1328015e80 con 0x7f133c0fc720 2024-09-13T02:52:32.084 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:32.081+0000 7f1342dda640 1 -- 172.21.15.89:0/1867834093 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f133c115240 con 0x7f133c0fc720 2024-09-13T02:52:32.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:32.082+0000 7f1342dda640 1 -- 172.21.15.89:0/1867834093 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f133c0fa8b0 con 0x7f133c0fc720 2024-09-13T02:52:32.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:32.082+0000 7f13397fa640 1 -- 172.21.15.89:0/1867834093 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f1328012070 con 0x7f133c0fc720 2024-09-13T02:52:32.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:32.083+0000 7f13397fa640 1 --2- 172.21.15.89:0/1867834093 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f132c06ed50 0x7f132c071200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:32.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:32.083+0000 7f13397fa640 1 -- 172.21.15.89:0/1867834093 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f132808dae0 con 0x7f133c0fc720 2024-09-13T02:52:32.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:32.083+0000 7f1340b76640 1 --2- 172.21.15.89:0/1867834093 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f132c06ed50 0x7f132c071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:32.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:32.083+0000 7f1340b76640 1 --2- 172.21.15.89:0/1867834093 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f132c06ed50 0x7f132c071200 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1330007ac0 tx=0x7f1330035040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:52:32.088 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:32.087+0000 7f13397fa640 1 -- 172.21.15.89:0/1867834093 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f132805abb0 con 0x7f133c0fc720 2024-09-13T02:52:32.256 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:32.255+0000 7f1342dda640 1 -- 172.21.15.89:0/1867834093 --> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:7741f7f9ee20524f89b8f61d1609b32fb3b1570a", "target": ["mon-mgr", ""]}) v1 -- 0x7f133c104040 con 0x7f132c06ed50 2024-09-13T02:52:32.261 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:32.260+0000 7f13397fa640 1 -- 172.21.15.89:0/1867834093 <== mgr.14204 v2:172.21.15.89:6800/1506060926 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7f133c104040 con 0x7f132c06ed50 2024-09-13T02:52:32.261 INFO:teuthology.orchestra.run.smithi089.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:7741f7f9ee20524f89b8f61d1609b32fb3b1570a 2024-09-13T02:52:32.264 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:32.262+0000 7f1342dda640 1 -- 172.21.15.89:0/1867834093 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f132c06ed50 msgr2=0x7f132c071200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:32.264 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:32.262+0000 7f1342dda640 1 --2- 172.21.15.89:0/1867834093 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f132c06ed50 0x7f132c071200 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1330007ac0 tx=0x7f1330035040 comp rx=0 tx=0).stop 2024-09-13T02:52:32.264 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:32.262+0000 7f1342dda640 1 -- 172.21.15.89:0/1867834093 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f133c0fc720 msgr2=0x7f133c0fda60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:32.264 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:32.262+0000 7f1342dda640 1 --2- 172.21.15.89:0/1867834093 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f133c0fc720 0x7f133c0fda60 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f132800b790 tx=0x7f13280091d0 comp rx=0 tx=0).stop 2024-09-13T02:52:32.264 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:32.263+0000 7f1342dda640 1 -- 172.21.15.89:0/1867834093 shutdown_connections 2024-09-13T02:52:32.264 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:32.263+0000 7f1342dda640 1 --2- 172.21.15.89:0/1867834093 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f133c0fc720 0x7f133c0fda60 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:32.265 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:32.263+0000 7f1342dda640 1 --2- 172.21.15.89:0/1867834093 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f132c06ed50 0x7f132c071200 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:32.265 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:32.263+0000 7f1342dda640 1 --2- 172.21.15.89:0/1867834093 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f133c0fb450 0x7f133c0ff520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:32.265 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:32.263+0000 7f1342dda640 1 -- 172.21.15.89:0/1867834093 >> 172.21.15.89:0/1867834093 conn(0x7f133c0f6c10 msgr2=0x7f133c066160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:52:32.265 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:32.263+0000 7f1342dda640 1 -- 172.21.15.89:0/1867834093 shutdown_connections 2024-09-13T02:52:32.265 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:32.263+0000 7f1342dda640 1 -- 172.21.15.89:0/1867834093 wait complete. 2024-09-13T02:52:32.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:52:32 smithi089 ceph-mon[27639]: pgmap v198: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 853 B/s wr, 4 op/s 2024-09-13T02:52:32.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:52:32 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:52:32.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:52:32 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:52:32.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:52:32 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:52:32.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:52:32 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:52:32.911 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-09-13T02:52:32.912 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi089.front.sepia.ceph.com 2024-09-13T02:52:32.912 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -e sha1=7741f7f9ee20524f89b8f61d1609b32fb3b1570a -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done' 2024-09-13T02:52:32.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:52:32 smithi131 ceph-mon[34689]: pgmap v198: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 853 B/s wr, 4 op/s 2024-09-13T02:52:32.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:52:32 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:52:32.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:52:32 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:52:32.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:52:32 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:52:32.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:52:32 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:52:33.169 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T02:52:33.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:52:33 smithi131 ceph-mon[34689]: from='client.14532 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:7741f7f9ee20524f89b8f61d1609b32fb3b1570a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:52:33.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:52:33 smithi131 ceph-mon[34689]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:7741f7f9ee20524f89b8f61d1609b32fb3b1570a 2024-09-13T02:52:33.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:52:33 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:52:33.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:52:33 smithi131 ceph-mon[34689]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:7741f7f9ee20524f89b8f61d1609b32fb3b1570a 2024-09-13T02:52:33.937 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:52:33 smithi089 ceph-mon[27639]: from='client.14532 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:7741f7f9ee20524f89b8f61d1609b32fb3b1570a", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:52:33.937 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:52:33 smithi089 ceph-mon[27639]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:7741f7f9ee20524f89b8f61d1609b32fb3b1570a 2024-09-13T02:52:33.937 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:52:33 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:52:33.937 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:52:33 smithi089 ceph-mon[27639]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:7741f7f9ee20524f89b8f61d1609b32fb3b1570a 2024-09-13T02:52:34.850 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:34.836+0000 7fb99f85a640 1 -- 172.21.15.89:0/112269771 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9980fc520 msgr2=0x7fb9980fc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:34.850 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:34.836+0000 7fb99f85a640 1 --2- 172.21.15.89:0/112269771 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9980fc520 0x7fb9980fc930 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb9940048d0 tx=0x7fb994009da0 comp rx=0 tx=0).stop 2024-09-13T02:52:34.850 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:34.836+0000 7fb99f85a640 1 -- 172.21.15.89:0/112269771 shutdown_connections 2024-09-13T02:52:34.850 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:34.836+0000 7fb99f85a640 1 --2- 172.21.15.89:0/112269771 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb9980fd7f0 0x7fb9980fdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:34.850 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:34.836+0000 7fb99f85a640 1 --2- 172.21.15.89:0/112269771 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9980fc520 0x7fb9980fc930 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:34.850 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:34.836+0000 7fb99f85a640 1 -- 172.21.15.89:0/112269771 >> 172.21.15.89:0/112269771 conn(0x7fb9980f7ce0 msgr2=0x7fb9980fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:52:34.850 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:34.836+0000 7fb99f85a640 1 -- 172.21.15.89:0/112269771 shutdown_connections 2024-09-13T02:52:34.850 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:34.836+0000 7fb99f85a640 1 -- 172.21.15.89:0/112269771 wait complete. 2024-09-13T02:52:34.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:34.837+0000 7fb99f85a640 1 Processor -- start 2024-09-13T02:52:34.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:34.837+0000 7fb99f85a640 1 -- start start 2024-09-13T02:52:34.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:34.837+0000 7fb99f85a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9980fc520 0x7fb99810d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:34.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:34.837+0000 7fb99f85a640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb9980fd7f0 0x7fb99810d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:34.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:34.837+0000 7fb99f85a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb99810e450 con 0x7fb9980fc520 2024-09-13T02:52:34.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:34.837+0000 7fb99f85a640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb99810e5c0 con 0x7fb9980fd7f0 2024-09-13T02:52:34.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:34.837+0000 7fb99d5f6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9980fc520 0x7fb99810d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:34.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:34.837+0000 7fb99d5f6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9980fc520 0x7fb99810d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36642/0 (socket says 172.21.15.89:36642) 2024-09-13T02:52:34.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:34.837+0000 7fb99d5f6640 1 -- 172.21.15.89:0/2100253941 learned_addr learned my addr 172.21.15.89:0/2100253941 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:52:34.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:34.837+0000 7fb99d5f6640 1 -- 172.21.15.89:0/2100253941 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb9980fd7f0 msgr2=0x7fb99810d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:34.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:34.837+0000 7fb99d5f6640 1 --2- 172.21.15.89:0/2100253941 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb9980fd7f0 0x7fb99810d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:34.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:34.837+0000 7fb99d5f6640 1 -- 172.21.15.89:0/2100253941 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb994005040 con 0x7fb9980fc520 2024-09-13T02:52:34.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:34.837+0000 7fb99d5f6640 1 --2- 172.21.15.89:0/2100253941 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9980fc520 0x7fb99810d0a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb994003080 tx=0x7fb994009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:52:34.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:34.837+0000 7fb98dffb640 1 -- 172.21.15.89:0/2100253941 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb994038070 con 0x7fb9980fc520 2024-09-13T02:52:34.852 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:34.838+0000 7fb98dffb640 1 -- 172.21.15.89:0/2100253941 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb99402abd0 con 0x7fb9980fc520 2024-09-13T02:52:34.852 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:34.838+0000 7fb98dffb640 1 -- 172.21.15.89:0/2100253941 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb99403e670 con 0x7fb9980fc520 2024-09-13T02:52:34.852 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:34.838+0000 7fb99f85a640 1 -- 172.21.15.89:0/2100253941 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb99810e840 con 0x7fb9980fc520 2024-09-13T02:52:34.852 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:34.838+0000 7fb99f85a640 1 -- 172.21.15.89:0/2100253941 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb99810ed60 con 0x7fb9980fc520 2024-09-13T02:52:34.852 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:34.839+0000 7fb99f85a640 1 -- 172.21.15.89:0/2100253941 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9980fb980 con 0x7fb9980fc520 2024-09-13T02:52:34.852 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:34.839+0000 7fb98dffb640 1 -- 172.21.15.89:0/2100253941 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fb994030020 con 0x7fb9980fc520 2024-09-13T02:52:34.852 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:34.840+0000 7fb98dffb640 1 --2- 172.21.15.89:0/2100253941 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fb98406ed60 0x7fb984071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:34.852 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:34.840+0000 7fb98dffb640 1 -- 172.21.15.89:0/2100253941 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fb9940ae5e0 con 0x7fb9980fc520 2024-09-13T02:52:34.852 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:34.840+0000 7fb99cdf5640 1 --2- 172.21.15.89:0/2100253941 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fb98406ed60 0x7fb984071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:34.852 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:34.840+0000 7fb99cdf5640 1 --2- 172.21.15.89:0/2100253941 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fb98406ed60 0x7fb984071210 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb99810ce50 tx=0x7fb988006d20 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:52:34.852 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:34.845+0000 7fb98dffb640 1 -- 172.21.15.89:0/2100253941 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fb99407b6b0 con 0x7fb9980fc520 2024-09-13T02:52:34.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:52:34 smithi131 ceph-mon[34689]: pgmap v199: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 853 B/s wr, 4 op/s 2024-09-13T02:52:35.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:52:34 smithi089 ceph-mon[27639]: pgmap v199: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 853 B/s wr, 4 op/s 2024-09-13T02:52:35.046 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.045+0000 7fb99f85a640 1 -- 172.21.15.89:0/2100253941 --> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb99810ef80 con 0x7fb98406ed60 2024-09-13T02:52:35.047 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.046+0000 7fb98dffb640 1 -- 172.21.15.89:0/2100253941 <== mgr.14204 v2:172.21.15.89:6800/1506060926 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7fb99810ef80 con 0x7fb98406ed60 2024-09-13T02:52:35.050 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.048+0000 7fb99f85a640 1 -- 172.21.15.89:0/2100253941 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fb98406ed60 msgr2=0x7fb984071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:35.050 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.048+0000 7fb99f85a640 1 --2- 172.21.15.89:0/2100253941 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fb98406ed60 0x7fb984071210 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb99810ce50 tx=0x7fb988006d20 comp rx=0 tx=0).stop 2024-09-13T02:52:35.050 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.048+0000 7fb99f85a640 1 -- 172.21.15.89:0/2100253941 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9980fc520 msgr2=0x7fb99810d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:35.050 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.048+0000 7fb99f85a640 1 --2- 172.21.15.89:0/2100253941 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9980fc520 0x7fb99810d0a0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb994003080 tx=0x7fb994009da0 comp rx=0 tx=0).stop 2024-09-13T02:52:35.050 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.048+0000 7fb99f85a640 1 -- 172.21.15.89:0/2100253941 shutdown_connections 2024-09-13T02:52:35.050 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.048+0000 7fb99f85a640 1 --2- 172.21.15.89:0/2100253941 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fb98406ed60 0x7fb984071210 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:35.050 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.048+0000 7fb99f85a640 1 --2- 172.21.15.89:0/2100253941 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb9980fd7f0 0x7fb99810d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:35.050 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.048+0000 7fb99f85a640 1 --2- 172.21.15.89:0/2100253941 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb9980fc520 0x7fb99810d0a0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:35.050 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.048+0000 7fb99f85a640 1 -- 172.21.15.89:0/2100253941 >> 172.21.15.89:0/2100253941 conn(0x7fb9980f7ce0 msgr2=0x7fb9980f9480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:52:35.050 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.048+0000 7fb99f85a640 1 -- 172.21.15.89:0/2100253941 shutdown_connections 2024-09-13T02:52:35.050 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.048+0000 7fb99f85a640 1 -- 172.21.15.89:0/2100253941 wait complete. 2024-09-13T02:52:35.059 INFO:teuthology.orchestra.run.smithi089.stdout:true 2024-09-13T02:52:35.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.138+0000 7fb46063c640 1 -- 172.21.15.89:0/4255938382 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb458065c40 msgr2=0x7fb4580ff140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:35.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.138+0000 7fb46063c640 1 --2- 172.21.15.89:0/4255938382 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb458065c40 0x7fb4580ff140 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fb4540048d0 tx=0x7fb454009da0 comp rx=0 tx=0).stop 2024-09-13T02:52:35.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.138+0000 7fb46063c640 1 -- 172.21.15.89:0/4255938382 shutdown_connections 2024-09-13T02:52:35.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.138+0000 7fb46063c640 1 --2- 172.21.15.89:0/4255938382 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb4580ff680 0x7fb458101a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:35.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.138+0000 7fb46063c640 1 --2- 172.21.15.89:0/4255938382 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb458065c40 0x7fb4580ff140 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:35.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.138+0000 7fb46063c640 1 -- 172.21.15.89:0/4255938382 >> 172.21.15.89:0/4255938382 conn(0x7fb4580f6c10 msgr2=0x7fb4580f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:52:35.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.138+0000 7fb46063c640 1 -- 172.21.15.89:0/4255938382 shutdown_connections 2024-09-13T02:52:35.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.138+0000 7fb46063c640 1 -- 172.21.15.89:0/4255938382 wait complete. 2024-09-13T02:52:35.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.139+0000 7fb46063c640 1 Processor -- start 2024-09-13T02:52:35.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.139+0000 7fb46063c640 1 -- start start 2024-09-13T02:52:35.142 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.139+0000 7fb46063c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb458065c40 0x7fb45810f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:35.142 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.139+0000 7fb46063c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb4580ff680 0x7fb45810f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:35.142 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.139+0000 7fb46063c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb45810fe70 con 0x7fb458065c40 2024-09-13T02:52:35.142 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.139+0000 7fb46063c640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb458110640 con 0x7fb4580ff680 2024-09-13T02:52:35.142 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.139+0000 7fb45e3d8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb458065c40 0x7fb45810f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:35.142 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.139+0000 7fb45e3d8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb458065c40 0x7fb45810f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36666/0 (socket says 172.21.15.89:36666) 2024-09-13T02:52:35.142 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.139+0000 7fb45e3d8640 1 -- 172.21.15.89:0/2231747846 learned_addr learned my addr 172.21.15.89:0/2231747846 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:52:35.142 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.140+0000 7fb45e3d8640 1 -- 172.21.15.89:0/2231747846 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb4580ff680 msgr2=0x7fb45810f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:35.142 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.140+0000 7fb45e3d8640 1 --2- 172.21.15.89:0/2231747846 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb4580ff680 0x7fb45810f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:35.142 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.140+0000 7fb45e3d8640 1 -- 172.21.15.89:0/2231747846 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb454005040 con 0x7fb458065c40 2024-09-13T02:52:35.144 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.140+0000 7fb45e3d8640 1 --2- 172.21.15.89:0/2231747846 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb458065c40 0x7fb45810f2e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fb4540048a0 tx=0x7fb454009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:52:35.144 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.140+0000 7fb44effd640 1 -- 172.21.15.89:0/2231747846 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb454038070 con 0x7fb458065c40 2024-09-13T02:52:35.144 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.140+0000 7fb44effd640 1 -- 172.21.15.89:0/2231747846 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb45402abd0 con 0x7fb458065c40 2024-09-13T02:52:35.144 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.140+0000 7fb44effd640 1 -- 172.21.15.89:0/2231747846 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb454033640 con 0x7fb458065c40 2024-09-13T02:52:35.144 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.140+0000 7fb46063c640 1 -- 172.21.15.89:0/2231747846 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb458110870 con 0x7fb458065c40 2024-09-13T02:52:35.144 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.140+0000 7fb46063c640 1 -- 172.21.15.89:0/2231747846 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb458110dc0 con 0x7fb458065c40 2024-09-13T02:52:35.144 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.141+0000 7fb46063c640 1 -- 172.21.15.89:0/2231747846 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4580fa890 con 0x7fb458065c40 2024-09-13T02:52:35.144 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.142+0000 7fb44effd640 1 -- 172.21.15.89:0/2231747846 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fb454030020 con 0x7fb458065c40 2024-09-13T02:52:35.144 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.142+0000 7fb44effd640 1 --2- 172.21.15.89:0/2231747846 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fb44406ed60 0x7fb444071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:35.144 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.142+0000 7fb44effd640 1 -- 172.21.15.89:0/2231747846 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fb4540ae490 con 0x7fb458065c40 2024-09-13T02:52:35.144 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.142+0000 7fb45dbd7640 1 --2- 172.21.15.89:0/2231747846 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fb44406ed60 0x7fb444071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:35.145 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.143+0000 7fb45dbd7640 1 --2- 172.21.15.89:0/2231747846 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fb44406ed60 0x7fb444071210 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb45810f090 tx=0x7fb448007c30 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:52:35.148 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.147+0000 7fb44effd640 1 -- 172.21.15.89:0/2231747846 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fb45407b5e0 con 0x7fb458065c40 2024-09-13T02:52:35.357 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.356+0000 7fb46063c640 1 -- 172.21.15.89:0/2231747846 --> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb4581050a0 con 0x7fb44406ed60 2024-09-13T02:52:35.358 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.357+0000 7fb44effd640 1 -- 172.21.15.89:0/2231747846 <== mgr.14204 v2:172.21.15.89:6800/1506060926 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7fb4581050a0 con 0x7fb44406ed60 2024-09-13T02:52:35.360 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.359+0000 7fb46063c640 1 -- 172.21.15.89:0/2231747846 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fb44406ed60 msgr2=0x7fb444071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:35.360 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.359+0000 7fb46063c640 1 --2- 172.21.15.89:0/2231747846 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fb44406ed60 0x7fb444071210 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb45810f090 tx=0x7fb448007c30 comp rx=0 tx=0).stop 2024-09-13T02:52:35.360 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.359+0000 7fb46063c640 1 -- 172.21.15.89:0/2231747846 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb458065c40 msgr2=0x7fb45810f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:35.360 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.359+0000 7fb46063c640 1 --2- 172.21.15.89:0/2231747846 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb458065c40 0x7fb45810f2e0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fb4540048a0 tx=0x7fb454009da0 comp rx=0 tx=0).stop 2024-09-13T02:52:35.361 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.359+0000 7fb46063c640 1 -- 172.21.15.89:0/2231747846 shutdown_connections 2024-09-13T02:52:35.361 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.359+0000 7fb46063c640 1 --2- 172.21.15.89:0/2231747846 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fb44406ed60 0x7fb444071210 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:35.361 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.359+0000 7fb46063c640 1 --2- 172.21.15.89:0/2231747846 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb4580ff680 0x7fb45810f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:35.361 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.359+0000 7fb46063c640 1 --2- 172.21.15.89:0/2231747846 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb458065c40 0x7fb45810f2e0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:35.361 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.359+0000 7fb46063c640 1 -- 172.21.15.89:0/2231747846 >> 172.21.15.89:0/2231747846 conn(0x7fb4580f6c10 msgr2=0x7fb4580fb320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:52:35.361 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.359+0000 7fb46063c640 1 -- 172.21.15.89:0/2231747846 shutdown_connections 2024-09-13T02:52:35.361 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.359+0000 7fb46063c640 1 -- 172.21.15.89:0/2231747846 wait complete. 2024-09-13T02:52:35.448 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.444+0000 7f400f5d0640 1 -- 172.21.15.89:0/2542303308 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f40080fe740 msgr2=0x7f40080feb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:35.448 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.444+0000 7f400f5d0640 1 --2- 172.21.15.89:0/2542303308 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f40080fe740 0x7f40080feb50 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f40040048d0 tx=0x7f4004009da0 comp rx=0 tx=0).stop 2024-09-13T02:52:35.448 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.444+0000 7f400f5d0640 1 -- 172.21.15.89:0/2542303308 shutdown_connections 2024-09-13T02:52:35.448 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.444+0000 7f400f5d0640 1 --2- 172.21.15.89:0/2542303308 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f40080ffa10 0x7f40080ffe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:35.448 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.444+0000 7f400f5d0640 1 --2- 172.21.15.89:0/2542303308 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f40080fe740 0x7f40080feb50 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:35.448 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.444+0000 7f400f5d0640 1 -- 172.21.15.89:0/2542303308 >> 172.21.15.89:0/2542303308 conn(0x7f40080fa060 msgr2=0x7f40080fc440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:52:35.448 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.444+0000 7f400f5d0640 1 -- 172.21.15.89:0/2542303308 shutdown_connections 2024-09-13T02:52:35.448 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.444+0000 7f400f5d0640 1 -- 172.21.15.89:0/2542303308 wait complete. 2024-09-13T02:52:35.448 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.445+0000 7f400f5d0640 1 Processor -- start 2024-09-13T02:52:35.448 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.445+0000 7f400f5d0640 1 -- start start 2024-09-13T02:52:35.449 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.445+0000 7f400f5d0640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f40080fe740 0x7f400810f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:35.449 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.445+0000 7f400f5d0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f40080ffa10 0x7f400810f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:35.449 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.445+0000 7f400f5d0640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f400810fe10 con 0x7f40080ffa10 2024-09-13T02:52:35.449 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.445+0000 7f400f5d0640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4008110630 con 0x7f40080fe740 2024-09-13T02:52:35.449 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.445+0000 7f400cb6b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f40080ffa10 0x7f400810f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:35.449 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.445+0000 7f400cb6b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f40080ffa10 0x7f400810f7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36678/0 (socket says 172.21.15.89:36678) 2024-09-13T02:52:35.449 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.445+0000 7f400cb6b640 1 -- 172.21.15.89:0/3441955814 learned_addr learned my addr 172.21.15.89:0/3441955814 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:52:35.449 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.446+0000 7f400d36c640 1 --2- 172.21.15.89:0/3441955814 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f40080fe740 0x7f400810f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:35.449 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.446+0000 7f400cb6b640 1 -- 172.21.15.89:0/3441955814 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f40080fe740 msgr2=0x7f400810f280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:35.449 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.446+0000 7f400cb6b640 1 --2- 172.21.15.89:0/3441955814 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f40080fe740 0x7f400810f280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:35.449 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.446+0000 7f400cb6b640 1 -- 172.21.15.89:0/3441955814 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4004005040 con 0x7f40080ffa10 2024-09-13T02:52:35.450 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.446+0000 7f400d36c640 1 --2- 172.21.15.89:0/3441955814 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f40080fe740 0x7f400810f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T02:52:35.450 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.446+0000 7f400cb6b640 1 --2- 172.21.15.89:0/3441955814 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f40080ffa10 0x7f400810f7c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f3ff8002a50 tx=0x7f3ff8004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:52:35.450 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.446+0000 7f3ffdffb640 1 -- 172.21.15.89:0/3441955814 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ff8007c30 con 0x7f40080ffa10 2024-09-13T02:52:35.450 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.446+0000 7f400f5d0640 1 -- 172.21.15.89:0/3441955814 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40081108c0 con 0x7f40080ffa10 2024-09-13T02:52:35.450 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.446+0000 7f3ffdffb640 1 -- 172.21.15.89:0/3441955814 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3ff800f040 con 0x7f40080ffa10 2024-09-13T02:52:35.450 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.446+0000 7f3ffdffb640 1 -- 172.21.15.89:0/3441955814 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ff800da90 con 0x7f40080ffa10 2024-09-13T02:52:35.450 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.446+0000 7f400f5d0640 1 -- 172.21.15.89:0/3441955814 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4008110e60 con 0x7f40080ffa10 2024-09-13T02:52:35.451 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.447+0000 7f400f5d0640 1 -- 172.21.15.89:0/3441955814 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40080fdba0 con 0x7f40080ffa10 2024-09-13T02:52:35.451 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.448+0000 7f3ffdffb640 1 -- 172.21.15.89:0/3441955814 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f3ff800dc30 con 0x7f40080ffa10 2024-09-13T02:52:35.451 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.448+0000 7f3ffdffb640 1 --2- 172.21.15.89:0/3441955814 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f3ff406ed60 0x7f3ff4071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:35.451 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.448+0000 7f3ffdffb640 1 -- 172.21.15.89:0/3441955814 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f3ff808da20 con 0x7f40080ffa10 2024-09-13T02:52:35.451 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.448+0000 7f400d36c640 1 --2- 172.21.15.89:0/3441955814 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f3ff406ed60 0x7f3ff4071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:35.451 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.449+0000 7f400d36c640 1 --2- 172.21.15.89:0/3441955814 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f3ff406ed60 0x7f3ff4071210 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4004007ac0 tx=0x7f4004035040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:52:35.454 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.453+0000 7f3ffdffb640 1 -- 172.21.15.89:0/3441955814 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f3ff804d2a0 con 0x7f40080ffa10 2024-09-13T02:52:35.651 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.650+0000 7f400f5d0640 1 -- 172.21.15.89:0/3441955814 --> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f40081111e0 con 0x7f3ff406ed60 2024-09-13T02:52:35.661 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.660+0000 7f3ffdffb640 1 -- 172.21.15.89:0/3441955814 <== mgr.14204 v2:172.21.15.89:6800/1506060926 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f40081111e0 con 0x7f3ff406ed60 2024-09-13T02:52:35.661 INFO:teuthology.orchestra.run.smithi089.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T02:52:35.662 INFO:teuthology.orchestra.run.smithi089.stdout:alertmanager.smithi089 smithi089 *:9093,9094 running (4m) 23s ago 6m 24.9M - 0.25.0 c8568f914cd2 e0d15812dfa4 2024-09-13T02:52:35.662 INFO:teuthology.orchestra.run.smithi089.stdout:crash.smithi089 smithi089 running (6m) 23s ago 6m 6895k - 17.2.7-1627-gbbdadfa3 a994b00deb3a e8994cd5600e 2024-09-13T02:52:35.662 INFO:teuthology.orchestra.run.smithi089.stdout:crash.smithi131 smithi131 running (5m) 29s ago 5m 6895k - 17.2.7-1627-gbbdadfa3 a994b00deb3a dcbb0a9d5261 2024-09-13T02:52:35.662 INFO:teuthology.orchestra.run.smithi089.stdout:grafana.smithi089 smithi089 *:3000 running (4m) 23s ago 5m 83.4M - 9.4.7 954c08fa6188 bb04115ceb76 2024-09-13T02:52:35.662 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi089.qjoitb smithi089 running (49s) 23s ago 48s 11.9M - 17.2.7-1627-gbbdadfa3 a994b00deb3a ff9b59ec5107 2024-09-13T02:52:35.662 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi089.rarddb smithi089 running (42s) 23s ago 41s 15.2M - 17.2.7-1627-gbbdadfa3 a994b00deb3a db2dc502c1ba 2024-09-13T02:52:35.662 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi131.rbovzc smithi131 running (39s) 29s ago 39s 14.9M - 17.2.7-1627-gbbdadfa3 a994b00deb3a d071b6d99537 2024-09-13T02:52:35.662 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi131.uasrkg smithi131 running (46s) 29s ago 46s 14.2M - 17.2.7-1627-gbbdadfa3 a994b00deb3a 0b3d4ffa6ce5 2024-09-13T02:52:35.662 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.smithi089.guohvs smithi089 *:9283,8765,8443 running (7m) 23s ago 7m 449M - 17.2.7-1627-gbbdadfa3 a994b00deb3a 32ceefe7e647 2024-09-13T02:52:35.662 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.smithi131.aunbqd smithi131 *:8443,9283 running (5m) 29s ago 5m 401M - 17.2.7-1627-gbbdadfa3 a994b00deb3a a950da375271 2024-09-13T02:52:35.662 INFO:teuthology.orchestra.run.smithi089.stdout:mon.smithi089 smithi089 running (7m) 23s ago 7m 47.2M 2048M 17.2.7-1627-gbbdadfa3 a994b00deb3a d2f18141b2af 2024-09-13T02:52:35.663 INFO:teuthology.orchestra.run.smithi089.stdout:mon.smithi131 smithi131 running (5m) 29s ago 5m 38.8M 2048M 17.2.7-1627-gbbdadfa3 a994b00deb3a 1191e59dc7a0 2024-09-13T02:52:35.663 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.smithi089 smithi089 *:9100 running (6m) 23s ago 6m 16.2M - 1.5.0 0da6a335fe13 c5dbf820b035 2024-09-13T02:52:35.663 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.smithi131 smithi131 *:9100 running (5m) 29s ago 5m 16.8M - 1.5.0 0da6a335fe13 c3309019f407 2024-09-13T02:52:35.663 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0 smithi089 running (4m) 23s ago 4m 48.0M 4287M 17.2.7-1627-gbbdadfa3 a994b00deb3a b9404e2bc82c 2024-09-13T02:52:35.663 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1 smithi089 running (4m) 23s ago 4m 45.8M 4287M 17.2.7-1627-gbbdadfa3 a994b00deb3a af6538730e42 2024-09-13T02:52:35.663 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2 smithi089 running (3m) 23s ago 3m 46.4M 4287M 17.2.7-1627-gbbdadfa3 a994b00deb3a 447cf103114b 2024-09-13T02:52:35.663 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3 smithi131 running (3m) 29s ago 3m 46.1M 5312M 17.2.7-1627-gbbdadfa3 a994b00deb3a 0b80a4dea862 2024-09-13T02:52:35.663 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4 smithi131 running (2m) 29s ago 2m 42.8M 5312M 17.2.7-1627-gbbdadfa3 a994b00deb3a 06ec44680b00 2024-09-13T02:52:35.663 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5 smithi131 running (2m) 29s ago 2m 43.1M 5312M 17.2.7-1627-gbbdadfa3 a994b00deb3a ace4b45e5873 2024-09-13T02:52:35.663 INFO:teuthology.orchestra.run.smithi089.stdout:prometheus.smithi089 smithi089 *:9095 running (4m) 23s ago 5m 52.8M - 2.43.0 a07b618ecd1d 003f13763491 2024-09-13T02:52:35.664 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.662+0000 7f400f5d0640 1 -- 172.21.15.89:0/3441955814 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f3ff406ed60 msgr2=0x7f3ff4071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:35.664 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.662+0000 7f400f5d0640 1 --2- 172.21.15.89:0/3441955814 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f3ff406ed60 0x7f3ff4071210 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f4004007ac0 tx=0x7f4004035040 comp rx=0 tx=0).stop 2024-09-13T02:52:35.664 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.662+0000 7f400f5d0640 1 -- 172.21.15.89:0/3441955814 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f40080ffa10 msgr2=0x7f400810f7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:35.664 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.662+0000 7f400f5d0640 1 --2- 172.21.15.89:0/3441955814 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f40080ffa10 0x7f400810f7c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f3ff8002a50 tx=0x7f3ff8004600 comp rx=0 tx=0).stop 2024-09-13T02:52:35.664 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.662+0000 7f400f5d0640 1 -- 172.21.15.89:0/3441955814 shutdown_connections 2024-09-13T02:52:35.664 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.662+0000 7f400f5d0640 1 --2- 172.21.15.89:0/3441955814 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f40080ffa10 0x7f400810f7c0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:35.664 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.662+0000 7f400f5d0640 1 --2- 172.21.15.89:0/3441955814 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f3ff406ed60 0x7f3ff4071210 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:35.664 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.662+0000 7f400f5d0640 1 --2- 172.21.15.89:0/3441955814 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f40080fe740 0x7f400810f280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:35.665 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.662+0000 7f400f5d0640 1 -- 172.21.15.89:0/3441955814 >> 172.21.15.89:0/3441955814 conn(0x7f40080fa060 msgr2=0x7f40080fc800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:52:35.665 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.662+0000 7f400f5d0640 1 -- 172.21.15.89:0/3441955814 shutdown_connections 2024-09-13T02:52:35.665 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.662+0000 7f400f5d0640 1 -- 172.21.15.89:0/3441955814 wait complete. 2024-09-13T02:52:35.756 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.754+0000 7fe234044640 1 -- 172.21.15.89:0/392933808 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe22c101a80 msgr2=0x7fe22c103e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:35.756 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.754+0000 7fe234044640 1 --2- 172.21.15.89:0/392933808 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe22c101a80 0x7fe22c103e60 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fe2200048d0 tx=0x7fe220009da0 comp rx=0 tx=0).stop 2024-09-13T02:52:35.757 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.754+0000 7fe234044640 1 -- 172.21.15.89:0/392933808 shutdown_connections 2024-09-13T02:52:35.757 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.754+0000 7fe234044640 1 --2- 172.21.15.89:0/392933808 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe22c101a80 0x7fe22c103e60 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:35.757 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.754+0000 7fe234044640 1 --2- 172.21.15.89:0/392933808 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe22c065c40 0x7fe22c101540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:35.757 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.754+0000 7fe234044640 1 -- 172.21.15.89:0/392933808 >> 172.21.15.89:0/392933808 conn(0x7fe22c0f6c10 msgr2=0x7fe22c0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:52:35.757 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.755+0000 7fe234044640 1 -- 172.21.15.89:0/392933808 shutdown_connections 2024-09-13T02:52:35.757 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.755+0000 7fe234044640 1 -- 172.21.15.89:0/392933808 wait complete. 2024-09-13T02:52:35.758 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.755+0000 7fe234044640 1 Processor -- start 2024-09-13T02:52:35.759 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.755+0000 7fe234044640 1 -- start start 2024-09-13T02:52:35.759 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.756+0000 7fe234044640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe22c065c40 0x7fe22c10f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:35.759 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.756+0000 7fe234044640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe22c101a80 0x7fe22c10f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:35.759 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.756+0000 7fe234044640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe22c10fe40 con 0x7fe22c101a80 2024-09-13T02:52:35.759 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.756+0000 7fe234044640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe22c110610 con 0x7fe22c065c40 2024-09-13T02:52:35.759 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.756+0000 7fe2315df640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe22c101a80 0x7fe22c10f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:35.759 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.756+0000 7fe2315df640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe22c101a80 0x7fe22c10f7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36694/0 (socket says 172.21.15.89:36694) 2024-09-13T02:52:35.759 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.756+0000 7fe2315df640 1 -- 172.21.15.89:0/3902267090 learned_addr learned my addr 172.21.15.89:0/3902267090 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:52:35.759 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.756+0000 7fe231de0640 1 --2- 172.21.15.89:0/3902267090 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe22c065c40 0x7fe22c10f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:35.759 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.756+0000 7fe2315df640 1 -- 172.21.15.89:0/3902267090 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe22c065c40 msgr2=0x7fe22c10f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:35.759 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.756+0000 7fe2315df640 1 --2- 172.21.15.89:0/3902267090 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe22c065c40 0x7fe22c10f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:35.759 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.756+0000 7fe2315df640 1 -- 172.21.15.89:0/3902267090 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe220005040 con 0x7fe22c101a80 2024-09-13T02:52:35.760 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.756+0000 7fe2315df640 1 --2- 172.21.15.89:0/3902267090 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe22c101a80 0x7fe22c10f7f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fe2200043d0 tx=0x7fe220009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:52:35.760 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.757+0000 7fe21e7fc640 1 -- 172.21.15.89:0/3902267090 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe220038070 con 0x7fe22c101a80 2024-09-13T02:52:35.760 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.757+0000 7fe234044640 1 -- 172.21.15.89:0/3902267090 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe22c110840 con 0x7fe22c101a80 2024-09-13T02:52:35.760 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.757+0000 7fe21e7fc640 1 -- 172.21.15.89:0/3902267090 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe22002ae90 con 0x7fe22c101a80 2024-09-13T02:52:35.760 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.757+0000 7fe21e7fc640 1 -- 172.21.15.89:0/3902267090 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe22003e670 con 0x7fe22c101a80 2024-09-13T02:52:35.760 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.757+0000 7fe234044640 1 -- 172.21.15.89:0/3902267090 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe22c110de0 con 0x7fe22c101a80 2024-09-13T02:52:35.761 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.758+0000 7fe234044640 1 -- 172.21.15.89:0/3902267090 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe22c0fa890 con 0x7fe22c101a80 2024-09-13T02:52:35.761 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.759+0000 7fe21e7fc640 1 -- 172.21.15.89:0/3902267090 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fe220030020 con 0x7fe22c101a80 2024-09-13T02:52:35.761 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.759+0000 7fe21e7fc640 1 --2- 172.21.15.89:0/3902267090 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fe21806ed60 0x7fe218071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:35.761 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.759+0000 7fe21e7fc640 1 -- 172.21.15.89:0/3902267090 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fe2200ae420 con 0x7fe22c101a80 2024-09-13T02:52:35.761 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.759+0000 7fe231de0640 1 --2- 172.21.15.89:0/3902267090 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fe21806ed60 0x7fe218071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:35.761 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.760+0000 7fe231de0640 1 --2- 172.21.15.89:0/3902267090 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fe21806ed60 0x7fe218071210 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe22c0659a0 tx=0x7fe22800b040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:52:35.765 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:35.764+0000 7fe21e7fc640 1 -- 172.21.15.89:0/3902267090 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fe22007b540 con 0x7fe22c101a80 2024-09-13T02:52:36.029 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.027+0000 7fe234044640 1 -- 172.21.15.89:0/3902267090 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fe22c1110a0 con 0x7fe22c101a80 2024-09-13T02:52:36.029 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.028+0000 7fe21e7fc640 1 -- 172.21.15.89:0/3902267090 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+643 (secure 0 0 0) 0x7fe22007aee0 con 0x7fe22c101a80 2024-09-13T02:52:36.029 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-13T02:52:36.029 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": { 2024-09-13T02:52:36.030 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 2 2024-09-13T02:52:36.030 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T02:52:36.030 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": { 2024-09-13T02:52:36.030 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 2 2024-09-13T02:52:36.030 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T02:52:36.030 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": { 2024-09-13T02:52:36.030 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 6 2024-09-13T02:52:36.030 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T02:52:36.030 INFO:teuthology.orchestra.run.smithi089.stdout: "mds": { 2024-09-13T02:52:36.030 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 4 2024-09-13T02:52:36.031 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T02:52:36.031 INFO:teuthology.orchestra.run.smithi089.stdout: "overall": { 2024-09-13T02:52:36.031 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 14 2024-09-13T02:52:36.031 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-13T02:52:36.031 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-13T02:52:36.032 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.030+0000 7fe234044640 1 -- 172.21.15.89:0/3902267090 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fe21806ed60 msgr2=0x7fe218071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:36.032 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.030+0000 7fe234044640 1 --2- 172.21.15.89:0/3902267090 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fe21806ed60 0x7fe218071210 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe22c0659a0 tx=0x7fe22800b040 comp rx=0 tx=0).stop 2024-09-13T02:52:36.032 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.030+0000 7fe234044640 1 -- 172.21.15.89:0/3902267090 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe22c101a80 msgr2=0x7fe22c10f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:36.032 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.030+0000 7fe234044640 1 --2- 172.21.15.89:0/3902267090 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe22c101a80 0x7fe22c10f7f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fe2200043d0 tx=0x7fe220009da0 comp rx=0 tx=0).stop 2024-09-13T02:52:36.032 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.030+0000 7fe234044640 1 -- 172.21.15.89:0/3902267090 shutdown_connections 2024-09-13T02:52:36.032 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.030+0000 7fe234044640 1 --2- 172.21.15.89:0/3902267090 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe22c101a80 0x7fe22c10f7f0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:36.032 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.030+0000 7fe234044640 1 --2- 172.21.15.89:0/3902267090 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fe21806ed60 0x7fe218071210 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:36.033 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.030+0000 7fe234044640 1 --2- 172.21.15.89:0/3902267090 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe22c065c40 0x7fe22c10f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:36.033 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.030+0000 7fe234044640 1 -- 172.21.15.89:0/3902267090 >> 172.21.15.89:0/3902267090 conn(0x7fe22c0f6c10 msgr2=0x7fe22c0f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:52:36.033 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.031+0000 7fe234044640 1 -- 172.21.15.89:0/3902267090 shutdown_connections 2024-09-13T02:52:36.033 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.031+0000 7fe234044640 1 -- 172.21.15.89:0/3902267090 wait complete. 2024-09-13T02:52:36.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.126+0000 7fdf77372640 1 -- 172.21.15.89:0/1365773293 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdf700fd7f0 msgr2=0x7fdf700fdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:36.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.126+0000 7fdf77372640 1 --2- 172.21.15.89:0/1365773293 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdf700fd7f0 0x7fdf700fdc60 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fdf600048d0 tx=0x7fdf60009da0 comp rx=0 tx=0).stop 2024-09-13T02:52:36.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.126+0000 7fdf77372640 1 -- 172.21.15.89:0/1365773293 shutdown_connections 2024-09-13T02:52:36.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.126+0000 7fdf77372640 1 --2- 172.21.15.89:0/1365773293 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdf700fd7f0 0x7fdf700fdc60 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:36.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.126+0000 7fdf77372640 1 --2- 172.21.15.89:0/1365773293 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf700fc520 0x7fdf700fc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:36.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.126+0000 7fdf77372640 1 -- 172.21.15.89:0/1365773293 >> 172.21.15.89:0/1365773293 conn(0x7fdf700f7ce0 msgr2=0x7fdf700fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:52:36.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.126+0000 7fdf77372640 1 -- 172.21.15.89:0/1365773293 shutdown_connections 2024-09-13T02:52:36.128 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.126+0000 7fdf77372640 1 -- 172.21.15.89:0/1365773293 wait complete. 2024-09-13T02:52:36.130 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.127+0000 7fdf77372640 1 Processor -- start 2024-09-13T02:52:36.130 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.127+0000 7fdf77372640 1 -- start start 2024-09-13T02:52:36.130 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.127+0000 7fdf77372640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf700fc520 0x7fdf7010d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:36.130 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.127+0000 7fdf77372640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdf700fd7f0 0x7fdf7010d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:36.130 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.127+0000 7fdf77372640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf7010dbf0 con 0x7fdf700fd7f0 2024-09-13T02:52:36.130 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.127+0000 7fdf77372640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf7010e410 con 0x7fdf700fc520 2024-09-13T02:52:36.130 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.127+0000 7fdf7490d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdf700fd7f0 0x7fdf7010d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:36.130 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.127+0000 7fdf7490d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdf700fd7f0 0x7fdf7010d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36716/0 (socket says 172.21.15.89:36716) 2024-09-13T02:52:36.130 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.127+0000 7fdf7490d640 1 -- 172.21.15.89:0/3846095920 learned_addr learned my addr 172.21.15.89:0/3846095920 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:52:36.130 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.127+0000 7fdf7510e640 1 --2- 172.21.15.89:0/3846095920 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf700fc520 0x7fdf7010d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:36.131 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.128+0000 7fdf7490d640 1 -- 172.21.15.89:0/3846095920 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf700fc520 msgr2=0x7fdf7010d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:36.131 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.128+0000 7fdf7490d640 1 --2- 172.21.15.89:0/3846095920 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf700fc520 0x7fdf7010d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:36.131 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.128+0000 7fdf7490d640 1 -- 172.21.15.89:0/3846095920 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf60005040 con 0x7fdf700fd7f0 2024-09-13T02:52:36.131 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.128+0000 7fdf7490d640 1 --2- 172.21.15.89:0/3846095920 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdf700fd7f0 0x7fdf7010d5a0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fdf600043d0 tx=0x7fdf60009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:52:36.131 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.128+0000 7fdf65ffb640 1 -- 172.21.15.89:0/3846095920 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdf60038070 con 0x7fdf700fd7f0 2024-09-13T02:52:36.131 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.128+0000 7fdf77372640 1 -- 172.21.15.89:0/3846095920 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf7010e640 con 0x7fdf700fd7f0 2024-09-13T02:52:36.131 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.128+0000 7fdf65ffb640 1 -- 172.21.15.89:0/3846095920 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fdf6002ae90 con 0x7fdf700fd7f0 2024-09-13T02:52:36.131 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.128+0000 7fdf65ffb640 1 -- 172.21.15.89:0/3846095920 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdf6003e670 con 0x7fdf700fd7f0 2024-09-13T02:52:36.131 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.128+0000 7fdf77372640 1 -- 172.21.15.89:0/3846095920 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf7010eb60 con 0x7fdf700fd7f0 2024-09-13T02:52:36.132 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.130+0000 7fdf77372640 1 -- 172.21.15.89:0/3846095920 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf700fb980 con 0x7fdf700fd7f0 2024-09-13T02:52:36.132 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.130+0000 7fdf65ffb640 1 -- 172.21.15.89:0/3846095920 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fdf60030020 con 0x7fdf700fd7f0 2024-09-13T02:52:36.132 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.131+0000 7fdf65ffb640 1 --2- 172.21.15.89:0/3846095920 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fdf5c06eda0 0x7fdf5c071250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:36.132 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.131+0000 7fdf65ffb640 1 -- 172.21.15.89:0/3846095920 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fdf600ae460 con 0x7fdf700fd7f0 2024-09-13T02:52:36.132 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.131+0000 7fdf7510e640 1 --2- 172.21.15.89:0/3846095920 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fdf5c06eda0 0x7fdf5c071250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:36.133 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.132+0000 7fdf7510e640 1 --2- 172.21.15.89:0/3846095920 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fdf5c06eda0 0x7fdf5c071250 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c009fd0 tx=0x7fdf6c00b040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:52:36.136 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.135+0000 7fdf65ffb640 1 -- 172.21.15.89:0/3846095920 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fdf6007b540 con 0x7fdf700fd7f0 2024-09-13T02:52:36.409 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.407+0000 7fdf77372640 1 -- 172.21.15.89:0/3846095920 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fdf7010ee20 con 0x7fdf700fd7f0 2024-09-13T02:52:36.409 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.408+0000 7fdf65ffb640 1 -- 172.21.15.89:0/3846095920 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) v1 ==== 76+0+1830 (secure 0 0 0) 0x7fdf6007aee0 con 0x7fdf700fd7f0 2024-09-13T02:52:36.410 INFO:teuthology.orchestra.run.smithi089.stdout:e19 2024-09-13T02:52:36.410 INFO:teuthology.orchestra.run.smithi089.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T02:52:36.410 INFO:teuthology.orchestra.run.smithi089.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:52:36.410 INFO:teuthology.orchestra.run.smithi089.stdout:legacy client fscid: 1 2024-09-13T02:52:36.410 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:52:36.410 INFO:teuthology.orchestra.run.smithi089.stdout:Filesystem 'cephfs' (1) 2024-09-13T02:52:36.410 INFO:teuthology.orchestra.run.smithi089.stdout:fs_name cephfs 2024-09-13T02:52:36.410 INFO:teuthology.orchestra.run.smithi089.stdout:epoch 19 2024-09-13T02:52:36.410 INFO:teuthology.orchestra.run.smithi089.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T02:52:36.410 INFO:teuthology.orchestra.run.smithi089.stdout:created 2024-09-13T02:51:40.657817+0000 2024-09-13T02:52:36.410 INFO:teuthology.orchestra.run.smithi089.stdout:modified 2024-09-13T02:52:02.591108+0000 2024-09-13T02:52:36.411 INFO:teuthology.orchestra.run.smithi089.stdout:tableserver 0 2024-09-13T02:52:36.411 INFO:teuthology.orchestra.run.smithi089.stdout:root 0 2024-09-13T02:52:36.411 INFO:teuthology.orchestra.run.smithi089.stdout:session_timeout 60 2024-09-13T02:52:36.411 INFO:teuthology.orchestra.run.smithi089.stdout:session_autoclose 300 2024-09-13T02:52:36.411 INFO:teuthology.orchestra.run.smithi089.stdout:max_file_size 1099511627776 2024-09-13T02:52:36.411 INFO:teuthology.orchestra.run.smithi089.stdout:required_client_features {} 2024-09-13T02:52:36.411 INFO:teuthology.orchestra.run.smithi089.stdout:last_failure 0 2024-09-13T02:52:36.411 INFO:teuthology.orchestra.run.smithi089.stdout:last_failure_osd_epoch 44 2024-09-13T02:52:36.411 INFO:teuthology.orchestra.run.smithi089.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:52:36.411 INFO:teuthology.orchestra.run.smithi089.stdout:max_mds 2 2024-09-13T02:52:36.411 INFO:teuthology.orchestra.run.smithi089.stdout:in 0,1 2024-09-13T02:52:36.411 INFO:teuthology.orchestra.run.smithi089.stdout:up {0=14480,1=24257} 2024-09-13T02:52:36.412 INFO:teuthology.orchestra.run.smithi089.stdout:failed 2024-09-13T02:52:36.412 INFO:teuthology.orchestra.run.smithi089.stdout:damaged 2024-09-13T02:52:36.412 INFO:teuthology.orchestra.run.smithi089.stdout:stopped 2024-09-13T02:52:36.412 INFO:teuthology.orchestra.run.smithi089.stdout:data_pools [3] 2024-09-13T02:52:36.412 INFO:teuthology.orchestra.run.smithi089.stdout:metadata_pool 2 2024-09-13T02:52:36.412 INFO:teuthology.orchestra.run.smithi089.stdout:inline_data disabled 2024-09-13T02:52:36.412 INFO:teuthology.orchestra.run.smithi089.stdout:balancer 2024-09-13T02:52:36.412 INFO:teuthology.orchestra.run.smithi089.stdout:standby_count_wanted 1 2024-09-13T02:52:36.412 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi089.rarddb{0:14480} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.89:6828/1561365213,v1:172.21.15.89:6829/1561365213] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:52:36.412 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi089.qjoitb{0:14488} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.89:6826/1464393547,v1:172.21.15.89:6827/1464393547] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:52:36.412 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi131.uasrkg{1:24257} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.131:6824/260493836,v1:172.21.15.131:6825/260493836] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:52:36.413 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi131.rbovzc{1:24265} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.131:6826/665579373,v1:172.21.15.131:6827/665579373] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:52:36.413 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:52:36.413 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:52:36.413 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 19 2024-09-13T02:52:36.413 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.410+0000 7fdf77372640 1 -- 172.21.15.89:0/3846095920 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fdf5c06eda0 msgr2=0x7fdf5c071250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:36.414 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.410+0000 7fdf77372640 1 --2- 172.21.15.89:0/3846095920 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fdf5c06eda0 0x7fdf5c071250 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c009fd0 tx=0x7fdf6c00b040 comp rx=0 tx=0).stop 2024-09-13T02:52:36.414 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.410+0000 7fdf77372640 1 -- 172.21.15.89:0/3846095920 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdf700fd7f0 msgr2=0x7fdf7010d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:36.414 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.410+0000 7fdf77372640 1 --2- 172.21.15.89:0/3846095920 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdf700fd7f0 0x7fdf7010d5a0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fdf600043d0 tx=0x7fdf60009da0 comp rx=0 tx=0).stop 2024-09-13T02:52:36.414 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.410+0000 7fdf77372640 1 -- 172.21.15.89:0/3846095920 shutdown_connections 2024-09-13T02:52:36.414 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.410+0000 7fdf77372640 1 --2- 172.21.15.89:0/3846095920 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdf700fd7f0 0x7fdf7010d5a0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:36.414 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.410+0000 7fdf77372640 1 --2- 172.21.15.89:0/3846095920 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fdf5c06eda0 0x7fdf5c071250 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:36.414 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.410+0000 7fdf77372640 1 --2- 172.21.15.89:0/3846095920 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf700fc520 0x7fdf7010d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:36.414 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.410+0000 7fdf77372640 1 -- 172.21.15.89:0/3846095920 >> 172.21.15.89:0/3846095920 conn(0x7fdf700f7ce0 msgr2=0x7fdf700f94b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:52:36.414 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.410+0000 7fdf77372640 1 -- 172.21.15.89:0/3846095920 shutdown_connections 2024-09-13T02:52:36.414 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.410+0000 7fdf77372640 1 -- 172.21.15.89:0/3846095920 wait complete. 2024-09-13T02:52:36.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.507+0000 7f8024810640 1 -- 172.21.15.89:0/3105289854 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80200fc6f0 msgr2=0x7f80200fcb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:36.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.507+0000 7f8024810640 1 --2- 172.21.15.89:0/3105289854 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80200fc6f0 0x7f80200fcb60 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f80080048d0 tx=0x7f8008009da0 comp rx=0 tx=0).stop 2024-09-13T02:52:36.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.508+0000 7f8024810640 1 -- 172.21.15.89:0/3105289854 shutdown_connections 2024-09-13T02:52:36.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.508+0000 7f8024810640 1 --2- 172.21.15.89:0/3105289854 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80200fc6f0 0x7f80200fcb60 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:36.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.508+0000 7f8024810640 1 --2- 172.21.15.89:0/3105289854 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f80200fb420 0x7f80200fb830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:36.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.508+0000 7f8024810640 1 -- 172.21.15.89:0/3105289854 >> 172.21.15.89:0/3105289854 conn(0x7f80200f6c00 msgr2=0x7f80200f9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:52:36.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.508+0000 7f8024810640 1 -- 172.21.15.89:0/3105289854 shutdown_connections 2024-09-13T02:52:36.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.508+0000 7f8024810640 1 -- 172.21.15.89:0/3105289854 wait complete. 2024-09-13T02:52:36.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.508+0000 7f8024810640 1 Processor -- start 2024-09-13T02:52:36.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.508+0000 7f8024810640 1 -- start start 2024-09-13T02:52:36.511 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.508+0000 7f8024810640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f80200fb420 0x7f802010d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:36.511 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.508+0000 7f8024810640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80200fc6f0 0x7f802010d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:36.511 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.508+0000 7f8024810640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f802010dc90 con 0x7f80200fc6f0 2024-09-13T02:52:36.511 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.508+0000 7f8024810640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f802010e460 con 0x7f80200fb420 2024-09-13T02:52:36.511 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.508+0000 7f8017fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80200fc6f0 0x7f802010d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:36.511 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.509+0000 7f801e59c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f80200fb420 0x7f802010d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:36.511 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.509+0000 7f8017fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80200fc6f0 0x7f802010d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36726/0 (socket says 172.21.15.89:36726) 2024-09-13T02:52:36.511 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.509+0000 7f8017fff640 1 -- 172.21.15.89:0/2910575853 learned_addr learned my addr 172.21.15.89:0/2910575853 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:52:36.512 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.509+0000 7f8017fff640 1 -- 172.21.15.89:0/2910575853 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f80200fb420 msgr2=0x7f802010d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:36.512 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.509+0000 7f8017fff640 1 --2- 172.21.15.89:0/2910575853 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f80200fb420 0x7f802010d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:36.512 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.509+0000 7f8017fff640 1 -- 172.21.15.89:0/2910575853 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8008005040 con 0x7f80200fc6f0 2024-09-13T02:52:36.512 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.509+0000 7f801e59c640 1 --2- 172.21.15.89:0/2910575853 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f80200fb420 0x7f802010d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T02:52:36.512 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.509+0000 7f8017fff640 1 --2- 172.21.15.89:0/2910575853 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80200fc6f0 0x7f802010d640 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f80080048a0 tx=0x7f8008009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:52:36.512 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.509+0000 7f8016ffd640 1 -- 172.21.15.89:0/2910575853 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8008038070 con 0x7f80200fc6f0 2024-09-13T02:52:36.512 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.509+0000 7f8024810640 1 -- 172.21.15.89:0/2910575853 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f802010e690 con 0x7f80200fc6f0 2024-09-13T02:52:36.513 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.509+0000 7f8024810640 1 -- 172.21.15.89:0/2910575853 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f802010ec30 con 0x7f80200fc6f0 2024-09-13T02:52:36.513 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.510+0000 7f8016ffd640 1 -- 172.21.15.89:0/2910575853 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f8008004290 con 0x7f80200fc6f0 2024-09-13T02:52:36.513 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.510+0000 7f8016ffd640 1 -- 172.21.15.89:0/2910575853 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8008033660 con 0x7f80200fc6f0 2024-09-13T02:52:36.513 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.511+0000 7f8024810640 1 -- 172.21.15.89:0/2910575853 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8000005210 con 0x7f80200fc6f0 2024-09-13T02:52:36.514 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.511+0000 7f8016ffd640 1 -- 172.21.15.89:0/2910575853 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f8008030020 con 0x7f80200fc6f0 2024-09-13T02:52:36.514 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.512+0000 7f8016ffd640 1 --2- 172.21.15.89:0/2910575853 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f800c06ed60 0x7f800c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:36.514 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.512+0000 7f8016ffd640 1 -- 172.21.15.89:0/2910575853 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f80080ae160 con 0x7f80200fc6f0 2024-09-13T02:52:36.514 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.512+0000 7f801e59c640 1 --2- 172.21.15.89:0/2910575853 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f800c06ed60 0x7f800c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:36.514 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.513+0000 7f801e59c640 1 --2- 172.21.15.89:0/2910575853 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f800c06ed60 0x7f800c071210 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8010004fd0 tx=0x7f801000b040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:52:36.518 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.516+0000 7f8016ffd640 1 -- 172.21.15.89:0/2910575853 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f800807b360 con 0x7f80200fc6f0 2024-09-13T02:52:36.700 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:52:36 smithi089 ceph-mon[27639]: pgmap v200: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.1 KiB/s rd, 853 B/s wr, 5 op/s 2024-09-13T02:52:36.700 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:52:36 smithi089 ceph-mon[27639]: from='client.14536 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:52:36.700 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:52:36 smithi089 ceph-mon[27639]: from='client.14540 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:52:36.700 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:52:36 smithi089 ceph-mon[27639]: from='client.14544 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:52:36.700 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:52:36 smithi089 ceph-mon[27639]: from='client.? 172.21.15.89:0/3902267090' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:52:36.700 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:52:36 smithi089 ceph-mon[27639]: from='client.? 172.21.15.89:0/3846095920' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T02:52:36.731 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.730+0000 7f8024810640 1 -- 172.21.15.89:0/2910575853 --> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8000000bc0 con 0x7f800c06ed60 2024-09-13T02:52:36.733 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.731+0000 7f8016ffd640 1 -- 172.21.15.89:0/2910575853 <== mgr.14204 v2:172.21.15.89:6800/1506060926 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+358 (secure 0 0 0) 0x7f8000000bc0 con 0x7f800c06ed60 2024-09-13T02:52:36.733 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-13T02:52:36.733 INFO:teuthology.orchestra.run.smithi089.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph:7741f7f9ee20524f89b8f61d1609b32fb3b1570a", 2024-09-13T02:52:36.733 INFO:teuthology.orchestra.run.smithi089.stdout: "in_progress": true, 2024-09-13T02:52:36.733 INFO:teuthology.orchestra.run.smithi089.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T02:52:36.733 INFO:teuthology.orchestra.run.smithi089.stdout: "services_complete": [], 2024-09-13T02:52:36.733 INFO:teuthology.orchestra.run.smithi089.stdout: "progress": "", 2024-09-13T02:52:36.733 INFO:teuthology.orchestra.run.smithi089.stdout: "message": "Doing first pull of quay.ceph.io/ceph-ci/ceph:7741f7f9ee20524f89b8f61d1609b32fb3b1570a image", 2024-09-13T02:52:36.734 INFO:teuthology.orchestra.run.smithi089.stdout: "is_paused": false 2024-09-13T02:52:36.734 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-13T02:52:36.735 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.733+0000 7f8024810640 1 -- 172.21.15.89:0/2910575853 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f800c06ed60 msgr2=0x7f800c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:36.735 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.733+0000 7f8024810640 1 --2- 172.21.15.89:0/2910575853 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f800c06ed60 0x7f800c071210 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8010004fd0 tx=0x7f801000b040 comp rx=0 tx=0).stop 2024-09-13T02:52:36.735 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.733+0000 7f8024810640 1 -- 172.21.15.89:0/2910575853 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80200fc6f0 msgr2=0x7f802010d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:36.735 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.733+0000 7f8024810640 1 --2- 172.21.15.89:0/2910575853 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80200fc6f0 0x7f802010d640 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f80080048a0 tx=0x7f8008009da0 comp rx=0 tx=0).stop 2024-09-13T02:52:36.735 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.734+0000 7f8024810640 1 -- 172.21.15.89:0/2910575853 shutdown_connections 2024-09-13T02:52:36.735 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.734+0000 7f8024810640 1 --2- 172.21.15.89:0/2910575853 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f80200fc6f0 0x7f802010d640 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:36.736 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.734+0000 7f8024810640 1 --2- 172.21.15.89:0/2910575853 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f800c06ed60 0x7f800c071210 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:36.736 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.734+0000 7f8024810640 1 --2- 172.21.15.89:0/2910575853 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f80200fb420 0x7f802010d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:36.736 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.734+0000 7f8024810640 1 -- 172.21.15.89:0/2910575853 >> 172.21.15.89:0/2910575853 conn(0x7f80200f6c00 msgr2=0x7f8020065f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:52:36.736 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.734+0000 7f8024810640 1 -- 172.21.15.89:0/2910575853 shutdown_connections 2024-09-13T02:52:36.736 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.734+0000 7f8024810640 1 -- 172.21.15.89:0/2910575853 wait complete. 2024-09-13T02:52:36.825 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.823+0000 7f1e2980e640 1 -- 172.21.15.89:0/1928731615 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1e240fc540 msgr2=0x7f1e240fc950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:36.825 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.823+0000 7f1e2980e640 1 --2- 172.21.15.89:0/1928731615 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1e240fc540 0x7f1e240fc950 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f1e140048d0 tx=0x7f1e14009da0 comp rx=0 tx=0).stop 2024-09-13T02:52:36.825 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.823+0000 7f1e2980e640 1 -- 172.21.15.89:0/1928731615 shutdown_connections 2024-09-13T02:52:36.825 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.823+0000 7f1e2980e640 1 --2- 172.21.15.89:0/1928731615 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1e240fd810 0x7f1e240fdc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:36.825 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.823+0000 7f1e2980e640 1 --2- 172.21.15.89:0/1928731615 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1e240fc540 0x7f1e240fc950 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:36.825 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.823+0000 7f1e2980e640 1 -- 172.21.15.89:0/1928731615 >> 172.21.15.89:0/1928731615 conn(0x7f1e240f7ce0 msgr2=0x7f1e240fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:52:36.826 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.823+0000 7f1e2980e640 1 -- 172.21.15.89:0/1928731615 shutdown_connections 2024-09-13T02:52:36.826 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.823+0000 7f1e2980e640 1 -- 172.21.15.89:0/1928731615 wait complete. 2024-09-13T02:52:36.827 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.824+0000 7f1e2980e640 1 Processor -- start 2024-09-13T02:52:36.827 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.824+0000 7f1e2980e640 1 -- start start 2024-09-13T02:52:36.827 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.824+0000 7f1e2980e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1e240fc540 0x7f1e24071570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:36.828 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.824+0000 7f1e2980e640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1e240fd810 0x7f1e2406fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:36.828 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.824+0000 7f1e2980e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e2406fff0 con 0x7f1e240fc540 2024-09-13T02:52:36.828 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.824+0000 7f1e2980e640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e24070130 con 0x7f1e240fd810 2024-09-13T02:52:36.828 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.825+0000 7f1e22ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1e240fc540 0x7f1e24071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:36.828 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.825+0000 7f1e227fc640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1e240fd810 0x7f1e2406fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:36.828 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.825+0000 7f1e227fc640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1e240fd810 0x7f1e2406fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.89:35940/0 (socket says 172.21.15.89:35940) 2024-09-13T02:52:36.828 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.825+0000 7f1e227fc640 1 -- 172.21.15.89:0/242678148 learned_addr learned my addr 172.21.15.89:0/242678148 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:52:36.828 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.825+0000 7f1e22ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1e240fc540 0x7f1e24071570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36750/0 (socket says 172.21.15.89:36750) 2024-09-13T02:52:36.828 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.825+0000 7f1e227fc640 1 -- 172.21.15.89:0/242678148 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1e240fc540 msgr2=0x7f1e24071570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:36.828 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.825+0000 7f1e227fc640 1 --2- 172.21.15.89:0/242678148 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1e240fc540 0x7f1e24071570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:36.828 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.825+0000 7f1e227fc640 1 -- 172.21.15.89:0/242678148 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e14005040 con 0x7f1e240fd810 2024-09-13T02:52:36.828 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.825+0000 7f1e22ffd640 1 --2- 172.21.15.89:0/242678148 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1e240fc540 0x7f1e24071570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T02:52:36.828 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.825+0000 7f1e227fc640 1 --2- 172.21.15.89:0/242678148 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1e240fd810 0x7f1e2406fa60 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1e18002a50 tx=0x7f1e18004600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:52:36.829 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.825+0000 7f1e0b7fe640 1 -- 172.21.15.89:0/242678148 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e18007c30 con 0x7f1e240fd810 2024-09-13T02:52:36.829 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.826+0000 7f1e2980e640 1 -- 172.21.15.89:0/242678148 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e24070410 con 0x7f1e240fd810 2024-09-13T02:52:36.829 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.826+0000 7f1e0b7fe640 1 -- 172.21.15.89:0/242678148 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f1e1800f040 con 0x7f1e240fd810 2024-09-13T02:52:36.829 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.826+0000 7f1e0b7fe640 1 -- 172.21.15.89:0/242678148 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e180094b0 con 0x7f1e240fd810 2024-09-13T02:52:36.829 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.826+0000 7f1e2980e640 1 -- 172.21.15.89:0/242678148 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e241150c0 con 0x7f1e240fd810 2024-09-13T02:52:36.830 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.827+0000 7f1e2980e640 1 -- 172.21.15.89:0/242678148 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e2404b720 con 0x7f1e240fd810 2024-09-13T02:52:36.830 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.827+0000 7f1e0b7fe640 1 -- 172.21.15.89:0/242678148 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f1e180096a0 con 0x7f1e240fd810 2024-09-13T02:52:36.830 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.828+0000 7f1e0b7fe640 1 --2- 172.21.15.89:0/242678148 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f1e0c06ed50 0x7f1e0c071200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:52:36.830 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.828+0000 7f1e0b7fe640 1 -- 172.21.15.89:0/242678148 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f1e1808dfb0 con 0x7f1e240fd810 2024-09-13T02:52:36.830 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.828+0000 7f1e22ffd640 1 --2- 172.21.15.89:0/242678148 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f1e0c06ed50 0x7f1e0c071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:52:36.830 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.828+0000 7f1e22ffd640 1 --2- 172.21.15.89:0/242678148 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f1e0c06ed50 0x7f1e0c071200 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1e14000c00 tx=0x7f1e14035040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:52:36.833 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:36.832+0000 7f1e0b7fe640 1 -- 172.21.15.89:0/242678148 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f1e1805b080 con 0x7f1e240fd810 2024-09-13T02:52:36.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:52:36 smithi131 ceph-mon[34689]: pgmap v200: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.1 KiB/s rd, 853 B/s wr, 5 op/s 2024-09-13T02:52:36.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:52:36 smithi131 ceph-mon[34689]: from='client.14536 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:52:36.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:52:36 smithi131 ceph-mon[34689]: from='client.14540 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:52:36.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:52:36 smithi131 ceph-mon[34689]: from='client.14544 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:52:36.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:52:36 smithi131 ceph-mon[34689]: from='client.? 172.21.15.89:0/3902267090' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:52:36.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:52:36 smithi131 ceph-mon[34689]: from='client.? 172.21.15.89:0/3846095920' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T02:52:37.113 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:37.111+0000 7f1e2980e640 1 -- 172.21.15.89:0/242678148 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f1e24104f40 con 0x7f1e240fd810 2024-09-13T02:52:37.113 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:37.112+0000 7f1e0b7fe640 1 -- 172.21.15.89:0/242678148 <== mon.1 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f1e1805aa20 con 0x7f1e240fd810 2024-09-13T02:52:37.113 INFO:teuthology.orchestra.run.smithi089.stdout:HEALTH_OK 2024-09-13T02:52:37.116 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:37.114+0000 7f1e2980e640 1 -- 172.21.15.89:0/242678148 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f1e0c06ed50 msgr2=0x7f1e0c071200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:37.116 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:37.114+0000 7f1e2980e640 1 --2- 172.21.15.89:0/242678148 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f1e0c06ed50 0x7f1e0c071200 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f1e14000c00 tx=0x7f1e14035040 comp rx=0 tx=0).stop 2024-09-13T02:52:37.116 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:37.114+0000 7f1e2980e640 1 -- 172.21.15.89:0/242678148 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1e240fd810 msgr2=0x7f1e2406fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:52:37.116 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:37.114+0000 7f1e2980e640 1 --2- 172.21.15.89:0/242678148 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1e240fd810 0x7f1e2406fa60 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1e18002a50 tx=0x7f1e18004600 comp rx=0 tx=0).stop 2024-09-13T02:52:37.116 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:37.114+0000 7f1e2980e640 1 -- 172.21.15.89:0/242678148 shutdown_connections 2024-09-13T02:52:37.116 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:37.114+0000 7f1e2980e640 1 --2- 172.21.15.89:0/242678148 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f1e0c06ed50 0x7f1e0c071200 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:37.116 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:37.114+0000 7f1e2980e640 1 --2- 172.21.15.89:0/242678148 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1e240fd810 0x7f1e2406fa60 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:37.116 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:37.114+0000 7f1e2980e640 1 --2- 172.21.15.89:0/242678148 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1e240fc540 0x7f1e24071570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:52:37.116 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:37.114+0000 7f1e2980e640 1 -- 172.21.15.89:0/242678148 >> 172.21.15.89:0/242678148 conn(0x7f1e240f7ce0 msgr2=0x7f1e240f94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:52:37.116 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:37.114+0000 7f1e2980e640 1 -- 172.21.15.89:0/242678148 shutdown_connections 2024-09-13T02:52:37.116 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:52:37.114+0000 7f1e2980e640 1 -- 172.21.15.89:0/242678148 wait complete. 2024-09-13T02:52:37.784 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:52:37 smithi089 ceph-mon[27639]: from='client.? 172.21.15.89:0/242678148' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T02:52:37.933 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:52:37 smithi131 ceph-mon[34689]: from='client.? 172.21.15.89:0/242678148' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T02:52:38.933 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:52:38 smithi131 ceph-mon[34689]: from='client.14556 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:52:38.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:52:38 smithi131 ceph-mon[34689]: pgmap v201: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-13T02:52:39.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:52:38 smithi089 ceph-mon[27639]: from='client.14556 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:52:39.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:52:38 smithi089 ceph-mon[27639]: pgmap v201: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-13T02:52:40.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:52:40 smithi131 ceph-mon[34689]: pgmap v202: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-13T02:52:41.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:52:40 smithi089 ceph-mon[27639]: pgmap v202: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-13T02:52:42.933 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:52:42 smithi131 ceph-mon[34689]: pgmap v203: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T02:52:43.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:52:42 smithi089 ceph-mon[27639]: pgmap v203: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T02:52:44.933 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:52:44 smithi131 ceph-mon[34689]: pgmap v204: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T02:52:44.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:52:44 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:52:45.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:52:44 smithi089 ceph-mon[27639]: pgmap v204: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T02:52:45.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:52:44 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:52:46.933 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:52:46 smithi131 ceph-mon[34689]: pgmap v205: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T02:52:47.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:52:46 smithi089 ceph-mon[27639]: pgmap v205: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T02:52:48.933 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:52:48 smithi131 ceph-mon[34689]: pgmap v206: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T02:52:49.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:52:48 smithi089 ceph-mon[27639]: pgmap v206: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T02:52:50.933 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:52:50 smithi131 ceph-mon[34689]: pgmap v207: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T02:52:51.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:52:50 smithi089 ceph-mon[27639]: pgmap v207: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T02:52:52.933 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:52:52 smithi131 ceph-mon[34689]: pgmap v208: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T02:52:53.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:52:52 smithi089 ceph-mon[27639]: pgmap v208: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T02:52:54.933 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:52:54 smithi131 ceph-mon[34689]: pgmap v209: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T02:52:55.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:52:54 smithi089 ceph-mon[27639]: pgmap v209: 65 pgs: 65 active+clean; 586 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T02:52:56.933 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:52:56 smithi131 ceph-mon[34689]: pgmap v210: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.8 KiB/s rd, 426 B/s wr, 4 op/s 2024-09-13T02:52:57.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:52:56 smithi089 ceph-mon[27639]: pgmap v210: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.8 KiB/s rd, 426 B/s wr, 4 op/s 2024-09-13T02:52:58.933 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:52:58 smithi131 ceph-mon[34689]: pgmap v211: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 426 B/s wr, 3 op/s 2024-09-13T02:52:59.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:52:58 smithi089 ceph-mon[27639]: pgmap v211: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 426 B/s wr, 3 op/s 2024-09-13T02:53:00.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:52:59 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:53:00.183 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:52:59 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:53:00.865 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:53:00 smithi089 ceph-mon[27639]: pgmap v212: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.8 KiB/s rd, 511 B/s wr, 5 op/s 2024-09-13T02:53:01.183 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:53:00 smithi131 ceph-mon[34689]: pgmap v212: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.8 KiB/s rd, 511 B/s wr, 5 op/s 2024-09-13T02:53:02.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:53:02 smithi131 ceph-mon[34689]: pgmap v213: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 511 B/s wr, 3 op/s 2024-09-13T02:53:02.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:53:02 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:53:02.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:53:02 smithi131 ceph-mon[34689]: Upgrade: Target is version 19.1.1-322-g7741f7f9 (unknown) 2024-09-13T02:53:02.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:53:02 smithi131 ceph-mon[34689]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, digests ['quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d'] 2024-09-13T02:53:02.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:53:02 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:53:02.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:53:02 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:53:02.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:53:02 smithi131 ceph-mon[34689]: Upgrade: Need to upgrade myself (mgr.smithi089.guohvs) 2024-09-13T02:53:03.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:53:02 smithi089 ceph-mon[27639]: pgmap v213: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 511 B/s wr, 3 op/s 2024-09-13T02:53:03.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:53:02 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:53:03.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:53:02 smithi089 ceph-mon[27639]: Upgrade: Target is version 19.1.1-322-g7741f7f9 (unknown) 2024-09-13T02:53:03.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:53:02 smithi089 ceph-mon[27639]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, digests ['quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d'] 2024-09-13T02:53:03.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:53:02 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:53:03.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:53:02 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:53:03.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:53:02 smithi089 ceph-mon[27639]: Upgrade: Need to upgrade myself (mgr.smithi089.guohvs) 2024-09-13T02:53:03.933 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:53:03 smithi131 ceph-mon[34689]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d on smithi131 2024-09-13T02:53:04.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:53:03 smithi089 ceph-mon[27639]: Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d on smithi131 2024-09-13T02:53:04.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:53:04 smithi131 ceph-mon[34689]: pgmap v214: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 511 B/s wr, 4 op/s 2024-09-13T02:53:05.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:53:04 smithi089 ceph-mon[27639]: pgmap v214: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 511 B/s wr, 4 op/s 2024-09-13T02:53:06.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:53:06 smithi131 ceph-mon[34689]: pgmap v215: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.8 KiB/s rd, 511 B/s wr, 5 op/s 2024-09-13T02:53:06.950 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:53:06 smithi089 ceph-mon[27639]: pgmap v215: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.8 KiB/s rd, 511 B/s wr, 5 op/s 2024-09-13T02:53:07.240 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.238+0000 7f52143a2640 1 -- 172.21.15.89:0/3040507385 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f520c0fc700 msgr2=0x7f520c0fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:07.240 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.238+0000 7f52143a2640 1 --2- 172.21.15.89:0/3040507385 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f520c0fc700 0x7f520c0fcb70 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f51fc0048d0 tx=0x7f51fc009da0 comp rx=0 tx=0).stop 2024-09-13T02:53:07.240 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.238+0000 7f52143a2640 1 -- 172.21.15.89:0/3040507385 shutdown_connections 2024-09-13T02:53:07.240 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.238+0000 7f52143a2640 1 --2- 172.21.15.89:0/3040507385 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f520c0fc700 0x7f520c0fcb70 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:07.240 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.238+0000 7f52143a2640 1 --2- 172.21.15.89:0/3040507385 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f520c0fb430 0x7f520c0fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:07.240 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.238+0000 7f52143a2640 1 -- 172.21.15.89:0/3040507385 >> 172.21.15.89:0/3040507385 conn(0x7f520c0f6c10 msgr2=0x7f520c0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:53:07.240 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.238+0000 7f52143a2640 1 -- 172.21.15.89:0/3040507385 shutdown_connections 2024-09-13T02:53:07.240 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.238+0000 7f52143a2640 1 -- 172.21.15.89:0/3040507385 wait complete. 2024-09-13T02:53:07.241 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.239+0000 7f52143a2640 1 Processor -- start 2024-09-13T02:53:07.241 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.239+0000 7f52143a2640 1 -- start start 2024-09-13T02:53:07.241 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.239+0000 7f52143a2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f520c0fb430 0x7f520c1134f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:53:07.241 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.239+0000 7f52143a2640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f520c0fc700 0x7f520c113a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:53:07.242 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.239+0000 7f52143a2640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f520c114080 con 0x7f520c0fb430 2024-09-13T02:53:07.242 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.239+0000 7f52143a2640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f520c114800 con 0x7f520c0fc700 2024-09-13T02:53:07.242 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.240+0000 7f521193d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f520c0fc700 0x7f520c113a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:53:07.242 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.240+0000 7f521193d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f520c0fc700 0x7f520c113a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.89:59196/0 (socket says 172.21.15.89:59196) 2024-09-13T02:53:07.242 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.240+0000 7f521193d640 1 -- 172.21.15.89:0/26815579 learned_addr learned my addr 172.21.15.89:0/26815579 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:53:07.242 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.240+0000 7f521193d640 1 -- 172.21.15.89:0/26815579 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f520c0fb430 msgr2=0x7f520c1134f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:07.242 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.240+0000 7f521213e640 1 --2- 172.21.15.89:0/26815579 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f520c0fb430 0x7f520c1134f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:53:07.242 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.240+0000 7f521193d640 1 --2- 172.21.15.89:0/26815579 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f520c0fb430 0x7f520c1134f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:07.242 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.240+0000 7f521193d640 1 -- 172.21.15.89:0/26815579 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51fc005040 con 0x7f520c0fc700 2024-09-13T02:53:07.243 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.240+0000 7f521213e640 1 --2- 172.21.15.89:0/26815579 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f520c0fb430 0x7f520c1134f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T02:53:07.243 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.240+0000 7f521193d640 1 --2- 172.21.15.89:0/26815579 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f520c0fc700 0x7f520c113a30 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f51fc0047f0 tx=0x7f51fc009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:53:07.243 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.241+0000 7f5202ffd640 1 -- 172.21.15.89:0/26815579 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f51fc038070 con 0x7f520c0fc700 2024-09-13T02:53:07.243 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.241+0000 7f52143a2640 1 -- 172.21.15.89:0/26815579 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f520c114a30 con 0x7f520c0fc700 2024-09-13T02:53:07.243 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.241+0000 7f52143a2640 1 -- 172.21.15.89:0/26815579 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f520c114ef0 con 0x7f520c0fc700 2024-09-13T02:53:07.243 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.241+0000 7f5202ffd640 1 -- 172.21.15.89:0/26815579 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f51fc02ade0 con 0x7f520c0fc700 2024-09-13T02:53:07.243 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.242+0000 7f5202ffd640 1 -- 172.21.15.89:0/26815579 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f51fc02c070 con 0x7f520c0fc700 2024-09-13T02:53:07.244 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.242+0000 7f52143a2640 1 -- 172.21.15.89:0/26815579 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51f0005240 con 0x7f520c0fc700 2024-09-13T02:53:07.244 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.243+0000 7f5202ffd640 1 -- 172.21.15.89:0/26815579 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f51fc030020 con 0x7f520c0fc700 2024-09-13T02:53:07.245 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.244+0000 7f5202ffd640 1 --2- 172.21.15.89:0/26815579 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f51f806ed60 0x7f51f8071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:53:07.246 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.244+0000 7f5202ffd640 1 -- 172.21.15.89:0/26815579 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f51fc0ae250 con 0x7f520c0fc700 2024-09-13T02:53:07.246 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.244+0000 7f521213e640 1 --2- 172.21.15.89:0/26815579 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f51f806ed60 0x7f51f8071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:53:07.246 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.245+0000 7f521213e640 1 --2- 172.21.15.89:0/26815579 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f51f806ed60 0x7f51f8071210 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5208009af0 tx=0x7f520800b040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:53:07.253 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.252+0000 7f5202ffd640 1 -- 172.21.15.89:0/26815579 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f51fc07b300 con 0x7f520c0fc700 2024-09-13T02:53:07.533 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.531+0000 7f52143a2640 1 -- 172.21.15.89:0/26815579 --> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f51f0000bf0 con 0x7f51f806ed60 2024-09-13T02:53:07.534 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.532+0000 7f5202ffd640 1 -- 172.21.15.89:0/26815579 <== mgr.14204 v2:172.21.15.89:6800/1506060926 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7f51f0000bf0 con 0x7f51f806ed60 2024-09-13T02:53:07.536 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.534+0000 7f52143a2640 1 -- 172.21.15.89:0/26815579 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f51f806ed60 msgr2=0x7f51f8071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:07.536 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.534+0000 7f52143a2640 1 --2- 172.21.15.89:0/26815579 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f51f806ed60 0x7f51f8071210 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f5208009af0 tx=0x7f520800b040 comp rx=0 tx=0).stop 2024-09-13T02:53:07.536 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.534+0000 7f52143a2640 1 -- 172.21.15.89:0/26815579 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f520c0fc700 msgr2=0x7f520c113a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:07.536 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.534+0000 7f52143a2640 1 --2- 172.21.15.89:0/26815579 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f520c0fc700 0x7f520c113a30 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f51fc0047f0 tx=0x7f51fc009da0 comp rx=0 tx=0).stop 2024-09-13T02:53:07.536 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.535+0000 7f52143a2640 1 -- 172.21.15.89:0/26815579 shutdown_connections 2024-09-13T02:53:07.536 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.535+0000 7f52143a2640 1 --2- 172.21.15.89:0/26815579 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f51f806ed60 0x7f51f8071210 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:07.536 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.535+0000 7f52143a2640 1 --2- 172.21.15.89:0/26815579 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f520c0fc700 0x7f520c113a30 secure :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f51fc0047f0 tx=0x7f51fc009da0 comp rx=0 tx=0).stop 2024-09-13T02:53:07.536 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.535+0000 7f52143a2640 1 --2- 172.21.15.89:0/26815579 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f520c0fb430 0x7f520c1134f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:07.537 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.535+0000 7f52143a2640 1 -- 172.21.15.89:0/26815579 >> 172.21.15.89:0/26815579 conn(0x7f520c0f6c10 msgr2=0x7f520c065380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:53:07.537 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.535+0000 7f52143a2640 1 -- 172.21.15.89:0/26815579 shutdown_connections 2024-09-13T02:53:07.537 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.535+0000 7f52143a2640 1 -- 172.21.15.89:0/26815579 wait complete. 2024-09-13T02:53:07.545 INFO:teuthology.orchestra.run.smithi089.stdout:true 2024-09-13T02:53:07.620 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.619+0000 7f1579c67640 1 -- 172.21.15.89:0/1391491285 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15740fc700 msgr2=0x7f15740fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:07.621 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.619+0000 7f1579c67640 1 --2- 172.21.15.89:0/1391491285 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15740fc700 0x7f15740fcb70 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f15680048d0 tx=0x7f1568009da0 comp rx=0 tx=0).stop 2024-09-13T02:53:07.621 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.619+0000 7f1579c67640 1 -- 172.21.15.89:0/1391491285 shutdown_connections 2024-09-13T02:53:07.621 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.619+0000 7f1579c67640 1 --2- 172.21.15.89:0/1391491285 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15740fc700 0x7f15740fcb70 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:07.621 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.619+0000 7f1579c67640 1 --2- 172.21.15.89:0/1391491285 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f15740fb430 0x7f15740fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:07.621 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.619+0000 7f1579c67640 1 -- 172.21.15.89:0/1391491285 >> 172.21.15.89:0/1391491285 conn(0x7f15740f6c10 msgr2=0x7f15740f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:53:07.621 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.620+0000 7f1579c67640 1 -- 172.21.15.89:0/1391491285 shutdown_connections 2024-09-13T02:53:07.621 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.620+0000 7f1579c67640 1 -- 172.21.15.89:0/1391491285 wait complete. 2024-09-13T02:53:07.622 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.620+0000 7f1579c67640 1 Processor -- start 2024-09-13T02:53:07.622 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.620+0000 7f1579c67640 1 -- start start 2024-09-13T02:53:07.623 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.621+0000 7f1579c67640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15740fb430 0x7f157410fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:53:07.623 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.621+0000 7f1579c67640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f15740fc700 0x7f1574112310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:53:07.623 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.621+0000 7f1579c67640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1574065c60 con 0x7f15740fb430 2024-09-13T02:53:07.623 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.621+0000 7f1579c67640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1574065dd0 con 0x7f15740fc700 2024-09-13T02:53:07.623 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.621+0000 7f15737fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15740fb430 0x7f157410fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:53:07.623 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.621+0000 7f15737fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15740fb430 0x7f157410fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:57686/0 (socket says 172.21.15.89:57686) 2024-09-13T02:53:07.623 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.621+0000 7f15737fe640 1 -- 172.21.15.89:0/430299621 learned_addr learned my addr 172.21.15.89:0/430299621 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:53:07.623 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.621+0000 7f1572ffd640 1 --2- 172.21.15.89:0/430299621 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f15740fc700 0x7f1574112310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:53:07.623 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.621+0000 7f1572ffd640 1 -- 172.21.15.89:0/430299621 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15740fb430 msgr2=0x7f157410fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:07.623 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.621+0000 7f1572ffd640 1 --2- 172.21.15.89:0/430299621 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15740fb430 0x7f157410fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:07.623 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.621+0000 7f1572ffd640 1 -- 172.21.15.89:0/430299621 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1568005040 con 0x7f15740fc700 2024-09-13T02:53:07.623 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.621+0000 7f15737fe640 1 --2- 172.21.15.89:0/430299621 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15740fb430 0x7f157410fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T02:53:07.624 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.622+0000 7f1572ffd640 1 --2- 172.21.15.89:0/430299621 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f15740fc700 0x7f1574112310 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f156802a530 tx=0x7f1568009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:53:07.624 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.622+0000 7f155bfff640 1 -- 172.21.15.89:0/430299621 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f156803c070 con 0x7f15740fc700 2024-09-13T02:53:07.624 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.622+0000 7f1579c67640 1 -- 172.21.15.89:0/430299621 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f157410bba0 con 0x7f15740fc700 2024-09-13T02:53:07.624 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.622+0000 7f155bfff640 1 -- 172.21.15.89:0/430299621 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f156802ae90 con 0x7f15740fc700 2024-09-13T02:53:07.624 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.622+0000 7f155bfff640 1 -- 172.21.15.89:0/430299621 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f156802c350 con 0x7f15740fc700 2024-09-13T02:53:07.625 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.622+0000 7f1579c67640 1 -- 172.21.15.89:0/430299621 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f157410c140 con 0x7f15740fc700 2024-09-13T02:53:07.625 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.623+0000 7f1579c67640 1 -- 172.21.15.89:0/430299621 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15740fa890 con 0x7f15740fc700 2024-09-13T02:53:07.625 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.624+0000 7f155bfff640 1 -- 172.21.15.89:0/430299621 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f1568030020 con 0x7f15740fc700 2024-09-13T02:53:07.625 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.624+0000 7f155bfff640 1 --2- 172.21.15.89:0/430299621 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f155c06ed60 0x7f155c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:53:07.625 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.624+0000 7f155bfff640 1 -- 172.21.15.89:0/430299621 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f15680b2610 con 0x7f15740fc700 2024-09-13T02:53:07.626 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.624+0000 7f15737fe640 1 --2- 172.21.15.89:0/430299621 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f155c06ed60 0x7f155c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:53:07.626 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.625+0000 7f15737fe640 1 --2- 172.21.15.89:0/430299621 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f155c06ed60 0x7f155c071210 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1574065950 tx=0x7f156400b040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:53:07.629 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.628+0000 7f155bfff640 1 -- 172.21.15.89:0/430299621 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f156807f780 con 0x7f15740fc700 2024-09-13T02:53:07.807 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.806+0000 7f1579c67640 1 -- 172.21.15.89:0/430299621 --> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1574100b10 con 0x7f155c06ed60 2024-09-13T02:53:07.809 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.807+0000 7f155bfff640 1 -- 172.21.15.89:0/430299621 <== mgr.14204 v2:172.21.15.89:6800/1506060926 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7f1574100b10 con 0x7f155c06ed60 2024-09-13T02:53:07.812 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.811+0000 7f1579c67640 1 -- 172.21.15.89:0/430299621 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f155c06ed60 msgr2=0x7f155c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:07.812 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.811+0000 7f1579c67640 1 --2- 172.21.15.89:0/430299621 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f155c06ed60 0x7f155c071210 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f1574065950 tx=0x7f156400b040 comp rx=0 tx=0).stop 2024-09-13T02:53:07.812 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.811+0000 7f1579c67640 1 -- 172.21.15.89:0/430299621 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f15740fc700 msgr2=0x7f1574112310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:07.812 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.811+0000 7f1579c67640 1 --2- 172.21.15.89:0/430299621 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f15740fc700 0x7f1574112310 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f156802a530 tx=0x7f1568009da0 comp rx=0 tx=0).stop 2024-09-13T02:53:07.813 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.811+0000 7f1579c67640 1 -- 172.21.15.89:0/430299621 shutdown_connections 2024-09-13T02:53:07.813 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.811+0000 7f1579c67640 1 --2- 172.21.15.89:0/430299621 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f155c06ed60 0x7f155c071210 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:07.813 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.811+0000 7f1579c67640 1 --2- 172.21.15.89:0/430299621 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f15740fc700 0x7f1574112310 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:07.813 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.811+0000 7f1579c67640 1 --2- 172.21.15.89:0/430299621 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15740fb430 0x7f157410fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:07.813 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.811+0000 7f1579c67640 1 -- 172.21.15.89:0/430299621 >> 172.21.15.89:0/430299621 conn(0x7f15740f6c10 msgr2=0x7f15740f83f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:53:07.813 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.811+0000 7f1579c67640 1 -- 172.21.15.89:0/430299621 shutdown_connections 2024-09-13T02:53:07.813 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.811+0000 7f1579c67640 1 -- 172.21.15.89:0/430299621 wait complete. 2024-09-13T02:53:07.899 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.898+0000 7f7ca04dc640 1 -- 172.21.15.89:0/1957530512 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c980fc700 msgr2=0x7f7c980fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:07.900 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.898+0000 7f7ca04dc640 1 --2- 172.21.15.89:0/1957530512 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c980fc700 0x7f7c980fcb70 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f7c880048d0 tx=0x7f7c88009da0 comp rx=0 tx=0).stop 2024-09-13T02:53:07.900 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.898+0000 7f7ca04dc640 1 -- 172.21.15.89:0/1957530512 shutdown_connections 2024-09-13T02:53:07.900 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.898+0000 7f7ca04dc640 1 --2- 172.21.15.89:0/1957530512 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c980fc700 0x7f7c980fcb70 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:07.900 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.898+0000 7f7ca04dc640 1 --2- 172.21.15.89:0/1957530512 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7c980fb430 0x7f7c980fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:07.900 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.898+0000 7f7ca04dc640 1 -- 172.21.15.89:0/1957530512 >> 172.21.15.89:0/1957530512 conn(0x7f7c980f6c10 msgr2=0x7f7c980f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:53:07.900 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.898+0000 7f7ca04dc640 1 -- 172.21.15.89:0/1957530512 shutdown_connections 2024-09-13T02:53:07.900 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.898+0000 7f7ca04dc640 1 -- 172.21.15.89:0/1957530512 wait complete. 2024-09-13T02:53:07.902 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.899+0000 7f7ca04dc640 1 Processor -- start 2024-09-13T02:53:07.902 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.899+0000 7f7ca04dc640 1 -- start start 2024-09-13T02:53:07.902 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.899+0000 7f7ca04dc640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7c980fb430 0x7f7c98112180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:53:07.902 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.899+0000 7f7ca04dc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c980fc700 0x7f7c981146d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:53:07.902 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.899+0000 7f7ca04dc640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9810dc30 con 0x7f7c980fc700 2024-09-13T02:53:07.902 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.899+0000 7f7ca04dc640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c98065bd0 con 0x7f7c980fb430 2024-09-13T02:53:07.902 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.899+0000 7f7c9da77640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c980fc700 0x7f7c981146d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:53:07.902 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.899+0000 7f7c9da77640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c980fc700 0x7f7c981146d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:57706/0 (socket says 172.21.15.89:57706) 2024-09-13T02:53:07.902 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.899+0000 7f7c9da77640 1 -- 172.21.15.89:0/4111808028 learned_addr learned my addr 172.21.15.89:0/4111808028 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:53:07.902 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.899+0000 7f7c9e278640 1 --2- 172.21.15.89:0/4111808028 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7c980fb430 0x7f7c98112180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:53:07.902 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.900+0000 7f7c9da77640 1 -- 172.21.15.89:0/4111808028 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7c980fb430 msgr2=0x7f7c98112180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:07.903 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.900+0000 7f7c9da77640 1 --2- 172.21.15.89:0/4111808028 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7c980fb430 0x7f7c98112180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:07.903 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.900+0000 7f7c9da77640 1 -- 172.21.15.89:0/4111808028 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c88005040 con 0x7f7c980fc700 2024-09-13T02:53:07.903 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.900+0000 7f7c9da77640 1 --2- 172.21.15.89:0/4111808028 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c980fc700 0x7f7c981146d0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f7c880043d0 tx=0x7f7c88009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:53:07.903 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.900+0000 7f7c8effd640 1 -- 172.21.15.89:0/4111808028 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c88038070 con 0x7f7c980fc700 2024-09-13T02:53:07.903 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.900+0000 7f7c8effd640 1 -- 172.21.15.89:0/4111808028 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f7c8802ae90 con 0x7f7c980fc700 2024-09-13T02:53:07.903 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.900+0000 7f7ca04dc640 1 -- 172.21.15.89:0/4111808028 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c98065e50 con 0x7f7c980fc700 2024-09-13T02:53:07.903 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.901+0000 7f7c8effd640 1 -- 172.21.15.89:0/4111808028 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c8803e670 con 0x7f7c980fc700 2024-09-13T02:53:07.904 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.901+0000 7f7ca04dc640 1 -- 172.21.15.89:0/4111808028 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c98114eb0 con 0x7f7c980fc700 2024-09-13T02:53:07.904 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.902+0000 7f7c8effd640 1 -- 172.21.15.89:0/4111808028 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f7c88030020 con 0x7f7c980fc700 2024-09-13T02:53:07.904 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.902+0000 7f7ca04dc640 1 -- 172.21.15.89:0/4111808028 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c9804b720 con 0x7f7c980fc700 2024-09-13T02:53:07.906 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.905+0000 7f7c8effd640 1 --2- 172.21.15.89:0/4111808028 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f7c8406ed60 0x7f7c84071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:53:07.906 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.905+0000 7f7c8effd640 1 -- 172.21.15.89:0/4111808028 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f7c880ae370 con 0x7f7c980fc700 2024-09-13T02:53:07.906 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.905+0000 7f7c9e278640 1 --2- 172.21.15.89:0/4111808028 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f7c8406ed60 0x7f7c84071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:53:07.906 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.905+0000 7f7c9e278640 1 --2- 172.21.15.89:0/4111808028 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f7c8406ed60 0x7f7c84071210 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7c98065950 tx=0x7f7c9400b040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:53:07.912 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:07.911+0000 7f7c8effd640 1 -- 172.21.15.89:0/4111808028 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f7c8807b690 con 0x7f7c980fc700 2024-09-13T02:53:08.089 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.087+0000 7f7ca04dc640 1 -- 172.21.15.89:0/4111808028 --> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7c98100bb0 con 0x7f7c8406ed60 2024-09-13T02:53:08.098 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.097+0000 7f7c8effd640 1 -- 172.21.15.89:0/4111808028 <== mgr.14204 v2:172.21.15.89:6800/1506060926 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f7c98100bb0 con 0x7f7c8406ed60 2024-09-13T02:53:08.098 INFO:teuthology.orchestra.run.smithi089.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T02:53:08.098 INFO:teuthology.orchestra.run.smithi089.stdout:alertmanager.smithi089 smithi089 *:9093,9094 running (5m) 55s ago 6m 24.9M - 0.25.0 c8568f914cd2 e0d15812dfa4 2024-09-13T02:53:08.098 INFO:teuthology.orchestra.run.smithi089.stdout:crash.smithi089 smithi089 running (6m) 55s ago 6m 6895k - 17.2.7-1627-gbbdadfa3 a994b00deb3a e8994cd5600e 2024-09-13T02:53:08.099 INFO:teuthology.orchestra.run.smithi089.stdout:crash.smithi131 smithi131 running (5m) 61s ago 5m 6895k - 17.2.7-1627-gbbdadfa3 a994b00deb3a dcbb0a9d5261 2024-09-13T02:53:08.099 INFO:teuthology.orchestra.run.smithi089.stdout:grafana.smithi089 smithi089 *:3000 running (5m) 55s ago 6m 83.4M - 9.4.7 954c08fa6188 bb04115ceb76 2024-09-13T02:53:08.099 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi089.qjoitb smithi089 running (81s) 55s ago 81s 11.9M - 17.2.7-1627-gbbdadfa3 a994b00deb3a ff9b59ec5107 2024-09-13T02:53:08.099 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi089.rarddb smithi089 running (75s) 55s ago 73s 15.2M - 17.2.7-1627-gbbdadfa3 a994b00deb3a db2dc502c1ba 2024-09-13T02:53:08.099 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi131.rbovzc smithi131 running (72s) 61s ago 71s 14.9M - 17.2.7-1627-gbbdadfa3 a994b00deb3a d071b6d99537 2024-09-13T02:53:08.099 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi131.uasrkg smithi131 running (79s) 61s ago 78s 14.2M - 17.2.7-1627-gbbdadfa3 a994b00deb3a 0b3d4ffa6ce5 2024-09-13T02:53:08.099 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.smithi089.guohvs smithi089 *:9283,8765,8443 running (7m) 55s ago 7m 449M - 17.2.7-1627-gbbdadfa3 a994b00deb3a 32ceefe7e647 2024-09-13T02:53:08.099 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.smithi131.aunbqd smithi131 *:8443,9283 running (5m) 61s ago 5m 401M - 17.2.7-1627-gbbdadfa3 a994b00deb3a a950da375271 2024-09-13T02:53:08.099 INFO:teuthology.orchestra.run.smithi089.stdout:mon.smithi089 smithi089 running (7m) 55s ago 8m 47.2M 2048M 17.2.7-1627-gbbdadfa3 a994b00deb3a d2f18141b2af 2024-09-13T02:53:08.099 INFO:teuthology.orchestra.run.smithi089.stdout:mon.smithi131 smithi131 running (5m) 61s ago 5m 38.8M 2048M 17.2.7-1627-gbbdadfa3 a994b00deb3a 1191e59dc7a0 2024-09-13T02:53:08.099 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.smithi089 smithi089 *:9100 running (6m) 55s ago 6m 16.2M - 1.5.0 0da6a335fe13 c5dbf820b035 2024-09-13T02:53:08.099 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.smithi131 smithi131 *:9100 running (5m) 61s ago 5m 16.8M - 1.5.0 0da6a335fe13 c3309019f407 2024-09-13T02:53:08.099 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0 smithi089 running (5m) 55s ago 5m 48.0M 4287M 17.2.7-1627-gbbdadfa3 a994b00deb3a b9404e2bc82c 2024-09-13T02:53:08.099 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1 smithi089 running (4m) 55s ago 4m 45.8M 4287M 17.2.7-1627-gbbdadfa3 a994b00deb3a af6538730e42 2024-09-13T02:53:08.100 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2 smithi089 running (4m) 55s ago 4m 46.4M 4287M 17.2.7-1627-gbbdadfa3 a994b00deb3a 447cf103114b 2024-09-13T02:53:08.100 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3 smithi131 running (3m) 61s ago 3m 46.1M 5312M 17.2.7-1627-gbbdadfa3 a994b00deb3a 0b80a4dea862 2024-09-13T02:53:08.100 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4 smithi131 running (3m) 61s ago 3m 42.8M 5312M 17.2.7-1627-gbbdadfa3 a994b00deb3a 06ec44680b00 2024-09-13T02:53:08.100 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5 smithi131 running (2m) 61s ago 2m 43.1M 5312M 17.2.7-1627-gbbdadfa3 a994b00deb3a ace4b45e5873 2024-09-13T02:53:08.100 INFO:teuthology.orchestra.run.smithi089.stdout:prometheus.smithi089 smithi089 *:9095 running (5m) 55s ago 6m 52.8M - 2.43.0 a07b618ecd1d 003f13763491 2024-09-13T02:53:08.101 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.099+0000 7f7ca04dc640 1 -- 172.21.15.89:0/4111808028 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f7c8406ed60 msgr2=0x7f7c84071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:08.101 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.099+0000 7f7ca04dc640 1 --2- 172.21.15.89:0/4111808028 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f7c8406ed60 0x7f7c84071210 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7c98065950 tx=0x7f7c9400b040 comp rx=0 tx=0).stop 2024-09-13T02:53:08.101 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.099+0000 7f7ca04dc640 1 -- 172.21.15.89:0/4111808028 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c980fc700 msgr2=0x7f7c981146d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:08.101 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.099+0000 7f7ca04dc640 1 --2- 172.21.15.89:0/4111808028 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c980fc700 0x7f7c981146d0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f7c880043d0 tx=0x7f7c88009da0 comp rx=0 tx=0).stop 2024-09-13T02:53:08.101 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.099+0000 7f7ca04dc640 1 -- 172.21.15.89:0/4111808028 shutdown_connections 2024-09-13T02:53:08.101 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.099+0000 7f7ca04dc640 1 --2- 172.21.15.89:0/4111808028 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c980fc700 0x7f7c981146d0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:08.101 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.099+0000 7f7ca04dc640 1 --2- 172.21.15.89:0/4111808028 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f7c8406ed60 0x7f7c84071210 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:08.101 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.099+0000 7f7ca04dc640 1 --2- 172.21.15.89:0/4111808028 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7c980fb430 0x7f7c98112180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:08.101 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.099+0000 7f7ca04dc640 1 -- 172.21.15.89:0/4111808028 >> 172.21.15.89:0/4111808028 conn(0x7f7c980f6c10 msgr2=0x7f7c980f83b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:53:08.101 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.099+0000 7f7ca04dc640 1 -- 172.21.15.89:0/4111808028 shutdown_connections 2024-09-13T02:53:08.101 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.099+0000 7f7ca04dc640 1 -- 172.21.15.89:0/4111808028 wait complete. 2024-09-13T02:53:08.179 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.178+0000 7fa5a7b66640 1 -- 172.21.15.89:0/1646714977 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa5a00ff680 msgr2=0x7fa5a0101a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:08.180 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.178+0000 7fa5a7b66640 1 --2- 172.21.15.89:0/1646714977 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa5a00ff680 0x7fa5a0101a60 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fa5900048d0 tx=0x7fa590009da0 comp rx=0 tx=0).stop 2024-09-13T02:53:08.180 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.178+0000 7fa5a7b66640 1 -- 172.21.15.89:0/1646714977 shutdown_connections 2024-09-13T02:53:08.180 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.178+0000 7fa5a7b66640 1 --2- 172.21.15.89:0/1646714977 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa5a00ff680 0x7fa5a0101a60 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:08.180 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.178+0000 7fa5a7b66640 1 --2- 172.21.15.89:0/1646714977 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa5a0065c40 0x7fa5a00ff140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:08.180 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.178+0000 7fa5a7b66640 1 -- 172.21.15.89:0/1646714977 >> 172.21.15.89:0/1646714977 conn(0x7fa5a00f6c10 msgr2=0x7fa5a00f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:53:08.181 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.178+0000 7fa5a7b66640 1 -- 172.21.15.89:0/1646714977 shutdown_connections 2024-09-13T02:53:08.181 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.178+0000 7fa5a7b66640 1 -- 172.21.15.89:0/1646714977 wait complete. 2024-09-13T02:53:08.181 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.179+0000 7fa5a7b66640 1 Processor -- start 2024-09-13T02:53:08.182 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.179+0000 7fa5a7b66640 1 -- start start 2024-09-13T02:53:08.182 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.179+0000 7fa5a7b66640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa5a0065c40 0x7fa5a010d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:53:08.182 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.179+0000 7fa5a7b66640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa5a00ff680 0x7fa5a010d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:53:08.182 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.179+0000 7fa5a7b66640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a010dc00 con 0x7fa5a0065c40 2024-09-13T02:53:08.182 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.179+0000 7fa5a7b66640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a010e420 con 0x7fa5a00ff680 2024-09-13T02:53:08.182 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.179+0000 7fa5a5101640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa5a00ff680 0x7fa5a010d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:53:08.182 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.180+0000 7fa5a5101640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa5a00ff680 0x7fa5a010d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.89:59244/0 (socket says 172.21.15.89:59244) 2024-09-13T02:53:08.182 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.180+0000 7fa5a5101640 1 -- 172.21.15.89:0/388688580 learned_addr learned my addr 172.21.15.89:0/388688580 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:53:08.182 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.180+0000 7fa5a5902640 1 --2- 172.21.15.89:0/388688580 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa5a0065c40 0x7fa5a010d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:53:08.182 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.180+0000 7fa5a5101640 1 -- 172.21.15.89:0/388688580 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa5a0065c40 msgr2=0x7fa5a010d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:08.182 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.180+0000 7fa5a5101640 1 --2- 172.21.15.89:0/388688580 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa5a0065c40 0x7fa5a010d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:08.182 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.180+0000 7fa5a5101640 1 -- 172.21.15.89:0/388688580 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa590005040 con 0x7fa5a00ff680 2024-09-13T02:53:08.182 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.180+0000 7fa5a5101640 1 --2- 172.21.15.89:0/388688580 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa5a00ff680 0x7fa5a010d5b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa5900048a0 tx=0x7fa590009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:53:08.183 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.181+0000 7fa5967fc640 1 -- 172.21.15.89:0/388688580 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa590038070 con 0x7fa5a00ff680 2024-09-13T02:53:08.183 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.181+0000 7fa5a7b66640 1 -- 172.21.15.89:0/388688580 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5a010e650 con 0x7fa5a00ff680 2024-09-13T02:53:08.183 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.181+0000 7fa5967fc640 1 -- 172.21.15.89:0/388688580 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa590004290 con 0x7fa5a00ff680 2024-09-13T02:53:08.183 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.181+0000 7fa5a7b66640 1 -- 172.21.15.89:0/388688580 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5a010ebf0 con 0x7fa5a00ff680 2024-09-13T02:53:08.183 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.182+0000 7fa5967fc640 1 -- 172.21.15.89:0/388688580 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa590033660 con 0x7fa5a00ff680 2024-09-13T02:53:08.184 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.182+0000 7fa5a7b66640 1 -- 172.21.15.89:0/388688580 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5a00fa890 con 0x7fa5a00ff680 2024-09-13T02:53:08.184 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.183+0000 7fa5967fc640 1 -- 172.21.15.89:0/388688580 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fa590030020 con 0x7fa5a00ff680 2024-09-13T02:53:08.185 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.184+0000 7fa5967fc640 1 --2- 172.21.15.89:0/388688580 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fa58c06ed60 0x7fa58c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:53:08.185 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.184+0000 7fa5a5902640 1 --2- 172.21.15.89:0/388688580 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fa58c06ed60 0x7fa58c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:53:08.186 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.184+0000 7fa5967fc640 1 -- 172.21.15.89:0/388688580 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fa5900ae320 con 0x7fa5a00ff680 2024-09-13T02:53:08.186 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.185+0000 7fa5a5902640 1 --2- 172.21.15.89:0/388688580 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fa58c06ed60 0x7fa58c071210 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa59c009af0 tx=0x7fa59c00b040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:53:08.193 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.192+0000 7fa5967fc640 1 -- 172.21.15.89:0/388688580 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fa59007b480 con 0x7fa5a00ff680 2024-09-13T02:53:08.418 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.417+0000 7fa5a7b66640 1 -- 172.21.15.89:0/388688580 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa5a0104f50 con 0x7fa5a00ff680 2024-09-13T02:53:08.419 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.418+0000 7fa5967fc640 1 -- 172.21.15.89:0/388688580 <== mon.1 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+643 (secure 0 0 0) 0x7fa59002c870 con 0x7fa5a00ff680 2024-09-13T02:53:08.419 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-13T02:53:08.419 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": { 2024-09-13T02:53:08.419 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 2 2024-09-13T02:53:08.419 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T02:53:08.419 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": { 2024-09-13T02:53:08.420 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 2 2024-09-13T02:53:08.420 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T02:53:08.420 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": { 2024-09-13T02:53:08.420 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 6 2024-09-13T02:53:08.420 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T02:53:08.420 INFO:teuthology.orchestra.run.smithi089.stdout: "mds": { 2024-09-13T02:53:08.420 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 4 2024-09-13T02:53:08.420 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T02:53:08.420 INFO:teuthology.orchestra.run.smithi089.stdout: "overall": { 2024-09-13T02:53:08.420 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 14 2024-09-13T02:53:08.420 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-13T02:53:08.420 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-13T02:53:08.422 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.420+0000 7fa5a7b66640 1 -- 172.21.15.89:0/388688580 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fa58c06ed60 msgr2=0x7fa58c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:08.422 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.420+0000 7fa5a7b66640 1 --2- 172.21.15.89:0/388688580 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fa58c06ed60 0x7fa58c071210 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa59c009af0 tx=0x7fa59c00b040 comp rx=0 tx=0).stop 2024-09-13T02:53:08.422 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.421+0000 7fa5a7b66640 1 -- 172.21.15.89:0/388688580 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa5a00ff680 msgr2=0x7fa5a010d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:08.422 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.421+0000 7fa5a7b66640 1 --2- 172.21.15.89:0/388688580 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa5a00ff680 0x7fa5a010d5b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fa5900048a0 tx=0x7fa590009da0 comp rx=0 tx=0).stop 2024-09-13T02:53:08.423 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.421+0000 7fa5a7b66640 1 -- 172.21.15.89:0/388688580 shutdown_connections 2024-09-13T02:53:08.423 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.421+0000 7fa5a7b66640 1 --2- 172.21.15.89:0/388688580 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fa58c06ed60 0x7fa58c071210 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:08.423 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.421+0000 7fa5a7b66640 1 --2- 172.21.15.89:0/388688580 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa5a00ff680 0x7fa5a010d5b0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:08.423 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.421+0000 7fa5a7b66640 1 --2- 172.21.15.89:0/388688580 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa5a0065c40 0x7fa5a010d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:08.423 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.421+0000 7fa5a7b66640 1 -- 172.21.15.89:0/388688580 >> 172.21.15.89:0/388688580 conn(0x7fa5a00f6c10 msgr2=0x7fa5a00f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:53:08.423 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.422+0000 7fa5a7b66640 1 -- 172.21.15.89:0/388688580 shutdown_connections 2024-09-13T02:53:08.423 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.422+0000 7fa5a7b66640 1 -- 172.21.15.89:0/388688580 wait complete. 2024-09-13T02:53:08.545 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.542+0000 7fdab7ee6640 1 -- 172.21.15.89:0/3203712555 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdab00fb430 msgr2=0x7fdab00fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:08.545 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.543+0000 7fdab7ee6640 1 --2- 172.21.15.89:0/3203712555 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdab00fb430 0x7fdab00fb840 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fdaac0048d0 tx=0x7fdaac009da0 comp rx=0 tx=0).stop 2024-09-13T02:53:08.545 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.543+0000 7fdab7ee6640 1 -- 172.21.15.89:0/3203712555 shutdown_connections 2024-09-13T02:53:08.545 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.543+0000 7fdab7ee6640 1 --2- 172.21.15.89:0/3203712555 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdab00fc700 0x7fdab00fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:08.545 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.543+0000 7fdab7ee6640 1 --2- 172.21.15.89:0/3203712555 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdab00fb430 0x7fdab00fb840 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:08.545 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.543+0000 7fdab7ee6640 1 -- 172.21.15.89:0/3203712555 >> 172.21.15.89:0/3203712555 conn(0x7fdab00f6c10 msgr2=0x7fdab00f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:53:08.545 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.543+0000 7fdab7ee6640 1 -- 172.21.15.89:0/3203712555 shutdown_connections 2024-09-13T02:53:08.545 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.543+0000 7fdab7ee6640 1 -- 172.21.15.89:0/3203712555 wait complete. 2024-09-13T02:53:08.546 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.544+0000 7fdab7ee6640 1 Processor -- start 2024-09-13T02:53:08.547 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.544+0000 7fdab7ee6640 1 -- start start 2024-09-13T02:53:08.547 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.544+0000 7fdab7ee6640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdab00fb430 0x7fdab010db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:53:08.547 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.544+0000 7fdab7ee6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdab00fc700 0x7fdab01100a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:53:08.547 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.544+0000 7fdab7ee6640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdab0065cc0 con 0x7fdab00fc700 2024-09-13T02:53:08.547 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.544+0000 7fdab7ee6640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdab0065e30 con 0x7fdab00fb430 2024-09-13T02:53:08.547 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.544+0000 7fdab5481640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdab00fc700 0x7fdab01100a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:53:08.547 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.545+0000 7fdab5481640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdab00fc700 0x7fdab01100a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:57726/0 (socket says 172.21.15.89:57726) 2024-09-13T02:53:08.547 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.545+0000 7fdab5481640 1 -- 172.21.15.89:0/2162447911 learned_addr learned my addr 172.21.15.89:0/2162447911 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:53:08.547 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.545+0000 7fdab5c82640 1 --2- 172.21.15.89:0/2162447911 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdab00fb430 0x7fdab010db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:53:08.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.545+0000 7fdab5481640 1 -- 172.21.15.89:0/2162447911 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdab00fb430 msgr2=0x7fdab010db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:08.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.545+0000 7fdab5481640 1 --2- 172.21.15.89:0/2162447911 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdab00fb430 0x7fdab010db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:08.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.545+0000 7fdab5481640 1 -- 172.21.15.89:0/2162447911 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaac005040 con 0x7fdab00fc700 2024-09-13T02:53:08.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.545+0000 7fdab5481640 1 --2- 172.21.15.89:0/2162447911 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdab00fc700 0x7fdab01100a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fdaa0002a50 tx=0x7fdaa0004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:53:08.549 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.545+0000 7fdaa67fc640 1 -- 172.21.15.89:0/2162447911 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdaa0007c30 con 0x7fdab00fc700 2024-09-13T02:53:08.549 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.545+0000 7fdaa67fc640 1 -- 172.21.15.89:0/2162447911 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fdaa000f040 con 0x7fdab00fc700 2024-09-13T02:53:08.549 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.545+0000 7fdab7ee6640 1 -- 172.21.15.89:0/2162447911 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdab01106a0 con 0x7fdab00fc700 2024-09-13T02:53:08.549 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.546+0000 7fdab7ee6640 1 -- 172.21.15.89:0/2162447911 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdab0110b80 con 0x7fdab00fc700 2024-09-13T02:53:08.549 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.548+0000 7fdaa67fc640 1 -- 172.21.15.89:0/2162447911 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdaa000da10 con 0x7fdab00fc700 2024-09-13T02:53:08.550 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.548+0000 7fdab7ee6640 1 -- 172.21.15.89:0/2162447911 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda94005240 con 0x7fdab00fc700 2024-09-13T02:53:08.550 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.548+0000 7fdaa67fc640 1 -- 172.21.15.89:0/2162447911 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fdaa000dc70 con 0x7fdab00fc700 2024-09-13T02:53:08.550 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.549+0000 7fdaa67fc640 1 --2- 172.21.15.89:0/2162447911 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fda9c06ee20 0x7fda9c0712d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:53:08.550 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.549+0000 7fdaa67fc640 1 -- 172.21.15.89:0/2162447911 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fdaa008d880 con 0x7fdab00fc700 2024-09-13T02:53:08.551 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.549+0000 7fdab5c82640 1 --2- 172.21.15.89:0/2162447911 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fda9c06ee20 0x7fda9c0712d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:53:08.551 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.550+0000 7fdab5c82640 1 --2- 172.21.15.89:0/2162447911 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fda9c06ee20 0x7fda9c0712d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fdaac000c00 tx=0x7fdaac035040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:53:08.558 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.556+0000 7fdaa67fc640 1 -- 172.21.15.89:0/2162447911 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fdaa004d2a0 con 0x7fdab00fc700 2024-09-13T02:53:08.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:53:08 smithi089 ceph-mon[27639]: pgmap v216: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 85 B/s wr, 3 op/s 2024-09-13T02:53:08.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:53:08 smithi089 ceph-mon[27639]: from='client.24313 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:53:08.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:53:08 smithi089 ceph-mon[27639]: from='client.? 172.21.15.89:0/388688580' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:53:08.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:53:08 smithi131 ceph-mon[34689]: pgmap v216: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 85 B/s wr, 3 op/s 2024-09-13T02:53:08.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:53:08 smithi131 ceph-mon[34689]: from='client.24313 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:53:08.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:53:08 smithi131 ceph-mon[34689]: from='client.? 172.21.15.89:0/388688580' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:53:08.949 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.947+0000 7fdab7ee6640 1 -- 172.21.15.89:0/2162447911 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fda94005d00 con 0x7fdab00fc700 2024-09-13T02:53:08.949 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.948+0000 7fdaa67fc640 1 -- 172.21.15.89:0/2162447911 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 19 v19) v1 ==== 76+0+1830 (secure 0 0 0) 0x7fdaa005bad0 con 0x7fdab00fc700 2024-09-13T02:53:08.949 INFO:teuthology.orchestra.run.smithi089.stdout:e19 2024-09-13T02:53:08.949 INFO:teuthology.orchestra.run.smithi089.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T02:53:08.949 INFO:teuthology.orchestra.run.smithi089.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:53:08.950 INFO:teuthology.orchestra.run.smithi089.stdout:legacy client fscid: 1 2024-09-13T02:53:08.950 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:53:08.950 INFO:teuthology.orchestra.run.smithi089.stdout:Filesystem 'cephfs' (1) 2024-09-13T02:53:08.950 INFO:teuthology.orchestra.run.smithi089.stdout:fs_name cephfs 2024-09-13T02:53:08.950 INFO:teuthology.orchestra.run.smithi089.stdout:epoch 19 2024-09-13T02:53:08.950 INFO:teuthology.orchestra.run.smithi089.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T02:53:08.950 INFO:teuthology.orchestra.run.smithi089.stdout:created 2024-09-13T02:51:40.657817+0000 2024-09-13T02:53:08.950 INFO:teuthology.orchestra.run.smithi089.stdout:modified 2024-09-13T02:52:02.591108+0000 2024-09-13T02:53:08.950 INFO:teuthology.orchestra.run.smithi089.stdout:tableserver 0 2024-09-13T02:53:08.950 INFO:teuthology.orchestra.run.smithi089.stdout:root 0 2024-09-13T02:53:08.950 INFO:teuthology.orchestra.run.smithi089.stdout:session_timeout 60 2024-09-13T02:53:08.950 INFO:teuthology.orchestra.run.smithi089.stdout:session_autoclose 300 2024-09-13T02:53:08.950 INFO:teuthology.orchestra.run.smithi089.stdout:max_file_size 1099511627776 2024-09-13T02:53:08.950 INFO:teuthology.orchestra.run.smithi089.stdout:required_client_features {} 2024-09-13T02:53:08.951 INFO:teuthology.orchestra.run.smithi089.stdout:last_failure 0 2024-09-13T02:53:08.951 INFO:teuthology.orchestra.run.smithi089.stdout:last_failure_osd_epoch 44 2024-09-13T02:53:08.951 INFO:teuthology.orchestra.run.smithi089.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:53:08.951 INFO:teuthology.orchestra.run.smithi089.stdout:max_mds 2 2024-09-13T02:53:08.951 INFO:teuthology.orchestra.run.smithi089.stdout:in 0,1 2024-09-13T02:53:08.951 INFO:teuthology.orchestra.run.smithi089.stdout:up {0=14480,1=24257} 2024-09-13T02:53:08.951 INFO:teuthology.orchestra.run.smithi089.stdout:failed 2024-09-13T02:53:08.951 INFO:teuthology.orchestra.run.smithi089.stdout:damaged 2024-09-13T02:53:08.951 INFO:teuthology.orchestra.run.smithi089.stdout:stopped 2024-09-13T02:53:08.951 INFO:teuthology.orchestra.run.smithi089.stdout:data_pools [3] 2024-09-13T02:53:08.951 INFO:teuthology.orchestra.run.smithi089.stdout:metadata_pool 2 2024-09-13T02:53:08.951 INFO:teuthology.orchestra.run.smithi089.stdout:inline_data disabled 2024-09-13T02:53:08.951 INFO:teuthology.orchestra.run.smithi089.stdout:balancer 2024-09-13T02:53:08.951 INFO:teuthology.orchestra.run.smithi089.stdout:standby_count_wanted 1 2024-09-13T02:53:08.951 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi089.rarddb{0:14480} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.89:6828/1561365213,v1:172.21.15.89:6829/1561365213] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:53:08.952 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi089.qjoitb{0:14488} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.89:6826/1464393547,v1:172.21.15.89:6827/1464393547] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:53:08.952 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi131.uasrkg{1:24257} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.131:6824/260493836,v1:172.21.15.131:6825/260493836] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:53:08.952 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi131.rbovzc{1:24265} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.131:6826/665579373,v1:172.21.15.131:6827/665579373] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:53:08.952 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:53:08.952 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:53:08.952 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 19 2024-09-13T02:53:08.952 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.950+0000 7fdab7ee6640 1 -- 172.21.15.89:0/2162447911 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fda9c06ee20 msgr2=0x7fda9c0712d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:08.952 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.950+0000 7fdab7ee6640 1 --2- 172.21.15.89:0/2162447911 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fda9c06ee20 0x7fda9c0712d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fdaac000c00 tx=0x7fdaac035040 comp rx=0 tx=0).stop 2024-09-13T02:53:08.953 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.951+0000 7fdab7ee6640 1 -- 172.21.15.89:0/2162447911 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdab00fc700 msgr2=0x7fdab01100a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:08.953 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.951+0000 7fdab7ee6640 1 --2- 172.21.15.89:0/2162447911 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdab00fc700 0x7fdab01100a0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fdaa0002a50 tx=0x7fdaa0004600 comp rx=0 tx=0).stop 2024-09-13T02:53:08.953 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.951+0000 7fdab7ee6640 1 -- 172.21.15.89:0/2162447911 shutdown_connections 2024-09-13T02:53:08.953 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.951+0000 7fdab7ee6640 1 --2- 172.21.15.89:0/2162447911 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdab00fc700 0x7fdab01100a0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:08.953 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.951+0000 7fdab7ee6640 1 --2- 172.21.15.89:0/2162447911 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fda9c06ee20 0x7fda9c0712d0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:08.953 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.951+0000 7fdab7ee6640 1 --2- 172.21.15.89:0/2162447911 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdab00fb430 0x7fdab010db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:08.953 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.951+0000 7fdab7ee6640 1 -- 172.21.15.89:0/2162447911 >> 172.21.15.89:0/2162447911 conn(0x7fdab00f6c10 msgr2=0x7fdab00f83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:53:08.953 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.951+0000 7fdab7ee6640 1 -- 172.21.15.89:0/2162447911 shutdown_connections 2024-09-13T02:53:08.953 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:08.951+0000 7fdab7ee6640 1 -- 172.21.15.89:0/2162447911 wait complete. 2024-09-13T02:53:09.078 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:09.076+0000 7f453d0a5640 1 -- 172.21.15.89:0/631409614 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45380fc700 msgr2=0x7f45380fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:09.078 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:09.076+0000 7f453d0a5640 1 --2- 172.21.15.89:0/631409614 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45380fc700 0x7f45380fcb70 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f452c0048d0 tx=0x7f452c009da0 comp rx=0 tx=0).stop 2024-09-13T02:53:09.078 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:09.076+0000 7f453d0a5640 1 -- 172.21.15.89:0/631409614 shutdown_connections 2024-09-13T02:53:09.078 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:09.076+0000 7f453d0a5640 1 --2- 172.21.15.89:0/631409614 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45380fc700 0x7f45380fcb70 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:09.078 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:09.076+0000 7f453d0a5640 1 --2- 172.21.15.89:0/631409614 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f45380fb430 0x7f45380fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:09.078 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:09.076+0000 7f453d0a5640 1 -- 172.21.15.89:0/631409614 >> 172.21.15.89:0/631409614 conn(0x7f45380f6c10 msgr2=0x7f45380f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:53:09.078 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:09.077+0000 7f453d0a5640 1 -- 172.21.15.89:0/631409614 shutdown_connections 2024-09-13T02:53:09.078 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:09.077+0000 7f453d0a5640 1 -- 172.21.15.89:0/631409614 wait complete. 2024-09-13T02:53:09.079 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:09.077+0000 7f453d0a5640 1 Processor -- start 2024-09-13T02:53:09.079 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:09.077+0000 7f453d0a5640 1 -- start start 2024-09-13T02:53:09.079 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:09.078+0000 7f453d0a5640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f45380fb430 0x7f453810bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:53:09.079 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:09.078+0000 7f453d0a5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45380fc700 0x7f453810c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:53:09.079 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:09.078+0000 7f453d0a5640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f453810cb10 con 0x7f45380fc700 2024-09-13T02:53:09.079 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:09.078+0000 7f453d0a5640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f453810d330 con 0x7f45380fb430 2024-09-13T02:53:09.080 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:09.078+0000 7f453659c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45380fc700 0x7f453810c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:53:09.080 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:09.078+0000 7f453659c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45380fc700 0x7f453810c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:57748/0 (socket says 172.21.15.89:57748) 2024-09-13T02:53:09.080 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:09.078+0000 7f453659c640 1 -- 172.21.15.89:0/134062981 learned_addr learned my addr 172.21.15.89:0/134062981 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:53:09.080 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:09.078+0000 7f4536d9d640 1 --2- 172.21.15.89:0/134062981 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f45380fb430 0x7f453810bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:53:09.080 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:09.078+0000 7f453659c640 1 -- 172.21.15.89:0/134062981 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f45380fb430 msgr2=0x7f453810bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:09.081 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:09.078+0000 7f453659c640 1 --2- 172.21.15.89:0/134062981 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f45380fb430 0x7f453810bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:09.081 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:09.078+0000 7f453659c640 1 -- 172.21.15.89:0/134062981 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f452c005040 con 0x7f45380fc700 2024-09-13T02:53:09.081 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:09.079+0000 7f453659c640 1 --2- 172.21.15.89:0/134062981 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45380fc700 0x7f453810c4c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f452c0048a0 tx=0x7f452c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:53:09.081 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:09.079+0000 7f451f7fe640 1 -- 172.21.15.89:0/134062981 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f452c038070 con 0x7f45380fc700 2024-09-13T02:53:09.081 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:09.079+0000 7f453d0a5640 1 -- 172.21.15.89:0/134062981 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f453810d5b0 con 0x7f45380fc700 2024-09-13T02:53:09.081 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:09.079+0000 7f451f7fe640 1 -- 172.21.15.89:0/134062981 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f452c004290 con 0x7f45380fc700 2024-09-13T02:53:09.081 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:09.079+0000 7f451f7fe640 1 -- 172.21.15.89:0/134062981 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f452c033660 con 0x7f45380fc700 2024-09-13T02:53:09.081 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:09.079+0000 7f453d0a5640 1 -- 172.21.15.89:0/134062981 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f453810dad0 con 0x7f45380fc700 2024-09-13T02:53:09.082 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:09.081+0000 7f451f7fe640 1 -- 172.21.15.89:0/134062981 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f452c030020 con 0x7f45380fc700 2024-09-13T02:53:09.083 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:09.081+0000 7f451f7fe640 1 --2- 172.21.15.89:0/134062981 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f452006ee20 0x7f45200712d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:53:09.083 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:09.081+0000 7f453d0a5640 1 -- 172.21.15.89:0/134062981 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45380fa890 con 0x7f45380fc700 2024-09-13T02:53:09.083 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:09.081+0000 7f451f7fe640 1 -- 172.21.15.89:0/134062981 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f452c0af240 con 0x7f45380fc700 2024-09-13T02:53:09.083 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:09.082+0000 7f4536d9d640 1 --2- 172.21.15.89:0/134062981 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f452006ee20 0x7f45200712d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:53:09.083 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:09.082+0000 7f4536d9d640 1 --2- 172.21.15.89:0/134062981 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f452006ee20 0x7f45200712d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4528009af0 tx=0x7f452800b040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:53:09.087 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:09.086+0000 7f451f7fe640 1 -- 172.21.15.89:0/134062981 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f452c07c3a0 con 0x7f45380fc700 2024-09-13T02:53:09.262 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:09.261+0000 7f453d0a5640 1 -- 172.21.15.89:0/134062981 --> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f453810de00 con 0x7f452006ee20 2024-09-13T02:53:09.263 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:09.262+0000 7f451f7fe640 1 -- 172.21.15.89:0/134062981 <== mgr.14204 v2:172.21.15.89:6800/1506060926 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7f453810de00 con 0x7f452006ee20 2024-09-13T02:53:09.264 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-13T02:53:09.264 INFO:teuthology.orchestra.run.smithi089.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d", 2024-09-13T02:53:09.264 INFO:teuthology.orchestra.run.smithi089.stdout: "in_progress": true, 2024-09-13T02:53:09.264 INFO:teuthology.orchestra.run.smithi089.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T02:53:09.264 INFO:teuthology.orchestra.run.smithi089.stdout: "services_complete": [], 2024-09-13T02:53:09.264 INFO:teuthology.orchestra.run.smithi089.stdout: "progress": "0/21 daemons upgraded", 2024-09-13T02:53:09.264 INFO:teuthology.orchestra.run.smithi089.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d image on host smithi131", 2024-09-13T02:53:09.264 INFO:teuthology.orchestra.run.smithi089.stdout: "is_paused": false 2024-09-13T02:53:09.264 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-13T02:53:09.266 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:09.264+0000 7f453d0a5640 1 -- 172.21.15.89:0/134062981 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f452006ee20 msgr2=0x7f45200712d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:09.266 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:09.264+0000 7f453d0a5640 1 --2- 172.21.15.89:0/134062981 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f452006ee20 0x7f45200712d0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f4528009af0 tx=0x7f452800b040 comp rx=0 tx=0).stop 2024-09-13T02:53:09.266 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:09.265+0000 7f453d0a5640 1 -- 172.21.15.89:0/134062981 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45380fc700 msgr2=0x7f453810c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:09.266 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:09.265+0000 7f453d0a5640 1 --2- 172.21.15.89:0/134062981 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45380fc700 0x7f453810c4c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f452c0048a0 tx=0x7f452c009da0 comp rx=0 tx=0).stop 2024-09-13T02:53:09.266 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:09.265+0000 7f453d0a5640 1 -- 172.21.15.89:0/134062981 shutdown_connections 2024-09-13T02:53:09.266 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:09.265+0000 7f453d0a5640 1 --2- 172.21.15.89:0/134062981 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45380fc700 0x7f453810c4c0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:09.266 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:09.265+0000 7f453d0a5640 1 --2- 172.21.15.89:0/134062981 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f452006ee20 0x7f45200712d0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:09.267 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:09.265+0000 7f453d0a5640 1 --2- 172.21.15.89:0/134062981 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f45380fb430 0x7f453810bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:09.267 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:09.265+0000 7f453d0a5640 1 -- 172.21.15.89:0/134062981 >> 172.21.15.89:0/134062981 conn(0x7f45380f6c10 msgr2=0x7f45380f83f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:53:09.271 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:09.270+0000 7f453d0a5640 1 -- 172.21.15.89:0/134062981 shutdown_connections 2024-09-13T02:53:09.271 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:09.270+0000 7f453d0a5640 1 -- 172.21.15.89:0/134062981 wait complete. 2024-09-13T02:53:09.352 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:09.351+0000 7f199e72e640 1 -- 172.21.15.89:0/1658469927 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1998065be0 msgr2=0x7f19981015a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:09.352 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:09.351+0000 7f199e72e640 1 --2- 172.21.15.89:0/1658469927 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1998065be0 0x7f19981015a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f19880048d0 tx=0x7f1988009da0 comp rx=0 tx=0).stop 2024-09-13T02:53:09.352 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:09.351+0000 7f199e72e640 1 -- 172.21.15.89:0/1658469927 shutdown_connections 2024-09-13T02:53:09.352 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:09.351+0000 7f199e72e640 1 --2- 172.21.15.89:0/1658469927 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1998101ae0 0x7f1998103ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:09.353 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:09.351+0000 7f199e72e640 1 --2- 172.21.15.89:0/1658469927 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1998065be0 0x7f19981015a0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:09.353 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:09.351+0000 7f199e72e640 1 -- 172.21.15.89:0/1658469927 >> 172.21.15.89:0/1658469927 conn(0x7f19980f6c10 msgr2=0x7f19980f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:53:09.353 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:09.351+0000 7f199e72e640 1 -- 172.21.15.89:0/1658469927 shutdown_connections 2024-09-13T02:53:09.353 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:09.351+0000 7f199e72e640 1 -- 172.21.15.89:0/1658469927 wait complete. 2024-09-13T02:53:09.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:09.351+0000 7f199e72e640 1 Processor -- start 2024-09-13T02:53:09.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:09.352+0000 7f199e72e640 1 -- start start 2024-09-13T02:53:09.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:09.352+0000 7f199e72e640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1998101ae0 0x7f199810f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:53:09.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:09.352+0000 7f199e72e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f199810f960 0x7f19981107d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:53:09.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:09.352+0000 7f199e72e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f199810fe20 con 0x7f199810f960 2024-09-13T02:53:09.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:09.352+0000 7f199e72e640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f199810ff60 con 0x7f1998101ae0 2024-09-13T02:53:09.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:09.352+0000 7f19977fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f199810f960 0x7f19981107d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:53:09.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:09.352+0000 7f19977fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f199810f960 0x7f19981107d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:57774/0 (socket says 172.21.15.89:57774) 2024-09-13T02:53:09.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:09.352+0000 7f19977fe640 1 -- 172.21.15.89:0/4263946935 learned_addr learned my addr 172.21.15.89:0/4263946935 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:53:09.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:09.352+0000 7f1997fff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1998101ae0 0x7f199810f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:53:09.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:09.353+0000 7f1997fff640 1 -- 172.21.15.89:0/4263946935 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f199810f960 msgr2=0x7f19981107d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:09.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:09.353+0000 7f1997fff640 1 --2- 172.21.15.89:0/4263946935 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f199810f960 0x7f19981107d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:09.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:09.353+0000 7f1997fff640 1 -- 172.21.15.89:0/4263946935 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1988005040 con 0x7f1998101ae0 2024-09-13T02:53:09.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:09.353+0000 7f19977fe640 1 --2- 172.21.15.89:0/4263946935 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f199810f960 0x7f19981107d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T02:53:09.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:09.353+0000 7f1997fff640 1 --2- 172.21.15.89:0/4263946935 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1998101ae0 0x7f199810f420 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1998065000 tx=0x7f1988009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:53:09.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:09.353+0000 7f1994ff9640 1 -- 172.21.15.89:0/4263946935 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1988038070 con 0x7f1998101ae0 2024-09-13T02:53:09.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:09.353+0000 7f199e72e640 1 -- 172.21.15.89:0/4263946935 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1998110d70 con 0x7f1998101ae0 2024-09-13T02:53:09.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:09.353+0000 7f1994ff9640 1 -- 172.21.15.89:0/4263946935 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f1988032b20 con 0x7f1998101ae0 2024-09-13T02:53:09.356 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:09.354+0000 7f1994ff9640 1 -- 172.21.15.89:0/4263946935 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f198803d760 con 0x7f1998101ae0 2024-09-13T02:53:09.356 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:09.354+0000 7f199e72e640 1 -- 172.21.15.89:0/4263946935 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1998111280 con 0x7f1998101ae0 2024-09-13T02:53:09.357 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:09.355+0000 7f1994ff9640 1 -- 172.21.15.89:0/4263946935 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f1988030020 con 0x7f1998101ae0 2024-09-13T02:53:09.357 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:09.355+0000 7f199e72e640 1 -- 172.21.15.89:0/4263946935 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19980fa890 con 0x7f1998101ae0 2024-09-13T02:53:09.357 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:09.356+0000 7f1994ff9640 1 --2- 172.21.15.89:0/4263946935 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f198006eb50 0x7f1980071000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:53:09.357 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:09.356+0000 7f1994ff9640 1 -- 172.21.15.89:0/4263946935 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f19880adc70 con 0x7f1998101ae0 2024-09-13T02:53:09.357 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:09.356+0000 7f19977fe640 1 --2- 172.21.15.89:0/4263946935 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f198006eb50 0x7f1980071000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:53:09.358 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:09.357+0000 7f19977fe640 1 --2- 172.21.15.89:0/4263946935 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f198006eb50 0x7f1980071000 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f198c007e60 tx=0x7f198c00b040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:53:09.365 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:09.364+0000 7f1994ff9640 1 -- 172.21.15.89:0/4263946935 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f198807ae80 con 0x7f1998101ae0 2024-09-13T02:53:09.592 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:09.590+0000 7f199e72e640 1 -- 172.21.15.89:0/4263946935 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f1998111470 con 0x7f1998101ae0 2024-09-13T02:53:09.592 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:09.591+0000 7f1994ff9640 1 -- 172.21.15.89:0/4263946935 <== mon.1 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f198807a820 con 0x7f1998101ae0 2024-09-13T02:53:09.593 INFO:teuthology.orchestra.run.smithi089.stdout:HEALTH_OK 2024-09-13T02:53:09.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:09.593+0000 7f199e72e640 1 -- 172.21.15.89:0/4263946935 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f198006eb50 msgr2=0x7f1980071000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:09.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:09.593+0000 7f199e72e640 1 --2- 172.21.15.89:0/4263946935 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f198006eb50 0x7f1980071000 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f198c007e60 tx=0x7f198c00b040 comp rx=0 tx=0).stop 2024-09-13T02:53:09.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:09.593+0000 7f199e72e640 1 -- 172.21.15.89:0/4263946935 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1998101ae0 msgr2=0x7f199810f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:09.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:09.593+0000 7f199e72e640 1 --2- 172.21.15.89:0/4263946935 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1998101ae0 0x7f199810f420 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f1998065000 tx=0x7f1988009da0 comp rx=0 tx=0).stop 2024-09-13T02:53:09.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:09.593+0000 7f199e72e640 1 -- 172.21.15.89:0/4263946935 shutdown_connections 2024-09-13T02:53:09.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:09.593+0000 7f199e72e640 1 --2- 172.21.15.89:0/4263946935 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f199810f960 0x7f19981107d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:09.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:09.593+0000 7f199e72e640 1 --2- 172.21.15.89:0/4263946935 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f198006eb50 0x7f1980071000 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:09.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:09.593+0000 7f199e72e640 1 --2- 172.21.15.89:0/4263946935 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1998101ae0 0x7f199810f420 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:09.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:09.593+0000 7f199e72e640 1 -- 172.21.15.89:0/4263946935 >> 172.21.15.89:0/4263946935 conn(0x7f19980f6c10 msgr2=0x7f19980f8ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:53:09.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:09.594+0000 7f199e72e640 1 -- 172.21.15.89:0/4263946935 shutdown_connections 2024-09-13T02:53:09.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:09.594+0000 7f199e72e640 1 -- 172.21.15.89:0/4263946935 wait complete. 2024-09-13T02:53:09.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:53:09 smithi131 ceph-mon[34689]: from='client.24317 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:53:09.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:53:09 smithi131 ceph-mon[34689]: from='client.14570 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:53:09.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:53:09 smithi131 ceph-mon[34689]: from='client.? 172.21.15.89:0/2162447911' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T02:53:09.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:53:09 smithi131 ceph-mon[34689]: from='client.? 172.21.15.89:0/4263946935' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T02:53:10.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:53:09 smithi089 ceph-mon[27639]: from='client.24317 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:53:10.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:53:09 smithi089 ceph-mon[27639]: from='client.14570 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:53:10.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:53:09 smithi089 ceph-mon[27639]: from='client.? 172.21.15.89:0/2162447911' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T02:53:10.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:53:09 smithi089 ceph-mon[27639]: from='client.? 172.21.15.89:0/4263946935' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T02:53:10.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:53:10 smithi131 ceph-mon[34689]: pgmap v217: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-13T02:53:10.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:53:10 smithi131 ceph-mon[34689]: from='client.14582 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:53:11.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:53:10 smithi089 ceph-mon[27639]: pgmap v217: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-13T02:53:11.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:53:10 smithi089 ceph-mon[27639]: from='client.14582 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:53:12.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:53:12 smithi131 ceph-mon[34689]: pgmap v218: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 85 B/s wr, 3 op/s 2024-09-13T02:53:13.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:53:12 smithi089 ceph-mon[27639]: pgmap v218: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 85 B/s wr, 3 op/s 2024-09-13T02:53:14.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:53:14 smithi131 ceph-mon[34689]: pgmap v219: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 85 B/s wr, 4 op/s 2024-09-13T02:53:14.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:53:14 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:53:15.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:53:14 smithi089 ceph-mon[27639]: pgmap v219: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 85 B/s wr, 4 op/s 2024-09-13T02:53:15.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:53:14 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:53:16.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:53:16 smithi131 ceph-mon[34689]: pgmap v220: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 85 B/s wr, 4 op/s 2024-09-13T02:53:17.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:53:16 smithi089 ceph-mon[27639]: pgmap v220: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 85 B/s wr, 4 op/s 2024-09-13T02:53:18.173 INFO:tasks.workunit.client.1.smithi131.stderr:Updating files: 98% (12698/12903) Updating files: 99% (12774/12903) Updating files: 100% (12903/12903) Updating files: 100% (12903/12903), done. 2024-09-13T02:53:18.620 INFO:tasks.workunit.client.1.smithi131.stderr:Note: switching to 'ecab7be58963a5bd03910cd73eef66405d7fdd50'. 2024-09-13T02:53:18.620 INFO:tasks.workunit.client.1.smithi131.stderr: 2024-09-13T02:53:18.621 INFO:tasks.workunit.client.1.smithi131.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-13T02:53:18.621 INFO:tasks.workunit.client.1.smithi131.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-13T02:53:18.621 INFO:tasks.workunit.client.1.smithi131.stderr:state without impacting any branches by switching back to a branch. 2024-09-13T02:53:18.621 INFO:tasks.workunit.client.1.smithi131.stderr: 2024-09-13T02:53:18.621 INFO:tasks.workunit.client.1.smithi131.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-13T02:53:18.621 INFO:tasks.workunit.client.1.smithi131.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-13T02:53:18.621 INFO:tasks.workunit.client.1.smithi131.stderr: 2024-09-13T02:53:18.621 INFO:tasks.workunit.client.1.smithi131.stderr: git switch -c 2024-09-13T02:53:18.621 INFO:tasks.workunit.client.1.smithi131.stderr: 2024-09-13T02:53:18.621 INFO:tasks.workunit.client.1.smithi131.stderr:Or undo this operation with: 2024-09-13T02:53:18.621 INFO:tasks.workunit.client.1.smithi131.stderr: 2024-09-13T02:53:18.621 INFO:tasks.workunit.client.1.smithi131.stderr: git switch - 2024-09-13T02:53:18.621 INFO:tasks.workunit.client.1.smithi131.stderr: 2024-09-13T02:53:18.621 INFO:tasks.workunit.client.1.smithi131.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-13T02:53:18.621 INFO:tasks.workunit.client.1.smithi131.stderr: 2024-09-13T02:53:18.622 INFO:tasks.workunit.client.1.smithi131.stderr:HEAD is now at ecab7be5896 Merge pull request #59767 from zdover23/wip-doc-2024-09-13-backport-59438-to-squid 2024-09-13T02:53:18.626 DEBUG:teuthology.orchestra.run.smithi131:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2024-09-13T02:53:18.693 INFO:tasks.workunit.client.1.smithi131.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-13T02:53:18.695 INFO:tasks.workunit.client.1.smithi131.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-09-13T02:53:18.695 INFO:tasks.workunit.client.1.smithi131.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-13T02:53:18.933 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:53:18 smithi131 ceph-mon[34689]: pgmap v221: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 85 B/s wr, 3 op/s 2024-09-13T02:53:19.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:53:18 smithi089 ceph-mon[27639]: pgmap v221: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 85 B/s wr, 3 op/s 2024-09-13T02:53:19.393 INFO:tasks.workunit.client.1.smithi131.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-13T02:53:19.482 INFO:tasks.workunit.client.1.smithi131.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-13T02:53:19.518 INFO:tasks.workunit.client.1.smithi131.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-09-13T02:53:19.520 INFO:tasks.workunit.client.1.smithi131.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-09-13T02:53:19.520 INFO:tasks.workunit.client.1.smithi131.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-13T02:53:19.559 INFO:tasks.workunit.client.1.smithi131.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-09-13T02:53:19.562 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-13T02:53:19.563 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2024-09-13T02:53:19.619 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.1... 2024-09-13T02:53:19.620 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-09-13T02:53:19.620 DEBUG:teuthology.orchestra.run.smithi131:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ecab7be58963a5bd03910cd73eef66405d7fdd50 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh 2024-09-13T02:53:19.682 INFO:tasks.workunit.client.1.smithi131.stderr:+ mkdir -p fsstress 2024-09-13T02:53:19.684 INFO:tasks.workunit.client.1.smithi131.stderr:+ pushd fsstress 2024-09-13T02:53:19.684 INFO:tasks.workunit.client.1.smithi131.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-13T02:53:19.684 INFO:tasks.workunit.client.1.smithi131.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-09-13T02:53:20.196 INFO:tasks.workunit.client.1.smithi131.stderr:+ tar xzf ltp-full.tgz 2024-09-13T02:53:20.285 INFO:tasks.workunit.client.0.smithi089.stderr:Note: switching to 'ecab7be58963a5bd03910cd73eef66405d7fdd50'. 2024-09-13T02:53:20.285 INFO:tasks.workunit.client.0.smithi089.stderr: 2024-09-13T02:53:20.285 INFO:tasks.workunit.client.0.smithi089.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-13T02:53:20.285 INFO:tasks.workunit.client.0.smithi089.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-13T02:53:20.285 INFO:tasks.workunit.client.0.smithi089.stderr:state without impacting any branches by switching back to a branch. 2024-09-13T02:53:20.285 INFO:tasks.workunit.client.0.smithi089.stderr: 2024-09-13T02:53:20.285 INFO:tasks.workunit.client.0.smithi089.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-13T02:53:20.285 INFO:tasks.workunit.client.0.smithi089.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-13T02:53:20.285 INFO:tasks.workunit.client.0.smithi089.stderr: 2024-09-13T02:53:20.285 INFO:tasks.workunit.client.0.smithi089.stderr: git switch -c 2024-09-13T02:53:20.285 INFO:tasks.workunit.client.0.smithi089.stderr: 2024-09-13T02:53:20.286 INFO:tasks.workunit.client.0.smithi089.stderr:Or undo this operation with: 2024-09-13T02:53:20.286 INFO:tasks.workunit.client.0.smithi089.stderr: 2024-09-13T02:53:20.286 INFO:tasks.workunit.client.0.smithi089.stderr: git switch - 2024-09-13T02:53:20.286 INFO:tasks.workunit.client.0.smithi089.stderr: 2024-09-13T02:53:20.286 INFO:tasks.workunit.client.0.smithi089.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-13T02:53:20.286 INFO:tasks.workunit.client.0.smithi089.stderr: 2024-09-13T02:53:20.286 INFO:tasks.workunit.client.0.smithi089.stderr:HEAD is now at ecab7be5896 Merge pull request #59767 from zdover23/wip-doc-2024-09-13-backport-59438-to-squid 2024-09-13T02:53:20.291 DEBUG:teuthology.orchestra.run.smithi089:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-13T02:53:20.317 INFO:tasks.workunit.client.0.smithi089.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-13T02:53:20.320 INFO:tasks.workunit.client.0.smithi089.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-13T02:53:20.320 INFO:tasks.workunit.client.0.smithi089.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-13T02:53:20.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:53:20 smithi131 ceph-mon[34689]: pgmap v222: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-13T02:53:21.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:53:20 smithi089 ceph-mon[27639]: pgmap v222: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-13T02:53:21.047 INFO:tasks.workunit.client.0.smithi089.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-13T02:53:21.128 INFO:tasks.workunit.client.0.smithi089.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-13T02:53:21.168 INFO:tasks.workunit.client.0.smithi089.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-13T02:53:21.170 INFO:tasks.workunit.client.0.smithi089.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-13T02:53:21.170 INFO:tasks.workunit.client.0.smithi089.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-13T02:53:21.260 INFO:tasks.workunit.client.0.smithi089.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-13T02:53:21.264 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-13T02:53:21.264 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-13T02:53:21.321 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-09-13T02:53:21.322 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-09-13T02:53:21.322 DEBUG:teuthology.orchestra.run.smithi089:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=ecab7be58963a5bd03910cd73eef66405d7fdd50 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-09-13T02:53:21.383 INFO:tasks.workunit.client.0.smithi089.stderr:+ mkdir -p fsstress 2024-09-13T02:53:21.385 INFO:tasks.workunit.client.0.smithi089.stderr:+ pushd fsstress 2024-09-13T02:53:21.385 INFO:tasks.workunit.client.0.smithi089.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-13T02:53:21.385 INFO:tasks.workunit.client.0.smithi089.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-09-13T02:53:22.219 INFO:tasks.workunit.client.0.smithi089.stderr:+ tar xzf ltp-full.tgz 2024-09-13T02:53:22.933 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:53:22 smithi131 ceph-mon[34689]: pgmap v223: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T02:53:23.034 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:53:22 smithi089 ceph-mon[27639]: pgmap v223: 65 pgs: 65 active+clean; 589 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T02:53:24.933 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:53:24 smithi131 ceph-mon[34689]: pgmap v224: 65 pgs: 65 active+clean; 2.7 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 108 KiB/s rd, 181 KiB/s wr, 4 op/s 2024-09-13T02:53:25.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:53:24 smithi089 ceph-mon[27639]: pgmap v224: 65 pgs: 65 active+clean; 2.7 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 108 KiB/s rd, 181 KiB/s wr, 4 op/s 2024-09-13T02:53:26.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:53:26 smithi089 ceph-mon[27639]: pgmap v225: 65 pgs: 65 active+clean; 11 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 449 KiB/s rd, 864 KiB/s wr, 5 op/s 2024-09-13T02:53:26.933 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:53:26 smithi131 ceph-mon[34689]: pgmap v225: 65 pgs: 65 active+clean; 11 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 449 KiB/s rd, 864 KiB/s wr, 5 op/s 2024-09-13T02:53:28.933 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:53:28 smithi131 ceph-mon[34689]: pgmap v226: 65 pgs: 65 active+clean; 17 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 448 KiB/s rd, 1.4 MiB/s wr, 62 op/s 2024-09-13T02:53:29.034 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:53:28 smithi089 ceph-mon[27639]: pgmap v226: 65 pgs: 65 active+clean; 17 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 448 KiB/s rd, 1.4 MiB/s wr, 62 op/s 2024-09-13T02:53:29.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:53:29 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:53:30.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:53:29 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:53:30.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:53:30 smithi131 ceph-mon[34689]: pgmap v227: 65 pgs: 65 active+clean; 56 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 4.8 MiB/s wr, 334 op/s 2024-09-13T02:53:30.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:53:30 smithi131 ceph-mon[34689]: fsmap cephfs:2 {0=cephfs.smithi089.rarddb=up:active,1=cephfs.smithi131.uasrkg=up:active} 2 up:standby-replay 2024-09-13T02:53:31.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:53:30 smithi089 ceph-mon[27639]: pgmap v227: 65 pgs: 65 active+clean; 56 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.3 MiB/s rd, 4.8 MiB/s wr, 334 op/s 2024-09-13T02:53:31.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:53:30 smithi089 ceph-mon[27639]: fsmap cephfs:2 {0=cephfs.smithi089.rarddb=up:active,1=cephfs.smithi131.uasrkg=up:active} 2 up:standby-replay 2024-09-13T02:53:32.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:53:32 smithi131 ceph-mon[34689]: pgmap v228: 65 pgs: 65 active+clean; 63 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 5.4 MiB/s wr, 385 op/s 2024-09-13T02:53:33.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:53:32 smithi089 ceph-mon[27639]: pgmap v228: 65 pgs: 65 active+clean; 63 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 1.7 MiB/s rd, 5.4 MiB/s wr, 385 op/s 2024-09-13T02:53:34.933 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:53:34 smithi131 ceph-mon[34689]: pgmap v229: 65 pgs: 65 active+clean; 70 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 2.0 MiB/s rd, 6.0 MiB/s wr, 402 op/s 2024-09-13T02:53:35.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:53:34 smithi089 ceph-mon[27639]: pgmap v229: 65 pgs: 65 active+clean; 70 MiB data, 1.9 GiB used, 534 GiB / 536 GiB avail; 2.0 MiB/s rd, 6.0 MiB/s wr, 402 op/s 2024-09-13T02:53:36.933 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:53:36 smithi131 ceph-mon[34689]: pgmap v230: 65 pgs: 65 active+clean; 79 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 2.9 MiB/s rd, 6.6 MiB/s wr, 417 op/s 2024-09-13T02:53:37.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:53:36 smithi089 ceph-mon[27639]: pgmap v230: 65 pgs: 65 active+clean; 79 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 2.9 MiB/s rd, 6.6 MiB/s wr, 417 op/s 2024-09-13T02:53:38.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:53:38 smithi131 ceph-mon[34689]: pgmap v231: 65 pgs: 65 active+clean; 86 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 2.9 MiB/s rd, 6.6 MiB/s wr, 471 op/s 2024-09-13T02:53:39.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:53:38 smithi089 ceph-mon[27639]: pgmap v231: 65 pgs: 65 active+clean; 86 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 2.9 MiB/s rd, 6.6 MiB/s wr, 471 op/s 2024-09-13T02:53:39.699 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:39.695+0000 7f044170e640 1 -- 172.21.15.89:0/2844494183 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f043c0fd810 msgr2=0x7f043c0fdc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:39.700 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:39.695+0000 7f044170e640 1 --2- 172.21.15.89:0/2844494183 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f043c0fd810 0x7f043c0fdc80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f04300048d0 tx=0x7f0430009da0 comp rx=0 tx=0).stop 2024-09-13T02:53:39.700 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:39.696+0000 7f044170e640 1 -- 172.21.15.89:0/2844494183 shutdown_connections 2024-09-13T02:53:39.700 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:39.696+0000 7f044170e640 1 --2- 172.21.15.89:0/2844494183 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f043c0fd810 0x7f043c0fdc80 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:39.700 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:39.696+0000 7f044170e640 1 --2- 172.21.15.89:0/2844494183 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f043c0fc540 0x7f043c0fc950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:39.700 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:39.696+0000 7f044170e640 1 -- 172.21.15.89:0/2844494183 >> 172.21.15.89:0/2844494183 conn(0x7f043c0f7ce0 msgr2=0x7f043c0fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:53:39.700 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:39.696+0000 7f044170e640 1 -- 172.21.15.89:0/2844494183 shutdown_connections 2024-09-13T02:53:39.700 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:39.696+0000 7f044170e640 1 -- 172.21.15.89:0/2844494183 wait complete. 2024-09-13T02:53:39.700 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:39.696+0000 7f044170e640 1 Processor -- start 2024-09-13T02:53:39.700 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:39.696+0000 7f044170e640 1 -- start start 2024-09-13T02:53:39.700 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:39.697+0000 7f044170e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f043c0fc540 0x7f043c10f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:53:39.700 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:39.697+0000 7f044170e640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f043c0fd810 0x7f043c10f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:53:39.701 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:39.697+0000 7f044170e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f043c10fe00 con 0x7f043c0fc540 2024-09-13T02:53:39.701 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:39.697+0000 7f044170e640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f043c110620 con 0x7f043c0fd810 2024-09-13T02:53:39.701 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:39.697+0000 7f043affd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f043c0fc540 0x7f043c10f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:53:39.701 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:39.697+0000 7f043a7fc640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f043c0fd810 0x7f043c10f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:53:39.701 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:39.697+0000 7f043affd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f043c0fc540 0x7f043c10f270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:58882/0 (socket says 172.21.15.89:58882) 2024-09-13T02:53:39.701 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:39.697+0000 7f043affd640 1 -- 172.21.15.89:0/2349306038 learned_addr learned my addr 172.21.15.89:0/2349306038 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:53:39.702 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:39.698+0000 7f043affd640 1 -- 172.21.15.89:0/2349306038 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f043c0fd810 msgr2=0x7f043c10f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:39.702 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:39.698+0000 7f043affd640 1 --2- 172.21.15.89:0/2349306038 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f043c0fd810 0x7f043c10f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:39.702 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:39.698+0000 7f043affd640 1 -- 172.21.15.89:0/2349306038 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f042c005040 con 0x7f043c0fc540 2024-09-13T02:53:39.702 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:39.698+0000 7f043affd640 1 --2- 172.21.15.89:0/2349306038 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f043c0fc540 0x7f043c10f270 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f042c009700 tx=0x7f042c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:53:39.702 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:39.698+0000 7f04237fe640 1 -- 172.21.15.89:0/2349306038 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f042c00e930 con 0x7f043c0fc540 2024-09-13T02:53:39.702 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:39.698+0000 7f04237fe640 1 -- 172.21.15.89:0/2349306038 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f042c00f040 con 0x7f043c0fc540 2024-09-13T02:53:39.702 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:39.698+0000 7f044170e640 1 -- 172.21.15.89:0/2349306038 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0430005040 con 0x7f043c0fc540 2024-09-13T02:53:39.702 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:39.698+0000 7f04237fe640 1 -- 172.21.15.89:0/2349306038 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f042c013d90 con 0x7f043c0fc540 2024-09-13T02:53:39.702 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:39.698+0000 7f044170e640 1 -- 172.21.15.89:0/2349306038 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f043c110c60 con 0x7f043c0fc540 2024-09-13T02:53:39.702 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:39.699+0000 7f044170e640 1 -- 172.21.15.89:0/2349306038 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f043c0fb9a0 con 0x7f043c0fc540 2024-09-13T02:53:39.703 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:39.700+0000 7f04237fe640 1 -- 172.21.15.89:0/2349306038 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f042c00ea90 con 0x7f043c0fc540 2024-09-13T02:53:39.703 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:39.701+0000 7f04237fe640 1 --2- 172.21.15.89:0/2349306038 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f042406ed60 0x7f0424071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:53:39.704 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:39.701+0000 7f04237fe640 1 -- 172.21.15.89:0/2349306038 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f042c08e0c0 con 0x7f043c0fc540 2024-09-13T02:53:39.704 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:39.701+0000 7f043a7fc640 1 --2- 172.21.15.89:0/2349306038 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f042406ed60 0x7f0424071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:53:39.704 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:39.701+0000 7f043a7fc640 1 --2- 172.21.15.89:0/2349306038 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f042406ed60 0x7f0424071210 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f0430007ac0 tx=0x7f0430035040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:53:39.708 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:39.706+0000 7f04237fe640 1 -- 172.21.15.89:0/2349306038 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f042c05b190 con 0x7f043c0fc540 2024-09-13T02:53:39.940 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:39.938+0000 7f044170e640 1 -- 172.21.15.89:0/2349306038 --> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f043c111030 con 0x7f042406ed60 2024-09-13T02:53:39.941 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:39.939+0000 7f04237fe640 1 -- 172.21.15.89:0/2349306038 <== mgr.14204 v2:172.21.15.89:6800/1506060926 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7f043c111030 con 0x7f042406ed60 2024-09-13T02:53:39.944 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:39.941+0000 7f044170e640 1 -- 172.21.15.89:0/2349306038 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f042406ed60 msgr2=0x7f0424071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:39.944 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:39.941+0000 7f044170e640 1 --2- 172.21.15.89:0/2349306038 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f042406ed60 0x7f0424071210 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f0430007ac0 tx=0x7f0430035040 comp rx=0 tx=0).stop 2024-09-13T02:53:39.944 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:39.941+0000 7f044170e640 1 -- 172.21.15.89:0/2349306038 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f043c0fc540 msgr2=0x7f043c10f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:39.944 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:39.941+0000 7f044170e640 1 --2- 172.21.15.89:0/2349306038 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f043c0fc540 0x7f043c10f270 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f042c009700 tx=0x7f042c009da0 comp rx=0 tx=0).stop 2024-09-13T02:53:39.944 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:39.941+0000 7f044170e640 1 -- 172.21.15.89:0/2349306038 shutdown_connections 2024-09-13T02:53:39.944 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:39.941+0000 7f044170e640 1 --2- 172.21.15.89:0/2349306038 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f042406ed60 0x7f0424071210 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:39.945 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:39.941+0000 7f044170e640 1 --2- 172.21.15.89:0/2349306038 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f043c0fd810 0x7f043c10f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:39.945 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:39.941+0000 7f044170e640 1 --2- 172.21.15.89:0/2349306038 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f043c0fc540 0x7f043c10f270 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:39.945 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:39.941+0000 7f044170e640 1 -- 172.21.15.89:0/2349306038 >> 172.21.15.89:0/2349306038 conn(0x7f043c0f7ce0 msgr2=0x7f043c0f8590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:53:39.945 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:39.941+0000 7f044170e640 1 -- 172.21.15.89:0/2349306038 shutdown_connections 2024-09-13T02:53:39.945 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:39.941+0000 7f044170e640 1 -- 172.21.15.89:0/2349306038 wait complete. 2024-09-13T02:53:39.952 INFO:teuthology.orchestra.run.smithi089.stdout:true 2024-09-13T02:53:40.035 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.029+0000 7f2f72581640 1 -- 172.21.15.89:0/465876224 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f6c0fc3f0 msgr2=0x7f2f6c0fc860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:40.035 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.029+0000 7f2f72581640 1 --2- 172.21.15.89:0/465876224 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f6c0fc3f0 0x7f2f6c0fc860 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f2f600048d0 tx=0x7f2f60009da0 comp rx=0 tx=0).stop 2024-09-13T02:53:40.035 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.030+0000 7f2f72581640 1 -- 172.21.15.89:0/465876224 shutdown_connections 2024-09-13T02:53:40.035 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.030+0000 7f2f72581640 1 --2- 172.21.15.89:0/465876224 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f6c0fc3f0 0x7f2f6c0fc860 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:40.035 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.030+0000 7f2f72581640 1 --2- 172.21.15.89:0/465876224 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2f6c0fbaa0 0x7f2f6c0fbeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:40.035 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.030+0000 7f2f72581640 1 -- 172.21.15.89:0/465876224 >> 172.21.15.89:0/465876224 conn(0x7f2f6c0f6390 msgr2=0x7f2f6c0f87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:53:40.035 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.030+0000 7f2f72581640 1 -- 172.21.15.89:0/465876224 shutdown_connections 2024-09-13T02:53:40.035 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.030+0000 7f2f72581640 1 -- 172.21.15.89:0/465876224 wait complete. 2024-09-13T02:53:40.036 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.030+0000 7f2f72581640 1 Processor -- start 2024-09-13T02:53:40.036 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.030+0000 7f2f72581640 1 -- start start 2024-09-13T02:53:40.036 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.031+0000 7f2f72581640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2f6c0fbaa0 0x7f2f6c10d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:53:40.036 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.031+0000 7f2f72581640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f6c0fc3f0 0x7f2f6c10d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:53:40.036 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.031+0000 7f2f72581640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6c10dbf0 con 0x7f2f6c0fc3f0 2024-09-13T02:53:40.036 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.031+0000 7f2f72581640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f6c10e410 con 0x7f2f6c0fbaa0 2024-09-13T02:53:40.036 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.031+0000 7f2f6bfff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2f6c0fbaa0 0x7f2f6c10d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:53:40.036 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.031+0000 7f2f6b7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f6c0fc3f0 0x7f2f6c10d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:53:40.036 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.031+0000 7f2f6bfff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2f6c0fbaa0 0x7f2f6c10d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.89:51086/0 (socket says 172.21.15.89:51086) 2024-09-13T02:53:40.036 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.031+0000 7f2f6bfff640 1 -- 172.21.15.89:0/3399295145 learned_addr learned my addr 172.21.15.89:0/3399295145 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:53:40.036 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.031+0000 7f2f6b7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f6c0fc3f0 0x7f2f6c10d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:58912/0 (socket says 172.21.15.89:58912) 2024-09-13T02:53:40.037 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.031+0000 7f2f6bfff640 1 -- 172.21.15.89:0/3399295145 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f6c0fc3f0 msgr2=0x7f2f6c10d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:40.037 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.031+0000 7f2f6bfff640 1 --2- 172.21.15.89:0/3399295145 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f6c0fc3f0 0x7f2f6c10d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:40.037 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.031+0000 7f2f6bfff640 1 -- 172.21.15.89:0/3399295145 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f60005040 con 0x7f2f6c0fbaa0 2024-09-13T02:53:40.037 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.031+0000 7f2f6b7fe640 1 --2- 172.21.15.89:0/3399295145 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f6c0fc3f0 0x7f2f6c10d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T02:53:40.037 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.032+0000 7f2f6bfff640 1 --2- 172.21.15.89:0/3399295145 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2f6c0fbaa0 0x7f2f6c10d060 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c00eb70 tx=0x7f2f5c00b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:53:40.037 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.032+0000 7f2f68ff9640 1 -- 172.21.15.89:0/3399295145 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f5c007c30 con 0x7f2f6c0fbaa0 2024-09-13T02:53:40.037 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.032+0000 7f2f72581640 1 -- 172.21.15.89:0/3399295145 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f6c10e640 con 0x7f2f6c0fbaa0 2024-09-13T02:53:40.037 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.032+0000 7f2f68ff9640 1 -- 172.21.15.89:0/3399295145 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f2f5c00f040 con 0x7f2f6c0fbaa0 2024-09-13T02:53:40.037 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.032+0000 7f2f68ff9640 1 -- 172.21.15.89:0/3399295145 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f5c009470 con 0x7f2f6c0fbaa0 2024-09-13T02:53:40.037 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.032+0000 7f2f72581640 1 -- 172.21.15.89:0/3399295145 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f6c10ebb0 con 0x7f2f6c0fbaa0 2024-09-13T02:53:40.038 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.033+0000 7f2f72581640 1 -- 172.21.15.89:0/3399295145 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f6c1057e0 con 0x7f2f6c0fbaa0 2024-09-13T02:53:40.038 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.034+0000 7f2f68ff9640 1 -- 172.21.15.89:0/3399295145 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f2f5c0095d0 con 0x7f2f6c0fbaa0 2024-09-13T02:53:40.038 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.034+0000 7f2f68ff9640 1 --2- 172.21.15.89:0/3399295145 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f2f5406ed60 0x7f2f54071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:53:40.038 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.034+0000 7f2f68ff9640 1 -- 172.21.15.89:0/3399295145 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f2f5c08dd80 con 0x7f2f6c0fbaa0 2024-09-13T02:53:40.038 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.034+0000 7f2f6b7fe640 1 --2- 172.21.15.89:0/3399295145 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f2f5406ed60 0x7f2f54071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:53:40.038 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.035+0000 7f2f6b7fe640 1 --2- 172.21.15.89:0/3399295145 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f2f5406ed60 0x7f2f54071210 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2f60009ac0 tx=0x7f2f60035040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:53:40.040 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.038+0000 7f2f68ff9640 1 -- 172.21.15.89:0/3399295145 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f2f5c091030 con 0x7f2f6c0fbaa0 2024-09-13T02:53:40.255 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.253+0000 7f2f72581640 1 -- 172.21.15.89:0/3399295145 --> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2f6c10ef30 con 0x7f2f5406ed60 2024-09-13T02:53:40.256 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.254+0000 7f2f68ff9640 1 -- 172.21.15.89:0/3399295145 <== mgr.14204 v2:172.21.15.89:6800/1506060926 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7f2f6c10ef30 con 0x7f2f5406ed60 2024-09-13T02:53:40.259 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.256+0000 7f2f72581640 1 -- 172.21.15.89:0/3399295145 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f2f5406ed60 msgr2=0x7f2f54071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:40.259 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.256+0000 7f2f72581640 1 --2- 172.21.15.89:0/3399295145 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f2f5406ed60 0x7f2f54071210 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f2f60009ac0 tx=0x7f2f60035040 comp rx=0 tx=0).stop 2024-09-13T02:53:40.259 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.256+0000 7f2f72581640 1 -- 172.21.15.89:0/3399295145 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2f6c0fbaa0 msgr2=0x7f2f6c10d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:40.259 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.256+0000 7f2f72581640 1 --2- 172.21.15.89:0/3399295145 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2f6c0fbaa0 0x7f2f6c10d060 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c00eb70 tx=0x7f2f5c00b040 comp rx=0 tx=0).stop 2024-09-13T02:53:40.259 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.257+0000 7f2f72581640 1 -- 172.21.15.89:0/3399295145 shutdown_connections 2024-09-13T02:53:40.259 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.257+0000 7f2f72581640 1 --2- 172.21.15.89:0/3399295145 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f6c0fc3f0 0x7f2f6c10d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:40.259 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.257+0000 7f2f72581640 1 --2- 172.21.15.89:0/3399295145 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f2f5406ed60 0x7f2f54071210 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:40.260 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.257+0000 7f2f72581640 1 --2- 172.21.15.89:0/3399295145 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2f6c0fbaa0 0x7f2f6c10d060 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:40.260 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.257+0000 7f2f72581640 1 -- 172.21.15.89:0/3399295145 >> 172.21.15.89:0/3399295145 conn(0x7f2f6c0f6390 msgr2=0x7f2f6c0f7b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:53:40.260 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.257+0000 7f2f72581640 1 -- 172.21.15.89:0/3399295145 shutdown_connections 2024-09-13T02:53:40.260 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.257+0000 7f2f72581640 1 -- 172.21.15.89:0/3399295145 wait complete. 2024-09-13T02:53:40.361 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.358+0000 7efe32f0c640 1 -- 172.21.15.89:0/902832391 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efe2c0ff740 msgr2=0x7efe2c101b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:40.362 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.358+0000 7efe32f0c640 1 --2- 172.21.15.89:0/902832391 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efe2c0ff740 0x7efe2c101b20 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7efe18004810 tx=0x7efe18009da0 comp rx=0 tx=0).stop 2024-09-13T02:53:40.362 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.358+0000 7efe32f0c640 1 -- 172.21.15.89:0/902832391 shutdown_connections 2024-09-13T02:53:40.362 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.358+0000 7efe32f0c640 1 --2- 172.21.15.89:0/902832391 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efe2c0ff740 0x7efe2c101b20 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:40.362 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.358+0000 7efe32f0c640 1 --2- 172.21.15.89:0/902832391 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efe2c065b80 0x7efe2c0ff200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:40.362 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.358+0000 7efe32f0c640 1 -- 172.21.15.89:0/902832391 >> 172.21.15.89:0/902832391 conn(0x7efe2c0f6c10 msgr2=0x7efe2c0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:53:40.362 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.358+0000 7efe32f0c640 1 -- 172.21.15.89:0/902832391 shutdown_connections 2024-09-13T02:53:40.362 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.358+0000 7efe32f0c640 1 -- 172.21.15.89:0/902832391 wait complete. 2024-09-13T02:53:40.362 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.359+0000 7efe32f0c640 1 Processor -- start 2024-09-13T02:53:40.362 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.359+0000 7efe32f0c640 1 -- start start 2024-09-13T02:53:40.364 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.360+0000 7efe32f0c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efe2c065b80 0x7efe2c10d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:53:40.364 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.360+0000 7efe32f0c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efe2c0ff740 0x7efe2c10d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:53:40.364 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.360+0000 7efe32f0c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe2c10dc20 con 0x7efe2c065b80 2024-09-13T02:53:40.364 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.360+0000 7efe32f0c640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe2c10e3f0 con 0x7efe2c0ff740 2024-09-13T02:53:40.364 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.360+0000 7efe30ca8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efe2c065b80 0x7efe2c10d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:53:40.364 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.360+0000 7efe30ca8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efe2c065b80 0x7efe2c10d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:58928/0 (socket says 172.21.15.89:58928) 2024-09-13T02:53:40.365 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.360+0000 7efe30ca8640 1 -- 172.21.15.89:0/2386268175 learned_addr learned my addr 172.21.15.89:0/2386268175 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:53:40.365 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.360+0000 7efe2bfff640 1 --2- 172.21.15.89:0/2386268175 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efe2c0ff740 0x7efe2c10d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:53:40.365 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.360+0000 7efe30ca8640 1 -- 172.21.15.89:0/2386268175 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efe2c0ff740 msgr2=0x7efe2c10d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:40.365 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.360+0000 7efe30ca8640 1 --2- 172.21.15.89:0/2386268175 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efe2c0ff740 0x7efe2c10d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:40.365 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.360+0000 7efe30ca8640 1 -- 172.21.15.89:0/2386268175 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe18005040 con 0x7efe2c065b80 2024-09-13T02:53:40.365 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.360+0000 7efe30ca8640 1 --2- 172.21.15.89:0/2386268175 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efe2c065b80 0x7efe2c10d090 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7efe2000eb40 tx=0x7efe2000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:53:40.365 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.360+0000 7efe297fa640 1 -- 172.21.15.89:0/2386268175 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe20007c30 con 0x7efe2c065b80 2024-09-13T02:53:40.365 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.360+0000 7efe32f0c640 1 -- 172.21.15.89:0/2386268175 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe2c10e680 con 0x7efe2c065b80 2024-09-13T02:53:40.365 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.360+0000 7efe297fa640 1 -- 172.21.15.89:0/2386268175 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7efe2000f040 con 0x7efe2c065b80 2024-09-13T02:53:40.365 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.361+0000 7efe32f0c640 1 -- 172.21.15.89:0/2386268175 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe2c10ec20 con 0x7efe2c065b80 2024-09-13T02:53:40.365 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.361+0000 7efe297fa640 1 -- 172.21.15.89:0/2386268175 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe2000caf0 con 0x7efe2c065b80 2024-09-13T02:53:40.365 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.362+0000 7efe32f0c640 1 -- 172.21.15.89:0/2386268175 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe2c0fa890 con 0x7efe2c065b80 2024-09-13T02:53:40.366 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.362+0000 7efe297fa640 1 -- 172.21.15.89:0/2386268175 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7efe200096b0 con 0x7efe2c065b80 2024-09-13T02:53:40.366 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.363+0000 7efe297fa640 1 --2- 172.21.15.89:0/2386268175 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7efe1c06ed60 0x7efe1c071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:53:40.366 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.363+0000 7efe297fa640 1 -- 172.21.15.89:0/2386268175 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7efe2008e350 con 0x7efe2c065b80 2024-09-13T02:53:40.367 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.363+0000 7efe2bfff640 1 --2- 172.21.15.89:0/2386268175 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7efe1c06ed60 0x7efe1c071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:53:40.367 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.364+0000 7efe2bfff640 1 --2- 172.21.15.89:0/2386268175 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7efe1c06ed60 0x7efe1c071210 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7efe18007ac0 tx=0x7efe18035040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:53:40.369 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.368+0000 7efe297fa640 1 -- 172.21.15.89:0/2386268175 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7efe2005b420 con 0x7efe2c065b80 2024-09-13T02:53:40.621 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.620+0000 7efe32f0c640 1 -- 172.21.15.89:0/2386268175 --> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7efe2c10f000 con 0x7efe1c06ed60 2024-09-13T02:53:40.631 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.630+0000 7efe297fa640 1 -- 172.21.15.89:0/2386268175 <== mgr.14204 v2:172.21.15.89:6800/1506060926 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3542 (secure 0 0 0) 0x7efe2c10f000 con 0x7efe1c06ed60 2024-09-13T02:53:40.632 INFO:teuthology.orchestra.run.smithi089.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T02:53:40.632 INFO:teuthology.orchestra.run.smithi089.stdout:alertmanager.smithi089 smithi089 *:9093,9094 running (5m) 88s ago 7m 24.9M - 0.25.0 c8568f914cd2 e0d15812dfa4 2024-09-13T02:53:40.632 INFO:teuthology.orchestra.run.smithi089.stdout:crash.smithi089 smithi089 running (7m) 88s ago 7m 6895k - 17.2.7-1627-gbbdadfa3 a994b00deb3a e8994cd5600e 2024-09-13T02:53:40.632 INFO:teuthology.orchestra.run.smithi089.stdout:crash.smithi131 smithi131 running (6m) 94s ago 6m 6895k - 17.2.7-1627-gbbdadfa3 a994b00deb3a dcbb0a9d5261 2024-09-13T02:53:40.632 INFO:teuthology.orchestra.run.smithi089.stdout:grafana.smithi089 smithi089 *:3000 running (5m) 88s ago 6m 83.4M - 9.4.7 954c08fa6188 bb04115ceb76 2024-09-13T02:53:40.632 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi089.qjoitb smithi089 running (113s) 88s ago 113s 11.9M - 17.2.7-1627-gbbdadfa3 a994b00deb3a ff9b59ec5107 2024-09-13T02:53:40.632 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi089.rarddb smithi089 running (107s) 88s ago 106s 15.2M - 17.2.7-1627-gbbdadfa3 a994b00deb3a db2dc502c1ba 2024-09-13T02:53:40.632 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi131.rbovzc smithi131 running (104s) 94s ago 104s 14.9M - 17.2.7-1627-gbbdadfa3 a994b00deb3a d071b6d99537 2024-09-13T02:53:40.632 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi131.uasrkg smithi131 running (111s) 94s ago 111s 14.2M - 17.2.7-1627-gbbdadfa3 a994b00deb3a 0b3d4ffa6ce5 2024-09-13T02:53:40.632 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.smithi089.guohvs smithi089 *:9283,8765,8443 running (8m) 88s ago 8m 449M - 17.2.7-1627-gbbdadfa3 a994b00deb3a 32ceefe7e647 2024-09-13T02:53:40.632 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.smithi131.aunbqd smithi131 *:8443,9283 running (6m) 94s ago 6m 401M - 17.2.7-1627-gbbdadfa3 a994b00deb3a a950da375271 2024-09-13T02:53:40.633 INFO:teuthology.orchestra.run.smithi089.stdout:mon.smithi089 smithi089 running (8m) 88s ago 8m 47.2M 2048M 17.2.7-1627-gbbdadfa3 a994b00deb3a d2f18141b2af 2024-09-13T02:53:40.633 INFO:teuthology.orchestra.run.smithi089.stdout:mon.smithi131 smithi131 running (6m) 94s ago 6m 38.8M 2048M 17.2.7-1627-gbbdadfa3 a994b00deb3a 1191e59dc7a0 2024-09-13T02:53:40.633 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.smithi089 smithi089 *:9100 running (7m) 88s ago 7m 16.2M - 1.5.0 0da6a335fe13 c5dbf820b035 2024-09-13T02:53:40.633 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.smithi131 smithi131 *:9100 running (6m) 94s ago 6m 16.8M - 1.5.0 0da6a335fe13 c3309019f407 2024-09-13T02:53:40.633 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0 smithi089 running (5m) 88s ago 5m 48.0M 4287M 17.2.7-1627-gbbdadfa3 a994b00deb3a b9404e2bc82c 2024-09-13T02:53:40.633 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1 smithi089 running (5m) 88s ago 5m 45.8M 4287M 17.2.7-1627-gbbdadfa3 a994b00deb3a af6538730e42 2024-09-13T02:53:40.633 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2 smithi089 running (4m) 88s ago 4m 46.4M 4287M 17.2.7-1627-gbbdadfa3 a994b00deb3a 447cf103114b 2024-09-13T02:53:40.633 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3 smithi131 running (4m) 94s ago 4m 46.1M 5312M 17.2.7-1627-gbbdadfa3 a994b00deb3a 0b80a4dea862 2024-09-13T02:53:40.633 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4 smithi131 running (3m) 94s ago 3m 42.8M 5312M 17.2.7-1627-gbbdadfa3 a994b00deb3a 06ec44680b00 2024-09-13T02:53:40.633 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5 smithi131 running (3m) 94s ago 3m 43.1M 5312M 17.2.7-1627-gbbdadfa3 a994b00deb3a ace4b45e5873 2024-09-13T02:53:40.633 INFO:teuthology.orchestra.run.smithi089.stdout:prometheus.smithi089 smithi089 *:9095 running (5m) 88s ago 6m 52.8M - 2.43.0 a07b618ecd1d 003f13763491 2024-09-13T02:53:40.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.633+0000 7efe32f0c640 1 -- 172.21.15.89:0/2386268175 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7efe1c06ed60 msgr2=0x7efe1c071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:40.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.633+0000 7efe32f0c640 1 --2- 172.21.15.89:0/2386268175 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7efe1c06ed60 0x7efe1c071210 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7efe18007ac0 tx=0x7efe18035040 comp rx=0 tx=0).stop 2024-09-13T02:53:40.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.633+0000 7efe32f0c640 1 -- 172.21.15.89:0/2386268175 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efe2c065b80 msgr2=0x7efe2c10d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:40.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.633+0000 7efe32f0c640 1 --2- 172.21.15.89:0/2386268175 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efe2c065b80 0x7efe2c10d090 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7efe2000eb40 tx=0x7efe2000b040 comp rx=0 tx=0).stop 2024-09-13T02:53:40.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.633+0000 7efe32f0c640 1 -- 172.21.15.89:0/2386268175 shutdown_connections 2024-09-13T02:53:40.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.633+0000 7efe32f0c640 1 --2- 172.21.15.89:0/2386268175 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7efe1c06ed60 0x7efe1c071210 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:40.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.633+0000 7efe32f0c640 1 --2- 172.21.15.89:0/2386268175 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efe2c0ff740 0x7efe2c10d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:40.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.633+0000 7efe32f0c640 1 --2- 172.21.15.89:0/2386268175 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efe2c065b80 0x7efe2c10d090 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:40.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.633+0000 7efe32f0c640 1 -- 172.21.15.89:0/2386268175 >> 172.21.15.89:0/2386268175 conn(0x7efe2c0f6c10 msgr2=0x7efe2c0f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:53:40.636 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.633+0000 7efe32f0c640 1 -- 172.21.15.89:0/2386268175 shutdown_connections 2024-09-13T02:53:40.636 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.633+0000 7efe32f0c640 1 -- 172.21.15.89:0/2386268175 wait complete. 2024-09-13T02:53:40.719 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.717+0000 7f0c0e0f2640 1 -- 172.21.15.89:0/3894813768 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c080fb430 msgr2=0x7f0c080fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:40.719 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.717+0000 7f0c0e0f2640 1 --2- 172.21.15.89:0/3894813768 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c080fb430 0x7f0c080fb840 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f0bf80048d0 tx=0x7f0bf8009da0 comp rx=0 tx=0).stop 2024-09-13T02:53:40.720 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.717+0000 7f0c0e0f2640 1 -- 172.21.15.89:0/3894813768 shutdown_connections 2024-09-13T02:53:40.720 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.717+0000 7f0c0e0f2640 1 --2- 172.21.15.89:0/3894813768 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0c080fc700 0x7f0c080fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:40.720 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.717+0000 7f0c0e0f2640 1 --2- 172.21.15.89:0/3894813768 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c080fb430 0x7f0c080fb840 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:40.720 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.717+0000 7f0c0e0f2640 1 -- 172.21.15.89:0/3894813768 >> 172.21.15.89:0/3894813768 conn(0x7f0c080f6c10 msgr2=0x7f0c080f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:53:40.720 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.717+0000 7f0c0e0f2640 1 -- 172.21.15.89:0/3894813768 shutdown_connections 2024-09-13T02:53:40.720 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.717+0000 7f0c0e0f2640 1 -- 172.21.15.89:0/3894813768 wait complete. 2024-09-13T02:53:40.720 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.718+0000 7f0c0e0f2640 1 Processor -- start 2024-09-13T02:53:40.722 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.718+0000 7f0c0e0f2640 1 -- start start 2024-09-13T02:53:40.722 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.719+0000 7f0c0e0f2640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0c080fb430 0x7f0c0810bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:53:40.722 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.719+0000 7f0c0e0f2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c080fc700 0x7f0c0810c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:53:40.722 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.719+0000 7f0c0e0f2640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c0810caf0 con 0x7f0c080fc700 2024-09-13T02:53:40.723 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.719+0000 7f0c0e0f2640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c0810d310 con 0x7f0c080fb430 2024-09-13T02:53:40.723 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.719+0000 7f0c06ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c080fc700 0x7f0c0810c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:53:40.723 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.719+0000 7f0c077fe640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0c080fb430 0x7f0c0810bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:53:40.723 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.719+0000 7f0c06ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c080fc700 0x7f0c0810c4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:58950/0 (socket says 172.21.15.89:58950) 2024-09-13T02:53:40.723 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.719+0000 7f0c06ffd640 1 -- 172.21.15.89:0/508496988 learned_addr learned my addr 172.21.15.89:0/508496988 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:53:40.723 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.719+0000 7f0c06ffd640 1 -- 172.21.15.89:0/508496988 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0c080fb430 msgr2=0x7f0c0810bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:40.723 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.719+0000 7f0c06ffd640 1 --2- 172.21.15.89:0/508496988 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0c080fb430 0x7f0c0810bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:40.723 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.719+0000 7f0c06ffd640 1 -- 172.21.15.89:0/508496988 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bf8005040 con 0x7f0c080fc700 2024-09-13T02:53:40.723 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.719+0000 7f0c06ffd640 1 --2- 172.21.15.89:0/508496988 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c080fc700 0x7f0c0810c4a0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f0bfc00eb70 tx=0x7f0bfc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:53:40.723 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.720+0000 7f0beffff640 1 -- 172.21.15.89:0/508496988 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0bfc007e10 con 0x7f0c080fc700 2024-09-13T02:53:40.723 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.720+0000 7f0beffff640 1 -- 172.21.15.89:0/508496988 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0bfc00dba0 con 0x7f0c080fc700 2024-09-13T02:53:40.723 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.720+0000 7f0beffff640 1 -- 172.21.15.89:0/508496988 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0bfc009880 con 0x7f0c080fc700 2024-09-13T02:53:40.724 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.720+0000 7f0c0e0f2640 1 -- 172.21.15.89:0/508496988 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c0810d540 con 0x7f0c080fc700 2024-09-13T02:53:40.724 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.720+0000 7f0c0e0f2640 1 -- 172.21.15.89:0/508496988 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c0810dae0 con 0x7f0c080fc700 2024-09-13T02:53:40.724 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.721+0000 7f0c0e0f2640 1 -- 172.21.15.89:0/508496988 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c080fa890 con 0x7f0c080fc700 2024-09-13T02:53:40.725 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.722+0000 7f0beffff640 1 -- 172.21.15.89:0/508496988 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f0bfc00dd10 con 0x7f0c080fc700 2024-09-13T02:53:40.725 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.722+0000 7f0beffff640 1 --2- 172.21.15.89:0/508496988 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f0bf006ed60 0x7f0bf0071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:53:40.725 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.722+0000 7f0c077fe640 1 --2- 172.21.15.89:0/508496988 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f0bf006ed60 0x7f0bf0071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:53:40.725 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.722+0000 7f0beffff640 1 -- 172.21.15.89:0/508496988 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f0bfc015020 con 0x7f0c080fc700 2024-09-13T02:53:40.725 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.723+0000 7f0c077fe640 1 --2- 172.21.15.89:0/508496988 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f0bf006ed60 0x7f0bf0071210 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0bf8004540 tx=0x7f0bf8039040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:53:40.728 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.727+0000 7f0beffff640 1 -- 172.21.15.89:0/508496988 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f0bfc05bcc0 con 0x7f0c080fc700 2024-09-13T02:53:40.933 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:53:40 smithi131 ceph-mon[34689]: pgmap v232: 65 pgs: 65 active+clean; 137 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 4.7 MiB/s rd, 11 MiB/s wr, 950 op/s 2024-09-13T02:53:40.989 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.988+0000 7f0c0e0f2640 1 -- 172.21.15.89:0/508496988 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0c0804b720 con 0x7f0c080fc700 2024-09-13T02:53:40.989 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:53:40 smithi089 ceph-mon[27639]: pgmap v232: 65 pgs: 65 active+clean; 137 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 4.7 MiB/s rd, 11 MiB/s wr, 950 op/s 2024-09-13T02:53:40.990 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.988+0000 7f0beffff640 1 -- 172.21.15.89:0/508496988 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+643 (secure 0 0 0) 0x7f0bfc05b660 con 0x7f0c080fc700 2024-09-13T02:53:40.990 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-13T02:53:40.990 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": { 2024-09-13T02:53:40.990 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 2 2024-09-13T02:53:40.990 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T02:53:40.990 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": { 2024-09-13T02:53:40.990 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 2 2024-09-13T02:53:40.991 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T02:53:40.991 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": { 2024-09-13T02:53:40.991 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 6 2024-09-13T02:53:40.991 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T02:53:40.991 INFO:teuthology.orchestra.run.smithi089.stdout: "mds": { 2024-09-13T02:53:40.991 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 4 2024-09-13T02:53:40.991 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T02:53:40.991 INFO:teuthology.orchestra.run.smithi089.stdout: "overall": { 2024-09-13T02:53:40.991 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 14 2024-09-13T02:53:40.991 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-13T02:53:40.991 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-13T02:53:40.992 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.991+0000 7f0c0e0f2640 1 -- 172.21.15.89:0/508496988 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f0bf006ed60 msgr2=0x7f0bf0071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:40.992 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.991+0000 7f0c0e0f2640 1 --2- 172.21.15.89:0/508496988 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f0bf006ed60 0x7f0bf0071210 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0bf8004540 tx=0x7f0bf8039040 comp rx=0 tx=0).stop 2024-09-13T02:53:40.992 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.991+0000 7f0c0e0f2640 1 -- 172.21.15.89:0/508496988 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c080fc700 msgr2=0x7f0c0810c4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:40.993 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.991+0000 7f0c0e0f2640 1 --2- 172.21.15.89:0/508496988 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c080fc700 0x7f0c0810c4a0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f0bfc00eb70 tx=0x7f0bfc00b040 comp rx=0 tx=0).stop 2024-09-13T02:53:40.993 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.991+0000 7f0c0e0f2640 1 -- 172.21.15.89:0/508496988 shutdown_connections 2024-09-13T02:53:40.993 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.991+0000 7f0c0e0f2640 1 --2- 172.21.15.89:0/508496988 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0c080fc700 0x7f0c0810c4a0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:40.993 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.991+0000 7f0c0e0f2640 1 --2- 172.21.15.89:0/508496988 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f0bf006ed60 0x7f0bf0071210 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:40.993 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.991+0000 7f0c0e0f2640 1 --2- 172.21.15.89:0/508496988 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0c080fb430 0x7f0c0810bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:40.993 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.991+0000 7f0c0e0f2640 1 -- 172.21.15.89:0/508496988 >> 172.21.15.89:0/508496988 conn(0x7f0c080f6c10 msgr2=0x7f0c080f83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:53:40.993 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.991+0000 7f0c0e0f2640 1 -- 172.21.15.89:0/508496988 shutdown_connections 2024-09-13T02:53:40.993 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:40.991+0000 7f0c0e0f2640 1 -- 172.21.15.89:0/508496988 wait complete. 2024-09-13T02:53:41.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.083+0000 7f813effa640 1 -- 172.21.15.89:0/3588832488 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81380666b0 msgr2=0x7f81380ff150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:41.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.083+0000 7f813effa640 1 --2- 172.21.15.89:0/3588832488 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81380666b0 0x7f81380ff150 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f81340048d0 tx=0x7f8134009da0 comp rx=0 tx=0).stop 2024-09-13T02:53:41.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.083+0000 7f813effa640 1 -- 172.21.15.89:0/3588832488 shutdown_connections 2024-09-13T02:53:41.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.083+0000 7f813effa640 1 --2- 172.21.15.89:0/3588832488 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81380ff690 0x7f8138101a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:41.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.083+0000 7f813effa640 1 --2- 172.21.15.89:0/3588832488 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81380666b0 0x7f81380ff150 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:41.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.083+0000 7f813effa640 1 -- 172.21.15.89:0/3588832488 >> 172.21.15.89:0/3588832488 conn(0x7f81380f6c20 msgr2=0x7f81380f9030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:53:41.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.083+0000 7f813effa640 1 -- 172.21.15.89:0/3588832488 shutdown_connections 2024-09-13T02:53:41.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.083+0000 7f813effa640 1 -- 172.21.15.89:0/3588832488 wait complete. 2024-09-13T02:53:41.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.084+0000 7f813effa640 1 Processor -- start 2024-09-13T02:53:41.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.084+0000 7f813effa640 1 -- start start 2024-09-13T02:53:41.087 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.084+0000 7f813effa640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81380666b0 0x7f813810d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:53:41.087 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.084+0000 7f813effa640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81380ff690 0x7f813810d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:53:41.087 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.084+0000 7f813effa640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f813810dca0 con 0x7f81380ff690 2024-09-13T02:53:41.087 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.084+0000 7f813effa640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f813810e4c0 con 0x7f81380666b0 2024-09-13T02:53:41.087 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.084+0000 7f813cd96640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81380666b0 0x7f813810d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:53:41.087 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.084+0000 7f812ffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81380ff690 0x7f813810d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:53:41.087 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.084+0000 7f813cd96640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81380666b0 0x7f813810d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.89:51124/0 (socket says 172.21.15.89:51124) 2024-09-13T02:53:41.087 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.084+0000 7f813cd96640 1 -- 172.21.15.89:0/2860402804 learned_addr learned my addr 172.21.15.89:0/2860402804 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:53:41.087 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.084+0000 7f813cd96640 1 -- 172.21.15.89:0/2860402804 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81380ff690 msgr2=0x7f813810d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:41.087 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.084+0000 7f813cd96640 1 --2- 172.21.15.89:0/2860402804 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81380ff690 0x7f813810d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:41.088 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.085+0000 7f813cd96640 1 -- 172.21.15.89:0/2860402804 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8134005040 con 0x7f81380666b0 2024-09-13T02:53:41.088 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.085+0000 7f813cd96640 1 --2- 172.21.15.89:0/2860402804 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81380666b0 0x7f813810d110 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8134009470 tx=0x7f8134009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:53:41.088 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.085+0000 7f812d7fa640 1 -- 172.21.15.89:0/2860402804 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8134038070 con 0x7f81380666b0 2024-09-13T02:53:41.088 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.085+0000 7f812d7fa640 1 -- 172.21.15.89:0/2860402804 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f8134004290 con 0x7f81380666b0 2024-09-13T02:53:41.088 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.085+0000 7f813effa640 1 -- 172.21.15.89:0/2860402804 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f813810e6f0 con 0x7f81380666b0 2024-09-13T02:53:41.088 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.085+0000 7f812d7fa640 1 -- 172.21.15.89:0/2860402804 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8134033420 con 0x7f81380666b0 2024-09-13T02:53:41.088 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.085+0000 7f813effa640 1 -- 172.21.15.89:0/2860402804 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f813810ec90 con 0x7f81380666b0 2024-09-13T02:53:41.089 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.087+0000 7f812d7fa640 1 -- 172.21.15.89:0/2860402804 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f8134030020 con 0x7f81380666b0 2024-09-13T02:53:41.089 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.087+0000 7f813effa640 1 -- 172.21.15.89:0/2860402804 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81380fa8a0 con 0x7f81380666b0 2024-09-13T02:53:41.089 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.087+0000 7f812d7fa640 1 --2- 172.21.15.89:0/2860402804 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f812006ed50 0x7f8120071200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:53:41.089 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.087+0000 7f812d7fa640 1 -- 172.21.15.89:0/2860402804 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f81340ae2e0 con 0x7f81380666b0 2024-09-13T02:53:41.089 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.087+0000 7f812ffff640 1 --2- 172.21.15.89:0/2860402804 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f812006ed50 0x7f8120071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:53:41.089 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.088+0000 7f812ffff640 1 --2- 172.21.15.89:0/2860402804 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f812006ed50 0x7f8120071200 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f813810cec0 tx=0x7f812800b040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:53:41.092 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.091+0000 7f812d7fa640 1 -- 172.21.15.89:0/2860402804 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f813407b3c0 con 0x7f81380666b0 2024-09-13T02:53:41.379 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.378+0000 7f813effa640 1 -- 172.21.15.89:0/2860402804 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f813810ef50 con 0x7f81380666b0 2024-09-13T02:53:41.380 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.378+0000 7f812d7fa640 1 -- 172.21.15.89:0/2860402804 <== mon.1 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 20 v20) v1 ==== 76+0+1847 (secure 0 0 0) 0x7f813407ad60 con 0x7f81380666b0 2024-09-13T02:53:41.380 INFO:teuthology.orchestra.run.smithi089.stdout:e20 2024-09-13T02:53:41.380 INFO:teuthology.orchestra.run.smithi089.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T02:53:41.380 INFO:teuthology.orchestra.run.smithi089.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:53:41.380 INFO:teuthology.orchestra.run.smithi089.stdout:legacy client fscid: 1 2024-09-13T02:53:41.380 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:53:41.380 INFO:teuthology.orchestra.run.smithi089.stdout:Filesystem 'cephfs' (1) 2024-09-13T02:53:41.381 INFO:teuthology.orchestra.run.smithi089.stdout:fs_name cephfs 2024-09-13T02:53:41.381 INFO:teuthology.orchestra.run.smithi089.stdout:epoch 20 2024-09-13T02:53:41.381 INFO:teuthology.orchestra.run.smithi089.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T02:53:41.381 INFO:teuthology.orchestra.run.smithi089.stdout:created 2024-09-13T02:51:40.657817+0000 2024-09-13T02:53:41.381 INFO:teuthology.orchestra.run.smithi089.stdout:modified 2024-09-13T02:53:29.634977+0000 2024-09-13T02:53:41.381 INFO:teuthology.orchestra.run.smithi089.stdout:tableserver 0 2024-09-13T02:53:41.381 INFO:teuthology.orchestra.run.smithi089.stdout:root 0 2024-09-13T02:53:41.381 INFO:teuthology.orchestra.run.smithi089.stdout:session_timeout 60 2024-09-13T02:53:41.381 INFO:teuthology.orchestra.run.smithi089.stdout:session_autoclose 300 2024-09-13T02:53:41.381 INFO:teuthology.orchestra.run.smithi089.stdout:max_file_size 1099511627776 2024-09-13T02:53:41.381 INFO:teuthology.orchestra.run.smithi089.stdout:required_client_features {} 2024-09-13T02:53:41.381 INFO:teuthology.orchestra.run.smithi089.stdout:last_failure 0 2024-09-13T02:53:41.382 INFO:teuthology.orchestra.run.smithi089.stdout:last_failure_osd_epoch 44 2024-09-13T02:53:41.382 INFO:teuthology.orchestra.run.smithi089.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:53:41.382 INFO:teuthology.orchestra.run.smithi089.stdout:max_mds 2 2024-09-13T02:53:41.382 INFO:teuthology.orchestra.run.smithi089.stdout:in 0,1 2024-09-13T02:53:41.382 INFO:teuthology.orchestra.run.smithi089.stdout:up {0=14480,1=24257} 2024-09-13T02:53:41.382 INFO:teuthology.orchestra.run.smithi089.stdout:failed 2024-09-13T02:53:41.382 INFO:teuthology.orchestra.run.smithi089.stdout:damaged 2024-09-13T02:53:41.382 INFO:teuthology.orchestra.run.smithi089.stdout:stopped 2024-09-13T02:53:41.382 INFO:teuthology.orchestra.run.smithi089.stdout:data_pools [3] 2024-09-13T02:53:41.382 INFO:teuthology.orchestra.run.smithi089.stdout:metadata_pool 2 2024-09-13T02:53:41.382 INFO:teuthology.orchestra.run.smithi089.stdout:inline_data disabled 2024-09-13T02:53:41.382 INFO:teuthology.orchestra.run.smithi089.stdout:balancer 2024-09-13T02:53:41.382 INFO:teuthology.orchestra.run.smithi089.stdout:standby_count_wanted 1 2024-09-13T02:53:41.383 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi089.rarddb{0:14480} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.89:6828/1561365213,v1:172.21.15.89:6829/1561365213] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:53:41.383 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi089.qjoitb{0:14488} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.89:6826/1464393547,v1:172.21.15.89:6827/1464393547] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:53:41.383 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi131.uasrkg{1:24257} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.131:6824/260493836,v1:172.21.15.131:6825/260493836] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:53:41.383 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi131.rbovzc{1:24265} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.131:6826/665579373,v1:172.21.15.131:6827/665579373] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:53:41.383 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:53:41.383 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:53:41.384 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 20 2024-09-13T02:53:41.384 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.381+0000 7f813effa640 1 -- 172.21.15.89:0/2860402804 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f812006ed50 msgr2=0x7f8120071200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:41.384 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.381+0000 7f813effa640 1 --2- 172.21.15.89:0/2860402804 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f812006ed50 0x7f8120071200 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f813810cec0 tx=0x7f812800b040 comp rx=0 tx=0).stop 2024-09-13T02:53:41.384 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.381+0000 7f813effa640 1 -- 172.21.15.89:0/2860402804 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81380666b0 msgr2=0x7f813810d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:41.384 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.381+0000 7f813effa640 1 --2- 172.21.15.89:0/2860402804 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81380666b0 0x7f813810d110 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f8134009470 tx=0x7f8134009da0 comp rx=0 tx=0).stop 2024-09-13T02:53:41.384 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.381+0000 7f813effa640 1 -- 172.21.15.89:0/2860402804 shutdown_connections 2024-09-13T02:53:41.384 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.381+0000 7f813effa640 1 --2- 172.21.15.89:0/2860402804 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81380ff690 0x7f813810d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:41.384 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.381+0000 7f813effa640 1 --2- 172.21.15.89:0/2860402804 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f812006ed50 0x7f8120071200 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:41.384 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.381+0000 7f813effa640 1 --2- 172.21.15.89:0/2860402804 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81380666b0 0x7f813810d110 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:41.384 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.381+0000 7f813effa640 1 -- 172.21.15.89:0/2860402804 >> 172.21.15.89:0/2860402804 conn(0x7f81380f6c20 msgr2=0x7f81380f6ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:53:41.385 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.381+0000 7f813effa640 1 -- 172.21.15.89:0/2860402804 shutdown_connections 2024-09-13T02:53:41.385 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.381+0000 7f813effa640 1 -- 172.21.15.89:0/2860402804 wait complete. 2024-09-13T02:53:41.471 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.469+0000 7fcb879b2640 1 -- 172.21.15.89:0/278623710 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb800ff6e0 msgr2=0x7fcb80101ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:41.471 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.469+0000 7fcb879b2640 1 --2- 172.21.15.89:0/278623710 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb800ff6e0 0x7fcb80101ac0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fcb700048d0 tx=0x7fcb70009da0 comp rx=0 tx=0).stop 2024-09-13T02:53:41.471 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.469+0000 7fcb879b2640 1 -- 172.21.15.89:0/278623710 shutdown_connections 2024-09-13T02:53:41.471 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.469+0000 7fcb879b2640 1 --2- 172.21.15.89:0/278623710 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb800ff6e0 0x7fcb80101ac0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:41.471 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.469+0000 7fcb879b2640 1 --2- 172.21.15.89:0/278623710 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcb80065be0 0x7fcb800ff1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:41.471 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.469+0000 7fcb879b2640 1 -- 172.21.15.89:0/278623710 >> 172.21.15.89:0/278623710 conn(0x7fcb800f6c10 msgr2=0x7fcb800f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:53:41.471 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.469+0000 7fcb879b2640 1 -- 172.21.15.89:0/278623710 shutdown_connections 2024-09-13T02:53:41.471 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.469+0000 7fcb879b2640 1 -- 172.21.15.89:0/278623710 wait complete. 2024-09-13T02:53:41.473 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.470+0000 7fcb879b2640 1 Processor -- start 2024-09-13T02:53:41.474 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.470+0000 7fcb879b2640 1 -- start start 2024-09-13T02:53:41.474 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.470+0000 7fcb879b2640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcb80065be0 0x7fcb8010d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:53:41.474 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.470+0000 7fcb879b2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb800ff6e0 0x7fcb8010d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:53:41.474 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.470+0000 7fcb879b2640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb8010dbe0 con 0x7fcb800ff6e0 2024-09-13T02:53:41.474 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.470+0000 7fcb879b2640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb8010e400 con 0x7fcb80065be0 2024-09-13T02:53:41.474 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.470+0000 7fcb84f4d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb800ff6e0 0x7fcb8010d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:53:41.474 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.470+0000 7fcb8574e640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcb80065be0 0x7fcb8010d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:53:41.474 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.470+0000 7fcb84f4d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb800ff6e0 0x7fcb8010d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34754/0 (socket says 172.21.15.89:34754) 2024-09-13T02:53:41.474 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.470+0000 7fcb84f4d640 1 -- 172.21.15.89:0/1261111910 learned_addr learned my addr 172.21.15.89:0/1261111910 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:53:41.474 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.470+0000 7fcb8574e640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcb80065be0 0x7fcb8010d050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.89:53164/0 (socket says 172.21.15.89:53164) 2024-09-13T02:53:41.474 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.470+0000 7fcb84f4d640 1 -- 172.21.15.89:0/1261111910 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcb80065be0 msgr2=0x7fcb8010d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:41.474 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.470+0000 7fcb84f4d640 1 --2- 172.21.15.89:0/1261111910 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcb80065be0 0x7fcb8010d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:41.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.470+0000 7fcb84f4d640 1 -- 172.21.15.89:0/1261111910 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb70005040 con 0x7fcb800ff6e0 2024-09-13T02:53:41.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.471+0000 7fcb84f4d640 1 --2- 172.21.15.89:0/1261111910 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb800ff6e0 0x7fcb8010d590 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fcb700048a0 tx=0x7fcb70009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:53:41.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.471+0000 7fcb75ffb640 1 -- 172.21.15.89:0/1261111910 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb70038070 con 0x7fcb800ff6e0 2024-09-13T02:53:41.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.471+0000 7fcb879b2640 1 -- 172.21.15.89:0/1261111910 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb8010e630 con 0x7fcb800ff6e0 2024-09-13T02:53:41.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.471+0000 7fcb75ffb640 1 -- 172.21.15.89:0/1261111910 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fcb70032d30 con 0x7fcb800ff6e0 2024-09-13T02:53:41.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.471+0000 7fcb75ffb640 1 -- 172.21.15.89:0/1261111910 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb70033ac0 con 0x7fcb800ff6e0 2024-09-13T02:53:41.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.471+0000 7fcb879b2640 1 -- 172.21.15.89:0/1261111910 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb8010ebd0 con 0x7fcb800ff6e0 2024-09-13T02:53:41.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.473+0000 7fcb879b2640 1 -- 172.21.15.89:0/1261111910 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb800fa890 con 0x7fcb800ff6e0 2024-09-13T02:53:41.476 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.473+0000 7fcb75ffb640 1 -- 172.21.15.89:0/1261111910 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fcb70030020 con 0x7fcb800ff6e0 2024-09-13T02:53:41.476 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.473+0000 7fcb75ffb640 1 --2- 172.21.15.89:0/1261111910 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fcb6c06eda0 0x7fcb6c071250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:53:41.476 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.473+0000 7fcb75ffb640 1 -- 172.21.15.89:0/1261111910 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fcb700ae7d0 con 0x7fcb800ff6e0 2024-09-13T02:53:41.477 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.474+0000 7fcb8574e640 1 --2- 172.21.15.89:0/1261111910 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fcb6c06eda0 0x7fcb6c071250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:53:41.477 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.474+0000 7fcb8574e640 1 --2- 172.21.15.89:0/1261111910 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fcb6c06eda0 0x7fcb6c071250 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c009af0 tx=0x7fcb7c00b040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:53:41.479 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.478+0000 7fcb75ffb640 1 -- 172.21.15.89:0/1261111910 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fcb7007b800 con 0x7fcb800ff6e0 2024-09-13T02:53:41.602 INFO:tasks.workunit.client.1.smithi131.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-09-13T02:53:41.622 INFO:tasks.workunit.client.1.smithi131.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-13T02:53:41.622 INFO:tasks.workunit.client.1.smithi131.stderr:+ make 2024-09-13T02:53:41.710 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.709+0000 7fcb879b2640 1 -- 172.21.15.89:0/1261111910 --> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcb8010ef00 con 0x7fcb6c06eda0 2024-09-13T02:53:41.712 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.710+0000 7fcb75ffb640 1 -- 172.21.15.89:0/1261111910 <== mgr.14204 v2:172.21.15.89:6800/1506060926 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7fcb8010ef00 con 0x7fcb6c06eda0 2024-09-13T02:53:41.712 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-13T02:53:41.712 INFO:teuthology.orchestra.run.smithi089.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d", 2024-09-13T02:53:41.712 INFO:teuthology.orchestra.run.smithi089.stdout: "in_progress": true, 2024-09-13T02:53:41.712 INFO:teuthology.orchestra.run.smithi089.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T02:53:41.712 INFO:teuthology.orchestra.run.smithi089.stdout: "services_complete": [], 2024-09-13T02:53:41.712 INFO:teuthology.orchestra.run.smithi089.stdout: "progress": "0/21 daemons upgraded", 2024-09-13T02:53:41.712 INFO:teuthology.orchestra.run.smithi089.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d image on host smithi131", 2024-09-13T02:53:41.712 INFO:teuthology.orchestra.run.smithi089.stdout: "is_paused": false 2024-09-13T02:53:41.712 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-13T02:53:41.715 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.713+0000 7fcb879b2640 1 -- 172.21.15.89:0/1261111910 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fcb6c06eda0 msgr2=0x7fcb6c071250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:41.715 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.713+0000 7fcb879b2640 1 --2- 172.21.15.89:0/1261111910 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fcb6c06eda0 0x7fcb6c071250 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fcb7c009af0 tx=0x7fcb7c00b040 comp rx=0 tx=0).stop 2024-09-13T02:53:41.715 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.713+0000 7fcb879b2640 1 -- 172.21.15.89:0/1261111910 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb800ff6e0 msgr2=0x7fcb8010d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:41.715 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.713+0000 7fcb879b2640 1 --2- 172.21.15.89:0/1261111910 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb800ff6e0 0x7fcb8010d590 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fcb700048a0 tx=0x7fcb70009da0 comp rx=0 tx=0).stop 2024-09-13T02:53:41.715 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.713+0000 7fcb879b2640 1 -- 172.21.15.89:0/1261111910 shutdown_connections 2024-09-13T02:53:41.715 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.714+0000 7fcb879b2640 1 --2- 172.21.15.89:0/1261111910 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcb800ff6e0 0x7fcb8010d590 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:41.715 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.714+0000 7fcb879b2640 1 --2- 172.21.15.89:0/1261111910 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fcb6c06eda0 0x7fcb6c071250 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:41.716 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.714+0000 7fcb879b2640 1 --2- 172.21.15.89:0/1261111910 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcb80065be0 0x7fcb8010d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:41.716 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.714+0000 7fcb879b2640 1 -- 172.21.15.89:0/1261111910 >> 172.21.15.89:0/1261111910 conn(0x7fcb800f6c10 msgr2=0x7fcb800f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:53:41.716 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.714+0000 7fcb879b2640 1 -- 172.21.15.89:0/1261111910 shutdown_connections 2024-09-13T02:53:41.716 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.714+0000 7fcb879b2640 1 -- 172.21.15.89:0/1261111910 wait complete. 2024-09-13T02:53:41.815 INFO:tasks.workunit.client.1.smithi131.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-09-13T02:53:41.827 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.826+0000 7f0be55b0640 1 -- 172.21.15.89:0/3578345194 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0be00fb430 msgr2=0x7f0be00fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:41.828 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.826+0000 7f0be55b0640 1 --2- 172.21.15.89:0/3578345194 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0be00fb430 0x7f0be00fb840 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f0bd80048d0 tx=0x7f0bd8009da0 comp rx=0 tx=0).stop 2024-09-13T02:53:41.828 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.826+0000 7f0be55b0640 1 -- 172.21.15.89:0/3578345194 shutdown_connections 2024-09-13T02:53:41.828 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.826+0000 7f0be55b0640 1 --2- 172.21.15.89:0/3578345194 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0be00fc700 0x7f0be00fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:41.828 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.826+0000 7f0be55b0640 1 --2- 172.21.15.89:0/3578345194 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0be00fb430 0x7f0be00fb840 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:41.828 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.826+0000 7f0be55b0640 1 -- 172.21.15.89:0/3578345194 >> 172.21.15.89:0/3578345194 conn(0x7f0be00f6c10 msgr2=0x7f0be00f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:53:41.828 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.826+0000 7f0be55b0640 1 -- 172.21.15.89:0/3578345194 shutdown_connections 2024-09-13T02:53:41.828 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.826+0000 7f0be55b0640 1 -- 172.21.15.89:0/3578345194 wait complete. 2024-09-13T02:53:41.830 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.827+0000 7f0be55b0640 1 Processor -- start 2024-09-13T02:53:41.830 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.827+0000 7f0be55b0640 1 -- start start 2024-09-13T02:53:41.830 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.827+0000 7f0be55b0640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0be00fb430 0x7f0be010f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:53:41.831 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.827+0000 7f0be55b0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0be00fc700 0x7f0be010f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:53:41.831 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.827+0000 7f0be55b0640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0be010fe00 con 0x7f0be00fc700 2024-09-13T02:53:41.831 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.827+0000 7f0be55b0640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0be0110620 con 0x7f0be00fb430 2024-09-13T02:53:41.831 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.827+0000 7f0bde7fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0be00fc700 0x7f0be010f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:53:41.832 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.827+0000 7f0bdeffd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0be00fb430 0x7f0be010f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:53:41.832 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.827+0000 7f0bdeffd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0be00fb430 0x7f0be010f270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.89:53176/0 (socket says 172.21.15.89:53176) 2024-09-13T02:53:41.832 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.827+0000 7f0bde7fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0be00fc700 0x7f0be010f7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34776/0 (socket says 172.21.15.89:34776) 2024-09-13T02:53:41.832 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.827+0000 7f0bdeffd640 1 -- 172.21.15.89:0/4183687764 learned_addr learned my addr 172.21.15.89:0/4183687764 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:53:41.832 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.828+0000 7f0bdeffd640 1 -- 172.21.15.89:0/4183687764 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0be00fc700 msgr2=0x7f0be010f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:41.832 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.828+0000 7f0bdeffd640 1 --2- 172.21.15.89:0/4183687764 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0be00fc700 0x7f0be010f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:41.832 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.828+0000 7f0bdeffd640 1 -- 172.21.15.89:0/4183687764 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bd8005040 con 0x7f0be00fb430 2024-09-13T02:53:41.832 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.828+0000 7f0bde7fc640 1 --2- 172.21.15.89:0/4183687764 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0be00fc700 0x7f0be010f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T02:53:41.832 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.828+0000 7f0bdeffd640 1 --2- 172.21.15.89:0/4183687764 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0be00fb430 0x7f0be010f270 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0bd80048a0 tx=0x7f0bd8009da0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:53:41.832 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.828+0000 7f0bd77fe640 1 -- 172.21.15.89:0/4183687764 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0bd8038070 con 0x7f0be00fb430 2024-09-13T02:53:41.832 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.828+0000 7f0be55b0640 1 -- 172.21.15.89:0/4183687764 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0be0110850 con 0x7f0be00fb430 2024-09-13T02:53:41.832 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.828+0000 7f0bd77fe640 1 -- 172.21.15.89:0/4183687764 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0bd8004290 con 0x7f0be00fb430 2024-09-13T02:53:41.833 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.828+0000 7f0bd77fe640 1 -- 172.21.15.89:0/4183687764 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0bd8033660 con 0x7f0be00fb430 2024-09-13T02:53:41.833 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.828+0000 7f0be55b0640 1 -- 172.21.15.89:0/4183687764 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0be0110df0 con 0x7f0be00fb430 2024-09-13T02:53:41.833 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.829+0000 7f0be55b0640 1 -- 172.21.15.89:0/4183687764 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0be00fa890 con 0x7f0be00fb430 2024-09-13T02:53:41.834 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.830+0000 7f0bd77fe640 1 -- 172.21.15.89:0/4183687764 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f0bd8030020 con 0x7f0be00fb430 2024-09-13T02:53:41.834 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.830+0000 7f0bd77fe640 1 --2- 172.21.15.89:0/4183687764 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f0bcc06ed60 0x7f0bcc071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:53:41.834 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.830+0000 7f0bd77fe640 1 -- 172.21.15.89:0/4183687764 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f0bd80ae300 con 0x7f0be00fb430 2024-09-13T02:53:41.834 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.830+0000 7f0bde7fc640 1 --2- 172.21.15.89:0/4183687764 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f0bcc06ed60 0x7f0bcc071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:53:41.834 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.831+0000 7f0bde7fc640 1 --2- 172.21.15.89:0/4183687764 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f0bcc06ed60 0x7f0bcc071210 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0bc8004fd0 tx=0x7f0bc800b040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:53:41.835 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:41.834+0000 7f0bd77fe640 1 -- 172.21.15.89:0/4183687764 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f0bd807b480 con 0x7f0be00fb430 2024-09-13T02:53:41.933 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:53:41 smithi131 ceph-mon[34689]: from='client.14590 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:53:41.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:53:41 smithi131 ceph-mon[34689]: from='client.24345 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:53:41.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:53:41 smithi131 ceph-mon[34689]: from='client.14598 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:53:41.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:53:41 smithi131 ceph-mon[34689]: from='client.? 172.21.15.89:0/508496988' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:53:41.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:53:41 smithi131 ceph-mon[34689]: from='client.? 172.21.15.89:0/2860402804' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T02:53:42.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:53:41 smithi089 ceph-mon[27639]: from='client.14590 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:53:42.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:53:41 smithi089 ceph-mon[27639]: from='client.24345 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:53:42.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:53:41 smithi089 ceph-mon[27639]: from='client.14598 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:53:42.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:53:41 smithi089 ceph-mon[27639]: from='client.? 172.21.15.89:0/508496988' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:53:42.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:53:41 smithi089 ceph-mon[27639]: from='client.? 172.21.15.89:0/2860402804' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T02:53:42.116 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:42.115+0000 7f0be55b0640 1 -- 172.21.15.89:0/4183687764 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f0be004b720 con 0x7f0be00fb430 2024-09-13T02:53:42.116 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:42.115+0000 7f0bd77fe640 1 -- 172.21.15.89:0/4183687764 <== mon.1 v2:172.21.15.131:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f0bd802c870 con 0x7f0be00fb430 2024-09-13T02:53:42.117 INFO:teuthology.orchestra.run.smithi089.stdout:HEALTH_OK 2024-09-13T02:53:42.119 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:42.118+0000 7f0be55b0640 1 -- 172.21.15.89:0/4183687764 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f0bcc06ed60 msgr2=0x7f0bcc071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:42.119 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:42.118+0000 7f0be55b0640 1 --2- 172.21.15.89:0/4183687764 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f0bcc06ed60 0x7f0bcc071210 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f0bc8004fd0 tx=0x7f0bc800b040 comp rx=0 tx=0).stop 2024-09-13T02:53:42.119 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:42.118+0000 7f0be55b0640 1 -- 172.21.15.89:0/4183687764 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0be00fb430 msgr2=0x7f0be010f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:53:42.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:42.118+0000 7f0be55b0640 1 --2- 172.21.15.89:0/4183687764 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0be00fb430 0x7f0be010f270 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f0bd80048a0 tx=0x7f0bd8009da0 comp rx=0 tx=0).stop 2024-09-13T02:53:42.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:42.118+0000 7f0be55b0640 1 -- 172.21.15.89:0/4183687764 shutdown_connections 2024-09-13T02:53:42.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:42.118+0000 7f0be55b0640 1 --2- 172.21.15.89:0/4183687764 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0be00fc700 0x7f0be010f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:42.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:42.118+0000 7f0be55b0640 1 --2- 172.21.15.89:0/4183687764 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f0bcc06ed60 0x7f0bcc071210 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:42.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:42.118+0000 7f0be55b0640 1 --2- 172.21.15.89:0/4183687764 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0be00fb430 0x7f0be010f270 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:53:42.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:42.118+0000 7f0be55b0640 1 -- 172.21.15.89:0/4183687764 >> 172.21.15.89:0/4183687764 conn(0x7f0be00f6c10 msgr2=0x7f0be00f7820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:53:42.120 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:42.119+0000 7f0be55b0640 1 -- 172.21.15.89:0/4183687764 shutdown_connections 2024-09-13T02:53:42.121 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:53:42.119+0000 7f0be55b0640 1 -- 172.21.15.89:0/4183687764 wait complete. 2024-09-13T02:53:42.933 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:53:42 smithi131 ceph-mon[34689]: pgmap v233: 65 pgs: 65 active+clean; 150 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 4.1 MiB/s rd, 8.3 MiB/s wr, 837 op/s 2024-09-13T02:53:42.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:53:42 smithi131 ceph-mon[34689]: from='client.14610 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:53:42.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:53:42 smithi131 ceph-mon[34689]: from='client.? 172.21.15.89:0/4183687764' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T02:53:43.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:53:42 smithi089 ceph-mon[27639]: pgmap v233: 65 pgs: 65 active+clean; 150 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 4.1 MiB/s rd, 8.3 MiB/s wr, 837 op/s 2024-09-13T02:53:43.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:53:42 smithi089 ceph-mon[27639]: from='client.14610 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:53:43.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:53:42 smithi089 ceph-mon[27639]: from='client.? 172.21.15.89:0/4183687764' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T02:53:43.121 INFO:tasks.workunit.client.1.smithi131.stderr:++ readlink -f fsstress 2024-09-13T02:53:43.121 INFO:tasks.workunit.client.1.smithi131.stderr:+ BIN=/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-09-13T02:53:43.122 INFO:tasks.workunit.client.1.smithi131.stderr:+ popd 2024-09-13T02:53:43.122 INFO:tasks.workunit.client.1.smithi131.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-09-13T02:53:43.122 INFO:tasks.workunit.client.1.smithi131.stderr:+ popd 2024-09-13T02:53:43.122 INFO:tasks.workunit.client.1.smithi131.stdout:~/cephtest/mnt.1/client.1/tmp 2024-09-13T02:53:43.123 INFO:tasks.workunit.client.1.smithi131.stderr:++ mktemp -d -p . 2024-09-13T02:53:43.123 INFO:tasks.workunit.client.1.smithi131.stderr:+ T=./tmp.SRfns8LUvZ 2024-09-13T02:53:43.123 INFO:tasks.workunit.client.1.smithi131.stderr:+ /home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.SRfns8LUvZ -l 1 -n 1000 -p 10 -v 2024-09-13T02:53:43.125 INFO:tasks.workunit.client.1.smithi131.stdout:seed = 1726103727 2024-09-13T02:53:43.127 INFO:tasks.workunit.client.1.smithi131.stdout:0/0: dwrite - no filename 2024-09-13T02:53:43.127 INFO:tasks.workunit.client.1.smithi131.stdout:0/1: dread - no filename 2024-09-13T02:53:43.127 INFO:tasks.workunit.client.1.smithi131.stdout:1/0: dwrite - no filename 2024-09-13T02:53:43.127 INFO:tasks.workunit.client.1.smithi131.stdout:1/1: readlink - no filename 2024-09-13T02:53:43.127 INFO:tasks.workunit.client.1.smithi131.stdout:1/2: rename - no filename 2024-09-13T02:53:43.128 INFO:tasks.workunit.client.1.smithi131.stdout:0/2: mkdir d0 0 2024-09-13T02:53:43.128 INFO:tasks.workunit.client.1.smithi131.stdout:0/3: dwrite - no filename 2024-09-13T02:53:43.128 INFO:tasks.workunit.client.1.smithi131.stdout:0/4: dread - no filename 2024-09-13T02:53:43.128 INFO:tasks.workunit.client.1.smithi131.stdout:2/0: stat - no entries 2024-09-13T02:53:43.128 INFO:tasks.workunit.client.1.smithi131.stdout:2/1: rmdir - no directory 2024-09-13T02:53:43.128 INFO:tasks.workunit.client.1.smithi131.stdout:2/2: chown . 426977 1 2024-09-13T02:53:43.129 INFO:tasks.workunit.client.1.smithi131.stdout:1/3: creat f0 x:0 0 0 2024-09-13T02:53:43.133 INFO:tasks.workunit.client.1.smithi131.stdout:3/0: rename - no filename 2024-09-13T02:53:43.133 INFO:tasks.workunit.client.1.smithi131.stdout:3/1: readlink - no filename 2024-09-13T02:53:43.133 INFO:tasks.workunit.client.1.smithi131.stdout:3/2: dread - no filename 2024-09-13T02:53:43.133 INFO:tasks.workunit.client.1.smithi131.stdout:3/3: rename - no filename 2024-09-13T02:53:43.133 INFO:tasks.workunit.client.1.smithi131.stdout:3/4: getdents . 0 2024-09-13T02:53:43.133 INFO:tasks.workunit.client.1.smithi131.stdout:3/5: fsync - no filename 2024-09-13T02:53:43.133 INFO:tasks.workunit.client.1.smithi131.stdout:3/6: readlink - no filename 2024-09-13T02:53:43.133 INFO:tasks.workunit.client.1.smithi131.stdout:3/7: chown . 1 1 2024-09-13T02:53:43.134 INFO:tasks.workunit.client.1.smithi131.stdout:3/8: read - no filename 2024-09-13T02:53:43.134 INFO:tasks.workunit.client.1.smithi131.stdout:1/4: mknod c1 0 2024-09-13T02:53:43.134 INFO:tasks.workunit.client.1.smithi131.stdout:1/5: dread - f0 zero size 2024-09-13T02:53:43.134 INFO:tasks.workunit.client.1.smithi131.stdout:0/5: creat d0/f1 x:0 0 0 2024-09-13T02:53:43.134 INFO:tasks.workunit.client.1.smithi131.stdout:4/0: write - no filename 2024-09-13T02:53:43.134 INFO:tasks.workunit.client.1.smithi131.stdout:1/6: mknod c2 0 2024-09-13T02:53:43.135 INFO:tasks.workunit.client.1.smithi131.stdout:3/9: symlink l0 0 2024-09-13T02:53:43.136 INFO:tasks.workunit.client.1.smithi131.stdout:5/0: truncate - no filename 2024-09-13T02:53:43.136 INFO:tasks.workunit.client.1.smithi131.stdout:5/1: unlink - no file 2024-09-13T02:53:43.137 INFO:tasks.workunit.client.1.smithi131.stdout:4/1: creat f0 x:0 0 0 2024-09-13T02:53:43.137 INFO:tasks.workunit.client.1.smithi131.stdout:4/2: stat f0 0 2024-09-13T02:53:43.138 INFO:tasks.workunit.client.1.smithi131.stdout:1/7: mknod c3 0 2024-09-13T02:53:43.138 INFO:tasks.workunit.client.1.smithi131.stdout:1/8: stat c3 0 2024-09-13T02:53:43.138 INFO:tasks.workunit.client.1.smithi131.stdout:1/9: write f0 [361922,98256] 0 2024-09-13T02:53:43.139 INFO:tasks.workunit.client.1.smithi131.stdout:5/2: symlink l0 0 2024-09-13T02:53:43.141 INFO:tasks.workunit.client.1.smithi131.stdout:4/3: mkdir d1 0 2024-09-13T02:53:43.141 INFO:tasks.workunit.client.1.smithi131.stdout:4/4: write f0 [273596,110593] 0 2024-09-13T02:53:43.142 INFO:tasks.workunit.client.1.smithi131.stdout:4/5: write f0 [1376857,32161] 0 2024-09-13T02:53:43.142 INFO:tasks.workunit.client.1.smithi131.stdout:4/6: rename d1 to d1/d2 22 2024-09-13T02:53:43.142 INFO:tasks.workunit.client.1.smithi131.stdout:4/7: chown d1 1869355 1 2024-09-13T02:53:43.142 INFO:tasks.workunit.client.1.smithi131.stdout:5/3: mkdir d1 0 2024-09-13T02:53:43.142 INFO:tasks.workunit.client.1.smithi131.stdout:5/4: dread - no filename 2024-09-13T02:53:43.142 INFO:tasks.workunit.client.1.smithi131.stdout:5/5: dwrite - no filename 2024-09-13T02:53:43.143 INFO:tasks.workunit.client.1.smithi131.stdout:6/0: symlink l0 0 2024-09-13T02:53:43.145 INFO:tasks.workunit.client.1.smithi131.stdout:8/0: fdatasync - no filename 2024-09-13T02:53:43.145 INFO:tasks.workunit.client.1.smithi131.stdout:8/1: getdents . 0 2024-09-13T02:53:43.145 INFO:tasks.workunit.client.1.smithi131.stdout:8/2: fdatasync - no filename 2024-09-13T02:53:43.145 INFO:tasks.workunit.client.1.smithi131.stdout:8/3: read - no filename 2024-09-13T02:53:43.145 INFO:tasks.workunit.client.1.smithi131.stdout:8/4: truncate - no filename 2024-09-13T02:53:43.146 INFO:tasks.workunit.client.1.smithi131.stdout:8/5: dwrite - no filename 2024-09-13T02:53:43.146 INFO:tasks.workunit.client.1.smithi131.stdout:8/6: rmdir - no directory 2024-09-13T02:53:43.146 INFO:tasks.workunit.client.1.smithi131.stdout:8/7: chown . 6211 1 2024-09-13T02:53:43.146 INFO:tasks.workunit.client.1.smithi131.stdout:8/8: fdatasync - no filename 2024-09-13T02:53:43.146 INFO:tasks.workunit.client.1.smithi131.stdout:8/9: fsync - no filename 2024-09-13T02:53:43.146 INFO:tasks.workunit.client.1.smithi131.stdout:8/10: readlink - no filename 2024-09-13T02:53:43.146 INFO:tasks.workunit.client.1.smithi131.stdout:5/6: link l0 d1/l2 0 2024-09-13T02:53:43.146 INFO:tasks.workunit.client.1.smithi131.stdout:5/7: write - no filename 2024-09-13T02:53:43.147 INFO:tasks.workunit.client.1.smithi131.stdout:6/1: mkdir d1 0 2024-09-13T02:53:43.147 INFO:tasks.workunit.client.1.smithi131.stdout:6/2: chown l0 909459 1 2024-09-13T02:53:43.147 INFO:tasks.workunit.client.1.smithi131.stdout:8/11: symlink l0 0 2024-09-13T02:53:43.147 INFO:tasks.workunit.client.1.smithi131.stdout:8/12: write - no filename 2024-09-13T02:53:43.148 INFO:tasks.workunit.client.1.smithi131.stdout:8/13: chown l0 3030333 1 2024-09-13T02:53:43.148 INFO:tasks.workunit.client.1.smithi131.stdout:8/14: read - no filename 2024-09-13T02:53:43.148 INFO:tasks.workunit.client.1.smithi131.stdout:8/15: dwrite - no filename 2024-09-13T02:53:43.151 INFO:tasks.workunit.client.1.smithi131.stdout:6/3: unlink l0 0 2024-09-13T02:53:43.151 INFO:tasks.workunit.client.1.smithi131.stdout:6/4: unlink - no file 2024-09-13T02:53:43.151 INFO:tasks.workunit.client.1.smithi131.stdout:6/5: write - no filename 2024-09-13T02:53:43.151 INFO:tasks.workunit.client.1.smithi131.stdout:6/6: dread - no filename 2024-09-13T02:53:43.151 INFO:tasks.workunit.client.1.smithi131.stdout:6/7: write - no filename 2024-09-13T02:53:43.151 INFO:tasks.workunit.client.1.smithi131.stdout:6/8: readlink - no filename 2024-09-13T02:53:43.151 INFO:tasks.workunit.client.1.smithi131.stdout:5/8: mkdir d1/d3 0 2024-09-13T02:53:43.151 INFO:tasks.workunit.client.1.smithi131.stdout:7/0: truncate - no filename 2024-09-13T02:53:43.151 INFO:tasks.workunit.client.1.smithi131.stdout:8/16: symlink l1 0 2024-09-13T02:53:43.152 INFO:tasks.workunit.client.1.smithi131.stdout:8/17: dwrite - no filename 2024-09-13T02:53:43.152 INFO:tasks.workunit.client.1.smithi131.stdout:8/18: dread - no filename 2024-09-13T02:53:43.152 INFO:tasks.workunit.client.1.smithi131.stdout:8/19: dread - no filename 2024-09-13T02:53:43.152 INFO:tasks.workunit.client.1.smithi131.stdout:8/20: dread - no filename 2024-09-13T02:53:43.157 INFO:tasks.workunit.client.1.smithi131.stdout:8/21: creat f2 x:0 0 0 2024-09-13T02:53:43.157 INFO:tasks.workunit.client.1.smithi131.stdout:8/22: stat l1 0 2024-09-13T02:53:43.157 INFO:tasks.workunit.client.1.smithi131.stdout:6/9: symlink d1/l2 0 2024-09-13T02:53:43.158 INFO:tasks.workunit.client.1.smithi131.stdout:6/10: chown d1 1543380 1 2024-09-13T02:53:43.158 INFO:tasks.workunit.client.1.smithi131.stdout:6/11: write - no filename 2024-09-13T02:53:43.158 INFO:tasks.workunit.client.1.smithi131.stdout:8/23: creat f3 x:0 0 0 2024-09-13T02:53:43.158 INFO:tasks.workunit.client.1.smithi131.stdout:8/24: creat f4 x:0 0 0 2024-09-13T02:53:43.158 INFO:tasks.workunit.client.1.smithi131.stdout:7/1: creat f0 x:0 0 0 2024-09-13T02:53:43.159 INFO:tasks.workunit.client.1.smithi131.stdout:7/2: write f0 [229711,115944] 0 2024-09-13T02:53:43.159 INFO:tasks.workunit.client.1.smithi131.stdout:7/3: creat f1 x:0 0 0 2024-09-13T02:53:43.159 INFO:tasks.workunit.client.1.smithi131.stdout:7/4: rmdir - no directory 2024-09-13T02:53:43.159 INFO:tasks.workunit.client.1.smithi131.stdout:5/9: mknod d1/c4 0 2024-09-13T02:53:43.159 INFO:tasks.workunit.client.1.smithi131.stdout:5/10: fdatasync - no filename 2024-09-13T02:53:43.159 INFO:tasks.workunit.client.1.smithi131.stdout:5/11: fsync - no filename 2024-09-13T02:53:43.162 INFO:tasks.workunit.client.1.smithi131.stdout:6/12: creat d1/f3 x:0 0 0 2024-09-13T02:53:43.163 INFO:tasks.workunit.client.1.smithi131.stdout:5/12: rename d1/d3 to d1/d5 0 2024-09-13T02:53:43.163 INFO:tasks.workunit.client.1.smithi131.stdout:5/13: dread - no filename 2024-09-13T02:53:43.163 INFO:tasks.workunit.client.1.smithi131.stdout:6/13: dread - d1/f3 zero size 2024-09-13T02:53:43.163 INFO:tasks.workunit.client.1.smithi131.stdout:6/14: readlink d1/l2 0 2024-09-13T02:53:43.163 INFO:tasks.workunit.client.1.smithi131.stdout:9/0: mkdir d0 0 2024-09-13T02:53:43.163 INFO:tasks.workunit.client.1.smithi131.stdout:6/15: dread - d1/f3 zero size 2024-09-13T02:53:43.163 INFO:tasks.workunit.client.1.smithi131.stdout:9/1: write - no filename 2024-09-13T02:53:43.163 INFO:tasks.workunit.client.1.smithi131.stdout:9/2: link - no file 2024-09-13T02:53:43.163 INFO:tasks.workunit.client.1.smithi131.stdout:9/3: write - no filename 2024-09-13T02:53:43.163 INFO:tasks.workunit.client.1.smithi131.stdout:9/4: fsync - no filename 2024-09-13T02:53:43.163 INFO:tasks.workunit.client.1.smithi131.stdout:9/5: chown d0 28704 1 2024-09-13T02:53:43.165 INFO:tasks.workunit.client.1.smithi131.stdout:5/14: creat d1/f6 x:0 0 0 2024-09-13T02:53:43.165 INFO:tasks.workunit.client.1.smithi131.stdout:5/15: rename d1 to d1/d5/d7 22 2024-09-13T02:53:43.166 INFO:tasks.workunit.client.1.smithi131.stdout:5/16: dread - d1/f6 zero size 2024-09-13T02:53:43.166 INFO:tasks.workunit.client.1.smithi131.stdout:5/17: chown d1/f6 17 1 2024-09-13T02:53:43.166 INFO:tasks.workunit.client.1.smithi131.stdout:9/6: symlink d0/l1 0 2024-09-13T02:53:43.169 INFO:tasks.workunit.client.1.smithi131.stdout:9/7: rmdir d0 39 2024-09-13T02:53:43.234 INFO:tasks.workunit.client.1.smithi131.stdout:0/6: rmdir d0 39 2024-09-13T02:53:43.236 INFO:tasks.workunit.client.1.smithi131.stdout:0/7: mkdir d0/d2 0 2024-09-13T02:53:43.242 INFO:tasks.workunit.client.1.smithi131.stdout:0/8: unlink d0/f1 0 2024-09-13T02:53:43.249 INFO:tasks.workunit.client.1.smithi131.stdout:1/10: truncate f0 130426 0 2024-09-13T02:53:43.261 INFO:tasks.workunit.client.1.smithi131.stdout:9/8: rmdir d0 39 2024-09-13T02:53:43.261 INFO:tasks.workunit.client.1.smithi131.stdout:9/9: chown d0/l1 191 1 2024-09-13T02:53:43.261 INFO:tasks.workunit.client.1.smithi131.stdout:9/10: stat d0/l1 0 2024-09-13T02:53:43.262 INFO:tasks.workunit.client.1.smithi131.stdout:0/9: creat d0/d2/f3 x:0 0 0 2024-09-13T02:53:43.272 INFO:tasks.workunit.client.1.smithi131.stdout:9/11: rename d0/l1 to d0/l2 0 2024-09-13T02:53:43.273 INFO:tasks.workunit.client.1.smithi131.stdout:0/10: symlink d0/l4 0 2024-09-13T02:53:43.273 INFO:tasks.workunit.client.1.smithi131.stdout:0/11: chown d0/d2 71 1 2024-09-13T02:53:43.281 INFO:tasks.workunit.client.1.smithi131.stdout:0/12: mknod d0/c5 0 2024-09-13T02:53:43.281 INFO:tasks.workunit.client.1.smithi131.stdout:0/13: write d0/d2/f3 [395147,37046] 0 2024-09-13T02:53:43.409 INFO:tasks.workunit.client.1.smithi131.stdout:8/25: dwrite f4 [0,4194304] 0 2024-09-13T02:53:43.409 INFO:tasks.workunit.client.1.smithi131.stdout:8/26: rmdir - no directory 2024-09-13T02:53:43.428 INFO:tasks.workunit.client.1.smithi131.stdout:4/8: dread f0 [0,4194304] 0 2024-09-13T02:53:43.428 INFO:tasks.workunit.client.1.smithi131.stdout:4/9: truncate f0 2240318 0 2024-09-13T02:53:43.428 INFO:tasks.workunit.client.1.smithi131.stdout:4/10: truncate f0 3007040 0 2024-09-13T02:53:43.434 INFO:tasks.workunit.client.1.smithi131.stdout:1/11: fsync f0 0 2024-09-13T02:53:43.451 INFO:tasks.workunit.client.1.smithi131.stdout:8/27: write f4 [2971869,95719] 0 2024-09-13T02:53:43.458 INFO:tasks.workunit.client.1.smithi131.stdout:5/18: dwrite d1/f6 [0,4194304] 0 2024-09-13T02:53:43.458 INFO:tasks.workunit.client.1.smithi131.stdout:5/19: truncate d1/f6 5131363 0 2024-09-13T02:53:43.463 INFO:tasks.workunit.client.1.smithi131.stdout:6/16: dwrite d1/f3 [0,4194304] 0 2024-09-13T02:53:43.474 INFO:tasks.workunit.client.1.smithi131.stdout:9/12: unlink d0/l2 0 2024-09-13T02:53:43.474 INFO:tasks.workunit.client.1.smithi131.stdout:9/13: chown d0 2108743333 1 2024-09-13T02:53:43.474 INFO:tasks.workunit.client.1.smithi131.stdout:9/14: truncate - no filename 2024-09-13T02:53:43.497 INFO:tasks.workunit.client.1.smithi131.stdout:1/12: dread f0 [0,4194304] 0 2024-09-13T02:53:43.503 INFO:tasks.workunit.client.1.smithi131.stdout:1/13: dread f0 [0,4194304] 0 2024-09-13T02:53:43.506 INFO:tasks.workunit.client.1.smithi131.stdout:4/11: link f0 d1/f3 0 2024-09-13T02:53:43.523 INFO:tasks.workunit.client.1.smithi131.stdout:6/17: write d1/f3 [1436555,10071] 0 2024-09-13T02:53:43.541 INFO:tasks.workunit.client.1.smithi131.stdout:0/14: read d0/d2/f3 [164108,70003] 0 2024-09-13T02:53:43.541 INFO:tasks.workunit.client.1.smithi131.stdout:0/15: truncate d0/d2/f3 1019443 0 2024-09-13T02:53:43.551 INFO:tasks.workunit.client.1.smithi131.stdout:8/28: rename f4 to f5 0 2024-09-13T02:53:43.551 INFO:tasks.workunit.client.1.smithi131.stdout:8/29: write f2 [649183,38150] 0 2024-09-13T02:53:43.551 INFO:tasks.workunit.client.1.smithi131.stdout:8/30: rmdir - no directory 2024-09-13T02:53:43.571 INFO:tasks.workunit.client.1.smithi131.stdout:5/20: mknod d1/d5/c8 0 2024-09-13T02:53:43.579 INFO:tasks.workunit.client.1.smithi131.stdout:1/14: dwrite f0 [0,4194304] 0 2024-09-13T02:53:43.597 INFO:tasks.workunit.client.1.smithi131.stdout:9/15: mkdir d0/d3 0 2024-09-13T02:53:43.601 INFO:tasks.workunit.client.1.smithi131.stdout:1/15: dread f0 [0,4194304] 0 2024-09-13T02:53:43.639 INFO:tasks.workunit.client.1.smithi131.stdout:6/18: rename d1/f3 to d1/f4 0 2024-09-13T02:53:43.649 INFO:tasks.workunit.client.1.smithi131.stdout:8/31: rename f3 to f6 0 2024-09-13T02:53:43.649 INFO:tasks.workunit.client.1.smithi131.stdout:8/32: fdatasync f6 0 2024-09-13T02:53:43.664 INFO:tasks.workunit.client.1.smithi131.stdout:5/21: unlink d1/f6 0 2024-09-13T02:53:43.667 INFO:tasks.workunit.client.1.smithi131.stdout:8/33: dwrite f2 [0,4194304] 0 2024-09-13T02:53:43.708 INFO:tasks.workunit.client.1.smithi131.stdout:4/12: fsync f0 0 2024-09-13T02:53:43.720 INFO:tasks.workunit.client.1.smithi131.stdout:9/16: getdents d0 0 2024-09-13T02:53:43.720 INFO:tasks.workunit.client.1.smithi131.stdout:9/17: stat d0/d3 0 2024-09-13T02:53:43.720 INFO:tasks.workunit.client.1.smithi131.stdout:9/18: mkdir d0/d3/d4 0 2024-09-13T02:53:43.721 INFO:tasks.workunit.client.1.smithi131.stdout:9/19: dwrite - no filename 2024-09-13T02:53:43.721 INFO:tasks.workunit.client.1.smithi131.stdout:9/20: write - no filename 2024-09-13T02:53:43.721 INFO:tasks.workunit.client.1.smithi131.stdout:9/21: dwrite - no filename 2024-09-13T02:53:43.721 INFO:tasks.workunit.client.1.smithi131.stdout:9/22: dwrite - no filename 2024-09-13T02:53:43.721 INFO:tasks.workunit.client.1.smithi131.stdout:9/23: creat d0/f5 x:0 0 0 2024-09-13T02:53:43.724 INFO:tasks.workunit.client.1.smithi131.stdout:9/24: unlink d0/f5 0 2024-09-13T02:53:43.724 INFO:tasks.workunit.client.1.smithi131.stdout:9/25: write - no filename 2024-09-13T02:53:43.724 INFO:tasks.workunit.client.1.smithi131.stdout:9/26: dread - no filename 2024-09-13T02:53:43.724 INFO:tasks.workunit.client.1.smithi131.stdout:9/27: creat d0/f6 x:0 0 0 2024-09-13T02:53:43.740 INFO:tasks.workunit.client.1.smithi131.stdout:6/19: dwrite d1/f4 [4194304,4194304] 0 2024-09-13T02:53:43.741 INFO:tasks.workunit.client.1.smithi131.stdout:5/22: rmdir d1 39 2024-09-13T02:53:43.743 INFO:tasks.workunit.client.1.smithi131.stdout:5/23: creat d1/d5/f9 x:0 0 0 2024-09-13T02:53:43.744 INFO:tasks.workunit.client.1.smithi131.stdout:9/28: dwrite d0/f6 [0,4194304] 0 2024-09-13T02:53:43.745 INFO:tasks.workunit.client.1.smithi131.stdout:5/24: creat d1/d5/fa x:0 0 0 2024-09-13T02:53:43.745 INFO:tasks.workunit.client.1.smithi131.stdout:5/25: read - d1/d5/fa zero size 2024-09-13T02:53:43.749 INFO:tasks.workunit.client.1.smithi131.stdout:9/29: rmdir d0/d3/d4 0 2024-09-13T02:53:43.758 INFO:tasks.workunit.client.1.smithi131.stdout:0/16: truncate d0/d2/f3 377978 0 2024-09-13T02:53:43.758 INFO:tasks.workunit.client.1.smithi131.stdout:0/17: chown d0 14 1 2024-09-13T02:53:43.759 INFO:tasks.workunit.client.1.smithi131.stdout:8/34: truncate f5 453811 0 2024-09-13T02:53:43.760 INFO:tasks.workunit.client.1.smithi131.stdout:0/18: link d0/l4 d0/l6 0 2024-09-13T02:53:43.762 INFO:tasks.workunit.client.1.smithi131.stdout:0/19: link d0/c5 d0/c7 0 2024-09-13T02:53:43.763 INFO:tasks.workunit.client.1.smithi131.stdout:8/35: getdents . 0 2024-09-13T02:53:43.764 INFO:tasks.workunit.client.1.smithi131.stdout:0/20: creat d0/f8 x:0 0 0 2024-09-13T02:53:43.765 INFO:tasks.workunit.client.1.smithi131.stdout:8/36: mknod c7 0 2024-09-13T02:53:43.766 INFO:tasks.workunit.client.1.smithi131.stdout:9/30: getdents d0 0 2024-09-13T02:53:43.772 INFO:tasks.workunit.client.1.smithi131.stdout:1/16: dwrite f0 [4194304,4194304] 0 2024-09-13T02:53:43.773 INFO:tasks.workunit.client.1.smithi131.stdout:1/17: creat f4 x:0 0 0 2024-09-13T02:53:43.773 INFO:tasks.workunit.client.1.smithi131.stdout:1/18: rmdir - no directory 2024-09-13T02:53:43.773 INFO:tasks.workunit.client.1.smithi131.stdout:6/20: dwrite d1/f4 [4194304,4194304] 0 2024-09-13T02:53:43.774 INFO:tasks.workunit.client.1.smithi131.stdout:5/26: dwrite d1/d5/fa [0,4194304] 0 2024-09-13T02:53:43.775 INFO:tasks.workunit.client.1.smithi131.stdout:0/21: write d0/d2/f3 [971396,20141] 0 2024-09-13T02:53:43.775 INFO:tasks.workunit.client.1.smithi131.stdout:0/22: chown d0/l6 2 1 2024-09-13T02:53:43.775 INFO:tasks.workunit.client.1.smithi131.stdout:0/23: chown d0 990813156 1 2024-09-13T02:53:43.775 INFO:tasks.workunit.client.1.smithi131.stdout:0/24: readlink d0/l4 0 2024-09-13T02:53:43.776 INFO:tasks.workunit.client.1.smithi131.stdout:8/37: read f5 [349750,62526] 0 2024-09-13T02:53:43.776 INFO:tasks.workunit.client.1.smithi131.stdout:8/38: write f5 [1337395,45025] 0 2024-09-13T02:53:43.777 INFO:tasks.workunit.client.1.smithi131.stdout:1/19: mknod c5 0 2024-09-13T02:53:43.777 INFO:tasks.workunit.client.1.smithi131.stdout:1/20: chown f4 454954337 1 2024-09-13T02:53:43.781 INFO:tasks.workunit.client.1.smithi131.stdout:0/25: stat d0/c7 0 2024-09-13T02:53:43.783 INFO:tasks.workunit.client.1.smithi131.stdout:8/39: creat f8 x:0 0 0 2024-09-13T02:53:43.786 INFO:tasks.workunit.client.1.smithi131.stdout:8/40: symlink l9 0 2024-09-13T02:53:43.787 INFO:tasks.workunit.client.1.smithi131.stdout:8/41: write f6 [174358,81613] 0 2024-09-13T02:53:43.787 INFO:tasks.workunit.client.1.smithi131.stdout:1/21: write f0 [5839755,115667] 0 2024-09-13T02:53:43.788 INFO:tasks.workunit.client.1.smithi131.stdout:8/42: stat l0 0 2024-09-13T02:53:43.790 INFO:tasks.workunit.client.1.smithi131.stdout:1/22: link c3 c6 0 2024-09-13T02:53:43.790 INFO:tasks.workunit.client.1.smithi131.stdout:1/23: fdatasync f4 0 2024-09-13T02:53:43.792 INFO:tasks.workunit.client.1.smithi131.stdout:9/31: dwrite d0/f6 [0,4194304] 0 2024-09-13T02:53:43.792 INFO:tasks.workunit.client.1.smithi131.stdout:5/27: dread d1/d5/fa [0,4194304] 0 2024-09-13T02:53:43.792 INFO:tasks.workunit.client.1.smithi131.stdout:5/28: dread - d1/d5/f9 zero size 2024-09-13T02:53:43.792 INFO:tasks.workunit.client.1.smithi131.stdout:8/43: mknod ca 0 2024-09-13T02:53:43.792 INFO:tasks.workunit.client.1.smithi131.stdout:8/44: truncate f6 450613 0 2024-09-13T02:53:43.792 INFO:tasks.workunit.client.1.smithi131.stdout:8/45: stat f8 0 2024-09-13T02:53:43.792 INFO:tasks.workunit.client.1.smithi131.stdout:5/29: write d1/d5/f9 [749233,126842] 0 2024-09-13T02:53:43.793 INFO:tasks.workunit.client.1.smithi131.stdout:1/24: rename c3 to c7 0 2024-09-13T02:53:43.793 INFO:tasks.workunit.client.1.smithi131.stdout:1/25: creat f8 x:0 0 0 2024-09-13T02:53:43.805 INFO:tasks.workunit.client.1.smithi131.stdout:8/46: getdents . 0 2024-09-13T02:53:43.805 INFO:tasks.workunit.client.1.smithi131.stdout:8/47: getdents . 0 2024-09-13T02:53:43.805 INFO:tasks.workunit.client.1.smithi131.stdout:5/30: dread d1/d5/f9 [0,4194304] 0 2024-09-13T02:53:43.806 INFO:tasks.workunit.client.1.smithi131.stdout:5/31: chown d1/d5/fa 382822 1 2024-09-13T02:53:43.806 INFO:tasks.workunit.client.1.smithi131.stdout:5/32: creat d1/d5/fb x:0 0 0 2024-09-13T02:53:43.806 INFO:tasks.workunit.client.1.smithi131.stdout:6/21: dwrite d1/f4 [4194304,4194304] 0 2024-09-13T02:53:43.807 INFO:tasks.workunit.client.1.smithi131.stdout:1/26: dread f0 [4194304,4194304] 0 2024-09-13T02:53:43.809 INFO:tasks.workunit.client.1.smithi131.stdout:1/27: link c1 c9 0 2024-09-13T02:53:43.811 INFO:tasks.workunit.client.1.smithi131.stdout:1/28: unlink c9 0 2024-09-13T02:53:43.815 INFO:tasks.workunit.client.1.smithi131.stdout:8/48: dread f2 [0,4194304] 0 2024-09-13T02:53:43.816 INFO:tasks.workunit.client.1.smithi131.stdout:8/49: rmdir - no directory 2024-09-13T02:53:43.818 INFO:tasks.workunit.client.1.smithi131.stdout:5/33: dread d1/d5/fa [0,4194304] 0 2024-09-13T02:53:43.818 INFO:tasks.workunit.client.1.smithi131.stdout:8/50: mkdir db 0 2024-09-13T02:53:43.818 INFO:tasks.workunit.client.1.smithi131.stdout:0/26: dwrite d0/f8 [0,4194304] 0 2024-09-13T02:53:43.819 INFO:tasks.workunit.client.1.smithi131.stdout:0/27: readlink d0/l4 0 2024-09-13T02:53:43.819 INFO:tasks.workunit.client.1.smithi131.stdout:0/28: truncate d0/f8 4822128 0 2024-09-13T02:53:43.819 INFO:tasks.workunit.client.1.smithi131.stdout:5/34: creat d1/fc x:0 0 0 2024-09-13T02:53:43.819 INFO:tasks.workunit.client.1.smithi131.stdout:5/35: readlink l0 0 2024-09-13T02:53:43.819 INFO:tasks.workunit.client.1.smithi131.stdout:8/51: mknod db/cc 0 2024-09-13T02:53:43.819 INFO:tasks.workunit.client.1.smithi131.stdout:8/52: fsync f8 0 2024-09-13T02:53:43.820 INFO:tasks.workunit.client.1.smithi131.stdout:0/29: stat d0/l4 0 2024-09-13T02:53:43.820 INFO:tasks.workunit.client.1.smithi131.stdout:0/30: readlink d0/l6 0 2024-09-13T02:53:43.822 INFO:tasks.workunit.client.1.smithi131.stdout:5/36: mknod d1/cd 0 2024-09-13T02:53:43.822 INFO:tasks.workunit.client.1.smithi131.stdout:5/37: fdatasync d1/d5/f9 0 2024-09-13T02:53:43.822 INFO:tasks.workunit.client.1.smithi131.stdout:8/53: creat db/fd x:0 0 0 2024-09-13T02:53:43.822 INFO:tasks.workunit.client.1.smithi131.stdout:8/54: fdatasync f8 0 2024-09-13T02:53:43.824 INFO:tasks.workunit.client.1.smithi131.stdout:5/38: rename l0 to d1/le 0 2024-09-13T02:53:43.825 INFO:tasks.workunit.client.1.smithi131.stdout:8/55: symlink db/le 0 2024-09-13T02:53:43.829 INFO:tasks.workunit.client.1.smithi131.stdout:5/39: link d1/l2 d1/d5/lf 0 2024-09-13T02:53:43.829 INFO:tasks.workunit.client.1.smithi131.stdout:6/22: dwrite d1/f4 [0,4194304] 0 2024-09-13T02:53:43.829 INFO:tasks.workunit.client.1.smithi131.stdout:8/56: symlink db/lf 0 2024-09-13T02:53:43.832 INFO:tasks.workunit.client.1.smithi131.stdout:6/23: rename d1/l2 to d1/l5 0 2024-09-13T02:53:43.845 INFO:tasks.workunit.client.1.smithi131.stdout:1/29: dwrite f0 [8388608,4194304] 0 2024-09-13T02:53:43.847 INFO:tasks.workunit.client.1.smithi131.stdout:1/30: rename c7 to ca 0 2024-09-13T02:53:43.847 INFO:tasks.workunit.client.1.smithi131.stdout:1/31: dread - f4 zero size 2024-09-13T02:53:43.847 INFO:tasks.workunit.client.1.smithi131.stdout:1/32: chown ca 17852 1 2024-09-13T02:53:43.848 INFO:tasks.workunit.client.1.smithi131.stdout:1/33: symlink lb 0 2024-09-13T02:53:43.848 INFO:tasks.workunit.client.1.smithi131.stdout:1/34: creat fc x:0 0 0 2024-09-13T02:53:43.852 INFO:tasks.workunit.client.1.smithi131.stdout:1/35: dread f0 [4194304,4194304] 0 2024-09-13T02:53:43.854 INFO:tasks.workunit.client.1.smithi131.stdout:1/36: mkdir dd 0 2024-09-13T02:53:43.854 INFO:tasks.workunit.client.1.smithi131.stdout:1/37: write f4 [797059,26541] 0 2024-09-13T02:53:43.854 INFO:tasks.workunit.client.1.smithi131.stdout:1/38: chown fc 60 1 2024-09-13T02:53:43.854 INFO:tasks.workunit.client.1.smithi131.stdout:1/39: chown ca 109301 1 2024-09-13T02:53:43.854 INFO:tasks.workunit.client.1.smithi131.stdout:1/40: fsync f0 0 2024-09-13T02:53:43.856 INFO:tasks.workunit.client.1.smithi131.stdout:1/41: mknod dd/ce 0 2024-09-13T02:53:43.856 INFO:tasks.workunit.client.1.smithi131.stdout:1/42: write fc [929746,30161] 0 2024-09-13T02:53:43.856 INFO:tasks.workunit.client.1.smithi131.stdout:1/43: chown c5 182848 1 2024-09-13T02:53:43.856 INFO:tasks.workunit.client.1.smithi131.stdout:1/44: write f0 [6924282,46825] 0 2024-09-13T02:53:43.856 INFO:tasks.workunit.client.1.smithi131.stdout:1/45: chown c2 7 1 2024-09-13T02:53:43.856 INFO:tasks.workunit.client.1.smithi131.stdout:1/46: stat dd 0 2024-09-13T02:53:43.866 INFO:tasks.workunit.client.1.smithi131.stdout:6/24: dwrite d1/f4 [0,4194304] 0 2024-09-13T02:53:43.866 INFO:tasks.workunit.client.1.smithi131.stdout:8/57: dwrite f5 [0,4194304] 0 2024-09-13T02:53:43.866 INFO:tasks.workunit.client.1.smithi131.stdout:5/40: dwrite d1/d5/fb [0,4194304] 0 2024-09-13T02:53:43.866 INFO:tasks.workunit.client.1.smithi131.stdout:0/31: dwrite d0/f8 [0,4194304] 0 2024-09-13T02:53:43.866 INFO:tasks.workunit.client.1.smithi131.stdout:8/58: symlink db/l10 0 2024-09-13T02:53:43.866 INFO:tasks.workunit.client.1.smithi131.stdout:8/59: stat db/l10 0 2024-09-13T02:53:43.871 INFO:tasks.workunit.client.1.smithi131.stdout:8/60: mknod db/c11 0 2024-09-13T02:53:43.873 INFO:tasks.workunit.client.1.smithi131.stdout:8/61: mknod db/c12 0 2024-09-13T02:53:43.873 INFO:tasks.workunit.client.1.smithi131.stdout:5/41: dread d1/d5/fa [0,4194304] 0 2024-09-13T02:53:43.874 INFO:tasks.workunit.client.1.smithi131.stdout:5/42: chown d1/d5/fb 352 1 2024-09-13T02:53:43.875 INFO:tasks.workunit.client.1.smithi131.stdout:5/43: symlink d1/l10 0 2024-09-13T02:53:43.877 INFO:tasks.workunit.client.1.smithi131.stdout:1/47: dread f0 [8388608,4194304] 0 2024-09-13T02:53:43.877 INFO:tasks.workunit.client.1.smithi131.stdout:0/32: read d0/f8 [3889108,106065] 0 2024-09-13T02:53:43.877 INFO:tasks.workunit.client.1.smithi131.stdout:0/33: readlink d0/l6 0 2024-09-13T02:53:43.878 INFO:tasks.workunit.client.1.smithi131.stdout:5/44: read d1/d5/f9 [559972,26134] 0 2024-09-13T02:53:43.878 INFO:tasks.workunit.client.1.smithi131.stdout:1/48: creat dd/ff x:0 0 0 2024-09-13T02:53:43.879 INFO:tasks.workunit.client.1.smithi131.stdout:5/45: symlink d1/d5/l11 0 2024-09-13T02:53:43.880 INFO:tasks.workunit.client.1.smithi131.stdout:5/46: creat d1/d5/f12 x:0 0 0 2024-09-13T02:53:43.880 INFO:tasks.workunit.client.1.smithi131.stdout:5/47: write d1/d5/f12 [357943,83718] 0 2024-09-13T02:53:43.881 INFO:tasks.workunit.client.1.smithi131.stdout:8/62: rmdir db 39 2024-09-13T02:53:43.882 INFO:tasks.workunit.client.1.smithi131.stdout:6/25: dwrite d1/f4 [8388608,4194304] 0 2024-09-13T02:53:43.882 INFO:tasks.workunit.client.1.smithi131.stdout:6/26: chown d1 7444 1 2024-09-13T02:53:43.883 INFO:tasks.workunit.client.1.smithi131.stdout:1/49: dread f0 [8388608,4194304] 0 2024-09-13T02:53:43.883 INFO:tasks.workunit.client.1.smithi131.stdout:0/34: dread d0/f8 [0,4194304] 0 2024-09-13T02:53:43.883 INFO:tasks.workunit.client.1.smithi131.stdout:8/63: mknod db/c13 0 2024-09-13T02:53:43.885 INFO:tasks.workunit.client.1.smithi131.stdout:1/50: rename c6 to dd/c10 0 2024-09-13T02:53:43.886 INFO:tasks.workunit.client.1.smithi131.stdout:8/64: symlink db/l14 0 2024-09-13T02:53:43.888 INFO:tasks.workunit.client.1.smithi131.stdout:5/48: dread d1/d5/fa [0,4194304] 0 2024-09-13T02:53:43.889 INFO:tasks.workunit.client.1.smithi131.stdout:5/49: creat d1/d5/f13 x:0 0 0 2024-09-13T02:53:43.889 INFO:tasks.workunit.client.1.smithi131.stdout:1/51: dread f0 [4194304,4194304] 0 2024-09-13T02:53:43.890 INFO:tasks.workunit.client.1.smithi131.stdout:0/35: dread d0/f8 [0,4194304] 0 2024-09-13T02:53:43.893 INFO:tasks.workunit.client.1.smithi131.stdout:0/36: link d0/c5 d0/d2/c9 0 2024-09-13T02:53:43.893 INFO:tasks.workunit.client.1.smithi131.stdout:0/37: truncate d0/d2/f3 1091406 0 2024-09-13T02:53:43.893 INFO:tasks.workunit.client.1.smithi131.stdout:1/52: write f4 [223395,19468] 0 2024-09-13T02:53:43.896 INFO:tasks.workunit.client.1.smithi131.stdout:0/38: rename d0/d2/f3 to d0/d2/fa 0 2024-09-13T02:53:43.896 INFO:tasks.workunit.client.1.smithi131.stdout:0/39: chown d0/l4 649940 1 2024-09-13T02:53:43.896 INFO:tasks.workunit.client.1.smithi131.stdout:0/40: creat d0/d2/fb x:0 0 0 2024-09-13T02:53:43.896 INFO:tasks.workunit.client.1.smithi131.stdout:1/53: dread f0 [4194304,4194304] 0 2024-09-13T02:53:43.896 INFO:tasks.workunit.client.1.smithi131.stdout:1/54: readlink lb 0 2024-09-13T02:53:43.896 INFO:tasks.workunit.client.1.smithi131.stdout:1/55: write f8 [58632,47379] 0 2024-09-13T02:53:43.896 INFO:tasks.workunit.client.1.smithi131.stdout:1/56: chown fc 274 1 2024-09-13T02:53:43.896 INFO:tasks.workunit.client.1.smithi131.stdout:6/27: truncate d1/f4 8485723 0 2024-09-13T02:53:43.897 INFO:tasks.workunit.client.1.smithi131.stdout:6/28: rename d1 to d1/d6 22 2024-09-13T02:53:43.897 INFO:tasks.workunit.client.1.smithi131.stdout:8/65: truncate f5 2825844 0 2024-09-13T02:53:43.898 INFO:tasks.workunit.client.1.smithi131.stdout:0/41: mknod d0/cc 0 2024-09-13T02:53:43.898 INFO:tasks.workunit.client.1.smithi131.stdout:0/42: creat d0/fd x:0 0 0 2024-09-13T02:53:43.899 INFO:tasks.workunit.client.1.smithi131.stdout:0/43: readlink d0/l6 0 2024-09-13T02:53:43.899 INFO:tasks.workunit.client.1.smithi131.stdout:0/44: dread - d0/d2/fb zero size 2024-09-13T02:53:43.899 INFO:tasks.workunit.client.1.smithi131.stdout:0/45: stat d0/fd 0 2024-09-13T02:53:43.899 INFO:tasks.workunit.client.1.smithi131.stdout:1/57: mknod dd/c11 0 2024-09-13T02:53:43.899 INFO:tasks.workunit.client.1.smithi131.stdout:1/58: stat f8 0 2024-09-13T02:53:43.899 INFO:tasks.workunit.client.1.smithi131.stdout:1/59: chown dd/ce 234549304 1 2024-09-13T02:53:43.900 INFO:tasks.workunit.client.1.smithi131.stdout:8/66: creat db/f15 x:0 0 0 2024-09-13T02:53:43.903 INFO:tasks.workunit.client.1.smithi131.stdout:0/46: mkdir d0/de 0 2024-09-13T02:53:43.903 INFO:tasks.workunit.client.1.smithi131.stdout:0/47: creat d0/d2/ff x:0 0 0 2024-09-13T02:53:43.903 INFO:tasks.workunit.client.1.smithi131.stdout:0/48: creat d0/f10 x:0 0 0 2024-09-13T02:53:43.903 INFO:tasks.workunit.client.1.smithi131.stdout:0/49: creat d0/f11 x:0 0 0 2024-09-13T02:53:43.903 INFO:tasks.workunit.client.1.smithi131.stdout:0/50: creat d0/f12 x:0 0 0 2024-09-13T02:53:43.903 INFO:tasks.workunit.client.1.smithi131.stdout:0/51: read - d0/f10 zero size 2024-09-13T02:53:43.903 INFO:tasks.workunit.client.1.smithi131.stdout:0/52: stat d0/f11 0 2024-09-13T02:53:43.903 INFO:tasks.workunit.client.1.smithi131.stdout:1/60: mknod dd/c12 0 2024-09-13T02:53:43.903 INFO:tasks.workunit.client.1.smithi131.stdout:1/61: write dd/ff [555048,82229] 0 2024-09-13T02:53:43.903 INFO:tasks.workunit.client.1.smithi131.stdout:1/62: creat dd/f13 x:0 0 0 2024-09-13T02:53:43.907 INFO:tasks.workunit.client.1.smithi131.stdout:0/53: mknod d0/c13 0 2024-09-13T02:53:43.909 INFO:tasks.workunit.client.1.smithi131.stdout:1/63: mknod dd/c14 0 2024-09-13T02:53:43.910 INFO:tasks.workunit.client.1.smithi131.stdout:1/64: creat dd/f15 x:0 0 0 2024-09-13T02:53:43.911 INFO:tasks.workunit.client.1.smithi131.stdout:0/54: creat d0/de/f14 x:0 0 0 2024-09-13T02:53:43.911 INFO:tasks.workunit.client.1.smithi131.stdout:0/55: readlink d0/l6 0 2024-09-13T02:53:43.914 INFO:tasks.workunit.client.1.smithi131.stdout:1/65: unlink ca 0 2024-09-13T02:53:43.915 INFO:tasks.workunit.client.1.smithi131.stdout:0/56: symlink d0/d2/l15 0 2024-09-13T02:53:43.916 INFO:tasks.workunit.client.1.smithi131.stdout:0/57: unlink d0/f10 0 2024-09-13T02:53:43.921 INFO:tasks.workunit.client.1.smithi131.stdout:6/29: truncate d1/f4 239496 0 2024-09-13T02:53:43.936 INFO:tasks.workunit.client.1.smithi131.stdout:8/67: dwrite f5 [0,4194304] 0 2024-09-13T02:53:43.936 INFO:tasks.workunit.client.1.smithi131.stdout:1/66: dwrite fc [0,4194304] 0 2024-09-13T02:53:43.939 INFO:tasks.workunit.client.1.smithi131.stdout:0/58: dwrite d0/d2/ff [0,4194304] 0 2024-09-13T02:53:43.939 INFO:tasks.workunit.client.1.smithi131.stdout:8/68: symlink db/l16 0 2024-09-13T02:53:43.940 INFO:tasks.workunit.client.1.smithi131.stdout:8/69: write f8 [808549,80467] 0 2024-09-13T02:53:43.940 INFO:tasks.workunit.client.1.smithi131.stdout:8/70: write f8 [1580511,127916] 0 2024-09-13T02:53:43.940 INFO:tasks.workunit.client.1.smithi131.stdout:8/71: write f6 [1475835,107920] 0 2024-09-13T02:53:43.940 INFO:tasks.workunit.client.1.smithi131.stdout:8/72: creat db/f17 x:0 0 0 2024-09-13T02:53:43.942 INFO:tasks.workunit.client.1.smithi131.stdout:0/59: unlink d0/f8 0 2024-09-13T02:53:43.943 INFO:tasks.workunit.client.1.smithi131.stdout:0/60: readlink d0/l6 0 2024-09-13T02:53:43.943 INFO:tasks.workunit.client.1.smithi131.stdout:0/61: read - d0/d2/fb zero size 2024-09-13T02:53:43.944 INFO:tasks.workunit.client.1.smithi131.stdout:6/30: dread d1/f4 [0,4194304] 0 2024-09-13T02:53:43.946 INFO:tasks.workunit.client.1.smithi131.stdout:6/31: write d1/f4 [98234,28318] 0 2024-09-13T02:53:43.946 INFO:tasks.workunit.client.1.smithi131.stdout:6/32: creat d1/f7 x:0 0 0 2024-09-13T02:53:43.946 INFO:tasks.workunit.client.1.smithi131.stdout:6/33: stat d1/f4 0 2024-09-13T02:53:43.946 INFO:tasks.workunit.client.1.smithi131.stdout:1/67: creat dd/f16 x:0 0 0 2024-09-13T02:53:43.958 INFO:tasks.workunit.client.1.smithi131.stdout:1/68: dread - dd/f13 zero size 2024-09-13T02:53:43.958 INFO:tasks.workunit.client.1.smithi131.stdout:1/69: readlink lb 0 2024-09-13T02:53:43.966 INFO:tasks.workunit.client.1.smithi131.stdout:8/73: dwrite f6 [0,4194304] 0 2024-09-13T02:53:43.966 INFO:tasks.workunit.client.1.smithi131.stdout:8/74: truncate db/fd 240112 0 2024-09-13T02:53:43.966 INFO:tasks.workunit.client.1.smithi131.stdout:0/62: dwrite d0/d2/fb [0,4194304] 0 2024-09-13T02:53:43.972 INFO:tasks.workunit.client.1.smithi131.stdout:8/75: dread f2 [0,4194304] 0 2024-09-13T02:53:43.972 INFO:tasks.workunit.client.1.smithi131.stdout:8/76: creat db/f18 x:0 0 0 2024-09-13T02:53:43.972 INFO:tasks.workunit.client.1.smithi131.stdout:8/77: truncate db/f15 162661 0 2024-09-13T02:53:43.972 INFO:tasks.workunit.client.1.smithi131.stdout:8/78: chown db/f17 50252 1 2024-09-13T02:53:43.972 INFO:tasks.workunit.client.1.smithi131.stdout:8/79: creat db/f19 x:0 0 0 2024-09-13T02:53:43.973 INFO:tasks.workunit.client.1.smithi131.stdout:8/80: rename db/l16 to db/l1a 0 2024-09-13T02:53:43.974 INFO:tasks.workunit.client.1.smithi131.stdout:8/81: symlink db/l1b 0 2024-09-13T02:53:43.983 INFO:tasks.workunit.client.1.smithi131.stdout:8/82: dread f5 [0,4194304] 0 2024-09-13T02:53:43.983 INFO:tasks.workunit.client.1.smithi131.stdout:8/83: chown f6 85067 1 2024-09-13T02:53:43.996 INFO:tasks.workunit.client.1.smithi131.stdout:8/84: dwrite db/f19 [0,4194304] 0 2024-09-13T02:53:43.996 INFO:tasks.workunit.client.1.smithi131.stdout:8/85: creat db/f1c x:0 0 0 2024-09-13T02:53:44.002 INFO:tasks.workunit.client.1.smithi131.stdout:8/86: rmdir db 39 2024-09-13T02:53:44.003 INFO:tasks.workunit.client.1.smithi131.stdout:8/87: mkdir db/d1d 0 2024-09-13T02:53:44.003 INFO:tasks.workunit.client.1.smithi131.stdout:8/88: readlink db/lf 0 2024-09-13T02:53:44.003 INFO:tasks.workunit.client.1.smithi131.stdout:8/89: readlink db/le 0 2024-09-13T02:53:44.003 INFO:tasks.workunit.client.1.smithi131.stdout:8/90: chown db/cc 857 1 2024-09-13T02:53:44.003 INFO:tasks.workunit.client.1.smithi131.stdout:8/91: stat l9 0 2024-09-13T02:53:44.003 INFO:tasks.workunit.client.1.smithi131.stdout:8/92: write db/f1c [645042,116999] 0 2024-09-13T02:53:44.004 INFO:tasks.workunit.client.1.smithi131.stdout:8/93: symlink db/d1d/l1e 0 2024-09-13T02:53:44.004 INFO:tasks.workunit.client.1.smithi131.stdout:8/94: mkdir db/d1d/d1f 0 2024-09-13T02:53:44.005 INFO:tasks.workunit.client.1.smithi131.stdout:8/95: dread db/fd [0,4194304] 0 2024-09-13T02:53:44.006 INFO:tasks.workunit.client.1.smithi131.stdout:8/96: mkdir db/d1d/d1f/d20 0 2024-09-13T02:53:44.006 INFO:tasks.workunit.client.1.smithi131.stdout:8/97: chown db/d1d/d1f/d20 532 1 2024-09-13T02:53:44.006 INFO:tasks.workunit.client.1.smithi131.stdout:8/98: chown f5 0 1 2024-09-13T02:53:44.019 INFO:tasks.workunit.client.1.smithi131.stdout:8/99: dwrite db/fd [0,4194304] 0 2024-09-13T02:53:44.019 INFO:tasks.workunit.client.1.smithi131.stdout:8/100: getdents db/d1d/d1f/d20 0 2024-09-13T02:53:44.019 INFO:tasks.workunit.client.1.smithi131.stdout:8/101: write db/f18 [149418,91722] 0 2024-09-13T02:53:44.020 INFO:tasks.workunit.client.1.smithi131.stdout:8/102: chown l1 157 1 2024-09-13T02:53:44.041 INFO:tasks.workunit.client.1.smithi131.stdout:8/103: dwrite f8 [0,4194304] 0 2024-09-13T02:53:44.041 INFO:tasks.workunit.client.1.smithi131.stdout:8/104: read db/f15 [48987,1344] 0 2024-09-13T02:53:44.041 INFO:tasks.workunit.client.1.smithi131.stdout:8/105: chown db/c12 10 1 2024-09-13T02:53:44.042 INFO:tasks.workunit.client.1.smithi131.stdout:8/106: mknod db/c21 0 2024-09-13T02:53:44.047 INFO:tasks.workunit.client.1.smithi131.stdout:8/107: dread f5 [0,4194304] 0 2024-09-13T02:53:44.065 INFO:tasks.workunit.client.1.smithi131.stdout:8/108: dwrite db/f1c [0,4194304] 0 2024-09-13T02:53:44.065 INFO:tasks.workunit.client.1.smithi131.stdout:8/109: getdents db/d1d/d1f/d20 0 2024-09-13T02:53:44.102 INFO:tasks.workunit.client.1.smithi131.stdout:8/110: symlink db/l22 0 2024-09-13T02:53:44.103 INFO:tasks.workunit.client.1.smithi131.stdout:8/111: creat db/f23 x:0 0 0 2024-09-13T02:53:44.105 INFO:tasks.workunit.client.1.smithi131.stdout:8/112: rmdir db/d1d/d1f/d20 0 2024-09-13T02:53:44.106 INFO:tasks.workunit.client.1.smithi131.stdout:8/113: unlink db/f1c 0 2024-09-13T02:53:44.108 INFO:tasks.workunit.client.1.smithi131.stdout:8/114: rename db/l1a to db/d1d/d1f/l24 0 2024-09-13T02:53:44.109 INFO:tasks.workunit.client.1.smithi131.stdout:8/115: creat db/d1d/f25 x:0 0 0 2024-09-13T02:53:44.124 INFO:tasks.workunit.client.1.smithi131.stdout:8/116: dwrite f6 [0,4194304] 0 2024-09-13T02:53:44.124 INFO:tasks.workunit.client.1.smithi131.stdout:8/117: dread - db/f23 zero size 2024-09-13T02:53:44.125 INFO:tasks.workunit.client.1.smithi131.stdout:8/118: mknod db/c26 0 2024-09-13T02:53:44.129 INFO:tasks.workunit.client.1.smithi131.stdout:8/119: truncate db/f18 84904 0 2024-09-13T02:53:44.143 INFO:tasks.workunit.client.1.smithi131.stdout:8/120: dwrite db/fd [0,4194304] 0 2024-09-13T02:53:44.144 INFO:tasks.workunit.client.1.smithi131.stdout:8/121: creat db/d1d/f27 x:0 0 0 2024-09-13T02:53:44.933 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:53:44 smithi131 ceph-mon[34689]: pgmap v234: 65 pgs: 65 active+clean; 162 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 4.3 MiB/s rd, 8.8 MiB/s wr, 889 op/s 2024-09-13T02:53:44.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:53:44 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:53:45.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:53:44 smithi089 ceph-mon[27639]: pgmap v234: 65 pgs: 65 active+clean; 162 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 4.3 MiB/s rd, 8.8 MiB/s wr, 889 op/s 2024-09-13T02:53:45.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:53:44 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:53:45.139 INFO:tasks.workunit.client.0.smithi089.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-09-13T02:53:45.146 INFO:tasks.workunit.client.0.smithi089.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-13T02:53:45.146 INFO:tasks.workunit.client.0.smithi089.stderr:+ make 2024-09-13T02:53:45.318 INFO:tasks.workunit.client.0.smithi089.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-09-13T02:53:46.248 INFO:tasks.workunit.client.0.smithi089.stderr:++ readlink -f fsstress 2024-09-13T02:53:46.249 INFO:tasks.workunit.client.0.smithi089.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-09-13T02:53:46.249 INFO:tasks.workunit.client.0.smithi089.stderr:+ popd 2024-09-13T02:53:46.250 INFO:tasks.workunit.client.0.smithi089.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-09-13T02:53:46.250 INFO:tasks.workunit.client.0.smithi089.stdout:~/cephtest/mnt.0/client.0/tmp 2024-09-13T02:53:46.251 INFO:tasks.workunit.client.0.smithi089.stderr:+ popd 2024-09-13T02:53:46.251 INFO:tasks.workunit.client.0.smithi089.stderr:++ mktemp -d -p . 2024-09-13T02:53:46.252 INFO:tasks.workunit.client.0.smithi089.stderr:+ T=./tmp.kmnIbmwQkg 2024-09-13T02:53:46.253 INFO:tasks.workunit.client.0.smithi089.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.kmnIbmwQkg -l 1 -n 1000 -p 10 -v 2024-09-13T02:53:46.254 INFO:tasks.workunit.client.0.smithi089.stdout:seed = 1725974815 2024-09-13T02:53:46.257 INFO:tasks.workunit.client.0.smithi089.stdout:1/0: link - no file 2024-09-13T02:53:46.258 INFO:tasks.workunit.client.0.smithi089.stdout:1/1: unlink - no file 2024-09-13T02:53:46.259 INFO:tasks.workunit.client.0.smithi089.stdout:0/0: creat f0 x:0 0 0 2024-09-13T02:53:46.259 INFO:tasks.workunit.client.0.smithi089.stdout:0/1: dread - f0 zero size 2024-09-13T02:53:46.259 INFO:tasks.workunit.client.0.smithi089.stdout:0/2: creat f1 x:0 0 0 2024-09-13T02:53:46.261 INFO:tasks.workunit.client.0.smithi089.stdout:2/0: write - no filename 2024-09-13T02:53:46.261 INFO:tasks.workunit.client.0.smithi089.stdout:2/1: read - no filename 2024-09-13T02:53:46.261 INFO:tasks.workunit.client.0.smithi089.stdout:1/2: creat f0 x:0 0 0 2024-09-13T02:53:46.262 INFO:tasks.workunit.client.0.smithi089.stdout:1/3: write f0 [3300,71263] 0 2024-09-13T02:53:46.262 INFO:tasks.workunit.client.0.smithi089.stdout:1/4: creat f1 x:0 0 0 2024-09-13T02:53:46.262 INFO:tasks.workunit.client.0.smithi089.stdout:1/5: truncate f1 478413 0 2024-09-13T02:53:46.262 INFO:tasks.workunit.client.0.smithi089.stdout:1/6: truncate f1 783230 0 2024-09-13T02:53:46.262 INFO:tasks.workunit.client.0.smithi089.stdout:1/7: chown f0 998518 1 2024-09-13T02:53:46.262 INFO:tasks.workunit.client.0.smithi089.stdout:1/8: readlink - no filename 2024-09-13T02:53:46.264 INFO:tasks.workunit.client.0.smithi089.stdout:0/3: mkdir d2 0 2024-09-13T02:53:46.264 INFO:tasks.workunit.client.0.smithi089.stdout:0/4: dread - f0 zero size 2024-09-13T02:53:46.264 INFO:tasks.workunit.client.0.smithi089.stdout:3/0: write - no filename 2024-09-13T02:53:46.265 INFO:tasks.workunit.client.0.smithi089.stdout:3/1: getdents . 0 2024-09-13T02:53:46.265 INFO:tasks.workunit.client.0.smithi089.stdout:3/2: read - no filename 2024-09-13T02:53:46.265 INFO:tasks.workunit.client.0.smithi089.stdout:2/2: creat f0 x:0 0 0 2024-09-13T02:53:46.265 INFO:tasks.workunit.client.0.smithi089.stdout:2/3: creat f1 x:0 0 0 2024-09-13T02:53:46.265 INFO:tasks.workunit.client.0.smithi089.stdout:2/4: dread - f0 zero size 2024-09-13T02:53:46.266 INFO:tasks.workunit.client.0.smithi089.stdout:4/0: stat - no entries 2024-09-13T02:53:46.266 INFO:tasks.workunit.client.0.smithi089.stdout:4/1: truncate - no filename 2024-09-13T02:53:46.266 INFO:tasks.workunit.client.0.smithi089.stdout:3/3: mknod c0 0 2024-09-13T02:53:46.269 INFO:tasks.workunit.client.0.smithi089.stdout:2/5: rename f0 to f2 0 2024-09-13T02:53:46.269 INFO:tasks.workunit.client.0.smithi089.stdout:2/6: fdatasync f1 0 2024-09-13T02:53:46.269 INFO:tasks.workunit.client.0.smithi089.stdout:5/0: read - no filename 2024-09-13T02:53:46.269 INFO:tasks.workunit.client.0.smithi089.stdout:1/9: dread f0 [0,4194304] 0 2024-09-13T02:53:46.269 INFO:tasks.workunit.client.0.smithi089.stdout:4/2: mknod c0 0 2024-09-13T02:53:46.269 INFO:tasks.workunit.client.0.smithi089.stdout:4/3: chown c0 76 1 2024-09-13T02:53:46.270 INFO:tasks.workunit.client.0.smithi089.stdout:3/4: symlink l1 0 2024-09-13T02:53:46.271 INFO:tasks.workunit.client.0.smithi089.stdout:6/0: dread - no filename 2024-09-13T02:53:46.271 INFO:tasks.workunit.client.0.smithi089.stdout:6/1: read - no filename 2024-09-13T02:53:46.271 INFO:tasks.workunit.client.0.smithi089.stdout:6/2: dwrite - no filename 2024-09-13T02:53:46.271 INFO:tasks.workunit.client.0.smithi089.stdout:6/3: dread - no filename 2024-09-13T02:53:46.271 INFO:tasks.workunit.client.0.smithi089.stdout:5/1: creat f0 x:0 0 0 2024-09-13T02:53:46.272 INFO:tasks.workunit.client.0.smithi089.stdout:4/4: mknod c1 0 2024-09-13T02:53:46.272 INFO:tasks.workunit.client.0.smithi089.stdout:4/5: dwrite - no filename 2024-09-13T02:53:46.273 INFO:tasks.workunit.client.0.smithi089.stdout:3/5: mkdir d2 0 2024-09-13T02:53:46.273 INFO:tasks.workunit.client.0.smithi089.stdout:3/6: fdatasync - no filename 2024-09-13T02:53:46.273 INFO:tasks.workunit.client.0.smithi089.stdout:3/7: rename d2 to d2/d3 22 2024-09-13T02:53:46.274 INFO:tasks.workunit.client.0.smithi089.stdout:3/8: chown d2 242542043 1 2024-09-13T02:53:46.274 INFO:tasks.workunit.client.0.smithi089.stdout:7/0: truncate - no filename 2024-09-13T02:53:46.275 INFO:tasks.workunit.client.0.smithi089.stdout:6/4: creat f0 x:0 0 0 2024-09-13T02:53:46.276 INFO:tasks.workunit.client.0.smithi089.stdout:4/6: mkdir d2 0 2024-09-13T02:53:46.276 INFO:tasks.workunit.client.0.smithi089.stdout:4/7: write - no filename 2024-09-13T02:53:46.277 INFO:tasks.workunit.client.0.smithi089.stdout:3/9: unlink l1 0 2024-09-13T02:53:46.277 INFO:tasks.workunit.client.0.smithi089.stdout:3/10: getdents d2 0 2024-09-13T02:53:46.277 INFO:tasks.workunit.client.0.smithi089.stdout:3/11: dwrite - no filename 2024-09-13T02:53:46.278 INFO:tasks.workunit.client.0.smithi089.stdout:8/0: dwrite - no filename 2024-09-13T02:53:46.279 INFO:tasks.workunit.client.0.smithi089.stdout:8/1: write - no filename 2024-09-13T02:53:46.279 INFO:tasks.workunit.client.0.smithi089.stdout:8/2: getdents . 0 2024-09-13T02:53:46.279 INFO:tasks.workunit.client.0.smithi089.stdout:8/3: truncate - no filename 2024-09-13T02:53:46.280 INFO:tasks.workunit.client.0.smithi089.stdout:7/1: creat f0 x:0 0 0 2024-09-13T02:53:46.280 INFO:tasks.workunit.client.0.smithi089.stdout:7/2: creat f1 x:0 0 0 2024-09-13T02:53:46.280 INFO:tasks.workunit.client.0.smithi089.stdout:6/5: symlink l1 0 2024-09-13T02:53:46.282 INFO:tasks.workunit.client.0.smithi089.stdout:0/5: dwrite f0 [0,4194304] 0 2024-09-13T02:53:46.283 INFO:tasks.workunit.client.0.smithi089.stdout:4/8: mkdir d2/d3 0 2024-09-13T02:53:46.284 INFO:tasks.workunit.client.0.smithi089.stdout:3/12: mkdir d2/d4 0 2024-09-13T02:53:46.284 INFO:tasks.workunit.client.0.smithi089.stdout:3/13: stat d2 0 2024-09-13T02:53:46.286 INFO:tasks.workunit.client.0.smithi089.stdout:9/0: write - no filename 2024-09-13T02:53:46.286 INFO:tasks.workunit.client.0.smithi089.stdout:9/1: chown . 9 1 2024-09-13T02:53:46.286 INFO:tasks.workunit.client.0.smithi089.stdout:9/2: dwrite - no filename 2024-09-13T02:53:46.286 INFO:tasks.workunit.client.0.smithi089.stdout:9/3: dread - no filename 2024-09-13T02:53:46.286 INFO:tasks.workunit.client.0.smithi089.stdout:9/4: write - no filename 2024-09-13T02:53:46.287 INFO:tasks.workunit.client.0.smithi089.stdout:9/5: write - no filename 2024-09-13T02:53:46.287 INFO:tasks.workunit.client.0.smithi089.stdout:9/6: fdatasync - no filename 2024-09-13T02:53:46.287 INFO:tasks.workunit.client.0.smithi089.stdout:9/7: getdents . 0 2024-09-13T02:53:46.287 INFO:tasks.workunit.client.0.smithi089.stdout:8/4: creat f0 x:0 0 0 2024-09-13T02:53:46.291 INFO:tasks.workunit.client.0.smithi089.stdout:7/3: symlink l2 0 2024-09-13T02:53:46.291 INFO:tasks.workunit.client.0.smithi089.stdout:7/4: dread - f0 zero size 2024-09-13T02:53:46.294 INFO:tasks.workunit.client.0.smithi089.stdout:4/9: creat d2/f4 x:0 0 0 2024-09-13T02:53:46.297 INFO:tasks.workunit.client.0.smithi089.stdout:1/10: dwrite f0 [0,4194304] 0 2024-09-13T02:53:46.297 INFO:tasks.workunit.client.0.smithi089.stdout:3/14: creat d2/d4/f5 x:0 0 0 2024-09-13T02:53:46.298 INFO:tasks.workunit.client.0.smithi089.stdout:9/8: creat f0 x:0 0 0 2024-09-13T02:53:46.299 INFO:tasks.workunit.client.0.smithi089.stdout:8/5: mknod c1 0 2024-09-13T02:53:46.299 INFO:tasks.workunit.client.0.smithi089.stdout:8/6: stat f0 0 2024-09-13T02:53:46.300 INFO:tasks.workunit.client.0.smithi089.stdout:4/10: mkdir d2/d3/d5 0 2024-09-13T02:53:46.300 INFO:tasks.workunit.client.0.smithi089.stdout:4/11: dread - d2/f4 zero size 2024-09-13T02:53:46.300 INFO:tasks.workunit.client.0.smithi089.stdout:4/12: truncate d2/f4 576008 0 2024-09-13T02:53:46.300 INFO:tasks.workunit.client.0.smithi089.stdout:5/2: dwrite f0 [0,4194304] 0 2024-09-13T02:53:46.303 INFO:tasks.workunit.client.0.smithi089.stdout:2/7: rename f2 to f3 0 2024-09-13T02:53:46.303 INFO:tasks.workunit.client.0.smithi089.stdout:2/8: dread - f3 zero size 2024-09-13T02:53:46.303 INFO:tasks.workunit.client.0.smithi089.stdout:2/9: dread - f3 zero size 2024-09-13T02:53:46.306 INFO:tasks.workunit.client.0.smithi089.stdout:9/9: rename f0 to f1 0 2024-09-13T02:53:46.308 INFO:tasks.workunit.client.0.smithi089.stdout:4/13: rename c0 to d2/c6 0 2024-09-13T02:53:46.309 INFO:tasks.workunit.client.0.smithi089.stdout:1/11: link f1 f2 0 2024-09-13T02:53:46.311 INFO:tasks.workunit.client.0.smithi089.stdout:1/12: dread f2 [0,4194304] 0 2024-09-13T02:53:46.311 INFO:tasks.workunit.client.0.smithi089.stdout:4/14: link c1 d2/d3/d5/c7 0 2024-09-13T02:53:46.312 INFO:tasks.workunit.client.0.smithi089.stdout:1/13: dread f1 [0,4194304] 0 2024-09-13T02:53:46.312 INFO:tasks.workunit.client.0.smithi089.stdout:4/15: read d2/f4 [149997,47287] 0 2024-09-13T02:53:46.312 INFO:tasks.workunit.client.0.smithi089.stdout:4/16: truncate d2/f4 1140117 0 2024-09-13T02:53:46.312 INFO:tasks.workunit.client.0.smithi089.stdout:4/17: write d2/f4 [1720049,9308] 0 2024-09-13T02:53:46.313 INFO:tasks.workunit.client.0.smithi089.stdout:1/14: link f1 f3 0 2024-09-13T02:53:46.315 INFO:tasks.workunit.client.0.smithi089.stdout:4/18: unlink c1 0 2024-09-13T02:53:46.315 INFO:tasks.workunit.client.0.smithi089.stdout:1/15: mknod c4 0 2024-09-13T02:53:46.315 INFO:tasks.workunit.client.0.smithi089.stdout:1/16: creat f5 x:0 0 0 2024-09-13T02:53:46.316 INFO:tasks.workunit.client.0.smithi089.stdout:6/6: dwrite f0 [0,4194304] 0 2024-09-13T02:53:46.316 INFO:tasks.workunit.client.0.smithi089.stdout:1/17: read f1 [10872,79288] 0 2024-09-13T02:53:46.316 INFO:tasks.workunit.client.0.smithi089.stdout:4/19: write d2/f4 [1649467,17338] 0 2024-09-13T02:53:46.317 INFO:tasks.workunit.client.0.smithi089.stdout:6/7: link l1 l2 0 2024-09-13T02:53:46.318 INFO:tasks.workunit.client.0.smithi089.stdout:1/18: link f1 f6 0 2024-09-13T02:53:46.318 INFO:tasks.workunit.client.0.smithi089.stdout:6/8: stat l2 0 2024-09-13T02:53:46.319 INFO:tasks.workunit.client.0.smithi089.stdout:1/19: dread f2 [0,4194304] 0 2024-09-13T02:53:46.321 INFO:tasks.workunit.client.0.smithi089.stdout:5/3: dread f0 [0,4194304] 0 2024-09-13T02:53:46.322 INFO:tasks.workunit.client.0.smithi089.stdout:5/4: mkdir d1 0 2024-09-13T02:53:46.323 INFO:tasks.workunit.client.0.smithi089.stdout:5/5: mkdir d1/d2 0 2024-09-13T02:53:46.324 INFO:tasks.workunit.client.0.smithi089.stdout:5/6: creat d1/f3 x:0 0 0 2024-09-13T02:53:46.324 INFO:tasks.workunit.client.0.smithi089.stdout:5/7: write d1/f3 [798188,94830] 0 2024-09-13T02:53:46.325 INFO:tasks.workunit.client.0.smithi089.stdout:5/8: rmdir d1/d2 0 2024-09-13T02:53:46.326 INFO:tasks.workunit.client.0.smithi089.stdout:5/9: mkdir d1/d4 0 2024-09-13T02:53:46.328 INFO:tasks.workunit.client.0.smithi089.stdout:0/6: dwrite f1 [0,4194304] 0 2024-09-13T02:53:46.328 INFO:tasks.workunit.client.0.smithi089.stdout:7/5: dwrite f1 [0,4194304] 0 2024-09-13T02:53:46.331 INFO:tasks.workunit.client.0.smithi089.stdout:2/10: dwrite f3 [0,4194304] 0 2024-09-13T02:53:46.334 INFO:tasks.workunit.client.0.smithi089.stdout:7/6: mkdir d3 0 2024-09-13T02:53:46.334 INFO:tasks.workunit.client.0.smithi089.stdout:7/7: stat f0 0 2024-09-13T02:53:46.334 INFO:tasks.workunit.client.0.smithi089.stdout:7/8: read - f0 zero size 2024-09-13T02:53:46.334 INFO:tasks.workunit.client.0.smithi089.stdout:5/10: write f0 [3779927,34307] 0 2024-09-13T02:53:46.337 INFO:tasks.workunit.client.0.smithi089.stdout:2/11: symlink l4 0 2024-09-13T02:53:46.339 INFO:tasks.workunit.client.0.smithi089.stdout:7/9: rename f1 to d3/f4 0 2024-09-13T02:53:46.340 INFO:tasks.workunit.client.0.smithi089.stdout:5/11: fsync f0 0 2024-09-13T02:53:46.341 INFO:tasks.workunit.client.0.smithi089.stdout:8/7: fsync f0 0 2024-09-13T02:53:46.341 INFO:tasks.workunit.client.0.smithi089.stdout:8/8: fsync f0 0 2024-09-13T02:53:46.341 INFO:tasks.workunit.client.0.smithi089.stdout:8/9: write f0 [293532,74520] 0 2024-09-13T02:53:46.342 INFO:tasks.workunit.client.0.smithi089.stdout:1/20: dwrite f0 [0,4194304] 0 2024-09-13T02:53:46.342 INFO:tasks.workunit.client.0.smithi089.stdout:1/21: chown f5 1 1 2024-09-13T02:53:46.343 INFO:tasks.workunit.client.0.smithi089.stdout:1/22: dread f2 [0,4194304] 0 2024-09-13T02:53:46.344 INFO:tasks.workunit.client.0.smithi089.stdout:1/23: write f2 [265440,54301] 0 2024-09-13T02:53:46.344 INFO:tasks.workunit.client.0.smithi089.stdout:5/12: creat d1/d4/f5 x:0 0 0 2024-09-13T02:53:46.345 INFO:tasks.workunit.client.0.smithi089.stdout:8/10: mknod c2 0 2024-09-13T02:53:46.345 INFO:tasks.workunit.client.0.smithi089.stdout:8/11: creat f3 x:0 0 0 2024-09-13T02:53:46.347 INFO:tasks.workunit.client.0.smithi089.stdout:1/24: rename f6 to f7 0 2024-09-13T02:53:46.347 INFO:tasks.workunit.client.0.smithi089.stdout:1/25: creat f8 x:0 0 0 2024-09-13T02:53:46.347 INFO:tasks.workunit.client.0.smithi089.stdout:1/26: chown f7 3162506 1 2024-09-13T02:53:46.362 INFO:tasks.workunit.client.0.smithi089.stdout:5/13: symlink d1/l6 0 2024-09-13T02:53:46.365 INFO:tasks.workunit.client.0.smithi089.stdout:1/27: symlink l9 0 2024-09-13T02:53:46.371 INFO:tasks.workunit.client.0.smithi089.stdout:9/10: rename f1 to f2 0 2024-09-13T02:53:46.373 INFO:tasks.workunit.client.0.smithi089.stdout:9/11: mkdir d3 0 2024-09-13T02:53:46.373 INFO:tasks.workunit.client.0.smithi089.stdout:9/12: truncate f2 74643 0 2024-09-13T02:53:46.385 INFO:tasks.workunit.client.0.smithi089.stdout:6/9: write f0 [3955433,95476] 0 2024-09-13T02:53:46.385 INFO:tasks.workunit.client.0.smithi089.stdout:3/15: dwrite d2/d4/f5 [0,4194304] 0 2024-09-13T02:53:46.385 INFO:tasks.workunit.client.0.smithi089.stdout:3/16: rename d2/d4 to d2/d4/d6 22 2024-09-13T02:53:46.393 INFO:tasks.workunit.client.0.smithi089.stdout:3/17: unlink c0 0 2024-09-13T02:53:46.398 INFO:tasks.workunit.client.0.smithi089.stdout:2/12: getdents . 0 2024-09-13T02:53:46.437 INFO:tasks.workunit.client.0.smithi089.stdout:0/7: dread f1 [0,4194304] 0 2024-09-13T02:53:46.439 INFO:tasks.workunit.client.0.smithi089.stdout:0/8: truncate f1 3696230 0 2024-09-13T02:53:46.445 INFO:tasks.workunit.client.0.smithi089.stdout:0/9: creat d2/f3 x:0 0 0 2024-09-13T02:53:46.445 INFO:tasks.workunit.client.0.smithi089.stdout:0/10: chown f0 195829127 1 2024-09-13T02:53:46.447 INFO:tasks.workunit.client.0.smithi089.stdout:0/11: unlink f0 0 2024-09-13T02:53:46.560 INFO:tasks.workunit.client.0.smithi089.stdout:7/10: dwrite d3/f4 [0,4194304] 0 2024-09-13T02:53:46.560 INFO:tasks.workunit.client.0.smithi089.stdout:7/11: fdatasync d3/f4 0 2024-09-13T02:53:46.588 INFO:tasks.workunit.client.0.smithi089.stdout:4/20: dwrite d2/f4 [0,4194304] 0 2024-09-13T02:53:46.693 INFO:tasks.workunit.client.0.smithi089.stdout:3/18: write d2/d4/f5 [3726457,114130] 0 2024-09-13T02:53:46.701 INFO:tasks.workunit.client.0.smithi089.stdout:7/12: rename d3/f4 to d3/f5 0 2024-09-13T02:53:46.763 INFO:tasks.workunit.client.0.smithi089.stdout:2/13: dwrite f3 [0,4194304] 0 2024-09-13T02:53:46.763 INFO:tasks.workunit.client.0.smithi089.stdout:2/14: write f1 [903295,2200] 0 2024-09-13T02:53:46.825 INFO:tasks.workunit.client.0.smithi089.stdout:2/15: dread f3 [0,4194304] 0 2024-09-13T02:53:46.859 INFO:tasks.workunit.client.0.smithi089.stdout:4/21: mknod d2/c8 0 2024-09-13T02:53:46.925 INFO:tasks.workunit.client.0.smithi089.stdout:2/16: dwrite f3 [0,4194304] 0 2024-09-13T02:53:46.933 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:53:46 smithi131 ceph-mon[34689]: pgmap v235: 65 pgs: 65 active+clean; 210 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 7.2 MiB/s rd, 13 MiB/s wr, 995 op/s 2024-09-13T02:53:46.992 INFO:tasks.workunit.client.0.smithi089.stdout:5/14: rmdir d1/d4 39 2024-09-13T02:53:46.998 INFO:tasks.workunit.client.0.smithi089.stdout:9/13: link f2 d3/f4 0 2024-09-13T02:53:47.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:53:46 smithi089 ceph-mon[27639]: pgmap v235: 65 pgs: 65 active+clean; 210 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 7.2 MiB/s rd, 13 MiB/s wr, 995 op/s 2024-09-13T02:53:47.074 INFO:tasks.workunit.client.0.smithi089.stdout:5/15: dwrite d1/f3 [0,4194304] 0 2024-09-13T02:53:47.249 INFO:tasks.workunit.client.0.smithi089.stdout:3/19: dwrite d2/d4/f5 [0,4194304] 0 2024-09-13T02:53:47.276 INFO:tasks.workunit.client.0.smithi089.stdout:6/10: truncate f0 1998179 0 2024-09-13T02:53:47.276 INFO:tasks.workunit.client.0.smithi089.stdout:6/11: creat f3 x:0 0 0 2024-09-13T02:53:47.353 INFO:tasks.workunit.client.0.smithi089.stdout:0/12: dread f1 [0,4194304] 0 2024-09-13T02:53:47.353 INFO:tasks.workunit.client.0.smithi089.stdout:0/13: creat d2/f4 x:0 0 0 2024-09-13T02:53:47.353 INFO:tasks.workunit.client.0.smithi089.stdout:0/14: chown d2/f4 23780520 1 2024-09-13T02:53:47.354 INFO:tasks.workunit.client.0.smithi089.stdout:0/15: creat d2/f5 x:0 0 0 2024-09-13T02:53:47.479 INFO:tasks.workunit.client.0.smithi089.stdout:0/16: dwrite d2/f5 [0,4194304] 0 2024-09-13T02:53:47.487 INFO:tasks.workunit.client.0.smithi089.stdout:0/17: write f1 [2807664,40197] 0 2024-09-13T02:53:47.487 INFO:tasks.workunit.client.0.smithi089.stdout:0/18: dread - d2/f3 zero size 2024-09-13T02:53:47.487 INFO:tasks.workunit.client.0.smithi089.stdout:0/19: read - d2/f3 zero size 2024-09-13T02:53:47.503 INFO:tasks.workunit.client.0.smithi089.stdout:7/13: symlink d3/l6 0 2024-09-13T02:53:47.850 INFO:tasks.workunit.client.0.smithi089.stdout:4/22: unlink d2/c6 0 2024-09-13T02:53:47.943 INFO:tasks.workunit.client.0.smithi089.stdout:2/17: creat f5 x:0 0 0 2024-09-13T02:53:47.951 INFO:tasks.workunit.client.0.smithi089.stdout:2/18: read f3 [2798428,81679] 0 2024-09-13T02:53:47.951 INFO:tasks.workunit.client.0.smithi089.stdout:2/19: chown f1 161881244 1 2024-09-13T02:53:47.951 INFO:tasks.workunit.client.0.smithi089.stdout:2/20: stat l4 0 2024-09-13T02:53:47.951 INFO:tasks.workunit.client.0.smithi089.stdout:2/21: write f3 [3779709,108959] 0 2024-09-13T02:53:48.020 INFO:tasks.workunit.client.0.smithi089.stdout:9/14: creat d3/f5 x:0 0 0 2024-09-13T02:53:48.084 INFO:tasks.workunit.client.0.smithi089.stdout:5/16: mkdir d1/d7 0 2024-09-13T02:53:48.092 INFO:tasks.workunit.client.0.smithi089.stdout:5/17: dread d1/f3 [0,4194304] 0 2024-09-13T02:53:48.093 INFO:tasks.workunit.client.0.smithi089.stdout:5/18: write f0 [2649207,124279] 0 2024-09-13T02:53:48.093 INFO:tasks.workunit.client.0.smithi089.stdout:5/19: readlink d1/l6 0 2024-09-13T02:53:48.093 INFO:tasks.workunit.client.0.smithi089.stdout:5/20: write d1/d4/f5 [667034,70229] 0 2024-09-13T02:53:48.140 INFO:tasks.workunit.client.0.smithi089.stdout:3/20: unlink d2/d4/f5 0 2024-09-13T02:53:48.140 INFO:tasks.workunit.client.0.smithi089.stdout:3/21: unlink - no file 2024-09-13T02:53:48.140 INFO:tasks.workunit.client.0.smithi089.stdout:3/22: dwrite - no filename 2024-09-13T02:53:48.162 INFO:tasks.workunit.client.0.smithi089.stdout:6/12: symlink l4 0 2024-09-13T02:53:48.223 INFO:tasks.workunit.client.0.smithi089.stdout:7/14: mknod d3/c7 0 2024-09-13T02:53:48.223 INFO:tasks.workunit.client.0.smithi089.stdout:4/23: rmdir d2/d3 39 2024-09-13T02:53:48.224 INFO:tasks.workunit.client.0.smithi089.stdout:2/22: symlink l6 0 2024-09-13T02:53:48.224 INFO:tasks.workunit.client.0.smithi089.stdout:2/23: write f3 [2924557,51655] 0 2024-09-13T02:53:48.224 INFO:tasks.workunit.client.0.smithi089.stdout:9/15: mkdir d3/d6 0 2024-09-13T02:53:48.226 INFO:tasks.workunit.client.0.smithi089.stdout:5/21: symlink d1/d4/l8 0 2024-09-13T02:53:48.227 INFO:tasks.workunit.client.0.smithi089.stdout:3/23: symlink d2/l7 0 2024-09-13T02:53:48.227 INFO:tasks.workunit.client.0.smithi089.stdout:3/24: read - no filename 2024-09-13T02:53:48.227 INFO:tasks.workunit.client.0.smithi089.stdout:6/13: stat l2 0 2024-09-13T02:53:48.227 INFO:tasks.workunit.client.0.smithi089.stdout:6/14: readlink l1 0 2024-09-13T02:53:48.231 INFO:tasks.workunit.client.0.smithi089.stdout:7/15: unlink d3/l6 0 2024-09-13T02:53:48.233 INFO:tasks.workunit.client.0.smithi089.stdout:2/24: mknod c7 0 2024-09-13T02:53:48.234 INFO:tasks.workunit.client.0.smithi089.stdout:9/16: mknod d3/d6/c7 0 2024-09-13T02:53:48.234 INFO:tasks.workunit.client.0.smithi089.stdout:9/17: fsync d3/f4 0 2024-09-13T02:53:48.236 INFO:tasks.workunit.client.0.smithi089.stdout:5/22: rename d1/f3 to d1/d7/f9 0 2024-09-13T02:53:48.237 INFO:tasks.workunit.client.0.smithi089.stdout:3/25: mkdir d2/d8 0 2024-09-13T02:53:48.240 INFO:tasks.workunit.client.0.smithi089.stdout:7/16: mknod d3/c8 0 2024-09-13T02:53:48.240 INFO:tasks.workunit.client.0.smithi089.stdout:7/17: write f0 [915522,6882] 0 2024-09-13T02:53:48.241 INFO:tasks.workunit.client.0.smithi089.stdout:2/25: mknod c8 0 2024-09-13T02:53:48.243 INFO:tasks.workunit.client.0.smithi089.stdout:9/18: symlink d3/l8 0 2024-09-13T02:53:48.243 INFO:tasks.workunit.client.0.smithi089.stdout:9/19: chown d3/l8 321 1 2024-09-13T02:53:48.245 INFO:tasks.workunit.client.0.smithi089.stdout:5/23: rename f0 to d1/fa 0 2024-09-13T02:53:48.247 INFO:tasks.workunit.client.0.smithi089.stdout:2/26: symlink l9 0 2024-09-13T02:53:48.247 INFO:tasks.workunit.client.0.smithi089.stdout:2/27: creat fa x:0 0 0 2024-09-13T02:53:48.247 INFO:tasks.workunit.client.0.smithi089.stdout:2/28: creat fb x:0 0 0 2024-09-13T02:53:48.247 INFO:tasks.workunit.client.0.smithi089.stdout:2/29: read f3 [1590146,59858] 0 2024-09-13T02:53:48.249 INFO:tasks.workunit.client.0.smithi089.stdout:6/15: dwrite f0 [0,4194304] 0 2024-09-13T02:53:48.255 INFO:tasks.workunit.client.0.smithi089.stdout:6/16: mknod c5 0 2024-09-13T02:53:48.262 INFO:tasks.workunit.client.0.smithi089.stdout:7/18: dwrite d3/f5 [0,4194304] 0 2024-09-13T02:53:48.267 INFO:tasks.workunit.client.0.smithi089.stdout:7/19: fsync f0 0 2024-09-13T02:53:48.267 INFO:tasks.workunit.client.0.smithi089.stdout:6/17: dread f0 [0,4194304] 0 2024-09-13T02:53:48.267 INFO:tasks.workunit.client.0.smithi089.stdout:6/18: creat f6 x:0 0 0 2024-09-13T02:53:48.285 INFO:tasks.workunit.client.0.smithi089.stdout:7/20: dwrite d3/f5 [0,4194304] 0 2024-09-13T02:53:48.285 INFO:tasks.workunit.client.0.smithi089.stdout:7/21: stat l2 0 2024-09-13T02:53:48.289 INFO:tasks.workunit.client.0.smithi089.stdout:7/22: dread f0 [0,4194304] 0 2024-09-13T02:53:48.290 INFO:tasks.workunit.client.0.smithi089.stdout:7/23: rename d3/c7 to d3/c9 0 2024-09-13T02:53:48.292 INFO:tasks.workunit.client.0.smithi089.stdout:7/24: dread f0 [0,4194304] 0 2024-09-13T02:53:48.292 INFO:tasks.workunit.client.0.smithi089.stdout:7/25: write f0 [1266174,23095] 0 2024-09-13T02:53:48.293 INFO:tasks.workunit.client.0.smithi089.stdout:7/26: creat d3/fa x:0 0 0 2024-09-13T02:53:48.294 INFO:tasks.workunit.client.0.smithi089.stdout:7/27: mknod d3/cb 0 2024-09-13T02:53:48.295 INFO:tasks.workunit.client.0.smithi089.stdout:7/28: link l2 d3/lc 0 2024-09-13T02:53:48.304 INFO:tasks.workunit.client.0.smithi089.stdout:7/29: dread d3/f5 [0,4194304] 0 2024-09-13T02:53:48.305 INFO:tasks.workunit.client.0.smithi089.stdout:7/30: dread - d3/fa zero size 2024-09-13T02:53:48.305 INFO:tasks.workunit.client.0.smithi089.stdout:7/31: write d3/f5 [5132413,5514] 0 2024-09-13T02:53:48.320 INFO:tasks.workunit.client.0.smithi089.stdout:4/24: getdents d2 0 2024-09-13T02:53:48.340 INFO:tasks.workunit.client.0.smithi089.stdout:4/25: dwrite d2/f4 [0,4194304] 0 2024-09-13T02:53:48.340 INFO:tasks.workunit.client.0.smithi089.stdout:4/26: chown d2/c8 139432306 1 2024-09-13T02:53:48.360 INFO:tasks.workunit.client.0.smithi089.stdout:4/27: dread d2/f4 [0,4194304] 0 2024-09-13T02:53:48.361 INFO:tasks.workunit.client.0.smithi089.stdout:4/28: mknod d2/d3/d5/c9 0 2024-09-13T02:53:48.362 INFO:tasks.workunit.client.0.smithi089.stdout:4/29: mkdir d2/da 0 2024-09-13T02:53:48.371 INFO:tasks.workunit.client.0.smithi089.stdout:4/30: dread d2/f4 [0,4194304] 0 2024-09-13T02:53:48.372 INFO:tasks.workunit.client.0.smithi089.stdout:4/31: getdents d2/d3 0 2024-09-13T02:53:48.391 INFO:tasks.workunit.client.0.smithi089.stdout:4/32: dwrite d2/f4 [0,4194304] 0 2024-09-13T02:53:48.409 INFO:tasks.workunit.client.0.smithi089.stdout:4/33: dwrite d2/f4 [0,4194304] 0 2024-09-13T02:53:48.409 INFO:tasks.workunit.client.0.smithi089.stdout:4/34: fdatasync d2/f4 0 2024-09-13T02:53:48.419 INFO:tasks.workunit.client.0.smithi089.stdout:4/35: dread d2/f4 [0,4194304] 0 2024-09-13T02:53:48.424 INFO:tasks.workunit.client.0.smithi089.stdout:4/36: write d2/f4 [1314513,24222] 0 2024-09-13T02:53:48.430 INFO:tasks.workunit.client.0.smithi089.stdout:0/20: truncate d2/f5 2743381 0 2024-09-13T02:53:48.433 INFO:tasks.workunit.client.0.smithi089.stdout:9/20: getdents d3/d6 0 2024-09-13T02:53:48.433 INFO:tasks.workunit.client.0.smithi089.stdout:9/21: stat d3/f5 0 2024-09-13T02:53:48.434 INFO:tasks.workunit.client.0.smithi089.stdout:9/22: symlink d3/l9 0 2024-09-13T02:53:48.434 INFO:tasks.workunit.client.0.smithi089.stdout:9/23: chown d3/d6 745731 1 2024-09-13T02:53:48.438 INFO:tasks.workunit.client.0.smithi089.stdout:5/24: getdents d1 0 2024-09-13T02:53:48.439 INFO:tasks.workunit.client.0.smithi089.stdout:2/30: fsync fa 0 2024-09-13T02:53:48.442 INFO:tasks.workunit.client.0.smithi089.stdout:0/21: truncate f1 395161 0 2024-09-13T02:53:48.442 INFO:tasks.workunit.client.0.smithi089.stdout:0/22: dread - d2/f4 zero size 2024-09-13T02:53:48.444 INFO:tasks.workunit.client.0.smithi089.stdout:6/19: getdents . 0 2024-09-13T02:53:48.444 INFO:tasks.workunit.client.0.smithi089.stdout:6/20: dread - f6 zero size 2024-09-13T02:53:48.444 INFO:tasks.workunit.client.0.smithi089.stdout:6/21: stat l1 0 2024-09-13T02:53:48.444 INFO:tasks.workunit.client.0.smithi089.stdout:0/23: getdents d2 0 2024-09-13T02:53:48.445 INFO:tasks.workunit.client.0.smithi089.stdout:4/37: dwrite d2/f4 [0,4194304] 0 2024-09-13T02:53:48.446 INFO:tasks.workunit.client.0.smithi089.stdout:6/22: mknod c7 0 2024-09-13T02:53:48.447 INFO:tasks.workunit.client.0.smithi089.stdout:6/23: chown l2 21 1 2024-09-13T02:53:48.449 INFO:tasks.workunit.client.0.smithi089.stdout:7/32: getdents d3 0 2024-09-13T02:53:48.451 INFO:tasks.workunit.client.0.smithi089.stdout:6/24: symlink l8 0 2024-09-13T02:53:48.454 INFO:tasks.workunit.client.0.smithi089.stdout:7/33: symlink d3/ld 0 2024-09-13T02:53:48.455 INFO:tasks.workunit.client.0.smithi089.stdout:9/24: getdents d3 0 2024-09-13T02:53:48.456 INFO:tasks.workunit.client.0.smithi089.stdout:6/25: creat f9 x:0 0 0 2024-09-13T02:53:48.456 INFO:tasks.workunit.client.0.smithi089.stdout:6/26: readlink l8 0 2024-09-13T02:53:48.458 INFO:tasks.workunit.client.0.smithi089.stdout:9/25: mknod d3/ca 0 2024-09-13T02:53:48.458 INFO:tasks.workunit.client.0.smithi089.stdout:6/27: dread - f6 zero size 2024-09-13T02:53:48.459 INFO:tasks.workunit.client.0.smithi089.stdout:6/28: chown c5 2473 1 2024-09-13T02:53:48.461 INFO:tasks.workunit.client.0.smithi089.stdout:6/29: mknod ca 0 2024-09-13T02:53:48.463 INFO:tasks.workunit.client.0.smithi089.stdout:6/30: mkdir db 0 2024-09-13T02:53:48.464 INFO:tasks.workunit.client.0.smithi089.stdout:6/31: creat db/fc x:0 0 0 2024-09-13T02:53:48.464 INFO:tasks.workunit.client.0.smithi089.stdout:6/32: dread - f9 zero size 2024-09-13T02:53:48.464 INFO:tasks.workunit.client.0.smithi089.stdout:6/33: stat c7 0 2024-09-13T02:53:48.465 INFO:tasks.workunit.client.0.smithi089.stdout:6/34: write f9 [832045,124706] 0 2024-09-13T02:53:48.472 INFO:tasks.workunit.client.0.smithi089.stdout:5/25: dwrite d1/fa [0,4194304] 0 2024-09-13T02:53:48.475 INFO:tasks.workunit.client.0.smithi089.stdout:0/24: dread f1 [0,4194304] 0 2024-09-13T02:53:48.475 INFO:tasks.workunit.client.0.smithi089.stdout:5/26: symlink d1/d7/lb 0 2024-09-13T02:53:48.477 INFO:tasks.workunit.client.0.smithi089.stdout:0/25: link d2/f3 d2/f6 0 2024-09-13T02:53:48.478 INFO:tasks.workunit.client.0.smithi089.stdout:7/34: dread f0 [0,4194304] 0 2024-09-13T02:53:48.481 INFO:tasks.workunit.client.0.smithi089.stdout:2/31: dwrite fb [0,4194304] 0 2024-09-13T02:53:48.481 INFO:tasks.workunit.client.0.smithi089.stdout:4/38: write d2/f4 [1055546,60312] 0 2024-09-13T02:53:48.482 INFO:tasks.workunit.client.0.smithi089.stdout:7/35: mkdir d3/de 0 2024-09-13T02:53:48.483 INFO:tasks.workunit.client.0.smithi089.stdout:6/35: getdents db 0 2024-09-13T02:53:48.487 INFO:tasks.workunit.client.0.smithi089.stdout:2/32: link f5 fc 0 2024-09-13T02:53:48.487 INFO:tasks.workunit.client.0.smithi089.stdout:2/33: creat fd x:0 0 0 2024-09-13T02:53:48.488 INFO:tasks.workunit.client.0.smithi089.stdout:4/39: mknod d2/cb 0 2024-09-13T02:53:48.489 INFO:tasks.workunit.client.0.smithi089.stdout:7/36: write d3/f5 [6112880,24506] 0 2024-09-13T02:53:48.489 INFO:tasks.workunit.client.0.smithi089.stdout:6/36: dread - f3 zero size 2024-09-13T02:53:48.491 INFO:tasks.workunit.client.0.smithi089.stdout:2/34: mkdir de 0 2024-09-13T02:53:48.492 INFO:tasks.workunit.client.0.smithi089.stdout:7/37: chown d3/c9 367781 1 2024-09-13T02:53:48.493 INFO:tasks.workunit.client.0.smithi089.stdout:6/37: symlink db/ld 0 2024-09-13T02:53:48.494 INFO:tasks.workunit.client.0.smithi089.stdout:6/38: dread - f3 zero size 2024-09-13T02:53:48.494 INFO:tasks.workunit.client.0.smithi089.stdout:6/39: fdatasync f3 0 2024-09-13T02:53:48.494 INFO:tasks.workunit.client.0.smithi089.stdout:5/27: dwrite d1/fa [4194304,4194304] 0 2024-09-13T02:53:48.495 INFO:tasks.workunit.client.0.smithi089.stdout:2/35: rmdir de 0 2024-09-13T02:53:48.495 INFO:tasks.workunit.client.0.smithi089.stdout:2/36: write fd [984929,64903] 0 2024-09-13T02:53:48.497 INFO:tasks.workunit.client.0.smithi089.stdout:4/40: rename d2/d3/d5/c7 to d2/da/cc 0 2024-09-13T02:53:48.497 INFO:tasks.workunit.client.0.smithi089.stdout:5/28: write d1/d7/f9 [1511681,55219] 0 2024-09-13T02:53:48.498 INFO:tasks.workunit.client.0.smithi089.stdout:6/40: mkdir db/de 0 2024-09-13T02:53:48.499 INFO:tasks.workunit.client.0.smithi089.stdout:2/37: symlink lf 0 2024-09-13T02:53:48.502 INFO:tasks.workunit.client.0.smithi089.stdout:5/29: creat d1/d4/fc x:0 0 0 2024-09-13T02:53:48.504 INFO:tasks.workunit.client.0.smithi089.stdout:6/41: rmdir db/de 0 2024-09-13T02:53:48.505 INFO:tasks.workunit.client.0.smithi089.stdout:2/38: rename l4 to l10 0 2024-09-13T02:53:48.505 INFO:tasks.workunit.client.0.smithi089.stdout:2/39: truncate f1 1760792 0 2024-09-13T02:53:48.505 INFO:tasks.workunit.client.0.smithi089.stdout:2/40: fdatasync f5 0 2024-09-13T02:53:48.507 INFO:tasks.workunit.client.0.smithi089.stdout:7/38: rename d3/c8 to d3/de/cf 0 2024-09-13T02:53:48.511 INFO:tasks.workunit.client.0.smithi089.stdout:7/39: mknod d3/c10 0 2024-09-13T02:53:48.513 INFO:tasks.workunit.client.0.smithi089.stdout:7/40: creat d3/f11 x:0 0 0 2024-09-13T02:53:48.515 INFO:tasks.workunit.client.0.smithi089.stdout:4/41: dread d2/f4 [0,4194304] 0 2024-09-13T02:53:48.515 INFO:tasks.workunit.client.0.smithi089.stdout:4/42: chown d2/f4 29874 1 2024-09-13T02:53:48.515 INFO:tasks.workunit.client.0.smithi089.stdout:7/41: creat d3/de/f12 x:0 0 0 2024-09-13T02:53:48.515 INFO:tasks.workunit.client.0.smithi089.stdout:7/42: chown d3/ld 133246 1 2024-09-13T02:53:48.536 INFO:tasks.workunit.client.0.smithi089.stdout:6/42: dwrite f0 [0,4194304] 0 2024-09-13T02:53:48.536 INFO:tasks.workunit.client.0.smithi089.stdout:4/43: dwrite d2/f4 [4194304,4194304] 0 2024-09-13T02:53:48.536 INFO:tasks.workunit.client.0.smithi089.stdout:4/44: chown d2/d3 32693450 1 2024-09-13T02:53:48.536 INFO:tasks.workunit.client.0.smithi089.stdout:4/45: stat d2/d3/d5/c9 0 2024-09-13T02:53:48.541 INFO:tasks.workunit.client.0.smithi089.stdout:4/46: dread d2/f4 [0,4194304] 0 2024-09-13T02:53:48.602 INFO:tasks.workunit.client.0.smithi089.stdout:9/26: dwrite d3/f4 [0,4194304] 0 2024-09-13T02:53:48.603 INFO:tasks.workunit.client.0.smithi089.stdout:9/27: fdatasync d3/f4 0 2024-09-13T02:53:48.611 INFO:tasks.workunit.client.0.smithi089.stdout:9/28: dread f2 [0,4194304] 0 2024-09-13T02:53:48.612 INFO:tasks.workunit.client.0.smithi089.stdout:6/43: truncate f9 537862 0 2024-09-13T02:53:48.613 INFO:tasks.workunit.client.0.smithi089.stdout:7/43: dwrite d3/f11 [0,4194304] 0 2024-09-13T02:53:48.613 INFO:tasks.workunit.client.0.smithi089.stdout:7/44: creat d3/de/f13 x:0 0 0 2024-09-13T02:53:48.613 INFO:tasks.workunit.client.0.smithi089.stdout:6/44: mkdir db/df 0 2024-09-13T02:53:48.617 INFO:tasks.workunit.client.0.smithi089.stdout:5/30: rmdir d1/d4 39 2024-09-13T02:53:48.617 INFO:tasks.workunit.client.0.smithi089.stdout:9/29: dread d3/f4 [0,4194304] 0 2024-09-13T02:53:48.618 INFO:tasks.workunit.client.0.smithi089.stdout:5/31: creat d1/fd x:0 0 0 2024-09-13T02:53:48.618 INFO:tasks.workunit.client.0.smithi089.stdout:5/32: write d1/d4/f5 [681895,103942] 0 2024-09-13T02:53:48.619 INFO:tasks.workunit.client.0.smithi089.stdout:5/33: write d1/d4/f5 [389349,14713] 0 2024-09-13T02:53:48.620 INFO:tasks.workunit.client.0.smithi089.stdout:2/41: getdents . 0 2024-09-13T02:53:48.620 INFO:tasks.workunit.client.0.smithi089.stdout:2/42: write f3 [3889522,21871] 0 2024-09-13T02:53:48.622 INFO:tasks.workunit.client.0.smithi089.stdout:9/30: write d3/f4 [2432961,77957] 0 2024-09-13T02:53:48.625 INFO:tasks.workunit.client.0.smithi089.stdout:9/31: symlink d3/lb 0 2024-09-13T02:53:48.625 INFO:tasks.workunit.client.0.smithi089.stdout:9/32: chown d3/ca 0 1 2024-09-13T02:53:48.626 INFO:tasks.workunit.client.0.smithi089.stdout:9/33: chown d3/lb 7365254 1 2024-09-13T02:53:48.626 INFO:tasks.workunit.client.0.smithi089.stdout:9/34: write d3/f5 [24018,36633] 0 2024-09-13T02:53:48.626 INFO:tasks.workunit.client.0.smithi089.stdout:9/35: symlink d3/lc 0 2024-09-13T02:53:48.627 INFO:tasks.workunit.client.0.smithi089.stdout:7/45: dwrite d3/f11 [0,4194304] 0 2024-09-13T02:53:48.627 INFO:tasks.workunit.client.0.smithi089.stdout:2/43: fdatasync f3 0 2024-09-13T02:53:48.628 INFO:tasks.workunit.client.0.smithi089.stdout:9/36: creat d3/fd x:0 0 0 2024-09-13T02:53:48.630 INFO:tasks.workunit.client.0.smithi089.stdout:2/44: creat f11 x:0 0 0 2024-09-13T02:53:48.630 INFO:tasks.workunit.client.0.smithi089.stdout:9/37: fdatasync d3/f5 0 2024-09-13T02:53:48.630 INFO:tasks.workunit.client.0.smithi089.stdout:9/38: fsync d3/f5 0 2024-09-13T02:53:48.631 INFO:tasks.workunit.client.0.smithi089.stdout:7/46: rmdir d3 39 2024-09-13T02:53:48.632 INFO:tasks.workunit.client.0.smithi089.stdout:2/45: link f1 f12 0 2024-09-13T02:53:48.633 INFO:tasks.workunit.client.0.smithi089.stdout:2/46: fsync fd 0 2024-09-13T02:53:48.635 INFO:tasks.workunit.client.0.smithi089.stdout:9/39: creat d3/d6/fe x:0 0 0 2024-09-13T02:53:48.636 INFO:tasks.workunit.client.0.smithi089.stdout:9/40: stat d3/l8 0 2024-09-13T02:53:48.637 INFO:tasks.workunit.client.0.smithi089.stdout:9/41: mkdir d3/d6/df 0 2024-09-13T02:53:48.639 INFO:tasks.workunit.client.0.smithi089.stdout:9/42: rename d3/l8 to d3/d6/df/l10 0 2024-09-13T02:53:48.639 INFO:tasks.workunit.client.0.smithi089.stdout:9/43: stat f2 0 2024-09-13T02:53:48.640 INFO:tasks.workunit.client.0.smithi089.stdout:9/44: symlink d3/l11 0 2024-09-13T02:53:48.641 INFO:tasks.workunit.client.0.smithi089.stdout:9/45: readlink d3/l11 0 2024-09-13T02:53:48.642 INFO:tasks.workunit.client.0.smithi089.stdout:9/46: creat d3/d6/df/f12 x:0 0 0 2024-09-13T02:53:48.644 INFO:tasks.workunit.client.0.smithi089.stdout:9/47: mknod d3/d6/df/c13 0 2024-09-13T02:53:48.656 INFO:tasks.workunit.client.0.smithi089.stdout:9/48: fsync f2 0 2024-09-13T02:53:48.656 INFO:tasks.workunit.client.0.smithi089.stdout:9/49: chown d3/ca 175180 1 2024-09-13T02:53:48.656 INFO:tasks.workunit.client.0.smithi089.stdout:9/50: chown d3/d6/df/f12 3 1 2024-09-13T02:53:48.656 INFO:tasks.workunit.client.0.smithi089.stdout:9/51: truncate d3/f5 212539 0 2024-09-13T02:53:48.656 INFO:tasks.workunit.client.0.smithi089.stdout:2/47: dwrite fc [0,4194304] 0 2024-09-13T02:53:48.656 INFO:tasks.workunit.client.0.smithi089.stdout:2/48: chown fc 206182 1 2024-09-13T02:53:48.657 INFO:tasks.workunit.client.0.smithi089.stdout:2/49: chown f11 25038167 1 2024-09-13T02:53:48.657 INFO:tasks.workunit.client.0.smithi089.stdout:7/47: dwrite d3/de/f13 [0,4194304] 0 2024-09-13T02:53:48.658 INFO:tasks.workunit.client.0.smithi089.stdout:2/50: unlink fa 0 2024-09-13T02:53:48.662 INFO:tasks.workunit.client.0.smithi089.stdout:7/48: mkdir d3/de/d14 0 2024-09-13T02:53:48.662 INFO:tasks.workunit.client.0.smithi089.stdout:7/49: truncate d3/f11 4513987 0 2024-09-13T02:53:48.673 INFO:tasks.workunit.client.0.smithi089.stdout:7/50: dread f0 [0,4194304] 0 2024-09-13T02:53:48.674 INFO:tasks.workunit.client.0.smithi089.stdout:7/51: creat d3/f15 x:0 0 0 2024-09-13T02:53:48.681 INFO:tasks.workunit.client.0.smithi089.stdout:7/52: rmdir d3 39 2024-09-13T02:53:48.682 INFO:tasks.workunit.client.0.smithi089.stdout:2/51: dwrite fd [0,4194304] 0 2024-09-13T02:53:48.682 INFO:tasks.workunit.client.0.smithi089.stdout:7/53: mknod d3/c16 0 2024-09-13T02:53:48.684 INFO:tasks.workunit.client.0.smithi089.stdout:2/52: mkdir d13 0 2024-09-13T02:53:48.685 INFO:tasks.workunit.client.0.smithi089.stdout:2/53: symlink d13/l14 0 2024-09-13T02:53:48.686 INFO:tasks.workunit.client.0.smithi089.stdout:2/54: fsync fc 0 2024-09-13T02:53:48.686 INFO:tasks.workunit.client.0.smithi089.stdout:2/55: dread - f11 zero size 2024-09-13T02:53:48.686 INFO:tasks.workunit.client.0.smithi089.stdout:2/56: rmdir d13 39 2024-09-13T02:53:48.686 INFO:tasks.workunit.client.0.smithi089.stdout:2/57: fsync fd 0 2024-09-13T02:53:48.686 INFO:tasks.workunit.client.0.smithi089.stdout:2/58: fsync f1 0 2024-09-13T02:53:48.689 INFO:tasks.workunit.client.0.smithi089.stdout:2/59: dread f3 [0,4194304] 0 2024-09-13T02:53:48.690 INFO:tasks.workunit.client.0.smithi089.stdout:2/60: symlink d13/l15 0 2024-09-13T02:53:48.691 INFO:tasks.workunit.client.0.smithi089.stdout:2/61: rename l10 to d13/l16 0 2024-09-13T02:53:48.692 INFO:tasks.workunit.client.0.smithi089.stdout:2/62: stat l6 0 2024-09-13T02:53:48.692 INFO:tasks.workunit.client.0.smithi089.stdout:7/54: write d3/de/f13 [4067167,43635] 0 2024-09-13T02:53:48.692 INFO:tasks.workunit.client.0.smithi089.stdout:2/63: creat d13/f17 x:0 0 0 2024-09-13T02:53:48.693 INFO:tasks.workunit.client.0.smithi089.stdout:7/55: write d3/fa [897336,66512] 0 2024-09-13T02:53:48.694 INFO:tasks.workunit.client.0.smithi089.stdout:2/64: rename fb to d13/f18 0 2024-09-13T02:53:48.694 INFO:tasks.workunit.client.0.smithi089.stdout:2/65: creat d13/f19 x:0 0 0 2024-09-13T02:53:48.694 INFO:tasks.workunit.client.0.smithi089.stdout:2/66: creat d13/f1a x:0 0 0 2024-09-13T02:53:48.694 INFO:tasks.workunit.client.0.smithi089.stdout:7/56: creat d3/f17 x:0 0 0 2024-09-13T02:53:48.694 INFO:tasks.workunit.client.0.smithi089.stdout:7/57: fdatasync f0 0 2024-09-13T02:53:48.695 INFO:tasks.workunit.client.0.smithi089.stdout:7/58: truncate d3/f11 5024065 0 2024-09-13T02:53:48.700 INFO:tasks.workunit.client.0.smithi089.stdout:2/67: getdents d13 0 2024-09-13T02:53:48.702 INFO:tasks.workunit.client.0.smithi089.stdout:2/68: rename f11 to d13/f1b 0 2024-09-13T02:53:48.702 INFO:tasks.workunit.client.0.smithi089.stdout:2/69: truncate fc 3044860 0 2024-09-13T02:53:48.702 INFO:tasks.workunit.client.0.smithi089.stdout:2/70: readlink d13/l14 0 2024-09-13T02:53:48.706 INFO:tasks.workunit.client.0.smithi089.stdout:2/71: dread f3 [0,4194304] 0 2024-09-13T02:53:48.708 INFO:tasks.workunit.client.0.smithi089.stdout:2/72: rename d13/f19 to d13/f1c 0 2024-09-13T02:53:48.725 INFO:tasks.workunit.client.0.smithi089.stdout:2/73: dwrite fc [0,4194304] 0 2024-09-13T02:53:48.734 INFO:tasks.workunit.client.0.smithi089.stdout:2/74: write fd [2539615,112132] 0 2024-09-13T02:53:48.753 INFO:tasks.workunit.client.0.smithi089.stdout:2/75: dwrite fd [0,4194304] 0 2024-09-13T02:53:48.755 INFO:tasks.workunit.client.0.smithi089.stdout:2/76: mkdir d13/d1d 0 2024-09-13T02:53:48.756 INFO:tasks.workunit.client.0.smithi089.stdout:2/77: mknod d13/d1d/c1e 0 2024-09-13T02:53:48.758 INFO:tasks.workunit.client.0.smithi089.stdout:2/78: getdents d13/d1d 0 2024-09-13T02:53:48.760 INFO:tasks.workunit.client.0.smithi089.stdout:2/79: mknod d13/d1d/c1f 0 2024-09-13T02:53:48.768 INFO:tasks.workunit.client.0.smithi089.stdout:2/80: dread fd [0,4194304] 0 2024-09-13T02:53:48.770 INFO:tasks.workunit.client.0.smithi089.stdout:2/81: rename d13/d1d/c1e to d13/c20 0 2024-09-13T02:53:48.770 INFO:tasks.workunit.client.0.smithi089.stdout:2/82: chown c7 78199 1 2024-09-13T02:53:48.771 INFO:tasks.workunit.client.0.smithi089.stdout:2/83: chown d13/f17 1489368 1 2024-09-13T02:53:48.772 INFO:tasks.workunit.client.0.smithi089.stdout:2/84: link d13/l14 d13/d1d/l21 0 2024-09-13T02:53:48.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:53:48 smithi131 ceph-mon[34689]: pgmap v236: 65 pgs: 65 active+clean; 242 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 7.8 MiB/s rd, 15 MiB/s wr, 1.06k op/s 2024-09-13T02:53:49.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:53:48 smithi089 ceph-mon[27639]: pgmap v236: 65 pgs: 65 active+clean; 242 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 7.8 MiB/s rd, 15 MiB/s wr, 1.06k op/s 2024-09-13T02:53:50.686 INFO:tasks.workunit.client.1.smithi131.stdout:2/3: sync 2024-09-13T02:53:50.687 INFO:tasks.workunit.client.1.smithi131.stdout:2/4: mknod c0 0 2024-09-13T02:53:50.688 INFO:tasks.workunit.client.1.smithi131.stdout:2/5: symlink l1 0 2024-09-13T02:53:50.688 INFO:tasks.workunit.client.1.smithi131.stdout:2/6: stat l1 0 2024-09-13T02:53:50.688 INFO:tasks.workunit.client.1.smithi131.stdout:2/7: read - no filename 2024-09-13T02:53:50.688 INFO:tasks.workunit.client.1.smithi131.stdout:2/8: rmdir - no directory 2024-09-13T02:53:50.688 INFO:tasks.workunit.client.1.smithi131.stdout:2/9: rename c0 to c2 0 2024-09-13T02:53:50.689 INFO:tasks.workunit.client.1.smithi131.stdout:2/10: write - no filename 2024-09-13T02:53:50.689 INFO:tasks.workunit.client.1.smithi131.stdout:2/11: creat f3 x:0 0 0 2024-09-13T02:53:50.689 INFO:tasks.workunit.client.1.smithi131.stdout:2/12: creat f4 x:0 0 0 2024-09-13T02:53:50.721 INFO:tasks.workunit.client.1.smithi131.stdout:6/34: sync 2024-09-13T02:53:50.721 INFO:tasks.workunit.client.1.smithi131.stdout:4/13: sync 2024-09-13T02:53:50.721 INFO:tasks.workunit.client.1.smithi131.stdout:8/122: sync 2024-09-13T02:53:50.721 INFO:tasks.workunit.client.1.smithi131.stdout:6/35: fdatasync d1/f4 0 2024-09-13T02:53:50.721 INFO:tasks.workunit.client.1.smithi131.stdout:9/32: sync 2024-09-13T02:53:50.721 INFO:tasks.workunit.client.1.smithi131.stdout:5/50: sync 2024-09-13T02:53:50.721 INFO:tasks.workunit.client.1.smithi131.stdout:3/10: sync 2024-09-13T02:53:50.721 INFO:tasks.workunit.client.1.smithi131.stdout:0/63: sync 2024-09-13T02:53:50.722 INFO:tasks.workunit.client.1.smithi131.stdout:5/51: read - d1/fc zero size 2024-09-13T02:53:50.722 INFO:tasks.workunit.client.1.smithi131.stdout:3/11: readlink l0 0 2024-09-13T02:53:50.722 INFO:tasks.workunit.client.1.smithi131.stdout:3/12: rmdir - no directory 2024-09-13T02:53:50.722 INFO:tasks.workunit.client.1.smithi131.stdout:3/13: dwrite - no filename 2024-09-13T02:53:50.722 INFO:tasks.workunit.client.1.smithi131.stdout:3/14: rmdir - no directory 2024-09-13T02:53:50.722 INFO:tasks.workunit.client.1.smithi131.stdout:7/5: sync 2024-09-13T02:53:50.722 INFO:tasks.workunit.client.1.smithi131.stdout:1/70: sync 2024-09-13T02:53:50.722 INFO:tasks.workunit.client.1.smithi131.stdout:7/6: stat f0 0 2024-09-13T02:53:50.723 INFO:tasks.workunit.client.1.smithi131.stdout:9/33: rmdir d0 39 2024-09-13T02:53:50.723 INFO:tasks.workunit.client.1.smithi131.stdout:8/123: creat db/d1d/f28 x:0 0 0 2024-09-13T02:53:50.724 INFO:tasks.workunit.client.1.smithi131.stdout:0/64: rename d0/f11 to d0/f16 0 2024-09-13T02:53:50.724 INFO:tasks.workunit.client.1.smithi131.stdout:0/65: creat d0/d2/f17 x:0 0 0 2024-09-13T02:53:50.725 INFO:tasks.workunit.client.1.smithi131.stdout:5/52: mknod d1/c14 0 2024-09-13T02:53:50.725 INFO:tasks.workunit.client.1.smithi131.stdout:3/15: mknod c1 0 2024-09-13T02:53:50.725 INFO:tasks.workunit.client.1.smithi131.stdout:3/16: dwrite - no filename 2024-09-13T02:53:50.726 INFO:tasks.workunit.client.1.smithi131.stdout:7/7: mknod c2 0 2024-09-13T02:53:50.726 INFO:tasks.workunit.client.1.smithi131.stdout:7/8: creat f3 x:0 0 0 2024-09-13T02:53:50.726 INFO:tasks.workunit.client.1.smithi131.stdout:7/9: write f3 [532022,79138] 0 2024-09-13T02:53:50.726 INFO:tasks.workunit.client.1.smithi131.stdout:7/10: truncate f1 463709 0 2024-09-13T02:53:50.727 INFO:tasks.workunit.client.1.smithi131.stdout:6/36: rmdir d1 39 2024-09-13T02:53:50.727 INFO:tasks.workunit.client.1.smithi131.stdout:6/37: readlink d1/l5 0 2024-09-13T02:53:50.727 INFO:tasks.workunit.client.1.smithi131.stdout:6/38: chown d1/l5 198244213 1 2024-09-13T02:53:50.727 INFO:tasks.workunit.client.1.smithi131.stdout:9/34: unlink d0/f6 0 2024-09-13T02:53:50.727 INFO:tasks.workunit.client.1.smithi131.stdout:9/35: chown d0 36 1 2024-09-13T02:53:50.728 INFO:tasks.workunit.client.1.smithi131.stdout:8/124: symlink db/d1d/l29 0 2024-09-13T02:53:50.730 INFO:tasks.workunit.client.1.smithi131.stdout:7/11: dread f0 [0,4194304] 0 2024-09-13T02:53:50.730 INFO:tasks.workunit.client.1.smithi131.stdout:7/12: rmdir - no directory 2024-09-13T02:53:50.730 INFO:tasks.workunit.client.1.smithi131.stdout:5/53: mknod d1/d5/c15 0 2024-09-13T02:53:50.733 INFO:tasks.workunit.client.1.smithi131.stdout:3/17: mkdir d2 0 2024-09-13T02:53:50.734 INFO:tasks.workunit.client.1.smithi131.stdout:6/39: mkdir d1/d8 0 2024-09-13T02:53:50.736 INFO:tasks.workunit.client.1.smithi131.stdout:7/13: rename f0 to f4 0 2024-09-13T02:53:50.738 INFO:tasks.workunit.client.1.smithi131.stdout:5/54: link d1/fc d1/d5/f16 0 2024-09-13T02:53:50.738 INFO:tasks.workunit.client.1.smithi131.stdout:1/71: dwrite f8 [0,4194304] 0 2024-09-13T02:53:50.739 INFO:tasks.workunit.client.1.smithi131.stdout:8/125: dread f8 [0,4194304] 0 2024-09-13T02:53:50.740 INFO:tasks.workunit.client.1.smithi131.stdout:3/18: link c1 d2/c3 0 2024-09-13T02:53:50.740 INFO:tasks.workunit.client.1.smithi131.stdout:3/19: dread - no filename 2024-09-13T02:53:50.741 INFO:tasks.workunit.client.1.smithi131.stdout:7/14: mkdir d5 0 2024-09-13T02:53:50.742 INFO:tasks.workunit.client.1.smithi131.stdout:9/36: getdents d0 0 2024-09-13T02:53:50.742 INFO:tasks.workunit.client.1.smithi131.stdout:7/15: write f3 [104845,20564] 0 2024-09-13T02:53:50.743 INFO:tasks.workunit.client.1.smithi131.stdout:5/55: symlink d1/d5/l17 0 2024-09-13T02:53:50.743 INFO:tasks.workunit.client.1.smithi131.stdout:5/56: dread - d1/fc zero size 2024-09-13T02:53:50.745 INFO:tasks.workunit.client.1.smithi131.stdout:4/14: dwrite f0 [0,4194304] 0 2024-09-13T02:53:50.745 INFO:tasks.workunit.client.1.smithi131.stdout:1/72: dread - dd/f15 zero size 2024-09-13T02:53:50.745 INFO:tasks.workunit.client.1.smithi131.stdout:0/66: write d0/d2/fa [900624,67318] 0 2024-09-13T02:53:50.747 INFO:tasks.workunit.client.1.smithi131.stdout:8/126: rename db/d1d/f27 to db/f2a 0 2024-09-13T02:53:50.747 INFO:tasks.workunit.client.1.smithi131.stdout:8/127: fdatasync db/f17 0 2024-09-13T02:53:50.747 INFO:tasks.workunit.client.1.smithi131.stdout:9/37: rename d0/d3 to d0/d3/d7 22 2024-09-13T02:53:50.747 INFO:tasks.workunit.client.1.smithi131.stdout:9/38: truncate - no filename 2024-09-13T02:53:50.748 INFO:tasks.workunit.client.1.smithi131.stdout:3/20: mkdir d2/d4 0 2024-09-13T02:53:50.750 INFO:tasks.workunit.client.1.smithi131.stdout:7/16: rmdir d5 0 2024-09-13T02:53:50.750 INFO:tasks.workunit.client.1.smithi131.stdout:7/17: readlink - no filename 2024-09-13T02:53:50.751 INFO:tasks.workunit.client.1.smithi131.stdout:7/18: chown f1 10576952 1 2024-09-13T02:53:50.751 INFO:tasks.workunit.client.1.smithi131.stdout:5/57: link d1/c4 d1/c18 0 2024-09-13T02:53:50.751 INFO:tasks.workunit.client.1.smithi131.stdout:5/58: fdatasync d1/d5/fa 0 2024-09-13T02:53:50.753 INFO:tasks.workunit.client.1.smithi131.stdout:1/73: chown dd/ff 619186 1 2024-09-13T02:53:50.753 INFO:tasks.workunit.client.1.smithi131.stdout:1/74: readlink lb 0 2024-09-13T02:53:50.754 INFO:tasks.workunit.client.1.smithi131.stdout:0/67: creat d0/f18 x:0 0 0 2024-09-13T02:53:50.755 INFO:tasks.workunit.client.1.smithi131.stdout:8/128: getdents db/d1d/d1f 0 2024-09-13T02:53:50.755 INFO:tasks.workunit.client.1.smithi131.stdout:8/129: dread - db/d1d/f25 zero size 2024-09-13T02:53:50.756 INFO:tasks.workunit.client.1.smithi131.stdout:9/39: rmdir d0 39 2024-09-13T02:53:50.756 INFO:tasks.workunit.client.1.smithi131.stdout:9/40: dwrite - no filename 2024-09-13T02:53:50.756 INFO:tasks.workunit.client.1.smithi131.stdout:9/41: dwrite - no filename 2024-09-13T02:53:50.756 INFO:tasks.workunit.client.1.smithi131.stdout:9/42: truncate - no filename 2024-09-13T02:53:50.756 INFO:tasks.workunit.client.1.smithi131.stdout:9/43: fdatasync - no filename 2024-09-13T02:53:50.756 INFO:tasks.workunit.client.1.smithi131.stdout:9/44: unlink - no file 2024-09-13T02:53:50.756 INFO:tasks.workunit.client.1.smithi131.stdout:9/45: readlink - no filename 2024-09-13T02:53:50.756 INFO:tasks.workunit.client.1.smithi131.stdout:4/15: dread d1/f3 [0,4194304] 0 2024-09-13T02:53:50.757 INFO:tasks.workunit.client.1.smithi131.stdout:7/19: symlink l6 0 2024-09-13T02:53:50.757 INFO:tasks.workunit.client.1.smithi131.stdout:7/20: creat f7 x:0 0 0 2024-09-13T02:53:50.758 INFO:tasks.workunit.client.1.smithi131.stdout:5/59: link d1/d5/l11 d1/l19 0 2024-09-13T02:53:50.759 INFO:tasks.workunit.client.1.smithi131.stdout:1/75: getdents dd 0 2024-09-13T02:53:50.760 INFO:tasks.workunit.client.1.smithi131.stdout:0/68: link d0/d2/c9 d0/de/c19 0 2024-09-13T02:53:50.760 INFO:tasks.workunit.client.1.smithi131.stdout:9/46: creat d0/f8 x:0 0 0 2024-09-13T02:53:50.760 INFO:tasks.workunit.client.1.smithi131.stdout:9/47: stat d0/f8 0 2024-09-13T02:53:50.760 INFO:tasks.workunit.client.1.smithi131.stdout:9/48: dread - d0/f8 zero size 2024-09-13T02:53:50.761 INFO:tasks.workunit.client.1.smithi131.stdout:4/16: symlink d1/l4 0 2024-09-13T02:53:50.763 INFO:tasks.workunit.client.1.smithi131.stdout:8/130: read db/fd [3089813,32938] 0 2024-09-13T02:53:50.763 INFO:tasks.workunit.client.1.smithi131.stdout:7/21: symlink l8 0 2024-09-13T02:53:50.763 INFO:tasks.workunit.client.1.smithi131.stdout:7/22: truncate f4 435267 0 2024-09-13T02:53:50.763 INFO:tasks.workunit.client.1.smithi131.stdout:8/131: write db/f15 [939884,3295] 0 2024-09-13T02:53:50.763 INFO:tasks.workunit.client.1.smithi131.stdout:5/60: rename d1/c14 to d1/d5/c1a 0 2024-09-13T02:53:50.763 INFO:tasks.workunit.client.1.smithi131.stdout:1/76: symlink dd/l17 0 2024-09-13T02:53:50.764 INFO:tasks.workunit.client.1.smithi131.stdout:4/17: rename d1/f3 to d1/f5 0 2024-09-13T02:53:50.765 INFO:tasks.workunit.client.1.smithi131.stdout:7/23: mknod c9 0 2024-09-13T02:53:50.765 INFO:tasks.workunit.client.1.smithi131.stdout:7/24: chown l8 2998 1 2024-09-13T02:53:50.765 INFO:tasks.workunit.client.1.smithi131.stdout:8/132: mkdir db/d2b 0 2024-09-13T02:53:50.767 INFO:tasks.workunit.client.1.smithi131.stdout:5/61: creat d1/f1b x:0 0 0 2024-09-13T02:53:50.767 INFO:tasks.workunit.client.1.smithi131.stdout:5/62: write d1/d5/f9 [1661367,4090] 0 2024-09-13T02:53:50.767 INFO:tasks.workunit.client.1.smithi131.stdout:1/77: creat dd/f18 x:0 0 0 2024-09-13T02:53:50.770 INFO:tasks.workunit.client.1.smithi131.stdout:5/63: mkdir d1/d1c 0 2024-09-13T02:53:50.770 INFO:tasks.workunit.client.1.smithi131.stdout:4/18: dread f0 [0,4194304] 0 2024-09-13T02:53:50.770 INFO:tasks.workunit.client.1.smithi131.stdout:9/49: rmdir d0 39 2024-09-13T02:53:50.771 INFO:tasks.workunit.client.1.smithi131.stdout:8/133: rmdir db/d1d 39 2024-09-13T02:53:50.772 INFO:tasks.workunit.client.1.smithi131.stdout:5/64: creat d1/d1c/f1d x:0 0 0 2024-09-13T02:53:50.773 INFO:tasks.workunit.client.1.smithi131.stdout:9/50: rename d0/f8 to d0/f9 0 2024-09-13T02:53:50.775 INFO:tasks.workunit.client.1.smithi131.stdout:1/78: write fc [2013865,49552] 0 2024-09-13T02:53:50.775 INFO:tasks.workunit.client.1.smithi131.stdout:8/134: creat db/d1d/d1f/f2c x:0 0 0 2024-09-13T02:53:50.775 INFO:tasks.workunit.client.1.smithi131.stdout:4/19: write d1/f5 [3832978,107460] 0 2024-09-13T02:53:50.776 INFO:tasks.workunit.client.1.smithi131.stdout:1/79: write dd/f13 [525060,92794] 0 2024-09-13T02:53:50.778 INFO:tasks.workunit.client.1.smithi131.stdout:4/20: fdatasync f0 0 2024-09-13T02:53:50.779 INFO:tasks.workunit.client.1.smithi131.stdout:1/80: mknod dd/c19 0 2024-09-13T02:53:50.780 INFO:tasks.workunit.client.1.smithi131.stdout:4/21: unlink f0 0 2024-09-13T02:53:50.783 INFO:tasks.workunit.client.1.smithi131.stdout:8/135: read db/f19 [3145795,116158] 0 2024-09-13T02:53:50.783 INFO:tasks.workunit.client.1.smithi131.stdout:8/136: stat db/d1d/f25 0 2024-09-13T02:53:50.783 INFO:tasks.workunit.client.1.smithi131.stdout:1/81: dread - dd/f16 zero size 2024-09-13T02:53:50.783 INFO:tasks.workunit.client.1.smithi131.stdout:8/137: write db/f2a [280705,13703] 0 2024-09-13T02:53:50.783 INFO:tasks.workunit.client.1.smithi131.stdout:4/22: write d1/f5 [4273659,111883] 0 2024-09-13T02:53:50.783 INFO:tasks.workunit.client.1.smithi131.stdout:8/138: creat db/d1d/d1f/f2d x:0 0 0 2024-09-13T02:53:50.783 INFO:tasks.workunit.client.1.smithi131.stdout:8/139: dread - db/d1d/f25 zero size 2024-09-13T02:53:50.785 INFO:tasks.workunit.client.1.smithi131.stdout:8/140: mkdir db/d2e 0 2024-09-13T02:53:50.785 INFO:tasks.workunit.client.1.smithi131.stdout:1/82: mkdir dd/d1a 0 2024-09-13T02:53:50.788 INFO:tasks.workunit.client.1.smithi131.stdout:1/83: unlink dd/f18 0 2024-09-13T02:53:50.789 INFO:tasks.workunit.client.1.smithi131.stdout:1/84: creat dd/d1a/f1b x:0 0 0 2024-09-13T02:53:50.790 INFO:tasks.workunit.client.1.smithi131.stdout:1/85: chown dd/d1a 400645 1 2024-09-13T02:53:50.790 INFO:tasks.workunit.client.1.smithi131.stdout:1/86: fsync dd/f13 0 2024-09-13T02:53:50.790 INFO:tasks.workunit.client.1.smithi131.stdout:1/87: rename dd to dd/d1a/d1c 22 2024-09-13T02:53:50.791 INFO:tasks.workunit.client.1.smithi131.stdout:1/88: symlink dd/d1a/l1d 0 2024-09-13T02:53:50.802 INFO:tasks.workunit.client.1.smithi131.stdout:8/141: dwrite db/f15 [0,4194304] 0 2024-09-13T02:53:50.802 INFO:tasks.workunit.client.1.smithi131.stdout:1/89: rmdir dd 39 2024-09-13T02:53:50.803 INFO:tasks.workunit.client.1.smithi131.stdout:8/142: symlink db/d1d/l2f 0 2024-09-13T02:53:50.830 INFO:tasks.workunit.client.1.smithi131.stdout:8/143: dwrite db/f23 [0,4194304] 0 2024-09-13T02:53:50.830 INFO:tasks.workunit.client.1.smithi131.stdout:8/144: write db/f18 [443556,58245] 0 2024-09-13T02:53:50.830 INFO:tasks.workunit.client.1.smithi131.stdout:1/90: dwrite dd/f15 [0,4194304] 0 2024-09-13T02:53:50.832 INFO:tasks.workunit.client.1.smithi131.stdout:8/145: creat db/f30 x:0 0 0 2024-09-13T02:53:50.833 INFO:tasks.workunit.client.1.smithi131.stdout:8/146: truncate f6 2465840 0 2024-09-13T02:53:50.833 INFO:tasks.workunit.client.1.smithi131.stdout:8/147: read - db/d1d/f28 zero size 2024-09-13T02:53:50.833 INFO:tasks.workunit.client.1.smithi131.stdout:8/148: chown db 112508 1 2024-09-13T02:53:50.834 INFO:tasks.workunit.client.1.smithi131.stdout:2/13: sync 2024-09-13T02:53:50.834 INFO:tasks.workunit.client.1.smithi131.stdout:2/14: dread - f3 zero size 2024-09-13T02:53:50.835 INFO:tasks.workunit.client.1.smithi131.stdout:8/149: unlink db/l14 0 2024-09-13T02:53:50.835 INFO:tasks.workunit.client.1.smithi131.stdout:8/150: getdents db/d2b 0 2024-09-13T02:53:50.836 INFO:tasks.workunit.client.1.smithi131.stdout:8/151: write f2 [5106628,118885] 0 2024-09-13T02:53:50.836 INFO:tasks.workunit.client.1.smithi131.stdout:8/152: write db/d1d/d1f/f2d [352920,101467] 0 2024-09-13T02:53:50.854 INFO:tasks.workunit.client.1.smithi131.stdout:8/153: dwrite db/f30 [0,4194304] 0 2024-09-13T02:53:50.854 INFO:tasks.workunit.client.1.smithi131.stdout:8/154: chown db/d1d 1883027 1 2024-09-13T02:53:50.854 INFO:tasks.workunit.client.1.smithi131.stdout:2/15: dwrite f3 [0,4194304] 0 2024-09-13T02:53:50.854 INFO:tasks.workunit.client.1.smithi131.stdout:2/16: chown l1 14416994 1 2024-09-13T02:53:50.856 INFO:tasks.workunit.client.1.smithi131.stdout:8/155: mkdir db/d1d/d31 0 2024-09-13T02:53:50.857 INFO:tasks.workunit.client.1.smithi131.stdout:2/17: mkdir d5 0 2024-09-13T02:53:50.858 INFO:tasks.workunit.client.1.smithi131.stdout:2/18: symlink d5/l6 0 2024-09-13T02:53:50.858 INFO:tasks.workunit.client.1.smithi131.stdout:2/19: chown f4 0 1 2024-09-13T02:53:50.859 INFO:tasks.workunit.client.1.smithi131.stdout:2/20: rmdir d5 39 2024-09-13T02:53:50.860 INFO:tasks.workunit.client.1.smithi131.stdout:2/21: symlink d5/l7 0 2024-09-13T02:53:50.860 INFO:tasks.workunit.client.1.smithi131.stdout:2/22: readlink d5/l6 0 2024-09-13T02:53:50.860 INFO:tasks.workunit.client.1.smithi131.stdout:2/23: rename d5 to d5/d8 22 2024-09-13T02:53:50.861 INFO:tasks.workunit.client.1.smithi131.stdout:2/24: creat d5/f9 x:0 0 0 2024-09-13T02:53:50.863 INFO:tasks.workunit.client.1.smithi131.stdout:2/25: link d5/f9 d5/fa 0 2024-09-13T02:53:50.866 INFO:tasks.workunit.client.1.smithi131.stdout:8/156: write db/f23 [1087215,83702] 0 2024-09-13T02:53:50.867 INFO:tasks.workunit.client.1.smithi131.stdout:8/157: creat db/d2b/f32 x:0 0 0 2024-09-13T02:53:50.868 INFO:tasks.workunit.client.1.smithi131.stdout:8/158: mknod db/d1d/d31/c33 0 2024-09-13T02:53:50.868 INFO:tasks.workunit.client.1.smithi131.stdout:8/159: dread - db/d1d/f25 zero size 2024-09-13T02:53:50.870 INFO:tasks.workunit.client.1.smithi131.stdout:2/26: getdents d5 0 2024-09-13T02:53:50.878 INFO:tasks.workunit.client.1.smithi131.stdout:2/27: read f3 [4165664,125173] 0 2024-09-13T02:53:50.880 INFO:tasks.workunit.client.1.smithi131.stdout:2/28: unlink d5/l7 0 2024-09-13T02:53:50.880 INFO:tasks.workunit.client.1.smithi131.stdout:2/29: write f4 [796640,24194] 0 2024-09-13T02:53:50.884 INFO:tasks.workunit.client.1.smithi131.stdout:2/30: truncate f4 199709 0 2024-09-13T02:53:50.884 INFO:tasks.workunit.client.1.smithi131.stdout:2/31: mknod d5/cb 0 2024-09-13T02:53:50.898 INFO:tasks.workunit.client.1.smithi131.stdout:2/32: dwrite d5/f9 [0,4194304] 0 2024-09-13T02:53:50.904 INFO:tasks.workunit.client.1.smithi131.stdout:2/33: read d5/f9 [1047812,61186] 0 2024-09-13T02:53:50.919 INFO:tasks.workunit.client.1.smithi131.stdout:2/34: dwrite f3 [0,4194304] 0 2024-09-13T02:53:50.933 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:53:50 smithi131 ceph-mon[34689]: pgmap v237: 65 pgs: 65 active+clean; 364 MiB data, 2.9 GiB used, 534 GiB / 536 GiB avail; 20 MiB/s rd, 34 MiB/s wr, 1.31k op/s 2024-09-13T02:53:50.935 INFO:tasks.workunit.client.1.smithi131.stdout:2/35: dwrite f3 [4194304,4194304] 0 2024-09-13T02:53:50.948 INFO:tasks.workunit.client.1.smithi131.stdout:2/36: dwrite d5/fa [0,4194304] 0 2024-09-13T02:53:50.949 INFO:tasks.workunit.client.1.smithi131.stdout:2/37: creat d5/fc x:0 0 0 2024-09-13T02:53:50.950 INFO:tasks.workunit.client.1.smithi131.stdout:6/40: sync 2024-09-13T02:53:50.951 INFO:tasks.workunit.client.1.smithi131.stdout:6/41: mkdir d1/d8/d9 0 2024-09-13T02:53:50.951 INFO:tasks.workunit.client.1.smithi131.stdout:6/42: truncate d1/f4 758413 0 2024-09-13T02:53:50.952 INFO:tasks.workunit.client.1.smithi131.stdout:6/43: write d1/f7 [629422,108820] 0 2024-09-13T02:53:50.952 INFO:tasks.workunit.client.1.smithi131.stdout:6/44: stat d1/d8/d9 0 2024-09-13T02:53:50.953 INFO:tasks.workunit.client.1.smithi131.stdout:6/45: dread d1/f4 [0,4194304] 0 2024-09-13T02:53:50.953 INFO:tasks.workunit.client.1.smithi131.stdout:6/46: chown d1/d8 218 1 2024-09-13T02:53:50.959 INFO:tasks.workunit.client.1.smithi131.stdout:2/38: write d5/f9 [793642,123615] 0 2024-09-13T02:53:50.967 INFO:tasks.workunit.client.1.smithi131.stdout:2/39: fsync d5/f9 0 2024-09-13T02:53:50.967 INFO:tasks.workunit.client.1.smithi131.stdout:6/47: dwrite d1/f4 [0,4194304] 0 2024-09-13T02:53:50.969 INFO:tasks.workunit.client.1.smithi131.stdout:6/48: creat d1/d8/d9/fa x:0 0 0 2024-09-13T02:53:50.976 INFO:tasks.workunit.client.1.smithi131.stdout:6/49: dread d1/f4 [0,4194304] 0 2024-09-13T02:53:50.977 INFO:tasks.workunit.client.1.smithi131.stdout:6/50: truncate d1/f4 993846 0 2024-09-13T02:53:50.978 INFO:tasks.workunit.client.1.smithi131.stdout:6/51: mkdir d1/d8/d9/db 0 2024-09-13T02:53:50.978 INFO:tasks.workunit.client.1.smithi131.stdout:6/52: creat d1/d8/d9/fc x:0 0 0 2024-09-13T02:53:50.978 INFO:tasks.workunit.client.1.smithi131.stdout:6/53: fdatasync d1/d8/d9/fa 0 2024-09-13T02:53:50.995 INFO:tasks.workunit.client.1.smithi131.stdout:3/21: sync 2024-09-13T02:53:50.995 INFO:tasks.workunit.client.1.smithi131.stdout:3/22: truncate - no filename 2024-09-13T02:53:50.995 INFO:tasks.workunit.client.1.smithi131.stdout:6/54: dwrite d1/d8/d9/fa [0,4194304] 0 2024-09-13T02:53:50.996 INFO:tasks.workunit.client.1.smithi131.stdout:3/23: creat d2/f5 x:0 0 0 2024-09-13T02:53:50.997 INFO:tasks.workunit.client.1.smithi131.stdout:6/55: unlink d1/d8/d9/fa 0 2024-09-13T02:53:50.997 INFO:tasks.workunit.client.1.smithi131.stdout:6/56: creat d1/d8/d9/fd x:0 0 0 2024-09-13T02:53:50.998 INFO:tasks.workunit.client.1.smithi131.stdout:3/24: rename l0 to d2/l6 0 2024-09-13T02:53:50.999 INFO:tasks.workunit.client.1.smithi131.stdout:6/57: creat d1/fe x:0 0 0 2024-09-13T02:53:50.999 INFO:tasks.workunit.client.1.smithi131.stdout:6/58: read - d1/d8/d9/fd zero size 2024-09-13T02:53:51.000 INFO:tasks.workunit.client.1.smithi131.stdout:3/25: mkdir d2/d4/d7 0 2024-09-13T02:53:51.001 INFO:tasks.workunit.client.1.smithi131.stdout:6/59: rename d1/d8/d9/fc to d1/d8/d9/db/ff 0 2024-09-13T02:53:51.002 INFO:tasks.workunit.client.1.smithi131.stdout:6/60: read d1/f4 [419469,77004] 0 2024-09-13T02:53:51.004 INFO:tasks.workunit.client.1.smithi131.stdout:6/61: mknod d1/c10 0 2024-09-13T02:53:51.004 INFO:tasks.workunit.client.1.smithi131.stdout:6/62: chown d1/f7 1155 1 2024-09-13T02:53:51.004 INFO:tasks.workunit.client.1.smithi131.stdout:6/63: write d1/d8/d9/db/ff [485986,23406] 0 2024-09-13T02:53:51.004 INFO:tasks.workunit.client.1.smithi131.stdout:6/64: chown d1/fe 6745457 1 2024-09-13T02:53:51.004 INFO:tasks.workunit.client.1.smithi131.stdout:6/65: rename d1/d8 to d1/d8/d11 22 2024-09-13T02:53:51.004 INFO:tasks.workunit.client.1.smithi131.stdout:6/66: readlink d1/l5 0 2024-09-13T02:53:51.005 INFO:tasks.workunit.client.1.smithi131.stdout:6/67: symlink d1/l12 0 2024-09-13T02:53:51.009 INFO:tasks.workunit.client.1.smithi131.stdout:6/68: fsync d1/fe 0 2024-09-13T02:53:51.010 INFO:tasks.workunit.client.1.smithi131.stdout:6/69: mknod d1/d8/d9/c13 0 2024-09-13T02:53:51.011 INFO:tasks.workunit.client.1.smithi131.stdout:6/70: mkdir d1/d14 0 2024-09-13T02:53:51.011 INFO:tasks.workunit.client.1.smithi131.stdout:6/71: dread - d1/fe zero size 2024-09-13T02:53:51.012 INFO:tasks.workunit.client.1.smithi131.stdout:3/26: dwrite d2/f5 [0,4194304] 0 2024-09-13T02:53:51.012 INFO:tasks.workunit.client.1.smithi131.stdout:3/27: chown d2/l6 56206 1 2024-09-13T02:53:51.012 INFO:tasks.workunit.client.1.smithi131.stdout:6/72: mkdir d1/d8/d9/db/d15 0 2024-09-13T02:53:51.012 INFO:tasks.workunit.client.1.smithi131.stdout:6/73: dread - d1/fe zero size 2024-09-13T02:53:51.012 INFO:tasks.workunit.client.1.smithi131.stdout:6/74: truncate d1/fe 459927 0 2024-09-13T02:53:51.015 INFO:tasks.workunit.client.1.smithi131.stdout:6/75: dread d1/f7 [0,4194304] 0 2024-09-13T02:53:51.020 INFO:tasks.workunit.client.1.smithi131.stdout:3/28: dread d2/f5 [0,4194304] 0 2024-09-13T02:53:51.021 INFO:tasks.workunit.client.1.smithi131.stdout:3/29: mkdir d2/d4/d7/d8 0 2024-09-13T02:53:51.023 INFO:tasks.workunit.client.1.smithi131.stdout:3/30: creat d2/d4/f9 x:0 0 0 2024-09-13T02:53:51.023 INFO:tasks.workunit.client.1.smithi131.stdout:3/31: dread - d2/d4/f9 zero size 2024-09-13T02:53:51.024 INFO:tasks.workunit.client.1.smithi131.stdout:3/32: mkdir d2/da 0 2024-09-13T02:53:51.025 INFO:tasks.workunit.client.1.smithi131.stdout:3/33: rename c1 to d2/d4/cb 0 2024-09-13T02:53:51.030 INFO:tasks.workunit.client.1.smithi131.stdout:6/76: dwrite d1/f7 [0,4194304] 0 2024-09-13T02:53:51.032 INFO:tasks.workunit.client.1.smithi131.stdout:3/34: rmdir d2 39 2024-09-13T02:53:51.032 INFO:tasks.workunit.client.1.smithi131.stdout:3/35: getdents d2/d4/d7/d8 0 2024-09-13T02:53:51.034 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:53:50 smithi089 ceph-mon[27639]: pgmap v237: 65 pgs: 65 active+clean; 364 MiB data, 2.9 GiB used, 534 GiB / 536 GiB avail; 20 MiB/s rd, 34 MiB/s wr, 1.31k op/s 2024-09-13T02:53:51.035 INFO:tasks.workunit.client.1.smithi131.stdout:7/25: sync 2024-09-13T02:53:51.035 INFO:tasks.workunit.client.1.smithi131.stdout:5/65: sync 2024-09-13T02:53:51.035 INFO:tasks.workunit.client.1.smithi131.stdout:8/160: sync 2024-09-13T02:53:51.035 INFO:tasks.workunit.client.1.smithi131.stdout:0/69: sync 2024-09-13T02:53:51.035 INFO:tasks.workunit.client.1.smithi131.stdout:4/23: sync 2024-09-13T02:53:51.035 INFO:tasks.workunit.client.1.smithi131.stdout:1/91: sync 2024-09-13T02:53:51.035 INFO:tasks.workunit.client.1.smithi131.stdout:9/51: sync 2024-09-13T02:53:51.036 INFO:tasks.workunit.client.1.smithi131.stdout:0/70: chown d0/l4 4 1 2024-09-13T02:53:51.036 INFO:tasks.workunit.client.1.smithi131.stdout:4/24: chown d1/f5 24061128 1 2024-09-13T02:53:51.037 INFO:tasks.workunit.client.1.smithi131.stdout:1/92: creat dd/d1a/f1e x:0 0 0 2024-09-13T02:53:51.038 INFO:tasks.workunit.client.1.smithi131.stdout:9/52: symlink d0/la 0 2024-09-13T02:53:51.038 INFO:tasks.workunit.client.1.smithi131.stdout:9/53: readlink d0/la 0 2024-09-13T02:53:51.038 INFO:tasks.workunit.client.1.smithi131.stdout:8/161: mkdir db/d1d/d34 0 2024-09-13T02:53:51.040 INFO:tasks.workunit.client.1.smithi131.stdout:1/93: fdatasync dd/ff 0 2024-09-13T02:53:51.041 INFO:tasks.workunit.client.1.smithi131.stdout:4/25: truncate d1/f5 1743377 0 2024-09-13T02:53:51.041 INFO:tasks.workunit.client.1.smithi131.stdout:0/71: getdents d0 0 2024-09-13T02:53:51.041 INFO:tasks.workunit.client.1.smithi131.stdout:6/77: dread d1/f7 [0,4194304] 0 2024-09-13T02:53:51.041 INFO:tasks.workunit.client.1.smithi131.stdout:0/72: creat d0/de/f1a x:0 0 0 2024-09-13T02:53:51.041 INFO:tasks.workunit.client.1.smithi131.stdout:9/54: creat d0/fb x:0 0 0 2024-09-13T02:53:51.042 INFO:tasks.workunit.client.1.smithi131.stdout:8/162: mknod db/d1d/d34/c35 0 2024-09-13T02:53:51.044 INFO:tasks.workunit.client.1.smithi131.stdout:6/78: mkdir d1/d16 0 2024-09-13T02:53:51.044 INFO:tasks.workunit.client.1.smithi131.stdout:6/79: readlink d1/l12 0 2024-09-13T02:53:51.045 INFO:tasks.workunit.client.1.smithi131.stdout:9/55: mknod d0/cc 0 2024-09-13T02:53:51.045 INFO:tasks.workunit.client.1.smithi131.stdout:9/56: fdatasync d0/fb 0 2024-09-13T02:53:51.045 INFO:tasks.workunit.client.1.smithi131.stdout:9/57: write d0/fb [176814,3980] 0 2024-09-13T02:53:51.046 INFO:tasks.workunit.client.1.smithi131.stdout:9/58: write d0/fb [656042,30116] 0 2024-09-13T02:53:51.047 INFO:tasks.workunit.client.1.smithi131.stdout:8/163: unlink db/d2b/f32 0 2024-09-13T02:53:51.048 INFO:tasks.workunit.client.1.smithi131.stdout:8/164: rmdir db/d1d/d34 39 2024-09-13T02:53:51.050 INFO:tasks.workunit.client.1.smithi131.stdout:1/94: rename dd/c10 to dd/c1f 0 2024-09-13T02:53:51.052 INFO:tasks.workunit.client.1.smithi131.stdout:4/26: write d1/f5 [1841080,48750] 0 2024-09-13T02:53:51.052 INFO:tasks.workunit.client.1.smithi131.stdout:4/27: stat d1/f5 0 2024-09-13T02:53:51.053 INFO:tasks.workunit.client.1.smithi131.stdout:1/95: creat dd/f20 x:0 0 0 2024-09-13T02:53:51.053 INFO:tasks.workunit.client.1.smithi131.stdout:0/73: dread d0/d2/fb [0,4194304] 0 2024-09-13T02:53:51.053 INFO:tasks.workunit.client.1.smithi131.stdout:0/74: dread - d0/f16 zero size 2024-09-13T02:53:51.053 INFO:tasks.workunit.client.1.smithi131.stdout:4/28: creat d1/f6 x:0 0 0 2024-09-13T02:53:51.055 INFO:tasks.workunit.client.1.smithi131.stdout:0/75: mknod d0/d2/c1b 0 2024-09-13T02:53:51.055 INFO:tasks.workunit.client.1.smithi131.stdout:0/76: write d0/d2/fa [283591,85235] 0 2024-09-13T02:53:51.055 INFO:tasks.workunit.client.1.smithi131.stdout:0/77: chown d0/d2/c9 163042515 1 2024-09-13T02:53:51.055 INFO:tasks.workunit.client.1.smithi131.stdout:0/78: dread - d0/f16 zero size 2024-09-13T02:53:51.055 INFO:tasks.workunit.client.1.smithi131.stdout:4/29: readlink d1/l4 0 2024-09-13T02:53:51.056 INFO:tasks.workunit.client.1.smithi131.stdout:0/79: symlink d0/de/l1c 0 2024-09-13T02:53:51.056 INFO:tasks.workunit.client.1.smithi131.stdout:8/165: write f8 [2363792,77672] 0 2024-09-13T02:53:51.058 INFO:tasks.workunit.client.1.smithi131.stdout:5/66: dwrite d1/d5/f16 [0,4194304] 0 2024-09-13T02:53:51.058 INFO:tasks.workunit.client.1.smithi131.stdout:5/67: write d1/d5/f9 [152873,48829] 0 2024-09-13T02:53:51.058 INFO:tasks.workunit.client.1.smithi131.stdout:5/68: stat d1/d5/c8 0 2024-09-13T02:53:51.058 INFO:tasks.workunit.client.1.smithi131.stdout:5/69: stat d1/l10 0 2024-09-13T02:53:51.058 INFO:tasks.workunit.client.1.smithi131.stdout:5/70: chown d1/d5/fb 898 1 2024-09-13T02:53:51.059 INFO:tasks.workunit.client.1.smithi131.stdout:0/80: symlink d0/l1d 0 2024-09-13T02:53:51.067 INFO:tasks.workunit.client.1.smithi131.stdout:7/26: dwrite f3 [0,4194304] 0 2024-09-13T02:53:51.067 INFO:tasks.workunit.client.1.smithi131.stdout:7/27: creat fa x:0 0 0 2024-09-13T02:53:51.067 INFO:tasks.workunit.client.1.smithi131.stdout:7/28: rmdir - no directory 2024-09-13T02:53:51.067 INFO:tasks.workunit.client.1.smithi131.stdout:7/29: write f7 [495515,91362] 0 2024-09-13T02:53:51.068 INFO:tasks.workunit.client.1.smithi131.stdout:7/30: write f7 [483323,30384] 0 2024-09-13T02:53:51.068 INFO:tasks.workunit.client.1.smithi131.stdout:7/31: write fa [634466,109943] 0 2024-09-13T02:53:51.079 INFO:tasks.workunit.client.1.smithi131.stdout:0/81: getdents d0/de 0 2024-09-13T02:53:51.079 INFO:tasks.workunit.client.1.smithi131.stdout:5/71: dread d1/d5/fa [0,4194304] 0 2024-09-13T02:53:51.080 INFO:tasks.workunit.client.1.smithi131.stdout:0/82: rename d0/l4 to d0/de/l1e 0 2024-09-13T02:53:51.080 INFO:tasks.workunit.client.1.smithi131.stdout:0/83: truncate d0/f18 69513 0 2024-09-13T02:53:51.081 INFO:tasks.workunit.client.1.smithi131.stdout:7/32: fdatasync fa 0 2024-09-13T02:53:51.081 INFO:tasks.workunit.client.1.smithi131.stdout:4/30: truncate d1/f5 1051834 0 2024-09-13T02:53:51.081 INFO:tasks.workunit.client.1.smithi131.stdout:4/31: write d1/f6 [476818,78519] 0 2024-09-13T02:53:51.081 INFO:tasks.workunit.client.1.smithi131.stdout:4/32: chown d1/f5 1063017 1 2024-09-13T02:53:51.082 INFO:tasks.workunit.client.1.smithi131.stdout:6/80: dwrite d1/f7 [4194304,4194304] 0 2024-09-13T02:53:51.082 INFO:tasks.workunit.client.1.smithi131.stdout:9/59: dwrite d0/f9 [0,4194304] 0 2024-09-13T02:53:51.082 INFO:tasks.workunit.client.1.smithi131.stdout:9/60: fsync d0/fb 0 2024-09-13T02:53:51.082 INFO:tasks.workunit.client.1.smithi131.stdout:9/61: write d0/fb [1071179,68838] 0 2024-09-13T02:53:51.083 INFO:tasks.workunit.client.1.smithi131.stdout:0/84: mkdir d0/de/d1f 0 2024-09-13T02:53:51.084 INFO:tasks.workunit.client.1.smithi131.stdout:4/33: mknod d1/c7 0 2024-09-13T02:53:51.087 INFO:tasks.workunit.client.1.smithi131.stdout:1/96: dwrite dd/d1a/f1e [0,4194304] 0 2024-09-13T02:53:51.088 INFO:tasks.workunit.client.1.smithi131.stdout:6/81: dread d1/d8/d9/db/ff [0,4194304] 0 2024-09-13T02:53:51.088 INFO:tasks.workunit.client.1.smithi131.stdout:6/82: stat d1/d8/d9/db/d15 0 2024-09-13T02:53:51.088 INFO:tasks.workunit.client.1.smithi131.stdout:9/62: creat d0/d3/fd x:0 0 0 2024-09-13T02:53:51.088 INFO:tasks.workunit.client.1.smithi131.stdout:6/83: creat d1/d8/d9/f17 x:0 0 0 2024-09-13T02:53:51.088 INFO:tasks.workunit.client.1.smithi131.stdout:6/84: truncate d1/fe 1068057 0 2024-09-13T02:53:51.088 INFO:tasks.workunit.client.1.smithi131.stdout:9/63: creat d0/d3/fe x:0 0 0 2024-09-13T02:53:51.089 INFO:tasks.workunit.client.1.smithi131.stdout:0/85: symlink d0/l20 0 2024-09-13T02:53:51.089 INFO:tasks.workunit.client.1.smithi131.stdout:0/86: fdatasync d0/d2/fb 0 2024-09-13T02:53:51.093 INFO:tasks.workunit.client.1.smithi131.stdout:1/97: rename c5 to dd/d1a/c21 0 2024-09-13T02:53:51.093 INFO:tasks.workunit.client.1.smithi131.stdout:1/98: creat dd/d1a/f22 x:0 0 0 2024-09-13T02:53:51.093 INFO:tasks.workunit.client.1.smithi131.stdout:4/34: write d1/f6 [105431,92042] 0 2024-09-13T02:53:51.099 INFO:tasks.workunit.client.1.smithi131.stdout:5/72: dwrite d1/fc [0,4194304] 0 2024-09-13T02:53:51.099 INFO:tasks.workunit.client.1.smithi131.stdout:5/73: truncate d1/d5/fb 4565806 0 2024-09-13T02:53:51.104 INFO:tasks.workunit.client.1.smithi131.stdout:5/74: link d1/l19 d1/d5/l1e 0 2024-09-13T02:53:51.110 INFO:tasks.workunit.client.1.smithi131.stdout:2/40: sync 2024-09-13T02:53:51.111 INFO:tasks.workunit.client.1.smithi131.stdout:2/41: mkdir d5/dd 0 2024-09-13T02:53:51.111 INFO:tasks.workunit.client.1.smithi131.stdout:2/42: fdatasync d5/f9 0 2024-09-13T02:53:51.115 INFO:tasks.workunit.client.1.smithi131.stdout:6/85: dwrite d1/d8/d9/f17 [0,4194304] 0 2024-09-13T02:53:51.116 INFO:tasks.workunit.client.1.smithi131.stdout:9/64: dwrite d0/f9 [0,4194304] 0 2024-09-13T02:53:51.116 INFO:tasks.workunit.client.1.smithi131.stdout:1/99: dread dd/d1a/f1e [0,4194304] 0 2024-09-13T02:53:51.116 INFO:tasks.workunit.client.1.smithi131.stdout:9/65: chown d0/f9 53921 1 2024-09-13T02:53:51.117 INFO:tasks.workunit.client.1.smithi131.stdout:1/100: write dd/ff [1525148,83287] 0 2024-09-13T02:53:51.117 INFO:tasks.workunit.client.1.smithi131.stdout:1/101: creat dd/d1a/f23 x:0 0 0 2024-09-13T02:53:51.117 INFO:tasks.workunit.client.1.smithi131.stdout:1/102: chown dd/f20 611888 1 2024-09-13T02:53:51.118 INFO:tasks.workunit.client.1.smithi131.stdout:8/166: dwrite f8 [0,4194304] 0 2024-09-13T02:53:51.119 INFO:tasks.workunit.client.1.smithi131.stdout:9/66: symlink d0/d3/lf 0 2024-09-13T02:53:51.121 INFO:tasks.workunit.client.1.smithi131.stdout:1/103: write f0 [12295427,129546] 0 2024-09-13T02:53:51.121 INFO:tasks.workunit.client.1.smithi131.stdout:1/104: chown dd/d1a/f22 75 1 2024-09-13T02:53:51.121 INFO:tasks.workunit.client.1.smithi131.stdout:8/167: creat db/d1d/d34/f36 x:0 0 0 2024-09-13T02:53:51.126 INFO:tasks.workunit.client.1.smithi131.stdout:6/86: write d1/d8/d9/f17 [1519754,124875] 0 2024-09-13T02:53:51.127 INFO:tasks.workunit.client.1.smithi131.stdout:6/87: mknod d1/d16/c18 0 2024-09-13T02:53:51.146 INFO:tasks.workunit.client.1.smithi131.stdout:2/43: dwrite d5/fa [0,4194304] 0 2024-09-13T02:53:51.157 INFO:tasks.workunit.client.1.smithi131.stdout:5/75: dwrite d1/d5/f12 [0,4194304] 0 2024-09-13T02:53:51.158 INFO:tasks.workunit.client.1.smithi131.stdout:5/76: symlink d1/l1f 0 2024-09-13T02:53:51.159 INFO:tasks.workunit.client.1.smithi131.stdout:5/77: link d1/d5/l1e d1/l20 0 2024-09-13T02:53:51.160 INFO:tasks.workunit.client.1.smithi131.stdout:6/88: dwrite d1/d8/d9/db/ff [0,4194304] 0 2024-09-13T02:53:51.160 INFO:tasks.workunit.client.1.smithi131.stdout:6/89: write d1/fe [1947164,100549] 0 2024-09-13T02:53:51.165 INFO:tasks.workunit.client.1.smithi131.stdout:2/44: dwrite d5/fc [0,4194304] 0 2024-09-13T02:53:51.165 INFO:tasks.workunit.client.1.smithi131.stdout:1/105: dwrite dd/f20 [0,4194304] 0 2024-09-13T02:53:51.166 INFO:tasks.workunit.client.1.smithi131.stdout:9/67: dwrite d0/d3/fd [0,4194304] 0 2024-09-13T02:53:51.171 INFO:tasks.workunit.client.1.smithi131.stdout:6/90: fsync d1/fe 0 2024-09-13T02:53:51.171 INFO:tasks.workunit.client.1.smithi131.stdout:6/91: fdatasync d1/f7 0 2024-09-13T02:53:51.176 INFO:tasks.workunit.client.1.smithi131.stdout:1/106: symlink dd/l24 0 2024-09-13T02:53:51.176 INFO:tasks.workunit.client.1.smithi131.stdout:1/107: fdatasync fc 0 2024-09-13T02:53:51.182 INFO:tasks.workunit.client.1.smithi131.stdout:5/78: dwrite d1/fc [0,4194304] 0 2024-09-13T02:53:51.183 INFO:tasks.workunit.client.1.smithi131.stdout:2/45: dread d5/fc [0,4194304] 0 2024-09-13T02:53:51.183 INFO:tasks.workunit.client.1.smithi131.stdout:2/46: write f3 [8978442,81206] 0 2024-09-13T02:53:51.185 INFO:tasks.workunit.client.1.smithi131.stdout:5/79: mkdir d1/d21 0 2024-09-13T02:53:51.196 INFO:tasks.workunit.client.1.smithi131.stdout:3/36: sync 2024-09-13T02:53:51.197 INFO:tasks.workunit.client.1.smithi131.stdout:2/47: fdatasync f3 0 2024-09-13T02:53:51.197 INFO:tasks.workunit.client.1.smithi131.stdout:8/168: dwrite f6 [0,4194304] 0 2024-09-13T02:53:51.198 INFO:tasks.workunit.client.1.smithi131.stdout:9/68: dwrite d0/fb [0,4194304] 0 2024-09-13T02:53:51.198 INFO:tasks.workunit.client.1.smithi131.stdout:1/108: dwrite dd/d1a/f23 [0,4194304] 0 2024-09-13T02:53:51.198 INFO:tasks.workunit.client.1.smithi131.stdout:3/37: unlink d2/f5 0 2024-09-13T02:53:51.198 INFO:tasks.workunit.client.1.smithi131.stdout:3/38: fsync d2/d4/f9 0 2024-09-13T02:53:51.199 INFO:tasks.workunit.client.1.smithi131.stdout:2/48: unlink d5/fc 0 2024-09-13T02:53:51.200 INFO:tasks.workunit.client.1.smithi131.stdout:8/169: creat db/d1d/d31/f37 x:0 0 0 2024-09-13T02:53:51.203 INFO:tasks.workunit.client.1.smithi131.stdout:3/39: mkdir d2/dc 0 2024-09-13T02:53:51.203 INFO:tasks.workunit.client.1.smithi131.stdout:3/40: dread - d2/d4/f9 zero size 2024-09-13T02:53:51.208 INFO:tasks.workunit.client.1.smithi131.stdout:9/69: write d0/d3/fd [1379047,2692] 0 2024-09-13T02:53:51.208 INFO:tasks.workunit.client.1.smithi131.stdout:9/70: chown d0/fb 2087294147 1 2024-09-13T02:53:51.208 INFO:tasks.workunit.client.1.smithi131.stdout:9/71: creat d0/f10 x:0 0 0 2024-09-13T02:53:51.208 INFO:tasks.workunit.client.1.smithi131.stdout:9/72: chown d0/d3/fe 6132 1 2024-09-13T02:53:51.210 INFO:tasks.workunit.client.1.smithi131.stdout:8/170: rmdir db 39 2024-09-13T02:53:51.210 INFO:tasks.workunit.client.1.smithi131.stdout:8/171: write db/d1d/f25 [449988,114031] 0 2024-09-13T02:53:51.216 INFO:tasks.workunit.client.1.smithi131.stdout:1/109: dwrite f8 [0,4194304] 0 2024-09-13T02:53:51.216 INFO:tasks.workunit.client.1.smithi131.stdout:1/110: creat dd/d1a/f25 x:0 0 0 2024-09-13T02:53:51.216 INFO:tasks.workunit.client.1.smithi131.stdout:1/111: truncate dd/ff 2465612 0 2024-09-13T02:53:51.218 INFO:tasks.workunit.client.1.smithi131.stdout:9/73: dread d0/fb [0,4194304] 0 2024-09-13T02:53:51.218 INFO:tasks.workunit.client.1.smithi131.stdout:9/74: creat d0/f11 x:0 0 0 2024-09-13T02:53:51.218 INFO:tasks.workunit.client.1.smithi131.stdout:1/112: mkdir dd/d26 0 2024-09-13T02:53:51.218 INFO:tasks.workunit.client.1.smithi131.stdout:9/75: creat d0/f12 x:0 0 0 2024-09-13T02:53:51.220 INFO:tasks.workunit.client.1.smithi131.stdout:9/76: link d0/cc d0/d3/c13 0 2024-09-13T02:53:51.220 INFO:tasks.workunit.client.1.smithi131.stdout:9/77: truncate d0/f11 272930 0 2024-09-13T02:53:51.221 INFO:tasks.workunit.client.1.smithi131.stdout:1/113: mknod dd/d1a/c27 0 2024-09-13T02:53:51.231 INFO:tasks.workunit.client.1.smithi131.stdout:8/172: dread f8 [0,4194304] 0 2024-09-13T02:53:51.232 INFO:tasks.workunit.client.1.smithi131.stdout:8/173: unlink db/d1d/l2f 0 2024-09-13T02:53:51.232 INFO:tasks.workunit.client.1.smithi131.stdout:8/174: chown db/c13 126544167 1 2024-09-13T02:53:51.249 INFO:tasks.workunit.client.1.smithi131.stdout:2/49: dwrite f4 [0,4194304] 0 2024-09-13T02:53:51.249 INFO:tasks.workunit.client.1.smithi131.stdout:2/50: truncate d5/fa 4993699 0 2024-09-13T02:53:51.257 INFO:tasks.workunit.client.1.smithi131.stdout:3/41: dwrite d2/d4/f9 [0,4194304] 0 2024-09-13T02:53:51.257 INFO:tasks.workunit.client.1.smithi131.stdout:8/175: dwrite f8 [0,4194304] 0 2024-09-13T02:53:51.257 INFO:tasks.workunit.client.1.smithi131.stdout:1/114: dwrite dd/f13 [0,4194304] 0 2024-09-13T02:53:51.258 INFO:tasks.workunit.client.1.smithi131.stdout:8/176: write db/d1d/d1f/f2d [243591,48065] 0 2024-09-13T02:53:51.267 INFO:tasks.workunit.client.1.smithi131.stdout:7/33: sync 2024-09-13T02:53:51.271 INFO:tasks.workunit.client.1.smithi131.stdout:1/115: dread f8 [0,4194304] 0 2024-09-13T02:53:51.271 INFO:tasks.workunit.client.1.smithi131.stdout:1/116: fsync dd/d1a/f25 0 2024-09-13T02:53:51.271 INFO:tasks.workunit.client.1.smithi131.stdout:1/117: creat dd/d1a/f28 x:0 0 0 2024-09-13T02:53:51.271 INFO:tasks.workunit.client.1.smithi131.stdout:9/78: dwrite d0/d3/fd [0,4194304] 0 2024-09-13T02:53:51.271 INFO:tasks.workunit.client.1.smithi131.stdout:9/79: stat d0 0 2024-09-13T02:53:51.271 INFO:tasks.workunit.client.1.smithi131.stdout:9/80: stat d0/f9 0 2024-09-13T02:53:51.272 INFO:tasks.workunit.client.1.smithi131.stdout:1/118: symlink dd/d26/l29 0 2024-09-13T02:53:51.274 INFO:tasks.workunit.client.1.smithi131.stdout:1/119: mkdir dd/d26/d2a 0 2024-09-13T02:53:51.274 INFO:tasks.workunit.client.1.smithi131.stdout:3/42: write d2/d4/f9 [1433562,22800] 0 2024-09-13T02:53:51.274 INFO:tasks.workunit.client.1.smithi131.stdout:9/81: getdents d0 0 2024-09-13T02:53:51.274 INFO:tasks.workunit.client.1.smithi131.stdout:9/82: fsync d0/f9 0 2024-09-13T02:53:51.274 INFO:tasks.workunit.client.1.smithi131.stdout:9/83: chown d0/d3/fe 5 1 2024-09-13T02:53:51.275 INFO:tasks.workunit.client.1.smithi131.stdout:9/84: mkdir d0/d3/d14 0 2024-09-13T02:53:51.276 INFO:tasks.workunit.client.1.smithi131.stdout:3/43: fdatasync d2/d4/f9 0 2024-09-13T02:53:51.276 INFO:tasks.workunit.client.1.smithi131.stdout:3/44: write d2/d4/f9 [172884,98845] 0 2024-09-13T02:53:51.277 INFO:tasks.workunit.client.1.smithi131.stdout:3/45: rename d2/da to d2/d4/dd 0 2024-09-13T02:53:51.278 INFO:tasks.workunit.client.1.smithi131.stdout:7/34: dread f3 [0,4194304] 0 2024-09-13T02:53:51.278 INFO:tasks.workunit.client.1.smithi131.stdout:7/35: chown f1 6 1 2024-09-13T02:53:51.278 INFO:tasks.workunit.client.1.smithi131.stdout:7/36: truncate f3 4451293 0 2024-09-13T02:53:51.278 INFO:tasks.workunit.client.1.smithi131.stdout:7/37: creat fb x:0 0 0 2024-09-13T02:53:51.286 INFO:tasks.workunit.client.1.smithi131.stdout:3/46: dread d2/d4/f9 [0,4194304] 0 2024-09-13T02:53:51.287 INFO:tasks.workunit.client.1.smithi131.stdout:3/47: mknod d2/ce 0 2024-09-13T02:53:51.301 INFO:tasks.workunit.client.1.smithi131.stdout:8/177: dwrite f6 [4194304,4194304] 0 2024-09-13T02:53:51.301 INFO:tasks.workunit.client.1.smithi131.stdout:1/120: dwrite dd/d1a/f1e [4194304,4194304] 0 2024-09-13T02:53:51.301 INFO:tasks.workunit.client.1.smithi131.stdout:8/178: write db/d1d/f28 [691644,88074] 0 2024-09-13T02:53:51.302 INFO:tasks.workunit.client.1.smithi131.stdout:9/85: rmdir d0/d3 39 2024-09-13T02:53:51.305 INFO:tasks.workunit.client.1.smithi131.stdout:1/121: symlink dd/d26/l2b 0 2024-09-13T02:53:51.307 INFO:tasks.workunit.client.1.smithi131.stdout:9/86: creat d0/f15 x:0 0 0 2024-09-13T02:53:51.311 INFO:tasks.workunit.client.1.smithi131.stdout:3/48: dwrite d2/d4/f9 [0,4194304] 0 2024-09-13T02:53:51.311 INFO:tasks.workunit.client.1.smithi131.stdout:3/49: getdents d2/d4/d7/d8 0 2024-09-13T02:53:51.313 INFO:tasks.workunit.client.1.smithi131.stdout:8/179: dread db/f15 [0,4194304] 0 2024-09-13T02:53:51.322 INFO:tasks.workunit.client.1.smithi131.stdout:4/35: sync 2024-09-13T02:53:51.322 INFO:tasks.workunit.client.1.smithi131.stdout:4/36: fsync d1/f6 0 2024-09-13T02:53:51.322 INFO:tasks.workunit.client.1.smithi131.stdout:0/87: sync 2024-09-13T02:53:51.322 INFO:tasks.workunit.client.1.smithi131.stdout:0/88: truncate d0/fd 1047823 0 2024-09-13T02:53:51.322 INFO:tasks.workunit.client.1.smithi131.stdout:0/89: write d0/f12 [249592,96514] 0 2024-09-13T02:53:51.323 INFO:tasks.workunit.client.1.smithi131.stdout:7/38: dwrite f1 [0,4194304] 0 2024-09-13T02:53:51.324 INFO:tasks.workunit.client.1.smithi131.stdout:0/90: fsync d0/de/f1a 0 2024-09-13T02:53:51.324 INFO:tasks.workunit.client.1.smithi131.stdout:0/91: chown d0/d2 1134811 1 2024-09-13T02:53:51.326 INFO:tasks.workunit.client.1.smithi131.stdout:4/37: mkdir d1/d8 0 2024-09-13T02:53:51.326 INFO:tasks.workunit.client.1.smithi131.stdout:4/38: fsync d1/f5 0 2024-09-13T02:53:51.327 INFO:tasks.workunit.client.1.smithi131.stdout:3/50: dread d2/d4/f9 [0,4194304] 0 2024-09-13T02:53:51.327 INFO:tasks.workunit.client.1.smithi131.stdout:7/39: truncate f3 2324181 0 2024-09-13T02:53:51.329 INFO:tasks.workunit.client.1.smithi131.stdout:0/92: rename d0/d2/c9 to d0/c21 0 2024-09-13T02:53:51.330 INFO:tasks.workunit.client.1.smithi131.stdout:4/39: creat d1/d8/f9 x:0 0 0 2024-09-13T02:53:51.331 INFO:tasks.workunit.client.1.smithi131.stdout:4/40: creat d1/d8/fa x:0 0 0 2024-09-13T02:53:51.332 INFO:tasks.workunit.client.1.smithi131.stdout:3/51: creat d2/ff x:0 0 0 2024-09-13T02:53:51.332 INFO:tasks.workunit.client.1.smithi131.stdout:3/52: dread - d2/ff zero size 2024-09-13T02:53:51.333 INFO:tasks.workunit.client.1.smithi131.stdout:7/40: symlink lc 0 2024-09-13T02:53:51.334 INFO:tasks.workunit.client.1.smithi131.stdout:0/93: mkdir d0/de/d1f/d22 0 2024-09-13T02:53:51.336 INFO:tasks.workunit.client.1.smithi131.stdout:0/94: symlink d0/de/d1f/l23 0 2024-09-13T02:53:51.338 INFO:tasks.workunit.client.1.smithi131.stdout:7/41: truncate f1 3930369 0 2024-09-13T02:53:51.338 INFO:tasks.workunit.client.1.smithi131.stdout:3/53: write d2/d4/f9 [1522751,76133] 0 2024-09-13T02:53:51.339 INFO:tasks.workunit.client.1.smithi131.stdout:7/42: unlink c2 0 2024-09-13T02:53:51.339 INFO:tasks.workunit.client.1.smithi131.stdout:3/54: stat d2/c3 0 2024-09-13T02:53:51.344 INFO:tasks.workunit.client.1.smithi131.stdout:1/122: dwrite f4 [0,4194304] 0 2024-09-13T02:53:51.347 INFO:tasks.workunit.client.1.smithi131.stdout:1/123: mkdir dd/d26/d2a/d2c 0 2024-09-13T02:53:51.348 INFO:tasks.workunit.client.1.smithi131.stdout:9/87: dwrite d0/fb [0,4194304] 0 2024-09-13T02:53:51.349 INFO:tasks.workunit.client.1.smithi131.stdout:1/124: stat dd/c11 0 2024-09-13T02:53:51.349 INFO:tasks.workunit.client.1.smithi131.stdout:8/180: dwrite f2 [4194304,4194304] 0 2024-09-13T02:53:51.350 INFO:tasks.workunit.client.1.smithi131.stdout:9/88: mknod d0/d3/d14/c16 0 2024-09-13T02:53:51.350 INFO:tasks.workunit.client.1.smithi131.stdout:9/89: write d0/f11 [1176386,74511] 0 2024-09-13T02:53:51.350 INFO:tasks.workunit.client.1.smithi131.stdout:9/90: truncate d0/d3/fe 419714 0 2024-09-13T02:53:51.352 INFO:tasks.workunit.client.1.smithi131.stdout:1/125: creat dd/d26/f2d x:0 0 0 2024-09-13T02:53:51.356 INFO:tasks.workunit.client.1.smithi131.stdout:3/55: dread d2/d4/f9 [0,4194304] 0 2024-09-13T02:53:51.356 INFO:tasks.workunit.client.1.smithi131.stdout:3/56: stat d2/ff 0 2024-09-13T02:53:51.356 INFO:tasks.workunit.client.1.smithi131.stdout:3/57: creat d2/f10 x:0 0 0 2024-09-13T02:53:51.356 INFO:tasks.workunit.client.1.smithi131.stdout:3/58: fdatasync d2/d4/f9 0 2024-09-13T02:53:51.358 INFO:tasks.workunit.client.1.smithi131.stdout:7/43: dread f3 [0,4194304] 0 2024-09-13T02:53:51.359 INFO:tasks.workunit.client.1.smithi131.stdout:3/59: symlink d2/dc/l11 0 2024-09-13T02:53:51.359 INFO:tasks.workunit.client.1.smithi131.stdout:3/60: creat d2/f12 x:0 0 0 2024-09-13T02:53:51.359 INFO:tasks.workunit.client.1.smithi131.stdout:3/61: dread - d2/f12 zero size 2024-09-13T02:53:51.360 INFO:tasks.workunit.client.1.smithi131.stdout:7/44: symlink ld 0 2024-09-13T02:53:51.362 INFO:tasks.workunit.client.1.smithi131.stdout:9/91: dread d0/f9 [0,4194304] 0 2024-09-13T02:53:51.362 INFO:tasks.workunit.client.1.smithi131.stdout:9/92: read - d0/f15 zero size 2024-09-13T02:53:51.362 INFO:tasks.workunit.client.1.smithi131.stdout:9/93: chown d0/d3/c13 46412 1 2024-09-13T02:53:51.362 INFO:tasks.workunit.client.1.smithi131.stdout:3/62: symlink d2/d4/d7/d8/l13 0 2024-09-13T02:53:51.362 INFO:tasks.workunit.client.1.smithi131.stdout:7/45: truncate f3 1084322 0 2024-09-13T02:53:51.363 INFO:tasks.workunit.client.1.smithi131.stdout:9/94: mkdir d0/d3/d14/d17 0 2024-09-13T02:53:51.365 INFO:tasks.workunit.client.1.smithi131.stdout:3/63: mkdir d2/d4/d14 0 2024-09-13T02:53:51.365 INFO:tasks.workunit.client.1.smithi131.stdout:3/64: dread - d2/ff zero size 2024-09-13T02:53:51.365 INFO:tasks.workunit.client.1.smithi131.stdout:9/95: mknod d0/c18 0 2024-09-13T02:53:51.368 INFO:tasks.workunit.client.1.smithi131.stdout:9/96: symlink d0/l19 0 2024-09-13T02:53:51.369 INFO:tasks.workunit.client.1.smithi131.stdout:9/97: read - d0/f12 zero size 2024-09-13T02:53:51.369 INFO:tasks.workunit.client.1.smithi131.stdout:9/98: mkdir d0/d3/d14/d1a 0 2024-09-13T02:53:51.369 INFO:tasks.workunit.client.1.smithi131.stdout:9/99: stat d0/d3/lf 0 2024-09-13T02:53:51.374 INFO:tasks.workunit.client.1.smithi131.stdout:0/95: dwrite d0/f16 [0,4194304] 0 2024-09-13T02:53:51.379 INFO:tasks.workunit.client.1.smithi131.stdout:5/80: sync 2024-09-13T02:53:51.379 INFO:tasks.workunit.client.1.smithi131.stdout:6/92: sync 2024-09-13T02:53:51.379 INFO:tasks.workunit.client.1.smithi131.stdout:6/93: creat d1/d8/d9/f19 x:0 0 0 2024-09-13T02:53:51.379 INFO:tasks.workunit.client.1.smithi131.stdout:1/126: dwrite dd/d1a/f1e [4194304,4194304] 0 2024-09-13T02:53:51.380 INFO:tasks.workunit.client.1.smithi131.stdout:5/81: mkdir d1/d21/d22 0 2024-09-13T02:53:51.380 INFO:tasks.workunit.client.1.smithi131.stdout:5/82: creat d1/f23 x:0 0 0 2024-09-13T02:53:51.382 INFO:tasks.workunit.client.1.smithi131.stdout:3/65: dwrite d2/d4/f9 [4194304,4194304] 0 2024-09-13T02:53:51.383 INFO:tasks.workunit.client.1.smithi131.stdout:6/94: creat d1/d8/f1a x:0 0 0 2024-09-13T02:53:51.383 INFO:tasks.workunit.client.1.smithi131.stdout:1/127: symlink dd/d26/d2a/d2c/l2e 0 2024-09-13T02:53:51.385 INFO:tasks.workunit.client.1.smithi131.stdout:3/66: fsync d2/f12 0 2024-09-13T02:53:51.388 INFO:tasks.workunit.client.1.smithi131.stdout:0/96: write d0/f16 [3111708,46846] 0 2024-09-13T02:53:51.389 INFO:tasks.workunit.client.1.smithi131.stdout:6/95: link d1/d8/d9/f17 d1/d8/f1b 0 2024-09-13T02:53:51.392 INFO:tasks.workunit.client.1.smithi131.stdout:7/46: dread f3 [0,4194304] 0 2024-09-13T02:53:51.392 INFO:tasks.workunit.client.1.smithi131.stdout:7/47: truncate f3 1356243 0 2024-09-13T02:53:51.394 INFO:tasks.workunit.client.1.smithi131.stdout:3/67: rename d2/l6 to d2/l15 0 2024-09-13T02:53:51.395 INFO:tasks.workunit.client.1.smithi131.stdout:5/83: getdents d1/d1c 0 2024-09-13T02:53:51.396 INFO:tasks.workunit.client.1.smithi131.stdout:0/97: creat d0/de/d1f/f24 x:0 0 0 2024-09-13T02:53:51.398 INFO:tasks.workunit.client.1.smithi131.stdout:6/96: truncate d1/fe 950303 0 2024-09-13T02:53:51.398 INFO:tasks.workunit.client.1.smithi131.stdout:6/97: chown d1/l5 243609946 1 2024-09-13T02:53:51.399 INFO:tasks.workunit.client.1.smithi131.stdout:5/84: rename d1/l20 to d1/l24 0 2024-09-13T02:53:51.400 INFO:tasks.workunit.client.1.smithi131.stdout:7/48: dread f1 [0,4194304] 0 2024-09-13T02:53:51.400 INFO:tasks.workunit.client.1.smithi131.stdout:7/49: chown c9 162905221 1 2024-09-13T02:53:51.403 INFO:tasks.workunit.client.1.smithi131.stdout:5/85: creat d1/d21/f25 x:0 0 0 2024-09-13T02:53:51.403 INFO:tasks.workunit.client.1.smithi131.stdout:1/128: dwrite fc [0,4194304] 0 2024-09-13T02:53:51.404 INFO:tasks.workunit.client.1.smithi131.stdout:7/50: dread fa [0,4194304] 0 2024-09-13T02:53:51.404 INFO:tasks.workunit.client.1.smithi131.stdout:0/98: symlink d0/de/l25 0 2024-09-13T02:53:51.405 INFO:tasks.workunit.client.1.smithi131.stdout:5/86: creat d1/d21/d22/f26 x:0 0 0 2024-09-13T02:53:51.405 INFO:tasks.workunit.client.1.smithi131.stdout:5/87: truncate d1/d5/f16 4490051 0 2024-09-13T02:53:51.409 INFO:tasks.workunit.client.1.smithi131.stdout:0/99: creat d0/f26 x:0 0 0 2024-09-13T02:53:51.409 INFO:tasks.workunit.client.1.smithi131.stdout:2/51: sync 2024-09-13T02:53:51.409 INFO:tasks.workunit.client.1.smithi131.stdout:6/98: dread d1/d8/f1b [0,4194304] 0 2024-09-13T02:53:51.409 INFO:tasks.workunit.client.1.smithi131.stdout:5/88: mknod d1/d21/d22/c27 0 2024-09-13T02:53:51.411 INFO:tasks.workunit.client.1.smithi131.stdout:6/99: mkdir d1/d16/d1c 0 2024-09-13T02:53:51.411 INFO:tasks.workunit.client.1.smithi131.stdout:5/89: symlink d1/d21/l28 0 2024-09-13T02:53:51.411 INFO:tasks.workunit.client.1.smithi131.stdout:5/90: chown d1/d21/d22/f26 214152 1 2024-09-13T02:53:51.411 INFO:tasks.workunit.client.1.smithi131.stdout:5/91: truncate d1/f23 821895 0 2024-09-13T02:53:51.412 INFO:tasks.workunit.client.1.smithi131.stdout:6/100: truncate d1/f4 422415 0 2024-09-13T02:53:51.426 INFO:tasks.workunit.client.1.smithi131.stdout:2/52: write d5/f9 [338929,6408] 0 2024-09-13T02:53:51.437 INFO:tasks.workunit.client.1.smithi131.stdout:3/68: dwrite d2/f12 [0,4194304] 0 2024-09-13T02:53:51.437 INFO:tasks.workunit.client.1.smithi131.stdout:3/69: chown d2/d4 0 1 2024-09-13T02:53:51.440 INFO:tasks.workunit.client.1.smithi131.stdout:3/70: symlink d2/d4/d7/d8/l16 0 2024-09-13T02:53:51.440 INFO:tasks.workunit.client.1.smithi131.stdout:3/71: write d2/f10 [36638,2430] 0 2024-09-13T02:53:51.440 INFO:tasks.workunit.client.1.smithi131.stdout:3/72: truncate d2/ff 134370 0 2024-09-13T02:53:51.441 INFO:tasks.workunit.client.1.smithi131.stdout:3/73: link d2/l15 d2/dc/l17 0 2024-09-13T02:53:51.447 INFO:tasks.workunit.client.1.smithi131.stdout:7/51: dwrite f1 [4194304,4194304] 0 2024-09-13T02:53:51.447 INFO:tasks.workunit.client.1.smithi131.stdout:7/52: readlink l8 0 2024-09-13T02:53:51.448 INFO:tasks.workunit.client.1.smithi131.stdout:5/92: dwrite d1/d1c/f1d [0,4194304] 0 2024-09-13T02:53:51.449 INFO:tasks.workunit.client.1.smithi131.stdout:5/93: fdatasync d1/d21/f25 0 2024-09-13T02:53:51.449 INFO:tasks.workunit.client.1.smithi131.stdout:5/94: write d1/d21/f25 [479924,78060] 0 2024-09-13T02:53:51.449 INFO:tasks.workunit.client.1.smithi131.stdout:5/95: truncate d1/d5/f16 5108140 0 2024-09-13T02:53:51.449 INFO:tasks.workunit.client.1.smithi131.stdout:1/129: dwrite dd/f13 [0,4194304] 0 2024-09-13T02:53:51.449 INFO:tasks.workunit.client.1.smithi131.stdout:1/130: write fc [4850787,8538] 0 2024-09-13T02:53:51.449 INFO:tasks.workunit.client.1.smithi131.stdout:3/74: fsync d2/f10 0 2024-09-13T02:53:51.449 INFO:tasks.workunit.client.1.smithi131.stdout:2/53: fsync d5/f9 0 2024-09-13T02:53:51.449 INFO:tasks.workunit.client.1.smithi131.stdout:2/54: chown f4 5756519 1 2024-09-13T02:53:51.449 INFO:tasks.workunit.client.1.smithi131.stdout:0/100: dwrite d0/f26 [0,4194304] 0 2024-09-13T02:53:51.451 INFO:tasks.workunit.client.1.smithi131.stdout:1/131: write f8 [1370261,89629] 0 2024-09-13T02:53:51.451 INFO:tasks.workunit.client.1.smithi131.stdout:1/132: readlink dd/d26/d2a/d2c/l2e 0 2024-09-13T02:53:51.454 INFO:tasks.workunit.client.1.smithi131.stdout:5/96: mkdir d1/d29 0 2024-09-13T02:53:51.454 INFO:tasks.workunit.client.1.smithi131.stdout:5/97: truncate d1/d5/f13 612173 0 2024-09-13T02:53:51.454 INFO:tasks.workunit.client.1.smithi131.stdout:5/98: fsync d1/d1c/f1d 0 2024-09-13T02:53:51.455 INFO:tasks.workunit.client.1.smithi131.stdout:0/101: read d0/f18 [61140,79900] 0 2024-09-13T02:53:51.456 INFO:tasks.workunit.client.1.smithi131.stdout:3/75: symlink d2/dc/l18 0 2024-09-13T02:53:51.459 INFO:tasks.workunit.client.1.smithi131.stdout:1/133: creat dd/d26/d2a/d2c/f2f x:0 0 0 2024-09-13T02:53:51.461 INFO:tasks.workunit.client.1.smithi131.stdout:5/99: symlink d1/d21/d22/l2a 0 2024-09-13T02:53:51.463 INFO:tasks.workunit.client.1.smithi131.stdout:0/102: symlink d0/l27 0 2024-09-13T02:53:51.463 INFO:tasks.workunit.client.1.smithi131.stdout:0/103: stat d0/d2/fb 0 2024-09-13T02:53:51.463 INFO:tasks.workunit.client.1.smithi131.stdout:3/76: symlink d2/d4/dd/l19 0 2024-09-13T02:53:51.464 INFO:tasks.workunit.client.1.smithi131.stdout:2/55: getdents d5 0 2024-09-13T02:53:51.466 INFO:tasks.workunit.client.1.smithi131.stdout:0/104: symlink d0/de/d1f/d22/l28 0 2024-09-13T02:53:51.466 INFO:tasks.workunit.client.1.smithi131.stdout:0/105: truncate d0/f12 596046 0 2024-09-13T02:53:51.468 INFO:tasks.workunit.client.1.smithi131.stdout:3/77: mkdir d2/d4/d1a 0 2024-09-13T02:53:51.468 INFO:tasks.workunit.client.1.smithi131.stdout:3/78: fsync d2/d4/f9 0 2024-09-13T02:53:51.468 INFO:tasks.workunit.client.1.smithi131.stdout:3/79: chown d2/ce 237 1 2024-09-13T02:53:51.470 INFO:tasks.workunit.client.1.smithi131.stdout:2/56: unlink f3 0 2024-09-13T02:53:51.470 INFO:tasks.workunit.client.1.smithi131.stdout:1/134: rmdir dd/d1a 39 2024-09-13T02:53:51.471 INFO:tasks.workunit.client.1.smithi131.stdout:1/135: chown lb 141579 1 2024-09-13T02:53:51.471 INFO:tasks.workunit.client.1.smithi131.stdout:7/53: dwrite fa [0,4194304] 0 2024-09-13T02:53:51.472 INFO:tasks.workunit.client.1.smithi131.stdout:3/80: creat d2/dc/f1b x:0 0 0 2024-09-13T02:53:51.472 INFO:tasks.workunit.client.1.smithi131.stdout:3/81: truncate d2/f10 542916 0 2024-09-13T02:53:51.472 INFO:tasks.workunit.client.1.smithi131.stdout:0/106: dread d0/fd [0,4194304] 0 2024-09-13T02:53:51.476 INFO:tasks.workunit.client.1.smithi131.stdout:7/54: getdents . 0 2024-09-13T02:53:51.477 INFO:tasks.workunit.client.1.smithi131.stdout:0/107: link d0/de/f14 d0/de/d1f/d22/f29 0 2024-09-13T02:53:51.479 INFO:tasks.workunit.client.1.smithi131.stdout:7/55: symlink le 0 2024-09-13T02:53:51.481 INFO:tasks.workunit.client.1.smithi131.stdout:7/56: stat ld 0 2024-09-13T02:53:51.481 INFO:tasks.workunit.client.1.smithi131.stdout:2/57: read f4 [4050818,4681] 0 2024-09-13T02:53:51.482 INFO:tasks.workunit.client.1.smithi131.stdout:6/101: truncate d1/f4 336955 0 2024-09-13T02:53:51.483 INFO:tasks.workunit.client.1.smithi131.stdout:0/108: rename d0/de/c19 to d0/de/d1f/c2a 0 2024-09-13T02:53:51.483 INFO:tasks.workunit.client.1.smithi131.stdout:0/109: read - d0/de/d1f/f24 zero size 2024-09-13T02:53:51.484 INFO:tasks.workunit.client.1.smithi131.stdout:7/57: creat ff x:0 0 0 2024-09-13T02:53:51.485 INFO:tasks.workunit.client.1.smithi131.stdout:2/58: unlink c2 0 2024-09-13T02:53:51.485 INFO:tasks.workunit.client.1.smithi131.stdout:2/59: write d5/f9 [3114210,1037] 0 2024-09-13T02:53:51.487 INFO:tasks.workunit.client.1.smithi131.stdout:0/110: rename d0/d2/fb to d0/f2b 0 2024-09-13T02:53:51.488 INFO:tasks.workunit.client.1.smithi131.stdout:5/100: dwrite d1/d5/fa [0,4194304] 0 2024-09-13T02:53:51.488 INFO:tasks.workunit.client.1.smithi131.stdout:3/82: read d2/f12 [1762848,70700] 0 2024-09-13T02:53:51.488 INFO:tasks.workunit.client.1.smithi131.stdout:3/83: write d2/dc/f1b [95179,112771] 0 2024-09-13T02:53:51.489 INFO:tasks.workunit.client.1.smithi131.stdout:1/136: dread f8 [0,4194304] 0 2024-09-13T02:53:51.489 INFO:tasks.workunit.client.1.smithi131.stdout:1/137: chown f4 303 1 2024-09-13T02:53:51.489 INFO:tasks.workunit.client.1.smithi131.stdout:1/138: dread - dd/d26/f2d zero size 2024-09-13T02:53:51.489 INFO:tasks.workunit.client.1.smithi131.stdout:2/60: creat d5/fe x:0 0 0 2024-09-13T02:53:51.490 INFO:tasks.workunit.client.1.smithi131.stdout:0/111: symlink d0/de/d1f/l2c 0 2024-09-13T02:53:51.492 INFO:tasks.workunit.client.1.smithi131.stdout:5/101: rename d1/d5/f9 to d1/d29/f2b 0 2024-09-13T02:53:51.492 INFO:tasks.workunit.client.1.smithi131.stdout:5/102: write d1/d5/fa [4481625,27945] 0 2024-09-13T02:53:51.495 INFO:tasks.workunit.client.1.smithi131.stdout:3/84: mknod d2/dc/c1c 0 2024-09-13T02:53:51.495 INFO:tasks.workunit.client.1.smithi131.stdout:2/61: unlink l1 0 2024-09-13T02:53:51.497 INFO:tasks.workunit.client.1.smithi131.stdout:3/85: rename d2/d4/dd to d2/d4/d7/d1d 0 2024-09-13T02:53:51.497 INFO:tasks.workunit.client.1.smithi131.stdout:3/86: chown d2/d4/d7/d1d/l19 6223 1 2024-09-13T02:53:51.497 INFO:tasks.workunit.client.1.smithi131.stdout:3/87: write d2/f12 [1724820,106714] 0 2024-09-13T02:53:51.497 INFO:tasks.workunit.client.1.smithi131.stdout:2/62: creat d5/dd/ff x:0 0 0 2024-09-13T02:53:51.498 INFO:tasks.workunit.client.1.smithi131.stdout:2/63: mkdir d5/dd/d10 0 2024-09-13T02:53:51.500 INFO:tasks.workunit.client.1.smithi131.stdout:2/64: rename d5/l6 to d5/l11 0 2024-09-13T02:53:51.501 INFO:tasks.workunit.client.1.smithi131.stdout:1/139: dread dd/f13 [0,4194304] 0 2024-09-13T02:53:51.501 INFO:tasks.workunit.client.1.smithi131.stdout:1/140: creat dd/d26/f30 x:0 0 0 2024-09-13T02:53:51.501 INFO:tasks.workunit.client.1.smithi131.stdout:1/141: chown dd/d1a/f28 4527 1 2024-09-13T02:53:51.502 INFO:tasks.workunit.client.1.smithi131.stdout:0/112: dread d0/f2b [0,4194304] 0 2024-09-13T02:53:51.503 INFO:tasks.workunit.client.1.smithi131.stdout:1/142: rename dd/d1a/c21 to dd/d26/d2a/c31 0 2024-09-13T02:53:51.504 INFO:tasks.workunit.client.1.smithi131.stdout:0/113: unlink d0/f16 0 2024-09-13T02:53:51.505 INFO:tasks.workunit.client.1.smithi131.stdout:7/58: write fa [667007,14538] 0 2024-09-13T02:53:51.505 INFO:tasks.workunit.client.1.smithi131.stdout:1/143: creat dd/d1a/f32 x:0 0 0 2024-09-13T02:53:51.507 INFO:tasks.workunit.client.1.smithi131.stdout:7/59: rename fa to f10 0 2024-09-13T02:53:51.513 INFO:tasks.workunit.client.1.smithi131.stdout:6/102: dwrite d1/d8/d9/f17 [0,4194304] 0 2024-09-13T02:53:51.514 INFO:tasks.workunit.client.1.smithi131.stdout:5/103: dwrite d1/d5/f16 [0,4194304] 0 2024-09-13T02:53:51.514 INFO:tasks.workunit.client.1.smithi131.stdout:5/104: creat d1/f2c x:0 0 0 2024-09-13T02:53:51.514 INFO:tasks.workunit.client.1.smithi131.stdout:5/105: chown d1/d5/f16 571061 1 2024-09-13T02:53:51.523 INFO:tasks.workunit.client.1.smithi131.stdout:2/65: rmdir d5/dd 39 2024-09-13T02:53:51.523 INFO:tasks.workunit.client.1.smithi131.stdout:2/66: stat d5/dd 0 2024-09-13T02:53:51.523 INFO:tasks.workunit.client.1.smithi131.stdout:2/67: truncate d5/dd/ff 206079 0 2024-09-13T02:53:51.523 INFO:tasks.workunit.client.1.smithi131.stdout:0/114: dwrite d0/f2b [0,4194304] 0 2024-09-13T02:53:51.528 INFO:tasks.workunit.client.1.smithi131.stdout:5/106: rename d1/d5/l1e to d1/d21/d22/l2d 0 2024-09-13T02:53:51.531 INFO:tasks.workunit.client.1.smithi131.stdout:0/115: truncate d0/fd 543199 0 2024-09-13T02:53:51.532 INFO:tasks.workunit.client.1.smithi131.stdout:7/60: getdents . 0 2024-09-13T02:53:51.533 INFO:tasks.workunit.client.1.smithi131.stdout:5/107: creat d1/d29/f2e x:0 0 0 2024-09-13T02:53:51.534 INFO:tasks.workunit.client.1.smithi131.stdout:5/108: chown d1/d5/f12 299227580 1 2024-09-13T02:53:51.534 INFO:tasks.workunit.client.1.smithi131.stdout:5/109: read d1/d29/f2b [1007222,8218] 0 2024-09-13T02:53:51.534 INFO:tasks.workunit.client.1.smithi131.stdout:0/116: mknod d0/de/d1f/c2d 0 2024-09-13T02:53:51.538 INFO:tasks.workunit.client.1.smithi131.stdout:7/61: truncate f1 4050046 0 2024-09-13T02:53:51.538 INFO:tasks.workunit.client.1.smithi131.stdout:7/62: read - ff zero size 2024-09-13T02:53:51.538 INFO:tasks.workunit.client.1.smithi131.stdout:7/63: rmdir - no directory 2024-09-13T02:53:51.538 INFO:tasks.workunit.client.1.smithi131.stdout:7/64: write ff [632557,83202] 0 2024-09-13T02:53:51.538 INFO:tasks.workunit.client.1.smithi131.stdout:0/117: dread d0/f12 [0,4194304] 0 2024-09-13T02:53:51.538 INFO:tasks.workunit.client.1.smithi131.stdout:0/118: chown d0/l27 63948840 1 2024-09-13T02:53:51.539 INFO:tasks.workunit.client.1.smithi131.stdout:7/65: rename l8 to l11 0 2024-09-13T02:53:51.539 INFO:tasks.workunit.client.1.smithi131.stdout:7/66: fdatasync f1 0 2024-09-13T02:53:51.539 INFO:tasks.workunit.client.1.smithi131.stdout:4/41: sync 2024-09-13T02:53:51.539 INFO:tasks.workunit.client.1.smithi131.stdout:9/100: sync 2024-09-13T02:53:51.539 INFO:tasks.workunit.client.1.smithi131.stdout:8/181: sync 2024-09-13T02:53:51.540 INFO:tasks.workunit.client.1.smithi131.stdout:5/110: dread d1/d29/f2b [0,4194304] 0 2024-09-13T02:53:51.540 INFO:tasks.workunit.client.1.smithi131.stdout:5/111: dread - d1/d21/d22/f26 zero size 2024-09-13T02:53:51.540 INFO:tasks.workunit.client.1.smithi131.stdout:0/119: rename d0/d2/ff to d0/de/d1f/f2e 0 2024-09-13T02:53:51.540 INFO:tasks.workunit.client.1.smithi131.stdout:0/120: stat d0/d2/l15 0 2024-09-13T02:53:51.541 INFO:tasks.workunit.client.1.smithi131.stdout:7/67: creat f12 x:0 0 0 2024-09-13T02:53:51.541 INFO:tasks.workunit.client.1.smithi131.stdout:7/68: creat f13 x:0 0 0 2024-09-13T02:53:51.541 INFO:tasks.workunit.client.1.smithi131.stdout:7/69: fdatasync f10 0 2024-09-13T02:53:51.545 INFO:tasks.workunit.client.1.smithi131.stdout:4/42: dread d1/f6 [0,4194304] 0 2024-09-13T02:53:51.545 INFO:tasks.workunit.client.1.smithi131.stdout:4/43: truncate d1/d8/f9 812919 0 2024-09-13T02:53:51.545 INFO:tasks.workunit.client.1.smithi131.stdout:4/44: creat d1/d8/fb x:0 0 0 2024-09-13T02:53:51.548 INFO:tasks.workunit.client.1.smithi131.stdout:2/68: dwrite f4 [0,4194304] 0 2024-09-13T02:53:51.548 INFO:tasks.workunit.client.1.smithi131.stdout:2/69: chown d5/dd 176059 1 2024-09-13T02:53:51.549 INFO:tasks.workunit.client.1.smithi131.stdout:0/121: rename d0/de/d1f/f2e to d0/d2/f2f 0 2024-09-13T02:53:51.550 INFO:tasks.workunit.client.1.smithi131.stdout:0/122: write d0/de/f14 [844595,25300] 0 2024-09-13T02:53:51.551 INFO:tasks.workunit.client.1.smithi131.stdout:7/70: dread f1 [0,4194304] 0 2024-09-13T02:53:51.553 INFO:tasks.workunit.client.1.smithi131.stdout:8/182: rename db/d1d/d34/c35 to db/d1d/c38 0 2024-09-13T02:53:51.553 INFO:tasks.workunit.client.1.smithi131.stdout:8/183: dread - db/d1d/d34/f36 zero size 2024-09-13T02:53:51.553 INFO:tasks.workunit.client.1.smithi131.stdout:8/184: truncate db/f19 5195975 0 2024-09-13T02:53:51.553 INFO:tasks.workunit.client.1.smithi131.stdout:4/45: dread d1/f6 [0,4194304] 0 2024-09-13T02:53:51.553 INFO:tasks.workunit.client.1.smithi131.stdout:4/46: write d1/d8/f9 [1719895,29455] 0 2024-09-13T02:53:51.554 INFO:tasks.workunit.client.1.smithi131.stdout:0/123: creat d0/de/f30 x:0 0 0 2024-09-13T02:53:51.554 INFO:tasks.workunit.client.1.smithi131.stdout:0/124: dread - d0/de/f30 zero size 2024-09-13T02:53:51.555 INFO:tasks.workunit.client.1.smithi131.stdout:2/70: dread d5/f9 [0,4194304] 0 2024-09-13T02:53:51.555 INFO:tasks.workunit.client.1.smithi131.stdout:2/71: stat d5/fe 0 2024-09-13T02:53:51.556 INFO:tasks.workunit.client.1.smithi131.stdout:2/72: write d5/fa [2251585,128281] 0 2024-09-13T02:53:51.556 INFO:tasks.workunit.client.1.smithi131.stdout:0/125: mkdir d0/de/d1f/d22/d31 0 2024-09-13T02:53:51.557 INFO:tasks.workunit.client.1.smithi131.stdout:4/47: mkdir d1/dc 0 2024-09-13T02:53:51.558 INFO:tasks.workunit.client.1.smithi131.stdout:0/126: mknod d0/de/d1f/c32 0 2024-09-13T02:53:51.559 INFO:tasks.workunit.client.1.smithi131.stdout:4/48: dread d1/f6 [0,4194304] 0 2024-09-13T02:53:51.560 INFO:tasks.workunit.client.1.smithi131.stdout:0/127: rename d0/de/f30 to d0/de/d1f/f33 0 2024-09-13T02:53:51.561 INFO:tasks.workunit.client.1.smithi131.stdout:4/49: creat d1/dc/fd x:0 0 0 2024-09-13T02:53:51.565 INFO:tasks.workunit.client.1.smithi131.stdout:0/128: truncate d0/d2/f2f 4039263 0 2024-09-13T02:53:51.566 INFO:tasks.workunit.client.1.smithi131.stdout:9/101: dwrite d0/fb [0,4194304] 0 2024-09-13T02:53:51.568 INFO:tasks.workunit.client.1.smithi131.stdout:9/102: unlink d0/d3/fd 0 2024-09-13T02:53:51.589 INFO:tasks.workunit.client.1.smithi131.stdout:5/112: dwrite d1/f2c [0,4194304] 0 2024-09-13T02:53:51.599 INFO:tasks.workunit.client.1.smithi131.stdout:7/71: dwrite f12 [0,4194304] 0 2024-09-13T02:53:51.599 INFO:tasks.workunit.client.1.smithi131.stdout:7/72: write f10 [1303928,44839] 0 2024-09-13T02:53:51.600 INFO:tasks.workunit.client.1.smithi131.stdout:7/73: rmdir - no directory 2024-09-13T02:53:51.600 INFO:tasks.workunit.client.1.smithi131.stdout:2/73: dread d5/fa [0,4194304] 0 2024-09-13T02:53:51.600 INFO:tasks.workunit.client.1.smithi131.stdout:7/74: write f10 [372734,79261] 0 2024-09-13T02:53:51.600 INFO:tasks.workunit.client.1.smithi131.stdout:2/74: write d5/dd/ff [1170967,107720] 0 2024-09-13T02:53:51.600 INFO:tasks.workunit.client.1.smithi131.stdout:2/75: rename d5 to d5/dd/d12 22 2024-09-13T02:53:51.600 INFO:tasks.workunit.client.1.smithi131.stdout:0/129: fsync d0/de/d1f/d22/f29 0 2024-09-13T02:53:51.600 INFO:tasks.workunit.client.1.smithi131.stdout:9/103: dwrite d0/f9 [0,4194304] 0 2024-09-13T02:53:51.600 INFO:tasks.workunit.client.1.smithi131.stdout:4/50: dwrite d1/d8/fb [0,4194304] 0 2024-09-13T02:53:51.600 INFO:tasks.workunit.client.1.smithi131.stdout:4/51: stat d1/d8 0 2024-09-13T02:53:51.600 INFO:tasks.workunit.client.1.smithi131.stdout:8/185: dwrite db/f2a [0,4194304] 0 2024-09-13T02:53:51.600 INFO:tasks.workunit.client.1.smithi131.stdout:4/52: write d1/d8/fa [30220,89808] 0 2024-09-13T02:53:51.600 INFO:tasks.workunit.client.1.smithi131.stdout:4/53: creat d1/dc/fe x:0 0 0 2024-09-13T02:53:51.601 INFO:tasks.workunit.client.1.smithi131.stdout:2/76: dread d5/f9 [4194304,4194304] 0 2024-09-13T02:53:51.601 INFO:tasks.workunit.client.1.smithi131.stdout:7/75: rename l6 to l14 0 2024-09-13T02:53:51.603 INFO:tasks.workunit.client.1.smithi131.stdout:0/130: mknod d0/c34 0 2024-09-13T02:53:51.604 INFO:tasks.workunit.client.1.smithi131.stdout:0/131: write d0/de/d1f/f24 [809911,124443] 0 2024-09-13T02:53:51.608 INFO:tasks.workunit.client.1.smithi131.stdout:5/113: dwrite d1/fc [0,4194304] 0 2024-09-13T02:53:51.613 INFO:tasks.workunit.client.1.smithi131.stdout:8/186: dread db/f30 [0,4194304] 0 2024-09-13T02:53:51.614 INFO:tasks.workunit.client.1.smithi131.stdout:2/77: mknod d5/dd/c13 0 2024-09-13T02:53:51.615 INFO:tasks.workunit.client.1.smithi131.stdout:7/76: symlink l15 0 2024-09-13T02:53:51.616 INFO:tasks.workunit.client.1.smithi131.stdout:0/132: symlink d0/de/d1f/d22/d31/l35 0 2024-09-13T02:53:51.618 INFO:tasks.workunit.client.1.smithi131.stdout:9/104: rmdir d0/d3 39 2024-09-13T02:53:51.619 INFO:tasks.workunit.client.1.smithi131.stdout:8/187: mkdir db/d2b/d39 0 2024-09-13T02:53:51.619 INFO:tasks.workunit.client.1.smithi131.stdout:2/78: creat d5/dd/d10/f14 x:0 0 0 2024-09-13T02:53:51.620 INFO:tasks.workunit.client.1.smithi131.stdout:7/77: mknod c16 0 2024-09-13T02:53:51.621 INFO:tasks.workunit.client.1.smithi131.stdout:9/105: symlink d0/d3/d14/l1b 0 2024-09-13T02:53:51.622 INFO:tasks.workunit.client.1.smithi131.stdout:8/188: mkdir db/d2e/d3a 0 2024-09-13T02:53:51.622 INFO:tasks.workunit.client.1.smithi131.stdout:8/189: stat db/d1d/d31/f37 0 2024-09-13T02:53:51.622 INFO:tasks.workunit.client.1.smithi131.stdout:8/190: truncate db/d1d/d1f/f2c 815213 0 2024-09-13T02:53:51.624 INFO:tasks.workunit.client.1.smithi131.stdout:8/191: rmdir db/d1d/d31 39 2024-09-13T02:53:51.624 INFO:tasks.workunit.client.1.smithi131.stdout:8/192: fdatasync f5 0 2024-09-13T02:53:51.625 INFO:tasks.workunit.client.1.smithi131.stdout:9/106: dread d0/d3/fe [0,4194304] 0 2024-09-13T02:53:51.625 INFO:tasks.workunit.client.1.smithi131.stdout:1/144: sync 2024-09-13T02:53:51.625 INFO:tasks.workunit.client.1.smithi131.stdout:9/107: getdents d0 0 2024-09-13T02:53:51.625 INFO:tasks.workunit.client.1.smithi131.stdout:9/108: chown d0/f11 13702436 1 2024-09-13T02:53:51.625 INFO:tasks.workunit.client.1.smithi131.stdout:9/109: symlink d0/l1c 0 2024-09-13T02:53:51.627 INFO:tasks.workunit.client.1.smithi131.stdout:9/110: creat d0/d3/d14/d1a/f1d x:0 0 0 2024-09-13T02:53:51.631 INFO:tasks.workunit.client.1.smithi131.stdout:0/133: write d0/f26 [1085310,2306] 0 2024-09-13T02:53:51.631 INFO:tasks.workunit.client.1.smithi131.stdout:0/134: chown d0/d2/l15 186 1 2024-09-13T02:53:51.631 INFO:tasks.workunit.client.1.smithi131.stdout:0/135: readlink d0/de/l1e 0 2024-09-13T02:53:51.633 INFO:tasks.workunit.client.1.smithi131.stdout:0/136: symlink d0/l36 0 2024-09-13T02:53:51.643 INFO:tasks.workunit.client.1.smithi131.stdout:3/88: sync 2024-09-13T02:53:51.645 INFO:tasks.workunit.client.1.smithi131.stdout:3/89: unlink d2/dc/l18 0 2024-09-13T02:53:51.645 INFO:tasks.workunit.client.1.smithi131.stdout:3/90: write d2/dc/f1b [1253772,70768] 0 2024-09-13T02:53:51.645 INFO:tasks.workunit.client.1.smithi131.stdout:4/54: dwrite d1/d8/f9 [0,4194304] 0 2024-09-13T02:53:51.645 INFO:tasks.workunit.client.1.smithi131.stdout:4/55: creat d1/d8/ff x:0 0 0 2024-09-13T02:53:51.645 INFO:tasks.workunit.client.1.smithi131.stdout:4/56: chown d1/dc 32575179 1 2024-09-13T02:53:51.645 INFO:tasks.workunit.client.1.smithi131.stdout:4/57: write d1/dc/fe [76402,13284] 0 2024-09-13T02:53:51.646 INFO:tasks.workunit.client.1.smithi131.stdout:4/58: read - d1/dc/fd zero size 2024-09-13T02:53:51.646 INFO:tasks.workunit.client.1.smithi131.stdout:4/59: creat d1/dc/f10 x:0 0 0 2024-09-13T02:53:51.646 INFO:tasks.workunit.client.1.smithi131.stdout:5/114: dwrite d1/d5/f16 [0,4194304] 0 2024-09-13T02:53:51.646 INFO:tasks.workunit.client.1.smithi131.stdout:5/115: read d1/d21/f25 [544841,123812] 0 2024-09-13T02:53:51.646 INFO:tasks.workunit.client.1.smithi131.stdout:2/79: dwrite d5/dd/d10/f14 [0,4194304] 0 2024-09-13T02:53:51.648 INFO:tasks.workunit.client.1.smithi131.stdout:6/103: sync 2024-09-13T02:53:51.648 INFO:tasks.workunit.client.1.smithi131.stdout:6/104: read - d1/d8/d9/fd zero size 2024-09-13T02:53:51.648 INFO:tasks.workunit.client.1.smithi131.stdout:6/105: creat d1/d8/d9/f1d x:0 0 0 2024-09-13T02:53:51.651 INFO:tasks.workunit.client.1.smithi131.stdout:5/116: mkdir d1/d2f 0 2024-09-13T02:53:51.651 INFO:tasks.workunit.client.1.smithi131.stdout:7/78: getdents . 0 2024-09-13T02:53:51.653 INFO:tasks.workunit.client.1.smithi131.stdout:7/79: dread f3 [0,4194304] 0 2024-09-13T02:53:51.654 INFO:tasks.workunit.client.1.smithi131.stdout:2/80: symlink d5/dd/d10/l15 0 2024-09-13T02:53:51.654 INFO:tasks.workunit.client.1.smithi131.stdout:2/81: readlink d5/l11 0 2024-09-13T02:53:51.656 INFO:tasks.workunit.client.1.smithi131.stdout:4/60: fdatasync d1/dc/fe 0 2024-09-13T02:53:51.656 INFO:tasks.workunit.client.1.smithi131.stdout:9/111: dwrite d0/f11 [0,4194304] 0 2024-09-13T02:53:51.656 INFO:tasks.workunit.client.1.smithi131.stdout:0/137: rmdir d0 39 2024-09-13T02:53:51.657 INFO:tasks.workunit.client.1.smithi131.stdout:7/80: symlink l17 0 2024-09-13T02:53:51.657 INFO:tasks.workunit.client.1.smithi131.stdout:7/81: fsync f4 0 2024-09-13T02:53:51.657 INFO:tasks.workunit.client.1.smithi131.stdout:6/106: write d1/d8/f1b [4169900,51604] 0 2024-09-13T02:53:51.657 INFO:tasks.workunit.client.1.smithi131.stdout:6/107: truncate d1/d8/f1b 4482393 0 2024-09-13T02:53:51.658 INFO:tasks.workunit.client.1.smithi131.stdout:2/82: creat d5/dd/f16 x:0 0 0 2024-09-13T02:53:51.658 INFO:tasks.workunit.client.1.smithi131.stdout:2/83: creat d5/f17 x:0 0 0 2024-09-13T02:53:51.660 INFO:tasks.workunit.client.1.smithi131.stdout:9/112: symlink d0/d3/d14/d17/l1e 0 2024-09-13T02:53:51.662 INFO:tasks.workunit.client.1.smithi131.stdout:6/108: mknod d1/d16/d1c/c1e 0 2024-09-13T02:53:51.662 INFO:tasks.workunit.client.1.smithi131.stdout:6/109: readlink d1/l5 0 2024-09-13T02:53:51.663 INFO:tasks.workunit.client.1.smithi131.stdout:0/138: symlink d0/de/l37 0 2024-09-13T02:53:51.665 INFO:tasks.workunit.client.1.smithi131.stdout:6/110: rename d1/l5 to d1/d8/d9/db/l1f 0 2024-09-13T02:53:51.666 INFO:tasks.workunit.client.1.smithi131.stdout:0/139: creat d0/de/f38 x:0 0 0 2024-09-13T02:53:51.669 INFO:tasks.workunit.client.1.smithi131.stdout:3/91: getdents d2/dc 0 2024-09-13T02:53:51.669 INFO:tasks.workunit.client.1.smithi131.stdout:5/117: write d1/d5/f16 [2526966,94410] 0 2024-09-13T02:53:51.669 INFO:tasks.workunit.client.1.smithi131.stdout:5/118: fdatasync d1/d29/f2b 0 2024-09-13T02:53:51.669 INFO:tasks.workunit.client.1.smithi131.stdout:5/119: dread - d1/f1b zero size 2024-09-13T02:53:51.671 INFO:tasks.workunit.client.1.smithi131.stdout:3/92: creat d2/d4/d1a/f1e x:0 0 0 2024-09-13T02:53:51.673 INFO:tasks.workunit.client.1.smithi131.stdout:6/111: dread d1/fe [0,4194304] 0 2024-09-13T02:53:51.673 INFO:tasks.workunit.client.1.smithi131.stdout:1/145: dwrite dd/d1a/f32 [0,4194304] 0 2024-09-13T02:53:51.673 INFO:tasks.workunit.client.1.smithi131.stdout:6/112: readlink d1/l12 0 2024-09-13T02:53:51.673 INFO:tasks.workunit.client.1.smithi131.stdout:6/113: chown d1/d8/d9/f1d 864387865 1 2024-09-13T02:53:51.673 INFO:tasks.workunit.client.1.smithi131.stdout:6/114: stat d1/d8/f1a 0 2024-09-13T02:53:51.673 INFO:tasks.workunit.client.1.smithi131.stdout:6/115: write d1/d8/f1a [685301,79394] 0 2024-09-13T02:53:51.673 INFO:tasks.workunit.client.1.smithi131.stdout:6/116: dread - d1/d8/d9/f19 zero size 2024-09-13T02:53:51.674 INFO:tasks.workunit.client.1.smithi131.stdout:3/93: creat d2/d4/d14/f1f x:0 0 0 2024-09-13T02:53:51.675 INFO:tasks.workunit.client.1.smithi131.stdout:8/193: dwrite db/d1d/d31/f37 [0,4194304] 0 2024-09-13T02:53:51.679 INFO:tasks.workunit.client.1.smithi131.stdout:6/117: creat d1/d14/f20 x:0 0 0 2024-09-13T02:53:51.680 INFO:tasks.workunit.client.1.smithi131.stdout:3/94: rmdir d2/dc 39 2024-09-13T02:53:51.681 INFO:tasks.workunit.client.1.smithi131.stdout:2/84: truncate d5/dd/d10/f14 1350759 0 2024-09-13T02:53:51.681 INFO:tasks.workunit.client.1.smithi131.stdout:2/85: chown d5/cb 111 1 2024-09-13T02:53:51.681 INFO:tasks.workunit.client.1.smithi131.stdout:2/86: readlink d5/l11 0 2024-09-13T02:53:51.682 INFO:tasks.workunit.client.1.smithi131.stdout:8/194: dread db/fd [0,4194304] 0 2024-09-13T02:53:51.684 INFO:tasks.workunit.client.1.smithi131.stdout:5/120: dread d1/f2c [0,4194304] 0 2024-09-13T02:53:51.684 INFO:tasks.workunit.client.1.smithi131.stdout:1/146: getdents dd 0 2024-09-13T02:53:51.684 INFO:tasks.workunit.client.1.smithi131.stdout:1/147: dread - dd/d1a/f22 zero size 2024-09-13T02:53:51.685 INFO:tasks.workunit.client.1.smithi131.stdout:6/118: rmdir d1/d8/d9/db 39 2024-09-13T02:53:51.688 INFO:tasks.workunit.client.1.smithi131.stdout:3/95: rename d2/dc/l17 to d2/d4/d1a/l20 0 2024-09-13T02:53:51.688 INFO:tasks.workunit.client.1.smithi131.stdout:2/87: truncate d5/dd/ff 335497 0 2024-09-13T02:53:51.688 INFO:tasks.workunit.client.1.smithi131.stdout:2/88: fdatasync d5/fa 0 2024-09-13T02:53:51.689 INFO:tasks.workunit.client.1.smithi131.stdout:8/195: creat db/d2e/f3b x:0 0 0 2024-09-13T02:53:51.692 INFO:tasks.workunit.client.1.smithi131.stdout:4/61: dwrite d1/d8/ff [0,4194304] 0 2024-09-13T02:53:51.692 INFO:tasks.workunit.client.1.smithi131.stdout:4/62: fdatasync d1/dc/fe 0 2024-09-13T02:53:51.692 INFO:tasks.workunit.client.1.smithi131.stdout:4/63: stat d1/d8 0 2024-09-13T02:53:51.692 INFO:tasks.workunit.client.1.smithi131.stdout:9/113: dwrite d0/d3/fe [0,4194304] 0 2024-09-13T02:53:51.692 INFO:tasks.workunit.client.1.smithi131.stdout:1/148: mkdir dd/d33 0 2024-09-13T02:53:51.693 INFO:tasks.workunit.client.1.smithi131.stdout:0/140: dwrite d0/de/d1f/f33 [0,4194304] 0 2024-09-13T02:53:51.693 INFO:tasks.workunit.client.1.smithi131.stdout:8/196: dread db/f15 [0,4194304] 0 2024-09-13T02:53:51.694 INFO:tasks.workunit.client.1.smithi131.stdout:4/64: dread d1/d8/fa [0,4194304] 0 2024-09-13T02:53:51.694 INFO:tasks.workunit.client.1.smithi131.stdout:8/197: write db/d2e/f3b [709911,125501] 0 2024-09-13T02:53:51.694 INFO:tasks.workunit.client.1.smithi131.stdout:8/198: rename db to db/d1d/d31/d3c 22 2024-09-13T02:53:51.694 INFO:tasks.workunit.client.1.smithi131.stdout:8/199: fsync f5 0 2024-09-13T02:53:51.694 INFO:tasks.workunit.client.1.smithi131.stdout:6/119: symlink d1/d8/l21 0 2024-09-13T02:53:51.695 INFO:tasks.workunit.client.1.smithi131.stdout:6/120: creat d1/d14/f22 x:0 0 0 2024-09-13T02:53:51.695 INFO:tasks.workunit.client.1.smithi131.stdout:6/121: chown d1/d8/d9/f19 96446317 1 2024-09-13T02:53:51.695 INFO:tasks.workunit.client.1.smithi131.stdout:3/96: creat d2/d4/d7/d1d/f21 x:0 0 0 2024-09-13T02:53:51.699 INFO:tasks.workunit.client.1.smithi131.stdout:1/149: truncate f0 425293 0 2024-09-13T02:53:51.701 INFO:tasks.workunit.client.1.smithi131.stdout:0/141: mkdir d0/de/d1f/d22/d31/d39 0 2024-09-13T02:53:51.701 INFO:tasks.workunit.client.1.smithi131.stdout:0/142: chown d0/de/f38 1 1 2024-09-13T02:53:51.702 INFO:tasks.workunit.client.1.smithi131.stdout:8/200: rmdir db 39 2024-09-13T02:53:51.702 INFO:tasks.workunit.client.1.smithi131.stdout:8/201: readlink l1 0 2024-09-13T02:53:51.703 INFO:tasks.workunit.client.1.smithi131.stdout:6/122: rmdir d1/d8/d9/db 39 2024-09-13T02:53:51.705 INFO:tasks.workunit.client.1.smithi131.stdout:9/114: read d0/fb [806218,76143] 0 2024-09-13T02:53:51.705 INFO:tasks.workunit.client.1.smithi131.stdout:9/115: rename d0 to d0/d3/d14/d1f 22 2024-09-13T02:53:51.705 INFO:tasks.workunit.client.1.smithi131.stdout:3/97: mknod d2/c22 0 2024-09-13T02:53:51.705 INFO:tasks.workunit.client.1.smithi131.stdout:3/98: chown d2/d4/cb 127382085 1 2024-09-13T02:53:51.705 INFO:tasks.workunit.client.1.smithi131.stdout:4/65: dread d1/d8/ff [0,4194304] 0 2024-09-13T02:53:51.706 INFO:tasks.workunit.client.1.smithi131.stdout:0/143: unlink d0/fd 0 2024-09-13T02:53:51.706 INFO:tasks.workunit.client.1.smithi131.stdout:0/144: chown d0/f18 2 1 2024-09-13T02:53:51.707 INFO:tasks.workunit.client.1.smithi131.stdout:4/66: dread d1/dc/fe [0,4194304] 0 2024-09-13T02:53:51.707 INFO:tasks.workunit.client.1.smithi131.stdout:4/67: write d1/d8/fa [289538,36275] 0 2024-09-13T02:53:51.708 INFO:tasks.workunit.client.1.smithi131.stdout:6/123: mknod d1/d14/c23 0 2024-09-13T02:53:51.708 INFO:tasks.workunit.client.1.smithi131.stdout:2/89: dread d5/dd/ff [0,4194304] 0 2024-09-13T02:53:51.710 INFO:tasks.workunit.client.1.smithi131.stdout:4/68: dread d1/dc/fe [0,4194304] 0 2024-09-13T02:53:51.710 INFO:tasks.workunit.client.1.smithi131.stdout:4/69: fsync d1/f6 0 2024-09-13T02:53:51.710 INFO:tasks.workunit.client.1.smithi131.stdout:9/116: rename d0/d3/fe to d0/d3/d14/f20 0 2024-09-13T02:53:51.710 INFO:tasks.workunit.client.1.smithi131.stdout:9/117: truncate d0/f10 666876 0 2024-09-13T02:53:51.710 INFO:tasks.workunit.client.1.smithi131.stdout:9/118: readlink d0/l19 0 2024-09-13T02:53:51.710 INFO:tasks.workunit.client.1.smithi131.stdout:9/119: readlink d0/la 0 2024-09-13T02:53:51.711 INFO:tasks.workunit.client.1.smithi131.stdout:3/99: creat d2/d4/f23 x:0 0 0 2024-09-13T02:53:51.712 INFO:tasks.workunit.client.1.smithi131.stdout:0/145: unlink d0/c21 0 2024-09-13T02:53:51.712 INFO:tasks.workunit.client.1.smithi131.stdout:0/146: fsync d0/de/f14 0 2024-09-13T02:53:51.712 INFO:tasks.workunit.client.1.smithi131.stdout:0/147: chown d0/c5 14240269 1 2024-09-13T02:53:51.713 INFO:tasks.workunit.client.1.smithi131.stdout:6/124: mknod d1/c24 0 2024-09-13T02:53:51.715 INFO:tasks.workunit.client.1.smithi131.stdout:3/100: mkdir d2/d4/d7/d1d/d24 0 2024-09-13T02:53:51.717 INFO:tasks.workunit.client.1.smithi131.stdout:6/125: link d1/d16/c18 d1/d16/c25 0 2024-09-13T02:53:51.719 INFO:tasks.workunit.client.1.smithi131.stdout:6/126: write d1/d8/d9/f17 [4224806,75312] 0 2024-09-13T02:53:51.728 INFO:tasks.workunit.client.1.smithi131.stdout:4/70: write d1/d8/f9 [957724,95233] 0 2024-09-13T02:53:51.730 INFO:tasks.workunit.client.1.smithi131.stdout:4/71: unlink d1/c7 0 2024-09-13T02:53:51.730 INFO:tasks.workunit.client.1.smithi131.stdout:4/72: readlink d1/l4 0 2024-09-13T02:53:51.730 INFO:tasks.workunit.client.1.smithi131.stdout:4/73: dread - d1/dc/fd zero size 2024-09-13T02:53:51.730 INFO:tasks.workunit.client.1.smithi131.stdout:4/74: write d1/dc/f10 [891454,3195] 0 2024-09-13T02:53:51.730 INFO:tasks.workunit.client.1.smithi131.stdout:4/75: chown d1/dc/f10 301564938 1 2024-09-13T02:53:51.730 INFO:tasks.workunit.client.1.smithi131.stdout:4/76: write d1/dc/fe [27052,71427] 0 2024-09-13T02:53:51.731 INFO:tasks.workunit.client.1.smithi131.stdout:4/77: write d1/f6 [461940,29892] 0 2024-09-13T02:53:51.731 INFO:tasks.workunit.client.1.smithi131.stdout:4/78: mknod d1/d8/c11 0 2024-09-13T02:53:51.732 INFO:tasks.workunit.client.1.smithi131.stdout:4/79: mknod d1/c12 0 2024-09-13T02:53:51.732 INFO:tasks.workunit.client.1.smithi131.stdout:4/80: mkdir d1/d8/d13 0 2024-09-13T02:53:51.732 INFO:tasks.workunit.client.1.smithi131.stdout:4/81: chown d1/d8/ff 270 1 2024-09-13T02:53:51.733 INFO:tasks.workunit.client.1.smithi131.stdout:4/82: symlink d1/d8/l14 0 2024-09-13T02:53:51.733 INFO:tasks.workunit.client.1.smithi131.stdout:4/83: creat d1/d8/f15 x:0 0 0 2024-09-13T02:53:51.734 INFO:tasks.workunit.client.1.smithi131.stdout:4/84: creat d1/f16 x:0 0 0 2024-09-13T02:53:51.734 INFO:tasks.workunit.client.1.smithi131.stdout:4/85: creat d1/d8/f17 x:0 0 0 2024-09-13T02:53:51.734 INFO:tasks.workunit.client.1.smithi131.stdout:4/86: chown d1/dc/f10 9 1 2024-09-13T02:53:51.738 INFO:tasks.workunit.client.1.smithi131.stdout:4/87: dread d1/d8/ff [0,4194304] 0 2024-09-13T02:53:51.740 INFO:tasks.workunit.client.1.smithi131.stdout:8/202: dwrite db/f19 [0,4194304] 0 2024-09-13T02:53:51.740 INFO:tasks.workunit.client.1.smithi131.stdout:5/121: dwrite d1/d5/f13 [0,4194304] 0 2024-09-13T02:53:51.741 INFO:tasks.workunit.client.1.smithi131.stdout:1/150: dwrite dd/ff [0,4194304] 0 2024-09-13T02:53:51.741 INFO:tasks.workunit.client.1.smithi131.stdout:1/151: creat dd/d26/d2a/d2c/f34 x:0 0 0 2024-09-13T02:53:51.741 INFO:tasks.workunit.client.1.smithi131.stdout:8/203: rmdir db/d1d/d34 39 2024-09-13T02:53:51.742 INFO:tasks.workunit.client.1.smithi131.stdout:0/148: dwrite d0/f12 [0,4194304] 0 2024-09-13T02:53:51.742 INFO:tasks.workunit.client.1.smithi131.stdout:0/149: write d0/f26 [2050674,108907] 0 2024-09-13T02:53:51.745 INFO:tasks.workunit.client.1.smithi131.stdout:9/120: rename d0/d3/d14/f20 to d0/d3/d14/d17/f21 0 2024-09-13T02:53:51.745 INFO:tasks.workunit.client.1.smithi131.stdout:8/204: read db/f30 [2621909,125868] 0 2024-09-13T02:53:51.745 INFO:tasks.workunit.client.1.smithi131.stdout:9/121: truncate d0/d3/d14/d17/f21 5092651 0 2024-09-13T02:53:51.745 INFO:tasks.workunit.client.1.smithi131.stdout:8/205: chown db/d1d/d1f/f2c 34614 1 2024-09-13T02:53:51.745 INFO:tasks.workunit.client.1.smithi131.stdout:9/122: write d0/f10 [1454315,64988] 0 2024-09-13T02:53:51.746 INFO:tasks.workunit.client.1.smithi131.stdout:9/123: fsync d0/f9 0 2024-09-13T02:53:51.749 INFO:tasks.workunit.client.1.smithi131.stdout:3/101: getdents d2/d4/d7/d1d 0 2024-09-13T02:53:51.749 INFO:tasks.workunit.client.1.smithi131.stdout:3/102: write d2/f12 [2912015,103271] 0 2024-09-13T02:53:51.750 INFO:tasks.workunit.client.1.smithi131.stdout:3/103: chown d2/d4/d7/d8/l16 32691 1 2024-09-13T02:53:51.754 INFO:tasks.workunit.client.1.smithi131.stdout:1/152: unlink dd/d1a/c27 0 2024-09-13T02:53:51.754 INFO:tasks.workunit.client.1.smithi131.stdout:4/88: truncate d1/d8/f9 2195883 0 2024-09-13T02:53:51.756 INFO:tasks.workunit.client.1.smithi131.stdout:8/206: dread db/f2a [0,4194304] 0 2024-09-13T02:53:51.756 INFO:tasks.workunit.client.1.smithi131.stdout:8/207: chown db/l1b 0 1 2024-09-13T02:53:51.756 INFO:tasks.workunit.client.1.smithi131.stdout:0/150: creat d0/de/d1f/d22/d31/f3a x:0 0 0 2024-09-13T02:53:51.758 INFO:tasks.workunit.client.1.smithi131.stdout:6/127: rename d1/d16 to d1/d8/d9/db/d15/d26 0 2024-09-13T02:53:51.760 INFO:tasks.workunit.client.1.smithi131.stdout:3/104: write d2/d4/f9 [5177841,36298] 0 2024-09-13T02:53:51.760 INFO:tasks.workunit.client.1.smithi131.stdout:3/105: readlink d2/d4/d7/d8/l13 0 2024-09-13T02:53:51.760 INFO:tasks.workunit.client.1.smithi131.stdout:8/208: truncate db/f15 674494 0 2024-09-13T02:53:51.760 INFO:tasks.workunit.client.1.smithi131.stdout:4/89: fsync d1/d8/f17 0 2024-09-13T02:53:51.761 INFO:tasks.workunit.client.1.smithi131.stdout:6/128: mknod d1/d14/c27 0 2024-09-13T02:53:51.761 INFO:tasks.workunit.client.1.smithi131.stdout:6/129: chown d1/c10 223 1 2024-09-13T02:53:51.762 INFO:tasks.workunit.client.1.smithi131.stdout:3/106: creat d2/d4/d7/d1d/f25 x:0 0 0 2024-09-13T02:53:51.764 INFO:tasks.workunit.client.1.smithi131.stdout:5/122: dwrite d1/d29/f2b [0,4194304] 0 2024-09-13T02:53:51.764 INFO:tasks.workunit.client.1.smithi131.stdout:5/123: read - d1/f1b zero size 2024-09-13T02:53:51.764 INFO:tasks.workunit.client.1.smithi131.stdout:8/209: rename db/le to db/d2b/d39/l3d 0 2024-09-13T02:53:51.764 INFO:tasks.workunit.client.1.smithi131.stdout:8/210: fdatasync db/f17 0 2024-09-13T02:53:51.764 INFO:tasks.workunit.client.1.smithi131.stdout:8/211: write db/f30 [4722405,99392] 0 2024-09-13T02:53:51.765 INFO:tasks.workunit.client.1.smithi131.stdout:6/130: link d1/d8/d9/db/d15/d26/d1c/c1e d1/d14/c28 0 2024-09-13T02:53:51.765 INFO:tasks.workunit.client.1.smithi131.stdout:6/131: readlink d1/d8/l21 0 2024-09-13T02:53:51.766 INFO:tasks.workunit.client.1.smithi131.stdout:3/107: truncate d2/ff 97169 0 2024-09-13T02:53:51.768 INFO:tasks.workunit.client.1.smithi131.stdout:1/153: dread f4 [0,4194304] 0 2024-09-13T02:53:51.768 INFO:tasks.workunit.client.1.smithi131.stdout:1/154: creat dd/d26/f35 x:0 0 0 2024-09-13T02:53:51.768 INFO:tasks.workunit.client.1.smithi131.stdout:1/155: chown dd/f15 1008561 1 2024-09-13T02:53:51.768 INFO:tasks.workunit.client.1.smithi131.stdout:1/156: dread - dd/d26/f2d zero size 2024-09-13T02:53:51.770 INFO:tasks.workunit.client.1.smithi131.stdout:5/124: mknod d1/d29/c30 0 2024-09-13T02:53:51.771 INFO:tasks.workunit.client.1.smithi131.stdout:8/212: creat db/d2b/d39/f3e x:0 0 0 2024-09-13T02:53:51.772 INFO:tasks.workunit.client.1.smithi131.stdout:6/132: symlink d1/l29 0 2024-09-13T02:53:51.773 INFO:tasks.workunit.client.1.smithi131.stdout:3/108: rename d2/c3 to d2/d4/d1a/c26 0 2024-09-13T02:53:51.775 INFO:tasks.workunit.client.1.smithi131.stdout:8/213: getdents db/d1d/d1f 0 2024-09-13T02:53:51.776 INFO:tasks.workunit.client.1.smithi131.stdout:6/133: mkdir d1/d8/d9/db/d2a 0 2024-09-13T02:53:51.776 INFO:tasks.workunit.client.1.smithi131.stdout:6/134: truncate d1/d8/d9/fd 477333 0 2024-09-13T02:53:51.776 INFO:tasks.workunit.client.1.smithi131.stdout:6/135: chown d1/d8/d9/db/d15/d26/d1c/c1e 59 1 2024-09-13T02:53:51.777 INFO:tasks.workunit.client.1.smithi131.stdout:1/157: rename dd/d26/l29 to dd/d26/d2a/d2c/l36 0 2024-09-13T02:53:51.778 INFO:tasks.workunit.client.1.smithi131.stdout:6/136: link d1/d8/d9/f17 d1/f2b 0 2024-09-13T02:53:51.780 INFO:tasks.workunit.client.1.smithi131.stdout:5/125: rename d1/d5/fb to d1/d2f/f31 0 2024-09-13T02:53:51.782 INFO:tasks.workunit.client.1.smithi131.stdout:0/151: dwrite d0/f18 [0,4194304] 0 2024-09-13T02:53:51.782 INFO:tasks.workunit.client.1.smithi131.stdout:0/152: readlink d0/de/l37 0 2024-09-13T02:53:51.783 INFO:tasks.workunit.client.1.smithi131.stdout:4/90: dwrite d1/f5 [0,4194304] 0 2024-09-13T02:53:51.783 INFO:tasks.workunit.client.1.smithi131.stdout:1/158: unlink dd/d26/f30 0 2024-09-13T02:53:51.791 INFO:tasks.workunit.client.1.smithi131.stdout:8/214: dread f2 [4194304,4194304] 0 2024-09-13T02:53:51.795 INFO:tasks.workunit.client.1.smithi131.stdout:1/159: rename dd/c1f to dd/d26/d2a/d2c/c37 0 2024-09-13T02:53:51.795 INFO:tasks.workunit.client.1.smithi131.stdout:1/160: read - dd/d1a/f1b zero size 2024-09-13T02:53:51.797 INFO:tasks.workunit.client.1.smithi131.stdout:1/161: mknod dd/d26/d2a/d2c/c38 0 2024-09-13T02:53:51.800 INFO:tasks.workunit.client.1.smithi131.stdout:3/109: link d2/d4/d1a/c26 d2/d4/d7/d1d/d24/c27 0 2024-09-13T02:53:51.800 INFO:tasks.workunit.client.1.smithi131.stdout:3/110: chown d2/d4/d7/d1d/l19 1573183149 1 2024-09-13T02:53:51.800 INFO:tasks.workunit.client.1.smithi131.stdout:3/111: fdatasync d2/f12 0 2024-09-13T02:53:51.800 INFO:tasks.workunit.client.1.smithi131.stdout:3/112: creat d2/d4/f28 x:0 0 0 2024-09-13T02:53:51.800 INFO:tasks.workunit.client.1.smithi131.stdout:3/113: dread - d2/d4/d7/d1d/f21 zero size 2024-09-13T02:53:51.800 INFO:tasks.workunit.client.1.smithi131.stdout:4/91: dread d1/f5 [0,4194304] 0 2024-09-13T02:53:51.800 INFO:tasks.workunit.client.1.smithi131.stdout:4/92: stat d1/dc/fd 0 2024-09-13T02:53:51.801 INFO:tasks.workunit.client.1.smithi131.stdout:0/153: write d0/f2b [3920089,119199] 0 2024-09-13T02:53:51.801 INFO:tasks.workunit.client.1.smithi131.stdout:3/114: rename d2/d4/d7/d8/l13 to d2/d4/d1a/l29 0 2024-09-13T02:53:51.803 INFO:tasks.workunit.client.1.smithi131.stdout:5/126: dwrite d1/fc [0,4194304] 0 2024-09-13T02:53:51.803 INFO:tasks.workunit.client.1.smithi131.stdout:4/93: unlink d1/dc/f10 0 2024-09-13T02:53:51.803 INFO:tasks.workunit.client.1.smithi131.stdout:0/154: mknod d0/de/d1f/d22/d31/c3b 0 2024-09-13T02:53:51.804 INFO:tasks.workunit.client.1.smithi131.stdout:3/115: creat d2/dc/f2a x:0 0 0 2024-09-13T02:53:51.806 INFO:tasks.workunit.client.1.smithi131.stdout:6/137: dwrite d1/f7 [0,4194304] 0 2024-09-13T02:53:51.806 INFO:tasks.workunit.client.1.smithi131.stdout:5/127: rmdir d1/d5 39 2024-09-13T02:53:51.808 INFO:tasks.workunit.client.1.smithi131.stdout:3/116: symlink d2/d4/l2b 0 2024-09-13T02:53:51.808 INFO:tasks.workunit.client.1.smithi131.stdout:3/117: readlink d2/d4/d7/d8/l16 0 2024-09-13T02:53:51.808 INFO:tasks.workunit.client.1.smithi131.stdout:3/118: creat d2/d4/d7/d1d/f2c x:0 0 0 2024-09-13T02:53:51.808 INFO:tasks.workunit.client.1.smithi131.stdout:3/119: write d2/ff [99248,89114] 0 2024-09-13T02:53:51.809 INFO:tasks.workunit.client.1.smithi131.stdout:1/162: dread dd/f15 [0,4194304] 0 2024-09-13T02:53:51.809 INFO:tasks.workunit.client.1.smithi131.stdout:3/120: write d2/d4/d7/d1d/f25 [153643,129731] 0 2024-09-13T02:53:51.810 INFO:tasks.workunit.client.1.smithi131.stdout:6/138: getdents d1/d8/d9/db/d15 0 2024-09-13T02:53:51.811 INFO:tasks.workunit.client.1.smithi131.stdout:4/94: mkdir d1/d18 0 2024-09-13T02:53:51.812 INFO:tasks.workunit.client.1.smithi131.stdout:5/128: write d1/f2c [1126162,124954] 0 2024-09-13T02:53:51.812 INFO:tasks.workunit.client.1.smithi131.stdout:6/139: rename d1/d14/f22 to d1/d8/f2c 0 2024-09-13T02:53:51.812 INFO:tasks.workunit.client.1.smithi131.stdout:6/140: creat d1/d8/f2d x:0 0 0 2024-09-13T02:53:51.814 INFO:tasks.workunit.client.1.smithi131.stdout:4/95: mkdir d1/dc/d19 0 2024-09-13T02:53:51.814 INFO:tasks.workunit.client.1.smithi131.stdout:4/96: dread - d1/dc/fd zero size 2024-09-13T02:53:51.815 INFO:tasks.workunit.client.1.smithi131.stdout:4/97: dread - d1/f16 zero size 2024-09-13T02:53:51.816 INFO:tasks.workunit.client.1.smithi131.stdout:0/155: dread d0/f26 [0,4194304] 0 2024-09-13T02:53:51.816 INFO:tasks.workunit.client.1.smithi131.stdout:1/163: rmdir dd/d1a 39 2024-09-13T02:53:51.816 INFO:tasks.workunit.client.1.smithi131.stdout:1/164: stat dd/d26/d2a/d2c/f34 0 2024-09-13T02:53:51.818 INFO:tasks.workunit.client.1.smithi131.stdout:6/141: symlink d1/d8/d9/db/d15/l2e 0 2024-09-13T02:53:51.818 INFO:tasks.workunit.client.1.smithi131.stdout:0/156: readlink d0/de/l1c 0 2024-09-13T02:53:51.819 INFO:tasks.workunit.client.1.smithi131.stdout:6/142: mknod d1/d8/d9/db/d15/d26/d1c/c2f 0 2024-09-13T02:53:51.820 INFO:tasks.workunit.client.1.smithi131.stdout:8/215: dwrite db/d1d/d31/f37 [0,4194304] 0 2024-09-13T02:53:51.820 INFO:tasks.workunit.client.1.smithi131.stdout:0/157: mkdir d0/de/d1f/d22/d31/d39/d3c 0 2024-09-13T02:53:51.820 INFO:tasks.workunit.client.1.smithi131.stdout:0/158: fdatasync d0/de/d1f/d22/f29 0 2024-09-13T02:53:51.820 INFO:tasks.workunit.client.1.smithi131.stdout:6/143: mkdir d1/d8/d9/db/d15/d30 0 2024-09-13T02:53:51.821 INFO:tasks.workunit.client.1.smithi131.stdout:7/82: sync 2024-09-13T02:53:51.822 INFO:tasks.workunit.client.1.smithi131.stdout:0/159: mkdir d0/de/d1f/d22/d3d 0 2024-09-13T02:53:51.823 INFO:tasks.workunit.client.1.smithi131.stdout:0/160: readlink d0/l20 0 2024-09-13T02:53:51.823 INFO:tasks.workunit.client.1.smithi131.stdout:0/161: fdatasync d0/de/f38 0 2024-09-13T02:53:51.823 INFO:tasks.workunit.client.1.smithi131.stdout:0/162: truncate d0/de/f1a 717757 0 2024-09-13T02:53:51.824 INFO:tasks.workunit.client.1.smithi131.stdout:6/144: dread d1/f4 [0,4194304] 0 2024-09-13T02:53:51.824 INFO:tasks.workunit.client.1.smithi131.stdout:6/145: chown d1/d8/f2d 2 1 2024-09-13T02:53:51.824 INFO:tasks.workunit.client.1.smithi131.stdout:6/146: chown d1/d8/d9/db/d2a 569 1 2024-09-13T02:53:51.824 INFO:tasks.workunit.client.1.smithi131.stdout:6/147: readlink d1/d8/l21 0 2024-09-13T02:53:51.824 INFO:tasks.workunit.client.1.smithi131.stdout:6/148: write d1/d14/f20 [106379,52316] 0 2024-09-13T02:53:51.824 INFO:tasks.workunit.client.1.smithi131.stdout:7/83: creat f18 x:0 0 0 2024-09-13T02:53:51.825 INFO:tasks.workunit.client.1.smithi131.stdout:0/163: link d0/de/d1f/d22/d31/c3b d0/de/d1f/d22/d31/c3e 0 2024-09-13T02:53:51.827 INFO:tasks.workunit.client.1.smithi131.stdout:6/149: creat d1/d8/d9/db/d15/f31 x:0 0 0 2024-09-13T02:53:51.827 INFO:tasks.workunit.client.1.smithi131.stdout:6/150: chown d1/d8/l21 29574999 1 2024-09-13T02:53:51.827 INFO:tasks.workunit.client.1.smithi131.stdout:8/216: dread db/f30 [0,4194304] 0 2024-09-13T02:53:51.827 INFO:tasks.workunit.client.1.smithi131.stdout:7/84: mknod c19 0 2024-09-13T02:53:51.827 INFO:tasks.workunit.client.1.smithi131.stdout:7/85: rmdir - no directory 2024-09-13T02:53:51.828 INFO:tasks.workunit.client.1.smithi131.stdout:0/164: creat d0/d2/f3f x:0 0 0 2024-09-13T02:53:51.829 INFO:tasks.workunit.client.1.smithi131.stdout:6/151: symlink d1/d8/d9/db/l32 0 2024-09-13T02:53:51.829 INFO:tasks.workunit.client.1.smithi131.stdout:6/152: chown d1/d8/f2c 1 1 2024-09-13T02:53:51.830 INFO:tasks.workunit.client.1.smithi131.stdout:8/217: creat db/d1d/d34/f3f x:0 0 0 2024-09-13T02:53:51.830 INFO:tasks.workunit.client.1.smithi131.stdout:8/218: write db/d1d/d31/f37 [4229330,11577] 0 2024-09-13T02:53:51.831 INFO:tasks.workunit.client.1.smithi131.stdout:7/86: symlink l1a 0 2024-09-13T02:53:51.832 INFO:tasks.workunit.client.1.smithi131.stdout:7/87: fsync f4 0 2024-09-13T02:53:51.832 INFO:tasks.workunit.client.1.smithi131.stdout:7/88: truncate f18 335247 0 2024-09-13T02:53:51.832 INFO:tasks.workunit.client.1.smithi131.stdout:7/89: stat c9 0 2024-09-13T02:53:51.832 INFO:tasks.workunit.client.1.smithi131.stdout:7/90: dread - f13 zero size 2024-09-13T02:53:51.833 INFO:tasks.workunit.client.1.smithi131.stdout:0/165: mkdir d0/de/d1f/d22/d31/d39/d40 0 2024-09-13T02:53:51.834 INFO:tasks.workunit.client.1.smithi131.stdout:6/153: creat d1/d8/d9/db/d2a/f33 x:0 0 0 2024-09-13T02:53:51.836 INFO:tasks.workunit.client.1.smithi131.stdout:7/91: unlink c16 0 2024-09-13T02:53:51.838 INFO:tasks.workunit.client.1.smithi131.stdout:0/166: mkdir d0/d2/d41 0 2024-09-13T02:53:51.838 INFO:tasks.workunit.client.1.smithi131.stdout:0/167: fsync d0/de/d1f/d22/f29 0 2024-09-13T02:53:51.839 INFO:tasks.workunit.client.1.smithi131.stdout:8/219: getdents db/d2b/d39 0 2024-09-13T02:53:51.839 INFO:tasks.workunit.client.1.smithi131.stdout:8/220: readlink l0 0 2024-09-13T02:53:51.840 INFO:tasks.workunit.client.1.smithi131.stdout:7/92: mkdir d1b 0 2024-09-13T02:53:51.840 INFO:tasks.workunit.client.1.smithi131.stdout:8/221: mkdir db/d2e/d40 0 2024-09-13T02:53:51.840 INFO:tasks.workunit.client.1.smithi131.stdout:8/222: chown f8 3172 1 2024-09-13T02:53:51.841 INFO:tasks.workunit.client.1.smithi131.stdout:3/121: dwrite d2/dc/f1b [0,4194304] 0 2024-09-13T02:53:51.841 INFO:tasks.workunit.client.1.smithi131.stdout:8/223: mkdir db/d1d/d1f/d41 0 2024-09-13T02:53:51.842 INFO:tasks.workunit.client.1.smithi131.stdout:1/165: dwrite dd/ff [4194304,4194304] 0 2024-09-13T02:53:51.842 INFO:tasks.workunit.client.1.smithi131.stdout:1/166: stat fc 0 2024-09-13T02:53:51.842 INFO:tasks.workunit.client.1.smithi131.stdout:4/98: dwrite d1/f6 [0,4194304] 0 2024-09-13T02:53:51.846 INFO:tasks.workunit.client.1.smithi131.stdout:3/122: stat d2/d4/d1a/l29 0 2024-09-13T02:53:51.847 INFO:tasks.workunit.client.1.smithi131.stdout:8/224: mknod db/d2b/c42 0 2024-09-13T02:53:51.849 INFO:tasks.workunit.client.1.smithi131.stdout:7/93: fsync f18 0 2024-09-13T02:53:51.849 INFO:tasks.workunit.client.1.smithi131.stdout:7/94: chown f10 6985623 1 2024-09-13T02:53:51.849 INFO:tasks.workunit.client.1.smithi131.stdout:7/95: fdatasync fb 0 2024-09-13T02:53:51.850 INFO:tasks.workunit.client.1.smithi131.stdout:4/99: rename d1/d8/f9 to d1/dc/d19/f1a 0 2024-09-13T02:53:51.851 INFO:tasks.workunit.client.1.smithi131.stdout:3/123: mkdir d2/d4/d2d 0 2024-09-13T02:53:51.851 INFO:tasks.workunit.client.1.smithi131.stdout:6/154: dwrite d1/d8/d9/db/ff [0,4194304] 0 2024-09-13T02:53:51.852 INFO:tasks.workunit.client.1.smithi131.stdout:3/124: creat d2/d4/d7/d1d/f2e x:0 0 0 2024-09-13T02:53:51.852 INFO:tasks.workunit.client.1.smithi131.stdout:6/155: chown d1/d8/d9/db/ff 6129568 1 2024-09-13T02:53:51.852 INFO:tasks.workunit.client.1.smithi131.stdout:1/167: rmdir dd/d26/d2a/d2c 39 2024-09-13T02:53:51.854 INFO:tasks.workunit.client.1.smithi131.stdout:7/96: rename l11 to d1b/l1c 0 2024-09-13T02:53:51.854 INFO:tasks.workunit.client.1.smithi131.stdout:7/97: stat ff 0 2024-09-13T02:53:51.854 INFO:tasks.workunit.client.1.smithi131.stdout:7/98: write f7 [1423113,9760] 0 2024-09-13T02:53:51.854 INFO:tasks.workunit.client.1.smithi131.stdout:4/100: mknod d1/dc/c1b 0 2024-09-13T02:53:51.855 INFO:tasks.workunit.client.1.smithi131.stdout:4/101: fdatasync d1/dc/d19/f1a 0 2024-09-13T02:53:51.857 INFO:tasks.workunit.client.1.smithi131.stdout:3/125: link d2/d4/d7/d8/l16 d2/d4/d7/d8/l2f 0 2024-09-13T02:53:51.857 INFO:tasks.workunit.client.1.smithi131.stdout:3/126: write d2/d4/d1a/f1e [965441,110043] 0 2024-09-13T02:53:51.857 INFO:tasks.workunit.client.1.smithi131.stdout:3/127: creat d2/d4/d7/d1d/f30 x:0 0 0 2024-09-13T02:53:51.858 INFO:tasks.workunit.client.1.smithi131.stdout:3/128: stat d2/dc 0 2024-09-13T02:53:51.858 INFO:tasks.workunit.client.1.smithi131.stdout:1/168: truncate f8 665231 0 2024-09-13T02:53:51.859 INFO:tasks.workunit.client.1.smithi131.stdout:7/99: rename le to d1b/l1d 0 2024-09-13T02:53:51.860 INFO:tasks.workunit.client.1.smithi131.stdout:4/102: creat d1/d8/d13/f1c x:0 0 0 2024-09-13T02:53:51.864 INFO:tasks.workunit.client.1.smithi131.stdout:3/129: mkdir d2/d4/d1a/d31 0 2024-09-13T02:53:51.864 INFO:tasks.workunit.client.1.smithi131.stdout:1/169: rmdir dd/d26/d2a 39 2024-09-13T02:53:51.865 INFO:tasks.workunit.client.1.smithi131.stdout:7/100: rename c19 to d1b/c1e 0 2024-09-13T02:53:51.866 INFO:tasks.workunit.client.1.smithi131.stdout:4/103: rename d1/d8/d13/f1c to d1/d8/f1d 0 2024-09-13T02:53:51.868 INFO:tasks.workunit.client.1.smithi131.stdout:2/90: sync 2024-09-13T02:53:51.872 INFO:tasks.workunit.client.1.smithi131.stdout:7/101: dread f4 [0,4194304] 0 2024-09-13T02:53:51.873 INFO:tasks.workunit.client.1.smithi131.stdout:2/91: rename d5/dd/d10 to d5/d18 0 2024-09-13T02:53:51.873 INFO:tasks.workunit.client.1.smithi131.stdout:2/92: fdatasync f4 0 2024-09-13T02:53:51.874 INFO:tasks.workunit.client.1.smithi131.stdout:4/104: unlink d1/dc/d19/f1a 0 2024-09-13T02:53:51.876 INFO:tasks.workunit.client.1.smithi131.stdout:7/102: rename f12 to d1b/f1f 0 2024-09-13T02:53:51.876 INFO:tasks.workunit.client.1.smithi131.stdout:7/103: readlink l17 0 2024-09-13T02:53:51.877 INFO:tasks.workunit.client.1.smithi131.stdout:2/93: mkdir d5/d19 0 2024-09-13T02:53:51.877 INFO:tasks.workunit.client.1.smithi131.stdout:2/94: creat d5/dd/f1a x:0 0 0 2024-09-13T02:53:51.878 INFO:tasks.workunit.client.1.smithi131.stdout:6/156: dwrite d1/fe [0,4194304] 0 2024-09-13T02:53:51.878 INFO:tasks.workunit.client.1.smithi131.stdout:6/157: creat d1/d14/f34 x:0 0 0 2024-09-13T02:53:51.879 INFO:tasks.workunit.client.1.smithi131.stdout:2/95: rmdir d5/d19 0 2024-09-13T02:53:51.881 INFO:tasks.workunit.client.1.smithi131.stdout:6/158: dread d1/f4 [0,4194304] 0 2024-09-13T02:53:51.882 INFO:tasks.workunit.client.1.smithi131.stdout:2/96: creat d5/d18/f1b x:0 0 0 2024-09-13T02:53:51.884 INFO:tasks.workunit.client.1.smithi131.stdout:6/159: mknod d1/d8/d9/db/d15/d26/c35 0 2024-09-13T02:53:51.884 INFO:tasks.workunit.client.1.smithi131.stdout:3/130: dwrite d2/d4/d1a/f1e [0,4194304] 0 2024-09-13T02:53:51.884 INFO:tasks.workunit.client.1.smithi131.stdout:3/131: chown d2/c22 196 1 2024-09-13T02:53:51.885 INFO:tasks.workunit.client.1.smithi131.stdout:2/97: mknod d5/dd/c1c 0 2024-09-13T02:53:51.887 INFO:tasks.workunit.client.1.smithi131.stdout:6/160: creat d1/d8/d9/db/f36 x:0 0 0 2024-09-13T02:53:51.889 INFO:tasks.workunit.client.1.smithi131.stdout:2/98: dread d5/f9 [0,4194304] 0 2024-09-13T02:53:51.889 INFO:tasks.workunit.client.1.smithi131.stdout:2/99: write d5/dd/f1a [828781,57507] 0 2024-09-13T02:53:51.890 INFO:tasks.workunit.client.1.smithi131.stdout:3/132: rename d2/f10 to d2/d4/d14/f32 0 2024-09-13T02:53:51.892 INFO:tasks.workunit.client.1.smithi131.stdout:2/100: truncate d5/f9 3709144 0 2024-09-13T02:53:51.892 INFO:tasks.workunit.client.1.smithi131.stdout:2/101: chown d5/fa 3157 1 2024-09-13T02:53:51.892 INFO:tasks.workunit.client.1.smithi131.stdout:2/102: stat d5/d18/f14 0 2024-09-13T02:53:51.893 INFO:tasks.workunit.client.1.smithi131.stdout:3/133: creat d2/d4/d2d/f33 x:0 0 0 2024-09-13T02:53:51.893 INFO:tasks.workunit.client.1.smithi131.stdout:3/134: write d2/d4/f23 [325251,16112] 0 2024-09-13T02:53:51.893 INFO:tasks.workunit.client.1.smithi131.stdout:3/135: creat d2/d4/f34 x:0 0 0 2024-09-13T02:53:51.894 INFO:tasks.workunit.client.1.smithi131.stdout:3/136: creat d2/d4/d14/f35 x:0 0 0 2024-09-13T02:53:51.895 INFO:tasks.workunit.client.1.smithi131.stdout:2/103: mkdir d5/dd/d1d 0 2024-09-13T02:53:51.896 INFO:tasks.workunit.client.1.smithi131.stdout:2/104: chown d5/d18 340762020 1 2024-09-13T02:53:51.897 INFO:tasks.workunit.client.1.smithi131.stdout:3/137: rename d2/c22 to d2/d4/d7/c36 0 2024-09-13T02:53:51.897 INFO:tasks.workunit.client.1.smithi131.stdout:3/138: creat d2/d4/d1a/f37 x:0 0 0 2024-09-13T02:53:51.897 INFO:tasks.workunit.client.1.smithi131.stdout:3/139: stat d2/d4/d1a/d31 0 2024-09-13T02:53:51.897 INFO:tasks.workunit.client.1.smithi131.stdout:3/140: fsync d2/dc/f1b 0 2024-09-13T02:53:51.898 INFO:tasks.workunit.client.1.smithi131.stdout:2/105: mkdir d5/d1e 0 2024-09-13T02:53:51.898 INFO:tasks.workunit.client.1.smithi131.stdout:1/170: dwrite dd/f15 [4194304,4194304] 0 2024-09-13T02:53:51.899 INFO:tasks.workunit.client.1.smithi131.stdout:3/141: link d2/d4/d1a/c26 d2/d4/d2d/c38 0 2024-09-13T02:53:51.901 INFO:tasks.workunit.client.1.smithi131.stdout:1/171: creat dd/d26/d2a/d2c/f39 x:0 0 0 2024-09-13T02:53:51.902 INFO:tasks.workunit.client.1.smithi131.stdout:6/161: write d1/fe [725898,59418] 0 2024-09-13T02:53:51.903 INFO:tasks.workunit.client.1.smithi131.stdout:6/162: readlink d1/l29 0 2024-09-13T02:53:51.903 INFO:tasks.workunit.client.1.smithi131.stdout:1/172: creat dd/f3a x:0 0 0 2024-09-13T02:53:51.905 INFO:tasks.workunit.client.1.smithi131.stdout:4/105: dwrite d1/d8/fb [0,4194304] 0 2024-09-13T02:53:51.905 INFO:tasks.workunit.client.1.smithi131.stdout:4/106: readlink d1/l4 0 2024-09-13T02:53:51.905 INFO:tasks.workunit.client.1.smithi131.stdout:6/163: rename d1/c10 to d1/c37 0 2024-09-13T02:53:51.909 INFO:tasks.workunit.client.1.smithi131.stdout:4/107: symlink d1/dc/l1e 0 2024-09-13T02:53:51.909 INFO:tasks.workunit.client.1.smithi131.stdout:4/108: chown d1/f6 7814075 1 2024-09-13T02:53:51.914 INFO:tasks.workunit.client.1.smithi131.stdout:6/164: truncate d1/f7 2243620 0 2024-09-13T02:53:51.914 INFO:tasks.workunit.client.1.smithi131.stdout:2/106: write f4 [1398314,29148] 0 2024-09-13T02:53:51.914 INFO:tasks.workunit.client.1.smithi131.stdout:7/104: dwrite d1b/f1f [0,4194304] 0 2024-09-13T02:53:51.914 INFO:tasks.workunit.client.1.smithi131.stdout:6/165: fdatasync d1/d8/f2d 0 2024-09-13T02:53:51.914 INFO:tasks.workunit.client.1.smithi131.stdout:6/166: write d1/d8/d9/db/f36 [324464,71956] 0 2024-09-13T02:53:51.914 INFO:tasks.workunit.client.1.smithi131.stdout:6/167: read - d1/d8/d9/db/d15/f31 zero size 2024-09-13T02:53:51.914 INFO:tasks.workunit.client.1.smithi131.stdout:1/173: getdents dd/d26 0 2024-09-13T02:53:51.915 INFO:tasks.workunit.client.1.smithi131.stdout:4/109: unlink d1/d8/fa 0 2024-09-13T02:53:51.918 INFO:tasks.workunit.client.1.smithi131.stdout:7/105: link f18 d1b/f20 0 2024-09-13T02:53:51.919 INFO:tasks.workunit.client.1.smithi131.stdout:3/142: dwrite d2/d4/d2d/f33 [0,4194304] 0 2024-09-13T02:53:51.919 INFO:tasks.workunit.client.1.smithi131.stdout:3/143: readlink d2/d4/d1a/l29 0 2024-09-13T02:53:51.919 INFO:tasks.workunit.client.1.smithi131.stdout:2/107: symlink d5/dd/d1d/l1f 0 2024-09-13T02:53:51.920 INFO:tasks.workunit.client.1.smithi131.stdout:7/106: dread f3 [0,4194304] 0 2024-09-13T02:53:51.921 INFO:tasks.workunit.client.1.smithi131.stdout:1/174: rename dd/d1a/f1b to dd/d1a/f3b 0 2024-09-13T02:53:51.921 INFO:tasks.workunit.client.1.smithi131.stdout:1/175: fdatasync dd/f3a 0 2024-09-13T02:53:51.922 INFO:tasks.workunit.client.1.smithi131.stdout:1/176: creat dd/f3c x:0 0 0 2024-09-13T02:53:51.923 INFO:tasks.workunit.client.1.smithi131.stdout:4/110: mknod d1/d8/c1f 0 2024-09-13T02:53:51.923 INFO:tasks.workunit.client.1.smithi131.stdout:4/111: creat d1/dc/f20 x:0 0 0 2024-09-13T02:53:51.926 INFO:tasks.workunit.client.1.smithi131.stdout:3/144: mkdir d2/dc/d39 0 2024-09-13T02:53:51.928 INFO:tasks.workunit.client.1.smithi131.stdout:2/108: rename d5/dd/f1a to d5/d1e/f20 0 2024-09-13T02:53:51.929 INFO:tasks.workunit.client.1.smithi131.stdout:7/107: creat d1b/f21 x:0 0 0 2024-09-13T02:53:51.930 INFO:tasks.workunit.client.1.smithi131.stdout:6/168: dwrite d1/d8/d9/f19 [0,4194304] 0 2024-09-13T02:53:51.931 INFO:tasks.workunit.client.1.smithi131.stdout:1/177: mknod dd/d26/d2a/d2c/c3d 0 2024-09-13T02:53:51.932 INFO:tasks.workunit.client.1.smithi131.stdout:3/145: creat d2/d4/d7/d1d/d24/f3a x:0 0 0 2024-09-13T02:53:51.934 INFO:tasks.workunit.client.1.smithi131.stdout:2/109: mkdir d5/dd/d21 0 2024-09-13T02:53:51.934 INFO:tasks.workunit.client.1.smithi131.stdout:3/146: dread d2/ff [0,4194304] 0 2024-09-13T02:53:51.934 INFO:tasks.workunit.client.1.smithi131.stdout:7/108: rename d1b/c1e to d1b/c22 0 2024-09-13T02:53:51.938 INFO:tasks.workunit.client.1.smithi131.stdout:1/178: unlink dd/d26/d2a/d2c/f2f 0 2024-09-13T02:53:51.938 INFO:tasks.workunit.client.1.smithi131.stdout:1/179: dread - dd/f16 zero size 2024-09-13T02:53:51.939 INFO:tasks.workunit.client.1.smithi131.stdout:3/147: rename d2/ce to d2/d4/d7/c3b 0 2024-09-13T02:53:51.939 INFO:tasks.workunit.client.1.smithi131.stdout:3/148: chown d2 180190 1 2024-09-13T02:53:51.939 INFO:tasks.workunit.client.1.smithi131.stdout:6/169: dread d1/d8/d9/db/ff [0,4194304] 0 2024-09-13T02:53:51.939 INFO:tasks.workunit.client.1.smithi131.stdout:6/170: creat d1/d8/f38 x:0 0 0 2024-09-13T02:53:51.940 INFO:tasks.workunit.client.1.smithi131.stdout:3/149: mknod d2/d4/d14/c3c 0 2024-09-13T02:53:51.943 INFO:tasks.workunit.client.1.smithi131.stdout:9/124: sync 2024-09-13T02:53:51.943 INFO:tasks.workunit.client.1.smithi131.stdout:6/171: symlink d1/d8/d9/db/d2a/l39 0 2024-09-13T02:53:51.946 INFO:tasks.workunit.client.1.smithi131.stdout:9/125: link d0/d3/lf d0/l22 0 2024-09-13T02:53:51.946 INFO:tasks.workunit.client.1.smithi131.stdout:9/126: write d0/f10 [2558571,33569] 0 2024-09-13T02:53:51.946 INFO:tasks.workunit.client.1.smithi131.stdout:9/127: fsync d0/d3/d14/d1a/f1d 0 2024-09-13T02:53:51.946 INFO:tasks.workunit.client.1.smithi131.stdout:9/128: write d0/fb [3821969,101099] 0 2024-09-13T02:53:51.948 INFO:tasks.workunit.client.1.smithi131.stdout:6/172: creat d1/d8/d9/db/d15/d26/f3a x:0 0 0 2024-09-13T02:53:51.949 INFO:tasks.workunit.client.1.smithi131.stdout:6/173: write d1/d8/d9/db/d15/d26/f3a [660896,19984] 0 2024-09-13T02:53:51.953 INFO:tasks.workunit.client.1.smithi131.stdout:3/150: dread d2/d4/d1a/f1e [0,4194304] 0 2024-09-13T02:53:51.955 INFO:tasks.workunit.client.1.smithi131.stdout:1/180: write dd/d1a/f1e [715906,116167] 0 2024-09-13T02:53:51.955 INFO:tasks.workunit.client.1.smithi131.stdout:1/181: fdatasync dd/d26/f2d 0 2024-09-13T02:53:51.955 INFO:tasks.workunit.client.1.smithi131.stdout:1/182: fdatasync dd/d1a/f32 0 2024-09-13T02:53:51.955 INFO:tasks.workunit.client.1.smithi131.stdout:1/183: truncate dd/f3c 937931 0 2024-09-13T02:53:51.955 INFO:tasks.workunit.client.1.smithi131.stdout:1/184: chown f8 3536449 1 2024-09-13T02:53:51.957 INFO:tasks.workunit.client.1.smithi131.stdout:1/185: mknod dd/d33/c3e 0 2024-09-13T02:53:51.960 INFO:tasks.workunit.client.1.smithi131.stdout:6/174: rmdir d1/d8/d9/db/d15 39 2024-09-13T02:53:51.965 INFO:tasks.workunit.client.1.smithi131.stdout:2/110: dwrite f4 [0,4194304] 0 2024-09-13T02:53:51.965 INFO:tasks.workunit.client.1.smithi131.stdout:7/109: dwrite ff [0,4194304] 0 2024-09-13T02:53:51.965 INFO:tasks.workunit.client.1.smithi131.stdout:7/110: read - d1b/f21 zero size 2024-09-13T02:53:51.967 INFO:tasks.workunit.client.1.smithi131.stdout:2/111: mkdir d5/dd/d22 0 2024-09-13T02:53:51.967 INFO:tasks.workunit.client.1.smithi131.stdout:2/112: write d5/d18/f1b [749902,54888] 0 2024-09-13T02:53:51.971 INFO:tasks.workunit.client.1.smithi131.stdout:2/113: link d5/dd/c1c d5/dd/d22/c23 0 2024-09-13T02:53:51.971 INFO:tasks.workunit.client.1.smithi131.stdout:2/114: write d5/dd/f16 [1016383,2396] 0 2024-09-13T02:53:51.971 INFO:tasks.workunit.client.1.smithi131.stdout:2/115: write d5/fe [642590,121093] 0 2024-09-13T02:53:51.971 INFO:tasks.workunit.client.1.smithi131.stdout:2/116: chown d5/d18/f14 5095 1 2024-09-13T02:53:51.971 INFO:tasks.workunit.client.1.smithi131.stdout:2/117: readlink d5/dd/d1d/l1f 0 2024-09-13T02:53:51.971 INFO:tasks.workunit.client.1.smithi131.stdout:2/118: truncate d5/dd/f16 1466923 0 2024-09-13T02:53:51.974 INFO:tasks.workunit.client.1.smithi131.stdout:2/119: link d5/fa d5/dd/d21/f24 0 2024-09-13T02:53:51.976 INFO:tasks.workunit.client.1.smithi131.stdout:3/151: dwrite d2/d4/f34 [0,4194304] 0 2024-09-13T02:53:51.978 INFO:tasks.workunit.client.1.smithi131.stdout:3/152: getdents d2/dc 0 2024-09-13T02:53:51.980 INFO:tasks.workunit.client.1.smithi131.stdout:3/153: creat d2/dc/d39/f3d x:0 0 0 2024-09-13T02:53:51.980 INFO:tasks.workunit.client.1.smithi131.stdout:3/154: creat d2/d4/d14/f3e x:0 0 0 2024-09-13T02:53:51.980 INFO:tasks.workunit.client.1.smithi131.stdout:3/155: creat d2/d4/d7/d1d/f3f x:0 0 0 2024-09-13T02:53:51.981 INFO:tasks.workunit.client.1.smithi131.stdout:3/156: rename d2/ff to d2/f40 0 2024-09-13T02:53:51.982 INFO:tasks.workunit.client.1.smithi131.stdout:3/157: chown d2/d4/d14/f32 57333285 1 2024-09-13T02:53:51.982 INFO:tasks.workunit.client.1.smithi131.stdout:3/158: unlink d2/d4/d7/d1d/d24/c27 0 2024-09-13T02:53:51.982 INFO:tasks.workunit.client.1.smithi131.stdout:3/159: dread - d2/d4/d7/d1d/f3f zero size 2024-09-13T02:53:51.990 INFO:tasks.workunit.client.1.smithi131.stdout:7/111: dwrite f4 [0,4194304] 0 2024-09-13T02:53:51.991 INFO:tasks.workunit.client.1.smithi131.stdout:7/112: write f13 [505866,81073] 0 2024-09-13T02:53:51.995 INFO:tasks.workunit.client.1.smithi131.stdout:1/186: dwrite dd/d1a/f23 [0,4194304] 0 2024-09-13T02:53:51.995 INFO:tasks.workunit.client.1.smithi131.stdout:1/187: fdatasync dd/f3a 0 2024-09-13T02:53:51.995 INFO:tasks.workunit.client.1.smithi131.stdout:1/188: dread - dd/d1a/f28 zero size 2024-09-13T02:53:51.995 INFO:tasks.workunit.client.1.smithi131.stdout:1/189: chown dd/d26/d2a/d2c/c3d 26 1 2024-09-13T02:53:51.997 INFO:tasks.workunit.client.1.smithi131.stdout:1/190: mknod dd/d26/d2a/c3f 0 2024-09-13T02:53:51.998 INFO:tasks.workunit.client.1.smithi131.stdout:1/191: creat dd/d1a/f40 x:0 0 0 2024-09-13T02:53:52.005 INFO:tasks.workunit.client.1.smithi131.stdout:9/129: dwrite d0/f10 [0,4194304] 0 2024-09-13T02:53:52.005 INFO:tasks.workunit.client.1.smithi131.stdout:9/130: chown d0/d3/d14/l1b 2 1 2024-09-13T02:53:52.006 INFO:tasks.workunit.client.1.smithi131.stdout:6/175: dwrite d1/d8/f1b [0,4194304] 0 2024-09-13T02:53:52.006 INFO:tasks.workunit.client.1.smithi131.stdout:3/160: dwrite d2/d4/d1a/f1e [0,4194304] 0 2024-09-13T02:53:52.006 INFO:tasks.workunit.client.1.smithi131.stdout:2/120: getdents d5/dd 0 2024-09-13T02:53:52.009 INFO:tasks.workunit.client.1.smithi131.stdout:6/176: mkdir d1/d8/d9/db/d2a/d3b 0 2024-09-13T02:53:52.011 INFO:tasks.workunit.client.1.smithi131.stdout:2/121: link d5/dd/c1c d5/c25 0 2024-09-13T02:53:52.011 INFO:tasks.workunit.client.1.smithi131.stdout:2/122: write d5/d1e/f20 [1325677,46161] 0 2024-09-13T02:53:52.013 INFO:tasks.workunit.client.1.smithi131.stdout:6/177: creat d1/d8/d9/db/d15/f3c x:0 0 0 2024-09-13T02:53:52.016 INFO:tasks.workunit.client.1.smithi131.stdout:6/178: rmdir d1/d8/d9/db/d15/d30 0 2024-09-13T02:53:52.016 INFO:tasks.workunit.client.1.smithi131.stdout:6/179: write d1/d8/f1a [712624,22751] 0 2024-09-13T02:53:52.016 INFO:tasks.workunit.client.1.smithi131.stdout:6/180: chown d1/d8/f1b 2737749 1 2024-09-13T02:53:52.018 INFO:tasks.workunit.client.1.smithi131.stdout:3/161: truncate d2/d4/f34 636222 0 2024-09-13T02:53:52.019 INFO:tasks.workunit.client.1.smithi131.stdout:7/113: dwrite d1b/f21 [0,4194304] 0 2024-09-13T02:53:52.020 INFO:tasks.workunit.client.1.smithi131.stdout:3/162: mkdir d2/d4/d7/d8/d41 0 2024-09-13T02:53:52.020 INFO:tasks.workunit.client.1.smithi131.stdout:3/163: dread - d2/d4/d7/d1d/f21 zero size 2024-09-13T02:53:52.021 INFO:tasks.workunit.client.1.smithi131.stdout:3/164: read - d2/d4/d7/d1d/f21 zero size 2024-09-13T02:53:52.022 INFO:tasks.workunit.client.1.smithi131.stdout:6/181: dread d1/fe [0,4194304] 0 2024-09-13T02:53:52.022 INFO:tasks.workunit.client.1.smithi131.stdout:6/182: chown d1/d8/d9/db/l1f 9495199 1 2024-09-13T02:53:52.026 INFO:tasks.workunit.client.1.smithi131.stdout:7/114: dread f1 [0,4194304] 0 2024-09-13T02:53:52.029 INFO:tasks.workunit.client.1.smithi131.stdout:7/115: mkdir d1b/d23 0 2024-09-13T02:53:52.038 INFO:tasks.workunit.client.1.smithi131.stdout:6/183: rmdir d1/d8/d9/db/d15 39 2024-09-13T02:53:52.039 INFO:tasks.workunit.client.1.smithi131.stdout:1/192: dwrite dd/d1a/f22 [0,4194304] 0 2024-09-13T02:53:52.039 INFO:tasks.workunit.client.1.smithi131.stdout:6/184: creat d1/d8/d9/db/d15/f3d x:0 0 0 2024-09-13T02:53:52.039 INFO:tasks.workunit.client.1.smithi131.stdout:6/185: creat d1/d8/f3e x:0 0 0 2024-09-13T02:53:52.042 INFO:tasks.workunit.client.1.smithi131.stdout:1/193: symlink dd/d1a/l41 0 2024-09-13T02:53:52.045 INFO:tasks.workunit.client.1.smithi131.stdout:6/186: mknod d1/d8/d9/db/d2a/d3b/c3f 0 2024-09-13T02:53:52.045 INFO:tasks.workunit.client.1.smithi131.stdout:9/131: dwrite d0/fb [0,4194304] 0 2024-09-13T02:53:52.045 INFO:tasks.workunit.client.1.smithi131.stdout:9/132: chown d0/c18 3 1 2024-09-13T02:53:52.045 INFO:tasks.workunit.client.1.smithi131.stdout:1/194: mkdir dd/d33/d42 0 2024-09-13T02:53:52.046 INFO:tasks.workunit.client.1.smithi131.stdout:1/195: creat dd/f43 x:0 0 0 2024-09-13T02:53:52.046 INFO:tasks.workunit.client.1.smithi131.stdout:6/187: mkdir d1/d8/d9/db/d40 0 2024-09-13T02:53:52.049 INFO:tasks.workunit.client.1.smithi131.stdout:6/188: symlink d1/d8/d9/l41 0 2024-09-13T02:53:52.051 INFO:tasks.workunit.client.1.smithi131.stdout:8/225: sync 2024-09-13T02:53:52.051 INFO:tasks.workunit.client.1.smithi131.stdout:5/129: sync 2024-09-13T02:53:52.051 INFO:tasks.workunit.client.1.smithi131.stdout:0/168: sync 2024-09-13T02:53:52.051 INFO:tasks.workunit.client.1.smithi131.stdout:5/130: truncate d1/d21/f25 605244 0 2024-09-13T02:53:52.051 INFO:tasks.workunit.client.1.smithi131.stdout:8/226: creat db/d2e/f43 x:0 0 0 2024-09-13T02:53:52.052 INFO:tasks.workunit.client.1.smithi131.stdout:2/123: dwrite d5/f17 [0,4194304] 0 2024-09-13T02:53:52.052 INFO:tasks.workunit.client.1.smithi131.stdout:7/116: dwrite fb [0,4194304] 0 2024-09-13T02:53:52.052 INFO:tasks.workunit.client.1.smithi131.stdout:7/117: creat d1b/f24 x:0 0 0 2024-09-13T02:53:52.052 INFO:tasks.workunit.client.1.smithi131.stdout:7/118: fdatasync f3 0 2024-09-13T02:53:52.053 INFO:tasks.workunit.client.1.smithi131.stdout:3/165: dwrite d2/d4/d7/d1d/f21 [0,4194304] 0 2024-09-13T02:53:52.053 INFO:tasks.workunit.client.1.smithi131.stdout:3/166: fsync d2/f40 0 2024-09-13T02:53:52.055 INFO:tasks.workunit.client.1.smithi131.stdout:5/131: truncate d1/d5/f16 3553423 0 2024-09-13T02:53:52.055 INFO:tasks.workunit.client.1.smithi131.stdout:8/227: mknod db/d2e/d3a/c44 0 2024-09-13T02:53:52.056 INFO:tasks.workunit.client.1.smithi131.stdout:8/228: write db/f18 [198320,111225] 0 2024-09-13T02:53:52.056 INFO:tasks.workunit.client.1.smithi131.stdout:9/133: dread d0/fb [0,4194304] 0 2024-09-13T02:53:52.057 INFO:tasks.workunit.client.1.smithi131.stdout:9/134: fdatasync d0/f9 0 2024-09-13T02:53:52.057 INFO:tasks.workunit.client.1.smithi131.stdout:2/124: dread d5/dd/f16 [0,4194304] 0 2024-09-13T02:53:52.058 INFO:tasks.workunit.client.1.smithi131.stdout:2/125: fsync d5/d18/f14 0 2024-09-13T02:53:52.061 INFO:tasks.workunit.client.1.smithi131.stdout:4/112: sync 2024-09-13T02:53:52.061 INFO:tasks.workunit.client.1.smithi131.stdout:4/113: fdatasync d1/d8/ff 0 2024-09-13T02:53:52.061 INFO:tasks.workunit.client.1.smithi131.stdout:7/119: mknod d1b/c25 0 2024-09-13T02:53:52.061 INFO:tasks.workunit.client.1.smithi131.stdout:7/120: chown d1b/d23 140 1 2024-09-13T02:53:52.065 INFO:tasks.workunit.client.1.smithi131.stdout:1/196: rename dd/d1a to dd/d26/d44 0 2024-09-13T02:53:52.066 INFO:tasks.workunit.client.1.smithi131.stdout:9/135: getdents d0 0 2024-09-13T02:53:52.067 INFO:tasks.workunit.client.1.smithi131.stdout:4/114: dread d1/d8/ff [0,4194304] 0 2024-09-13T02:53:52.067 INFO:tasks.workunit.client.1.smithi131.stdout:2/126: rename d5/dd/d22 to d5/dd/d26 0 2024-09-13T02:53:52.067 INFO:tasks.workunit.client.1.smithi131.stdout:2/127: stat d5/d18/f14 0 2024-09-13T02:53:52.068 INFO:tasks.workunit.client.1.smithi131.stdout:7/121: mkdir d1b/d23/d26 0 2024-09-13T02:53:52.068 INFO:tasks.workunit.client.1.smithi131.stdout:7/122: chown l1a 48 1 2024-09-13T02:53:52.068 INFO:tasks.workunit.client.1.smithi131.stdout:7/123: creat d1b/f27 x:0 0 0 2024-09-13T02:53:52.069 INFO:tasks.workunit.client.1.smithi131.stdout:3/167: getdents d2/d4/d14 0 2024-09-13T02:53:52.070 INFO:tasks.workunit.client.1.smithi131.stdout:5/132: getdents d1/d21 0 2024-09-13T02:53:52.071 INFO:tasks.workunit.client.1.smithi131.stdout:6/189: rename d1/d8/d9/db/d2a/l39 to d1/d8/d9/db/d15/d26/l42 0 2024-09-13T02:53:52.072 INFO:tasks.workunit.client.1.smithi131.stdout:9/136: unlink d0/fb 0 2024-09-13T02:53:52.072 INFO:tasks.workunit.client.1.smithi131.stdout:4/115: dread d1/d8/ff [0,4194304] 0 2024-09-13T02:53:52.072 INFO:tasks.workunit.client.1.smithi131.stdout:4/116: stat d1/dc/fd 0 2024-09-13T02:53:52.074 INFO:tasks.workunit.client.1.smithi131.stdout:7/124: rmdir d1b/d23/d26 0 2024-09-13T02:53:52.075 INFO:tasks.workunit.client.1.smithi131.stdout:3/168: creat d2/d4/d1a/d31/f42 x:0 0 0 2024-09-13T02:53:52.075 INFO:tasks.workunit.client.1.smithi131.stdout:5/133: dread d1/d21/f25 [0,4194304] 0 2024-09-13T02:53:52.075 INFO:tasks.workunit.client.1.smithi131.stdout:6/190: rename d1/d14/c27 to d1/d8/d9/db/d40/c43 0 2024-09-13T02:53:52.077 INFO:tasks.workunit.client.1.smithi131.stdout:4/117: creat d1/d18/f21 x:0 0 0 2024-09-13T02:53:52.078 INFO:tasks.workunit.client.1.smithi131.stdout:4/118: write d1/f16 [590417,63969] 0 2024-09-13T02:53:52.082 INFO:tasks.workunit.client.1.smithi131.stdout:7/125: creat d1b/d23/f28 x:0 0 0 2024-09-13T02:53:52.082 INFO:tasks.workunit.client.1.smithi131.stdout:0/169: dwrite d0/d2/f2f [4194304,4194304] 0 2024-09-13T02:53:52.082 INFO:tasks.workunit.client.1.smithi131.stdout:6/191: link d1/d8/d9/db/d2a/f33 d1/f44 0 2024-09-13T02:53:52.082 INFO:tasks.workunit.client.1.smithi131.stdout:6/192: fsync d1/d8/f2c 0 2024-09-13T02:53:52.082 INFO:tasks.workunit.client.1.smithi131.stdout:6/193: chown d1/c37 1484352323 1 2024-09-13T02:53:52.082 INFO:tasks.workunit.client.1.smithi131.stdout:6/194: fdatasync d1/d8/d9/db/d15/d26/f3a 0 2024-09-13T02:53:52.082 INFO:tasks.workunit.client.1.smithi131.stdout:6/195: truncate d1/d8/f3e 553605 0 2024-09-13T02:53:52.082 INFO:tasks.workunit.client.1.smithi131.stdout:6/196: truncate d1/d8/d9/db/d2a/f33 748644 0 2024-09-13T02:53:52.083 INFO:tasks.workunit.client.1.smithi131.stdout:2/128: write d5/f17 [4148390,110796] 0 2024-09-13T02:53:52.083 INFO:tasks.workunit.client.1.smithi131.stdout:4/119: mkdir d1/dc/d22 0 2024-09-13T02:53:52.085 INFO:tasks.workunit.client.1.smithi131.stdout:0/170: symlink d0/de/d1f/d22/l42 0 2024-09-13T02:53:52.086 INFO:tasks.workunit.client.1.smithi131.stdout:4/120: creat d1/dc/d19/f23 x:0 0 0 2024-09-13T02:53:52.087 INFO:tasks.workunit.client.1.smithi131.stdout:4/121: creat d1/dc/d22/f24 x:0 0 0 2024-09-13T02:53:52.087 INFO:tasks.workunit.client.1.smithi131.stdout:4/122: readlink d1/dc/l1e 0 2024-09-13T02:53:52.087 INFO:tasks.workunit.client.1.smithi131.stdout:4/123: readlink d1/d8/l14 0 2024-09-13T02:53:52.088 INFO:tasks.workunit.client.1.smithi131.stdout:2/129: dread d5/dd/d21/f24 [0,4194304] 0 2024-09-13T02:53:52.089 INFO:tasks.workunit.client.1.smithi131.stdout:4/124: mknod d1/d8/c25 0 2024-09-13T02:53:52.090 INFO:tasks.workunit.client.1.smithi131.stdout:2/130: rename d5/dd/d26/c23 to d5/dd/d1d/c27 0 2024-09-13T02:53:52.090 INFO:tasks.workunit.client.1.smithi131.stdout:2/131: fdatasync d5/fe 0 2024-09-13T02:53:52.094 INFO:tasks.workunit.client.1.smithi131.stdout:4/125: symlink d1/d8/d13/l26 0 2024-09-13T02:53:52.095 INFO:tasks.workunit.client.1.smithi131.stdout:7/126: dread f10 [0,4194304] 0 2024-09-13T02:53:52.095 INFO:tasks.workunit.client.1.smithi131.stdout:4/126: creat d1/f27 x:0 0 0 2024-09-13T02:53:52.097 INFO:tasks.workunit.client.1.smithi131.stdout:4/127: creat d1/f28 x:0 0 0 2024-09-13T02:53:52.097 INFO:tasks.workunit.client.1.smithi131.stdout:4/128: write d1/f27 [664320,67970] 0 2024-09-13T02:53:52.097 INFO:tasks.workunit.client.1.smithi131.stdout:4/129: chown d1/f6 7517 1 2024-09-13T02:53:52.097 INFO:tasks.workunit.client.1.smithi131.stdout:4/130: write d1/f27 [668754,105271] 0 2024-09-13T02:53:52.098 INFO:tasks.workunit.client.1.smithi131.stdout:4/131: mkdir d1/dc/d19/d29 0 2024-09-13T02:53:52.098 INFO:tasks.workunit.client.1.smithi131.stdout:4/132: fsync d1/d8/f1d 0 2024-09-13T02:53:52.098 INFO:tasks.workunit.client.1.smithi131.stdout:4/133: fdatasync d1/dc/d19/f23 0 2024-09-13T02:53:52.099 INFO:tasks.workunit.client.1.smithi131.stdout:3/169: dwrite d2/d4/d1a/f1e [0,4194304] 0 2024-09-13T02:53:52.099 INFO:tasks.workunit.client.1.smithi131.stdout:3/170: creat d2/d4/f43 x:0 0 0 2024-09-13T02:53:52.102 INFO:tasks.workunit.client.1.smithi131.stdout:4/134: write d1/d8/ff [278503,46508] 0 2024-09-13T02:53:52.105 INFO:tasks.workunit.client.1.smithi131.stdout:3/171: unlink d2/d4/cb 0 2024-09-13T02:53:52.107 INFO:tasks.workunit.client.1.smithi131.stdout:3/172: stat d2/d4/d7/d8/l16 0 2024-09-13T02:53:52.107 INFO:tasks.workunit.client.1.smithi131.stdout:3/173: read d2/d4/f9 [4990945,95105] 0 2024-09-13T02:53:52.107 INFO:tasks.workunit.client.1.smithi131.stdout:3/174: chown d2/d4/d1a/f37 3 1 2024-09-13T02:53:52.108 INFO:tasks.workunit.client.1.smithi131.stdout:3/175: symlink d2/dc/l44 0 2024-09-13T02:53:52.110 INFO:tasks.workunit.client.1.smithi131.stdout:3/176: rename d2/d4/d2d/c38 to d2/d4/d2d/c45 0 2024-09-13T02:53:52.110 INFO:tasks.workunit.client.1.smithi131.stdout:3/177: dread - d2/d4/d7/d1d/f3f zero size 2024-09-13T02:53:52.110 INFO:tasks.workunit.client.1.smithi131.stdout:3/178: fdatasync d2/d4/d14/f35 0 2024-09-13T02:53:52.111 INFO:tasks.workunit.client.1.smithi131.stdout:3/179: rename d2/d4/d7/c3b to d2/dc/c46 0 2024-09-13T02:53:52.113 INFO:tasks.workunit.client.1.smithi131.stdout:6/197: dwrite d1/f4 [0,4194304] 0 2024-09-13T02:53:52.113 INFO:tasks.workunit.client.1.smithi131.stdout:6/198: fsync d1/f4 0 2024-09-13T02:53:52.113 INFO:tasks.workunit.client.1.smithi131.stdout:6/199: dread - d1/d8/f2d zero size 2024-09-13T02:53:52.113 INFO:tasks.workunit.client.1.smithi131.stdout:3/180: getdents d2/d4/d7/d8 0 2024-09-13T02:53:52.113 INFO:tasks.workunit.client.1.smithi131.stdout:9/137: dwrite d0/d3/d14/d17/f21 [0,4194304] 0 2024-09-13T02:53:52.113 INFO:tasks.workunit.client.1.smithi131.stdout:9/138: dread - d0/d3/d14/d1a/f1d zero size 2024-09-13T02:53:52.113 INFO:tasks.workunit.client.1.smithi131.stdout:3/181: dread - d2/d4/d7/d1d/f2e zero size 2024-09-13T02:53:52.115 INFO:tasks.workunit.client.1.smithi131.stdout:6/200: truncate d1/d8/f1b 538903 0 2024-09-13T02:53:52.116 INFO:tasks.workunit.client.1.smithi131.stdout:3/182: creat d2/d4/d14/f47 x:0 0 0 2024-09-13T02:53:52.116 INFO:tasks.workunit.client.1.smithi131.stdout:3/183: write d2/d4/d7/d1d/d24/f3a [160172,63583] 0 2024-09-13T02:53:52.116 INFO:tasks.workunit.client.1.smithi131.stdout:3/184: chown d2/d4/d14/c3c 289758 1 2024-09-13T02:53:52.116 INFO:tasks.workunit.client.1.smithi131.stdout:6/201: link d1/l29 d1/d8/d9/db/l45 0 2024-09-13T02:53:52.117 INFO:tasks.workunit.client.1.smithi131.stdout:3/185: mkdir d2/d4/d1a/d31/d48 0 2024-09-13T02:53:52.119 INFO:tasks.workunit.client.1.smithi131.stdout:3/186: mkdir d2/d4/d14/d49 0 2024-09-13T02:53:52.119 INFO:tasks.workunit.client.1.smithi131.stdout:3/187: fsync d2/d4/d7/d1d/f2e 0 2024-09-13T02:53:52.120 INFO:tasks.workunit.client.1.smithi131.stdout:3/188: rename d2/f40 to d2/d4/d14/d49/f4a 0 2024-09-13T02:53:52.122 INFO:tasks.workunit.client.1.smithi131.stdout:3/189: unlink d2/d4/d7/d1d/f3f 0 2024-09-13T02:53:52.123 INFO:tasks.workunit.client.1.smithi131.stdout:0/171: dwrite d0/f18 [4194304,4194304] 0 2024-09-13T02:53:52.124 INFO:tasks.workunit.client.1.smithi131.stdout:2/132: dwrite d5/d1e/f20 [0,4194304] 0 2024-09-13T02:53:52.127 INFO:tasks.workunit.client.1.smithi131.stdout:0/172: truncate d0/de/f14 270723 0 2024-09-13T02:53:52.129 INFO:tasks.workunit.client.1.smithi131.stdout:6/202: dread d1/d8/d9/f19 [0,4194304] 0 2024-09-13T02:53:52.131 INFO:tasks.workunit.client.1.smithi131.stdout:0/173: stat d0/c7 0 2024-09-13T02:53:52.132 INFO:tasks.workunit.client.1.smithi131.stdout:0/174: mkdir d0/de/d1f/d22/d3d/d43 0 2024-09-13T02:53:52.135 INFO:tasks.workunit.client.1.smithi131.stdout:4/135: dwrite d1/dc/d19/f23 [0,4194304] 0 2024-09-13T02:53:52.135 INFO:tasks.workunit.client.1.smithi131.stdout:4/136: creat d1/d18/f2a x:0 0 0 2024-09-13T02:53:52.135 INFO:tasks.workunit.client.1.smithi131.stdout:4/137: truncate d1/dc/fe 517108 0 2024-09-13T02:53:52.135 INFO:tasks.workunit.client.1.smithi131.stdout:9/139: dwrite d0/f15 [0,4194304] 0 2024-09-13T02:53:52.138 INFO:tasks.workunit.client.1.smithi131.stdout:0/175: mknod d0/de/c44 0 2024-09-13T02:53:52.140 INFO:tasks.workunit.client.1.smithi131.stdout:6/203: write d1/d8/d9/f17 [694151,93664] 0 2024-09-13T02:53:52.147 INFO:tasks.workunit.client.1.smithi131.stdout:3/190: rmdir d2/d4/d7/d1d 39 2024-09-13T02:53:52.153 INFO:tasks.workunit.client.1.smithi131.stdout:6/204: write d1/f4 [3023562,78101] 0 2024-09-13T02:53:52.153 INFO:tasks.workunit.client.1.smithi131.stdout:4/138: dwrite d1/f5 [4194304,4194304] 0 2024-09-13T02:53:52.157 INFO:tasks.workunit.client.1.smithi131.stdout:3/191: symlink d2/d4/d7/d1d/d24/l4b 0 2024-09-13T02:53:52.157 INFO:tasks.workunit.client.1.smithi131.stdout:3/192: dread - d2/d4/d7/d1d/f2c zero size 2024-09-13T02:53:52.158 INFO:tasks.workunit.client.1.smithi131.stdout:0/176: mkdir d0/de/d45 0 2024-09-13T02:53:52.163 INFO:tasks.workunit.client.1.smithi131.stdout:4/139: unlink d1/dc/c1b 0 2024-09-13T02:53:52.163 INFO:tasks.workunit.client.1.smithi131.stdout:4/140: dread - d1/d18/f2a zero size 2024-09-13T02:53:52.164 INFO:tasks.workunit.client.1.smithi131.stdout:6/205: rmdir d1/d8/d9/db/d15 39 2024-09-13T02:53:52.166 INFO:tasks.workunit.client.1.smithi131.stdout:4/141: creat d1/dc/d19/d29/f2b x:0 0 0 2024-09-13T02:53:52.169 INFO:tasks.workunit.client.1.smithi131.stdout:0/177: dread d0/f18 [4194304,4194304] 0 2024-09-13T02:53:52.169 INFO:tasks.workunit.client.1.smithi131.stdout:0/178: write d0/de/f38 [155556,50908] 0 2024-09-13T02:53:52.170 INFO:tasks.workunit.client.1.smithi131.stdout:6/206: dread d1/d8/d9/db/ff [0,4194304] 0 2024-09-13T02:53:52.172 INFO:tasks.workunit.client.1.smithi131.stdout:6/207: rename d1/l29 to d1/d8/d9/l46 0 2024-09-13T02:53:52.172 INFO:tasks.workunit.client.1.smithi131.stdout:6/208: chown d1/d8/d9/c13 812161576 1 2024-09-13T02:53:52.173 INFO:tasks.workunit.client.1.smithi131.stdout:6/209: write d1/d8/d9/fd [279781,92135] 0 2024-09-13T02:53:52.173 INFO:tasks.workunit.client.1.smithi131.stdout:9/140: dwrite d0/f9 [0,4194304] 0 2024-09-13T02:53:52.173 INFO:tasks.workunit.client.1.smithi131.stdout:6/210: creat d1/d8/d9/db/d40/f47 x:0 0 0 2024-09-13T02:53:52.175 INFO:tasks.workunit.client.1.smithi131.stdout:6/211: link d1/d8/d9/db/ff d1/d8/d9/db/d2a/d3b/f48 0 2024-09-13T02:53:52.175 INFO:tasks.workunit.client.1.smithi131.stdout:6/212: dread - d1/d8/f2d zero size 2024-09-13T02:53:52.175 INFO:tasks.workunit.client.1.smithi131.stdout:6/213: write d1/d8/f3e [757918,18412] 0 2024-09-13T02:53:52.176 INFO:tasks.workunit.client.1.smithi131.stdout:6/214: chown d1/d8/d9/db/d15/l2e 867802 1 2024-09-13T02:53:52.176 INFO:tasks.workunit.client.1.smithi131.stdout:6/215: link d1/c24 d1/d8/d9/db/c49 0 2024-09-13T02:53:52.177 INFO:tasks.workunit.client.1.smithi131.stdout:4/142: dread d1/d8/fb [0,4194304] 0 2024-09-13T02:53:52.177 INFO:tasks.workunit.client.1.smithi131.stdout:4/143: write d1/dc/fe [137174,10735] 0 2024-09-13T02:53:52.178 INFO:tasks.workunit.client.1.smithi131.stdout:4/144: truncate d1/dc/d19/d29/f2b 601228 0 2024-09-13T02:53:52.178 INFO:tasks.workunit.client.1.smithi131.stdout:4/145: readlink d1/l4 0 2024-09-13T02:53:52.178 INFO:tasks.workunit.client.1.smithi131.stdout:4/146: write d1/dc/fe [880257,2497] 0 2024-09-13T02:53:52.178 INFO:tasks.workunit.client.1.smithi131.stdout:4/147: dread - d1/dc/d22/f24 zero size 2024-09-13T02:53:52.178 INFO:tasks.workunit.client.1.smithi131.stdout:6/216: truncate d1/f4 1890756 0 2024-09-13T02:53:52.178 INFO:tasks.workunit.client.1.smithi131.stdout:3/193: dwrite d2/dc/d39/f3d [0,4194304] 0 2024-09-13T02:53:52.179 INFO:tasks.workunit.client.1.smithi131.stdout:4/148: unlink d1/dc/f20 0 2024-09-13T02:53:52.184 INFO:tasks.workunit.client.1.smithi131.stdout:9/141: dread d0/f15 [0,4194304] 0 2024-09-13T02:53:52.184 INFO:tasks.workunit.client.1.smithi131.stdout:9/142: creat d0/d3/d14/d1a/f23 x:0 0 0 2024-09-13T02:53:52.185 INFO:tasks.workunit.client.1.smithi131.stdout:6/217: symlink d1/d8/d9/db/d40/l4a 0 2024-09-13T02:53:52.185 INFO:tasks.workunit.client.1.smithi131.stdout:3/194: write d2/d4/d1a/d31/f42 [803433,106307] 0 2024-09-13T02:53:52.186 INFO:tasks.workunit.client.1.smithi131.stdout:3/195: read d2/d4/f23 [8022,72019] 0 2024-09-13T02:53:52.187 INFO:tasks.workunit.client.1.smithi131.stdout:6/218: rmdir d1/d8/d9/db/d15/d26/d1c 39 2024-09-13T02:53:52.187 INFO:tasks.workunit.client.1.smithi131.stdout:6/219: write d1/f44 [1630430,93433] 0 2024-09-13T02:53:52.188 INFO:tasks.workunit.client.1.smithi131.stdout:9/143: rename d0/d3/lf to d0/l24 0 2024-09-13T02:53:52.189 INFO:tasks.workunit.client.1.smithi131.stdout:3/196: link d2/d4/d7/d8/l16 d2/d4/d14/l4c 0 2024-09-13T02:53:52.189 INFO:tasks.workunit.client.1.smithi131.stdout:6/220: mkdir d1/d8/d9/d4b 0 2024-09-13T02:53:52.190 INFO:tasks.workunit.client.1.smithi131.stdout:9/144: truncate d0/d3/d14/d17/f21 3608461 0 2024-09-13T02:53:52.190 INFO:tasks.workunit.client.1.smithi131.stdout:3/197: truncate d2/d4/d14/d49/f4a 137000 0 2024-09-13T02:53:52.192 INFO:tasks.workunit.client.1.smithi131.stdout:9/145: unlink d0/la 0 2024-09-13T02:53:52.193 INFO:tasks.workunit.client.1.smithi131.stdout:9/146: stat d0/l22 0 2024-09-13T02:53:52.193 INFO:tasks.workunit.client.1.smithi131.stdout:9/147: write d0/d3/d14/d1a/f1d [1022301,20554] 0 2024-09-13T02:53:52.194 INFO:tasks.workunit.client.1.smithi131.stdout:6/221: dread d1/d8/d9/db/f36 [0,4194304] 0 2024-09-13T02:53:52.194 INFO:tasks.workunit.client.1.smithi131.stdout:9/148: creat d0/f25 x:0 0 0 2024-09-13T02:53:52.195 INFO:tasks.workunit.client.1.smithi131.stdout:4/149: dwrite d1/d8/f1d [0,4194304] 0 2024-09-13T02:53:52.198 INFO:tasks.workunit.client.1.smithi131.stdout:4/150: unlink d1/dc/d22/f24 0 2024-09-13T02:53:52.199 INFO:tasks.workunit.client.1.smithi131.stdout:6/222: write d1/f2b [483344,115805] 0 2024-09-13T02:53:52.200 INFO:tasks.workunit.client.1.smithi131.stdout:8/229: sync 2024-09-13T02:53:52.201 INFO:tasks.workunit.client.1.smithi131.stdout:6/223: rename d1/c37 to d1/d8/d9/db/d15/c4c 0 2024-09-13T02:53:52.201 INFO:tasks.workunit.client.1.smithi131.stdout:6/224: fsync d1/d8/d9/db/f36 0 2024-09-13T02:53:52.203 INFO:tasks.workunit.client.1.smithi131.stdout:8/230: mknod db/c45 0 2024-09-13T02:53:52.203 INFO:tasks.workunit.client.1.smithi131.stdout:8/231: write db/f23 [3474466,75891] 0 2024-09-13T02:53:52.203 INFO:tasks.workunit.client.1.smithi131.stdout:8/232: read db/f23 [739406,97122] 0 2024-09-13T02:53:52.203 INFO:tasks.workunit.client.1.smithi131.stdout:8/233: fsync f6 0 2024-09-13T02:53:52.203 INFO:tasks.workunit.client.1.smithi131.stdout:8/234: readlink db/d1d/l29 0 2024-09-13T02:53:52.206 INFO:tasks.workunit.client.1.smithi131.stdout:9/149: write d0/f10 [423976,23224] 0 2024-09-13T02:53:52.207 INFO:tasks.workunit.client.1.smithi131.stdout:9/150: mknod d0/d3/d14/d1a/c26 0 2024-09-13T02:53:52.208 INFO:tasks.workunit.client.1.smithi131.stdout:9/151: mknod d0/d3/d14/c27 0 2024-09-13T02:53:52.209 INFO:tasks.workunit.client.1.smithi131.stdout:3/198: dwrite d2/d4/f43 [0,4194304] 0 2024-09-13T02:53:52.209 INFO:tasks.workunit.client.1.smithi131.stdout:3/199: fsync d2/dc/d39/f3d 0 2024-09-13T02:53:52.213 INFO:tasks.workunit.client.1.smithi131.stdout:4/151: dread d1/dc/fe [0,4194304] 0 2024-09-13T02:53:52.216 INFO:tasks.workunit.client.1.smithi131.stdout:8/235: dread f6 [0,4194304] 0 2024-09-13T02:53:52.216 INFO:tasks.workunit.client.1.smithi131.stdout:8/236: fdatasync db/f19 0 2024-09-13T02:53:52.217 INFO:tasks.workunit.client.1.smithi131.stdout:4/152: rename d1/f6 to d1/dc/d19/d29/f2c 0 2024-09-13T02:53:52.217 INFO:tasks.workunit.client.1.smithi131.stdout:4/153: fsync d1/f5 0 2024-09-13T02:53:52.218 INFO:tasks.workunit.client.1.smithi131.stdout:4/154: chown d1/dc/d19/f23 124 1 2024-09-13T02:53:52.219 INFO:tasks.workunit.client.1.smithi131.stdout:8/237: link db/d1d/d31/c33 db/d1d/d1f/c46 0 2024-09-13T02:53:52.221 INFO:tasks.workunit.client.1.smithi131.stdout:8/238: creat db/d2b/f47 x:0 0 0 2024-09-13T02:53:52.221 INFO:tasks.workunit.client.1.smithi131.stdout:3/200: dread d2/d4/f9 [0,4194304] 0 2024-09-13T02:53:52.222 INFO:tasks.workunit.client.1.smithi131.stdout:8/239: creat db/d2e/d40/f48 x:0 0 0 2024-09-13T02:53:52.223 INFO:tasks.workunit.client.1.smithi131.stdout:3/201: rename d2/d4/d14/f47 to d2/d4/d7/f4d 0 2024-09-13T02:53:52.223 INFO:tasks.workunit.client.1.smithi131.stdout:3/202: creat d2/d4/d14/f4e x:0 0 0 2024-09-13T02:53:52.223 INFO:tasks.workunit.client.1.smithi131.stdout:3/203: write d2/d4/d7/d1d/f30 [1023471,128035] 0 2024-09-13T02:53:52.224 INFO:tasks.workunit.client.1.smithi131.stdout:8/240: dread db/f15 [0,4194304] 0 2024-09-13T02:53:52.226 INFO:tasks.workunit.client.1.smithi131.stdout:3/204: mkdir d2/d4/d14/d4f 0 2024-09-13T02:53:52.232 INFO:tasks.workunit.client.1.smithi131.stdout:4/155: dread d1/dc/d19/f23 [0,4194304] 0 2024-09-13T02:53:52.232 INFO:tasks.workunit.client.1.smithi131.stdout:4/156: fsync d1/d8/f15 0 2024-09-13T02:53:52.232 INFO:tasks.workunit.client.1.smithi131.stdout:4/157: write d1/d8/f15 [289375,22371] 0 2024-09-13T02:53:52.233 INFO:tasks.workunit.client.1.smithi131.stdout:4/158: unlink d1/d8/fb 0 2024-09-13T02:53:52.233 INFO:tasks.workunit.client.1.smithi131.stdout:8/241: write db/f2a [704543,11709] 0 2024-09-13T02:53:52.234 INFO:tasks.workunit.client.1.smithi131.stdout:8/242: mknod db/d1d/d31/c49 0 2024-09-13T02:53:52.235 INFO:tasks.workunit.client.1.smithi131.stdout:8/243: rename db/d1d/d31/f37 to db/d1d/d34/f4a 0 2024-09-13T02:53:52.236 INFO:tasks.workunit.client.1.smithi131.stdout:6/225: dwrite d1/d8/d9/fd [0,4194304] 0 2024-09-13T02:53:52.236 INFO:tasks.workunit.client.1.smithi131.stdout:9/152: dwrite d0/d3/d14/d1a/f1d [0,4194304] 0 2024-09-13T02:53:52.236 INFO:tasks.workunit.client.1.smithi131.stdout:6/226: write d1/d8/f2d [1025963,128676] 0 2024-09-13T02:53:52.238 INFO:tasks.workunit.client.1.smithi131.stdout:6/227: read d1/d8/d9/db/d15/d26/f3a [512924,104852] 0 2024-09-13T02:53:52.239 INFO:tasks.workunit.client.1.smithi131.stdout:4/159: link d1/dc/d19/d29/f2c d1/d18/f2d 0 2024-09-13T02:53:52.248 INFO:tasks.workunit.client.1.smithi131.stdout:6/228: mknod d1/d8/d9/c4d 0 2024-09-13T02:53:52.249 INFO:tasks.workunit.client.1.smithi131.stdout:9/153: symlink d0/l28 0 2024-09-13T02:53:52.249 INFO:tasks.workunit.client.1.smithi131.stdout:9/154: chown d0/f10 1 1 2024-09-13T02:53:52.250 INFO:tasks.workunit.client.1.smithi131.stdout:9/155: readlink d0/d3/d14/d17/l1e 0 2024-09-13T02:53:52.250 INFO:tasks.workunit.client.1.smithi131.stdout:6/229: mkdir d1/d8/d9/db/d15/d26/d1c/d4e 0 2024-09-13T02:53:52.251 INFO:tasks.workunit.client.1.smithi131.stdout:6/230: chown d1/d8/d9/db/d15/f3c 3592532 1 2024-09-13T02:53:52.261 INFO:tasks.workunit.client.1.smithi131.stdout:8/244: dwrite f2 [0,4194304] 0 2024-09-13T02:53:52.261 INFO:tasks.workunit.client.1.smithi131.stdout:9/156: dread d0/f9 [0,4194304] 0 2024-09-13T02:53:52.263 INFO:tasks.workunit.client.1.smithi131.stdout:9/157: symlink d0/l29 0 2024-09-13T02:53:52.263 INFO:tasks.workunit.client.1.smithi131.stdout:9/158: fdatasync d0/f25 0 2024-09-13T02:53:52.264 INFO:tasks.workunit.client.1.smithi131.stdout:9/159: mkdir d0/d3/d14/d1a/d2a 0 2024-09-13T02:53:52.265 INFO:tasks.workunit.client.1.smithi131.stdout:9/160: link d0/l24 d0/d3/d14/d17/l2b 0 2024-09-13T02:53:52.266 INFO:tasks.workunit.client.1.smithi131.stdout:9/161: symlink d0/d3/d14/d1a/d2a/l2c 0 2024-09-13T02:53:52.270 INFO:tasks.workunit.client.1.smithi131.stdout:4/160: dwrite d1/d8/f17 [0,4194304] 0 2024-09-13T02:53:52.282 INFO:tasks.workunit.client.1.smithi131.stdout:6/231: dwrite d1/d8/d9/db/d15/d26/f3a [0,4194304] 0 2024-09-13T02:53:52.286 INFO:tasks.workunit.client.1.smithi131.stdout:8/245: dwrite f8 [0,4194304] 0 2024-09-13T02:53:52.286 INFO:tasks.workunit.client.1.smithi131.stdout:6/232: rmdir d1/d8/d9/db 39 2024-09-13T02:53:52.286 INFO:tasks.workunit.client.1.smithi131.stdout:6/233: dread - d1/d8/f2c zero size 2024-09-13T02:53:52.287 INFO:tasks.workunit.client.1.smithi131.stdout:8/246: link db/c21 db/c4b 0 2024-09-13T02:53:52.288 INFO:tasks.workunit.client.1.smithi131.stdout:8/247: stat ca 0 2024-09-13T02:53:52.288 INFO:tasks.workunit.client.1.smithi131.stdout:6/234: mknod d1/d8/d9/db/c4f 0 2024-09-13T02:53:52.289 INFO:tasks.workunit.client.1.smithi131.stdout:8/248: symlink db/d1d/d1f/d41/l4c 0 2024-09-13T02:53:52.289 INFO:tasks.workunit.client.1.smithi131.stdout:8/249: stat db/d1d/d34 0 2024-09-13T02:53:52.290 INFO:tasks.workunit.client.1.smithi131.stdout:6/235: mknod d1/d8/d9/c50 0 2024-09-13T02:53:52.291 INFO:tasks.workunit.client.1.smithi131.stdout:8/250: symlink db/d1d/d1f/d41/l4d 0 2024-09-13T02:53:52.291 INFO:tasks.workunit.client.1.smithi131.stdout:1/197: sync 2024-09-13T02:53:52.292 INFO:tasks.workunit.client.1.smithi131.stdout:6/236: symlink d1/d8/d9/db/d15/d26/d1c/d4e/l51 0 2024-09-13T02:53:52.293 INFO:tasks.workunit.client.1.smithi131.stdout:1/198: getdents dd/d26/d2a/d2c 0 2024-09-13T02:53:52.294 INFO:tasks.workunit.client.1.smithi131.stdout:9/162: dwrite d0/d3/d14/d17/f21 [0,4194304] 0 2024-09-13T02:53:52.295 INFO:tasks.workunit.client.1.smithi131.stdout:1/199: getdents dd 0 2024-09-13T02:53:52.296 INFO:tasks.workunit.client.1.smithi131.stdout:4/161: dwrite d1/d18/f2a [0,4194304] 0 2024-09-13T02:53:52.296 INFO:tasks.workunit.client.1.smithi131.stdout:4/162: chown d1/d8 23934505 1 2024-09-13T02:53:52.296 INFO:tasks.workunit.client.1.smithi131.stdout:9/163: symlink d0/d3/d14/l2d 0 2024-09-13T02:53:52.297 INFO:tasks.workunit.client.1.smithi131.stdout:1/200: symlink dd/d26/l45 0 2024-09-13T02:53:52.297 INFO:tasks.workunit.client.1.smithi131.stdout:5/134: sync 2024-09-13T02:53:52.297 INFO:tasks.workunit.client.1.smithi131.stdout:4/163: write d1/dc/fe [163036,71128] 0 2024-09-13T02:53:52.299 INFO:tasks.workunit.client.1.smithi131.stdout:9/164: symlink d0/d3/l2e 0 2024-09-13T02:53:52.300 INFO:tasks.workunit.client.1.smithi131.stdout:1/201: mknod dd/d26/d2a/c46 0 2024-09-13T02:53:52.302 INFO:tasks.workunit.client.1.smithi131.stdout:5/135: mkdir d1/d1c/d32 0 2024-09-13T02:53:52.302 INFO:tasks.workunit.client.1.smithi131.stdout:8/251: dread f8 [0,4194304] 0 2024-09-13T02:53:52.303 INFO:tasks.workunit.client.1.smithi131.stdout:9/165: fdatasync d0/f11 0 2024-09-13T02:53:52.303 INFO:tasks.workunit.client.1.smithi131.stdout:1/202: dread dd/f3c [0,4194304] 0 2024-09-13T02:53:52.303 INFO:tasks.workunit.client.1.smithi131.stdout:9/166: write d0/d3/d14/d1a/f1d [4477531,119852] 0 2024-09-13T02:53:52.304 INFO:tasks.workunit.client.1.smithi131.stdout:5/136: write d1/f23 [490265,58721] 0 2024-09-13T02:53:52.304 INFO:tasks.workunit.client.1.smithi131.stdout:5/137: chown d1/d5/lf 157 1 2024-09-13T02:53:52.305 INFO:tasks.workunit.client.1.smithi131.stdout:8/252: mkdir db/d1d/d34/d4e 0 2024-09-13T02:53:52.307 INFO:tasks.workunit.client.1.smithi131.stdout:8/253: truncate db/d1d/d1f/f2d 198785 0 2024-09-13T02:53:52.307 INFO:tasks.workunit.client.1.smithi131.stdout:8/254: fdatasync db/f23 0 2024-09-13T02:53:52.309 INFO:tasks.workunit.client.1.smithi131.stdout:8/255: symlink db/d1d/d1f/l4f 0 2024-09-13T02:53:52.310 INFO:tasks.workunit.client.1.smithi131.stdout:8/256: mkdir db/d1d/d1f/d41/d50 0 2024-09-13T02:53:52.310 INFO:tasks.workunit.client.1.smithi131.stdout:8/257: write db/d2e/f43 [864529,9727] 0 2024-09-13T02:53:52.311 INFO:tasks.workunit.client.1.smithi131.stdout:8/258: symlink db/l51 0 2024-09-13T02:53:52.314 INFO:tasks.workunit.client.1.smithi131.stdout:6/237: dwrite d1/d8/f2d [0,4194304] 0 2024-09-13T02:53:52.314 INFO:tasks.workunit.client.1.smithi131.stdout:6/238: write d1/d8/d9/f1d [456173,77098] 0 2024-09-13T02:53:52.319 INFO:tasks.workunit.client.1.smithi131.stdout:6/239: dread d1/d8/d9/db/ff [0,4194304] 0 2024-09-13T02:53:52.319 INFO:tasks.workunit.client.1.smithi131.stdout:6/240: write d1/d8/d9/db/d15/f3d [332560,25782] 0 2024-09-13T02:53:52.319 INFO:tasks.workunit.client.1.smithi131.stdout:6/241: stat d1/d8/d9/f1d 0 2024-09-13T02:53:52.323 INFO:tasks.workunit.client.1.smithi131.stdout:6/242: read d1/d8/d9/db/ff [1471714,82255] 0 2024-09-13T02:53:52.331 INFO:tasks.workunit.client.1.smithi131.stdout:8/259: dread f2 [0,4194304] 0 2024-09-13T02:53:52.331 INFO:tasks.workunit.client.1.smithi131.stdout:5/138: dread d1/d5/fa [0,4194304] 0 2024-09-13T02:53:52.331 INFO:tasks.workunit.client.1.smithi131.stdout:8/260: write db/f2a [583469,111013] 0 2024-09-13T02:53:52.331 INFO:tasks.workunit.client.1.smithi131.stdout:8/261: fdatasync db/d2e/f43 0 2024-09-13T02:53:52.332 INFO:tasks.workunit.client.1.smithi131.stdout:8/262: fdatasync db/f19 0 2024-09-13T02:53:52.333 INFO:tasks.workunit.client.1.smithi131.stdout:4/164: dwrite d1/dc/fd [0,4194304] 0 2024-09-13T02:53:52.333 INFO:tasks.workunit.client.1.smithi131.stdout:5/139: mkdir d1/d2f/d33 0 2024-09-13T02:53:52.338 INFO:tasks.workunit.client.1.smithi131.stdout:4/165: rename d1/f28 to d1/dc/f2e 0 2024-09-13T02:53:52.339 INFO:tasks.workunit.client.1.smithi131.stdout:5/140: mknod d1/d1c/d32/c34 0 2024-09-13T02:53:52.339 INFO:tasks.workunit.client.1.smithi131.stdout:5/141: creat d1/d29/f35 x:0 0 0 2024-09-13T02:53:52.341 INFO:tasks.workunit.client.1.smithi131.stdout:5/142: mknod d1/d21/c36 0 2024-09-13T02:53:52.341 INFO:tasks.workunit.client.1.smithi131.stdout:5/143: chown d1/d1c/d32 8703254 1 2024-09-13T02:53:52.342 INFO:tasks.workunit.client.1.smithi131.stdout:5/144: mkdir d1/d21/d22/d37 0 2024-09-13T02:53:52.343 INFO:tasks.workunit.client.1.smithi131.stdout:1/203: dwrite dd/d26/f35 [0,4194304] 0 2024-09-13T02:53:52.343 INFO:tasks.workunit.client.1.smithi131.stdout:1/204: stat f8 0 2024-09-13T02:53:52.343 INFO:tasks.workunit.client.1.smithi131.stdout:9/167: dwrite d0/d3/d14/d1a/f23 [0,4194304] 0 2024-09-13T02:53:52.343 INFO:tasks.workunit.client.1.smithi131.stdout:9/168: readlink d0/d3/d14/d17/l1e 0 2024-09-13T02:53:52.346 INFO:tasks.workunit.client.1.smithi131.stdout:1/205: mkdir dd/d33/d42/d47 0 2024-09-13T02:53:52.346 INFO:tasks.workunit.client.1.smithi131.stdout:1/206: chown dd/ce 210 1 2024-09-13T02:53:52.349 INFO:tasks.workunit.client.1.smithi131.stdout:5/145: write d1/d5/fa [3892478,91137] 0 2024-09-13T02:53:52.349 INFO:tasks.workunit.client.1.smithi131.stdout:9/169: rename d0/d3/d14/c16 to d0/d3/d14/d17/c2f 0 2024-09-13T02:53:52.349 INFO:tasks.workunit.client.1.smithi131.stdout:9/170: fsync d0/f25 0 2024-09-13T02:53:52.350 INFO:tasks.workunit.client.1.smithi131.stdout:9/171: write d0/d3/d14/d17/f21 [5002215,105286] 0 2024-09-13T02:53:52.350 INFO:tasks.workunit.client.1.smithi131.stdout:1/207: creat dd/d33/d42/f48 x:0 0 0 2024-09-13T02:53:52.350 INFO:tasks.workunit.client.1.smithi131.stdout:1/208: dread - dd/d26/d44/f25 zero size 2024-09-13T02:53:52.350 INFO:tasks.workunit.client.1.smithi131.stdout:1/209: creat dd/d26/d2a/f49 x:0 0 0 2024-09-13T02:53:52.351 INFO:tasks.workunit.client.1.smithi131.stdout:1/210: mknod dd/d33/d42/c4a 0 2024-09-13T02:53:52.352 INFO:tasks.workunit.client.1.smithi131.stdout:1/211: mkdir dd/d26/d2a/d2c/d4b 0 2024-09-13T02:53:52.353 INFO:tasks.workunit.client.1.smithi131.stdout:1/212: mknod dd/d26/d2a/c4c 0 2024-09-13T02:53:52.355 INFO:tasks.workunit.client.1.smithi131.stdout:5/146: dread d1/f2c [0,4194304] 0 2024-09-13T02:53:52.356 INFO:tasks.workunit.client.1.smithi131.stdout:5/147: getdents d1/d5 0 2024-09-13T02:53:52.357 INFO:tasks.workunit.client.1.smithi131.stdout:5/148: rename d1/d21/c36 to d1/d2f/c38 0 2024-09-13T02:53:52.359 INFO:tasks.workunit.client.1.smithi131.stdout:5/149: mkdir d1/d29/d39 0 2024-09-13T02:53:52.359 INFO:tasks.workunit.client.1.smithi131.stdout:8/263: dwrite db/d1d/f25 [0,4194304] 0 2024-09-13T02:53:52.363 INFO:tasks.workunit.client.1.smithi131.stdout:8/264: rmdir db/d2e 39 2024-09-13T02:53:52.364 INFO:tasks.workunit.client.1.smithi131.stdout:8/265: chown db/c26 370 1 2024-09-13T02:53:52.364 INFO:tasks.workunit.client.1.smithi131.stdout:1/213: write dd/d26/d44/f1e [5898485,47912] 0 2024-09-13T02:53:52.364 INFO:tasks.workunit.client.1.smithi131.stdout:1/214: fdatasync dd/f20 0 2024-09-13T02:53:52.365 INFO:tasks.workunit.client.1.smithi131.stdout:1/215: mknod dd/d33/d42/d47/c4d 0 2024-09-13T02:53:52.366 INFO:tasks.workunit.client.1.smithi131.stdout:1/216: write dd/f13 [4840683,88539] 0 2024-09-13T02:53:52.366 INFO:tasks.workunit.client.1.smithi131.stdout:1/217: symlink dd/d33/d42/l4e 0 2024-09-13T02:53:52.367 INFO:tasks.workunit.client.1.smithi131.stdout:1/218: fdatasync dd/f3c 0 2024-09-13T02:53:52.367 INFO:tasks.workunit.client.1.smithi131.stdout:1/219: dread - dd/d26/f2d zero size 2024-09-13T02:53:52.367 INFO:tasks.workunit.client.1.smithi131.stdout:1/220: chown dd/f13 240850 1 2024-09-13T02:53:52.368 INFO:tasks.workunit.client.1.smithi131.stdout:1/221: rename dd/d26/l45 to dd/d26/d2a/d2c/d4b/l4f 0 2024-09-13T02:53:52.369 INFO:tasks.workunit.client.1.smithi131.stdout:7/127: sync 2024-09-13T02:53:52.369 INFO:tasks.workunit.client.1.smithi131.stdout:0/179: sync 2024-09-13T02:53:52.369 INFO:tasks.workunit.client.1.smithi131.stdout:0/180: chown d0/de/d1f/l23 3913788 1 2024-09-13T02:53:52.369 INFO:tasks.workunit.client.1.smithi131.stdout:3/205: sync 2024-09-13T02:53:52.369 INFO:tasks.workunit.client.1.smithi131.stdout:2/133: sync 2024-09-13T02:53:52.369 INFO:tasks.workunit.client.1.smithi131.stdout:3/206: chown d2/d4/d1a/d31/f42 0 1 2024-09-13T02:53:52.369 INFO:tasks.workunit.client.1.smithi131.stdout:2/134: write d5/fa [3087192,98177] 0 2024-09-13T02:53:52.369 INFO:tasks.workunit.client.1.smithi131.stdout:2/135: creat d5/f28 x:0 0 0 2024-09-13T02:53:52.370 INFO:tasks.workunit.client.1.smithi131.stdout:5/150: read d1/d5/f13 [3652319,10649] 0 2024-09-13T02:53:52.370 INFO:tasks.workunit.client.1.smithi131.stdout:0/181: symlink d0/d2/l46 0 2024-09-13T02:53:52.372 INFO:tasks.workunit.client.1.smithi131.stdout:9/172: dwrite d0/f25 [0,4194304] 0 2024-09-13T02:53:52.373 INFO:tasks.workunit.client.1.smithi131.stdout:3/207: link d2/d4/d7/d8/l16 d2/d4/d14/l50 0 2024-09-13T02:53:52.377 INFO:tasks.workunit.client.1.smithi131.stdout:3/208: chown d2/d4/d1a/l29 781152665 1 2024-09-13T02:53:52.377 INFO:tasks.workunit.client.1.smithi131.stdout:3/209: fdatasync d2/d4/d14/f35 0 2024-09-13T02:53:52.383 INFO:tasks.workunit.client.1.smithi131.stdout:3/210: creat d2/d4/d7/d1d/d24/f51 x:0 0 0 2024-09-13T02:53:52.392 INFO:tasks.workunit.client.1.smithi131.stdout:7/128: dread d1b/f1f [0,4194304] 0 2024-09-13T02:53:52.393 INFO:tasks.workunit.client.1.smithi131.stdout:7/129: mkdir d1b/d23/d29 0 2024-09-13T02:53:52.393 INFO:tasks.workunit.client.1.smithi131.stdout:7/130: truncate d1b/f24 1015601 0 2024-09-13T02:53:52.393 INFO:tasks.workunit.client.1.smithi131.stdout:7/131: mknod d1b/d23/c2a 0 2024-09-13T02:53:52.394 INFO:tasks.workunit.client.1.smithi131.stdout:7/132: readlink d1b/l1d 0 2024-09-13T02:53:52.395 INFO:tasks.workunit.client.1.smithi131.stdout:7/133: rmdir d1b/d23/d29 0 2024-09-13T02:53:52.396 INFO:tasks.workunit.client.1.smithi131.stdout:7/134: mknod d1b/d23/c2b 0 2024-09-13T02:53:52.396 INFO:tasks.workunit.client.1.smithi131.stdout:7/135: creat d1b/f2c x:0 0 0 2024-09-13T02:53:52.399 INFO:tasks.workunit.client.1.smithi131.stdout:9/173: dwrite d0/d3/d14/d1a/f23 [4194304,4194304] 0 2024-09-13T02:53:52.399 INFO:tasks.workunit.client.1.smithi131.stdout:9/174: fsync d0/f15 0 2024-09-13T02:53:52.399 INFO:tasks.workunit.client.1.smithi131.stdout:9/175: creat d0/d3/d14/d1a/f30 x:0 0 0 2024-09-13T02:53:52.399 INFO:tasks.workunit.client.1.smithi131.stdout:7/136: rename f18 to d1b/d23/f2d 0 2024-09-13T02:53:52.399 INFO:tasks.workunit.client.1.smithi131.stdout:7/137: write f4 [4535965,59978] 0 2024-09-13T02:53:52.399 INFO:tasks.workunit.client.1.smithi131.stdout:7/138: creat d1b/f2e x:0 0 0 2024-09-13T02:53:52.400 INFO:tasks.workunit.client.1.smithi131.stdout:9/176: creat d0/d3/d14/d17/f31 x:0 0 0 2024-09-13T02:53:52.401 INFO:tasks.workunit.client.1.smithi131.stdout:0/182: dwrite d0/d2/f3f [0,4194304] 0 2024-09-13T02:53:52.401 INFO:tasks.workunit.client.1.smithi131.stdout:2/136: write f4 [2170333,109267] 0 2024-09-13T02:53:52.401 INFO:tasks.workunit.client.1.smithi131.stdout:1/222: dwrite dd/d26/d2a/d2c/f34 [0,4194304] 0 2024-09-13T02:53:52.401 INFO:tasks.workunit.client.1.smithi131.stdout:7/139: rename d1b/f20 to d1b/f2f 0 2024-09-13T02:53:52.402 INFO:tasks.workunit.client.1.smithi131.stdout:3/211: dread d2/d4/d7/d1d/f21 [0,4194304] 0 2024-09-13T02:53:52.407 INFO:tasks.workunit.client.1.smithi131.stdout:0/183: truncate d0/f18 873832 0 2024-09-13T02:53:52.407 INFO:tasks.workunit.client.1.smithi131.stdout:2/137: symlink d5/d18/l29 0 2024-09-13T02:53:52.408 INFO:tasks.workunit.client.1.smithi131.stdout:3/212: rmdir d2/d4/d14/d49 39 2024-09-13T02:53:52.411 INFO:tasks.workunit.client.1.smithi131.stdout:0/184: creat d0/de/f47 x:0 0 0 2024-09-13T02:53:52.413 INFO:tasks.workunit.client.1.smithi131.stdout:2/138: rename d5/cb to d5/dd/d21/c2a 0 2024-09-13T02:53:52.414 INFO:tasks.workunit.client.1.smithi131.stdout:3/213: mknod d2/d4/d14/d4f/c52 0 2024-09-13T02:53:52.421 INFO:tasks.workunit.client.1.smithi131.stdout:2/139: dread d5/fe [0,4194304] 0 2024-09-13T02:53:52.422 INFO:tasks.workunit.client.1.smithi131.stdout:2/140: rmdir d5/dd/d1d 39 2024-09-13T02:53:52.424 INFO:tasks.workunit.client.1.smithi131.stdout:2/141: creat d5/dd/d21/f2b x:0 0 0 2024-09-13T02:53:52.425 INFO:tasks.workunit.client.1.smithi131.stdout:2/142: mkdir d5/d1e/d2c 0 2024-09-13T02:53:52.425 INFO:tasks.workunit.client.1.smithi131.stdout:0/185: dread d0/f12 [0,4194304] 0 2024-09-13T02:53:52.426 INFO:tasks.workunit.client.1.smithi131.stdout:3/214: dread d2/d4/d7/d1d/f30 [0,4194304] 0 2024-09-13T02:53:52.426 INFO:tasks.workunit.client.1.smithi131.stdout:1/223: dwrite f0 [0,4194304] 0 2024-09-13T02:53:52.427 INFO:tasks.workunit.client.1.smithi131.stdout:2/143: symlink d5/l2d 0 2024-09-13T02:53:52.427 INFO:tasks.workunit.client.1.smithi131.stdout:2/144: readlink d5/d18/l29 0 2024-09-13T02:53:52.427 INFO:tasks.workunit.client.1.smithi131.stdout:9/177: dwrite d0/d3/d14/d17/f21 [0,4194304] 0 2024-09-13T02:53:52.427 INFO:tasks.workunit.client.1.smithi131.stdout:0/186: mknod d0/de/d1f/d22/d31/c48 0 2024-09-13T02:53:52.427 INFO:tasks.workunit.client.1.smithi131.stdout:3/215: dread - d2/d4/d1a/f37 zero size 2024-09-13T02:53:52.429 INFO:tasks.workunit.client.1.smithi131.stdout:1/224: creat dd/d26/f50 x:0 0 0 2024-09-13T02:53:52.430 INFO:tasks.workunit.client.1.smithi131.stdout:2/145: truncate d5/d18/f1b 505060 0 2024-09-13T02:53:52.431 INFO:tasks.workunit.client.1.smithi131.stdout:9/178: truncate d0/d3/d14/d1a/f1d 577912 0 2024-09-13T02:53:52.432 INFO:tasks.workunit.client.1.smithi131.stdout:3/216: rename d2/d4/d14/f1f to d2/d4/d7/f53 0 2024-09-13T02:53:52.434 INFO:tasks.workunit.client.1.smithi131.stdout:1/225: mkdir dd/d51 0 2024-09-13T02:53:52.434 INFO:tasks.workunit.client.1.smithi131.stdout:1/226: write dd/d26/f50 [508812,70212] 0 2024-09-13T02:53:52.434 INFO:tasks.workunit.client.1.smithi131.stdout:1/227: creat dd/d33/d42/f52 x:0 0 0 2024-09-13T02:53:52.434 INFO:tasks.workunit.client.1.smithi131.stdout:1/228: dread - dd/f43 zero size 2024-09-13T02:53:52.435 INFO:tasks.workunit.client.1.smithi131.stdout:2/146: truncate d5/fe 670373 0 2024-09-13T02:53:52.436 INFO:tasks.workunit.client.1.smithi131.stdout:3/217: dread d2/d4/d1a/d31/f42 [0,4194304] 0 2024-09-13T02:53:52.436 INFO:tasks.workunit.client.1.smithi131.stdout:3/218: rename d2/d4/d7/d1d to d2/d4/d7/d1d/d54 22 2024-09-13T02:53:52.436 INFO:tasks.workunit.client.1.smithi131.stdout:3/219: chown d2/d4/f23 31 1 2024-09-13T02:53:52.437 INFO:tasks.workunit.client.1.smithi131.stdout:1/229: mknod dd/d26/d2a/d2c/d4b/c53 0 2024-09-13T02:53:52.438 INFO:tasks.workunit.client.1.smithi131.stdout:1/230: creat dd/d33/d42/f54 x:0 0 0 2024-09-13T02:53:52.439 INFO:tasks.workunit.client.1.smithi131.stdout:1/231: symlink dd/d33/l55 0 2024-09-13T02:53:52.454 INFO:tasks.workunit.client.1.smithi131.stdout:3/220: dwrite d2/d4/d7/d1d/f2e [0,4194304] 0 2024-09-13T02:53:52.455 INFO:tasks.workunit.client.1.smithi131.stdout:0/187: dwrite d0/f2b [0,4194304] 0 2024-09-13T02:53:52.455 INFO:tasks.workunit.client.1.smithi131.stdout:2/147: dread d5/fe [0,4194304] 0 2024-09-13T02:53:52.455 INFO:tasks.workunit.client.1.smithi131.stdout:2/148: fsync d5/dd/ff 0 2024-09-13T02:53:52.455 INFO:tasks.workunit.client.1.smithi131.stdout:2/149: chown d5/d18/f14 52783143 1 2024-09-13T02:53:52.455 INFO:tasks.workunit.client.1.smithi131.stdout:2/150: dread - d5/dd/d21/f2b zero size 2024-09-13T02:53:52.455 INFO:tasks.workunit.client.1.smithi131.stdout:2/151: creat d5/f2e x:0 0 0 2024-09-13T02:53:52.458 INFO:tasks.workunit.client.1.smithi131.stdout:3/221: truncate d2/d4/d1a/f1e 1102994 0 2024-09-13T02:53:52.459 INFO:tasks.workunit.client.1.smithi131.stdout:3/222: truncate d2/d4/f43 550735 0 2024-09-13T02:53:52.460 INFO:tasks.workunit.client.1.smithi131.stdout:2/152: dread d5/dd/d21/f24 [0,4194304] 0 2024-09-13T02:53:52.460 INFO:tasks.workunit.client.1.smithi131.stdout:9/179: read d0/d3/d14/d1a/f1d [100805,37064] 0 2024-09-13T02:53:52.460 INFO:tasks.workunit.client.1.smithi131.stdout:3/223: truncate d2/dc/f1b 3226344 0 2024-09-13T02:53:52.460 INFO:tasks.workunit.client.1.smithi131.stdout:3/224: read - d2/d4/d14/f3e zero size 2024-09-13T02:53:52.462 INFO:tasks.workunit.client.1.smithi131.stdout:9/180: mkdir d0/d3/d14/d17/d32 0 2024-09-13T02:53:52.465 INFO:tasks.workunit.client.1.smithi131.stdout:2/153: dread d5/fa [0,4194304] 0 2024-09-13T02:53:52.465 INFO:tasks.workunit.client.1.smithi131.stdout:3/225: getdents d2/dc/d39 0 2024-09-13T02:53:52.469 INFO:tasks.workunit.client.1.smithi131.stdout:2/154: unlink d5/f17 0 2024-09-13T02:53:52.470 INFO:tasks.workunit.client.1.smithi131.stdout:2/155: symlink d5/dd/d26/l2f 0 2024-09-13T02:53:52.472 INFO:tasks.workunit.client.1.smithi131.stdout:2/156: write d5/d18/f1b [418616,89807] 0 2024-09-13T02:53:52.472 INFO:tasks.workunit.client.1.smithi131.stdout:2/157: stat d5/dd/d21 0 2024-09-13T02:53:52.474 INFO:tasks.workunit.client.1.smithi131.stdout:0/188: dwrite d0/f18 [0,4194304] 0 2024-09-13T02:53:52.475 INFO:tasks.workunit.client.1.smithi131.stdout:6/243: sync 2024-09-13T02:53:52.476 INFO:tasks.workunit.client.1.smithi131.stdout:0/189: mknod d0/de/d1f/d22/d31/d39/c49 0 2024-09-13T02:53:52.478 INFO:tasks.workunit.client.1.smithi131.stdout:0/190: creat d0/d2/d41/f4a x:0 0 0 2024-09-13T02:53:52.480 INFO:tasks.workunit.client.1.smithi131.stdout:0/191: rmdir d0/de/d1f/d22/d31/d39 39 2024-09-13T02:53:52.481 INFO:tasks.workunit.client.1.smithi131.stdout:0/192: mkdir d0/de/d1f/d22/d3d/d43/d4b 0 2024-09-13T02:53:52.484 INFO:tasks.workunit.client.1.smithi131.stdout:0/193: rmdir d0/de/d1f/d22/d31/d39 39 2024-09-13T02:53:52.484 INFO:tasks.workunit.client.1.smithi131.stdout:0/194: truncate d0/de/d1f/f33 4203189 0 2024-09-13T02:53:52.484 INFO:tasks.workunit.client.1.smithi131.stdout:0/195: symlink d0/de/d1f/d22/d3d/d43/l4c 0 2024-09-13T02:53:52.501 INFO:tasks.workunit.client.1.smithi131.stdout:9/181: dwrite d0/f11 [0,4194304] 0 2024-09-13T02:53:52.501 INFO:tasks.workunit.client.1.smithi131.stdout:9/182: write d0/d3/d14/d1a/f30 [261137,120156] 0 2024-09-13T02:53:52.507 INFO:tasks.workunit.client.1.smithi131.stdout:9/183: dread d0/f9 [0,4194304] 0 2024-09-13T02:53:52.507 INFO:tasks.workunit.client.1.smithi131.stdout:9/184: readlink d0/l22 0 2024-09-13T02:53:52.508 INFO:tasks.workunit.client.1.smithi131.stdout:3/226: dwrite d2/d4/f34 [0,4194304] 0 2024-09-13T02:53:52.508 INFO:tasks.workunit.client.1.smithi131.stdout:3/227: truncate d2/d4/d7/f53 329402 0 2024-09-13T02:53:52.509 INFO:tasks.workunit.client.1.smithi131.stdout:3/228: mknod d2/d4/d1a/c55 0 2024-09-13T02:53:52.509 INFO:tasks.workunit.client.1.smithi131.stdout:3/229: mknod d2/d4/d7/d8/c56 0 2024-09-13T02:53:52.512 INFO:tasks.workunit.client.1.smithi131.stdout:6/244: dwrite d1/d8/f1a [0,4194304] 0 2024-09-13T02:53:52.513 INFO:tasks.workunit.client.1.smithi131.stdout:2/158: dwrite d5/dd/ff [0,4194304] 0 2024-09-13T02:53:52.513 INFO:tasks.workunit.client.1.smithi131.stdout:2/159: write d5/d18/f1b [865090,123350] 0 2024-09-13T02:53:52.513 INFO:tasks.workunit.client.1.smithi131.stdout:2/160: write d5/dd/d21/f24 [2440351,117153] 0 2024-09-13T02:53:52.513 INFO:tasks.workunit.client.1.smithi131.stdout:9/185: dread d0/f10 [0,4194304] 0 2024-09-13T02:53:52.514 INFO:tasks.workunit.client.1.smithi131.stdout:0/196: dwrite d0/d2/f3f [0,4194304] 0 2024-09-13T02:53:52.515 INFO:tasks.workunit.client.1.smithi131.stdout:2/161: symlink d5/dd/d26/l30 0 2024-09-13T02:53:52.516 INFO:tasks.workunit.client.1.smithi131.stdout:9/186: creat d0/f33 x:0 0 0 2024-09-13T02:53:52.519 INFO:tasks.workunit.client.1.smithi131.stdout:9/187: write d0/f15 [567800,88454] 0 2024-09-13T02:53:52.520 INFO:tasks.workunit.client.1.smithi131.stdout:0/197: symlink d0/de/d1f/l4d 0 2024-09-13T02:53:52.522 INFO:tasks.workunit.client.1.smithi131.stdout:9/188: link d0/d3/d14/d17/f21 d0/d3/d14/f34 0 2024-09-13T02:53:52.523 INFO:tasks.workunit.client.1.smithi131.stdout:0/198: creat d0/de/d1f/d22/f4e x:0 0 0 2024-09-13T02:53:52.523 INFO:tasks.workunit.client.1.smithi131.stdout:0/199: creat d0/de/f4f x:0 0 0 2024-09-13T02:53:52.524 INFO:tasks.workunit.client.1.smithi131.stdout:0/200: creat d0/d2/d41/f50 x:0 0 0 2024-09-13T02:53:52.528 INFO:tasks.workunit.client.1.smithi131.stdout:0/201: dread d0/d2/fa [0,4194304] 0 2024-09-13T02:53:52.528 INFO:tasks.workunit.client.1.smithi131.stdout:0/202: chown d0/de/l1e 47185 1 2024-09-13T02:53:52.528 INFO:tasks.workunit.client.1.smithi131.stdout:0/203: chown d0/l36 1615708 1 2024-09-13T02:53:52.529 INFO:tasks.workunit.client.1.smithi131.stdout:0/204: creat d0/de/d1f/d22/d3d/d43/d4b/f51 x:0 0 0 2024-09-13T02:53:52.529 INFO:tasks.workunit.client.1.smithi131.stdout:0/205: write d0/de/d1f/d22/f29 [635666,43612] 0 2024-09-13T02:53:52.530 INFO:tasks.workunit.client.1.smithi131.stdout:0/206: mknod d0/de/d1f/d22/d31/d39/d3c/c52 0 2024-09-13T02:53:52.531 INFO:tasks.workunit.client.1.smithi131.stdout:0/207: link d0/d2/f17 d0/de/d1f/d22/f53 0 2024-09-13T02:53:52.534 INFO:tasks.workunit.client.1.smithi131.stdout:6/245: dwrite d1/d8/d9/f17 [0,4194304] 0 2024-09-13T02:53:52.534 INFO:tasks.workunit.client.1.smithi131.stdout:6/246: write d1/d8/d9/db/d15/f31 [57846,98851] 0 2024-09-13T02:53:52.535 INFO:tasks.workunit.client.1.smithi131.stdout:6/247: getdents d1/d8/d9/db/d40 0 2024-09-13T02:53:52.538 INFO:tasks.workunit.client.1.smithi131.stdout:2/162: rename d5/dd to d5/d31 0 2024-09-13T02:53:52.538 INFO:tasks.workunit.client.1.smithi131.stdout:2/163: fdatasync d5/d31/f16 0 2024-09-13T02:53:52.538 INFO:tasks.workunit.client.1.smithi131.stdout:9/189: fsync d0/f33 0 2024-09-13T02:53:52.539 INFO:tasks.workunit.client.1.smithi131.stdout:9/190: mknod d0/d3/d14/d17/d32/c35 0 2024-09-13T02:53:52.541 INFO:tasks.workunit.client.1.smithi131.stdout:9/191: mknod d0/d3/d14/c36 0 2024-09-13T02:53:52.541 INFO:tasks.workunit.client.1.smithi131.stdout:9/192: truncate d0/d3/d14/d1a/f1d 1298362 0 2024-09-13T02:53:52.541 INFO:tasks.workunit.client.1.smithi131.stdout:9/193: creat d0/d3/d14/d17/f37 x:0 0 0 2024-09-13T02:53:52.555 INFO:tasks.workunit.client.1.smithi131.stdout:0/208: dwrite d0/de/f1a [0,4194304] 0 2024-09-13T02:53:52.555 INFO:tasks.workunit.client.1.smithi131.stdout:0/209: chown d0/de/d1f/d22/d3d/d43/l4c 14909 1 2024-09-13T02:53:52.557 INFO:tasks.workunit.client.1.smithi131.stdout:0/210: getdents d0/de/d1f 0 2024-09-13T02:53:52.557 INFO:tasks.workunit.client.1.smithi131.stdout:0/211: chown d0/de/d1f/d22 23084 1 2024-09-13T02:53:52.558 INFO:tasks.workunit.client.1.smithi131.stdout:0/212: mknod d0/c54 0 2024-09-13T02:53:52.558 INFO:tasks.workunit.client.1.smithi131.stdout:0/213: mkdir d0/de/d1f/d22/d3d/d55 0 2024-09-13T02:53:52.560 INFO:tasks.workunit.client.1.smithi131.stdout:0/214: mknod d0/de/d1f/c56 0 2024-09-13T02:53:52.567 INFO:tasks.workunit.client.1.smithi131.stdout:6/248: dwrite d1/f7 [0,4194304] 0 2024-09-13T02:53:52.568 INFO:tasks.workunit.client.1.smithi131.stdout:6/249: symlink d1/d8/d9/db/d2a/d3b/l52 0 2024-09-13T02:53:52.569 INFO:tasks.workunit.client.1.smithi131.stdout:2/164: dwrite d5/fa [0,4194304] 0 2024-09-13T02:53:52.569 INFO:tasks.workunit.client.1.smithi131.stdout:9/194: dwrite d0/f10 [0,4194304] 0 2024-09-13T02:53:52.570 INFO:tasks.workunit.client.1.smithi131.stdout:6/250: dread d1/d8/f3e [0,4194304] 0 2024-09-13T02:53:52.572 INFO:tasks.workunit.client.1.smithi131.stdout:6/251: mkdir d1/d53 0 2024-09-13T02:53:52.584 INFO:tasks.workunit.client.1.smithi131.stdout:2/165: read d5/f9 [2261498,44404] 0 2024-09-13T02:53:52.584 INFO:tasks.workunit.client.1.smithi131.stdout:2/166: mkdir d5/d31/d1d/d32 0 2024-09-13T02:53:52.599 INFO:tasks.workunit.client.1.smithi131.stdout:4/166: sync 2024-09-13T02:53:52.599 INFO:tasks.workunit.client.1.smithi131.stdout:8/266: sync 2024-09-13T02:53:52.600 INFO:tasks.workunit.client.1.smithi131.stdout:4/167: link d1/d8/f17 d1/d8/f2f 0 2024-09-13T02:53:52.609 INFO:tasks.workunit.client.1.smithi131.stdout:4/168: dread d1/d18/f2d [0,4194304] 0 2024-09-13T02:53:52.610 INFO:tasks.workunit.client.1.smithi131.stdout:0/215: dwrite d0/d2/f3f [0,4194304] 0 2024-09-13T02:53:52.610 INFO:tasks.workunit.client.1.smithi131.stdout:0/216: write d0/de/d1f/d22/d31/f3a [925183,115997] 0 2024-09-13T02:53:52.610 INFO:tasks.workunit.client.1.smithi131.stdout:0/217: chown d0/l1d 9071828 1 2024-09-13T02:53:52.610 INFO:tasks.workunit.client.1.smithi131.stdout:0/218: getdents d0/de/d45 0 2024-09-13T02:53:52.612 INFO:tasks.workunit.client.1.smithi131.stdout:4/169: rmdir d1/dc/d19 39 2024-09-13T02:53:52.612 INFO:tasks.workunit.client.1.smithi131.stdout:4/170: fdatasync d1/dc/f2e 0 2024-09-13T02:53:52.612 INFO:tasks.workunit.client.1.smithi131.stdout:4/171: chown d1/dc/d19/d29/f2c 6113 1 2024-09-13T02:53:52.612 INFO:tasks.workunit.client.1.smithi131.stdout:4/172: fdatasync d1/d8/f2f 0 2024-09-13T02:53:52.612 INFO:tasks.workunit.client.1.smithi131.stdout:4/173: creat d1/d8/d13/f30 x:0 0 0 2024-09-13T02:53:52.612 INFO:tasks.workunit.client.1.smithi131.stdout:4/174: chown d1/dc/f2e 107598008 1 2024-09-13T02:53:52.612 INFO:tasks.workunit.client.1.smithi131.stdout:4/175: creat d1/dc/f31 x:0 0 0 2024-09-13T02:53:52.613 INFO:tasks.workunit.client.1.smithi131.stdout:0/219: unlink d0/de/d1f/d22/d31/d39/c49 0 2024-09-13T02:53:52.614 INFO:tasks.workunit.client.1.smithi131.stdout:4/176: link d1/d18/f21 d1/d18/f32 0 2024-09-13T02:53:52.615 INFO:tasks.workunit.client.1.smithi131.stdout:6/252: dwrite d1/f2b [0,4194304] 0 2024-09-13T02:53:52.615 INFO:tasks.workunit.client.1.smithi131.stdout:6/253: readlink d1/d8/d9/db/d40/l4a 0 2024-09-13T02:53:52.615 INFO:tasks.workunit.client.1.smithi131.stdout:6/254: readlink d1/d8/d9/db/l45 0 2024-09-13T02:53:52.616 INFO:tasks.workunit.client.1.smithi131.stdout:6/255: unlink d1/d8/d9/db/d15/d26/c18 0 2024-09-13T02:53:52.616 INFO:tasks.workunit.client.1.smithi131.stdout:0/220: dread d0/de/f38 [0,4194304] 0 2024-09-13T02:53:52.617 INFO:tasks.workunit.client.1.smithi131.stdout:9/195: dwrite d0/f12 [0,4194304] 0 2024-09-13T02:53:52.617 INFO:tasks.workunit.client.1.smithi131.stdout:2/167: dwrite d5/d18/f14 [0,4194304] 0 2024-09-13T02:53:52.617 INFO:tasks.workunit.client.1.smithi131.stdout:2/168: dread - d5/d31/d21/f2b zero size 2024-09-13T02:53:52.618 INFO:tasks.workunit.client.1.smithi131.stdout:2/169: mkdir d5/d33 0 2024-09-13T02:53:52.618 INFO:tasks.workunit.client.1.smithi131.stdout:2/170: chown d5/d31/d1d 7391197 1 2024-09-13T02:53:52.619 INFO:tasks.workunit.client.1.smithi131.stdout:2/171: mkdir d5/d34 0 2024-09-13T02:53:52.619 INFO:tasks.workunit.client.1.smithi131.stdout:4/177: write d1/dc/d19/d29/f2c [3090010,108687] 0 2024-09-13T02:53:52.620 INFO:tasks.workunit.client.1.smithi131.stdout:2/172: symlink d5/d31/d1d/d32/l35 0 2024-09-13T02:53:52.620 INFO:tasks.workunit.client.1.smithi131.stdout:2/173: readlink d5/d31/d1d/l1f 0 2024-09-13T02:53:52.620 INFO:tasks.workunit.client.1.smithi131.stdout:2/174: read d5/f9 [2817435,70295] 0 2024-09-13T02:53:52.621 INFO:tasks.workunit.client.1.smithi131.stdout:8/267: dwrite db/d1d/d1f/f2d [0,4194304] 0 2024-09-13T02:53:52.621 INFO:tasks.workunit.client.1.smithi131.stdout:8/268: getdents db/d1d/d1f/d41/d50 0 2024-09-13T02:53:52.622 INFO:tasks.workunit.client.1.smithi131.stdout:4/178: mkdir d1/dc/d19/d29/d33 0 2024-09-13T02:53:52.624 INFO:tasks.workunit.client.1.smithi131.stdout:2/175: unlink d5/d31/d1d/d32/l35 0 2024-09-13T02:53:52.629 INFO:tasks.workunit.client.1.smithi131.stdout:6/256: read d1/f7 [380907,89338] 0 2024-09-13T02:53:52.629 INFO:tasks.workunit.client.1.smithi131.stdout:6/257: fsync d1/d8/d9/db/ff 0 2024-09-13T02:53:52.633 INFO:tasks.workunit.client.1.smithi131.stdout:8/269: creat db/d1d/d1f/f52 x:0 0 0 2024-09-13T02:53:52.634 INFO:tasks.workunit.client.1.smithi131.stdout:4/179: mkdir d1/d18/d34 0 2024-09-13T02:53:52.637 INFO:tasks.workunit.client.1.smithi131.stdout:4/180: mknod d1/dc/d19/d29/d33/c35 0 2024-09-13T02:53:52.638 INFO:tasks.workunit.client.1.smithi131.stdout:0/221: dread d0/de/f1a [0,4194304] 0 2024-09-13T02:53:52.639 INFO:tasks.workunit.client.1.smithi131.stdout:0/222: dread - d0/d2/d41/f4a zero size 2024-09-13T02:53:52.640 INFO:tasks.workunit.client.1.smithi131.stdout:8/270: write db/d2e/f43 [777941,2822] 0 2024-09-13T02:53:52.640 INFO:tasks.workunit.client.1.smithi131.stdout:4/181: creat d1/f36 x:0 0 0 2024-09-13T02:53:52.640 INFO:tasks.workunit.client.1.smithi131.stdout:8/271: write db/d1d/d34/f3f [671363,120855] 0 2024-09-13T02:53:52.641 INFO:tasks.workunit.client.1.smithi131.stdout:8/272: creat db/d2e/d40/f53 x:0 0 0 2024-09-13T02:53:52.642 INFO:tasks.workunit.client.1.smithi131.stdout:4/182: truncate d1/dc/d19/d29/f2c 645246 0 2024-09-13T02:53:52.643 INFO:tasks.workunit.client.1.smithi131.stdout:0/223: dread d0/de/f14 [0,4194304] 0 2024-09-13T02:53:52.644 INFO:tasks.workunit.client.1.smithi131.stdout:4/183: creat d1/dc/d19/d29/d33/f37 x:0 0 0 2024-09-13T02:53:52.644 INFO:tasks.workunit.client.1.smithi131.stdout:4/184: dread - d1/d18/f32 zero size 2024-09-13T02:53:52.645 INFO:tasks.workunit.client.1.smithi131.stdout:0/224: mknod d0/de/d1f/c57 0 2024-09-13T02:53:52.647 INFO:tasks.workunit.client.1.smithi131.stdout:4/185: rename d1/d8/c1f to d1/dc/d19/d29/c38 0 2024-09-13T02:53:52.647 INFO:tasks.workunit.client.1.smithi131.stdout:4/186: write d1/f16 [1281459,67537] 0 2024-09-13T02:53:52.647 INFO:tasks.workunit.client.1.smithi131.stdout:4/187: fsync d1/dc/f2e 0 2024-09-13T02:53:52.647 INFO:tasks.workunit.client.1.smithi131.stdout:4/188: write d1/d8/ff [2359893,72100] 0 2024-09-13T02:53:52.647 INFO:tasks.workunit.client.1.smithi131.stdout:4/189: stat d1/dc/d19/d29/d33/c35 0 2024-09-13T02:53:52.649 INFO:tasks.workunit.client.1.smithi131.stdout:0/225: rename d0/d2/fa to d0/de/d1f/d22/d3d/d55/f58 0 2024-09-13T02:53:52.649 INFO:tasks.workunit.client.1.smithi131.stdout:0/226: write d0/de/d1f/d22/d31/f3a [1396621,40388] 0 2024-09-13T02:53:52.649 INFO:tasks.workunit.client.1.smithi131.stdout:0/227: fsync d0/d2/d41/f50 0 2024-09-13T02:53:52.649 INFO:tasks.workunit.client.1.smithi131.stdout:0/228: read d0/de/d1f/d22/f29 [636948,20436] 0 2024-09-13T02:53:52.650 INFO:tasks.workunit.client.1.smithi131.stdout:7/140: sync 2024-09-13T02:53:52.650 INFO:tasks.workunit.client.1.smithi131.stdout:5/151: sync 2024-09-13T02:53:52.650 INFO:tasks.workunit.client.1.smithi131.stdout:1/232: sync 2024-09-13T02:53:52.650 INFO:tasks.workunit.client.1.smithi131.stdout:1/233: dread - dd/f3a zero size 2024-09-13T02:53:52.650 INFO:tasks.workunit.client.1.smithi131.stdout:2/176: dwrite d5/fe [0,4194304] 0 2024-09-13T02:53:52.650 INFO:tasks.workunit.client.1.smithi131.stdout:4/190: mknod d1/dc/d22/c39 0 2024-09-13T02:53:52.650 INFO:tasks.workunit.client.1.smithi131.stdout:4/191: dread - d1/dc/f31 zero size 2024-09-13T02:53:52.650 INFO:tasks.workunit.client.1.smithi131.stdout:6/258: dwrite d1/d8/d9/db/d15/f3d [0,4194304] 0 2024-09-13T02:53:52.651 INFO:tasks.workunit.client.1.smithi131.stdout:6/259: getdents d1/d8/d9/d4b 0 2024-09-13T02:53:52.651 INFO:tasks.workunit.client.1.smithi131.stdout:0/229: creat d0/de/f59 x:0 0 0 2024-09-13T02:53:52.652 INFO:tasks.workunit.client.1.smithi131.stdout:5/152: creat d1/d5/f3a x:0 0 0 2024-09-13T02:53:52.652 INFO:tasks.workunit.client.1.smithi131.stdout:7/141: dread f3 [0,4194304] 0 2024-09-13T02:53:52.653 INFO:tasks.workunit.client.1.smithi131.stdout:1/234: mknod dd/d33/c56 0 2024-09-13T02:53:52.653 INFO:tasks.workunit.client.1.smithi131.stdout:1/235: creat dd/d26/f57 x:0 0 0 2024-09-13T02:53:52.657 INFO:tasks.workunit.client.1.smithi131.stdout:2/177: mknod d5/d31/d1d/d32/c36 0 2024-09-13T02:53:52.659 INFO:tasks.workunit.client.1.smithi131.stdout:0/230: mkdir d0/de/d45/d5a 0 2024-09-13T02:53:52.661 INFO:tasks.workunit.client.1.smithi131.stdout:5/153: rmdir d1/d21/d22/d37 0 2024-09-13T02:53:52.662 INFO:tasks.workunit.client.1.smithi131.stdout:7/142: mkdir d1b/d30 0 2024-09-13T02:53:52.663 INFO:tasks.workunit.client.1.smithi131.stdout:4/192: dread d1/d8/f1d [0,4194304] 0 2024-09-13T02:53:52.664 INFO:tasks.workunit.client.1.smithi131.stdout:2/178: mkdir d5/d31/d1d/d37 0 2024-09-13T02:53:52.666 INFO:tasks.workunit.client.1.smithi131.stdout:7/143: mkdir d1b/d30/d31 0 2024-09-13T02:53:52.666 INFO:tasks.workunit.client.1.smithi131.stdout:2/179: creat d5/d31/d1d/d32/f38 x:0 0 0 2024-09-13T02:53:52.666 INFO:tasks.workunit.client.1.smithi131.stdout:2/180: write d5/f28 [380510,113593] 0 2024-09-13T02:53:52.672 INFO:tasks.workunit.client.1.smithi131.stdout:1/236: dread dd/ff [0,4194304] 0 2024-09-13T02:53:52.672 INFO:tasks.workunit.client.1.smithi131.stdout:1/237: truncate dd/f3c 1175148 0 2024-09-13T02:53:52.673 INFO:tasks.workunit.client.1.smithi131.stdout:0/231: dread d0/f2b [0,4194304] 0 2024-09-13T02:53:52.674 INFO:tasks.workunit.client.1.smithi131.stdout:0/232: creat d0/de/d45/d5a/f5b x:0 0 0 2024-09-13T02:53:52.675 INFO:tasks.workunit.client.1.smithi131.stdout:0/233: readlink d0/l20 0 2024-09-13T02:53:52.676 INFO:tasks.workunit.client.1.smithi131.stdout:0/234: rename d0/de/l1c to d0/de/d1f/d22/l5c 0 2024-09-13T02:53:52.685 INFO:tasks.workunit.client.1.smithi131.stdout:6/260: dwrite d1/d8/d9/fd [0,4194304] 0 2024-09-13T02:53:52.689 INFO:tasks.workunit.client.1.smithi131.stdout:2/181: dread d5/f28 [0,4194304] 0 2024-09-13T02:53:52.691 INFO:tasks.workunit.client.1.smithi131.stdout:2/182: read d5/d31/f16 [382069,68113] 0 2024-09-13T02:53:52.691 INFO:tasks.workunit.client.1.smithi131.stdout:8/273: dwrite f6 [4194304,4194304] 0 2024-09-13T02:53:52.691 INFO:tasks.workunit.client.1.smithi131.stdout:8/274: truncate db/f18 864518 0 2024-09-13T02:53:52.691 INFO:tasks.workunit.client.1.smithi131.stdout:8/275: chown db/d1d/d34/f3f 677760420 1 2024-09-13T02:53:52.700 INFO:tasks.workunit.client.1.smithi131.stdout:6/261: rmdir d1/d8 39 2024-09-13T02:53:52.700 INFO:tasks.workunit.client.1.smithi131.stdout:6/262: readlink d1/d8/d9/db/d2a/d3b/l52 0 2024-09-13T02:53:52.701 INFO:tasks.workunit.client.1.smithi131.stdout:8/276: rmdir db/d1d/d31 39 2024-09-13T02:53:52.702 INFO:tasks.workunit.client.1.smithi131.stdout:8/277: write db/d1d/d1f/f2c [330920,66435] 0 2024-09-13T02:53:52.702 INFO:tasks.workunit.client.1.smithi131.stdout:8/278: rename db/d1d/d34 to db/d1d/d34/d54 22 2024-09-13T02:53:52.702 INFO:tasks.workunit.client.1.smithi131.stdout:8/279: write db/f23 [3465443,117839] 0 2024-09-13T02:53:52.703 INFO:tasks.workunit.client.1.smithi131.stdout:8/280: fsync db/f17 0 2024-09-13T02:53:52.703 INFO:tasks.workunit.client.1.smithi131.stdout:6/263: symlink d1/d8/d9/db/d40/l54 0 2024-09-13T02:53:52.703 INFO:tasks.workunit.client.1.smithi131.stdout:6/264: write d1/d14/f20 [500590,12686] 0 2024-09-13T02:53:52.703 INFO:tasks.workunit.client.1.smithi131.stdout:6/265: dread - d1/d8/d9/db/d15/f3c zero size 2024-09-13T02:53:52.705 INFO:tasks.workunit.client.1.smithi131.stdout:8/281: link db/f23 db/d1d/d1f/d41/f55 0 2024-09-13T02:53:52.707 INFO:tasks.workunit.client.1.smithi131.stdout:6/266: rename d1/d8/f1b to d1/f55 0 2024-09-13T02:53:52.708 INFO:tasks.workunit.client.1.smithi131.stdout:8/282: mkdir db/d2b/d39/d56 0 2024-09-13T02:53:52.709 INFO:tasks.workunit.client.1.smithi131.stdout:6/267: symlink d1/d14/l56 0 2024-09-13T02:53:52.711 INFO:tasks.workunit.client.1.smithi131.stdout:8/283: creat db/d2b/d39/d56/f57 x:0 0 0 2024-09-13T02:53:52.713 INFO:tasks.workunit.client.1.smithi131.stdout:6/268: rename d1/d8/d9/db/d15/c4c to d1/d8/d9/db/c57 0 2024-09-13T02:53:52.713 INFO:tasks.workunit.client.1.smithi131.stdout:6/269: truncate d1/d8/d9/db/f36 1041676 0 2024-09-13T02:53:52.722 INFO:tasks.workunit.client.1.smithi131.stdout:6/270: dread d1/d8/d9/fd [0,4194304] 0 2024-09-13T02:53:52.725 INFO:tasks.workunit.client.1.smithi131.stdout:4/193: dwrite d1/d8/f17 [0,4194304] 0 2024-09-13T02:53:52.725 INFO:tasks.workunit.client.1.smithi131.stdout:4/194: write d1/dc/fe [1751052,38525] 0 2024-09-13T02:53:52.727 INFO:tasks.workunit.client.1.smithi131.stdout:6/271: dread d1/d8/d9/f19 [0,4194304] 0 2024-09-13T02:53:52.730 INFO:tasks.workunit.client.1.smithi131.stdout:1/238: dwrite dd/d26/f35 [0,4194304] 0 2024-09-13T02:53:52.730 INFO:tasks.workunit.client.1.smithi131.stdout:7/144: dwrite d1b/f21 [0,4194304] 0 2024-09-13T02:53:52.730 INFO:tasks.workunit.client.1.smithi131.stdout:7/145: chown c9 136942 1 2024-09-13T02:53:52.730 INFO:tasks.workunit.client.1.smithi131.stdout:0/235: dwrite d0/de/d45/d5a/f5b [0,4194304] 0 2024-09-13T02:53:52.730 INFO:tasks.workunit.client.1.smithi131.stdout:2/183: dwrite d5/fe [0,4194304] 0 2024-09-13T02:53:52.731 INFO:tasks.workunit.client.1.smithi131.stdout:1/239: truncate dd/ff 7104513 0 2024-09-13T02:53:52.731 INFO:tasks.workunit.client.1.smithi131.stdout:1/240: chown dd/d33/d42/l4e 19432416 1 2024-09-13T02:53:52.732 INFO:tasks.workunit.client.1.smithi131.stdout:1/241: chown dd/d26/d44/f22 35 1 2024-09-13T02:53:52.732 INFO:tasks.workunit.client.1.smithi131.stdout:1/242: stat dd/d26/d44/f28 0 2024-09-13T02:53:52.732 INFO:tasks.workunit.client.1.smithi131.stdout:7/146: symlink d1b/l32 0 2024-09-13T02:53:52.732 INFO:tasks.workunit.client.1.smithi131.stdout:7/147: creat d1b/d23/f33 x:0 0 0 2024-09-13T02:53:52.733 INFO:tasks.workunit.client.1.smithi131.stdout:0/236: symlink d0/de/d45/l5d 0 2024-09-13T02:53:52.735 INFO:tasks.workunit.client.1.smithi131.stdout:2/184: dread d5/d31/d21/f24 [0,4194304] 0 2024-09-13T02:53:52.735 INFO:tasks.workunit.client.1.smithi131.stdout:4/195: rmdir d1 39 2024-09-13T02:53:52.735 INFO:tasks.workunit.client.1.smithi131.stdout:4/196: write d1/d8/f15 [374641,42237] 0 2024-09-13T02:53:52.735 INFO:tasks.workunit.client.1.smithi131.stdout:8/284: dwrite db/d2e/d40/f53 [0,4194304] 0 2024-09-13T02:53:52.737 INFO:tasks.workunit.client.1.smithi131.stdout:0/237: creat d0/de/d1f/d22/d31/d39/d3c/f5e x:0 0 0 2024-09-13T02:53:52.738 INFO:tasks.workunit.client.1.smithi131.stdout:2/185: rename d5/d1e/f20 to d5/d31/d26/f39 0 2024-09-13T02:53:52.738 INFO:tasks.workunit.client.1.smithi131.stdout:2/186: creat d5/f3a x:0 0 0 2024-09-13T02:53:52.739 INFO:tasks.workunit.client.1.smithi131.stdout:4/197: dread d1/dc/d19/d29/f2b [0,4194304] 0 2024-09-13T02:53:52.745 INFO:tasks.workunit.client.1.smithi131.stdout:2/187: mkdir d5/d31/d1d/d32/d3b 0 2024-09-13T02:53:52.745 INFO:tasks.workunit.client.1.smithi131.stdout:2/188: chown d5/d31/d1d/d37 81096663 1 2024-09-13T02:53:52.745 INFO:tasks.workunit.client.1.smithi131.stdout:2/189: stat d5/d31 0 2024-09-13T02:53:52.746 INFO:tasks.workunit.client.1.smithi131.stdout:8/285: rmdir db/d2e/d40 39 2024-09-13T02:53:52.747 INFO:tasks.workunit.client.1.smithi131.stdout:0/238: getdents d0/de/d45/d5a 0 2024-09-13T02:53:52.747 INFO:tasks.workunit.client.1.smithi131.stdout:6/272: getdents d1/d8/d9/db/d15 0 2024-09-13T02:53:52.749 INFO:tasks.workunit.client.1.smithi131.stdout:8/286: truncate db/f19 2599424 0 2024-09-13T02:53:52.751 INFO:tasks.workunit.client.1.smithi131.stdout:0/239: creat d0/de/d1f/d22/d3d/d43/f5f x:0 0 0 2024-09-13T02:53:52.752 INFO:tasks.workunit.client.1.smithi131.stdout:8/287: symlink db/d1d/d1f/d41/d50/l58 0 2024-09-13T02:53:52.755 INFO:tasks.workunit.client.1.smithi131.stdout:8/288: getdents db/d1d/d1f 0 2024-09-13T02:53:52.755 INFO:tasks.workunit.client.1.smithi131.stdout:8/289: fdatasync db/d2b/f47 0 2024-09-13T02:53:52.755 INFO:tasks.workunit.client.1.smithi131.stdout:8/290: truncate db/d2e/d40/f48 397483 0 2024-09-13T02:53:52.756 INFO:tasks.workunit.client.1.smithi131.stdout:3/230: sync 2024-09-13T02:53:52.757 INFO:tasks.workunit.client.1.smithi131.stdout:1/243: dwrite dd/d26/f50 [0,4194304] 0 2024-09-13T02:53:52.757 INFO:tasks.workunit.client.1.smithi131.stdout:7/148: dwrite d1b/f21 [4194304,4194304] 0 2024-09-13T02:53:52.758 INFO:tasks.workunit.client.1.smithi131.stdout:3/231: mknod d2/d4/d7/c57 0 2024-09-13T02:53:52.758 INFO:tasks.workunit.client.1.smithi131.stdout:3/232: chown d2/d4/d1a/f37 23 1 2024-09-13T02:53:52.767 INFO:tasks.workunit.client.1.smithi131.stdout:5/154: sync 2024-09-13T02:53:52.767 INFO:tasks.workunit.client.1.smithi131.stdout:9/196: sync 2024-09-13T02:53:52.767 INFO:tasks.workunit.client.1.smithi131.stdout:9/197: write d0/d3/d14/d17/f37 [227909,35445] 0 2024-09-13T02:53:52.768 INFO:tasks.workunit.client.1.smithi131.stdout:9/198: mknod d0/d3/d14/d1a/d2a/c38 0 2024-09-13T02:53:52.772 INFO:tasks.workunit.client.1.smithi131.stdout:2/190: dwrite d5/d31/d1d/d32/f38 [0,4194304] 0 2024-09-13T02:53:52.772 INFO:tasks.workunit.client.1.smithi131.stdout:0/240: read d0/de/d1f/f33 [1599203,50848] 0 2024-09-13T02:53:52.772 INFO:tasks.workunit.client.1.smithi131.stdout:5/155: dread d1/d5/f13 [0,4194304] 0 2024-09-13T02:53:52.776 INFO:tasks.workunit.client.1.smithi131.stdout:0/241: link d0/de/d45/d5a/f5b d0/de/d1f/d22/d31/f60 0 2024-09-13T02:53:52.776 INFO:tasks.workunit.client.1.smithi131.stdout:0/242: write d0/de/d1f/d22/f29 [653623,69688] 0 2024-09-13T02:53:52.778 INFO:tasks.workunit.client.1.smithi131.stdout:7/149: write ff [3732540,38328] 0 2024-09-13T02:53:52.780 INFO:tasks.workunit.client.1.smithi131.stdout:7/150: creat d1b/f34 x:0 0 0 2024-09-13T02:53:52.780 INFO:tasks.workunit.client.1.smithi131.stdout:7/151: readlink d1b/l1d 0 2024-09-13T02:53:52.781 INFO:tasks.workunit.client.1.smithi131.stdout:7/152: getdents d1b/d30 0 2024-09-13T02:53:52.783 INFO:tasks.workunit.client.1.smithi131.stdout:7/153: unlink ff 0 2024-09-13T02:53:52.785 INFO:tasks.workunit.client.1.smithi131.stdout:7/154: symlink d1b/d30/l35 0 2024-09-13T02:53:52.788 INFO:tasks.workunit.client.1.smithi131.stdout:5/156: dread d1/d5/fa [0,4194304] 0 2024-09-13T02:53:52.790 INFO:tasks.workunit.client.1.smithi131.stdout:5/157: creat d1/d1c/f3b x:0 0 0 2024-09-13T02:53:52.790 INFO:tasks.workunit.client.1.smithi131.stdout:5/158: read - d1/d29/f2e zero size 2024-09-13T02:53:52.792 INFO:tasks.workunit.client.1.smithi131.stdout:7/155: dread f13 [0,4194304] 0 2024-09-13T02:53:52.792 INFO:tasks.workunit.client.1.smithi131.stdout:5/159: link d1/d1c/f3b d1/d2f/f3c 0 2024-09-13T02:53:52.793 INFO:tasks.workunit.client.1.smithi131.stdout:7/156: creat d1b/d30/d31/f36 x:0 0 0 2024-09-13T02:53:52.794 INFO:tasks.workunit.client.1.smithi131.stdout:5/160: unlink d1/d29/f2b 0 2024-09-13T02:53:52.796 INFO:tasks.workunit.client.1.smithi131.stdout:2/191: write d5/d31/d26/f39 [53984,111139] 0 2024-09-13T02:53:52.797 INFO:tasks.workunit.client.1.smithi131.stdout:2/192: mknod d5/d31/c3c 0 2024-09-13T02:53:52.816 INFO:tasks.workunit.client.1.smithi131.stdout:9/199: dwrite d0/d3/d14/d1a/f1d [0,4194304] 0 2024-09-13T02:53:52.817 INFO:tasks.workunit.client.1.smithi131.stdout:9/200: mkdir d0/d3/d14/d17/d32/d39 0 2024-09-13T02:53:52.818 INFO:tasks.workunit.client.1.smithi131.stdout:9/201: mknod d0/c3a 0 2024-09-13T02:53:52.833 INFO:tasks.workunit.client.1.smithi131.stdout:0/243: dwrite d0/de/d1f/d22/d31/f3a [0,4194304] 0 2024-09-13T02:53:52.833 INFO:tasks.workunit.client.1.smithi131.stdout:3/233: dwrite d2/d4/d7/d1d/f30 [0,4194304] 0 2024-09-13T02:53:52.834 INFO:tasks.workunit.client.1.smithi131.stdout:1/244: dwrite dd/d26/f57 [0,4194304] 0 2024-09-13T02:53:52.834 INFO:tasks.workunit.client.1.smithi131.stdout:2/193: dwrite d5/d18/f1b [0,4194304] 0 2024-09-13T02:53:52.834 INFO:tasks.workunit.client.1.smithi131.stdout:2/194: write d5/f28 [444648,78544] 0 2024-09-13T02:53:52.834 INFO:tasks.workunit.client.1.smithi131.stdout:2/195: stat d5/d31/d21/f2b 0 2024-09-13T02:53:52.834 INFO:tasks.workunit.client.1.smithi131.stdout:2/196: read d5/d31/d21/f24 [2114591,25628] 0 2024-09-13T02:53:52.834 INFO:tasks.workunit.client.1.smithi131.stdout:9/202: read d0/f10 [39713,10850] 0 2024-09-13T02:53:52.838 INFO:tasks.workunit.client.1.smithi131.stdout:3/234: rename d2/d4/d14/f3e to d2/d4/d7/d1d/d24/f58 0 2024-09-13T02:53:52.839 INFO:tasks.workunit.client.1.smithi131.stdout:9/203: mknod d0/d3/d14/c3b 0 2024-09-13T02:53:52.839 INFO:tasks.workunit.client.1.smithi131.stdout:3/235: truncate d2/d4/f34 2983824 0 2024-09-13T02:53:52.839 INFO:tasks.workunit.client.1.smithi131.stdout:3/236: read - d2/d4/d7/d1d/f2c zero size 2024-09-13T02:53:52.840 INFO:tasks.workunit.client.1.smithi131.stdout:9/204: mkdir d0/d3/d14/d3c 0 2024-09-13T02:53:52.842 INFO:tasks.workunit.client.1.smithi131.stdout:8/291: dwrite db/d1d/f25 [4194304,4194304] 0 2024-09-13T02:53:52.842 INFO:tasks.workunit.client.1.smithi131.stdout:9/205: mknod d0/d3/d14/d3c/c3d 0 2024-09-13T02:53:52.844 INFO:tasks.workunit.client.1.smithi131.stdout:7/157: dwrite f10 [0,4194304] 0 2024-09-13T02:53:52.845 INFO:tasks.workunit.client.1.smithi131.stdout:0/244: write d0/d2/f2f [3477345,5736] 0 2024-09-13T02:53:52.846 INFO:tasks.workunit.client.1.smithi131.stdout:0/245: write d0/de/d1f/d22/d3d/d55/f58 [1283591,92459] 0 2024-09-13T02:53:52.847 INFO:tasks.workunit.client.1.smithi131.stdout:5/161: dwrite d1/d5/f13 [4194304,4194304] 0 2024-09-13T02:53:52.849 INFO:tasks.workunit.client.1.smithi131.stdout:7/158: rmdir d1b/d23 39 2024-09-13T02:53:52.852 INFO:tasks.workunit.client.1.smithi131.stdout:2/197: dread d5/f28 [0,4194304] 0 2024-09-13T02:53:52.852 INFO:tasks.workunit.client.1.smithi131.stdout:2/198: fsync d5/fe 0 2024-09-13T02:53:52.853 INFO:tasks.workunit.client.1.smithi131.stdout:2/199: creat d5/d31/d1d/d32/f3d x:0 0 0 2024-09-13T02:53:52.853 INFO:tasks.workunit.client.1.smithi131.stdout:2/200: readlink d5/l2d 0 2024-09-13T02:53:52.854 INFO:tasks.workunit.client.1.smithi131.stdout:7/159: symlink d1b/d23/l37 0 2024-09-13T02:53:52.854 INFO:tasks.workunit.client.1.smithi131.stdout:7/160: read - d1b/d30/d31/f36 zero size 2024-09-13T02:53:52.865 INFO:tasks.workunit.client.1.smithi131.stdout:2/201: dread d5/d31/d21/f24 [0,4194304] 0 2024-09-13T02:53:52.868 INFO:tasks.workunit.client.1.smithi131.stdout:7/161: write f10 [52688,119288] 0 2024-09-13T02:53:52.869 INFO:tasks.workunit.client.1.smithi131.stdout:7/162: mkdir d1b/d30/d31/d38 0 2024-09-13T02:53:52.870 INFO:tasks.workunit.client.1.smithi131.stdout:1/245: dwrite dd/f43 [0,4194304] 0 2024-09-13T02:53:52.873 INFO:tasks.workunit.client.1.smithi131.stdout:1/246: rename c2 to dd/d26/c58 0 2024-09-13T02:53:52.873 INFO:tasks.workunit.client.1.smithi131.stdout:0/246: dread d0/f2b [0,4194304] 0 2024-09-13T02:53:52.873 INFO:tasks.workunit.client.1.smithi131.stdout:0/247: readlink d0/de/d1f/l23 0 2024-09-13T02:53:52.874 INFO:tasks.workunit.client.1.smithi131.stdout:1/247: truncate dd/d26/f57 1762438 0 2024-09-13T02:53:52.874 INFO:tasks.workunit.client.1.smithi131.stdout:1/248: rmdir dd/d33/d42/d47 39 2024-09-13T02:53:52.876 INFO:tasks.workunit.client.1.smithi131.stdout:1/249: symlink dd/l59 0 2024-09-13T02:53:52.880 INFO:tasks.workunit.client.1.smithi131.stdout:3/237: dwrite d2/dc/f2a [0,4194304] 0 2024-09-13T02:53:52.881 INFO:tasks.workunit.client.1.smithi131.stdout:3/238: chown d2/d4/d7/d1d/f2e 46 1 2024-09-13T02:53:52.883 INFO:tasks.workunit.client.1.smithi131.stdout:1/250: dread dd/d26/f50 [0,4194304] 0 2024-09-13T02:53:52.883 INFO:tasks.workunit.client.1.smithi131.stdout:1/251: chown dd/d33/d42/f54 118 1 2024-09-13T02:53:52.884 INFO:tasks.workunit.client.1.smithi131.stdout:3/239: unlink d2/d4/d14/f32 0 2024-09-13T02:53:52.884 INFO:tasks.workunit.client.1.smithi131.stdout:3/240: chown d2/d4/d7/c57 230 1 2024-09-13T02:53:52.884 INFO:tasks.workunit.client.1.smithi131.stdout:3/241: chown d2/dc/l11 137014261 1 2024-09-13T02:53:52.884 INFO:tasks.workunit.client.1.smithi131.stdout:9/206: dwrite d0/d3/d14/d17/f21 [0,4194304] 0 2024-09-13T02:53:52.885 INFO:tasks.workunit.client.1.smithi131.stdout:3/242: rename d2/d4/f43 to d2/d4/d7/f59 0 2024-09-13T02:53:52.887 INFO:tasks.workunit.client.1.smithi131.stdout:8/292: dwrite db/d1d/d1f/f2d [0,4194304] 0 2024-09-13T02:53:52.887 INFO:tasks.workunit.client.1.smithi131.stdout:8/293: write db/d2e/d40/f48 [1205073,103547] 0 2024-09-13T02:53:52.889 INFO:tasks.workunit.client.1.smithi131.stdout:0/248: write d0/de/d1f/d22/d31/f60 [3835283,51894] 0 2024-09-13T02:53:52.892 INFO:tasks.workunit.client.1.smithi131.stdout:0/249: rename d0/de/d1f/l2c to d0/de/l61 0 2024-09-13T02:53:52.893 INFO:tasks.workunit.client.1.smithi131.stdout:0/250: mkdir d0/d2/d62 0 2024-09-13T02:53:52.894 INFO:tasks.workunit.client.1.smithi131.stdout:9/207: dread d0/f11 [0,4194304] 0 2024-09-13T02:53:52.900 INFO:tasks.workunit.client.1.smithi131.stdout:7/163: dwrite d1b/d23/f2d [0,4194304] 0 2024-09-13T02:53:52.901 INFO:tasks.workunit.client.1.smithi131.stdout:0/251: dread d0/de/d1f/d22/f29 [0,4194304] 0 2024-09-13T02:53:52.901 INFO:tasks.workunit.client.1.smithi131.stdout:0/252: readlink d0/de/d45/l5d 0 2024-09-13T02:53:52.901 INFO:tasks.workunit.client.1.smithi131.stdout:0/253: write d0/de/d1f/d22/f4e [316189,65831] 0 2024-09-13T02:53:52.905 INFO:tasks.workunit.client.1.smithi131.stdout:0/254: mkdir d0/de/d1f/d22/d3d/d55/d63 0 2024-09-13T02:53:52.907 INFO:tasks.workunit.client.1.smithi131.stdout:9/208: truncate d0/d3/d14/f34 4005155 0 2024-09-13T02:53:52.907 INFO:tasks.workunit.client.1.smithi131.stdout:9/209: stat d0/d3/d14/d1a/f30 0 2024-09-13T02:53:52.907 INFO:tasks.workunit.client.1.smithi131.stdout:9/210: stat d0/f33 0 2024-09-13T02:53:52.911 INFO:tasks.workunit.client.1.smithi131.stdout:9/211: rename d0/d3/d14/d17/d32/c35 to d0/d3/d14/c3e 0 2024-09-13T02:53:52.911 INFO:tasks.workunit.client.1.smithi131.stdout:9/212: chown d0/d3/d14/d17/f37 4274 1 2024-09-13T02:53:52.913 INFO:tasks.workunit.client.1.smithi131.stdout:9/213: mkdir d0/d3f 0 2024-09-13T02:53:52.913 INFO:tasks.workunit.client.1.smithi131.stdout:9/214: truncate d0/d3/d14/d17/f37 423539 0 2024-09-13T02:53:52.913 INFO:tasks.workunit.client.1.smithi131.stdout:9/215: fdatasync d0/f10 0 2024-09-13T02:53:52.914 INFO:tasks.workunit.client.1.smithi131.stdout:0/255: dread d0/de/f1a [0,4194304] 0 2024-09-13T02:53:52.915 INFO:tasks.workunit.client.1.smithi131.stdout:0/256: truncate d0/de/d45/d5a/f5b 331473 0 2024-09-13T02:53:52.915 INFO:tasks.workunit.client.1.smithi131.stdout:0/257: dread - d0/de/f47 zero size 2024-09-13T02:53:52.917 INFO:tasks.workunit.client.1.smithi131.stdout:0/258: creat d0/de/d45/d5a/f64 x:0 0 0 2024-09-13T02:53:52.917 INFO:tasks.workunit.client.1.smithi131.stdout:0/259: fdatasync d0/de/d1f/d22/d31/d39/d3c/f5e 0 2024-09-13T02:53:52.918 INFO:tasks.workunit.client.1.smithi131.stdout:0/260: creat d0/de/d1f/f65 x:0 0 0 2024-09-13T02:53:52.918 INFO:tasks.workunit.client.1.smithi131.stdout:0/261: write d0/de/d1f/d22/d31/f3a [4293387,52357] 0 2024-09-13T02:53:52.919 INFO:tasks.workunit.client.1.smithi131.stdout:0/262: write d0/d2/f3f [4233697,41117] 0 2024-09-13T02:53:52.925 INFO:tasks.workunit.client.1.smithi131.stdout:3/243: dwrite d2/d4/d1a/d31/f42 [0,4194304] 0 2024-09-13T02:53:52.928 INFO:tasks.workunit.client.1.smithi131.stdout:3/244: mknod d2/d4/d1a/d31/d48/c5a 0 2024-09-13T02:53:52.928 INFO:tasks.workunit.client.1.smithi131.stdout:3/245: write d2/d4/f9 [2329696,12032] 0 2024-09-13T02:53:52.928 INFO:tasks.workunit.client.1.smithi131.stdout:3/246: readlink d2/d4/d7/d1d/d24/l4b 0 2024-09-13T02:53:52.929 INFO:tasks.workunit.client.1.smithi131.stdout:3/247: read d2/d4/d14/d49/f4a [15941,13399] 0 2024-09-13T02:53:52.929 INFO:tasks.workunit.client.1.smithi131.stdout:3/248: symlink d2/d4/d7/d8/d41/l5b 0 2024-09-13T02:53:52.933 INFO:tasks.workunit.client.1.smithi131.stdout:3/249: rename d2/d4/d14 to d2/d4/d7/d8/d41/d5c 0 2024-09-13T02:53:52.934 INFO:tasks.workunit.client.1.smithi131.stdout:3/250: truncate d2/d4/d7/d1d/f2e 1522793 0 2024-09-13T02:53:52.934 INFO:tasks.workunit.client.1.smithi131.stdout:3/251: write d2/d4/d7/d1d/d24/f3a [1077353,126103] 0 2024-09-13T02:53:52.934 INFO:tasks.workunit.client.1.smithi131.stdout:3/252: fdatasync d2/dc/f2a 0 2024-09-13T02:53:52.934 INFO:tasks.workunit.client.1.smithi131.stdout:3/253: creat d2/d4/f5d x:0 0 0 2024-09-13T02:53:52.935 INFO:tasks.workunit.client.1.smithi131.stdout:3/254: mknod d2/d4/c5e 0 2024-09-13T02:53:52.942 INFO:tasks.workunit.client.1.smithi131.stdout:7/164: dwrite f3 [0,4194304] 0 2024-09-13T02:53:52.942 INFO:tasks.workunit.client.1.smithi131.stdout:1/252: dwrite dd/d26/d44/f25 [0,4194304] 0 2024-09-13T02:53:52.942 INFO:tasks.workunit.client.1.smithi131.stdout:1/253: stat dd/d26/d44/f25 0 2024-09-13T02:53:52.943 INFO:tasks.workunit.client.1.smithi131.stdout:7/165: mknod d1b/d30/c39 0 2024-09-13T02:53:52.950 INFO:tasks.workunit.client.1.smithi131.stdout:8/294: dwrite f5 [0,4194304] 0 2024-09-13T02:53:52.951 INFO:tasks.workunit.client.1.smithi131.stdout:8/295: write db/f15 [1437232,130588] 0 2024-09-13T02:53:52.951 INFO:tasks.workunit.client.1.smithi131.stdout:0/263: dwrite d0/de/d1f/f65 [0,4194304] 0 2024-09-13T02:53:52.953 INFO:tasks.workunit.client.1.smithi131.stdout:0/264: dread d0/de/d1f/d22/f29 [0,4194304] 0 2024-09-13T02:53:52.954 INFO:tasks.workunit.client.1.smithi131.stdout:9/216: dwrite d0/f12 [0,4194304] 0 2024-09-13T02:53:52.954 INFO:tasks.workunit.client.1.smithi131.stdout:0/265: symlink d0/de/d1f/d22/d31/d39/d3c/l66 0 2024-09-13T02:53:52.955 INFO:tasks.workunit.client.1.smithi131.stdout:1/254: dread dd/ff [4194304,4194304] 0 2024-09-13T02:53:52.956 INFO:tasks.workunit.client.1.smithi131.stdout:1/255: write fc [4783558,96293] 0 2024-09-13T02:53:52.959 INFO:tasks.workunit.client.1.smithi131.stdout:7/166: dread f3 [0,4194304] 0 2024-09-13T02:53:52.960 INFO:tasks.workunit.client.1.smithi131.stdout:7/167: dread f13 [0,4194304] 0 2024-09-13T02:53:52.960 INFO:tasks.workunit.client.1.smithi131.stdout:7/168: chown ld 84 1 2024-09-13T02:53:52.965 INFO:tasks.workunit.client.1.smithi131.stdout:9/217: chown d0/l1c 2038172 1 2024-09-13T02:53:52.966 INFO:tasks.workunit.client.1.smithi131.stdout:1/256: mkdir dd/d51/d5a 0 2024-09-13T02:53:52.969 INFO:tasks.workunit.client.1.smithi131.stdout:7/169: mknod d1b/c3a 0 2024-09-13T02:53:52.970 INFO:tasks.workunit.client.1.smithi131.stdout:1/257: truncate f0 4081158 0 2024-09-13T02:53:52.971 INFO:tasks.workunit.client.1.smithi131.stdout:1/258: link dd/d26/d2a/d2c/f34 dd/d26/d2a/d2c/d4b/f5b 0 2024-09-13T02:53:52.971 INFO:tasks.workunit.client.1.smithi131.stdout:1/259: dread - dd/f16 zero size 2024-09-13T02:53:52.973 INFO:tasks.workunit.client.1.smithi131.stdout:7/170: rename d1b/d30 to d1b/d3b 0 2024-09-13T02:53:52.975 INFO:tasks.workunit.client.1.smithi131.stdout:1/260: creat dd/d26/d2a/d2c/f5c x:0 0 0 2024-09-13T02:53:52.975 INFO:tasks.workunit.client.1.smithi131.stdout:1/261: readlink dd/l59 0 2024-09-13T02:53:52.975 INFO:tasks.workunit.client.1.smithi131.stdout:9/218: dread d0/d3/d14/f34 [0,4194304] 0 2024-09-13T02:53:52.975 INFO:tasks.workunit.client.1.smithi131.stdout:1/262: chown dd/d26/d2a/d2c/c3d 13522 1 2024-09-13T02:53:52.976 INFO:tasks.workunit.client.1.smithi131.stdout:7/171: symlink d1b/d23/l3c 0 2024-09-13T02:53:52.976 INFO:tasks.workunit.client.1.smithi131.stdout:7/172: readlink ld 0 2024-09-13T02:53:52.976 INFO:tasks.workunit.client.1.smithi131.stdout:7/173: chown d1b/f2e 13789708 1 2024-09-13T02:53:52.976 INFO:tasks.workunit.client.1.smithi131.stdout:7/174: write d1b/d23/f33 [564142,120548] 0 2024-09-13T02:53:52.976 INFO:tasks.workunit.client.1.smithi131.stdout:7/175: stat f7 0 2024-09-13T02:53:52.977 INFO:tasks.workunit.client.1.smithi131.stdout:7/176: fdatasync d1b/f2f 0 2024-09-13T02:53:52.977 INFO:tasks.workunit.client.1.smithi131.stdout:0/266: rename d0/de/d1f/d22/d31/d39/d3c to d0/de/d1f/d22/d31/d39/d67 0 2024-09-13T02:53:52.977 INFO:tasks.workunit.client.1.smithi131.stdout:1/263: getdents dd/d33/d42/d47 0 2024-09-13T02:53:52.978 INFO:tasks.workunit.client.1.smithi131.stdout:1/264: chown dd/d26/d2a/f49 6265 1 2024-09-13T02:53:52.978 INFO:tasks.workunit.client.1.smithi131.stdout:1/265: creat dd/d33/d42/f5d x:0 0 0 2024-09-13T02:53:52.978 INFO:tasks.workunit.client.1.smithi131.stdout:1/266: fdatasync dd/f43 0 2024-09-13T02:53:52.979 INFO:tasks.workunit.client.1.smithi131.stdout:9/219: link d0/d3/d14/l2d d0/d3/d14/d17/l40 0 2024-09-13T02:53:52.979 INFO:tasks.workunit.client.1.smithi131.stdout:9/220: truncate d0/d3/d14/d17/f37 1079717 0 2024-09-13T02:53:52.979 INFO:tasks.workunit.client.1.smithi131.stdout:0/267: dread d0/de/d1f/d22/d31/f60 [0,4194304] 0 2024-09-13T02:53:52.980 INFO:tasks.workunit.client.1.smithi131.stdout:1/267: rename dd/c14 to dd/d26/c5e 0 2024-09-13T02:53:52.981 INFO:tasks.workunit.client.1.smithi131.stdout:9/221: mknod d0/d3/d14/d1a/d2a/c41 0 2024-09-13T02:53:52.982 INFO:tasks.workunit.client.1.smithi131.stdout:4/198: sync 2024-09-13T02:53:52.982 INFO:tasks.workunit.client.1.smithi131.stdout:6/273: sync 2024-09-13T02:53:52.983 INFO:tasks.workunit.client.1.smithi131.stdout:3/255: dwrite d2/d4/d7/d1d/f2e [0,4194304] 0 2024-09-13T02:53:52.986 INFO:tasks.workunit.client.1.smithi131.stdout:4/199: mkdir d1/dc/d19/d29/d33/d3a 0 2024-09-13T02:53:52.986 INFO:tasks.workunit.client.1.smithi131.stdout:4/200: readlink d1/d8/d13/l26 0 2024-09-13T02:53:52.988 INFO:tasks.workunit.client.1.smithi131.stdout:4/201: rename d1/dc/fd to d1/dc/f3b 0 2024-09-13T02:53:52.990 INFO:tasks.workunit.client.1.smithi131.stdout:4/202: symlink d1/dc/d19/d29/l3c 0 2024-09-13T02:53:52.993 INFO:tasks.workunit.client.1.smithi131.stdout:4/203: creat d1/f3d x:0 0 0 2024-09-13T02:53:52.994 INFO:tasks.workunit.client.1.smithi131.stdout:9/222: dread d0/d3/d14/d1a/f1d [0,4194304] 0 2024-09-13T02:53:52.994 INFO:tasks.workunit.client.1.smithi131.stdout:9/223: read - d0/f33 zero size 2024-09-13T02:53:52.995 INFO:tasks.workunit.client.1.smithi131.stdout:4/204: read d1/d8/f15 [95789,106930] 0 2024-09-13T02:53:52.997 INFO:tasks.workunit.client.1.smithi131.stdout:9/224: unlink d0/d3/d14/d17/l1e 0 2024-09-13T02:53:52.998 INFO:tasks.workunit.client.1.smithi131.stdout:4/205: rename d1/f16 to d1/dc/f3e 0 2024-09-13T02:53:53.001 INFO:tasks.workunit.client.1.smithi131.stdout:4/206: mkdir d1/dc/d19/d29/d3f 0 2024-09-13T02:53:53.001 INFO:tasks.workunit.client.1.smithi131.stdout:9/225: dread d0/d3/d14/d1a/f1d [0,4194304] 0 2024-09-13T02:53:53.001 INFO:tasks.workunit.client.1.smithi131.stdout:4/207: getdents d1/d18 0 2024-09-13T02:53:53.003 INFO:tasks.workunit.client.1.smithi131.stdout:9/226: mknod d0/d3/d14/c42 0 2024-09-13T02:53:53.004 INFO:tasks.workunit.client.1.smithi131.stdout:4/208: unlink d1/dc/d19/f23 0 2024-09-13T02:53:53.005 INFO:tasks.workunit.client.1.smithi131.stdout:9/227: unlink d0/d3/d14/d17/f37 0 2024-09-13T02:53:53.006 INFO:tasks.workunit.client.1.smithi131.stdout:4/209: unlink d1/d8/c25 0 2024-09-13T02:53:53.006 INFO:tasks.workunit.client.1.smithi131.stdout:4/210: dread - d1/f3d zero size 2024-09-13T02:53:53.007 INFO:tasks.workunit.client.1.smithi131.stdout:4/211: mknod d1/c40 0 2024-09-13T02:53:53.008 INFO:tasks.workunit.client.1.smithi131.stdout:4/212: write d1/d8/f15 [1375271,49240] 0 2024-09-13T02:53:53.009 INFO:tasks.workunit.client.1.smithi131.stdout:4/213: creat d1/dc/f41 x:0 0 0 2024-09-13T02:53:53.009 INFO:tasks.workunit.client.1.smithi131.stdout:4/214: mknod d1/dc/d19/d29/c42 0 2024-09-13T02:53:53.016 INFO:tasks.workunit.client.1.smithi131.stdout:7/177: dwrite d1b/d23/f28 [0,4194304] 0 2024-09-13T02:53:53.021 INFO:tasks.workunit.client.1.smithi131.stdout:4/215: dread d1/d18/f2a [0,4194304] 0 2024-09-13T02:53:53.030 INFO:tasks.workunit.client.1.smithi131.stdout:7/178: dread d1b/f1f [0,4194304] 0 2024-09-13T02:53:53.031 INFO:tasks.workunit.client.1.smithi131.stdout:7/179: symlink d1b/d3b/d31/d38/l3d 0 2024-09-13T02:53:53.031 INFO:tasks.workunit.client.1.smithi131.stdout:7/180: dread - d1b/d3b/d31/f36 zero size 2024-09-13T02:53:53.032 INFO:tasks.workunit.client.1.smithi131.stdout:0/268: dwrite d0/de/d45/d5a/f5b [0,4194304] 0 2024-09-13T02:53:53.032 INFO:tasks.workunit.client.1.smithi131.stdout:1/268: dwrite f4 [0,4194304] 0 2024-09-13T02:53:53.032 INFO:tasks.workunit.client.1.smithi131.stdout:1/269: creat dd/d26/f5f x:0 0 0 2024-09-13T02:53:53.032 INFO:tasks.workunit.client.1.smithi131.stdout:6/274: dwrite d1/d8/d9/db/ff [4194304,4194304] 0 2024-09-13T02:53:53.032 INFO:tasks.workunit.client.1.smithi131.stdout:9/228: dwrite d0/f33 [0,4194304] 0 2024-09-13T02:53:53.032 INFO:tasks.workunit.client.1.smithi131.stdout:3/256: dwrite d2/d4/f34 [0,4194304] 0 2024-09-13T02:53:53.032 INFO:tasks.workunit.client.1.smithi131.stdout:3/257: truncate d2/d4/d7/d1d/d24/f58 690411 0 2024-09-13T02:53:53.034 INFO:tasks.workunit.client.1.smithi131.stdout:7/181: rename d1b/f27 to d1b/d3b/f3e 0 2024-09-13T02:53:53.034 INFO:tasks.workunit.client.1.smithi131.stdout:0/269: mkdir d0/de/d1f/d22/d31/d39/d40/d68 0 2024-09-13T02:53:53.034 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:53:52 smithi089 ceph-mon[27639]: pgmap v238: 65 pgs: 65 active+clean; 380 MiB data, 2.9 GiB used, 534 GiB / 536 GiB avail; 19 MiB/s rd, 31 MiB/s wr, 838 op/s 2024-09-13T02:53:53.037 INFO:tasks.workunit.client.1.smithi131.stdout:9/229: mknod d0/d3/d14/d17/c43 0 2024-09-13T02:53:53.041 INFO:tasks.workunit.client.1.smithi131.stdout:3/258: rmdir d2/d4/d7/d8/d41 39 2024-09-13T02:53:53.042 INFO:tasks.workunit.client.1.smithi131.stdout:3/259: chown d2/dc/l44 5 1 2024-09-13T02:53:53.042 INFO:tasks.workunit.client.1.smithi131.stdout:3/260: fdatasync d2/d4/d7/d8/d41/d5c/f4e 0 2024-09-13T02:53:53.042 INFO:tasks.workunit.client.1.smithi131.stdout:3/261: truncate d2/d4/d7/d8/d41/d5c/d49/f4a 1164080 0 2024-09-13T02:53:53.046 INFO:tasks.workunit.client.1.smithi131.stdout:1/270: read dd/d26/d44/f22 [3601680,124304] 0 2024-09-13T02:53:53.047 INFO:tasks.workunit.client.1.smithi131.stdout:1/271: write dd/f20 [4806013,120679] 0 2024-09-13T02:53:53.047 INFO:tasks.workunit.client.1.smithi131.stdout:1/272: fdatasync dd/d26/d44/f25 0 2024-09-13T02:53:53.049 INFO:tasks.workunit.client.1.smithi131.stdout:6/275: rename d1/d8/d9/c50 to d1/d8/d9/db/d15/c58 0 2024-09-13T02:53:53.049 INFO:tasks.workunit.client.1.smithi131.stdout:2/202: sync 2024-09-13T02:53:53.049 INFO:tasks.workunit.client.1.smithi131.stdout:7/182: getdents d1b/d23 0 2024-09-13T02:53:53.049 INFO:tasks.workunit.client.1.smithi131.stdout:0/270: creat d0/de/d1f/d22/d31/d39/d67/f69 x:0 0 0 2024-09-13T02:53:53.049 INFO:tasks.workunit.client.1.smithi131.stdout:9/230: readlink d0/l19 0 2024-09-13T02:53:53.049 INFO:tasks.workunit.client.1.smithi131.stdout:5/162: sync 2024-09-13T02:53:53.049 INFO:tasks.workunit.client.1.smithi131.stdout:9/231: chown d0/d3/d14/d17/f31 60626269 1 2024-09-13T02:53:53.049 INFO:tasks.workunit.client.1.smithi131.stdout:5/163: readlink d1/d21/d22/l2a 0 2024-09-13T02:53:53.049 INFO:tasks.workunit.client.1.smithi131.stdout:0/271: write d0/d2/f2f [8550313,111994] 0 2024-09-13T02:53:53.051 INFO:tasks.workunit.client.1.smithi131.stdout:1/273: rename dd/d26/d2a/d2c/c3d to dd/c60 0 2024-09-13T02:53:53.051 INFO:tasks.workunit.client.1.smithi131.stdout:1/274: read - dd/d26/d2a/d2c/f5c zero size 2024-09-13T02:53:53.053 INFO:tasks.workunit.client.1.smithi131.stdout:7/183: mknod d1b/d3b/d31/c3f 0 2024-09-13T02:53:53.053 INFO:tasks.workunit.client.1.smithi131.stdout:2/203: link d5/d31/d1d/d32/c36 d5/d31/d1d/c3e 0 2024-09-13T02:53:53.053 INFO:tasks.workunit.client.1.smithi131.stdout:5/164: mknod d1/d21/c3d 0 2024-09-13T02:53:53.053 INFO:tasks.workunit.client.1.smithi131.stdout:5/165: fsync d1/d1c/f1d 0 2024-09-13T02:53:53.053 INFO:tasks.workunit.client.1.smithi131.stdout:5/166: read d1/f23 [210349,75653] 0 2024-09-13T02:53:53.054 INFO:tasks.workunit.client.1.smithi131.stdout:5/167: write d1/d2f/f3c [971307,108588] 0 2024-09-13T02:53:53.054 INFO:tasks.workunit.client.1.smithi131.stdout:2/204: mknod d5/d31/c3f 0 2024-09-13T02:53:53.055 INFO:tasks.workunit.client.1.smithi131.stdout:0/272: getdents d0/de/d1f/d22/d31 0 2024-09-13T02:53:53.057 INFO:tasks.workunit.client.1.smithi131.stdout:1/275: rmdir dd/d33/d42 39 2024-09-13T02:53:53.057 INFO:tasks.workunit.client.1.smithi131.stdout:1/276: creat dd/d26/d2a/f61 x:0 0 0 2024-09-13T02:53:53.057 INFO:tasks.workunit.client.1.smithi131.stdout:1/277: fdatasync dd/d26/d2a/d2c/f5c 0 2024-09-13T02:53:53.058 INFO:tasks.workunit.client.1.smithi131.stdout:0/273: symlink d0/de/d1f/l6a 0 2024-09-13T02:53:53.059 INFO:tasks.workunit.client.1.smithi131.stdout:2/205: creat d5/d1e/d2c/f40 x:0 0 0 2024-09-13T02:53:53.060 INFO:tasks.workunit.client.1.smithi131.stdout:0/274: unlink d0/de/d1f/f65 0 2024-09-13T02:53:53.061 INFO:tasks.workunit.client.1.smithi131.stdout:0/275: creat d0/de/d1f/d22/d3d/d55/f6b x:0 0 0 2024-09-13T02:53:53.075 INFO:tasks.workunit.client.1.smithi131.stdout:1/278: dread f4 [0,4194304] 0 2024-09-13T02:53:53.075 INFO:tasks.workunit.client.1.smithi131.stdout:3/262: dwrite d2/d4/d7/f59 [0,4194304] 0 2024-09-13T02:53:53.076 INFO:tasks.workunit.client.1.smithi131.stdout:1/279: mknod dd/d26/d44/c62 0 2024-09-13T02:53:53.077 INFO:tasks.workunit.client.1.smithi131.stdout:3/263: mknod d2/dc/d39/c5f 0 2024-09-13T02:53:53.077 INFO:tasks.workunit.client.1.smithi131.stdout:1/280: mknod dd/d51/c63 0 2024-09-13T02:53:53.077 INFO:tasks.workunit.client.1.smithi131.stdout:1/281: chown dd 2708673 1 2024-09-13T02:53:53.077 INFO:tasks.workunit.client.1.smithi131.stdout:1/282: read dd/d26/d44/f1e [7590372,3772] 0 2024-09-13T02:53:53.078 INFO:tasks.workunit.client.1.smithi131.stdout:3/264: symlink d2/d4/d1a/d31/l60 0 2024-09-13T02:53:53.078 INFO:tasks.workunit.client.1.smithi131.stdout:3/265: chown d2/l15 94820 1 2024-09-13T02:53:53.078 INFO:tasks.workunit.client.1.smithi131.stdout:1/283: truncate f0 3873645 0 2024-09-13T02:53:53.078 INFO:tasks.workunit.client.1.smithi131.stdout:3/266: mkdir d2/dc/d39/d61 0 2024-09-13T02:53:53.080 INFO:tasks.workunit.client.1.smithi131.stdout:1/284: rename dd/d26/d2a/c31 to dd/d51/d5a/c64 0 2024-09-13T02:53:53.080 INFO:tasks.workunit.client.1.smithi131.stdout:1/285: fdatasync f8 0 2024-09-13T02:53:53.080 INFO:tasks.workunit.client.1.smithi131.stdout:1/286: creat dd/d26/f65 x:0 0 0 2024-09-13T02:53:53.082 INFO:tasks.workunit.client.1.smithi131.stdout:1/287: symlink dd/d51/d5a/l66 0 2024-09-13T02:53:53.083 INFO:tasks.workunit.client.1.smithi131.stdout:1/288: unlink dd/d26/d2a/c4c 0 2024-09-13T02:53:53.095 INFO:tasks.workunit.client.1.smithi131.stdout:0/276: dwrite d0/d2/f17 [0,4194304] 0 2024-09-13T02:53:53.097 INFO:tasks.workunit.client.1.smithi131.stdout:0/277: rename d0/f2b to d0/de/d1f/d22/d3d/f6c 0 2024-09-13T02:53:53.098 INFO:tasks.workunit.client.1.smithi131.stdout:0/278: rename d0/de/d1f/c2d to d0/de/d1f/d22/d3d/c6d 0 2024-09-13T02:53:53.098 INFO:tasks.workunit.client.1.smithi131.stdout:0/279: stat d0/de/d1f/d22/d31/d39/d67/f5e 0 2024-09-13T02:53:53.099 INFO:tasks.workunit.client.1.smithi131.stdout:7/184: dwrite d1b/f1f [4194304,4194304] 0 2024-09-13T02:53:53.099 INFO:tasks.workunit.client.1.smithi131.stdout:9/232: dwrite d0/d3/d14/d1a/f23 [4194304,4194304] 0 2024-09-13T02:53:53.099 INFO:tasks.workunit.client.1.smithi131.stdout:0/280: mknod d0/de/d1f/d22/d3d/d55/d63/c6e 0 2024-09-13T02:53:53.100 INFO:tasks.workunit.client.1.smithi131.stdout:7/185: mknod d1b/d3b/d31/c40 0 2024-09-13T02:53:53.100 INFO:tasks.workunit.client.1.smithi131.stdout:7/186: chown d1b/d3b 253 1 2024-09-13T02:53:53.101 INFO:tasks.workunit.client.1.smithi131.stdout:7/187: dread - d1b/f2e zero size 2024-09-13T02:53:53.103 INFO:tasks.workunit.client.1.smithi131.stdout:7/188: mkdir d1b/d3b/d41 0 2024-09-13T02:53:53.114 INFO:tasks.workunit.client.1.smithi131.stdout:3/267: dwrite d2/d4/f34 [0,4194304] 0 2024-09-13T02:53:53.114 INFO:tasks.workunit.client.1.smithi131.stdout:1/289: dwrite dd/d26/d2a/f49 [0,4194304] 0 2024-09-13T02:53:53.114 INFO:tasks.workunit.client.1.smithi131.stdout:5/168: dwrite d1/d21/d22/f26 [0,4194304] 0 2024-09-13T02:53:53.115 INFO:tasks.workunit.client.1.smithi131.stdout:5/169: truncate d1/f1b 292467 0 2024-09-13T02:53:53.115 INFO:tasks.workunit.client.1.smithi131.stdout:5/170: write d1/f2c [5022937,119925] 0 2024-09-13T02:53:53.137 INFO:tasks.workunit.client.1.smithi131.stdout:9/233: dwrite d0/d3/d14/d1a/f23 [4194304,4194304] 0 2024-09-13T02:53:53.138 INFO:tasks.workunit.client.1.smithi131.stdout:9/234: write d0/d3/d14/f34 [4219028,74491] 0 2024-09-13T02:53:53.146 INFO:tasks.workunit.client.1.smithi131.stdout:0/281: dwrite d0/de/f47 [0,4194304] 0 2024-09-13T02:53:53.146 INFO:tasks.workunit.client.1.smithi131.stdout:0/282: creat d0/de/d45/d5a/f6f x:0 0 0 2024-09-13T02:53:53.146 INFO:tasks.workunit.client.1.smithi131.stdout:0/283: chown d0/de/d1f/d22/f29 9122010 1 2024-09-13T02:53:53.146 INFO:tasks.workunit.client.1.smithi131.stdout:0/284: fdatasync d0/de/d45/d5a/f6f 0 2024-09-13T02:53:53.148 INFO:tasks.workunit.client.1.smithi131.stdout:9/235: dread d0/f12 [0,4194304] 0 2024-09-13T02:53:53.149 INFO:tasks.workunit.client.1.smithi131.stdout:5/171: dwrite d1/d5/f13 [4194304,4194304] 0 2024-09-13T02:53:53.149 INFO:tasks.workunit.client.1.smithi131.stdout:5/172: truncate d1/d1c/f3b 2041585 0 2024-09-13T02:53:53.149 INFO:tasks.workunit.client.1.smithi131.stdout:5/173: truncate d1/d29/f2e 259680 0 2024-09-13T02:53:53.150 INFO:tasks.workunit.client.1.smithi131.stdout:0/285: link d0/de/d1f/d22/d31/d39/d67/l66 d0/de/l70 0 2024-09-13T02:53:53.152 INFO:tasks.workunit.client.1.smithi131.stdout:0/286: link d0/de/l25 d0/de/d1f/l71 0 2024-09-13T02:53:53.158 INFO:tasks.workunit.client.1.smithi131.stdout:1/290: dwrite dd/d26/d2a/f61 [0,4194304] 0 2024-09-13T02:53:53.159 INFO:tasks.workunit.client.1.smithi131.stdout:7/189: dwrite d1b/d23/f2d [0,4194304] 0 2024-09-13T02:53:53.159 INFO:tasks.workunit.client.1.smithi131.stdout:7/190: stat d1b/d23/c2a 0 2024-09-13T02:53:53.161 INFO:tasks.workunit.client.1.smithi131.stdout:3/268: dwrite d2/d4/d2d/f33 [0,4194304] 0 2024-09-13T02:53:53.165 INFO:tasks.workunit.client.1.smithi131.stdout:3/269: creat d2/d4/d7/f62 x:0 0 0 2024-09-13T02:53:53.165 INFO:tasks.workunit.client.1.smithi131.stdout:9/236: dread d0/d3/d14/d1a/f23 [4194304,4194304] 0 2024-09-13T02:53:53.165 INFO:tasks.workunit.client.1.smithi131.stdout:9/237: readlink d0/d3/d14/d17/l40 0 2024-09-13T02:53:53.166 INFO:tasks.workunit.client.1.smithi131.stdout:9/238: symlink d0/d3/d14/l44 0 2024-09-13T02:53:53.167 INFO:tasks.workunit.client.1.smithi131.stdout:9/239: symlink d0/d3/l45 0 2024-09-13T02:53:53.168 INFO:tasks.workunit.client.1.smithi131.stdout:9/240: mknod d0/d3/d14/d17/c46 0 2024-09-13T02:53:53.169 INFO:tasks.workunit.client.1.smithi131.stdout:9/241: symlink d0/d3/d14/d1a/d2a/l47 0 2024-09-13T02:53:53.169 INFO:tasks.workunit.client.1.smithi131.stdout:9/242: creat d0/d3/d14/d1a/f48 x:0 0 0 2024-09-13T02:53:53.170 INFO:tasks.workunit.client.1.smithi131.stdout:9/243: creat d0/d3/d14/d17/d32/d39/f49 x:0 0 0 2024-09-13T02:53:53.176 INFO:tasks.workunit.client.1.smithi131.stdout:3/270: dread d2/dc/f2a [0,4194304] 0 2024-09-13T02:53:53.182 INFO:tasks.workunit.client.1.smithi131.stdout:9/244: dread d0/f10 [0,4194304] 0 2024-09-13T02:53:53.182 INFO:tasks.workunit.client.1.smithi131.stdout:9/245: write d0/d3/d14/d17/f31 [3450,36132] 0 2024-09-13T02:53:53.182 INFO:tasks.workunit.client.1.smithi131.stdout:7/191: dwrite d1b/f2e [0,4194304] 0 2024-09-13T02:53:53.182 INFO:tasks.workunit.client.1.smithi131.stdout:7/192: fdatasync f10 0 2024-09-13T02:53:53.183 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:53:52 smithi131 ceph-mon[34689]: pgmap v238: 65 pgs: 65 active+clean; 380 MiB data, 2.9 GiB used, 534 GiB / 536 GiB avail; 19 MiB/s rd, 31 MiB/s wr, 838 op/s 2024-09-13T02:53:53.185 INFO:tasks.workunit.client.1.smithi131.stdout:0/287: rmdir d0/de/d1f/d22 39 2024-09-13T02:53:53.192 INFO:tasks.workunit.client.1.smithi131.stdout:1/291: write dd/f16 [36948,94947] 0 2024-09-13T02:53:53.195 INFO:tasks.workunit.client.1.smithi131.stdout:7/193: symlink d1b/d3b/l42 0 2024-09-13T02:53:53.195 INFO:tasks.workunit.client.1.smithi131.stdout:9/246: getdents d0 0 2024-09-13T02:53:53.198 INFO:tasks.workunit.client.1.smithi131.stdout:3/271: dwrite d2/d4/d7/d1d/f30 [0,4194304] 0 2024-09-13T02:53:53.198 INFO:tasks.workunit.client.1.smithi131.stdout:7/194: dread f7 [0,4194304] 0 2024-09-13T02:53:53.199 INFO:tasks.workunit.client.1.smithi131.stdout:7/195: write f4 [4506694,9377] 0 2024-09-13T02:53:53.200 INFO:tasks.workunit.client.1.smithi131.stdout:3/272: mknod d2/d4/d7/c63 0 2024-09-13T02:53:53.200 INFO:tasks.workunit.client.1.smithi131.stdout:5/174: write d1/d2f/f31 [1491105,127489] 0 2024-09-13T02:53:53.202 INFO:tasks.workunit.client.1.smithi131.stdout:7/196: mkdir d1b/d3b/d31/d38/d43 0 2024-09-13T02:53:53.203 INFO:tasks.workunit.client.1.smithi131.stdout:3/273: symlink d2/d4/d7/d8/d41/l64 0 2024-09-13T02:53:53.205 INFO:tasks.workunit.client.1.smithi131.stdout:7/197: mkdir d1b/d3b/d31/d38/d43/d44 0 2024-09-13T02:53:53.207 INFO:tasks.workunit.client.1.smithi131.stdout:8/296: sync 2024-09-13T02:53:53.207 INFO:tasks.workunit.client.1.smithi131.stdout:8/297: chown db/d2e/f43 0 1 2024-09-13T02:53:53.207 INFO:tasks.workunit.client.1.smithi131.stdout:8/298: chown l9 36868 1 2024-09-13T02:53:53.208 INFO:tasks.workunit.client.1.smithi131.stdout:8/299: symlink db/d2b/d39/l59 0 2024-09-13T02:53:53.209 INFO:tasks.workunit.client.1.smithi131.stdout:8/300: symlink db/d2b/d39/l5a 0 2024-09-13T02:53:53.210 INFO:tasks.workunit.client.1.smithi131.stdout:8/301: symlink db/d1d/d1f/d41/l5b 0 2024-09-13T02:53:53.214 INFO:tasks.workunit.client.1.smithi131.stdout:5/175: read d1/d5/f16 [2768386,95425] 0 2024-09-13T02:53:53.214 INFO:tasks.workunit.client.1.smithi131.stdout:8/302: unlink db/f2a 0 2024-09-13T02:53:53.215 INFO:tasks.workunit.client.1.smithi131.stdout:5/176: mkdir d1/d29/d3e 0 2024-09-13T02:53:53.217 INFO:tasks.workunit.client.1.smithi131.stdout:1/292: dwrite dd/d26/d44/f3b [0,4194304] 0 2024-09-13T02:53:53.217 INFO:tasks.workunit.client.1.smithi131.stdout:5/177: link d1/d1c/f3b d1/d5/f3f 0 2024-09-13T02:53:53.220 INFO:tasks.workunit.client.1.smithi131.stdout:1/293: creat dd/d26/d44/f67 x:0 0 0 2024-09-13T02:53:53.221 INFO:tasks.workunit.client.1.smithi131.stdout:5/178: unlink d1/d5/lf 0 2024-09-13T02:53:53.222 INFO:tasks.workunit.client.1.smithi131.stdout:5/179: rename d1/d5/l11 to d1/d2f/l40 0 2024-09-13T02:53:53.229 INFO:tasks.workunit.client.1.smithi131.stdout:9/247: dwrite d0/d3/d14/d1a/f30 [0,4194304] 0 2024-09-13T02:53:53.236 INFO:tasks.workunit.client.1.smithi131.stdout:3/274: dwrite d2/dc/f1b [0,4194304] 0 2024-09-13T02:53:53.237 INFO:tasks.workunit.client.1.smithi131.stdout:3/275: creat d2/dc/f65 x:0 0 0 2024-09-13T02:53:53.242 INFO:tasks.workunit.client.1.smithi131.stdout:7/198: dwrite d1b/f24 [0,4194304] 0 2024-09-13T02:53:53.242 INFO:tasks.workunit.client.1.smithi131.stdout:5/180: dwrite d1/d21/f25 [0,4194304] 0 2024-09-13T02:53:53.246 INFO:tasks.workunit.client.1.smithi131.stdout:5/181: getdents d1/d21 0 2024-09-13T02:53:53.249 INFO:tasks.workunit.client.1.smithi131.stdout:3/276: read d2/d4/f34 [435887,23638] 0 2024-09-13T02:53:53.250 INFO:tasks.workunit.client.1.smithi131.stdout:3/277: creat d2/d4/d1a/f66 x:0 0 0 2024-09-13T02:53:53.251 INFO:tasks.workunit.client.1.smithi131.stdout:3/278: fsync d2/d4/f5d 0 2024-09-13T02:53:53.251 INFO:tasks.workunit.client.1.smithi131.stdout:3/279: truncate d2/dc/f1b 5064040 0 2024-09-13T02:53:53.251 INFO:tasks.workunit.client.1.smithi131.stdout:7/199: dread d1b/f21 [4194304,4194304] 0 2024-09-13T02:53:53.251 INFO:tasks.workunit.client.1.smithi131.stdout:7/200: write f10 [1939099,125141] 0 2024-09-13T02:53:53.253 INFO:tasks.workunit.client.1.smithi131.stdout:9/248: truncate d0/d3/d14/d1a/f30 1549307 0 2024-09-13T02:53:53.253 INFO:tasks.workunit.client.1.smithi131.stdout:7/201: unlink d1b/d3b/d31/f36 0 2024-09-13T02:53:53.256 INFO:tasks.workunit.client.1.smithi131.stdout:7/202: dread d1b/d23/f33 [0,4194304] 0 2024-09-13T02:53:53.258 INFO:tasks.workunit.client.1.smithi131.stdout:9/249: dread d0/d3/d14/d17/f31 [0,4194304] 0 2024-09-13T02:53:53.258 INFO:tasks.workunit.client.1.smithi131.stdout:9/250: creat d0/d3/d14/d17/d32/d39/f4a x:0 0 0 2024-09-13T02:53:53.261 INFO:tasks.workunit.client.1.smithi131.stdout:9/251: symlink d0/l4b 0 2024-09-13T02:53:53.266 INFO:tasks.workunit.client.1.smithi131.stdout:9/252: write d0/f12 [1706094,12245] 0 2024-09-13T02:53:53.266 INFO:tasks.workunit.client.1.smithi131.stdout:7/203: write d1b/d23/f28 [1226702,42727] 0 2024-09-13T02:53:53.266 INFO:tasks.workunit.client.1.smithi131.stdout:7/204: stat d1b/l32 0 2024-09-13T02:53:53.267 INFO:tasks.workunit.client.1.smithi131.stdout:9/253: mknod d0/d3/c4c 0 2024-09-13T02:53:53.271 INFO:tasks.workunit.client.1.smithi131.stdout:3/280: dwrite d2/d4/d1a/f37 [0,4194304] 0 2024-09-13T02:53:53.272 INFO:tasks.workunit.client.1.smithi131.stdout:5/182: dwrite d1/f2c [0,4194304] 0 2024-09-13T02:53:53.273 INFO:tasks.workunit.client.1.smithi131.stdout:5/183: symlink d1/d5/l41 0 2024-09-13T02:53:53.276 INFO:tasks.workunit.client.1.smithi131.stdout:3/281: dread d2/d4/d7/d1d/d24/f3a [0,4194304] 0 2024-09-13T02:53:53.278 INFO:tasks.workunit.client.1.smithi131.stdout:5/184: dread d1/f23 [0,4194304] 0 2024-09-13T02:53:53.278 INFO:tasks.workunit.client.1.smithi131.stdout:5/185: rmdir d1/d21 39 2024-09-13T02:53:53.279 INFO:tasks.workunit.client.1.smithi131.stdout:5/186: unlink d1/d5/f3f 0 2024-09-13T02:53:53.279 INFO:tasks.workunit.client.1.smithi131.stdout:5/187: chown d1/d1c/f3b 39588259 1 2024-09-13T02:53:53.280 INFO:tasks.workunit.client.1.smithi131.stdout:5/188: write d1/fc [4126013,27091] 0 2024-09-13T02:53:53.281 INFO:tasks.workunit.client.1.smithi131.stdout:5/189: link d1/d29/f2e d1/d29/d3e/f42 0 2024-09-13T02:53:53.281 INFO:tasks.workunit.client.1.smithi131.stdout:5/190: write d1/d29/d3e/f42 [519492,102580] 0 2024-09-13T02:53:53.281 INFO:tasks.workunit.client.1.smithi131.stdout:5/191: dread - d1/d5/f3a zero size 2024-09-13T02:53:53.282 INFO:tasks.workunit.client.1.smithi131.stdout:5/192: creat d1/d1c/d32/f43 x:0 0 0 2024-09-13T02:53:53.291 INFO:tasks.workunit.client.1.smithi131.stdout:3/282: dwrite d2/d4/f5d [0,4194304] 0 2024-09-13T02:53:53.292 INFO:tasks.workunit.client.1.smithi131.stdout:3/283: mkdir d2/d4/d7/d8/d67 0 2024-09-13T02:53:53.302 INFO:tasks.workunit.client.1.smithi131.stdout:5/193: dwrite d1/d5/fa [0,4194304] 0 2024-09-13T02:53:53.303 INFO:tasks.workunit.client.1.smithi131.stdout:5/194: symlink d1/l44 0 2024-09-13T02:53:53.305 INFO:tasks.workunit.client.1.smithi131.stdout:5/195: rename d1/d1c/d32 to d1/d29/d39/d45 0 2024-09-13T02:53:53.305 INFO:tasks.workunit.client.1.smithi131.stdout:5/196: rename d1 to d1/d21/d46 22 2024-09-13T02:53:53.318 INFO:tasks.workunit.client.1.smithi131.stdout:5/197: dwrite d1/f1b [0,4194304] 0 2024-09-13T02:53:53.318 INFO:tasks.workunit.client.1.smithi131.stdout:5/198: write d1/f23 [1268025,34408] 0 2024-09-13T02:53:53.320 INFO:tasks.workunit.client.1.smithi131.stdout:5/199: rmdir d1/d1c 39 2024-09-13T02:53:53.322 INFO:tasks.workunit.client.1.smithi131.stdout:5/200: write d1/d1c/f3b [340413,127669] 0 2024-09-13T02:53:53.323 INFO:tasks.workunit.client.1.smithi131.stdout:5/201: rename d1/d5/l17 to d1/d2f/d33/l47 0 2024-09-13T02:53:53.324 INFO:tasks.workunit.client.1.smithi131.stdout:5/202: creat d1/d29/d39/d45/f48 x:0 0 0 2024-09-13T02:53:53.332 INFO:tasks.workunit.client.1.smithi131.stdout:5/203: write d1/d21/d22/f26 [1026873,5158] 0 2024-09-13T02:53:53.350 INFO:tasks.workunit.client.1.smithi131.stdout:5/204: dwrite d1/d2f/f3c [0,4194304] 0 2024-09-13T02:53:53.350 INFO:tasks.workunit.client.1.smithi131.stdout:5/205: fsync d1/d2f/f31 0 2024-09-13T02:53:53.352 INFO:tasks.workunit.client.1.smithi131.stdout:5/206: rename d1/d29/f35 to d1/d29/d39/f49 0 2024-09-13T02:53:53.367 INFO:tasks.workunit.client.1.smithi131.stdout:5/207: dwrite d1/d1c/f3b [4194304,4194304] 0 2024-09-13T02:53:53.373 INFO:tasks.workunit.client.1.smithi131.stdout:5/208: dread d1/d1c/f3b [4194304,4194304] 0 2024-09-13T02:53:53.375 INFO:tasks.workunit.client.1.smithi131.stdout:5/209: creat d1/d29/d39/f4a x:0 0 0 2024-09-13T02:53:53.375 INFO:tasks.workunit.client.1.smithi131.stdout:5/210: fsync d1/f2c 0 2024-09-13T02:53:53.375 INFO:tasks.workunit.client.1.smithi131.stdout:5/211: fsync d1/fc 0 2024-09-13T02:53:53.377 INFO:tasks.workunit.client.1.smithi131.stdout:5/212: dread d1/d29/f2e [0,4194304] 0 2024-09-13T02:53:53.378 INFO:tasks.workunit.client.1.smithi131.stdout:5/213: unlink d1/d2f/c38 0 2024-09-13T02:53:53.387 INFO:tasks.workunit.client.1.smithi131.stdout:5/214: dread d1/d21/d22/f26 [0,4194304] 0 2024-09-13T02:53:53.388 INFO:tasks.workunit.client.1.smithi131.stdout:5/215: write d1/d21/d22/f26 [2982781,84354] 0 2024-09-13T02:53:53.388 INFO:tasks.workunit.client.1.smithi131.stdout:5/216: link d1/d21/c3d d1/d21/c4b 0 2024-09-13T02:53:53.389 INFO:tasks.workunit.client.1.smithi131.stdout:5/217: symlink d1/d2f/d33/l4c 0 2024-09-13T02:53:53.389 INFO:tasks.workunit.client.1.smithi131.stdout:5/218: readlink d1/l2 0 2024-09-13T02:53:53.389 INFO:tasks.workunit.client.1.smithi131.stdout:5/219: mknod d1/d2f/d33/c4d 0 2024-09-13T02:53:53.391 INFO:tasks.workunit.client.1.smithi131.stdout:4/216: sync 2024-09-13T02:53:53.391 INFO:tasks.workunit.client.1.smithi131.stdout:6/276: sync 2024-09-13T02:53:53.391 INFO:tasks.workunit.client.1.smithi131.stdout:6/277: readlink d1/d8/d9/l46 0 2024-09-13T02:53:53.392 INFO:tasks.workunit.client.1.smithi131.stdout:4/217: fsync d1/dc/f41 0 2024-09-13T02:53:53.392 INFO:tasks.workunit.client.1.smithi131.stdout:4/218: chown d1/dc/f31 10 1 2024-09-13T02:53:53.392 INFO:tasks.workunit.client.1.smithi131.stdout:4/219: dread - d1/dc/d19/d29/d33/f37 zero size 2024-09-13T02:53:53.392 INFO:tasks.workunit.client.1.smithi131.stdout:6/278: mknod d1/d8/d9/db/c59 0 2024-09-13T02:53:53.392 INFO:tasks.workunit.client.1.smithi131.stdout:6/279: write d1/d8/d9/db/d40/f47 [647849,48125] 0 2024-09-13T02:53:53.393 INFO:tasks.workunit.client.1.smithi131.stdout:6/280: stat d1/d8/l21 0 2024-09-13T02:53:53.393 INFO:tasks.workunit.client.1.smithi131.stdout:4/220: truncate d1/f27 340240 0 2024-09-13T02:53:53.393 INFO:tasks.workunit.client.1.smithi131.stdout:4/221: mkdir d1/d18/d43 0 2024-09-13T02:53:53.394 INFO:tasks.workunit.client.1.smithi131.stdout:4/222: link d1/dc/f31 d1/d8/d13/f44 0 2024-09-13T02:53:53.394 INFO:tasks.workunit.client.1.smithi131.stdout:4/223: stat d1/dc/l1e 0 2024-09-13T02:53:53.394 INFO:tasks.workunit.client.1.smithi131.stdout:4/224: chown d1/dc/f41 10038 1 2024-09-13T02:53:53.395 INFO:tasks.workunit.client.1.smithi131.stdout:4/225: creat d1/f45 x:0 0 0 2024-09-13T02:53:53.395 INFO:tasks.workunit.client.1.smithi131.stdout:4/226: fsync d1/d18/f2d 0 2024-09-13T02:53:53.395 INFO:tasks.workunit.client.1.smithi131.stdout:4/227: symlink d1/dc/d22/l46 0 2024-09-13T02:53:53.396 INFO:tasks.workunit.client.1.smithi131.stdout:4/228: rmdir d1/dc/d19/d29/d3f 0 2024-09-13T02:53:53.402 INFO:tasks.workunit.client.1.smithi131.stdout:5/220: dread d1/f1b [0,4194304] 0 2024-09-13T02:53:53.402 INFO:tasks.workunit.client.1.smithi131.stdout:5/221: write d1/d2f/f31 [1210272,6234] 0 2024-09-13T02:53:53.402 INFO:tasks.workunit.client.1.smithi131.stdout:5/222: creat d1/d5/f4e x:0 0 0 2024-09-13T02:53:53.402 INFO:tasks.workunit.client.1.smithi131.stdout:5/223: chown d1/d2f/d33/l47 3 1 2024-09-13T02:53:53.405 INFO:tasks.workunit.client.1.smithi131.stdout:6/281: dread d1/f2b [0,4194304] 0 2024-09-13T02:53:53.406 INFO:tasks.workunit.client.1.smithi131.stdout:6/282: symlink d1/d8/d9/db/d40/l5a 0 2024-09-13T02:53:53.411 INFO:tasks.workunit.client.1.smithi131.stdout:5/224: dread d1/d1c/f1d [0,4194304] 0 2024-09-13T02:53:53.416 INFO:tasks.workunit.client.1.smithi131.stdout:4/229: dwrite d1/d8/f17 [0,4194304] 0 2024-09-13T02:53:53.416 INFO:tasks.workunit.client.1.smithi131.stdout:4/230: write d1/dc/d19/d29/d33/f37 [135800,120503] 0 2024-09-13T02:53:53.418 INFO:tasks.workunit.client.1.smithi131.stdout:4/231: creat d1/d18/d43/f47 x:0 0 0 2024-09-13T02:53:53.418 INFO:tasks.workunit.client.1.smithi131.stdout:4/232: mknod d1/d18/c48 0 2024-09-13T02:53:53.419 INFO:tasks.workunit.client.1.smithi131.stdout:4/233: mkdir d1/dc/d22/d49 0 2024-09-13T02:53:53.420 INFO:tasks.workunit.client.1.smithi131.stdout:4/234: creat d1/dc/d19/d29/f4a x:0 0 0 2024-09-13T02:53:53.421 INFO:tasks.workunit.client.1.smithi131.stdout:4/235: symlink d1/d8/l4b 0 2024-09-13T02:53:53.422 INFO:tasks.workunit.client.1.smithi131.stdout:4/236: creat d1/dc/d19/d29/d33/f4c x:0 0 0 2024-09-13T02:53:53.423 INFO:tasks.workunit.client.1.smithi131.stdout:4/237: write d1/dc/f2e [180060,126551] 0 2024-09-13T02:53:53.424 INFO:tasks.workunit.client.1.smithi131.stdout:4/238: dread d1/dc/d19/d29/f2c [0,4194304] 0 2024-09-13T02:53:53.430 INFO:tasks.workunit.client.1.smithi131.stdout:6/283: dwrite d1/d8/d9/db/ff [4194304,4194304] 0 2024-09-13T02:53:53.431 INFO:tasks.workunit.client.1.smithi131.stdout:6/284: symlink d1/l5b 0 2024-09-13T02:53:53.432 INFO:tasks.workunit.client.1.smithi131.stdout:6/285: readlink d1/d8/l21 0 2024-09-13T02:53:53.433 INFO:tasks.workunit.client.1.smithi131.stdout:6/286: rename d1/f4 to d1/d14/f5c 0 2024-09-13T02:53:53.433 INFO:tasks.workunit.client.1.smithi131.stdout:5/225: dwrite d1/d5/f16 [0,4194304] 0 2024-09-13T02:53:53.435 INFO:tasks.workunit.client.1.smithi131.stdout:6/287: symlink d1/d8/d9/db/d15/d26/l5d 0 2024-09-13T02:53:53.437 INFO:tasks.workunit.client.1.smithi131.stdout:6/288: rename d1/d8/d9/db/d15/d26/l42 to d1/d8/d9/db/d40/l5e 0 2024-09-13T02:53:53.442 INFO:tasks.workunit.client.1.smithi131.stdout:4/239: dwrite d1/d18/f2d [0,4194304] 0 2024-09-13T02:53:53.442 INFO:tasks.workunit.client.1.smithi131.stdout:4/240: chown d1/dc/d22/l46 334077 1 2024-09-13T02:53:53.442 INFO:tasks.workunit.client.1.smithi131.stdout:5/226: dread d1/d21/f25 [0,4194304] 0 2024-09-13T02:53:53.444 INFO:tasks.workunit.client.1.smithi131.stdout:5/227: getdents d1/d21 0 2024-09-13T02:53:53.444 INFO:tasks.workunit.client.1.smithi131.stdout:5/228: chown d1/cd 13364 1 2024-09-13T02:53:53.444 INFO:tasks.workunit.client.1.smithi131.stdout:5/229: fdatasync d1/d5/f13 0 2024-09-13T02:53:53.445 INFO:tasks.workunit.client.1.smithi131.stdout:5/230: mkdir d1/d2f/d4f 0 2024-09-13T02:53:53.446 INFO:tasks.workunit.client.1.smithi131.stdout:5/231: mkdir d1/d50 0 2024-09-13T02:53:53.446 INFO:tasks.workunit.client.1.smithi131.stdout:5/232: readlink d1/l24 0 2024-09-13T02:53:53.446 INFO:tasks.workunit.client.1.smithi131.stdout:5/233: write d1/d29/d39/f49 [263468,79674] 0 2024-09-13T02:53:53.451 INFO:tasks.workunit.client.1.smithi131.stdout:4/241: write d1/d8/f2f [3023899,34511] 0 2024-09-13T02:53:53.475 INFO:tasks.workunit.client.1.smithi131.stdout:5/234: dwrite d1/d29/f2e [0,4194304] 0 2024-09-13T02:53:53.475 INFO:tasks.workunit.client.1.smithi131.stdout:5/235: chown d1/d2f/d33/l47 7409 1 2024-09-13T02:53:53.475 INFO:tasks.workunit.client.1.smithi131.stdout:4/242: dwrite d1/dc/f3b [0,4194304] 0 2024-09-13T02:53:53.475 INFO:tasks.workunit.client.1.smithi131.stdout:4/243: read - d1/d18/f32 zero size 2024-09-13T02:53:53.475 INFO:tasks.workunit.client.1.smithi131.stdout:4/244: chown d1/c12 0 1 2024-09-13T02:53:53.475 INFO:tasks.workunit.client.1.smithi131.stdout:4/245: write d1/dc/d19/d29/f2c [4652138,103075] 0 2024-09-13T02:53:53.476 INFO:tasks.workunit.client.1.smithi131.stdout:5/236: rename d1/d29/d39/f49 to d1/d21/f51 0 2024-09-13T02:53:53.480 INFO:tasks.workunit.client.1.smithi131.stdout:5/237: truncate d1/d21/f25 2729563 0 2024-09-13T02:53:53.484 INFO:tasks.workunit.client.1.smithi131.stdout:4/246: rmdir d1 39 2024-09-13T02:53:53.486 INFO:tasks.workunit.client.1.smithi131.stdout:4/247: creat d1/dc/d22/d49/f4d x:0 0 0 2024-09-13T02:53:53.487 INFO:tasks.workunit.client.1.smithi131.stdout:4/248: write d1/f27 [162059,117848] 0 2024-09-13T02:53:53.488 INFO:tasks.workunit.client.1.smithi131.stdout:4/249: mkdir d1/d18/d34/d4e 0 2024-09-13T02:53:53.488 INFO:tasks.workunit.client.1.smithi131.stdout:4/250: creat d1/dc/f4f x:0 0 0 2024-09-13T02:53:53.489 INFO:tasks.workunit.client.1.smithi131.stdout:4/251: symlink d1/d18/l50 0 2024-09-13T02:53:53.489 INFO:tasks.workunit.client.1.smithi131.stdout:4/252: truncate d1/d18/f2d 4819357 0 2024-09-13T02:53:53.490 INFO:tasks.workunit.client.1.smithi131.stdout:4/253: rename d1/d8/l14 to d1/dc/d19/d29/l51 0 2024-09-13T02:53:53.492 INFO:tasks.workunit.client.1.smithi131.stdout:2/206: sync 2024-09-13T02:53:53.492 INFO:tasks.workunit.client.1.smithi131.stdout:5/238: truncate d1/d1c/f3b 3373549 0 2024-09-13T02:53:53.492 INFO:tasks.workunit.client.1.smithi131.stdout:5/239: chown d1/d2f/l40 18 1 2024-09-13T02:53:53.500 INFO:tasks.workunit.client.1.smithi131.stdout:2/207: dread d5/fa [0,4194304] 0 2024-09-13T02:53:53.501 INFO:tasks.workunit.client.1.smithi131.stdout:2/208: mkdir d5/d33/d41 0 2024-09-13T02:53:53.501 INFO:tasks.workunit.client.1.smithi131.stdout:2/209: readlink d5/l2d 0 2024-09-13T02:53:53.501 INFO:tasks.workunit.client.1.smithi131.stdout:2/210: rmdir d5/d1e 39 2024-09-13T02:53:53.502 INFO:tasks.workunit.client.1.smithi131.stdout:2/211: mkdir d5/d34/d42 0 2024-09-13T02:53:53.503 INFO:tasks.workunit.client.1.smithi131.stdout:2/212: unlink d5/d18/f14 0 2024-09-13T02:53:53.508 INFO:tasks.workunit.client.1.smithi131.stdout:2/213: truncate d5/f9 2224215 0 2024-09-13T02:53:53.508 INFO:tasks.workunit.client.1.smithi131.stdout:2/214: fsync d5/d1e/d2c/f40 0 2024-09-13T02:53:53.508 INFO:tasks.workunit.client.1.smithi131.stdout:2/215: rename d5/d31/d21/c2a to d5/d18/c43 0 2024-09-13T02:53:53.508 INFO:tasks.workunit.client.1.smithi131.stdout:2/216: chown d5/d31/d1d/c27 427 1 2024-09-13T02:53:53.510 INFO:tasks.workunit.client.1.smithi131.stdout:2/217: write d5/d31/d21/f24 [2765048,8397] 0 2024-09-13T02:53:53.512 INFO:tasks.workunit.client.1.smithi131.stdout:4/254: dread d1/d18/f2d [0,4194304] 0 2024-09-13T02:53:53.512 INFO:tasks.workunit.client.1.smithi131.stdout:2/218: creat d5/d33/d41/f44 x:0 0 0 2024-09-13T02:53:53.513 INFO:tasks.workunit.client.1.smithi131.stdout:4/255: mknod d1/d8/c52 0 2024-09-13T02:53:53.513 INFO:tasks.workunit.client.1.smithi131.stdout:4/256: chown d1/dc 32559 1 2024-09-13T02:53:53.516 INFO:tasks.workunit.client.1.smithi131.stdout:2/219: symlink d5/d31/d1d/d32/d3b/l45 0 2024-09-13T02:53:53.516 INFO:tasks.workunit.client.1.smithi131.stdout:2/220: fdatasync d5/d33/d41/f44 0 2024-09-13T02:53:53.516 INFO:tasks.workunit.client.1.smithi131.stdout:2/221: readlink d5/l2d 0 2024-09-13T02:53:53.516 INFO:tasks.workunit.client.1.smithi131.stdout:2/222: write d5/d1e/d2c/f40 [398453,18456] 0 2024-09-13T02:53:53.519 INFO:tasks.workunit.client.1.smithi131.stdout:5/240: dwrite d1/f2c [0,4194304] 0 2024-09-13T02:53:53.521 INFO:tasks.workunit.client.1.smithi131.stdout:5/241: truncate d1/f23 928055 0 2024-09-13T02:53:53.534 INFO:tasks.workunit.client.1.smithi131.stdout:4/257: dwrite d1/dc/d22/d49/f4d [0,4194304] 0 2024-09-13T02:53:53.535 INFO:tasks.workunit.client.1.smithi131.stdout:2/223: dwrite d5/f2e [0,4194304] 0 2024-09-13T02:53:53.538 INFO:tasks.workunit.client.1.smithi131.stdout:4/258: unlink d1/d18/l50 0 2024-09-13T02:53:53.540 INFO:tasks.workunit.client.1.smithi131.stdout:2/224: mknod d5/d31/d26/c46 0 2024-09-13T02:53:53.541 INFO:tasks.workunit.client.1.smithi131.stdout:2/225: chown d5/d18/l29 63 1 2024-09-13T02:53:53.541 INFO:tasks.workunit.client.1.smithi131.stdout:2/226: dread - d5/f3a zero size 2024-09-13T02:53:53.541 INFO:tasks.workunit.client.1.smithi131.stdout:2/227: chown d5/d31/c13 13757 1 2024-09-13T02:53:53.541 INFO:tasks.workunit.client.1.smithi131.stdout:5/242: dwrite d1/d5/f3a [0,4194304] 0 2024-09-13T02:53:53.542 INFO:tasks.workunit.client.1.smithi131.stdout:5/243: fsync d1/f23 0 2024-09-13T02:53:53.542 INFO:tasks.workunit.client.1.smithi131.stdout:5/244: fdatasync d1/fc 0 2024-09-13T02:53:53.542 INFO:tasks.workunit.client.1.smithi131.stdout:4/259: rename d1/dc/d19/d29/f2c to d1/dc/d19/d29/d33/d3a/f53 0 2024-09-13T02:53:53.542 INFO:tasks.workunit.client.1.smithi131.stdout:4/260: creat d1/dc/d22/d49/f54 x:0 0 0 2024-09-13T02:53:53.542 INFO:tasks.workunit.client.1.smithi131.stdout:2/228: link d5/d31/d21/f2b d5/f47 0 2024-09-13T02:53:53.548 INFO:tasks.workunit.client.1.smithi131.stdout:4/261: creat d1/d18/f55 x:0 0 0 2024-09-13T02:53:53.552 INFO:tasks.workunit.client.1.smithi131.stdout:2/229: mkdir d5/d1e/d48 0 2024-09-13T02:53:53.552 INFO:tasks.workunit.client.1.smithi131.stdout:2/230: dread - d5/f47 zero size 2024-09-13T02:53:53.552 INFO:tasks.workunit.client.1.smithi131.stdout:2/231: chown d5/d31/d26 4870411 1 2024-09-13T02:53:53.552 INFO:tasks.workunit.client.1.smithi131.stdout:5/245: dread d1/d5/f13 [4194304,4194304] 0 2024-09-13T02:53:53.552 INFO:tasks.workunit.client.1.smithi131.stdout:5/246: creat d1/d29/d39/d45/f52 x:0 0 0 2024-09-13T02:53:53.552 INFO:tasks.workunit.client.1.smithi131.stdout:5/247: fdatasync d1/d1c/f3b 0 2024-09-13T02:53:53.552 INFO:tasks.workunit.client.1.smithi131.stdout:4/262: mknod d1/dc/d19/d29/c56 0 2024-09-13T02:53:53.553 INFO:tasks.workunit.client.1.smithi131.stdout:4/263: creat d1/d8/d13/f57 x:0 0 0 2024-09-13T02:53:53.554 INFO:tasks.workunit.client.1.smithi131.stdout:4/264: creat d1/dc/d19/d29/d33/f58 x:0 0 0 2024-09-13T02:53:53.555 INFO:tasks.workunit.client.1.smithi131.stdout:4/265: truncate d1/d8/f17 480956 0 2024-09-13T02:53:53.557 INFO:tasks.workunit.client.1.smithi131.stdout:4/266: creat d1/dc/d22/f59 x:0 0 0 2024-09-13T02:53:53.561 INFO:tasks.workunit.client.1.smithi131.stdout:5/248: write d1/f2c [3514600,41091] 0 2024-09-13T02:53:53.561 INFO:tasks.workunit.client.1.smithi131.stdout:5/249: fsync d1/d5/f13 0 2024-09-13T02:53:53.569 INFO:tasks.workunit.client.1.smithi131.stdout:4/267: dread d1/d8/f2f [0,4194304] 0 2024-09-13T02:53:53.569 INFO:tasks.workunit.client.1.smithi131.stdout:2/232: dwrite d5/f9 [0,4194304] 0 2024-09-13T02:53:53.570 INFO:tasks.workunit.client.1.smithi131.stdout:4/268: creat d1/d18/d34/f5a x:0 0 0 2024-09-13T02:53:53.571 INFO:tasks.workunit.client.1.smithi131.stdout:4/269: mknod d1/dc/d19/c5b 0 2024-09-13T02:53:53.571 INFO:tasks.workunit.client.1.smithi131.stdout:4/270: rmdir d1/dc/d19/d29 39 2024-09-13T02:53:53.578 INFO:tasks.workunit.client.1.smithi131.stdout:5/250: write d1/d5/f12 [3709692,17739] 0 2024-09-13T02:53:53.578 INFO:tasks.workunit.client.1.smithi131.stdout:5/251: chown d1/d2f/d33 323 1 2024-09-13T02:53:53.582 INFO:tasks.workunit.client.1.smithi131.stdout:5/252: rename d1/fc to d1/d1c/f53 0 2024-09-13T02:53:53.582 INFO:tasks.workunit.client.1.smithi131.stdout:2/233: write d5/d31/ff [1680364,87955] 0 2024-09-13T02:53:53.582 INFO:tasks.workunit.client.1.smithi131.stdout:2/234: creat d5/d31/d1d/d32/f49 x:0 0 0 2024-09-13T02:53:53.585 INFO:tasks.workunit.client.1.smithi131.stdout:2/235: rename d5/d31/f16 to d5/d33/d41/f4a 0 2024-09-13T02:53:53.585 INFO:tasks.workunit.client.1.smithi131.stdout:2/236: write d5/d33/d41/f44 [701164,50131] 0 2024-09-13T02:53:53.587 INFO:tasks.workunit.client.1.smithi131.stdout:4/271: dwrite d1/dc/f3b [0,4194304] 0 2024-09-13T02:53:53.587 INFO:tasks.workunit.client.1.smithi131.stdout:4/272: creat d1/d18/f5c x:0 0 0 2024-09-13T02:53:53.587 INFO:tasks.workunit.client.1.smithi131.stdout:4/273: write d1/dc/f41 [244192,89197] 0 2024-09-13T02:53:53.587 INFO:tasks.workunit.client.1.smithi131.stdout:4/274: write d1/d18/f55 [226329,84198] 0 2024-09-13T02:53:53.588 INFO:tasks.workunit.client.1.smithi131.stdout:2/237: rename d5/d1e/d2c to d5/d18/d4b 0 2024-09-13T02:53:53.589 INFO:tasks.workunit.client.1.smithi131.stdout:4/275: symlink d1/dc/d19/d29/d33/d3a/l5d 0 2024-09-13T02:53:53.590 INFO:tasks.workunit.client.1.smithi131.stdout:4/276: rename d1/dc/d19/d29/d33/f58 to d1/d18/d34/d4e/f5e 0 2024-09-13T02:53:53.591 INFO:tasks.workunit.client.1.smithi131.stdout:4/277: symlink d1/dc/d22/l5f 0 2024-09-13T02:53:53.591 INFO:tasks.workunit.client.1.smithi131.stdout:4/278: chown d1/dc/d19/d29/c56 2543 1 2024-09-13T02:53:53.592 INFO:tasks.workunit.client.1.smithi131.stdout:4/279: write d1/dc/fe [521887,86630] 0 2024-09-13T02:53:53.592 INFO:tasks.workunit.client.1.smithi131.stdout:4/280: dread - d1/d8/d13/f44 zero size 2024-09-13T02:53:53.595 INFO:tasks.workunit.client.1.smithi131.stdout:4/281: dread d1/dc/f2e [0,4194304] 0 2024-09-13T02:53:53.595 INFO:tasks.workunit.client.1.smithi131.stdout:4/282: read d1/d8/f17 [284503,80411] 0 2024-09-13T02:53:53.595 INFO:tasks.workunit.client.1.smithi131.stdout:4/283: stat d1/d8/l4b 0 2024-09-13T02:53:53.595 INFO:tasks.workunit.client.1.smithi131.stdout:2/238: dread d5/d18/f1b [0,4194304] 0 2024-09-13T02:53:53.596 INFO:tasks.workunit.client.1.smithi131.stdout:4/284: creat d1/dc/d19/d29/f60 x:0 0 0 2024-09-13T02:53:53.596 INFO:tasks.workunit.client.1.smithi131.stdout:2/239: mkdir d5/d1e/d48/d4c 0 2024-09-13T02:53:53.596 INFO:tasks.workunit.client.1.smithi131.stdout:2/240: write d5/f28 [857598,121469] 0 2024-09-13T02:53:53.597 INFO:tasks.workunit.client.1.smithi131.stdout:4/285: read d1/d8/f15 [1256200,108081] 0 2024-09-13T02:53:53.597 INFO:tasks.workunit.client.1.smithi131.stdout:4/286: read - d1/d8/d13/f57 zero size 2024-09-13T02:53:53.597 INFO:tasks.workunit.client.1.smithi131.stdout:4/287: readlink d1/d8/d13/l26 0 2024-09-13T02:53:53.599 INFO:tasks.workunit.client.1.smithi131.stdout:2/241: fdatasync d5/d33/d41/f44 0 2024-09-13T02:53:53.609 INFO:tasks.workunit.client.1.smithi131.stdout:2/242: write d5/f2e [1740988,90491] 0 2024-09-13T02:53:53.609 INFO:tasks.workunit.client.1.smithi131.stdout:2/243: dread - d5/f3a zero size 2024-09-13T02:53:53.613 INFO:tasks.workunit.client.1.smithi131.stdout:4/288: dwrite d1/d8/f1d [0,4194304] 0 2024-09-13T02:53:53.616 INFO:tasks.workunit.client.1.smithi131.stdout:4/289: link d1/dc/d19/d29/f2b d1/dc/d22/d49/f61 0 2024-09-13T02:53:53.618 INFO:tasks.workunit.client.1.smithi131.stdout:4/290: rmdir d1 39 2024-09-13T02:53:53.618 INFO:tasks.workunit.client.1.smithi131.stdout:4/291: fsync d1/dc/d22/d49/f4d 0 2024-09-13T02:53:53.618 INFO:tasks.workunit.client.1.smithi131.stdout:4/292: readlink d1/dc/d22/l5f 0 2024-09-13T02:53:53.633 INFO:tasks.workunit.client.1.smithi131.stdout:2/244: dwrite d5/d31/ff [0,4194304] 0 2024-09-13T02:53:53.635 INFO:tasks.workunit.client.1.smithi131.stdout:4/293: dwrite d1/dc/fe [0,4194304] 0 2024-09-13T02:53:53.646 INFO:tasks.workunit.client.1.smithi131.stdout:2/245: dwrite d5/f28 [0,4194304] 0 2024-09-13T02:53:53.648 INFO:tasks.workunit.client.1.smithi131.stdout:2/246: creat d5/d1e/f4d x:0 0 0 2024-09-13T02:53:53.649 INFO:tasks.workunit.client.1.smithi131.stdout:2/247: rmdir d5/d31/d26 39 2024-09-13T02:53:53.649 INFO:tasks.workunit.client.1.smithi131.stdout:2/248: mkdir d5/d31/d4e 0 2024-09-13T02:53:53.650 INFO:tasks.workunit.client.1.smithi131.stdout:2/249: mkdir d5/d4f 0 2024-09-13T02:53:53.651 INFO:tasks.workunit.client.1.smithi131.stdout:2/250: mkdir d5/d31/d1d/d50 0 2024-09-13T02:53:53.660 INFO:tasks.workunit.client.1.smithi131.stdout:2/251: read d5/fe [4023370,93610] 0 2024-09-13T02:53:53.662 INFO:tasks.workunit.client.1.smithi131.stdout:2/252: rename f4 to d5/d18/f51 0 2024-09-13T02:53:53.662 INFO:tasks.workunit.client.1.smithi131.stdout:2/253: creat d5/d31/d1d/f52 x:0 0 0 2024-09-13T02:53:53.663 INFO:tasks.workunit.client.1.smithi131.stdout:2/254: mkdir d5/d53 0 2024-09-13T02:53:53.664 INFO:tasks.workunit.client.1.smithi131.stdout:2/255: write d5/d1e/f4d [183534,78942] 0 2024-09-13T02:53:53.664 INFO:tasks.workunit.client.1.smithi131.stdout:2/256: creat d5/d31/d1d/f54 x:0 0 0 2024-09-13T02:53:53.664 INFO:tasks.workunit.client.1.smithi131.stdout:2/257: mknod d5/d1e/d48/d4c/c55 0 2024-09-13T02:53:53.671 INFO:tasks.workunit.client.1.smithi131.stdout:2/258: write d5/d31/d21/f24 [3267437,35939] 0 2024-09-13T02:53:53.671 INFO:tasks.workunit.client.1.smithi131.stdout:2/259: truncate d5/f3a 732915 0 2024-09-13T02:53:53.671 INFO:tasks.workunit.client.1.smithi131.stdout:2/260: chown d5/d31/d1d/l1f 883 1 2024-09-13T02:53:53.671 INFO:tasks.workunit.client.1.smithi131.stdout:2/261: creat d5/d31/d1d/d37/f56 x:0 0 0 2024-09-13T02:53:53.672 INFO:tasks.workunit.client.1.smithi131.stdout:2/262: mkdir d5/d31/d21/d57 0 2024-09-13T02:53:53.685 INFO:tasks.workunit.client.1.smithi131.stdout:2/263: dwrite d5/d31/d21/f2b [0,4194304] 0 2024-09-13T02:53:53.701 INFO:tasks.workunit.client.1.smithi131.stdout:2/264: dwrite d5/f3a [0,4194304] 0 2024-09-13T02:53:53.703 INFO:tasks.workunit.client.1.smithi131.stdout:2/265: mknod d5/d31/d26/c58 0 2024-09-13T02:53:53.704 INFO:tasks.workunit.client.1.smithi131.stdout:2/266: write d5/d31/d1d/d32/f3d [220076,52606] 0 2024-09-13T02:53:53.704 INFO:tasks.workunit.client.1.smithi131.stdout:2/267: creat d5/d31/d26/f59 x:0 0 0 2024-09-13T02:53:53.710 INFO:tasks.workunit.client.1.smithi131.stdout:2/268: write d5/f28 [184672,18185] 0 2024-09-13T02:53:53.711 INFO:tasks.workunit.client.1.smithi131.stdout:2/269: truncate d5/d18/f51 1995855 0 2024-09-13T02:53:53.711 INFO:tasks.workunit.client.1.smithi131.stdout:2/270: stat d5/d31/d26/l2f 0 2024-09-13T02:53:53.712 INFO:tasks.workunit.client.1.smithi131.stdout:2/271: mknod d5/c5a 0 2024-09-13T02:53:53.713 INFO:tasks.workunit.client.1.smithi131.stdout:2/272: creat d5/d53/f5b x:0 0 0 2024-09-13T02:53:53.713 INFO:tasks.workunit.client.1.smithi131.stdout:2/273: readlink d5/d31/d26/l30 0 2024-09-13T02:53:53.730 INFO:tasks.workunit.client.1.smithi131.stdout:2/274: dwrite d5/fa [0,4194304] 0 2024-09-13T02:53:53.730 INFO:tasks.workunit.client.1.smithi131.stdout:2/275: chown d5/d33/d41/f4a 141 1 2024-09-13T02:53:53.744 INFO:tasks.workunit.client.1.smithi131.stdout:0/288: sync 2024-09-13T02:53:53.745 INFO:tasks.workunit.client.1.smithi131.stdout:0/289: unlink d0/d2/c1b 0 2024-09-13T02:53:53.745 INFO:tasks.workunit.client.1.smithi131.stdout:0/290: chown d0/d2/f17 13282495 1 2024-09-13T02:53:53.746 INFO:tasks.workunit.client.1.smithi131.stdout:0/291: link d0/de/d1f/d22/d3d/f6c d0/de/d1f/f72 0 2024-09-13T02:53:53.762 INFO:tasks.workunit.client.1.smithi131.stdout:0/292: dwrite d0/de/d1f/d22/d3d/f6c [0,4194304] 0 2024-09-13T02:53:53.763 INFO:tasks.workunit.client.1.smithi131.stdout:0/293: link d0/de/d1f/d22/d31/c48 d0/de/d1f/d22/d3d/c73 0 2024-09-13T02:53:53.764 INFO:tasks.workunit.client.1.smithi131.stdout:0/294: rename d0/f12 to d0/de/d1f/d22/d31/d39/f74 0 2024-09-13T02:53:53.765 INFO:tasks.workunit.client.1.smithi131.stdout:0/295: rmdir d0/de/d1f/d22/d31/d39/d40 39 2024-09-13T02:53:53.765 INFO:tasks.workunit.client.1.smithi131.stdout:0/296: getdents d0/de/d1f/d22/d31/d39/d67 0 2024-09-13T02:53:53.772 INFO:tasks.workunit.client.1.smithi131.stdout:0/297: dread d0/de/d1f/d22/f53 [0,4194304] 0 2024-09-13T02:53:53.773 INFO:tasks.workunit.client.1.smithi131.stdout:0/298: mkdir d0/de/d1f/d22/d3d/d75 0 2024-09-13T02:53:53.774 INFO:tasks.workunit.client.1.smithi131.stdout:0/299: creat d0/de/d1f/d22/d31/f76 x:0 0 0 2024-09-13T02:53:53.774 INFO:tasks.workunit.client.1.smithi131.stdout:0/300: chown d0/d2/d62 222720 1 2024-09-13T02:53:53.774 INFO:tasks.workunit.client.1.smithi131.stdout:0/301: write d0/de/d45/d5a/f6f [876569,17014] 0 2024-09-13T02:53:53.774 INFO:tasks.workunit.client.1.smithi131.stdout:0/302: rmdir d0/de/d1f/d22/d3d/d75 0 2024-09-13T02:53:53.780 INFO:tasks.workunit.client.1.smithi131.stdout:0/303: rmdir d0/de/d1f 39 2024-09-13T02:53:53.781 INFO:tasks.workunit.client.1.smithi131.stdout:0/304: link d0/de/d1f/l23 d0/de/d45/d5a/l77 0 2024-09-13T02:53:53.781 INFO:tasks.workunit.client.1.smithi131.stdout:0/305: write d0/de/f1a [4411093,72305] 0 2024-09-13T02:53:53.782 INFO:tasks.workunit.client.1.smithi131.stdout:0/306: mkdir d0/de/d45/d78 0 2024-09-13T02:53:53.782 INFO:tasks.workunit.client.1.smithi131.stdout:0/307: dread - d0/de/d1f/d22/d31/d39/d67/f5e zero size 2024-09-13T02:53:53.782 INFO:tasks.workunit.client.1.smithi131.stdout:0/308: write d0/de/d1f/d22/f29 [1049347,18099] 0 2024-09-13T02:53:53.783 INFO:tasks.workunit.client.1.smithi131.stdout:0/309: unlink d0/f26 0 2024-09-13T02:53:53.783 INFO:tasks.workunit.client.1.smithi131.stdout:0/310: creat d0/d2/d41/f79 x:0 0 0 2024-09-13T02:53:53.783 INFO:tasks.workunit.client.1.smithi131.stdout:0/311: chown d0/de/d1f/d22/d31/l35 18 1 2024-09-13T02:53:53.784 INFO:tasks.workunit.client.1.smithi131.stdout:0/312: symlink d0/de/d1f/l7a 0 2024-09-13T02:53:53.785 INFO:tasks.workunit.client.1.smithi131.stdout:0/313: mknod d0/c7b 0 2024-09-13T02:53:53.786 INFO:tasks.workunit.client.1.smithi131.stdout:0/314: write d0/de/f14 [448975,66217] 0 2024-09-13T02:53:53.787 INFO:tasks.workunit.client.1.smithi131.stdout:0/315: unlink d0/c54 0 2024-09-13T02:53:53.788 INFO:tasks.workunit.client.1.smithi131.stdout:0/316: creat d0/de/d1f/d22/d31/d39/d40/f7c x:0 0 0 2024-09-13T02:53:53.797 INFO:tasks.workunit.client.1.smithi131.stdout:0/317: write d0/de/d1f/d22/d3d/f6c [616553,64144] 0 2024-09-13T02:53:53.797 INFO:tasks.workunit.client.1.smithi131.stdout:0/318: truncate d0/de/d1f/d22/f29 1764963 0 2024-09-13T02:53:53.797 INFO:tasks.workunit.client.1.smithi131.stdout:0/319: readlink d0/de/l25 0 2024-09-13T02:53:53.797 INFO:tasks.workunit.client.1.smithi131.stdout:0/320: chown d0/de/f59 189592165 1 2024-09-13T02:53:53.798 INFO:tasks.workunit.client.1.smithi131.stdout:0/321: creat d0/de/f7d x:0 0 0 2024-09-13T02:53:53.799 INFO:tasks.workunit.client.1.smithi131.stdout:0/322: read d0/de/d1f/d22/f4e [204558,11002] 0 2024-09-13T02:53:53.799 INFO:tasks.workunit.client.1.smithi131.stdout:0/323: readlink d0/de/d1f/d22/l28 0 2024-09-13T02:53:53.799 INFO:tasks.workunit.client.1.smithi131.stdout:0/324: creat d0/d2/d41/f7e x:0 0 0 2024-09-13T02:53:53.799 INFO:tasks.workunit.client.1.smithi131.stdout:0/325: fsync d0/de/d1f/d22/d31/d39/d67/f69 0 2024-09-13T02:53:53.805 INFO:tasks.workunit.client.1.smithi131.stdout:0/326: dread d0/de/f47 [0,4194304] 0 2024-09-13T02:53:53.805 INFO:tasks.workunit.client.1.smithi131.stdout:0/327: creat d0/de/d45/d5a/f7f x:0 0 0 2024-09-13T02:53:53.807 INFO:tasks.workunit.client.1.smithi131.stdout:0/328: unlink d0/de/l25 0 2024-09-13T02:53:53.807 INFO:tasks.workunit.client.1.smithi131.stdout:0/329: mkdir d0/de/d1f/d22/d3d/d80 0 2024-09-13T02:53:53.814 INFO:tasks.workunit.client.1.smithi131.stdout:0/330: write d0/de/d1f/d22/d31/f3a [2671572,91242] 0 2024-09-13T02:53:53.815 INFO:tasks.workunit.client.1.smithi131.stdout:0/331: mknod d0/de/d45/d5a/c81 0 2024-09-13T02:53:53.815 INFO:tasks.workunit.client.1.smithi131.stdout:0/332: chown d0/d2/l15 6 1 2024-09-13T02:53:53.816 INFO:tasks.workunit.client.1.smithi131.stdout:0/333: mknod d0/d2/d41/c82 0 2024-09-13T02:53:53.817 INFO:tasks.workunit.client.1.smithi131.stdout:0/334: unlink d0/de/f38 0 2024-09-13T02:53:53.817 INFO:tasks.workunit.client.1.smithi131.stdout:0/335: write d0/de/d1f/d22/d31/f76 [371863,34581] 0 2024-09-13T02:53:53.818 INFO:tasks.workunit.client.1.smithi131.stdout:0/336: write d0/de/d1f/d22/f29 [1713446,73259] 0 2024-09-13T02:53:53.818 INFO:tasks.workunit.client.1.smithi131.stdout:0/337: fdatasync d0/d2/f2f 0 2024-09-13T02:53:53.818 INFO:tasks.workunit.client.1.smithi131.stdout:0/338: mknod d0/de/d45/c83 0 2024-09-13T02:53:53.824 INFO:tasks.workunit.client.1.smithi131.stdout:0/339: dread d0/de/d45/d5a/f6f [0,4194304] 0 2024-09-13T02:53:53.826 INFO:tasks.workunit.client.1.smithi131.stdout:0/340: rename d0/de/d1f/d22/d31/f76 to d0/de/d1f/f84 0 2024-09-13T02:53:53.828 INFO:tasks.workunit.client.1.smithi131.stdout:0/341: dread d0/de/d1f/f24 [0,4194304] 0 2024-09-13T02:53:53.828 INFO:tasks.workunit.client.1.smithi131.stdout:0/342: chown d0/de/d1f/f33 78 1 2024-09-13T02:53:53.829 INFO:tasks.workunit.client.1.smithi131.stdout:0/343: creat d0/d2/d62/f85 x:0 0 0 2024-09-13T02:53:53.829 INFO:tasks.workunit.client.1.smithi131.stdout:0/344: getdents d0/de/d1f/d22/d31/d39/d67 0 2024-09-13T02:53:53.830 INFO:tasks.workunit.client.1.smithi131.stdout:0/345: mkdir d0/de/d45/d86 0 2024-09-13T02:53:53.842 INFO:tasks.workunit.client.1.smithi131.stdout:0/346: dwrite d0/de/d45/d5a/f6f [0,4194304] 0 2024-09-13T02:53:53.844 INFO:tasks.workunit.client.1.smithi131.stdout:0/347: mkdir d0/de/d1f/d22/d3d/d87 0 2024-09-13T02:53:53.845 INFO:tasks.workunit.client.1.smithi131.stdout:0/348: dread - d0/de/d1f/d22/d3d/d43/f5f zero size 2024-09-13T02:53:53.845 INFO:tasks.workunit.client.1.smithi131.stdout:0/349: rmdir d0/de/d1f/d22/d3d 39 2024-09-13T02:53:53.845 INFO:tasks.workunit.client.1.smithi131.stdout:0/350: write d0/de/d1f/d22/d3d/d55/f58 [576628,62567] 0 2024-09-13T02:53:53.853 INFO:tasks.workunit.client.1.smithi131.stdout:0/351: dread d0/de/d1f/d22/f29 [0,4194304] 0 2024-09-13T02:53:53.853 INFO:tasks.workunit.client.1.smithi131.stdout:0/352: chown d0/de/d45/d5a/f6f 900854 1 2024-09-13T02:53:53.854 INFO:tasks.workunit.client.1.smithi131.stdout:0/353: creat d0/de/d45/d86/f88 x:0 0 0 2024-09-13T02:53:53.862 INFO:tasks.workunit.client.1.smithi131.stdout:0/354: dread d0/de/f1a [0,4194304] 0 2024-09-13T02:53:53.881 INFO:tasks.workunit.client.1.smithi131.stdout:0/355: dwrite d0/de/d1f/d22/d3d/d43/f5f [0,4194304] 0 2024-09-13T02:53:53.897 INFO:tasks.workunit.client.1.smithi131.stdout:0/356: dwrite d0/de/d1f/d22/d3d/d55/f6b [0,4194304] 0 2024-09-13T02:53:53.899 INFO:tasks.workunit.client.1.smithi131.stdout:0/357: fsync d0/de/d1f/f24 0 2024-09-13T02:53:53.900 INFO:tasks.workunit.client.1.smithi131.stdout:0/358: getdents d0 0 2024-09-13T02:53:53.904 INFO:tasks.workunit.client.1.smithi131.stdout:0/359: dread d0/de/f47 [0,4194304] 0 2024-09-13T02:53:53.904 INFO:tasks.workunit.client.1.smithi131.stdout:0/360: fsync d0/d2/d41/f79 0 2024-09-13T02:53:53.904 INFO:tasks.workunit.client.1.smithi131.stdout:0/361: chown d0/d2/l46 5 1 2024-09-13T02:53:53.904 INFO:tasks.workunit.client.1.smithi131.stdout:0/362: chown d0/de/d1f/d22/d31/c3b 42039548 1 2024-09-13T02:53:53.904 INFO:tasks.workunit.client.1.smithi131.stdout:0/363: read d0/de/d1f/d22/d3d/f6c [2783353,37682] 0 2024-09-13T02:53:53.904 INFO:tasks.workunit.client.1.smithi131.stdout:0/364: chown d0/de/d1f/d22/d3d/d55 2106 1 2024-09-13T02:53:53.905 INFO:tasks.workunit.client.1.smithi131.stdout:0/365: rename d0/d2/f3f to d0/de/d1f/d22/d3d/d87/f89 0 2024-09-13T02:53:53.905 INFO:tasks.workunit.client.1.smithi131.stdout:0/366: creat d0/de/d45/d86/f8a x:0 0 0 2024-09-13T02:53:53.907 INFO:tasks.workunit.client.1.smithi131.stdout:0/367: mknod d0/de/d1f/d22/d31/d39/d40/c8b 0 2024-09-13T02:53:53.913 INFO:tasks.workunit.client.1.smithi131.stdout:8/303: sync 2024-09-13T02:53:53.913 INFO:tasks.workunit.client.1.smithi131.stdout:1/294: sync 2024-09-13T02:53:53.915 INFO:tasks.workunit.client.1.smithi131.stdout:1/295: unlink dd/l17 0 2024-09-13T02:53:53.920 INFO:tasks.workunit.client.1.smithi131.stdout:1/296: dread dd/d26/d44/f22 [0,4194304] 0 2024-09-13T02:53:53.921 INFO:tasks.workunit.client.1.smithi131.stdout:0/368: dwrite d0/d2/d62/f85 [0,4194304] 0 2024-09-13T02:53:53.921 INFO:tasks.workunit.client.1.smithi131.stdout:0/369: truncate d0/d2/d41/f7e 912880 0 2024-09-13T02:53:53.923 INFO:tasks.workunit.client.1.smithi131.stdout:1/297: mkdir dd/d68 0 2024-09-13T02:53:53.924 INFO:tasks.workunit.client.1.smithi131.stdout:0/370: link d0/de/c44 d0/c8c 0 2024-09-13T02:53:53.924 INFO:tasks.workunit.client.1.smithi131.stdout:1/298: mkdir dd/d26/d2a/d69 0 2024-09-13T02:53:53.925 INFO:tasks.workunit.client.1.smithi131.stdout:0/371: stat d0/c8c 0 2024-09-13T02:53:53.926 INFO:tasks.workunit.client.1.smithi131.stdout:0/372: mknod d0/de/c8d 0 2024-09-13T02:53:53.927 INFO:tasks.workunit.client.1.smithi131.stdout:0/373: truncate d0/de/d1f/d22/d3d/d55/f6b 3530722 0 2024-09-13T02:53:53.927 INFO:tasks.workunit.client.1.smithi131.stdout:0/374: dread - d0/de/d45/d86/f8a zero size 2024-09-13T02:53:53.928 INFO:tasks.workunit.client.1.smithi131.stdout:0/375: write d0/de/f4f [43745,10863] 0 2024-09-13T02:53:53.928 INFO:tasks.workunit.client.1.smithi131.stdout:0/376: getdents d0/de/d1f/d22/d3d/d43 0 2024-09-13T02:53:53.929 INFO:tasks.workunit.client.1.smithi131.stdout:0/377: creat d0/d2/d62/f8e x:0 0 0 2024-09-13T02:53:53.929 INFO:tasks.workunit.client.1.smithi131.stdout:0/378: creat d0/d2/d62/f8f x:0 0 0 2024-09-13T02:53:53.931 INFO:tasks.workunit.client.1.smithi131.stdout:0/379: chown d0/de/d1f/l71 654473352 1 2024-09-13T02:53:53.932 INFO:tasks.workunit.client.1.smithi131.stdout:0/380: creat d0/f90 x:0 0 0 2024-09-13T02:53:53.933 INFO:tasks.workunit.client.1.smithi131.stdout:0/381: truncate d0/de/d1f/d22/f29 2078695 0 2024-09-13T02:53:53.933 INFO:tasks.workunit.client.1.smithi131.stdout:0/382: chown d0/d2/d62/f8e 447791519 1 2024-09-13T02:53:53.933 INFO:tasks.workunit.client.1.smithi131.stdout:0/383: write d0/de/d1f/f33 [2704765,7706] 0 2024-09-13T02:53:53.933 INFO:tasks.workunit.client.1.smithi131.stdout:0/384: write d0/de/f59 [248227,101434] 0 2024-09-13T02:53:53.934 INFO:tasks.workunit.client.1.smithi131.stdout:0/385: mknod d0/de/c91 0 2024-09-13T02:53:53.935 INFO:tasks.workunit.client.1.smithi131.stdout:0/386: creat d0/de/d1f/f92 x:0 0 0 2024-09-13T02:53:53.935 INFO:tasks.workunit.client.1.smithi131.stdout:0/387: chown d0/de/d45/d5a/f64 49080 1 2024-09-13T02:53:53.943 INFO:tasks.workunit.client.1.smithi131.stdout:1/299: dwrite dd/d26/d2a/f49 [4194304,4194304] 0 2024-09-13T02:53:53.943 INFO:tasks.workunit.client.1.smithi131.stdout:1/300: read dd/d26/d44/f22 [438055,28583] 0 2024-09-13T02:53:53.944 INFO:tasks.workunit.client.1.smithi131.stdout:1/301: link dd/ff dd/d33/f6a 0 2024-09-13T02:53:53.946 INFO:tasks.workunit.client.1.smithi131.stdout:0/388: dread d0/d2/f2f [0,4194304] 0 2024-09-13T02:53:53.948 INFO:tasks.workunit.client.1.smithi131.stdout:0/389: rename d0/de/d1f/f84 to d0/de/d45/d86/f93 0 2024-09-13T02:53:53.957 INFO:tasks.workunit.client.1.smithi131.stdout:1/302: dwrite dd/f3c [0,4194304] 0 2024-09-13T02:53:53.971 INFO:tasks.workunit.client.1.smithi131.stdout:1/303: dwrite dd/f16 [0,4194304] 0 2024-09-13T02:53:53.971 INFO:tasks.workunit.client.1.smithi131.stdout:1/304: creat dd/d26/d2a/d2c/f6b x:0 0 0 2024-09-13T02:53:53.971 INFO:tasks.workunit.client.1.smithi131.stdout:1/305: fdatasync dd/f13 0 2024-09-13T02:53:54.057 INFO:tasks.workunit.client.1.smithi131.stdout:0/390: mkdir d0/de/d1f/d22/d3d/d55/d63/d94 0 2024-09-13T02:53:54.062 INFO:tasks.workunit.client.1.smithi131.stdout:1/306: dwrite dd/d26/d44/f23 [0,4194304] 0 2024-09-13T02:53:54.062 INFO:tasks.workunit.client.1.smithi131.stdout:1/307: dread - dd/d33/d42/f5d zero size 2024-09-13T02:53:54.062 INFO:tasks.workunit.client.1.smithi131.stdout:1/308: write dd/d26/d44/f67 [501174,108144] 0 2024-09-13T02:53:54.062 INFO:tasks.workunit.client.1.smithi131.stdout:1/309: dread - dd/d33/d42/f48 zero size 2024-09-13T02:53:54.080 INFO:tasks.workunit.client.1.smithi131.stdout:1/310: dwrite dd/d26/d44/f25 [0,4194304] 0 2024-09-13T02:53:54.082 INFO:tasks.workunit.client.1.smithi131.stdout:0/391: rmdir d0/de/d1f/d22/d31/d39 39 2024-09-13T02:53:54.086 INFO:tasks.workunit.client.1.smithi131.stdout:0/392: mkdir d0/de/d1f/d22/d3d/d55/d63/d95 0 2024-09-13T02:53:54.086 INFO:tasks.workunit.client.1.smithi131.stdout:0/393: chown d0/d2/d41/f79 2 1 2024-09-13T02:53:54.087 INFO:tasks.workunit.client.1.smithi131.stdout:0/394: creat d0/d2/d41/f96 x:0 0 0 2024-09-13T02:53:54.087 INFO:tasks.workunit.client.1.smithi131.stdout:7/205: sync 2024-09-13T02:53:54.089 INFO:tasks.workunit.client.1.smithi131.stdout:7/206: link d1b/d3b/c39 d1b/c45 0 2024-09-13T02:53:54.090 INFO:tasks.workunit.client.1.smithi131.stdout:5/253: sync 2024-09-13T02:53:54.090 INFO:tasks.workunit.client.1.smithi131.stdout:9/254: sync 2024-09-13T02:53:54.090 INFO:tasks.workunit.client.1.smithi131.stdout:2/276: sync 2024-09-13T02:53:54.090 INFO:tasks.workunit.client.1.smithi131.stdout:2/277: truncate d5/d53/f5b 229874 0 2024-09-13T02:53:54.090 INFO:tasks.workunit.client.1.smithi131.stdout:6/289: sync 2024-09-13T02:53:54.090 INFO:tasks.workunit.client.1.smithi131.stdout:3/284: sync 2024-09-13T02:53:54.090 INFO:tasks.workunit.client.1.smithi131.stdout:3/285: dread - d2/d4/d7/f4d zero size 2024-09-13T02:53:54.090 INFO:tasks.workunit.client.1.smithi131.stdout:6/290: fdatasync d1/d8/d9/db/d15/f3d 0 2024-09-13T02:53:54.090 INFO:tasks.workunit.client.1.smithi131.stdout:6/291: chown d1/d14/f5c 7330 1 2024-09-13T02:53:54.091 INFO:tasks.workunit.client.1.smithi131.stdout:9/255: getdents d0/d3/d14 0 2024-09-13T02:53:54.091 INFO:tasks.workunit.client.1.smithi131.stdout:8/304: sync 2024-09-13T02:53:54.091 INFO:tasks.workunit.client.1.smithi131.stdout:4/294: sync 2024-09-13T02:53:54.091 INFO:tasks.workunit.client.1.smithi131.stdout:4/295: truncate d1/d8/f2f 729050 0 2024-09-13T02:53:54.095 INFO:tasks.workunit.client.1.smithi131.stdout:9/256: mkdir d0/d4d 0 2024-09-13T02:53:54.095 INFO:tasks.workunit.client.1.smithi131.stdout:3/286: unlink d2/d4/d7/c57 0 2024-09-13T02:53:54.095 INFO:tasks.workunit.client.1.smithi131.stdout:5/254: dread d1/d21/f51 [0,4194304] 0 2024-09-13T02:53:54.096 INFO:tasks.workunit.client.1.smithi131.stdout:5/255: read d1/d21/f51 [297628,91026] 0 2024-09-13T02:53:54.096 INFO:tasks.workunit.client.1.smithi131.stdout:7/207: rename d1b/d3b/d31/d38/d43/d44 to d1b/d3b/d46 0 2024-09-13T02:53:54.096 INFO:tasks.workunit.client.1.smithi131.stdout:4/296: mkdir d1/d18/d34/d62 0 2024-09-13T02:53:54.099 INFO:tasks.workunit.client.1.smithi131.stdout:4/297: write d1/d18/f2a [5127230,103452] 0 2024-09-13T02:53:54.099 INFO:tasks.workunit.client.1.smithi131.stdout:1/311: dwrite dd/d33/d42/f5d [0,4194304] 0 2024-09-13T02:53:54.099 INFO:tasks.workunit.client.1.smithi131.stdout:9/257: creat d0/d3/d14/d1a/d2a/f4e x:0 0 0 2024-09-13T02:53:54.099 INFO:tasks.workunit.client.1.smithi131.stdout:9/258: creat d0/d3/d14/d1a/d2a/f4f x:0 0 0 2024-09-13T02:53:54.099 INFO:tasks.workunit.client.1.smithi131.stdout:9/259: creat d0/d3/d14/d17/d32/d39/f50 x:0 0 0 2024-09-13T02:53:54.099 INFO:tasks.workunit.client.1.smithi131.stdout:7/208: creat d1b/d23/f47 x:0 0 0 2024-09-13T02:53:54.099 INFO:tasks.workunit.client.1.smithi131.stdout:8/305: rename db/d1d/d31 to db/d1d/d1f/d5c 0 2024-09-13T02:53:54.101 INFO:tasks.workunit.client.1.smithi131.stdout:5/256: symlink d1/d21/d22/l54 0 2024-09-13T02:53:54.101 INFO:tasks.workunit.client.1.smithi131.stdout:5/257: write d1/f2c [3776647,55548] 0 2024-09-13T02:53:54.101 INFO:tasks.workunit.client.1.smithi131.stdout:1/312: rename dd/d33/d42/f54 to dd/d33/d42/f6c 0 2024-09-13T02:53:54.106 INFO:tasks.workunit.client.1.smithi131.stdout:9/260: symlink d0/d3/d14/d1a/l51 0 2024-09-13T02:53:54.106 INFO:tasks.workunit.client.1.smithi131.stdout:9/261: stat d0/d3/d14/d1a/d2a/f4f 0 2024-09-13T02:53:54.112 INFO:tasks.workunit.client.1.smithi131.stdout:0/395: dwrite d0/de/f4f [0,4194304] 0 2024-09-13T02:53:54.112 INFO:tasks.workunit.client.1.smithi131.stdout:1/313: mkdir dd/d26/d44/d6d 0 2024-09-13T02:53:54.112 INFO:tasks.workunit.client.1.smithi131.stdout:9/262: mknod d0/d4d/c52 0 2024-09-13T02:53:54.112 INFO:tasks.workunit.client.1.smithi131.stdout:7/209: getdents d1b/d3b/d31 0 2024-09-13T02:53:54.113 INFO:tasks.workunit.client.1.smithi131.stdout:9/263: rename d0/d3/d14/d17/d32/d39/f49 to d0/d3/d14/d17/d32/f53 0 2024-09-13T02:53:54.115 INFO:tasks.workunit.client.1.smithi131.stdout:9/264: rmdir d0/d4d 39 2024-09-13T02:53:54.119 INFO:tasks.workunit.client.1.smithi131.stdout:7/210: rename d1b/l1d to d1b/d3b/l48 0 2024-09-13T02:53:54.119 INFO:tasks.workunit.client.1.smithi131.stdout:9/265: symlink d0/d3/d14/l54 0 2024-09-13T02:53:54.123 INFO:tasks.workunit.client.1.smithi131.stdout:9/266: mkdir d0/d4d/d55 0 2024-09-13T02:53:54.123 INFO:tasks.workunit.client.1.smithi131.stdout:9/267: chown d0/d3/l2e 925 1 2024-09-13T02:53:54.128 INFO:tasks.workunit.client.1.smithi131.stdout:9/268: rename d0/f10 to d0/d3/d14/d17/d32/f56 0 2024-09-13T02:53:54.129 INFO:tasks.workunit.client.1.smithi131.stdout:9/269: creat d0/d3/d14/d17/d32/f57 x:0 0 0 2024-09-13T02:53:54.129 INFO:tasks.workunit.client.1.smithi131.stdout:9/270: rename d0 to d0/d3/d14/d1a/d2a/d58 22 2024-09-13T02:53:54.145 INFO:tasks.workunit.client.1.smithi131.stdout:6/292: dwrite d1/d14/f20 [0,4194304] 0 2024-09-13T02:53:54.146 INFO:tasks.workunit.client.1.smithi131.stdout:6/293: creat d1/d14/f5f x:0 0 0 2024-09-13T02:53:54.148 INFO:tasks.workunit.client.1.smithi131.stdout:6/294: rename d1/d14/f34 to d1/d8/d9/db/d15/f60 0 2024-09-13T02:53:54.149 INFO:tasks.workunit.client.1.smithi131.stdout:6/295: mknod d1/d8/d9/db/d15/c61 0 2024-09-13T02:53:54.149 INFO:tasks.workunit.client.1.smithi131.stdout:6/296: fdatasync d1/d14/f5c 0 2024-09-13T02:53:54.149 INFO:tasks.workunit.client.1.smithi131.stdout:6/297: chown d1/f55 1192 1 2024-09-13T02:53:54.150 INFO:tasks.workunit.client.1.smithi131.stdout:6/298: creat d1/d8/f62 x:0 0 0 2024-09-13T02:53:54.151 INFO:tasks.workunit.client.1.smithi131.stdout:6/299: creat d1/d8/d9/db/d40/f63 x:0 0 0 2024-09-13T02:53:54.153 INFO:tasks.workunit.client.1.smithi131.stdout:6/300: creat d1/d8/d9/db/f64 x:0 0 0 2024-09-13T02:53:54.153 INFO:tasks.workunit.client.1.smithi131.stdout:6/301: dread - d1/d8/f2c zero size 2024-09-13T02:53:54.160 INFO:tasks.workunit.client.1.smithi131.stdout:5/258: dwrite d1/d29/d39/d45/f43 [0,4194304] 0 2024-09-13T02:53:54.160 INFO:tasks.workunit.client.1.smithi131.stdout:5/259: creat d1/d21/d22/f55 x:0 0 0 2024-09-13T02:53:54.161 INFO:tasks.workunit.client.1.smithi131.stdout:2/278: dwrite d5/d31/d1d/d32/f38 [0,4194304] 0 2024-09-13T02:53:54.161 INFO:tasks.workunit.client.1.smithi131.stdout:7/211: dwrite d1b/f2e [0,4194304] 0 2024-09-13T02:53:54.162 INFO:tasks.workunit.client.1.smithi131.stdout:0/396: dwrite d0/de/d45/d5a/f6f [0,4194304] 0 2024-09-13T02:53:54.162 INFO:tasks.workunit.client.1.smithi131.stdout:4/298: dwrite d1/f5 [4194304,4194304] 0 2024-09-13T02:53:54.162 INFO:tasks.workunit.client.1.smithi131.stdout:8/306: dwrite db/d1d/d1f/d41/f55 [0,4194304] 0 2024-09-13T02:53:54.163 INFO:tasks.workunit.client.1.smithi131.stdout:5/260: rename d1/d5/l41 to d1/d21/d22/l56 0 2024-09-13T02:53:54.164 INFO:tasks.workunit.client.1.smithi131.stdout:5/261: getdents d1/d2f/d4f 0 2024-09-13T02:53:54.164 INFO:tasks.workunit.client.1.smithi131.stdout:3/287: dwrite d2/d4/f5d [0,4194304] 0 2024-09-13T02:53:54.164 INFO:tasks.workunit.client.1.smithi131.stdout:3/288: write d2/d4/d7/d1d/d24/f58 [281247,102137] 0 2024-09-13T02:53:54.165 INFO:tasks.workunit.client.1.smithi131.stdout:8/307: write db/f15 [587503,131065] 0 2024-09-13T02:53:54.167 INFO:tasks.workunit.client.1.smithi131.stdout:7/212: symlink d1b/d3b/d31/d38/l49 0 2024-09-13T02:53:54.169 INFO:tasks.workunit.client.1.smithi131.stdout:0/397: truncate d0/de/d45/d5a/f5b 3663590 0 2024-09-13T02:53:54.170 INFO:tasks.workunit.client.1.smithi131.stdout:4/299: mknod d1/d18/c63 0 2024-09-13T02:53:54.170 INFO:tasks.workunit.client.1.smithi131.stdout:4/300: creat d1/dc/d19/d29/d33/f64 x:0 0 0 2024-09-13T02:53:54.171 INFO:tasks.workunit.client.1.smithi131.stdout:2/279: dread d5/f9 [0,4194304] 0 2024-09-13T02:53:54.172 INFO:tasks.workunit.client.1.smithi131.stdout:5/262: mkdir d1/d5/d57 0 2024-09-13T02:53:54.172 INFO:tasks.workunit.client.1.smithi131.stdout:5/263: chown d1/d29/d3e 86739049 1 2024-09-13T02:53:54.173 INFO:tasks.workunit.client.1.smithi131.stdout:6/302: dwrite d1/d8/d9/f19 [0,4194304] 0 2024-09-13T02:53:54.173 INFO:tasks.workunit.client.1.smithi131.stdout:6/303: read d1/fe [3391492,28096] 0 2024-09-13T02:53:54.177 INFO:tasks.workunit.client.1.smithi131.stdout:0/398: mknod d0/de/d45/d86/c97 0 2024-09-13T02:53:54.181 INFO:tasks.workunit.client.1.smithi131.stdout:4/301: mkdir d1/d18/d43/d65 0 2024-09-13T02:53:54.181 INFO:tasks.workunit.client.1.smithi131.stdout:2/280: mkdir d5/d31/d21/d57/d5c 0 2024-09-13T02:53:54.181 INFO:tasks.workunit.client.1.smithi131.stdout:3/289: creat d2/d4/d7/d8/d41/f68 x:0 0 0 2024-09-13T02:53:54.181 INFO:tasks.workunit.client.1.smithi131.stdout:3/290: readlink d2/d4/d7/d8/d41/d5c/l50 0 2024-09-13T02:53:54.181 INFO:tasks.workunit.client.1.smithi131.stdout:3/291: chown d2/d4/d1a/f66 0 1 2024-09-13T02:53:54.181 INFO:tasks.workunit.client.1.smithi131.stdout:3/292: dread - d2/d4/d7/f4d zero size 2024-09-13T02:53:54.182 INFO:tasks.workunit.client.1.smithi131.stdout:5/264: link d1/cd d1/c58 0 2024-09-13T02:53:54.182 INFO:tasks.workunit.client.1.smithi131.stdout:0/399: mknod d0/d2/d62/c98 0 2024-09-13T02:53:54.182 INFO:tasks.workunit.client.1.smithi131.stdout:0/400: write d0/d2/d41/f96 [115888,122035] 0 2024-09-13T02:53:54.182 INFO:tasks.workunit.client.1.smithi131.stdout:0/401: write d0/de/d1f/f92 [923828,68619] 0 2024-09-13T02:53:54.182 INFO:tasks.workunit.client.1.smithi131.stdout:4/302: mknod d1/dc/d19/c66 0 2024-09-13T02:53:54.184 INFO:tasks.workunit.client.1.smithi131.stdout:2/281: mknod d5/d31/d21/d57/c5d 0 2024-09-13T02:53:54.184 INFO:tasks.workunit.client.1.smithi131.stdout:3/293: rmdir d2/d4/d7/d8/d67 0 2024-09-13T02:53:54.185 INFO:tasks.workunit.client.1.smithi131.stdout:3/294: fdatasync d2/dc/f65 0 2024-09-13T02:53:54.185 INFO:tasks.workunit.client.1.smithi131.stdout:5/265: creat d1/d2f/d33/f59 x:0 0 0 2024-09-13T02:53:54.185 INFO:tasks.workunit.client.1.smithi131.stdout:5/266: chown d1/d29 1 1 2024-09-13T02:53:54.186 INFO:tasks.workunit.client.1.smithi131.stdout:5/267: truncate d1/d5/f12 4266208 0 2024-09-13T02:53:54.186 INFO:tasks.workunit.client.1.smithi131.stdout:5/268: write d1/d5/f13 [1196836,107175] 0 2024-09-13T02:53:54.189 INFO:tasks.workunit.client.1.smithi131.stdout:4/303: write d1/d18/f2a [977049,120471] 0 2024-09-13T02:53:54.190 INFO:tasks.workunit.client.1.smithi131.stdout:0/402: truncate d0/d2/f2f 6281093 0 2024-09-13T02:53:54.193 INFO:tasks.workunit.client.1.smithi131.stdout:0/403: fdatasync d0/de/d1f/f72 0 2024-09-13T02:53:54.195 INFO:tasks.workunit.client.1.smithi131.stdout:0/404: symlink d0/d2/d62/l99 0 2024-09-13T02:53:54.195 INFO:tasks.workunit.client.1.smithi131.stdout:0/405: stat d0/de/d1f/d22/d31 0 2024-09-13T02:53:54.196 INFO:tasks.workunit.client.1.smithi131.stdout:0/406: truncate d0/de/d1f/f72 3363712 0 2024-09-13T02:53:54.197 INFO:tasks.workunit.client.1.smithi131.stdout:0/407: write d0/de/d1f/d22/d3d/d55/f58 [1540933,98882] 0 2024-09-13T02:53:54.205 INFO:tasks.workunit.client.1.smithi131.stdout:8/308: dwrite db/d2e/f43 [0,4194304] 0 2024-09-13T02:53:54.208 INFO:tasks.workunit.client.1.smithi131.stdout:8/309: creat db/d1d/d1f/d41/f5d x:0 0 0 2024-09-13T02:53:54.208 INFO:tasks.workunit.client.1.smithi131.stdout:7/213: dwrite f1 [0,4194304] 0 2024-09-13T02:53:54.210 INFO:tasks.workunit.client.1.smithi131.stdout:7/214: mkdir d1b/d3b/d31/d38/d4a 0 2024-09-13T02:53:54.210 INFO:tasks.workunit.client.1.smithi131.stdout:5/269: fsync d1/d5/f13 0 2024-09-13T02:53:54.215 INFO:tasks.workunit.client.1.smithi131.stdout:6/304: dwrite d1/d8/f62 [0,4194304] 0 2024-09-13T02:53:54.215 INFO:tasks.workunit.client.1.smithi131.stdout:6/305: write d1/d8/f1a [4705085,51707] 0 2024-09-13T02:53:54.219 INFO:tasks.workunit.client.1.smithi131.stdout:6/306: rmdir d1/d8/d9/db/d15/d26 39 2024-09-13T02:53:54.219 INFO:tasks.workunit.client.1.smithi131.stdout:6/307: read - d1/d8/d9/db/d15/f3c zero size 2024-09-13T02:53:54.219 INFO:tasks.workunit.client.1.smithi131.stdout:6/308: write d1/d8/d9/db/d15/f31 [649083,88522] 0 2024-09-13T02:53:54.225 INFO:tasks.workunit.client.1.smithi131.stdout:8/310: write db/f23 [697311,52371] 0 2024-09-13T02:53:54.225 INFO:tasks.workunit.client.1.smithi131.stdout:7/215: write d1b/f2e [72588,89045] 0 2024-09-13T02:53:54.225 INFO:tasks.workunit.client.1.smithi131.stdout:8/311: dread - db/d2b/d39/f3e zero size 2024-09-13T02:53:54.225 INFO:tasks.workunit.client.1.smithi131.stdout:8/312: fsync db/d1d/d1f/f52 0 2024-09-13T02:53:54.225 INFO:tasks.workunit.client.1.smithi131.stdout:8/313: chown db/f15 269140 1 2024-09-13T02:53:54.225 INFO:tasks.workunit.client.1.smithi131.stdout:8/314: write db/f18 [471568,74552] 0 2024-09-13T02:53:54.227 INFO:tasks.workunit.client.1.smithi131.stdout:8/315: creat db/d1d/f5e x:0 0 0 2024-09-13T02:53:54.227 INFO:tasks.workunit.client.1.smithi131.stdout:8/316: write f8 [4894880,121625] 0 2024-09-13T02:53:54.228 INFO:tasks.workunit.client.1.smithi131.stdout:8/317: mknod db/d2e/c5f 0 2024-09-13T02:53:54.229 INFO:tasks.workunit.client.1.smithi131.stdout:8/318: unlink db/f17 0 2024-09-13T02:53:54.230 INFO:tasks.workunit.client.1.smithi131.stdout:2/282: dwrite d5/d18/f51 [0,4194304] 0 2024-09-13T02:53:54.236 INFO:tasks.workunit.client.1.smithi131.stdout:6/309: write d1/d8/d9/fd [2906707,49194] 0 2024-09-13T02:53:54.237 INFO:tasks.workunit.client.1.smithi131.stdout:3/295: dwrite d2/d4/f5d [0,4194304] 0 2024-09-13T02:53:54.237 INFO:tasks.workunit.client.1.smithi131.stdout:3/296: write d2/d4/d1a/f37 [4414012,80824] 0 2024-09-13T02:53:54.238 INFO:tasks.workunit.client.1.smithi131.stdout:5/270: dwrite d1/d5/f3a [0,4194304] 0 2024-09-13T02:53:54.238 INFO:tasks.workunit.client.1.smithi131.stdout:6/310: write d1/f44 [1387945,69741] 0 2024-09-13T02:53:54.239 INFO:tasks.workunit.client.1.smithi131.stdout:6/311: readlink d1/d8/d9/db/d40/l5a 0 2024-09-13T02:53:54.239 INFO:tasks.workunit.client.1.smithi131.stdout:4/304: dwrite d1/d8/f1d [4194304,4194304] 0 2024-09-13T02:53:54.239 INFO:tasks.workunit.client.1.smithi131.stdout:4/305: write d1/dc/d19/d29/f4a [306464,29640] 0 2024-09-13T02:53:54.240 INFO:tasks.workunit.client.1.smithi131.stdout:4/306: write d1/dc/f2e [677114,119455] 0 2024-09-13T02:53:54.240 INFO:tasks.workunit.client.1.smithi131.stdout:4/307: creat d1/dc/d19/d29/d33/f67 x:0 0 0 2024-09-13T02:53:54.240 INFO:tasks.workunit.client.1.smithi131.stdout:7/216: write f1 [1299665,92083] 0 2024-09-13T02:53:54.240 INFO:tasks.workunit.client.1.smithi131.stdout:7/217: chown d1b 472525 1 2024-09-13T02:53:54.240 INFO:tasks.workunit.client.1.smithi131.stdout:7/218: readlink d1b/d3b/l42 0 2024-09-13T02:53:54.240 INFO:tasks.workunit.client.1.smithi131.stdout:0/408: dwrite d0/de/f59 [0,4194304] 0 2024-09-13T02:53:54.240 INFO:tasks.workunit.client.1.smithi131.stdout:0/409: chown d0/de/d45/d86/f93 3827098 1 2024-09-13T02:53:54.242 INFO:tasks.workunit.client.1.smithi131.stdout:3/297: mkdir d2/d4/d1a/d31/d48/d69 0 2024-09-13T02:53:54.244 INFO:tasks.workunit.client.1.smithi131.stdout:7/219: mkdir d1b/d3b/d46/d4b 0 2024-09-13T02:53:54.245 INFO:tasks.workunit.client.1.smithi131.stdout:4/308: creat d1/d8/f68 x:0 0 0 2024-09-13T02:53:54.245 INFO:tasks.workunit.client.1.smithi131.stdout:4/309: write d1/dc/d19/d29/f4a [699823,55842] 0 2024-09-13T02:53:54.245 INFO:tasks.workunit.client.1.smithi131.stdout:4/310: write d1/dc/f4f [776766,117191] 0 2024-09-13T02:53:54.246 INFO:tasks.workunit.client.1.smithi131.stdout:8/319: dread db/d1d/d34/f4a [0,4194304] 0 2024-09-13T02:53:54.248 INFO:tasks.workunit.client.1.smithi131.stdout:3/298: creat d2/d4/d7/d8/f6a x:0 0 0 2024-09-13T02:53:54.248 INFO:tasks.workunit.client.1.smithi131.stdout:0/410: mkdir d0/de/d1f/d22/d3d/d43/d4b/d9a 0 2024-09-13T02:53:54.249 INFO:tasks.workunit.client.1.smithi131.stdout:5/271: rmdir d1/d21/d22 39 2024-09-13T02:53:54.249 INFO:tasks.workunit.client.1.smithi131.stdout:5/272: write d1/d21/d22/f55 [86088,54170] 0 2024-09-13T02:53:54.250 INFO:tasks.workunit.client.1.smithi131.stdout:5/273: chown d1/d21/c3d 15 1 2024-09-13T02:53:54.250 INFO:tasks.workunit.client.1.smithi131.stdout:5/274: readlink d1/le 0 2024-09-13T02:53:54.250 INFO:tasks.workunit.client.1.smithi131.stdout:5/275: fdatasync d1/f2c 0 2024-09-13T02:53:54.250 INFO:tasks.workunit.client.1.smithi131.stdout:6/312: rmdir d1/d8/d9/db 39 2024-09-13T02:53:54.254 INFO:tasks.workunit.client.1.smithi131.stdout:7/220: rmdir d1b/d3b/d31/d38/d4a 0 2024-09-13T02:53:54.254 INFO:tasks.workunit.client.1.smithi131.stdout:7/221: dread - d1b/d23/f47 zero size 2024-09-13T02:53:54.255 INFO:tasks.workunit.client.1.smithi131.stdout:2/283: dwrite d5/d18/f51 [0,4194304] 0 2024-09-13T02:53:54.255 INFO:tasks.workunit.client.1.smithi131.stdout:2/284: creat d5/d31/d1d/d32/f5e x:0 0 0 2024-09-13T02:53:54.255 INFO:tasks.workunit.client.1.smithi131.stdout:3/299: unlink d2/d4/d7/d1d/d24/f3a 0 2024-09-13T02:53:54.255 INFO:tasks.workunit.client.1.smithi131.stdout:3/300: truncate d2/dc/f2a 5071120 0 2024-09-13T02:53:54.255 INFO:tasks.workunit.client.1.smithi131.stdout:5/276: symlink d1/d21/l5a 0 2024-09-13T02:53:54.257 INFO:tasks.workunit.client.1.smithi131.stdout:6/313: truncate d1/d8/f3e 664845 0 2024-09-13T02:53:54.257 INFO:tasks.workunit.client.1.smithi131.stdout:2/285: symlink d5/d1e/d48/d4c/l5f 0 2024-09-13T02:53:54.257 INFO:tasks.workunit.client.1.smithi131.stdout:2/286: chown d5/d31/d21 28 1 2024-09-13T02:53:54.257 INFO:tasks.workunit.client.1.smithi131.stdout:2/287: readlink d5/d18/l29 0 2024-09-13T02:53:54.259 INFO:tasks.workunit.client.1.smithi131.stdout:4/311: unlink d1/f36 0 2024-09-13T02:53:54.259 INFO:tasks.workunit.client.1.smithi131.stdout:4/312: dread - d1/dc/f31 zero size 2024-09-13T02:53:54.259 INFO:tasks.workunit.client.1.smithi131.stdout:4/313: creat d1/dc/d22/f69 x:0 0 0 2024-09-13T02:53:54.261 INFO:tasks.workunit.client.1.smithi131.stdout:4/314: mknod d1/dc/d19/d29/d33/d3a/c6a 0 2024-09-13T02:53:54.266 INFO:tasks.workunit.client.1.smithi131.stdout:4/315: getdents d1/d18/d34 0 2024-09-13T02:53:54.267 INFO:tasks.workunit.client.1.smithi131.stdout:4/316: fsync d1/d18/f5c 0 2024-09-13T02:53:54.267 INFO:tasks.workunit.client.1.smithi131.stdout:4/317: fdatasync d1/dc/d19/d29/d33/f37 0 2024-09-13T02:53:54.267 INFO:tasks.workunit.client.1.smithi131.stdout:4/318: readlink d1/dc/d22/l46 0 2024-09-13T02:53:54.267 INFO:tasks.workunit.client.1.smithi131.stdout:4/319: write d1/d18/f32 [144746,93021] 0 2024-09-13T02:53:54.267 INFO:tasks.workunit.client.1.smithi131.stdout:4/320: write d1/dc/f31 [401840,113654] 0 2024-09-13T02:53:54.268 INFO:tasks.workunit.client.1.smithi131.stdout:4/321: unlink d1/dc/d19/d29/d33/d3a/f53 0 2024-09-13T02:53:54.271 INFO:tasks.workunit.client.1.smithi131.stdout:4/322: mknod d1/dc/d19/d29/c6b 0 2024-09-13T02:53:54.272 INFO:tasks.workunit.client.1.smithi131.stdout:4/323: rmdir d1/d18/d43 39 2024-09-13T02:53:54.276 INFO:tasks.workunit.client.1.smithi131.stdout:4/324: link d1/f45 d1/d18/d43/f6c 0 2024-09-13T02:53:54.276 INFO:tasks.workunit.client.1.smithi131.stdout:4/325: read d1/d8/f15 [450695,114248] 0 2024-09-13T02:53:54.276 INFO:tasks.workunit.client.1.smithi131.stdout:4/326: chown d1/dc/d19/d29/d33/f64 11711 1 2024-09-13T02:53:54.277 INFO:tasks.workunit.client.1.smithi131.stdout:4/327: read d1/d8/ff [892000,128022] 0 2024-09-13T02:53:54.278 INFO:tasks.workunit.client.1.smithi131.stdout:2/288: dread d5/d18/f1b [0,4194304] 0 2024-09-13T02:53:54.280 INFO:tasks.workunit.client.1.smithi131.stdout:2/289: creat d5/d31/d4e/f60 x:0 0 0 2024-09-13T02:53:54.280 INFO:tasks.workunit.client.1.smithi131.stdout:2/290: write d5/d31/d26/f39 [1229024,104286] 0 2024-09-13T02:53:54.282 INFO:tasks.workunit.client.1.smithi131.stdout:2/291: mknod d5/d31/d1d/d37/c61 0 2024-09-13T02:53:54.284 INFO:tasks.workunit.client.1.smithi131.stdout:8/320: dwrite db/d1d/d1f/d41/f5d [0,4194304] 0 2024-09-13T02:53:54.293 INFO:tasks.workunit.client.1.smithi131.stdout:7/222: dwrite f10 [0,4194304] 0 2024-09-13T02:53:54.294 INFO:tasks.workunit.client.1.smithi131.stdout:0/411: dwrite d0/f90 [0,4194304] 0 2024-09-13T02:53:54.294 INFO:tasks.workunit.client.1.smithi131.stdout:7/223: creat d1b/d23/f4c x:0 0 0 2024-09-13T02:53:54.294 INFO:tasks.workunit.client.1.smithi131.stdout:7/224: truncate d1b/d23/f47 321317 0 2024-09-13T02:53:54.295 INFO:tasks.workunit.client.1.smithi131.stdout:6/314: dwrite d1/d8/d9/f19 [0,4194304] 0 2024-09-13T02:53:54.296 INFO:tasks.workunit.client.1.smithi131.stdout:2/292: dread d5/f2e [0,4194304] 0 2024-09-13T02:53:54.296 INFO:tasks.workunit.client.1.smithi131.stdout:7/225: creat d1b/d3b/d41/f4d x:0 0 0 2024-09-13T02:53:54.297 INFO:tasks.workunit.client.1.smithi131.stdout:3/301: dwrite d2/dc/d39/f3d [0,4194304] 0 2024-09-13T02:53:54.297 INFO:tasks.workunit.client.1.smithi131.stdout:3/302: chown d2/d4/d7/d8/d41/d5c/l50 30 1 2024-09-13T02:53:54.297 INFO:tasks.workunit.client.1.smithi131.stdout:3/303: write d2/d4/f23 [630221,127077] 0 2024-09-13T02:53:54.297 INFO:tasks.workunit.client.1.smithi131.stdout:3/304: write d2/d4/d7/d1d/f2c [895926,8638] 0 2024-09-13T02:53:54.300 INFO:tasks.workunit.client.1.smithi131.stdout:6/315: read d1/f55 [1620777,95807] 0 2024-09-13T02:53:54.302 INFO:tasks.workunit.client.1.smithi131.stdout:2/293: dread d5/d31/d1d/d32/f3d [0,4194304] 0 2024-09-13T02:53:54.308 INFO:tasks.workunit.client.1.smithi131.stdout:8/321: dwrite db/fd [0,4194304] 0 2024-09-13T02:53:54.308 INFO:tasks.workunit.client.1.smithi131.stdout:8/322: chown db/l1b 991 1 2024-09-13T02:53:54.308 INFO:tasks.workunit.client.1.smithi131.stdout:8/323: fdatasync db/d1d/d34/f3f 0 2024-09-13T02:53:54.308 INFO:tasks.workunit.client.1.smithi131.stdout:8/324: creat db/d2b/d39/d56/f60 x:0 0 0 2024-09-13T02:53:54.309 INFO:tasks.workunit.client.1.smithi131.stdout:8/325: write db/d1d/d1f/d41/f55 [3005109,121011] 0 2024-09-13T02:53:54.313 INFO:tasks.workunit.client.1.smithi131.stdout:7/226: dread f4 [0,4194304] 0 2024-09-13T02:53:54.315 INFO:tasks.workunit.client.1.smithi131.stdout:8/326: dread db/d1d/d34/f4a [0,4194304] 0 2024-09-13T02:53:54.315 INFO:tasks.workunit.client.1.smithi131.stdout:8/327: chown db/d1d/d1f/d41/l5b 45911 1 2024-09-13T02:53:54.316 INFO:tasks.workunit.client.1.smithi131.stdout:8/328: chown f6 96078088 1 2024-09-13T02:53:54.318 INFO:tasks.workunit.client.1.smithi131.stdout:3/305: creat d2/d4/d1a/f6b x:0 0 0 2024-09-13T02:53:54.318 INFO:tasks.workunit.client.1.smithi131.stdout:3/306: fdatasync d2/d4/d7/f62 0 2024-09-13T02:53:54.318 INFO:tasks.workunit.client.1.smithi131.stdout:3/307: truncate d2/d4/d1a/f66 174163 0 2024-09-13T02:53:54.320 INFO:tasks.workunit.client.1.smithi131.stdout:6/316: symlink d1/d8/d9/db/d2a/l65 0 2024-09-13T02:53:54.320 INFO:tasks.workunit.client.1.smithi131.stdout:2/294: mknod d5/d31/d4e/c62 0 2024-09-13T02:53:54.320 INFO:tasks.workunit.client.1.smithi131.stdout:2/295: stat d5/d31/d4e 0 2024-09-13T02:53:54.321 INFO:tasks.workunit.client.1.smithi131.stdout:4/328: dwrite d1/d8/d13/f44 [0,4194304] 0 2024-09-13T02:53:54.321 INFO:tasks.workunit.client.1.smithi131.stdout:4/329: chown d1/dc/f3e 36466581 1 2024-09-13T02:53:54.323 INFO:tasks.workunit.client.1.smithi131.stdout:0/412: dwrite d0/de/d1f/d22/d3d/d55/f58 [0,4194304] 0 2024-09-13T02:53:54.324 INFO:tasks.workunit.client.1.smithi131.stdout:7/227: mkdir d1b/d3b/d31/d4e 0 2024-09-13T02:53:54.326 INFO:tasks.workunit.client.1.smithi131.stdout:8/329: mknod db/d1d/d34/c61 0 2024-09-13T02:53:54.326 INFO:tasks.workunit.client.1.smithi131.stdout:8/330: chown db/d2b/d39/d56/f60 123 1 2024-09-13T02:53:54.326 INFO:tasks.workunit.client.1.smithi131.stdout:8/331: chown db/d2b/d39/d56/f57 283267923 1 2024-09-13T02:53:54.327 INFO:tasks.workunit.client.1.smithi131.stdout:3/308: creat d2/dc/d39/d61/f6c x:0 0 0 2024-09-13T02:53:54.327 INFO:tasks.workunit.client.1.smithi131.stdout:3/309: dread - d2/d4/d7/d8/d41/d5c/f35 zero size 2024-09-13T02:53:54.328 INFO:tasks.workunit.client.1.smithi131.stdout:6/317: rename d1/d8/d9/db/d15/d26/l5d to d1/d8/d9/db/d15/l66 0 2024-09-13T02:53:54.329 INFO:tasks.workunit.client.1.smithi131.stdout:2/296: getdents d5/d18/d4b 0 2024-09-13T02:53:54.329 INFO:tasks.workunit.client.1.smithi131.stdout:4/330: symlink d1/d8/d13/l6d 0 2024-09-13T02:53:54.330 INFO:tasks.workunit.client.1.smithi131.stdout:6/318: dread d1/d8/d9/db/d40/f47 [0,4194304] 0 2024-09-13T02:53:54.330 INFO:tasks.workunit.client.1.smithi131.stdout:0/413: mknod d0/de/d45/d78/c9b 0 2024-09-13T02:53:54.330 INFO:tasks.workunit.client.1.smithi131.stdout:0/414: write d0/de/d1f/d22/d31/d39/d40/f7c [34317,80603] 0 2024-09-13T02:53:54.332 INFO:tasks.workunit.client.1.smithi131.stdout:8/332: unlink db/l51 0 2024-09-13T02:53:54.333 INFO:tasks.workunit.client.1.smithi131.stdout:2/297: getdents d5/d1e/d48 0 2024-09-13T02:53:54.334 INFO:tasks.workunit.client.1.smithi131.stdout:8/333: dread db/d2e/f3b [0,4194304] 0 2024-09-13T02:53:54.335 INFO:tasks.workunit.client.1.smithi131.stdout:4/331: link d1/f45 d1/dc/d22/d49/f6e 0 2024-09-13T02:53:54.335 INFO:tasks.workunit.client.1.smithi131.stdout:6/319: mknod d1/d8/d9/db/d40/c67 0 2024-09-13T02:53:54.337 INFO:tasks.workunit.client.1.smithi131.stdout:3/310: rename d2/d4/d2d/c45 to d2/d4/d1a/d31/c6d 0 2024-09-13T02:53:54.338 INFO:tasks.workunit.client.1.smithi131.stdout:0/415: rmdir d0/de/d1f/d22/d31/d39/d40 39 2024-09-13T02:53:54.339 INFO:tasks.workunit.client.1.smithi131.stdout:0/416: write d0/de/d45/d86/f88 [282728,73868] 0 2024-09-13T02:53:54.339 INFO:tasks.workunit.client.1.smithi131.stdout:0/417: write d0/de/d45/d86/f88 [1165575,67040] 0 2024-09-13T02:53:54.340 INFO:tasks.workunit.client.1.smithi131.stdout:4/332: creat d1/d18/d34/f6f x:0 0 0 2024-09-13T02:53:54.341 INFO:tasks.workunit.client.1.smithi131.stdout:0/418: mknod d0/de/d45/d5a/c9c 0 2024-09-13T02:53:54.343 INFO:tasks.workunit.client.1.smithi131.stdout:0/419: creat d0/de/d1f/d22/d3d/d43/f9d x:0 0 0 2024-09-13T02:53:54.345 INFO:tasks.workunit.client.1.smithi131.stdout:0/420: mknod d0/d2/d62/c9e 0 2024-09-13T02:53:54.345 INFO:tasks.workunit.client.1.smithi131.stdout:0/421: truncate d0/de/d45/d5a/f64 258912 0 2024-09-13T02:53:54.346 INFO:tasks.workunit.client.1.smithi131.stdout:8/334: dread db/d1d/d1f/f2d [0,4194304] 0 2024-09-13T02:53:54.348 INFO:tasks.workunit.client.1.smithi131.stdout:0/422: mknod d0/de/d45/c9f 0 2024-09-13T02:53:54.349 INFO:tasks.workunit.client.1.smithi131.stdout:2/298: read d5/d31/ff [2480126,43626] 0 2024-09-13T02:53:54.349 INFO:tasks.workunit.client.1.smithi131.stdout:2/299: creat d5/d31/d26/f63 x:0 0 0 2024-09-13T02:53:54.351 INFO:tasks.workunit.client.1.smithi131.stdout:6/320: write d1/d8/f62 [2419628,56498] 0 2024-09-13T02:53:54.351 INFO:tasks.workunit.client.1.smithi131.stdout:6/321: fdatasync d1/d8/f2c 0 2024-09-13T02:53:54.351 INFO:tasks.workunit.client.1.smithi131.stdout:6/322: chown d1/d8/d9/db/d40/c67 16463884 1 2024-09-13T02:53:54.351 INFO:tasks.workunit.client.1.smithi131.stdout:6/323: truncate d1/f44 2061868 0 2024-09-13T02:53:54.354 INFO:tasks.workunit.client.1.smithi131.stdout:2/300: link d5/d31/d1d/f52 d5/d34/d42/f64 0 2024-09-13T02:53:54.354 INFO:tasks.workunit.client.1.smithi131.stdout:2/301: truncate d5/d31/d1d/f54 471532 0 2024-09-13T02:53:54.354 INFO:tasks.workunit.client.1.smithi131.stdout:7/228: dwrite f10 [0,4194304] 0 2024-09-13T02:53:54.356 INFO:tasks.workunit.client.1.smithi131.stdout:3/311: read d2/d4/d7/d1d/f2e [2427186,101825] 0 2024-09-13T02:53:54.358 INFO:tasks.workunit.client.1.smithi131.stdout:3/312: mkdir d2/d4/d7/d8/d41/d6e 0 2024-09-13T02:53:54.358 INFO:tasks.workunit.client.1.smithi131.stdout:6/324: read d1/d8/d9/db/d40/f47 [481436,45469] 0 2024-09-13T02:53:54.358 INFO:tasks.workunit.client.1.smithi131.stdout:6/325: fdatasync d1/f44 0 2024-09-13T02:53:54.359 INFO:tasks.workunit.client.1.smithi131.stdout:2/302: link d5/d33/d41/f4a d5/d34/f65 0 2024-09-13T02:53:54.359 INFO:tasks.workunit.client.1.smithi131.stdout:2/303: readlink d5/d31/d1d/l1f 0 2024-09-13T02:53:54.359 INFO:tasks.workunit.client.1.smithi131.stdout:3/313: truncate d2/d4/d7/f59 2180875 0 2024-09-13T02:53:54.361 INFO:tasks.workunit.client.1.smithi131.stdout:0/423: write d0/f90 [2416196,49807] 0 2024-09-13T02:53:54.361 INFO:tasks.workunit.client.1.smithi131.stdout:0/424: readlink d0/l27 0 2024-09-13T02:53:54.363 INFO:tasks.workunit.client.1.smithi131.stdout:6/326: creat d1/d8/d9/db/f68 x:0 0 0 2024-09-13T02:53:54.363 INFO:tasks.workunit.client.1.smithi131.stdout:2/304: mkdir d5/d33/d66 0 2024-09-13T02:53:54.364 INFO:tasks.workunit.client.1.smithi131.stdout:0/425: symlink d0/de/d1f/d22/d31/d39/d40/la0 0 2024-09-13T02:53:54.366 INFO:tasks.workunit.client.1.smithi131.stdout:0/426: mknod d0/de/ca1 0 2024-09-13T02:53:54.367 INFO:tasks.workunit.client.1.smithi131.stdout:0/427: mkdir d0/de/d1f/d22/d31/d39/d40/d68/da2 0 2024-09-13T02:53:54.369 INFO:tasks.workunit.client.1.smithi131.stdout:0/428: rename d0/de/d1f/d22/d31/d39/d40/d68/da2 to d0/de/da3 0 2024-09-13T02:53:54.370 INFO:tasks.workunit.client.1.smithi131.stdout:0/429: truncate d0/de/d1f/d22/d3d/d55/f58 4878630 0 2024-09-13T02:53:54.370 INFO:tasks.workunit.client.1.smithi131.stdout:0/430: readlink d0/d2/l15 0 2024-09-13T02:53:54.370 INFO:tasks.workunit.client.1.smithi131.stdout:0/431: mkdir d0/de/d45/d86/da4 0 2024-09-13T02:53:54.370 INFO:tasks.workunit.client.1.smithi131.stdout:0/432: write d0/de/d1f/f92 [1642199,97223] 0 2024-09-13T02:53:54.370 INFO:tasks.workunit.client.1.smithi131.stdout:0/433: write d0/d2/f17 [5183849,92559] 0 2024-09-13T02:53:54.371 INFO:tasks.workunit.client.1.smithi131.stdout:0/434: unlink d0/de/f7d 0 2024-09-13T02:53:54.376 INFO:tasks.workunit.client.1.smithi131.stdout:6/327: dread d1/d8/f2d [0,4194304] 0 2024-09-13T02:53:54.377 INFO:tasks.workunit.client.1.smithi131.stdout:4/333: dwrite d1/dc/d19/d29/f4a [0,4194304] 0 2024-09-13T02:53:54.377 INFO:tasks.workunit.client.1.smithi131.stdout:4/334: creat d1/dc/d22/d49/f70 x:0 0 0 2024-09-13T02:53:54.377 INFO:tasks.workunit.client.1.smithi131.stdout:8/335: dwrite db/d2b/d39/d56/f60 [0,4194304] 0 2024-09-13T02:53:54.378 INFO:tasks.workunit.client.1.smithi131.stdout:8/336: creat db/d1d/d1f/d41/f62 x:0 0 0 2024-09-13T02:53:54.381 INFO:tasks.workunit.client.1.smithi131.stdout:4/335: symlink d1/dc/d19/d29/l71 0 2024-09-13T02:53:54.382 INFO:tasks.workunit.client.1.smithi131.stdout:7/229: dwrite d1b/d23/f47 [0,4194304] 0 2024-09-13T02:53:54.386 INFO:tasks.workunit.client.1.smithi131.stdout:8/337: mknod db/c63 0 2024-09-13T02:53:54.386 INFO:tasks.workunit.client.1.smithi131.stdout:8/338: chown db/d2e/d40/f53 21293 1 2024-09-13T02:53:54.387 INFO:tasks.workunit.client.1.smithi131.stdout:6/328: write d1/d8/d9/db/d15/d26/f3a [2597314,4152] 0 2024-09-13T02:53:54.387 INFO:tasks.workunit.client.1.smithi131.stdout:6/329: read - d1/d8/d9/db/d40/f63 zero size 2024-09-13T02:53:54.387 INFO:tasks.workunit.client.1.smithi131.stdout:6/330: fsync d1/d8/d9/db/f64 0 2024-09-13T02:53:54.389 INFO:tasks.workunit.client.1.smithi131.stdout:4/336: getdents d1/d18 0 2024-09-13T02:53:54.390 INFO:tasks.workunit.client.1.smithi131.stdout:4/337: chown d1/d8/d13 63334 1 2024-09-13T02:53:54.390 INFO:tasks.workunit.client.1.smithi131.stdout:4/338: stat d1/dc/d22/d49/f54 0 2024-09-13T02:53:54.390 INFO:tasks.workunit.client.1.smithi131.stdout:2/305: dwrite d5/d31/d21/f2b [0,4194304] 0 2024-09-13T02:53:54.390 INFO:tasks.workunit.client.1.smithi131.stdout:2/306: chown d5/d31/c1c 931362 1 2024-09-13T02:53:54.394 INFO:tasks.workunit.client.1.smithi131.stdout:6/331: rename d1/d8/f3e to d1/d8/d9/db/d15/f69 0 2024-09-13T02:53:54.395 INFO:tasks.workunit.client.1.smithi131.stdout:7/230: dread d1b/f24 [0,4194304] 0 2024-09-13T02:53:54.395 INFO:tasks.workunit.client.1.smithi131.stdout:0/435: getdents d0/de/d1f/d22/d31/d39/d40/d68 0 2024-09-13T02:53:54.397 INFO:tasks.workunit.client.1.smithi131.stdout:8/339: getdents db/d1d/d34 0 2024-09-13T02:53:54.399 INFO:tasks.workunit.client.1.smithi131.stdout:6/332: chown d1/d8/d9/db/d15/d26/d1c 2 1 2024-09-13T02:53:54.400 INFO:tasks.workunit.client.1.smithi131.stdout:7/231: truncate f13 521553 0 2024-09-13T02:53:54.401 INFO:tasks.workunit.client.1.smithi131.stdout:4/339: getdents d1/dc 0 2024-09-13T02:53:54.403 INFO:tasks.workunit.client.1.smithi131.stdout:0/436: mkdir d0/de/d1f/d22/d3d/d55/d63/d94/da5 0 2024-09-13T02:53:54.403 INFO:tasks.workunit.client.1.smithi131.stdout:0/437: write d0/de/d1f/d22/d3d/d43/d4b/f51 [308871,114633] 0 2024-09-13T02:53:54.404 INFO:tasks.workunit.client.1.smithi131.stdout:8/340: read db/f19 [848846,114760] 0 2024-09-13T02:53:54.404 INFO:tasks.workunit.client.1.smithi131.stdout:8/341: dread - db/d2b/d39/f3e zero size 2024-09-13T02:53:54.404 INFO:tasks.workunit.client.1.smithi131.stdout:6/333: dread d1/d8/d9/db/d40/f47 [0,4194304] 0 2024-09-13T02:53:54.404 INFO:tasks.workunit.client.1.smithi131.stdout:4/340: link d1/dc/d19/d29/l3c d1/d18/d34/d4e/l72 0 2024-09-13T02:53:54.404 INFO:tasks.workunit.client.1.smithi131.stdout:4/341: write d1/dc/d22/d49/f6e [108659,45320] 0 2024-09-13T02:53:54.405 INFO:tasks.workunit.client.1.smithi131.stdout:0/438: rmdir d0/de/d45/d86/da4 0 2024-09-13T02:53:54.409 INFO:tasks.workunit.client.1.smithi131.stdout:6/334: symlink d1/d8/d9/db/d2a/d3b/l6a 0 2024-09-13T02:53:54.409 INFO:tasks.workunit.client.1.smithi131.stdout:6/335: write d1/d8/d9/db/d15/f60 [914907,69255] 0 2024-09-13T02:53:54.409 INFO:tasks.workunit.client.1.smithi131.stdout:6/336: chown d1/d8/d9/f19 100 1 2024-09-13T02:53:54.409 INFO:tasks.workunit.client.1.smithi131.stdout:4/342: mkdir d1/dc/d22/d73 0 2024-09-13T02:53:54.409 INFO:tasks.workunit.client.1.smithi131.stdout:7/232: rmdir d1b/d3b/d31/d38/d43 0 2024-09-13T02:53:54.409 INFO:tasks.workunit.client.1.smithi131.stdout:7/233: dread - d1b/d23/f4c zero size 2024-09-13T02:53:54.409 INFO:tasks.workunit.client.1.smithi131.stdout:9/271: sync 2024-09-13T02:53:54.411 INFO:tasks.workunit.client.1.smithi131.stdout:6/337: creat d1/d8/d9/db/d2a/f6b x:0 0 0 2024-09-13T02:53:54.412 INFO:tasks.workunit.client.1.smithi131.stdout:1/314: sync 2024-09-13T02:53:54.412 INFO:tasks.workunit.client.1.smithi131.stdout:7/234: mknod d1b/d3b/c4f 0 2024-09-13T02:53:54.412 INFO:tasks.workunit.client.1.smithi131.stdout:7/235: fdatasync d1b/f2c 0 2024-09-13T02:53:54.412 INFO:tasks.workunit.client.1.smithi131.stdout:7/236: fdatasync d1b/d3b/f3e 0 2024-09-13T02:53:54.414 INFO:tasks.workunit.client.1.smithi131.stdout:7/237: write d1b/f2c [600803,38744] 0 2024-09-13T02:53:54.414 INFO:tasks.workunit.client.1.smithi131.stdout:7/238: readlink l1a 0 2024-09-13T02:53:54.418 INFO:tasks.workunit.client.1.smithi131.stdout:1/315: symlink dd/d33/d42/d47/l6e 0 2024-09-13T02:53:54.419 INFO:tasks.workunit.client.1.smithi131.stdout:6/338: rename d1/d8/d9/db/d15/d26/c35 to d1/d8/d9/db/d2a/c6c 0 2024-09-13T02:53:54.419 INFO:tasks.workunit.client.1.smithi131.stdout:6/339: symlink d1/d8/d9/db/l6d 0 2024-09-13T02:53:54.419 INFO:tasks.workunit.client.1.smithi131.stdout:6/340: readlink d1/l12 0 2024-09-13T02:53:54.419 INFO:tasks.workunit.client.1.smithi131.stdout:6/341: creat d1/f6e x:0 0 0 2024-09-13T02:53:54.426 INFO:tasks.workunit.client.1.smithi131.stdout:6/342: creat d1/d8/d9/f6f x:0 0 0 2024-09-13T02:53:54.426 INFO:tasks.workunit.client.1.smithi131.stdout:6/343: chown d1/d8/d9/db/ff 138547 1 2024-09-13T02:53:54.426 INFO:tasks.workunit.client.1.smithi131.stdout:0/439: dread d0/de/d1f/d22/d3d/d55/f58 [0,4194304] 0 2024-09-13T02:53:54.426 INFO:tasks.workunit.client.1.smithi131.stdout:0/440: stat d0/de/da3 0 2024-09-13T02:53:54.435 INFO:tasks.workunit.client.1.smithi131.stdout:0/441: dread d0/de/d1f/d22/d3d/d55/f58 [0,4194304] 0 2024-09-13T02:53:54.437 INFO:tasks.workunit.client.1.smithi131.stdout:0/442: mknod d0/de/d1f/d22/d31/d39/d40/d68/ca6 0 2024-09-13T02:53:54.439 INFO:tasks.workunit.client.1.smithi131.stdout:0/443: read d0/de/d1f/f92 [50488,103235] 0 2024-09-13T02:53:54.439 INFO:tasks.workunit.client.1.smithi131.stdout:0/444: write d0/de/d45/d5a/f7f [481881,110915] 0 2024-09-13T02:53:54.440 INFO:tasks.workunit.client.1.smithi131.stdout:0/445: mknod d0/de/da3/ca7 0 2024-09-13T02:53:54.440 INFO:tasks.workunit.client.1.smithi131.stdout:0/446: fsync d0/d2/f2f 0 2024-09-13T02:53:54.440 INFO:tasks.workunit.client.1.smithi131.stdout:2/307: dwrite d5/d31/d1d/d32/f5e [0,4194304] 0 2024-09-13T02:53:54.443 INFO:tasks.workunit.client.1.smithi131.stdout:2/308: mkdir d5/d31/d1d/d32/d3b/d67 0 2024-09-13T02:53:54.443 INFO:tasks.workunit.client.1.smithi131.stdout:0/447: rmdir d0/d2 39 2024-09-13T02:53:54.444 INFO:tasks.workunit.client.1.smithi131.stdout:2/309: mkdir d5/d18/d68 0 2024-09-13T02:53:54.453 INFO:tasks.workunit.client.1.smithi131.stdout:2/310: dread d5/d31/d26/f39 [0,4194304] 0 2024-09-13T02:53:54.455 INFO:tasks.workunit.client.1.smithi131.stdout:8/342: dwrite db/f18 [0,4194304] 0 2024-09-13T02:53:54.456 INFO:tasks.workunit.client.1.smithi131.stdout:8/343: chown db/l22 174 1 2024-09-13T02:53:54.456 INFO:tasks.workunit.client.1.smithi131.stdout:8/344: readlink db/d2b/d39/l3d 0 2024-09-13T02:53:54.456 INFO:tasks.workunit.client.1.smithi131.stdout:7/239: dwrite d1b/d3b/d41/f4d [0,4194304] 0 2024-09-13T02:53:54.457 INFO:tasks.workunit.client.1.smithi131.stdout:4/343: dwrite d1/d8/f15 [0,4194304] 0 2024-09-13T02:53:54.457 INFO:tasks.workunit.client.0.smithi089.stdout:8/12: sync 2024-09-13T02:53:54.458 INFO:tasks.workunit.client.1.smithi131.stdout:6/344: dwrite d1/d14/f20 [0,4194304] 0 2024-09-13T02:53:54.458 INFO:tasks.workunit.client.1.smithi131.stdout:1/316: dwrite dd/f16 [0,4194304] 0 2024-09-13T02:53:54.458 INFO:tasks.workunit.client.1.smithi131.stdout:9/272: dwrite d0/d3/d14/d17/d32/d39/f4a [0,4194304] 0 2024-09-13T02:53:54.459 INFO:tasks.workunit.client.1.smithi131.stdout:7/240: creat d1b/d3b/d31/d38/f50 x:0 0 0 2024-09-13T02:53:54.468 INFO:tasks.workunit.client.1.smithi131.stdout:6/345: symlink d1/d8/d9/db/d15/d26/d1c/d4e/l70 0 2024-09-13T02:53:54.468 INFO:tasks.workunit.client.1.smithi131.stdout:6/346: dread - d1/d8/d9/db/f68 zero size 2024-09-13T02:53:54.469 INFO:tasks.workunit.client.1.smithi131.stdout:1/317: write f4 [539279,122961] 0 2024-09-13T02:53:54.472 INFO:tasks.workunit.client.1.smithi131.stdout:7/241: mkdir d1b/d3b/d51 0 2024-09-13T02:53:54.472 INFO:tasks.workunit.client.1.smithi131.stdout:7/242: readlink l1a 0 2024-09-13T02:53:54.473 INFO:tasks.workunit.client.1.smithi131.stdout:6/347: creat d1/d8/d9/db/d2a/d3b/f71 x:0 0 0 2024-09-13T02:53:54.473 INFO:tasks.workunit.client.1.smithi131.stdout:6/348: read - d1/d8/d9/db/d2a/d3b/f71 zero size 2024-09-13T02:53:54.473 INFO:tasks.workunit.client.1.smithi131.stdout:4/344: read d1/d8/f1d [1513492,58739] 0 2024-09-13T02:53:54.475 INFO:tasks.workunit.client.1.smithi131.stdout:6/349: creat d1/d8/d9/db/d15/d26/d1c/d4e/f72 x:0 0 0 2024-09-13T02:53:54.476 INFO:tasks.workunit.client.1.smithi131.stdout:4/345: creat d1/dc/d19/d29/d33/d3a/f74 x:0 0 0 2024-09-13T02:53:54.476 INFO:tasks.workunit.client.1.smithi131.stdout:4/346: dread - d1/d18/f5c zero size 2024-09-13T02:53:54.477 INFO:tasks.workunit.client.1.smithi131.stdout:4/347: creat d1/d18/f75 x:0 0 0 2024-09-13T02:53:54.478 INFO:tasks.workunit.client.1.smithi131.stdout:4/348: rmdir d1/dc 39 2024-09-13T02:53:54.481 INFO:tasks.workunit.client.1.smithi131.stdout:0/448: dwrite d0/de/d1f/d22/d31/d39/d40/f7c [0,4194304] 0 2024-09-13T02:53:54.481 INFO:tasks.workunit.client.1.smithi131.stdout:0/449: truncate d0/d2/d62/f8f 862727 0 2024-09-13T02:53:54.481 INFO:tasks.workunit.client.1.smithi131.stdout:0/450: chown d0/de/d45/c83 43309732 1 2024-09-13T02:53:54.482 INFO:tasks.workunit.client.1.smithi131.stdout:0/451: mkdir d0/de/d1f/d22/d31/d39/da8 0 2024-09-13T02:53:54.483 INFO:tasks.workunit.client.1.smithi131.stdout:0/452: dread - d0/d2/d41/f50 zero size 2024-09-13T02:53:54.483 INFO:tasks.workunit.client.1.smithi131.stdout:1/318: write dd/f13 [3946849,74879] 0 2024-09-13T02:53:54.484 INFO:tasks.workunit.client.1.smithi131.stdout:0/453: symlink d0/de/d1f/d22/d3d/d80/la9 0 2024-09-13T02:53:54.485 INFO:tasks.workunit.client.1.smithi131.stdout:0/454: fsync d0/de/d1f/d22/d3d/d43/f5f 0 2024-09-13T02:53:54.485 INFO:tasks.workunit.client.1.smithi131.stdout:1/319: mkdir dd/d33/d42/d6f 0 2024-09-13T02:53:54.487 INFO:tasks.workunit.client.1.smithi131.stdout:0/455: link d0/de/d1f/d22/d3d/d55/d63/c6e d0/de/d1f/d22/d31/caa 0 2024-09-13T02:53:54.487 INFO:tasks.workunit.client.1.smithi131.stdout:0/456: chown d0/c5 918963 1 2024-09-13T02:53:54.487 INFO:tasks.workunit.client.1.smithi131.stdout:0/457: chown d0/l1d 120 1 2024-09-13T02:53:54.488 INFO:tasks.workunit.client.1.smithi131.stdout:1/320: creat dd/d51/f70 x:0 0 0 2024-09-13T02:53:54.489 INFO:tasks.workunit.client.1.smithi131.stdout:0/458: mknod d0/de/d1f/d22/d3d/d55/cab 0 2024-09-13T02:53:54.489 INFO:tasks.workunit.client.1.smithi131.stdout:7/243: dread d1b/d3b/d41/f4d [0,4194304] 0 2024-09-13T02:53:54.490 INFO:tasks.workunit.client.1.smithi131.stdout:1/321: creat dd/d33/d42/d6f/f71 x:0 0 0 2024-09-13T02:53:54.492 INFO:tasks.workunit.client.1.smithi131.stdout:8/345: dwrite db/d1d/d1f/d41/f5d [4194304,4194304] 0 2024-09-13T02:53:54.492 INFO:tasks.workunit.client.1.smithi131.stdout:7/244: unlink lc 0 2024-09-13T02:53:54.492 INFO:tasks.workunit.client.1.smithi131.stdout:7/245: stat d1b/l32 0 2024-09-13T02:53:54.492 INFO:tasks.workunit.client.1.smithi131.stdout:1/322: mknod dd/d26/d44/c72 0 2024-09-13T02:53:54.492 INFO:tasks.workunit.client.1.smithi131.stdout:1/323: readlink dd/d26/d2a/d2c/l2e 0 2024-09-13T02:53:54.494 INFO:tasks.workunit.client.1.smithi131.stdout:7/246: rename d1b/d3b/l42 to d1b/l52 0 2024-09-13T02:53:54.494 INFO:tasks.workunit.client.1.smithi131.stdout:7/247: fdatasync f1 0 2024-09-13T02:53:54.504 INFO:tasks.workunit.client.0.smithi089.stdout:8/13: dwrite f0 [0,4194304] 0 2024-09-13T02:53:54.506 INFO:tasks.workunit.client.1.smithi131.stdout:2/311: dwrite d5/d31/d26/f59 [0,4194304] 0 2024-09-13T02:53:54.506 INFO:tasks.workunit.client.1.smithi131.stdout:7/248: dread d1b/f2c [0,4194304] 0 2024-09-13T02:53:54.506 INFO:tasks.workunit.client.1.smithi131.stdout:7/249: write d1b/d23/f4c [414403,63849] 0 2024-09-13T02:53:54.506 INFO:tasks.workunit.client.1.smithi131.stdout:7/250: write f1 [2030684,62487] 0 2024-09-13T02:53:54.507 INFO:tasks.workunit.client.0.smithi089.stdout:8/14: rename c2 to c4 0 2024-09-13T02:53:54.508 INFO:tasks.workunit.client.1.smithi131.stdout:7/251: creat d1b/d3b/d31/d4e/f53 x:0 0 0 2024-09-13T02:53:54.509 INFO:tasks.workunit.client.1.smithi131.stdout:7/252: mkdir d1b/d23/d54 0 2024-09-13T02:53:54.509 INFO:tasks.workunit.client.1.smithi131.stdout:7/253: dread - d1b/d3b/f3e zero size 2024-09-13T02:53:54.514 INFO:tasks.workunit.client.1.smithi131.stdout:9/273: dwrite d0/f33 [4194304,4194304] 0 2024-09-13T02:53:54.515 INFO:tasks.workunit.client.1.smithi131.stdout:9/274: write d0/f15 [2003149,91850] 0 2024-09-13T02:53:54.515 INFO:tasks.workunit.client.1.smithi131.stdout:9/275: fsync d0/d3/d14/d1a/d2a/f4f 0 2024-09-13T02:53:54.518 INFO:tasks.workunit.client.1.smithi131.stdout:9/276: link d0/d3/d14/d17/f31 d0/d3/d14/d17/d32/f59 0 2024-09-13T02:53:54.518 INFO:tasks.workunit.client.1.smithi131.stdout:9/277: dread - d0/d3/d14/d17/d32/f57 zero size 2024-09-13T02:53:54.520 INFO:tasks.workunit.client.0.smithi089.stdout:8/15: dread f0 [0,4194304] 0 2024-09-13T02:53:54.520 INFO:tasks.workunit.client.0.smithi089.stdout:8/16: chown c4 20783826 1 2024-09-13T02:53:54.520 INFO:tasks.workunit.client.0.smithi089.stdout:8/17: creat f5 x:0 0 0 2024-09-13T02:53:54.521 INFO:tasks.workunit.client.1.smithi131.stdout:2/312: dread d5/d31/d21/f2b [0,4194304] 0 2024-09-13T02:53:54.522 INFO:tasks.workunit.client.1.smithi131.stdout:4/349: dwrite d1/d18/d43/f47 [0,4194304] 0 2024-09-13T02:53:54.522 INFO:tasks.workunit.client.0.smithi089.stdout:8/18: symlink l6 0 2024-09-13T02:53:54.523 INFO:tasks.workunit.client.1.smithi131.stdout:2/313: mknod d5/d31/d1d/d32/d3b/d67/c69 0 2024-09-13T02:53:54.523 INFO:tasks.workunit.client.1.smithi131.stdout:2/314: fdatasync d5/d31/d21/f24 0 2024-09-13T02:53:54.524 INFO:tasks.workunit.client.1.smithi131.stdout:2/315: mknod d5/d33/d66/c6a 0 2024-09-13T02:53:54.525 INFO:tasks.workunit.client.1.smithi131.stdout:2/316: link d5/d31/d21/d57/c5d d5/d18/c6b 0 2024-09-13T02:53:54.531 INFO:tasks.workunit.client.1.smithi131.stdout:0/459: dwrite d0/de/d1f/d22/d31/d39/d67/f69 [0,4194304] 0 2024-09-13T02:53:54.531 INFO:tasks.workunit.client.1.smithi131.stdout:0/460: fsync d0/de/d1f/d22/d3d/d43/f9d 0 2024-09-13T02:53:54.531 INFO:tasks.workunit.client.1.smithi131.stdout:7/254: dwrite d1b/f24 [0,4194304] 0 2024-09-13T02:53:54.531 INFO:tasks.workunit.client.1.smithi131.stdout:1/324: dwrite dd/d26/d2a/f61 [0,4194304] 0 2024-09-13T02:53:54.531 INFO:tasks.workunit.client.1.smithi131.stdout:1/325: readlink dd/d26/d2a/d2c/l2e 0 2024-09-13T02:53:54.532 INFO:tasks.workunit.client.1.smithi131.stdout:9/278: dread d0/f33 [0,4194304] 0 2024-09-13T02:53:54.533 INFO:tasks.workunit.client.1.smithi131.stdout:4/350: dread d1/dc/f4f [0,4194304] 0 2024-09-13T02:53:54.533 INFO:tasks.workunit.client.1.smithi131.stdout:0/461: unlink d0/d2/d41/f96 0 2024-09-13T02:53:54.533 INFO:tasks.workunit.client.1.smithi131.stdout:4/351: creat d1/d18/f76 x:0 0 0 2024-09-13T02:53:54.535 INFO:tasks.workunit.client.0.smithi089.stdout:8/19: getdents . 0 2024-09-13T02:53:54.536 INFO:tasks.workunit.client.0.smithi089.stdout:8/20: chown f5 219284017 1 2024-09-13T02:53:54.536 INFO:tasks.workunit.client.1.smithi131.stdout:6/350: dwrite d1/d8/d9/db/ff [4194304,4194304] 0 2024-09-13T02:53:54.536 INFO:tasks.workunit.client.1.smithi131.stdout:2/317: dread d5/fe [0,4194304] 0 2024-09-13T02:53:54.536 INFO:tasks.workunit.client.1.smithi131.stdout:6/351: fdatasync d1/d8/f2c 0 2024-09-13T02:53:54.536 INFO:tasks.workunit.client.1.smithi131.stdout:2/318: write d5/d31/ff [2992384,89898] 0 2024-09-13T02:53:54.536 INFO:tasks.workunit.client.1.smithi131.stdout:7/255: creat d1b/d3b/f55 x:0 0 0 2024-09-13T02:53:54.539 INFO:tasks.workunit.client.1.smithi131.stdout:1/326: creat dd/d51/d5a/f73 x:0 0 0 2024-09-13T02:53:54.539 INFO:tasks.workunit.client.1.smithi131.stdout:1/327: chown dd/d26/d2a/d2c/c37 483924779 1 2024-09-13T02:53:54.542 INFO:tasks.workunit.client.1.smithi131.stdout:0/462: rename d0/de/d1f/d22/d3d/d55/d63/c6e to d0/d2/cac 0 2024-09-13T02:53:54.542 INFO:tasks.workunit.client.1.smithi131.stdout:9/279: write d0/d3/d14/d17/d32/d39/f4a [418039,90025] 0 2024-09-13T02:53:54.546 INFO:tasks.workunit.client.1.smithi131.stdout:0/463: dread d0/de/d45/d5a/f7f [0,4194304] 0 2024-09-13T02:53:54.546 INFO:tasks.workunit.client.1.smithi131.stdout:0/464: write d0/d2/d41/f4a [555528,125667] 0 2024-09-13T02:53:54.547 INFO:tasks.workunit.client.1.smithi131.stdout:7/256: write f4 [519914,14611] 0 2024-09-13T02:53:54.549 INFO:tasks.workunit.client.1.smithi131.stdout:4/352: unlink d1/dc/d19/d29/d33/d3a/l5d 0 2024-09-13T02:53:54.551 INFO:tasks.workunit.client.0.smithi089.stdout:8/21: dwrite f5 [0,4194304] 0 2024-09-13T02:53:54.553 INFO:tasks.workunit.client.1.smithi131.stdout:6/352: rmdir d1/d8/d9/db/d15 39 2024-09-13T02:53:54.553 INFO:tasks.workunit.client.1.smithi131.stdout:6/353: chown d1/d8/d9/db/f64 8116 1 2024-09-13T02:53:54.553 INFO:tasks.workunit.client.1.smithi131.stdout:6/354: fsync d1/d8/d9/db/d15/f31 0 2024-09-13T02:53:54.553 INFO:tasks.workunit.client.1.smithi131.stdout:6/355: truncate d1/f55 4508010 0 2024-09-13T02:53:54.553 INFO:tasks.workunit.client.1.smithi131.stdout:6/356: creat d1/d8/d9/db/d15/d26/d1c/d4e/f73 x:0 0 0 2024-09-13T02:53:54.553 INFO:tasks.workunit.client.1.smithi131.stdout:6/357: fsync d1/f55 0 2024-09-13T02:53:54.553 INFO:tasks.workunit.client.1.smithi131.stdout:6/358: chown d1/d8/d9/db/d40 28321164 1 2024-09-13T02:53:54.553 INFO:tasks.workunit.client.1.smithi131.stdout:6/359: write d1/f7 [1890792,77891] 0 2024-09-13T02:53:54.553 INFO:tasks.workunit.client.1.smithi131.stdout:6/360: write d1/d8/d9/db/d40/f47 [993904,95891] 0 2024-09-13T02:53:54.554 INFO:tasks.workunit.client.0.smithi089.stdout:8/22: creat f7 x:0 0 0 2024-09-13T02:53:54.554 INFO:tasks.workunit.client.1.smithi131.stdout:2/319: creat d5/d33/d66/f6c x:0 0 0 2024-09-13T02:53:54.557 INFO:tasks.workunit.client.1.smithi131.stdout:9/280: rmdir d0/d4d 39 2024-09-13T02:53:54.559 INFO:tasks.workunit.client.1.smithi131.stdout:7/257: mknod d1b/d3b/d31/c56 0 2024-09-13T02:53:54.559 INFO:tasks.workunit.client.1.smithi131.stdout:4/353: getdents d1/dc/d19 0 2024-09-13T02:53:54.564 INFO:tasks.workunit.client.1.smithi131.stdout:2/320: symlink d5/d1e/l6d 0 2024-09-13T02:53:54.572 INFO:tasks.workunit.client.1.smithi131.stdout:1/328: rmdir dd 39 2024-09-13T02:53:54.574 INFO:tasks.workunit.client.1.smithi131.stdout:7/258: mkdir d1b/d3b/d46/d4b/d57 0 2024-09-13T02:53:54.576 INFO:tasks.workunit.client.1.smithi131.stdout:4/354: unlink d1/d18/d34/d4e/l72 0 2024-09-13T02:53:54.577 INFO:tasks.workunit.client.1.smithi131.stdout:2/321: mkdir d5/d6e 0 2024-09-13T02:53:54.577 INFO:tasks.workunit.client.1.smithi131.stdout:2/322: fdatasync d5/d53/f5b 0 2024-09-13T02:53:54.577 INFO:tasks.workunit.client.1.smithi131.stdout:2/323: creat d5/d31/d1d/d32/f6f x:0 0 0 2024-09-13T02:53:54.578 INFO:tasks.workunit.client.1.smithi131.stdout:1/329: symlink dd/l74 0 2024-09-13T02:53:54.579 INFO:tasks.workunit.client.1.smithi131.stdout:6/361: dwrite d1/d8/d9/db/d15/d26/d1c/d4e/f72 [0,4194304] 0 2024-09-13T02:53:54.579 INFO:tasks.workunit.client.1.smithi131.stdout:6/362: truncate d1/d8/d9/db/d2a/f6b 998046 0 2024-09-13T02:53:54.581 INFO:tasks.workunit.client.1.smithi131.stdout:7/259: unlink f1 0 2024-09-13T02:53:54.583 INFO:tasks.workunit.client.1.smithi131.stdout:7/260: write d1b/f2c [532577,20726] 0 2024-09-13T02:53:54.583 INFO:tasks.workunit.client.0.smithi089.stdout:8/23: dwrite f5 [0,4194304] 0 2024-09-13T02:53:54.584 INFO:tasks.workunit.client.1.smithi131.stdout:9/281: dwrite d0/d3/d14/d17/d32/d39/f50 [0,4194304] 0 2024-09-13T02:53:54.585 INFO:tasks.workunit.client.1.smithi131.stdout:9/282: dread - d0/d3/d14/d17/d32/f53 zero size 2024-09-13T02:53:54.585 INFO:tasks.workunit.client.0.smithi089.stdout:8/24: mkdir d8 0 2024-09-13T02:53:54.586 INFO:tasks.workunit.client.1.smithi131.stdout:2/324: rename d5/d18/c6b to d5/d31/d26/c70 0 2024-09-13T02:53:54.587 INFO:tasks.workunit.client.1.smithi131.stdout:1/330: symlink dd/d26/d2a/d69/l75 0 2024-09-13T02:53:54.587 INFO:tasks.workunit.client.1.smithi131.stdout:1/331: chown dd/d33/d42 8250 1 2024-09-13T02:53:54.590 INFO:tasks.workunit.client.0.smithi089.stdout:8/25: write f0 [833083,29968] 0 2024-09-13T02:53:54.591 INFO:tasks.workunit.client.1.smithi131.stdout:6/363: symlink d1/d8/d9/db/d40/l74 0 2024-09-13T02:53:54.591 INFO:tasks.workunit.client.1.smithi131.stdout:6/364: write d1/d8/d9/db/d40/f47 [353216,119507] 0 2024-09-13T02:53:54.592 INFO:tasks.workunit.client.1.smithi131.stdout:7/261: truncate d1b/d23/f2d 3163182 0 2024-09-13T02:53:54.592 INFO:tasks.workunit.client.0.smithi089.stdout:8/26: rmdir d8 0 2024-09-13T02:53:54.592 INFO:tasks.workunit.client.0.smithi089.stdout:8/27: creat f9 x:0 0 0 2024-09-13T02:53:54.593 INFO:tasks.workunit.client.1.smithi131.stdout:4/355: dwrite d1/dc/d19/d29/f4a [4194304,4194304] 0 2024-09-13T02:53:54.593 INFO:tasks.workunit.client.1.smithi131.stdout:4/356: creat d1/dc/d19/d29/d33/d3a/f77 x:0 0 0 2024-09-13T02:53:54.593 INFO:tasks.workunit.client.1.smithi131.stdout:4/357: chown d1/dc/d19/d29/d33/d3a/f77 228559376 1 2024-09-13T02:53:54.593 INFO:tasks.workunit.client.1.smithi131.stdout:4/358: fsync d1/dc/d22/f59 0 2024-09-13T02:53:54.593 INFO:tasks.workunit.client.1.smithi131.stdout:4/359: readlink d1/l4 0 2024-09-13T02:53:54.594 INFO:tasks.workunit.client.0.smithi089.stdout:8/28: link l6 la 0 2024-09-13T02:53:54.597 INFO:tasks.workunit.client.1.smithi131.stdout:2/325: symlink d5/d34/l71 0 2024-09-13T02:53:54.597 INFO:tasks.workunit.client.1.smithi131.stdout:1/332: symlink dd/d26/d2a/d2c/d4b/l76 0 2024-09-13T02:53:54.597 INFO:tasks.workunit.client.1.smithi131.stdout:1/333: readlink dd/l74 0 2024-09-13T02:53:54.599 INFO:tasks.workunit.client.1.smithi131.stdout:6/365: symlink d1/l75 0 2024-09-13T02:53:54.599 INFO:tasks.workunit.client.1.smithi131.stdout:6/366: creat d1/f76 x:0 0 0 2024-09-13T02:53:54.599 INFO:tasks.workunit.client.1.smithi131.stdout:6/367: chown d1/d8/d9/f17 3337004 1 2024-09-13T02:53:54.602 INFO:tasks.workunit.client.1.smithi131.stdout:4/360: mkdir d1/d18/d34/d62/d78 0 2024-09-13T02:53:54.604 INFO:tasks.workunit.client.1.smithi131.stdout:2/326: creat d5/d31/d21/f72 x:0 0 0 2024-09-13T02:53:54.604 INFO:tasks.workunit.client.1.smithi131.stdout:2/327: fsync d5/d33/d41/f4a 0 2024-09-13T02:53:54.604 INFO:tasks.workunit.client.1.smithi131.stdout:2/328: fdatasync d5/f47 0 2024-09-13T02:53:54.604 INFO:tasks.workunit.client.1.smithi131.stdout:2/329: write d5/d31/d26/f63 [896263,178] 0 2024-09-13T02:53:54.608 INFO:tasks.workunit.client.1.smithi131.stdout:4/361: rename d1/dc/d19/d29/c6b to d1/d18/d34/d62/d78/c79 0 2024-09-13T02:53:54.608 INFO:tasks.workunit.client.1.smithi131.stdout:6/368: dread d1/f7 [0,4194304] 0 2024-09-13T02:53:54.609 INFO:tasks.workunit.client.1.smithi131.stdout:4/362: mkdir d1/dc/d7a 0 2024-09-13T02:53:54.609 INFO:tasks.workunit.client.1.smithi131.stdout:4/363: read - d1/dc/d19/d29/f60 zero size 2024-09-13T02:53:54.610 INFO:tasks.workunit.client.1.smithi131.stdout:1/334: write dd/f16 [1930448,3539] 0 2024-09-13T02:53:54.611 INFO:tasks.workunit.client.1.smithi131.stdout:1/335: getdents dd/d68 0 2024-09-13T02:53:54.611 INFO:tasks.workunit.client.1.smithi131.stdout:1/336: write dd/d26/f50 [4313241,527] 0 2024-09-13T02:53:54.613 INFO:tasks.workunit.client.1.smithi131.stdout:1/337: creat dd/f77 x:0 0 0 2024-09-13T02:53:54.626 INFO:tasks.workunit.client.1.smithi131.stdout:7/262: dwrite f10 [4194304,4194304] 0 2024-09-13T02:53:54.626 INFO:tasks.workunit.client.1.smithi131.stdout:7/263: chown d1b/d3b/d31/d4e/f53 54 1 2024-09-13T02:53:54.627 INFO:tasks.workunit.client.0.smithi089.stdout:8/29: dwrite f3 [0,4194304] 0 2024-09-13T02:53:54.627 INFO:tasks.workunit.client.0.smithi089.stdout:8/30: fdatasync f5 0 2024-09-13T02:53:54.627 INFO:tasks.workunit.client.0.smithi089.stdout:8/31: stat f5 0 2024-09-13T02:53:54.630 INFO:tasks.workunit.client.1.smithi131.stdout:2/330: dwrite d5/d33/d41/f44 [0,4194304] 0 2024-09-13T02:53:54.630 INFO:tasks.workunit.client.0.smithi089.stdout:8/32: rename f7 to fb 0 2024-09-13T02:53:54.630 INFO:tasks.workunit.client.0.smithi089.stdout:8/33: write f0 [3048460,126634] 0 2024-09-13T02:53:54.631 INFO:tasks.workunit.client.1.smithi131.stdout:2/331: dread d5/d53/f5b [0,4194304] 0 2024-09-13T02:53:54.631 INFO:tasks.workunit.client.1.smithi131.stdout:2/332: creat d5/d33/d66/f73 x:0 0 0 2024-09-13T02:53:54.632 INFO:tasks.workunit.client.1.smithi131.stdout:7/264: unlink d1b/d3b/d41/f4d 0 2024-09-13T02:53:54.633 INFO:tasks.workunit.client.0.smithi089.stdout:8/34: rename la to lc 0 2024-09-13T02:53:54.633 INFO:tasks.workunit.client.1.smithi131.stdout:9/283: dwrite d0/d3/d14/d17/f21 [0,4194304] 0 2024-09-13T02:53:54.634 INFO:tasks.workunit.client.0.smithi089.stdout:8/35: symlink ld 0 2024-09-13T02:53:54.636 INFO:tasks.workunit.client.1.smithi131.stdout:2/333: link d5/d31/d1d/f52 d5/d33/d66/f74 0 2024-09-13T02:53:54.638 INFO:tasks.workunit.client.1.smithi131.stdout:7/265: link d1b/d23/c2a d1b/d3b/d31/c58 0 2024-09-13T02:53:54.638 INFO:tasks.workunit.client.1.smithi131.stdout:7/266: creat d1b/d3b/d41/f59 x:0 0 0 2024-09-13T02:53:54.638 INFO:tasks.workunit.client.1.smithi131.stdout:7/267: chown d1b/d3b/c4f 1102 1 2024-09-13T02:53:54.639 INFO:tasks.workunit.client.1.smithi131.stdout:9/284: rename d0/d3/d14/d1a/f48 to d0/d3/d14/d1a/d2a/f5a 0 2024-09-13T02:53:54.639 INFO:tasks.workunit.client.1.smithi131.stdout:9/285: dread - d0/d3/d14/d1a/d2a/f4e zero size 2024-09-13T02:53:54.639 INFO:tasks.workunit.client.1.smithi131.stdout:9/286: chown d0/d3/d14/d1a/d2a/c41 1704122 1 2024-09-13T02:53:54.640 INFO:tasks.workunit.client.1.smithi131.stdout:2/334: truncate d5/d34/f65 399933 0 2024-09-13T02:53:54.640 INFO:tasks.workunit.client.1.smithi131.stdout:2/335: chown d5/d18/c43 20 1 2024-09-13T02:53:54.643 INFO:tasks.workunit.client.1.smithi131.stdout:7/268: mknod d1b/d3b/d41/c5a 0 2024-09-13T02:53:54.643 INFO:tasks.workunit.client.1.smithi131.stdout:7/269: creat d1b/d3b/f5b x:0 0 0 2024-09-13T02:53:54.643 INFO:tasks.workunit.client.1.smithi131.stdout:7/270: write d1b/d3b/f55 [219525,67462] 0 2024-09-13T02:53:54.645 INFO:tasks.workunit.client.1.smithi131.stdout:7/271: creat d1b/d3b/d31/f5c x:0 0 0 2024-09-13T02:53:54.645 INFO:tasks.workunit.client.1.smithi131.stdout:7/272: write d1b/d23/f28 [4268574,363] 0 2024-09-13T02:53:54.646 INFO:tasks.workunit.client.1.smithi131.stdout:7/273: stat d1b/d3b/d41/c5a 0 2024-09-13T02:53:54.647 INFO:tasks.workunit.client.1.smithi131.stdout:4/364: dwrite d1/dc/f2e [0,4194304] 0 2024-09-13T02:53:54.647 INFO:tasks.workunit.client.1.smithi131.stdout:4/365: fdatasync d1/dc/d19/d29/f2b 0 2024-09-13T02:53:54.647 INFO:tasks.workunit.client.1.smithi131.stdout:4/366: chown d1/dc/d19/c66 509788 1 2024-09-13T02:53:54.648 INFO:tasks.workunit.client.1.smithi131.stdout:6/369: dwrite d1/d8/d9/f1d [0,4194304] 0 2024-09-13T02:53:54.648 INFO:tasks.workunit.client.1.smithi131.stdout:6/370: fsync d1/d8/f2c 0 2024-09-13T02:53:54.648 INFO:tasks.workunit.client.1.smithi131.stdout:6/371: creat d1/d8/d9/db/d15/d26/d1c/d4e/f77 x:0 0 0 2024-09-13T02:53:54.652 INFO:tasks.workunit.client.0.smithi089.stdout:8/36: truncate f3 2252011 0 2024-09-13T02:53:54.656 INFO:tasks.workunit.client.0.smithi089.stdout:8/37: getdents . 0 2024-09-13T02:53:54.657 INFO:tasks.workunit.client.1.smithi131.stdout:1/338: dwrite dd/d26/f57 [0,4194304] 0 2024-09-13T02:53:54.657 INFO:tasks.workunit.client.1.smithi131.stdout:1/339: chown dd/f3a 10137 1 2024-09-13T02:53:54.657 INFO:tasks.workunit.client.1.smithi131.stdout:6/372: unlink d1/d8/f2d 0 2024-09-13T02:53:54.658 INFO:tasks.workunit.client.1.smithi131.stdout:6/373: chown d1/d8/d9/db/d15/d26/d1c 6174 1 2024-09-13T02:53:54.658 INFO:tasks.workunit.client.1.smithi131.stdout:4/367: dread d1/d18/f2d [0,4194304] 0 2024-09-13T02:53:54.658 INFO:tasks.workunit.client.1.smithi131.stdout:4/368: write d1/d18/f2a [935566,116034] 0 2024-09-13T02:53:54.658 INFO:tasks.workunit.client.1.smithi131.stdout:6/374: write d1/d8/d9/db/d15/f31 [150105,58192] 0 2024-09-13T02:53:54.658 INFO:tasks.workunit.client.0.smithi089.stdout:8/38: mkdir de 0 2024-09-13T02:53:54.658 INFO:tasks.workunit.client.0.smithi089.stdout:8/39: getdents de 0 2024-09-13T02:53:54.659 INFO:tasks.workunit.client.1.smithi131.stdout:1/340: mknod dd/d26/d2a/d69/c78 0 2024-09-13T02:53:54.659 INFO:tasks.workunit.client.1.smithi131.stdout:1/341: write dd/d26/f57 [5147683,108403] 0 2024-09-13T02:53:54.659 INFO:tasks.workunit.client.0.smithi089.stdout:8/40: chown f0 211 1 2024-09-13T02:53:54.659 INFO:tasks.workunit.client.1.smithi131.stdout:6/375: rename d1/d8/d9/db/d15/f69 to d1/d8/d9/db/d15/d26/d1c/f78 0 2024-09-13T02:53:54.660 INFO:tasks.workunit.client.1.smithi131.stdout:1/342: rmdir dd/d26/d2a/d2c/d4b 39 2024-09-13T02:53:54.666 INFO:tasks.workunit.client.1.smithi131.stdout:4/369: dread d1/dc/f3e [0,4194304] 0 2024-09-13T02:53:54.666 INFO:tasks.workunit.client.1.smithi131.stdout:4/370: truncate d1/d18/f76 165535 0 2024-09-13T02:53:54.666 INFO:tasks.workunit.client.1.smithi131.stdout:4/371: fsync d1/dc/d22/f69 0 2024-09-13T02:53:54.666 INFO:tasks.workunit.client.1.smithi131.stdout:4/372: readlink d1/dc/d22/l46 0 2024-09-13T02:53:54.666 INFO:tasks.workunit.client.1.smithi131.stdout:4/373: stat d1/d8/d13/l6d 0 2024-09-13T02:53:54.666 INFO:tasks.workunit.client.1.smithi131.stdout:4/374: chown d1/d8/c11 1140 1 2024-09-13T02:53:54.666 INFO:tasks.workunit.client.1.smithi131.stdout:9/287: dwrite d0/d3/d14/d17/d32/d39/f4a [0,4194304] 0 2024-09-13T02:53:54.667 INFO:tasks.workunit.client.1.smithi131.stdout:9/288: fdatasync d0/d3/d14/d17/d32/d39/f50 0 2024-09-13T02:53:54.667 INFO:tasks.workunit.client.1.smithi131.stdout:4/375: creat d1/dc/d22/d73/f7b x:0 0 0 2024-09-13T02:53:54.668 INFO:tasks.workunit.client.1.smithi131.stdout:2/336: dwrite d5/d33/d66/f73 [0,4194304] 0 2024-09-13T02:53:54.670 INFO:tasks.workunit.client.1.smithi131.stdout:9/289: creat d0/d3/f5b x:0 0 0 2024-09-13T02:53:54.673 INFO:tasks.workunit.client.1.smithi131.stdout:4/376: link d1/dc/d19/d29/c56 d1/dc/d22/d73/c7c 0 2024-09-13T02:53:54.675 INFO:tasks.workunit.client.1.smithi131.stdout:6/376: write d1/d8/d9/f1d [1177023,46393] 0 2024-09-13T02:53:54.675 INFO:tasks.workunit.client.1.smithi131.stdout:6/377: chown d1/d8 40762 1 2024-09-13T02:53:54.675 INFO:tasks.workunit.client.1.smithi131.stdout:6/378: dread - d1/f76 zero size 2024-09-13T02:53:54.678 INFO:tasks.workunit.client.1.smithi131.stdout:4/377: dread d1/d8/f1d [0,4194304] 0 2024-09-13T02:53:54.688 INFO:tasks.workunit.client.1.smithi131.stdout:6/379: read d1/d8/f1a [2773292,124441] 0 2024-09-13T02:53:54.690 INFO:tasks.workunit.client.1.smithi131.stdout:6/380: mkdir d1/d8/d9/db/d15/d26/d1c/d79 0 2024-09-13T02:53:54.690 INFO:tasks.workunit.client.1.smithi131.stdout:6/381: write d1/d14/f5c [1356583,58946] 0 2024-09-13T02:53:54.690 INFO:tasks.workunit.client.1.smithi131.stdout:6/382: creat d1/d8/f7a x:0 0 0 2024-09-13T02:53:54.690 INFO:tasks.workunit.client.1.smithi131.stdout:6/383: readlink d1/d8/d9/db/d40/l54 0 2024-09-13T02:53:54.690 INFO:tasks.workunit.client.1.smithi131.stdout:6/384: chown d1/d8/d9/db/d40/f63 5042887 1 2024-09-13T02:53:54.690 INFO:tasks.workunit.client.1.smithi131.stdout:6/385: write d1/d8/d9/f17 [1989274,125385] 0 2024-09-13T02:53:54.690 INFO:tasks.workunit.client.1.smithi131.stdout:6/386: chown d1/d8/d9/db/c59 35075 1 2024-09-13T02:53:54.691 INFO:tasks.workunit.client.1.smithi131.stdout:6/387: mknod d1/d8/d9/db/d2a/d3b/c7b 0 2024-09-13T02:53:54.698 INFO:tasks.workunit.client.1.smithi131.stdout:7/274: dwrite d1b/d3b/f55 [0,4194304] 0 2024-09-13T02:53:54.698 INFO:tasks.workunit.client.1.smithi131.stdout:7/275: write d1b/d3b/f5b [1019520,114504] 0 2024-09-13T02:53:54.702 INFO:tasks.workunit.client.1.smithi131.stdout:2/337: dwrite d5/d34/d42/f64 [0,4194304] 0 2024-09-13T02:53:54.702 INFO:tasks.workunit.client.1.smithi131.stdout:9/290: dwrite d0/d3/d14/f34 [4194304,4194304] 0 2024-09-13T02:53:54.703 INFO:tasks.workunit.client.0.smithi089.stdout:8/41: dwrite fb [0,4194304] 0 2024-09-13T02:53:54.703 INFO:tasks.workunit.client.1.smithi131.stdout:1/343: dwrite dd/d26/d44/f28 [0,4194304] 0 2024-09-13T02:53:54.703 INFO:tasks.workunit.client.1.smithi131.stdout:1/344: chown dd/d26/d2a/d2c/d4b/f5b 85804 1 2024-09-13T02:53:54.707 INFO:tasks.workunit.client.1.smithi131.stdout:7/276: write d1b/f2f [1838193,3637] 0 2024-09-13T02:53:54.707 INFO:tasks.workunit.client.1.smithi131.stdout:7/277: chown f3 6779 1 2024-09-13T02:53:54.708 INFO:tasks.workunit.client.1.smithi131.stdout:2/338: mkdir d5/d53/d75 0 2024-09-13T02:53:54.708 INFO:tasks.workunit.client.1.smithi131.stdout:2/339: dread - d5/d31/d1d/d32/f6f zero size 2024-09-13T02:53:54.708 INFO:tasks.workunit.client.0.smithi089.stdout:8/42: mknod de/cf 0 2024-09-13T02:53:54.709 INFO:tasks.workunit.client.0.smithi089.stdout:8/43: chown c4 47076 1 2024-09-13T02:53:54.711 INFO:tasks.workunit.client.1.smithi131.stdout:6/388: getdents d1/d8/d9/db/d15 0 2024-09-13T02:53:54.712 INFO:tasks.workunit.client.1.smithi131.stdout:1/345: truncate dd/ff 1180943 0 2024-09-13T02:53:54.712 INFO:tasks.workunit.client.1.smithi131.stdout:4/378: dwrite d1/dc/d22/f59 [0,4194304] 0 2024-09-13T02:53:54.713 INFO:tasks.workunit.client.1.smithi131.stdout:7/278: mkdir d1b/d3b/d46/d4b/d5d 0 2024-09-13T02:53:54.713 INFO:tasks.workunit.client.1.smithi131.stdout:7/279: chown d1b/d3b/l35 200176052 1 2024-09-13T02:53:54.715 INFO:tasks.workunit.client.0.smithi089.stdout:8/44: creat de/f10 x:0 0 0 2024-09-13T02:53:54.716 INFO:tasks.workunit.client.0.smithi089.stdout:8/45: creat de/f11 x:0 0 0 2024-09-13T02:53:54.721 INFO:tasks.workunit.client.1.smithi131.stdout:4/379: unlink d1/dc/d19/d29/d33/d3a/f77 0 2024-09-13T02:53:54.721 INFO:tasks.workunit.client.1.smithi131.stdout:4/380: truncate d1/dc/d19/d29/f60 528822 0 2024-09-13T02:53:54.721 INFO:tasks.workunit.client.1.smithi131.stdout:4/381: fdatasync d1/dc/d22/d49/f4d 0 2024-09-13T02:53:54.723 INFO:tasks.workunit.client.1.smithi131.stdout:7/280: link d1b/d3b/d31/f5c d1b/d23/d54/f5e 0 2024-09-13T02:53:54.723 INFO:tasks.workunit.client.1.smithi131.stdout:7/281: fsync d1b/d3b/f55 0 2024-09-13T02:53:54.723 INFO:tasks.workunit.client.1.smithi131.stdout:7/282: readlink l17 0 2024-09-13T02:53:54.725 INFO:tasks.workunit.client.1.smithi131.stdout:2/340: dwrite d5/d18/f1b [4194304,4194304] 0 2024-09-13T02:53:54.744 INFO:tasks.workunit.client.1.smithi131.stdout:6/389: dread d1/d8/d9/f19 [0,4194304] 0 2024-09-13T02:53:54.744 INFO:tasks.workunit.client.1.smithi131.stdout:6/390: write d1/d8/d9/db/f64 [360558,64530] 0 2024-09-13T02:53:54.746 INFO:tasks.workunit.client.0.smithi089.stdout:8/46: dread fb [0,4194304] 0 2024-09-13T02:53:54.746 INFO:tasks.workunit.client.0.smithi089.stdout:8/47: dread - de/f11 zero size 2024-09-13T02:53:54.746 INFO:tasks.workunit.client.1.smithi131.stdout:6/391: getdents d1/d8/d9/db/d15/d26/d1c/d4e 0 2024-09-13T02:53:54.746 INFO:tasks.workunit.client.1.smithi131.stdout:6/392: creat d1/d14/f7c x:0 0 0 2024-09-13T02:53:54.747 INFO:tasks.workunit.client.0.smithi089.stdout:8/48: stat f9 0 2024-09-13T02:53:54.747 INFO:tasks.workunit.client.0.smithi089.stdout:8/49: chown lc 34517196 1 2024-09-13T02:53:54.748 INFO:tasks.workunit.client.1.smithi131.stdout:6/393: getdents d1/d8/d9/db/d40 0 2024-09-13T02:53:54.749 INFO:tasks.workunit.client.1.smithi131.stdout:2/341: write d5/d33/d66/f73 [2216213,48596] 0 2024-09-13T02:53:54.749 INFO:tasks.workunit.client.1.smithi131.stdout:6/394: mknod d1/d8/d9/db/d15/d26/d1c/c7d 0 2024-09-13T02:53:54.752 INFO:tasks.workunit.client.1.smithi131.stdout:4/382: dwrite d1/d18/f21 [0,4194304] 0 2024-09-13T02:53:54.753 INFO:tasks.workunit.client.1.smithi131.stdout:7/283: dwrite f10 [4194304,4194304] 0 2024-09-13T02:53:54.753 INFO:tasks.workunit.client.1.smithi131.stdout:6/395: unlink d1/f76 0 2024-09-13T02:53:54.753 INFO:tasks.workunit.client.1.smithi131.stdout:6/396: stat d1/d8/d9/db/d15/d26/d1c/c7d 0 2024-09-13T02:53:54.755 INFO:tasks.workunit.client.1.smithi131.stdout:2/342: write d5/d18/f1b [732166,11706] 0 2024-09-13T02:53:54.757 INFO:tasks.workunit.client.1.smithi131.stdout:7/284: mkdir d1b/d3b/d31/d5f 0 2024-09-13T02:53:54.758 INFO:tasks.workunit.client.1.smithi131.stdout:6/397: mknod d1/d8/d9/db/d15/d26/d1c/c7e 0 2024-09-13T02:53:54.758 INFO:tasks.workunit.client.0.smithi089.stdout:8/50: truncate f0 3196918 0 2024-09-13T02:53:54.758 INFO:tasks.workunit.client.0.smithi089.stdout:8/51: truncate de/f10 859056 0 2024-09-13T02:53:54.759 INFO:tasks.workunit.client.0.smithi089.stdout:8/52: dread de/f10 [0,4194304] 0 2024-09-13T02:53:54.759 INFO:tasks.workunit.client.1.smithi131.stdout:6/398: truncate d1/fe 2762256 0 2024-09-13T02:53:54.760 INFO:tasks.workunit.client.1.smithi131.stdout:6/399: creat d1/d8/f7f x:0 0 0 2024-09-13T02:53:54.760 INFO:tasks.workunit.client.1.smithi131.stdout:6/400: chown d1/d8/d9/db/d15/f3c 7 1 2024-09-13T02:53:54.761 INFO:tasks.workunit.client.0.smithi089.stdout:8/53: truncate fb 1919097 0 2024-09-13T02:53:54.763 INFO:tasks.workunit.client.1.smithi131.stdout:6/401: mknod d1/d8/d9/c80 0 2024-09-13T02:53:54.763 INFO:tasks.workunit.client.1.smithi131.stdout:6/402: chown d1/d8/d9/c13 24792 1 2024-09-13T02:53:54.767 INFO:tasks.workunit.client.1.smithi131.stdout:4/383: dread d1/dc/d19/d29/f4a [4194304,4194304] 0 2024-09-13T02:53:54.768 INFO:tasks.workunit.client.1.smithi131.stdout:1/346: dwrite dd/d26/d44/f25 [0,4194304] 0 2024-09-13T02:53:54.770 INFO:tasks.workunit.client.1.smithi131.stdout:4/384: mkdir d1/d18/d43/d7d 0 2024-09-13T02:53:54.770 INFO:tasks.workunit.client.1.smithi131.stdout:7/285: dread fb [0,4194304] 0 2024-09-13T02:53:54.770 INFO:tasks.workunit.client.1.smithi131.stdout:7/286: write d1b/f2c [1394522,84827] 0 2024-09-13T02:53:54.771 INFO:tasks.workunit.client.1.smithi131.stdout:4/385: creat d1/dc/f7e x:0 0 0 2024-09-13T02:53:54.771 INFO:tasks.workunit.client.1.smithi131.stdout:2/343: dwrite d5/d33/d66/f6c [0,4194304] 0 2024-09-13T02:53:54.772 INFO:tasks.workunit.client.1.smithi131.stdout:7/287: unlink d1b/f2e 0 2024-09-13T02:53:54.773 INFO:tasks.workunit.client.1.smithi131.stdout:7/288: getdents d1b/d3b/d51 0 2024-09-13T02:53:54.774 INFO:tasks.workunit.client.1.smithi131.stdout:4/386: symlink d1/dc/d19/d29/d33/l7f 0 2024-09-13T02:53:54.776 INFO:tasks.workunit.client.1.smithi131.stdout:2/344: dread d5/d1e/f4d [0,4194304] 0 2024-09-13T02:53:54.776 INFO:tasks.workunit.client.1.smithi131.stdout:2/345: write d5/d31/d21/f72 [666355,65393] 0 2024-09-13T02:53:54.776 INFO:tasks.workunit.client.1.smithi131.stdout:2/346: write d5/fe [2032315,33898] 0 2024-09-13T02:53:54.780 INFO:tasks.workunit.client.1.smithi131.stdout:7/289: mkdir d1b/d3b/d31/d60 0 2024-09-13T02:53:54.780 INFO:tasks.workunit.client.1.smithi131.stdout:7/290: readlink d1b/d3b/d31/d38/l49 0 2024-09-13T02:53:54.780 INFO:tasks.workunit.client.1.smithi131.stdout:7/291: stat d1b/d3b/d46 0 2024-09-13T02:53:54.780 INFO:tasks.workunit.client.1.smithi131.stdout:7/292: creat d1b/d23/f61 x:0 0 0 2024-09-13T02:53:54.781 INFO:tasks.workunit.client.1.smithi131.stdout:4/387: creat d1/d18/d43/d7d/f80 x:0 0 0 2024-09-13T02:53:54.783 INFO:tasks.workunit.client.1.smithi131.stdout:2/347: rmdir d5/d1e/d48/d4c 39 2024-09-13T02:53:54.785 INFO:tasks.workunit.client.1.smithi131.stdout:7/293: unlink d1b/d3b/d31/c40 0 2024-09-13T02:53:54.789 INFO:tasks.workunit.client.1.smithi131.stdout:4/388: mkdir d1/d18/d81 0 2024-09-13T02:53:54.789 INFO:tasks.workunit.client.1.smithi131.stdout:2/348: rename d5/d53/d75 to d5/d31/d4e/d76 0 2024-09-13T02:53:54.789 INFO:tasks.workunit.client.1.smithi131.stdout:4/389: chown d1/d18/f5c 1649 1 2024-09-13T02:53:54.789 INFO:tasks.workunit.client.1.smithi131.stdout:7/294: truncate d1b/d3b/f55 76015 0 2024-09-13T02:53:54.789 INFO:tasks.workunit.client.1.smithi131.stdout:4/390: truncate d1/d18/d34/f5a 328025 0 2024-09-13T02:53:54.790 INFO:tasks.workunit.client.1.smithi131.stdout:7/295: mkdir d1b/d3b/d51/d62 0 2024-09-13T02:53:54.790 INFO:tasks.workunit.client.1.smithi131.stdout:7/296: chown d1b/d23/f28 317 1 2024-09-13T02:53:54.790 INFO:tasks.workunit.client.1.smithi131.stdout:7/297: write d1b/d3b/d31/d4e/f53 [748107,45388] 0 2024-09-13T02:53:54.790 INFO:tasks.workunit.client.1.smithi131.stdout:7/298: truncate d1b/f34 256606 0 2024-09-13T02:53:54.791 INFO:tasks.workunit.client.1.smithi131.stdout:4/391: creat d1/d18/d81/f82 x:0 0 0 2024-09-13T02:53:54.791 INFO:tasks.workunit.client.1.smithi131.stdout:2/349: getdents d5/d1e 0 2024-09-13T02:53:54.791 INFO:tasks.workunit.client.1.smithi131.stdout:2/350: stat d5/d33/d66 0 2024-09-13T02:53:54.792 INFO:tasks.workunit.client.1.smithi131.stdout:1/347: dwrite dd/d26/f2d [0,4194304] 0 2024-09-13T02:53:54.792 INFO:tasks.workunit.client.0.smithi089.stdout:8/54: dwrite f0 [0,4194304] 0 2024-09-13T02:53:54.793 INFO:tasks.workunit.client.1.smithi131.stdout:7/299: mknod d1b/d3b/d31/d38/c63 0 2024-09-13T02:53:54.793 INFO:tasks.workunit.client.1.smithi131.stdout:7/300: dread - d1b/d3b/d31/f5c zero size 2024-09-13T02:53:54.793 INFO:tasks.workunit.client.1.smithi131.stdout:7/301: fdatasync d1b/d23/d54/f5e 0 2024-09-13T02:53:54.793 INFO:tasks.workunit.client.1.smithi131.stdout:7/302: chown l17 0 1 2024-09-13T02:53:54.794 INFO:tasks.workunit.client.1.smithi131.stdout:4/392: unlink d1/f3d 0 2024-09-13T02:53:54.794 INFO:tasks.workunit.client.1.smithi131.stdout:4/393: readlink d1/d8/d13/l6d 0 2024-09-13T02:53:54.794 INFO:tasks.workunit.client.1.smithi131.stdout:4/394: write d1/d8/f2f [1174913,106320] 0 2024-09-13T02:53:54.794 INFO:tasks.workunit.client.1.smithi131.stdout:4/395: stat d1/dc/f3e 0 2024-09-13T02:53:54.797 INFO:tasks.workunit.client.1.smithi131.stdout:1/348: rename dd/f43 to dd/d68/f79 0 2024-09-13T02:53:54.798 INFO:tasks.workunit.client.1.smithi131.stdout:7/303: mknod d1b/d3b/c64 0 2024-09-13T02:53:54.798 INFO:tasks.workunit.client.1.smithi131.stdout:2/351: rmdir d5/d33/d41 39 2024-09-13T02:53:54.800 INFO:tasks.workunit.client.0.smithi089.stdout:8/55: dread f3 [0,4194304] 0 2024-09-13T02:53:54.800 INFO:tasks.workunit.client.1.smithi131.stdout:1/349: symlink dd/d26/d2a/d69/l7a 0 2024-09-13T02:53:54.802 INFO:tasks.workunit.client.1.smithi131.stdout:7/304: rename d1b/f24 to d1b/d23/d54/f65 0 2024-09-13T02:53:54.804 INFO:tasks.workunit.client.1.smithi131.stdout:1/350: creat dd/d26/d2a/d69/f7b x:0 0 0 2024-09-13T02:53:54.804 INFO:tasks.workunit.client.1.smithi131.stdout:1/351: readlink dd/l24 0 2024-09-13T02:53:54.805 INFO:tasks.workunit.client.1.smithi131.stdout:7/305: rmdir d1b/d3b/d46/d4b 39 2024-09-13T02:53:54.805 INFO:tasks.workunit.client.1.smithi131.stdout:7/306: stat f4 0 2024-09-13T02:53:54.807 INFO:tasks.workunit.client.1.smithi131.stdout:1/352: mkdir dd/d26/d44/d6d/d7c 0 2024-09-13T02:53:54.808 INFO:tasks.workunit.client.0.smithi089.stdout:8/56: write f3 [951725,50135] 0 2024-09-13T02:53:54.808 INFO:tasks.workunit.client.0.smithi089.stdout:8/57: write f3 [1252737,5346] 0 2024-09-13T02:53:54.808 INFO:tasks.workunit.client.0.smithi089.stdout:8/58: creat de/f12 x:0 0 0 2024-09-13T02:53:54.808 INFO:tasks.workunit.client.0.smithi089.stdout:8/59: dread - de/f12 zero size 2024-09-13T02:53:54.808 INFO:tasks.workunit.client.0.smithi089.stdout:8/60: write f9 [766411,71681] 0 2024-09-13T02:53:54.808 INFO:tasks.workunit.client.0.smithi089.stdout:8/61: write fb [2937193,29926] 0 2024-09-13T02:53:54.808 INFO:tasks.workunit.client.1.smithi131.stdout:7/307: rename d1b/d3b/c39 to d1b/d3b/d51/d62/c66 0 2024-09-13T02:53:54.809 INFO:tasks.workunit.client.1.smithi131.stdout:7/308: mknod d1b/d3b/d46/d4b/d5d/c67 0 2024-09-13T02:53:54.810 INFO:tasks.workunit.client.0.smithi089.stdout:8/62: symlink de/l13 0 2024-09-13T02:53:54.812 INFO:tasks.workunit.client.1.smithi131.stdout:7/309: getdents d1b/d3b/d31/d38 0 2024-09-13T02:53:54.814 INFO:tasks.workunit.client.1.smithi131.stdout:7/310: symlink d1b/d23/d54/l68 0 2024-09-13T02:53:54.814 INFO:tasks.workunit.client.1.smithi131.stdout:7/311: read d1b/d23/f28 [888469,5293] 0 2024-09-13T02:53:54.814 INFO:tasks.workunit.client.1.smithi131.stdout:7/312: chown c9 130416630 1 2024-09-13T02:53:54.816 INFO:tasks.workunit.client.1.smithi131.stdout:7/313: unlink f13 0 2024-09-13T02:53:54.816 INFO:tasks.workunit.client.1.smithi131.stdout:7/314: write d1b/f2c [2091895,102289] 0 2024-09-13T02:53:54.816 INFO:tasks.workunit.client.1.smithi131.stdout:7/315: write d1b/f2f [3058230,2306] 0 2024-09-13T02:53:54.817 INFO:tasks.workunit.client.1.smithi131.stdout:7/316: mknod d1b/d3b/d31/d60/c69 0 2024-09-13T02:53:54.817 INFO:tasks.workunit.client.1.smithi131.stdout:7/317: dread - d1b/d3b/d41/f59 zero size 2024-09-13T02:53:54.817 INFO:tasks.workunit.client.1.smithi131.stdout:7/318: truncate d1b/d23/f4c 1394621 0 2024-09-13T02:53:54.820 INFO:tasks.workunit.client.1.smithi131.stdout:2/352: dwrite d5/d18/f1b [0,4194304] 0 2024-09-13T02:53:54.820 INFO:tasks.workunit.client.1.smithi131.stdout:4/396: dwrite d1/f5 [4194304,4194304] 0 2024-09-13T02:53:54.821 INFO:tasks.workunit.client.1.smithi131.stdout:4/397: fdatasync d1/d18/f75 0 2024-09-13T02:53:54.822 INFO:tasks.workunit.client.1.smithi131.stdout:4/398: symlink d1/d18/d34/d62/d78/l83 0 2024-09-13T02:53:54.823 INFO:tasks.workunit.client.1.smithi131.stdout:4/399: truncate d1/dc/d19/d29/f4a 5717823 0 2024-09-13T02:53:54.823 INFO:tasks.workunit.client.0.smithi089.stdout:8/63: dread fb [0,4194304] 0 2024-09-13T02:53:54.824 INFO:tasks.workunit.client.0.smithi089.stdout:8/64: truncate f3 2813670 0 2024-09-13T02:53:54.824 INFO:tasks.workunit.client.0.smithi089.stdout:8/65: write de/f10 [646901,101040] 0 2024-09-13T02:53:54.824 INFO:tasks.workunit.client.0.smithi089.stdout:8/66: creat de/f14 x:0 0 0 2024-09-13T02:53:54.826 INFO:tasks.workunit.client.1.smithi131.stdout:1/353: dwrite dd/d26/d2a/d2c/f34 [0,4194304] 0 2024-09-13T02:53:54.826 INFO:tasks.workunit.client.1.smithi131.stdout:1/354: write dd/d26/d2a/d2c/d4b/f5b [4592609,105926] 0 2024-09-13T02:53:54.829 INFO:tasks.workunit.client.1.smithi131.stdout:1/355: mkdir dd/d26/d7d 0 2024-09-13T02:53:54.843 INFO:tasks.workunit.client.1.smithi131.stdout:1/356: write dd/d33/d42/f5d [973116,4105] 0 2024-09-13T02:53:54.846 INFO:tasks.workunit.client.0.smithi089.stdout:8/67: dwrite de/f11 [0,4194304] 0 2024-09-13T02:53:54.846 INFO:tasks.workunit.client.0.smithi089.stdout:8/68: creat de/f15 x:0 0 0 2024-09-13T02:53:54.848 INFO:tasks.workunit.client.0.smithi089.stdout:8/69: mkdir de/d16 0 2024-09-13T02:53:54.848 INFO:tasks.workunit.client.0.smithi089.stdout:8/70: chown c1 1042 1 2024-09-13T02:53:54.850 INFO:tasks.workunit.client.1.smithi131.stdout:4/400: dwrite d1/dc/d19/d29/d33/f67 [0,4194304] 0 2024-09-13T02:53:54.851 INFO:tasks.workunit.client.1.smithi131.stdout:4/401: truncate d1/dc/d19/d29/f60 1525354 0 2024-09-13T02:53:54.851 INFO:tasks.workunit.client.1.smithi131.stdout:4/402: chown d1/dc/d19/d29/f2b 343847 1 2024-09-13T02:53:54.851 INFO:tasks.workunit.client.1.smithi131.stdout:4/403: readlink d1/dc/d19/d29/d33/l7f 0 2024-09-13T02:53:54.852 INFO:tasks.workunit.client.1.smithi131.stdout:4/404: symlink d1/d18/d34/d62/l84 0 2024-09-13T02:53:54.855 INFO:tasks.workunit.client.1.smithi131.stdout:1/357: write fc [846796,91945] 0 2024-09-13T02:53:54.856 INFO:tasks.workunit.client.1.smithi131.stdout:1/358: creat dd/f7e x:0 0 0 2024-09-13T02:53:54.863 INFO:tasks.workunit.client.1.smithi131.stdout:7/319: dwrite d1b/f2c [0,4194304] 0 2024-09-13T02:53:54.863 INFO:tasks.workunit.client.1.smithi131.stdout:7/320: stat c9 0 2024-09-13T02:53:54.863 INFO:tasks.workunit.client.1.smithi131.stdout:2/353: dwrite d5/d31/d21/f72 [0,4194304] 0 2024-09-13T02:53:54.863 INFO:tasks.workunit.client.1.smithi131.stdout:2/354: fsync d5/d33/d66/f74 0 2024-09-13T02:53:54.865 INFO:tasks.workunit.client.1.smithi131.stdout:7/321: creat d1b/d3b/d46/f6a x:0 0 0 2024-09-13T02:53:54.865 INFO:tasks.workunit.client.1.smithi131.stdout:7/322: readlink ld 0 2024-09-13T02:53:54.865 INFO:tasks.workunit.client.1.smithi131.stdout:7/323: creat d1b/d3b/f6b x:0 0 0 2024-09-13T02:53:54.867 INFO:tasks.workunit.client.1.smithi131.stdout:2/355: stat d5/l11 0 2024-09-13T02:53:54.867 INFO:tasks.workunit.client.1.smithi131.stdout:2/356: creat d5/d31/d26/f77 x:0 0 0 2024-09-13T02:53:54.869 INFO:tasks.workunit.client.1.smithi131.stdout:2/357: dread d5/d18/d4b/f40 [0,4194304] 0 2024-09-13T02:53:54.869 INFO:tasks.workunit.client.1.smithi131.stdout:1/359: dread dd/d26/f35 [0,4194304] 0 2024-09-13T02:53:54.871 INFO:tasks.workunit.client.1.smithi131.stdout:2/358: mkdir d5/d31/d4e/d78 0 2024-09-13T02:53:54.871 INFO:tasks.workunit.client.1.smithi131.stdout:2/359: fsync d5/d31/d26/f63 0 2024-09-13T02:53:54.871 INFO:tasks.workunit.client.1.smithi131.stdout:2/360: dread - d5/d31/d4e/f60 zero size 2024-09-13T02:53:54.871 INFO:tasks.workunit.client.1.smithi131.stdout:2/361: stat d5/fe 0 2024-09-13T02:53:54.871 INFO:tasks.workunit.client.1.smithi131.stdout:1/360: symlink dd/d33/l7f 0 2024-09-13T02:53:54.872 INFO:tasks.workunit.client.1.smithi131.stdout:2/362: truncate d5/d31/d1d/d32/f38 1919681 0 2024-09-13T02:53:54.877 INFO:tasks.workunit.client.1.smithi131.stdout:7/324: write f3 [3107170,80112] 0 2024-09-13T02:53:54.877 INFO:tasks.workunit.client.1.smithi131.stdout:4/405: dwrite d1/d18/f2a [0,4194304] 0 2024-09-13T02:53:54.881 INFO:tasks.workunit.client.1.smithi131.stdout:7/325: dread d1b/d3b/f55 [0,4194304] 0 2024-09-13T02:53:54.882 INFO:tasks.workunit.client.0.smithi089.stdout:8/71: dwrite de/f10 [0,4194304] 0 2024-09-13T02:53:54.882 INFO:tasks.workunit.client.0.smithi089.stdout:8/72: creat de/f17 x:0 0 0 2024-09-13T02:53:54.882 INFO:tasks.workunit.client.1.smithi131.stdout:7/326: getdents d1b/d3b/d46 0 2024-09-13T02:53:54.882 INFO:tasks.workunit.client.1.smithi131.stdout:7/327: write d1b/d3b/d46/f6a [1029598,767] 0 2024-09-13T02:53:54.884 INFO:tasks.workunit.client.1.smithi131.stdout:7/328: mknod d1b/d3b/d31/d4e/c6c 0 2024-09-13T02:53:54.884 INFO:tasks.workunit.client.1.smithi131.stdout:1/361: write f0 [339705,65570] 0 2024-09-13T02:53:54.885 INFO:tasks.workunit.client.1.smithi131.stdout:1/362: mkdir dd/d33/d80 0 2024-09-13T02:53:54.889 INFO:tasks.workunit.client.1.smithi131.stdout:7/329: mkdir d1b/d3b/d51/d62/d6d 0 2024-09-13T02:53:54.901 INFO:tasks.workunit.client.1.smithi131.stdout:2/363: dwrite d5/d31/d26/f39 [0,4194304] 0 2024-09-13T02:53:54.908 INFO:tasks.workunit.client.1.smithi131.stdout:4/406: dwrite d1/d18/d43/f6c [0,4194304] 0 2024-09-13T02:53:54.908 INFO:tasks.workunit.client.1.smithi131.stdout:4/407: fsync d1/d18/d43/f6c 0 2024-09-13T02:53:54.910 INFO:tasks.workunit.client.0.smithi089.stdout:8/73: truncate f0 1293154 0 2024-09-13T02:53:54.910 INFO:tasks.workunit.client.0.smithi089.stdout:8/74: creat de/f18 x:0 0 0 2024-09-13T02:53:54.911 INFO:tasks.workunit.client.1.smithi131.stdout:4/408: link d1/d8/l4b d1/d18/d34/d62/l85 0 2024-09-13T02:53:54.913 INFO:tasks.workunit.client.0.smithi089.stdout:8/75: symlink de/d16/l19 0 2024-09-13T02:53:54.913 INFO:tasks.workunit.client.0.smithi089.stdout:8/76: write fb [3354816,41703] 0 2024-09-13T02:53:54.913 INFO:tasks.workunit.client.0.smithi089.stdout:8/77: dread - de/f12 zero size 2024-09-13T02:53:54.913 INFO:tasks.workunit.client.0.smithi089.stdout:8/78: creat de/f1a x:0 0 0 2024-09-13T02:53:54.913 INFO:tasks.workunit.client.1.smithi131.stdout:4/409: link d1/dc/d22/c39 d1/d18/d34/d62/c86 0 2024-09-13T02:53:54.914 INFO:tasks.workunit.client.1.smithi131.stdout:4/410: chown d1/dc/f41 4 1 2024-09-13T02:53:54.914 INFO:tasks.workunit.client.1.smithi131.stdout:4/411: write d1/dc/d19/d29/d33/f37 [622932,16290] 0 2024-09-13T02:53:54.914 INFO:tasks.workunit.client.1.smithi131.stdout:4/412: unlink d1/dc/d22/d49/f70 0 2024-09-13T02:53:54.914 INFO:tasks.workunit.client.1.smithi131.stdout:4/413: creat d1/dc/d22/d73/f87 x:0 0 0 2024-09-13T02:53:54.915 INFO:tasks.workunit.client.1.smithi131.stdout:2/364: dread d5/d31/d21/f72 [0,4194304] 0 2024-09-13T02:53:54.915 INFO:tasks.workunit.client.1.smithi131.stdout:4/414: symlink d1/d18/d43/d65/l88 0 2024-09-13T02:53:54.916 INFO:tasks.workunit.client.1.smithi131.stdout:4/415: fsync d1/f27 0 2024-09-13T02:53:54.916 INFO:tasks.workunit.client.1.smithi131.stdout:7/330: dwrite f7 [0,4194304] 0 2024-09-13T02:53:54.917 INFO:tasks.workunit.client.1.smithi131.stdout:1/363: dwrite dd/d26/d44/f32 [0,4194304] 0 2024-09-13T02:53:54.917 INFO:tasks.workunit.client.1.smithi131.stdout:1/364: write dd/d26/d2a/f61 [4273581,25156] 0 2024-09-13T02:53:54.918 INFO:tasks.workunit.client.1.smithi131.stdout:7/331: creat d1b/d3b/d46/f6e x:0 0 0 2024-09-13T02:53:54.918 INFO:tasks.workunit.client.1.smithi131.stdout:7/332: fdatasync d1b/d3b/f5b 0 2024-09-13T02:53:54.918 INFO:tasks.workunit.client.1.smithi131.stdout:7/333: chown d1b/d3b/d41/f59 4841874 1 2024-09-13T02:53:54.919 INFO:tasks.workunit.client.1.smithi131.stdout:7/334: write d1b/d3b/d31/d38/f50 [587441,14202] 0 2024-09-13T02:53:54.919 INFO:tasks.workunit.client.1.smithi131.stdout:7/335: symlink d1b/d3b/d31/d4e/l6f 0 2024-09-13T02:53:54.921 INFO:tasks.workunit.client.1.smithi131.stdout:7/336: creat d1b/d3b/d46/d4b/d5d/f70 x:0 0 0 2024-09-13T02:53:54.927 INFO:tasks.workunit.client.1.smithi131.stdout:2/365: write d5/d18/f1b [4344582,123454] 0 2024-09-13T02:53:54.928 INFO:tasks.workunit.client.1.smithi131.stdout:1/365: fsync dd/d26/d2a/d2c/f34 0 2024-09-13T02:53:54.932 INFO:tasks.workunit.client.1.smithi131.stdout:1/366: symlink dd/d26/d2a/d2c/l81 0 2024-09-13T02:53:54.934 INFO:tasks.workunit.client.1.smithi131.stdout:7/337: dread f10 [0,4194304] 0 2024-09-13T02:53:54.934 INFO:tasks.workunit.client.1.smithi131.stdout:7/338: read - d1b/d3b/f6b zero size 2024-09-13T02:53:54.935 INFO:tasks.workunit.client.1.smithi131.stdout:7/339: creat d1b/d3b/d51/f71 x:0 0 0 2024-09-13T02:53:54.935 INFO:tasks.workunit.client.1.smithi131.stdout:7/340: write f3 [1059063,62306] 0 2024-09-13T02:53:54.937 INFO:tasks.workunit.client.1.smithi131.stdout:7/341: mknod d1b/d3b/d46/d4b/d5d/c72 0 2024-09-13T02:53:54.943 INFO:tasks.workunit.client.1.smithi131.stdout:4/416: dwrite d1/dc/f2e [0,4194304] 0 2024-09-13T02:53:54.943 INFO:tasks.workunit.client.1.smithi131.stdout:4/417: readlink d1/d18/d43/d65/l88 0 2024-09-13T02:53:54.943 INFO:tasks.workunit.client.0.smithi089.stdout:8/79: dwrite f9 [0,4194304] 0 2024-09-13T02:53:54.944 INFO:tasks.workunit.client.1.smithi131.stdout:4/418: mknod d1/d8/c89 0 2024-09-13T02:53:54.944 INFO:tasks.workunit.client.1.smithi131.stdout:4/419: chown d1/d8/f15 196147167 1 2024-09-13T02:53:54.946 INFO:tasks.workunit.client.0.smithi089.stdout:8/80: rename fb to de/d16/f1b 0 2024-09-13T02:53:54.947 INFO:tasks.workunit.client.1.smithi131.stdout:2/366: truncate d5/d31/d21/f72 2381536 0 2024-09-13T02:53:54.953 INFO:tasks.workunit.client.1.smithi131.stdout:1/367: dwrite dd/d26/d2a/d2c/f39 [0,4194304] 0 2024-09-13T02:53:54.953 INFO:tasks.workunit.client.1.smithi131.stdout:1/368: getdents dd/d33/d80 0 2024-09-13T02:53:54.954 INFO:tasks.workunit.client.0.smithi089.stdout:8/81: getdents de/d16 0 2024-09-13T02:53:54.960 INFO:tasks.workunit.client.1.smithi131.stdout:1/369: rmdir dd/d33/d42 39 2024-09-13T02:53:54.962 INFO:tasks.workunit.client.1.smithi131.stdout:7/342: rename d1b/d3b/d46/d4b/d5d to d1b/d73 0 2024-09-13T02:53:54.962 INFO:tasks.workunit.client.1.smithi131.stdout:7/343: truncate d1b/d3b/d31/d38/f50 1414600 0 2024-09-13T02:53:54.962 INFO:tasks.workunit.client.1.smithi131.stdout:1/370: symlink dd/d33/d42/d47/l82 0 2024-09-13T02:53:54.964 INFO:tasks.workunit.client.1.smithi131.stdout:7/344: rename d1b/d3b/d51/f71 to d1b/d3b/d31/d5f/f74 0 2024-09-13T02:53:54.964 INFO:tasks.workunit.client.1.smithi131.stdout:7/345: fsync d1b/d23/f28 0 2024-09-13T02:53:54.964 INFO:tasks.workunit.client.1.smithi131.stdout:7/346: truncate d1b/d23/d54/f65 3679917 0 2024-09-13T02:53:54.965 INFO:tasks.workunit.client.1.smithi131.stdout:7/347: rmdir d1b/d23/d54 39 2024-09-13T02:53:54.967 INFO:tasks.workunit.client.1.smithi131.stdout:7/348: dread f4 [4194304,4194304] 0 2024-09-13T02:53:54.968 INFO:tasks.workunit.client.1.smithi131.stdout:7/349: symlink d1b/d3b/d51/d62/d6d/l75 0 2024-09-13T02:53:54.970 INFO:tasks.workunit.client.1.smithi131.stdout:1/371: dread dd/d26/d2a/f61 [0,4194304] 0 2024-09-13T02:53:54.971 INFO:tasks.workunit.client.1.smithi131.stdout:1/372: creat dd/d26/d2a/d69/f83 x:0 0 0 2024-09-13T02:53:54.971 INFO:tasks.workunit.client.1.smithi131.stdout:1/373: chown dd/f15 15 1 2024-09-13T02:53:54.971 INFO:tasks.workunit.client.1.smithi131.stdout:7/350: dread d1b/d3b/f55 [0,4194304] 0 2024-09-13T02:53:54.971 INFO:tasks.workunit.client.1.smithi131.stdout:1/374: mknod dd/d26/c84 0 2024-09-13T02:53:54.972 INFO:tasks.workunit.client.1.smithi131.stdout:1/375: mknod dd/d26/d2a/d2c/c85 0 2024-09-13T02:53:54.972 INFO:tasks.workunit.client.1.smithi131.stdout:7/351: write d1b/d3b/f5b [470513,57015] 0 2024-09-13T02:53:54.973 INFO:tasks.workunit.client.1.smithi131.stdout:1/376: mknod dd/d26/d44/d6d/c86 0 2024-09-13T02:53:54.974 INFO:tasks.workunit.client.1.smithi131.stdout:1/377: creat dd/d26/f87 x:0 0 0 2024-09-13T02:53:54.974 INFO:tasks.workunit.client.1.smithi131.stdout:1/378: fsync dd/d26/d2a/f49 0 2024-09-13T02:53:54.975 INFO:tasks.workunit.client.1.smithi131.stdout:1/379: symlink dd/d33/d42/d47/l88 0 2024-09-13T02:53:54.975 INFO:tasks.workunit.client.1.smithi131.stdout:1/380: write dd/d26/f87 [112441,102349] 0 2024-09-13T02:53:54.976 INFO:tasks.workunit.client.1.smithi131.stdout:1/381: creat dd/d51/f89 x:0 0 0 2024-09-13T02:53:54.977 INFO:tasks.workunit.client.1.smithi131.stdout:1/382: mkdir dd/d51/d8a 0 2024-09-13T02:53:54.982 INFO:tasks.workunit.client.1.smithi131.stdout:1/383: write dd/d26/d2a/f61 [451026,122205] 0 2024-09-13T02:53:54.983 INFO:tasks.workunit.client.1.smithi131.stdout:1/384: write f0 [1391358,9968] 0 2024-09-13T02:53:54.984 INFO:tasks.workunit.client.1.smithi131.stdout:1/385: creat dd/d33/d80/f8b x:0 0 0 2024-09-13T02:53:54.996 INFO:tasks.workunit.client.1.smithi131.stdout:7/352: dwrite d1b/d3b/d46/f6e [0,4194304] 0 2024-09-13T02:53:54.997 INFO:tasks.workunit.client.1.smithi131.stdout:7/353: fsync d1b/d3b/f55 0 2024-09-13T02:53:55.005 INFO:tasks.workunit.client.1.smithi131.stdout:7/354: getdents d1b/d3b/d46/d4b 0 2024-09-13T02:53:55.006 INFO:tasks.workunit.client.1.smithi131.stdout:7/355: unlink ld 0 2024-09-13T02:53:55.006 INFO:tasks.workunit.client.1.smithi131.stdout:7/356: fdatasync d1b/d3b/d31/f5c 0 2024-09-13T02:53:55.007 INFO:tasks.workunit.client.1.smithi131.stdout:7/357: getdents d1b/d3b/d51/d62 0 2024-09-13T02:53:55.016 INFO:tasks.workunit.client.1.smithi131.stdout:7/358: dread d1b/f2c [0,4194304] 0 2024-09-13T02:53:55.016 INFO:tasks.workunit.client.1.smithi131.stdout:7/359: write d1b/d3b/d41/f59 [820948,113286] 0 2024-09-13T02:53:55.016 INFO:tasks.workunit.client.1.smithi131.stdout:7/360: creat d1b/d3b/d31/d4e/f76 x:0 0 0 2024-09-13T02:53:55.016 INFO:tasks.workunit.client.1.smithi131.stdout:7/361: chown d1b/d23/d54/l68 0 1 2024-09-13T02:53:55.016 INFO:tasks.workunit.client.1.smithi131.stdout:7/362: creat d1b/d3b/d41/f77 x:0 0 0 2024-09-13T02:53:55.016 INFO:tasks.workunit.client.1.smithi131.stdout:7/363: write d1b/d3b/f6b [108564,46750] 0 2024-09-13T02:53:55.017 INFO:tasks.workunit.client.1.smithi131.stdout:7/364: readlink d1b/d3b/l35 0 2024-09-13T02:53:55.017 INFO:tasks.workunit.client.1.smithi131.stdout:7/365: symlink d1b/d73/l78 0 2024-09-13T02:53:55.018 INFO:tasks.workunit.client.1.smithi131.stdout:7/366: unlink d1b/d3b/d51/d62/d6d/l75 0 2024-09-13T02:53:55.018 INFO:tasks.workunit.client.1.smithi131.stdout:7/367: write d1b/d3b/f6b [1031355,33245] 0 2024-09-13T02:53:55.019 INFO:tasks.workunit.client.1.smithi131.stdout:7/368: creat d1b/d3b/d31/d5f/f79 x:0 0 0 2024-09-13T02:53:55.020 INFO:tasks.workunit.client.1.smithi131.stdout:7/369: rename d1b/d3b/d31/d4e/f76 to d1b/d3b/d51/d62/f7a 0 2024-09-13T02:53:55.034 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:53:54 smithi089 ceph-mon[27639]: pgmap v239: 65 pgs: 65 active+clean; 473 MiB data, 3.1 GiB used, 533 GiB / 536 GiB avail; 28 MiB/s rd, 42 MiB/s wr, 708 op/s 2024-09-13T02:53:55.037 INFO:tasks.workunit.client.1.smithi131.stdout:7/370: dwrite d1b/f21 [8388608,4194304] 0 2024-09-13T02:53:55.044 INFO:tasks.workunit.client.1.smithi131.stdout:7/371: write f7 [2670668,92189] 0 2024-09-13T02:53:55.050 INFO:tasks.workunit.client.1.smithi131.stdout:7/372: rename d1b/d3b/d31/d4e to d1b/d3b/d46/d4b/d57/d7b 0 2024-09-13T02:53:55.051 INFO:tasks.workunit.client.1.smithi131.stdout:7/373: mkdir d1b/d3b/d31/d7c 0 2024-09-13T02:53:55.051 INFO:tasks.workunit.client.1.smithi131.stdout:7/374: fsync d1b/d23/f28 0 2024-09-13T02:53:55.052 INFO:tasks.workunit.client.1.smithi131.stdout:7/375: rename d1b/d3b/l48 to d1b/d23/d54/l7d 0 2024-09-13T02:53:55.054 INFO:tasks.workunit.client.1.smithi131.stdout:7/376: rename d1b/d3b/d46/f6a to d1b/d3b/d31/d5f/f7e 0 2024-09-13T02:53:55.058 INFO:tasks.workunit.client.1.smithi131.stdout:7/377: link d1b/l1c d1b/d3b/d31/d5f/l7f 0 2024-09-13T02:53:55.063 INFO:tasks.workunit.client.1.smithi131.stdout:7/378: dread f3 [0,4194304] 0 2024-09-13T02:53:55.080 INFO:tasks.workunit.client.1.smithi131.stdout:5/277: sync 2024-09-13T02:53:55.080 INFO:tasks.workunit.client.1.smithi131.stdout:3/314: sync 2024-09-13T02:53:55.080 INFO:tasks.workunit.client.1.smithi131.stdout:5/278: creat d1/d2f/d33/f5b x:0 0 0 2024-09-13T02:53:55.080 INFO:tasks.workunit.client.1.smithi131.stdout:5/279: chown d1/d29/d39 876 1 2024-09-13T02:53:55.080 INFO:tasks.workunit.client.1.smithi131.stdout:7/379: dwrite d1b/d3b/d41/f77 [0,4194304] 0 2024-09-13T02:53:55.081 INFO:tasks.workunit.client.1.smithi131.stdout:3/315: mkdir d2/d4/d7/d1d/d24/d6f 0 2024-09-13T02:53:55.083 INFO:tasks.workunit.client.1.smithi131.stdout:7/380: creat d1b/d23/d54/f80 x:0 0 0 2024-09-13T02:53:55.084 INFO:tasks.workunit.client.1.smithi131.stdout:3/316: creat d2/d4/d7/d1d/d24/d6f/f70 x:0 0 0 2024-09-13T02:53:55.084 INFO:tasks.workunit.client.1.smithi131.stdout:3/317: write d2/dc/f65 [292675,9516] 0 2024-09-13T02:53:55.084 INFO:tasks.workunit.client.1.smithi131.stdout:7/381: mkdir d1b/d3b/d41/d81 0 2024-09-13T02:53:55.085 INFO:tasks.workunit.client.1.smithi131.stdout:3/318: mkdir d2/d4/d7/d8/d41/d5c/d71 0 2024-09-13T02:53:55.086 INFO:tasks.workunit.client.1.smithi131.stdout:7/382: getdents d1b/d3b/d51/d62 0 2024-09-13T02:53:55.088 INFO:tasks.workunit.client.1.smithi131.stdout:5/280: write d1/d29/d3e/f42 [979375,67164] 0 2024-09-13T02:53:55.088 INFO:tasks.workunit.client.1.smithi131.stdout:3/319: rmdir d2/dc 39 2024-09-13T02:53:55.112 INFO:tasks.workunit.client.1.smithi131.stdout:5/281: dwrite d1/d21/f51 [0,4194304] 0 2024-09-13T02:53:55.112 INFO:tasks.workunit.client.1.smithi131.stdout:3/320: dwrite d2/d4/d7/d1d/f2c [0,4194304] 0 2024-09-13T02:53:55.115 INFO:tasks.workunit.client.1.smithi131.stdout:3/321: creat d2/dc/d39/f72 x:0 0 0 2024-09-13T02:53:55.115 INFO:tasks.workunit.client.1.smithi131.stdout:3/322: write d2/d4/f23 [634954,28462] 0 2024-09-13T02:53:55.116 INFO:tasks.workunit.client.1.smithi131.stdout:3/323: mkdir d2/d4/d7/d1d/d24/d6f/d73 0 2024-09-13T02:53:55.116 INFO:tasks.workunit.client.1.smithi131.stdout:3/324: write d2/d4/d7/d8/d41/d5c/f4e [484470,100116] 0 2024-09-13T02:53:55.117 INFO:tasks.workunit.client.1.smithi131.stdout:3/325: truncate d2/dc/d39/f3d 3150070 0 2024-09-13T02:53:55.120 INFO:tasks.workunit.client.1.smithi131.stdout:3/326: mknod d2/d4/d2d/c74 0 2024-09-13T02:53:55.120 INFO:tasks.workunit.client.1.smithi131.stdout:3/327: write d2/d4/d1a/f6b [763856,56253] 0 2024-09-13T02:53:55.122 INFO:tasks.workunit.client.1.smithi131.stdout:3/328: rename d2/d4/d7/d1d/d24/l4b to d2/d4/d7/d8/d41/l75 0 2024-09-13T02:53:55.122 INFO:tasks.workunit.client.1.smithi131.stdout:3/329: dread - d2/dc/d39/d61/f6c zero size 2024-09-13T02:53:55.127 INFO:tasks.workunit.client.1.smithi131.stdout:3/330: rmdir d2/d4/d7 39 2024-09-13T02:53:55.129 INFO:tasks.workunit.client.1.smithi131.stdout:3/331: mkdir d2/d4/d76 0 2024-09-13T02:53:55.130 INFO:tasks.workunit.client.1.smithi131.stdout:3/332: creat d2/d4/d1a/d31/d48/f77 x:0 0 0 2024-09-13T02:53:55.131 INFO:tasks.workunit.client.1.smithi131.stdout:3/333: link d2/d4/d1a/d31/f42 d2/dc/f78 0 2024-09-13T02:53:55.135 INFO:tasks.workunit.client.1.smithi131.stdout:3/334: dread d2/d4/f34 [0,4194304] 0 2024-09-13T02:53:55.135 INFO:tasks.workunit.client.1.smithi131.stdout:5/282: dwrite d1/d29/d39/d45/f48 [0,4194304] 0 2024-09-13T02:53:55.136 INFO:tasks.workunit.client.1.smithi131.stdout:3/335: creat d2/dc/d39/f79 x:0 0 0 2024-09-13T02:53:55.139 INFO:tasks.workunit.client.1.smithi131.stdout:5/283: rename d1/f1b to d1/d29/d39/d45/f5c 0 2024-09-13T02:53:55.139 INFO:tasks.workunit.client.1.smithi131.stdout:3/336: dread d2/d4/d1a/f6b [0,4194304] 0 2024-09-13T02:53:55.140 INFO:tasks.workunit.client.1.smithi131.stdout:5/284: symlink d1/d2f/d33/l5d 0 2024-09-13T02:53:55.140 INFO:tasks.workunit.client.1.smithi131.stdout:3/337: mkdir d2/d4/d7/d1d/d24/d6f/d7a 0 2024-09-13T02:53:55.141 INFO:tasks.workunit.client.1.smithi131.stdout:5/285: mknod d1/d21/c5e 0 2024-09-13T02:53:55.141 INFO:tasks.workunit.client.1.smithi131.stdout:5/286: getdents d1/d50 0 2024-09-13T02:53:55.142 INFO:tasks.workunit.client.1.smithi131.stdout:5/287: unlink d1/d2f/d33/f59 0 2024-09-13T02:53:55.143 INFO:tasks.workunit.client.1.smithi131.stdout:5/288: symlink d1/d1c/l5f 0 2024-09-13T02:53:55.144 INFO:tasks.workunit.client.1.smithi131.stdout:3/338: dread d2/d4/d7/d1d/f2e [0,4194304] 0 2024-09-13T02:53:55.145 INFO:tasks.workunit.client.1.smithi131.stdout:3/339: creat d2/d4/d1a/f7b x:0 0 0 2024-09-13T02:53:55.145 INFO:tasks.workunit.client.1.smithi131.stdout:3/340: stat d2/d4/d7/f62 0 2024-09-13T02:53:55.145 INFO:tasks.workunit.client.1.smithi131.stdout:3/341: dread - d2/d4/d1a/f7b zero size 2024-09-13T02:53:55.146 INFO:tasks.workunit.client.1.smithi131.stdout:3/342: creat d2/d4/d7/d1d/d24/d6f/f7c x:0 0 0 2024-09-13T02:53:55.153 INFO:tasks.workunit.client.1.smithi131.stdout:5/289: dread d1/d5/f13 [4194304,4194304] 0 2024-09-13T02:53:55.153 INFO:tasks.workunit.client.1.smithi131.stdout:5/290: readlink d1/d2f/d33/l4c 0 2024-09-13T02:53:55.155 INFO:tasks.workunit.client.1.smithi131.stdout:3/343: dread d2/dc/f78 [0,4194304] 0 2024-09-13T02:53:55.157 INFO:tasks.workunit.client.1.smithi131.stdout:3/344: rename d2/d4/d7/d1d/l19 to d2/d4/d7/d8/d41/d5c/d4f/l7d 0 2024-09-13T02:53:55.158 INFO:tasks.workunit.client.1.smithi131.stdout:3/345: mkdir d2/d4/d7/d1d/d24/d7e 0 2024-09-13T02:53:55.158 INFO:tasks.workunit.client.1.smithi131.stdout:3/346: getdents d2/d4/d7/d8/d41/d5c/d71 0 2024-09-13T02:53:55.159 INFO:tasks.workunit.client.1.smithi131.stdout:3/347: truncate d2/d4/d2d/f33 1729424 0 2024-09-13T02:53:55.161 INFO:tasks.workunit.client.1.smithi131.stdout:5/291: rmdir d1/d2f 39 2024-09-13T02:53:55.162 INFO:tasks.workunit.client.1.smithi131.stdout:5/292: mkdir d1/d5/d57/d60 0 2024-09-13T02:53:55.163 INFO:tasks.workunit.client.1.smithi131.stdout:5/293: symlink d1/d5/d57/l61 0 2024-09-13T02:53:55.163 INFO:tasks.workunit.client.1.smithi131.stdout:5/294: readlink d1/d21/d22/l2d 0 2024-09-13T02:53:55.163 INFO:tasks.workunit.client.1.smithi131.stdout:5/295: truncate d1/d5/f4e 5304 0 2024-09-13T02:53:55.163 INFO:tasks.workunit.client.1.smithi131.stdout:5/296: write d1/f23 [345322,40560] 0 2024-09-13T02:53:55.164 INFO:tasks.workunit.client.1.smithi131.stdout:5/297: mknod d1/d29/d39/d45/c62 0 2024-09-13T02:53:55.164 INFO:tasks.workunit.client.1.smithi131.stdout:5/298: fsync d1/d2f/f3c 0 2024-09-13T02:53:55.167 INFO:tasks.workunit.client.1.smithi131.stdout:3/348: dread d2/d4/d1a/f37 [0,4194304] 0 2024-09-13T02:53:55.168 INFO:tasks.workunit.client.1.smithi131.stdout:3/349: mkdir d2/d4/d7/d1d/d24/d6f/d7f 0 2024-09-13T02:53:55.169 INFO:tasks.workunit.client.1.smithi131.stdout:3/350: getdents d2/d4 0 2024-09-13T02:53:55.169 INFO:tasks.workunit.client.1.smithi131.stdout:3/351: dread - d2/d4/d7/f4d zero size 2024-09-13T02:53:55.174 INFO:tasks.workunit.client.0.smithi089.stdout:1/28: sync 2024-09-13T02:53:55.174 INFO:tasks.workunit.client.0.smithi089.stdout:3/26: sync 2024-09-13T02:53:55.174 INFO:tasks.workunit.client.0.smithi089.stdout:0/26: sync 2024-09-13T02:53:55.174 INFO:tasks.workunit.client.0.smithi089.stdout:0/27: chown d2/f3 2639 1 2024-09-13T02:53:55.174 INFO:tasks.workunit.client.0.smithi089.stdout:0/28: dread - d2/f4 zero size 2024-09-13T02:53:55.174 INFO:tasks.workunit.client.0.smithi089.stdout:1/29: write f8 [1002074,21425] 0 2024-09-13T02:53:55.174 INFO:tasks.workunit.client.1.smithi131.stdout:5/299: write d1/d5/f3a [4026984,97112] 0 2024-09-13T02:53:55.175 INFO:tasks.workunit.client.1.smithi131.stdout:5/300: link d1/d2f/d33/l47 d1/d29/d3e/l63 0 2024-09-13T02:53:55.176 INFO:tasks.workunit.client.0.smithi089.stdout:3/27: symlink d2/l9 0 2024-09-13T02:53:55.176 INFO:tasks.workunit.client.0.smithi089.stdout:3/28: dread - no filename 2024-09-13T02:53:55.176 INFO:tasks.workunit.client.0.smithi089.stdout:3/29: rename d2 to d2/d4/da 22 2024-09-13T02:53:55.176 INFO:tasks.workunit.client.0.smithi089.stdout:3/30: chown d2 111443 1 2024-09-13T02:53:55.176 INFO:tasks.workunit.client.0.smithi089.stdout:1/30: dread f3 [0,4194304] 0 2024-09-13T02:53:55.176 INFO:tasks.workunit.client.0.smithi089.stdout:0/29: mknod d2/c7 0 2024-09-13T02:53:55.177 INFO:tasks.workunit.client.0.smithi089.stdout:1/31: symlink la 0 2024-09-13T02:53:55.177 INFO:tasks.workunit.client.0.smithi089.stdout:1/32: write f8 [1331338,70081] 0 2024-09-13T02:53:55.177 INFO:tasks.workunit.client.0.smithi089.stdout:3/31: getdents d2/d4 0 2024-09-13T02:53:55.179 INFO:tasks.workunit.client.0.smithi089.stdout:3/32: mkdir d2/d8/db 0 2024-09-13T02:53:55.182 INFO:tasks.workunit.client.0.smithi089.stdout:3/33: rename d2/d4 to d2/d8/dc 0 2024-09-13T02:53:55.182 INFO:tasks.workunit.client.0.smithi089.stdout:3/34: read - no filename 2024-09-13T02:53:55.182 INFO:tasks.workunit.client.0.smithi089.stdout:3/35: dread - no filename 2024-09-13T02:53:55.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:53:54 smithi131 ceph-mon[34689]: pgmap v239: 65 pgs: 65 active+clean; 473 MiB data, 3.1 GiB used, 533 GiB / 536 GiB avail; 28 MiB/s rd, 42 MiB/s wr, 708 op/s 2024-09-13T02:53:55.201 INFO:tasks.workunit.client.1.smithi131.stdout:5/301: dwrite d1/d21/f25 [0,4194304] 0 2024-09-13T02:53:55.201 INFO:tasks.workunit.client.1.smithi131.stdout:5/302: write d1/d2f/d33/f5b [248535,64436] 0 2024-09-13T02:53:55.202 INFO:tasks.workunit.client.1.smithi131.stdout:5/303: mknod d1/d29/d3e/c64 0 2024-09-13T02:53:55.202 INFO:tasks.workunit.client.1.smithi131.stdout:5/304: creat d1/d5/f65 x:0 0 0 2024-09-13T02:53:55.202 INFO:tasks.workunit.client.1.smithi131.stdout:5/305: truncate d1/d5/f4e 356903 0 2024-09-13T02:53:55.203 INFO:tasks.workunit.client.1.smithi131.stdout:5/306: rmdir d1/d21 39 2024-09-13T02:53:55.212 INFO:tasks.workunit.client.1.smithi131.stdout:5/307: read d1/d29/d39/d45/f43 [1950139,63067] 0 2024-09-13T02:53:55.212 INFO:tasks.workunit.client.1.smithi131.stdout:3/352: dwrite d2/d4/d1a/d31/d48/f77 [0,4194304] 0 2024-09-13T02:53:55.213 INFO:tasks.workunit.client.1.smithi131.stdout:5/308: rename d1/l44 to d1/d2f/d4f/l66 0 2024-09-13T02:53:55.213 INFO:tasks.workunit.client.1.smithi131.stdout:5/309: truncate d1/d5/f65 77994 0 2024-09-13T02:53:55.214 INFO:tasks.workunit.client.0.smithi089.stdout:0/30: dwrite d2/f5 [0,4194304] 0 2024-09-13T02:53:55.214 INFO:tasks.workunit.client.0.smithi089.stdout:0/31: stat d2/f4 0 2024-09-13T02:53:55.215 INFO:tasks.workunit.client.1.smithi131.stdout:3/353: mkdir d2/d4/d7/d1d/d80 0 2024-09-13T02:53:55.215 INFO:tasks.workunit.client.0.smithi089.stdout:1/33: dwrite f7 [0,4194304] 0 2024-09-13T02:53:55.215 INFO:tasks.workunit.client.0.smithi089.stdout:1/34: dread - f5 zero size 2024-09-13T02:53:55.216 INFO:tasks.workunit.client.1.smithi131.stdout:5/310: symlink d1/d5/l67 0 2024-09-13T02:53:55.218 INFO:tasks.workunit.client.0.smithi089.stdout:0/32: dread f1 [0,4194304] 0 2024-09-13T02:53:55.218 INFO:tasks.workunit.client.1.smithi131.stdout:3/354: symlink d2/d4/d1a/l81 0 2024-09-13T02:53:55.218 INFO:tasks.workunit.client.1.smithi131.stdout:3/355: dread - d2/dc/d39/d61/f6c zero size 2024-09-13T02:53:55.219 INFO:tasks.workunit.client.0.smithi089.stdout:0/33: mknod d2/c8 0 2024-09-13T02:53:55.219 INFO:tasks.workunit.client.1.smithi131.stdout:3/356: symlink d2/d4/l82 0 2024-09-13T02:53:55.221 INFO:tasks.workunit.client.1.smithi131.stdout:3/357: dread - d2/d4/d7/d8/f6a zero size 2024-09-13T02:53:55.222 INFO:tasks.workunit.client.0.smithi089.stdout:0/34: symlink d2/l9 0 2024-09-13T02:53:55.222 INFO:tasks.workunit.client.0.smithi089.stdout:0/35: chown d2 422968 1 2024-09-13T02:53:55.222 INFO:tasks.workunit.client.0.smithi089.stdout:0/36: fdatasync d2/f3 0 2024-09-13T02:53:55.224 INFO:tasks.workunit.client.0.smithi089.stdout:0/37: unlink d2/f5 0 2024-09-13T02:53:55.243 INFO:tasks.workunit.client.1.smithi131.stdout:5/311: dwrite d1/d1c/f1d [0,4194304] 0 2024-09-13T02:53:55.243 INFO:tasks.workunit.client.1.smithi131.stdout:5/312: chown d1/f2c 445351 1 2024-09-13T02:53:55.243 INFO:tasks.workunit.client.0.smithi089.stdout:1/35: dwrite f2 [0,4194304] 0 2024-09-13T02:53:55.244 INFO:tasks.workunit.client.1.smithi131.stdout:3/358: dwrite d2/d4/f9 [0,4194304] 0 2024-09-13T02:53:55.244 INFO:tasks.workunit.client.1.smithi131.stdout:5/313: mknod d1/d5/c68 0 2024-09-13T02:53:55.244 INFO:tasks.workunit.client.1.smithi131.stdout:5/314: write d1/f2c [3749301,61953] 0 2024-09-13T02:53:55.245 INFO:tasks.workunit.client.1.smithi131.stdout:5/315: getdents d1/d21 0 2024-09-13T02:53:55.245 INFO:tasks.workunit.client.0.smithi089.stdout:1/36: symlink lb 0 2024-09-13T02:53:55.246 INFO:tasks.workunit.client.1.smithi131.stdout:5/316: creat d1/d2f/f69 x:0 0 0 2024-09-13T02:53:55.246 INFO:tasks.workunit.client.0.smithi089.stdout:1/37: mkdir dc 0 2024-09-13T02:53:55.247 INFO:tasks.workunit.client.0.smithi089.stdout:1/38: creat dc/fd x:0 0 0 2024-09-13T02:53:55.249 INFO:tasks.workunit.client.0.smithi089.stdout:1/39: unlink f5 0 2024-09-13T02:53:55.261 INFO:tasks.workunit.client.1.smithi131.stdout:3/359: write d2/d4/d7/d1d/f30 [3061292,23681] 0 2024-09-13T02:53:55.261 INFO:tasks.workunit.client.1.smithi131.stdout:3/360: fsync d2/d4/d7/d1d/d24/d6f/f7c 0 2024-09-13T02:53:55.261 INFO:tasks.workunit.client.1.smithi131.stdout:3/361: chown d2/dc/l44 2 1 2024-09-13T02:53:55.262 INFO:tasks.workunit.client.1.smithi131.stdout:3/362: mknod d2/d4/d7/d8/d41/d6e/c83 0 2024-09-13T02:53:55.263 INFO:tasks.workunit.client.1.smithi131.stdout:3/363: creat d2/d4/f84 x:0 0 0 2024-09-13T02:53:55.263 INFO:tasks.workunit.client.1.smithi131.stdout:3/364: truncate d2/dc/f78 4587753 0 2024-09-13T02:53:55.263 INFO:tasks.workunit.client.1.smithi131.stdout:3/365: truncate d2/d4/d1a/d31/f42 5313732 0 2024-09-13T02:53:55.263 INFO:tasks.workunit.client.1.smithi131.stdout:3/366: write d2/d4/d7/d1d/f2e [2062556,77901] 0 2024-09-13T02:53:55.264 INFO:tasks.workunit.client.0.smithi089.stdout:1/40: dread f3 [0,4194304] 0 2024-09-13T02:53:55.264 INFO:tasks.workunit.client.1.smithi131.stdout:3/367: creat d2/d4/d7/d1d/d24/d7e/f85 x:0 0 0 2024-09-13T02:53:55.264 INFO:tasks.workunit.client.1.smithi131.stdout:3/368: symlink d2/d4/d7/d1d/l86 0 2024-09-13T02:53:55.264 INFO:tasks.workunit.client.1.smithi131.stdout:3/369: stat d2/d4/d1a/l29 0 2024-09-13T02:53:55.265 INFO:tasks.workunit.client.0.smithi089.stdout:1/41: rename f0 to dc/fe 0 2024-09-13T02:53:55.267 INFO:tasks.workunit.client.0.smithi089.stdout:1/42: symlink dc/lf 0 2024-09-13T02:53:55.271 INFO:tasks.workunit.client.1.smithi131.stdout:5/317: dwrite d1/d29/d3e/f42 [0,4194304] 0 2024-09-13T02:53:55.273 INFO:tasks.workunit.client.1.smithi131.stdout:5/318: mknod d1/d29/d39/d45/c6a 0 2024-09-13T02:53:55.281 INFO:tasks.workunit.client.1.smithi131.stdout:5/319: dread d1/f2c [0,4194304] 0 2024-09-13T02:53:55.289 INFO:tasks.workunit.client.1.smithi131.stdout:5/320: write d1/d1c/f1d [1512337,103984] 0 2024-09-13T02:53:55.298 INFO:tasks.workunit.client.1.smithi131.stdout:5/321: write d1/d29/f2e [1453443,95496] 0 2024-09-13T02:53:55.298 INFO:tasks.workunit.client.1.smithi131.stdout:5/322: write d1/f2c [1704996,79607] 0 2024-09-13T02:53:55.298 INFO:tasks.workunit.client.1.smithi131.stdout:5/323: write d1/d2f/f69 [463838,8031] 0 2024-09-13T02:53:55.298 INFO:tasks.workunit.client.1.smithi131.stdout:5/324: stat d1/d1c/l5f 0 2024-09-13T02:53:55.315 INFO:tasks.workunit.client.1.smithi131.stdout:5/325: dwrite d1/d5/fa [0,4194304] 0 2024-09-13T02:53:55.323 INFO:tasks.workunit.client.1.smithi131.stdout:5/326: write d1/d1c/f53 [2680790,45867] 0 2024-09-13T02:53:55.324 INFO:tasks.workunit.client.1.smithi131.stdout:5/327: mknod d1/d1c/c6b 0 2024-09-13T02:53:55.325 INFO:tasks.workunit.client.1.smithi131.stdout:5/328: write d1/d5/f4e [668980,90376] 0 2024-09-13T02:53:55.338 INFO:tasks.workunit.client.1.smithi131.stdout:5/329: dwrite d1/d21/d22/f55 [0,4194304] 0 2024-09-13T02:53:55.338 INFO:tasks.workunit.client.1.smithi131.stdout:5/330: chown d1/d5/d57/l61 4185414 1 2024-09-13T02:53:55.338 INFO:tasks.workunit.client.1.smithi131.stdout:5/331: creat d1/d29/d39/d45/f6c x:0 0 0 2024-09-13T02:53:55.365 INFO:tasks.workunit.client.0.smithi089.stdout:5/34: sync 2024-09-13T02:53:55.366 INFO:tasks.workunit.client.0.smithi089.stdout:7/59: sync 2024-09-13T02:53:55.366 INFO:tasks.workunit.client.0.smithi089.stdout:2/85: sync 2024-09-13T02:53:55.366 INFO:tasks.workunit.client.0.smithi089.stdout:4/47: sync 2024-09-13T02:53:55.366 INFO:tasks.workunit.client.0.smithi089.stdout:6/45: sync 2024-09-13T02:53:55.366 INFO:tasks.workunit.client.0.smithi089.stdout:9/52: sync 2024-09-13T02:53:55.366 INFO:tasks.workunit.client.0.smithi089.stdout:8/82: sync 2024-09-13T02:53:55.366 INFO:tasks.workunit.client.0.smithi089.stdout:8/83: fdatasync de/f18 0 2024-09-13T02:53:55.367 INFO:tasks.workunit.client.0.smithi089.stdout:5/35: mknod d1/d4/ce 0 2024-09-13T02:53:55.367 INFO:tasks.workunit.client.0.smithi089.stdout:2/86: readlink d13/l16 0 2024-09-13T02:53:55.367 INFO:tasks.workunit.client.0.smithi089.stdout:6/46: chown l1 3820 1 2024-09-13T02:53:55.369 INFO:tasks.workunit.client.0.smithi089.stdout:7/60: creat d3/de/f18 x:0 0 0 2024-09-13T02:53:55.369 INFO:tasks.workunit.client.0.smithi089.stdout:7/61: dread - d3/de/f12 zero size 2024-09-13T02:53:55.369 INFO:tasks.workunit.client.0.smithi089.stdout:7/62: dread - d3/de/f12 zero size 2024-09-13T02:53:55.369 INFO:tasks.workunit.client.0.smithi089.stdout:7/63: write d3/de/f18 [399128,82608] 0 2024-09-13T02:53:55.370 INFO:tasks.workunit.client.0.smithi089.stdout:9/53: rename d3/fd to d3/d6/f14 0 2024-09-13T02:53:55.370 INFO:tasks.workunit.client.0.smithi089.stdout:9/54: dread - d3/d6/df/f12 zero size 2024-09-13T02:53:55.371 INFO:tasks.workunit.client.0.smithi089.stdout:8/84: rmdir de/d16 39 2024-09-13T02:53:55.372 INFO:tasks.workunit.client.0.smithi089.stdout:5/36: unlink d1/fa 0 2024-09-13T02:53:55.372 INFO:tasks.workunit.client.0.smithi089.stdout:5/37: write d1/d4/fc [254586,118923] 0 2024-09-13T02:53:55.372 INFO:tasks.workunit.client.0.smithi089.stdout:6/47: chown l4 61657 1 2024-09-13T02:53:55.375 INFO:tasks.workunit.client.0.smithi089.stdout:8/85: creat de/d16/f1c x:0 0 0 2024-09-13T02:53:55.375 INFO:tasks.workunit.client.0.smithi089.stdout:8/86: dread - de/f18 zero size 2024-09-13T02:53:55.376 INFO:tasks.workunit.client.0.smithi089.stdout:5/38: rename d1/l6 to d1/d4/lf 0 2024-09-13T02:53:55.378 INFO:tasks.workunit.client.0.smithi089.stdout:6/48: rmdir db/df 0 2024-09-13T02:53:55.378 INFO:tasks.workunit.client.0.smithi089.stdout:7/64: mkdir d3/d19 0 2024-09-13T02:53:55.379 INFO:tasks.workunit.client.0.smithi089.stdout:8/87: mknod de/c1d 0 2024-09-13T02:53:55.380 INFO:tasks.workunit.client.0.smithi089.stdout:5/39: mknod d1/c10 0 2024-09-13T02:53:55.380 INFO:tasks.workunit.client.0.smithi089.stdout:5/40: truncate d1/fd 920468 0 2024-09-13T02:53:55.380 INFO:tasks.workunit.client.0.smithi089.stdout:6/49: mkdir db/d10 0 2024-09-13T02:53:55.381 INFO:tasks.workunit.client.0.smithi089.stdout:7/65: creat d3/f1a x:0 0 0 2024-09-13T02:53:55.383 INFO:tasks.workunit.client.0.smithi089.stdout:8/88: mkdir de/d16/d1e 0 2024-09-13T02:53:55.383 INFO:tasks.workunit.client.0.smithi089.stdout:8/89: read - de/f14 zero size 2024-09-13T02:53:55.383 INFO:tasks.workunit.client.0.smithi089.stdout:8/90: creat de/d16/f1f x:0 0 0 2024-09-13T02:53:55.383 INFO:tasks.workunit.client.0.smithi089.stdout:8/91: dread - de/f18 zero size 2024-09-13T02:53:55.383 INFO:tasks.workunit.client.0.smithi089.stdout:8/92: readlink de/d16/l19 0 2024-09-13T02:53:55.383 INFO:tasks.workunit.client.0.smithi089.stdout:8/93: fsync de/f18 0 2024-09-13T02:53:55.383 INFO:tasks.workunit.client.0.smithi089.stdout:5/41: creat d1/d4/f11 x:0 0 0 2024-09-13T02:53:55.385 INFO:tasks.workunit.client.0.smithi089.stdout:6/50: truncate f0 1193102 0 2024-09-13T02:53:55.386 INFO:tasks.workunit.client.0.smithi089.stdout:6/51: creat db/d10/f11 x:0 0 0 2024-09-13T02:53:55.389 INFO:tasks.workunit.client.0.smithi089.stdout:9/55: dwrite d3/d6/f14 [0,4194304] 0 2024-09-13T02:53:55.389 INFO:tasks.workunit.client.0.smithi089.stdout:4/48: dwrite d2/f4 [8388608,4194304] 0 2024-09-13T02:53:55.389 INFO:tasks.workunit.client.0.smithi089.stdout:9/56: fsync d3/f5 0 2024-09-13T02:53:55.390 INFO:tasks.workunit.client.0.smithi089.stdout:4/49: rename d2/d3 to d2/d3/dd 22 2024-09-13T02:53:55.390 INFO:tasks.workunit.client.0.smithi089.stdout:4/50: write d2/f4 [1396521,42784] 0 2024-09-13T02:53:55.390 INFO:tasks.workunit.client.0.smithi089.stdout:9/57: read f2 [2818639,102911] 0 2024-09-13T02:53:55.402 INFO:tasks.workunit.client.0.smithi089.stdout:9/58: fsync d3/d6/f14 0 2024-09-13T02:53:55.405 INFO:tasks.workunit.client.1.smithi131.stdout:8/346: sync 2024-09-13T02:53:55.407 INFO:tasks.workunit.client.1.smithi131.stdout:8/347: rename db/d2e/f3b to db/d1d/d1f/d5c/f64 0 2024-09-13T02:53:55.410 INFO:tasks.workunit.client.1.smithi131.stdout:8/348: link db/c26 db/d2b/d39/d56/c65 0 2024-09-13T02:53:55.410 INFO:tasks.workunit.client.1.smithi131.stdout:8/349: chown f5 1940786986 1 2024-09-13T02:53:55.410 INFO:tasks.workunit.client.1.smithi131.stdout:8/350: write db/d1d/d1f/d5c/f64 [748033,19181] 0 2024-09-13T02:53:55.410 INFO:tasks.workunit.client.1.smithi131.stdout:8/351: chown db/d2b/d39/l3d 1084039 1 2024-09-13T02:53:55.412 INFO:tasks.workunit.client.1.smithi131.stdout:8/352: mkdir db/d1d/d1f/d66 0 2024-09-13T02:53:55.415 INFO:tasks.workunit.client.0.smithi089.stdout:9/59: write d3/d6/f14 [1594949,80609] 0 2024-09-13T02:53:55.434 INFO:tasks.workunit.client.0.smithi089.stdout:5/42: dwrite d1/d4/f11 [0,4194304] 0 2024-09-13T02:53:55.434 INFO:tasks.workunit.client.0.smithi089.stdout:5/43: chown d1/fd 27499104 1 2024-09-13T02:53:55.434 INFO:tasks.workunit.client.0.smithi089.stdout:6/52: dwrite f9 [0,4194304] 0 2024-09-13T02:53:55.436 INFO:tasks.workunit.client.0.smithi089.stdout:7/66: dwrite d3/de/f18 [0,4194304] 0 2024-09-13T02:53:55.436 INFO:tasks.workunit.client.0.smithi089.stdout:4/51: dwrite d2/f4 [0,4194304] 0 2024-09-13T02:53:55.437 INFO:tasks.workunit.client.0.smithi089.stdout:8/94: dwrite de/f15 [0,4194304] 0 2024-09-13T02:53:55.437 INFO:tasks.workunit.client.0.smithi089.stdout:6/53: creat db/f12 x:0 0 0 2024-09-13T02:53:55.438 INFO:tasks.workunit.client.0.smithi089.stdout:8/95: read f3 [2221416,126872] 0 2024-09-13T02:53:55.438 INFO:tasks.workunit.client.0.smithi089.stdout:8/96: dread - de/f12 zero size 2024-09-13T02:53:55.441 INFO:tasks.workunit.client.1.smithi131.stdout:8/353: dwrite db/d1d/f28 [0,4194304] 0 2024-09-13T02:53:55.442 INFO:tasks.workunit.client.0.smithi089.stdout:4/52: mkdir d2/d3/de 0 2024-09-13T02:53:55.444 INFO:tasks.workunit.client.1.smithi131.stdout:8/354: mkdir db/d1d/d1f/d67 0 2024-09-13T02:53:55.445 INFO:tasks.workunit.client.1.smithi131.stdout:8/355: write db/d1d/d1f/f2c [350231,107457] 0 2024-09-13T02:53:55.447 INFO:tasks.workunit.client.1.smithi131.stdout:8/356: getdents db/d2b/d39/d56 0 2024-09-13T02:53:55.449 INFO:tasks.workunit.client.0.smithi089.stdout:8/97: mkdir de/d16/d1e/d20 0 2024-09-13T02:53:55.449 INFO:tasks.workunit.client.1.smithi131.stdout:8/357: rename db/c13 to db/d1d/d34/c68 0 2024-09-13T02:53:55.450 INFO:tasks.workunit.client.1.smithi131.stdout:8/358: symlink db/d2e/d3a/l69 0 2024-09-13T02:53:55.450 INFO:tasks.workunit.client.1.smithi131.stdout:8/359: getdents db/d1d/d34/d4e 0 2024-09-13T02:53:55.450 INFO:tasks.workunit.client.0.smithi089.stdout:5/44: write d1/d4/f11 [1262324,125575] 0 2024-09-13T02:53:55.451 INFO:tasks.workunit.client.1.smithi131.stdout:8/360: mknod db/d1d/d1f/d66/c6a 0 2024-09-13T02:53:55.451 INFO:tasks.workunit.client.0.smithi089.stdout:8/98: creat de/d16/d1e/f21 x:0 0 0 2024-09-13T02:53:55.452 INFO:tasks.workunit.client.0.smithi089.stdout:3/36: sync 2024-09-13T02:53:55.452 INFO:tasks.workunit.client.0.smithi089.stdout:0/38: sync 2024-09-13T02:53:55.452 INFO:tasks.workunit.client.0.smithi089.stdout:1/43: sync 2024-09-13T02:53:55.454 INFO:tasks.workunit.client.0.smithi089.stdout:3/37: rmdir d2/d8/db 0 2024-09-13T02:53:55.454 INFO:tasks.workunit.client.0.smithi089.stdout:3/38: write - no filename 2024-09-13T02:53:55.454 INFO:tasks.workunit.client.0.smithi089.stdout:3/39: write - no filename 2024-09-13T02:53:55.454 INFO:tasks.workunit.client.0.smithi089.stdout:3/40: dread - no filename 2024-09-13T02:53:55.456 INFO:tasks.workunit.client.0.smithi089.stdout:0/39: symlink d2/la 0 2024-09-13T02:53:55.457 INFO:tasks.workunit.client.0.smithi089.stdout:4/53: dread d2/f4 [4194304,4194304] 0 2024-09-13T02:53:55.459 INFO:tasks.workunit.client.0.smithi089.stdout:3/41: symlink d2/d8/ld 0 2024-09-13T02:53:55.461 INFO:tasks.workunit.client.0.smithi089.stdout:1/44: getdents dc 0 2024-09-13T02:53:55.461 INFO:tasks.workunit.client.0.smithi089.stdout:1/45: chown f3 5540 1 2024-09-13T02:53:55.461 INFO:tasks.workunit.client.0.smithi089.stdout:7/67: dwrite d3/f1a [0,4194304] 0 2024-09-13T02:53:55.461 INFO:tasks.workunit.client.0.smithi089.stdout:7/68: dread - d3/de/f12 zero size 2024-09-13T02:53:55.462 INFO:tasks.workunit.client.0.smithi089.stdout:0/40: mknod d2/cb 0 2024-09-13T02:53:55.462 INFO:tasks.workunit.client.0.smithi089.stdout:0/41: truncate d2/f6 6340 0 2024-09-13T02:53:55.463 INFO:tasks.workunit.client.0.smithi089.stdout:3/42: getdents d2 0 2024-09-13T02:53:55.463 INFO:tasks.workunit.client.0.smithi089.stdout:8/99: write de/f11 [2360840,96062] 0 2024-09-13T02:53:55.464 INFO:tasks.workunit.client.0.smithi089.stdout:8/100: write f0 [1747144,113205] 0 2024-09-13T02:53:55.465 INFO:tasks.workunit.client.0.smithi089.stdout:4/54: read d2/f4 [12266694,76841] 0 2024-09-13T02:53:55.465 INFO:tasks.workunit.client.0.smithi089.stdout:1/46: unlink f1 0 2024-09-13T02:53:55.468 INFO:tasks.workunit.client.0.smithi089.stdout:7/69: creat d3/f1b x:0 0 0 2024-09-13T02:53:55.470 INFO:tasks.workunit.client.0.smithi089.stdout:0/42: creat d2/fc x:0 0 0 2024-09-13T02:53:55.470 INFO:tasks.workunit.client.0.smithi089.stdout:0/43: creat d2/fd x:0 0 0 2024-09-13T02:53:55.470 INFO:tasks.workunit.client.0.smithi089.stdout:0/44: readlink d2/l9 0 2024-09-13T02:53:55.470 INFO:tasks.workunit.client.0.smithi089.stdout:0/45: write d2/f4 [909329,103515] 0 2024-09-13T02:53:55.471 INFO:tasks.workunit.client.0.smithi089.stdout:3/43: getdents d2/d8 0 2024-09-13T02:53:55.473 INFO:tasks.workunit.client.0.smithi089.stdout:4/55: creat d2/d3/ff x:0 0 0 2024-09-13T02:53:55.473 INFO:tasks.workunit.client.0.smithi089.stdout:4/56: dread - d2/d3/ff zero size 2024-09-13T02:53:55.473 INFO:tasks.workunit.client.0.smithi089.stdout:4/57: chown d2/d3 26 1 2024-09-13T02:53:55.474 INFO:tasks.workunit.client.0.smithi089.stdout:4/58: dread - d2/d3/ff zero size 2024-09-13T02:53:55.475 INFO:tasks.workunit.client.0.smithi089.stdout:7/70: creat d3/de/d14/f1c x:0 0 0 2024-09-13T02:53:55.478 INFO:tasks.workunit.client.0.smithi089.stdout:0/46: link d2/f6 d2/fe 0 2024-09-13T02:53:55.479 INFO:tasks.workunit.client.0.smithi089.stdout:3/44: mknod d2/d8/dc/ce 0 2024-09-13T02:53:55.479 INFO:tasks.workunit.client.0.smithi089.stdout:3/45: dwrite - no filename 2024-09-13T02:53:55.479 INFO:tasks.workunit.client.0.smithi089.stdout:3/46: write - no filename 2024-09-13T02:53:55.479 INFO:tasks.workunit.client.0.smithi089.stdout:3/47: dread - no filename 2024-09-13T02:53:55.479 INFO:tasks.workunit.client.0.smithi089.stdout:3/48: read - no filename 2024-09-13T02:53:55.480 INFO:tasks.workunit.client.0.smithi089.stdout:3/49: readlink d2/l9 0 2024-09-13T02:53:55.480 INFO:tasks.workunit.client.0.smithi089.stdout:3/50: dread - no filename 2024-09-13T02:53:55.480 INFO:tasks.workunit.client.0.smithi089.stdout:8/101: rmdir de/d16/d1e 39 2024-09-13T02:53:55.481 INFO:tasks.workunit.client.0.smithi089.stdout:4/59: creat d2/da/f10 x:0 0 0 2024-09-13T02:53:55.481 INFO:tasks.workunit.client.0.smithi089.stdout:4/60: fdatasync d2/d3/ff 0 2024-09-13T02:53:55.481 INFO:tasks.workunit.client.0.smithi089.stdout:5/45: dwrite d1/fd [0,4194304] 0 2024-09-13T02:53:55.481 INFO:tasks.workunit.client.0.smithi089.stdout:1/47: write f2 [3404714,88667] 0 2024-09-13T02:53:55.482 INFO:tasks.workunit.client.0.smithi089.stdout:6/54: dwrite f0 [0,4194304] 0 2024-09-13T02:53:55.484 INFO:tasks.workunit.client.0.smithi089.stdout:3/51: creat d2/d8/dc/ff x:0 0 0 2024-09-13T02:53:55.484 INFO:tasks.workunit.client.0.smithi089.stdout:3/52: truncate d2/d8/dc/ff 281558 0 2024-09-13T02:53:55.484 INFO:tasks.workunit.client.0.smithi089.stdout:3/53: dread d2/d8/dc/ff [0,4194304] 0 2024-09-13T02:53:55.485 INFO:tasks.workunit.client.0.smithi089.stdout:8/102: link de/f14 de/f22 0 2024-09-13T02:53:55.486 INFO:tasks.workunit.client.0.smithi089.stdout:4/61: link d2/c8 d2/da/c11 0 2024-09-13T02:53:55.489 INFO:tasks.workunit.client.0.smithi089.stdout:5/46: symlink d1/l12 0 2024-09-13T02:53:55.492 INFO:tasks.workunit.client.0.smithi089.stdout:0/47: fsync d2/f6 0 2024-09-13T02:53:55.494 INFO:tasks.workunit.client.0.smithi089.stdout:7/71: dwrite f0 [0,4194304] 0 2024-09-13T02:53:55.494 INFO:tasks.workunit.client.0.smithi089.stdout:7/72: chown d3/c9 119946107 1 2024-09-13T02:53:55.494 INFO:tasks.workunit.client.0.smithi089.stdout:7/73: truncate d3/de/d14/f1c 127577 0 2024-09-13T02:53:55.494 INFO:tasks.workunit.client.0.smithi089.stdout:7/74: creat d3/de/f1d x:0 0 0 2024-09-13T02:53:55.495 INFO:tasks.workunit.client.0.smithi089.stdout:6/55: symlink db/l13 0 2024-09-13T02:53:55.495 INFO:tasks.workunit.client.0.smithi089.stdout:6/56: chown db/fc 0 1 2024-09-13T02:53:55.497 INFO:tasks.workunit.client.0.smithi089.stdout:3/54: rename d2/d8/ld to d2/l10 0 2024-09-13T02:53:55.498 INFO:tasks.workunit.client.0.smithi089.stdout:3/55: dread d2/d8/dc/ff [0,4194304] 0 2024-09-13T02:53:55.499 INFO:tasks.workunit.client.0.smithi089.stdout:4/62: creat d2/f12 x:0 0 0 2024-09-13T02:53:55.501 INFO:tasks.workunit.client.0.smithi089.stdout:5/47: unlink d1/l12 0 2024-09-13T02:53:55.501 INFO:tasks.workunit.client.0.smithi089.stdout:5/48: chown d1/d7 38 1 2024-09-13T02:53:55.503 INFO:tasks.workunit.client.0.smithi089.stdout:1/48: unlink dc/fd 0 2024-09-13T02:53:55.504 INFO:tasks.workunit.client.0.smithi089.stdout:0/48: mknod d2/cf 0 2024-09-13T02:53:55.508 INFO:tasks.workunit.client.0.smithi089.stdout:7/75: read d3/f1a [3446192,94452] 0 2024-09-13T02:53:55.509 INFO:tasks.workunit.client.0.smithi089.stdout:0/49: dread d2/f4 [0,4194304] 0 2024-09-13T02:53:55.511 INFO:tasks.workunit.client.0.smithi089.stdout:6/57: link db/d10/f11 db/d10/f14 0 2024-09-13T02:53:55.521 INFO:tasks.workunit.client.0.smithi089.stdout:3/56: mknod d2/d8/dc/c11 0 2024-09-13T02:53:55.522 INFO:tasks.workunit.client.0.smithi089.stdout:8/103: link l6 de/d16/d1e/d20/l23 0 2024-09-13T02:53:55.524 INFO:tasks.workunit.client.0.smithi089.stdout:7/76: dwrite d3/f17 [0,4194304] 0 2024-09-13T02:53:55.526 INFO:tasks.workunit.client.0.smithi089.stdout:0/50: symlink d2/l10 0 2024-09-13T02:53:55.527 INFO:tasks.workunit.client.0.smithi089.stdout:0/51: creat d2/f11 x:0 0 0 2024-09-13T02:53:55.527 INFO:tasks.workunit.client.0.smithi089.stdout:3/57: symlink d2/l12 0 2024-09-13T02:53:55.529 INFO:tasks.workunit.client.0.smithi089.stdout:8/104: truncate de/d16/f1b 1093478 0 2024-09-13T02:53:55.529 INFO:tasks.workunit.client.0.smithi089.stdout:8/105: dread - de/f17 zero size 2024-09-13T02:53:55.531 INFO:tasks.workunit.client.0.smithi089.stdout:4/63: rename d2/f12 to d2/da/f13 0 2024-09-13T02:53:55.532 INFO:tasks.workunit.client.0.smithi089.stdout:5/49: rmdir d1/d4 39 2024-09-13T02:53:55.532 INFO:tasks.workunit.client.0.smithi089.stdout:5/50: write d1/d7/f9 [5113059,54347] 0 2024-09-13T02:53:55.535 INFO:tasks.workunit.client.0.smithi089.stdout:5/51: dread d1/d4/f5 [0,4194304] 0 2024-09-13T02:53:55.535 INFO:tasks.workunit.client.0.smithi089.stdout:5/52: chown d1/d4/f5 6 1 2024-09-13T02:53:55.535 INFO:tasks.workunit.client.0.smithi089.stdout:5/53: fdatasync d1/d4/f11 0 2024-09-13T02:53:55.535 INFO:tasks.workunit.client.0.smithi089.stdout:1/49: dread f7 [0,4194304] 0 2024-09-13T02:53:55.535 INFO:tasks.workunit.client.0.smithi089.stdout:7/77: mknod d3/d19/c1e 0 2024-09-13T02:53:55.536 INFO:tasks.workunit.client.0.smithi089.stdout:2/87: sync 2024-09-13T02:53:55.537 INFO:tasks.workunit.client.0.smithi089.stdout:3/58: creat d2/d8/f13 x:0 0 0 2024-09-13T02:53:55.538 INFO:tasks.workunit.client.0.smithi089.stdout:3/59: dread d2/d8/dc/ff [0,4194304] 0 2024-09-13T02:53:55.538 INFO:tasks.workunit.client.0.smithi089.stdout:3/60: chown d2/l12 442612210 1 2024-09-13T02:53:55.540 INFO:tasks.workunit.client.0.smithi089.stdout:6/58: rename c5 to db/d10/c15 0 2024-09-13T02:53:55.542 INFO:tasks.workunit.client.0.smithi089.stdout:4/64: mknod d2/da/c14 0 2024-09-13T02:53:55.542 INFO:tasks.workunit.client.0.smithi089.stdout:5/54: dread d1/fd [0,4194304] 0 2024-09-13T02:53:55.544 INFO:tasks.workunit.client.0.smithi089.stdout:1/50: truncate dc/fe 872292 0 2024-09-13T02:53:55.545 INFO:tasks.workunit.client.0.smithi089.stdout:9/60: sync 2024-09-13T02:53:55.545 INFO:tasks.workunit.client.0.smithi089.stdout:7/78: symlink d3/de/l1f 0 2024-09-13T02:53:55.547 INFO:tasks.workunit.client.0.smithi089.stdout:2/88: creat d13/d1d/f22 x:0 0 0 2024-09-13T02:53:55.548 INFO:tasks.workunit.client.0.smithi089.stdout:3/61: truncate d2/d8/dc/ff 276863 0 2024-09-13T02:53:55.549 INFO:tasks.workunit.client.0.smithi089.stdout:8/106: rmdir de/d16 39 2024-09-13T02:53:55.551 INFO:tasks.workunit.client.0.smithi089.stdout:6/59: mkdir db/d10/d16 0 2024-09-13T02:53:55.553 INFO:tasks.workunit.client.0.smithi089.stdout:5/55: mknod d1/c13 0 2024-09-13T02:53:55.554 INFO:tasks.workunit.client.0.smithi089.stdout:5/56: dread d1/d4/f5 [0,4194304] 0 2024-09-13T02:53:55.554 INFO:tasks.workunit.client.0.smithi089.stdout:1/51: chown f2 928823 1 2024-09-13T02:53:55.557 INFO:tasks.workunit.client.0.smithi089.stdout:2/89: creat d13/d1d/f23 x:0 0 0 2024-09-13T02:53:55.558 INFO:tasks.workunit.client.0.smithi089.stdout:2/90: write d13/f17 [988513,3468] 0 2024-09-13T02:53:55.558 INFO:tasks.workunit.client.0.smithi089.stdout:3/62: creat d2/f14 x:0 0 0 2024-09-13T02:53:55.559 INFO:tasks.workunit.client.0.smithi089.stdout:8/107: symlink de/d16/d1e/l24 0 2024-09-13T02:53:55.559 INFO:tasks.workunit.client.0.smithi089.stdout:8/108: truncate de/d16/d1e/f21 372181 0 2024-09-13T02:53:55.560 INFO:tasks.workunit.client.0.smithi089.stdout:3/63: dread d2/d8/dc/ff [0,4194304] 0 2024-09-13T02:53:55.561 INFO:tasks.workunit.client.0.smithi089.stdout:6/60: rmdir db/d10/d16 0 2024-09-13T02:53:55.562 INFO:tasks.workunit.client.0.smithi089.stdout:4/65: symlink d2/d3/d5/l15 0 2024-09-13T02:53:55.562 INFO:tasks.workunit.client.0.smithi089.stdout:4/66: chown d2 1606221 1 2024-09-13T02:53:55.563 INFO:tasks.workunit.client.0.smithi089.stdout:5/57: creat d1/d4/f14 x:0 0 0 2024-09-13T02:53:55.563 INFO:tasks.workunit.client.0.smithi089.stdout:5/58: write d1/d4/f5 [296595,66637] 0 2024-09-13T02:53:55.564 INFO:tasks.workunit.client.0.smithi089.stdout:9/61: mkdir d3/d15 0 2024-09-13T02:53:55.564 INFO:tasks.workunit.client.0.smithi089.stdout:9/62: fdatasync f2 0 2024-09-13T02:53:55.565 INFO:tasks.workunit.client.0.smithi089.stdout:7/79: mkdir d3/d20 0 2024-09-13T02:53:55.566 INFO:tasks.workunit.client.0.smithi089.stdout:8/109: rmdir de/d16/d1e 39 2024-09-13T02:53:55.567 INFO:tasks.workunit.client.0.smithi089.stdout:3/64: mknod d2/d8/c15 0 2024-09-13T02:53:55.569 INFO:tasks.workunit.client.0.smithi089.stdout:4/67: unlink d2/d3/d5/c9 0 2024-09-13T02:53:55.570 INFO:tasks.workunit.client.0.smithi089.stdout:4/68: stat d2 0 2024-09-13T02:53:55.570 INFO:tasks.workunit.client.0.smithi089.stdout:4/69: dread - d2/da/f10 zero size 2024-09-13T02:53:55.571 INFO:tasks.workunit.client.0.smithi089.stdout:5/59: creat d1/d7/f15 x:0 0 0 2024-09-13T02:53:55.573 INFO:tasks.workunit.client.0.smithi089.stdout:1/52: truncate f3 1717937 0 2024-09-13T02:53:55.575 INFO:tasks.workunit.client.0.smithi089.stdout:6/61: dwrite db/f12 [0,4194304] 0 2024-09-13T02:53:55.575 INFO:tasks.workunit.client.0.smithi089.stdout:7/80: symlink d3/d19/l21 0 2024-09-13T02:53:55.575 INFO:tasks.workunit.client.0.smithi089.stdout:7/81: read - d3/f1b zero size 2024-09-13T02:53:55.575 INFO:tasks.workunit.client.0.smithi089.stdout:2/91: symlink d13/d1d/l24 0 2024-09-13T02:53:55.578 INFO:tasks.workunit.client.0.smithi089.stdout:9/63: symlink d3/l16 0 2024-09-13T02:53:55.579 INFO:tasks.workunit.client.0.smithi089.stdout:9/64: write d3/d6/df/f12 [307642,28997] 0 2024-09-13T02:53:55.584 INFO:tasks.workunit.client.0.smithi089.stdout:7/82: rename d3/f17 to d3/d19/f22 0 2024-09-13T02:53:55.584 INFO:tasks.workunit.client.0.smithi089.stdout:7/83: dread - d3/de/f12 zero size 2024-09-13T02:53:55.584 INFO:tasks.workunit.client.0.smithi089.stdout:8/110: getdents de/d16/d1e 0 2024-09-13T02:53:55.584 INFO:tasks.workunit.client.0.smithi089.stdout:7/84: chown d3/de/f18 333 1 2024-09-13T02:53:55.584 INFO:tasks.workunit.client.0.smithi089.stdout:9/65: rmdir d3/d6 39 2024-09-13T02:53:55.585 INFO:tasks.workunit.client.0.smithi089.stdout:2/92: write d13/f1a [858736,75907] 0 2024-09-13T02:53:55.586 INFO:tasks.workunit.client.0.smithi089.stdout:7/85: truncate d3/de/f13 1436861 0 2024-09-13T02:53:55.587 INFO:tasks.workunit.client.0.smithi089.stdout:3/65: dwrite d2/d8/dc/ff [0,4194304] 0 2024-09-13T02:53:55.587 INFO:tasks.workunit.client.0.smithi089.stdout:8/111: rmdir de/d16/d1e 39 2024-09-13T02:53:55.592 INFO:tasks.workunit.client.0.smithi089.stdout:9/66: creat d3/d15/f17 x:0 0 0 2024-09-13T02:53:55.592 INFO:tasks.workunit.client.0.smithi089.stdout:9/67: rename d3 to d3/d6/d18 22 2024-09-13T02:53:55.592 INFO:tasks.workunit.client.0.smithi089.stdout:9/68: chown d3/d6/df/c13 3396012 1 2024-09-13T02:53:55.595 INFO:tasks.workunit.client.0.smithi089.stdout:7/86: symlink d3/d20/l23 0 2024-09-13T02:53:55.595 INFO:tasks.workunit.client.0.smithi089.stdout:7/87: truncate d3/f1b 1000579 0 2024-09-13T02:53:55.600 INFO:tasks.workunit.client.0.smithi089.stdout:8/112: truncate de/d16/f1b 895633 0 2024-09-13T02:53:55.601 INFO:tasks.workunit.client.0.smithi089.stdout:2/93: mknod d13/c25 0 2024-09-13T02:53:55.601 INFO:tasks.workunit.client.0.smithi089.stdout:9/69: symlink d3/d15/l19 0 2024-09-13T02:53:55.602 INFO:tasks.workunit.client.0.smithi089.stdout:9/70: fsync f2 0 2024-09-13T02:53:55.602 INFO:tasks.workunit.client.0.smithi089.stdout:4/70: dwrite d2/f4 [0,4194304] 0 2024-09-13T02:53:55.603 INFO:tasks.workunit.client.0.smithi089.stdout:8/113: symlink de/d16/d1e/d20/l25 0 2024-09-13T02:53:55.605 INFO:tasks.workunit.client.0.smithi089.stdout:4/71: creat d2/d3/de/f16 x:0 0 0 2024-09-13T02:53:55.606 INFO:tasks.workunit.client.0.smithi089.stdout:4/72: creat d2/d3/f17 x:0 0 0 2024-09-13T02:53:55.606 INFO:tasks.workunit.client.0.smithi089.stdout:4/73: write d2/d3/ff [372092,62774] 0 2024-09-13T02:53:55.606 INFO:tasks.workunit.client.0.smithi089.stdout:4/74: creat d2/d3/de/f18 x:0 0 0 2024-09-13T02:53:55.606 INFO:tasks.workunit.client.0.smithi089.stdout:4/75: read - d2/da/f10 zero size 2024-09-13T02:53:55.606 INFO:tasks.workunit.client.0.smithi089.stdout:4/76: truncate d2/da/f13 912042 0 2024-09-13T02:53:55.606 INFO:tasks.workunit.client.0.smithi089.stdout:8/114: dread de/d16/d1e/f21 [0,4194304] 0 2024-09-13T02:53:55.607 INFO:tasks.workunit.client.0.smithi089.stdout:7/88: rename d3/de/l1f to d3/l24 0 2024-09-13T02:53:55.607 INFO:tasks.workunit.client.0.smithi089.stdout:3/66: dwrite d2/d8/dc/ff [0,4194304] 0 2024-09-13T02:53:55.608 INFO:tasks.workunit.client.0.smithi089.stdout:5/60: dwrite d1/d4/fc [0,4194304] 0 2024-09-13T02:53:55.608 INFO:tasks.workunit.client.0.smithi089.stdout:5/61: chown d1/fd 152 1 2024-09-13T02:53:55.609 INFO:tasks.workunit.client.0.smithi089.stdout:2/94: mknod d13/c26 0 2024-09-13T02:53:55.614 INFO:tasks.workunit.client.0.smithi089.stdout:4/77: symlink d2/l19 0 2024-09-13T02:53:55.614 INFO:tasks.workunit.client.0.smithi089.stdout:4/78: readlink d2/l19 0 2024-09-13T02:53:55.614 INFO:tasks.workunit.client.0.smithi089.stdout:8/115: symlink de/l26 0 2024-09-13T02:53:55.620 INFO:tasks.workunit.client.0.smithi089.stdout:1/53: dwrite dc/fe [0,4194304] 0 2024-09-13T02:53:55.621 INFO:tasks.workunit.client.0.smithi089.stdout:1/54: chown dc/fe 125 1 2024-09-13T02:53:55.621 INFO:tasks.workunit.client.0.smithi089.stdout:1/55: read f2 [1158705,34750] 0 2024-09-13T02:53:55.621 INFO:tasks.workunit.client.0.smithi089.stdout:1/56: write f7 [547808,128336] 0 2024-09-13T02:53:55.621 INFO:tasks.workunit.client.0.smithi089.stdout:1/57: fdatasync dc/fe 0 2024-09-13T02:53:55.625 INFO:tasks.workunit.client.0.smithi089.stdout:5/62: symlink d1/d4/l16 0 2024-09-13T02:53:55.625 INFO:tasks.workunit.client.0.smithi089.stdout:5/63: write d1/d7/f9 [2126796,130357] 0 2024-09-13T02:53:55.625 INFO:tasks.workunit.client.0.smithi089.stdout:5/64: chown d1/d4 17535838 1 2024-09-13T02:53:55.625 INFO:tasks.workunit.client.0.smithi089.stdout:5/65: creat d1/d4/f17 x:0 0 0 2024-09-13T02:53:55.625 INFO:tasks.workunit.client.0.smithi089.stdout:5/66: truncate d1/d4/f17 185653 0 2024-09-13T02:53:55.625 INFO:tasks.workunit.client.0.smithi089.stdout:5/67: creat d1/d7/f18 x:0 0 0 2024-09-13T02:53:55.627 INFO:tasks.workunit.client.0.smithi089.stdout:4/79: symlink d2/da/l1a 0 2024-09-13T02:53:55.627 INFO:tasks.workunit.client.0.smithi089.stdout:8/116: write f9 [1847618,88288] 0 2024-09-13T02:53:55.628 INFO:tasks.workunit.client.0.smithi089.stdout:7/89: link d3/lc d3/d19/l25 0 2024-09-13T02:53:55.629 INFO:tasks.workunit.client.0.smithi089.stdout:3/67: getdents d2/d8 0 2024-09-13T02:53:55.629 INFO:tasks.workunit.client.0.smithi089.stdout:3/68: fdatasync d2/f14 0 2024-09-13T02:53:55.629 INFO:tasks.workunit.client.0.smithi089.stdout:3/69: write d2/d8/f13 [812038,70117] 0 2024-09-13T02:53:55.633 INFO:tasks.workunit.client.0.smithi089.stdout:1/58: creat dc/f10 x:0 0 0 2024-09-13T02:53:55.638 INFO:tasks.workunit.client.0.smithi089.stdout:4/80: mknod d2/da/c1b 0 2024-09-13T02:53:55.639 INFO:tasks.workunit.client.0.smithi089.stdout:8/117: mkdir de/d16/d1e/d27 0 2024-09-13T02:53:55.640 INFO:tasks.workunit.client.0.smithi089.stdout:8/118: readlink de/l26 0 2024-09-13T02:53:55.647 INFO:tasks.workunit.client.0.smithi089.stdout:1/59: dread f8 [0,4194304] 0 2024-09-13T02:53:55.647 INFO:tasks.workunit.client.0.smithi089.stdout:1/60: write f3 [1752299,61054] 0 2024-09-13T02:53:55.647 INFO:tasks.workunit.client.0.smithi089.stdout:4/81: link d2/da/c14 d2/d3/d5/c1c 0 2024-09-13T02:53:55.647 INFO:tasks.workunit.client.0.smithi089.stdout:4/82: read d2/da/f13 [153090,79616] 0 2024-09-13T02:53:55.648 INFO:tasks.workunit.client.0.smithi089.stdout:4/83: truncate d2/d3/de/f18 728086 0 2024-09-13T02:53:55.648 INFO:tasks.workunit.client.0.smithi089.stdout:4/84: creat d2/f1d x:0 0 0 2024-09-13T02:53:55.648 INFO:tasks.workunit.client.0.smithi089.stdout:4/85: stat d2/d3/d5 0 2024-09-13T02:53:55.649 INFO:tasks.workunit.client.0.smithi089.stdout:8/119: dread f9 [0,4194304] 0 2024-09-13T02:53:55.649 INFO:tasks.workunit.client.0.smithi089.stdout:1/61: mknod dc/c11 0 2024-09-13T02:53:55.654 INFO:tasks.workunit.client.0.smithi089.stdout:7/90: write d3/de/f13 [2193055,59549] 0 2024-09-13T02:53:55.654 INFO:tasks.workunit.client.0.smithi089.stdout:3/70: dwrite d2/f14 [0,4194304] 0 2024-09-13T02:53:55.654 INFO:tasks.workunit.client.0.smithi089.stdout:3/71: creat d2/f16 x:0 0 0 2024-09-13T02:53:55.657 INFO:tasks.workunit.client.0.smithi089.stdout:8/120: dread de/f10 [0,4194304] 0 2024-09-13T02:53:55.660 INFO:tasks.workunit.client.0.smithi089.stdout:7/91: symlink d3/de/d14/l26 0 2024-09-13T02:53:55.660 INFO:tasks.workunit.client.0.smithi089.stdout:1/62: read dc/fe [1419786,83114] 0 2024-09-13T02:53:55.660 INFO:tasks.workunit.client.0.smithi089.stdout:7/92: write d3/de/f13 [1701962,61138] 0 2024-09-13T02:53:55.664 INFO:tasks.workunit.client.0.smithi089.stdout:8/121: rename c4 to de/d16/d1e/c28 0 2024-09-13T02:53:55.665 INFO:tasks.workunit.client.0.smithi089.stdout:7/93: mknod d3/de/c27 0 2024-09-13T02:53:55.666 INFO:tasks.workunit.client.0.smithi089.stdout:0/52: sync 2024-09-13T02:53:55.666 INFO:tasks.workunit.client.0.smithi089.stdout:0/53: write d2/f11 [778871,53828] 0 2024-09-13T02:53:55.666 INFO:tasks.workunit.client.0.smithi089.stdout:0/54: readlink d2/la 0 2024-09-13T02:53:55.667 INFO:tasks.workunit.client.0.smithi089.stdout:1/63: dread f3 [0,4194304] 0 2024-09-13T02:53:55.669 INFO:tasks.workunit.client.0.smithi089.stdout:1/64: write f8 [317395,32201] 0 2024-09-13T02:53:55.675 INFO:tasks.workunit.client.0.smithi089.stdout:3/72: dwrite d2/f16 [0,4194304] 0 2024-09-13T02:53:55.675 INFO:tasks.workunit.client.0.smithi089.stdout:7/94: dread d3/f11 [0,4194304] 0 2024-09-13T02:53:55.676 INFO:tasks.workunit.client.0.smithi089.stdout:7/95: write d3/de/f13 [2118323,63222] 0 2024-09-13T02:53:55.678 INFO:tasks.workunit.client.0.smithi089.stdout:3/73: link d2/d8/c15 d2/d8/c17 0 2024-09-13T02:53:55.678 INFO:tasks.workunit.client.0.smithi089.stdout:3/74: stat d2/l9 0 2024-09-13T02:53:55.678 INFO:tasks.workunit.client.0.smithi089.stdout:0/55: dread d2/f11 [0,4194304] 0 2024-09-13T02:53:55.681 INFO:tasks.workunit.client.0.smithi089.stdout:7/96: unlink d3/f15 0 2024-09-13T02:53:55.681 INFO:tasks.workunit.client.0.smithi089.stdout:7/97: dread - d3/de/f12 zero size 2024-09-13T02:53:55.682 INFO:tasks.workunit.client.0.smithi089.stdout:8/122: dwrite f9 [0,4194304] 0 2024-09-13T02:53:55.682 INFO:tasks.workunit.client.0.smithi089.stdout:8/123: write de/d16/f1f [574701,33163] 0 2024-09-13T02:53:55.682 INFO:tasks.workunit.client.0.smithi089.stdout:8/124: write de/d16/f1c [435137,41000] 0 2024-09-13T02:53:55.682 INFO:tasks.workunit.client.0.smithi089.stdout:0/56: unlink d2/l9 0 2024-09-13T02:53:55.682 INFO:tasks.workunit.client.0.smithi089.stdout:0/57: chown d2/f11 11424065 1 2024-09-13T02:53:55.682 INFO:tasks.workunit.client.0.smithi089.stdout:0/58: chown d2/f3 9 1 2024-09-13T02:53:55.683 INFO:tasks.workunit.client.0.smithi089.stdout:7/98: mkdir d3/d20/d28 0 2024-09-13T02:53:55.684 INFO:tasks.workunit.client.0.smithi089.stdout:0/59: rename d2/c7 to d2/c12 0 2024-09-13T02:53:55.697 INFO:tasks.workunit.client.0.smithi089.stdout:3/75: dwrite d2/d8/f13 [0,4194304] 0 2024-09-13T02:53:55.699 INFO:tasks.workunit.client.0.smithi089.stdout:3/76: truncate d2/f14 1153673 0 2024-09-13T02:53:55.700 INFO:tasks.workunit.client.0.smithi089.stdout:7/99: dread f0 [0,4194304] 0 2024-09-13T02:53:55.704 INFO:tasks.workunit.client.0.smithi089.stdout:8/125: dwrite de/d16/d1e/f21 [0,4194304] 0 2024-09-13T02:53:55.705 INFO:tasks.workunit.client.0.smithi089.stdout:7/100: unlink d3/f1a 0 2024-09-13T02:53:55.705 INFO:tasks.workunit.client.0.smithi089.stdout:7/101: dread - d3/de/f1d zero size 2024-09-13T02:53:55.707 INFO:tasks.workunit.client.0.smithi089.stdout:8/126: mknod de/d16/c29 0 2024-09-13T02:53:55.712 INFO:tasks.workunit.client.0.smithi089.stdout:8/127: dread de/f11 [0,4194304] 0 2024-09-13T02:53:55.712 INFO:tasks.workunit.client.0.smithi089.stdout:8/128: readlink de/d16/d1e/d20/l23 0 2024-09-13T02:53:55.716 INFO:tasks.workunit.client.0.smithi089.stdout:3/77: dwrite d2/d8/dc/ff [0,4194304] 0 2024-09-13T02:53:55.717 INFO:tasks.workunit.client.0.smithi089.stdout:6/62: sync 2024-09-13T02:53:55.718 INFO:tasks.workunit.client.0.smithi089.stdout:3/78: mknod d2/d8/c18 0 2024-09-13T02:53:55.730 INFO:tasks.workunit.client.0.smithi089.stdout:3/79: read d2/d8/f13 [1185812,103546] 0 2024-09-13T02:53:55.731 INFO:tasks.workunit.client.0.smithi089.stdout:7/102: dwrite d3/de/f1d [0,4194304] 0 2024-09-13T02:53:55.732 INFO:tasks.workunit.client.0.smithi089.stdout:7/103: read d3/f1b [147873,46280] 0 2024-09-13T02:53:55.732 INFO:tasks.workunit.client.0.smithi089.stdout:7/104: write d3/de/f18 [4821626,43419] 0 2024-09-13T02:53:55.732 INFO:tasks.workunit.client.0.smithi089.stdout:7/105: creat d3/de/f29 x:0 0 0 2024-09-13T02:53:55.733 INFO:tasks.workunit.client.0.smithi089.stdout:6/63: read f9 [274987,1929] 0 2024-09-13T02:53:55.733 INFO:tasks.workunit.client.0.smithi089.stdout:6/64: fdatasync db/d10/f11 0 2024-09-13T02:53:55.733 INFO:tasks.workunit.client.0.smithi089.stdout:6/65: write db/fc [631670,101746] 0 2024-09-13T02:53:55.734 INFO:tasks.workunit.client.0.smithi089.stdout:7/106: unlink d3/fa 0 2024-09-13T02:53:55.735 INFO:tasks.workunit.client.0.smithi089.stdout:6/66: mknod db/d10/c17 0 2024-09-13T02:53:55.737 INFO:tasks.workunit.client.0.smithi089.stdout:6/67: mknod db/c18 0 2024-09-13T02:53:55.739 INFO:tasks.workunit.client.0.smithi089.stdout:6/68: unlink f6 0 2024-09-13T02:53:55.741 INFO:tasks.workunit.client.0.smithi089.stdout:3/80: dread d2/f16 [0,4194304] 0 2024-09-13T02:53:55.741 INFO:tasks.workunit.client.0.smithi089.stdout:3/81: creat d2/f19 x:0 0 0 2024-09-13T02:53:55.743 INFO:tasks.workunit.client.0.smithi089.stdout:3/82: rename d2/l12 to d2/l1a 0 2024-09-13T02:53:55.744 INFO:tasks.workunit.client.0.smithi089.stdout:3/83: write d2/f14 [1788089,40153] 0 2024-09-13T02:53:55.767 INFO:tasks.workunit.client.0.smithi089.stdout:7/107: dwrite d3/d19/f22 [0,4194304] 0 2024-09-13T02:53:55.768 INFO:tasks.workunit.client.0.smithi089.stdout:3/84: dwrite d2/d8/dc/ff [0,4194304] 0 2024-09-13T02:53:55.768 INFO:tasks.workunit.client.0.smithi089.stdout:3/85: creat d2/d8/dc/f1b x:0 0 0 2024-09-13T02:53:55.768 INFO:tasks.workunit.client.0.smithi089.stdout:6/69: dwrite f9 [0,4194304] 0 2024-09-13T02:53:55.772 INFO:tasks.workunit.client.0.smithi089.stdout:3/86: rename d2/l7 to d2/l1c 0 2024-09-13T02:53:55.772 INFO:tasks.workunit.client.0.smithi089.stdout:3/87: fdatasync d2/d8/dc/ff 0 2024-09-13T02:53:55.774 INFO:tasks.workunit.client.0.smithi089.stdout:6/70: unlink db/d10/c15 0 2024-09-13T02:53:55.779 INFO:tasks.workunit.client.0.smithi089.stdout:6/71: link db/d10/f11 db/f19 0 2024-09-13T02:53:55.779 INFO:tasks.workunit.client.0.smithi089.stdout:6/72: write db/f19 [851155,51683] 0 2024-09-13T02:53:55.782 INFO:tasks.workunit.client.0.smithi089.stdout:7/108: rename d3/cb to d3/c2a 0 2024-09-13T02:53:55.785 INFO:tasks.workunit.client.0.smithi089.stdout:6/73: mknod db/d10/c1a 0 2024-09-13T02:53:55.787 INFO:tasks.workunit.client.0.smithi089.stdout:7/109: dread f0 [0,4194304] 0 2024-09-13T02:53:55.788 INFO:tasks.workunit.client.0.smithi089.stdout:6/74: dread db/fc [0,4194304] 0 2024-09-13T02:53:55.789 INFO:tasks.workunit.client.0.smithi089.stdout:6/75: truncate f3 225582 0 2024-09-13T02:53:55.789 INFO:tasks.workunit.client.0.smithi089.stdout:6/76: stat db/f12 0 2024-09-13T02:53:55.789 INFO:tasks.workunit.client.0.smithi089.stdout:7/110: truncate d3/f1b 900806 0 2024-09-13T02:53:55.789 INFO:tasks.workunit.client.0.smithi089.stdout:7/111: write d3/de/f12 [688513,116330] 0 2024-09-13T02:53:55.789 INFO:tasks.workunit.client.0.smithi089.stdout:7/112: fdatasync d3/de/f18 0 2024-09-13T02:53:55.789 INFO:tasks.workunit.client.0.smithi089.stdout:6/77: write f3 [210477,45498] 0 2024-09-13T02:53:55.789 INFO:tasks.workunit.client.0.smithi089.stdout:6/78: truncate db/fc 881905 0 2024-09-13T02:53:55.789 INFO:tasks.workunit.client.0.smithi089.stdout:3/88: getdents d2 0 2024-09-13T02:53:55.792 INFO:tasks.workunit.client.0.smithi089.stdout:6/79: mknod db/d10/c1b 0 2024-09-13T02:53:55.793 INFO:tasks.workunit.client.0.smithi089.stdout:3/89: mknod d2/c1d 0 2024-09-13T02:53:55.795 INFO:tasks.workunit.client.0.smithi089.stdout:6/80: symlink db/d10/l1c 0 2024-09-13T02:53:55.799 INFO:tasks.workunit.client.0.smithi089.stdout:6/81: rename f9 to db/f1d 0 2024-09-13T02:53:55.799 INFO:tasks.workunit.client.0.smithi089.stdout:6/82: stat ca 0 2024-09-13T02:53:55.800 INFO:tasks.workunit.client.0.smithi089.stdout:6/83: truncate db/f19 1053384 0 2024-09-13T02:53:55.805 INFO:tasks.workunit.client.0.smithi089.stdout:3/90: dread d2/f14 [0,4194304] 0 2024-09-13T02:53:55.805 INFO:tasks.workunit.client.0.smithi089.stdout:7/113: dwrite d3/f5 [4194304,4194304] 0 2024-09-13T02:53:55.807 INFO:tasks.workunit.client.0.smithi089.stdout:2/95: sync 2024-09-13T02:53:55.807 INFO:tasks.workunit.client.0.smithi089.stdout:9/71: sync 2024-09-13T02:53:55.808 INFO:tasks.workunit.client.0.smithi089.stdout:9/72: readlink d3/l16 0 2024-09-13T02:53:55.808 INFO:tasks.workunit.client.0.smithi089.stdout:7/114: dread d3/f11 [0,4194304] 0 2024-09-13T02:53:55.809 INFO:tasks.workunit.client.0.smithi089.stdout:9/73: dread d3/f5 [0,4194304] 0 2024-09-13T02:53:55.809 INFO:tasks.workunit.client.0.smithi089.stdout:9/74: truncate d3/d6/df/f12 601232 0 2024-09-13T02:53:55.809 INFO:tasks.workunit.client.0.smithi089.stdout:9/75: readlink d3/l16 0 2024-09-13T02:53:55.809 INFO:tasks.workunit.client.0.smithi089.stdout:9/76: fsync d3/d15/f17 0 2024-09-13T02:53:55.809 INFO:tasks.workunit.client.0.smithi089.stdout:6/84: getdents db 0 2024-09-13T02:53:55.810 INFO:tasks.workunit.client.0.smithi089.stdout:6/85: fdatasync f0 0 2024-09-13T02:53:55.811 INFO:tasks.workunit.client.0.smithi089.stdout:7/115: symlink d3/d19/l2b 0 2024-09-13T02:53:55.814 INFO:tasks.workunit.client.0.smithi089.stdout:9/77: symlink d3/d6/df/l1a 0 2024-09-13T02:53:55.826 INFO:tasks.workunit.client.0.smithi089.stdout:6/86: dread f0 [0,4194304] 0 2024-09-13T02:53:55.826 INFO:tasks.workunit.client.0.smithi089.stdout:2/96: dread f5 [0,4194304] 0 2024-09-13T02:53:55.826 INFO:tasks.workunit.client.0.smithi089.stdout:2/97: chown f1 155061274 1 2024-09-13T02:53:55.828 INFO:tasks.workunit.client.0.smithi089.stdout:2/98: getdents d13 0 2024-09-13T02:53:55.828 INFO:tasks.workunit.client.0.smithi089.stdout:2/99: write f12 [2662553,13886] 0 2024-09-13T02:53:55.830 INFO:tasks.workunit.client.0.smithi089.stdout:2/100: creat d13/f27 x:0 0 0 2024-09-13T02:53:55.830 INFO:tasks.workunit.client.0.smithi089.stdout:3/91: dwrite d2/f14 [0,4194304] 0 2024-09-13T02:53:55.832 INFO:tasks.workunit.client.0.smithi089.stdout:9/78: dread d3/f4 [0,4194304] 0 2024-09-13T02:53:55.832 INFO:tasks.workunit.client.0.smithi089.stdout:9/79: creat d3/d15/f1b x:0 0 0 2024-09-13T02:53:55.833 INFO:tasks.workunit.client.0.smithi089.stdout:9/80: write d3/d15/f17 [231147,29396] 0 2024-09-13T02:53:55.837 INFO:tasks.workunit.client.0.smithi089.stdout:6/87: dread db/f12 [0,4194304] 0 2024-09-13T02:53:55.837 INFO:tasks.workunit.client.0.smithi089.stdout:6/88: creat db/d10/f1e x:0 0 0 2024-09-13T02:53:55.837 INFO:tasks.workunit.client.0.smithi089.stdout:6/89: creat db/d10/f1f x:0 0 0 2024-09-13T02:53:55.837 INFO:tasks.workunit.client.0.smithi089.stdout:7/116: dwrite d3/f1b [0,4194304] 0 2024-09-13T02:53:55.839 INFO:tasks.workunit.client.0.smithi089.stdout:2/101: symlink d13/l28 0 2024-09-13T02:53:55.839 INFO:tasks.workunit.client.0.smithi089.stdout:2/102: readlink l9 0 2024-09-13T02:53:55.839 INFO:tasks.workunit.client.0.smithi089.stdout:9/81: dread d3/d15/f17 [0,4194304] 0 2024-09-13T02:53:55.840 INFO:tasks.workunit.client.0.smithi089.stdout:9/82: dread d3/f5 [0,4194304] 0 2024-09-13T02:53:55.842 INFO:tasks.workunit.client.0.smithi089.stdout:6/90: symlink db/d10/l20 0 2024-09-13T02:53:55.844 INFO:tasks.workunit.client.0.smithi089.stdout:5/68: sync 2024-09-13T02:53:55.844 INFO:tasks.workunit.client.0.smithi089.stdout:4/86: sync 2024-09-13T02:53:55.844 INFO:tasks.workunit.client.0.smithi089.stdout:4/87: dread - d2/d3/f17 zero size 2024-09-13T02:53:55.844 INFO:tasks.workunit.client.0.smithi089.stdout:5/69: truncate d1/d4/f14 317797 0 2024-09-13T02:53:55.844 INFO:tasks.workunit.client.0.smithi089.stdout:5/70: creat d1/d7/f19 x:0 0 0 2024-09-13T02:53:55.844 INFO:tasks.workunit.client.0.smithi089.stdout:5/71: write d1/d7/f18 [753793,35868] 0 2024-09-13T02:53:55.844 INFO:tasks.workunit.client.0.smithi089.stdout:5/72: truncate d1/d4/f11 4853574 0 2024-09-13T02:53:55.845 INFO:tasks.workunit.client.0.smithi089.stdout:7/117: symlink d3/d20/d28/l2c 0 2024-09-13T02:53:55.845 INFO:tasks.workunit.client.0.smithi089.stdout:7/118: truncate d3/de/f12 978516 0 2024-09-13T02:53:55.845 INFO:tasks.workunit.client.0.smithi089.stdout:3/92: rmdir d2/d8 39 2024-09-13T02:53:55.845 INFO:tasks.workunit.client.0.smithi089.stdout:3/93: creat d2/d8/dc/f1e x:0 0 0 2024-09-13T02:53:55.847 INFO:tasks.workunit.client.0.smithi089.stdout:4/88: unlink d2/d3/ff 0 2024-09-13T02:53:55.847 INFO:tasks.workunit.client.0.smithi089.stdout:4/89: fsync d2/d3/f17 0 2024-09-13T02:53:55.850 INFO:tasks.workunit.client.0.smithi089.stdout:3/94: mknod d2/d8/c1f 0 2024-09-13T02:53:55.851 INFO:tasks.workunit.client.0.smithi089.stdout:9/83: symlink d3/l1c 0 2024-09-13T02:53:55.851 INFO:tasks.workunit.client.0.smithi089.stdout:9/84: dread - d3/d15/f1b zero size 2024-09-13T02:53:55.852 INFO:tasks.workunit.client.0.smithi089.stdout:1/65: sync 2024-09-13T02:53:55.852 INFO:tasks.workunit.client.0.smithi089.stdout:8/129: sync 2024-09-13T02:53:55.852 INFO:tasks.workunit.client.0.smithi089.stdout:0/60: sync 2024-09-13T02:53:55.852 INFO:tasks.workunit.client.0.smithi089.stdout:1/66: truncate dc/f10 149149 0 2024-09-13T02:53:55.856 INFO:tasks.workunit.client.0.smithi089.stdout:5/73: read d1/d4/fc [1667547,100111] 0 2024-09-13T02:53:55.856 INFO:tasks.workunit.client.0.smithi089.stdout:5/74: stat d1/d4 0 2024-09-13T02:53:55.857 INFO:tasks.workunit.client.0.smithi089.stdout:7/119: write d3/de/f18 [4115629,74173] 0 2024-09-13T02:53:55.857 INFO:tasks.workunit.client.0.smithi089.stdout:8/130: unlink de/d16/d1e/l24 0 2024-09-13T02:53:55.859 INFO:tasks.workunit.client.0.smithi089.stdout:0/61: link f1 d2/f13 0 2024-09-13T02:53:55.860 INFO:tasks.workunit.client.0.smithi089.stdout:2/103: dwrite d13/f1c [0,4194304] 0 2024-09-13T02:53:55.860 INFO:tasks.workunit.client.0.smithi089.stdout:3/95: mkdir d2/d20 0 2024-09-13T02:53:55.864 INFO:tasks.workunit.client.0.smithi089.stdout:9/85: symlink d3/l1d 0 2024-09-13T02:53:55.866 INFO:tasks.workunit.client.0.smithi089.stdout:5/75: link d1/d7/lb d1/d4/l1a 0 2024-09-13T02:53:55.868 INFO:tasks.workunit.client.0.smithi089.stdout:7/120: unlink l2 0 2024-09-13T02:53:55.870 INFO:tasks.workunit.client.0.smithi089.stdout:4/90: dwrite d2/da/f13 [0,4194304] 0 2024-09-13T02:53:55.870 INFO:tasks.workunit.client.0.smithi089.stdout:4/91: chown d2/d3/d5 201605 1 2024-09-13T02:53:55.870 INFO:tasks.workunit.client.0.smithi089.stdout:4/92: truncate d2/da/f10 304006 0 2024-09-13T02:53:55.870 INFO:tasks.workunit.client.0.smithi089.stdout:5/76: dread d1/d4/f5 [0,4194304] 0 2024-09-13T02:53:55.872 INFO:tasks.workunit.client.0.smithi089.stdout:0/62: link f1 d2/f14 0 2024-09-13T02:53:55.873 INFO:tasks.workunit.client.0.smithi089.stdout:0/63: dread d2/f6 [0,4194304] 0 2024-09-13T02:53:55.875 INFO:tasks.workunit.client.0.smithi089.stdout:7/121: dread f0 [0,4194304] 0 2024-09-13T02:53:55.875 INFO:tasks.workunit.client.0.smithi089.stdout:3/96: creat d2/d8/f21 x:0 0 0 2024-09-13T02:53:55.877 INFO:tasks.workunit.client.0.smithi089.stdout:5/77: creat d1/f1b x:0 0 0 2024-09-13T02:53:55.878 INFO:tasks.workunit.client.0.smithi089.stdout:5/78: truncate d1/d7/f19 248251 0 2024-09-13T02:53:55.878 INFO:tasks.workunit.client.0.smithi089.stdout:0/64: symlink d2/l15 0 2024-09-13T02:53:55.878 INFO:tasks.workunit.client.0.smithi089.stdout:0/65: creat d2/f16 x:0 0 0 2024-09-13T02:53:55.879 INFO:tasks.workunit.client.0.smithi089.stdout:0/66: creat d2/f17 x:0 0 0 2024-09-13T02:53:55.879 INFO:tasks.workunit.client.0.smithi089.stdout:0/67: fdatasync d2/f13 0 2024-09-13T02:53:55.880 INFO:tasks.workunit.client.0.smithi089.stdout:9/86: rename d3/d6/c7 to d3/c1e 0 2024-09-13T02:53:55.882 INFO:tasks.workunit.client.0.smithi089.stdout:5/79: mkdir d1/d4/d1c 0 2024-09-13T02:53:55.892 INFO:tasks.workunit.client.0.smithi089.stdout:4/93: rename d2/f1d to d2/d3/d5/f1e 0 2024-09-13T02:53:55.896 INFO:tasks.workunit.client.0.smithi089.stdout:3/97: getdents d2/d8 0 2024-09-13T02:53:55.896 INFO:tasks.workunit.client.0.smithi089.stdout:3/98: dread - d2/d8/dc/f1b zero size 2024-09-13T02:53:55.901 INFO:tasks.workunit.client.0.smithi089.stdout:7/122: dwrite d3/de/d14/f1c [0,4194304] 0 2024-09-13T02:53:55.901 INFO:tasks.workunit.client.0.smithi089.stdout:9/87: dwrite d3/d15/f17 [0,4194304] 0 2024-09-13T02:53:55.907 INFO:tasks.workunit.client.0.smithi089.stdout:3/99: dread d2/f14 [0,4194304] 0 2024-09-13T02:53:55.910 INFO:tasks.workunit.client.0.smithi089.stdout:3/100: symlink d2/l22 0 2024-09-13T02:53:55.910 INFO:tasks.workunit.client.0.smithi089.stdout:3/101: fsync d2/f14 0 2024-09-13T02:53:55.910 INFO:tasks.workunit.client.0.smithi089.stdout:3/102: dread - d2/d8/dc/f1b zero size 2024-09-13T02:53:55.915 INFO:tasks.workunit.client.0.smithi089.stdout:7/123: rename d3/de to d3/d19/d2d 0 2024-09-13T02:53:55.916 INFO:tasks.workunit.client.0.smithi089.stdout:3/103: write d2/f16 [202700,20902] 0 2024-09-13T02:53:55.917 INFO:tasks.workunit.client.0.smithi089.stdout:3/104: mkdir d2/d20/d23 0 2024-09-13T02:53:55.925 INFO:tasks.workunit.client.0.smithi089.stdout:7/124: write d3/f5 [903370,32957] 0 2024-09-13T02:53:55.933 INFO:tasks.workunit.client.0.smithi089.stdout:2/104: dwrite f1 [0,4194304] 0 2024-09-13T02:53:55.935 INFO:tasks.workunit.client.0.smithi089.stdout:3/105: dwrite d2/d8/f13 [4194304,4194304] 0 2024-09-13T02:53:55.936 INFO:tasks.workunit.client.0.smithi089.stdout:7/125: dread d3/d19/d2d/f12 [0,4194304] 0 2024-09-13T02:53:55.936 INFO:tasks.workunit.client.0.smithi089.stdout:7/126: dread - d3/d19/d2d/f29 zero size 2024-09-13T02:53:55.942 INFO:tasks.workunit.client.0.smithi089.stdout:7/127: write d3/f11 [1244952,99422] 0 2024-09-13T02:53:55.944 INFO:tasks.workunit.client.0.smithi089.stdout:7/128: mkdir d3/d19/d2e 0 2024-09-13T02:53:55.952 INFO:tasks.workunit.client.0.smithi089.stdout:5/80: dwrite d1/d4/f14 [0,4194304] 0 2024-09-13T02:53:55.953 INFO:tasks.workunit.client.0.smithi089.stdout:3/106: dwrite d2/d8/dc/f1b [0,4194304] 0 2024-09-13T02:53:55.955 INFO:tasks.workunit.client.0.smithi089.stdout:5/81: link d1/d4/l16 d1/d4/l1d 0 2024-09-13T02:53:55.955 INFO:tasks.workunit.client.0.smithi089.stdout:5/82: chown d1/d4/l8 35207 1 2024-09-13T02:53:55.956 INFO:tasks.workunit.client.0.smithi089.stdout:5/83: stat d1/fd 0 2024-09-13T02:53:55.957 INFO:tasks.workunit.client.0.smithi089.stdout:7/129: dread d3/f11 [0,4194304] 0 2024-09-13T02:53:55.958 INFO:tasks.workunit.client.0.smithi089.stdout:7/130: dread d3/d19/d2d/f12 [0,4194304] 0 2024-09-13T02:53:55.958 INFO:tasks.workunit.client.0.smithi089.stdout:3/107: symlink d2/l24 0 2024-09-13T02:53:55.960 INFO:tasks.workunit.client.0.smithi089.stdout:3/108: creat d2/d20/f25 x:0 0 0 2024-09-13T02:53:55.961 INFO:tasks.workunit.client.0.smithi089.stdout:7/131: mknod d3/c2f 0 2024-09-13T02:53:55.962 INFO:tasks.workunit.client.0.smithi089.stdout:5/84: dread d1/d4/f14 [0,4194304] 0 2024-09-13T02:53:55.964 INFO:tasks.workunit.client.0.smithi089.stdout:5/85: link d1/d7/f15 d1/d4/d1c/f1e 0 2024-09-13T02:53:55.964 INFO:tasks.workunit.client.0.smithi089.stdout:5/86: dread - d1/d4/d1c/f1e zero size 2024-09-13T02:53:55.967 INFO:tasks.workunit.client.0.smithi089.stdout:7/132: link d3/l24 d3/d19/d2d/d14/l30 0 2024-09-13T02:53:55.968 INFO:tasks.workunit.client.0.smithi089.stdout:3/109: write d2/d8/dc/f1b [4873167,48464] 0 2024-09-13T02:53:55.968 INFO:tasks.workunit.client.0.smithi089.stdout:3/110: creat d2/d20/f26 x:0 0 0 2024-09-13T02:53:55.969 INFO:tasks.workunit.client.0.smithi089.stdout:5/87: dread d1/d4/fc [0,4194304] 0 2024-09-13T02:53:55.971 INFO:tasks.workunit.client.0.smithi089.stdout:5/88: mkdir d1/d7/d1f 0 2024-09-13T02:53:55.973 INFO:tasks.workunit.client.0.smithi089.stdout:5/89: link d1/d4/lf d1/d7/l20 0 2024-09-13T02:53:55.975 INFO:tasks.workunit.client.0.smithi089.stdout:5/90: unlink d1/f1b 0 2024-09-13T02:53:55.975 INFO:tasks.workunit.client.0.smithi089.stdout:5/91: fsync d1/d4/f14 0 2024-09-13T02:53:55.975 INFO:tasks.workunit.client.0.smithi089.stdout:7/133: dread d3/f5 [4194304,4194304] 0 2024-09-13T02:53:55.975 INFO:tasks.workunit.client.0.smithi089.stdout:7/134: fsync d3/d19/d2d/d14/f1c 0 2024-09-13T02:53:55.977 INFO:tasks.workunit.client.0.smithi089.stdout:7/135: rename d3/f11 to d3/d20/f31 0 2024-09-13T02:53:55.978 INFO:tasks.workunit.client.0.smithi089.stdout:7/136: creat d3/d20/f32 x:0 0 0 2024-09-13T02:53:55.978 INFO:tasks.workunit.client.0.smithi089.stdout:7/137: chown d3/f5 365610 1 2024-09-13T02:53:55.996 INFO:tasks.workunit.client.0.smithi089.stdout:5/92: dwrite d1/d7/f18 [0,4194304] 0 2024-09-13T02:53:55.998 INFO:tasks.workunit.client.0.smithi089.stdout:5/93: truncate d1/d4/f11 3078451 0 2024-09-13T02:53:56.001 INFO:tasks.workunit.client.0.smithi089.stdout:7/138: dwrite f0 [0,4194304] 0 2024-09-13T02:53:56.002 INFO:tasks.workunit.client.0.smithi089.stdout:7/139: chown d3/d19/c1e 1242 1 2024-09-13T02:53:56.008 INFO:tasks.workunit.client.0.smithi089.stdout:7/140: fsync d3/d20/f31 0 2024-09-13T02:53:56.010 INFO:tasks.workunit.client.0.smithi089.stdout:7/141: truncate d3/d20/f31 3603201 0 2024-09-13T02:53:56.011 INFO:tasks.workunit.client.0.smithi089.stdout:7/142: creat d3/d19/d2e/f33 x:0 0 0 2024-09-13T02:53:56.012 INFO:tasks.workunit.client.0.smithi089.stdout:7/143: mkdir d3/d19/d2e/d34 0 2024-09-13T02:53:56.014 INFO:tasks.workunit.client.0.smithi089.stdout:7/144: symlink d3/d19/d2e/l35 0 2024-09-13T02:53:56.014 INFO:tasks.workunit.client.0.smithi089.stdout:6/91: sync 2024-09-13T02:53:56.015 INFO:tasks.workunit.client.0.smithi089.stdout:7/145: fsync d3/d20/f31 0 2024-09-13T02:53:56.017 INFO:tasks.workunit.client.0.smithi089.stdout:6/92: dread f3 [0,4194304] 0 2024-09-13T02:53:56.017 INFO:tasks.workunit.client.0.smithi089.stdout:6/93: creat db/d10/f21 x:0 0 0 2024-09-13T02:53:56.019 INFO:tasks.workunit.client.0.smithi089.stdout:7/146: dread d3/d19/d2d/f18 [4194304,4194304] 0 2024-09-13T02:53:56.019 INFO:tasks.workunit.client.0.smithi089.stdout:7/147: chown d3/d19/d2d/f13 47185525 1 2024-09-13T02:53:56.019 INFO:tasks.workunit.client.0.smithi089.stdout:7/148: chown d3/l24 1011117986 1 2024-09-13T02:53:56.019 INFO:tasks.workunit.client.0.smithi089.stdout:7/149: chown d3/d19/d2d/d14/l26 298 1 2024-09-13T02:53:56.020 INFO:tasks.workunit.client.0.smithi089.stdout:7/150: creat d3/d19/f36 x:0 0 0 2024-09-13T02:53:56.034 INFO:tasks.workunit.client.0.smithi089.stdout:5/94: dwrite d1/d7/f18 [4194304,4194304] 0 2024-09-13T02:53:56.034 INFO:tasks.workunit.client.0.smithi089.stdout:5/95: write d1/d4/f17 [1030174,36783] 0 2024-09-13T02:53:56.034 INFO:tasks.workunit.client.0.smithi089.stdout:5/96: creat d1/d7/f21 x:0 0 0 2024-09-13T02:53:56.034 INFO:tasks.workunit.client.0.smithi089.stdout:5/97: write d1/d4/f17 [872927,112383] 0 2024-09-13T02:53:56.036 INFO:tasks.workunit.client.0.smithi089.stdout:5/98: symlink d1/d4/d1c/l22 0 2024-09-13T02:53:56.036 INFO:tasks.workunit.client.0.smithi089.stdout:5/99: write d1/d4/f17 [578136,78998] 0 2024-09-13T02:53:56.037 INFO:tasks.workunit.client.0.smithi089.stdout:5/100: link d1/d4/d1c/l22 d1/d4/l23 0 2024-09-13T02:53:56.041 INFO:tasks.workunit.client.0.smithi089.stdout:6/94: dwrite db/d10/f1f [0,4194304] 0 2024-09-13T02:53:56.041 INFO:tasks.workunit.client.0.smithi089.stdout:7/151: dwrite d3/f5 [4194304,4194304] 0 2024-09-13T02:53:56.043 INFO:tasks.workunit.client.0.smithi089.stdout:6/95: dread db/fc [0,4194304] 0 2024-09-13T02:53:56.043 INFO:tasks.workunit.client.0.smithi089.stdout:6/96: fsync db/d10/f11 0 2024-09-13T02:53:56.045 INFO:tasks.workunit.client.0.smithi089.stdout:6/97: mknod db/d10/c22 0 2024-09-13T02:53:56.045 INFO:tasks.workunit.client.0.smithi089.stdout:7/152: rmdir d3/d20 39 2024-09-13T02:53:56.045 INFO:tasks.workunit.client.0.smithi089.stdout:7/153: readlink d3/d19/l21 0 2024-09-13T02:53:56.045 INFO:tasks.workunit.client.0.smithi089.stdout:7/154: chown d3/d19/d2d/f1d 10 1 2024-09-13T02:53:56.046 INFO:tasks.workunit.client.0.smithi089.stdout:6/98: read db/fc [513434,43947] 0 2024-09-13T02:53:56.047 INFO:tasks.workunit.client.0.smithi089.stdout:7/155: rename d3/d19/d2e/d34 to d3/d19/d2e/d37 0 2024-09-13T02:53:56.049 INFO:tasks.workunit.client.0.smithi089.stdout:6/99: unlink db/fc 0 2024-09-13T02:53:56.049 INFO:tasks.workunit.client.0.smithi089.stdout:6/100: read f3 [158639,115004] 0 2024-09-13T02:53:56.050 INFO:tasks.workunit.client.0.smithi089.stdout:7/156: rmdir d3/d19/d2d 39 2024-09-13T02:53:56.050 INFO:tasks.workunit.client.0.smithi089.stdout:7/157: creat d3/d19/f38 x:0 0 0 2024-09-13T02:53:56.053 INFO:tasks.workunit.client.0.smithi089.stdout:7/158: creat d3/d20/d28/f39 x:0 0 0 2024-09-13T02:53:56.054 INFO:tasks.workunit.client.0.smithi089.stdout:7/159: rename d3/d19/c1e to d3/d19/d2e/d37/c3a 0 2024-09-13T02:53:56.055 INFO:tasks.workunit.client.0.smithi089.stdout:7/160: stat d3/lc 0 2024-09-13T02:53:56.060 INFO:tasks.workunit.client.0.smithi089.stdout:5/101: dwrite d1/d7/f18 [4194304,4194304] 0 2024-09-13T02:53:56.060 INFO:tasks.workunit.client.0.smithi089.stdout:5/102: chown d1 7 1 2024-09-13T02:53:56.063 INFO:tasks.workunit.client.0.smithi089.stdout:5/103: mknod d1/d7/d1f/c24 0 2024-09-13T02:53:56.063 INFO:tasks.workunit.client.0.smithi089.stdout:5/104: fdatasync d1/d4/f5 0 2024-09-13T02:53:56.063 INFO:tasks.workunit.client.0.smithi089.stdout:5/105: creat d1/d4/f25 x:0 0 0 2024-09-13T02:53:56.063 INFO:tasks.workunit.client.0.smithi089.stdout:5/106: creat d1/f26 x:0 0 0 2024-09-13T02:53:56.066 INFO:tasks.workunit.client.0.smithi089.stdout:5/107: link d1/d4/f11 d1/d7/f27 0 2024-09-13T02:53:56.066 INFO:tasks.workunit.client.0.smithi089.stdout:5/108: write d1/d7/f9 [166776,121530] 0 2024-09-13T02:53:56.067 INFO:tasks.workunit.client.0.smithi089.stdout:5/109: chown d1/d7 3918 1 2024-09-13T02:53:56.067 INFO:tasks.workunit.client.0.smithi089.stdout:5/110: readlink d1/d7/lb 0 2024-09-13T02:53:56.069 INFO:tasks.workunit.client.0.smithi089.stdout:5/111: mknod d1/c28 0 2024-09-13T02:53:56.069 INFO:tasks.workunit.client.0.smithi089.stdout:6/101: write db/f1d [3515692,69893] 0 2024-09-13T02:53:56.069 INFO:tasks.workunit.client.0.smithi089.stdout:6/102: write db/d10/f1e [928117,112913] 0 2024-09-13T02:53:56.069 INFO:tasks.workunit.client.0.smithi089.stdout:5/112: symlink d1/d7/d1f/l29 0 2024-09-13T02:53:56.073 INFO:tasks.workunit.client.0.smithi089.stdout:6/103: creat db/f23 x:0 0 0 2024-09-13T02:53:56.073 INFO:tasks.workunit.client.0.smithi089.stdout:6/104: creat db/d10/f24 x:0 0 0 2024-09-13T02:53:56.074 INFO:tasks.workunit.client.0.smithi089.stdout:5/113: mknod d1/d4/d1c/c2a 0 2024-09-13T02:53:56.074 INFO:tasks.workunit.client.0.smithi089.stdout:7/161: dwrite d3/f5 [4194304,4194304] 0 2024-09-13T02:53:56.076 INFO:tasks.workunit.client.0.smithi089.stdout:5/114: mkdir d1/d4/d2b 0 2024-09-13T02:53:56.076 INFO:tasks.workunit.client.0.smithi089.stdout:5/115: chown d1/d7/f15 5656151 1 2024-09-13T02:53:56.076 INFO:tasks.workunit.client.0.smithi089.stdout:5/116: dread - d1/f26 zero size 2024-09-13T02:53:56.079 INFO:tasks.workunit.client.0.smithi089.stdout:1/67: sync 2024-09-13T02:53:56.079 INFO:tasks.workunit.client.0.smithi089.stdout:1/68: truncate dc/f10 629251 0 2024-09-13T02:53:56.079 INFO:tasks.workunit.client.0.smithi089.stdout:1/69: fsync f7 0 2024-09-13T02:53:56.081 INFO:tasks.workunit.client.0.smithi089.stdout:1/70: mkdir dc/d12 0 2024-09-13T02:53:56.082 INFO:tasks.workunit.client.0.smithi089.stdout:6/105: write db/d10/f1f [734337,70167] 0 2024-09-13T02:53:56.082 INFO:tasks.workunit.client.0.smithi089.stdout:6/106: readlink db/d10/l1c 0 2024-09-13T02:53:56.082 INFO:tasks.workunit.client.0.smithi089.stdout:6/107: truncate db/d10/f24 481435 0 2024-09-13T02:53:56.083 INFO:tasks.workunit.client.0.smithi089.stdout:1/71: rename f2 to dc/f13 0 2024-09-13T02:53:56.083 INFO:tasks.workunit.client.0.smithi089.stdout:1/72: write f3 [2349477,108850] 0 2024-09-13T02:53:56.084 INFO:tasks.workunit.client.0.smithi089.stdout:6/108: mknod db/d10/c25 0 2024-09-13T02:53:56.084 INFO:tasks.workunit.client.0.smithi089.stdout:6/109: creat db/f26 x:0 0 0 2024-09-13T02:53:56.087 INFO:tasks.workunit.client.0.smithi089.stdout:7/162: dread d3/f1b [0,4194304] 0 2024-09-13T02:53:56.088 INFO:tasks.workunit.client.0.smithi089.stdout:6/110: dread db/d10/f14 [0,4194304] 0 2024-09-13T02:53:56.088 INFO:tasks.workunit.client.0.smithi089.stdout:7/163: rmdir d3/d19/d2e/d37 39 2024-09-13T02:53:56.089 INFO:tasks.workunit.client.0.smithi089.stdout:5/117: rmdir d1/d7 39 2024-09-13T02:53:56.090 INFO:tasks.workunit.client.0.smithi089.stdout:6/111: mkdir db/d10/d27 0 2024-09-13T02:53:56.092 INFO:tasks.workunit.client.0.smithi089.stdout:7/164: creat d3/d19/d2d/f3b x:0 0 0 2024-09-13T02:53:56.092 INFO:tasks.workunit.client.0.smithi089.stdout:5/118: dread d1/fd [0,4194304] 0 2024-09-13T02:53:56.095 INFO:tasks.workunit.client.0.smithi089.stdout:6/112: mkdir db/d10/d27/d28 0 2024-09-13T02:53:56.096 INFO:tasks.workunit.client.0.smithi089.stdout:6/113: mknod db/d10/d27/c29 0 2024-09-13T02:53:56.097 INFO:tasks.workunit.client.0.smithi089.stdout:6/114: truncate f0 1677492 0 2024-09-13T02:53:56.098 INFO:tasks.workunit.client.0.smithi089.stdout:0/68: sync 2024-09-13T02:53:56.099 INFO:tasks.workunit.client.0.smithi089.stdout:2/105: sync 2024-09-13T02:53:56.100 INFO:tasks.workunit.client.0.smithi089.stdout:8/131: sync 2024-09-13T02:53:56.100 INFO:tasks.workunit.client.0.smithi089.stdout:3/111: sync 2024-09-13T02:53:56.100 INFO:tasks.workunit.client.0.smithi089.stdout:4/94: sync 2024-09-13T02:53:56.100 INFO:tasks.workunit.client.0.smithi089.stdout:4/95: write d2/da/f10 [1328072,38017] 0 2024-09-13T02:53:56.101 INFO:tasks.workunit.client.0.smithi089.stdout:4/96: creat d2/f1f x:0 0 0 2024-09-13T02:53:56.101 INFO:tasks.workunit.client.0.smithi089.stdout:4/97: fdatasync d2/d3/de/f16 0 2024-09-13T02:53:56.101 INFO:tasks.workunit.client.0.smithi089.stdout:4/98: truncate d2/d3/d5/f1e 899167 0 2024-09-13T02:53:56.101 INFO:tasks.workunit.client.0.smithi089.stdout:4/99: chown d2/da/c1b 1338139 1 2024-09-13T02:53:56.101 INFO:tasks.workunit.client.0.smithi089.stdout:9/88: sync 2024-09-13T02:53:56.102 INFO:tasks.workunit.client.0.smithi089.stdout:2/106: readlink d13/d1d/l21 0 2024-09-13T02:53:56.104 INFO:tasks.workunit.client.0.smithi089.stdout:4/100: rmdir d2/da 39 2024-09-13T02:53:56.104 INFO:tasks.workunit.client.0.smithi089.stdout:4/101: fdatasync d2/f4 0 2024-09-13T02:53:56.105 INFO:tasks.workunit.client.0.smithi089.stdout:7/165: dread f0 [0,4194304] 0 2024-09-13T02:53:56.107 INFO:tasks.workunit.client.0.smithi089.stdout:0/69: dread d2/f13 [0,4194304] 0 2024-09-13T02:53:56.107 INFO:tasks.workunit.client.0.smithi089.stdout:0/70: stat d2/f6 0 2024-09-13T02:53:56.107 INFO:tasks.workunit.client.0.smithi089.stdout:0/71: dread - d2/f16 zero size 2024-09-13T02:53:56.107 INFO:tasks.workunit.client.0.smithi089.stdout:0/72: creat d2/f18 x:0 0 0 2024-09-13T02:53:56.107 INFO:tasks.workunit.client.0.smithi089.stdout:0/73: read - d2/f17 zero size 2024-09-13T02:53:56.108 INFO:tasks.workunit.client.0.smithi089.stdout:9/89: rename d3/f4 to d3/f1f 0 2024-09-13T02:53:56.108 INFO:tasks.workunit.client.0.smithi089.stdout:5/119: dread d1/d4/f17 [0,4194304] 0 2024-09-13T02:53:56.108 INFO:tasks.workunit.client.0.smithi089.stdout:2/107: symlink d13/l29 0 2024-09-13T02:53:56.108 INFO:tasks.workunit.client.0.smithi089.stdout:4/102: symlink d2/d3/de/l20 0 2024-09-13T02:53:56.111 INFO:tasks.workunit.client.0.smithi089.stdout:9/90: truncate d3/f1f 188941 0 2024-09-13T02:53:56.113 INFO:tasks.workunit.client.0.smithi089.stdout:4/103: symlink d2/da/l21 0 2024-09-13T02:53:56.114 INFO:tasks.workunit.client.0.smithi089.stdout:7/166: mknod d3/c3c 0 2024-09-13T02:53:56.114 INFO:tasks.workunit.client.0.smithi089.stdout:2/108: dread d13/f1a [0,4194304] 0 2024-09-13T02:53:56.116 INFO:tasks.workunit.client.0.smithi089.stdout:4/104: mkdir d2/d22 0 2024-09-13T02:53:56.119 INFO:tasks.workunit.client.0.smithi089.stdout:1/73: dwrite dc/f13 [0,4194304] 0 2024-09-13T02:53:56.119 INFO:tasks.workunit.client.0.smithi089.stdout:1/74: write f8 [825929,89580] 0 2024-09-13T02:53:56.119 INFO:tasks.workunit.client.0.smithi089.stdout:7/167: link d3/d19/f36 d3/d19/f3d 0 2024-09-13T02:53:56.119 INFO:tasks.workunit.client.0.smithi089.stdout:7/168: readlink d3/d19/l2b 0 2024-09-13T02:53:56.121 INFO:tasks.workunit.client.0.smithi089.stdout:9/91: rename d3/l9 to d3/d15/l20 0 2024-09-13T02:53:56.125 INFO:tasks.workunit.client.0.smithi089.stdout:1/75: symlink dc/l14 0 2024-09-13T02:53:56.128 INFO:tasks.workunit.client.0.smithi089.stdout:7/169: link d3/lc d3/d19/l3e 0 2024-09-13T02:53:56.128 INFO:tasks.workunit.client.0.smithi089.stdout:7/170: write d3/d19/d2d/f29 [1004672,26012] 0 2024-09-13T02:53:56.130 INFO:tasks.workunit.client.0.smithi089.stdout:4/105: rmdir d2/d3/d5 39 2024-09-13T02:53:56.135 INFO:tasks.workunit.client.0.smithi089.stdout:2/109: rename d13/c25 to d13/c2a 0 2024-09-13T02:53:56.135 INFO:tasks.workunit.client.0.smithi089.stdout:2/110: dread - d13/d1d/f23 zero size 2024-09-13T02:53:56.136 INFO:tasks.workunit.client.0.smithi089.stdout:4/106: mkdir d2/da/d23 0 2024-09-13T02:53:56.138 INFO:tasks.workunit.client.0.smithi089.stdout:4/107: symlink d2/da/l24 0 2024-09-13T02:53:56.138 INFO:tasks.workunit.client.0.smithi089.stdout:4/108: truncate d2/f1f 178694 0 2024-09-13T02:53:56.138 INFO:tasks.workunit.client.0.smithi089.stdout:2/111: rmdir d13/d1d 39 2024-09-13T02:53:56.138 INFO:tasks.workunit.client.0.smithi089.stdout:2/112: write d13/d1d/f22 [146966,8505] 0 2024-09-13T02:53:56.138 INFO:tasks.workunit.client.0.smithi089.stdout:5/120: dwrite d1/d4/f17 [0,4194304] 0 2024-09-13T02:53:56.139 INFO:tasks.workunit.client.0.smithi089.stdout:8/132: dwrite f0 [0,4194304] 0 2024-09-13T02:53:56.140 INFO:tasks.workunit.client.0.smithi089.stdout:3/112: dwrite d2/d8/f21 [0,4194304] 0 2024-09-13T02:53:56.140 INFO:tasks.workunit.client.0.smithi089.stdout:3/113: write d2/d20/f25 [983750,58159] 0 2024-09-13T02:53:56.140 INFO:tasks.workunit.client.0.smithi089.stdout:4/109: rename d2/d3/f17 to d2/d3/f25 0 2024-09-13T02:53:56.144 INFO:tasks.workunit.client.0.smithi089.stdout:5/121: mkdir d1/d7/d2c 0 2024-09-13T02:53:56.149 INFO:tasks.workunit.client.0.smithi089.stdout:2/113: dread d13/f1c [0,4194304] 0 2024-09-13T02:53:56.151 INFO:tasks.workunit.client.0.smithi089.stdout:7/171: dwrite d3/d19/d2d/f13 [0,4194304] 0 2024-09-13T02:53:56.151 INFO:tasks.workunit.client.0.smithi089.stdout:7/172: chown d3/lc 1228484 1 2024-09-13T02:53:56.152 INFO:tasks.workunit.client.0.smithi089.stdout:1/76: dwrite f7 [0,4194304] 0 2024-09-13T02:53:56.157 INFO:tasks.workunit.client.0.smithi089.stdout:8/133: creat de/d16/d1e/f2a x:0 0 0 2024-09-13T02:53:56.161 INFO:tasks.workunit.client.0.smithi089.stdout:3/114: read - d2/f19 zero size 2024-09-13T02:53:56.162 INFO:tasks.workunit.client.0.smithi089.stdout:4/110: creat d2/d22/f26 x:0 0 0 2024-09-13T02:53:56.162 INFO:tasks.workunit.client.0.smithi089.stdout:4/111: stat d2/d3/de/f18 0 2024-09-13T02:53:56.164 INFO:tasks.workunit.client.0.smithi089.stdout:9/92: truncate d3/f1f 446028 0 2024-09-13T02:53:56.174 INFO:tasks.workunit.client.0.smithi089.stdout:3/115: mkdir d2/d20/d23/d27 0 2024-09-13T02:53:56.174 INFO:tasks.workunit.client.0.smithi089.stdout:3/116: write d2/d8/dc/f1e [698411,76112] 0 2024-09-13T02:53:56.175 INFO:tasks.workunit.client.0.smithi089.stdout:1/77: dwrite dc/fe [0,4194304] 0 2024-09-13T02:53:56.175 INFO:tasks.workunit.client.0.smithi089.stdout:1/78: write f8 [1571559,77536] 0 2024-09-13T02:53:56.176 INFO:tasks.workunit.client.0.smithi089.stdout:2/114: rmdir d13 39 2024-09-13T02:53:56.176 INFO:tasks.workunit.client.0.smithi089.stdout:2/115: fsync d13/d1d/f22 0 2024-09-13T02:53:56.176 INFO:tasks.workunit.client.0.smithi089.stdout:2/116: write f3 [3552976,95058] 0 2024-09-13T02:53:56.178 INFO:tasks.workunit.client.0.smithi089.stdout:7/173: getdents d3/d20/d28 0 2024-09-13T02:53:56.178 INFO:tasks.workunit.client.0.smithi089.stdout:3/117: dread d2/d20/f25 [0,4194304] 0 2024-09-13T02:53:56.179 INFO:tasks.workunit.client.0.smithi089.stdout:3/118: creat d2/d20/f28 x:0 0 0 2024-09-13T02:53:56.183 INFO:tasks.workunit.client.0.smithi089.stdout:1/79: creat dc/d12/f15 x:0 0 0 2024-09-13T02:53:56.184 INFO:tasks.workunit.client.0.smithi089.stdout:2/117: creat d13/d1d/f2b x:0 0 0 2024-09-13T02:53:56.185 INFO:tasks.workunit.client.0.smithi089.stdout:8/134: rmdir de/d16/d1e 39 2024-09-13T02:53:56.185 INFO:tasks.workunit.client.0.smithi089.stdout:8/135: write de/f12 [659056,103921] 0 2024-09-13T02:53:56.188 INFO:tasks.workunit.client.0.smithi089.stdout:7/174: rename d3/d20/f31 to d3/d19/f3f 0 2024-09-13T02:53:56.188 INFO:tasks.workunit.client.0.smithi089.stdout:7/175: dread - d3/d19/d2d/f3b zero size 2024-09-13T02:53:56.189 INFO:tasks.workunit.client.0.smithi089.stdout:9/93: dwrite d3/d15/f1b [0,4194304] 0 2024-09-13T02:53:56.192 INFO:tasks.workunit.client.0.smithi089.stdout:9/94: dread f2 [0,4194304] 0 2024-09-13T02:53:56.193 INFO:tasks.workunit.client.0.smithi089.stdout:1/80: truncate f3 1618189 0 2024-09-13T02:53:56.194 INFO:tasks.workunit.client.0.smithi089.stdout:9/95: symlink d3/d6/l21 0 2024-09-13T02:53:56.200 INFO:tasks.workunit.client.0.smithi089.stdout:4/112: dwrite d2/d3/de/f18 [0,4194304] 0 2024-09-13T02:53:56.200 INFO:tasks.workunit.client.0.smithi089.stdout:7/176: write d3/d19/d2d/d14/f1c [2266094,48453] 0 2024-09-13T02:53:56.200 INFO:tasks.workunit.client.0.smithi089.stdout:4/113: chown d2/f4 56776 1 2024-09-13T02:53:56.201 INFO:tasks.workunit.client.0.smithi089.stdout:4/114: chown d2/da/d23 16387114 1 2024-09-13T02:53:56.201 INFO:tasks.workunit.client.0.smithi089.stdout:9/96: write d3/d6/df/f12 [222661,35124] 0 2024-09-13T02:53:56.204 INFO:tasks.workunit.client.0.smithi089.stdout:4/115: symlink d2/d22/l27 0 2024-09-13T02:53:56.205 INFO:tasks.workunit.client.0.smithi089.stdout:2/118: dwrite d13/f1a [0,4194304] 0 2024-09-13T02:53:56.205 INFO:tasks.workunit.client.0.smithi089.stdout:2/119: write d13/f27 [726331,63738] 0 2024-09-13T02:53:56.205 INFO:tasks.workunit.client.0.smithi089.stdout:2/120: stat fd 0 2024-09-13T02:53:56.206 INFO:tasks.workunit.client.0.smithi089.stdout:7/177: symlink d3/d19/d2d/d14/l40 0 2024-09-13T02:53:56.206 INFO:tasks.workunit.client.0.smithi089.stdout:9/97: rmdir d3/d6 39 2024-09-13T02:53:56.206 INFO:tasks.workunit.client.0.smithi089.stdout:3/119: dwrite d2/d8/f13 [4194304,4194304] 0 2024-09-13T02:53:56.206 INFO:tasks.workunit.client.0.smithi089.stdout:3/120: chown d2/d20/f28 1476887 1 2024-09-13T02:53:56.207 INFO:tasks.workunit.client.0.smithi089.stdout:4/116: creat d2/d3/d5/f28 x:0 0 0 2024-09-13T02:53:56.207 INFO:tasks.workunit.client.0.smithi089.stdout:4/117: chown d2/d3/d5/f28 119902250 1 2024-09-13T02:53:56.208 INFO:tasks.workunit.client.0.smithi089.stdout:9/98: dread f2 [0,4194304] 0 2024-09-13T02:53:56.208 INFO:tasks.workunit.client.0.smithi089.stdout:9/99: truncate f2 792555 0 2024-09-13T02:53:56.208 INFO:tasks.workunit.client.0.smithi089.stdout:9/100: readlink d3/l1c 0 2024-09-13T02:53:56.211 INFO:tasks.workunit.client.0.smithi089.stdout:7/178: link d3/d19/d2d/f13 d3/d19/f41 0 2024-09-13T02:53:56.212 INFO:tasks.workunit.client.0.smithi089.stdout:3/121: creat d2/d20/d23/f29 x:0 0 0 2024-09-13T02:53:56.212 INFO:tasks.workunit.client.0.smithi089.stdout:3/122: stat d2/d8/dc/ff 0 2024-09-13T02:53:56.218 INFO:tasks.workunit.client.0.smithi089.stdout:4/118: mknod d2/d3/de/c29 0 2024-09-13T02:53:56.222 INFO:tasks.workunit.client.0.smithi089.stdout:4/119: mknod d2/d3/de/c2a 0 2024-09-13T02:53:56.222 INFO:tasks.workunit.client.0.smithi089.stdout:4/120: chown d2/d3/de/f16 589310 1 2024-09-13T02:53:56.222 INFO:tasks.workunit.client.0.smithi089.stdout:4/121: stat d2/d3/de/c2a 0 2024-09-13T02:53:56.222 INFO:tasks.workunit.client.0.smithi089.stdout:4/122: dread - d2/d3/de/f16 zero size 2024-09-13T02:53:56.222 INFO:tasks.workunit.client.0.smithi089.stdout:6/115: sync 2024-09-13T02:53:56.222 INFO:tasks.workunit.client.0.smithi089.stdout:0/74: sync 2024-09-13T02:53:56.224 INFO:tasks.workunit.client.0.smithi089.stdout:6/116: truncate db/d10/f11 1029572 0 2024-09-13T02:53:56.225 INFO:tasks.workunit.client.0.smithi089.stdout:2/121: dread f1 [0,4194304] 0 2024-09-13T02:53:56.225 INFO:tasks.workunit.client.0.smithi089.stdout:1/81: dwrite f8 [0,4194304] 0 2024-09-13T02:53:56.226 INFO:tasks.workunit.client.0.smithi089.stdout:0/75: mkdir d2/d19 0 2024-09-13T02:53:56.226 INFO:tasks.workunit.client.0.smithi089.stdout:0/76: truncate d2/f4 1755565 0 2024-09-13T02:53:56.227 INFO:tasks.workunit.client.0.smithi089.stdout:6/117: symlink db/d10/d27/d28/l2a 0 2024-09-13T02:53:56.229 INFO:tasks.workunit.client.0.smithi089.stdout:2/122: stat d13/l14 0 2024-09-13T02:53:56.231 INFO:tasks.workunit.client.0.smithi089.stdout:6/118: mknod db/c2b 0 2024-09-13T02:53:56.231 INFO:tasks.workunit.client.0.smithi089.stdout:6/119: truncate db/d10/f21 282529 0 2024-09-13T02:53:56.232 INFO:tasks.workunit.client.0.smithi089.stdout:1/82: getdents dc/d12 0 2024-09-13T02:53:56.232 INFO:tasks.workunit.client.0.smithi089.stdout:1/83: write dc/d12/f15 [908488,68210] 0 2024-09-13T02:53:56.233 INFO:tasks.workunit.client.0.smithi089.stdout:6/120: unlink db/d10/f21 0 2024-09-13T02:53:56.234 INFO:tasks.workunit.client.0.smithi089.stdout:2/123: truncate d13/f17 141299 0 2024-09-13T02:53:56.236 INFO:tasks.workunit.client.0.smithi089.stdout:6/121: creat db/d10/d27/f2c x:0 0 0 2024-09-13T02:53:56.236 INFO:tasks.workunit.client.0.smithi089.stdout:7/179: dwrite d3/d19/d2d/f3b [0,4194304] 0 2024-09-13T02:53:56.237 INFO:tasks.workunit.client.0.smithi089.stdout:4/123: getdents d2/d22 0 2024-09-13T02:53:56.237 INFO:tasks.workunit.client.0.smithi089.stdout:4/124: chown d2/d22/f26 14523288 1 2024-09-13T02:53:56.238 INFO:tasks.workunit.client.0.smithi089.stdout:1/84: rmdir dc 39 2024-09-13T02:53:56.238 INFO:tasks.workunit.client.0.smithi089.stdout:1/85: fdatasync f3 0 2024-09-13T02:53:56.241 INFO:tasks.workunit.client.0.smithi089.stdout:9/101: dwrite d3/f1f [0,4194304] 0 2024-09-13T02:53:56.242 INFO:tasks.workunit.client.0.smithi089.stdout:7/180: rename d3/d20/l23 to d3/d19/d2d/l42 0 2024-09-13T02:53:56.246 INFO:tasks.workunit.client.0.smithi089.stdout:2/124: read d13/f1a [1939002,34045] 0 2024-09-13T02:53:56.246 INFO:tasks.workunit.client.0.smithi089.stdout:3/123: dwrite d2/d20/d23/f29 [0,4194304] 0 2024-09-13T02:53:56.246 INFO:tasks.workunit.client.0.smithi089.stdout:3/124: chown d2/d20/d23/f29 1 1 2024-09-13T02:53:56.246 INFO:tasks.workunit.client.0.smithi089.stdout:1/86: mknod dc/c16 0 2024-09-13T02:53:56.246 INFO:tasks.workunit.client.0.smithi089.stdout:3/125: stat d2/d8/c1f 0 2024-09-13T02:53:56.246 INFO:tasks.workunit.client.0.smithi089.stdout:1/87: fdatasync f3 0 2024-09-13T02:53:56.247 INFO:tasks.workunit.client.0.smithi089.stdout:4/125: dread d2/da/f13 [0,4194304] 0 2024-09-13T02:53:56.247 INFO:tasks.workunit.client.0.smithi089.stdout:4/126: creat d2/d3/de/f2b x:0 0 0 2024-09-13T02:53:56.247 INFO:tasks.workunit.client.0.smithi089.stdout:4/127: chown d2/da/f13 60634 1 2024-09-13T02:53:56.248 INFO:tasks.workunit.client.0.smithi089.stdout:9/102: getdents d3/d6/df 0 2024-09-13T02:53:56.248 INFO:tasks.workunit.client.0.smithi089.stdout:5/122: sync 2024-09-13T02:53:56.250 INFO:tasks.workunit.client.0.smithi089.stdout:3/126: readlink d2/l1c 0 2024-09-13T02:53:56.251 INFO:tasks.workunit.client.0.smithi089.stdout:3/127: chown d2/d8/dc/f1e 10453 1 2024-09-13T02:53:56.253 INFO:tasks.workunit.client.0.smithi089.stdout:1/88: rename f8 to dc/f17 0 2024-09-13T02:53:56.255 INFO:tasks.workunit.client.0.smithi089.stdout:2/125: write f5 [3183874,109140] 0 2024-09-13T02:53:56.256 INFO:tasks.workunit.client.0.smithi089.stdout:7/181: dread d3/f5 [4194304,4194304] 0 2024-09-13T02:53:56.258 INFO:tasks.workunit.client.0.smithi089.stdout:5/123: creat d1/d4/d2b/f2d x:0 0 0 2024-09-13T02:53:56.258 INFO:tasks.workunit.client.0.smithi089.stdout:6/122: getdents db/d10/d27/d28 0 2024-09-13T02:53:56.259 INFO:tasks.workunit.client.0.smithi089.stdout:9/103: write d3/d6/df/f12 [369860,33010] 0 2024-09-13T02:53:56.259 INFO:tasks.workunit.client.0.smithi089.stdout:5/124: dread d1/d7/f19 [0,4194304] 0 2024-09-13T02:53:56.259 INFO:tasks.workunit.client.0.smithi089.stdout:5/125: write d1/d4/f5 [515337,58394] 0 2024-09-13T02:53:56.259 INFO:tasks.workunit.client.0.smithi089.stdout:5/126: chown d1/d7/f15 258234875 1 2024-09-13T02:53:56.259 INFO:tasks.workunit.client.0.smithi089.stdout:7/182: getdents d3/d19/d2d/d14 0 2024-09-13T02:53:56.259 INFO:tasks.workunit.client.0.smithi089.stdout:3/128: dread d2/d8/dc/ff [0,4194304] 0 2024-09-13T02:53:56.261 INFO:tasks.workunit.client.0.smithi089.stdout:6/123: truncate db/f12 2813944 0 2024-09-13T02:53:56.261 INFO:tasks.workunit.client.0.smithi089.stdout:3/129: dread d2/d20/f25 [0,4194304] 0 2024-09-13T02:53:56.261 INFO:tasks.workunit.client.0.smithi089.stdout:6/124: fsync f0 0 2024-09-13T02:53:56.261 INFO:tasks.workunit.client.0.smithi089.stdout:0/77: truncate d2/f4 993460 0 2024-09-13T02:53:56.262 INFO:tasks.workunit.client.0.smithi089.stdout:7/183: dread d3/d19/d2d/f12 [0,4194304] 0 2024-09-13T02:53:56.262 INFO:tasks.workunit.client.0.smithi089.stdout:9/104: creat d3/f22 x:0 0 0 2024-09-13T02:53:56.263 INFO:tasks.workunit.client.0.smithi089.stdout:9/105: fdatasync d3/f1f 0 2024-09-13T02:53:56.264 INFO:tasks.workunit.client.0.smithi089.stdout:1/89: dread dc/d12/f15 [0,4194304] 0 2024-09-13T02:53:56.266 INFO:tasks.workunit.client.0.smithi089.stdout:2/126: link d13/d1d/f23 d13/d1d/f2c 0 2024-09-13T02:53:56.268 INFO:tasks.workunit.client.0.smithi089.stdout:6/125: mknod db/d10/d27/d28/c2d 0 2024-09-13T02:53:56.269 INFO:tasks.workunit.client.0.smithi089.stdout:3/130: write d2/d8/dc/f1b [1574647,57540] 0 2024-09-13T02:53:56.269 INFO:tasks.workunit.client.0.smithi089.stdout:3/131: truncate d2/f19 331656 0 2024-09-13T02:53:56.270 INFO:tasks.workunit.client.0.smithi089.stdout:0/78: mkdir d2/d19/d1a 0 2024-09-13T02:53:56.270 INFO:tasks.workunit.client.0.smithi089.stdout:0/79: write f1 [636468,29331] 0 2024-09-13T02:53:56.270 INFO:tasks.workunit.client.0.smithi089.stdout:0/80: truncate d2/f17 447309 0 2024-09-13T02:53:56.270 INFO:tasks.workunit.client.0.smithi089.stdout:4/128: dwrite d2/d3/de/f18 [0,4194304] 0 2024-09-13T02:53:56.272 INFO:tasks.workunit.client.0.smithi089.stdout:7/184: rename d3/d19/d2d/f13 to d3/d20/d28/f43 0 2024-09-13T02:53:56.272 INFO:tasks.workunit.client.0.smithi089.stdout:7/185: chown d3/d19/f3d 14982576 1 2024-09-13T02:53:56.272 INFO:tasks.workunit.client.0.smithi089.stdout:7/186: chown d3/c3c 379197352 1 2024-09-13T02:53:56.273 INFO:tasks.workunit.client.0.smithi089.stdout:1/90: symlink dc/l18 0 2024-09-13T02:53:56.273 INFO:tasks.workunit.client.0.smithi089.stdout:1/91: truncate f7 2074106 0 2024-09-13T02:53:56.273 INFO:tasks.workunit.client.0.smithi089.stdout:1/92: chown dc 60096377 1 2024-09-13T02:53:56.275 INFO:tasks.workunit.client.0.smithi089.stdout:6/126: mkdir db/d10/d27/d2e 0 2024-09-13T02:53:56.275 INFO:tasks.workunit.client.0.smithi089.stdout:6/127: read - db/d10/d27/f2c zero size 2024-09-13T02:53:56.275 INFO:tasks.workunit.client.0.smithi089.stdout:6/128: chown db/d10/c1a 1838 1 2024-09-13T02:53:56.277 INFO:tasks.workunit.client.0.smithi089.stdout:0/81: symlink d2/d19/d1a/l1b 0 2024-09-13T02:53:56.277 INFO:tasks.workunit.client.0.smithi089.stdout:0/82: chown d2/f18 47943 1 2024-09-13T02:53:56.285 INFO:tasks.workunit.client.0.smithi089.stdout:9/106: dwrite f2 [4194304,4194304] 0 2024-09-13T02:53:56.287 INFO:tasks.workunit.client.0.smithi089.stdout:5/127: dwrite d1/f26 [0,4194304] 0 2024-09-13T02:53:56.287 INFO:tasks.workunit.client.0.smithi089.stdout:5/128: write d1/d4/f25 [1045777,95797] 0 2024-09-13T02:53:56.288 INFO:tasks.workunit.client.0.smithi089.stdout:4/129: link d2/d3/de/l20 d2/l2c 0 2024-09-13T02:53:56.288 INFO:tasks.workunit.client.0.smithi089.stdout:4/130: creat d2/d3/de/f2d x:0 0 0 2024-09-13T02:53:56.288 INFO:tasks.workunit.client.0.smithi089.stdout:4/131: stat d2/d3 0 2024-09-13T02:53:56.288 INFO:tasks.workunit.client.0.smithi089.stdout:4/132: fsync d2/f4 0 2024-09-13T02:53:56.288 INFO:tasks.workunit.client.0.smithi089.stdout:4/133: dread d2/f1f [0,4194304] 0 2024-09-13T02:53:56.288 INFO:tasks.workunit.client.0.smithi089.stdout:4/134: fdatasync d2/f4 0 2024-09-13T02:53:56.289 INFO:tasks.workunit.client.0.smithi089.stdout:4/135: write d2/d3/de/f2b [139477,102995] 0 2024-09-13T02:53:56.289 INFO:tasks.workunit.client.0.smithi089.stdout:1/93: rmdir dc 39 2024-09-13T02:53:56.292 INFO:tasks.workunit.client.0.smithi089.stdout:6/129: mkdir db/d10/d27/d28/d2f 0 2024-09-13T02:53:56.294 INFO:tasks.workunit.client.0.smithi089.stdout:0/83: creat d2/d19/f1c x:0 0 0 2024-09-13T02:53:56.294 INFO:tasks.workunit.client.0.smithi089.stdout:0/84: write d2/f6 [848033,113201] 0 2024-09-13T02:53:56.297 INFO:tasks.workunit.client.0.smithi089.stdout:5/129: dread d1/d7/f27 [0,4194304] 0 2024-09-13T02:53:56.297 INFO:tasks.workunit.client.0.smithi089.stdout:5/130: write d1/d7/f15 [1018205,67855] 0 2024-09-13T02:53:56.299 INFO:tasks.workunit.client.0.smithi089.stdout:1/94: dread dc/d12/f15 [0,4194304] 0 2024-09-13T02:53:56.301 INFO:tasks.workunit.client.0.smithi089.stdout:7/187: rename d3/d20/d28 to d3/d44 0 2024-09-13T02:53:56.302 INFO:tasks.workunit.client.0.smithi089.stdout:6/130: link db/f23 db/d10/d27/f30 0 2024-09-13T02:53:56.302 INFO:tasks.workunit.client.0.smithi089.stdout:6/131: chown db/d10/c17 352 1 2024-09-13T02:53:56.302 INFO:tasks.workunit.client.0.smithi089.stdout:6/132: stat db/d10/c25 0 2024-09-13T02:53:56.308 INFO:tasks.workunit.client.0.smithi089.stdout:6/133: mknod db/d10/d27/c31 0 2024-09-13T02:53:56.309 INFO:tasks.workunit.client.0.smithi089.stdout:3/132: truncate d2/d8/dc/f1b 550769 0 2024-09-13T02:53:56.309 INFO:tasks.workunit.client.0.smithi089.stdout:3/133: write d2/d8/dc/f1e [856224,95923] 0 2024-09-13T02:53:56.310 INFO:tasks.workunit.client.0.smithi089.stdout:6/134: write db/d10/f11 [304560,22089] 0 2024-09-13T02:53:56.317 INFO:tasks.workunit.client.0.smithi089.stdout:1/95: dread dc/fe [0,4194304] 0 2024-09-13T02:53:56.317 INFO:tasks.workunit.client.0.smithi089.stdout:5/131: rmdir d1 39 2024-09-13T02:53:56.319 INFO:tasks.workunit.client.0.smithi089.stdout:2/127: dwrite f5 [0,4194304] 0 2024-09-13T02:53:56.319 INFO:tasks.workunit.client.0.smithi089.stdout:2/128: write d13/d1d/f2b [675016,123575] 0 2024-09-13T02:53:56.319 INFO:tasks.workunit.client.0.smithi089.stdout:2/129: dread - d13/d1d/f2c zero size 2024-09-13T02:53:56.320 INFO:tasks.workunit.client.0.smithi089.stdout:0/85: dwrite d2/f18 [0,4194304] 0 2024-09-13T02:53:56.320 INFO:tasks.workunit.client.0.smithi089.stdout:7/188: dwrite d3/d19/d2d/f3b [0,4194304] 0 2024-09-13T02:53:56.320 INFO:tasks.workunit.client.0.smithi089.stdout:9/107: rename d3/d6/df/c13 to d3/c23 0 2024-09-13T02:53:56.321 INFO:tasks.workunit.client.0.smithi089.stdout:1/96: symlink dc/d12/l19 0 2024-09-13T02:53:56.321 INFO:tasks.workunit.client.0.smithi089.stdout:5/132: stat d1/d7/l20 0 2024-09-13T02:53:56.327 INFO:tasks.workunit.client.0.smithi089.stdout:0/86: stat d2/c12 0 2024-09-13T02:53:56.328 INFO:tasks.workunit.client.0.smithi089.stdout:7/189: symlink d3/d19/d2d/l45 0 2024-09-13T02:53:56.328 INFO:tasks.workunit.client.0.smithi089.stdout:7/190: chown d3/d19/f36 8 1 2024-09-13T02:53:56.329 INFO:tasks.workunit.client.0.smithi089.stdout:3/134: dwrite d2/f16 [0,4194304] 0 2024-09-13T02:53:56.329 INFO:tasks.workunit.client.0.smithi089.stdout:3/135: chown d2 834426153 1 2024-09-13T02:53:56.330 INFO:tasks.workunit.client.0.smithi089.stdout:6/135: rename db/l13 to db/d10/l32 0 2024-09-13T02:53:56.330 INFO:tasks.workunit.client.0.smithi089.stdout:6/136: write db/d10/f11 [385082,10377] 0 2024-09-13T02:53:56.330 INFO:tasks.workunit.client.0.smithi089.stdout:6/137: dread - db/d10/d27/f2c zero size 2024-09-13T02:53:56.330 INFO:tasks.workunit.client.0.smithi089.stdout:6/138: stat db/d10/f1e 0 2024-09-13T02:53:56.330 INFO:tasks.workunit.client.0.smithi089.stdout:6/139: write db/f26 [290522,53885] 0 2024-09-13T02:53:56.330 INFO:tasks.workunit.client.0.smithi089.stdout:6/140: truncate db/f19 1104509 0 2024-09-13T02:53:56.330 INFO:tasks.workunit.client.0.smithi089.stdout:9/108: mkdir d3/d6/df/d24 0 2024-09-13T02:53:56.331 INFO:tasks.workunit.client.0.smithi089.stdout:8/136: sync 2024-09-13T02:53:56.331 INFO:tasks.workunit.client.0.smithi089.stdout:1/97: rmdir dc 39 2024-09-13T02:53:56.332 INFO:tasks.workunit.client.0.smithi089.stdout:5/133: creat d1/d4/d2b/f2e x:0 0 0 2024-09-13T02:53:56.333 INFO:tasks.workunit.client.0.smithi089.stdout:6/141: write db/f12 [1918729,48288] 0 2024-09-13T02:53:56.334 INFO:tasks.workunit.client.0.smithi089.stdout:2/130: getdents d13/d1d 0 2024-09-13T02:53:56.335 INFO:tasks.workunit.client.0.smithi089.stdout:0/87: mknod d2/d19/c1d 0 2024-09-13T02:53:56.335 INFO:tasks.workunit.client.0.smithi089.stdout:7/191: truncate d3/d44/f43 3835457 0 2024-09-13T02:53:56.338 INFO:tasks.workunit.client.0.smithi089.stdout:9/109: mknod d3/d6/c25 0 2024-09-13T02:53:56.338 INFO:tasks.workunit.client.0.smithi089.stdout:9/110: readlink d3/d15/l20 0 2024-09-13T02:53:56.339 INFO:tasks.workunit.client.0.smithi089.stdout:5/134: dread d1/d7/f27 [0,4194304] 0 2024-09-13T02:53:56.340 INFO:tasks.workunit.client.0.smithi089.stdout:1/98: creat dc/f1a x:0 0 0 2024-09-13T02:53:56.341 INFO:tasks.workunit.client.0.smithi089.stdout:6/142: creat db/d10/d27/d28/d2f/f33 x:0 0 0 2024-09-13T02:53:56.342 INFO:tasks.workunit.client.0.smithi089.stdout:6/143: readlink db/d10/l1c 0 2024-09-13T02:53:56.342 INFO:tasks.workunit.client.0.smithi089.stdout:7/192: mknod d3/d20/c46 0 2024-09-13T02:53:56.344 INFO:tasks.workunit.client.0.smithi089.stdout:9/111: truncate d3/d6/f14 400475 0 2024-09-13T02:53:56.344 INFO:tasks.workunit.client.0.smithi089.stdout:5/135: symlink d1/d4/d1c/l2f 0 2024-09-13T02:53:56.346 INFO:tasks.workunit.client.0.smithi089.stdout:5/136: link d1/fd d1/d7/f30 0 2024-09-13T02:53:56.347 INFO:tasks.workunit.client.0.smithi089.stdout:5/137: mknod d1/d4/d2b/c31 0 2024-09-13T02:53:56.348 INFO:tasks.workunit.client.0.smithi089.stdout:5/138: mknod d1/d7/d2c/c32 0 2024-09-13T02:53:56.353 INFO:tasks.workunit.client.0.smithi089.stdout:8/137: write f5 [242823,105541] 0 2024-09-13T02:53:56.353 INFO:tasks.workunit.client.0.smithi089.stdout:8/138: write f9 [5026472,47195] 0 2024-09-13T02:53:56.353 INFO:tasks.workunit.client.0.smithi089.stdout:8/139: write de/f14 [711251,108133] 0 2024-09-13T02:53:56.355 INFO:tasks.workunit.client.0.smithi089.stdout:8/140: creat de/d16/d1e/d20/f2b x:0 0 0 2024-09-13T02:53:56.368 INFO:tasks.workunit.client.0.smithi089.stdout:6/144: fsync db/d10/f11 0 2024-09-13T02:53:56.370 INFO:tasks.workunit.client.0.smithi089.stdout:6/145: mkdir db/d34 0 2024-09-13T02:53:56.370 INFO:tasks.workunit.client.0.smithi089.stdout:6/146: write f0 [1999315,94516] 0 2024-09-13T02:53:56.372 INFO:tasks.workunit.client.0.smithi089.stdout:3/136: dwrite d2/d8/f13 [0,4194304] 0 2024-09-13T02:53:56.372 INFO:tasks.workunit.client.0.smithi089.stdout:2/131: dwrite d13/d1d/f2c [0,4194304] 0 2024-09-13T02:53:56.373 INFO:tasks.workunit.client.0.smithi089.stdout:3/137: symlink d2/d8/l2a 0 2024-09-13T02:53:56.374 INFO:tasks.workunit.client.0.smithi089.stdout:3/138: dread d2/f19 [0,4194304] 0 2024-09-13T02:53:56.375 INFO:tasks.workunit.client.0.smithi089.stdout:0/88: dwrite d2/f18 [0,4194304] 0 2024-09-13T02:53:56.375 INFO:tasks.workunit.client.0.smithi089.stdout:0/89: readlink d2/d19/d1a/l1b 0 2024-09-13T02:53:56.375 INFO:tasks.workunit.client.0.smithi089.stdout:9/112: dwrite d3/f1f [4194304,4194304] 0 2024-09-13T02:53:56.377 INFO:tasks.workunit.client.0.smithi089.stdout:8/141: dwrite de/f1a [0,4194304] 0 2024-09-13T02:53:56.377 INFO:tasks.workunit.client.0.smithi089.stdout:8/142: truncate de/f12 1404663 0 2024-09-13T02:53:56.377 INFO:tasks.workunit.client.0.smithi089.stdout:0/90: dread d2/f13 [0,4194304] 0 2024-09-13T02:53:56.380 INFO:tasks.workunit.client.0.smithi089.stdout:3/139: rmdir d2 39 2024-09-13T02:53:56.380 INFO:tasks.workunit.client.0.smithi089.stdout:3/140: read d2/d20/f25 [382130,65943] 0 2024-09-13T02:53:56.381 INFO:tasks.workunit.client.0.smithi089.stdout:1/99: getdents dc 0 2024-09-13T02:53:56.388 INFO:tasks.workunit.client.0.smithi089.stdout:5/139: getdents d1/d7 0 2024-09-13T02:53:56.391 INFO:tasks.workunit.client.0.smithi089.stdout:5/140: dread d1/d4/d1c/f1e [0,4194304] 0 2024-09-13T02:53:56.391 INFO:tasks.workunit.client.0.smithi089.stdout:5/141: fdatasync d1/d4/f5 0 2024-09-13T02:53:56.392 INFO:tasks.workunit.client.0.smithi089.stdout:5/142: chown d1/d7/f19 5473289 1 2024-09-13T02:53:56.392 INFO:tasks.workunit.client.0.smithi089.stdout:8/143: symlink de/d16/d1e/d27/l2c 0 2024-09-13T02:53:56.395 INFO:tasks.workunit.client.0.smithi089.stdout:0/91: mkdir d2/d19/d1a/d1e 0 2024-09-13T02:53:56.395 INFO:tasks.workunit.client.0.smithi089.stdout:0/92: rename d2 to d2/d19/d1a/d1e/d1f 22 2024-09-13T02:53:56.396 INFO:tasks.workunit.client.0.smithi089.stdout:6/147: truncate f0 224697 0 2024-09-13T02:53:56.396 INFO:tasks.workunit.client.1.smithi131.stdout:0/465: sync 2024-09-13T02:53:56.396 INFO:tasks.workunit.client.1.smithi131.stdout:0/466: fdatasync d0/d2/d62/f8f 0 2024-09-13T02:53:56.397 INFO:tasks.workunit.client.0.smithi089.stdout:3/141: unlink d2/d20/d23/f29 0 2024-09-13T02:53:56.397 INFO:tasks.workunit.client.1.smithi131.stdout:0/467: creat d0/de/d1f/d22/d31/d39/fad x:0 0 0 2024-09-13T02:53:56.398 INFO:tasks.workunit.client.0.smithi089.stdout:9/113: getdents d3 0 2024-09-13T02:53:56.399 INFO:tasks.workunit.client.1.smithi131.stdout:0/468: dread d0/de/d45/d5a/f7f [0,4194304] 0 2024-09-13T02:53:56.399 INFO:tasks.workunit.client.1.smithi131.stdout:0/469: truncate d0/d2/d41/f50 163610 0 2024-09-13T02:53:56.400 INFO:tasks.workunit.client.1.smithi131.stdout:0/470: write d0/de/d1f/d22/f4e [581783,110899] 0 2024-09-13T02:53:56.400 INFO:tasks.workunit.client.1.smithi131.stdout:0/471: write d0/d2/d41/f4a [1022210,96548] 0 2024-09-13T02:53:56.400 INFO:tasks.workunit.client.0.smithi089.stdout:5/143: mknod d1/c33 0 2024-09-13T02:53:56.402 INFO:tasks.workunit.client.0.smithi089.stdout:1/100: dwrite dc/d12/f15 [0,4194304] 0 2024-09-13T02:53:56.402 INFO:tasks.workunit.client.0.smithi089.stdout:8/144: mknod de/d16/d1e/d20/c2d 0 2024-09-13T02:53:56.404 INFO:tasks.workunit.client.0.smithi089.stdout:2/132: link d13/f1b d13/f2d 0 2024-09-13T02:53:56.406 INFO:tasks.workunit.client.0.smithi089.stdout:0/93: read d2/f18 [489596,127183] 0 2024-09-13T02:53:56.406 INFO:tasks.workunit.client.0.smithi089.stdout:0/94: fsync d2/f4 0 2024-09-13T02:53:56.406 INFO:tasks.workunit.client.0.smithi089.stdout:0/95: creat d2/f20 x:0 0 0 2024-09-13T02:53:56.406 INFO:tasks.workunit.client.0.smithi089.stdout:3/142: dread d2/d8/dc/f1b [0,4194304] 0 2024-09-13T02:53:56.407 INFO:tasks.workunit.client.0.smithi089.stdout:0/96: dread d2/f4 [0,4194304] 0 2024-09-13T02:53:56.408 INFO:tasks.workunit.client.0.smithi089.stdout:9/114: link d3/lb d3/d15/l26 0 2024-09-13T02:53:56.408 INFO:tasks.workunit.client.0.smithi089.stdout:9/115: read d3/d6/df/f12 [53504,26016] 0 2024-09-13T02:53:56.409 INFO:tasks.workunit.client.0.smithi089.stdout:5/144: mknod d1/d4/c34 0 2024-09-13T02:53:56.409 INFO:tasks.workunit.client.0.smithi089.stdout:5/145: read - d1/d4/d2b/f2e zero size 2024-09-13T02:53:56.411 INFO:tasks.workunit.client.0.smithi089.stdout:1/101: truncate dc/f13 1082199 0 2024-09-13T02:53:56.413 INFO:tasks.workunit.client.0.smithi089.stdout:8/145: unlink de/c1d 0 2024-09-13T02:53:56.415 INFO:tasks.workunit.client.0.smithi089.stdout:6/148: rmdir db/d10/d27 39 2024-09-13T02:53:56.415 INFO:tasks.workunit.client.0.smithi089.stdout:6/149: chown db/d10/l1c 479 1 2024-09-13T02:53:56.418 INFO:tasks.workunit.client.0.smithi089.stdout:3/143: mkdir d2/d20/d23/d2b 0 2024-09-13T02:53:56.418 INFO:tasks.workunit.client.0.smithi089.stdout:3/144: chown d2/d20/f25 3970 1 2024-09-13T02:53:56.418 INFO:tasks.workunit.client.1.smithi131.stdout:0/472: dwrite d0/de/d45/d86/f8a [0,4194304] 0 2024-09-13T02:53:56.420 INFO:tasks.workunit.client.0.smithi089.stdout:0/97: unlink d2/cb 0 2024-09-13T02:53:56.422 INFO:tasks.workunit.client.0.smithi089.stdout:0/98: write d2/f3 [146400,83236] 0 2024-09-13T02:53:56.422 INFO:tasks.workunit.client.0.smithi089.stdout:0/99: chown d2/fd 1402980 1 2024-09-13T02:53:56.422 INFO:tasks.workunit.client.0.smithi089.stdout:0/100: creat d2/f21 x:0 0 0 2024-09-13T02:53:56.422 INFO:tasks.workunit.client.0.smithi089.stdout:0/101: truncate f1 1143341 0 2024-09-13T02:53:56.422 INFO:tasks.workunit.client.0.smithi089.stdout:0/102: chown d2/c8 3121 1 2024-09-13T02:53:56.422 INFO:tasks.workunit.client.0.smithi089.stdout:0/103: creat d2/d19/f22 x:0 0 0 2024-09-13T02:53:56.422 INFO:tasks.workunit.client.0.smithi089.stdout:9/116: mknod d3/d6/df/d24/c27 0 2024-09-13T02:53:56.423 INFO:tasks.workunit.client.1.smithi131.stdout:0/473: rename d0/d2/d62/l99 to d0/de/d1f/d22/d31/d39/d67/lae 0 2024-09-13T02:53:56.423 INFO:tasks.workunit.client.1.smithi131.stdout:0/474: symlink d0/de/d1f/d22/d31/d39/d40/laf 0 2024-09-13T02:53:56.423 INFO:tasks.workunit.client.0.smithi089.stdout:5/146: dread d1/f26 [0,4194304] 0 2024-09-13T02:53:56.423 INFO:tasks.workunit.client.0.smithi089.stdout:5/147: readlink d1/d7/l20 0 2024-09-13T02:53:56.424 INFO:tasks.workunit.client.1.smithi131.stdout:0/475: truncate d0/de/d1f/d22/f29 589821 0 2024-09-13T02:53:56.427 INFO:tasks.workunit.client.0.smithi089.stdout:6/150: creat db/d10/d27/d28/d2f/f35 x:0 0 0 2024-09-13T02:53:56.427 INFO:tasks.workunit.client.0.smithi089.stdout:6/151: readlink db/ld 0 2024-09-13T02:53:56.428 INFO:tasks.workunit.client.0.smithi089.stdout:8/146: dwrite f0 [0,4194304] 0 2024-09-13T02:53:56.430 INFO:tasks.workunit.client.0.smithi089.stdout:0/104: symlink d2/d19/d1a/l23 0 2024-09-13T02:53:56.430 INFO:tasks.workunit.client.0.smithi089.stdout:3/145: dread d2/d8/f21 [0,4194304] 0 2024-09-13T02:53:56.430 INFO:tasks.workunit.client.0.smithi089.stdout:3/146: chown d2/d8/c18 1 1 2024-09-13T02:53:56.430 INFO:tasks.workunit.client.0.smithi089.stdout:3/147: fdatasync d2/d8/f21 0 2024-09-13T02:53:56.433 INFO:tasks.workunit.client.0.smithi089.stdout:9/117: symlink d3/l28 0 2024-09-13T02:53:56.433 INFO:tasks.workunit.client.0.smithi089.stdout:9/118: chown d3 690063 1 2024-09-13T02:53:56.433 INFO:tasks.workunit.client.0.smithi089.stdout:8/147: mknod de/d16/d1e/d20/c2e 0 2024-09-13T02:53:56.436 INFO:tasks.workunit.client.0.smithi089.stdout:0/105: rename d2/f11 to d2/d19/f24 0 2024-09-13T02:53:56.439 INFO:tasks.workunit.client.0.smithi089.stdout:8/148: creat de/d16/d1e/f2f x:0 0 0 2024-09-13T02:53:56.439 INFO:tasks.workunit.client.0.smithi089.stdout:8/149: dread - de/d16/d1e/f2a zero size 2024-09-13T02:53:56.440 INFO:tasks.workunit.client.0.smithi089.stdout:8/150: truncate de/d16/f1f 1458765 0 2024-09-13T02:53:56.440 INFO:tasks.workunit.client.0.smithi089.stdout:8/151: chown de/l13 4419 1 2024-09-13T02:53:56.440 INFO:tasks.workunit.client.0.smithi089.stdout:8/152: stat c1 0 2024-09-13T02:53:56.440 INFO:tasks.workunit.client.0.smithi089.stdout:8/153: creat de/d16/d1e/f30 x:0 0 0 2024-09-13T02:53:56.441 INFO:tasks.workunit.client.0.smithi089.stdout:8/154: chown f9 244642448 1 2024-09-13T02:53:56.441 INFO:tasks.workunit.client.0.smithi089.stdout:8/155: creat de/d16/d1e/f31 x:0 0 0 2024-09-13T02:53:56.442 INFO:tasks.workunit.client.0.smithi089.stdout:0/106: dread d2/f18 [0,4194304] 0 2024-09-13T02:53:56.442 INFO:tasks.workunit.client.0.smithi089.stdout:0/107: chown d2/f13 348 1 2024-09-13T02:53:56.442 INFO:tasks.workunit.client.0.smithi089.stdout:0/108: dread - d2/d19/f1c zero size 2024-09-13T02:53:56.442 INFO:tasks.workunit.client.0.smithi089.stdout:0/109: dread d2/f17 [0,4194304] 0 2024-09-13T02:53:56.445 INFO:tasks.workunit.client.0.smithi089.stdout:0/110: dread d2/f18 [0,4194304] 0 2024-09-13T02:53:56.447 INFO:tasks.workunit.client.0.smithi089.stdout:5/148: dwrite d1/f26 [4194304,4194304] 0 2024-09-13T02:53:56.447 INFO:tasks.workunit.client.0.smithi089.stdout:5/149: fsync d1/d4/f5 0 2024-09-13T02:53:56.449 INFO:tasks.workunit.client.0.smithi089.stdout:1/102: write dc/f13 [761128,16519] 0 2024-09-13T02:53:56.449 INFO:tasks.workunit.client.0.smithi089.stdout:1/103: read dc/f13 [650124,26535] 0 2024-09-13T02:53:56.451 INFO:tasks.workunit.client.0.smithi089.stdout:5/150: dread d1/fd [0,4194304] 0 2024-09-13T02:53:56.451 INFO:tasks.workunit.client.0.smithi089.stdout:5/151: chown d1/d7/f19 229808062 1 2024-09-13T02:53:56.454 INFO:tasks.workunit.client.0.smithi089.stdout:5/152: symlink d1/d4/d1c/l35 0 2024-09-13T02:53:56.455 INFO:tasks.workunit.client.0.smithi089.stdout:5/153: dread d1/d7/f19 [0,4194304] 0 2024-09-13T02:53:56.456 INFO:tasks.workunit.client.0.smithi089.stdout:5/154: truncate d1/d7/f15 1308130 0 2024-09-13T02:53:56.456 INFO:tasks.workunit.client.0.smithi089.stdout:5/155: write d1/d4/f25 [2046330,104470] 0 2024-09-13T02:53:56.456 INFO:tasks.workunit.client.0.smithi089.stdout:5/156: read - d1/d7/f21 zero size 2024-09-13T02:53:56.460 INFO:tasks.workunit.client.0.smithi089.stdout:1/104: read dc/fe [1398985,91887] 0 2024-09-13T02:53:56.468 INFO:tasks.workunit.client.0.smithi089.stdout:1/105: dread dc/fe [0,4194304] 0 2024-09-13T02:53:56.468 INFO:tasks.workunit.client.0.smithi089.stdout:1/106: chown f7 1000411 1 2024-09-13T02:53:56.472 INFO:tasks.workunit.client.0.smithi089.stdout:3/148: dwrite d2/d8/dc/ff [0,4194304] 0 2024-09-13T02:53:56.472 INFO:tasks.workunit.client.0.smithi089.stdout:0/111: dwrite d2/f4 [0,4194304] 0 2024-09-13T02:53:56.473 INFO:tasks.workunit.client.1.smithi131.stdout:0/476: dwrite d0/de/d1f/f72 [4194304,4194304] 0 2024-09-13T02:53:56.473 INFO:tasks.workunit.client.0.smithi089.stdout:5/157: dread d1/d4/f17 [0,4194304] 0 2024-09-13T02:53:56.474 INFO:tasks.workunit.client.0.smithi089.stdout:9/119: dwrite d3/d6/df/f12 [0,4194304] 0 2024-09-13T02:53:56.474 INFO:tasks.workunit.client.1.smithi131.stdout:0/477: creat d0/de/da3/fb0 x:0 0 0 2024-09-13T02:53:56.475 INFO:tasks.workunit.client.0.smithi089.stdout:0/112: mknod d2/c25 0 2024-09-13T02:53:56.475 INFO:tasks.workunit.client.0.smithi089.stdout:0/113: chown d2/d19/d1a 37082202 1 2024-09-13T02:53:56.476 INFO:tasks.workunit.client.0.smithi089.stdout:0/114: creat d2/f26 x:0 0 0 2024-09-13T02:53:56.476 INFO:tasks.workunit.client.0.smithi089.stdout:0/115: chown d2/d19/f22 0 1 2024-09-13T02:53:56.478 INFO:tasks.workunit.client.1.smithi131.stdout:0/478: dread d0/de/d1f/d22/d3d/d43/d4b/f51 [0,4194304] 0 2024-09-13T02:53:56.478 INFO:tasks.workunit.client.1.smithi131.stdout:0/479: fsync d0/de/d1f/d22/d31/d39/d67/f5e 0 2024-09-13T02:53:56.479 INFO:tasks.workunit.client.0.smithi089.stdout:5/158: rename d1/d4/d1c/f1e to d1/f36 0 2024-09-13T02:53:56.481 INFO:tasks.workunit.client.1.smithi131.stdout:0/480: write d0/de/d1f/f24 [473582,49362] 0 2024-09-13T02:53:56.481 INFO:tasks.workunit.client.0.smithi089.stdout:9/120: write d3/f1f [6445532,82208] 0 2024-09-13T02:53:56.481 INFO:tasks.workunit.client.0.smithi089.stdout:9/121: stat d3/c1e 0 2024-09-13T02:53:56.482 INFO:tasks.workunit.client.0.smithi089.stdout:3/149: dread d2/d8/f21 [0,4194304] 0 2024-09-13T02:53:56.483 INFO:tasks.workunit.client.1.smithi131.stdout:0/481: unlink d0/f18 0 2024-09-13T02:53:56.483 INFO:tasks.workunit.client.0.smithi089.stdout:0/116: creat d2/d19/d1a/d1e/f27 x:0 0 0 2024-09-13T02:53:56.484 INFO:tasks.workunit.client.1.smithi131.stdout:0/482: mknod d0/de/d1f/d22/d3d/d80/cb1 0 2024-09-13T02:53:56.485 INFO:tasks.workunit.client.1.smithi131.stdout:0/483: creat d0/de/d1f/d22/fb2 x:0 0 0 2024-09-13T02:53:56.485 INFO:tasks.workunit.client.0.smithi089.stdout:9/122: mkdir d3/d6/df/d24/d29 0 2024-09-13T02:53:56.486 INFO:tasks.workunit.client.1.smithi131.stdout:0/484: symlink d0/de/d1f/d22/d31/lb3 0 2024-09-13T02:53:56.486 INFO:tasks.workunit.client.0.smithi089.stdout:5/159: rmdir d1/d4/d2b 39 2024-09-13T02:53:56.486 INFO:tasks.workunit.client.0.smithi089.stdout:5/160: truncate d1/d4/fc 4875508 0 2024-09-13T02:53:56.487 INFO:tasks.workunit.client.1.smithi131.stdout:0/485: mknod d0/de/d45/d86/cb4 0 2024-09-13T02:53:56.488 INFO:tasks.workunit.client.1.smithi131.stdout:0/486: mkdir d0/de/d1f/d22/d31/d39/d67/db5 0 2024-09-13T02:53:56.488 INFO:tasks.workunit.client.1.smithi131.stdout:0/487: rename d0/de/d1f/d22 to d0/de/d1f/d22/d31/d39/d67/db5/db6 22 2024-09-13T02:53:56.489 INFO:tasks.workunit.client.0.smithi089.stdout:9/123: mkdir d3/d6/d2a 0 2024-09-13T02:53:56.489 INFO:tasks.workunit.client.0.smithi089.stdout:9/124: chown d3/d6/f14 533 1 2024-09-13T02:53:56.489 INFO:tasks.workunit.client.0.smithi089.stdout:1/107: dwrite dc/d12/f15 [0,4194304] 0 2024-09-13T02:53:56.490 INFO:tasks.workunit.client.0.smithi089.stdout:9/125: symlink d3/d6/df/d24/l2b 0 2024-09-13T02:53:56.490 INFO:tasks.workunit.client.0.smithi089.stdout:9/126: readlink d3/l11 0 2024-09-13T02:53:56.492 INFO:tasks.workunit.client.0.smithi089.stdout:1/108: creat dc/d12/f1b x:0 0 0 2024-09-13T02:53:56.495 INFO:tasks.workunit.client.0.smithi089.stdout:5/161: rename d1/f36 to d1/d4/d1c/f37 0 2024-09-13T02:53:56.496 INFO:tasks.workunit.client.0.smithi089.stdout:9/127: dread d3/f1f [4194304,4194304] 0 2024-09-13T02:53:56.496 INFO:tasks.workunit.client.0.smithi089.stdout:9/128: chown d3/ca 9105967 1 2024-09-13T02:53:56.496 INFO:tasks.workunit.client.0.smithi089.stdout:9/129: dread - d3/d6/fe zero size 2024-09-13T02:53:56.496 INFO:tasks.workunit.client.0.smithi089.stdout:3/150: truncate d2/d8/dc/ff 1503647 0 2024-09-13T02:53:56.498 INFO:tasks.workunit.client.0.smithi089.stdout:9/130: unlink d3/lc 0 2024-09-13T02:53:56.500 INFO:tasks.workunit.client.0.smithi089.stdout:4/136: sync 2024-09-13T02:53:56.500 INFO:tasks.workunit.client.0.smithi089.stdout:7/193: sync 2024-09-13T02:53:56.500 INFO:tasks.workunit.client.0.smithi089.stdout:7/194: fsync d3/d19/d2d/f1d 0 2024-09-13T02:53:56.500 INFO:tasks.workunit.client.0.smithi089.stdout:4/137: write d2/d3/f25 [623309,5185] 0 2024-09-13T02:53:56.500 INFO:tasks.workunit.client.0.smithi089.stdout:4/138: truncate d2/d3/d5/f28 160374 0 2024-09-13T02:53:56.501 INFO:tasks.workunit.client.1.smithi131.stdout:0/488: write d0/de/d1f/f72 [4606360,13758] 0 2024-09-13T02:53:56.502 INFO:tasks.workunit.client.0.smithi089.stdout:7/195: truncate d3/d19/d2d/f1d 2790267 0 2024-09-13T02:53:56.502 INFO:tasks.workunit.client.0.smithi089.stdout:7/196: chown d3/d19/d2e 0 1 2024-09-13T02:53:56.502 INFO:tasks.workunit.client.1.smithi131.stdout:0/489: truncate d0/de/d1f/d22/d3d/d87/f89 2174034 0 2024-09-13T02:53:56.503 INFO:tasks.workunit.client.0.smithi089.stdout:4/139: unlink d2/da/l24 0 2024-09-13T02:53:56.504 INFO:tasks.workunit.client.1.smithi131.stdout:0/490: truncate d0/de/d45/d5a/f7f 177632 0 2024-09-13T02:53:56.505 INFO:tasks.workunit.client.0.smithi089.stdout:4/140: creat d2/d3/d5/f2e x:0 0 0 2024-09-13T02:53:56.506 INFO:tasks.workunit.client.0.smithi089.stdout:4/141: chown d2/d3/de/f2d 14172304 1 2024-09-13T02:53:56.507 INFO:tasks.workunit.client.1.smithi131.stdout:0/491: mknod d0/de/d1f/cb7 0 2024-09-13T02:53:56.508 INFO:tasks.workunit.client.0.smithi089.stdout:4/142: unlink d2/d3/d5/f28 0 2024-09-13T02:53:56.508 INFO:tasks.workunit.client.1.smithi131.stdout:0/492: creat d0/de/d1f/d22/d3d/d87/fb8 x:0 0 0 2024-09-13T02:53:56.509 INFO:tasks.workunit.client.1.smithi131.stdout:0/493: creat d0/de/d1f/d22/fb9 x:0 0 0 2024-09-13T02:53:56.510 INFO:tasks.workunit.client.0.smithi089.stdout:9/131: read d3/d15/f17 [54961,105283] 0 2024-09-13T02:53:56.512 INFO:tasks.workunit.client.1.smithi131.stdout:0/494: unlink d0/de/d1f/c2a 0 2024-09-13T02:53:56.512 INFO:tasks.workunit.client.0.smithi089.stdout:9/132: symlink d3/d6/df/d24/l2c 0 2024-09-13T02:53:56.513 INFO:tasks.workunit.client.0.smithi089.stdout:9/133: write d3/f1f [5763029,87823] 0 2024-09-13T02:53:56.523 INFO:tasks.workunit.client.0.smithi089.stdout:3/151: dwrite d2/d8/dc/f1e [0,4194304] 0 2024-09-13T02:53:56.525 INFO:tasks.workunit.client.0.smithi089.stdout:9/134: write d3/d15/f1b [73860,79320] 0 2024-09-13T02:53:56.525 INFO:tasks.workunit.client.0.smithi089.stdout:4/143: write d2/f4 [5100433,102674] 0 2024-09-13T02:53:56.526 INFO:tasks.workunit.client.1.smithi131.stdout:0/495: dread d0/de/d45/d5a/f5b [0,4194304] 0 2024-09-13T02:53:56.527 INFO:tasks.workunit.client.1.smithi131.stdout:0/496: truncate d0/de/d1f/d22/d3d/d43/f5f 2410617 0 2024-09-13T02:53:56.528 INFO:tasks.workunit.client.0.smithi089.stdout:3/152: unlink d2/d20/f26 0 2024-09-13T02:53:56.528 INFO:tasks.workunit.client.0.smithi089.stdout:3/153: truncate d2/d20/f25 1489134 0 2024-09-13T02:53:56.528 INFO:tasks.workunit.client.0.smithi089.stdout:3/154: readlink d2/l1c 0 2024-09-13T02:53:56.528 INFO:tasks.workunit.client.0.smithi089.stdout:5/162: dwrite d1/f26 [0,4194304] 0 2024-09-13T02:53:56.529 INFO:tasks.workunit.client.1.smithi131.stdout:0/497: creat d0/de/d1f/d22/d31/fba x:0 0 0 2024-09-13T02:53:56.529 INFO:tasks.workunit.client.0.smithi089.stdout:9/135: rmdir d3/d6/df 39 2024-09-13T02:53:56.529 INFO:tasks.workunit.client.0.smithi089.stdout:7/197: dwrite d3/f1b [0,4194304] 0 2024-09-13T02:53:56.530 INFO:tasks.workunit.client.1.smithi131.stdout:0/498: creat d0/de/d1f/d22/d31/d39/da8/fbb x:0 0 0 2024-09-13T02:53:56.532 INFO:tasks.workunit.client.0.smithi089.stdout:3/155: rename d2/d8/dc/ff to d2/d8/dc/f2c 0 2024-09-13T02:53:56.535 INFO:tasks.workunit.client.0.smithi089.stdout:5/163: unlink d1/d4/d1c/f37 0 2024-09-13T02:53:56.535 INFO:tasks.workunit.client.0.smithi089.stdout:5/164: read - d1/d4/d2b/f2e zero size 2024-09-13T02:53:56.535 INFO:tasks.workunit.client.0.smithi089.stdout:5/165: chown d1/d7/l20 56 1 2024-09-13T02:53:56.536 INFO:tasks.workunit.client.0.smithi089.stdout:9/136: mknod d3/d6/d2a/c2d 0 2024-09-13T02:53:56.540 INFO:tasks.workunit.client.0.smithi089.stdout:3/156: unlink d2/f19 0 2024-09-13T02:53:56.540 INFO:tasks.workunit.client.0.smithi089.stdout:3/157: truncate d2/d20/f28 241725 0 2024-09-13T02:53:56.540 INFO:tasks.workunit.client.0.smithi089.stdout:3/158: write d2/d8/dc/f2c [2068264,51488] 0 2024-09-13T02:53:56.540 INFO:tasks.workunit.client.0.smithi089.stdout:3/159: write d2/d8/dc/f1b [1366040,18057] 0 2024-09-13T02:53:56.541 INFO:tasks.workunit.client.0.smithi089.stdout:5/166: creat d1/d7/d2c/f38 x:0 0 0 2024-09-13T02:53:56.541 INFO:tasks.workunit.client.0.smithi089.stdout:5/167: fdatasync d1/d4/f14 0 2024-09-13T02:53:56.541 INFO:tasks.workunit.client.0.smithi089.stdout:3/160: write d2/d8/dc/f1b [808386,103471] 0 2024-09-13T02:53:56.542 INFO:tasks.workunit.client.0.smithi089.stdout:9/137: mkdir d3/d6/df/d24/d2e 0 2024-09-13T02:53:56.544 INFO:tasks.workunit.client.0.smithi089.stdout:7/198: mkdir d3/d47 0 2024-09-13T02:53:56.550 INFO:tasks.workunit.client.0.smithi089.stdout:3/161: stat d2/d8/c15 0 2024-09-13T02:53:56.552 INFO:tasks.workunit.client.1.smithi131.stdout:0/499: dread d0/de/d1f/d22/d31/d39/d40/f7c [0,4194304] 0 2024-09-13T02:53:56.552 INFO:tasks.workunit.client.0.smithi089.stdout:9/138: symlink d3/d6/df/l2f 0 2024-09-13T02:53:56.553 INFO:tasks.workunit.client.1.smithi131.stdout:0/500: unlink d0/de/da3/fb0 0 2024-09-13T02:53:56.554 INFO:tasks.workunit.client.1.smithi131.stdout:0/501: truncate d0/de/d1f/d22/d3d/d87/f89 2101491 0 2024-09-13T02:53:56.554 INFO:tasks.workunit.client.1.smithi131.stdout:0/502: write d0/de/d1f/d22/d3d/d43/f9d [609567,90811] 0 2024-09-13T02:53:56.555 INFO:tasks.workunit.client.1.smithi131.stdout:0/503: getdents d0/de/d1f/d22/d31/d39/d40/d68 0 2024-09-13T02:53:56.556 INFO:tasks.workunit.client.0.smithi089.stdout:4/144: truncate d2/d3/f25 423170 0 2024-09-13T02:53:56.558 INFO:tasks.workunit.client.0.smithi089.stdout:5/168: dwrite d1/fd [0,4194304] 0 2024-09-13T02:53:56.558 INFO:tasks.workunit.client.0.smithi089.stdout:3/162: creat d2/f2d x:0 0 0 2024-09-13T02:53:56.559 INFO:tasks.workunit.client.0.smithi089.stdout:3/163: chown d2/d8/f21 28372 1 2024-09-13T02:53:56.559 INFO:tasks.workunit.client.0.smithi089.stdout:3/164: stat d2/d20/f25 0 2024-09-13T02:53:56.559 INFO:tasks.workunit.client.0.smithi089.stdout:3/165: dread d2/d20/f28 [0,4194304] 0 2024-09-13T02:53:56.561 INFO:tasks.workunit.client.0.smithi089.stdout:9/139: symlink d3/d6/df/l30 0 2024-09-13T02:53:56.562 INFO:tasks.workunit.client.0.smithi089.stdout:4/145: mkdir d2/d2f 0 2024-09-13T02:53:56.562 INFO:tasks.workunit.client.0.smithi089.stdout:4/146: write d2/d3/de/f16 [574755,35142] 0 2024-09-13T02:53:56.562 INFO:tasks.workunit.client.0.smithi089.stdout:4/147: fdatasync d2/d3/d5/f2e 0 2024-09-13T02:53:56.562 INFO:tasks.workunit.client.0.smithi089.stdout:4/148: readlink d2/d3/de/l20 0 2024-09-13T02:53:56.563 INFO:tasks.workunit.client.0.smithi089.stdout:5/169: creat d1/d7/d1f/f39 x:0 0 0 2024-09-13T02:53:56.564 INFO:tasks.workunit.client.0.smithi089.stdout:3/166: link d2/c1d d2/d20/d23/d27/c2e 0 2024-09-13T02:53:56.566 INFO:tasks.workunit.client.0.smithi089.stdout:5/170: creat d1/d4/f3a x:0 0 0 2024-09-13T02:53:56.566 INFO:tasks.workunit.client.0.smithi089.stdout:5/171: creat d1/d7/d1f/f3b x:0 0 0 2024-09-13T02:53:56.568 INFO:tasks.workunit.client.0.smithi089.stdout:2/133: sync 2024-09-13T02:53:56.568 INFO:tasks.workunit.client.0.smithi089.stdout:2/134: fdatasync d13/d1d/f23 0 2024-09-13T02:53:56.572 INFO:tasks.workunit.client.0.smithi089.stdout:2/135: rename d13/c26 to d13/c2e 0 2024-09-13T02:53:56.573 INFO:tasks.workunit.client.0.smithi089.stdout:4/149: write d2/d3/f25 [44527,51243] 0 2024-09-13T02:53:56.575 INFO:tasks.workunit.client.0.smithi089.stdout:4/150: creat d2/da/f30 x:0 0 0 2024-09-13T02:53:56.575 INFO:tasks.workunit.client.0.smithi089.stdout:4/151: chown d2/d3 97 1 2024-09-13T02:53:56.577 INFO:tasks.workunit.client.0.smithi089.stdout:2/136: link d13/c2a d13/c2f 0 2024-09-13T02:53:56.577 INFO:tasks.workunit.client.0.smithi089.stdout:2/137: write f5 [5011939,13142] 0 2024-09-13T02:53:56.580 INFO:tasks.workunit.client.0.smithi089.stdout:2/138: rename d13/d1d to d13/d30 0 2024-09-13T02:53:56.580 INFO:tasks.workunit.client.0.smithi089.stdout:2/139: fdatasync d13/d30/f2c 0 2024-09-13T02:53:56.583 INFO:tasks.workunit.client.0.smithi089.stdout:4/152: dread d2/da/f10 [0,4194304] 0 2024-09-13T02:53:56.588 INFO:tasks.workunit.client.1.smithi131.stdout:0/504: dwrite d0/de/d1f/d22/d3d/d55/f6b [0,4194304] 0 2024-09-13T02:53:56.592 INFO:tasks.workunit.client.0.smithi089.stdout:9/140: dwrite d3/d15/f17 [0,4194304] 0 2024-09-13T02:53:56.596 INFO:tasks.workunit.client.0.smithi089.stdout:9/141: dread d3/d15/f1b [0,4194304] 0 2024-09-13T02:53:56.597 INFO:tasks.workunit.client.0.smithi089.stdout:3/167: dwrite d2/d20/f28 [0,4194304] 0 2024-09-13T02:53:56.600 INFO:tasks.workunit.client.1.smithi131.stdout:0/505: dread d0/de/d45/d86/f8a [0,4194304] 0 2024-09-13T02:53:56.601 INFO:tasks.workunit.client.1.smithi131.stdout:0/506: write d0/de/d1f/f24 [1176998,69715] 0 2024-09-13T02:53:56.602 INFO:tasks.workunit.client.0.smithi089.stdout:3/168: creat d2/d20/d23/d2b/f2f x:0 0 0 2024-09-13T02:53:56.602 INFO:tasks.workunit.client.0.smithi089.stdout:3/169: creat d2/d8/dc/f30 x:0 0 0 2024-09-13T02:53:56.602 INFO:tasks.workunit.client.0.smithi089.stdout:3/170: chown d2/d20/d23/d27/c2e 891 1 2024-09-13T02:53:56.603 INFO:tasks.workunit.client.1.smithi131.stdout:0/507: symlink d0/de/da3/lbc 0 2024-09-13T02:53:56.604 INFO:tasks.workunit.client.0.smithi089.stdout:4/153: dwrite d2/d3/de/f2d [0,4194304] 0 2024-09-13T02:53:56.608 INFO:tasks.workunit.client.0.smithi089.stdout:3/171: symlink d2/d8/dc/l31 0 2024-09-13T02:53:56.611 INFO:tasks.workunit.client.0.smithi089.stdout:3/172: mkdir d2/d20/d23/d32 0 2024-09-13T02:53:56.612 INFO:tasks.workunit.client.0.smithi089.stdout:3/173: write d2/d8/dc/f30 [965927,98172] 0 2024-09-13T02:53:56.612 INFO:tasks.workunit.client.0.smithi089.stdout:3/174: fdatasync d2/f16 0 2024-09-13T02:53:56.614 INFO:tasks.workunit.client.0.smithi089.stdout:2/140: getdents d13 0 2024-09-13T02:53:56.616 INFO:tasks.workunit.client.0.smithi089.stdout:3/175: mknod d2/d20/d23/d32/c33 0 2024-09-13T02:53:56.617 INFO:tasks.workunit.client.0.smithi089.stdout:2/141: creat d13/d30/f31 x:0 0 0 2024-09-13T02:53:56.619 INFO:tasks.workunit.client.0.smithi089.stdout:2/142: creat d13/f32 x:0 0 0 2024-09-13T02:53:56.631 INFO:tasks.workunit.client.0.smithi089.stdout:2/143: dread f3 [0,4194304] 0 2024-09-13T02:53:56.632 INFO:tasks.workunit.client.0.smithi089.stdout:9/142: dwrite d3/f5 [0,4194304] 0 2024-09-13T02:53:56.632 INFO:tasks.workunit.client.0.smithi089.stdout:2/144: read d13/d30/f2b [283512,66917] 0 2024-09-13T02:53:56.634 INFO:tasks.workunit.client.0.smithi089.stdout:9/143: symlink d3/d6/df/d24/d29/l31 0 2024-09-13T02:53:56.634 INFO:tasks.workunit.client.1.smithi131.stdout:0/508: dwrite d0/de/d1f/d22/d31/d39/d67/f5e [0,4194304] 0 2024-09-13T02:53:56.635 INFO:tasks.workunit.client.0.smithi089.stdout:2/145: mknod d13/d30/c33 0 2024-09-13T02:53:56.635 INFO:tasks.workunit.client.0.smithi089.stdout:4/154: dwrite d2/d3/de/f2b [0,4194304] 0 2024-09-13T02:53:56.635 INFO:tasks.workunit.client.0.smithi089.stdout:3/176: dwrite d2/d8/f13 [4194304,4194304] 0 2024-09-13T02:53:56.635 INFO:tasks.workunit.client.0.smithi089.stdout:9/144: mkdir d3/d6/df/d24/d32 0 2024-09-13T02:53:56.636 INFO:tasks.workunit.client.1.smithi131.stdout:0/509: creat d0/de/d1f/fbd x:0 0 0 2024-09-13T02:53:56.637 INFO:tasks.workunit.client.1.smithi131.stdout:0/510: creat d0/de/d45/d78/fbe x:0 0 0 2024-09-13T02:53:56.637 INFO:tasks.workunit.client.1.smithi131.stdout:0/511: symlink d0/de/d1f/d22/d31/d39/d40/lbf 0 2024-09-13T02:53:56.638 INFO:tasks.workunit.client.1.smithi131.stdout:0/512: creat d0/de/d1f/d22/d3d/d55/fc0 x:0 0 0 2024-09-13T02:53:56.639 INFO:tasks.workunit.client.1.smithi131.stdout:0/513: write d0/d2/d62/f8e [18144,108289] 0 2024-09-13T02:53:56.640 INFO:tasks.workunit.client.1.smithi131.stdout:0/514: dread d0/d2/d62/f8f [0,4194304] 0 2024-09-13T02:53:56.641 INFO:tasks.workunit.client.0.smithi089.stdout:4/155: link d2/l19 d2/d2f/l31 0 2024-09-13T02:53:56.642 INFO:tasks.workunit.client.0.smithi089.stdout:9/145: dread f2 [4194304,4194304] 0 2024-09-13T02:53:56.643 INFO:tasks.workunit.client.0.smithi089.stdout:9/146: dread - d3/d6/fe zero size 2024-09-13T02:53:56.644 INFO:tasks.workunit.client.0.smithi089.stdout:3/177: chown d2/l9 0 1 2024-09-13T02:53:56.645 INFO:tasks.workunit.client.0.smithi089.stdout:3/178: write d2/d20/f25 [957196,127839] 0 2024-09-13T02:53:56.646 INFO:tasks.workunit.client.0.smithi089.stdout:2/146: rmdir d13 39 2024-09-13T02:53:56.650 INFO:tasks.workunit.client.0.smithi089.stdout:2/147: rename d13/l15 to d13/l34 0 2024-09-13T02:53:56.651 INFO:tasks.workunit.client.0.smithi089.stdout:3/179: symlink d2/d20/l34 0 2024-09-13T02:53:56.652 INFO:tasks.workunit.client.0.smithi089.stdout:2/148: mknod d13/d30/c35 0 2024-09-13T02:53:56.661 INFO:tasks.workunit.client.0.smithi089.stdout:3/180: dread d2/d20/f28 [0,4194304] 0 2024-09-13T02:53:56.667 INFO:tasks.workunit.client.0.smithi089.stdout:9/147: dwrite d3/d6/f14 [0,4194304] 0 2024-09-13T02:53:56.668 INFO:tasks.workunit.client.1.smithi131.stdout:0/515: dwrite d0/de/d1f/fbd [0,4194304] 0 2024-09-13T02:53:56.668 INFO:tasks.workunit.client.0.smithi089.stdout:9/148: mknod d3/d6/df/d24/d32/c33 0 2024-09-13T02:53:56.669 INFO:tasks.workunit.client.0.smithi089.stdout:9/149: creat d3/f34 x:0 0 0 2024-09-13T02:53:56.670 INFO:tasks.workunit.client.1.smithi131.stdout:0/516: rename d0/de/d1f/d22/d3d/d80/la9 to d0/de/d1f/d22/d3d/d87/lc1 0 2024-09-13T02:53:56.671 INFO:tasks.workunit.client.0.smithi089.stdout:9/150: mkdir d3/d6/df/d24/d35 0 2024-09-13T02:53:56.671 INFO:tasks.workunit.client.1.smithi131.stdout:0/517: mkdir d0/de/d1f/d22/d3d/d43/dc2 0 2024-09-13T02:53:56.673 INFO:tasks.workunit.client.0.smithi089.stdout:2/149: getdents d13/d30 0 2024-09-13T02:53:56.673 INFO:tasks.workunit.client.0.smithi089.stdout:1/109: sync 2024-09-13T02:53:56.673 INFO:tasks.workunit.client.0.smithi089.stdout:7/199: sync 2024-09-13T02:53:56.673 INFO:tasks.workunit.client.0.smithi089.stdout:8/156: sync 2024-09-13T02:53:56.673 INFO:tasks.workunit.client.0.smithi089.stdout:6/152: sync 2024-09-13T02:53:56.673 INFO:tasks.workunit.client.0.smithi089.stdout:1/110: stat dc/f1a 0 2024-09-13T02:53:56.674 INFO:tasks.workunit.client.0.smithi089.stdout:3/181: write d2/d8/dc/f1e [490852,58366] 0 2024-09-13T02:53:56.674 INFO:tasks.workunit.client.0.smithi089.stdout:8/157: creat de/d16/d1e/f32 x:0 0 0 2024-09-13T02:53:56.674 INFO:tasks.workunit.client.0.smithi089.stdout:8/158: readlink de/l26 0 2024-09-13T02:53:56.674 INFO:tasks.workunit.client.0.smithi089.stdout:5/172: sync 2024-09-13T02:53:56.674 INFO:tasks.workunit.client.0.smithi089.stdout:0/117: sync 2024-09-13T02:53:56.674 INFO:tasks.workunit.client.0.smithi089.stdout:0/118: creat d2/f28 x:0 0 0 2024-09-13T02:53:56.674 INFO:tasks.workunit.client.0.smithi089.stdout:0/119: read - d2/f16 zero size 2024-09-13T02:53:56.674 INFO:tasks.workunit.client.0.smithi089.stdout:0/120: creat d2/f29 x:0 0 0 2024-09-13T02:53:56.675 INFO:tasks.workunit.client.0.smithi089.stdout:9/151: mkdir d3/d6/d36 0 2024-09-13T02:53:56.675 INFO:tasks.workunit.client.0.smithi089.stdout:2/150: rename c7 to d13/c36 0 2024-09-13T02:53:56.676 INFO:tasks.workunit.client.1.smithi131.stdout:0/518: mknod d0/de/cc3 0 2024-09-13T02:53:56.676 INFO:tasks.workunit.client.1.smithi131.stdout:0/519: creat d0/d2/d41/fc4 x:0 0 0 2024-09-13T02:53:56.676 INFO:tasks.workunit.client.1.smithi131.stdout:0/520: write d0/de/d1f/d22/d3d/d87/fb8 [338834,73055] 0 2024-09-13T02:53:56.676 INFO:tasks.workunit.client.1.smithi131.stdout:0/521: getdents d0/de/d1f/d22/d3d/d55/d63/d95 0 2024-09-13T02:53:56.677 INFO:tasks.workunit.client.0.smithi089.stdout:8/159: creat de/d16/f33 x:0 0 0 2024-09-13T02:53:56.677 INFO:tasks.workunit.client.0.smithi089.stdout:8/160: stat de/d16/f33 0 2024-09-13T02:53:56.680 INFO:tasks.workunit.client.0.smithi089.stdout:2/151: write d13/f1c [2379071,118053] 0 2024-09-13T02:53:56.681 INFO:tasks.workunit.client.0.smithi089.stdout:3/182: read d2/d20/f28 [381320,6768] 0 2024-09-13T02:53:56.681 INFO:tasks.workunit.client.0.smithi089.stdout:3/183: chown d2/d20 40563849 1 2024-09-13T02:53:56.682 INFO:tasks.workunit.client.0.smithi089.stdout:0/121: mkdir d2/d19/d1a/d2a 0 2024-09-13T02:53:56.682 INFO:tasks.workunit.client.0.smithi089.stdout:9/152: symlink d3/d6/d2a/l37 0 2024-09-13T02:53:56.682 INFO:tasks.workunit.client.0.smithi089.stdout:0/122: write d2/fc [98458,109834] 0 2024-09-13T02:53:56.682 INFO:tasks.workunit.client.0.smithi089.stdout:0/123: write d2/f6 [1206702,123487] 0 2024-09-13T02:53:56.684 INFO:tasks.workunit.client.0.smithi089.stdout:5/173: read d1/fd [2731055,119168] 0 2024-09-13T02:53:56.685 INFO:tasks.workunit.client.0.smithi089.stdout:2/152: creat d13/d30/f37 x:0 0 0 2024-09-13T02:53:56.686 INFO:tasks.workunit.client.0.smithi089.stdout:3/184: symlink d2/d20/d23/d32/l35 0 2024-09-13T02:53:56.688 INFO:tasks.workunit.client.0.smithi089.stdout:9/153: link d3/d6/df/f12 d3/d6/df/f38 0 2024-09-13T02:53:56.691 INFO:tasks.workunit.client.0.smithi089.stdout:0/124: unlink d2/f4 0 2024-09-13T02:53:56.702 INFO:tasks.workunit.client.0.smithi089.stdout:5/174: dread d1/d7/f27 [0,4194304] 0 2024-09-13T02:53:56.706 INFO:tasks.workunit.client.0.smithi089.stdout:9/154: write d3/d15/f17 [1322085,96690] 0 2024-09-13T02:53:56.712 INFO:tasks.workunit.client.0.smithi089.stdout:5/175: dread d1/d7/f9 [0,4194304] 0 2024-09-13T02:53:56.713 INFO:tasks.workunit.client.0.smithi089.stdout:5/176: rename d1/d7/d2c/c32 to d1/d4/d1c/c3c 0 2024-09-13T02:53:56.713 INFO:tasks.workunit.client.0.smithi089.stdout:5/177: chown d1/d7/f15 9176 1 2024-09-13T02:53:56.713 INFO:tasks.workunit.client.0.smithi089.stdout:5/178: chown d1/d4/f14 0 1 2024-09-13T02:53:56.717 INFO:tasks.workunit.client.0.smithi089.stdout:5/179: write d1/d4/f14 [1364368,11440] 0 2024-09-13T02:53:56.717 INFO:tasks.workunit.client.0.smithi089.stdout:5/180: write d1/d4/f11 [11106,103713] 0 2024-09-13T02:53:56.718 INFO:tasks.workunit.client.0.smithi089.stdout:9/155: read d3/d6/f14 [3056672,53616] 0 2024-09-13T02:53:56.718 INFO:tasks.workunit.client.0.smithi089.stdout:9/156: chown d3/d6/df/d24/d32/c33 2166 1 2024-09-13T02:53:56.720 INFO:tasks.workunit.client.0.smithi089.stdout:3/185: dwrite d2/d8/dc/f1e [0,4194304] 0 2024-09-13T02:53:56.723 INFO:tasks.workunit.client.0.smithi089.stdout:7/200: dwrite d3/d19/f3f [0,4194304] 0 2024-09-13T02:53:56.723 INFO:tasks.workunit.client.0.smithi089.stdout:7/201: dread - d3/d19/f36 zero size 2024-09-13T02:53:56.723 INFO:tasks.workunit.client.0.smithi089.stdout:7/202: write d3/d19/f38 [415098,12835] 0 2024-09-13T02:53:56.734 INFO:tasks.workunit.client.0.smithi089.stdout:7/203: read d3/d19/f3f [1176911,122721] 0 2024-09-13T02:53:56.734 INFO:tasks.workunit.client.0.smithi089.stdout:7/204: write d3/d19/d2d/f1d [3051218,64759] 0 2024-09-13T02:53:56.734 INFO:tasks.workunit.client.0.smithi089.stdout:7/205: truncate d3/f1b 4559660 0 2024-09-13T02:53:56.736 INFO:tasks.workunit.client.0.smithi089.stdout:7/206: getdents d3/d19/d2e 0 2024-09-13T02:53:56.737 INFO:tasks.workunit.client.0.smithi089.stdout:5/181: dwrite d1/d7/f19 [0,4194304] 0 2024-09-13T02:53:56.738 INFO:tasks.workunit.client.0.smithi089.stdout:7/207: rename d3/d19/d2d/d14/l30 to d3/d19/d2d/l48 0 2024-09-13T02:53:56.741 INFO:tasks.workunit.client.0.smithi089.stdout:7/208: write d3/d19/d2d/f29 [523684,71557] 0 2024-09-13T02:53:56.741 INFO:tasks.workunit.client.0.smithi089.stdout:5/182: link d1/d4/lf d1/d4/l3d 0 2024-09-13T02:53:56.741 INFO:tasks.workunit.client.0.smithi089.stdout:5/183: chown d1/d7/d1f/c24 1409985 1 2024-09-13T02:53:56.741 INFO:tasks.workunit.client.0.smithi089.stdout:5/184: readlink d1/d4/l23 0 2024-09-13T02:53:56.742 INFO:tasks.workunit.client.0.smithi089.stdout:7/209: mknod d3/d19/d2d/c49 0 2024-09-13T02:53:56.743 INFO:tasks.workunit.client.0.smithi089.stdout:7/210: write d3/d19/d2d/f12 [324465,64018] 0 2024-09-13T02:53:56.743 INFO:tasks.workunit.client.0.smithi089.stdout:5/185: symlink d1/d7/d1f/l3e 0 2024-09-13T02:53:56.743 INFO:tasks.workunit.client.0.smithi089.stdout:7/211: creat d3/d19/d2d/f4a x:0 0 0 2024-09-13T02:53:56.743 INFO:tasks.workunit.client.0.smithi089.stdout:5/186: mknod d1/d7/d2c/c3f 0 2024-09-13T02:53:56.758 INFO:tasks.workunit.client.0.smithi089.stdout:3/186: dwrite d2/f14 [0,4194304] 0 2024-09-13T02:53:56.758 INFO:tasks.workunit.client.0.smithi089.stdout:3/187: fsync d2/f2d 0 2024-09-13T02:53:56.758 INFO:tasks.workunit.client.0.smithi089.stdout:3/188: write d2/d8/dc/f30 [1392421,100461] 0 2024-09-13T02:53:56.769 INFO:tasks.workunit.client.0.smithi089.stdout:5/187: dwrite d1/d7/d2c/f38 [0,4194304] 0 2024-09-13T02:53:56.772 INFO:tasks.workunit.client.0.smithi089.stdout:5/188: rename d1/d7/lb to d1/d7/l40 0 2024-09-13T02:53:56.772 INFO:tasks.workunit.client.0.smithi089.stdout:5/189: chown d1/d4/d1c/c3c 719 1 2024-09-13T02:53:56.772 INFO:tasks.workunit.client.0.smithi089.stdout:5/190: chown d1/d7/d1f/f3b 3133907 1 2024-09-13T02:53:56.786 INFO:tasks.workunit.client.0.smithi089.stdout:0/125: dread f1 [0,4194304] 0 2024-09-13T02:53:56.788 INFO:tasks.workunit.client.0.smithi089.stdout:0/126: mkdir d2/d2b 0 2024-09-13T02:53:56.792 INFO:tasks.workunit.client.0.smithi089.stdout:0/127: unlink d2/fd 0 2024-09-13T02:53:56.793 INFO:tasks.workunit.client.1.smithi131.stdout:0/522: dwrite d0/de/d1f/d22/d31/d39/d67/f5e [0,4194304] 0 2024-09-13T02:53:56.794 INFO:tasks.workunit.client.0.smithi089.stdout:0/128: symlink d2/l2c 0 2024-09-13T02:53:56.796 INFO:tasks.workunit.client.1.smithi131.stdout:0/523: rename d0/de/d1f/l4d to d0/de/d1f/d22/d31/d39/lc5 0 2024-09-13T02:53:56.796 INFO:tasks.workunit.client.1.smithi131.stdout:0/524: write d0/de/d1f/d22/d31/fba [678926,84665] 0 2024-09-13T02:53:56.797 INFO:tasks.workunit.client.0.smithi089.stdout:6/153: dwrite db/d10/f14 [0,4194304] 0 2024-09-13T02:53:56.799 INFO:tasks.workunit.client.0.smithi089.stdout:6/154: creat db/d10/d27/d2e/f36 x:0 0 0 2024-09-13T02:53:56.802 INFO:tasks.workunit.client.0.smithi089.stdout:6/155: unlink db/d10/d27/d28/c2d 0 2024-09-13T02:53:56.802 INFO:tasks.workunit.client.0.smithi089.stdout:6/156: fsync db/d10/d27/d28/d2f/f33 0 2024-09-13T02:53:56.803 INFO:tasks.workunit.client.0.smithi089.stdout:6/157: mkdir db/d10/d27/d28/d37 0 2024-09-13T02:53:56.806 INFO:tasks.workunit.client.0.smithi089.stdout:7/212: write d3/f1b [4061777,127178] 0 2024-09-13T02:53:56.808 INFO:tasks.workunit.client.0.smithi089.stdout:7/213: symlink d3/d44/l4b 0 2024-09-13T02:53:56.809 INFO:tasks.workunit.client.0.smithi089.stdout:7/214: mknod d3/d44/c4c 0 2024-09-13T02:53:56.814 INFO:tasks.workunit.client.0.smithi089.stdout:5/191: dwrite d1/d7/f21 [0,4194304] 0 2024-09-13T02:53:56.817 INFO:tasks.workunit.client.0.smithi089.stdout:5/192: rmdir d1/d4/d2b 39 2024-09-13T02:53:56.817 INFO:tasks.workunit.client.0.smithi089.stdout:1/111: dwrite f3 [0,4194304] 0 2024-09-13T02:53:56.818 INFO:tasks.workunit.client.0.smithi089.stdout:6/158: read db/d10/f14 [1527390,64448] 0 2024-09-13T02:53:56.819 INFO:tasks.workunit.client.0.smithi089.stdout:5/193: rename d1/d4/lf to d1/d7/d2c/l41 0 2024-09-13T02:53:56.819 INFO:tasks.workunit.client.0.smithi089.stdout:5/194: creat d1/d7/d1f/f42 x:0 0 0 2024-09-13T02:53:56.820 INFO:tasks.workunit.client.0.smithi089.stdout:1/112: creat dc/f1c x:0 0 0 2024-09-13T02:53:56.822 INFO:tasks.workunit.client.0.smithi089.stdout:6/159: link l2 db/d10/d27/l38 0 2024-09-13T02:53:56.824 INFO:tasks.workunit.client.0.smithi089.stdout:6/160: link c7 db/d10/c39 0 2024-09-13T02:53:56.825 INFO:tasks.workunit.client.0.smithi089.stdout:8/161: dwrite f5 [0,4194304] 0 2024-09-13T02:53:56.825 INFO:tasks.workunit.client.0.smithi089.stdout:6/161: chown db/d10/d27/d28/d2f 420 1 2024-09-13T02:53:56.828 INFO:tasks.workunit.client.0.smithi089.stdout:2/153: dwrite d13/f17 [0,4194304] 0 2024-09-13T02:53:56.829 INFO:tasks.workunit.client.0.smithi089.stdout:2/154: write f3 [2376122,15254] 0 2024-09-13T02:53:56.829 INFO:tasks.workunit.client.0.smithi089.stdout:2/155: readlink l6 0 2024-09-13T02:53:56.833 INFO:tasks.workunit.client.1.smithi131.stdout:0/525: dwrite d0/de/d1f/d22/d3d/d43/f9d [0,4194304] 0 2024-09-13T02:53:56.833 INFO:tasks.workunit.client.0.smithi089.stdout:9/157: dwrite d3/d6/df/f38 [0,4194304] 0 2024-09-13T02:53:56.834 INFO:tasks.workunit.client.0.smithi089.stdout:8/162: rmdir de 39 2024-09-13T02:53:56.839 INFO:tasks.workunit.client.0.smithi089.stdout:7/215: dwrite d3/d19/d2d/d14/f1c [0,4194304] 0 2024-09-13T02:53:56.840 INFO:tasks.workunit.client.0.smithi089.stdout:7/216: creat d3/d19/f4d x:0 0 0 2024-09-13T02:53:56.841 INFO:tasks.workunit.client.0.smithi089.stdout:7/217: dread d3/d19/d2d/f12 [0,4194304] 0 2024-09-13T02:53:56.841 INFO:tasks.workunit.client.0.smithi089.stdout:7/218: dread - d3/d19/f36 zero size 2024-09-13T02:53:56.841 INFO:tasks.workunit.client.0.smithi089.stdout:7/219: truncate d3/d19/d2d/f4a 265684 0 2024-09-13T02:53:56.841 INFO:tasks.workunit.client.0.smithi089.stdout:7/220: dread - d3/d20/f32 zero size 2024-09-13T02:53:56.842 INFO:tasks.workunit.client.0.smithi089.stdout:7/221: creat d3/d19/d2d/f4e x:0 0 0 2024-09-13T02:53:56.896 INFO:tasks.workunit.client.0.smithi089.stdout:5/195: dwrite d1/d7/f30 [0,4194304] 0 2024-09-13T02:53:56.898 INFO:tasks.workunit.client.0.smithi089.stdout:2/156: creat d13/f38 x:0 0 0 2024-09-13T02:53:56.899 INFO:tasks.workunit.client.1.smithi131.stdout:0/526: rmdir d0/de/d1f/d22/d31 39 2024-09-13T02:53:56.900 INFO:tasks.workunit.client.0.smithi089.stdout:7/222: read d3/d19/d2d/f1d [2103237,13020] 0 2024-09-13T02:53:56.900 INFO:tasks.workunit.client.0.smithi089.stdout:7/223: fsync d3/d19/d2d/f12 0 2024-09-13T02:53:56.901 INFO:tasks.workunit.client.1.smithi131.stdout:0/527: rename d0/de/f1a to d0/fc6 0 2024-09-13T02:53:56.901 INFO:tasks.workunit.client.0.smithi089.stdout:8/163: creat de/d16/d1e/d27/f34 x:0 0 0 2024-09-13T02:53:56.901 INFO:tasks.workunit.client.1.smithi131.stdout:0/528: truncate d0/de/d1f/fbd 263970 0 2024-09-13T02:53:56.901 INFO:tasks.workunit.client.1.smithi131.stdout:0/529: creat d0/d2/d41/fc7 x:0 0 0 2024-09-13T02:53:56.914 INFO:tasks.workunit.client.0.smithi089.stdout:7/224: creat d3/d19/d2e/f4f x:0 0 0 2024-09-13T02:53:56.916 INFO:tasks.workunit.client.0.smithi089.stdout:7/225: creat d3/d47/f50 x:0 0 0 2024-09-13T02:53:56.923 INFO:tasks.workunit.client.0.smithi089.stdout:6/162: rename db/d10/d27/d2e to db/d10/d3a 0 2024-09-13T02:53:56.924 INFO:tasks.workunit.client.0.smithi089.stdout:6/163: chown db/d10/f1e 6 1 2024-09-13T02:53:56.924 INFO:tasks.workunit.client.0.smithi089.stdout:6/164: write db/d10/f11 [3704206,35647] 0 2024-09-13T02:53:56.926 INFO:tasks.workunit.client.0.smithi089.stdout:8/164: dwrite de/d16/d1e/f21 [0,4194304] 0 2024-09-13T02:53:56.929 INFO:tasks.workunit.client.0.smithi089.stdout:8/165: mkdir de/d16/d1e/d27/d35 0 2024-09-13T02:53:56.930 INFO:tasks.workunit.client.0.smithi089.stdout:1/113: getdents dc 0 2024-09-13T02:53:56.933 INFO:tasks.workunit.client.0.smithi089.stdout:8/166: unlink de/d16/l19 0 2024-09-13T02:53:56.935 INFO:tasks.workunit.client.0.smithi089.stdout:8/167: creat de/d16/d1e/d20/f36 x:0 0 0 2024-09-13T02:53:56.936 INFO:tasks.workunit.client.0.smithi089.stdout:1/114: getdents dc/d12 0 2024-09-13T02:53:56.937 INFO:tasks.workunit.client.0.smithi089.stdout:8/168: rename f3 to de/d16/d1e/d20/f37 0 2024-09-13T02:53:56.938 INFO:tasks.workunit.client.0.smithi089.stdout:1/115: rmdir dc/d12 39 2024-09-13T02:53:56.938 INFO:tasks.workunit.client.0.smithi089.stdout:1/116: rename dc/d12 to dc/d12/d1d 22 2024-09-13T02:53:56.939 INFO:tasks.workunit.client.0.smithi089.stdout:8/169: mknod de/d16/d1e/d27/d35/c38 0 2024-09-13T02:53:56.939 INFO:tasks.workunit.client.0.smithi089.stdout:1/117: rmdir dc/d12 39 2024-09-13T02:53:56.939 INFO:tasks.workunit.client.0.smithi089.stdout:1/118: dread - dc/f1c zero size 2024-09-13T02:53:56.940 INFO:tasks.workunit.client.0.smithi089.stdout:9/158: truncate d3/d6/df/f38 1572358 0 2024-09-13T02:53:56.941 INFO:tasks.workunit.client.0.smithi089.stdout:9/159: dread - d3/f22 zero size 2024-09-13T02:53:56.941 INFO:tasks.workunit.client.0.smithi089.stdout:9/160: symlink d3/d6/l39 0 2024-09-13T02:53:56.941 INFO:tasks.workunit.client.0.smithi089.stdout:9/161: write d3/d15/f1b [2536603,72151] 0 2024-09-13T02:53:56.945 INFO:tasks.workunit.client.0.smithi089.stdout:8/170: dread de/f10 [0,4194304] 0 2024-09-13T02:53:56.945 INFO:tasks.workunit.client.0.smithi089.stdout:7/226: dwrite d3/f5 [0,4194304] 0 2024-09-13T02:53:56.946 INFO:tasks.workunit.client.0.smithi089.stdout:7/227: mknod d3/d19/d2d/c51 0 2024-09-13T02:53:56.949 INFO:tasks.workunit.client.0.smithi089.stdout:7/228: getdents d3/d47 0 2024-09-13T02:53:56.950 INFO:tasks.workunit.client.0.smithi089.stdout:4/156: sync 2024-09-13T02:53:56.950 INFO:tasks.workunit.client.0.smithi089.stdout:4/157: fsync d2/f4 0 2024-09-13T02:53:56.950 INFO:tasks.workunit.client.0.smithi089.stdout:4/158: chown d2/l2c 0 1 2024-09-13T02:53:56.951 INFO:tasks.workunit.client.0.smithi089.stdout:7/229: mknod d3/d19/d2e/d37/c52 0 2024-09-13T02:53:56.952 INFO:tasks.workunit.client.0.smithi089.stdout:4/159: mknod d2/da/d23/c32 0 2024-09-13T02:53:56.952 INFO:tasks.workunit.client.0.smithi089.stdout:4/160: creat d2/d3/de/f33 x:0 0 0 2024-09-13T02:53:56.952 INFO:tasks.workunit.client.0.smithi089.stdout:4/161: write d2/d3/d5/f1e [1672699,122655] 0 2024-09-13T02:53:56.952 INFO:tasks.workunit.client.0.smithi089.stdout:6/165: dwrite db/d10/d27/f30 [0,4194304] 0 2024-09-13T02:53:56.953 INFO:tasks.workunit.client.0.smithi089.stdout:7/230: truncate d3/d19/d2d/d14/f1c 3268753 0 2024-09-13T02:53:56.953 INFO:tasks.workunit.client.0.smithi089.stdout:1/119: write f7 [3315799,90985] 0 2024-09-13T02:53:56.953 INFO:tasks.workunit.client.0.smithi089.stdout:1/120: fdatasync dc/d12/f1b 0 2024-09-13T02:53:56.953 INFO:tasks.workunit.client.0.smithi089.stdout:1/121: write f3 [2868103,68900] 0 2024-09-13T02:53:56.953 INFO:tasks.workunit.client.0.smithi089.stdout:4/162: write d2/d3/de/f16 [371924,14282] 0 2024-09-13T02:53:56.958 INFO:tasks.workunit.client.0.smithi089.stdout:6/166: creat db/d34/f3b x:0 0 0 2024-09-13T02:53:56.958 INFO:tasks.workunit.client.0.smithi089.stdout:6/167: readlink db/d10/l1c 0 2024-09-13T02:53:56.958 INFO:tasks.workunit.client.0.smithi089.stdout:6/168: creat db/d10/d27/d28/d2f/f3c x:0 0 0 2024-09-13T02:53:56.959 INFO:tasks.workunit.client.0.smithi089.stdout:8/171: dwrite de/d16/d1e/f2a [0,4194304] 0 2024-09-13T02:53:56.959 INFO:tasks.workunit.client.0.smithi089.stdout:0/129: sync 2024-09-13T02:53:56.959 INFO:tasks.workunit.client.0.smithi089.stdout:3/189: sync 2024-09-13T02:53:56.960 INFO:tasks.workunit.client.0.smithi089.stdout:9/162: rmdir d3 39 2024-09-13T02:53:56.960 INFO:tasks.workunit.client.0.smithi089.stdout:9/163: chown d3/d15/f1b 3303 1 2024-09-13T02:53:56.961 INFO:tasks.workunit.client.0.smithi089.stdout:9/164: stat d3/d6/df/d24/l2b 0 2024-09-13T02:53:56.962 INFO:tasks.workunit.client.0.smithi089.stdout:4/163: unlink d2/d3/d5/l15 0 2024-09-13T02:53:56.965 INFO:tasks.workunit.client.0.smithi089.stdout:9/165: dread d3/d15/f1b [0,4194304] 0 2024-09-13T02:53:56.965 INFO:tasks.workunit.client.0.smithi089.stdout:7/231: link d3/c16 d3/d19/c53 0 2024-09-13T02:53:56.969 INFO:tasks.workunit.client.0.smithi089.stdout:0/130: rmdir d2/d2b 0 2024-09-13T02:53:56.969 INFO:tasks.workunit.client.0.smithi089.stdout:0/131: creat d2/d19/f2d x:0 0 0 2024-09-13T02:53:56.973 INFO:tasks.workunit.client.0.smithi089.stdout:4/164: creat d2/d22/f34 x:0 0 0 2024-09-13T02:53:56.974 INFO:tasks.workunit.client.0.smithi089.stdout:9/166: mknod d3/d6/d36/c3a 0 2024-09-13T02:53:56.975 INFO:tasks.workunit.client.0.smithi089.stdout:6/169: rmdir db/d34 39 2024-09-13T02:53:56.977 INFO:tasks.workunit.client.0.smithi089.stdout:0/132: rmdir d2/d19/d1a/d2a 0 2024-09-13T02:53:56.977 INFO:tasks.workunit.client.0.smithi089.stdout:0/133: write d2/f6 [219744,60272] 0 2024-09-13T02:53:56.977 INFO:tasks.workunit.client.0.smithi089.stdout:9/167: symlink d3/d6/d36/l3b 0 2024-09-13T02:53:56.978 INFO:tasks.workunit.client.0.smithi089.stdout:6/170: symlink db/d10/d27/d28/d2f/l3d 0 2024-09-13T02:53:56.978 INFO:tasks.workunit.client.0.smithi089.stdout:6/171: readlink l2 0 2024-09-13T02:53:56.979 INFO:tasks.workunit.client.0.smithi089.stdout:6/172: symlink db/d10/d27/l3e 0 2024-09-13T02:53:56.980 INFO:tasks.workunit.client.0.smithi089.stdout:6/173: fsync db/f19 0 2024-09-13T02:53:56.980 INFO:tasks.workunit.client.0.smithi089.stdout:6/174: stat db/d10/d3a/f36 0 2024-09-13T02:53:56.981 INFO:tasks.workunit.client.0.smithi089.stdout:6/175: dread f3 [0,4194304] 0 2024-09-13T02:53:56.987 INFO:tasks.workunit.client.0.smithi089.stdout:9/168: dread d3/d15/f17 [0,4194304] 0 2024-09-13T02:53:56.990 INFO:tasks.workunit.client.0.smithi089.stdout:9/169: dread d3/d15/f1b [0,4194304] 0 2024-09-13T02:53:56.999 INFO:tasks.workunit.client.0.smithi089.stdout:9/170: dread f2 [0,4194304] 0 2024-09-13T02:53:57.003 INFO:tasks.workunit.client.0.smithi089.stdout:3/190: dwrite d2/d8/dc/f30 [0,4194304] 0 2024-09-13T02:53:57.004 INFO:tasks.workunit.client.0.smithi089.stdout:9/171: rename d3/d6/l21 to d3/d6/df/d24/l3c 0 2024-09-13T02:53:57.004 INFO:tasks.workunit.client.0.smithi089.stdout:9/172: truncate d3/d6/fe 885988 0 2024-09-13T02:53:57.004 INFO:tasks.workunit.client.0.smithi089.stdout:9/173: fsync d3/d6/f14 0 2024-09-13T02:53:57.005 INFO:tasks.workunit.client.0.smithi089.stdout:9/174: chown d3/d6/d36 7469 1 2024-09-13T02:53:57.021 INFO:tasks.workunit.client.0.smithi089.stdout:3/191: write d2/f14 [864099,83321] 0 2024-09-13T02:53:57.021 INFO:tasks.workunit.client.0.smithi089.stdout:3/192: fdatasync d2/d8/f21 0 2024-09-13T02:53:57.034 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:53:56 smithi089 ceph-mon[27639]: pgmap v240: 65 pgs: 65 active+clean; 737 MiB data, 3.8 GiB used, 533 GiB / 536 GiB avail; 63 MiB/s rd, 85 MiB/s wr, 696 op/s 2024-09-13T02:53:57.037 INFO:tasks.workunit.client.0.smithi089.stdout:5/196: dwrite d1/d7/d1f/f42 [0,4194304] 0 2024-09-13T02:53:57.038 INFO:tasks.workunit.client.0.smithi089.stdout:0/134: dwrite d2/f17 [0,4194304] 0 2024-09-13T02:53:57.038 INFO:tasks.workunit.client.0.smithi089.stdout:0/135: chown d2/f29 0 1 2024-09-13T02:53:57.038 INFO:tasks.workunit.client.0.smithi089.stdout:0/136: write d2/f20 [265448,81707] 0 2024-09-13T02:53:57.038 INFO:tasks.workunit.client.1.smithi131.stdout:0/530: dwrite d0/de/f4f [0,4194304] 0 2024-09-13T02:53:57.038 INFO:tasks.workunit.client.1.smithi131.stdout:0/531: write d0/de/d1f/d22/f4e [254177,74027] 0 2024-09-13T02:53:57.039 INFO:tasks.workunit.client.1.smithi131.stdout:0/532: stat d0/de/d1f/d22/d3d/d55/d63/d94 0 2024-09-13T02:53:57.039 INFO:tasks.workunit.client.0.smithi089.stdout:3/193: dread d2/d8/f13 [4194304,4194304] 0 2024-09-13T02:53:57.039 INFO:tasks.workunit.client.0.smithi089.stdout:5/197: mknod d1/d4/d2b/c43 0 2024-09-13T02:53:57.040 INFO:tasks.workunit.client.0.smithi089.stdout:0/137: dread d2/d19/f24 [0,4194304] 0 2024-09-13T02:53:57.040 INFO:tasks.workunit.client.0.smithi089.stdout:0/138: truncate d2/f26 410045 0 2024-09-13T02:53:57.040 INFO:tasks.workunit.client.1.smithi131.stdout:0/533: rmdir d0/de/d1f/d22/d3d/d43/d4b/d9a 0 2024-09-13T02:53:57.040 INFO:tasks.workunit.client.1.smithi131.stdout:0/534: write d0/de/d1f/d22/d3d/d87/f89 [2541135,89630] 0 2024-09-13T02:53:57.041 INFO:tasks.workunit.client.1.smithi131.stdout:0/535: truncate d0/de/d1f/f92 1841726 0 2024-09-13T02:53:57.042 INFO:tasks.workunit.client.0.smithi089.stdout:3/194: unlink d2/d8/dc/f1e 0 2024-09-13T02:53:57.044 INFO:tasks.workunit.client.0.smithi089.stdout:8/172: dwrite de/d16/d1e/f32 [0,4194304] 0 2024-09-13T02:53:57.044 INFO:tasks.workunit.client.0.smithi089.stdout:5/198: symlink d1/d4/l44 0 2024-09-13T02:53:57.044 INFO:tasks.workunit.client.0.smithi089.stdout:7/232: dwrite d3/d19/f38 [0,4194304] 0 2024-09-13T02:53:57.044 INFO:tasks.workunit.client.0.smithi089.stdout:7/233: chown d3/d19/d2d/d14/l26 1269437 1 2024-09-13T02:53:57.044 INFO:tasks.workunit.client.0.smithi089.stdout:6/176: dwrite db/d10/d3a/f36 [0,4194304] 0 2024-09-13T02:53:57.044 INFO:tasks.workunit.client.0.smithi089.stdout:6/177: chown db/d10/c1a 2 1 2024-09-13T02:53:57.044 INFO:tasks.workunit.client.0.smithi089.stdout:6/178: chown f0 6416 1 2024-09-13T02:53:57.045 INFO:tasks.workunit.client.0.smithi089.stdout:0/139: link d2/f21 d2/d19/f2e 0 2024-09-13T02:53:57.046 INFO:tasks.workunit.client.1.smithi131.stdout:0/536: read d0/de/d1f/fbd [67355,63738] 0 2024-09-13T02:53:57.046 INFO:tasks.workunit.client.1.smithi131.stdout:0/537: write d0/de/d1f/d22/fb2 [168977,21682] 0 2024-09-13T02:53:57.046 INFO:tasks.workunit.client.1.smithi131.stdout:0/538: chown d0/de/d1f/d22/f29 85446 1 2024-09-13T02:53:57.047 INFO:tasks.workunit.client.0.smithi089.stdout:9/175: dwrite d3/f34 [0,4194304] 0 2024-09-13T02:53:57.047 INFO:tasks.workunit.client.0.smithi089.stdout:3/195: creat d2/d8/f36 x:0 0 0 2024-09-13T02:53:57.047 INFO:tasks.workunit.client.0.smithi089.stdout:3/196: creat d2/d20/d23/d2b/f37 x:0 0 0 2024-09-13T02:53:57.047 INFO:tasks.workunit.client.0.smithi089.stdout:3/197: write d2/f14 [3612610,48434] 0 2024-09-13T02:53:57.049 INFO:tasks.workunit.client.0.smithi089.stdout:4/165: dwrite d2/d3/d5/f1e [0,4194304] 0 2024-09-13T02:53:57.049 INFO:tasks.workunit.client.0.smithi089.stdout:4/166: readlink d2/d22/l27 0 2024-09-13T02:53:57.050 INFO:tasks.workunit.client.0.smithi089.stdout:8/173: rmdir de/d16/d1e 39 2024-09-13T02:53:57.054 INFO:tasks.workunit.client.0.smithi089.stdout:5/199: mkdir d1/d4/d45 0 2024-09-13T02:53:57.055 INFO:tasks.workunit.client.0.smithi089.stdout:5/200: dread - d1/d4/d2b/f2e zero size 2024-09-13T02:53:57.063 INFO:tasks.workunit.client.0.smithi089.stdout:3/198: dread d2/d8/f21 [0,4194304] 0 2024-09-13T02:53:57.063 INFO:tasks.workunit.client.0.smithi089.stdout:3/199: readlink d2/l9 0 2024-09-13T02:53:57.067 INFO:tasks.workunit.client.0.smithi089.stdout:9/176: mkdir d3/d3d 0 2024-09-13T02:53:57.074 INFO:tasks.workunit.client.1.smithi131.stdout:0/539: dwrite d0/de/d1f/f92 [0,4194304] 0 2024-09-13T02:53:57.074 INFO:tasks.workunit.client.1.smithi131.stdout:0/540: readlink d0/de/l37 0 2024-09-13T02:53:57.074 INFO:tasks.workunit.client.1.smithi131.stdout:0/541: write d0/de/d1f/d22/f29 [785830,10447] 0 2024-09-13T02:53:57.075 INFO:tasks.workunit.client.0.smithi089.stdout:5/201: symlink d1/l46 0 2024-09-13T02:53:57.078 INFO:tasks.workunit.client.1.smithi131.stdout:0/542: mknod d0/de/cc8 0 2024-09-13T02:53:57.081 INFO:tasks.workunit.client.0.smithi089.stdout:0/140: dwrite d2/d19/f2d [0,4194304] 0 2024-09-13T02:53:57.081 INFO:tasks.workunit.client.0.smithi089.stdout:8/174: dwrite de/d16/d1e/f30 [0,4194304] 0 2024-09-13T02:53:57.081 INFO:tasks.workunit.client.0.smithi089.stdout:0/141: readlink d2/la 0 2024-09-13T02:53:57.082 INFO:tasks.workunit.client.0.smithi089.stdout:4/167: rmdir d2 39 2024-09-13T02:53:57.087 INFO:tasks.workunit.client.0.smithi089.stdout:3/200: dwrite d2/d20/d23/d2b/f2f [0,4194304] 0 2024-09-13T02:53:57.091 INFO:tasks.workunit.client.1.smithi131.stdout:0/543: dread d0/de/f14 [0,4194304] 0 2024-09-13T02:53:57.094 INFO:tasks.workunit.client.0.smithi089.stdout:0/142: mknod d2/d19/c2f 0 2024-09-13T02:53:57.095 INFO:tasks.workunit.client.0.smithi089.stdout:5/202: dwrite d1/d4/fc [0,4194304] 0 2024-09-13T02:53:57.096 INFO:tasks.workunit.client.0.smithi089.stdout:8/175: mkdir de/d16/d1e/d20/d39 0 2024-09-13T02:53:57.101 INFO:tasks.workunit.client.0.smithi089.stdout:0/143: link d2/c12 d2/d19/c30 0 2024-09-13T02:53:57.101 INFO:tasks.workunit.client.0.smithi089.stdout:0/144: write d2/f20 [850674,104567] 0 2024-09-13T02:53:57.101 INFO:tasks.workunit.client.0.smithi089.stdout:0/145: creat d2/d19/d1a/d1e/f31 x:0 0 0 2024-09-13T02:53:57.102 INFO:tasks.workunit.client.0.smithi089.stdout:5/203: creat d1/f47 x:0 0 0 2024-09-13T02:53:57.102 INFO:tasks.workunit.client.0.smithi089.stdout:5/204: write d1/f47 [613432,109202] 0 2024-09-13T02:53:57.104 INFO:tasks.workunit.client.0.smithi089.stdout:3/201: rmdir d2/d8/dc 39 2024-09-13T02:53:57.104 INFO:tasks.workunit.client.0.smithi089.stdout:3/202: fdatasync d2/d8/f36 0 2024-09-13T02:53:57.104 INFO:tasks.workunit.client.0.smithi089.stdout:3/203: read - d2/d20/d23/d2b/f37 zero size 2024-09-13T02:53:57.107 INFO:tasks.workunit.client.0.smithi089.stdout:0/146: rename d2/f20 to d2/d19/f32 0 2024-09-13T02:53:57.108 INFO:tasks.workunit.client.0.smithi089.stdout:1/122: sync 2024-09-13T02:53:57.108 INFO:tasks.workunit.client.0.smithi089.stdout:2/157: sync 2024-09-13T02:53:57.108 INFO:tasks.workunit.client.0.smithi089.stdout:4/168: dwrite d2/d3/de/f16 [0,4194304] 0 2024-09-13T02:53:57.108 INFO:tasks.workunit.client.0.smithi089.stdout:4/169: chown d2/l19 30835 1 2024-09-13T02:53:57.109 INFO:tasks.workunit.client.0.smithi089.stdout:0/147: symlink d2/d19/l33 0 2024-09-13T02:53:57.111 INFO:tasks.workunit.client.0.smithi089.stdout:1/123: link dc/fe dc/f1e 0 2024-09-13T02:53:57.113 INFO:tasks.workunit.client.0.smithi089.stdout:2/158: rename d13/f1c to d13/d30/f39 0 2024-09-13T02:53:57.113 INFO:tasks.workunit.client.0.smithi089.stdout:2/159: truncate d13/f38 80151 0 2024-09-13T02:53:57.113 INFO:tasks.workunit.client.0.smithi089.stdout:2/160: write d13/d30/f31 [95153,113253] 0 2024-09-13T02:53:57.116 INFO:tasks.workunit.client.0.smithi089.stdout:4/170: creat d2/d22/f35 x:0 0 0 2024-09-13T02:53:57.116 INFO:tasks.workunit.client.0.smithi089.stdout:4/171: chown d2/d3/d5/c1c 336311 1 2024-09-13T02:53:57.116 INFO:tasks.workunit.client.0.smithi089.stdout:4/172: dread - d2/da/f30 zero size 2024-09-13T02:53:57.116 INFO:tasks.workunit.client.0.smithi089.stdout:0/148: dread d2/fe [0,4194304] 0 2024-09-13T02:53:57.117 INFO:tasks.workunit.client.0.smithi089.stdout:1/124: mknod dc/c1f 0 2024-09-13T02:53:57.117 INFO:tasks.workunit.client.0.smithi089.stdout:4/173: creat d2/d3/de/f36 x:0 0 0 2024-09-13T02:53:57.124 INFO:tasks.workunit.client.0.smithi089.stdout:8/176: dwrite de/f17 [0,4194304] 0 2024-09-13T02:53:57.124 INFO:tasks.workunit.client.0.smithi089.stdout:8/177: chown de/d16/d1e 58609248 1 2024-09-13T02:53:57.125 INFO:tasks.workunit.client.0.smithi089.stdout:8/178: readlink de/l26 0 2024-09-13T02:53:57.127 INFO:tasks.workunit.client.0.smithi089.stdout:2/161: write fd [2840977,125331] 0 2024-09-13T02:53:57.129 INFO:tasks.workunit.client.0.smithi089.stdout:2/162: link d13/d30/c35 d13/c3a 0 2024-09-13T02:53:57.130 INFO:tasks.workunit.client.0.smithi089.stdout:2/163: creat d13/f3b x:0 0 0 2024-09-13T02:53:57.131 INFO:tasks.workunit.client.0.smithi089.stdout:8/179: getdents de/d16/d1e/d27 0 2024-09-13T02:53:57.134 INFO:tasks.workunit.client.0.smithi089.stdout:5/205: dwrite d1/d4/d2b/f2d [0,4194304] 0 2024-09-13T02:53:57.144 INFO:tasks.workunit.client.0.smithi089.stdout:3/204: dwrite d2/d8/dc/f1b [0,4194304] 0 2024-09-13T02:53:57.144 INFO:tasks.workunit.client.0.smithi089.stdout:3/205: write d2/d20/d23/d2b/f37 [1032287,75219] 0 2024-09-13T02:53:57.145 INFO:tasks.workunit.client.0.smithi089.stdout:3/206: unlink d2/d8/f13 0 2024-09-13T02:53:57.145 INFO:tasks.workunit.client.0.smithi089.stdout:3/207: creat d2/d8/f38 x:0 0 0 2024-09-13T02:53:57.153 INFO:tasks.workunit.client.0.smithi089.stdout:0/149: dwrite d2/f18 [0,4194304] 0 2024-09-13T02:53:57.153 INFO:tasks.workunit.client.0.smithi089.stdout:0/150: fdatasync d2/d19/d1a/d1e/f31 0 2024-09-13T02:53:57.153 INFO:tasks.workunit.client.0.smithi089.stdout:0/151: stat d2/la 0 2024-09-13T02:53:57.154 INFO:tasks.workunit.client.0.smithi089.stdout:2/164: dwrite f5 [0,4194304] 0 2024-09-13T02:53:57.154 INFO:tasks.workunit.client.0.smithi089.stdout:2/165: creat d13/d30/f3c x:0 0 0 2024-09-13T02:53:57.154 INFO:tasks.workunit.client.0.smithi089.stdout:2/166: dread - d13/f1b zero size 2024-09-13T02:53:57.155 INFO:tasks.workunit.client.0.smithi089.stdout:1/125: dwrite dc/f17 [4194304,4194304] 0 2024-09-13T02:53:57.156 INFO:tasks.workunit.client.0.smithi089.stdout:4/174: dwrite d2/d3/de/f2d [0,4194304] 0 2024-09-13T02:53:57.156 INFO:tasks.workunit.client.0.smithi089.stdout:4/175: read - d2/d3/d5/f2e zero size 2024-09-13T02:53:57.156 INFO:tasks.workunit.client.0.smithi089.stdout:4/176: chown d2/d3/de/c29 7 1 2024-09-13T02:53:57.156 INFO:tasks.workunit.client.0.smithi089.stdout:4/177: read - d2/d3/d5/f2e zero size 2024-09-13T02:53:57.156 INFO:tasks.workunit.client.0.smithi089.stdout:4/178: chown d2/d3/de/f18 0 1 2024-09-13T02:53:57.161 INFO:tasks.workunit.client.0.smithi089.stdout:0/152: write d2/f18 [988695,120260] 0 2024-09-13T02:53:57.161 INFO:tasks.workunit.client.0.smithi089.stdout:0/153: creat d2/f34 x:0 0 0 2024-09-13T02:53:57.181 INFO:tasks.workunit.client.0.smithi089.stdout:4/179: dread d2/f4 [0,4194304] 0 2024-09-13T02:53:57.181 INFO:tasks.workunit.client.0.smithi089.stdout:4/180: write d2/d3/d5/f2e [394701,119462] 0 2024-09-13T02:53:57.183 INFO:tasks.workunit.client.0.smithi089.stdout:4/181: unlink d2/d3/de/f18 0 2024-09-13T02:53:57.183 INFO:tasks.workunit.client.0.smithi089.stdout:4/182: write d2/d22/f35 [821170,38378] 0 2024-09-13T02:53:57.183 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:53:56 smithi131 ceph-mon[34689]: pgmap v240: 65 pgs: 65 active+clean; 737 MiB data, 3.8 GiB used, 533 GiB / 536 GiB avail; 63 MiB/s rd, 85 MiB/s wr, 696 op/s 2024-09-13T02:53:57.184 INFO:tasks.workunit.client.0.smithi089.stdout:4/183: creat d2/d3/d5/f37 x:0 0 0 2024-09-13T02:53:57.184 INFO:tasks.workunit.client.0.smithi089.stdout:4/184: creat d2/d3/d5/f38 x:0 0 0 2024-09-13T02:53:57.186 INFO:tasks.workunit.client.0.smithi089.stdout:4/185: getdents d2/d22 0 2024-09-13T02:53:57.186 INFO:tasks.workunit.client.0.smithi089.stdout:4/186: fdatasync d2/d22/f26 0 2024-09-13T02:53:57.186 INFO:tasks.workunit.client.0.smithi089.stdout:4/187: write d2/d22/f35 [1748668,29134] 0 2024-09-13T02:53:57.186 INFO:tasks.workunit.client.0.smithi089.stdout:4/188: dread - d2/d22/f34 zero size 2024-09-13T02:53:57.186 INFO:tasks.workunit.client.0.smithi089.stdout:4/189: stat d2/f4 0 2024-09-13T02:53:57.187 INFO:tasks.workunit.client.0.smithi089.stdout:2/167: dwrite d13/f3b [0,4194304] 0 2024-09-13T02:53:57.193 INFO:tasks.workunit.client.0.smithi089.stdout:1/126: dwrite dc/f13 [0,4194304] 0 2024-09-13T02:53:57.193 INFO:tasks.workunit.client.0.smithi089.stdout:0/154: dwrite d2/f6 [0,4194304] 0 2024-09-13T02:53:57.194 INFO:tasks.workunit.client.0.smithi089.stdout:2/168: dread f12 [0,4194304] 0 2024-09-13T02:53:57.195 INFO:tasks.workunit.client.0.smithi089.stdout:1/127: creat dc/d12/f20 x:0 0 0 2024-09-13T02:53:57.198 INFO:tasks.workunit.client.0.smithi089.stdout:2/169: dread d13/d30/f2b [0,4194304] 0 2024-09-13T02:53:57.202 INFO:tasks.workunit.client.0.smithi089.stdout:4/190: dwrite d2/d3/de/f33 [0,4194304] 0 2024-09-13T02:53:57.210 INFO:tasks.workunit.client.0.smithi089.stdout:1/128: rmdir dc/d12 39 2024-09-13T02:53:57.211 INFO:tasks.workunit.client.0.smithi089.stdout:1/129: chown dc/fe 5871279 1 2024-09-13T02:53:57.211 INFO:tasks.workunit.client.0.smithi089.stdout:1/130: write dc/f1c [392177,95918] 0 2024-09-13T02:53:57.211 INFO:tasks.workunit.client.0.smithi089.stdout:1/131: chown dc/d12/f15 99289027 1 2024-09-13T02:53:57.211 INFO:tasks.workunit.client.0.smithi089.stdout:4/191: rmdir d2/d3/d5 39 2024-09-13T02:53:57.211 INFO:tasks.workunit.client.0.smithi089.stdout:4/192: write d2/f4 [10625822,7479] 0 2024-09-13T02:53:57.212 INFO:tasks.workunit.client.0.smithi089.stdout:1/132: rename dc/d12/f1b to dc/f21 0 2024-09-13T02:53:57.213 INFO:tasks.workunit.client.0.smithi089.stdout:4/193: mknod d2/d2f/c39 0 2024-09-13T02:53:57.214 INFO:tasks.workunit.client.0.smithi089.stdout:4/194: chown d2/d22/f34 0 1 2024-09-13T02:53:57.214 INFO:tasks.workunit.client.0.smithi089.stdout:4/195: fdatasync d2/d3/de/f33 0 2024-09-13T02:53:57.214 INFO:tasks.workunit.client.0.smithi089.stdout:4/196: write d2/d3/de/f36 [528368,106290] 0 2024-09-13T02:53:57.214 INFO:tasks.workunit.client.0.smithi089.stdout:1/133: link dc/f1c dc/f22 0 2024-09-13T02:53:57.215 INFO:tasks.workunit.client.0.smithi089.stdout:1/134: creat dc/d12/f23 x:0 0 0 2024-09-13T02:53:57.215 INFO:tasks.workunit.client.0.smithi089.stdout:1/135: fdatasync dc/f13 0 2024-09-13T02:53:57.217 INFO:tasks.workunit.client.0.smithi089.stdout:2/170: dwrite fc [0,4194304] 0 2024-09-13T02:53:57.217 INFO:tasks.workunit.client.0.smithi089.stdout:2/171: write d13/d30/f2b [1519149,93415] 0 2024-09-13T02:53:57.217 INFO:tasks.workunit.client.0.smithi089.stdout:6/179: sync 2024-09-13T02:53:57.217 INFO:tasks.workunit.client.0.smithi089.stdout:7/234: sync 2024-09-13T02:53:57.217 INFO:tasks.workunit.client.0.smithi089.stdout:6/180: fdatasync db/f26 0 2024-09-13T02:53:57.218 INFO:tasks.workunit.client.0.smithi089.stdout:6/181: mknod db/d10/d27/d28/c3f 0 2024-09-13T02:53:57.219 INFO:tasks.workunit.client.0.smithi089.stdout:7/235: mkdir d3/d54 0 2024-09-13T02:53:57.221 INFO:tasks.workunit.client.0.smithi089.stdout:7/236: mkdir d3/d47/d55 0 2024-09-13T02:53:57.221 INFO:tasks.workunit.client.0.smithi089.stdout:7/237: write d3/f1b [887541,103234] 0 2024-09-13T02:53:57.222 INFO:tasks.workunit.client.0.smithi089.stdout:7/238: readlink d3/d19/l25 0 2024-09-13T02:53:57.241 INFO:tasks.workunit.client.0.smithi089.stdout:4/197: dwrite d2/da/f10 [0,4194304] 0 2024-09-13T02:53:57.244 INFO:tasks.workunit.client.0.smithi089.stdout:4/198: unlink d2/da/d23/c32 0 2024-09-13T02:53:57.245 INFO:tasks.workunit.client.0.smithi089.stdout:4/199: link d2/da/l21 d2/da/l3a 0 2024-09-13T02:53:57.247 INFO:tasks.workunit.client.0.smithi089.stdout:4/200: mkdir d2/da/d23/d3b 0 2024-09-13T02:53:57.247 INFO:tasks.workunit.client.0.smithi089.stdout:4/201: dread d2/f1f [0,4194304] 0 2024-09-13T02:53:57.247 INFO:tasks.workunit.client.0.smithi089.stdout:4/202: stat d2/da/d23 0 2024-09-13T02:53:57.248 INFO:tasks.workunit.client.0.smithi089.stdout:4/203: symlink d2/d3/d5/l3c 0 2024-09-13T02:53:57.249 INFO:tasks.workunit.client.0.smithi089.stdout:4/204: creat d2/da/f3d x:0 0 0 2024-09-13T02:53:57.256 INFO:tasks.workunit.client.0.smithi089.stdout:6/182: dwrite db/f1d [0,4194304] 0 2024-09-13T02:53:57.256 INFO:tasks.workunit.client.0.smithi089.stdout:2/172: dwrite f12 [0,4194304] 0 2024-09-13T02:53:57.257 INFO:tasks.workunit.client.0.smithi089.stdout:7/239: dwrite d3/d19/d2d/f18 [0,4194304] 0 2024-09-13T02:53:57.258 INFO:tasks.workunit.client.0.smithi089.stdout:6/183: truncate db/d10/f1e 679966 0 2024-09-13T02:53:57.258 INFO:tasks.workunit.client.0.smithi089.stdout:7/240: symlink d3/d19/d2d/l56 0 2024-09-13T02:53:57.259 INFO:tasks.workunit.client.0.smithi089.stdout:6/184: mknod db/d10/d27/d28/d2f/c40 0 2024-09-13T02:53:57.259 INFO:tasks.workunit.client.0.smithi089.stdout:6/185: chown db/f12 0 1 2024-09-13T02:53:57.259 INFO:tasks.workunit.client.0.smithi089.stdout:6/186: chown db/f19 60 1 2024-09-13T02:53:57.259 INFO:tasks.workunit.client.0.smithi089.stdout:1/136: dwrite dc/fe [0,4194304] 0 2024-09-13T02:53:57.260 INFO:tasks.workunit.client.0.smithi089.stdout:7/241: rename d3/lc to d3/d20/l57 0 2024-09-13T02:53:57.261 INFO:tasks.workunit.client.0.smithi089.stdout:6/187: mknod db/c41 0 2024-09-13T02:53:57.266 INFO:tasks.workunit.client.0.smithi089.stdout:6/188: creat db/d10/d3a/f42 x:0 0 0 2024-09-13T02:53:57.271 INFO:tasks.workunit.client.0.smithi089.stdout:2/173: dread f1 [0,4194304] 0 2024-09-13T02:53:57.273 INFO:tasks.workunit.client.0.smithi089.stdout:2/174: unlink d13/l16 0 2024-09-13T02:53:57.275 INFO:tasks.workunit.client.0.smithi089.stdout:2/175: symlink d13/l3d 0 2024-09-13T02:53:57.275 INFO:tasks.workunit.client.0.smithi089.stdout:7/242: write d3/d19/d2d/f3b [2679215,92543] 0 2024-09-13T02:53:57.275 INFO:tasks.workunit.client.0.smithi089.stdout:7/243: chown d3/d19/f41 1837239 1 2024-09-13T02:53:57.275 INFO:tasks.workunit.client.0.smithi089.stdout:7/244: read - d3/d19/f3d zero size 2024-09-13T02:53:57.275 INFO:tasks.workunit.client.0.smithi089.stdout:7/245: fsync d3/d19/f3d 0 2024-09-13T02:53:57.276 INFO:tasks.workunit.client.0.smithi089.stdout:7/246: chown d3/c3c 12 1 2024-09-13T02:53:57.276 INFO:tasks.workunit.client.0.smithi089.stdout:7/247: readlink d3/d19/d2d/l42 0 2024-09-13T02:53:57.276 INFO:tasks.workunit.client.0.smithi089.stdout:7/248: write d3/d19/d2d/f4a [458405,127721] 0 2024-09-13T02:53:57.277 INFO:tasks.workunit.client.0.smithi089.stdout:7/249: creat d3/d44/f58 x:0 0 0 2024-09-13T02:53:57.277 INFO:tasks.workunit.client.0.smithi089.stdout:7/250: chown d3/d19/d2d/c27 15767374 1 2024-09-13T02:53:57.279 INFO:tasks.workunit.client.0.smithi089.stdout:4/205: dwrite d2/d3/d5/f37 [0,4194304] 0 2024-09-13T02:53:57.279 INFO:tasks.workunit.client.0.smithi089.stdout:1/137: dwrite dc/f1a [0,4194304] 0 2024-09-13T02:53:57.283 INFO:tasks.workunit.client.0.smithi089.stdout:2/176: dread d13/d30/f2c [0,4194304] 0 2024-09-13T02:53:57.285 INFO:tasks.workunit.client.0.smithi089.stdout:7/251: dread d3/d19/d2d/d14/f1c [0,4194304] 0 2024-09-13T02:53:57.285 INFO:tasks.workunit.client.0.smithi089.stdout:7/252: getdents d3/d47/d55 0 2024-09-13T02:53:57.286 INFO:tasks.workunit.client.0.smithi089.stdout:1/138: mkdir dc/d24 0 2024-09-13T02:53:57.288 INFO:tasks.workunit.client.0.smithi089.stdout:4/206: link d2/l19 d2/d3/d5/l3e 0 2024-09-13T02:53:57.288 INFO:tasks.workunit.client.0.smithi089.stdout:4/207: chown d2/da/f3d 141274059 1 2024-09-13T02:53:57.288 INFO:tasks.workunit.client.0.smithi089.stdout:4/208: chown d2/da/cc 629 1 2024-09-13T02:53:57.289 INFO:tasks.workunit.client.0.smithi089.stdout:7/253: dread d3/d19/d2d/f4a [0,4194304] 0 2024-09-13T02:53:57.289 INFO:tasks.workunit.client.0.smithi089.stdout:7/254: chown d3/d19/d2e/d37 13271 1 2024-09-13T02:53:57.290 INFO:tasks.workunit.client.0.smithi089.stdout:2/177: rename d13/c2e to d13/d30/c3e 0 2024-09-13T02:53:57.295 INFO:tasks.workunit.client.0.smithi089.stdout:4/209: creat d2/d22/f3f x:0 0 0 2024-09-13T02:53:57.298 INFO:tasks.workunit.client.0.smithi089.stdout:1/139: link lb dc/d12/l25 0 2024-09-13T02:53:57.299 INFO:tasks.workunit.client.0.smithi089.stdout:7/255: symlink d3/l59 0 2024-09-13T02:53:57.300 INFO:tasks.workunit.client.0.smithi089.stdout:5/206: sync 2024-09-13T02:53:57.300 INFO:tasks.workunit.client.0.smithi089.stdout:9/177: sync 2024-09-13T02:53:57.300 INFO:tasks.workunit.client.0.smithi089.stdout:3/208: sync 2024-09-13T02:53:57.300 INFO:tasks.workunit.client.0.smithi089.stdout:8/180: sync 2024-09-13T02:53:57.300 INFO:tasks.workunit.client.0.smithi089.stdout:0/155: sync 2024-09-13T02:53:57.301 INFO:tasks.workunit.client.0.smithi089.stdout:3/209: creat d2/d20/f39 x:0 0 0 2024-09-13T02:53:57.303 INFO:tasks.workunit.client.0.smithi089.stdout:8/181: mknod de/d16/d1e/d20/c3a 0 2024-09-13T02:53:57.303 INFO:tasks.workunit.client.0.smithi089.stdout:8/182: stat de/d16/d1e/d20/f2b 0 2024-09-13T02:53:57.306 INFO:tasks.workunit.client.0.smithi089.stdout:0/156: rmdir d2/d19/d1a/d1e 39 2024-09-13T02:53:57.306 INFO:tasks.workunit.client.0.smithi089.stdout:7/256: write d3/d19/d2d/f18 [3599189,8263] 0 2024-09-13T02:53:57.307 INFO:tasks.workunit.client.0.smithi089.stdout:4/210: dread d2/d3/de/f2d [0,4194304] 0 2024-09-13T02:53:57.308 INFO:tasks.workunit.client.0.smithi089.stdout:8/183: truncate de/d16/d1e/f2a 2678965 0 2024-09-13T02:53:57.308 INFO:tasks.workunit.client.0.smithi089.stdout:0/157: write d2/d19/f32 [110521,15068] 0 2024-09-13T02:53:57.308 INFO:tasks.workunit.client.0.smithi089.stdout:0/158: write d2/f26 [640514,54493] 0 2024-09-13T02:53:57.313 INFO:tasks.workunit.client.0.smithi089.stdout:4/211: link d2/da/f10 d2/f40 0 2024-09-13T02:53:57.313 INFO:tasks.workunit.client.0.smithi089.stdout:8/184: getdents de 0 2024-09-13T02:53:57.313 INFO:tasks.workunit.client.0.smithi089.stdout:4/212: write d2/d3/de/f2b [4574862,116232] 0 2024-09-13T02:53:57.315 INFO:tasks.workunit.client.0.smithi089.stdout:2/178: dwrite d13/f27 [0,4194304] 0 2024-09-13T02:53:57.315 INFO:tasks.workunit.client.0.smithi089.stdout:2/179: chown d13/d30 1684 1 2024-09-13T02:53:57.316 INFO:tasks.workunit.client.0.smithi089.stdout:0/159: rename d2/d19/f2e to d2/f35 0 2024-09-13T02:53:57.316 INFO:tasks.workunit.client.0.smithi089.stdout:0/160: fdatasync d2/f14 0 2024-09-13T02:53:57.316 INFO:tasks.workunit.client.0.smithi089.stdout:0/161: dread - d2/f28 zero size 2024-09-13T02:53:57.317 INFO:tasks.workunit.client.0.smithi089.stdout:1/140: write f7 [3502693,108038] 0 2024-09-13T02:53:57.321 INFO:tasks.workunit.client.0.smithi089.stdout:4/213: creat d2/d3/f41 x:0 0 0 2024-09-13T02:53:57.321 INFO:tasks.workunit.client.0.smithi089.stdout:4/214: truncate d2/d3/de/f33 5039083 0 2024-09-13T02:53:57.321 INFO:tasks.workunit.client.0.smithi089.stdout:4/215: chown d2/d3/d5/f37 1172 1 2024-09-13T02:53:57.323 INFO:tasks.workunit.client.0.smithi089.stdout:3/210: dread d2/f16 [0,4194304] 0 2024-09-13T02:53:57.323 INFO:tasks.workunit.client.0.smithi089.stdout:4/216: getdents d2/d2f 0 2024-09-13T02:53:57.327 INFO:tasks.workunit.client.0.smithi089.stdout:3/211: getdents d2/d8 0 2024-09-13T02:53:57.327 INFO:tasks.workunit.client.0.smithi089.stdout:3/212: chown d2/c1d 111904 1 2024-09-13T02:53:57.331 INFO:tasks.workunit.client.0.smithi089.stdout:3/213: rename d2/d20/d23/d32/l35 to d2/d20/d23/d32/l3a 0 2024-09-13T02:53:57.336 INFO:tasks.workunit.client.0.smithi089.stdout:2/180: dread fc [0,4194304] 0 2024-09-13T02:53:57.336 INFO:tasks.workunit.client.0.smithi089.stdout:3/214: symlink d2/d20/d23/d2b/l3b 0 2024-09-13T02:53:57.339 INFO:tasks.workunit.client.0.smithi089.stdout:2/181: symlink d13/l3f 0 2024-09-13T02:53:57.339 INFO:tasks.workunit.client.0.smithi089.stdout:2/182: readlink d13/l28 0 2024-09-13T02:53:57.342 INFO:tasks.workunit.client.0.smithi089.stdout:8/185: rmdir de/d16/d1e/d20 39 2024-09-13T02:53:57.342 INFO:tasks.workunit.client.0.smithi089.stdout:3/215: mkdir d2/d8/dc/d3c 0 2024-09-13T02:53:57.344 INFO:tasks.workunit.client.0.smithi089.stdout:9/178: dwrite d3/d6/df/f12 [0,4194304] 0 2024-09-13T02:53:57.345 INFO:tasks.workunit.client.0.smithi089.stdout:8/186: link de/d16/f1b de/d16/d1e/d27/f3b 0 2024-09-13T02:53:57.346 INFO:tasks.workunit.client.0.smithi089.stdout:5/207: dwrite d1/f26 [0,4194304] 0 2024-09-13T02:53:57.347 INFO:tasks.workunit.client.0.smithi089.stdout:5/208: write d1/d4/f17 [4997274,110135] 0 2024-09-13T02:53:57.348 INFO:tasks.workunit.client.0.smithi089.stdout:9/179: truncate d3/d6/f14 667177 0 2024-09-13T02:53:57.349 INFO:tasks.workunit.client.0.smithi089.stdout:8/187: mknod de/d16/d1e/d27/c3c 0 2024-09-13T02:53:57.351 INFO:tasks.workunit.client.0.smithi089.stdout:5/209: symlink d1/d4/l48 0 2024-09-13T02:53:57.353 INFO:tasks.workunit.client.0.smithi089.stdout:9/180: unlink d3/d6/df/d24/d29/l31 0 2024-09-13T02:53:57.353 INFO:tasks.workunit.client.0.smithi089.stdout:9/181: readlink d3/d6/df/d24/l2c 0 2024-09-13T02:53:57.353 INFO:tasks.workunit.client.0.smithi089.stdout:9/182: chown d3/d6/d2a 42530933 1 2024-09-13T02:53:57.353 INFO:tasks.workunit.client.0.smithi089.stdout:9/183: fsync d3/f1f 0 2024-09-13T02:53:57.353 INFO:tasks.workunit.client.0.smithi089.stdout:9/184: chown d3/d6/df/l10 5 1 2024-09-13T02:53:57.354 INFO:tasks.workunit.client.0.smithi089.stdout:5/210: unlink d1/d7/f9 0 2024-09-13T02:53:57.355 INFO:tasks.workunit.client.0.smithi089.stdout:7/257: dwrite d3/d19/d2d/f29 [0,4194304] 0 2024-09-13T02:53:57.355 INFO:tasks.workunit.client.0.smithi089.stdout:7/258: dread - d3/d19/d2d/f4e zero size 2024-09-13T02:53:57.355 INFO:tasks.workunit.client.0.smithi089.stdout:7/259: write d3/d19/d2d/f12 [1192758,89069] 0 2024-09-13T02:53:57.356 INFO:tasks.workunit.client.0.smithi089.stdout:9/185: rename d3/d6/df/d24/l3c to d3/d6/d36/l3e 0 2024-09-13T02:53:57.356 INFO:tasks.workunit.client.0.smithi089.stdout:9/186: read d3/d15/f1b [1154094,52519] 0 2024-09-13T02:53:57.356 INFO:tasks.workunit.client.0.smithi089.stdout:8/188: dread de/f11 [0,4194304] 0 2024-09-13T02:53:57.356 INFO:tasks.workunit.client.0.smithi089.stdout:8/189: chown de/d16/d1e/d27/l2c 3998819 1 2024-09-13T02:53:57.356 INFO:tasks.workunit.client.0.smithi089.stdout:8/190: chown lc 820632932 1 2024-09-13T02:53:57.358 INFO:tasks.workunit.client.0.smithi089.stdout:8/191: unlink de/f15 0 2024-09-13T02:53:57.361 INFO:tasks.workunit.client.0.smithi089.stdout:9/187: dread d3/f1f [0,4194304] 0 2024-09-13T02:53:57.362 INFO:tasks.workunit.client.0.smithi089.stdout:9/188: creat d3/d15/f3f x:0 0 0 2024-09-13T02:53:57.365 INFO:tasks.workunit.client.0.smithi089.stdout:0/162: dwrite d2/f18 [0,4194304] 0 2024-09-13T02:53:57.366 INFO:tasks.workunit.client.0.smithi089.stdout:1/141: dwrite dc/d12/f23 [0,4194304] 0 2024-09-13T02:53:57.366 INFO:tasks.workunit.client.0.smithi089.stdout:1/142: creat dc/d12/f26 x:0 0 0 2024-09-13T02:53:57.366 INFO:tasks.workunit.client.0.smithi089.stdout:5/211: read d1/fd [2945489,54707] 0 2024-09-13T02:53:57.367 INFO:tasks.workunit.client.0.smithi089.stdout:0/163: getdents d2/d19/d1a/d1e 0 2024-09-13T02:53:57.367 INFO:tasks.workunit.client.0.smithi089.stdout:0/164: chown d2/d19/f2d 755 1 2024-09-13T02:53:57.367 INFO:tasks.workunit.client.0.smithi089.stdout:0/165: chown d2/d19/c30 8070 1 2024-09-13T02:53:57.368 INFO:tasks.workunit.client.0.smithi089.stdout:0/166: chown d2/f18 1941676 1 2024-09-13T02:53:57.371 INFO:tasks.workunit.client.0.smithi089.stdout:8/192: write de/f17 [3875774,2616] 0 2024-09-13T02:53:57.374 INFO:tasks.workunit.client.0.smithi089.stdout:8/193: creat de/d16/d1e/d20/f3d x:0 0 0 2024-09-13T02:53:57.374 INFO:tasks.workunit.client.0.smithi089.stdout:8/194: truncate de/d16/d1e/f2f 630977 0 2024-09-13T02:53:57.375 INFO:tasks.workunit.client.0.smithi089.stdout:3/216: dwrite d2/d20/f25 [0,4194304] 0 2024-09-13T02:53:57.375 INFO:tasks.workunit.client.0.smithi089.stdout:3/217: dread - d2/f2d zero size 2024-09-13T02:53:57.376 INFO:tasks.workunit.client.0.smithi089.stdout:3/218: chown d2/d20/l34 8320230 1 2024-09-13T02:53:57.376 INFO:tasks.workunit.client.0.smithi089.stdout:5/212: rename d1/d7/d2c to d1/d4/d1c/d49 0 2024-09-13T02:53:57.379 INFO:tasks.workunit.client.0.smithi089.stdout:1/143: dread f3 [0,4194304] 0 2024-09-13T02:53:57.379 INFO:tasks.workunit.client.0.smithi089.stdout:9/189: dread d3/f34 [0,4194304] 0 2024-09-13T02:53:57.379 INFO:tasks.workunit.client.0.smithi089.stdout:7/260: dwrite d3/d20/f32 [0,4194304] 0 2024-09-13T02:53:57.379 INFO:tasks.workunit.client.0.smithi089.stdout:8/195: write de/f12 [586799,88075] 0 2024-09-13T02:53:57.379 INFO:tasks.workunit.client.0.smithi089.stdout:4/217: dwrite d2/da/f30 [0,4194304] 0 2024-09-13T02:53:57.380 INFO:tasks.workunit.client.0.smithi089.stdout:3/219: truncate d2/d20/d23/d2b/f37 377777 0 2024-09-13T02:53:57.381 INFO:tasks.workunit.client.0.smithi089.stdout:3/220: creat d2/d20/d23/d2b/f3d x:0 0 0 2024-09-13T02:53:57.381 INFO:tasks.workunit.client.0.smithi089.stdout:7/261: write d3/d19/d2d/f4a [128140,33316] 0 2024-09-13T02:53:57.381 INFO:tasks.workunit.client.0.smithi089.stdout:7/262: creat d3/d19/d2d/f5a x:0 0 0 2024-09-13T02:53:57.381 INFO:tasks.workunit.client.0.smithi089.stdout:7/263: getdents d3/d54 0 2024-09-13T02:53:57.382 INFO:tasks.workunit.client.0.smithi089.stdout:9/190: symlink d3/d6/df/d24/d29/l40 0 2024-09-13T02:53:57.385 INFO:tasks.workunit.client.0.smithi089.stdout:8/196: creat de/d16/f3e x:0 0 0 2024-09-13T02:53:57.394 INFO:tasks.workunit.client.0.smithi089.stdout:7/264: mknod d3/d19/c5b 0 2024-09-13T02:53:57.401 INFO:tasks.workunit.client.0.smithi089.stdout:8/197: dread de/d16/f1f [0,4194304] 0 2024-09-13T02:53:57.402 INFO:tasks.workunit.client.0.smithi089.stdout:8/198: chown de/d16/d1e/d20/c3a 11689595 1 2024-09-13T02:53:57.402 INFO:tasks.workunit.client.0.smithi089.stdout:8/199: fdatasync de/d16/d1e/f31 0 2024-09-13T02:53:57.402 INFO:tasks.workunit.client.0.smithi089.stdout:8/200: fdatasync de/f18 0 2024-09-13T02:53:57.404 INFO:tasks.workunit.client.0.smithi089.stdout:5/213: dwrite d1/d7/f19 [0,4194304] 0 2024-09-13T02:53:57.405 INFO:tasks.workunit.client.0.smithi089.stdout:8/201: mkdir de/d16/d1e/d3f 0 2024-09-13T02:53:57.406 INFO:tasks.workunit.client.0.smithi089.stdout:8/202: write de/d16/f1f [331553,3046] 0 2024-09-13T02:53:57.407 INFO:tasks.workunit.client.0.smithi089.stdout:5/214: creat d1/d4/d45/f4a x:0 0 0 2024-09-13T02:53:57.407 INFO:tasks.workunit.client.0.smithi089.stdout:5/215: stat d1/d4/f5 0 2024-09-13T02:53:57.407 INFO:tasks.workunit.client.0.smithi089.stdout:5/216: dread - d1/d7/d1f/f39 zero size 2024-09-13T02:53:57.407 INFO:tasks.workunit.client.0.smithi089.stdout:5/217: fdatasync d1/d4/d45/f4a 0 2024-09-13T02:53:57.407 INFO:tasks.workunit.client.0.smithi089.stdout:5/218: chown d1/d4/d1c/d49 34401 1 2024-09-13T02:53:57.409 INFO:tasks.workunit.client.0.smithi089.stdout:5/219: mknod d1/d7/d1f/c4b 0 2024-09-13T02:53:57.410 INFO:tasks.workunit.client.0.smithi089.stdout:5/220: link d1/d4/d1c/c2a d1/d4/c4c 0 2024-09-13T02:53:57.413 INFO:tasks.workunit.client.0.smithi089.stdout:5/221: mkdir d1/d7/d1f/d4d 0 2024-09-13T02:53:57.414 INFO:tasks.workunit.client.0.smithi089.stdout:5/222: symlink d1/d4/d2b/l4e 0 2024-09-13T02:53:57.414 INFO:tasks.workunit.client.0.smithi089.stdout:5/223: stat d1/d7/f19 0 2024-09-13T02:53:57.418 INFO:tasks.workunit.client.0.smithi089.stdout:1/144: dwrite dc/d12/f26 [0,4194304] 0 2024-09-13T02:53:57.419 INFO:tasks.workunit.client.0.smithi089.stdout:9/191: dwrite d3/f22 [0,4194304] 0 2024-09-13T02:53:57.419 INFO:tasks.workunit.client.0.smithi089.stdout:8/203: write de/d16/d1e/f30 [1999727,12759] 0 2024-09-13T02:53:57.419 INFO:tasks.workunit.client.0.smithi089.stdout:3/221: dwrite d2/d20/d23/d2b/f2f [0,4194304] 0 2024-09-13T02:53:57.422 INFO:tasks.workunit.client.0.smithi089.stdout:1/145: mknod dc/d12/c27 0 2024-09-13T02:53:57.423 INFO:tasks.workunit.client.0.smithi089.stdout:5/224: write d1/d7/f19 [3306175,58798] 0 2024-09-13T02:53:57.425 INFO:tasks.workunit.client.0.smithi089.stdout:7/265: getdents d3/d19 0 2024-09-13T02:53:57.427 INFO:tasks.workunit.client.0.smithi089.stdout:9/192: link d3/l16 d3/d6/df/d24/d29/l41 0 2024-09-13T02:53:57.428 INFO:tasks.workunit.client.0.smithi089.stdout:5/225: dread d1/d4/f25 [0,4194304] 0 2024-09-13T02:53:57.428 INFO:tasks.workunit.client.0.smithi089.stdout:8/204: creat de/f40 x:0 0 0 2024-09-13T02:53:57.429 INFO:tasks.workunit.client.0.smithi089.stdout:3/222: symlink d2/d8/dc/l3e 0 2024-09-13T02:53:57.429 INFO:tasks.workunit.client.0.smithi089.stdout:1/146: dread f3 [0,4194304] 0 2024-09-13T02:53:57.430 INFO:tasks.workunit.client.0.smithi089.stdout:9/193: creat d3/d6/d2a/f42 x:0 0 0 2024-09-13T02:53:57.430 INFO:tasks.workunit.client.0.smithi089.stdout:9/194: chown d3 7668 1 2024-09-13T02:53:57.432 INFO:tasks.workunit.client.0.smithi089.stdout:8/205: unlink de/l13 0 2024-09-13T02:53:57.432 INFO:tasks.workunit.client.0.smithi089.stdout:8/206: fdatasync f0 0 2024-09-13T02:53:57.432 INFO:tasks.workunit.client.0.smithi089.stdout:3/223: symlink d2/d20/l3f 0 2024-09-13T02:53:57.432 INFO:tasks.workunit.client.0.smithi089.stdout:3/224: chown d2/d20/f39 6 1 2024-09-13T02:53:57.433 INFO:tasks.workunit.client.0.smithi089.stdout:9/195: truncate d3/f34 2820072 0 2024-09-13T02:53:57.436 INFO:tasks.workunit.client.0.smithi089.stdout:8/207: dread de/d16/d1e/d27/f3b [0,4194304] 0 2024-09-13T02:53:57.438 INFO:tasks.workunit.client.0.smithi089.stdout:3/225: rename d2/l24 to d2/d20/l40 0 2024-09-13T02:53:57.439 INFO:tasks.workunit.client.0.smithi089.stdout:1/147: dread dc/d12/f26 [0,4194304] 0 2024-09-13T02:53:57.442 INFO:tasks.workunit.client.0.smithi089.stdout:9/196: symlink d3/d6/d2a/l43 0 2024-09-13T02:53:57.444 INFO:tasks.workunit.client.0.smithi089.stdout:8/208: rename de/d16/d1e/d27/c3c to de/d16/d1e/d20/d39/c41 0 2024-09-13T02:53:57.444 INFO:tasks.workunit.client.0.smithi089.stdout:1/148: dread dc/f22 [0,4194304] 0 2024-09-13T02:53:57.444 INFO:tasks.workunit.client.0.smithi089.stdout:1/149: creat dc/d12/f28 x:0 0 0 2024-09-13T02:53:57.444 INFO:tasks.workunit.client.0.smithi089.stdout:1/150: chown dc/fe 45 1 2024-09-13T02:53:57.444 INFO:tasks.workunit.client.0.smithi089.stdout:9/197: unlink d3/l1c 0 2024-09-13T02:53:57.444 INFO:tasks.workunit.client.0.smithi089.stdout:9/198: chown d3/d6/df/l1a 0 1 2024-09-13T02:53:57.445 INFO:tasks.workunit.client.0.smithi089.stdout:8/209: unlink de/d16/f33 0 2024-09-13T02:53:57.445 INFO:tasks.workunit.client.0.smithi089.stdout:8/210: write de/d16/d1e/d20/f3d [374484,124892] 0 2024-09-13T02:53:57.447 INFO:tasks.workunit.client.0.smithi089.stdout:1/151: link dc/c1f dc/d12/c29 0 2024-09-13T02:53:57.447 INFO:tasks.workunit.client.0.smithi089.stdout:9/199: dread d3/d15/f1b [0,4194304] 0 2024-09-13T02:53:57.448 INFO:tasks.workunit.client.0.smithi089.stdout:1/152: symlink dc/l2a 0 2024-09-13T02:53:57.449 INFO:tasks.workunit.client.0.smithi089.stdout:9/200: link d3/d6/df/l1a d3/d6/df/d24/d2e/l44 0 2024-09-13T02:53:57.450 INFO:tasks.workunit.client.0.smithi089.stdout:7/266: dwrite d3/d19/d2d/f12 [0,4194304] 0 2024-09-13T02:53:57.450 INFO:tasks.workunit.client.0.smithi089.stdout:7/267: chown d3/d19/d2e/d37 9161 1 2024-09-13T02:53:57.450 INFO:tasks.workunit.client.0.smithi089.stdout:7/268: chown d3/d19/f3d 177204736 1 2024-09-13T02:53:57.450 INFO:tasks.workunit.client.0.smithi089.stdout:5/226: dwrite d1/f47 [0,4194304] 0 2024-09-13T02:53:57.450 INFO:tasks.workunit.client.0.smithi089.stdout:1/153: truncate dc/fe 1701574 0 2024-09-13T02:53:57.450 INFO:tasks.workunit.client.0.smithi089.stdout:1/154: chown dc/d24 2879557 1 2024-09-13T02:53:57.450 INFO:tasks.workunit.client.0.smithi089.stdout:1/155: chown dc/l14 0 1 2024-09-13T02:53:57.451 INFO:tasks.workunit.client.0.smithi089.stdout:9/201: creat d3/d6/df/d24/d35/f45 x:0 0 0 2024-09-13T02:53:57.451 INFO:tasks.workunit.client.0.smithi089.stdout:9/202: read d3/d15/f17 [3696590,123017] 0 2024-09-13T02:53:57.451 INFO:tasks.workunit.client.0.smithi089.stdout:9/203: fdatasync d3/d6/d2a/f42 0 2024-09-13T02:53:57.453 INFO:tasks.workunit.client.0.smithi089.stdout:5/227: symlink d1/d7/d1f/l4f 0 2024-09-13T02:53:57.454 INFO:tasks.workunit.client.0.smithi089.stdout:9/204: rename d3/d6/df/l10 to d3/d6/df/d24/l46 0 2024-09-13T02:53:57.473 INFO:tasks.workunit.client.0.smithi089.stdout:7/269: dwrite d3/d19/d2e/f33 [0,4194304] 0 2024-09-13T02:53:57.474 INFO:tasks.workunit.client.0.smithi089.stdout:5/228: dwrite d1/d4/f14 [0,4194304] 0 2024-09-13T02:53:57.476 INFO:tasks.workunit.client.0.smithi089.stdout:7/270: link d3/d20/c46 d3/d19/c5c 0 2024-09-13T02:53:57.476 INFO:tasks.workunit.client.0.smithi089.stdout:7/271: chown d3/d20/l57 420 1 2024-09-13T02:53:57.476 INFO:tasks.workunit.client.0.smithi089.stdout:7/272: stat d3 0 2024-09-13T02:53:57.476 INFO:tasks.workunit.client.0.smithi089.stdout:7/273: write d3/d19/d2e/f4f [882948,57618] 0 2024-09-13T02:53:57.476 INFO:tasks.workunit.client.0.smithi089.stdout:5/229: creat d1/d4/d2b/f50 x:0 0 0 2024-09-13T02:53:57.476 INFO:tasks.workunit.client.0.smithi089.stdout:5/230: fdatasync d1/d4/f3a 0 2024-09-13T02:53:57.477 INFO:tasks.workunit.client.0.smithi089.stdout:7/274: creat d3/d20/f5d x:0 0 0 2024-09-13T02:53:57.477 INFO:tasks.workunit.client.0.smithi089.stdout:7/275: write d3/d19/d2d/f1d [268399,120909] 0 2024-09-13T02:53:57.478 INFO:tasks.workunit.client.0.smithi089.stdout:7/276: mkdir d3/d47/d5e 0 2024-09-13T02:53:57.497 INFO:tasks.workunit.client.0.smithi089.stdout:5/231: dwrite d1/fd [0,4194304] 0 2024-09-13T02:53:57.497 INFO:tasks.workunit.client.0.smithi089.stdout:5/232: creat d1/f51 x:0 0 0 2024-09-13T02:53:57.499 INFO:tasks.workunit.client.0.smithi089.stdout:5/233: rename d1/d4/f11 to d1/d4/d2b/f52 0 2024-09-13T02:53:57.500 INFO:tasks.workunit.client.0.smithi089.stdout:5/234: link d1/c10 d1/c53 0 2024-09-13T02:53:57.501 INFO:tasks.workunit.client.0.smithi089.stdout:5/235: stat d1/d4/d45 0 2024-09-13T02:53:57.501 INFO:tasks.workunit.client.0.smithi089.stdout:5/236: chown d1/d4/d1c/d49/f38 5140 1 2024-09-13T02:53:57.501 INFO:tasks.workunit.client.0.smithi089.stdout:5/237: mknod d1/d4/d1c/d49/c54 0 2024-09-13T02:53:57.501 INFO:tasks.workunit.client.0.smithi089.stdout:5/238: write d1/d4/f5 [1242797,77761] 0 2024-09-13T02:53:57.502 INFO:tasks.workunit.client.0.smithi089.stdout:5/239: dread - d1/d4/f3a zero size 2024-09-13T02:53:57.502 INFO:tasks.workunit.client.0.smithi089.stdout:5/240: creat d1/f55 x:0 0 0 2024-09-13T02:53:57.515 INFO:tasks.workunit.client.0.smithi089.stdout:5/241: dwrite d1/d7/f15 [0,4194304] 0 2024-09-13T02:53:57.533 INFO:tasks.workunit.client.0.smithi089.stdout:5/242: dwrite d1/d7/f19 [4194304,4194304] 0 2024-09-13T02:53:57.533 INFO:tasks.workunit.client.0.smithi089.stdout:5/243: write d1/d7/d1f/f39 [5771,445] 0 2024-09-13T02:53:57.533 INFO:tasks.workunit.client.0.smithi089.stdout:5/244: write d1/f55 [820831,8671] 0 2024-09-13T02:53:57.542 INFO:tasks.workunit.client.0.smithi089.stdout:5/245: dread d1/f47 [0,4194304] 0 2024-09-13T02:53:57.542 INFO:tasks.workunit.client.0.smithi089.stdout:5/246: creat d1/f56 x:0 0 0 2024-09-13T02:53:57.544 INFO:tasks.workunit.client.0.smithi089.stdout:5/247: symlink d1/d4/l57 0 2024-09-13T02:53:57.545 INFO:tasks.workunit.client.0.smithi089.stdout:5/248: creat d1/d7/d1f/d4d/f58 x:0 0 0 2024-09-13T02:53:57.584 INFO:tasks.workunit.client.0.smithi089.stdout:9/205: dwrite d3/d6/df/d24/d35/f45 [0,4194304] 0 2024-09-13T02:53:57.591 INFO:tasks.workunit.client.0.smithi089.stdout:9/206: truncate d3/f5 3971864 0 2024-09-13T02:53:57.598 INFO:tasks.workunit.client.0.smithi089.stdout:8/211: dwrite de/d16/d1e/f21 [0,4194304] 0 2024-09-13T02:53:57.599 INFO:tasks.workunit.client.0.smithi089.stdout:7/277: dwrite d3/d19/f36 [0,4194304] 0 2024-09-13T02:53:57.599 INFO:tasks.workunit.client.0.smithi089.stdout:5/249: dwrite d1/d4/d2b/f2d [0,4194304] 0 2024-09-13T02:53:57.600 INFO:tasks.workunit.client.0.smithi089.stdout:5/250: fdatasync d1/d4/d2b/f2d 0 2024-09-13T02:53:57.602 INFO:tasks.workunit.client.0.smithi089.stdout:8/212: creat de/d16/d1e/d3f/f42 x:0 0 0 2024-09-13T02:53:57.602 INFO:tasks.workunit.client.0.smithi089.stdout:8/213: chown de/d16/d1e/c28 1 1 2024-09-13T02:53:57.610 INFO:tasks.workunit.client.0.smithi089.stdout:5/251: creat d1/d4/d1c/d49/f59 x:0 0 0 2024-09-13T02:53:57.615 INFO:tasks.workunit.client.0.smithi089.stdout:5/252: mkdir d1/d4/d1c/d49/d5a 0 2024-09-13T02:53:57.615 INFO:tasks.workunit.client.0.smithi089.stdout:5/253: creat d1/d4/d1c/d49/f5b x:0 0 0 2024-09-13T02:53:57.620 INFO:tasks.workunit.client.0.smithi089.stdout:5/254: mknod d1/d4/d1c/c5c 0 2024-09-13T02:53:57.620 INFO:tasks.workunit.client.0.smithi089.stdout:9/207: dwrite d3/d15/f1b [0,4194304] 0 2024-09-13T02:53:57.620 INFO:tasks.workunit.client.0.smithi089.stdout:9/208: write d3/d15/f17 [3367245,32462] 0 2024-09-13T02:53:57.621 INFO:tasks.workunit.client.1.smithi131.stdout:9/291: sync 2024-09-13T02:53:57.623 INFO:tasks.workunit.client.1.smithi131.stdout:9/292: creat d0/d4d/f5c x:0 0 0 2024-09-13T02:53:57.625 INFO:tasks.workunit.client.0.smithi089.stdout:5/255: truncate d1/d7/f30 4190247 0 2024-09-13T02:53:57.626 INFO:tasks.workunit.client.0.smithi089.stdout:5/256: dread - d1/d4/d2b/f2e zero size 2024-09-13T02:53:57.626 INFO:tasks.workunit.client.0.smithi089.stdout:5/257: creat d1/d4/d1c/d49/f5d x:0 0 0 2024-09-13T02:53:57.626 INFO:tasks.workunit.client.0.smithi089.stdout:5/258: creat d1/f5e x:0 0 0 2024-09-13T02:53:57.630 INFO:tasks.workunit.client.0.smithi089.stdout:6/189: sync 2024-09-13T02:53:57.630 INFO:tasks.workunit.client.0.smithi089.stdout:2/183: sync 2024-09-13T02:53:57.630 INFO:tasks.workunit.client.0.smithi089.stdout:2/184: dread - d13/f2d zero size 2024-09-13T02:53:57.634 INFO:tasks.workunit.client.0.smithi089.stdout:4/218: sync 2024-09-13T02:53:57.634 INFO:tasks.workunit.client.0.smithi089.stdout:0/167: sync 2024-09-13T02:53:57.634 INFO:tasks.workunit.client.0.smithi089.stdout:0/168: truncate d2/f34 172103 0 2024-09-13T02:53:57.635 INFO:tasks.workunit.client.0.smithi089.stdout:4/219: creat d2/d3/d5/f42 x:0 0 0 2024-09-13T02:53:57.636 INFO:tasks.workunit.client.0.smithi089.stdout:6/190: dread db/f26 [0,4194304] 0 2024-09-13T02:53:57.639 INFO:tasks.workunit.client.0.smithi089.stdout:5/259: dread d1/f47 [0,4194304] 0 2024-09-13T02:53:57.640 INFO:tasks.workunit.client.0.smithi089.stdout:8/214: dwrite de/f22 [0,4194304] 0 2024-09-13T02:53:57.640 INFO:tasks.workunit.client.0.smithi089.stdout:5/260: chown d1/d7/f30 3 1 2024-09-13T02:53:57.640 INFO:tasks.workunit.client.0.smithi089.stdout:4/220: getdents d2/da 0 2024-09-13T02:53:57.640 INFO:tasks.workunit.client.0.smithi089.stdout:4/221: readlink d2/l2c 0 2024-09-13T02:53:57.640 INFO:tasks.workunit.client.0.smithi089.stdout:5/261: creat d1/d7/d1f/f5f x:0 0 0 2024-09-13T02:53:57.644 INFO:tasks.workunit.client.0.smithi089.stdout:8/215: mknod de/d16/d1e/d27/c43 0 2024-09-13T02:53:57.644 INFO:tasks.workunit.client.0.smithi089.stdout:8/216: write de/d16/f1c [1127514,118398] 0 2024-09-13T02:53:57.644 INFO:tasks.workunit.client.0.smithi089.stdout:8/217: rename de/d16 to de/d16/d1e/d44 22 2024-09-13T02:53:57.644 INFO:tasks.workunit.client.0.smithi089.stdout:8/218: readlink de/d16/d1e/d20/l23 0 2024-09-13T02:53:57.646 INFO:tasks.workunit.client.0.smithi089.stdout:7/278: dwrite d3/d19/d2d/f12 [4194304,4194304] 0 2024-09-13T02:53:57.646 INFO:tasks.workunit.client.0.smithi089.stdout:2/185: dread f12 [0,4194304] 0 2024-09-13T02:53:57.647 INFO:tasks.workunit.client.0.smithi089.stdout:2/186: chown f12 28 1 2024-09-13T02:53:57.647 INFO:tasks.workunit.client.0.smithi089.stdout:2/187: creat d13/d30/f40 x:0 0 0 2024-09-13T02:53:57.647 INFO:tasks.workunit.client.0.smithi089.stdout:2/188: creat d13/d30/f41 x:0 0 0 2024-09-13T02:53:57.647 INFO:tasks.workunit.client.0.smithi089.stdout:8/219: mkdir de/d16/d1e/d45 0 2024-09-13T02:53:57.647 INFO:tasks.workunit.client.0.smithi089.stdout:8/220: fsync de/d16/d1e/f31 0 2024-09-13T02:53:57.647 INFO:tasks.workunit.client.0.smithi089.stdout:8/221: chown de/d16/d1e/d20/c3a 1451 1 2024-09-13T02:53:57.647 INFO:tasks.workunit.client.0.smithi089.stdout:8/222: chown de/d16/d1e/d20 143792 1 2024-09-13T02:53:57.647 INFO:tasks.workunit.client.0.smithi089.stdout:8/223: creat de/d16/d1e/d3f/f46 x:0 0 0 2024-09-13T02:53:57.650 INFO:tasks.workunit.client.0.smithi089.stdout:2/189: symlink d13/l42 0 2024-09-13T02:53:57.650 INFO:tasks.workunit.client.0.smithi089.stdout:2/190: truncate d13/d30/f3c 997434 0 2024-09-13T02:53:57.650 INFO:tasks.workunit.client.0.smithi089.stdout:4/222: write d2/da/f13 [887359,46226] 0 2024-09-13T02:53:57.653 INFO:tasks.workunit.client.0.smithi089.stdout:2/191: rename d13/f38 to d13/f43 0 2024-09-13T02:53:57.653 INFO:tasks.workunit.client.0.smithi089.stdout:2/192: creat d13/f44 x:0 0 0 2024-09-13T02:53:57.658 INFO:tasks.workunit.client.0.smithi089.stdout:7/279: write d3/d44/f43 [3727082,14837] 0 2024-09-13T02:53:57.659 INFO:tasks.workunit.client.0.smithi089.stdout:4/223: rename d2/da/d23 to d2/d3/d5/d43 0 2024-09-13T02:53:57.659 INFO:tasks.workunit.client.0.smithi089.stdout:4/224: dread - d2/d22/f26 zero size 2024-09-13T02:53:57.661 INFO:tasks.workunit.client.0.smithi089.stdout:2/193: rename c8 to d13/d30/c45 0 2024-09-13T02:53:57.661 INFO:tasks.workunit.client.0.smithi089.stdout:4/225: creat d2/da/f44 x:0 0 0 2024-09-13T02:53:57.662 INFO:tasks.workunit.client.0.smithi089.stdout:4/226: creat d2/da/f45 x:0 0 0 2024-09-13T02:53:57.663 INFO:tasks.workunit.client.0.smithi089.stdout:2/194: symlink d13/d30/l46 0 2024-09-13T02:53:57.663 INFO:tasks.workunit.client.0.smithi089.stdout:2/195: chown d13/d30/l24 151630845 1 2024-09-13T02:53:57.664 INFO:tasks.workunit.client.0.smithi089.stdout:2/196: write d13/d30/f2b [864830,97372] 0 2024-09-13T02:53:57.665 INFO:tasks.workunit.client.0.smithi089.stdout:2/197: write d13/f1a [3333192,27524] 0 2024-09-13T02:53:57.665 INFO:tasks.workunit.client.0.smithi089.stdout:2/198: chown d13/f3b 854 1 2024-09-13T02:53:57.665 INFO:tasks.workunit.client.0.smithi089.stdout:2/199: fdatasync d13/f32 0 2024-09-13T02:53:57.666 INFO:tasks.workunit.client.0.smithi089.stdout:2/200: truncate d13/f27 1247097 0 2024-09-13T02:53:57.689 INFO:tasks.workunit.client.0.smithi089.stdout:0/169: dwrite d2/fc [0,4194304] 0 2024-09-13T02:53:57.690 INFO:tasks.workunit.client.0.smithi089.stdout:0/170: write d2/f26 [1168315,105812] 0 2024-09-13T02:53:57.690 INFO:tasks.workunit.client.0.smithi089.stdout:0/171: creat d2/d19/f36 x:0 0 0 2024-09-13T02:53:57.690 INFO:tasks.workunit.client.0.smithi089.stdout:0/172: chown d2/f34 2631453 1 2024-09-13T02:53:57.692 INFO:tasks.workunit.client.0.smithi089.stdout:0/173: rmdir d2/d19/d1a 39 2024-09-13T02:53:57.693 INFO:tasks.workunit.client.0.smithi089.stdout:0/174: symlink d2/d19/d1a/l37 0 2024-09-13T02:53:57.694 INFO:tasks.workunit.client.0.smithi089.stdout:0/175: mknod d2/d19/c38 0 2024-09-13T02:53:57.694 INFO:tasks.workunit.client.0.smithi089.stdout:0/176: chown d2/f17 527992680 1 2024-09-13T02:53:57.696 INFO:tasks.workunit.client.0.smithi089.stdout:9/209: dwrite d3/d6/fe [0,4194304] 0 2024-09-13T02:53:57.698 INFO:tasks.workunit.client.0.smithi089.stdout:5/262: dwrite d1/d4/d45/f4a [0,4194304] 0 2024-09-13T02:53:57.698 INFO:tasks.workunit.client.0.smithi089.stdout:5/263: stat d1 0 2024-09-13T02:53:57.698 INFO:tasks.workunit.client.0.smithi089.stdout:6/191: dwrite db/d10/f1f [0,4194304] 0 2024-09-13T02:53:57.698 INFO:tasks.workunit.client.0.smithi089.stdout:7/280: dwrite d3/d19/f3f [0,4194304] 0 2024-09-13T02:53:57.699 INFO:tasks.workunit.client.1.smithi131.stdout:9/293: dwrite d0/d3/d14/d1a/d2a/f4e [0,4194304] 0 2024-09-13T02:53:57.701 INFO:tasks.workunit.client.0.smithi089.stdout:4/227: dwrite d2/f40 [4194304,4194304] 0 2024-09-13T02:53:57.701 INFO:tasks.workunit.client.0.smithi089.stdout:4/228: chown d2 45130 1 2024-09-13T02:53:57.701 INFO:tasks.workunit.client.0.smithi089.stdout:2/201: dwrite d13/f32 [0,4194304] 0 2024-09-13T02:53:57.701 INFO:tasks.workunit.client.0.smithi089.stdout:2/202: creat d13/d30/f47 x:0 0 0 2024-09-13T02:53:57.701 INFO:tasks.workunit.client.0.smithi089.stdout:2/203: write d13/f1a [620072,124963] 0 2024-09-13T02:53:57.701 INFO:tasks.workunit.client.0.smithi089.stdout:2/204: chown d13/d30/c1f 0 1 2024-09-13T02:53:57.701 INFO:tasks.workunit.client.0.smithi089.stdout:2/205: creat d13/d30/f48 x:0 0 0 2024-09-13T02:53:57.701 INFO:tasks.workunit.client.0.smithi089.stdout:2/206: fdatasync d13/f27 0 2024-09-13T02:53:57.702 INFO:tasks.workunit.client.0.smithi089.stdout:2/207: fdatasync d13/d30/f47 0 2024-09-13T02:53:57.708 INFO:tasks.workunit.client.0.smithi089.stdout:6/192: rename db/d34 to db/d43 0 2024-09-13T02:53:57.709 INFO:tasks.workunit.client.0.smithi089.stdout:7/281: truncate d3/d19/d2d/f18 4393359 0 2024-09-13T02:53:57.715 INFO:tasks.workunit.client.0.smithi089.stdout:4/229: symlink d2/d3/d5/d43/d3b/l46 0 2024-09-13T02:53:57.719 INFO:tasks.workunit.client.0.smithi089.stdout:2/208: rename d13/f1b to d13/d30/f49 0 2024-09-13T02:53:57.719 INFO:tasks.workunit.client.0.smithi089.stdout:2/209: creat d13/d30/f4a x:0 0 0 2024-09-13T02:53:57.719 INFO:tasks.workunit.client.0.smithi089.stdout:2/210: fdatasync d13/d30/f39 0 2024-09-13T02:53:57.719 INFO:tasks.workunit.client.0.smithi089.stdout:2/211: dread - d13/d30/f47 zero size 2024-09-13T02:53:57.719 INFO:tasks.workunit.client.0.smithi089.stdout:2/212: creat d13/d30/f4b x:0 0 0 2024-09-13T02:53:57.719 INFO:tasks.workunit.client.0.smithi089.stdout:2/213: stat d13/d30/f4b 0 2024-09-13T02:53:57.720 INFO:tasks.workunit.client.0.smithi089.stdout:2/214: readlink d13/d30/l21 0 2024-09-13T02:53:57.720 INFO:tasks.workunit.client.0.smithi089.stdout:9/210: getdents d3/d15 0 2024-09-13T02:53:57.721 INFO:tasks.workunit.client.0.smithi089.stdout:0/177: dwrite d2/d19/f2d [0,4194304] 0 2024-09-13T02:53:57.721 INFO:tasks.workunit.client.0.smithi089.stdout:0/178: truncate d2/f21 493167 0 2024-09-13T02:53:57.721 INFO:tasks.workunit.client.0.smithi089.stdout:0/179: creat d2/d19/f39 x:0 0 0 2024-09-13T02:53:57.721 INFO:tasks.workunit.client.0.smithi089.stdout:0/180: readlink d2/d19/d1a/l23 0 2024-09-13T02:53:57.722 INFO:tasks.workunit.client.0.smithi089.stdout:9/211: dread d3/d6/f14 [0,4194304] 0 2024-09-13T02:53:57.722 INFO:tasks.workunit.client.0.smithi089.stdout:7/282: mknod d3/d47/d5e/c5f 0 2024-09-13T02:53:57.722 INFO:tasks.workunit.client.0.smithi089.stdout:7/283: fdatasync d3/d44/f58 0 2024-09-13T02:53:57.722 INFO:tasks.workunit.client.0.smithi089.stdout:5/264: dwrite d1/f56 [0,4194304] 0 2024-09-13T02:53:57.722 INFO:tasks.workunit.client.0.smithi089.stdout:5/265: write d1/d7/f27 [2578230,81330] 0 2024-09-13T02:53:57.722 INFO:tasks.workunit.client.0.smithi089.stdout:5/266: fdatasync d1/d4/f5 0 2024-09-13T02:53:57.723 INFO:tasks.workunit.client.0.smithi089.stdout:6/193: rename db/d10/f14 to db/d10/d3a/f44 0 2024-09-13T02:53:57.724 INFO:tasks.workunit.client.1.smithi131.stdout:9/294: dwrite d0/d3/d14/d1a/d2a/f4f [0,4194304] 0 2024-09-13T02:53:57.725 INFO:tasks.workunit.client.1.smithi131.stdout:9/295: dread - d0/d3/d14/d1a/d2a/f5a zero size 2024-09-13T02:53:57.727 INFO:tasks.workunit.client.0.smithi089.stdout:4/230: dread d2/d3/d5/f2e [0,4194304] 0 2024-09-13T02:53:57.727 INFO:tasks.workunit.client.0.smithi089.stdout:4/231: fdatasync d2/d3/de/f36 0 2024-09-13T02:53:57.727 INFO:tasks.workunit.client.1.smithi131.stdout:9/296: symlink d0/d3/d14/d17/d32/d39/l5d 0 2024-09-13T02:53:57.728 INFO:tasks.workunit.client.1.smithi131.stdout:9/297: stat d0/d3/d14/l54 0 2024-09-13T02:53:57.728 INFO:tasks.workunit.client.1.smithi131.stdout:9/298: chown d0/d3/d14/d1a/d2a/l47 23121061 1 2024-09-13T02:53:57.732 INFO:tasks.workunit.client.0.smithi089.stdout:5/267: rename d1/d4/l16 to d1/d4/l60 0 2024-09-13T02:53:57.737 INFO:tasks.workunit.client.1.smithi131.stdout:9/299: dread d0/f15 [0,4194304] 0 2024-09-13T02:53:57.746 INFO:tasks.workunit.client.0.smithi089.stdout:2/215: dread d13/f27 [0,4194304] 0 2024-09-13T02:53:57.747 INFO:tasks.workunit.client.0.smithi089.stdout:5/268: read d1/d7/f21 [2791721,108492] 0 2024-09-13T02:53:57.749 INFO:tasks.workunit.client.1.smithi131.stdout:9/300: read d0/d3/d14/f34 [8283136,71078] 0 2024-09-13T02:53:57.750 INFO:tasks.workunit.client.1.smithi131.stdout:9/301: mkdir d0/d3/d14/d1a/d2a/d5e 0 2024-09-13T02:53:57.752 INFO:tasks.workunit.client.0.smithi089.stdout:2/216: dread fc [0,4194304] 0 2024-09-13T02:53:57.752 INFO:tasks.workunit.client.0.smithi089.stdout:2/217: dread - d13/f44 zero size 2024-09-13T02:53:57.752 INFO:tasks.workunit.client.0.smithi089.stdout:2/218: chown d13/f2d 2 1 2024-09-13T02:53:57.755 INFO:tasks.workunit.client.0.smithi089.stdout:4/232: getdents d2/d3/d5/d43/d3b 0 2024-09-13T02:53:57.757 INFO:tasks.workunit.client.0.smithi089.stdout:4/233: getdents d2/d3/d5/d43 0 2024-09-13T02:53:57.757 INFO:tasks.workunit.client.0.smithi089.stdout:4/234: write d2/da/f45 [847762,30343] 0 2024-09-13T02:53:57.757 INFO:tasks.workunit.client.0.smithi089.stdout:7/284: dwrite d3/d44/f39 [0,4194304] 0 2024-09-13T02:53:57.757 INFO:tasks.workunit.client.0.smithi089.stdout:7/285: fdatasync d3/d19/d2d/d14/f1c 0 2024-09-13T02:53:57.758 INFO:tasks.workunit.client.0.smithi089.stdout:9/212: dwrite d3/d6/df/d24/d35/f45 [0,4194304] 0 2024-09-13T02:53:57.758 INFO:tasks.workunit.client.0.smithi089.stdout:9/213: stat d3/d6/d36/c3a 0 2024-09-13T02:53:57.758 INFO:tasks.workunit.client.0.smithi089.stdout:9/214: stat d3/d6/df/d24/d32 0 2024-09-13T02:53:57.761 INFO:tasks.workunit.client.0.smithi089.stdout:6/194: getdents db/d10/d3a 0 2024-09-13T02:53:57.761 INFO:tasks.workunit.client.1.smithi131.stdout:9/302: dread d0/f25 [0,4194304] 0 2024-09-13T02:53:57.763 INFO:tasks.workunit.client.0.smithi089.stdout:6/195: symlink db/d43/l45 0 2024-09-13T02:53:57.764 INFO:tasks.workunit.client.0.smithi089.stdout:5/269: dread d1/d7/d1f/f42 [0,4194304] 0 2024-09-13T02:53:57.764 INFO:tasks.workunit.client.0.smithi089.stdout:5/270: readlink d1/d4/l60 0 2024-09-13T02:53:57.764 INFO:tasks.workunit.client.0.smithi089.stdout:2/219: getdents d13/d30 0 2024-09-13T02:53:57.766 INFO:tasks.workunit.client.0.smithi089.stdout:2/220: rename d13/c3a to d13/c4c 0 2024-09-13T02:53:57.768 INFO:tasks.workunit.client.0.smithi089.stdout:2/221: symlink d13/d30/l4d 0 2024-09-13T02:53:57.770 INFO:tasks.workunit.client.0.smithi089.stdout:2/222: mkdir d13/d30/d4e 0 2024-09-13T02:53:57.771 INFO:tasks.workunit.client.0.smithi089.stdout:2/223: readlink l6 0 2024-09-13T02:53:57.775 INFO:tasks.workunit.client.1.smithi131.stdout:9/303: write d0/f33 [461960,68300] 0 2024-09-13T02:53:57.775 INFO:tasks.workunit.client.1.smithi131.stdout:9/304: dread - d0/d3/d14/d17/d32/f53 zero size 2024-09-13T02:53:57.775 INFO:tasks.workunit.client.1.smithi131.stdout:9/305: stat d0/d3/d14/d17 0 2024-09-13T02:53:57.775 INFO:tasks.workunit.client.0.smithi089.stdout:1/156: sync 2024-09-13T02:53:57.775 INFO:tasks.workunit.client.0.smithi089.stdout:3/226: sync 2024-09-13T02:53:57.776 INFO:tasks.workunit.client.0.smithi089.stdout:8/224: sync 2024-09-13T02:53:57.777 INFO:tasks.workunit.client.0.smithi089.stdout:1/157: mknod dc/d24/c2b 0 2024-09-13T02:53:57.777 INFO:tasks.workunit.client.0.smithi089.stdout:1/158: dread - dc/f21 zero size 2024-09-13T02:53:57.778 INFO:tasks.workunit.client.0.smithi089.stdout:8/225: creat de/d16/d1e/f47 x:0 0 0 2024-09-13T02:53:57.780 INFO:tasks.workunit.client.0.smithi089.stdout:8/226: unlink de/d16/d1e/d27/f34 0 2024-09-13T02:53:57.780 INFO:tasks.workunit.client.0.smithi089.stdout:8/227: chown de/d16/d1e/d20/c3a 1499179 1 2024-09-13T02:53:57.791 INFO:tasks.workunit.client.1.smithi131.stdout:9/306: write d0/d3/d14/d1a/f1d [1233141,92111] 0 2024-09-13T02:53:57.791 INFO:tasks.workunit.client.0.smithi089.stdout:5/271: dwrite d1/f51 [0,4194304] 0 2024-09-13T02:53:57.791 INFO:tasks.workunit.client.0.smithi089.stdout:5/272: chown d1/c13 123363 1 2024-09-13T02:53:57.794 INFO:tasks.workunit.client.1.smithi131.stdout:9/307: symlink d0/d3/d14/d1a/d2a/d5e/l5f 0 2024-09-13T02:53:57.794 INFO:tasks.workunit.client.1.smithi131.stdout:9/308: chown d0/d3/d14/d1a/d2a/f4f 3522205 1 2024-09-13T02:53:57.794 INFO:tasks.workunit.client.1.smithi131.stdout:9/309: write d0/d3/d14/d1a/d2a/f4e [5011055,30643] 0 2024-09-13T02:53:57.805 INFO:tasks.workunit.client.0.smithi089.stdout:1/159: write dc/d12/f23 [3487695,37698] 0 2024-09-13T02:53:57.805 INFO:tasks.workunit.client.0.smithi089.stdout:4/235: dwrite d2/da/f45 [0,4194304] 0 2024-09-13T02:53:57.806 INFO:tasks.workunit.client.0.smithi089.stdout:3/227: dwrite d2/f14 [0,4194304] 0 2024-09-13T02:53:57.812 INFO:tasks.workunit.client.0.smithi089.stdout:3/228: unlink d2/d8/f38 0 2024-09-13T02:53:57.813 INFO:tasks.workunit.client.0.smithi089.stdout:1/160: dread dc/f13 [0,4194304] 0 2024-09-13T02:53:57.813 INFO:tasks.workunit.client.0.smithi089.stdout:8/228: dwrite de/f22 [0,4194304] 0 2024-09-13T02:53:57.813 INFO:tasks.workunit.client.0.smithi089.stdout:8/229: write de/f12 [1602836,57377] 0 2024-09-13T02:53:57.813 INFO:tasks.workunit.client.0.smithi089.stdout:8/230: fsync de/d16/d1e/d20/f37 0 2024-09-13T02:53:57.814 INFO:tasks.workunit.client.0.smithi089.stdout:3/229: creat d2/f41 x:0 0 0 2024-09-13T02:53:57.821 INFO:tasks.workunit.client.0.smithi089.stdout:5/273: dwrite d1/d4/d2b/f50 [0,4194304] 0 2024-09-13T02:53:57.826 INFO:tasks.workunit.client.0.smithi089.stdout:5/274: rmdir d1/d4 39 2024-09-13T02:53:57.826 INFO:tasks.workunit.client.0.smithi089.stdout:5/275: write d1/d4/d2b/f2e [4200,59984] 0 2024-09-13T02:53:57.826 INFO:tasks.workunit.client.0.smithi089.stdout:5/276: write d1/d7/d1f/f39 [469060,24862] 0 2024-09-13T02:53:57.827 INFO:tasks.workunit.client.0.smithi089.stdout:8/231: write de/d16/d1e/f21 [3800358,79307] 0 2024-09-13T02:53:57.828 INFO:tasks.workunit.client.1.smithi131.stdout:9/310: dwrite d0/d3/d14/d1a/d2a/f4e [0,4194304] 0 2024-09-13T02:53:57.828 INFO:tasks.workunit.client.1.smithi131.stdout:9/311: chown d0/d3/d14/d17/d32/d39/f4a 11 1 2024-09-13T02:53:57.829 INFO:tasks.workunit.client.0.smithi089.stdout:3/230: write d2/d20/f25 [3776292,116471] 0 2024-09-13T02:53:57.832 INFO:tasks.workunit.client.0.smithi089.stdout:3/231: mknod d2/d20/d23/d27/c42 0 2024-09-13T02:53:57.832 INFO:tasks.workunit.client.0.smithi089.stdout:3/232: write d2/d20/f25 [1662009,36822] 0 2024-09-13T02:53:57.832 INFO:tasks.workunit.client.0.smithi089.stdout:3/233: stat d2/f14 0 2024-09-13T02:53:57.832 INFO:tasks.workunit.client.0.smithi089.stdout:3/234: write d2/d20/f25 [4666927,83262] 0 2024-09-13T02:53:57.833 INFO:tasks.workunit.client.0.smithi089.stdout:4/236: dwrite d2/da/f10 [4194304,4194304] 0 2024-09-13T02:53:57.836 INFO:tasks.workunit.client.0.smithi089.stdout:4/237: dread d2/d3/d5/f2e [0,4194304] 0 2024-09-13T02:53:57.836 INFO:tasks.workunit.client.0.smithi089.stdout:4/238: getdents d2/d2f 0 2024-09-13T02:53:57.836 INFO:tasks.workunit.client.0.smithi089.stdout:1/161: dwrite dc/f1e [0,4194304] 0 2024-09-13T02:53:57.837 INFO:tasks.workunit.client.0.smithi089.stdout:5/277: dread d1/d7/f18 [4194304,4194304] 0 2024-09-13T02:53:57.841 INFO:tasks.workunit.client.0.smithi089.stdout:3/235: rmdir d2/d20 39 2024-09-13T02:53:57.842 INFO:tasks.workunit.client.0.smithi089.stdout:4/239: symlink d2/d3/d5/d43/l47 0 2024-09-13T02:53:57.844 INFO:tasks.workunit.client.0.smithi089.stdout:3/236: truncate d2/d8/dc/f1b 3710064 0 2024-09-13T02:53:57.844 INFO:tasks.workunit.client.0.smithi089.stdout:3/237: write d2/d20/f39 [619480,83146] 0 2024-09-13T02:53:57.846 INFO:tasks.workunit.client.1.smithi131.stdout:9/312: dread d0/d3/d14/d1a/f1d [0,4194304] 0 2024-09-13T02:53:57.846 INFO:tasks.workunit.client.0.smithi089.stdout:4/240: unlink d2/d3/d5/d43/l47 0 2024-09-13T02:53:57.849 INFO:tasks.workunit.client.0.smithi089.stdout:4/241: truncate d2/d3/de/f16 3474493 0 2024-09-13T02:53:57.849 INFO:tasks.workunit.client.0.smithi089.stdout:4/242: readlink d2/d3/d5/d43/d3b/l46 0 2024-09-13T02:53:57.849 INFO:tasks.workunit.client.0.smithi089.stdout:8/232: dwrite de/d16/f3e [0,4194304] 0 2024-09-13T02:53:57.850 INFO:tasks.workunit.client.0.smithi089.stdout:5/278: write d1/f51 [862203,84060] 0 2024-09-13T02:53:57.850 INFO:tasks.workunit.client.0.smithi089.stdout:5/279: creat d1/d7/d1f/f61 x:0 0 0 2024-09-13T02:53:57.853 INFO:tasks.workunit.client.0.smithi089.stdout:4/243: symlink d2/d3/d5/d43/d3b/l48 0 2024-09-13T02:53:57.853 INFO:tasks.workunit.client.0.smithi089.stdout:4/244: chown d2 240686 1 2024-09-13T02:53:57.859 INFO:tasks.workunit.client.0.smithi089.stdout:8/233: mknod de/d16/d1e/d20/d39/c48 0 2024-09-13T02:53:57.859 INFO:tasks.workunit.client.0.smithi089.stdout:8/234: write de/d16/d1e/f31 [684112,114597] 0 2024-09-13T02:53:57.859 INFO:tasks.workunit.client.0.smithi089.stdout:8/235: truncate de/d16/f1f 1954910 0 2024-09-13T02:53:57.861 INFO:tasks.workunit.client.0.smithi089.stdout:4/245: dread d2/d3/de/f2d [0,4194304] 0 2024-09-13T02:53:57.861 INFO:tasks.workunit.client.0.smithi089.stdout:5/280: getdents d1/d4/d2b 0 2024-09-13T02:53:57.861 INFO:tasks.workunit.client.0.smithi089.stdout:5/281: write d1/d4/fc [5362804,110181] 0 2024-09-13T02:53:57.864 INFO:tasks.workunit.client.0.smithi089.stdout:5/282: dread d1/f55 [0,4194304] 0 2024-09-13T02:53:57.876 INFO:tasks.workunit.client.0.smithi089.stdout:4/246: write d2/da/f45 [2532218,47317] 0 2024-09-13T02:53:57.879 INFO:tasks.workunit.client.0.smithi089.stdout:4/247: write d2/d22/f35 [733357,23776] 0 2024-09-13T02:53:57.880 INFO:tasks.workunit.client.1.smithi131.stdout:9/313: dwrite d0/d3/d14/d1a/d2a/f4e [0,4194304] 0 2024-09-13T02:53:57.881 INFO:tasks.workunit.client.1.smithi131.stdout:9/314: chown d0/d3/d14/f34 69005 1 2024-09-13T02:53:57.886 INFO:tasks.workunit.client.0.smithi089.stdout:8/236: dwrite de/d16/d1e/f2a [0,4194304] 0 2024-09-13T02:53:57.886 INFO:tasks.workunit.client.0.smithi089.stdout:3/238: dwrite d2/d8/dc/f2c [0,4194304] 0 2024-09-13T02:53:57.887 INFO:tasks.workunit.client.0.smithi089.stdout:5/283: dwrite d1/d4/d1c/d49/f59 [0,4194304] 0 2024-09-13T02:53:57.887 INFO:tasks.workunit.client.0.smithi089.stdout:5/284: readlink d1/d4/d2b/l4e 0 2024-09-13T02:53:57.888 INFO:tasks.workunit.client.0.smithi089.stdout:8/237: truncate de/d16/d1e/f30 4102611 0 2024-09-13T02:53:57.888 INFO:tasks.workunit.client.0.smithi089.stdout:8/238: dread - de/f18 zero size 2024-09-13T02:53:57.888 INFO:tasks.workunit.client.0.smithi089.stdout:8/239: fsync de/f1a 0 2024-09-13T02:53:57.888 INFO:tasks.workunit.client.0.smithi089.stdout:8/240: creat de/d16/d1e/d3f/f49 x:0 0 0 2024-09-13T02:53:57.888 INFO:tasks.workunit.client.0.smithi089.stdout:8/241: readlink de/l26 0 2024-09-13T02:53:57.888 INFO:tasks.workunit.client.0.smithi089.stdout:1/162: dwrite dc/f13 [0,4194304] 0 2024-09-13T02:53:57.889 INFO:tasks.workunit.client.0.smithi089.stdout:3/239: creat d2/f43 x:0 0 0 2024-09-13T02:53:57.889 INFO:tasks.workunit.client.0.smithi089.stdout:3/240: write d2/d20/d23/d2b/f3d [873999,27766] 0 2024-09-13T02:53:57.890 INFO:tasks.workunit.client.0.smithi089.stdout:0/181: sync 2024-09-13T02:53:57.890 INFO:tasks.workunit.client.0.smithi089.stdout:0/182: creat d2/f3a x:0 0 0 2024-09-13T02:53:57.890 INFO:tasks.workunit.client.0.smithi089.stdout:0/183: read d2/f14 [152435,56978] 0 2024-09-13T02:53:57.894 INFO:tasks.workunit.client.0.smithi089.stdout:8/242: mknod de/d16/d1e/d27/c4a 0 2024-09-13T02:53:57.894 INFO:tasks.workunit.client.0.smithi089.stdout:8/243: fsync de/d16/d1e/f21 0 2024-09-13T02:53:57.895 INFO:tasks.workunit.client.0.smithi089.stdout:4/248: write d2/d3/de/f2b [3444044,8099] 0 2024-09-13T02:53:57.895 INFO:tasks.workunit.client.0.smithi089.stdout:1/163: mkdir dc/d12/d2c 0 2024-09-13T02:53:57.896 INFO:tasks.workunit.client.0.smithi089.stdout:0/184: symlink d2/d19/l3b 0 2024-09-13T02:53:57.897 INFO:tasks.workunit.client.0.smithi089.stdout:3/241: dread d2/d8/f21 [0,4194304] 0 2024-09-13T02:53:57.898 INFO:tasks.workunit.client.0.smithi089.stdout:1/164: truncate dc/f17 8283650 0 2024-09-13T02:53:57.899 INFO:tasks.workunit.client.0.smithi089.stdout:3/242: mkdir d2/d20/d44 0 2024-09-13T02:53:57.900 INFO:tasks.workunit.client.0.smithi089.stdout:5/285: write d1/d4/fc [1363186,88642] 0 2024-09-13T02:53:57.901 INFO:tasks.workunit.client.0.smithi089.stdout:5/286: write d1/d7/f27 [605266,13919] 0 2024-09-13T02:53:57.901 INFO:tasks.workunit.client.1.smithi131.stdout:9/315: dwrite d0/d3/d14/d17/f31 [0,4194304] 0 2024-09-13T02:53:57.901 INFO:tasks.workunit.client.1.smithi131.stdout:9/316: chown d0/d3/d14/d17/d32/d39/f4a 1658 1 2024-09-13T02:53:57.902 INFO:tasks.workunit.client.0.smithi089.stdout:4/249: rename d2/d2f to d2/d3/d5/d49 0 2024-09-13T02:53:57.903 INFO:tasks.workunit.client.1.smithi131.stdout:9/317: mknod d0/d3/d14/c60 0 2024-09-13T02:53:57.903 INFO:tasks.workunit.client.1.smithi131.stdout:9/318: readlink d0/d3/d14/d17/l2b 0 2024-09-13T02:53:57.903 INFO:tasks.workunit.client.1.smithi131.stdout:9/319: stat d0 0 2024-09-13T02:53:57.903 INFO:tasks.workunit.client.1.smithi131.stdout:9/320: chown d0/d3/d14/d1a/f30 150 1 2024-09-13T02:53:57.903 INFO:tasks.workunit.client.1.smithi131.stdout:9/321: chown d0/d4d 149533058 1 2024-09-13T02:53:57.904 INFO:tasks.workunit.client.0.smithi089.stdout:1/165: mknod dc/d12/c2d 0 2024-09-13T02:53:57.904 INFO:tasks.workunit.client.0.smithi089.stdout:1/166: stat dc/d12/c2d 0 2024-09-13T02:53:57.905 INFO:tasks.workunit.client.0.smithi089.stdout:4/250: mkdir d2/da/d4a 0 2024-09-13T02:53:57.906 INFO:tasks.workunit.client.1.smithi131.stdout:9/322: rename d0/f25 to d0/d4d/d55/f61 0 2024-09-13T02:53:57.906 INFO:tasks.workunit.client.0.smithi089.stdout:4/251: dread d2/f1f [0,4194304] 0 2024-09-13T02:53:57.907 INFO:tasks.workunit.client.0.smithi089.stdout:1/167: creat dc/d12/d2c/f2e x:0 0 0 2024-09-13T02:53:57.909 INFO:tasks.workunit.client.0.smithi089.stdout:4/252: creat d2/f4b x:0 0 0 2024-09-13T02:53:57.909 INFO:tasks.workunit.client.0.smithi089.stdout:4/253: dread - d2/d22/f34 zero size 2024-09-13T02:53:57.910 INFO:tasks.workunit.client.0.smithi089.stdout:1/168: symlink dc/d12/d2c/l2f 0 2024-09-13T02:53:57.911 INFO:tasks.workunit.client.0.smithi089.stdout:5/287: dread d1/d7/f30 [0,4194304] 0 2024-09-13T02:53:57.912 INFO:tasks.workunit.client.0.smithi089.stdout:1/169: creat dc/f30 x:0 0 0 2024-09-13T02:53:57.912 INFO:tasks.workunit.client.0.smithi089.stdout:1/170: fdatasync dc/f30 0 2024-09-13T02:53:57.912 INFO:tasks.workunit.client.0.smithi089.stdout:1/171: write f7 [4536596,59154] 0 2024-09-13T02:53:57.913 INFO:tasks.workunit.client.0.smithi089.stdout:5/288: getdents d1/d4/d1c 0 2024-09-13T02:53:57.916 INFO:tasks.workunit.client.0.smithi089.stdout:5/289: mkdir d1/d7/d1f/d62 0 2024-09-13T02:53:57.916 INFO:tasks.workunit.client.0.smithi089.stdout:5/290: readlink d1/d4/l44 0 2024-09-13T02:53:57.916 INFO:tasks.workunit.client.0.smithi089.stdout:5/291: write d1/d4/f3a [40302,103770] 0 2024-09-13T02:53:57.919 INFO:tasks.workunit.client.0.smithi089.stdout:3/243: dwrite d2/d20/d23/d2b/f3d [0,4194304] 0 2024-09-13T02:53:57.920 INFO:tasks.workunit.client.1.smithi131.stdout:9/323: write d0/f9 [951469,94585] 0 2024-09-13T02:53:57.921 INFO:tasks.workunit.client.1.smithi131.stdout:9/324: truncate d0/f11 3108344 0 2024-09-13T02:53:57.922 INFO:tasks.workunit.client.1.smithi131.stdout:9/325: creat d0/d3/d14/d1a/d2a/f62 x:0 0 0 2024-09-13T02:53:57.924 INFO:tasks.workunit.client.0.smithi089.stdout:1/172: rmdir dc/d12/d2c 39 2024-09-13T02:53:57.924 INFO:tasks.workunit.client.0.smithi089.stdout:8/244: dread de/d16/d1e/f30 [0,4194304] 0 2024-09-13T02:53:57.924 INFO:tasks.workunit.client.0.smithi089.stdout:8/245: truncate de/d16/f1b 957099 0 2024-09-13T02:53:57.925 INFO:tasks.workunit.client.1.smithi131.stdout:9/326: unlink d0/d3/d14/d17/d32/f57 0 2024-09-13T02:53:57.926 INFO:tasks.workunit.client.0.smithi089.stdout:1/173: mknod dc/d12/d2c/c31 0 2024-09-13T02:53:57.927 INFO:tasks.workunit.client.0.smithi089.stdout:1/174: write dc/f1c [330155,51944] 0 2024-09-13T02:53:57.929 INFO:tasks.workunit.client.0.smithi089.stdout:8/246: rename de/f17 to de/d16/d1e/d3f/f4b 0 2024-09-13T02:53:57.929 INFO:tasks.workunit.client.0.smithi089.stdout:8/247: readlink de/d16/d1e/d27/l2c 0 2024-09-13T02:53:57.931 INFO:tasks.workunit.client.0.smithi089.stdout:3/244: read d2/d20/d23/d2b/f2f [3353464,71826] 0 2024-09-13T02:53:57.932 INFO:tasks.workunit.client.0.smithi089.stdout:3/245: creat d2/d20/d23/d32/f45 x:0 0 0 2024-09-13T02:53:57.935 INFO:tasks.workunit.client.0.smithi089.stdout:4/254: dwrite d2/d22/f26 [0,4194304] 0 2024-09-13T02:53:57.936 INFO:tasks.workunit.client.0.smithi089.stdout:4/255: creat d2/f4c x:0 0 0 2024-09-13T02:53:57.936 INFO:tasks.workunit.client.0.smithi089.stdout:4/256: truncate d2/f4b 644562 0 2024-09-13T02:53:57.936 INFO:tasks.workunit.client.0.smithi089.stdout:4/257: readlink d2/l19 0 2024-09-13T02:53:57.938 INFO:tasks.workunit.client.0.smithi089.stdout:0/185: dwrite d2/f13 [0,4194304] 0 2024-09-13T02:53:57.939 INFO:tasks.workunit.client.0.smithi089.stdout:5/292: dwrite d1/d4/d1c/d49/f5d [0,4194304] 0 2024-09-13T02:53:57.940 INFO:tasks.workunit.client.0.smithi089.stdout:4/258: mknod d2/d3/c4d 0 2024-09-13T02:53:57.941 INFO:tasks.workunit.client.0.smithi089.stdout:1/175: dread dc/f1c [0,4194304] 0 2024-09-13T02:53:57.946 INFO:tasks.workunit.client.1.smithi131.stdout:9/327: dread d0/f9 [0,4194304] 0 2024-09-13T02:53:57.946 INFO:tasks.workunit.client.1.smithi131.stdout:9/328: write d0/d3/f5b [703520,16017] 0 2024-09-13T02:53:57.946 INFO:tasks.workunit.client.1.smithi131.stdout:9/329: fdatasync d0/d3/d14/d1a/f30 0 2024-09-13T02:53:57.946 INFO:tasks.workunit.client.0.smithi089.stdout:8/248: write de/f14 [2384702,102273] 0 2024-09-13T02:53:57.947 INFO:tasks.workunit.client.0.smithi089.stdout:4/259: write d2/d22/f26 [897571,128105] 0 2024-09-13T02:53:57.947 INFO:tasks.workunit.client.1.smithi131.stdout:9/330: creat d0/f63 x:0 0 0 2024-09-13T02:53:57.947 INFO:tasks.workunit.client.1.smithi131.stdout:9/331: creat d0/d3/d14/d17/d32/d39/f64 x:0 0 0 2024-09-13T02:53:57.948 INFO:tasks.workunit.client.0.smithi089.stdout:4/260: dread d2/f1f [0,4194304] 0 2024-09-13T02:53:57.948 INFO:tasks.workunit.client.0.smithi089.stdout:4/261: fdatasync d2/f1f 0 2024-09-13T02:53:57.949 INFO:tasks.workunit.client.1.smithi131.stdout:9/332: rename d0/d4d/f5c to d0/d3/d14/d1a/d2a/f65 0 2024-09-13T02:53:57.955 INFO:tasks.workunit.client.0.smithi089.stdout:0/186: write d2/d19/f2d [665387,20914] 0 2024-09-13T02:53:57.956 INFO:tasks.workunit.client.0.smithi089.stdout:0/187: chown d2/f17 1 1 2024-09-13T02:53:57.956 INFO:tasks.workunit.client.0.smithi089.stdout:0/188: write d2/d19/f1c [96072,57109] 0 2024-09-13T02:53:57.956 INFO:tasks.workunit.client.0.smithi089.stdout:0/189: fdatasync d2/f29 0 2024-09-13T02:53:57.956 INFO:tasks.workunit.client.0.smithi089.stdout:1/176: creat dc/d24/f32 x:0 0 0 2024-09-13T02:53:57.957 INFO:tasks.workunit.client.0.smithi089.stdout:4/262: symlink d2/d3/l4e 0 2024-09-13T02:53:57.958 INFO:tasks.workunit.client.0.smithi089.stdout:0/190: creat d2/d19/d1a/f3c x:0 0 0 2024-09-13T02:53:57.959 INFO:tasks.workunit.client.0.smithi089.stdout:1/177: mknod dc/d24/c33 0 2024-09-13T02:53:57.962 INFO:tasks.workunit.client.0.smithi089.stdout:5/293: dwrite d1/d7/d1f/d4d/f58 [0,4194304] 0 2024-09-13T02:53:57.964 INFO:tasks.workunit.client.0.smithi089.stdout:8/249: read f9 [472687,116767] 0 2024-09-13T02:53:57.967 INFO:tasks.workunit.client.0.smithi089.stdout:5/294: link d1/d4/d1c/l22 d1/d7/d1f/l63 0 2024-09-13T02:53:57.967 INFO:tasks.workunit.client.0.smithi089.stdout:5/295: fsync d1/d4/d2b/f52 0 2024-09-13T02:53:57.971 INFO:tasks.workunit.client.0.smithi089.stdout:8/250: creat de/d16/d1e/d27/d35/f4c x:0 0 0 2024-09-13T02:53:57.971 INFO:tasks.workunit.client.0.smithi089.stdout:8/251: write de/d16/d1e/d3f/f4b [2915252,24408] 0 2024-09-13T02:53:57.978 INFO:tasks.workunit.client.0.smithi089.stdout:8/252: unlink l6 0 2024-09-13T02:53:57.978 INFO:tasks.workunit.client.0.smithi089.stdout:6/196: sync 2024-09-13T02:53:57.978 INFO:tasks.workunit.client.0.smithi089.stdout:2/224: sync 2024-09-13T02:53:57.978 INFO:tasks.workunit.client.0.smithi089.stdout:9/215: sync 2024-09-13T02:53:57.979 INFO:tasks.workunit.client.0.smithi089.stdout:7/286: sync 2024-09-13T02:53:57.983 INFO:tasks.workunit.client.0.smithi089.stdout:7/287: truncate f0 1702649 0 2024-09-13T02:53:57.984 INFO:tasks.workunit.client.0.smithi089.stdout:9/216: link d3/d6/df/d24/l2b d3/d6/l47 0 2024-09-13T02:53:57.985 INFO:tasks.workunit.client.0.smithi089.stdout:2/225: symlink d13/d30/d4e/l4f 0 2024-09-13T02:53:57.988 INFO:tasks.workunit.client.1.smithi131.stdout:9/333: dwrite d0/f9 [0,4194304] 0 2024-09-13T02:53:57.988 INFO:tasks.workunit.client.0.smithi089.stdout:9/217: creat d3/d6/df/d24/f48 x:0 0 0 2024-09-13T02:53:57.989 INFO:tasks.workunit.client.0.smithi089.stdout:9/218: write d3/d15/f17 [3658362,68533] 0 2024-09-13T02:53:57.989 INFO:tasks.workunit.client.0.smithi089.stdout:2/226: rename d13/d30/f23 to d13/f50 0 2024-09-13T02:53:57.990 INFO:tasks.workunit.client.0.smithi089.stdout:2/227: read d13/d30/f39 [1654361,23680] 0 2024-09-13T02:53:57.991 INFO:tasks.workunit.client.0.smithi089.stdout:8/253: dread de/f12 [0,4194304] 0 2024-09-13T02:53:57.992 INFO:tasks.workunit.client.0.smithi089.stdout:9/219: rename d3/f34 to d3/d15/f49 0 2024-09-13T02:53:57.993 INFO:tasks.workunit.client.0.smithi089.stdout:1/178: dwrite dc/fe [0,4194304] 0 2024-09-13T02:53:57.997 INFO:tasks.workunit.client.0.smithi089.stdout:2/228: dread d13/d30/f2b [0,4194304] 0 2024-09-13T02:53:57.997 INFO:tasks.workunit.client.0.smithi089.stdout:2/229: fsync d13/f44 0 2024-09-13T02:53:57.997 INFO:tasks.workunit.client.0.smithi089.stdout:8/254: rename de/d16/d1e/f32 to de/f4d 0 2024-09-13T02:53:57.997 INFO:tasks.workunit.client.0.smithi089.stdout:9/220: creat d3/d6/df/d24/d32/f4a x:0 0 0 2024-09-13T02:53:58.000 INFO:tasks.workunit.client.0.smithi089.stdout:0/191: dwrite d2/f26 [0,4194304] 0 2024-09-13T02:53:58.000 INFO:tasks.workunit.client.0.smithi089.stdout:0/192: stat d2/f21 0 2024-09-13T02:53:58.000 INFO:tasks.workunit.client.0.smithi089.stdout:0/193: truncate d2/f34 248549 0 2024-09-13T02:53:58.000 INFO:tasks.workunit.client.0.smithi089.stdout:0/194: dread - d2/d19/d1a/d1e/f27 zero size 2024-09-13T02:53:58.000 INFO:tasks.workunit.client.0.smithi089.stdout:2/230: link d13/d30/f22 d13/d30/d4e/f51 0 2024-09-13T02:53:58.003 INFO:tasks.workunit.client.0.smithi089.stdout:8/255: unlink de/d16/d1e/d20/f36 0 2024-09-13T02:53:58.005 INFO:tasks.workunit.client.0.smithi089.stdout:9/221: mkdir d3/d6/d2a/d4b 0 2024-09-13T02:53:58.007 INFO:tasks.workunit.client.0.smithi089.stdout:1/179: rmdir dc/d12 39 2024-09-13T02:53:58.010 INFO:tasks.workunit.client.0.smithi089.stdout:0/195: mkdir d2/d19/d1a/d3d 0 2024-09-13T02:53:58.010 INFO:tasks.workunit.client.0.smithi089.stdout:0/196: chown d2/d19/l33 3 1 2024-09-13T02:53:58.010 INFO:tasks.workunit.client.0.smithi089.stdout:0/197: creat d2/d19/d1a/f3e x:0 0 0 2024-09-13T02:53:58.011 INFO:tasks.workunit.client.0.smithi089.stdout:2/231: link l9 d13/d30/l52 0 2024-09-13T02:53:58.011 INFO:tasks.workunit.client.0.smithi089.stdout:2/232: fdatasync d13/f18 0 2024-09-13T02:53:58.013 INFO:tasks.workunit.client.0.smithi089.stdout:9/222: rename d3/d6/df/d24/d2e to d3/d4c 0 2024-09-13T02:53:58.015 INFO:tasks.workunit.client.0.smithi089.stdout:9/223: rmdir d3/d15 39 2024-09-13T02:53:58.016 INFO:tasks.workunit.client.1.smithi131.stdout:9/334: dwrite d0/d3/d14/d17/f21 [0,4194304] 0 2024-09-13T02:53:58.017 INFO:tasks.workunit.client.0.smithi089.stdout:7/288: dwrite d3/d19/f36 [4194304,4194304] 0 2024-09-13T02:53:58.017 INFO:tasks.workunit.client.0.smithi089.stdout:7/289: creat d3/d19/d2e/f60 x:0 0 0 2024-09-13T02:53:58.017 INFO:tasks.workunit.client.0.smithi089.stdout:9/224: mknod d3/d6/d2a/c4d 0 2024-09-13T02:53:58.018 INFO:tasks.workunit.client.1.smithi131.stdout:9/335: truncate d0/d3/d14/d1a/d2a/f4f 3927645 0 2024-09-13T02:53:58.018 INFO:tasks.workunit.client.1.smithi131.stdout:9/336: truncate d0/f33 1429691 0 2024-09-13T02:53:58.019 INFO:tasks.workunit.client.0.smithi089.stdout:1/180: rename dc/d24 to dc/d12/d2c/d34 0 2024-09-13T02:53:58.019 INFO:tasks.workunit.client.0.smithi089.stdout:1/181: dread - dc/d12/d2c/d34/f32 zero size 2024-09-13T02:53:58.020 INFO:tasks.workunit.client.1.smithi131.stdout:9/337: getdents d0/d3/d14/d1a 0 2024-09-13T02:53:58.021 INFO:tasks.workunit.client.1.smithi131.stdout:9/338: mkdir d0/d3/d14/d17/d66 0 2024-09-13T02:53:58.022 INFO:tasks.workunit.client.1.smithi131.stdout:9/339: mkdir d0/d3/d14/d67 0 2024-09-13T02:53:58.025 INFO:tasks.workunit.client.0.smithi089.stdout:7/290: mknod d3/d19/d2e/d37/c61 0 2024-09-13T02:53:58.026 INFO:tasks.workunit.client.0.smithi089.stdout:7/291: fsync d3/d19/d2d/f5a 0 2024-09-13T02:53:58.027 INFO:tasks.workunit.client.0.smithi089.stdout:2/233: dwrite d13/f50 [0,4194304] 0 2024-09-13T02:53:58.027 INFO:tasks.workunit.client.0.smithi089.stdout:2/234: dread - d13/f2d zero size 2024-09-13T02:53:58.027 INFO:tasks.workunit.client.0.smithi089.stdout:2/235: write d13/d30/f47 [139083,37044] 0 2024-09-13T02:53:58.028 INFO:tasks.workunit.client.0.smithi089.stdout:2/236: readlink d13/d30/l46 0 2024-09-13T02:53:58.028 INFO:tasks.workunit.client.0.smithi089.stdout:2/237: read - d13/d30/f37 zero size 2024-09-13T02:53:58.030 INFO:tasks.workunit.client.0.smithi089.stdout:9/225: rename d3/d6/l47 to d3/l4e 0 2024-09-13T02:53:58.030 INFO:tasks.workunit.client.0.smithi089.stdout:7/292: rename d3 to d3/d19/d2e/d37/d62 22 2024-09-13T02:53:58.030 INFO:tasks.workunit.client.0.smithi089.stdout:1/182: getdents dc/d12 0 2024-09-13T02:53:58.030 INFO:tasks.workunit.client.0.smithi089.stdout:9/226: creat d3/d6/d2a/f4f x:0 0 0 2024-09-13T02:53:58.036 INFO:tasks.workunit.client.0.smithi089.stdout:7/293: dread d3/f1b [0,4194304] 0 2024-09-13T02:53:58.039 INFO:tasks.workunit.client.0.smithi089.stdout:1/183: dread dc/f1a [0,4194304] 0 2024-09-13T02:53:58.039 INFO:tasks.workunit.client.0.smithi089.stdout:1/184: mknod dc/c35 0 2024-09-13T02:53:58.040 INFO:tasks.workunit.client.0.smithi089.stdout:1/185: mkdir dc/d12/d2c/d36 0 2024-09-13T02:53:58.046 INFO:tasks.workunit.client.0.smithi089.stdout:2/238: dwrite f3 [0,4194304] 0 2024-09-13T02:53:58.062 INFO:tasks.workunit.client.0.smithi089.stdout:2/239: dwrite f5 [4194304,4194304] 0 2024-09-13T02:53:58.116 INFO:tasks.workunit.client.0.smithi089.stdout:6/197: dwrite db/d10/d27/d28/d2f/f33 [0,4194304] 0 2024-09-13T02:53:58.117 INFO:tasks.workunit.client.1.smithi131.stdout:9/340: write d0/f11 [3112011,35470] 0 2024-09-13T02:53:58.117 INFO:tasks.workunit.client.1.smithi131.stdout:9/341: chown d0/d3/d14/d1a/c26 879 1 2024-09-13T02:53:58.125 INFO:tasks.workunit.client.1.smithi131.stdout:9/342: dread d0/d3/d14/d17/f21 [4194304,4194304] 0 2024-09-13T02:53:58.125 INFO:tasks.workunit.client.1.smithi131.stdout:9/343: creat d0/d4d/f68 x:0 0 0 2024-09-13T02:53:58.127 INFO:tasks.workunit.client.0.smithi089.stdout:1/186: dwrite dc/f21 [0,4194304] 0 2024-09-13T02:53:58.128 INFO:tasks.workunit.client.1.smithi131.stdout:9/344: creat d0/d3/d14/d3c/f69 x:0 0 0 2024-09-13T02:53:58.128 INFO:tasks.workunit.client.1.smithi131.stdout:9/345: creat d0/d3/d14/d17/d32/f6a x:0 0 0 2024-09-13T02:53:58.129 INFO:tasks.workunit.client.1.smithi131.stdout:9/346: fsync d0/d3/d14/d17/f21 0 2024-09-13T02:53:58.130 INFO:tasks.workunit.client.0.smithi089.stdout:7/294: dread d3/d19/f22 [0,4194304] 0 2024-09-13T02:53:58.130 INFO:tasks.workunit.client.0.smithi089.stdout:7/295: readlink d3/d44/l2c 0 2024-09-13T02:53:58.134 INFO:tasks.workunit.client.0.smithi089.stdout:7/296: unlink d3/d19/l25 0 2024-09-13T02:53:58.135 INFO:tasks.workunit.client.0.smithi089.stdout:1/187: rmdir dc 39 2024-09-13T02:53:58.136 INFO:tasks.workunit.client.0.smithi089.stdout:7/297: mkdir d3/d19/d2d/d63 0 2024-09-13T02:53:58.137 INFO:tasks.workunit.client.0.smithi089.stdout:7/298: read d3/d19/d2d/f4a [184338,51984] 0 2024-09-13T02:53:58.137 INFO:tasks.workunit.client.0.smithi089.stdout:7/299: dread - d3/d19/d2d/f5a zero size 2024-09-13T02:53:58.137 INFO:tasks.workunit.client.0.smithi089.stdout:7/300: write d3/d19/f4d [463085,26783] 0 2024-09-13T02:53:58.137 INFO:tasks.workunit.client.0.smithi089.stdout:1/188: mknod dc/d12/d2c/d34/c37 0 2024-09-13T02:53:58.137 INFO:tasks.workunit.client.0.smithi089.stdout:1/189: getdents dc/d12/d2c/d36 0 2024-09-13T02:53:58.137 INFO:tasks.workunit.client.0.smithi089.stdout:1/190: chown dc/f21 14 1 2024-09-13T02:53:58.138 INFO:tasks.workunit.client.0.smithi089.stdout:6/198: dwrite db/d10/d3a/f36 [4194304,4194304] 0 2024-09-13T02:53:58.139 INFO:tasks.workunit.client.0.smithi089.stdout:7/301: unlink d3/c16 0 2024-09-13T02:53:58.139 INFO:tasks.workunit.client.0.smithi089.stdout:7/302: chown d3/d44/f43 2691280 1 2024-09-13T02:53:58.143 INFO:tasks.workunit.client.0.smithi089.stdout:6/199: mkdir db/d10/d27/d28/d46 0 2024-09-13T02:53:58.143 INFO:tasks.workunit.client.0.smithi089.stdout:3/246: sync 2024-09-13T02:53:58.146 INFO:tasks.workunit.client.0.smithi089.stdout:3/247: unlink d2/d20/d23/d32/f45 0 2024-09-13T02:53:58.147 INFO:tasks.workunit.client.0.smithi089.stdout:3/248: symlink d2/d20/l46 0 2024-09-13T02:53:58.165 INFO:tasks.workunit.client.0.smithi089.stdout:1/191: dwrite dc/fe [0,4194304] 0 2024-09-13T02:53:58.171 INFO:tasks.workunit.client.0.smithi089.stdout:6/200: dwrite db/d10/f1e [0,4194304] 0 2024-09-13T02:53:58.189 INFO:tasks.workunit.client.0.smithi089.stdout:6/201: dwrite db/d10/f1f [0,4194304] 0 2024-09-13T02:53:58.624 INFO:tasks.workunit.client.0.smithi089.stdout:3/249: symlink d2/d8/dc/l47 0 2024-09-13T02:53:58.625 INFO:tasks.workunit.client.0.smithi089.stdout:1/192: truncate dc/f17 203780 0 2024-09-13T02:53:58.627 INFO:tasks.workunit.client.0.smithi089.stdout:6/202: creat db/d10/d3a/f47 x:0 0 0 2024-09-13T02:53:58.628 INFO:tasks.workunit.client.0.smithi089.stdout:6/203: fdatasync db/d10/d3a/f47 0 2024-09-13T02:53:58.631 INFO:tasks.workunit.client.0.smithi089.stdout:6/204: rename db/d10/c25 to db/d10/c48 0 2024-09-13T02:53:58.633 INFO:tasks.workunit.client.0.smithi089.stdout:6/205: dread f3 [0,4194304] 0 2024-09-13T02:53:58.647 INFO:tasks.workunit.client.0.smithi089.stdout:4/263: sync 2024-09-13T02:53:58.647 INFO:tasks.workunit.client.0.smithi089.stdout:5/296: sync 2024-09-13T02:53:58.647 INFO:tasks.workunit.client.0.smithi089.stdout:4/264: stat d2/da/d4a 0 2024-09-13T02:53:58.648 INFO:tasks.workunit.client.0.smithi089.stdout:9/227: sync 2024-09-13T02:53:58.648 INFO:tasks.workunit.client.0.smithi089.stdout:7/303: sync 2024-09-13T02:53:58.648 INFO:tasks.workunit.client.0.smithi089.stdout:2/240: sync 2024-09-13T02:53:58.648 INFO:tasks.workunit.client.0.smithi089.stdout:0/198: sync 2024-09-13T02:53:58.648 INFO:tasks.workunit.client.0.smithi089.stdout:0/199: chown d2/f6 181 1 2024-09-13T02:53:58.648 INFO:tasks.workunit.client.0.smithi089.stdout:8/256: sync 2024-09-13T02:53:58.648 INFO:tasks.workunit.client.0.smithi089.stdout:8/257: dread - de/d16/d1e/d3f/f42 zero size 2024-09-13T02:53:58.648 INFO:tasks.workunit.client.0.smithi089.stdout:8/258: creat de/d16/d1e/f4e x:0 0 0 2024-09-13T02:53:58.649 INFO:tasks.workunit.client.0.smithi089.stdout:3/250: dwrite d2/d8/dc/f2c [0,4194304] 0 2024-09-13T02:53:58.649 INFO:tasks.workunit.client.0.smithi089.stdout:3/251: write d2/d8/f36 [684831,6031] 0 2024-09-13T02:53:58.649 INFO:tasks.workunit.client.0.smithi089.stdout:3/252: read - d2/f2d zero size 2024-09-13T02:53:58.649 INFO:tasks.workunit.client.0.smithi089.stdout:5/297: getdents d1/d4 0 2024-09-13T02:53:58.649 INFO:tasks.workunit.client.0.smithi089.stdout:5/298: chown d1/d4/d1c/d49/f5b 1833423 1 2024-09-13T02:53:58.650 INFO:tasks.workunit.client.0.smithi089.stdout:4/265: rename d2/da/d4a to d2/d22/d4f 0 2024-09-13T02:53:58.651 INFO:tasks.workunit.client.0.smithi089.stdout:7/304: symlink d3/d47/l64 0 2024-09-13T02:53:58.654 INFO:tasks.workunit.client.0.smithi089.stdout:8/259: creat de/d16/d1e/d20/f4f x:0 0 0 2024-09-13T02:53:58.654 INFO:tasks.workunit.client.0.smithi089.stdout:8/260: chown de/d16/d1e/d20/f4f 58526 1 2024-09-13T02:53:58.655 INFO:tasks.workunit.client.0.smithi089.stdout:5/299: symlink d1/d7/d1f/d62/l64 0 2024-09-13T02:53:58.655 INFO:tasks.workunit.client.0.smithi089.stdout:5/300: fdatasync d1/d4/d45/f4a 0 2024-09-13T02:53:58.656 INFO:tasks.workunit.client.0.smithi089.stdout:9/228: rename d3/d6/df/l1a to d3/d6/df/d24/d32/l50 0 2024-09-13T02:53:58.657 INFO:tasks.workunit.client.0.smithi089.stdout:7/305: write d3/d19/f36 [9103208,43134] 0 2024-09-13T02:53:58.658 INFO:tasks.workunit.client.0.smithi089.stdout:2/241: rmdir d13 39 2024-09-13T02:53:58.660 INFO:tasks.workunit.client.0.smithi089.stdout:1/193: dwrite dc/d12/f26 [0,4194304] 0 2024-09-13T02:53:58.660 INFO:tasks.workunit.client.0.smithi089.stdout:8/261: mknod de/d16/d1e/d27/c50 0 2024-09-13T02:53:58.660 INFO:tasks.workunit.client.0.smithi089.stdout:6/206: dwrite db/f26 [0,4194304] 0 2024-09-13T02:53:58.660 INFO:tasks.workunit.client.0.smithi089.stdout:6/207: creat db/f49 x:0 0 0 2024-09-13T02:53:58.662 INFO:tasks.workunit.client.0.smithi089.stdout:9/229: symlink d3/d6/df/d24/d32/l51 0 2024-09-13T02:53:58.663 INFO:tasks.workunit.client.0.smithi089.stdout:4/266: rmdir d2/d22 39 2024-09-13T02:53:58.666 INFO:tasks.workunit.client.0.smithi089.stdout:2/242: rename l6 to d13/d30/l53 0 2024-09-13T02:53:58.667 INFO:tasks.workunit.client.0.smithi089.stdout:3/253: dwrite d2/d20/d23/d2b/f3d [0,4194304] 0 2024-09-13T02:53:58.668 INFO:tasks.workunit.client.0.smithi089.stdout:3/254: stat d2/d20/d23/d27/c42 0 2024-09-13T02:53:58.668 INFO:tasks.workunit.client.0.smithi089.stdout:1/194: creat dc/d12/d2c/d36/f38 x:0 0 0 2024-09-13T02:53:58.670 INFO:tasks.workunit.client.0.smithi089.stdout:8/262: mknod de/d16/d1e/d27/d35/c51 0 2024-09-13T02:53:58.670 INFO:tasks.workunit.client.0.smithi089.stdout:5/301: getdents d1/d7/d1f/d62 0 2024-09-13T02:53:58.675 INFO:tasks.workunit.client.0.smithi089.stdout:6/208: stat db/d10/c39 0 2024-09-13T02:53:58.677 INFO:tasks.workunit.client.0.smithi089.stdout:6/209: dread db/d10/f24 [0,4194304] 0 2024-09-13T02:53:58.680 INFO:tasks.workunit.client.0.smithi089.stdout:9/230: unlink d3/d6/df/f12 0 2024-09-13T02:53:58.681 INFO:tasks.workunit.client.0.smithi089.stdout:7/306: mkdir d3/d19/d2d/d63/d65 0 2024-09-13T02:53:58.683 INFO:tasks.workunit.client.0.smithi089.stdout:4/267: rename d2/da/f10 to d2/d3/d5/d43/f50 0 2024-09-13T02:53:58.683 INFO:tasks.workunit.client.0.smithi089.stdout:4/268: chown d2/da/c14 22435507 1 2024-09-13T02:53:58.684 INFO:tasks.workunit.client.0.smithi089.stdout:2/243: creat d13/f54 x:0 0 0 2024-09-13T02:53:58.686 INFO:tasks.workunit.client.0.smithi089.stdout:6/210: link db/d10/l32 db/d10/d3a/l4a 0 2024-09-13T02:53:58.687 INFO:tasks.workunit.client.0.smithi089.stdout:6/211: chown l2 23058187 1 2024-09-13T02:53:58.687 INFO:tasks.workunit.client.0.smithi089.stdout:6/212: write db/f19 [2497841,119152] 0 2024-09-13T02:53:58.688 INFO:tasks.workunit.client.0.smithi089.stdout:9/231: unlink d3/ca 0 2024-09-13T02:53:58.688 INFO:tasks.workunit.client.0.smithi089.stdout:9/232: chown d3/l1d 250315 1 2024-09-13T02:53:58.689 INFO:tasks.workunit.client.0.smithi089.stdout:7/307: stat d3/d19/d2e/d37/c61 0 2024-09-13T02:53:58.691 INFO:tasks.workunit.client.0.smithi089.stdout:2/244: rename l9 to d13/d30/l55 0 2024-09-13T02:53:58.693 INFO:tasks.workunit.client.0.smithi089.stdout:7/308: mkdir d3/d19/d2d/d63/d65/d66 0 2024-09-13T02:53:58.694 INFO:tasks.workunit.client.0.smithi089.stdout:7/309: dread d3/d19/f36 [8388608,4194304] 0 2024-09-13T02:53:58.699 INFO:tasks.workunit.client.0.smithi089.stdout:7/310: mkdir d3/d19/d67 0 2024-09-13T02:53:58.699 INFO:tasks.workunit.client.0.smithi089.stdout:7/311: fsync d3/d20/f32 0 2024-09-13T02:53:58.699 INFO:tasks.workunit.client.0.smithi089.stdout:7/312: fsync d3/d19/d2d/f29 0 2024-09-13T02:53:58.710 INFO:tasks.workunit.client.0.smithi089.stdout:1/195: dwrite dc/d12/f15 [0,4194304] 0 2024-09-13T02:53:58.712 INFO:tasks.workunit.client.0.smithi089.stdout:1/196: creat dc/d12/d2c/d34/f39 x:0 0 0 2024-09-13T02:53:58.713 INFO:tasks.workunit.client.0.smithi089.stdout:1/197: read dc/f10 [200644,19477] 0 2024-09-13T02:53:58.713 INFO:tasks.workunit.client.0.smithi089.stdout:1/198: read - dc/d12/d2c/d36/f38 zero size 2024-09-13T02:53:58.713 INFO:tasks.workunit.client.0.smithi089.stdout:1/199: write dc/f22 [345650,76313] 0 2024-09-13T02:53:58.713 INFO:tasks.workunit.client.0.smithi089.stdout:7/313: write d3/f5 [2325740,129176] 0 2024-09-13T02:53:58.715 INFO:tasks.workunit.client.0.smithi089.stdout:1/200: mkdir dc/d3a 0 2024-09-13T02:53:58.715 INFO:tasks.workunit.client.0.smithi089.stdout:1/201: write dc/f10 [136041,97117] 0 2024-09-13T02:53:58.715 INFO:tasks.workunit.client.0.smithi089.stdout:1/202: creat dc/d12/d2c/d36/f3b x:0 0 0 2024-09-13T02:53:58.716 INFO:tasks.workunit.client.0.smithi089.stdout:7/314: mkdir d3/d19/d2e/d68 0 2024-09-13T02:53:58.716 INFO:tasks.workunit.client.0.smithi089.stdout:7/315: readlink d3/d19/d2d/d14/l26 0 2024-09-13T02:53:58.716 INFO:tasks.workunit.client.0.smithi089.stdout:7/316: write d3/d19/d2d/f4e [338587,46135] 0 2024-09-13T02:53:58.716 INFO:tasks.workunit.client.0.smithi089.stdout:7/317: write d3/d19/d2e/f4f [1745922,102586] 0 2024-09-13T02:53:58.717 INFO:tasks.workunit.client.0.smithi089.stdout:1/203: mknod dc/d12/d2c/d36/c3c 0 2024-09-13T02:53:58.720 INFO:tasks.workunit.client.0.smithi089.stdout:5/302: dwrite d1/d4/d2b/f50 [0,4194304] 0 2024-09-13T02:53:58.721 INFO:tasks.workunit.client.0.smithi089.stdout:5/303: chown d1/d7/l20 8 1 2024-09-13T02:53:58.721 INFO:tasks.workunit.client.0.smithi089.stdout:7/318: link d3/l59 d3/d19/l69 0 2024-09-13T02:53:58.723 INFO:tasks.workunit.client.0.smithi089.stdout:7/319: link d3/d19/d2d/d14/l40 d3/d47/l6a 0 2024-09-13T02:53:58.723 INFO:tasks.workunit.client.0.smithi089.stdout:7/320: write d3/d19/d2d/f1d [3509587,92135] 0 2024-09-13T02:53:58.725 INFO:tasks.workunit.client.0.smithi089.stdout:7/321: creat d3/d47/d55/f6b x:0 0 0 2024-09-13T02:53:58.726 INFO:tasks.workunit.client.0.smithi089.stdout:7/322: chown d3/d19/d2d/f4a 263625 1 2024-09-13T02:53:58.733 INFO:tasks.workunit.client.0.smithi089.stdout:9/233: dwrite d3/d15/f49 [0,4194304] 0 2024-09-13T02:53:58.734 INFO:tasks.workunit.client.0.smithi089.stdout:9/234: stat d3/d6/df/d24/d35/f45 0 2024-09-13T02:53:58.734 INFO:tasks.workunit.client.0.smithi089.stdout:4/269: dwrite d2/d3/de/f33 [4194304,4194304] 0 2024-09-13T02:53:58.736 INFO:tasks.workunit.client.0.smithi089.stdout:7/323: write d3/d19/d2d/d14/f1c [2374180,106659] 0 2024-09-13T02:53:58.736 INFO:tasks.workunit.client.0.smithi089.stdout:2/245: dwrite d13/f43 [0,4194304] 0 2024-09-13T02:53:58.738 INFO:tasks.workunit.client.0.smithi089.stdout:4/270: rename d2/da/l1a to d2/d3/d5/d43/l51 0 2024-09-13T02:53:58.738 INFO:tasks.workunit.client.0.smithi089.stdout:4/271: truncate d2/d3/d5/f2e 664875 0 2024-09-13T02:53:58.738 INFO:tasks.workunit.client.0.smithi089.stdout:4/272: fsync d2/da/f45 0 2024-09-13T02:53:58.739 INFO:tasks.workunit.client.0.smithi089.stdout:8/263: dwrite de/d16/d1e/d3f/f46 [0,4194304] 0 2024-09-13T02:53:58.742 INFO:tasks.workunit.client.0.smithi089.stdout:1/204: dwrite dc/f1a [0,4194304] 0 2024-09-13T02:53:58.742 INFO:tasks.workunit.client.0.smithi089.stdout:2/246: creat d13/d30/d4e/f56 x:0 0 0 2024-09-13T02:53:58.742 INFO:tasks.workunit.client.0.smithi089.stdout:2/247: chown d13/d30/f31 14250 1 2024-09-13T02:53:58.743 INFO:tasks.workunit.client.0.smithi089.stdout:2/248: chown d13/d30/f4b 980795 1 2024-09-13T02:53:58.744 INFO:tasks.workunit.client.0.smithi089.stdout:9/235: dread d3/d15/f49 [0,4194304] 0 2024-09-13T02:53:58.745 INFO:tasks.workunit.client.0.smithi089.stdout:8/264: mkdir de/d16/d1e/d27/d52 0 2024-09-13T02:53:58.746 INFO:tasks.workunit.client.0.smithi089.stdout:6/213: dread db/f19 [0,4194304] 0 2024-09-13T02:53:58.746 INFO:tasks.workunit.client.0.smithi089.stdout:6/214: chown db/d10/f24 68224 1 2024-09-13T02:53:58.748 INFO:tasks.workunit.client.0.smithi089.stdout:1/205: rename dc/d12/f20 to dc/d12/d2c/d36/f3d 0 2024-09-13T02:53:58.750 INFO:tasks.workunit.client.0.smithi089.stdout:2/249: mknod d13/c57 0 2024-09-13T02:53:58.750 INFO:tasks.workunit.client.0.smithi089.stdout:2/250: chown d13/c4c 7 1 2024-09-13T02:53:58.756 INFO:tasks.workunit.client.0.smithi089.stdout:2/251: unlink d13/d30/f2c 0 2024-09-13T02:53:58.764 INFO:tasks.workunit.client.0.smithi089.stdout:4/273: dwrite d2/f4b [0,4194304] 0 2024-09-13T02:53:58.764 INFO:tasks.workunit.client.1.smithi131.stdout:6/403: sync 2024-09-13T02:53:58.765 INFO:tasks.workunit.client.0.smithi089.stdout:9/236: write d3/f1f [543018,11797] 0 2024-09-13T02:53:58.766 INFO:tasks.workunit.client.0.smithi089.stdout:4/274: dread d2/d3/f25 [0,4194304] 0 2024-09-13T02:53:58.771 INFO:tasks.workunit.client.0.smithi089.stdout:4/275: link d2/d3/de/l20 d2/da/l52 0 2024-09-13T02:53:58.772 INFO:tasks.workunit.client.0.smithi089.stdout:5/304: dwrite d1/d4/f3a [0,4194304] 0 2024-09-13T02:53:58.773 INFO:tasks.workunit.client.0.smithi089.stdout:9/237: creat d3/d6/df/d24/d29/f52 x:0 0 0 2024-09-13T02:53:58.774 INFO:tasks.workunit.client.0.smithi089.stdout:4/276: link d2/d3/d5/f38 d2/f53 0 2024-09-13T02:53:58.777 INFO:tasks.workunit.client.1.smithi131.stdout:6/404: dread d1/f7 [0,4194304] 0 2024-09-13T02:53:58.777 INFO:tasks.workunit.client.1.smithi131.stdout:6/405: write d1/d8/f38 [116518,43731] 0 2024-09-13T02:53:58.778 INFO:tasks.workunit.client.0.smithi089.stdout:4/277: dread d2/d3/de/f36 [0,4194304] 0 2024-09-13T02:53:58.785 INFO:tasks.workunit.client.0.smithi089.stdout:8/265: dwrite de/d16/f1f [0,4194304] 0 2024-09-13T02:53:58.785 INFO:tasks.workunit.client.0.smithi089.stdout:5/305: write d1/d4/d45/f4a [208025,83757] 0 2024-09-13T02:53:58.788 INFO:tasks.workunit.client.0.smithi089.stdout:5/306: dread d1/d7/f30 [0,4194304] 0 2024-09-13T02:53:58.789 INFO:tasks.workunit.client.0.smithi089.stdout:6/215: dwrite db/d10/d27/d28/d2f/f33 [0,4194304] 0 2024-09-13T02:53:58.789 INFO:tasks.workunit.client.0.smithi089.stdout:6/216: read - db/d10/d27/f2c zero size 2024-09-13T02:53:58.790 INFO:tasks.workunit.client.0.smithi089.stdout:2/252: dwrite d13/f50 [4194304,4194304] 0 2024-09-13T02:53:58.790 INFO:tasks.workunit.client.0.smithi089.stdout:1/206: dwrite dc/d12/f26 [0,4194304] 0 2024-09-13T02:53:58.790 INFO:tasks.workunit.client.0.smithi089.stdout:1/207: chown dc/l14 255950912 1 2024-09-13T02:53:58.791 INFO:tasks.workunit.client.1.smithi131.stdout:6/406: dread d1/d8/d9/db/ff [0,4194304] 0 2024-09-13T02:53:58.791 INFO:tasks.workunit.client.0.smithi089.stdout:9/238: rename d3/d6/l39 to d3/d6/df/l53 0 2024-09-13T02:53:58.791 INFO:tasks.workunit.client.0.smithi089.stdout:4/278: write d2/f40 [972958,123555] 0 2024-09-13T02:53:58.793 INFO:tasks.workunit.client.1.smithi131.stdout:6/407: creat d1/d8/d9/db/d15/d26/d1c/d4e/f81 x:0 0 0 2024-09-13T02:53:58.794 INFO:tasks.workunit.client.1.smithi131.stdout:6/408: fsync d1/d8/d9/f6f 0 2024-09-13T02:53:58.794 INFO:tasks.workunit.client.1.smithi131.stdout:6/409: chown d1/d8/d9/f17 202 1 2024-09-13T02:53:58.794 INFO:tasks.workunit.client.1.smithi131.stdout:6/410: chown d1/f2b 591278 1 2024-09-13T02:53:58.794 INFO:tasks.workunit.client.1.smithi131.stdout:6/411: readlink d1/d8/d9/db/l32 0 2024-09-13T02:53:58.794 INFO:tasks.workunit.client.1.smithi131.stdout:6/412: truncate d1/d14/f5f 1006076 0 2024-09-13T02:53:58.794 INFO:tasks.workunit.client.1.smithi131.stdout:6/413: truncate d1/d8/f38 905379 0 2024-09-13T02:53:58.795 INFO:tasks.workunit.client.1.smithi131.stdout:6/414: rmdir d1/d14 39 2024-09-13T02:53:58.795 INFO:tasks.workunit.client.0.smithi089.stdout:8/266: mknod de/d16/d1e/d45/c53 0 2024-09-13T02:53:58.795 INFO:tasks.workunit.client.0.smithi089.stdout:5/307: rmdir d1/d4/d45 39 2024-09-13T02:53:58.795 INFO:tasks.workunit.client.0.smithi089.stdout:5/308: chown d1/d7/d1f 3637 1 2024-09-13T02:53:58.796 INFO:tasks.workunit.client.1.smithi131.stdout:6/415: symlink d1/d8/l82 0 2024-09-13T02:53:58.796 INFO:tasks.workunit.client.1.smithi131.stdout:6/416: chown d1/d8/d9/db/l6d 1382 1 2024-09-13T02:53:58.796 INFO:tasks.workunit.client.1.smithi131.stdout:6/417: symlink d1/d8/d9/db/d15/l83 0 2024-09-13T02:53:58.797 INFO:tasks.workunit.client.1.smithi131.stdout:6/418: creat d1/f84 x:0 0 0 2024-09-13T02:53:58.797 INFO:tasks.workunit.client.1.smithi131.stdout:6/419: dread - d1/d8/d9/db/d15/f3c zero size 2024-09-13T02:53:58.798 INFO:tasks.workunit.client.0.smithi089.stdout:2/253: mknod d13/d30/d4e/c58 0 2024-09-13T02:53:58.799 INFO:tasks.workunit.client.0.smithi089.stdout:4/279: dread d2/da/f13 [0,4194304] 0 2024-09-13T02:53:58.800 INFO:tasks.workunit.client.0.smithi089.stdout:1/208: mknod dc/d12/d2c/d34/c3e 0 2024-09-13T02:53:58.800 INFO:tasks.workunit.client.0.smithi089.stdout:0/200: sync 2024-09-13T02:53:58.801 INFO:tasks.workunit.client.0.smithi089.stdout:6/217: rename db/d10/c22 to db/d10/d27/d28/c4b 0 2024-09-13T02:53:58.802 INFO:tasks.workunit.client.0.smithi089.stdout:1/209: dread dc/f10 [0,4194304] 0 2024-09-13T02:53:58.803 INFO:tasks.workunit.client.0.smithi089.stdout:9/239: mkdir d3/d6/d2a/d4b/d54 0 2024-09-13T02:53:58.803 INFO:tasks.workunit.client.1.smithi131.stdout:6/420: rmdir d1 39 2024-09-13T02:53:58.803 INFO:tasks.workunit.client.1.smithi131.stdout:6/421: dread - d1/d8/f7a zero size 2024-09-13T02:53:58.803 INFO:tasks.workunit.client.1.smithi131.stdout:6/422: dread - d1/d8/f2c zero size 2024-09-13T02:53:58.803 INFO:tasks.workunit.client.1.smithi131.stdout:6/423: dread - d1/d8/f7f zero size 2024-09-13T02:53:58.805 INFO:tasks.workunit.client.1.smithi131.stdout:6/424: creat d1/d53/f85 x:0 0 0 2024-09-13T02:53:58.806 INFO:tasks.workunit.client.1.smithi131.stdout:6/425: mknod d1/d8/d9/db/d40/c86 0 2024-09-13T02:53:58.807 INFO:tasks.workunit.client.1.smithi131.stdout:6/426: dread - d1/d8/d9/db/d15/d26/d1c/d4e/f81 zero size 2024-09-13T02:53:58.807 INFO:tasks.workunit.client.0.smithi089.stdout:8/267: unlink de/d16/d1e/c28 0 2024-09-13T02:53:58.807 INFO:tasks.workunit.client.0.smithi089.stdout:8/268: creat de/d16/d1e/d3f/f54 x:0 0 0 2024-09-13T02:53:58.808 INFO:tasks.workunit.client.1.smithi131.stdout:6/427: truncate d1/d8/d9/db/d15/d26/f3a 3105623 0 2024-09-13T02:53:58.808 INFO:tasks.workunit.client.1.smithi131.stdout:6/428: read - d1/d53/f85 zero size 2024-09-13T02:53:58.808 INFO:tasks.workunit.client.1.smithi131.stdout:6/429: read d1/d8/d9/db/d2a/f33 [1049753,35261] 0 2024-09-13T02:53:58.809 INFO:tasks.workunit.client.0.smithi089.stdout:5/309: creat d1/d7/f65 x:0 0 0 2024-09-13T02:53:58.809 INFO:tasks.workunit.client.1.smithi131.stdout:6/430: symlink d1/d8/d9/db/d15/d26/d1c/d4e/l87 0 2024-09-13T02:53:58.809 INFO:tasks.workunit.client.0.smithi089.stdout:2/254: mkdir d13/d30/d59 0 2024-09-13T02:53:58.811 INFO:tasks.workunit.client.0.smithi089.stdout:4/280: creat d2/d3/d5/d43/d3b/f54 x:0 0 0 2024-09-13T02:53:58.813 INFO:tasks.workunit.client.0.smithi089.stdout:6/218: unlink db/d10/c17 0 2024-09-13T02:53:58.813 INFO:tasks.workunit.client.0.smithi089.stdout:6/219: stat c7 0 2024-09-13T02:53:58.813 INFO:tasks.workunit.client.0.smithi089.stdout:6/220: creat db/d10/d27/d28/d2f/f4c x:0 0 0 2024-09-13T02:53:58.814 INFO:tasks.workunit.client.0.smithi089.stdout:9/240: symlink d3/d6/d36/l55 0 2024-09-13T02:53:58.819 INFO:tasks.workunit.client.0.smithi089.stdout:1/210: dwrite dc/d12/d2c/d34/f39 [0,4194304] 0 2024-09-13T02:53:58.819 INFO:tasks.workunit.client.0.smithi089.stdout:8/269: creat de/d16/d1e/d45/f55 x:0 0 0 2024-09-13T02:53:58.819 INFO:tasks.workunit.client.0.smithi089.stdout:8/270: chown lc 16 1 2024-09-13T02:53:58.820 INFO:tasks.workunit.client.0.smithi089.stdout:5/310: rmdir d1/d7/d1f/d62 39 2024-09-13T02:53:58.824 INFO:tasks.workunit.client.0.smithi089.stdout:2/255: rename d13/d30/f4b to d13/d30/d59/f5a 0 2024-09-13T02:53:58.825 INFO:tasks.workunit.client.0.smithi089.stdout:4/281: mkdir d2/d55 0 2024-09-13T02:53:58.827 INFO:tasks.workunit.client.1.smithi131.stdout:6/431: write d1/d14/f20 [1169740,125309] 0 2024-09-13T02:53:58.827 INFO:tasks.workunit.client.0.smithi089.stdout:6/221: mknod db/c4d 0 2024-09-13T02:53:58.833 INFO:tasks.workunit.client.0.smithi089.stdout:8/271: unlink de/d16/d1e/d20/f4f 0 2024-09-13T02:53:58.836 INFO:tasks.workunit.client.0.smithi089.stdout:2/256: creat d13/d30/d59/f5b x:0 0 0 2024-09-13T02:53:58.836 INFO:tasks.workunit.client.0.smithi089.stdout:2/257: fdatasync d13/f50 0 2024-09-13T02:53:58.836 INFO:tasks.workunit.client.0.smithi089.stdout:4/282: creat d2/d22/d4f/f56 x:0 0 0 2024-09-13T02:53:58.837 INFO:tasks.workunit.client.0.smithi089.stdout:6/222: creat db/d10/d27/d28/d37/f4e x:0 0 0 2024-09-13T02:53:58.837 INFO:tasks.workunit.client.0.smithi089.stdout:6/223: creat db/d10/f4f x:0 0 0 2024-09-13T02:53:58.838 INFO:tasks.workunit.client.0.smithi089.stdout:9/241: mkdir d3/d6/df/d56 0 2024-09-13T02:53:58.841 INFO:tasks.workunit.client.0.smithi089.stdout:6/224: rename db/f19 to db/d10/d27/d28/d2f/f50 0 2024-09-13T02:53:58.841 INFO:tasks.workunit.client.0.smithi089.stdout:6/225: creat db/d10/d27/d28/d37/f51 x:0 0 0 2024-09-13T02:53:58.856 INFO:tasks.workunit.client.0.smithi089.stdout:5/311: dwrite d1/f55 [0,4194304] 0 2024-09-13T02:53:58.856 INFO:tasks.workunit.client.1.smithi131.stdout:6/432: dwrite d1/f55 [0,4194304] 0 2024-09-13T02:53:58.856 INFO:tasks.workunit.client.1.smithi131.stdout:6/433: dread - d1/d8/f2c zero size 2024-09-13T02:53:58.860 INFO:tasks.workunit.client.0.smithi089.stdout:5/312: symlink d1/d7/d1f/d4d/l66 0 2024-09-13T02:53:58.870 INFO:tasks.workunit.client.1.smithi131.stdout:6/434: dread d1/f2b [0,4194304] 0 2024-09-13T02:53:58.871 INFO:tasks.workunit.client.1.smithi131.stdout:6/435: truncate d1/d8/d9/db/d15/d26/d1c/d4e/f72 3596669 0 2024-09-13T02:53:58.873 INFO:tasks.workunit.client.1.smithi131.stdout:6/436: rename d1/d8/d9/db/d15/d26/d1c/f78 to d1/d8/d9/db/d2a/f88 0 2024-09-13T02:53:58.875 INFO:tasks.workunit.client.1.smithi131.stdout:6/437: rename d1/f44 to d1/d8/d9/db/d15/d26/f89 0 2024-09-13T02:53:58.875 INFO:tasks.workunit.client.1.smithi131.stdout:6/438: dread - d1/f6e zero size 2024-09-13T02:53:58.875 INFO:tasks.workunit.client.1.smithi131.stdout:6/439: creat d1/d53/f8a x:0 0 0 2024-09-13T02:53:58.876 INFO:tasks.workunit.client.1.smithi131.stdout:6/440: mknod d1/c8b 0 2024-09-13T02:53:58.876 INFO:tasks.workunit.client.1.smithi131.stdout:6/441: unlink d1/d8/d9/db/d2a/l65 0 2024-09-13T02:53:58.878 INFO:tasks.workunit.client.1.smithi131.stdout:6/442: rename d1/d8/d9/f19 to d1/d8/d9/db/d15/d26/d1c/d79/f8c 0 2024-09-13T02:53:58.879 INFO:tasks.workunit.client.1.smithi131.stdout:6/443: truncate d1/d8/d9/db/f36 764040 0 2024-09-13T02:53:58.879 INFO:tasks.workunit.client.1.smithi131.stdout:6/444: fsync d1/d8/d9/fd 0 2024-09-13T02:53:58.886 INFO:tasks.workunit.client.0.smithi089.stdout:2/258: dwrite d13/d30/f49 [0,4194304] 0 2024-09-13T02:53:58.888 INFO:tasks.workunit.client.0.smithi089.stdout:8/272: dwrite de/d16/d1e/d27/f3b [0,4194304] 0 2024-09-13T02:53:58.889 INFO:tasks.workunit.client.0.smithi089.stdout:5/313: dwrite d1/d4/d2b/f50 [4194304,4194304] 0 2024-09-13T02:53:58.890 INFO:tasks.workunit.client.0.smithi089.stdout:6/226: dwrite db/d10/f11 [0,4194304] 0 2024-09-13T02:53:58.890 INFO:tasks.workunit.client.0.smithi089.stdout:6/227: stat db/d10/d27/d28/d2f/c40 0 2024-09-13T02:53:58.890 INFO:tasks.workunit.client.0.smithi089.stdout:4/283: dwrite d2/d3/d5/d43/d3b/f54 [0,4194304] 0 2024-09-13T02:53:58.892 INFO:tasks.workunit.client.0.smithi089.stdout:8/273: rmdir de/d16/d1e/d45 39 2024-09-13T02:53:58.892 INFO:tasks.workunit.client.0.smithi089.stdout:8/274: fdatasync de/d16/d1e/d3f/f46 0 2024-09-13T02:53:58.900 INFO:tasks.workunit.client.0.smithi089.stdout:8/275: dread f9 [0,4194304] 0 2024-09-13T02:53:58.904 INFO:tasks.workunit.client.0.smithi089.stdout:6/228: unlink db/d10/d3a/f44 0 2024-09-13T02:53:58.907 INFO:tasks.workunit.client.0.smithi089.stdout:6/229: unlink db/d10/f24 0 2024-09-13T02:53:58.908 INFO:tasks.workunit.client.0.smithi089.stdout:4/284: symlink d2/d3/d5/l57 0 2024-09-13T02:53:58.908 INFO:tasks.workunit.client.0.smithi089.stdout:4/285: truncate d2/f4c 32913 0 2024-09-13T02:53:58.908 INFO:tasks.workunit.client.0.smithi089.stdout:4/286: dread - d2/d22/f34 zero size 2024-09-13T02:53:58.908 INFO:tasks.workunit.client.0.smithi089.stdout:4/287: dread - d2/d3/f41 zero size 2024-09-13T02:53:58.909 INFO:tasks.workunit.client.0.smithi089.stdout:8/276: write f0 [3788748,97705] 0 2024-09-13T02:53:58.910 INFO:tasks.workunit.client.0.smithi089.stdout:4/288: link d2/cb d2/d3/c58 0 2024-09-13T02:53:58.912 INFO:tasks.workunit.client.0.smithi089.stdout:8/277: mkdir de/d56 0 2024-09-13T02:53:58.918 INFO:tasks.workunit.client.1.smithi131.stdout:6/445: dwrite d1/d8/f38 [0,4194304] 0 2024-09-13T02:53:58.919 INFO:tasks.workunit.client.0.smithi089.stdout:5/314: dwrite d1/d7/f30 [0,4194304] 0 2024-09-13T02:53:58.920 INFO:tasks.workunit.client.0.smithi089.stdout:5/315: creat d1/d7/d1f/d4d/f67 x:0 0 0 2024-09-13T02:53:58.920 INFO:tasks.workunit.client.0.smithi089.stdout:3/255: sync 2024-09-13T02:53:58.920 INFO:tasks.workunit.client.0.smithi089.stdout:5/316: chown d1/d7/l40 1279580 1 2024-09-13T02:53:58.920 INFO:tasks.workunit.client.0.smithi089.stdout:2/259: dwrite d13/d30/f40 [0,4194304] 0 2024-09-13T02:53:58.920 INFO:tasks.workunit.client.0.smithi089.stdout:2/260: readlink d13/l3d 0 2024-09-13T02:53:58.922 INFO:tasks.workunit.client.1.smithi131.stdout:6/446: mkdir d1/d8/d9/d8d 0 2024-09-13T02:53:58.922 INFO:tasks.workunit.client.1.smithi131.stdout:6/447: getdents d1/d8/d9/db/d15/d26/d1c 0 2024-09-13T02:53:58.923 INFO:tasks.workunit.client.0.smithi089.stdout:3/256: creat d2/d8/f48 x:0 0 0 2024-09-13T02:53:58.923 INFO:tasks.workunit.client.0.smithi089.stdout:3/257: dread - d2/f43 zero size 2024-09-13T02:53:58.926 INFO:tasks.workunit.client.0.smithi089.stdout:6/230: write db/d10/d27/d28/d2f/f50 [36175,71358] 0 2024-09-13T02:53:58.937 INFO:tasks.workunit.client.0.smithi089.stdout:2/261: write d13/f3b [2983074,9211] 0 2024-09-13T02:53:58.937 INFO:tasks.workunit.client.0.smithi089.stdout:2/262: dread - d13/d30/f41 zero size 2024-09-13T02:53:58.939 INFO:tasks.workunit.client.0.smithi089.stdout:2/263: mkdir d13/d5c 0 2024-09-13T02:53:58.939 INFO:tasks.workunit.client.0.smithi089.stdout:2/264: creat d13/d30/d4e/f5d x:0 0 0 2024-09-13T02:53:58.939 INFO:tasks.workunit.client.0.smithi089.stdout:3/258: dread d2/d20/d23/d2b/f2f [0,4194304] 0 2024-09-13T02:53:58.943 INFO:tasks.workunit.client.0.smithi089.stdout:6/231: fsync db/d10/d27/d28/d2f/f50 0 2024-09-13T02:53:58.943 INFO:tasks.workunit.client.0.smithi089.stdout:4/289: dwrite d2/f4 [8388608,4194304] 0 2024-09-13T02:53:58.945 INFO:tasks.workunit.client.0.smithi089.stdout:6/232: truncate db/f12 916676 0 2024-09-13T02:53:58.945 INFO:tasks.workunit.client.0.smithi089.stdout:6/233: creat db/d10/d27/d28/d37/f52 x:0 0 0 2024-09-13T02:53:58.947 INFO:tasks.workunit.client.0.smithi089.stdout:8/278: dwrite de/d16/d1e/d20/f37 [0,4194304] 0 2024-09-13T02:53:58.948 INFO:tasks.workunit.client.0.smithi089.stdout:4/290: rmdir d2/d22/d4f 39 2024-09-13T02:53:58.948 INFO:tasks.workunit.client.0.smithi089.stdout:4/291: read - d2/da/f3d zero size 2024-09-13T02:53:58.948 INFO:tasks.workunit.client.0.smithi089.stdout:5/317: dwrite d1/d4/f14 [0,4194304] 0 2024-09-13T02:53:58.949 INFO:tasks.workunit.client.1.smithi131.stdout:6/448: dwrite d1/d8/d9/db/d2a/f88 [0,4194304] 0 2024-09-13T02:53:58.951 INFO:tasks.workunit.client.1.smithi131.stdout:6/449: mkdir d1/d8/d9/d4b/d8e 0 2024-09-13T02:53:58.952 INFO:tasks.workunit.client.0.smithi089.stdout:6/234: mkdir db/d10/d27/d28/d46/d53 0 2024-09-13T02:53:58.953 INFO:tasks.workunit.client.1.smithi131.stdout:6/450: creat d1/f8f x:0 0 0 2024-09-13T02:53:58.954 INFO:tasks.workunit.client.1.smithi131.stdout:6/451: link d1/d8/d9/db/d40/c86 d1/d8/d9/d4b/c90 0 2024-09-13T02:53:58.954 INFO:tasks.workunit.client.1.smithi131.stdout:6/452: chown d1/d8/d9/db/d15/d26/d1c/d4e/l87 442011 1 2024-09-13T02:53:58.955 INFO:tasks.workunit.client.1.smithi131.stdout:6/453: creat d1/d8/d9/db/d15/d26/f91 x:0 0 0 2024-09-13T02:53:58.955 INFO:tasks.workunit.client.1.smithi131.stdout:6/454: fdatasync d1/d8/f7a 0 2024-09-13T02:53:58.955 INFO:tasks.workunit.client.1.smithi131.stdout:6/455: write d1/f84 [1017679,63925] 0 2024-09-13T02:53:58.959 INFO:tasks.workunit.client.0.smithi089.stdout:6/235: rmdir db/d10/d27/d28/d46 39 2024-09-13T02:53:58.959 INFO:tasks.workunit.client.0.smithi089.stdout:6/236: chown l4 1031875 1 2024-09-13T02:53:58.959 INFO:tasks.workunit.client.0.smithi089.stdout:6/237: write f3 [1105538,28810] 0 2024-09-13T02:53:58.962 INFO:tasks.workunit.client.0.smithi089.stdout:5/318: getdents d1/d7 0 2024-09-13T02:53:58.964 INFO:tasks.workunit.client.0.smithi089.stdout:6/238: mkdir db/d10/d27/d54 0 2024-09-13T02:53:58.964 INFO:tasks.workunit.client.0.smithi089.stdout:6/239: readlink db/d10/d27/d28/l2a 0 2024-09-13T02:53:58.964 INFO:tasks.workunit.client.0.smithi089.stdout:6/240: dread - db/d10/f4f zero size 2024-09-13T02:53:58.965 INFO:tasks.workunit.client.0.smithi089.stdout:5/319: creat d1/d7/f68 x:0 0 0 2024-09-13T02:53:58.966 INFO:tasks.workunit.client.0.smithi089.stdout:6/241: creat db/d10/d27/f55 x:0 0 0 2024-09-13T02:53:58.966 INFO:tasks.workunit.client.0.smithi089.stdout:6/242: chown db/d10/d3a 26796 1 2024-09-13T02:53:58.966 INFO:tasks.workunit.client.0.smithi089.stdout:6/243: fdatasync db/d10/d3a/f36 0 2024-09-13T02:53:58.972 INFO:tasks.workunit.client.0.smithi089.stdout:4/292: dread d2/f4 [0,4194304] 0 2024-09-13T02:53:58.972 INFO:tasks.workunit.client.0.smithi089.stdout:4/293: fdatasync d2/d22/f35 0 2024-09-13T02:53:58.976 INFO:tasks.workunit.client.1.smithi131.stdout:6/456: dwrite d1/d8/f2c [0,4194304] 0 2024-09-13T02:53:58.977 INFO:tasks.workunit.client.0.smithi089.stdout:8/279: dwrite de/f12 [0,4194304] 0 2024-09-13T02:53:58.978 INFO:tasks.workunit.client.0.smithi089.stdout:7/324: sync 2024-09-13T02:53:58.978 INFO:tasks.workunit.client.0.smithi089.stdout:0/201: sync 2024-09-13T02:53:58.980 INFO:tasks.workunit.client.0.smithi089.stdout:0/202: symlink d2/l3f 0 2024-09-13T02:53:58.984 INFO:tasks.workunit.client.0.smithi089.stdout:0/203: truncate d2/f26 2315295 0 2024-09-13T02:53:58.986 INFO:tasks.workunit.client.0.smithi089.stdout:7/325: dread d3/d19/d2e/f4f [0,4194304] 0 2024-09-13T02:53:58.987 INFO:tasks.workunit.client.0.smithi089.stdout:0/204: mknod d2/d19/c40 0 2024-09-13T02:53:58.987 INFO:tasks.workunit.client.0.smithi089.stdout:0/205: write d2/d19/d1a/d1e/f27 [558925,60345] 0 2024-09-13T02:53:58.987 INFO:tasks.workunit.client.0.smithi089.stdout:0/206: write d2/d19/d1a/f3e [562571,17839] 0 2024-09-13T02:53:58.988 INFO:tasks.workunit.client.0.smithi089.stdout:7/326: stat d3/d19/d2d/d14/l40 0 2024-09-13T02:53:58.990 INFO:tasks.workunit.client.0.smithi089.stdout:0/207: symlink d2/d19/d1a/l41 0 2024-09-13T02:53:58.991 INFO:tasks.workunit.client.0.smithi089.stdout:0/208: mkdir d2/d19/d1a/d1e/d42 0 2024-09-13T02:53:58.993 INFO:tasks.workunit.client.0.smithi089.stdout:0/209: rename d2/d19/f36 to d2/d19/d1a/d1e/f43 0 2024-09-13T02:53:58.994 INFO:tasks.workunit.client.0.smithi089.stdout:0/210: dread - d2/d19/d1a/d1e/f31 zero size 2024-09-13T02:53:58.995 INFO:tasks.workunit.client.0.smithi089.stdout:0/211: truncate d2/f13 3988052 0 2024-09-13T02:53:58.995 INFO:tasks.workunit.client.0.smithi089.stdout:0/212: creat d2/d19/f44 x:0 0 0 2024-09-13T02:53:58.995 INFO:tasks.workunit.client.0.smithi089.stdout:0/213: fsync d2/d19/f22 0 2024-09-13T02:53:58.997 INFO:tasks.workunit.client.0.smithi089.stdout:0/214: creat d2/d19/d1a/d1e/d42/f45 x:0 0 0 2024-09-13T02:53:58.997 INFO:tasks.workunit.client.0.smithi089.stdout:0/215: creat d2/d19/d1a/d1e/d42/f46 x:0 0 0 2024-09-13T02:53:58.997 INFO:tasks.workunit.client.0.smithi089.stdout:0/216: creat d2/d19/d1a/d1e/d42/f47 x:0 0 0 2024-09-13T02:53:59.007 INFO:tasks.workunit.client.0.smithi089.stdout:6/244: dwrite db/d10/d27/d28/d2f/f33 [0,4194304] 0 2024-09-13T02:53:59.008 INFO:tasks.workunit.client.0.smithi089.stdout:4/294: dwrite d2/f4c [0,4194304] 0 2024-09-13T02:53:59.008 INFO:tasks.workunit.client.0.smithi089.stdout:4/295: chown d2/da/f44 84039 1 2024-09-13T02:53:59.010 INFO:tasks.workunit.client.1.smithi131.stdout:6/457: dwrite d1/d8/d9/db/d15/d26/d1c/d4e/f73 [0,4194304] 0 2024-09-13T02:53:59.010 INFO:tasks.workunit.client.0.smithi089.stdout:8/280: dwrite de/d16/d1e/f31 [0,4194304] 0 2024-09-13T02:53:59.010 INFO:tasks.workunit.client.0.smithi089.stdout:8/281: creat de/f57 x:0 0 0 2024-09-13T02:53:59.012 INFO:tasks.workunit.client.1.smithi131.stdout:6/458: mkdir d1/d8/d9/db/d15/d26/d1c/d79/d92 0 2024-09-13T02:53:59.013 INFO:tasks.workunit.client.0.smithi089.stdout:4/296: truncate d2/da/f13 2874378 0 2024-09-13T02:53:59.013 INFO:tasks.workunit.client.0.smithi089.stdout:4/297: write d2/f53 [957590,53559] 0 2024-09-13T02:53:59.013 INFO:tasks.workunit.client.1.smithi131.stdout:6/459: mkdir d1/d8/d9/db/d93 0 2024-09-13T02:53:59.015 INFO:tasks.workunit.client.1.smithi131.stdout:6/460: creat d1/d8/d9/d4b/f94 x:0 0 0 2024-09-13T02:53:59.017 INFO:tasks.workunit.client.1.smithi131.stdout:6/461: mknod d1/d8/d9/d4b/d8e/c95 0 2024-09-13T02:53:59.017 INFO:tasks.workunit.client.1.smithi131.stdout:6/462: chown d1/d8/d9/db/d15/d26/d1c/d4e/f77 3 1 2024-09-13T02:53:59.019 INFO:tasks.workunit.client.1.smithi131.stdout:6/463: write d1/d8/d9/db/f64 [132426,127281] 0 2024-09-13T02:53:59.019 INFO:tasks.workunit.client.0.smithi089.stdout:6/245: write db/f26 [1532950,86628] 0 2024-09-13T02:53:59.021 INFO:tasks.workunit.client.0.smithi089.stdout:8/282: dread - de/d16/d1e/d20/f2b zero size 2024-09-13T02:53:59.021 INFO:tasks.workunit.client.0.smithi089.stdout:8/283: truncate de/d16/d1e/f47 926122 0 2024-09-13T02:53:59.024 INFO:tasks.workunit.client.1.smithi131.stdout:6/464: truncate d1/d8/d9/db/d15/d26/d1c/d4e/f73 442327 0 2024-09-13T02:53:59.024 INFO:tasks.workunit.client.0.smithi089.stdout:4/298: dread d2/d3/d5/d43/d3b/f54 [0,4194304] 0 2024-09-13T02:53:59.024 INFO:tasks.workunit.client.0.smithi089.stdout:8/284: unlink de/d16/d1e/f2f 0 2024-09-13T02:53:59.026 INFO:tasks.workunit.client.1.smithi131.stdout:6/465: mknod d1/d8/c96 0 2024-09-13T02:53:59.026 INFO:tasks.workunit.client.1.smithi131.stdout:6/466: getdents d1/d8/d9/db/d15/d26/d1c/d79/d92 0 2024-09-13T02:53:59.026 INFO:tasks.workunit.client.1.smithi131.stdout:6/467: write d1/d8/d9/f1d [1702619,22343] 0 2024-09-13T02:53:59.026 INFO:tasks.workunit.client.0.smithi089.stdout:4/299: mknod d2/d3/d5/d49/c59 0 2024-09-13T02:53:59.026 INFO:tasks.workunit.client.0.smithi089.stdout:6/246: dread db/d10/f11 [0,4194304] 0 2024-09-13T02:53:59.027 INFO:tasks.workunit.client.1.smithi131.stdout:6/468: chown d1/d8/d9/db/d15/d26/c25 0 1 2024-09-13T02:53:59.028 INFO:tasks.workunit.client.0.smithi089.stdout:6/247: mknod db/d10/d3a/c56 0 2024-09-13T02:53:59.028 INFO:tasks.workunit.client.0.smithi089.stdout:6/248: dread - db/d10/d27/d28/d2f/f3c zero size 2024-09-13T02:53:59.029 INFO:tasks.workunit.client.0.smithi089.stdout:1/211: sync 2024-09-13T02:53:59.030 INFO:tasks.workunit.client.0.smithi089.stdout:9/242: sync 2024-09-13T02:53:59.030 INFO:tasks.workunit.client.0.smithi089.stdout:9/243: fsync d3/d6/fe 0 2024-09-13T02:53:59.030 INFO:tasks.workunit.client.0.smithi089.stdout:6/249: rmdir db/d43 39 2024-09-13T02:53:59.030 INFO:tasks.workunit.client.0.smithi089.stdout:6/250: fsync db/d10/d27/d28/d2f/f4c 0 2024-09-13T02:53:59.031 INFO:tasks.workunit.client.0.smithi089.stdout:0/217: read f1 [2734008,49223] 0 2024-09-13T02:53:59.032 INFO:tasks.workunit.client.0.smithi089.stdout:6/251: creat db/d10/d27/d28/f57 x:0 0 0 2024-09-13T02:53:59.032 INFO:tasks.workunit.client.0.smithi089.stdout:6/252: write db/d43/f3b [467888,65068] 0 2024-09-13T02:53:59.033 INFO:tasks.workunit.client.0.smithi089.stdout:8/285: dread de/f10 [0,4194304] 0 2024-09-13T02:53:59.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:53:58 smithi089 ceph-mon[27639]: pgmap v241: 65 pgs: 65 active+clean; 1.0 GiB data, 4.5 GiB used, 532 GiB / 536 GiB avail; 87 MiB/s rd, 122 MiB/s wr, 618 op/s 2024-09-13T02:53:59.036 INFO:tasks.workunit.client.0.smithi089.stdout:0/218: truncate d2/d19/d1a/d1e/f27 328817 0 2024-09-13T02:53:59.036 INFO:tasks.workunit.client.0.smithi089.stdout:4/300: dread d2/d3/d5/d43/d3b/f54 [0,4194304] 0 2024-09-13T02:53:59.036 INFO:tasks.workunit.client.0.smithi089.stdout:4/301: dread - d2/d22/d4f/f56 zero size 2024-09-13T02:53:59.038 INFO:tasks.workunit.client.0.smithi089.stdout:6/253: link db/f23 db/d10/f58 0 2024-09-13T02:53:59.039 INFO:tasks.workunit.client.0.smithi089.stdout:8/286: mknod de/c58 0 2024-09-13T02:53:59.040 INFO:tasks.workunit.client.1.smithi131.stdout:6/469: write d1/d8/d9/db/d15/d26/d1c/d79/f8c [1065398,93742] 0 2024-09-13T02:53:59.040 INFO:tasks.workunit.client.1.smithi131.stdout:6/470: dread - d1/d8/d9/db/f68 zero size 2024-09-13T02:53:59.041 INFO:tasks.workunit.client.0.smithi089.stdout:0/219: link d2/d19/f24 d2/f48 0 2024-09-13T02:53:59.042 INFO:tasks.workunit.client.0.smithi089.stdout:0/220: creat d2/d19/d1a/d1e/d42/f49 x:0 0 0 2024-09-13T02:53:59.042 INFO:tasks.workunit.client.0.smithi089.stdout:0/221: chown d2/d19/f39 1 1 2024-09-13T02:53:59.042 INFO:tasks.workunit.client.0.smithi089.stdout:0/222: write f1 [3719156,19059] 0 2024-09-13T02:53:59.042 INFO:tasks.workunit.client.0.smithi089.stdout:0/223: stat d2/d19/d1a/d1e/d42 0 2024-09-13T02:53:59.042 INFO:tasks.workunit.client.0.smithi089.stdout:0/224: creat d2/f4a x:0 0 0 2024-09-13T02:53:59.042 INFO:tasks.workunit.client.0.smithi089.stdout:1/212: write f3 [1287051,64731] 0 2024-09-13T02:53:59.042 INFO:tasks.workunit.client.0.smithi089.stdout:4/302: write d2/d22/f35 [1616868,66892] 0 2024-09-13T02:53:59.047 INFO:tasks.workunit.client.0.smithi089.stdout:1/213: creat dc/d12/f3f x:0 0 0 2024-09-13T02:53:59.047 INFO:tasks.workunit.client.0.smithi089.stdout:1/214: creat dc/d12/d2c/d36/f40 x:0 0 0 2024-09-13T02:53:59.049 INFO:tasks.workunit.client.0.smithi089.stdout:1/215: dread dc/f10 [0,4194304] 0 2024-09-13T02:53:59.050 INFO:tasks.workunit.client.0.smithi089.stdout:1/216: creat dc/d3a/f41 x:0 0 0 2024-09-13T02:53:59.053 INFO:tasks.workunit.client.0.smithi089.stdout:1/217: mkdir dc/d12/d42 0 2024-09-13T02:53:59.054 INFO:tasks.workunit.client.0.smithi089.stdout:0/225: write d2/f6 [1783309,22436] 0 2024-09-13T02:53:59.054 INFO:tasks.workunit.client.0.smithi089.stdout:9/244: dwrite d3/d6/df/d24/d29/f52 [0,4194304] 0 2024-09-13T02:53:59.055 INFO:tasks.workunit.client.0.smithi089.stdout:0/226: read d2/d19/d1a/f3e [383628,33982] 0 2024-09-13T02:53:59.055 INFO:tasks.workunit.client.0.smithi089.stdout:0/227: read - d2/f28 zero size 2024-09-13T02:53:59.055 INFO:tasks.workunit.client.0.smithi089.stdout:0/228: write d2/f18 [4755283,80632] 0 2024-09-13T02:53:59.056 INFO:tasks.workunit.client.0.smithi089.stdout:6/254: getdents db/d10 0 2024-09-13T02:53:59.057 INFO:tasks.workunit.client.0.smithi089.stdout:1/218: rename dc/d12/d42 to dc/d12/d2c/d34/d43 0 2024-09-13T02:53:59.062 INFO:tasks.workunit.client.0.smithi089.stdout:8/287: dwrite f0 [0,4194304] 0 2024-09-13T02:53:59.062 INFO:tasks.workunit.client.0.smithi089.stdout:8/288: write de/f40 [575232,18108] 0 2024-09-13T02:53:59.065 INFO:tasks.workunit.client.0.smithi089.stdout:0/229: write d2/f17 [39679,70185] 0 2024-09-13T02:53:59.066 INFO:tasks.workunit.client.0.smithi089.stdout:6/255: creat db/d10/f59 x:0 0 0 2024-09-13T02:53:59.067 INFO:tasks.workunit.client.0.smithi089.stdout:1/219: mkdir dc/d44 0 2024-09-13T02:53:59.069 INFO:tasks.workunit.client.0.smithi089.stdout:8/289: symlink de/l59 0 2024-09-13T02:53:59.069 INFO:tasks.workunit.client.0.smithi089.stdout:9/245: truncate d3/d6/df/f38 4193147 0 2024-09-13T02:53:59.073 INFO:tasks.workunit.client.0.smithi089.stdout:6/256: dread db/f12 [0,4194304] 0 2024-09-13T02:53:59.073 INFO:tasks.workunit.client.0.smithi089.stdout:1/220: creat dc/d44/f45 x:0 0 0 2024-09-13T02:53:59.073 INFO:tasks.workunit.client.0.smithi089.stdout:1/221: chown dc/c11 0 1 2024-09-13T02:53:59.077 INFO:tasks.workunit.client.0.smithi089.stdout:1/222: truncate dc/d12/f15 761284 0 2024-09-13T02:53:59.080 INFO:tasks.workunit.client.0.smithi089.stdout:0/230: dread d2/f6 [0,4194304] 0 2024-09-13T02:53:59.080 INFO:tasks.workunit.client.0.smithi089.stdout:0/231: fsync d2/f26 0 2024-09-13T02:53:59.081 INFO:tasks.workunit.client.0.smithi089.stdout:6/257: rmdir db/d10/d27/d28 39 2024-09-13T02:53:59.082 INFO:tasks.workunit.client.0.smithi089.stdout:1/223: mkdir dc/d46 0 2024-09-13T02:53:59.083 INFO:tasks.workunit.client.0.smithi089.stdout:0/232: mkdir d2/d19/d1a/d3d/d4b 0 2024-09-13T02:53:59.085 INFO:tasks.workunit.client.0.smithi089.stdout:6/258: link db/d10/d27/d28/d37/f51 db/d10/d27/d28/d46/d53/f5a 0 2024-09-13T02:53:59.086 INFO:tasks.workunit.client.0.smithi089.stdout:1/224: truncate dc/f22 370210 0 2024-09-13T02:53:59.086 INFO:tasks.workunit.client.0.smithi089.stdout:1/225: fsync dc/f13 0 2024-09-13T02:53:59.086 INFO:tasks.workunit.client.0.smithi089.stdout:1/226: write dc/d12/f3f [529777,28604] 0 2024-09-13T02:53:59.086 INFO:tasks.workunit.client.0.smithi089.stdout:1/227: stat dc/d12/d2c/d34/c33 0 2024-09-13T02:53:59.089 INFO:tasks.workunit.client.0.smithi089.stdout:6/259: mknod db/d10/d27/d28/c5b 0 2024-09-13T02:53:59.089 INFO:tasks.workunit.client.0.smithi089.stdout:6/260: chown db/d10/d27/l3e 29454665 1 2024-09-13T02:53:59.092 INFO:tasks.workunit.client.0.smithi089.stdout:1/228: dread f3 [0,4194304] 0 2024-09-13T02:53:59.092 INFO:tasks.workunit.client.0.smithi089.stdout:1/229: rename dc to dc/d12/d2c/d47 22 2024-09-13T02:53:59.097 INFO:tasks.workunit.client.0.smithi089.stdout:9/246: dwrite d3/d6/f14 [0,4194304] 0 2024-09-13T02:53:59.099 INFO:tasks.workunit.client.0.smithi089.stdout:8/290: dwrite de/f11 [0,4194304] 0 2024-09-13T02:53:59.100 INFO:tasks.workunit.client.0.smithi089.stdout:3/259: sync 2024-09-13T02:53:59.100 INFO:tasks.workunit.client.0.smithi089.stdout:3/260: fdatasync d2/d20/f25 0 2024-09-13T02:53:59.100 INFO:tasks.workunit.client.0.smithi089.stdout:2/265: sync 2024-09-13T02:53:59.102 INFO:tasks.workunit.client.0.smithi089.stdout:8/291: write de/d16/d1e/d20/f3d [1364854,52097] 0 2024-09-13T02:53:59.102 INFO:tasks.workunit.client.0.smithi089.stdout:8/292: stat de/d16/d1e/d27/c4a 0 2024-09-13T02:53:59.102 INFO:tasks.workunit.client.0.smithi089.stdout:8/293: read - de/d16/d1e/d3f/f54 zero size 2024-09-13T02:53:59.104 INFO:tasks.workunit.client.0.smithi089.stdout:0/233: rmdir d2 39 2024-09-13T02:53:59.104 INFO:tasks.workunit.client.0.smithi089.stdout:6/261: dread db/d10/d3a/f36 [0,4194304] 0 2024-09-13T02:53:59.104 INFO:tasks.workunit.client.0.smithi089.stdout:6/262: dread - db/d10/d27/d28/f57 zero size 2024-09-13T02:53:59.104 INFO:tasks.workunit.client.0.smithi089.stdout:6/263: chown l4 120 1 2024-09-13T02:53:59.104 INFO:tasks.workunit.client.0.smithi089.stdout:6/264: truncate db/d10/d27/d28/d37/f52 113365 0 2024-09-13T02:53:59.105 INFO:tasks.workunit.client.0.smithi089.stdout:9/247: symlink d3/d6/df/l57 0 2024-09-13T02:53:59.106 INFO:tasks.workunit.client.0.smithi089.stdout:3/261: mkdir d2/d20/d23/d32/d49 0 2024-09-13T02:53:59.106 INFO:tasks.workunit.client.0.smithi089.stdout:1/230: fsync dc/f22 0 2024-09-13T02:53:59.108 INFO:tasks.workunit.client.0.smithi089.stdout:2/266: symlink d13/d5c/l5e 0 2024-09-13T02:53:59.108 INFO:tasks.workunit.client.0.smithi089.stdout:2/267: write d13/d30/f31 [839276,94871] 0 2024-09-13T02:53:59.108 INFO:tasks.workunit.client.0.smithi089.stdout:2/268: truncate f12 4427993 0 2024-09-13T02:53:59.108 INFO:tasks.workunit.client.0.smithi089.stdout:2/269: readlink lf 0 2024-09-13T02:53:59.108 INFO:tasks.workunit.client.0.smithi089.stdout:2/270: write d13/f32 [5188244,11720] 0 2024-09-13T02:53:59.108 INFO:tasks.workunit.client.0.smithi089.stdout:2/271: stat d13/l3d 0 2024-09-13T02:53:59.112 INFO:tasks.workunit.client.0.smithi089.stdout:9/248: creat d3/f58 x:0 0 0 2024-09-13T02:53:59.113 INFO:tasks.workunit.client.0.smithi089.stdout:3/262: truncate d2/d20/f25 1722933 0 2024-09-13T02:53:59.113 INFO:tasks.workunit.client.0.smithi089.stdout:3/263: fdatasync d2/f41 0 2024-09-13T02:53:59.114 INFO:tasks.workunit.client.0.smithi089.stdout:3/264: symlink d2/d8/l4a 0 2024-09-13T02:53:59.116 INFO:tasks.workunit.client.0.smithi089.stdout:3/265: creat d2/d20/f4b x:0 0 0 2024-09-13T02:53:59.116 INFO:tasks.workunit.client.0.smithi089.stdout:3/266: truncate d2/d8/f48 934525 0 2024-09-13T02:53:59.118 INFO:tasks.workunit.client.0.smithi089.stdout:3/267: write d2/d8/f48 [871438,82569] 0 2024-09-13T02:53:59.118 INFO:tasks.workunit.client.0.smithi089.stdout:3/268: stat d2/d8/dc/l3e 0 2024-09-13T02:53:59.120 INFO:tasks.workunit.client.0.smithi089.stdout:3/269: link d2/l22 d2/d8/dc/d3c/l4c 0 2024-09-13T02:53:59.121 INFO:tasks.workunit.client.0.smithi089.stdout:2/272: dread f3 [0,4194304] 0 2024-09-13T02:53:59.122 INFO:tasks.workunit.client.0.smithi089.stdout:2/273: mkdir d13/d30/d59/d5f 0 2024-09-13T02:53:59.124 INFO:tasks.workunit.client.0.smithi089.stdout:2/274: mknod d13/d30/d59/c60 0 2024-09-13T02:53:59.128 INFO:tasks.workunit.client.0.smithi089.stdout:2/275: mkdir d13/d30/d61 0 2024-09-13T02:53:59.128 INFO:tasks.workunit.client.0.smithi089.stdout:9/249: dread d3/d6/fe [0,4194304] 0 2024-09-13T02:53:59.129 INFO:tasks.workunit.client.0.smithi089.stdout:3/270: dread d2/d20/d23/d2b/f37 [0,4194304] 0 2024-09-13T02:53:59.130 INFO:tasks.workunit.client.0.smithi089.stdout:9/250: creat d3/d6/d2a/d4b/f59 x:0 0 0 2024-09-13T02:53:59.131 INFO:tasks.workunit.client.0.smithi089.stdout:3/271: creat d2/d8/dc/d3c/f4d x:0 0 0 2024-09-13T02:53:59.134 INFO:tasks.workunit.client.0.smithi089.stdout:9/251: truncate d3/f1f 5834984 0 2024-09-13T02:53:59.134 INFO:tasks.workunit.client.0.smithi089.stdout:9/252: truncate d3/d15/f3f 409747 0 2024-09-13T02:53:59.134 INFO:tasks.workunit.client.0.smithi089.stdout:9/253: readlink d3/d6/df/l57 0 2024-09-13T02:53:59.134 INFO:tasks.workunit.client.0.smithi089.stdout:9/254: chown d3/d6/d2a/l43 43405696 1 2024-09-13T02:53:59.134 INFO:tasks.workunit.client.0.smithi089.stdout:9/255: write d3/d6/df/d24/d32/f4a [937230,109569] 0 2024-09-13T02:53:59.145 INFO:tasks.workunit.client.0.smithi089.stdout:2/276: dread d13/d30/f49 [0,4194304] 0 2024-09-13T02:53:59.151 INFO:tasks.workunit.client.0.smithi089.stdout:9/256: write d3/d6/df/f38 [1477612,49738] 0 2024-09-13T02:53:59.151 INFO:tasks.workunit.client.0.smithi089.stdout:6/265: dwrite db/d10/d27/d28/d2f/f3c [0,4194304] 0 2024-09-13T02:53:59.151 INFO:tasks.workunit.client.0.smithi089.stdout:6/266: chown db/f49 47557666 1 2024-09-13T02:53:59.151 INFO:tasks.workunit.client.0.smithi089.stdout:6/267: readlink db/d10/l1c 0 2024-09-13T02:53:59.154 INFO:tasks.workunit.client.0.smithi089.stdout:9/257: mkdir d3/d15/d5a 0 2024-09-13T02:53:59.156 INFO:tasks.workunit.client.0.smithi089.stdout:6/268: mknod db/c5c 0 2024-09-13T02:53:59.156 INFO:tasks.workunit.client.0.smithi089.stdout:6/269: creat db/d10/d3a/f5d x:0 0 0 2024-09-13T02:53:59.156 INFO:tasks.workunit.client.0.smithi089.stdout:6/270: creat db/d10/d3a/f5e x:0 0 0 2024-09-13T02:53:59.156 INFO:tasks.workunit.client.0.smithi089.stdout:3/272: dwrite d2/d8/dc/f2c [0,4194304] 0 2024-09-13T02:53:59.157 INFO:tasks.workunit.client.0.smithi089.stdout:3/273: truncate d2/d8/f21 4399374 0 2024-09-13T02:53:59.157 INFO:tasks.workunit.client.0.smithi089.stdout:3/274: chown d2/d8/dc/d3c/f4d 14 1 2024-09-13T02:53:59.157 INFO:tasks.workunit.client.0.smithi089.stdout:9/258: getdents d3/d6 0 2024-09-13T02:53:59.158 INFO:tasks.workunit.client.0.smithi089.stdout:1/231: dwrite f3 [4194304,4194304] 0 2024-09-13T02:53:59.158 INFO:tasks.workunit.client.0.smithi089.stdout:0/234: dwrite d2/f6 [0,4194304] 0 2024-09-13T02:53:59.159 INFO:tasks.workunit.client.0.smithi089.stdout:1/232: fdatasync dc/d12/d2c/d34/f39 0 2024-09-13T02:53:59.159 INFO:tasks.workunit.client.0.smithi089.stdout:1/233: chown dc/lf 50 1 2024-09-13T02:53:59.159 INFO:tasks.workunit.client.0.smithi089.stdout:1/234: read - dc/d3a/f41 zero size 2024-09-13T02:53:59.160 INFO:tasks.workunit.client.0.smithi089.stdout:8/294: dwrite f5 [0,4194304] 0 2024-09-13T02:53:59.161 INFO:tasks.workunit.client.0.smithi089.stdout:1/235: link dc/d12/c2d dc/c48 0 2024-09-13T02:53:59.164 INFO:tasks.workunit.client.0.smithi089.stdout:2/277: dwrite d13/f1a [0,4194304] 0 2024-09-13T02:53:59.165 INFO:tasks.workunit.client.0.smithi089.stdout:9/259: link d3/c1e d3/d6/df/c5b 0 2024-09-13T02:53:59.179 INFO:tasks.workunit.client.0.smithi089.stdout:1/236: truncate dc/f1e 221992 0 2024-09-13T02:53:59.179 INFO:tasks.workunit.client.0.smithi089.stdout:1/237: creat dc/d44/f49 x:0 0 0 2024-09-13T02:53:59.180 INFO:tasks.workunit.client.0.smithi089.stdout:6/271: dwrite db/d10/d3a/f47 [0,4194304] 0 2024-09-13T02:53:59.184 INFO:tasks.workunit.client.0.smithi089.stdout:8/295: dread de/d16/d1e/f47 [0,4194304] 0 2024-09-13T02:53:59.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:53:58 smithi131 ceph-mon[34689]: pgmap v241: 65 pgs: 65 active+clean; 1.0 GiB data, 4.5 GiB used, 532 GiB / 536 GiB avail; 87 MiB/s rd, 122 MiB/s wr, 618 op/s 2024-09-13T02:53:59.194 INFO:tasks.workunit.client.0.smithi089.stdout:2/278: creat d13/d30/f62 x:0 0 0 2024-09-13T02:53:59.196 INFO:tasks.workunit.client.0.smithi089.stdout:2/279: read d13/d30/f22 [50604,40279] 0 2024-09-13T02:53:59.205 INFO:tasks.workunit.client.0.smithi089.stdout:6/272: symlink db/d10/d27/d28/d2f/l5f 0 2024-09-13T02:53:59.206 INFO:tasks.workunit.client.0.smithi089.stdout:6/273: stat db/d10/d27/d28/d2f 0 2024-09-13T02:53:59.207 INFO:tasks.workunit.client.0.smithi089.stdout:2/280: link lf d13/d30/d4e/l63 0 2024-09-13T02:53:59.209 INFO:tasks.workunit.client.0.smithi089.stdout:0/235: dwrite d2/f48 [0,4194304] 0 2024-09-13T02:53:59.209 INFO:tasks.workunit.client.0.smithi089.stdout:9/260: dwrite d3/f5 [0,4194304] 0 2024-09-13T02:53:59.210 INFO:tasks.workunit.client.0.smithi089.stdout:8/296: dwrite f5 [4194304,4194304] 0 2024-09-13T02:53:59.210 INFO:tasks.workunit.client.0.smithi089.stdout:8/297: creat de/d16/d1e/d27/d35/f5a x:0 0 0 2024-09-13T02:53:59.211 INFO:tasks.workunit.client.0.smithi089.stdout:1/238: dwrite f7 [0,4194304] 0 2024-09-13T02:53:59.211 INFO:tasks.workunit.client.0.smithi089.stdout:1/239: chown dc/d12/d2c/d34 197658 1 2024-09-13T02:53:59.211 INFO:tasks.workunit.client.0.smithi089.stdout:1/240: creat dc/d44/f4a x:0 0 0 2024-09-13T02:53:59.211 INFO:tasks.workunit.client.0.smithi089.stdout:1/241: dread - dc/d12/d2c/d36/f3b zero size 2024-09-13T02:53:59.211 INFO:tasks.workunit.client.0.smithi089.stdout:1/242: creat dc/d12/f4b x:0 0 0 2024-09-13T02:53:59.212 INFO:tasks.workunit.client.0.smithi089.stdout:1/243: fsync dc/d12/f23 0 2024-09-13T02:53:59.212 INFO:tasks.workunit.client.0.smithi089.stdout:6/274: rename db/d10/d27/d54 to db/d43/d60 0 2024-09-13T02:53:59.212 INFO:tasks.workunit.client.0.smithi089.stdout:6/275: fdatasync f0 0 2024-09-13T02:53:59.212 INFO:tasks.workunit.client.0.smithi089.stdout:1/244: dread dc/f22 [0,4194304] 0 2024-09-13T02:53:59.213 INFO:tasks.workunit.client.0.smithi089.stdout:1/245: write dc/f22 [1195314,59392] 0 2024-09-13T02:53:59.213 INFO:tasks.workunit.client.0.smithi089.stdout:1/246: dread - dc/f30 zero size 2024-09-13T02:53:59.215 INFO:tasks.workunit.client.0.smithi089.stdout:0/236: creat d2/d19/d1a/d3d/d4b/f4c x:0 0 0 2024-09-13T02:53:59.218 INFO:tasks.workunit.client.0.smithi089.stdout:1/247: read dc/f17 [46995,60050] 0 2024-09-13T02:53:59.219 INFO:tasks.workunit.client.0.smithi089.stdout:9/261: truncate d3/d15/f17 2650426 0 2024-09-13T02:53:59.224 INFO:tasks.workunit.client.0.smithi089.stdout:5/320: sync 2024-09-13T02:53:59.224 INFO:tasks.workunit.client.0.smithi089.stdout:7/327: sync 2024-09-13T02:53:59.226 INFO:tasks.workunit.client.0.smithi089.stdout:6/276: dread db/d10/d3a/f47 [0,4194304] 0 2024-09-13T02:53:59.228 INFO:tasks.workunit.client.0.smithi089.stdout:8/298: mkdir de/d16/d1e/d3f/d5b 0 2024-09-13T02:53:59.234 INFO:tasks.workunit.client.0.smithi089.stdout:2/281: rename d13/d5c to d13/d30/d64 0 2024-09-13T02:53:59.235 INFO:tasks.workunit.client.0.smithi089.stdout:2/282: read d13/d30/f47 [99390,8782] 0 2024-09-13T02:53:59.238 INFO:tasks.workunit.client.0.smithi089.stdout:0/237: creat d2/d19/d1a/f4d x:0 0 0 2024-09-13T02:53:59.241 INFO:tasks.workunit.client.0.smithi089.stdout:7/328: mkdir d3/d19/d2d/d14/d6c 0 2024-09-13T02:53:59.242 INFO:tasks.workunit.client.0.smithi089.stdout:6/277: symlink db/d10/d27/d28/d46/d53/l61 0 2024-09-13T02:53:59.243 INFO:tasks.workunit.client.0.smithi089.stdout:8/299: symlink de/d16/d1e/d27/l5c 0 2024-09-13T02:53:59.244 INFO:tasks.workunit.client.0.smithi089.stdout:8/300: fsync de/d16/d1e/d3f/f4b 0 2024-09-13T02:53:59.249 INFO:tasks.workunit.client.0.smithi089.stdout:5/321: rename d1/d4/d1c/d49/f59 to d1/f69 0 2024-09-13T02:53:59.250 INFO:tasks.workunit.client.0.smithi089.stdout:5/322: write d1/f51 [4401564,99610] 0 2024-09-13T02:53:59.251 INFO:tasks.workunit.client.0.smithi089.stdout:4/303: sync 2024-09-13T02:53:59.251 INFO:tasks.workunit.client.0.smithi089.stdout:4/304: write d2/d3/de/f2b [2487843,122092] 0 2024-09-13T02:53:59.252 INFO:tasks.workunit.client.0.smithi089.stdout:7/329: symlink d3/d19/d2d/d14/d6c/l6d 0 2024-09-13T02:53:59.253 INFO:tasks.workunit.client.0.smithi089.stdout:6/278: creat db/d43/d60/f62 x:0 0 0 2024-09-13T02:53:59.255 INFO:tasks.workunit.client.0.smithi089.stdout:8/301: symlink de/d16/d1e/d3f/l5d 0 2024-09-13T02:53:59.258 INFO:tasks.workunit.client.0.smithi089.stdout:2/283: link d13/d30/f62 d13/d30/d4e/f65 0 2024-09-13T02:53:59.258 INFO:tasks.workunit.client.0.smithi089.stdout:2/284: fsync d13/d30/f48 0 2024-09-13T02:53:59.259 INFO:tasks.workunit.client.0.smithi089.stdout:7/330: stat d3/l24 0 2024-09-13T02:53:59.262 INFO:tasks.workunit.client.0.smithi089.stdout:6/279: getdents db/d10/d27/d28/d2f 0 2024-09-13T02:53:59.262 INFO:tasks.workunit.client.0.smithi089.stdout:0/238: dwrite d2/d19/d1a/d1e/d42/f45 [0,4194304] 0 2024-09-13T02:53:59.263 INFO:tasks.workunit.client.0.smithi089.stdout:8/302: link f9 de/f5e 0 2024-09-13T02:53:59.263 INFO:tasks.workunit.client.0.smithi089.stdout:8/303: fdatasync de/d16/d1e/d27/f3b 0 2024-09-13T02:53:59.264 INFO:tasks.workunit.client.0.smithi089.stdout:2/285: truncate fc 6298395 0 2024-09-13T02:53:59.265 INFO:tasks.workunit.client.0.smithi089.stdout:6/280: mknod db/d10/d3a/c63 0 2024-09-13T02:53:59.270 INFO:tasks.workunit.client.0.smithi089.stdout:0/239: rmdir d2 39 2024-09-13T02:53:59.346 INFO:tasks.workunit.client.0.smithi089.stdout:2/286: getdents d13/d30 0 2024-09-13T02:53:59.348 INFO:tasks.workunit.client.0.smithi089.stdout:2/287: mknod d13/d30/d61/c66 0 2024-09-13T02:53:59.348 INFO:tasks.workunit.client.0.smithi089.stdout:2/288: write d13/f17 [4302227,90506] 0 2024-09-13T02:53:59.348 INFO:tasks.workunit.client.0.smithi089.stdout:2/289: chown d13/d30/d59 10993 1 2024-09-13T02:53:59.348 INFO:tasks.workunit.client.0.smithi089.stdout:2/290: fsync d13/f1a 0 2024-09-13T02:53:59.350 INFO:tasks.workunit.client.0.smithi089.stdout:2/291: mknod d13/d30/d4e/c67 0 2024-09-13T02:53:59.353 INFO:tasks.workunit.client.0.smithi089.stdout:2/292: rename f12 to d13/d30/d61/f68 0 2024-09-13T02:53:59.354 INFO:tasks.workunit.client.0.smithi089.stdout:2/293: rmdir d13/d30/d64 39 2024-09-13T02:53:59.360 INFO:tasks.workunit.client.0.smithi089.stdout:2/294: write d13/f1a [26437,70805] 0 2024-09-13T02:53:59.362 INFO:tasks.workunit.client.0.smithi089.stdout:2/295: symlink d13/d30/d61/l69 0 2024-09-13T02:53:59.362 INFO:tasks.workunit.client.0.smithi089.stdout:2/296: readlink d13/d30/l4d 0 2024-09-13T02:53:59.368 INFO:tasks.workunit.client.0.smithi089.stdout:2/297: dread f3 [0,4194304] 0 2024-09-13T02:53:59.368 INFO:tasks.workunit.client.0.smithi089.stdout:2/298: creat d13/d30/d59/f6a x:0 0 0 2024-09-13T02:53:59.373 INFO:tasks.workunit.client.0.smithi089.stdout:2/299: write d13/d30/f49 [1095813,37028] 0 2024-09-13T02:53:59.373 INFO:tasks.workunit.client.0.smithi089.stdout:2/300: truncate d13/d30/f37 389507 0 2024-09-13T02:53:59.373 INFO:tasks.workunit.client.0.smithi089.stdout:2/301: chown d13/d30/f47 3091681 1 2024-09-13T02:53:59.373 INFO:tasks.workunit.client.0.smithi089.stdout:2/302: chown fd 915 1 2024-09-13T02:53:59.387 INFO:tasks.workunit.client.0.smithi089.stdout:9/262: dwrite d3/f5 [0,4194304] 0 2024-09-13T02:53:59.389 INFO:tasks.workunit.client.0.smithi089.stdout:9/263: truncate f2 910481 0 2024-09-13T02:53:59.391 INFO:tasks.workunit.client.0.smithi089.stdout:9/264: creat d3/d6/d36/f5c x:0 0 0 2024-09-13T02:53:59.393 INFO:tasks.workunit.client.0.smithi089.stdout:9/265: rename d3/d6/d36/l3b to d3/d6/l5d 0 2024-09-13T02:53:59.394 INFO:tasks.workunit.client.0.smithi089.stdout:9/266: chown d3/d6/d2a/l43 531015 1 2024-09-13T02:53:59.395 INFO:tasks.workunit.client.0.smithi089.stdout:9/267: truncate d3/d6/df/f38 3619711 0 2024-09-13T02:53:59.395 INFO:tasks.workunit.client.0.smithi089.stdout:9/268: readlink d3/d6/df/d24/d32/l51 0 2024-09-13T02:53:59.395 INFO:tasks.workunit.client.0.smithi089.stdout:6/281: dwrite db/d10/d3a/f5d [0,4194304] 0 2024-09-13T02:53:59.395 INFO:tasks.workunit.client.0.smithi089.stdout:6/282: chown db/d10/d3a/f47 439159 1 2024-09-13T02:53:59.395 INFO:tasks.workunit.client.0.smithi089.stdout:8/304: dwrite de/d16/d1e/d3f/f46 [0,4194304] 0 2024-09-13T02:53:59.399 INFO:tasks.workunit.client.0.smithi089.stdout:6/283: mknod db/d10/d27/d28/c64 0 2024-09-13T02:53:59.400 INFO:tasks.workunit.client.0.smithi089.stdout:6/284: write f0 [479481,87820] 0 2024-09-13T02:53:59.402 INFO:tasks.workunit.client.0.smithi089.stdout:9/269: dread d3/d15/f17 [0,4194304] 0 2024-09-13T02:53:59.403 INFO:tasks.workunit.client.0.smithi089.stdout:6/285: link db/d10/d27/d28/d2f/c40 db/d10/d3a/c65 0 2024-09-13T02:53:59.406 INFO:tasks.workunit.client.0.smithi089.stdout:6/286: link db/d10/d27/d28/d46/d53/l61 db/d10/d27/d28/d37/l66 0 2024-09-13T02:53:59.406 INFO:tasks.workunit.client.0.smithi089.stdout:6/287: write db/d10/d27/d28/d2f/f50 [67152,113205] 0 2024-09-13T02:53:59.409 INFO:tasks.workunit.client.0.smithi089.stdout:6/288: creat db/d43/f67 x:0 0 0 2024-09-13T02:53:59.411 INFO:tasks.workunit.client.0.smithi089.stdout:6/289: rename db/d10/f58 to db/d10/d27/f68 0 2024-09-13T02:53:59.411 INFO:tasks.workunit.client.0.smithi089.stdout:6/290: chown db/d43/f67 1582323224 1 2024-09-13T02:53:59.417 INFO:tasks.workunit.client.0.smithi089.stdout:9/270: dwrite d3/f58 [0,4194304] 0 2024-09-13T02:53:59.417 INFO:tasks.workunit.client.0.smithi089.stdout:8/305: dwrite de/f4d [0,4194304] 0 2024-09-13T02:53:59.417 INFO:tasks.workunit.client.0.smithi089.stdout:2/303: getdents d13/d30/d59 0 2024-09-13T02:53:59.422 INFO:tasks.workunit.client.0.smithi089.stdout:8/306: creat de/d16/d1e/d27/d52/f5f x:0 0 0 2024-09-13T02:53:59.424 INFO:tasks.workunit.client.0.smithi089.stdout:2/304: creat d13/d30/f6b x:0 0 0 2024-09-13T02:53:59.426 INFO:tasks.workunit.client.0.smithi089.stdout:9/271: symlink d3/d6/df/l5e 0 2024-09-13T02:53:59.426 INFO:tasks.workunit.client.0.smithi089.stdout:9/272: fdatasync d3/f5 0 2024-09-13T02:53:59.427 INFO:tasks.workunit.client.0.smithi089.stdout:8/307: mknod de/c60 0 2024-09-13T02:53:59.429 INFO:tasks.workunit.client.0.smithi089.stdout:2/305: link lf d13/l6c 0 2024-09-13T02:53:59.429 INFO:tasks.workunit.client.0.smithi089.stdout:2/306: fdatasync d13/d30/f4a 0 2024-09-13T02:53:59.429 INFO:tasks.workunit.client.0.smithi089.stdout:9/273: stat d3/d6/df/c5b 0 2024-09-13T02:53:59.431 INFO:tasks.workunit.client.0.smithi089.stdout:8/308: mkdir de/d16/d1e/d27/d52/d61 0 2024-09-13T02:53:59.432 INFO:tasks.workunit.client.0.smithi089.stdout:3/275: sync 2024-09-13T02:53:59.433 INFO:tasks.workunit.client.0.smithi089.stdout:9/274: unlink d3/d6/df/d24/c27 0 2024-09-13T02:53:59.433 INFO:tasks.workunit.client.0.smithi089.stdout:9/275: readlink d3/d6/d36/l55 0 2024-09-13T02:53:59.433 INFO:tasks.workunit.client.0.smithi089.stdout:9/276: fsync d3/f22 0 2024-09-13T02:53:59.434 INFO:tasks.workunit.client.0.smithi089.stdout:8/309: symlink de/d16/d1e/d45/l62 0 2024-09-13T02:53:59.436 INFO:tasks.workunit.client.0.smithi089.stdout:3/276: creat d2/d20/d23/d27/f4e x:0 0 0 2024-09-13T02:53:59.439 INFO:tasks.workunit.client.0.smithi089.stdout:3/277: symlink d2/d20/d44/l4f 0 2024-09-13T02:53:59.444 INFO:tasks.workunit.client.0.smithi089.stdout:2/307: dwrite d13/d30/f62 [0,4194304] 0 2024-09-13T02:53:59.447 INFO:tasks.workunit.client.0.smithi089.stdout:2/308: symlink d13/d30/d59/d5f/l6d 0 2024-09-13T02:53:59.449 INFO:tasks.workunit.client.0.smithi089.stdout:2/309: creat d13/d30/d64/f6e x:0 0 0 2024-09-13T02:53:59.449 INFO:tasks.workunit.client.0.smithi089.stdout:2/310: fsync d13/d30/d59/f5b 0 2024-09-13T02:53:59.449 INFO:tasks.workunit.client.0.smithi089.stdout:2/311: write d13/f54 [966722,15728] 0 2024-09-13T02:53:59.451 INFO:tasks.workunit.client.0.smithi089.stdout:3/278: write d2/d20/d23/d2b/f3d [1260784,105086] 0 2024-09-13T02:53:59.451 INFO:tasks.workunit.client.0.smithi089.stdout:3/279: rename d2/d20 to d2/d20/d23/d27/d50 22 2024-09-13T02:53:59.464 INFO:tasks.workunit.client.0.smithi089.stdout:8/310: dwrite de/d16/f1f [0,4194304] 0 2024-09-13T02:53:59.464 INFO:tasks.workunit.client.0.smithi089.stdout:8/311: write f9 [2717213,30297] 0 2024-09-13T02:53:59.473 INFO:tasks.workunit.client.0.smithi089.stdout:3/280: dwrite d2/d8/f36 [0,4194304] 0 2024-09-13T02:53:59.473 INFO:tasks.workunit.client.0.smithi089.stdout:2/312: dwrite d13/f3b [0,4194304] 0 2024-09-13T02:53:59.474 INFO:tasks.workunit.client.0.smithi089.stdout:2/313: write d13/d30/f62 [4486576,103610] 0 2024-09-13T02:53:59.474 INFO:tasks.workunit.client.0.smithi089.stdout:3/281: mkdir d2/d20/d23/d27/d51 0 2024-09-13T02:53:59.474 INFO:tasks.workunit.client.0.smithi089.stdout:3/282: chown d2/f14 90 1 2024-09-13T02:53:59.474 INFO:tasks.workunit.client.0.smithi089.stdout:2/314: truncate f5 5847738 0 2024-09-13T02:53:59.474 INFO:tasks.workunit.client.0.smithi089.stdout:8/312: dread f0 [0,4194304] 0 2024-09-13T02:53:59.475 INFO:tasks.workunit.client.0.smithi089.stdout:8/313: write de/f5e [422980,58780] 0 2024-09-13T02:53:59.476 INFO:tasks.workunit.client.0.smithi089.stdout:3/283: creat d2/d20/d23/d27/d51/f52 x:0 0 0 2024-09-13T02:53:59.476 INFO:tasks.workunit.client.0.smithi089.stdout:8/314: symlink de/d16/d1e/d3f/d5b/l63 0 2024-09-13T02:53:59.476 INFO:tasks.workunit.client.0.smithi089.stdout:8/315: dread - de/d16/d1e/f4e zero size 2024-09-13T02:53:59.476 INFO:tasks.workunit.client.0.smithi089.stdout:8/316: chown de/d16/d1e 43895242 1 2024-09-13T02:53:59.477 INFO:tasks.workunit.client.0.smithi089.stdout:8/317: readlink de/d16/d1e/d20/l25 0 2024-09-13T02:53:59.479 INFO:tasks.workunit.client.0.smithi089.stdout:8/318: truncate de/d16/d1e/d27/f3b 2093012 0 2024-09-13T02:53:59.479 INFO:tasks.workunit.client.0.smithi089.stdout:8/319: fdatasync de/f18 0 2024-09-13T02:53:59.479 INFO:tasks.workunit.client.0.smithi089.stdout:8/320: stat de/d16/d1e/d45/l62 0 2024-09-13T02:53:59.479 INFO:tasks.workunit.client.0.smithi089.stdout:8/321: readlink de/d16/d1e/d27/l2c 0 2024-09-13T02:53:59.479 INFO:tasks.workunit.client.0.smithi089.stdout:8/322: fdatasync de/d16/d1e/f21 0 2024-09-13T02:53:59.479 INFO:tasks.workunit.client.0.smithi089.stdout:8/323: creat de/d16/d1e/d3f/f64 x:0 0 0 2024-09-13T02:53:59.483 INFO:tasks.workunit.client.0.smithi089.stdout:8/324: link de/d16/d1e/d27/d35/c38 de/d16/d1e/d27/d35/c65 0 2024-09-13T02:53:59.486 INFO:tasks.workunit.client.0.smithi089.stdout:8/325: write de/f10 [1514024,96265] 0 2024-09-13T02:53:59.486 INFO:tasks.workunit.client.0.smithi089.stdout:8/326: chown de/f10 75846 1 2024-09-13T02:53:59.486 INFO:tasks.workunit.client.0.smithi089.stdout:8/327: chown de/d16/d1e/d20/f37 3637741 1 2024-09-13T02:53:59.486 INFO:tasks.workunit.client.0.smithi089.stdout:8/328: chown de/d16/d1e/d3f/d5b 364113924 1 2024-09-13T02:53:59.486 INFO:tasks.workunit.client.0.smithi089.stdout:8/329: chown de/f10 782995137 1 2024-09-13T02:53:59.487 INFO:tasks.workunit.client.0.smithi089.stdout:8/330: fsync de/d16/d1e/d3f/f49 0 2024-09-13T02:53:59.489 INFO:tasks.workunit.client.0.smithi089.stdout:8/331: rename de/l59 to de/d16/d1e/d27/d35/l66 0 2024-09-13T02:53:59.490 INFO:tasks.workunit.client.0.smithi089.stdout:8/332: mkdir de/d16/d1e/d67 0 2024-09-13T02:53:59.505 INFO:tasks.workunit.client.0.smithi089.stdout:8/333: write de/d16/f3e [3023293,36026] 0 2024-09-13T02:53:59.505 INFO:tasks.workunit.client.0.smithi089.stdout:2/315: dwrite d13/d30/d64/f6e [0,4194304] 0 2024-09-13T02:53:59.511 INFO:tasks.workunit.client.0.smithi089.stdout:8/334: creat de/d16/d1e/d27/f68 x:0 0 0 2024-09-13T02:53:59.512 INFO:tasks.workunit.client.0.smithi089.stdout:8/335: write de/d16/d1e/d45/f55 [339207,5747] 0 2024-09-13T02:53:59.529 INFO:tasks.workunit.client.0.smithi089.stdout:8/336: dwrite de/f1a [0,4194304] 0 2024-09-13T02:53:59.529 INFO:tasks.workunit.client.0.smithi089.stdout:8/337: write de/d16/d1e/f4e [193256,30067] 0 2024-09-13T02:53:59.531 INFO:tasks.workunit.client.0.smithi089.stdout:8/338: symlink de/d16/d1e/d20/d39/l69 0 2024-09-13T02:53:59.531 INFO:tasks.workunit.client.0.smithi089.stdout:8/339: truncate de/f40 694500 0 2024-09-13T02:53:59.599 INFO:tasks.workunit.client.0.smithi089.stdout:5/323: sync 2024-09-13T02:53:59.599 INFO:tasks.workunit.client.0.smithi089.stdout:7/331: sync 2024-09-13T02:53:59.599 INFO:tasks.workunit.client.0.smithi089.stdout:4/305: sync 2024-09-13T02:53:59.599 INFO:tasks.workunit.client.0.smithi089.stdout:6/291: sync 2024-09-13T02:53:59.599 INFO:tasks.workunit.client.0.smithi089.stdout:0/240: sync 2024-09-13T02:53:59.599 INFO:tasks.workunit.client.0.smithi089.stdout:1/248: sync 2024-09-13T02:53:59.599 INFO:tasks.workunit.client.0.smithi089.stdout:6/292: rename db/d10/d27/d28/d46/d53 to db/d10/d27/d28/d46/d53/d69 22 2024-09-13T02:53:59.599 INFO:tasks.workunit.client.0.smithi089.stdout:1/249: chown dc/d12/d2c/d36/f40 808 1 2024-09-13T02:53:59.600 INFO:tasks.workunit.client.0.smithi089.stdout:7/332: stat d3/d19/c5b 0 2024-09-13T02:53:59.600 INFO:tasks.workunit.client.0.smithi089.stdout:7/333: read d3/d19/d2d/f4a [174695,118738] 0 2024-09-13T02:53:59.600 INFO:tasks.workunit.client.0.smithi089.stdout:5/324: symlink d1/l6a 0 2024-09-13T02:53:59.601 INFO:tasks.workunit.client.0.smithi089.stdout:4/306: symlink d2/d55/l5a 0 2024-09-13T02:53:59.601 INFO:tasks.workunit.client.0.smithi089.stdout:4/307: write d2/d22/f35 [444266,37198] 0 2024-09-13T02:53:59.601 INFO:tasks.workunit.client.0.smithi089.stdout:4/308: creat d2/d3/d5/d43/d3b/f5b x:0 0 0 2024-09-13T02:53:59.601 INFO:tasks.workunit.client.0.smithi089.stdout:0/241: mkdir d2/d19/d1a/d4e 0 2024-09-13T02:53:59.603 INFO:tasks.workunit.client.0.smithi089.stdout:7/334: unlink d3/d19/d2d/d14/d6c/l6d 0 2024-09-13T02:53:59.605 INFO:tasks.workunit.client.0.smithi089.stdout:5/325: rename d1/f51 to d1/d4/d1c/d49/f6b 0 2024-09-13T02:53:59.605 INFO:tasks.workunit.client.0.smithi089.stdout:5/326: fdatasync d1/d4/fc 0 2024-09-13T02:53:59.605 INFO:tasks.workunit.client.0.smithi089.stdout:5/327: readlink d1/d7/d1f/l3e 0 2024-09-13T02:53:59.608 INFO:tasks.workunit.client.0.smithi089.stdout:4/309: mknod d2/d55/c5c 0 2024-09-13T02:53:59.610 INFO:tasks.workunit.client.0.smithi089.stdout:0/242: mkdir d2/d19/d1a/d3d/d4b/d4f 0 2024-09-13T02:53:59.611 INFO:tasks.workunit.client.0.smithi089.stdout:6/293: getdents db 0 2024-09-13T02:53:59.611 INFO:tasks.workunit.client.0.smithi089.stdout:6/294: chown db/d10/d27/d28/d2f/c40 58823 1 2024-09-13T02:53:59.611 INFO:tasks.workunit.client.0.smithi089.stdout:6/295: write db/d10/d27/d28/f57 [980341,11894] 0 2024-09-13T02:53:59.611 INFO:tasks.workunit.client.0.smithi089.stdout:5/328: truncate d1/f55 2622153 0 2024-09-13T02:53:59.612 INFO:tasks.workunit.client.0.smithi089.stdout:4/310: mknod d2/d3/de/c5d 0 2024-09-13T02:53:59.613 INFO:tasks.workunit.client.0.smithi089.stdout:0/243: symlink d2/d19/d1a/d3d/l50 0 2024-09-13T02:53:59.613 INFO:tasks.workunit.client.0.smithi089.stdout:0/244: truncate d2/d19/f32 1195068 0 2024-09-13T02:53:59.615 INFO:tasks.workunit.client.0.smithi089.stdout:5/329: mknod d1/d7/c6c 0 2024-09-13T02:53:59.615 INFO:tasks.workunit.client.0.smithi089.stdout:6/296: mknod db/d10/d27/d28/d2f/c6a 0 2024-09-13T02:53:59.615 INFO:tasks.workunit.client.0.smithi089.stdout:5/330: fdatasync d1/d4/f25 0 2024-09-13T02:53:59.615 INFO:tasks.workunit.client.0.smithi089.stdout:1/250: dwrite dc/f1e [0,4194304] 0 2024-09-13T02:53:59.616 INFO:tasks.workunit.client.0.smithi089.stdout:4/311: mknod d2/d22/c5e 0 2024-09-13T02:53:59.618 INFO:tasks.workunit.client.0.smithi089.stdout:5/331: truncate d1/d7/d1f/f39 291769 0 2024-09-13T02:53:59.620 INFO:tasks.workunit.client.0.smithi089.stdout:6/297: mknod db/c6b 0 2024-09-13T02:53:59.622 INFO:tasks.workunit.client.0.smithi089.stdout:6/298: mknod db/c6c 0 2024-09-13T02:53:59.624 INFO:tasks.workunit.client.0.smithi089.stdout:4/312: mknod d2/d3/d5/c5f 0 2024-09-13T02:53:59.624 INFO:tasks.workunit.client.0.smithi089.stdout:4/313: creat d2/d3/d5/d43/d3b/f60 x:0 0 0 2024-09-13T02:53:59.627 INFO:tasks.workunit.client.0.smithi089.stdout:4/314: symlink d2/d55/l61 0 2024-09-13T02:53:59.628 INFO:tasks.workunit.client.0.smithi089.stdout:6/299: dread db/d43/f3b [0,4194304] 0 2024-09-13T02:53:59.629 INFO:tasks.workunit.client.0.smithi089.stdout:4/315: mkdir d2/d3/de/d62 0 2024-09-13T02:53:59.629 INFO:tasks.workunit.client.0.smithi089.stdout:5/332: dread d1/d7/d1f/d4d/f58 [0,4194304] 0 2024-09-13T02:53:59.629 INFO:tasks.workunit.client.0.smithi089.stdout:5/333: fdatasync d1/d4/d1c/d49/f6b 0 2024-09-13T02:53:59.629 INFO:tasks.workunit.client.0.smithi089.stdout:5/334: creat d1/d7/d1f/f6d x:0 0 0 2024-09-13T02:53:59.629 INFO:tasks.workunit.client.0.smithi089.stdout:5/335: dread - d1/d7/d1f/f5f zero size 2024-09-13T02:53:59.629 INFO:tasks.workunit.client.0.smithi089.stdout:6/300: truncate db/d10/d27/d28/d2f/f50 807130 0 2024-09-13T02:53:59.630 INFO:tasks.workunit.client.0.smithi089.stdout:4/316: truncate d2/d3/de/f2b 2300714 0 2024-09-13T02:53:59.631 INFO:tasks.workunit.client.0.smithi089.stdout:4/317: fdatasync d2/da/f13 0 2024-09-13T02:53:59.633 INFO:tasks.workunit.client.0.smithi089.stdout:0/245: dwrite d2/f4a [0,4194304] 0 2024-09-13T02:53:59.633 INFO:tasks.workunit.client.0.smithi089.stdout:6/301: symlink db/d10/d27/d28/d37/l6d 0 2024-09-13T02:53:59.634 INFO:tasks.workunit.client.0.smithi089.stdout:4/318: rename d2/d3/d5/d43/l51 to d2/d3/d5/d49/l63 0 2024-09-13T02:53:59.634 INFO:tasks.workunit.client.0.smithi089.stdout:0/246: rename d2/d19 to d2/d19/d1a/d4e/d51 22 2024-09-13T02:53:59.637 INFO:tasks.workunit.client.0.smithi089.stdout:1/251: dwrite dc/d12/f28 [0,4194304] 0 2024-09-13T02:53:59.637 INFO:tasks.workunit.client.0.smithi089.stdout:1/252: write dc/d12/d2c/d36/f38 [945080,3211] 0 2024-09-13T02:53:59.640 INFO:tasks.workunit.client.0.smithi089.stdout:1/253: symlink dc/d44/l4c 0 2024-09-13T02:53:59.640 INFO:tasks.workunit.client.0.smithi089.stdout:1/254: chown dc/d12/d2c 58451 1 2024-09-13T02:53:59.640 INFO:tasks.workunit.client.0.smithi089.stdout:1/255: stat dc/d12/d2c/d36/f3d 0 2024-09-13T02:53:59.644 INFO:tasks.workunit.client.0.smithi089.stdout:5/336: dread d1/f69 [0,4194304] 0 2024-09-13T02:53:59.646 INFO:tasks.workunit.client.0.smithi089.stdout:5/337: mknod d1/d4/d2b/c6e 0 2024-09-13T02:53:59.651 INFO:tasks.workunit.client.0.smithi089.stdout:1/256: write dc/f21 [423518,95807] 0 2024-09-13T02:53:59.651 INFO:tasks.workunit.client.0.smithi089.stdout:1/257: stat dc/lf 0 2024-09-13T02:53:59.652 INFO:tasks.workunit.client.0.smithi089.stdout:6/302: rename db/d10/d27 to db/d43/d6e 0 2024-09-13T02:53:59.654 INFO:tasks.workunit.client.0.smithi089.stdout:4/319: dwrite d2/d3/d5/f42 [0,4194304] 0 2024-09-13T02:53:59.656 INFO:tasks.workunit.client.0.smithi089.stdout:6/303: link l2 db/l6f 0 2024-09-13T02:53:59.660 INFO:tasks.workunit.client.0.smithi089.stdout:2/316: sync 2024-09-13T02:53:59.660 INFO:tasks.workunit.client.0.smithi089.stdout:9/277: sync 2024-09-13T02:53:59.660 INFO:tasks.workunit.client.0.smithi089.stdout:3/284: sync 2024-09-13T02:53:59.662 INFO:tasks.workunit.client.0.smithi089.stdout:6/304: unlink db/f26 0 2024-09-13T02:53:59.663 INFO:tasks.workunit.client.0.smithi089.stdout:2/317: rmdir d13/d30/d59/d5f 39 2024-09-13T02:53:59.663 INFO:tasks.workunit.client.0.smithi089.stdout:4/320: dread d2/d3/d5/d43/f50 [4194304,4194304] 0 2024-09-13T02:53:59.665 INFO:tasks.workunit.client.0.smithi089.stdout:9/278: mknod d3/d6/d2a/d4b/c5f 0 2024-09-13T02:53:59.665 INFO:tasks.workunit.client.0.smithi089.stdout:9/279: creat d3/d6/d2a/f60 x:0 0 0 2024-09-13T02:53:59.666 INFO:tasks.workunit.client.0.smithi089.stdout:3/285: creat d2/d20/d23/d2b/f53 x:0 0 0 2024-09-13T02:53:59.666 INFO:tasks.workunit.client.0.smithi089.stdout:3/286: chown d2/d8/dc/f2c 44812 1 2024-09-13T02:53:59.666 INFO:tasks.workunit.client.0.smithi089.stdout:3/287: write d2/d20/f25 [2671579,58796] 0 2024-09-13T02:53:59.667 INFO:tasks.workunit.client.0.smithi089.stdout:5/338: rename d1/d7/d1f to d1/d4/d45/d6f 0 2024-09-13T02:53:59.668 INFO:tasks.workunit.client.0.smithi089.stdout:6/305: rmdir db/d43/d6e/d28 39 2024-09-13T02:53:59.669 INFO:tasks.workunit.client.0.smithi089.stdout:2/318: stat d13/l34 0 2024-09-13T02:53:59.671 INFO:tasks.workunit.client.0.smithi089.stdout:9/280: symlink d3/d6/d2a/d4b/d54/l61 0 2024-09-13T02:53:59.671 INFO:tasks.workunit.client.0.smithi089.stdout:3/288: chown d2/l1a 40668318 1 2024-09-13T02:53:59.673 INFO:tasks.workunit.client.0.smithi089.stdout:2/319: mkdir d13/d30/d4e/d6f 0 2024-09-13T02:53:59.673 INFO:tasks.workunit.client.0.smithi089.stdout:3/289: mknod d2/d20/d23/d32/d49/c54 0 2024-09-13T02:53:59.676 INFO:tasks.workunit.client.0.smithi089.stdout:4/321: rename d2/d22/d4f/f56 to d2/d3/d5/f64 0 2024-09-13T02:53:59.676 INFO:tasks.workunit.client.0.smithi089.stdout:4/322: write d2/d3/de/f2b [681480,58932] 0 2024-09-13T02:53:59.676 INFO:tasks.workunit.client.0.smithi089.stdout:2/320: truncate d13/d30/d4e/f65 576410 0 2024-09-13T02:53:59.676 INFO:tasks.workunit.client.0.smithi089.stdout:2/321: creat d13/f70 x:0 0 0 2024-09-13T02:53:59.676 INFO:tasks.workunit.client.0.smithi089.stdout:2/322: stat d13/f70 0 2024-09-13T02:53:59.681 INFO:tasks.workunit.client.0.smithi089.stdout:3/290: symlink d2/d20/d23/d32/l55 0 2024-09-13T02:53:59.681 INFO:tasks.workunit.client.0.smithi089.stdout:2/323: getdents d13/d30/d59/d5f 0 2024-09-13T02:53:59.685 INFO:tasks.workunit.client.0.smithi089.stdout:2/324: unlink d13/d30/d59/f6a 0 2024-09-13T02:53:59.685 INFO:tasks.workunit.client.0.smithi089.stdout:2/325: dread - d13/f70 zero size 2024-09-13T02:53:59.701 INFO:tasks.workunit.client.0.smithi089.stdout:9/281: dwrite d3/d6/d2a/f4f [0,4194304] 0 2024-09-13T02:53:59.711 INFO:tasks.workunit.client.0.smithi089.stdout:6/306: dwrite db/d43/d6e/f55 [0,4194304] 0 2024-09-13T02:53:59.712 INFO:tasks.workunit.client.0.smithi089.stdout:5/339: dwrite d1/d4/d45/f4a [0,4194304] 0 2024-09-13T02:53:59.712 INFO:tasks.workunit.client.0.smithi089.stdout:4/323: dwrite d2/da/f44 [0,4194304] 0 2024-09-13T02:53:59.712 INFO:tasks.workunit.client.0.smithi089.stdout:3/291: dwrite d2/d20/d23/d2b/f3d [0,4194304] 0 2024-09-13T02:53:59.714 INFO:tasks.workunit.client.0.smithi089.stdout:6/307: link db/l6f db/d10/l70 0 2024-09-13T02:53:59.716 INFO:tasks.workunit.client.0.smithi089.stdout:5/340: symlink d1/d7/l70 0 2024-09-13T02:53:59.717 INFO:tasks.workunit.client.0.smithi089.stdout:2/326: dwrite d13/d30/f22 [0,4194304] 0 2024-09-13T02:53:59.718 INFO:tasks.workunit.client.0.smithi089.stdout:4/324: creat d2/d3/d5/d43/f65 x:0 0 0 2024-09-13T02:53:59.724 INFO:tasks.workunit.client.0.smithi089.stdout:9/282: dwrite d3/f22 [0,4194304] 0 2024-09-13T02:53:59.726 INFO:tasks.workunit.client.0.smithi089.stdout:6/308: unlink db/f12 0 2024-09-13T02:53:59.727 INFO:tasks.workunit.client.0.smithi089.stdout:5/341: write d1/d4/d2b/f50 [4594156,5696] 0 2024-09-13T02:53:59.729 INFO:tasks.workunit.client.0.smithi089.stdout:4/325: dread d2/f4 [4194304,4194304] 0 2024-09-13T02:53:59.731 INFO:tasks.workunit.client.0.smithi089.stdout:3/292: dwrite d2/f2d [0,4194304] 0 2024-09-13T02:53:59.736 INFO:tasks.workunit.client.0.smithi089.stdout:5/342: creat d1/d4/d45/d6f/d4d/f71 x:0 0 0 2024-09-13T02:53:59.736 INFO:tasks.workunit.client.0.smithi089.stdout:5/343: truncate d1/d4/d45/d6f/d4d/f67 536781 0 2024-09-13T02:53:59.737 INFO:tasks.workunit.client.0.smithi089.stdout:4/326: symlink d2/d3/l66 0 2024-09-13T02:53:59.737 INFO:tasks.workunit.client.0.smithi089.stdout:4/327: truncate d2/f1f 739206 0 2024-09-13T02:53:59.738 INFO:tasks.workunit.client.0.smithi089.stdout:6/309: getdents db/d43 0 2024-09-13T02:53:59.743 INFO:tasks.workunit.client.0.smithi089.stdout:3/293: link d2/d20/d23/d27/f4e d2/d20/d23/d32/d49/f56 0 2024-09-13T02:53:59.744 INFO:tasks.workunit.client.0.smithi089.stdout:5/344: truncate d1/d7/f19 4697698 0 2024-09-13T02:53:59.746 INFO:tasks.workunit.client.0.smithi089.stdout:4/328: symlink d2/l67 0 2024-09-13T02:53:59.747 INFO:tasks.workunit.client.0.smithi089.stdout:6/310: mknod db/d43/d60/c71 0 2024-09-13T02:53:59.750 INFO:tasks.workunit.client.0.smithi089.stdout:3/294: mkdir d2/d8/dc/d57 0 2024-09-13T02:53:59.751 INFO:tasks.workunit.client.0.smithi089.stdout:3/295: truncate d2/d20/d23/d2b/f2f 5068779 0 2024-09-13T02:53:59.751 INFO:tasks.workunit.client.0.smithi089.stdout:3/296: write d2/d8/f48 [1605068,61828] 0 2024-09-13T02:53:59.751 INFO:tasks.workunit.client.0.smithi089.stdout:9/283: dwrite d3/d6/df/f38 [0,4194304] 0 2024-09-13T02:53:59.751 INFO:tasks.workunit.client.0.smithi089.stdout:9/284: truncate d3/d6/d36/f5c 100660 0 2024-09-13T02:53:59.751 INFO:tasks.workunit.client.0.smithi089.stdout:4/329: unlink d2/d3/d5/d43/d3b/l46 0 2024-09-13T02:53:59.757 INFO:tasks.workunit.client.0.smithi089.stdout:3/297: dread d2/d20/d23/d2b/f3d [0,4194304] 0 2024-09-13T02:53:59.757 INFO:tasks.workunit.client.0.smithi089.stdout:3/298: stat d2/d20/d23/d32/d49/c54 0 2024-09-13T02:53:59.762 INFO:tasks.workunit.client.0.smithi089.stdout:7/335: sync 2024-09-13T02:53:59.762 INFO:tasks.workunit.client.0.smithi089.stdout:8/340: sync 2024-09-13T02:53:59.762 INFO:tasks.workunit.client.0.smithi089.stdout:7/336: fsync d3/d44/f43 0 2024-09-13T02:53:59.763 INFO:tasks.workunit.client.0.smithi089.stdout:7/337: rmdir d3/d19 39 2024-09-13T02:53:59.766 INFO:tasks.workunit.client.0.smithi089.stdout:7/338: creat d3/d19/d2e/f6e x:0 0 0 2024-09-13T02:53:59.767 INFO:tasks.workunit.client.0.smithi089.stdout:7/339: write d3/d44/f43 [2980474,73831] 0 2024-09-13T02:53:59.767 INFO:tasks.workunit.client.0.smithi089.stdout:3/299: dread d2/d8/dc/f1b [0,4194304] 0 2024-09-13T02:53:59.769 INFO:tasks.workunit.client.0.smithi089.stdout:6/311: dread db/d43/d6e/f55 [0,4194304] 0 2024-09-13T02:53:59.769 INFO:tasks.workunit.client.0.smithi089.stdout:3/300: unlink d2/f43 0 2024-09-13T02:53:59.772 INFO:tasks.workunit.client.0.smithi089.stdout:6/312: creat db/d43/d6e/d28/d37/f72 x:0 0 0 2024-09-13T02:53:59.773 INFO:tasks.workunit.client.0.smithi089.stdout:3/301: creat d2/d20/d44/f58 x:0 0 0 2024-09-13T02:53:59.773 INFO:tasks.workunit.client.0.smithi089.stdout:9/285: dread d3/d6/df/d24/d35/f45 [0,4194304] 0 2024-09-13T02:53:59.774 INFO:tasks.workunit.client.0.smithi089.stdout:8/341: write de/d16/d1e/d3f/f46 [2307517,23837] 0 2024-09-13T02:53:59.774 INFO:tasks.workunit.client.0.smithi089.stdout:8/342: truncate de/d16/d1e/d45/f55 776458 0 2024-09-13T02:53:59.774 INFO:tasks.workunit.client.0.smithi089.stdout:7/340: dread f0 [0,4194304] 0 2024-09-13T02:53:59.774 INFO:tasks.workunit.client.0.smithi089.stdout:5/345: dwrite d1/f5e [0,4194304] 0 2024-09-13T02:53:59.775 INFO:tasks.workunit.client.0.smithi089.stdout:3/302: symlink d2/d20/d23/d32/d49/l59 0 2024-09-13T02:53:59.777 INFO:tasks.workunit.client.0.smithi089.stdout:8/343: creat de/d16/d1e/d20/f6a x:0 0 0 2024-09-13T02:53:59.778 INFO:tasks.workunit.client.0.smithi089.stdout:9/286: rmdir d3/d6/df/d24/d32 39 2024-09-13T02:53:59.778 INFO:tasks.workunit.client.0.smithi089.stdout:9/287: chown d3/d6/df/d24/d32 111664728 1 2024-09-13T02:53:59.778 INFO:tasks.workunit.client.0.smithi089.stdout:8/344: dread de/d16/d1e/d45/f55 [0,4194304] 0 2024-09-13T02:53:59.779 INFO:tasks.workunit.client.0.smithi089.stdout:6/313: rmdir db/d43/d6e/d28/d37 39 2024-09-13T02:53:59.781 INFO:tasks.workunit.client.0.smithi089.stdout:7/341: truncate d3/d19/d2d/f4e 358476 0 2024-09-13T02:53:59.782 INFO:tasks.workunit.client.0.smithi089.stdout:5/346: mkdir d1/d4/d45/d6f/d62/d72 0 2024-09-13T02:53:59.782 INFO:tasks.workunit.client.0.smithi089.stdout:3/303: chown d2/l10 179 1 2024-09-13T02:53:59.783 INFO:tasks.workunit.client.0.smithi089.stdout:9/288: creat d3/d6/df/f62 x:0 0 0 2024-09-13T02:53:59.783 INFO:tasks.workunit.client.0.smithi089.stdout:9/289: chown d3/d6/d2a/f4f 11855 1 2024-09-13T02:53:59.785 INFO:tasks.workunit.client.0.smithi089.stdout:6/314: creat db/d43/d60/f73 x:0 0 0 2024-09-13T02:53:59.785 INFO:tasks.workunit.client.0.smithi089.stdout:6/315: chown db/c2b 0 1 2024-09-13T02:53:59.785 INFO:tasks.workunit.client.0.smithi089.stdout:4/330: dwrite d2/d3/d5/f1e [0,4194304] 0 2024-09-13T02:53:59.787 INFO:tasks.workunit.client.0.smithi089.stdout:5/347: read d1/d4/d45/d6f/f42 [2558350,128600] 0 2024-09-13T02:53:59.787 INFO:tasks.workunit.client.0.smithi089.stdout:5/348: chown d1/d4/f25 2837 1 2024-09-13T02:53:59.790 INFO:tasks.workunit.client.0.smithi089.stdout:3/304: link d2/d20/d23/d27/c2e d2/d20/d23/d27/d51/c5a 0 2024-09-13T02:53:59.794 INFO:tasks.workunit.client.0.smithi089.stdout:9/290: link d3/d6/df/l57 d3/d6/d2a/d4b/d54/l63 0 2024-09-13T02:53:59.794 INFO:tasks.workunit.client.0.smithi089.stdout:9/291: fsync d3/d15/f1b 0 2024-09-13T02:53:59.795 INFO:tasks.workunit.client.0.smithi089.stdout:4/331: dread d2/f4b [0,4194304] 0 2024-09-13T02:53:59.799 INFO:tasks.workunit.client.0.smithi089.stdout:6/316: dread db/d10/d3a/f5d [0,4194304] 0 2024-09-13T02:53:59.799 INFO:tasks.workunit.client.0.smithi089.stdout:6/317: chown l8 78 1 2024-09-13T02:53:59.800 INFO:tasks.workunit.client.0.smithi089.stdout:8/345: rmdir de/d16/d1e 39 2024-09-13T02:53:59.803 INFO:tasks.workunit.client.0.smithi089.stdout:6/318: dread db/d43/d6e/d28/f57 [0,4194304] 0 2024-09-13T02:53:59.804 INFO:tasks.workunit.client.0.smithi089.stdout:6/319: dread - db/d43/d6e/d28/d37/f4e zero size 2024-09-13T02:53:59.804 INFO:tasks.workunit.client.0.smithi089.stdout:6/320: stat db/d43/f67 0 2024-09-13T02:53:59.805 INFO:tasks.workunit.client.0.smithi089.stdout:9/292: write d3/f5 [3986834,84555] 0 2024-09-13T02:53:59.806 INFO:tasks.workunit.client.0.smithi089.stdout:4/332: creat d2/d3/de/d62/f68 x:0 0 0 2024-09-13T02:53:59.808 INFO:tasks.workunit.client.0.smithi089.stdout:8/346: rename de/d16/d1e/d3f/f42 to de/d16/d1e/d27/d52/f6b 0 2024-09-13T02:53:59.808 INFO:tasks.workunit.client.0.smithi089.stdout:8/347: fsync de/f40 0 2024-09-13T02:53:59.808 INFO:tasks.workunit.client.0.smithi089.stdout:8/348: readlink de/l26 0 2024-09-13T02:53:59.809 INFO:tasks.workunit.client.0.smithi089.stdout:6/321: stat db/d43/d6e/d28/d46/d53/l61 0 2024-09-13T02:53:59.810 INFO:tasks.workunit.client.0.smithi089.stdout:4/333: write d2/d3/d5/d43/f50 [6086534,32109] 0 2024-09-13T02:53:59.813 INFO:tasks.workunit.client.0.smithi089.stdout:6/322: mkdir db/d43/d60/d74 0 2024-09-13T02:53:59.813 INFO:tasks.workunit.client.0.smithi089.stdout:6/323: write f0 [486096,80532] 0 2024-09-13T02:53:59.814 INFO:tasks.workunit.client.0.smithi089.stdout:6/324: dread - db/d43/d60/f62 zero size 2024-09-13T02:53:59.814 INFO:tasks.workunit.client.0.smithi089.stdout:4/334: write d2/f4b [2536870,93948] 0 2024-09-13T02:53:59.814 INFO:tasks.workunit.client.0.smithi089.stdout:8/349: mkdir de/d16/d1e/d20/d6c 0 2024-09-13T02:53:59.814 INFO:tasks.workunit.client.0.smithi089.stdout:8/350: dread de/d16/d1e/f47 [0,4194304] 0 2024-09-13T02:53:59.814 INFO:tasks.workunit.client.0.smithi089.stdout:6/325: mknod db/d43/d6e/d28/d2f/c75 0 2024-09-13T02:53:59.815 INFO:tasks.workunit.client.0.smithi089.stdout:4/335: mknod d2/d3/d5/d43/c69 0 2024-09-13T02:53:59.816 INFO:tasks.workunit.client.0.smithi089.stdout:8/351: dread de/d16/d1e/d45/f55 [0,4194304] 0 2024-09-13T02:53:59.817 INFO:tasks.workunit.client.0.smithi089.stdout:6/326: link db/d10/d3a/c63 db/d43/d6e/d28/d37/c76 0 2024-09-13T02:53:59.817 INFO:tasks.workunit.client.0.smithi089.stdout:6/327: chown db/d10/d3a/f42 29209 1 2024-09-13T02:53:59.817 INFO:tasks.workunit.client.0.smithi089.stdout:4/336: rmdir d2/d3/d5/d49 39 2024-09-13T02:53:59.817 INFO:tasks.workunit.client.0.smithi089.stdout:4/337: dread - d2/d3/d5/f64 zero size 2024-09-13T02:53:59.820 INFO:tasks.workunit.client.0.smithi089.stdout:8/352: rename de/d16/d1e/d20/d39/c41 to de/d16/d1e/c6d 0 2024-09-13T02:53:59.820 INFO:tasks.workunit.client.0.smithi089.stdout:5/349: dwrite d1/d4/d45/d6f/f3b [0,4194304] 0 2024-09-13T02:53:59.820 INFO:tasks.workunit.client.0.smithi089.stdout:3/305: dwrite d2/d8/dc/f2c [0,4194304] 0 2024-09-13T02:53:59.822 INFO:tasks.workunit.client.0.smithi089.stdout:6/328: link db/d10/c1a db/d43/d6e/d28/d46/d53/c77 0 2024-09-13T02:53:59.822 INFO:tasks.workunit.client.0.smithi089.stdout:7/342: dwrite d3/d19/d2d/f5a [0,4194304] 0 2024-09-13T02:53:59.823 INFO:tasks.workunit.client.0.smithi089.stdout:8/353: mkdir de/d16/d1e/d20/d6c/d6e 0 2024-09-13T02:53:59.824 INFO:tasks.workunit.client.0.smithi089.stdout:8/354: chown c1 10 1 2024-09-13T02:53:59.824 INFO:tasks.workunit.client.0.smithi089.stdout:8/355: creat de/d16/f6f x:0 0 0 2024-09-13T02:53:59.830 INFO:tasks.workunit.client.0.smithi089.stdout:9/293: dwrite d3/d6/df/f38 [0,4194304] 0 2024-09-13T02:53:59.834 INFO:tasks.workunit.client.0.smithi089.stdout:3/306: mkdir d2/d20/d23/d32/d5b 0 2024-09-13T02:53:59.840 INFO:tasks.workunit.client.0.smithi089.stdout:7/343: mkdir d3/d47/d5e/d6f 0 2024-09-13T02:53:59.842 INFO:tasks.workunit.client.0.smithi089.stdout:8/356: creat de/d16/d1e/d20/d39/f70 x:0 0 0 2024-09-13T02:53:59.843 INFO:tasks.workunit.client.0.smithi089.stdout:9/294: symlink d3/d6/l64 0 2024-09-13T02:53:59.844 INFO:tasks.workunit.client.0.smithi089.stdout:4/338: dwrite d2/da/f13 [0,4194304] 0 2024-09-13T02:53:59.844 INFO:tasks.workunit.client.0.smithi089.stdout:6/329: dwrite db/f1d [4194304,4194304] 0 2024-09-13T02:53:59.844 INFO:tasks.workunit.client.0.smithi089.stdout:5/350: rmdir d1/d4/d45/d6f/d4d 39 2024-09-13T02:53:59.846 INFO:tasks.workunit.client.0.smithi089.stdout:3/307: mknod d2/d20/d44/c5c 0 2024-09-13T02:53:59.846 INFO:tasks.workunit.client.0.smithi089.stdout:3/308: creat d2/d8/dc/d3c/f5d x:0 0 0 2024-09-13T02:53:59.847 INFO:tasks.workunit.client.0.smithi089.stdout:8/357: mkdir de/d16/d1e/d3f/d71 0 2024-09-13T02:53:59.850 INFO:tasks.workunit.client.0.smithi089.stdout:4/339: symlink d2/l6a 0 2024-09-13T02:53:59.855 INFO:tasks.workunit.client.0.smithi089.stdout:6/330: link db/d10/l20 db/d10/l78 0 2024-09-13T02:53:59.855 INFO:tasks.workunit.client.0.smithi089.stdout:6/331: dread - db/d43/d60/f73 zero size 2024-09-13T02:53:59.855 INFO:tasks.workunit.client.0.smithi089.stdout:3/309: dread d2/d8/f21 [0,4194304] 0 2024-09-13T02:53:59.856 INFO:tasks.workunit.client.0.smithi089.stdout:5/351: mkdir d1/d73 0 2024-09-13T02:53:59.857 INFO:tasks.workunit.client.0.smithi089.stdout:0/247: sync 2024-09-13T02:53:59.857 INFO:tasks.workunit.client.0.smithi089.stdout:1/258: sync 2024-09-13T02:53:59.858 INFO:tasks.workunit.client.0.smithi089.stdout:0/248: dread - d2/d19/f22 zero size 2024-09-13T02:53:59.858 INFO:tasks.workunit.client.0.smithi089.stdout:0/249: stat d2/f4a 0 2024-09-13T02:53:59.858 INFO:tasks.workunit.client.0.smithi089.stdout:9/295: rmdir d3/d6/d2a/d4b 39 2024-09-13T02:53:59.859 INFO:tasks.workunit.client.0.smithi089.stdout:4/340: rmdir d2/d22 39 2024-09-13T02:53:59.862 INFO:tasks.workunit.client.0.smithi089.stdout:5/352: rmdir d1/d4/d45/d6f/d62 39 2024-09-13T02:53:59.862 INFO:tasks.workunit.client.0.smithi089.stdout:8/358: dread de/f4d [0,4194304] 0 2024-09-13T02:53:59.863 INFO:tasks.workunit.client.0.smithi089.stdout:1/259: symlink dc/d12/d2c/d36/l4d 0 2024-09-13T02:53:59.863 INFO:tasks.workunit.client.0.smithi089.stdout:1/260: creat dc/d12/d2c/d34/f4e x:0 0 0 2024-09-13T02:53:59.864 INFO:tasks.workunit.client.0.smithi089.stdout:7/344: dwrite d3/d19/d2d/d14/f1c [0,4194304] 0 2024-09-13T02:53:59.865 INFO:tasks.workunit.client.0.smithi089.stdout:7/345: chown d3/d19/d2d/cf 3013697 1 2024-09-13T02:53:59.865 INFO:tasks.workunit.client.0.smithi089.stdout:7/346: creat d3/d44/f70 x:0 0 0 2024-09-13T02:53:59.867 INFO:tasks.workunit.client.0.smithi089.stdout:4/341: unlink d2/d3/de/f2b 0 2024-09-13T02:53:59.870 INFO:tasks.workunit.client.0.smithi089.stdout:5/353: creat d1/d4/d45/d6f/f74 x:0 0 0 2024-09-13T02:53:59.870 INFO:tasks.workunit.client.0.smithi089.stdout:5/354: read d1/d7/f27 [2753658,65784] 0 2024-09-13T02:53:59.871 INFO:tasks.workunit.client.0.smithi089.stdout:1/261: dread dc/f13 [4194304,4194304] 0 2024-09-13T02:53:59.873 INFO:tasks.workunit.client.0.smithi089.stdout:8/359: creat de/d16/d1e/d27/d35/f72 x:0 0 0 2024-09-13T02:53:59.873 INFO:tasks.workunit.client.0.smithi089.stdout:8/360: dread - de/d16/d1e/d20/f6a zero size 2024-09-13T02:53:59.875 INFO:tasks.workunit.client.0.smithi089.stdout:0/250: rmdir d2/d19/d1a/d3d/d4b 39 2024-09-13T02:53:59.882 INFO:tasks.workunit.client.0.smithi089.stdout:5/355: dread d1/f47 [0,4194304] 0 2024-09-13T02:53:59.882 INFO:tasks.workunit.client.0.smithi089.stdout:5/356: write d1/d4/d2b/f2e [98237,11170] 0 2024-09-13T02:53:59.882 INFO:tasks.workunit.client.0.smithi089.stdout:1/262: mknod dc/d12/d2c/d34/d43/c4f 0 2024-09-13T02:53:59.883 INFO:tasks.workunit.client.0.smithi089.stdout:4/342: write d2/d3/d5/d43/d3b/f54 [2123585,19211] 0 2024-09-13T02:53:59.883 INFO:tasks.workunit.client.0.smithi089.stdout:0/251: rename d2/d19/c40 to d2/d19/d1a/d1e/d42/c52 0 2024-09-13T02:53:59.884 INFO:tasks.workunit.client.0.smithi089.stdout:1/263: mknod dc/d46/c50 0 2024-09-13T02:53:59.885 INFO:tasks.workunit.client.0.smithi089.stdout:9/296: dwrite d3/d15/f3f [0,4194304] 0 2024-09-13T02:53:59.885 INFO:tasks.workunit.client.0.smithi089.stdout:9/297: truncate d3/d6/df/d24/f48 915456 0 2024-09-13T02:53:59.885 INFO:tasks.workunit.client.0.smithi089.stdout:9/298: chown d3/l1d 0 1 2024-09-13T02:53:59.885 INFO:tasks.workunit.client.0.smithi089.stdout:9/299: readlink d3/d6/l64 0 2024-09-13T02:53:59.885 INFO:tasks.workunit.client.0.smithi089.stdout:9/300: stat d3/d6/df/d24/d32/c33 0 2024-09-13T02:53:59.886 INFO:tasks.workunit.client.0.smithi089.stdout:9/301: fdatasync d3/d6/df/d24/f48 0 2024-09-13T02:53:59.886 INFO:tasks.workunit.client.0.smithi089.stdout:9/302: dread - d3/d6/d2a/d4b/f59 zero size 2024-09-13T02:53:59.886 INFO:tasks.workunit.client.0.smithi089.stdout:9/303: readlink d3/d15/l26 0 2024-09-13T02:53:59.888 INFO:tasks.workunit.client.0.smithi089.stdout:4/343: link d2/d22/f3f d2/da/f6b 0 2024-09-13T02:53:59.888 INFO:tasks.workunit.client.0.smithi089.stdout:4/344: fdatasync d2/d3/d5/f38 0 2024-09-13T02:53:59.888 INFO:tasks.workunit.client.0.smithi089.stdout:4/345: truncate d2/da/f3d 980006 0 2024-09-13T02:53:59.890 INFO:tasks.workunit.client.0.smithi089.stdout:0/252: symlink d2/d19/d1a/d1e/l53 0 2024-09-13T02:53:59.894 INFO:tasks.workunit.client.0.smithi089.stdout:9/304: creat d3/d6/f65 x:0 0 0 2024-09-13T02:53:59.894 INFO:tasks.workunit.client.0.smithi089.stdout:9/305: fdatasync d3/d6/df/d24/d35/f45 0 2024-09-13T02:53:59.894 INFO:tasks.workunit.client.0.smithi089.stdout:5/357: read d1/d7/f30 [3173327,90944] 0 2024-09-13T02:53:59.896 INFO:tasks.workunit.client.0.smithi089.stdout:4/346: mkdir d2/d3/de/d62/d6c 0 2024-09-13T02:53:59.896 INFO:tasks.workunit.client.0.smithi089.stdout:4/347: creat d2/da/f6d x:0 0 0 2024-09-13T02:53:59.896 INFO:tasks.workunit.client.0.smithi089.stdout:4/348: chown d2/d3/d5/d43/f65 0 1 2024-09-13T02:53:59.896 INFO:tasks.workunit.client.0.smithi089.stdout:4/349: write d2/da/f3d [1175939,67143] 0 2024-09-13T02:53:59.896 INFO:tasks.workunit.client.0.smithi089.stdout:4/350: stat d2/d3/d5/f64 0 2024-09-13T02:53:59.896 INFO:tasks.workunit.client.0.smithi089.stdout:4/351: fdatasync d2/da/f30 0 2024-09-13T02:53:59.897 INFO:tasks.workunit.client.0.smithi089.stdout:5/358: mknod d1/d73/c75 0 2024-09-13T02:53:59.897 INFO:tasks.workunit.client.0.smithi089.stdout:9/306: dread d3/d15/f49 [0,4194304] 0 2024-09-13T02:53:59.897 INFO:tasks.workunit.client.0.smithi089.stdout:9/307: chown d3/c23 3 1 2024-09-13T02:53:59.898 INFO:tasks.workunit.client.0.smithi089.stdout:5/359: mknod d1/d4/d45/d6f/d62/d72/c76 0 2024-09-13T02:53:59.900 INFO:tasks.workunit.client.0.smithi089.stdout:9/308: rename d3/d6/d36/c3a to d3/d15/d5a/c66 0 2024-09-13T02:53:59.902 INFO:tasks.workunit.client.0.smithi089.stdout:2/327: sync 2024-09-13T02:53:59.902 INFO:tasks.workunit.client.0.smithi089.stdout:2/328: read - d13/f70 zero size 2024-09-13T02:53:59.902 INFO:tasks.workunit.client.0.smithi089.stdout:2/329: chown d13/d30/f62 3993 1 2024-09-13T02:53:59.904 INFO:tasks.workunit.client.0.smithi089.stdout:5/360: rename d1/d4/l57 to d1/d4/d45/d6f/l77 0 2024-09-13T02:53:59.907 INFO:tasks.workunit.client.0.smithi089.stdout:9/309: rename d3/d6/d2a/f42 to d3/d3d/f67 0 2024-09-13T02:53:59.907 INFO:tasks.workunit.client.0.smithi089.stdout:2/330: dread d13/d30/f62 [0,4194304] 0 2024-09-13T02:53:59.907 INFO:tasks.workunit.client.0.smithi089.stdout:2/331: stat f3 0 2024-09-13T02:53:59.909 INFO:tasks.workunit.client.0.smithi089.stdout:9/310: unlink d3/l28 0 2024-09-13T02:53:59.910 INFO:tasks.workunit.client.0.smithi089.stdout:9/311: truncate d3/d15/f1b 4505787 0 2024-09-13T02:53:59.910 INFO:tasks.workunit.client.0.smithi089.stdout:4/352: read d2/da/f30 [3169990,72136] 0 2024-09-13T02:53:59.910 INFO:tasks.workunit.client.0.smithi089.stdout:3/310: dwrite d2/d8/f21 [4194304,4194304] 0 2024-09-13T02:53:59.910 INFO:tasks.workunit.client.0.smithi089.stdout:3/311: fdatasync d2/d20/f25 0 2024-09-13T02:53:59.912 INFO:tasks.workunit.client.0.smithi089.stdout:4/353: symlink d2/d3/d5/d43/l6e 0 2024-09-13T02:53:59.913 INFO:tasks.workunit.client.0.smithi089.stdout:4/354: creat d2/d3/d5/d43/d3b/f6f x:0 0 0 2024-09-13T02:53:59.913 INFO:tasks.workunit.client.0.smithi089.stdout:4/355: dread - d2/d3/d5/d43/d3b/f5b zero size 2024-09-13T02:53:59.913 INFO:tasks.workunit.client.0.smithi089.stdout:4/356: chown d2/d55/l5a 518313523 1 2024-09-13T02:53:59.913 INFO:tasks.workunit.client.0.smithi089.stdout:4/357: fsync d2/d3/f25 0 2024-09-13T02:53:59.914 INFO:tasks.workunit.client.0.smithi089.stdout:2/332: rmdir d13/d30/d64 39 2024-09-13T02:53:59.918 INFO:tasks.workunit.client.0.smithi089.stdout:2/333: truncate fd 2631220 0 2024-09-13T02:53:59.918 INFO:tasks.workunit.client.0.smithi089.stdout:8/361: dwrite f5 [4194304,4194304] 0 2024-09-13T02:53:59.919 INFO:tasks.workunit.client.0.smithi089.stdout:8/362: stat de/f10 0 2024-09-13T02:53:59.919 INFO:tasks.workunit.client.0.smithi089.stdout:3/312: symlink d2/l5e 0 2024-09-13T02:53:59.921 INFO:tasks.workunit.client.0.smithi089.stdout:4/358: rename d2/da/f6b to d2/d3/d5/f70 0 2024-09-13T02:53:59.925 INFO:tasks.workunit.client.0.smithi089.stdout:3/313: write d2/d8/f21 [1251276,106907] 0 2024-09-13T02:53:59.925 INFO:tasks.workunit.client.0.smithi089.stdout:3/314: getdents d2/d20/d23/d32/d5b 0 2024-09-13T02:53:59.925 INFO:tasks.workunit.client.0.smithi089.stdout:7/347: dwrite d3/d19/f38 [0,4194304] 0 2024-09-13T02:53:59.927 INFO:tasks.workunit.client.0.smithi089.stdout:2/334: dread d13/f1a [0,4194304] 0 2024-09-13T02:53:59.927 INFO:tasks.workunit.client.0.smithi089.stdout:1/264: dwrite dc/d12/d2c/d34/f4e [0,4194304] 0 2024-09-13T02:53:59.927 INFO:tasks.workunit.client.0.smithi089.stdout:1/265: stat dc/f1c 0 2024-09-13T02:53:59.927 INFO:tasks.workunit.client.0.smithi089.stdout:2/335: creat d13/d30/d4e/f71 x:0 0 0 2024-09-13T02:53:59.927 INFO:tasks.workunit.client.0.smithi089.stdout:1/266: creat dc/d12/d2c/d36/f51 x:0 0 0 2024-09-13T02:53:59.927 INFO:tasks.workunit.client.0.smithi089.stdout:1/267: chown dc/d44/f45 15316 1 2024-09-13T02:53:59.929 INFO:tasks.workunit.client.0.smithi089.stdout:7/348: mkdir d3/d19/d2d/d14/d71 0 2024-09-13T02:53:59.929 INFO:tasks.workunit.client.0.smithi089.stdout:7/349: chown d3/d19/d2e/d37/c61 268564 1 2024-09-13T02:53:59.929 INFO:tasks.workunit.client.0.smithi089.stdout:4/359: dread d2/da/f45 [0,4194304] 0 2024-09-13T02:53:59.932 INFO:tasks.workunit.client.0.smithi089.stdout:0/253: dwrite d2/d19/d1a/d1e/d42/f49 [0,4194304] 0 2024-09-13T02:53:59.933 INFO:tasks.workunit.client.0.smithi089.stdout:5/361: dwrite d1/d4/f25 [0,4194304] 0 2024-09-13T02:53:59.933 INFO:tasks.workunit.client.0.smithi089.stdout:5/362: creat d1/f78 x:0 0 0 2024-09-13T02:53:59.934 INFO:tasks.workunit.client.0.smithi089.stdout:5/363: write d1/d4/d45/d6f/f42 [742203,119829] 0 2024-09-13T02:53:59.937 INFO:tasks.workunit.client.0.smithi089.stdout:1/268: dread dc/d12/d2c/d34/f39 [0,4194304] 0 2024-09-13T02:53:59.937 INFO:tasks.workunit.client.0.smithi089.stdout:1/269: fdatasync dc/d12/d2c/d34/f39 0 2024-09-13T02:53:59.937 INFO:tasks.workunit.client.0.smithi089.stdout:1/270: creat dc/d12/f52 x:0 0 0 2024-09-13T02:53:59.939 INFO:tasks.workunit.client.0.smithi089.stdout:3/315: dread d2/f2d [0,4194304] 0 2024-09-13T02:53:59.943 INFO:tasks.workunit.client.0.smithi089.stdout:2/336: write d13/d30/d64/f6e [3987396,17444] 0 2024-09-13T02:53:59.943 INFO:tasks.workunit.client.0.smithi089.stdout:5/364: dread d1/d4/d1c/d49/f5d [0,4194304] 0 2024-09-13T02:53:59.943 INFO:tasks.workunit.client.0.smithi089.stdout:9/312: dwrite d3/d15/f49 [0,4194304] 0 2024-09-13T02:53:59.943 INFO:tasks.workunit.client.0.smithi089.stdout:9/313: fsync d3/d6/df/d24/d35/f45 0 2024-09-13T02:53:59.944 INFO:tasks.workunit.client.0.smithi089.stdout:9/314: fdatasync d3/f22 0 2024-09-13T02:53:59.944 INFO:tasks.workunit.client.0.smithi089.stdout:9/315: write d3/d6/df/d24/f48 [1744061,30440] 0 2024-09-13T02:53:59.944 INFO:tasks.workunit.client.0.smithi089.stdout:9/316: write f2 [583660,115434] 0 2024-09-13T02:53:59.950 INFO:tasks.workunit.client.0.smithi089.stdout:7/350: read d3/d19/f3d [1110384,8589] 0 2024-09-13T02:53:59.950 INFO:tasks.workunit.client.0.smithi089.stdout:8/363: rmdir de/d16 39 2024-09-13T02:53:59.951 INFO:tasks.workunit.client.0.smithi089.stdout:8/364: write de/d16/d1e/d20/d39/f70 [137450,39364] 0 2024-09-13T02:53:59.953 INFO:tasks.workunit.client.0.smithi089.stdout:3/316: unlink d2/d20/d23/d27/d51/f52 0 2024-09-13T02:53:59.954 INFO:tasks.workunit.client.0.smithi089.stdout:2/337: dread d13/f54 [0,4194304] 0 2024-09-13T02:53:59.955 INFO:tasks.workunit.client.0.smithi089.stdout:2/338: creat d13/f72 x:0 0 0 2024-09-13T02:53:59.963 INFO:tasks.workunit.client.0.smithi089.stdout:7/351: chown d3/c9 7 1 2024-09-13T02:53:59.964 INFO:tasks.workunit.client.0.smithi089.stdout:4/360: rmdir d2/d22/d4f 0 2024-09-13T02:53:59.968 INFO:tasks.workunit.client.0.smithi089.stdout:3/317: mkdir d2/d8/d5f 0 2024-09-13T02:53:59.971 INFO:tasks.workunit.client.0.smithi089.stdout:2/339: dwrite d13/f32 [0,4194304] 0 2024-09-13T02:53:59.971 INFO:tasks.workunit.client.0.smithi089.stdout:2/340: creat d13/d30/f73 x:0 0 0 2024-09-13T02:53:59.971 INFO:tasks.workunit.client.0.smithi089.stdout:2/341: creat d13/d30/d4e/f74 x:0 0 0 2024-09-13T02:53:59.972 INFO:tasks.workunit.client.0.smithi089.stdout:2/342: creat d13/d30/f75 x:0 0 0 2024-09-13T02:53:59.972 INFO:tasks.workunit.client.0.smithi089.stdout:7/352: mknod d3/d47/c72 0 2024-09-13T02:53:59.980 INFO:tasks.workunit.client.0.smithi089.stdout:3/318: write d2/f16 [1160680,99786] 0 2024-09-13T02:53:59.980 INFO:tasks.workunit.client.0.smithi089.stdout:3/319: creat d2/d8/dc/d3c/f60 x:0 0 0 2024-09-13T02:53:59.980 INFO:tasks.workunit.client.0.smithi089.stdout:3/320: chown d2/d20/d23/d2b/f2f 34442789 1 2024-09-13T02:53:59.981 INFO:tasks.workunit.client.0.smithi089.stdout:2/343: unlink d13/d30/c3e 0 2024-09-13T02:53:59.983 INFO:tasks.workunit.client.0.smithi089.stdout:7/353: dread d3/d44/f39 [0,4194304] 0 2024-09-13T02:53:59.983 INFO:tasks.workunit.client.0.smithi089.stdout:3/321: symlink d2/d20/l61 0 2024-09-13T02:53:59.985 INFO:tasks.workunit.client.0.smithi089.stdout:7/354: rmdir d3/d19/d2d/d63 39 2024-09-13T02:53:59.986 INFO:tasks.workunit.client.0.smithi089.stdout:7/355: mknod d3/d19/d2d/d14/d71/c73 0 2024-09-13T02:53:59.987 INFO:tasks.workunit.client.0.smithi089.stdout:7/356: unlink d3/c3c 0 2024-09-13T02:53:59.988 INFO:tasks.workunit.client.0.smithi089.stdout:7/357: mknod d3/d19/d2d/d63/d65/d66/c74 0 2024-09-13T02:53:59.998 INFO:tasks.workunit.client.0.smithi089.stdout:5/365: dread d1/d4/d45/d6f/f42 [0,4194304] 0 2024-09-13T02:54:00.001 INFO:tasks.workunit.client.0.smithi089.stdout:4/361: dwrite d2/da/f45 [0,4194304] 0 2024-09-13T02:54:00.002 INFO:tasks.workunit.client.0.smithi089.stdout:4/362: fdatasync d2/d3/f25 0 2024-09-13T02:54:00.003 INFO:tasks.workunit.client.0.smithi089.stdout:1/271: rename dc/d12 to dc/d3a/d53 0 2024-09-13T02:54:00.005 INFO:tasks.workunit.client.0.smithi089.stdout:9/317: rename d3/d15/l26 to d3/d6/df/d24/d32/l68 0 2024-09-13T02:54:00.006 INFO:tasks.workunit.client.0.smithi089.stdout:1/272: mknod dc/d3a/d53/d2c/d36/c54 0 2024-09-13T02:54:00.007 INFO:tasks.workunit.client.0.smithi089.stdout:4/363: getdents d2/da 0 2024-09-13T02:54:00.009 INFO:tasks.workunit.client.0.smithi089.stdout:2/344: rename d13/d30/d59/d5f to d13/d30/d4e/d6f/d76 0 2024-09-13T02:54:00.012 INFO:tasks.workunit.client.0.smithi089.stdout:3/322: rename d2/f14 to d2/d8/d5f/f62 0 2024-09-13T02:54:00.012 INFO:tasks.workunit.client.0.smithi089.stdout:3/323: chown d2/d20/d23/d32/d49/f56 1146 1 2024-09-13T02:54:00.014 INFO:tasks.workunit.client.0.smithi089.stdout:2/345: dread d13/d30/f62 [0,4194304] 0 2024-09-13T02:54:00.017 INFO:tasks.workunit.client.0.smithi089.stdout:2/346: rename d13/d30/c1f to d13/d30/d59/c77 0 2024-09-13T02:54:00.019 INFO:tasks.workunit.client.0.smithi089.stdout:2/347: truncate d13/f17 2208159 0 2024-09-13T02:54:00.019 INFO:tasks.workunit.client.0.smithi089.stdout:2/348: dread - d13/d30/f6b zero size 2024-09-13T02:54:00.019 INFO:tasks.workunit.client.0.smithi089.stdout:2/349: write d13/d30/d64/f6e [2917371,90824] 0 2024-09-13T02:54:00.023 INFO:tasks.workunit.client.0.smithi089.stdout:2/350: mkdir d13/d30/d61/d78 0 2024-09-13T02:54:00.023 INFO:tasks.workunit.client.0.smithi089.stdout:2/351: chown d13/d30/f49 113544447 1 2024-09-13T02:54:00.027 INFO:tasks.workunit.client.0.smithi089.stdout:9/318: dwrite d3/d6/d2a/d4b/f59 [0,4194304] 0 2024-09-13T02:54:00.028 INFO:tasks.workunit.client.0.smithi089.stdout:7/358: rename d3/d19/d2d to d3/d19/d75 0 2024-09-13T02:54:00.028 INFO:tasks.workunit.client.0.smithi089.stdout:7/359: fdatasync d3/d19/f3d 0 2024-09-13T02:54:00.029 INFO:tasks.workunit.client.0.smithi089.stdout:1/273: getdents dc/d3a 0 2024-09-13T02:54:00.033 INFO:tasks.workunit.client.0.smithi089.stdout:1/274: creat dc/d46/f55 x:0 0 0 2024-09-13T02:54:00.034 INFO:tasks.workunit.client.0.smithi089.stdout:1/275: dread - dc/d3a/d53/d2c/d36/f3d zero size 2024-09-13T02:54:00.034 INFO:tasks.workunit.client.0.smithi089.stdout:7/360: mknod d3/c76 0 2024-09-13T02:54:00.034 INFO:tasks.workunit.client.0.smithi089.stdout:7/361: stat d3/d19/d2e/d37/c61 0 2024-09-13T02:54:00.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:53:59 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:54:00.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:53:59 smithi089 ceph-mon[27639]: pgmap v242: 65 pgs: 65 active+clean; 1.5 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail; 153 MiB/s rd, 206 MiB/s wr, 651 op/s 2024-09-13T02:54:00.035 INFO:tasks.workunit.client.0.smithi089.stdout:1/276: mknod dc/c56 0 2024-09-13T02:54:00.035 INFO:tasks.workunit.client.0.smithi089.stdout:7/362: mkdir d3/d47/d77 0 2024-09-13T02:54:00.035 INFO:tasks.workunit.client.0.smithi089.stdout:7/363: chown d3/c76 0 1 2024-09-13T02:54:00.036 INFO:tasks.workunit.client.0.smithi089.stdout:7/364: rename d3/d19 to d3/d19/d78 22 2024-09-13T02:54:00.037 INFO:tasks.workunit.client.0.smithi089.stdout:7/365: rename d3/d19/c53 to d3/d19/d2e/c79 0 2024-09-13T02:54:00.038 INFO:tasks.workunit.client.0.smithi089.stdout:1/277: write f3 [4357756,75136] 0 2024-09-13T02:54:00.039 INFO:tasks.workunit.client.0.smithi089.stdout:4/364: dwrite d2/d3/de/f36 [0,4194304] 0 2024-09-13T02:54:00.039 INFO:tasks.workunit.client.0.smithi089.stdout:4/365: readlink d2/d3/d5/d43/l6e 0 2024-09-13T02:54:00.039 INFO:tasks.workunit.client.0.smithi089.stdout:4/366: write d2/d3/d5/d43/f50 [4818677,116310] 0 2024-09-13T02:54:00.039 INFO:tasks.workunit.client.0.smithi089.stdout:3/324: dwrite d2/d8/f21 [0,4194304] 0 2024-09-13T02:54:00.039 INFO:tasks.workunit.client.0.smithi089.stdout:7/366: rename d3/d19/d75/d63/d65/d66 to d3/d19/d2e/d7a 0 2024-09-13T02:54:00.044 INFO:tasks.workunit.client.0.smithi089.stdout:4/367: mkdir d2/d3/d5/d43/d3b/d71 0 2024-09-13T02:54:00.045 INFO:tasks.workunit.client.0.smithi089.stdout:3/325: stat d2/d20/l40 0 2024-09-13T02:54:00.047 INFO:tasks.workunit.client.0.smithi089.stdout:7/367: creat d3/d19/d67/f7b x:0 0 0 2024-09-13T02:54:00.047 INFO:tasks.workunit.client.0.smithi089.stdout:7/368: fdatasync d3/d19/d75/d14/f1c 0 2024-09-13T02:54:00.047 INFO:tasks.workunit.client.0.smithi089.stdout:7/369: fdatasync d3/d19/d2e/f60 0 2024-09-13T02:54:00.047 INFO:tasks.workunit.client.0.smithi089.stdout:7/370: readlink d3/d19/d2e/l35 0 2024-09-13T02:54:00.047 INFO:tasks.workunit.client.0.smithi089.stdout:7/371: fsync d3/d47/f50 0 2024-09-13T02:54:00.048 INFO:tasks.workunit.client.0.smithi089.stdout:6/332: sync 2024-09-13T02:54:00.049 INFO:tasks.workunit.client.0.smithi089.stdout:3/326: mkdir d2/d20/d63 0 2024-09-13T02:54:00.050 INFO:tasks.workunit.client.0.smithi089.stdout:7/372: creat d3/f7c x:0 0 0 2024-09-13T02:54:00.052 INFO:tasks.workunit.client.0.smithi089.stdout:4/368: mkdir d2/d3/d5/d72 0 2024-09-13T02:54:00.052 INFO:tasks.workunit.client.0.smithi089.stdout:4/369: stat d2/da/f45 0 2024-09-13T02:54:00.052 INFO:tasks.workunit.client.0.smithi089.stdout:4/370: write d2/d3/d5/d43/f50 [664741,121695] 0 2024-09-13T02:54:00.052 INFO:tasks.workunit.client.0.smithi089.stdout:1/278: dwrite dc/d3a/d53/d2c/d36/f51 [0,4194304] 0 2024-09-13T02:54:00.053 INFO:tasks.workunit.client.0.smithi089.stdout:3/327: creat d2/d8/d5f/f64 x:0 0 0 2024-09-13T02:54:00.053 INFO:tasks.workunit.client.0.smithi089.stdout:6/333: write db/d43/d6e/f55 [1961925,2537] 0 2024-09-13T02:54:00.053 INFO:tasks.workunit.client.0.smithi089.stdout:4/371: write d2/f53 [949101,35571] 0 2024-09-13T02:54:00.054 INFO:tasks.workunit.client.0.smithi089.stdout:7/373: truncate d3/d19/f4d 1339451 0 2024-09-13T02:54:00.056 INFO:tasks.workunit.client.0.smithi089.stdout:3/328: mkdir d2/d8/dc/d3c/d65 0 2024-09-13T02:54:00.059 INFO:tasks.workunit.client.0.smithi089.stdout:4/372: rename d2/d3/de/f16 to d2/f73 0 2024-09-13T02:54:00.059 INFO:tasks.workunit.client.0.smithi089.stdout:4/373: chown d2/f4b 188548390 1 2024-09-13T02:54:00.060 INFO:tasks.workunit.client.0.smithi089.stdout:4/374: dread - d2/d3/d5/d43/f65 zero size 2024-09-13T02:54:00.060 INFO:tasks.workunit.client.0.smithi089.stdout:4/375: dread - d2/d3/d5/d43/d3b/f6f zero size 2024-09-13T02:54:00.061 INFO:tasks.workunit.client.0.smithi089.stdout:3/329: mknod d2/d8/dc/d57/c66 0 2024-09-13T02:54:00.065 INFO:tasks.workunit.client.0.smithi089.stdout:1/279: dread dc/f1e [0,4194304] 0 2024-09-13T02:54:00.065 INFO:tasks.workunit.client.0.smithi089.stdout:1/280: fdatasync dc/d3a/d53/d2c/d34/f39 0 2024-09-13T02:54:00.068 INFO:tasks.workunit.client.0.smithi089.stdout:1/281: fdatasync f3 0 2024-09-13T02:54:00.069 INFO:tasks.workunit.client.0.smithi089.stdout:1/282: fdatasync dc/f1c 0 2024-09-13T02:54:00.069 INFO:tasks.workunit.client.0.smithi089.stdout:1/283: chown dc/d3a/d53/d2c/d34/f4e 1715645 1 2024-09-13T02:54:00.069 INFO:tasks.workunit.client.0.smithi089.stdout:1/284: stat dc/d3a/d53/d2c/f2e 0 2024-09-13T02:54:00.091 INFO:tasks.workunit.client.0.smithi089.stdout:7/374: dwrite d3/f7c [0,4194304] 0 2024-09-13T02:54:00.091 INFO:tasks.workunit.client.0.smithi089.stdout:7/375: chown d3/d19/d75/f29 10457 1 2024-09-13T02:54:00.091 INFO:tasks.workunit.client.0.smithi089.stdout:7/376: write d3/d47/d55/f6b [880546,99953] 0 2024-09-13T02:54:00.091 INFO:tasks.workunit.client.0.smithi089.stdout:7/377: chown d3/d19/d75/d14/d71/c73 12274227 1 2024-09-13T02:54:00.091 INFO:tasks.workunit.client.0.smithi089.stdout:6/334: dwrite db/d43/d6e/d28/d46/d53/f5a [0,4194304] 0 2024-09-13T02:54:00.106 INFO:tasks.workunit.client.0.smithi089.stdout:6/335: write db/f1d [3200997,129339] 0 2024-09-13T02:54:00.106 INFO:tasks.workunit.client.0.smithi089.stdout:7/378: dread d3/f7c [0,4194304] 0 2024-09-13T02:54:00.106 INFO:tasks.workunit.client.0.smithi089.stdout:6/336: fdatasync db/d43/d6e/f2c 0 2024-09-13T02:54:00.106 INFO:tasks.workunit.client.0.smithi089.stdout:6/337: readlink db/d10/l70 0 2024-09-13T02:54:00.106 INFO:tasks.workunit.client.0.smithi089.stdout:7/379: write d3/f1b [3960564,107600] 0 2024-09-13T02:54:00.106 INFO:tasks.workunit.client.0.smithi089.stdout:6/338: write db/f49 [758094,81502] 0 2024-09-13T02:54:00.107 INFO:tasks.workunit.client.0.smithi089.stdout:6/339: write db/d10/d3a/f5e [828539,129199] 0 2024-09-13T02:54:00.108 INFO:tasks.workunit.client.0.smithi089.stdout:6/340: creat db/d43/d60/f79 x:0 0 0 2024-09-13T02:54:00.109 INFO:tasks.workunit.client.0.smithi089.stdout:6/341: symlink db/d43/d6e/d28/d46/l7a 0 2024-09-13T02:54:00.111 INFO:tasks.workunit.client.0.smithi089.stdout:4/376: dwrite d2/f4c [4194304,4194304] 0 2024-09-13T02:54:00.113 INFO:tasks.workunit.client.0.smithi089.stdout:6/342: getdents db/d43/d6e/d28/d46/d53 0 2024-09-13T02:54:00.113 INFO:tasks.workunit.client.0.smithi089.stdout:6/343: truncate db/d43/d6e/f2c 557470 0 2024-09-13T02:54:00.116 INFO:tasks.workunit.client.0.smithi089.stdout:7/380: read d3/d19/d75/f5a [2229527,41293] 0 2024-09-13T02:54:00.117 INFO:tasks.workunit.client.0.smithi089.stdout:7/381: write d3/d44/f70 [211564,48656] 0 2024-09-13T02:54:00.117 INFO:tasks.workunit.client.0.smithi089.stdout:7/382: write d3/d19/d2e/f6e [783244,61198] 0 2024-09-13T02:54:00.118 INFO:tasks.workunit.client.0.smithi089.stdout:6/344: mkdir db/d10/d3a/d7b 0 2024-09-13T02:54:00.119 INFO:tasks.workunit.client.0.smithi089.stdout:4/377: dread d2/f40 [0,4194304] 0 2024-09-13T02:54:00.119 INFO:tasks.workunit.client.0.smithi089.stdout:1/285: dwrite dc/f10 [0,4194304] 0 2024-09-13T02:54:00.125 INFO:tasks.workunit.client.0.smithi089.stdout:7/383: symlink d3/d19/d2e/d37/l7d 0 2024-09-13T02:54:00.126 INFO:tasks.workunit.client.0.smithi089.stdout:7/384: write d3/d19/d75/f3b [1670029,101460] 0 2024-09-13T02:54:00.126 INFO:tasks.workunit.client.0.smithi089.stdout:7/385: chown d3/d54 63251682 1 2024-09-13T02:54:00.126 INFO:tasks.workunit.client.0.smithi089.stdout:7/386: readlink d3/d19/d75/l48 0 2024-09-13T02:54:00.126 INFO:tasks.workunit.client.0.smithi089.stdout:6/345: creat db/d10/d3a/d7b/f7c x:0 0 0 2024-09-13T02:54:00.126 INFO:tasks.workunit.client.0.smithi089.stdout:6/346: chown db/c4d 18859820 1 2024-09-13T02:54:00.128 INFO:tasks.workunit.client.0.smithi089.stdout:4/378: rmdir d2/d22 39 2024-09-13T02:54:00.129 INFO:tasks.workunit.client.0.smithi089.stdout:1/286: mkdir dc/d57 0 2024-09-13T02:54:00.131 INFO:tasks.workunit.client.0.smithi089.stdout:7/387: unlink d3/d19/d2e/f60 0 2024-09-13T02:54:00.131 INFO:tasks.workunit.client.0.smithi089.stdout:7/388: write d3/d19/d75/f18 [4321746,95477] 0 2024-09-13T02:54:00.132 INFO:tasks.workunit.client.0.smithi089.stdout:6/347: mkdir db/d43/d60/d7d 0 2024-09-13T02:54:00.132 INFO:tasks.workunit.client.0.smithi089.stdout:6/348: chown db/d43/d6e/d28/d37/f72 7 1 2024-09-13T02:54:00.133 INFO:tasks.workunit.client.0.smithi089.stdout:4/379: rename d2/d3/l4e to d2/d22/l74 0 2024-09-13T02:54:00.133 INFO:tasks.workunit.client.0.smithi089.stdout:4/380: read d2/d3/f25 [163716,128571] 0 2024-09-13T02:54:00.133 INFO:tasks.workunit.client.0.smithi089.stdout:4/381: truncate d2/d22/f34 17225 0 2024-09-13T02:54:00.135 INFO:tasks.workunit.client.0.smithi089.stdout:1/287: link dc/d3a/d53/f15 dc/d3a/d53/d2c/d36/f58 0 2024-09-13T02:54:00.137 INFO:tasks.workunit.client.0.smithi089.stdout:7/389: unlink d3/d19/d75/f3b 0 2024-09-13T02:54:00.137 INFO:tasks.workunit.client.0.smithi089.stdout:7/390: readlink d3/l59 0 2024-09-13T02:54:00.139 INFO:tasks.workunit.client.0.smithi089.stdout:6/349: mkdir db/d43/d6e/d28/d46/d7e 0 2024-09-13T02:54:00.141 INFO:tasks.workunit.client.0.smithi089.stdout:4/382: rename d2/d22/f26 to d2/da/f75 0 2024-09-13T02:54:00.141 INFO:tasks.workunit.client.0.smithi089.stdout:4/383: readlink d2/d22/l27 0 2024-09-13T02:54:00.143 INFO:tasks.workunit.client.0.smithi089.stdout:1/288: symlink dc/d3a/l59 0 2024-09-13T02:54:00.143 INFO:tasks.workunit.client.0.smithi089.stdout:1/289: chown dc/d3a/d53/d2c/d36/f58 13732 1 2024-09-13T02:54:00.144 INFO:tasks.workunit.client.0.smithi089.stdout:4/384: link d2/d3/de/c5d d2/d3/de/d62/c76 0 2024-09-13T02:54:00.145 INFO:tasks.workunit.client.0.smithi089.stdout:1/290: truncate dc/d3a/d53/d2c/d34/f4e 3285699 0 2024-09-13T02:54:00.146 INFO:tasks.workunit.client.0.smithi089.stdout:1/291: chown dc/d3a/d53/f28 6125 1 2024-09-13T02:54:00.146 INFO:tasks.workunit.client.0.smithi089.stdout:4/385: dread d2/d22/f34 [0,4194304] 0 2024-09-13T02:54:00.146 INFO:tasks.workunit.client.0.smithi089.stdout:1/292: write dc/d3a/d53/f52 [844885,129758] 0 2024-09-13T02:54:00.146 INFO:tasks.workunit.client.0.smithi089.stdout:1/293: fsync dc/d3a/d53/f4b 0 2024-09-13T02:54:00.146 INFO:tasks.workunit.client.0.smithi089.stdout:1/294: chown dc/d3a/d53/d2c/d36/f38 401381 1 2024-09-13T02:54:00.146 INFO:tasks.workunit.client.0.smithi089.stdout:1/295: fsync dc/d3a/d53/d2c/d36/f3d 0 2024-09-13T02:54:00.146 INFO:tasks.workunit.client.0.smithi089.stdout:7/391: write d3/d19/d75/d14/f1c [3521122,7070] 0 2024-09-13T02:54:00.147 INFO:tasks.workunit.client.0.smithi089.stdout:6/350: dread db/d43/d6e/d28/d2f/f33 [0,4194304] 0 2024-09-13T02:54:00.147 INFO:tasks.workunit.client.0.smithi089.stdout:4/386: rename d2/d3/de/c29 to d2/d22/c77 0 2024-09-13T02:54:00.147 INFO:tasks.workunit.client.0.smithi089.stdout:8/365: sync 2024-09-13T02:54:00.148 INFO:tasks.workunit.client.0.smithi089.stdout:0/254: sync 2024-09-13T02:54:00.150 INFO:tasks.workunit.client.0.smithi089.stdout:4/387: mkdir d2/d3/d5/d43/d3b/d71/d78 0 2024-09-13T02:54:00.150 INFO:tasks.workunit.client.0.smithi089.stdout:0/255: mknod d2/d19/d1a/d4e/c54 0 2024-09-13T02:54:00.152 INFO:tasks.workunit.client.0.smithi089.stdout:8/366: creat de/d16/d1e/d3f/f73 x:0 0 0 2024-09-13T02:54:00.154 INFO:tasks.workunit.client.0.smithi089.stdout:7/392: truncate d3/d19/f41 2566591 0 2024-09-13T02:54:00.154 INFO:tasks.workunit.client.0.smithi089.stdout:7/393: write d3/f5 [2350386,124446] 0 2024-09-13T02:54:00.154 INFO:tasks.workunit.client.0.smithi089.stdout:7/394: truncate d3/d19/d75/f18 5075583 0 2024-09-13T02:54:00.154 INFO:tasks.workunit.client.0.smithi089.stdout:7/395: write d3/d19/d2e/f6e [1293319,13169] 0 2024-09-13T02:54:00.155 INFO:tasks.workunit.client.0.smithi089.stdout:4/388: mknod d2/d3/d5/d43/d3b/c79 0 2024-09-13T02:54:00.156 INFO:tasks.workunit.client.0.smithi089.stdout:1/296: write dc/d3a/d53/f28 [3592102,104856] 0 2024-09-13T02:54:00.157 INFO:tasks.workunit.client.0.smithi089.stdout:1/297: truncate dc/d46/f55 807458 0 2024-09-13T02:54:00.157 INFO:tasks.workunit.client.0.smithi089.stdout:1/298: fdatasync f7 0 2024-09-13T02:54:00.157 INFO:tasks.workunit.client.0.smithi089.stdout:8/367: rename de/d16/d1e/d20/f3d to de/d16/d1e/d27/d35/f74 0 2024-09-13T02:54:00.161 INFO:tasks.workunit.client.0.smithi089.stdout:4/389: symlink d2/d3/d5/d72/l7a 0 2024-09-13T02:54:00.164 INFO:tasks.workunit.client.0.smithi089.stdout:1/299: link dc/fe dc/d3a/f5a 0 2024-09-13T02:54:00.166 INFO:tasks.workunit.client.0.smithi089.stdout:8/368: creat de/d16/d1e/d27/d52/d61/f75 x:0 0 0 2024-09-13T02:54:00.168 INFO:tasks.workunit.client.0.smithi089.stdout:7/396: link d3/ld d3/d19/d75/d14/l7e 0 2024-09-13T02:54:00.170 INFO:tasks.workunit.client.0.smithi089.stdout:1/300: dread dc/f1c [0,4194304] 0 2024-09-13T02:54:00.171 INFO:tasks.workunit.client.0.smithi089.stdout:7/397: rename d3/c76 to d3/d19/d75/d14/c7f 0 2024-09-13T02:54:00.174 INFO:tasks.workunit.client.0.smithi089.stdout:1/301: creat dc/d3a/d53/d2c/d34/d43/f5b x:0 0 0 2024-09-13T02:54:00.174 INFO:tasks.workunit.client.0.smithi089.stdout:1/302: chown dc/f1c 336926814 1 2024-09-13T02:54:00.175 INFO:tasks.workunit.client.0.smithi089.stdout:1/303: mknod dc/d57/c5c 0 2024-09-13T02:54:00.176 INFO:tasks.workunit.client.0.smithi089.stdout:8/369: dread de/d16/d1e/f31 [0,4194304] 0 2024-09-13T02:54:00.177 INFO:tasks.workunit.client.0.smithi089.stdout:8/370: dread de/d16/d1e/f4e [0,4194304] 0 2024-09-13T02:54:00.179 INFO:tasks.workunit.client.0.smithi089.stdout:1/304: rename dc/lf to dc/d3a/d53/d2c/l5d 0 2024-09-13T02:54:00.179 INFO:tasks.workunit.client.0.smithi089.stdout:6/351: dwrite db/d10/f59 [0,4194304] 0 2024-09-13T02:54:00.182 INFO:tasks.workunit.client.0.smithi089.stdout:8/371: rename de/d16/d1e/d45 to de/d16/d1e/d27/d76 0 2024-09-13T02:54:00.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:53:59 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:54:00.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:53:59 smithi131 ceph-mon[34689]: pgmap v242: 65 pgs: 65 active+clean; 1.5 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail; 153 MiB/s rd, 206 MiB/s wr, 651 op/s 2024-09-13T02:54:00.184 INFO:tasks.workunit.client.0.smithi089.stdout:0/256: dwrite d2/fe [0,4194304] 0 2024-09-13T02:54:00.185 INFO:tasks.workunit.client.0.smithi089.stdout:0/257: stat d2/f29 0 2024-09-13T02:54:00.186 INFO:tasks.workunit.client.0.smithi089.stdout:6/352: mknod db/d43/c7f 0 2024-09-13T02:54:00.186 INFO:tasks.workunit.client.0.smithi089.stdout:6/353: dread - db/d10/f4f zero size 2024-09-13T02:54:00.186 INFO:tasks.workunit.client.0.smithi089.stdout:6/354: dread - db/d10/d3a/f42 zero size 2024-09-13T02:54:00.186 INFO:tasks.workunit.client.0.smithi089.stdout:6/355: chown c7 648 1 2024-09-13T02:54:00.186 INFO:tasks.workunit.client.0.smithi089.stdout:6/356: creat db/d10/f80 x:0 0 0 2024-09-13T02:54:00.186 INFO:tasks.workunit.client.0.smithi089.stdout:6/357: creat db/d10/d3a/f81 x:0 0 0 2024-09-13T02:54:00.190 INFO:tasks.workunit.client.0.smithi089.stdout:8/372: creat de/d16/d1e/d27/d76/f77 x:0 0 0 2024-09-13T02:54:00.190 INFO:tasks.workunit.client.0.smithi089.stdout:8/373: dread - de/d16/d1e/d3f/f49 zero size 2024-09-13T02:54:00.190 INFO:tasks.workunit.client.0.smithi089.stdout:8/374: stat de/d16/d1e/d27/d76/f77 0 2024-09-13T02:54:00.191 INFO:tasks.workunit.client.0.smithi089.stdout:7/398: dwrite d3/d47/d55/f6b [0,4194304] 0 2024-09-13T02:54:00.191 INFO:tasks.workunit.client.0.smithi089.stdout:7/399: fdatasync d3/d19/d2e/f33 0 2024-09-13T02:54:00.191 INFO:tasks.workunit.client.0.smithi089.stdout:7/400: write d3/d19/d75/f18 [3819815,128189] 0 2024-09-13T02:54:00.191 INFO:tasks.workunit.client.0.smithi089.stdout:7/401: readlink d3/d44/l2c 0 2024-09-13T02:54:00.191 INFO:tasks.workunit.client.0.smithi089.stdout:7/402: creat d3/d19/d67/f80 x:0 0 0 2024-09-13T02:54:00.197 INFO:tasks.workunit.client.0.smithi089.stdout:8/375: rmdir de/d16/d1e/d20/d6c 39 2024-09-13T02:54:00.202 INFO:tasks.workunit.client.0.smithi089.stdout:7/403: mknod d3/d19/d75/c81 0 2024-09-13T02:54:00.203 INFO:tasks.workunit.client.0.smithi089.stdout:8/376: creat de/d16/d1e/d3f/d5b/f78 x:0 0 0 2024-09-13T02:54:00.204 INFO:tasks.workunit.client.0.smithi089.stdout:7/404: mkdir d3/d19/d67/d82 0 2024-09-13T02:54:00.205 INFO:tasks.workunit.client.0.smithi089.stdout:7/405: getdents d3/d47/d5e/d6f 0 2024-09-13T02:54:00.205 INFO:tasks.workunit.client.0.smithi089.stdout:7/406: dread - d3/d47/f50 zero size 2024-09-13T02:54:00.205 INFO:tasks.workunit.client.0.smithi089.stdout:7/407: readlink d3/d20/l57 0 2024-09-13T02:54:00.206 INFO:tasks.workunit.client.0.smithi089.stdout:7/408: mkdir d3/d19/d75/d63/d83 0 2024-09-13T02:54:00.206 INFO:tasks.workunit.client.0.smithi089.stdout:7/409: chown d3/d19/d67/f7b 8 1 2024-09-13T02:54:00.211 INFO:tasks.workunit.client.0.smithi089.stdout:6/358: dwrite db/d10/d3a/f81 [0,4194304] 0 2024-09-13T02:54:00.211 INFO:tasks.workunit.client.0.smithi089.stdout:1/305: dwrite dc/d3a/d53/f15 [0,4194304] 0 2024-09-13T02:54:00.212 INFO:tasks.workunit.client.0.smithi089.stdout:0/258: dwrite d2/f34 [0,4194304] 0 2024-09-13T02:54:00.216 INFO:tasks.workunit.client.0.smithi089.stdout:6/359: rename db/d10/d3a/c63 to db/c82 0 2024-09-13T02:54:00.220 INFO:tasks.workunit.client.0.smithi089.stdout:8/377: write de/f1a [3561310,4055] 0 2024-09-13T02:54:00.223 INFO:tasks.workunit.client.0.smithi089.stdout:0/259: rmdir d2 39 2024-09-13T02:54:00.223 INFO:tasks.workunit.client.0.smithi089.stdout:0/260: chown d2/d19/d1a/f3c 11090 1 2024-09-13T02:54:00.223 INFO:tasks.workunit.client.0.smithi089.stdout:0/261: write d2/f17 [2033921,83167] 0 2024-09-13T02:54:00.224 INFO:tasks.workunit.client.0.smithi089.stdout:6/360: mkdir db/d43/d6e/d28/d46/d53/d83 0 2024-09-13T02:54:00.226 INFO:tasks.workunit.client.0.smithi089.stdout:8/378: creat de/d16/d1e/d27/f79 x:0 0 0 2024-09-13T02:54:00.226 INFO:tasks.workunit.client.0.smithi089.stdout:8/379: getdents de/d16/d1e/d20/d6c/d6e 0 2024-09-13T02:54:00.229 INFO:tasks.workunit.client.0.smithi089.stdout:0/262: creat d2/d19/d1a/d3d/d4b/f55 x:0 0 0 2024-09-13T02:54:00.232 INFO:tasks.workunit.client.0.smithi089.stdout:8/380: creat de/d16/d1e/d67/f7a x:0 0 0 2024-09-13T02:54:00.232 INFO:tasks.workunit.client.0.smithi089.stdout:8/381: creat de/d16/d1e/d27/d52/d61/f7b x:0 0 0 2024-09-13T02:54:00.232 INFO:tasks.workunit.client.0.smithi089.stdout:8/382: chown de/d16/f6f 23 1 2024-09-13T02:54:00.233 INFO:tasks.workunit.client.0.smithi089.stdout:0/263: rename d2/d19/d1a/d1e/f27 to d2/d19/d1a/f56 0 2024-09-13T02:54:00.236 INFO:tasks.workunit.client.0.smithi089.stdout:0/264: rmdir d2/d19/d1a/d1e 39 2024-09-13T02:54:00.238 INFO:tasks.workunit.client.0.smithi089.stdout:7/410: dwrite f0 [0,4194304] 0 2024-09-13T02:54:00.238 INFO:tasks.workunit.client.0.smithi089.stdout:7/411: chown d3/d19/d75 34 1 2024-09-13T02:54:00.238 INFO:tasks.workunit.client.0.smithi089.stdout:7/412: stat d3/d19/d75/d14/f1c 0 2024-09-13T02:54:00.238 INFO:tasks.workunit.client.0.smithi089.stdout:1/306: dwrite dc/d3a/d53/f15 [0,4194304] 0 2024-09-13T02:54:00.239 INFO:tasks.workunit.client.0.smithi089.stdout:3/330: sync 2024-09-13T02:54:00.239 INFO:tasks.workunit.client.0.smithi089.stdout:9/319: sync 2024-09-13T02:54:00.239 INFO:tasks.workunit.client.0.smithi089.stdout:5/366: sync 2024-09-13T02:54:00.239 INFO:tasks.workunit.client.0.smithi089.stdout:2/352: sync 2024-09-13T02:54:00.239 INFO:tasks.workunit.client.0.smithi089.stdout:9/320: creat d3/d6/df/d24/f69 x:0 0 0 2024-09-13T02:54:00.239 INFO:tasks.workunit.client.0.smithi089.stdout:9/321: fsync d3/d6/d36/f5c 0 2024-09-13T02:54:00.240 INFO:tasks.workunit.client.0.smithi089.stdout:7/413: symlink d3/d47/d5e/d6f/l84 0 2024-09-13T02:54:00.240 INFO:tasks.workunit.client.0.smithi089.stdout:7/414: fdatasync d3/d19/d67/f7b 0 2024-09-13T02:54:00.243 INFO:tasks.workunit.client.0.smithi089.stdout:3/331: creat d2/d20/d23/d32/d49/f67 x:0 0 0 2024-09-13T02:54:00.244 INFO:tasks.workunit.client.0.smithi089.stdout:5/367: creat d1/d4/d45/d6f/d62/f79 x:0 0 0 2024-09-13T02:54:00.245 INFO:tasks.workunit.client.0.smithi089.stdout:2/353: mkdir d13/d30/d61/d78/d79 0 2024-09-13T02:54:00.247 INFO:tasks.workunit.client.0.smithi089.stdout:9/322: rename d3/d6/df/l5e to d3/d6/df/d24/l6a 0 2024-09-13T02:54:00.248 INFO:tasks.workunit.client.0.smithi089.stdout:3/332: creat d2/d8/dc/d57/f68 x:0 0 0 2024-09-13T02:54:00.249 INFO:tasks.workunit.client.0.smithi089.stdout:3/333: read d2/d20/f39 [692994,89924] 0 2024-09-13T02:54:00.249 INFO:tasks.workunit.client.0.smithi089.stdout:5/368: rmdir d1/d4/d1c 39 2024-09-13T02:54:00.249 INFO:tasks.workunit.client.0.smithi089.stdout:2/354: getdents d13/d30/d4e/d6f 0 2024-09-13T02:54:00.250 INFO:tasks.workunit.client.0.smithi089.stdout:9/323: symlink d3/d3d/l6b 0 2024-09-13T02:54:00.251 INFO:tasks.workunit.client.0.smithi089.stdout:3/334: rename d2/d20/d23/d32/d49/c54 to d2/d20/d23/c69 0 2024-09-13T02:54:00.252 INFO:tasks.workunit.client.0.smithi089.stdout:2/355: rename d13/d30/d64/l5e to d13/d30/l7a 0 2024-09-13T02:54:00.253 INFO:tasks.workunit.client.0.smithi089.stdout:3/335: mknod d2/d20/c6a 0 2024-09-13T02:54:00.254 INFO:tasks.workunit.client.0.smithi089.stdout:2/356: mkdir d13/d30/d4e/d7b 0 2024-09-13T02:54:00.254 INFO:tasks.workunit.client.0.smithi089.stdout:3/336: mknod d2/d8/dc/d3c/c6b 0 2024-09-13T02:54:00.255 INFO:tasks.workunit.client.0.smithi089.stdout:2/357: mkdir d13/d30/d61/d78/d79/d7c 0 2024-09-13T02:54:00.255 INFO:tasks.workunit.client.0.smithi089.stdout:2/358: getdents d13/d30/d4e/d6f/d76 0 2024-09-13T02:54:00.255 INFO:tasks.workunit.client.0.smithi089.stdout:2/359: readlink d13/l3f 0 2024-09-13T02:54:00.257 INFO:tasks.workunit.client.0.smithi089.stdout:2/360: rename d13/f18 to d13/d30/d4e/d6f/f7d 0 2024-09-13T02:54:00.265 INFO:tasks.workunit.client.0.smithi089.stdout:7/415: write d3/d19/f3f [2626386,124234] 0 2024-09-13T02:54:00.265 INFO:tasks.workunit.client.0.smithi089.stdout:7/416: fsync d3/d19/d75/d14/f1c 0 2024-09-13T02:54:00.265 INFO:tasks.workunit.client.0.smithi089.stdout:8/383: dwrite f0 [0,4194304] 0 2024-09-13T02:54:00.269 INFO:tasks.workunit.client.0.smithi089.stdout:6/361: dwrite db/f1d [4194304,4194304] 0 2024-09-13T02:54:00.269 INFO:tasks.workunit.client.0.smithi089.stdout:1/307: dwrite dc/d46/f55 [0,4194304] 0 2024-09-13T02:54:00.269 INFO:tasks.workunit.client.0.smithi089.stdout:1/308: truncate dc/d3a/d53/d2c/d34/d43/f5b 805258 0 2024-09-13T02:54:00.269 INFO:tasks.workunit.client.0.smithi089.stdout:1/309: creat dc/d44/f5e x:0 0 0 2024-09-13T02:54:00.274 INFO:tasks.workunit.client.0.smithi089.stdout:1/310: creat dc/d3a/d53/d2c/d34/f5f x:0 0 0 2024-09-13T02:54:00.277 INFO:tasks.workunit.client.0.smithi089.stdout:1/311: creat dc/d3a/d53/d2c/f60 x:0 0 0 2024-09-13T02:54:00.277 INFO:tasks.workunit.client.0.smithi089.stdout:1/312: chown dc/d3a/d53/d2c/d36/f38 12 1 2024-09-13T02:54:00.279 INFO:tasks.workunit.client.0.smithi089.stdout:1/313: getdents dc/d3a/d53/d2c/d34/d43 0 2024-09-13T02:54:00.283 INFO:tasks.workunit.client.0.smithi089.stdout:7/417: rename d3/d47 to d3/d44/d85 0 2024-09-13T02:54:00.283 INFO:tasks.workunit.client.0.smithi089.stdout:7/418: chown d3/d19/d75/d14/d6c 939533 1 2024-09-13T02:54:00.283 INFO:tasks.workunit.client.0.smithi089.stdout:4/390: sync 2024-09-13T02:54:00.283 INFO:tasks.workunit.client.0.smithi089.stdout:4/391: readlink d2/d3/d5/l3c 0 2024-09-13T02:54:00.284 INFO:tasks.workunit.client.0.smithi089.stdout:4/392: read d2/d22/f35 [479198,17062] 0 2024-09-13T02:54:00.284 INFO:tasks.workunit.client.0.smithi089.stdout:4/393: readlink d2/l6a 0 2024-09-13T02:54:00.285 INFO:tasks.workunit.client.0.smithi089.stdout:7/419: rename d3/d19/d75/l45 to d3/d19/d2e/l86 0 2024-09-13T02:54:00.285 INFO:tasks.workunit.client.0.smithi089.stdout:7/420: write d3/d19/d67/f7b [444988,107070] 0 2024-09-13T02:54:00.286 INFO:tasks.workunit.client.0.smithi089.stdout:4/394: symlink d2/d22/l7b 0 2024-09-13T02:54:00.286 INFO:tasks.workunit.client.0.smithi089.stdout:4/395: chown d2/d3/d5/l57 7 1 2024-09-13T02:54:00.287 INFO:tasks.workunit.client.0.smithi089.stdout:4/396: getdents d2/d3/d5/d49 0 2024-09-13T02:54:00.287 INFO:tasks.workunit.client.0.smithi089.stdout:4/397: truncate d2/d3/d5/f70 581577 0 2024-09-13T02:54:00.287 INFO:tasks.workunit.client.0.smithi089.stdout:4/398: readlink d2/d55/l61 0 2024-09-13T02:54:00.288 INFO:tasks.workunit.client.0.smithi089.stdout:4/399: write d2/d3/de/f36 [4890242,68671] 0 2024-09-13T02:54:00.289 INFO:tasks.workunit.client.0.smithi089.stdout:3/337: dwrite d2/d8/dc/d3c/f4d [0,4194304] 0 2024-09-13T02:54:00.289 INFO:tasks.workunit.client.0.smithi089.stdout:3/338: chown d2/d8/dc/d3c/f4d 157 1 2024-09-13T02:54:00.289 INFO:tasks.workunit.client.0.smithi089.stdout:3/339: write d2/d8/dc/d57/f68 [807548,126913] 0 2024-09-13T02:54:00.290 INFO:tasks.workunit.client.0.smithi089.stdout:3/340: fdatasync d2/d20/d23/d2b/f53 0 2024-09-13T02:54:00.290 INFO:tasks.workunit.client.0.smithi089.stdout:7/421: unlink d3/d19/c5c 0 2024-09-13T02:54:00.290 INFO:tasks.workunit.client.0.smithi089.stdout:4/400: link d2/f40 d2/d3/f7c 0 2024-09-13T02:54:00.292 INFO:tasks.workunit.client.0.smithi089.stdout:3/341: unlink d2/d8/dc/d3c/f4d 0 2024-09-13T02:54:00.296 INFO:tasks.workunit.client.0.smithi089.stdout:4/401: mknod d2/d3/d5/d43/d3b/d71/d78/c7d 0 2024-09-13T02:54:00.297 INFO:tasks.workunit.client.0.smithi089.stdout:3/342: mkdir d2/d20/d23/d27/d51/d6c 0 2024-09-13T02:54:00.297 INFO:tasks.workunit.client.0.smithi089.stdout:3/343: truncate d2/d20/f39 1139714 0 2024-09-13T02:54:00.297 INFO:tasks.workunit.client.0.smithi089.stdout:7/422: unlink d3/d19/f22 0 2024-09-13T02:54:00.297 INFO:tasks.workunit.client.0.smithi089.stdout:7/423: fsync d3/f7c 0 2024-09-13T02:54:00.297 INFO:tasks.workunit.client.0.smithi089.stdout:7/424: fsync d3/d44/f70 0 2024-09-13T02:54:00.298 INFO:tasks.workunit.client.0.smithi089.stdout:4/402: mkdir d2/d3/d5/d43/d3b/d71/d7e 0 2024-09-13T02:54:00.298 INFO:tasks.workunit.client.0.smithi089.stdout:4/403: chown d2/d3/d5/f37 351 1 2024-09-13T02:54:00.299 INFO:tasks.workunit.client.0.smithi089.stdout:3/344: rename d2/d8/dc/ce to d2/d20/d44/c6d 0 2024-09-13T02:54:00.299 INFO:tasks.workunit.client.0.smithi089.stdout:3/345: dread - d2/d20/d23/d27/f4e zero size 2024-09-13T02:54:00.301 INFO:tasks.workunit.client.0.smithi089.stdout:4/404: creat d2/d22/f7f x:0 0 0 2024-09-13T02:54:00.301 INFO:tasks.workunit.client.0.smithi089.stdout:4/405: stat d2/d3/f7c 0 2024-09-13T02:54:00.301 INFO:tasks.workunit.client.0.smithi089.stdout:4/406: readlink d2/d22/l74 0 2024-09-13T02:54:00.302 INFO:tasks.workunit.client.0.smithi089.stdout:2/361: dwrite d13/d30/d59/f5a [0,4194304] 0 2024-09-13T02:54:00.302 INFO:tasks.workunit.client.0.smithi089.stdout:3/346: mknod d2/d8/dc/d3c/c6e 0 2024-09-13T02:54:00.302 INFO:tasks.workunit.client.0.smithi089.stdout:9/324: dwrite d3/f1f [0,4194304] 0 2024-09-13T02:54:00.302 INFO:tasks.workunit.client.0.smithi089.stdout:6/362: dwrite db/d10/f59 [4194304,4194304] 0 2024-09-13T02:54:00.303 INFO:tasks.workunit.client.0.smithi089.stdout:6/363: creat db/d10/d3a/f84 x:0 0 0 2024-09-13T02:54:00.303 INFO:tasks.workunit.client.0.smithi089.stdout:8/384: dwrite de/d16/d1e/d27/d35/f74 [0,4194304] 0 2024-09-13T02:54:00.303 INFO:tasks.workunit.client.0.smithi089.stdout:4/407: getdents d2/d3/d5/d72 0 2024-09-13T02:54:00.303 INFO:tasks.workunit.client.0.smithi089.stdout:4/408: read d2/d3/d5/f70 [163598,102257] 0 2024-09-13T02:54:00.306 INFO:tasks.workunit.client.0.smithi089.stdout:3/347: truncate d2/d8/dc/f2c 1917009 0 2024-09-13T02:54:00.307 INFO:tasks.workunit.client.0.smithi089.stdout:9/325: mkdir d3/d6/df/d24/d6c 0 2024-09-13T02:54:00.316 INFO:tasks.workunit.client.0.smithi089.stdout:8/385: rename de/d16/d1e/d20/d39/l69 to de/d56/l7c 0 2024-09-13T02:54:00.317 INFO:tasks.workunit.client.0.smithi089.stdout:6/364: write db/f1d [8319265,52094] 0 2024-09-13T02:54:00.320 INFO:tasks.workunit.client.0.smithi089.stdout:4/409: dread d2/da/f13 [0,4194304] 0 2024-09-13T02:54:00.321 INFO:tasks.workunit.client.0.smithi089.stdout:9/326: mkdir d3/d6/d2a/d4b/d6d 0 2024-09-13T02:54:00.322 INFO:tasks.workunit.client.0.smithi089.stdout:9/327: readlink d3/d6/df/d24/d32/l68 0 2024-09-13T02:54:00.322 INFO:tasks.workunit.client.0.smithi089.stdout:3/348: dread d2/d8/dc/f30 [0,4194304] 0 2024-09-13T02:54:00.322 INFO:tasks.workunit.client.0.smithi089.stdout:3/349: write d2/d8/f48 [654353,90252] 0 2024-09-13T02:54:00.328 INFO:tasks.workunit.client.0.smithi089.stdout:8/386: unlink de/d16/d1e/d27/d76/f77 0 2024-09-13T02:54:00.329 INFO:tasks.workunit.client.0.smithi089.stdout:1/314: rmdir dc/d3a/d53/d2c 39 2024-09-13T02:54:00.331 INFO:tasks.workunit.client.0.smithi089.stdout:6/365: getdents db/d43/d6e/d28/d2f 0 2024-09-13T02:54:00.332 INFO:tasks.workunit.client.0.smithi089.stdout:7/425: getdents d3/d19/d75 0 2024-09-13T02:54:00.334 INFO:tasks.workunit.client.0.smithi089.stdout:9/328: creat d3/d6/df/f6e x:0 0 0 2024-09-13T02:54:00.337 INFO:tasks.workunit.client.0.smithi089.stdout:8/387: creat de/d16/d1e/d20/d6c/d6e/f7d x:0 0 0 2024-09-13T02:54:00.337 INFO:tasks.workunit.client.0.smithi089.stdout:1/315: mknod dc/d57/c61 0 2024-09-13T02:54:00.338 INFO:tasks.workunit.client.0.smithi089.stdout:1/316: creat dc/d44/f62 x:0 0 0 2024-09-13T02:54:00.338 INFO:tasks.workunit.client.0.smithi089.stdout:6/366: mknod db/d43/d6e/d28/d46/d53/c85 0 2024-09-13T02:54:00.340 INFO:tasks.workunit.client.0.smithi089.stdout:7/426: creat d3/d54/f87 x:0 0 0 2024-09-13T02:54:00.340 INFO:tasks.workunit.client.0.smithi089.stdout:7/427: write d3/d44/d85/f50 [1031105,82250] 0 2024-09-13T02:54:00.340 INFO:tasks.workunit.client.0.smithi089.stdout:7/428: readlink d3/d19/d75/d14/l40 0 2024-09-13T02:54:00.340 INFO:tasks.workunit.client.0.smithi089.stdout:7/429: read d3/d19/d75/f5a [881113,54147] 0 2024-09-13T02:54:00.340 INFO:tasks.workunit.client.0.smithi089.stdout:7/430: creat d3/d19/d2e/f88 x:0 0 0 2024-09-13T02:54:00.341 INFO:tasks.workunit.client.0.smithi089.stdout:9/329: dread d3/d6/df/d24/d29/f52 [0,4194304] 0 2024-09-13T02:54:00.348 INFO:tasks.workunit.client.0.smithi089.stdout:4/410: rmdir d2 39 2024-09-13T02:54:00.351 INFO:tasks.workunit.client.0.smithi089.stdout:8/388: mkdir de/d16/d1e/d20/d6c/d6e/d7e 0 2024-09-13T02:54:00.354 INFO:tasks.workunit.client.0.smithi089.stdout:1/317: mknod dc/d3a/d53/d2c/d34/c63 0 2024-09-13T02:54:00.356 INFO:tasks.workunit.client.0.smithi089.stdout:6/367: rename l2 to db/d43/d60/d74/l86 0 2024-09-13T02:54:00.358 INFO:tasks.workunit.client.0.smithi089.stdout:4/411: mknod d2/d3/d5/d43/d3b/d71/c80 0 2024-09-13T02:54:00.360 INFO:tasks.workunit.client.0.smithi089.stdout:8/389: truncate de/f10 1309088 0 2024-09-13T02:54:00.360 INFO:tasks.workunit.client.0.smithi089.stdout:8/390: creat de/d16/d1e/d67/f7f x:0 0 0 2024-09-13T02:54:00.360 INFO:tasks.workunit.client.0.smithi089.stdout:7/431: dwrite d3/d20/f5d [0,4194304] 0 2024-09-13T02:54:00.360 INFO:tasks.workunit.client.0.smithi089.stdout:1/318: rmdir dc/d3a/d53/d2c/d36 39 2024-09-13T02:54:00.361 INFO:tasks.workunit.client.0.smithi089.stdout:1/319: read dc/f1c [611055,67869] 0 2024-09-13T02:54:00.364 INFO:tasks.workunit.client.0.smithi089.stdout:6/368: unlink db/d10/l20 0 2024-09-13T02:54:00.364 INFO:tasks.workunit.client.0.smithi089.stdout:6/369: fsync db/d10/f80 0 2024-09-13T02:54:00.365 INFO:tasks.workunit.client.0.smithi089.stdout:4/412: creat d2/d3/d5/d43/d3b/d71/f81 x:0 0 0 2024-09-13T02:54:00.368 INFO:tasks.workunit.client.0.smithi089.stdout:8/391: creat de/d16/d1e/d20/f80 x:0 0 0 2024-09-13T02:54:00.370 INFO:tasks.workunit.client.0.smithi089.stdout:6/370: dread db/d43/d6e/f55 [0,4194304] 0 2024-09-13T02:54:00.372 INFO:tasks.workunit.client.0.smithi089.stdout:7/432: creat d3/d44/d85/d5e/d6f/f89 x:0 0 0 2024-09-13T02:54:00.372 INFO:tasks.workunit.client.0.smithi089.stdout:6/371: dread db/d43/d6e/f2c [0,4194304] 0 2024-09-13T02:54:00.372 INFO:tasks.workunit.client.0.smithi089.stdout:6/372: write db/d10/d3a/f84 [639364,65479] 0 2024-09-13T02:54:00.372 INFO:tasks.workunit.client.0.smithi089.stdout:6/373: getdents db/d43/d6e/d28/d2f 0 2024-09-13T02:54:00.372 INFO:tasks.workunit.client.0.smithi089.stdout:1/320: symlink dc/d3a/d53/d2c/d34/d43/l64 0 2024-09-13T02:54:00.374 INFO:tasks.workunit.client.0.smithi089.stdout:9/330: rename d3/d6/d2a/d4b/d54/l63 to d3/d6/df/l6f 0 2024-09-13T02:54:00.375 INFO:tasks.workunit.client.0.smithi089.stdout:8/392: truncate de/f14 203608 0 2024-09-13T02:54:00.376 INFO:tasks.workunit.client.0.smithi089.stdout:7/433: creat d3/d44/d85/f8a x:0 0 0 2024-09-13T02:54:00.376 INFO:tasks.workunit.client.0.smithi089.stdout:7/434: creat d3/d19/d67/f8b x:0 0 0 2024-09-13T02:54:00.378 INFO:tasks.workunit.client.0.smithi089.stdout:0/265: sync 2024-09-13T02:54:00.378 INFO:tasks.workunit.client.0.smithi089.stdout:0/266: creat d2/d19/d1a/f57 x:0 0 0 2024-09-13T02:54:00.379 INFO:tasks.workunit.client.0.smithi089.stdout:1/321: symlink dc/d44/l65 0 2024-09-13T02:54:00.380 INFO:tasks.workunit.client.0.smithi089.stdout:9/331: symlink d3/d6/df/d24/d6c/l70 0 2024-09-13T02:54:00.382 INFO:tasks.workunit.client.0.smithi089.stdout:8/393: creat de/d16/d1e/d3f/d71/f81 x:0 0 0 2024-09-13T02:54:00.382 INFO:tasks.workunit.client.0.smithi089.stdout:4/413: dwrite d2/f4b [0,4194304] 0 2024-09-13T02:54:00.384 INFO:tasks.workunit.client.0.smithi089.stdout:7/435: creat d3/d44/d85/d77/f8c x:0 0 0 2024-09-13T02:54:00.385 INFO:tasks.workunit.client.0.smithi089.stdout:0/267: dread d2/d19/f32 [0,4194304] 0 2024-09-13T02:54:00.387 INFO:tasks.workunit.client.0.smithi089.stdout:8/394: creat de/d16/d1e/d20/d6c/d6e/d7e/f82 x:0 0 0 2024-09-13T02:54:00.390 INFO:tasks.workunit.client.0.smithi089.stdout:4/414: getdents d2/d3/de/d62 0 2024-09-13T02:54:00.390 INFO:tasks.workunit.client.0.smithi089.stdout:1/322: write dc/d46/f55 [1283634,42370] 0 2024-09-13T02:54:00.391 INFO:tasks.workunit.client.0.smithi089.stdout:7/436: creat d3/d44/d85/d55/f8d x:0 0 0 2024-09-13T02:54:00.394 INFO:tasks.workunit.client.0.smithi089.stdout:0/268: creat d2/d19/d1a/d3d/d4b/d4f/f58 x:0 0 0 2024-09-13T02:54:00.394 INFO:tasks.workunit.client.0.smithi089.stdout:0/269: dread - d2/f29 zero size 2024-09-13T02:54:00.394 INFO:tasks.workunit.client.0.smithi089.stdout:0/270: write d2/f17 [3351029,33062] 0 2024-09-13T02:54:00.395 INFO:tasks.workunit.client.0.smithi089.stdout:8/395: creat de/d16/d1e/f83 x:0 0 0 2024-09-13T02:54:00.396 INFO:tasks.workunit.client.0.smithi089.stdout:4/415: truncate d2/d3/f7c 8266339 0 2024-09-13T02:54:00.399 INFO:tasks.workunit.client.0.smithi089.stdout:1/323: creat dc/d3a/d53/f66 x:0 0 0 2024-09-13T02:54:00.399 INFO:tasks.workunit.client.0.smithi089.stdout:1/324: dread - dc/d44/f49 zero size 2024-09-13T02:54:00.406 INFO:tasks.workunit.client.0.smithi089.stdout:0/271: unlink d2/f29 0 2024-09-13T02:54:00.406 INFO:tasks.workunit.client.0.smithi089.stdout:0/272: stat d2/d19/f39 0 2024-09-13T02:54:00.407 INFO:tasks.workunit.client.0.smithi089.stdout:8/396: symlink de/d16/d1e/d27/d52/d61/l84 0 2024-09-13T02:54:00.409 INFO:tasks.workunit.client.0.smithi089.stdout:1/325: creat dc/d3a/d53/d2c/d34/f67 x:0 0 0 2024-09-13T02:54:00.409 INFO:tasks.workunit.client.0.smithi089.stdout:1/326: readlink dc/d44/l4c 0 2024-09-13T02:54:00.409 INFO:tasks.workunit.client.0.smithi089.stdout:1/327: readlink dc/d3a/d53/d2c/d36/l4d 0 2024-09-13T02:54:00.409 INFO:tasks.workunit.client.0.smithi089.stdout:7/437: link d3/c2f d3/c8e 0 2024-09-13T02:54:00.410 INFO:tasks.workunit.client.0.smithi089.stdout:0/273: mkdir d2/d19/d1a/d3d/d4b/d4f/d59 0 2024-09-13T02:54:00.412 INFO:tasks.workunit.client.0.smithi089.stdout:8/397: rename de/d16/f1b to de/d16/f85 0 2024-09-13T02:54:00.413 INFO:tasks.workunit.client.0.smithi089.stdout:0/274: symlink d2/d19/d1a/d1e/d42/l5a 0 2024-09-13T02:54:00.414 INFO:tasks.workunit.client.0.smithi089.stdout:8/398: rename de/d16/d1e/d27/d35/f72 to de/d16/f86 0 2024-09-13T02:54:00.415 INFO:tasks.workunit.client.0.smithi089.stdout:8/399: truncate de/d16/d1e/d20/d39/f70 1085376 0 2024-09-13T02:54:00.417 INFO:tasks.workunit.client.0.smithi089.stdout:8/400: getdents de/d16/d1e/d3f 0 2024-09-13T02:54:00.418 INFO:tasks.workunit.client.0.smithi089.stdout:8/401: rmdir de/d16/d1e/d3f 39 2024-09-13T02:54:00.420 INFO:tasks.workunit.client.0.smithi089.stdout:1/328: write dc/d3a/d53/f26 [1899116,109971] 0 2024-09-13T02:54:00.420 INFO:tasks.workunit.client.0.smithi089.stdout:1/329: chown dc/d57 116638 1 2024-09-13T02:54:00.421 INFO:tasks.workunit.client.0.smithi089.stdout:8/402: link de/d16/d1e/f83 de/d16/d1e/f87 0 2024-09-13T02:54:00.425 INFO:tasks.workunit.client.0.smithi089.stdout:1/330: symlink dc/d3a/d53/d2c/d34/l68 0 2024-09-13T02:54:00.426 INFO:tasks.workunit.client.0.smithi089.stdout:8/403: mknod de/d16/d1e/c88 0 2024-09-13T02:54:00.427 INFO:tasks.workunit.client.0.smithi089.stdout:4/416: dread d2/d3/d5/d43/f50 [0,4194304] 0 2024-09-13T02:54:00.429 INFO:tasks.workunit.client.0.smithi089.stdout:1/331: rename dc/d44/f4a to dc/d3a/d53/d2c/d34/d43/f69 0 2024-09-13T02:54:00.429 INFO:tasks.workunit.client.0.smithi089.stdout:1/332: dread - dc/d3a/d53/d2c/d34/f5f zero size 2024-09-13T02:54:00.430 INFO:tasks.workunit.client.0.smithi089.stdout:8/404: creat de/d16/d1e/d27/d76/f89 x:0 0 0 2024-09-13T02:54:00.430 INFO:tasks.workunit.client.0.smithi089.stdout:8/405: truncate de/d16/d1e/f83 919262 0 2024-09-13T02:54:00.431 INFO:tasks.workunit.client.0.smithi089.stdout:8/406: write de/d16/d1e/d27/d52/d61/f7b [531613,14231] 0 2024-09-13T02:54:00.431 INFO:tasks.workunit.client.0.smithi089.stdout:8/407: chown f0 41 1 2024-09-13T02:54:00.431 INFO:tasks.workunit.client.0.smithi089.stdout:8/408: chown f0 0 1 2024-09-13T02:54:00.431 INFO:tasks.workunit.client.0.smithi089.stdout:4/417: creat d2/d3/d5/d43/f82 x:0 0 0 2024-09-13T02:54:00.434 INFO:tasks.workunit.client.0.smithi089.stdout:1/333: rename dc/d3a/d53/d2c/d34/f4e to dc/d44/f6a 0 2024-09-13T02:54:00.434 INFO:tasks.workunit.client.0.smithi089.stdout:7/438: dwrite d3/d44/d85/d55/f8d [0,4194304] 0 2024-09-13T02:54:00.436 INFO:tasks.workunit.client.0.smithi089.stdout:4/418: symlink d2/d22/l83 0 2024-09-13T02:54:00.437 INFO:tasks.workunit.client.0.smithi089.stdout:4/419: dread d2/d3/f25 [0,4194304] 0 2024-09-13T02:54:00.437 INFO:tasks.workunit.client.0.smithi089.stdout:8/409: rename de/d16/d1e/d27/d35/f4c to de/d16/d1e/d20/d39/f8a 0 2024-09-13T02:54:00.438 INFO:tasks.workunit.client.0.smithi089.stdout:5/369: sync 2024-09-13T02:54:00.439 INFO:tasks.workunit.client.0.smithi089.stdout:1/334: dread dc/fe [0,4194304] 0 2024-09-13T02:54:00.439 INFO:tasks.workunit.client.0.smithi089.stdout:1/335: creat dc/d46/f6b x:0 0 0 2024-09-13T02:54:00.439 INFO:tasks.workunit.client.0.smithi089.stdout:1/336: read - dc/d44/f5e zero size 2024-09-13T02:54:00.439 INFO:tasks.workunit.client.0.smithi089.stdout:1/337: chown dc/d46 6923 1 2024-09-13T02:54:00.440 INFO:tasks.workunit.client.0.smithi089.stdout:0/275: dwrite d2/d19/f44 [0,4194304] 0 2024-09-13T02:54:00.444 INFO:tasks.workunit.client.0.smithi089.stdout:8/410: truncate de/f1a 3377042 0 2024-09-13T02:54:00.446 INFO:tasks.workunit.client.0.smithi089.stdout:5/370: creat d1/d4/d45/d6f/d4d/f7a x:0 0 0 2024-09-13T02:54:00.446 INFO:tasks.workunit.client.0.smithi089.stdout:5/371: write d1/d4/f17 [5657015,35569] 0 2024-09-13T02:54:00.450 INFO:tasks.workunit.client.0.smithi089.stdout:1/338: mkdir dc/d46/d6c 0 2024-09-13T02:54:00.456 INFO:tasks.workunit.client.0.smithi089.stdout:5/372: dread d1/d4/d2b/f2d [0,4194304] 0 2024-09-13T02:54:00.465 INFO:tasks.workunit.client.0.smithi089.stdout:0/276: dwrite d2/f6 [0,4194304] 0 2024-09-13T02:54:00.467 INFO:tasks.workunit.client.0.smithi089.stdout:7/439: rmdir d3 39 2024-09-13T02:54:00.467 INFO:tasks.workunit.client.0.smithi089.stdout:4/420: rmdir d2/d3/d5/d43/d3b/d71 39 2024-09-13T02:54:00.467 INFO:tasks.workunit.client.0.smithi089.stdout:7/440: truncate f0 5097367 0 2024-09-13T02:54:00.467 INFO:tasks.workunit.client.0.smithi089.stdout:7/441: readlink d3/d19/d75/d14/l26 0 2024-09-13T02:54:00.467 INFO:tasks.workunit.client.0.smithi089.stdout:8/411: dwrite de/d16/d1e/d20/d6c/d6e/d7e/f82 [0,4194304] 0 2024-09-13T02:54:00.467 INFO:tasks.workunit.client.0.smithi089.stdout:8/412: write de/d16/d1e/d27/f68 [490972,87329] 0 2024-09-13T02:54:00.467 INFO:tasks.workunit.client.0.smithi089.stdout:4/421: dread d2/f1f [0,4194304] 0 2024-09-13T02:54:00.467 INFO:tasks.workunit.client.0.smithi089.stdout:4/422: chown d2/da/l52 15000 1 2024-09-13T02:54:00.467 INFO:tasks.workunit.client.0.smithi089.stdout:4/423: chown d2/d22/c5e 30072934 1 2024-09-13T02:54:00.469 INFO:tasks.workunit.client.0.smithi089.stdout:1/339: unlink dc/d3a/d53/d2c/l2f 0 2024-09-13T02:54:00.471 INFO:tasks.workunit.client.0.smithi089.stdout:7/442: symlink d3/d19/d2e/d37/l8f 0 2024-09-13T02:54:00.472 INFO:tasks.workunit.client.0.smithi089.stdout:5/373: dwrite d1/d7/f19 [0,4194304] 0 2024-09-13T02:54:00.473 INFO:tasks.workunit.client.0.smithi089.stdout:3/350: sync 2024-09-13T02:54:00.474 INFO:tasks.workunit.client.0.smithi089.stdout:2/362: sync 2024-09-13T02:54:00.474 INFO:tasks.workunit.client.0.smithi089.stdout:3/351: stat d2/d20/d23/d27/d51 0 2024-09-13T02:54:00.474 INFO:tasks.workunit.client.0.smithi089.stdout:3/352: fsync d2/f2d 0 2024-09-13T02:54:00.478 INFO:tasks.workunit.client.0.smithi089.stdout:8/413: creat de/d16/d1e/d27/d35/f8b x:0 0 0 2024-09-13T02:54:00.478 INFO:tasks.workunit.client.0.smithi089.stdout:4/424: mkdir d2/d3/d5/d43/d84 0 2024-09-13T02:54:00.478 INFO:tasks.workunit.client.0.smithi089.stdout:8/414: chown de/d16/d1e/d20 101608 1 2024-09-13T02:54:00.478 INFO:tasks.workunit.client.0.smithi089.stdout:4/425: chown d2/l19 49861 1 2024-09-13T02:54:00.479 INFO:tasks.workunit.client.0.smithi089.stdout:0/277: write d2/d19/d1a/d1e/d42/f49 [667248,129909] 0 2024-09-13T02:54:00.479 INFO:tasks.workunit.client.0.smithi089.stdout:7/443: mknod d3/d19/d2e/d68/c90 0 2024-09-13T02:54:00.480 INFO:tasks.workunit.client.0.smithi089.stdout:7/444: chown d3/l59 188378 1 2024-09-13T02:54:00.482 INFO:tasks.workunit.client.0.smithi089.stdout:5/374: rename d1/f56 to d1/d4/d45/f7b 0 2024-09-13T02:54:00.485 INFO:tasks.workunit.client.0.smithi089.stdout:3/353: mknod d2/d8/dc/d3c/d65/c6f 0 2024-09-13T02:54:00.485 INFO:tasks.workunit.client.0.smithi089.stdout:3/354: chown d2/d20/d23/d27 125 1 2024-09-13T02:54:00.485 INFO:tasks.workunit.client.0.smithi089.stdout:3/355: dread - d2/d8/dc/d3c/f60 zero size 2024-09-13T02:54:00.487 INFO:tasks.workunit.client.0.smithi089.stdout:8/415: unlink de/l26 0 2024-09-13T02:54:00.487 INFO:tasks.workunit.client.0.smithi089.stdout:8/416: write de/d16/f85 [2440075,101347] 0 2024-09-13T02:54:00.488 INFO:tasks.workunit.client.0.smithi089.stdout:0/278: dread d2/f4a [0,4194304] 0 2024-09-13T02:54:00.488 INFO:tasks.workunit.client.0.smithi089.stdout:4/426: creat d2/d3/d5/f85 x:0 0 0 2024-09-13T02:54:00.490 INFO:tasks.workunit.client.0.smithi089.stdout:5/375: mkdir d1/d4/d45/d6f/d7c 0 2024-09-13T02:54:00.490 INFO:tasks.workunit.client.0.smithi089.stdout:5/376: chown d1/f5e 709 1 2024-09-13T02:54:00.490 INFO:tasks.workunit.client.0.smithi089.stdout:5/377: dread - d1/d4/d45/d6f/d4d/f7a zero size 2024-09-13T02:54:00.491 INFO:tasks.workunit.client.0.smithi089.stdout:3/356: link d2/d20/d23/d2b/l3b d2/d20/d23/d32/d49/l70 0 2024-09-13T02:54:00.492 INFO:tasks.workunit.client.0.smithi089.stdout:8/417: creat de/d56/f8c x:0 0 0 2024-09-13T02:54:00.495 INFO:tasks.workunit.client.0.smithi089.stdout:0/279: unlink d2/d19/f24 0 2024-09-13T02:54:00.496 INFO:tasks.workunit.client.0.smithi089.stdout:4/427: mkdir d2/d3/d86 0 2024-09-13T02:54:00.497 INFO:tasks.workunit.client.0.smithi089.stdout:4/428: readlink d2/da/l21 0 2024-09-13T02:54:00.497 INFO:tasks.workunit.client.0.smithi089.stdout:8/418: getdents de/d16/d1e/d20/d6c 0 2024-09-13T02:54:00.499 INFO:tasks.workunit.client.0.smithi089.stdout:4/429: rename d2/da/c1b to d2/d3/d5/d43/d3b/d71/d7e/c87 0 2024-09-13T02:54:00.499 INFO:tasks.workunit.client.0.smithi089.stdout:4/430: fsync d2/da/f45 0 2024-09-13T02:54:00.499 INFO:tasks.workunit.client.0.smithi089.stdout:4/431: dread - d2/d3/d5/d43/d3b/f6f zero size 2024-09-13T02:54:00.505 INFO:tasks.workunit.client.0.smithi089.stdout:4/432: unlink d2/d3/de/l20 0 2024-09-13T02:54:00.505 INFO:tasks.workunit.client.0.smithi089.stdout:4/433: rmdir d2/d3/d5/d43/d3b/d71 39 2024-09-13T02:54:00.505 INFO:tasks.workunit.client.0.smithi089.stdout:4/434: fsync d2/d3/d5/d43/d3b/f54 0 2024-09-13T02:54:00.505 INFO:tasks.workunit.client.0.smithi089.stdout:4/435: chown d2/d3/d5/d43/d3b/d71/c80 29219545 1 2024-09-13T02:54:00.505 INFO:tasks.workunit.client.0.smithi089.stdout:1/340: dwrite f3 [8388608,4194304] 0 2024-09-13T02:54:00.505 INFO:tasks.workunit.client.0.smithi089.stdout:1/341: write dc/d44/f49 [905440,107646] 0 2024-09-13T02:54:00.505 INFO:tasks.workunit.client.0.smithi089.stdout:8/419: write de/d16/d1e/d20/d39/f70 [471912,3884] 0 2024-09-13T02:54:00.506 INFO:tasks.workunit.client.0.smithi089.stdout:4/436: mkdir d2/d3/de/d62/d6c/d88 0 2024-09-13T02:54:00.506 INFO:tasks.workunit.client.0.smithi089.stdout:4/437: chown d2/d3/d5/c1c 4 1 2024-09-13T02:54:00.509 INFO:tasks.workunit.client.0.smithi089.stdout:2/363: dwrite d13/d30/f40 [0,4194304] 0 2024-09-13T02:54:00.509 INFO:tasks.workunit.client.0.smithi089.stdout:2/364: stat d13/d30/d59 0 2024-09-13T02:54:00.509 INFO:tasks.workunit.client.0.smithi089.stdout:1/342: unlink dc/l18 0 2024-09-13T02:54:00.509 INFO:tasks.workunit.client.0.smithi089.stdout:1/343: fdatasync dc/f13 0 2024-09-13T02:54:00.509 INFO:tasks.workunit.client.0.smithi089.stdout:1/344: fdatasync dc/f13 0 2024-09-13T02:54:00.510 INFO:tasks.workunit.client.0.smithi089.stdout:5/378: write d1/d4/f17 [112648,64250] 0 2024-09-13T02:54:00.510 INFO:tasks.workunit.client.0.smithi089.stdout:8/420: mkdir de/d16/d1e/d27/d76/d8d 0 2024-09-13T02:54:00.511 INFO:tasks.workunit.client.0.smithi089.stdout:4/438: link d2/l2c d2/d3/d5/d43/d3b/d71/d7e/l89 0 2024-09-13T02:54:00.512 INFO:tasks.workunit.client.0.smithi089.stdout:2/365: creat d13/d30/d59/f7e x:0 0 0 2024-09-13T02:54:00.513 INFO:tasks.workunit.client.0.smithi089.stdout:1/345: rename dc/d44/l4c to dc/d57/l6d 0 2024-09-13T02:54:00.513 INFO:tasks.workunit.client.0.smithi089.stdout:2/366: mkdir d13/d30/d4e/d7f 0 2024-09-13T02:54:00.514 INFO:tasks.workunit.client.0.smithi089.stdout:1/346: mkdir dc/d6e 0 2024-09-13T02:54:00.516 INFO:tasks.workunit.client.0.smithi089.stdout:0/280: write d2/d19/d1a/d1e/d42/f45 [3125452,87436] 0 2024-09-13T02:54:00.516 INFO:tasks.workunit.client.0.smithi089.stdout:7/445: dwrite d3/d44/f70 [0,4194304] 0 2024-09-13T02:54:00.516 INFO:tasks.workunit.client.0.smithi089.stdout:7/446: write d3/d19/d2e/f4f [2367543,57372] 0 2024-09-13T02:54:00.516 INFO:tasks.workunit.client.0.smithi089.stdout:7/447: write d3/d19/d67/f8b [536494,34863] 0 2024-09-13T02:54:00.516 INFO:tasks.workunit.client.0.smithi089.stdout:5/379: read d1/d4/d2b/f2d [3183352,87742] 0 2024-09-13T02:54:00.523 INFO:tasks.workunit.client.0.smithi089.stdout:7/448: symlink d3/d44/d85/d5e/d6f/l91 0 2024-09-13T02:54:00.525 INFO:tasks.workunit.client.0.smithi089.stdout:5/380: rmdir d1/d4/d1c/d49 39 2024-09-13T02:54:00.525 INFO:tasks.workunit.client.0.smithi089.stdout:5/381: write d1/d4/d2b/f2d [855703,60049] 0 2024-09-13T02:54:00.528 INFO:tasks.workunit.client.0.smithi089.stdout:7/449: rename d3/d19/d75/l56 to d3/d19/d75/d14/d71/l92 0 2024-09-13T02:54:00.530 INFO:tasks.workunit.client.0.smithi089.stdout:4/439: dread d2/da/f44 [0,4194304] 0 2024-09-13T02:54:00.530 INFO:tasks.workunit.client.0.smithi089.stdout:4/440: dread - d2/d3/d5/f85 zero size 2024-09-13T02:54:00.531 INFO:tasks.workunit.client.0.smithi089.stdout:4/441: write d2/d3/d5/d43/d3b/f60 [165742,72303] 0 2024-09-13T02:54:00.535 INFO:tasks.workunit.client.0.smithi089.stdout:1/347: fdatasync dc/d3a/d53/f26 0 2024-09-13T02:54:00.535 INFO:tasks.workunit.client.0.smithi089.stdout:3/357: dwrite d2/d20/d23/d2b/f2f [0,4194304] 0 2024-09-13T02:54:00.537 INFO:tasks.workunit.client.0.smithi089.stdout:7/450: dread d3/d44/d85/f50 [0,4194304] 0 2024-09-13T02:54:00.540 INFO:tasks.workunit.client.0.smithi089.stdout:8/421: dwrite de/d16/d1e/d3f/f73 [0,4194304] 0 2024-09-13T02:54:00.544 INFO:tasks.workunit.client.0.smithi089.stdout:9/332: sync 2024-09-13T02:54:00.544 INFO:tasks.workunit.client.0.smithi089.stdout:6/374: sync 2024-09-13T02:54:00.544 INFO:tasks.workunit.client.0.smithi089.stdout:9/333: truncate d3/d6/df/f6e 719696 0 2024-09-13T02:54:00.547 INFO:tasks.workunit.client.0.smithi089.stdout:0/281: dwrite d2/d19/d1a/f3c [0,4194304] 0 2024-09-13T02:54:00.554 INFO:tasks.workunit.client.0.smithi089.stdout:7/451: rmdir d3/d19/d67/d82 0 2024-09-13T02:54:00.555 INFO:tasks.workunit.client.0.smithi089.stdout:5/382: dwrite d1/d4/d2b/f52 [0,4194304] 0 2024-09-13T02:54:00.567 INFO:tasks.workunit.client.0.smithi089.stdout:9/334: symlink d3/d6/d2a/d4b/l71 0 2024-09-13T02:54:00.569 INFO:tasks.workunit.client.0.smithi089.stdout:3/358: dwrite d2/d8/d5f/f62 [4194304,4194304] 0 2024-09-13T02:54:00.570 INFO:tasks.workunit.client.0.smithi089.stdout:1/348: rmdir dc/d3a/d53 39 2024-09-13T02:54:00.572 INFO:tasks.workunit.client.0.smithi089.stdout:0/282: truncate d2/d19/d1a/f57 361383 0 2024-09-13T02:54:00.572 INFO:tasks.workunit.client.0.smithi089.stdout:0/283: fdatasync d2/d19/f39 0 2024-09-13T02:54:00.572 INFO:tasks.workunit.client.0.smithi089.stdout:0/284: creat d2/d19/d1a/d3d/d4b/d4f/f5b x:0 0 0 2024-09-13T02:54:00.572 INFO:tasks.workunit.client.0.smithi089.stdout:0/285: creat d2/d19/d1a/d3d/d4b/d4f/f5c x:0 0 0 2024-09-13T02:54:00.572 INFO:tasks.workunit.client.0.smithi089.stdout:8/422: dwrite de/d16/d1e/d3f/d71/f81 [0,4194304] 0 2024-09-13T02:54:00.572 INFO:tasks.workunit.client.0.smithi089.stdout:4/442: dwrite d2/f53 [0,4194304] 0 2024-09-13T02:54:00.574 INFO:tasks.workunit.client.0.smithi089.stdout:7/452: unlink d3/d19/l69 0 2024-09-13T02:54:00.575 INFO:tasks.workunit.client.0.smithi089.stdout:5/383: mknod d1/d4/d45/c7d 0 2024-09-13T02:54:00.575 INFO:tasks.workunit.client.0.smithi089.stdout:5/384: chown d1/d4/d2b/f50 99191178 1 2024-09-13T02:54:00.576 INFO:tasks.workunit.client.0.smithi089.stdout:9/335: truncate d3/d15/f1b 1017958 0 2024-09-13T02:54:00.579 INFO:tasks.workunit.client.0.smithi089.stdout:3/359: unlink d2/d20/d23/d32/l3a 0 2024-09-13T02:54:00.579 INFO:tasks.workunit.client.0.smithi089.stdout:3/360: fsync d2/d20/f28 0 2024-09-13T02:54:00.580 INFO:tasks.workunit.client.0.smithi089.stdout:1/349: mkdir dc/d3a/d53/d2c/d6f 0 2024-09-13T02:54:00.584 INFO:tasks.workunit.client.0.smithi089.stdout:6/375: dwrite db/d10/f1f [0,4194304] 0 2024-09-13T02:54:00.589 INFO:tasks.workunit.client.0.smithi089.stdout:8/423: chown de/d16/d1e/d20/c3a 21 1 2024-09-13T02:54:00.592 INFO:tasks.workunit.client.0.smithi089.stdout:4/443: chown d2/d22/f34 7636 1 2024-09-13T02:54:00.592 INFO:tasks.workunit.client.0.smithi089.stdout:6/376: write db/d43/d6e/f30 [2445375,26064] 0 2024-09-13T02:54:00.595 INFO:tasks.workunit.client.0.smithi089.stdout:7/453: symlink d3/d19/d2e/d37/l93 0 2024-09-13T02:54:00.595 INFO:tasks.workunit.client.0.smithi089.stdout:7/454: fsync d3/d19/f3d 0 2024-09-13T02:54:00.595 INFO:tasks.workunit.client.0.smithi089.stdout:8/424: write de/d16/d1e/f31 [1984553,79105] 0 2024-09-13T02:54:00.595 INFO:tasks.workunit.client.0.smithi089.stdout:8/425: truncate de/d16/d1e/d27/d35/f8b 949279 0 2024-09-13T02:54:00.595 INFO:tasks.workunit.client.0.smithi089.stdout:8/426: write de/d16/d1e/d27/d76/f89 [248979,69943] 0 2024-09-13T02:54:00.595 INFO:tasks.workunit.client.0.smithi089.stdout:8/427: chown de/d16/d1e/f2a 0 1 2024-09-13T02:54:00.595 INFO:tasks.workunit.client.0.smithi089.stdout:5/385: getdents d1/d4/d2b 0 2024-09-13T02:54:00.597 INFO:tasks.workunit.client.0.smithi089.stdout:9/336: rename d3/f1f to d3/d6/d2a/d4b/d54/f72 0 2024-09-13T02:54:00.597 INFO:tasks.workunit.client.0.smithi089.stdout:9/337: chown d3/d15/d5a 65014042 1 2024-09-13T02:54:00.597 INFO:tasks.workunit.client.0.smithi089.stdout:9/338: stat d3/d6/df 0 2024-09-13T02:54:00.598 INFO:tasks.workunit.client.0.smithi089.stdout:1/350: rename dc/d57/c5c to dc/d57/c70 0 2024-09-13T02:54:00.598 INFO:tasks.workunit.client.0.smithi089.stdout:1/351: write dc/d44/f5e [425961,8928] 0 2024-09-13T02:54:00.605 INFO:tasks.workunit.client.0.smithi089.stdout:6/377: dread db/d10/f1f [0,4194304] 0 2024-09-13T02:54:00.605 INFO:tasks.workunit.client.0.smithi089.stdout:0/286: dwrite d2/f35 [0,4194304] 0 2024-09-13T02:54:00.606 INFO:tasks.workunit.client.0.smithi089.stdout:5/386: read d1/d4/f25 [1929891,15436] 0 2024-09-13T02:54:00.606 INFO:tasks.workunit.client.0.smithi089.stdout:7/455: symlink d3/d44/d85/d55/l94 0 2024-09-13T02:54:00.610 INFO:tasks.workunit.client.0.smithi089.stdout:8/428: mkdir de/d16/d1e/d27/d52/d61/d8e 0 2024-09-13T02:54:00.614 INFO:tasks.workunit.client.0.smithi089.stdout:3/361: rename d2/d20/d63 to d2/d20/d23/d32/d5b/d71 0 2024-09-13T02:54:00.614 INFO:tasks.workunit.client.0.smithi089.stdout:3/362: fdatasync d2/d8/dc/f2c 0 2024-09-13T02:54:00.614 INFO:tasks.workunit.client.0.smithi089.stdout:3/363: readlink d2/d20/l34 0 2024-09-13T02:54:00.614 INFO:tasks.workunit.client.0.smithi089.stdout:3/364: truncate d2/d20/d23/d32/d49/f56 160291 0 2024-09-13T02:54:00.614 INFO:tasks.workunit.client.0.smithi089.stdout:3/365: chown d2/d20/d23/d2b/f53 6341 1 2024-09-13T02:54:00.614 INFO:tasks.workunit.client.0.smithi089.stdout:3/366: write d2/d8/dc/d3c/f60 [80402,103138] 0 2024-09-13T02:54:00.615 INFO:tasks.workunit.client.0.smithi089.stdout:8/429: dread de/f1a [0,4194304] 0 2024-09-13T02:54:00.615 INFO:tasks.workunit.client.0.smithi089.stdout:8/430: read - de/d16/d1e/d67/f7a zero size 2024-09-13T02:54:00.617 INFO:tasks.workunit.client.0.smithi089.stdout:5/387: write d1/d4/d45/f7b [844593,78810] 0 2024-09-13T02:54:00.617 INFO:tasks.workunit.client.0.smithi089.stdout:5/388: dread - d1/d4/d45/d6f/d62/f79 zero size 2024-09-13T02:54:00.617 INFO:tasks.workunit.client.0.smithi089.stdout:4/444: link d2/d3/f25 d2/d3/d5/d43/d84/f8a 0 2024-09-13T02:54:00.619 INFO:tasks.workunit.client.0.smithi089.stdout:6/378: creat db/d43/d6e/d28/d2f/f87 x:0 0 0 2024-09-13T02:54:00.619 INFO:tasks.workunit.client.0.smithi089.stdout:6/379: write db/d43/d6e/f68 [1326062,126062] 0 2024-09-13T02:54:00.619 INFO:tasks.workunit.client.0.smithi089.stdout:6/380: dread - db/d43/d6e/d28/d2f/f4c zero size 2024-09-13T02:54:00.621 INFO:tasks.workunit.client.0.smithi089.stdout:2/367: sync 2024-09-13T02:54:00.621 INFO:tasks.workunit.client.0.smithi089.stdout:0/287: creat d2/d19/d1a/d1e/d42/f5d x:0 0 0 2024-09-13T02:54:00.622 INFO:tasks.workunit.client.0.smithi089.stdout:7/456: creat d3/d44/d85/d5e/f95 x:0 0 0 2024-09-13T02:54:00.623 INFO:tasks.workunit.client.0.smithi089.stdout:9/339: dwrite d3/d6/df/d24/d35/f45 [0,4194304] 0 2024-09-13T02:54:00.624 INFO:tasks.workunit.client.0.smithi089.stdout:1/352: dwrite dc/f22 [0,4194304] 0 2024-09-13T02:54:00.624 INFO:tasks.workunit.client.0.smithi089.stdout:9/340: creat d3/d6/f73 x:0 0 0 2024-09-13T02:54:00.625 INFO:tasks.workunit.client.0.smithi089.stdout:5/389: dread d1/d4/f5 [0,4194304] 0 2024-09-13T02:54:00.625 INFO:tasks.workunit.client.0.smithi089.stdout:5/390: write d1/d4/d45/d6f/d4d/f71 [255038,116629] 0 2024-09-13T02:54:00.625 INFO:tasks.workunit.client.0.smithi089.stdout:5/391: readlink d1/d7/l70 0 2024-09-13T02:54:00.625 INFO:tasks.workunit.client.0.smithi089.stdout:5/392: creat d1/d4/d45/d6f/d4d/f7e x:0 0 0 2024-09-13T02:54:00.625 INFO:tasks.workunit.client.0.smithi089.stdout:3/367: mkdir d2/d8/d5f/d72 0 2024-09-13T02:54:00.626 INFO:tasks.workunit.client.0.smithi089.stdout:4/445: mkdir d2/d3/d5/d72/d8b 0 2024-09-13T02:54:00.627 INFO:tasks.workunit.client.0.smithi089.stdout:3/368: dread d2/d8/dc/f1b [0,4194304] 0 2024-09-13T02:54:00.627 INFO:tasks.workunit.client.0.smithi089.stdout:3/369: fsync d2/d8/f21 0 2024-09-13T02:54:00.627 INFO:tasks.workunit.client.0.smithi089.stdout:4/446: dread d2/d3/d5/f70 [0,4194304] 0 2024-09-13T02:54:00.627 INFO:tasks.workunit.client.0.smithi089.stdout:4/447: chown d2/d3/d5/f42 1 1 2024-09-13T02:54:00.628 INFO:tasks.workunit.client.0.smithi089.stdout:8/431: dread de/d16/d1e/d3f/d71/f81 [0,4194304] 0 2024-09-13T02:54:00.628 INFO:tasks.workunit.client.0.smithi089.stdout:6/381: unlink f3 0 2024-09-13T02:54:00.630 INFO:tasks.workunit.client.0.smithi089.stdout:2/368: symlink d13/d30/d4e/l80 0 2024-09-13T02:54:00.630 INFO:tasks.workunit.client.0.smithi089.stdout:2/369: readlink d13/d30/l55 0 2024-09-13T02:54:00.630 INFO:tasks.workunit.client.0.smithi089.stdout:2/370: readlink d13/d30/l24 0 2024-09-13T02:54:00.631 INFO:tasks.workunit.client.0.smithi089.stdout:0/288: chown d2/la 4 1 2024-09-13T02:54:00.633 INFO:tasks.workunit.client.0.smithi089.stdout:7/457: mkdir d3/d44/d85/d55/d96 0 2024-09-13T02:54:00.633 INFO:tasks.workunit.client.0.smithi089.stdout:7/458: chown d3/d19/d75 178262 1 2024-09-13T02:54:00.633 INFO:tasks.workunit.client.0.smithi089.stdout:7/459: truncate d3/d44/d85/d5e/d6f/f89 431554 0 2024-09-13T02:54:00.636 INFO:tasks.workunit.client.0.smithi089.stdout:5/393: truncate d1/d7/f21 678593 0 2024-09-13T02:54:00.637 INFO:tasks.workunit.client.0.smithi089.stdout:3/370: truncate d2/d8/dc/f1b 2281570 0 2024-09-13T02:54:00.637 INFO:tasks.workunit.client.0.smithi089.stdout:3/371: read - d2/d20/d44/f58 zero size 2024-09-13T02:54:00.639 INFO:tasks.workunit.client.0.smithi089.stdout:8/432: symlink de/d16/d1e/d27/d52/d61/d8e/l8f 0 2024-09-13T02:54:00.641 INFO:tasks.workunit.client.0.smithi089.stdout:6/382: link db/d43/d6e/d28/d2f/c40 db/d43/c88 0 2024-09-13T02:54:00.643 INFO:tasks.workunit.client.0.smithi089.stdout:2/371: rename d13/d30/d59/c60 to d13/d30/d64/c81 0 2024-09-13T02:54:00.643 INFO:tasks.workunit.client.0.smithi089.stdout:4/448: dread d2/da/f30 [0,4194304] 0 2024-09-13T02:54:00.643 INFO:tasks.workunit.client.0.smithi089.stdout:4/449: dread - d2/d3/d5/d43/f65 zero size 2024-09-13T02:54:00.644 INFO:tasks.workunit.client.0.smithi089.stdout:4/450: chown d2/d3/de/d62/f68 0 1 2024-09-13T02:54:00.644 INFO:tasks.workunit.client.0.smithi089.stdout:7/460: getdents d3/d44/d85/d5e/d6f 0 2024-09-13T02:54:00.645 INFO:tasks.workunit.client.0.smithi089.stdout:9/341: getdents d3/d6/df/d24/d35 0 2024-09-13T02:54:00.645 INFO:tasks.workunit.client.0.smithi089.stdout:9/342: write d3/d6/df/f6e [1509613,5953] 0 2024-09-13T02:54:00.645 INFO:tasks.workunit.client.0.smithi089.stdout:1/353: dwrite dc/d3a/d53/d2c/f2e [0,4194304] 0 2024-09-13T02:54:00.649 INFO:tasks.workunit.client.0.smithi089.stdout:5/394: write d1/d4/f14 [1772282,39625] 0 2024-09-13T02:54:00.652 INFO:tasks.workunit.client.0.smithi089.stdout:2/372: rmdir d13/d30/d4e/d7f 0 2024-09-13T02:54:00.652 INFO:tasks.workunit.client.0.smithi089.stdout:2/373: chown d13/d30/l53 1747 1 2024-09-13T02:54:00.652 INFO:tasks.workunit.client.0.smithi089.stdout:6/383: dread db/d10/d3a/f84 [0,4194304] 0 2024-09-13T02:54:00.652 INFO:tasks.workunit.client.0.smithi089.stdout:6/384: write db/d43/d6e/d28/d37/f4e [315424,96951] 0 2024-09-13T02:54:00.654 INFO:tasks.workunit.client.0.smithi089.stdout:7/461: creat d3/d19/d75/d14/f97 x:0 0 0 2024-09-13T02:54:00.656 INFO:tasks.workunit.client.0.smithi089.stdout:9/343: mknod d3/d6/df/d24/d32/c74 0 2024-09-13T02:54:00.657 INFO:tasks.workunit.client.0.smithi089.stdout:8/433: dwrite de/d16/f86 [0,4194304] 0 2024-09-13T02:54:00.659 INFO:tasks.workunit.client.0.smithi089.stdout:5/395: dread d1/d4/d45/f7b [0,4194304] 0 2024-09-13T02:54:00.659 INFO:tasks.workunit.client.0.smithi089.stdout:1/354: creat dc/d46/d6c/f71 x:0 0 0 2024-09-13T02:54:00.661 INFO:tasks.workunit.client.0.smithi089.stdout:2/374: mkdir d13/d30/d64/d82 0 2024-09-13T02:54:00.663 INFO:tasks.workunit.client.0.smithi089.stdout:4/451: symlink d2/d55/l8c 0 2024-09-13T02:54:00.664 INFO:tasks.workunit.client.0.smithi089.stdout:0/289: rename d2/f4a to d2/d19/d1a/d3d/d4b/d4f/f5e 0 2024-09-13T02:54:00.664 INFO:tasks.workunit.client.0.smithi089.stdout:0/290: dread - d2/d19/f22 zero size 2024-09-13T02:54:00.665 INFO:tasks.workunit.client.0.smithi089.stdout:0/291: chown d2/d19/d1a/d3d 6606 1 2024-09-13T02:54:00.666 INFO:tasks.workunit.client.0.smithi089.stdout:7/462: creat d3/d54/f98 x:0 0 0 2024-09-13T02:54:00.670 INFO:tasks.workunit.client.0.smithi089.stdout:4/452: fdatasync d2/f1f 0 2024-09-13T02:54:00.671 INFO:tasks.workunit.client.0.smithi089.stdout:6/385: dwrite db/d43/d6e/d28/d37/f52 [0,4194304] 0 2024-09-13T02:54:00.671 INFO:tasks.workunit.client.0.smithi089.stdout:6/386: dread - db/d10/d3a/d7b/f7c zero size 2024-09-13T02:54:00.671 INFO:tasks.workunit.client.0.smithi089.stdout:8/434: write de/f12 [2204555,8336] 0 2024-09-13T02:54:00.672 INFO:tasks.workunit.client.0.smithi089.stdout:9/344: dread d3/d6/d2a/d4b/d54/f72 [0,4194304] 0 2024-09-13T02:54:00.673 INFO:tasks.workunit.client.0.smithi089.stdout:3/372: dwrite d2/d8/d5f/f62 [0,4194304] 0 2024-09-13T02:54:00.674 INFO:tasks.workunit.client.0.smithi089.stdout:5/396: rename d1/d4/d1c to d1/d4/d45/d6f/d4d/d7f 0 2024-09-13T02:54:00.675 INFO:tasks.workunit.client.0.smithi089.stdout:4/453: mknod d2/d3/d5/d43/c8d 0 2024-09-13T02:54:00.679 INFO:tasks.workunit.client.0.smithi089.stdout:8/435: creat de/d16/d1e/d27/d52/d61/d8e/f90 x:0 0 0 2024-09-13T02:54:00.683 INFO:tasks.workunit.client.0.smithi089.stdout:6/387: dread db/d43/d6e/f55 [0,4194304] 0 2024-09-13T02:54:00.686 INFO:tasks.workunit.client.0.smithi089.stdout:3/373: creat d2/d20/d23/f73 x:0 0 0 2024-09-13T02:54:00.687 INFO:tasks.workunit.client.0.smithi089.stdout:3/374: fdatasync d2/d20/d23/d27/f4e 0 2024-09-13T02:54:00.687 INFO:tasks.workunit.client.0.smithi089.stdout:7/463: write d3/d19/d75/f29 [1200778,21256] 0 2024-09-13T02:54:00.688 INFO:tasks.workunit.client.0.smithi089.stdout:5/397: unlink d1/d4/d45/d6f/c24 0 2024-09-13T02:54:00.690 INFO:tasks.workunit.client.0.smithi089.stdout:1/355: dwrite dc/d46/f6b [0,4194304] 0 2024-09-13T02:54:00.690 INFO:tasks.workunit.client.0.smithi089.stdout:3/375: write d2/d20/d23/d2b/f3d [3998649,124797] 0 2024-09-13T02:54:00.690 INFO:tasks.workunit.client.0.smithi089.stdout:3/376: truncate d2/d8/dc/d3c/f5d 774516 0 2024-09-13T02:54:00.690 INFO:tasks.workunit.client.0.smithi089.stdout:3/377: readlink d2/d8/dc/l47 0 2024-09-13T02:54:00.690 INFO:tasks.workunit.client.0.smithi089.stdout:7/464: dread d3/d19/d2e/f6e [0,4194304] 0 2024-09-13T02:54:00.690 INFO:tasks.workunit.client.0.smithi089.stdout:7/465: chown d3/d19/f3d 8090 1 2024-09-13T02:54:00.691 INFO:tasks.workunit.client.0.smithi089.stdout:2/375: dwrite d13/d30/d4e/f71 [0,4194304] 0 2024-09-13T02:54:00.691 INFO:tasks.workunit.client.0.smithi089.stdout:2/376: fdatasync d13/f27 0 2024-09-13T02:54:00.691 INFO:tasks.workunit.client.0.smithi089.stdout:2/377: write d13/d30/f3c [1341070,49995] 0 2024-09-13T02:54:00.695 INFO:tasks.workunit.client.0.smithi089.stdout:8/436: mkdir de/d16/d1e/d27/d35/d91 0 2024-09-13T02:54:00.697 INFO:tasks.workunit.client.0.smithi089.stdout:9/345: getdents d3/d6 0 2024-09-13T02:54:00.697 INFO:tasks.workunit.client.0.smithi089.stdout:9/346: chown d3/f58 3 1 2024-09-13T02:54:00.699 INFO:tasks.workunit.client.0.smithi089.stdout:6/388: symlink db/d10/d3a/l89 0 2024-09-13T02:54:00.702 INFO:tasks.workunit.client.0.smithi089.stdout:4/454: dread d2/f40 [4194304,4194304] 0 2024-09-13T02:54:00.702 INFO:tasks.workunit.client.0.smithi089.stdout:4/455: write d2/d3/d5/d43/d3b/f54 [4295230,90018] 0 2024-09-13T02:54:00.707 INFO:tasks.workunit.client.0.smithi089.stdout:1/356: getdents dc/d57 0 2024-09-13T02:54:00.708 INFO:tasks.workunit.client.0.smithi089.stdout:1/357: fdatasync dc/d3a/d53/f52 0 2024-09-13T02:54:00.709 INFO:tasks.workunit.client.0.smithi089.stdout:3/378: mknod d2/d20/d23/d27/d51/d6c/c74 0 2024-09-13T02:54:00.710 INFO:tasks.workunit.client.0.smithi089.stdout:5/398: dwrite d1/d4/d45/d6f/d62/f79 [0,4194304] 0 2024-09-13T02:54:00.710 INFO:tasks.workunit.client.0.smithi089.stdout:8/437: dwrite de/d16/d1e/d27/d52/d61/f7b [0,4194304] 0 2024-09-13T02:54:00.710 INFO:tasks.workunit.client.0.smithi089.stdout:7/466: rename d3/c9 to d3/d44/d85/d77/c99 0 2024-09-13T02:54:00.710 INFO:tasks.workunit.client.0.smithi089.stdout:7/467: fdatasync d3/d20/f5d 0 2024-09-13T02:54:00.712 INFO:tasks.workunit.client.0.smithi089.stdout:3/379: dread d2/d8/dc/f1b [0,4194304] 0 2024-09-13T02:54:00.712 INFO:tasks.workunit.client.0.smithi089.stdout:3/380: fdatasync d2/d8/d5f/f62 0 2024-09-13T02:54:00.712 INFO:tasks.workunit.client.0.smithi089.stdout:3/381: truncate d2/d20/d23/d27/f4e 582004 0 2024-09-13T02:54:00.712 INFO:tasks.workunit.client.0.smithi089.stdout:2/378: creat d13/d30/d4e/d7b/f83 x:0 0 0 2024-09-13T02:54:00.713 INFO:tasks.workunit.client.0.smithi089.stdout:9/347: link d3/d6/df/d24/d29/l40 d3/d6/l75 0 2024-09-13T02:54:00.714 INFO:tasks.workunit.client.0.smithi089.stdout:5/399: dread d1/d4/d45/d6f/d4d/d7f/d49/f5d [0,4194304] 0 2024-09-13T02:54:00.714 INFO:tasks.workunit.client.0.smithi089.stdout:6/389: rmdir db/d43/d60/d74 39 2024-09-13T02:54:00.714 INFO:tasks.workunit.client.0.smithi089.stdout:6/390: chown db/d43/d6e/d28/d46/d53/f5a 1056 1 2024-09-13T02:54:00.714 INFO:tasks.workunit.client.0.smithi089.stdout:6/391: creat db/d10/d3a/f8a x:0 0 0 2024-09-13T02:54:00.716 INFO:tasks.workunit.client.0.smithi089.stdout:1/358: symlink dc/d3a/d53/d2c/d34/l72 0 2024-09-13T02:54:00.716 INFO:tasks.workunit.client.0.smithi089.stdout:5/400: dread d1/d4/d2b/f2e [0,4194304] 0 2024-09-13T02:54:00.716 INFO:tasks.workunit.client.0.smithi089.stdout:1/359: write dc/d46/d6c/f71 [317431,90583] 0 2024-09-13T02:54:00.722 INFO:tasks.workunit.client.0.smithi089.stdout:3/382: mkdir d2/d20/d23/d32/d49/d75 0 2024-09-13T02:54:00.722 INFO:tasks.workunit.client.0.smithi089.stdout:3/383: truncate d2/d8/dc/f2c 2050334 0 2024-09-13T02:54:00.725 INFO:tasks.workunit.client.0.smithi089.stdout:6/392: mkdir db/d43/d6e/d28/d37/d8b 0 2024-09-13T02:54:00.728 INFO:tasks.workunit.client.0.smithi089.stdout:4/456: rename d2/da/f3d to d2/f8e 0 2024-09-13T02:54:00.728 INFO:tasks.workunit.client.0.smithi089.stdout:4/457: readlink d2/d22/l74 0 2024-09-13T02:54:00.730 INFO:tasks.workunit.client.0.smithi089.stdout:9/348: getdents d3 0 2024-09-13T02:54:00.733 INFO:tasks.workunit.client.0.smithi089.stdout:8/438: dwrite de/d16/d1e/f4e [0,4194304] 0 2024-09-13T02:54:00.733 INFO:tasks.workunit.client.0.smithi089.stdout:8/439: creat de/d16/d1e/d3f/d71/f92 x:0 0 0 2024-09-13T02:54:00.733 INFO:tasks.workunit.client.0.smithi089.stdout:8/440: chown de/d16/d1e/d27/c50 2877 1 2024-09-13T02:54:00.733 INFO:tasks.workunit.client.0.smithi089.stdout:8/441: getdents de/d16/d1e/d27/d76/d8d 0 2024-09-13T02:54:00.733 INFO:tasks.workunit.client.0.smithi089.stdout:8/442: stat de/f40 0 2024-09-13T02:54:00.733 INFO:tasks.workunit.client.0.smithi089.stdout:6/393: creat db/d43/d60/d74/f8c x:0 0 0 2024-09-13T02:54:00.733 INFO:tasks.workunit.client.0.smithi089.stdout:6/394: write db/f23 [2536807,117603] 0 2024-09-13T02:54:00.733 INFO:tasks.workunit.client.0.smithi089.stdout:1/360: dwrite dc/d3a/d53/d2c/d34/f67 [0,4194304] 0 2024-09-13T02:54:00.736 INFO:tasks.workunit.client.0.smithi089.stdout:5/401: rename d1/d4/c34 to d1/d4/d45/d6f/d4d/d7f/c80 0 2024-09-13T02:54:00.740 INFO:tasks.workunit.client.0.smithi089.stdout:7/468: getdents d3/d44/d85/d77 0 2024-09-13T02:54:00.740 INFO:tasks.workunit.client.0.smithi089.stdout:7/469: stat d3/d19/d2e 0 2024-09-13T02:54:00.741 INFO:tasks.workunit.client.0.smithi089.stdout:8/443: mknod de/d16/d1e/d3f/d71/c93 0 2024-09-13T02:54:00.741 INFO:tasks.workunit.client.0.smithi089.stdout:8/444: creat de/d16/d1e/d27/d52/d61/f94 x:0 0 0 2024-09-13T02:54:00.748 INFO:tasks.workunit.client.0.smithi089.stdout:1/361: rename dc/d3a/d53/d2c/d34/d43 to dc/d44/d73 0 2024-09-13T02:54:00.750 INFO:tasks.workunit.client.0.smithi089.stdout:5/402: symlink d1/l81 0 2024-09-13T02:54:00.750 INFO:tasks.workunit.client.0.smithi089.stdout:5/403: chown d1/d4/f5 12627 1 2024-09-13T02:54:00.751 INFO:tasks.workunit.client.0.smithi089.stdout:7/470: symlink d3/d19/d2e/d37/l9a 0 2024-09-13T02:54:00.751 INFO:tasks.workunit.client.0.smithi089.stdout:7/471: write d3/d19/d2e/f88 [511279,104537] 0 2024-09-13T02:54:00.754 INFO:tasks.workunit.client.0.smithi089.stdout:5/404: creat d1/d4/d45/f82 x:0 0 0 2024-09-13T02:54:00.757 INFO:tasks.workunit.client.0.smithi089.stdout:8/445: write de/d16/d1e/d27/d35/f74 [3650901,71147] 0 2024-09-13T02:54:00.757 INFO:tasks.workunit.client.0.smithi089.stdout:3/384: dwrite d2/d8/f21 [4194304,4194304] 0 2024-09-13T02:54:00.757 INFO:tasks.workunit.client.0.smithi089.stdout:8/446: fsync f0 0 2024-09-13T02:54:00.757 INFO:tasks.workunit.client.0.smithi089.stdout:5/405: getdents d1/d4/d45/d6f/d4d 0 2024-09-13T02:54:00.757 INFO:tasks.workunit.client.0.smithi089.stdout:9/349: dwrite d3/d6/f73 [0,4194304] 0 2024-09-13T02:54:00.759 INFO:tasks.workunit.client.0.smithi089.stdout:4/458: dwrite d2/d3/d5/f64 [0,4194304] 0 2024-09-13T02:54:00.759 INFO:tasks.workunit.client.0.smithi089.stdout:4/459: dread - d2/da/f6d zero size 2024-09-13T02:54:00.760 INFO:tasks.workunit.client.0.smithi089.stdout:3/385: symlink d2/d20/d44/l76 0 2024-09-13T02:54:00.762 INFO:tasks.workunit.client.0.smithi089.stdout:8/447: link de/d16/d1e/d20/f2b de/d16/d1e/d27/d52/d61/f95 0 2024-09-13T02:54:00.762 INFO:tasks.workunit.client.0.smithi089.stdout:1/362: write dc/f10 [2137957,121136] 0 2024-09-13T02:54:00.770 INFO:tasks.workunit.client.0.smithi089.stdout:7/472: dwrite d3/d44/d85/d77/f8c [0,4194304] 0 2024-09-13T02:54:00.770 INFO:tasks.workunit.client.0.smithi089.stdout:3/386: getdents d2/d20/d23/d32/d5b 0 2024-09-13T02:54:00.772 INFO:tasks.workunit.client.0.smithi089.stdout:8/448: creat de/d16/d1e/d27/d35/d91/f96 x:0 0 0 2024-09-13T02:54:00.773 INFO:tasks.workunit.client.0.smithi089.stdout:8/449: readlink lc 0 2024-09-13T02:54:00.773 INFO:tasks.workunit.client.0.smithi089.stdout:9/350: mknod d3/d6/d2a/c76 0 2024-09-13T02:54:00.775 INFO:tasks.workunit.client.0.smithi089.stdout:4/460: mkdir d2/d3/d5/d43/d3b/d71/d7e/d8f 0 2024-09-13T02:54:00.775 INFO:tasks.workunit.client.0.smithi089.stdout:1/363: read dc/f13 [1910655,391] 0 2024-09-13T02:54:00.778 INFO:tasks.workunit.client.0.smithi089.stdout:7/473: mknod d3/d44/d85/d77/c9b 0 2024-09-13T02:54:00.778 INFO:tasks.workunit.client.0.smithi089.stdout:7/474: chown d3/d44/d85/d55/d96 22533561 1 2024-09-13T02:54:00.780 INFO:tasks.workunit.client.0.smithi089.stdout:3/387: mknod d2/d20/d23/d32/d49/c77 0 2024-09-13T02:54:00.781 INFO:tasks.workunit.client.0.smithi089.stdout:3/388: fdatasync d2/d20/d23/d2b/f2f 0 2024-09-13T02:54:00.782 INFO:tasks.workunit.client.0.smithi089.stdout:9/351: mkdir d3/d6/d2a/d4b/d77 0 2024-09-13T02:54:00.783 INFO:tasks.workunit.client.0.smithi089.stdout:9/352: creat d3/d6/d2a/f78 x:0 0 0 2024-09-13T02:54:00.784 INFO:tasks.workunit.client.0.smithi089.stdout:4/461: rename d2/d3/d5/f64 to d2/d3/de/d62/d6c/d88/f90 0 2024-09-13T02:54:00.784 INFO:tasks.workunit.client.0.smithi089.stdout:4/462: chown d2/da/c14 349307 1 2024-09-13T02:54:00.785 INFO:tasks.workunit.client.0.smithi089.stdout:1/364: mkdir dc/d3a/d74 0 2024-09-13T02:54:00.786 INFO:tasks.workunit.client.0.smithi089.stdout:7/475: unlink d3/c8e 0 2024-09-13T02:54:00.786 INFO:tasks.workunit.client.0.smithi089.stdout:7/476: write d3/d19/f41 [2350466,31515] 0 2024-09-13T02:54:00.788 INFO:tasks.workunit.client.0.smithi089.stdout:3/389: dread d2/d20/f28 [0,4194304] 0 2024-09-13T02:54:00.788 INFO:tasks.workunit.client.0.smithi089.stdout:1/365: mknod dc/d6e/c75 0 2024-09-13T02:54:00.788 INFO:tasks.workunit.client.0.smithi089.stdout:1/366: creat dc/d46/f76 x:0 0 0 2024-09-13T02:54:00.789 INFO:tasks.workunit.client.0.smithi089.stdout:0/292: sync 2024-09-13T02:54:00.789 INFO:tasks.workunit.client.0.smithi089.stdout:9/353: dread d3/d15/f1b [0,4194304] 0 2024-09-13T02:54:00.790 INFO:tasks.workunit.client.0.smithi089.stdout:3/390: creat d2/d20/d23/d32/d49/d75/f78 x:0 0 0 2024-09-13T02:54:00.791 INFO:tasks.workunit.client.0.smithi089.stdout:8/450: dwrite de/d16/d1e/d27/d52/d61/f94 [0,4194304] 0 2024-09-13T02:54:00.793 INFO:tasks.workunit.client.0.smithi089.stdout:0/293: mknod d2/d19/d1a/d1e/d42/c5f 0 2024-09-13T02:54:00.794 INFO:tasks.workunit.client.0.smithi089.stdout:3/391: unlink d2/d8/dc/d3c/f60 0 2024-09-13T02:54:00.798 INFO:tasks.workunit.client.0.smithi089.stdout:0/294: symlink d2/d19/d1a/d3d/d4b/l60 0 2024-09-13T02:54:00.799 INFO:tasks.workunit.client.0.smithi089.stdout:7/477: dread d3/f1b [0,4194304] 0 2024-09-13T02:54:00.799 INFO:tasks.workunit.client.0.smithi089.stdout:7/478: chown d3/d19/d2e/d37/l9a 58764 1 2024-09-13T02:54:00.800 INFO:tasks.workunit.client.0.smithi089.stdout:7/479: dread - d3/d44/d85/d5e/f95 zero size 2024-09-13T02:54:00.800 INFO:tasks.workunit.client.0.smithi089.stdout:8/451: dread de/d16/d1e/d20/d39/f70 [0,4194304] 0 2024-09-13T02:54:00.800 INFO:tasks.workunit.client.0.smithi089.stdout:8/452: write de/d16/d1e/d3f/f49 [479826,110653] 0 2024-09-13T02:54:00.800 INFO:tasks.workunit.client.0.smithi089.stdout:8/453: fsync de/f14 0 2024-09-13T02:54:00.801 INFO:tasks.workunit.client.0.smithi089.stdout:3/392: creat d2/d20/d23/d32/d5b/f79 x:0 0 0 2024-09-13T02:54:00.801 INFO:tasks.workunit.client.0.smithi089.stdout:3/393: stat d2/d8/dc/d3c/f5d 0 2024-09-13T02:54:00.801 INFO:tasks.workunit.client.0.smithi089.stdout:7/480: mknod d3/d44/d85/d55/c9c 0 2024-09-13T02:54:00.801 INFO:tasks.workunit.client.0.smithi089.stdout:0/295: write d2/d19/d1a/d3d/d4b/d4f/f5e [1947175,75266] 0 2024-09-13T02:54:00.802 INFO:tasks.workunit.client.0.smithi089.stdout:4/463: dwrite d2/d3/d5/d43/d3b/f60 [0,4194304] 0 2024-09-13T02:54:00.803 INFO:tasks.workunit.client.0.smithi089.stdout:8/454: symlink de/d16/d1e/d27/d52/d61/d8e/l97 0 2024-09-13T02:54:00.803 INFO:tasks.workunit.client.0.smithi089.stdout:8/455: write de/f5e [3465864,130366] 0 2024-09-13T02:54:00.803 INFO:tasks.workunit.client.0.smithi089.stdout:8/456: dread - de/f57 zero size 2024-09-13T02:54:00.804 INFO:tasks.workunit.client.0.smithi089.stdout:9/354: dread d3/d15/f3f [0,4194304] 0 2024-09-13T02:54:00.804 INFO:tasks.workunit.client.0.smithi089.stdout:3/394: dread d2/d8/dc/d3c/f5d [0,4194304] 0 2024-09-13T02:54:00.804 INFO:tasks.workunit.client.0.smithi089.stdout:3/395: chown d2/d20/d23/d2b/f53 724265 1 2024-09-13T02:54:00.806 INFO:tasks.workunit.client.0.smithi089.stdout:1/367: dwrite dc/f13 [4194304,4194304] 0 2024-09-13T02:54:00.807 INFO:tasks.workunit.client.0.smithi089.stdout:4/464: symlink d2/d3/d5/d43/d3b/d71/d7e/l91 0 2024-09-13T02:54:00.807 INFO:tasks.workunit.client.0.smithi089.stdout:4/465: read d2/d3/d5/d43/d3b/f54 [1091449,78932] 0 2024-09-13T02:54:00.812 INFO:tasks.workunit.client.0.smithi089.stdout:1/368: mknod dc/d6e/c77 0 2024-09-13T02:54:00.818 INFO:tasks.workunit.client.0.smithi089.stdout:3/396: dread d2/f16 [0,4194304] 0 2024-09-13T02:54:00.821 INFO:tasks.workunit.client.0.smithi089.stdout:3/397: link d2/d20/f39 d2/d20/d23/d32/d5b/f7a 0 2024-09-13T02:54:00.831 INFO:tasks.workunit.client.0.smithi089.stdout:8/457: dread de/d16/d1e/f21 [0,4194304] 0 2024-09-13T02:54:00.831 INFO:tasks.workunit.client.0.smithi089.stdout:8/458: creat de/d16/d1e/d27/d76/f98 x:0 0 0 2024-09-13T02:54:00.834 INFO:tasks.workunit.client.0.smithi089.stdout:8/459: creat de/d16/d1e/d20/d6c/f99 x:0 0 0 2024-09-13T02:54:00.839 INFO:tasks.workunit.client.0.smithi089.stdout:2/379: sync 2024-09-13T02:54:00.849 INFO:tasks.workunit.client.0.smithi089.stdout:0/296: dwrite d2/d19/f2d [0,4194304] 0 2024-09-13T02:54:00.851 INFO:tasks.workunit.client.0.smithi089.stdout:0/297: mknod d2/d19/d1a/d3d/d4b/c61 0 2024-09-13T02:54:00.851 INFO:tasks.workunit.client.0.smithi089.stdout:0/298: mknod d2/d19/d1a/d1e/c62 0 2024-09-13T02:54:00.853 INFO:tasks.workunit.client.0.smithi089.stdout:0/299: mkdir d2/d19/d1a/d63 0 2024-09-13T02:54:00.854 INFO:tasks.workunit.client.0.smithi089.stdout:0/300: dread d2/d19/f32 [0,4194304] 0 2024-09-13T02:54:00.856 INFO:tasks.workunit.client.0.smithi089.stdout:0/301: mkdir d2/d64 0 2024-09-13T02:54:00.857 INFO:tasks.workunit.client.0.smithi089.stdout:0/302: mknod d2/c65 0 2024-09-13T02:54:00.859 INFO:tasks.workunit.client.0.smithi089.stdout:0/303: mknod d2/d19/d1a/d3d/c66 0 2024-09-13T02:54:00.859 INFO:tasks.workunit.client.0.smithi089.stdout:0/304: dread - d2/d19/d1a/d3d/d4b/d4f/f5b zero size 2024-09-13T02:54:00.859 INFO:tasks.workunit.client.0.smithi089.stdout:3/398: dwrite d2/d8/f36 [0,4194304] 0 2024-09-13T02:54:00.859 INFO:tasks.workunit.client.0.smithi089.stdout:1/369: dwrite dc/f13 [8388608,4194304] 0 2024-09-13T02:54:00.859 INFO:tasks.workunit.client.0.smithi089.stdout:3/399: chown d2/d8/dc/f30 0 1 2024-09-13T02:54:00.859 INFO:tasks.workunit.client.0.smithi089.stdout:9/355: dwrite d3/d6/df/d24/d35/f45 [0,4194304] 0 2024-09-13T02:54:00.859 INFO:tasks.workunit.client.0.smithi089.stdout:4/466: dwrite d2/d22/f7f [0,4194304] 0 2024-09-13T02:54:00.860 INFO:tasks.workunit.client.0.smithi089.stdout:4/467: read - d2/d3/d5/d43/f82 zero size 2024-09-13T02:54:00.860 INFO:tasks.workunit.client.0.smithi089.stdout:4/468: fsync d2/d3/d5/f85 0 2024-09-13T02:54:00.860 INFO:tasks.workunit.client.0.smithi089.stdout:4/469: chown d2/d22 25157129 1 2024-09-13T02:54:00.860 INFO:tasks.workunit.client.0.smithi089.stdout:2/380: dwrite d13/d30/f48 [0,4194304] 0 2024-09-13T02:54:00.860 INFO:tasks.workunit.client.0.smithi089.stdout:2/381: write d13/f44 [277722,120556] 0 2024-09-13T02:54:00.861 INFO:tasks.workunit.client.0.smithi089.stdout:1/370: unlink dc/d3a/d53/d2c/d34/f32 0 2024-09-13T02:54:00.862 INFO:tasks.workunit.client.0.smithi089.stdout:8/460: getdents de/d16/d1e/d20/d6c 0 2024-09-13T02:54:00.873 INFO:tasks.workunit.client.0.smithi089.stdout:4/470: rmdir d2/d3/d5/d72/d8b 0 2024-09-13T02:54:00.874 INFO:tasks.workunit.client.0.smithi089.stdout:8/461: dread de/d16/d1e/f21 [0,4194304] 0 2024-09-13T02:54:00.874 INFO:tasks.workunit.client.0.smithi089.stdout:2/382: link d13/d30/d4e/f74 d13/d30/d4e/d6f/f84 0 2024-09-13T02:54:00.876 INFO:tasks.workunit.client.0.smithi089.stdout:1/371: creat dc/d3a/d53/d2c/d34/f78 x:0 0 0 2024-09-13T02:54:00.876 INFO:tasks.workunit.client.0.smithi089.stdout:1/372: creat dc/d46/f79 x:0 0 0 2024-09-13T02:54:00.876 INFO:tasks.workunit.client.0.smithi089.stdout:1/373: write dc/d44/f62 [802155,6726] 0 2024-09-13T02:54:00.876 INFO:tasks.workunit.client.0.smithi089.stdout:1/374: creat dc/d46/d6c/f7a x:0 0 0 2024-09-13T02:54:00.877 INFO:tasks.workunit.client.0.smithi089.stdout:3/400: getdents d2/d20/d23/d32 0 2024-09-13T02:54:00.877 INFO:tasks.workunit.client.0.smithi089.stdout:3/401: read - d2/d20/f4b zero size 2024-09-13T02:54:00.877 INFO:tasks.workunit.client.0.smithi089.stdout:3/402: dread - d2/d20/d44/f58 zero size 2024-09-13T02:54:00.878 INFO:tasks.workunit.client.0.smithi089.stdout:8/462: dread de/d16/d1e/d3f/d71/f81 [0,4194304] 0 2024-09-13T02:54:00.879 INFO:tasks.workunit.client.0.smithi089.stdout:5/406: sync 2024-09-13T02:54:00.879 INFO:tasks.workunit.client.0.smithi089.stdout:6/395: sync 2024-09-13T02:54:00.880 INFO:tasks.workunit.client.0.smithi089.stdout:9/356: unlink d3/d6/d36/l3e 0 2024-09-13T02:54:00.881 INFO:tasks.workunit.client.0.smithi089.stdout:4/471: symlink d2/d3/de/d62/d6c/d88/l92 0 2024-09-13T02:54:00.885 INFO:tasks.workunit.client.0.smithi089.stdout:7/481: sync 2024-09-13T02:54:00.887 INFO:tasks.workunit.client.0.smithi089.stdout:0/305: dwrite d2/d19/d1a/d1e/d42/f49 [0,4194304] 0 2024-09-13T02:54:00.887 INFO:tasks.workunit.client.0.smithi089.stdout:3/403: rename d2/c1d to d2/d20/d23/c7b 0 2024-09-13T02:54:00.888 INFO:tasks.workunit.client.0.smithi089.stdout:2/383: write d13/f3b [528498,17336] 0 2024-09-13T02:54:00.888 INFO:tasks.workunit.client.0.smithi089.stdout:8/463: mknod de/d16/d1e/d3f/c9a 0 2024-09-13T02:54:00.889 INFO:tasks.workunit.client.0.smithi089.stdout:5/407: symlink d1/d4/d2b/l83 0 2024-09-13T02:54:00.889 INFO:tasks.workunit.client.0.smithi089.stdout:9/357: mknod d3/d6/d2a/c79 0 2024-09-13T02:54:00.890 INFO:tasks.workunit.client.0.smithi089.stdout:4/472: symlink d2/d3/d86/l93 0 2024-09-13T02:54:00.893 INFO:tasks.workunit.client.0.smithi089.stdout:0/306: creat d2/d19/d1a/d4e/f67 x:0 0 0 2024-09-13T02:54:00.894 INFO:tasks.workunit.client.0.smithi089.stdout:8/464: dread de/f4d [0,4194304] 0 2024-09-13T02:54:00.894 INFO:tasks.workunit.client.0.smithi089.stdout:3/404: link d2/d8/f36 d2/d20/d23/d27/d51/d6c/f7c 0 2024-09-13T02:54:00.897 INFO:tasks.workunit.client.0.smithi089.stdout:2/384: creat d13/d30/d61/d78/d79/f85 x:0 0 0 2024-09-13T02:54:00.898 INFO:tasks.workunit.client.0.smithi089.stdout:5/408: symlink d1/d4/d2b/l84 0 2024-09-13T02:54:00.899 INFO:tasks.workunit.client.0.smithi089.stdout:7/482: dread d3/d44/d85/d55/f8d [0,4194304] 0 2024-09-13T02:54:00.901 INFO:tasks.workunit.client.0.smithi089.stdout:8/465: symlink de/d16/d1e/d27/d35/d91/l9b 0 2024-09-13T02:54:00.901 INFO:tasks.workunit.client.0.smithi089.stdout:2/385: mkdir d13/d30/d4e/d7b/d86 0 2024-09-13T02:54:00.902 INFO:tasks.workunit.client.0.smithi089.stdout:5/409: symlink d1/d4/d45/d6f/d62/d72/l85 0 2024-09-13T02:54:00.903 INFO:tasks.workunit.client.0.smithi089.stdout:0/307: getdents d2/d19 0 2024-09-13T02:54:00.904 INFO:tasks.workunit.client.0.smithi089.stdout:0/308: write d2/d19/f39 [815073,17618] 0 2024-09-13T02:54:00.904 INFO:tasks.workunit.client.0.smithi089.stdout:8/466: symlink de/d16/d1e/d27/l9c 0 2024-09-13T02:54:00.905 INFO:tasks.workunit.client.0.smithi089.stdout:1/375: dwrite dc/d3a/d53/d2c/d34/f5f [0,4194304] 0 2024-09-13T02:54:00.905 INFO:tasks.workunit.client.0.smithi089.stdout:2/386: truncate d13/d30/d59/f5a 2137254 0 2024-09-13T02:54:00.908 INFO:tasks.workunit.client.0.smithi089.stdout:8/467: symlink de/d16/d1e/d27/d76/l9d 0 2024-09-13T02:54:00.908 INFO:tasks.workunit.client.0.smithi089.stdout:8/468: chown de/d16/d1e/d3f/f54 103 1 2024-09-13T02:54:00.909 INFO:tasks.workunit.client.0.smithi089.stdout:8/469: truncate de/d16/f6f 949485 0 2024-09-13T02:54:00.909 INFO:tasks.workunit.client.0.smithi089.stdout:6/396: dwrite db/d43/f3b [0,4194304] 0 2024-09-13T02:54:00.909 INFO:tasks.workunit.client.0.smithi089.stdout:3/405: dread d2/f2d [0,4194304] 0 2024-09-13T02:54:00.909 INFO:tasks.workunit.client.0.smithi089.stdout:3/406: write d2/d20/d23/d32/d5b/f79 [485303,21430] 0 2024-09-13T02:54:00.909 INFO:tasks.workunit.client.0.smithi089.stdout:0/309: rename d2/l10 to d2/d19/d1a/d1e/d42/l68 0 2024-09-13T02:54:00.912 INFO:tasks.workunit.client.0.smithi089.stdout:8/470: mknod de/d16/d1e/d27/d35/d91/c9e 0 2024-09-13T02:54:00.912 INFO:tasks.workunit.client.0.smithi089.stdout:7/483: write d3/f7c [3012061,73098] 0 2024-09-13T02:54:00.912 INFO:tasks.workunit.client.0.smithi089.stdout:7/484: truncate d3/d19/d75/d14/f97 982634 0 2024-09-13T02:54:00.912 INFO:tasks.workunit.client.0.smithi089.stdout:7/485: chown d3/d19/f4d 30649 1 2024-09-13T02:54:00.913 INFO:tasks.workunit.client.0.smithi089.stdout:6/397: creat db/d43/d6e/d28/d37/f8d x:0 0 0 2024-09-13T02:54:00.914 INFO:tasks.workunit.client.0.smithi089.stdout:4/473: dwrite d2/f8e [0,4194304] 0 2024-09-13T02:54:00.915 INFO:tasks.workunit.client.0.smithi089.stdout:3/407: mkdir d2/d8/dc/d3c/d65/d7d 0 2024-09-13T02:54:00.917 INFO:tasks.workunit.client.0.smithi089.stdout:5/410: read d1/d4/d45/d6f/f3b [617426,72226] 0 2024-09-13T02:54:00.917 INFO:tasks.workunit.client.0.smithi089.stdout:0/310: mknod d2/d19/c69 0 2024-09-13T02:54:00.924 INFO:tasks.workunit.client.0.smithi089.stdout:4/474: rmdir d2/d3/de/d62 39 2024-09-13T02:54:00.924 INFO:tasks.workunit.client.0.smithi089.stdout:4/475: readlink d2/d55/l5a 0 2024-09-13T02:54:00.925 INFO:tasks.workunit.client.0.smithi089.stdout:7/486: write f0 [2564185,7935] 0 2024-09-13T02:54:00.925 INFO:tasks.workunit.client.0.smithi089.stdout:8/471: dread de/d16/d1e/d20/d6c/d6e/d7e/f82 [0,4194304] 0 2024-09-13T02:54:00.927 INFO:tasks.workunit.client.0.smithi089.stdout:9/358: dwrite d3/d6/d2a/f78 [0,4194304] 0 2024-09-13T02:54:00.928 INFO:tasks.workunit.client.0.smithi089.stdout:3/408: creat d2/d20/d23/d32/f7e x:0 0 0 2024-09-13T02:54:00.929 INFO:tasks.workunit.client.0.smithi089.stdout:5/411: mknod d1/d73/c86 0 2024-09-13T02:54:00.929 INFO:tasks.workunit.client.0.smithi089.stdout:5/412: write d1/d4/d45/d6f/d4d/d7f/d49/f6b [3537751,128686] 0 2024-09-13T02:54:00.932 INFO:tasks.workunit.client.0.smithi089.stdout:0/311: rename d2/d19/f44 to d2/d19/d1a/d1e/d42/f6a 0 2024-09-13T02:54:00.934 INFO:tasks.workunit.client.0.smithi089.stdout:4/476: creat d2/d22/f94 x:0 0 0 2024-09-13T02:54:00.935 INFO:tasks.workunit.client.0.smithi089.stdout:7/487: symlink d3/d44/d85/d55/l9d 0 2024-09-13T02:54:00.935 INFO:tasks.workunit.client.0.smithi089.stdout:7/488: write d3/d44/d85/d55/f8d [5030624,49495] 0 2024-09-13T02:54:00.936 INFO:tasks.workunit.client.0.smithi089.stdout:2/387: dwrite d13/d30/d4e/f5d [0,4194304] 0 2024-09-13T02:54:00.936 INFO:tasks.workunit.client.0.smithi089.stdout:6/398: dwrite db/d43/d6e/d28/f57 [0,4194304] 0 2024-09-13T02:54:00.937 INFO:tasks.workunit.client.0.smithi089.stdout:9/359: mknod d3/d6/df/d24/d6c/c7a 0 2024-09-13T02:54:00.938 INFO:tasks.workunit.client.0.smithi089.stdout:9/360: dread - d3/d6/d2a/f60 zero size 2024-09-13T02:54:00.940 INFO:tasks.workunit.client.0.smithi089.stdout:7/489: link d3/d19/d2e/d37/l93 d3/d19/d2e/d37/l9e 0 2024-09-13T02:54:00.941 INFO:tasks.workunit.client.0.smithi089.stdout:7/490: write d3/d19/d67/f8b [1250949,86246] 0 2024-09-13T02:54:00.941 INFO:tasks.workunit.client.0.smithi089.stdout:5/413: write d1/d4/d45/d6f/d4d/f58 [548627,100656] 0 2024-09-13T02:54:00.943 INFO:tasks.workunit.client.0.smithi089.stdout:4/477: read d2/d3/d5/f38 [2110158,44702] 0 2024-09-13T02:54:00.948 INFO:tasks.workunit.client.0.smithi089.stdout:9/361: dread d3/f22 [0,4194304] 0 2024-09-13T02:54:00.948 INFO:tasks.workunit.client.0.smithi089.stdout:6/399: symlink db/l8e 0 2024-09-13T02:54:00.953 INFO:tasks.workunit.client.0.smithi089.stdout:0/312: rmdir d2/d19/d1a/d3d/d4b 39 2024-09-13T02:54:00.953 INFO:tasks.workunit.client.0.smithi089.stdout:0/313: write d2/d19/d1a/d3d/d4b/d4f/f5b [846113,8057] 0 2024-09-13T02:54:00.955 INFO:tasks.workunit.client.0.smithi089.stdout:7/491: chown d3/c2a 106383138 1 2024-09-13T02:54:00.957 INFO:tasks.workunit.client.0.smithi089.stdout:5/414: symlink d1/d4/d2b/l87 0 2024-09-13T02:54:00.957 INFO:tasks.workunit.client.0.smithi089.stdout:5/415: read - d1/d4/d45/d6f/d4d/f7a zero size 2024-09-13T02:54:00.957 INFO:tasks.workunit.client.0.smithi089.stdout:5/416: readlink d1/d4/d45/d6f/d62/l64 0 2024-09-13T02:54:00.961 INFO:tasks.workunit.client.0.smithi089.stdout:2/388: rmdir d13/d30 39 2024-09-13T02:54:00.963 INFO:tasks.workunit.client.0.smithi089.stdout:4/478: dwrite d2/d22/f35 [0,4194304] 0 2024-09-13T02:54:00.965 INFO:tasks.workunit.client.0.smithi089.stdout:0/314: unlink d2/d19/d1a/d3d/d4b/f4c 0 2024-09-13T02:54:00.967 INFO:tasks.workunit.client.0.smithi089.stdout:5/417: unlink d1/d4/d45/d6f/d4d/f67 0 2024-09-13T02:54:00.967 INFO:tasks.workunit.client.0.smithi089.stdout:5/418: write d1/d4/d45/d6f/d4d/d7f/d49/f5b [575731,100684] 0 2024-09-13T02:54:00.967 INFO:tasks.workunit.client.0.smithi089.stdout:5/419: creat d1/d4/d45/d6f/f88 x:0 0 0 2024-09-13T02:54:00.968 INFO:tasks.workunit.client.0.smithi089.stdout:9/362: symlink d3/d6/df/l7b 0 2024-09-13T02:54:00.968 INFO:tasks.workunit.client.0.smithi089.stdout:9/363: chown d3/d6/d2a/d4b/d77 425 1 2024-09-13T02:54:00.969 INFO:tasks.workunit.client.0.smithi089.stdout:9/364: truncate d3/d6/df/d24/d35/f45 4360907 0 2024-09-13T02:54:00.969 INFO:tasks.workunit.client.0.smithi089.stdout:9/365: write d3/d6/df/f62 [675558,46742] 0 2024-09-13T02:54:00.969 INFO:tasks.workunit.client.0.smithi089.stdout:7/492: dread d3/d20/f5d [0,4194304] 0 2024-09-13T02:54:00.974 INFO:tasks.workunit.client.0.smithi089.stdout:5/420: dread d1/f26 [4194304,4194304] 0 2024-09-13T02:54:00.975 INFO:tasks.workunit.client.0.smithi089.stdout:4/479: creat d2/d3/de/f95 x:0 0 0 2024-09-13T02:54:00.975 INFO:tasks.workunit.client.0.smithi089.stdout:4/480: fdatasync d2/da/f75 0 2024-09-13T02:54:00.975 INFO:tasks.workunit.client.0.smithi089.stdout:7/493: dread d3/f1b [0,4194304] 0 2024-09-13T02:54:00.977 INFO:tasks.workunit.client.0.smithi089.stdout:6/400: rename db/d10/l1c to db/d43/d60/d7d/l8f 0 2024-09-13T02:54:00.979 INFO:tasks.workunit.client.0.smithi089.stdout:0/315: truncate d2/f35 3509550 0 2024-09-13T02:54:00.984 INFO:tasks.workunit.client.0.smithi089.stdout:4/481: dread d2/d3/d5/d43/f50 [0,4194304] 0 2024-09-13T02:54:00.984 INFO:tasks.workunit.client.0.smithi089.stdout:9/366: unlink d3/d6/df/d24/d35/f45 0 2024-09-13T02:54:00.984 INFO:tasks.workunit.client.0.smithi089.stdout:4/482: stat d2/d3/d86/l93 0 2024-09-13T02:54:00.986 INFO:tasks.workunit.client.0.smithi089.stdout:2/389: dwrite d13/d30/f2b [0,4194304] 0 2024-09-13T02:54:00.986 INFO:tasks.workunit.client.0.smithi089.stdout:2/390: chown d13/d30/l21 637 1 2024-09-13T02:54:00.987 INFO:tasks.workunit.client.0.smithi089.stdout:5/421: creat d1/d4/d45/d6f/d4d/d7f/d49/d5a/f89 x:0 0 0 2024-09-13T02:54:00.987 INFO:tasks.workunit.client.0.smithi089.stdout:5/422: creat d1/d4/d45/d6f/d62/f8a x:0 0 0 2024-09-13T02:54:00.987 INFO:tasks.workunit.client.0.smithi089.stdout:5/423: dread - d1/d4/d45/d6f/f6d zero size 2024-09-13T02:54:00.987 INFO:tasks.workunit.client.0.smithi089.stdout:5/424: creat d1/d4/d45/d6f/d4d/d7f/d49/d5a/f8b x:0 0 0 2024-09-13T02:54:00.987 INFO:tasks.workunit.client.0.smithi089.stdout:5/425: chown d1/d4/d2b/f2d 28 1 2024-09-13T02:54:00.987 INFO:tasks.workunit.client.0.smithi089.stdout:7/494: dread d3/d19/d75/f5a [0,4194304] 0 2024-09-13T02:54:00.988 INFO:tasks.workunit.client.0.smithi089.stdout:0/316: write d2/f3a [187404,84036] 0 2024-09-13T02:54:00.988 INFO:tasks.workunit.client.0.smithi089.stdout:2/391: dread d13/d30/d4e/f65 [0,4194304] 0 2024-09-13T02:54:00.988 INFO:tasks.workunit.client.0.smithi089.stdout:2/392: chown d13/d30/f48 22411755 1 2024-09-13T02:54:00.988 INFO:tasks.workunit.client.0.smithi089.stdout:2/393: write d13/d30/f75 [985747,112939] 0 2024-09-13T02:54:00.989 INFO:tasks.workunit.client.0.smithi089.stdout:7/495: dread d3/d19/d2e/f6e [0,4194304] 0 2024-09-13T02:54:00.989 INFO:tasks.workunit.client.0.smithi089.stdout:9/367: unlink d3/d15/f17 0 2024-09-13T02:54:00.992 INFO:tasks.workunit.client.0.smithi089.stdout:1/376: sync 2024-09-13T02:54:00.996 INFO:tasks.workunit.client.0.smithi089.stdout:9/368: dread d3/d6/d2a/f4f [0,4194304] 0 2024-09-13T02:54:00.996 INFO:tasks.workunit.client.0.smithi089.stdout:5/426: mkdir d1/d4/d45/d8c 0 2024-09-13T02:54:00.997 INFO:tasks.workunit.client.0.smithi089.stdout:0/317: write d2/f34 [4455999,110647] 0 2024-09-13T02:54:00.999 INFO:tasks.workunit.client.0.smithi089.stdout:2/394: mknod d13/d30/d61/d78/d79/c87 0 2024-09-13T02:54:01.001 INFO:tasks.workunit.client.0.smithi089.stdout:7/496: symlink d3/d19/d75/d63/l9f 0 2024-09-13T02:54:01.001 INFO:tasks.workunit.client.0.smithi089.stdout:7/497: truncate d3/d19/d2e/f6e 1524440 0 2024-09-13T02:54:01.001 INFO:tasks.workunit.client.0.smithi089.stdout:7/498: fsync d3/d19/f36 0 2024-09-13T02:54:01.002 INFO:tasks.workunit.client.0.smithi089.stdout:9/369: dread d3/f5 [0,4194304] 0 2024-09-13T02:54:01.003 INFO:tasks.workunit.client.0.smithi089.stdout:4/483: rename d2/l2c to d2/d55/l96 0 2024-09-13T02:54:01.004 INFO:tasks.workunit.client.0.smithi089.stdout:5/427: link d1/d4/l1d d1/d4/l8d 0 2024-09-13T02:54:01.005 INFO:tasks.workunit.client.0.smithi089.stdout:1/377: dread dc/d3a/d53/d2c/d36/f58 [0,4194304] 0 2024-09-13T02:54:01.007 INFO:tasks.workunit.client.0.smithi089.stdout:0/318: mkdir d2/d19/d1a/d3d/d4b/d4f/d59/d6b 0 2024-09-13T02:54:01.008 INFO:tasks.workunit.client.0.smithi089.stdout:2/395: rmdir d13/d30/d64 39 2024-09-13T02:54:01.008 INFO:tasks.workunit.client.0.smithi089.stdout:8/472: sync 2024-09-13T02:54:01.008 INFO:tasks.workunit.client.0.smithi089.stdout:3/409: sync 2024-09-13T02:54:01.011 INFO:tasks.workunit.client.0.smithi089.stdout:7/499: rename d3/d19/d2e/d7a to d3/d19/d75/d14/da0 0 2024-09-13T02:54:01.012 INFO:tasks.workunit.client.0.smithi089.stdout:1/378: rmdir dc/d6e 39 2024-09-13T02:54:01.014 INFO:tasks.workunit.client.0.smithi089.stdout:0/319: link d2/d19/d1a/f4d d2/d19/d1a/d3d/d4b/d4f/d59/d6b/f6c 0 2024-09-13T02:54:01.016 INFO:tasks.workunit.client.0.smithi089.stdout:2/396: mknod d13/d30/d61/d78/d79/d7c/c88 0 2024-09-13T02:54:01.016 INFO:tasks.workunit.client.0.smithi089.stdout:2/397: fdatasync d13/d30/f4a 0 2024-09-13T02:54:01.016 INFO:tasks.workunit.client.0.smithi089.stdout:2/398: fdatasync d13/d30/f40 0 2024-09-13T02:54:01.016 INFO:tasks.workunit.client.0.smithi089.stdout:2/399: chown d13/d30/d4e/f5d 0 1 2024-09-13T02:54:01.016 INFO:tasks.workunit.client.0.smithi089.stdout:7/500: mkdir d3/d19/d75/d63/da1 0 2024-09-13T02:54:01.017 INFO:tasks.workunit.client.0.smithi089.stdout:7/501: chown d3/d19/d2e/f88 35680767 1 2024-09-13T02:54:01.017 INFO:tasks.workunit.client.0.smithi089.stdout:0/320: creat d2/d19/d1a/d3d/d4b/d4f/f6d x:0 0 0 2024-09-13T02:54:01.024 INFO:tasks.workunit.client.0.smithi089.stdout:4/484: read d2/f4c [5585465,105579] 0 2024-09-13T02:54:01.029 INFO:tasks.workunit.client.0.smithi089.stdout:7/502: dread d3/f7c [0,4194304] 0 2024-09-13T02:54:01.029 INFO:tasks.workunit.client.0.smithi089.stdout:7/503: chown d3/d44/c4c 180 1 2024-09-13T02:54:01.031 INFO:tasks.workunit.client.0.smithi089.stdout:7/504: creat d3/d19/d75/d63/da1/fa2 x:0 0 0 2024-09-13T02:54:01.034 INFO:tasks.workunit.client.0.smithi089.stdout:7/505: unlink d3/d19/d2e/d37/l8f 0 2024-09-13T02:54:01.036 INFO:tasks.workunit.client.0.smithi089.stdout:0/321: fdatasync d2/f34 0 2024-09-13T02:54:01.036 INFO:tasks.workunit.client.0.smithi089.stdout:2/400: dread d13/f3b [0,4194304] 0 2024-09-13T02:54:01.036 INFO:tasks.workunit.client.0.smithi089.stdout:2/401: dread - d13/d30/d4e/f56 zero size 2024-09-13T02:54:01.036 INFO:tasks.workunit.client.0.smithi089.stdout:1/379: dread dc/f21 [0,4194304] 0 2024-09-13T02:54:01.036 INFO:tasks.workunit.client.0.smithi089.stdout:1/380: write dc/d3a/d53/f66 [811901,84795] 0 2024-09-13T02:54:01.038 INFO:tasks.workunit.client.0.smithi089.stdout:7/506: creat d3/d44/d85/d5e/d6f/fa3 x:0 0 0 2024-09-13T02:54:01.038 INFO:tasks.workunit.client.0.smithi089.stdout:8/473: dwrite de/d16/f85 [0,4194304] 0 2024-09-13T02:54:01.040 INFO:tasks.workunit.client.0.smithi089.stdout:2/402: truncate d13/f3b 1366628 0 2024-09-13T02:54:01.040 INFO:tasks.workunit.client.0.smithi089.stdout:5/428: dwrite d1/d4/f3a [0,4194304] 0 2024-09-13T02:54:01.040 INFO:tasks.workunit.client.0.smithi089.stdout:9/370: dread d3/d6/fe [0,4194304] 0 2024-09-13T02:54:01.041 INFO:tasks.workunit.client.0.smithi089.stdout:0/322: truncate d2/d19/d1a/d3d/d4b/d4f/f5e 1857220 0 2024-09-13T02:54:01.041 INFO:tasks.workunit.client.0.smithi089.stdout:0/323: readlink d2/d19/d1a/d1e/d42/l5a 0 2024-09-13T02:54:01.042 INFO:tasks.workunit.client.0.smithi089.stdout:1/381: symlink dc/d44/l7b 0 2024-09-13T02:54:01.043 INFO:tasks.workunit.client.0.smithi089.stdout:3/410: dwrite d2/d20/f28 [0,4194304] 0 2024-09-13T02:54:01.043 INFO:tasks.workunit.client.0.smithi089.stdout:3/411: creat d2/d20/d23/d32/d49/f7f x:0 0 0 2024-09-13T02:54:01.043 INFO:tasks.workunit.client.0.smithi089.stdout:3/412: chown d2/d8/dc/d3c/c6b 35 1 2024-09-13T02:54:01.043 INFO:tasks.workunit.client.0.smithi089.stdout:3/413: chown d2/d20/d23/d32/d49/c77 433 1 2024-09-13T02:54:01.043 INFO:tasks.workunit.client.0.smithi089.stdout:3/414: fsync d2/d20/d23/d27/f4e 0 2024-09-13T02:54:01.043 INFO:tasks.workunit.client.0.smithi089.stdout:8/474: mknod de/d16/d1e/d3f/d5b/c9f 0 2024-09-13T02:54:01.047 INFO:tasks.workunit.client.0.smithi089.stdout:9/371: truncate d3/d6/df/d24/d29/f52 3219445 0 2024-09-13T02:54:01.050 INFO:tasks.workunit.client.0.smithi089.stdout:5/429: creat d1/d4/d45/d8c/f8e x:0 0 0 2024-09-13T02:54:01.050 INFO:tasks.workunit.client.0.smithi089.stdout:5/430: fdatasync d1/d4/d45/f82 0 2024-09-13T02:54:01.050 INFO:tasks.workunit.client.0.smithi089.stdout:5/431: read d1/d4/d2b/f2d [836494,35576] 0 2024-09-13T02:54:01.050 INFO:tasks.workunit.client.0.smithi089.stdout:5/432: truncate d1/d4/f5 1530622 0 2024-09-13T02:54:01.050 INFO:tasks.workunit.client.0.smithi089.stdout:1/382: unlink dc/d3a/d53/f3f 0 2024-09-13T02:54:01.050 INFO:tasks.workunit.client.0.smithi089.stdout:4/485: dwrite d2/f53 [0,4194304] 0 2024-09-13T02:54:01.051 INFO:tasks.workunit.client.0.smithi089.stdout:2/403: dread d13/f17 [0,4194304] 0 2024-09-13T02:54:01.051 INFO:tasks.workunit.client.0.smithi089.stdout:2/404: getdents d13/d30/d4e/d7b/d86 0 2024-09-13T02:54:01.052 INFO:tasks.workunit.client.0.smithi089.stdout:3/415: link d2/d20/d23/d27/d51/c5a d2/d20/d23/d32/d49/c80 0 2024-09-13T02:54:01.054 INFO:tasks.workunit.client.0.smithi089.stdout:8/475: creat de/d16/d1e/d27/d76/d8d/fa0 x:0 0 0 2024-09-13T02:54:01.054 INFO:tasks.workunit.client.0.smithi089.stdout:8/476: readlink de/d16/d1e/d3f/l5d 0 2024-09-13T02:54:01.057 INFO:tasks.workunit.client.0.smithi089.stdout:9/372: unlink d3/d6/df/d24/d29/l40 0 2024-09-13T02:54:01.061 INFO:tasks.workunit.client.0.smithi089.stdout:1/383: symlink dc/d3a/d53/d2c/d36/l7c 0 2024-09-13T02:54:01.061 INFO:tasks.workunit.client.0.smithi089.stdout:7/507: dwrite d3/d44/d85/d5e/d6f/fa3 [0,4194304] 0 2024-09-13T02:54:01.063 INFO:tasks.workunit.client.0.smithi089.stdout:3/416: creat d2/d8/dc/d3c/d65/f81 x:0 0 0 2024-09-13T02:54:01.067 INFO:tasks.workunit.client.0.smithi089.stdout:1/384: creat dc/d3a/d53/f7d x:0 0 0 2024-09-13T02:54:01.067 INFO:tasks.workunit.client.0.smithi089.stdout:1/385: chown dc/d3a/d53/d2c/d34/c63 1769503 1 2024-09-13T02:54:01.076 INFO:tasks.workunit.client.0.smithi089.stdout:7/508: symlink d3/d19/d75/d63/la4 0 2024-09-13T02:54:01.077 INFO:tasks.workunit.client.0.smithi089.stdout:1/386: read dc/d46/f6b [2373184,59025] 0 2024-09-13T02:54:01.078 INFO:tasks.workunit.client.0.smithi089.stdout:0/324: dwrite d2/d19/d1a/d1e/d42/f49 [0,4194304] 0 2024-09-13T02:54:01.078 INFO:tasks.workunit.client.0.smithi089.stdout:4/486: rename d2/d3/d5/d49/l31 to d2/l97 0 2024-09-13T02:54:01.078 INFO:tasks.workunit.client.0.smithi089.stdout:3/417: truncate d2/d8/f36 1132245 0 2024-09-13T02:54:01.080 INFO:tasks.workunit.client.0.smithi089.stdout:5/433: getdents d1/d4 0 2024-09-13T02:54:01.080 INFO:tasks.workunit.client.0.smithi089.stdout:3/418: read d2/d20/d23/d32/d5b/f7a [77084,19350] 0 2024-09-13T02:54:01.080 INFO:tasks.workunit.client.0.smithi089.stdout:3/419: fsync d2/d20/d23/d27/f4e 0 2024-09-13T02:54:01.082 INFO:tasks.workunit.client.0.smithi089.stdout:0/325: rename d2/d19/d1a/f3c to d2/d19/d1a/d3d/d4b/d4f/d59/f6e 0 2024-09-13T02:54:01.082 INFO:tasks.workunit.client.0.smithi089.stdout:4/487: readlink d2/l19 0 2024-09-13T02:54:01.083 INFO:tasks.workunit.client.0.smithi089.stdout:5/434: mkdir d1/d4/d45/d6f/d4d/d7f/d8f 0 2024-09-13T02:54:01.085 INFO:tasks.workunit.client.0.smithi089.stdout:2/405: dwrite d13/d30/f31 [0,4194304] 0 2024-09-13T02:54:01.086 INFO:tasks.workunit.client.0.smithi089.stdout:3/420: rename d2/d20/d23/d2b/f37 to d2/d20/d23/d32/f82 0 2024-09-13T02:54:01.086 INFO:tasks.workunit.client.0.smithi089.stdout:7/509: write d3/d44/f39 [935513,109283] 0 2024-09-13T02:54:01.086 INFO:tasks.workunit.client.0.smithi089.stdout:7/510: stat d3/d19/d75/d63/d83 0 2024-09-13T02:54:01.087 INFO:tasks.workunit.client.0.smithi089.stdout:1/387: dread dc/d46/f55 [0,4194304] 0 2024-09-13T02:54:01.087 INFO:tasks.workunit.client.0.smithi089.stdout:1/388: write dc/d44/f45 [805503,88976] 0 2024-09-13T02:54:01.087 INFO:tasks.workunit.client.0.smithi089.stdout:4/488: link d2/d3/d5/d43/d3b/f5b d2/d3/de/d62/d6c/d88/f98 0 2024-09-13T02:54:01.092 INFO:tasks.workunit.client.0.smithi089.stdout:0/326: rename d2/d19/d1a/d4e/f67 to d2/d19/d1a/d3d/d4b/d4f/d59/d6b/f6f 0 2024-09-13T02:54:01.093 INFO:tasks.workunit.client.0.smithi089.stdout:3/421: mkdir d2/d20/d23/d27/d51/d83 0 2024-09-13T02:54:01.094 INFO:tasks.workunit.client.0.smithi089.stdout:9/373: dwrite d3/d6/df/d24/d29/f52 [0,4194304] 0 2024-09-13T02:54:01.097 INFO:tasks.workunit.client.0.smithi089.stdout:5/435: rename d1/d4/l1d to d1/d73/l90 0 2024-09-13T02:54:01.097 INFO:tasks.workunit.client.0.smithi089.stdout:5/436: readlink d1/d4/l23 0 2024-09-13T02:54:01.098 INFO:tasks.workunit.client.0.smithi089.stdout:0/327: mknod d2/d19/c70 0 2024-09-13T02:54:01.099 INFO:tasks.workunit.client.0.smithi089.stdout:7/511: write d3/d44/f70 [994206,91709] 0 2024-09-13T02:54:01.099 INFO:tasks.workunit.client.0.smithi089.stdout:7/512: dread - d3/d44/d85/d5e/f95 zero size 2024-09-13T02:54:01.100 INFO:tasks.workunit.client.0.smithi089.stdout:3/422: truncate d2/d8/dc/d57/f68 428941 0 2024-09-13T02:54:01.101 INFO:tasks.workunit.client.0.smithi089.stdout:4/489: dread d2/f4c [0,4194304] 0 2024-09-13T02:54:01.101 INFO:tasks.workunit.client.0.smithi089.stdout:4/490: fsync d2/d3/d5/d43/f65 0 2024-09-13T02:54:01.102 INFO:tasks.workunit.client.0.smithi089.stdout:9/374: symlink d3/d6/df/d24/d29/l7c 0 2024-09-13T02:54:01.104 INFO:tasks.workunit.client.0.smithi089.stdout:5/437: truncate d1/d7/f30 3636979 0 2024-09-13T02:54:01.108 INFO:tasks.workunit.client.0.smithi089.stdout:4/491: mkdir d2/d3/d5/d43/d3b/d71/d99 0 2024-09-13T02:54:01.108 INFO:tasks.workunit.client.0.smithi089.stdout:7/513: dread d3/d44/f43 [0,4194304] 0 2024-09-13T02:54:01.109 INFO:tasks.workunit.client.0.smithi089.stdout:0/328: truncate d2/f3 3637019 0 2024-09-13T02:54:01.111 INFO:tasks.workunit.client.0.smithi089.stdout:5/438: creat d1/d4/d45/d6f/d4d/d7f/d8f/f91 x:0 0 0 2024-09-13T02:54:01.112 INFO:tasks.workunit.client.0.smithi089.stdout:2/406: dwrite d13/d30/d4e/f5d [0,4194304] 0 2024-09-13T02:54:01.112 INFO:tasks.workunit.client.0.smithi089.stdout:1/389: dwrite dc/d3a/d53/f7d [0,4194304] 0 2024-09-13T02:54:01.114 INFO:tasks.workunit.client.0.smithi089.stdout:4/492: mknod d2/d3/de/d62/d6c/d88/c9a 0 2024-09-13T02:54:01.114 INFO:tasks.workunit.client.0.smithi089.stdout:6/401: sync 2024-09-13T02:54:01.114 INFO:tasks.workunit.client.0.smithi089.stdout:4/493: creat d2/d22/f9b x:0 0 0 2024-09-13T02:54:01.116 INFO:tasks.workunit.client.0.smithi089.stdout:2/407: link d13/f50 d13/f89 0 2024-09-13T02:54:01.116 INFO:tasks.workunit.client.0.smithi089.stdout:2/408: fdatasync d13/d30/d4e/d6f/f84 0 2024-09-13T02:54:01.116 INFO:tasks.workunit.client.0.smithi089.stdout:2/409: chown d13/d30/f31 15904 1 2024-09-13T02:54:01.117 INFO:tasks.workunit.client.0.smithi089.stdout:3/423: write d2/d20/f28 [3894911,129057] 0 2024-09-13T02:54:01.118 INFO:tasks.workunit.client.0.smithi089.stdout:5/439: dread d1/d4/fc [4194304,4194304] 0 2024-09-13T02:54:01.121 INFO:tasks.workunit.client.0.smithi089.stdout:1/390: truncate dc/f21 467213 0 2024-09-13T02:54:01.122 INFO:tasks.workunit.client.0.smithi089.stdout:0/329: dread d2/f34 [0,4194304] 0 2024-09-13T02:54:01.124 INFO:tasks.workunit.client.0.smithi089.stdout:6/402: dread db/d43/d6e/f30 [0,4194304] 0 2024-09-13T02:54:01.124 INFO:tasks.workunit.client.0.smithi089.stdout:4/494: mkdir d2/d3/d5/d43/d3b/d71/d78/d9c 0 2024-09-13T02:54:01.128 INFO:tasks.workunit.client.0.smithi089.stdout:3/424: creat d2/d20/d23/d27/d51/d6c/f84 x:0 0 0 2024-09-13T02:54:01.129 INFO:tasks.workunit.client.0.smithi089.stdout:0/330: symlink d2/d19/l71 0 2024-09-13T02:54:01.131 INFO:tasks.workunit.client.0.smithi089.stdout:6/403: unlink db/d43/d60/d74/f8c 0 2024-09-13T02:54:01.131 INFO:tasks.workunit.client.0.smithi089.stdout:6/404: chown db/d10/d3a/d7b/f7c 1228 1 2024-09-13T02:54:01.131 INFO:tasks.workunit.client.0.smithi089.stdout:1/391: write dc/f13 [7557041,85955] 0 2024-09-13T02:54:01.132 INFO:tasks.workunit.client.0.smithi089.stdout:4/495: rmdir d2/d3/d5/d43/d3b/d71/d7e 39 2024-09-13T02:54:01.133 INFO:tasks.workunit.client.0.smithi089.stdout:2/410: dread fc [0,4194304] 0 2024-09-13T02:54:01.133 INFO:tasks.workunit.client.0.smithi089.stdout:9/375: dwrite d3/f22 [4194304,4194304] 0 2024-09-13T02:54:01.133 INFO:tasks.workunit.client.0.smithi089.stdout:7/514: rmdir d3/d19/d75/d63/d65 0 2024-09-13T02:54:01.135 INFO:tasks.workunit.client.0.smithi089.stdout:3/425: dread d2/d20/d23/d27/d51/d6c/f7c [0,4194304] 0 2024-09-13T02:54:01.135 INFO:tasks.workunit.client.0.smithi089.stdout:9/376: write d3/d15/f1b [966736,130648] 0 2024-09-13T02:54:01.135 INFO:tasks.workunit.client.0.smithi089.stdout:3/426: stat d2/d8/c15 0 2024-09-13T02:54:01.140 INFO:tasks.workunit.client.0.smithi089.stdout:6/405: creat db/d43/d6e/d28/d37/d8b/f90 x:0 0 0 2024-09-13T02:54:01.140 INFO:tasks.workunit.client.0.smithi089.stdout:6/406: write db/d43/d6e/d28/d2f/f4c [45028,120647] 0 2024-09-13T02:54:01.140 INFO:tasks.workunit.client.0.smithi089.stdout:6/407: stat db/d10/d3a/f36 0 2024-09-13T02:54:01.145 INFO:tasks.workunit.client.0.smithi089.stdout:2/411: creat d13/d30/d61/f8a x:0 0 0 2024-09-13T02:54:01.146 INFO:tasks.workunit.client.0.smithi089.stdout:9/377: dread - d3/d6/df/d24/f69 zero size 2024-09-13T02:54:01.148 INFO:tasks.workunit.client.0.smithi089.stdout:7/515: dread d3/d19/d67/f8b [0,4194304] 0 2024-09-13T02:54:01.149 INFO:tasks.workunit.client.0.smithi089.stdout:3/427: rename d2/d20/d23/d27/d51/c5a to d2/d8/dc/d3c/d65/c85 0 2024-09-13T02:54:01.157 INFO:tasks.workunit.client.0.smithi089.stdout:7/516: rename d3/d19/c5b to d3/d19/d2e/d68/ca5 0 2024-09-13T02:54:01.157 INFO:tasks.workunit.client.0.smithi089.stdout:7/517: readlink d3/d19/d2e/d37/l93 0 2024-09-13T02:54:01.159 INFO:tasks.workunit.client.0.smithi089.stdout:3/428: symlink d2/d8/dc/l86 0 2024-09-13T02:54:01.161 INFO:tasks.workunit.client.0.smithi089.stdout:2/412: write d13/d30/f40 [623553,43965] 0 2024-09-13T02:54:01.161 INFO:tasks.workunit.client.0.smithi089.stdout:6/408: rmdir db/d43/d6e/d28/d2f 39 2024-09-13T02:54:01.161 INFO:tasks.workunit.client.0.smithi089.stdout:6/409: creat db/d10/d3a/d7b/f91 x:0 0 0 2024-09-13T02:54:01.161 INFO:tasks.workunit.client.0.smithi089.stdout:3/429: dread d2/d20/d23/d27/d51/d6c/f7c [0,4194304] 0 2024-09-13T02:54:01.162 INFO:tasks.workunit.client.0.smithi089.stdout:9/378: truncate d3/d6/f14 3723406 0 2024-09-13T02:54:01.162 INFO:tasks.workunit.client.0.smithi089.stdout:9/379: readlink d3/d15/l20 0 2024-09-13T02:54:01.162 INFO:tasks.workunit.client.0.smithi089.stdout:3/430: read d2/d8/dc/d3c/f5d [731244,29188] 0 2024-09-13T02:54:01.163 INFO:tasks.workunit.client.0.smithi089.stdout:3/431: dread - d2/d8/dc/d3c/d65/f81 zero size 2024-09-13T02:54:01.164 INFO:tasks.workunit.client.0.smithi089.stdout:7/518: creat d3/d20/fa6 x:0 0 0 2024-09-13T02:54:01.164 INFO:tasks.workunit.client.0.smithi089.stdout:7/519: truncate d3/d44/d85/f8a 972973 0 2024-09-13T02:54:01.166 INFO:tasks.workunit.client.0.smithi089.stdout:6/410: read db/d10/d3a/f47 [1650613,65995] 0 2024-09-13T02:54:01.170 INFO:tasks.workunit.client.0.smithi089.stdout:9/380: unlink d3/d6/df/d24/l2b 0 2024-09-13T02:54:01.171 INFO:tasks.workunit.client.0.smithi089.stdout:7/520: creat d3/d19/d75/fa7 x:0 0 0 2024-09-13T02:54:01.172 INFO:tasks.workunit.client.0.smithi089.stdout:0/331: dwrite d2/d19/d1a/d3d/d4b/f55 [0,4194304] 0 2024-09-13T02:54:01.175 INFO:tasks.workunit.client.0.smithi089.stdout:1/392: dwrite dc/d3a/f41 [0,4194304] 0 2024-09-13T02:54:01.175 INFO:tasks.workunit.client.0.smithi089.stdout:9/381: creat d3/d6/df/d24/d32/f7d x:0 0 0 2024-09-13T02:54:01.176 INFO:tasks.workunit.client.0.smithi089.stdout:4/496: dwrite d2/d22/f9b [0,4194304] 0 2024-09-13T02:54:01.176 INFO:tasks.workunit.client.0.smithi089.stdout:4/497: chown d2/d3/d5/f37 24 1 2024-09-13T02:54:01.176 INFO:tasks.workunit.client.0.smithi089.stdout:7/521: dread d3/d19/d2e/f4f [0,4194304] 0 2024-09-13T02:54:01.184 INFO:tasks.workunit.client.0.smithi089.stdout:1/393: mknod dc/d3a/d53/d2c/d34/c7e 0 2024-09-13T02:54:01.186 INFO:tasks.workunit.client.0.smithi089.stdout:3/432: dwrite d2/d20/d23/f73 [0,4194304] 0 2024-09-13T02:54:01.188 INFO:tasks.workunit.client.0.smithi089.stdout:6/411: dwrite db/d10/d3a/d7b/f91 [0,4194304] 0 2024-09-13T02:54:01.188 INFO:tasks.workunit.client.0.smithi089.stdout:6/412: chown db/l6f 85 1 2024-09-13T02:54:01.188 INFO:tasks.workunit.client.0.smithi089.stdout:6/413: fsync db/d43/d6e/d28/d37/d8b/f90 0 2024-09-13T02:54:01.188 INFO:tasks.workunit.client.0.smithi089.stdout:6/414: fsync db/f23 0 2024-09-13T02:54:01.188 INFO:tasks.workunit.client.0.smithi089.stdout:6/415: creat db/d43/d6e/d28/d37/f92 x:0 0 0 2024-09-13T02:54:01.190 INFO:tasks.workunit.client.0.smithi089.stdout:7/522: creat d3/d44/d85/fa8 x:0 0 0 2024-09-13T02:54:01.191 INFO:tasks.workunit.client.0.smithi089.stdout:9/382: write d3/d6/fe [377889,124325] 0 2024-09-13T02:54:01.191 INFO:tasks.workunit.client.0.smithi089.stdout:0/332: dread d2/f21 [0,4194304] 0 2024-09-13T02:54:01.194 INFO:tasks.workunit.client.0.smithi089.stdout:9/383: write d3/d6/df/d24/f48 [1177360,74851] 0 2024-09-13T02:54:01.194 INFO:tasks.workunit.client.0.smithi089.stdout:3/433: write d2/d20/d23/d32/d5b/f7a [1030018,65835] 0 2024-09-13T02:54:01.195 INFO:tasks.workunit.client.0.smithi089.stdout:2/413: rmdir d13/d30/d61 39 2024-09-13T02:54:01.206 INFO:tasks.workunit.client.0.smithi089.stdout:1/394: dwrite dc/f1e [0,4194304] 0 2024-09-13T02:54:01.209 INFO:tasks.workunit.client.0.smithi089.stdout:0/333: rename d2/d19/f39 to d2/d19/d1a/d1e/d42/f72 0 2024-09-13T02:54:01.209 INFO:tasks.workunit.client.0.smithi089.stdout:0/334: write d2/d19/d1a/d1e/f43 [329640,115181] 0 2024-09-13T02:54:01.213 INFO:tasks.workunit.client.0.smithi089.stdout:2/414: mknod d13/d30/d64/d82/c8b 0 2024-09-13T02:54:01.214 INFO:tasks.workunit.client.0.smithi089.stdout:1/395: getdents dc/d6e 0 2024-09-13T02:54:01.218 INFO:tasks.workunit.client.0.smithi089.stdout:9/384: symlink d3/d6/df/l7e 0 2024-09-13T02:54:01.222 INFO:tasks.workunit.client.0.smithi089.stdout:3/434: rmdir d2/d20/d23/d32 39 2024-09-13T02:54:01.222 INFO:tasks.workunit.client.0.smithi089.stdout:3/435: creat d2/d8/dc/d3c/d65/f87 x:0 0 0 2024-09-13T02:54:01.222 INFO:tasks.workunit.client.0.smithi089.stdout:3/436: chown d2/d20/d23/d32/d49/c77 7 1 2024-09-13T02:54:01.224 INFO:tasks.workunit.client.0.smithi089.stdout:2/415: link fd d13/f8c 0 2024-09-13T02:54:01.225 INFO:tasks.workunit.client.0.smithi089.stdout:1/396: symlink dc/d3a/l7f 0 2024-09-13T02:54:01.228 INFO:tasks.workunit.client.0.smithi089.stdout:3/437: rmdir d2/d20/d23/d32 39 2024-09-13T02:54:01.228 INFO:tasks.workunit.client.0.smithi089.stdout:3/438: write d2/d8/f48 [459170,121544] 0 2024-09-13T02:54:01.228 INFO:tasks.workunit.client.0.smithi089.stdout:8/477: sync 2024-09-13T02:54:01.231 INFO:tasks.workunit.client.0.smithi089.stdout:2/416: symlink d13/d30/d4e/l8d 0 2024-09-13T02:54:01.231 INFO:tasks.workunit.client.0.smithi089.stdout:1/397: symlink dc/d44/l80 0 2024-09-13T02:54:01.231 INFO:tasks.workunit.client.0.smithi089.stdout:2/417: dread - d13/f70 zero size 2024-09-13T02:54:01.232 INFO:tasks.workunit.client.0.smithi089.stdout:9/385: write d3/d6/d2a/d4b/d54/f72 [4973611,108423] 0 2024-09-13T02:54:01.232 INFO:tasks.workunit.client.0.smithi089.stdout:9/386: chown d3/d6/d2a/d4b/d6d 105712264 1 2024-09-13T02:54:01.233 INFO:tasks.workunit.client.0.smithi089.stdout:3/439: truncate d2/d8/dc/f30 3781228 0 2024-09-13T02:54:01.235 INFO:tasks.workunit.client.0.smithi089.stdout:8/478: unlink de/d16/d1e/d27/d52/d61/d8e/l97 0 2024-09-13T02:54:01.235 INFO:tasks.workunit.client.0.smithi089.stdout:8/479: dread - de/d16/d1e/d3f/d5b/f78 zero size 2024-09-13T02:54:01.236 INFO:tasks.workunit.client.0.smithi089.stdout:6/416: dwrite db/d43/d6e/d28/d46/d53/f5a [0,4194304] 0 2024-09-13T02:54:01.236 INFO:tasks.workunit.client.0.smithi089.stdout:0/335: dwrite d2/d19/d1a/d3d/d4b/d4f/f58 [0,4194304] 0 2024-09-13T02:54:01.236 INFO:tasks.workunit.client.0.smithi089.stdout:0/336: chown d2/d19/f2d 25611 1 2024-09-13T02:54:01.238 INFO:tasks.workunit.client.0.smithi089.stdout:1/398: getdents dc/d3a/d53/d2c 0 2024-09-13T02:54:01.241 INFO:tasks.workunit.client.0.smithi089.stdout:2/418: creat d13/d30/d4e/d7b/f8e x:0 0 0 2024-09-13T02:54:01.241 INFO:tasks.workunit.client.0.smithi089.stdout:2/419: getdents d13/d30/d4e/d6f/d76 0 2024-09-13T02:54:01.245 INFO:tasks.workunit.client.0.smithi089.stdout:3/440: rename d2/d20/d23/d32/f82 to d2/d20/d23/f88 0 2024-09-13T02:54:01.246 INFO:tasks.workunit.client.0.smithi089.stdout:8/480: write de/d16/d1e/f2a [3788820,129700] 0 2024-09-13T02:54:01.250 INFO:tasks.workunit.client.0.smithi089.stdout:3/441: dread d2/d20/d23/d2b/f3d [0,4194304] 0 2024-09-13T02:54:01.250 INFO:tasks.workunit.client.0.smithi089.stdout:3/442: chown d2/d20/d23/d32/d5b/d71 4037 1 2024-09-13T02:54:01.250 INFO:tasks.workunit.client.0.smithi089.stdout:3/443: write d2/d20/d23/d27/f4e [832942,7708] 0 2024-09-13T02:54:01.250 INFO:tasks.workunit.client.0.smithi089.stdout:3/444: creat d2/d20/d23/d2b/f89 x:0 0 0 2024-09-13T02:54:01.251 INFO:tasks.workunit.client.0.smithi089.stdout:0/337: mknod d2/d64/c73 0 2024-09-13T02:54:01.252 INFO:tasks.workunit.client.0.smithi089.stdout:9/387: write d3/f58 [1397934,50619] 0 2024-09-13T02:54:01.252 INFO:tasks.workunit.client.0.smithi089.stdout:1/399: creat dc/f81 x:0 0 0 2024-09-13T02:54:01.254 INFO:tasks.workunit.client.0.smithi089.stdout:2/420: creat d13/d30/d4e/d6f/f8f x:0 0 0 2024-09-13T02:54:01.255 INFO:tasks.workunit.client.0.smithi089.stdout:6/417: dwrite db/f49 [0,4194304] 0 2024-09-13T02:54:01.255 INFO:tasks.workunit.client.0.smithi089.stdout:6/418: write db/d43/d6e/d28/d2f/f50 [740865,86689] 0 2024-09-13T02:54:01.255 INFO:tasks.workunit.client.0.smithi089.stdout:8/481: truncate de/d16/d1e/f83 417323 0 2024-09-13T02:54:01.255 INFO:tasks.workunit.client.0.smithi089.stdout:8/482: dread - de/d16/d1e/d3f/f54 zero size 2024-09-13T02:54:01.256 INFO:tasks.workunit.client.0.smithi089.stdout:8/483: chown de/d16/f1f 18 1 2024-09-13T02:54:01.257 INFO:tasks.workunit.client.0.smithi089.stdout:3/445: link d2/d20/d23/d27/f4e d2/d20/d23/d32/d5b/f8a 0 2024-09-13T02:54:01.257 INFO:tasks.workunit.client.0.smithi089.stdout:3/446: fsync d2/d20/d23/d32/d5b/f7a 0 2024-09-13T02:54:01.259 INFO:tasks.workunit.client.0.smithi089.stdout:3/447: dread d2/d20/d23/d32/d5b/f79 [0,4194304] 0 2024-09-13T02:54:01.260 INFO:tasks.workunit.client.0.smithi089.stdout:9/388: creat d3/d6/df/d24/d35/f7f x:0 0 0 2024-09-13T02:54:01.262 INFO:tasks.workunit.client.0.smithi089.stdout:1/400: link dc/d3a/d53/f26 dc/f82 0 2024-09-13T02:54:01.262 INFO:tasks.workunit.client.0.smithi089.stdout:1/401: dread - dc/d3a/d53/d2c/d36/f40 zero size 2024-09-13T02:54:01.263 INFO:tasks.workunit.client.0.smithi089.stdout:2/421: write f1 [2838102,84222] 0 2024-09-13T02:54:01.264 INFO:tasks.workunit.client.0.smithi089.stdout:5/440: sync 2024-09-13T02:54:01.267 INFO:tasks.workunit.client.0.smithi089.stdout:3/448: read d2/d8/dc/f30 [1919416,11750] 0 2024-09-13T02:54:01.267 INFO:tasks.workunit.client.0.smithi089.stdout:3/449: readlink d2/d20/l34 0 2024-09-13T02:54:01.267 INFO:tasks.workunit.client.0.smithi089.stdout:3/450: readlink d2/d8/dc/l47 0 2024-09-13T02:54:01.267 INFO:tasks.workunit.client.0.smithi089.stdout:6/419: symlink db/d43/d6e/d28/d46/d7e/l93 0 2024-09-13T02:54:01.268 INFO:tasks.workunit.client.0.smithi089.stdout:8/484: getdents de/d16 0 2024-09-13T02:54:01.269 INFO:tasks.workunit.client.0.smithi089.stdout:8/485: creat de/d16/d1e/d27/fa1 x:0 0 0 2024-09-13T02:54:01.269 INFO:tasks.workunit.client.0.smithi089.stdout:3/451: dread d2/d20/d23/d32/d49/f56 [0,4194304] 0 2024-09-13T02:54:01.269 INFO:tasks.workunit.client.0.smithi089.stdout:9/389: write d3/d6/df/d24/d29/f52 [3537178,36575] 0 2024-09-13T02:54:01.269 INFO:tasks.workunit.client.0.smithi089.stdout:9/390: write d3/d6/df/f62 [709251,127202] 0 2024-09-13T02:54:01.269 INFO:tasks.workunit.client.0.smithi089.stdout:9/391: chown d3/d6/df/d24/d35 7039 1 2024-09-13T02:54:01.270 INFO:tasks.workunit.client.0.smithi089.stdout:1/402: truncate f3 118177 0 2024-09-13T02:54:01.270 INFO:tasks.workunit.client.0.smithi089.stdout:2/422: mkdir d13/d30/d61/d78/d79/d90 0 2024-09-13T02:54:01.272 INFO:tasks.workunit.client.0.smithi089.stdout:5/441: creat d1/d4/d45/d6f/d62/d72/f92 x:0 0 0 2024-09-13T02:54:01.273 INFO:tasks.workunit.client.0.smithi089.stdout:3/452: dread d2/d8/dc/f2c [0,4194304] 0 2024-09-13T02:54:01.274 INFO:tasks.workunit.client.0.smithi089.stdout:6/420: creat db/d43/d6e/d28/d46/d53/f94 x:0 0 0 2024-09-13T02:54:01.278 INFO:tasks.workunit.client.0.smithi089.stdout:8/486: truncate de/d16/d1e/f4e 412958 0 2024-09-13T02:54:01.280 INFO:tasks.workunit.client.0.smithi089.stdout:9/392: truncate f2 1099482 0 2024-09-13T02:54:01.282 INFO:tasks.workunit.client.0.smithi089.stdout:2/423: link d13/d30/d61/c66 d13/d30/d61/c91 0 2024-09-13T02:54:01.282 INFO:tasks.workunit.client.0.smithi089.stdout:2/424: creat d13/d30/d4e/d7b/f92 x:0 0 0 2024-09-13T02:54:01.283 INFO:tasks.workunit.client.0.smithi089.stdout:5/442: dread d1/d7/f18 [0,4194304] 0 2024-09-13T02:54:01.284 INFO:tasks.workunit.client.0.smithi089.stdout:8/487: truncate de/d16/d1e/d20/f37 1184277 0 2024-09-13T02:54:01.284 INFO:tasks.workunit.client.0.smithi089.stdout:8/488: dread - de/d16/d1e/d27/d52/d61/f75 zero size 2024-09-13T02:54:01.288 INFO:tasks.workunit.client.0.smithi089.stdout:2/425: link d13/d30/l46 d13/d30/d61/d78/d79/d7c/l93 0 2024-09-13T02:54:01.288 INFO:tasks.workunit.client.0.smithi089.stdout:2/426: chown d13/d30/l55 65423 1 2024-09-13T02:54:01.289 INFO:tasks.workunit.client.0.smithi089.stdout:1/403: dwrite dc/d46/f6b [0,4194304] 0 2024-09-13T02:54:01.289 INFO:tasks.workunit.client.0.smithi089.stdout:1/404: write dc/d3a/d53/d2c/d36/f40 [466145,57806] 0 2024-09-13T02:54:01.292 INFO:tasks.workunit.client.0.smithi089.stdout:2/427: unlink d13/d30/f39 0 2024-09-13T02:54:01.292 INFO:tasks.workunit.client.0.smithi089.stdout:2/428: fdatasync d13/d30/d4e/d7b/f83 0 2024-09-13T02:54:01.296 INFO:tasks.workunit.client.0.smithi089.stdout:1/405: mknod dc/d3a/d53/d2c/d34/c83 0 2024-09-13T02:54:01.296 INFO:tasks.workunit.client.0.smithi089.stdout:1/406: write f7 [668554,122561] 0 2024-09-13T02:54:01.296 INFO:tasks.workunit.client.0.smithi089.stdout:8/489: rmdir de/d16/d1e/d20/d6c/d6e/d7e 39 2024-09-13T02:54:01.299 INFO:tasks.workunit.client.0.smithi089.stdout:1/407: rename dc/d46/d6c/f7a to dc/d3a/d53/d2c/d6f/f84 0 2024-09-13T02:54:01.299 INFO:tasks.workunit.client.0.smithi089.stdout:5/443: dwrite d1/d4/d45/d6f/d4d/d7f/d49/f5b [0,4194304] 0 2024-09-13T02:54:01.301 INFO:tasks.workunit.client.0.smithi089.stdout:8/490: creat de/d16/d1e/d3f/fa2 x:0 0 0 2024-09-13T02:54:01.301 INFO:tasks.workunit.client.0.smithi089.stdout:8/491: creat de/d16/d1e/d27/fa3 x:0 0 0 2024-09-13T02:54:01.303 INFO:tasks.workunit.client.0.smithi089.stdout:1/408: truncate dc/f10 3652078 0 2024-09-13T02:54:01.303 INFO:tasks.workunit.client.0.smithi089.stdout:1/409: fdatasync dc/d3a/d53/f52 0 2024-09-13T02:54:01.307 INFO:tasks.workunit.client.0.smithi089.stdout:8/492: symlink de/d16/d1e/d20/d39/la4 0 2024-09-13T02:54:01.309 INFO:tasks.workunit.client.0.smithi089.stdout:1/410: rename dc/d57 to dc/d44/d73/d85 0 2024-09-13T02:54:01.315 INFO:tasks.workunit.client.0.smithi089.stdout:2/429: dwrite d13/d30/f3c [0,4194304] 0 2024-09-13T02:54:01.320 INFO:tasks.workunit.client.0.smithi089.stdout:8/493: dread f0 [0,4194304] 0 2024-09-13T02:54:01.320 INFO:tasks.workunit.client.0.smithi089.stdout:8/494: chown de/d16/c29 24040 1 2024-09-13T02:54:01.325 INFO:tasks.workunit.client.0.smithi089.stdout:5/444: dwrite d1/d4/d45/d6f/f39 [0,4194304] 0 2024-09-13T02:54:01.325 INFO:tasks.workunit.client.0.smithi089.stdout:5/445: write d1/d4/d45/d6f/f74 [351568,121858] 0 2024-09-13T02:54:01.325 INFO:tasks.workunit.client.0.smithi089.stdout:8/495: truncate de/d16/f86 2617050 0 2024-09-13T02:54:01.325 INFO:tasks.workunit.client.0.smithi089.stdout:8/496: write de/d16/d1e/f31 [4177857,97113] 0 2024-09-13T02:54:01.325 INFO:tasks.workunit.client.0.smithi089.stdout:8/497: readlink de/d16/d1e/d27/d35/d91/l9b 0 2024-09-13T02:54:01.325 INFO:tasks.workunit.client.0.smithi089.stdout:5/446: dread d1/d4/d45/d6f/d4d/f71 [0,4194304] 0 2024-09-13T02:54:01.325 INFO:tasks.workunit.client.0.smithi089.stdout:1/411: getdents dc/d44/d73 0 2024-09-13T02:54:01.329 INFO:tasks.workunit.client.0.smithi089.stdout:8/498: write de/d16/d1e/d27/f3b [2877604,48142] 0 2024-09-13T02:54:01.333 INFO:tasks.workunit.client.0.smithi089.stdout:8/499: truncate f5 2375439 0 2024-09-13T02:54:01.335 INFO:tasks.workunit.client.0.smithi089.stdout:8/500: rename de/d16/d1e/d3f/f64 to de/d16/d1e/d3f/d5b/fa5 0 2024-09-13T02:54:01.342 INFO:tasks.workunit.client.0.smithi089.stdout:1/412: dwrite dc/f1c [4194304,4194304] 0 2024-09-13T02:54:01.342 INFO:tasks.workunit.client.0.smithi089.stdout:1/413: fsync dc/d3a/d53/d2c/d6f/f84 0 2024-09-13T02:54:01.344 INFO:tasks.workunit.client.0.smithi089.stdout:1/414: truncate dc/d3a/d53/f52 935534 0 2024-09-13T02:54:01.344 INFO:tasks.workunit.client.0.smithi089.stdout:1/415: dread - dc/d44/d73/f69 zero size 2024-09-13T02:54:01.344 INFO:tasks.workunit.client.0.smithi089.stdout:1/416: write dc/d44/f6a [3637233,43990] 0 2024-09-13T02:54:01.353 INFO:tasks.workunit.client.0.smithi089.stdout:8/501: dwrite de/d56/f8c [0,4194304] 0 2024-09-13T02:54:01.358 INFO:tasks.workunit.client.0.smithi089.stdout:8/502: unlink de/d16/d1e/d27/d35/d91/f96 0 2024-09-13T02:54:01.358 INFO:tasks.workunit.client.0.smithi089.stdout:8/503: stat de/d16/d1e/c88 0 2024-09-13T02:54:01.358 INFO:tasks.workunit.client.0.smithi089.stdout:8/504: chown de/d16/d1e/d20/f80 8576697 1 2024-09-13T02:54:01.362 INFO:tasks.workunit.client.0.smithi089.stdout:4/498: sync 2024-09-13T02:54:01.362 INFO:tasks.workunit.client.0.smithi089.stdout:7/523: sync 2024-09-13T02:54:01.362 INFO:tasks.workunit.client.0.smithi089.stdout:7/524: fsync d3/d44/d85/d5e/d6f/fa3 0 2024-09-13T02:54:01.363 INFO:tasks.workunit.client.0.smithi089.stdout:7/525: write d3/d19/d67/f8b [852774,63995] 0 2024-09-13T02:54:01.364 INFO:tasks.workunit.client.0.smithi089.stdout:7/526: readlink d3/d19/d75/d14/d71/l92 0 2024-09-13T02:54:01.372 INFO:tasks.workunit.client.0.smithi089.stdout:4/499: write d2/da/f45 [1252416,25382] 0 2024-09-13T02:54:01.372 INFO:tasks.workunit.client.0.smithi089.stdout:4/500: chown d2/d3/d5/d43/d3b/d71/d78/c7d 74 1 2024-09-13T02:54:01.373 INFO:tasks.workunit.client.0.smithi089.stdout:4/501: mknod d2/d3/d5/d43/d3b/d71/c9d 0 2024-09-13T02:54:01.375 INFO:tasks.workunit.client.0.smithi089.stdout:4/502: symlink d2/l9e 0 2024-09-13T02:54:01.375 INFO:tasks.workunit.client.0.smithi089.stdout:4/503: write d2/d3/d5/d43/d3b/d71/f81 [188456,131029] 0 2024-09-13T02:54:01.375 INFO:tasks.workunit.client.0.smithi089.stdout:4/504: read d2/d3/d5/d43/f50 [3826848,48361] 0 2024-09-13T02:54:01.375 INFO:tasks.workunit.client.0.smithi089.stdout:4/505: fsync d2/d3/de/f95 0 2024-09-13T02:54:01.376 INFO:tasks.workunit.client.0.smithi089.stdout:4/506: rmdir d2/d3/d5/d72 39 2024-09-13T02:54:01.377 INFO:tasks.workunit.client.0.smithi089.stdout:4/507: creat d2/d55/f9f x:0 0 0 2024-09-13T02:54:01.377 INFO:tasks.workunit.client.0.smithi089.stdout:4/508: chown d2/d22/l7b 0 1 2024-09-13T02:54:01.378 INFO:tasks.workunit.client.0.smithi089.stdout:7/527: dwrite d3/d19/d75/d14/f97 [0,4194304] 0 2024-09-13T02:54:01.378 INFO:tasks.workunit.client.0.smithi089.stdout:7/528: readlink d3/d19/d2e/l86 0 2024-09-13T02:54:01.378 INFO:tasks.workunit.client.0.smithi089.stdout:7/529: readlink d3/d44/d85/l6a 0 2024-09-13T02:54:01.380 INFO:tasks.workunit.client.0.smithi089.stdout:4/509: rename d2/d3/d5/d43/d3b/d71/d7e/l89 to d2/d3/d5/d43/d3b/d71/d99/la0 0 2024-09-13T02:54:01.382 INFO:tasks.workunit.client.0.smithi089.stdout:7/530: symlink d3/d44/d85/d55/d96/la9 0 2024-09-13T02:54:01.387 INFO:tasks.workunit.client.0.smithi089.stdout:4/510: rename d2/d3/de to d2/d22/da1 0 2024-09-13T02:54:01.387 INFO:tasks.workunit.client.0.smithi089.stdout:4/511: write d2/f4c [9273512,97882] 0 2024-09-13T02:54:01.387 INFO:tasks.workunit.client.0.smithi089.stdout:4/512: fdatasync d2/d3/f41 0 2024-09-13T02:54:01.387 INFO:tasks.workunit.client.0.smithi089.stdout:4/513: fdatasync d2/d3/d5/d43/f50 0 2024-09-13T02:54:01.389 INFO:tasks.workunit.client.0.smithi089.stdout:4/514: getdents d2/d22/da1 0 2024-09-13T02:54:01.391 INFO:tasks.workunit.client.0.smithi089.stdout:4/515: symlink d2/da/la2 0 2024-09-13T02:54:01.392 INFO:tasks.workunit.client.0.smithi089.stdout:4/516: dread - d2/da/f6d zero size 2024-09-13T02:54:01.399 INFO:tasks.workunit.client.0.smithi089.stdout:7/531: dwrite d3/d44/d85/fa8 [0,4194304] 0 2024-09-13T02:54:01.400 INFO:tasks.workunit.client.0.smithi089.stdout:7/532: fsync d3/d19/d2e/f88 0 2024-09-13T02:54:01.417 INFO:tasks.workunit.client.0.smithi089.stdout:4/517: dwrite d2/d3/d5/d43/d3b/f54 [0,4194304] 0 2024-09-13T02:54:01.418 INFO:tasks.workunit.client.0.smithi089.stdout:7/533: dwrite d3/d19/f3f [0,4194304] 0 2024-09-13T02:54:01.419 INFO:tasks.workunit.client.0.smithi089.stdout:4/518: creat d2/d3/d5/d43/d3b/d71/d99/fa3 x:0 0 0 2024-09-13T02:54:01.421 INFO:tasks.workunit.client.0.smithi089.stdout:4/519: creat d2/d3/d5/d43/d3b/d71/d78/d9c/fa4 x:0 0 0 2024-09-13T02:54:01.421 INFO:tasks.workunit.client.0.smithi089.stdout:4/520: readlink d2/da/la2 0 2024-09-13T02:54:01.424 INFO:tasks.workunit.client.0.smithi089.stdout:4/521: rename d2/d3/d5/d49/c59 to d2/d3/d5/d43/d3b/d71/ca5 0 2024-09-13T02:54:01.424 INFO:tasks.workunit.client.0.smithi089.stdout:4/522: fdatasync d2/d3/d5/f38 0 2024-09-13T02:54:01.424 INFO:tasks.workunit.client.0.smithi089.stdout:4/523: write d2/d22/da1/d62/d6c/d88/f98 [397381,50202] 0 2024-09-13T02:54:01.424 INFO:tasks.workunit.client.0.smithi089.stdout:4/524: creat d2/d22/fa6 x:0 0 0 2024-09-13T02:54:01.432 INFO:tasks.workunit.client.0.smithi089.stdout:7/534: dwrite d3/d19/d75/f12 [0,4194304] 0 2024-09-13T02:54:01.433 INFO:tasks.workunit.client.0.smithi089.stdout:6/421: sync 2024-09-13T02:54:01.433 INFO:tasks.workunit.client.0.smithi089.stdout:9/393: sync 2024-09-13T02:54:01.433 INFO:tasks.workunit.client.0.smithi089.stdout:0/338: sync 2024-09-13T02:54:01.433 INFO:tasks.workunit.client.0.smithi089.stdout:3/453: sync 2024-09-13T02:54:01.433 INFO:tasks.workunit.client.0.smithi089.stdout:2/430: sync 2024-09-13T02:54:01.433 INFO:tasks.workunit.client.0.smithi089.stdout:3/454: dread - d2/f41 zero size 2024-09-13T02:54:01.434 INFO:tasks.workunit.client.0.smithi089.stdout:7/535: unlink d3/d20/l57 0 2024-09-13T02:54:01.436 INFO:tasks.workunit.client.0.smithi089.stdout:9/394: link d3/d6/df/f38 d3/d6/df/d24/d35/f80 0 2024-09-13T02:54:01.436 INFO:tasks.workunit.client.0.smithi089.stdout:9/395: chown d3/d6/d2a/d4b 7 1 2024-09-13T02:54:01.437 INFO:tasks.workunit.client.0.smithi089.stdout:6/422: creat db/d43/f95 x:0 0 0 2024-09-13T02:54:01.437 INFO:tasks.workunit.client.0.smithi089.stdout:6/423: write db/d10/d3a/d7b/f7c [742809,27541] 0 2024-09-13T02:54:01.438 INFO:tasks.workunit.client.0.smithi089.stdout:3/455: unlink d2/d20/c6a 0 2024-09-13T02:54:01.439 INFO:tasks.workunit.client.0.smithi089.stdout:3/456: write d2/d8/dc/d3c/d65/f81 [498757,50684] 0 2024-09-13T02:54:01.439 INFO:tasks.workunit.client.0.smithi089.stdout:2/431: symlink d13/d30/d59/l94 0 2024-09-13T02:54:01.440 INFO:tasks.workunit.client.0.smithi089.stdout:2/432: chown d13/d30/d64/f6e 340 1 2024-09-13T02:54:01.440 INFO:tasks.workunit.client.0.smithi089.stdout:4/525: dwrite d2/f4c [4194304,4194304] 0 2024-09-13T02:54:01.440 INFO:tasks.workunit.client.0.smithi089.stdout:4/526: write d2/d3/d5/f70 [383228,72203] 0 2024-09-13T02:54:01.440 INFO:tasks.workunit.client.0.smithi089.stdout:9/396: mkdir d3/d6/df/d24/d29/d81 0 2024-09-13T02:54:01.440 INFO:tasks.workunit.client.0.smithi089.stdout:6/424: dread db/d43/d6e/d28/d2f/f4c [0,4194304] 0 2024-09-13T02:54:01.443 INFO:tasks.workunit.client.0.smithi089.stdout:2/433: creat d13/d30/f95 x:0 0 0 2024-09-13T02:54:01.443 INFO:tasks.workunit.client.0.smithi089.stdout:2/434: chown d13/d30/d4e/l80 0 1 2024-09-13T02:54:01.444 INFO:tasks.workunit.client.0.smithi089.stdout:4/527: creat d2/d22/da1/d62/d6c/d88/fa7 x:0 0 0 2024-09-13T02:54:01.444 INFO:tasks.workunit.client.0.smithi089.stdout:6/425: creat db/d43/d6e/d28/d46/d7e/f96 x:0 0 0 2024-09-13T02:54:01.444 INFO:tasks.workunit.client.0.smithi089.stdout:6/426: chown db/l8e 3 1 2024-09-13T02:54:01.445 INFO:tasks.workunit.client.0.smithi089.stdout:3/457: mkdir d2/d8b 0 2024-09-13T02:54:01.446 INFO:tasks.workunit.client.0.smithi089.stdout:2/435: creat d13/d30/d59/f96 x:0 0 0 2024-09-13T02:54:01.447 INFO:tasks.workunit.client.0.smithi089.stdout:6/427: mknod db/d43/c97 0 2024-09-13T02:54:01.447 INFO:tasks.workunit.client.0.smithi089.stdout:6/428: truncate db/d43/d6e/d28/d2f/f4c 777472 0 2024-09-13T02:54:01.447 INFO:tasks.workunit.client.0.smithi089.stdout:6/429: creat db/d43/d60/d74/f98 x:0 0 0 2024-09-13T02:54:01.448 INFO:tasks.workunit.client.0.smithi089.stdout:3/458: creat d2/d20/d23/d32/d5b/d71/f8c x:0 0 0 2024-09-13T02:54:01.451 INFO:tasks.workunit.client.0.smithi089.stdout:2/436: symlink d13/d30/d4e/d7b/d86/l97 0 2024-09-13T02:54:01.453 INFO:tasks.workunit.client.0.smithi089.stdout:6/430: mknod db/d43/d6e/c99 0 2024-09-13T02:54:01.453 INFO:tasks.workunit.client.0.smithi089.stdout:6/431: readlink db/d43/d6e/d28/d46/d53/l61 0 2024-09-13T02:54:01.455 INFO:tasks.workunit.client.0.smithi089.stdout:6/432: truncate db/d10/f80 236615 0 2024-09-13T02:54:01.455 INFO:tasks.workunit.client.0.smithi089.stdout:6/433: chown db/d43/d6e/d28/d46/d53/d83 224 1 2024-09-13T02:54:01.456 INFO:tasks.workunit.client.0.smithi089.stdout:3/459: mkdir d2/d8d 0 2024-09-13T02:54:01.457 INFO:tasks.workunit.client.0.smithi089.stdout:6/434: mknod db/d43/d6e/d28/d46/d53/d83/c9a 0 2024-09-13T02:54:01.457 INFO:tasks.workunit.client.0.smithi089.stdout:6/435: readlink db/ld 0 2024-09-13T02:54:01.493 INFO:tasks.workunit.client.0.smithi089.stdout:0/339: dwrite d2/fe [0,4194304] 0 2024-09-13T02:54:01.493 INFO:tasks.workunit.client.0.smithi089.stdout:0/340: creat d2/d19/d1a/d1e/d42/f74 x:0 0 0 2024-09-13T02:54:01.497 INFO:tasks.workunit.client.0.smithi089.stdout:0/341: rename d2/l3f to d2/l75 0 2024-09-13T02:54:01.497 INFO:tasks.workunit.client.0.smithi089.stdout:9/397: dwrite d3/d6/df/d24/d35/f80 [0,4194304] 0 2024-09-13T02:54:01.497 INFO:tasks.workunit.client.0.smithi089.stdout:9/398: chown d3/d6/d2a/c79 1 1 2024-09-13T02:54:01.498 INFO:tasks.workunit.client.0.smithi089.stdout:2/437: dwrite d13/d30/d61/d78/d79/f85 [0,4194304] 0 2024-09-13T02:54:01.499 INFO:tasks.workunit.client.0.smithi089.stdout:2/438: truncate d13/d30/d4e/f65 619006 0 2024-09-13T02:54:01.500 INFO:tasks.workunit.client.0.smithi089.stdout:6/436: dwrite db/d43/d6e/d28/d37/d8b/f90 [0,4194304] 0 2024-09-13T02:54:01.500 INFO:tasks.workunit.client.0.smithi089.stdout:6/437: stat db/d10 0 2024-09-13T02:54:01.500 INFO:tasks.workunit.client.0.smithi089.stdout:3/460: dwrite d2/d20/d23/d32/d49/f7f [0,4194304] 0 2024-09-13T02:54:01.501 INFO:tasks.workunit.client.0.smithi089.stdout:9/399: dread d3/d6/df/d24/d29/f52 [0,4194304] 0 2024-09-13T02:54:01.501 INFO:tasks.workunit.client.0.smithi089.stdout:2/439: creat d13/d30/d4e/d7b/d86/f98 x:0 0 0 2024-09-13T02:54:01.501 INFO:tasks.workunit.client.0.smithi089.stdout:2/440: write d13/d30/f95 [963144,10757] 0 2024-09-13T02:54:01.501 INFO:tasks.workunit.client.0.smithi089.stdout:2/441: write d13/f1a [2497097,1497] 0 2024-09-13T02:54:01.508 INFO:tasks.workunit.client.0.smithi089.stdout:9/400: dread d3/d6/d36/f5c [0,4194304] 0 2024-09-13T02:54:01.508 INFO:tasks.workunit.client.0.smithi089.stdout:9/401: readlink d3/d6/df/l6f 0 2024-09-13T02:54:01.510 INFO:tasks.workunit.client.0.smithi089.stdout:2/442: rename d13/l3f to d13/d30/d59/l99 0 2024-09-13T02:54:01.510 INFO:tasks.workunit.client.0.smithi089.stdout:2/443: creat d13/f9a x:0 0 0 2024-09-13T02:54:01.511 INFO:tasks.workunit.client.0.smithi089.stdout:9/402: creat d3/d6/d2a/d4b/d6d/f82 x:0 0 0 2024-09-13T02:54:01.514 INFO:tasks.workunit.client.0.smithi089.stdout:2/444: mknod d13/d30/d59/c9b 0 2024-09-13T02:54:01.515 INFO:tasks.workunit.client.0.smithi089.stdout:2/445: chown d13/d30/d4e/f74 36158524 1 2024-09-13T02:54:01.515 INFO:tasks.workunit.client.0.smithi089.stdout:6/438: dwrite db/d10/d3a/f5e [0,4194304] 0 2024-09-13T02:54:01.515 INFO:tasks.workunit.client.0.smithi089.stdout:6/439: write db/d43/d6e/d28/d46/d7e/f96 [119667,126450] 0 2024-09-13T02:54:01.515 INFO:tasks.workunit.client.0.smithi089.stdout:9/403: symlink d3/d6/df/d56/l83 0 2024-09-13T02:54:01.515 INFO:tasks.workunit.client.0.smithi089.stdout:9/404: chown d3/d6/d2a/c76 64277036 1 2024-09-13T02:54:01.520 INFO:tasks.workunit.client.0.smithi089.stdout:9/405: mknod d3/d6/df/d24/d32/c84 0 2024-09-13T02:54:01.523 INFO:tasks.workunit.client.0.smithi089.stdout:0/342: dwrite d2/d19/d1a/d1e/d42/f49 [0,4194304] 0 2024-09-13T02:54:01.524 INFO:tasks.workunit.client.0.smithi089.stdout:5/447: sync 2024-09-13T02:54:01.526 INFO:tasks.workunit.client.0.smithi089.stdout:6/440: dread db/d10/d3a/d7b/f91 [0,4194304] 0 2024-09-13T02:54:01.530 INFO:tasks.workunit.client.0.smithi089.stdout:2/446: rmdir d13/d30/d4e/d7b 39 2024-09-13T02:54:01.531 INFO:tasks.workunit.client.0.smithi089.stdout:0/343: symlink d2/d19/d1a/d63/l76 0 2024-09-13T02:54:01.532 INFO:tasks.workunit.client.0.smithi089.stdout:6/441: getdents db/d43/d6e/d28/d46 0 2024-09-13T02:54:01.533 INFO:tasks.workunit.client.0.smithi089.stdout:2/447: mkdir d13/d30/d61/d78/d9c 0 2024-09-13T02:54:01.535 INFO:tasks.workunit.client.0.smithi089.stdout:0/344: symlink d2/d19/d1a/d1e/l77 0 2024-09-13T02:54:01.536 INFO:tasks.workunit.client.0.smithi089.stdout:6/442: truncate db/f23 506960 0 2024-09-13T02:54:01.537 INFO:tasks.workunit.client.0.smithi089.stdout:6/443: write db/d10/d3a/f5d [4450956,12489] 0 2024-09-13T02:54:01.537 INFO:tasks.workunit.client.0.smithi089.stdout:6/444: fdatasync db/d43/d60/f79 0 2024-09-13T02:54:01.537 INFO:tasks.workunit.client.0.smithi089.stdout:6/445: chown db/d43/d6e/d28/d2f/f3c 1129081 1 2024-09-13T02:54:01.537 INFO:tasks.workunit.client.0.smithi089.stdout:5/448: dread d1/f26 [0,4194304] 0 2024-09-13T02:54:01.541 INFO:tasks.workunit.client.0.smithi089.stdout:6/446: mkdir db/d43/d6e/d28/d2f/d9b 0 2024-09-13T02:54:01.541 INFO:tasks.workunit.client.0.smithi089.stdout:6/447: chown db/d43/d6e/c99 3664 1 2024-09-13T02:54:01.545 INFO:tasks.workunit.client.0.smithi089.stdout:5/449: unlink d1/d7/f18 0 2024-09-13T02:54:01.545 INFO:tasks.workunit.client.0.smithi089.stdout:5/450: truncate d1/d4/d45/f7b 5114369 0 2024-09-13T02:54:01.545 INFO:tasks.workunit.client.0.smithi089.stdout:5/451: truncate d1/d4/f5 1604099 0 2024-09-13T02:54:01.545 INFO:tasks.workunit.client.0.smithi089.stdout:5/452: creat d1/d4/d45/d6f/f93 x:0 0 0 2024-09-13T02:54:01.545 INFO:tasks.workunit.client.0.smithi089.stdout:5/453: stat d1/d4/d45/d6f/f93 0 2024-09-13T02:54:01.545 INFO:tasks.workunit.client.0.smithi089.stdout:5/454: creat d1/d4/d45/d6f/d4d/d7f/d49/d5a/f94 x:0 0 0 2024-09-13T02:54:01.545 INFO:tasks.workunit.client.0.smithi089.stdout:0/345: mknod d2/c78 0 2024-09-13T02:54:01.546 INFO:tasks.workunit.client.0.smithi089.stdout:6/448: mknod db/d43/d6e/d28/d46/d53/d83/c9c 0 2024-09-13T02:54:01.546 INFO:tasks.workunit.client.0.smithi089.stdout:6/449: write db/d43/d60/f79 [477009,64301] 0 2024-09-13T02:54:01.546 INFO:tasks.workunit.client.0.smithi089.stdout:9/406: dwrite f2 [0,4194304] 0 2024-09-13T02:54:01.546 INFO:tasks.workunit.client.0.smithi089.stdout:9/407: stat d3/d6 0 2024-09-13T02:54:01.548 INFO:tasks.workunit.client.0.smithi089.stdout:8/505: sync 2024-09-13T02:54:01.548 INFO:tasks.workunit.client.0.smithi089.stdout:1/417: sync 2024-09-13T02:54:01.548 INFO:tasks.workunit.client.0.smithi089.stdout:1/418: truncate dc/d3a/d53/d2c/d36/f38 1245124 0 2024-09-13T02:54:01.548 INFO:tasks.workunit.client.0.smithi089.stdout:5/455: unlink d1/d4/l44 0 2024-09-13T02:54:01.549 INFO:tasks.workunit.client.0.smithi089.stdout:0/346: rename d2/d19/d1a/d1e/d42/f47 to d2/d19/d1a/d4e/f79 0 2024-09-13T02:54:01.549 INFO:tasks.workunit.client.0.smithi089.stdout:0/347: fdatasync d2/d19/d1a/d1e/d42/f46 0 2024-09-13T02:54:01.551 INFO:tasks.workunit.client.0.smithi089.stdout:6/450: unlink db/d43/d6e/d28/d37/d8b/f90 0 2024-09-13T02:54:01.551 INFO:tasks.workunit.client.0.smithi089.stdout:6/451: chown db/d43/d6e/f55 52901 1 2024-09-13T02:54:01.551 INFO:tasks.workunit.client.0.smithi089.stdout:6/452: readlink db/d43/d6e/d28/d46/l7a 0 2024-09-13T02:54:01.552 INFO:tasks.workunit.client.0.smithi089.stdout:9/408: chown d3/d15/f1b 22610508 1 2024-09-13T02:54:01.552 INFO:tasks.workunit.client.0.smithi089.stdout:2/448: dwrite d13/d30/d4e/d7b/f8e [0,4194304] 0 2024-09-13T02:54:01.553 INFO:tasks.workunit.client.0.smithi089.stdout:8/506: link de/d16/d1e/d27/d52/d61/f75 de/d16/d1e/d27/d52/d61/d8e/fa6 0 2024-09-13T02:54:01.554 INFO:tasks.workunit.client.0.smithi089.stdout:8/507: fsync de/d16/d1e/d27/d76/d8d/fa0 0 2024-09-13T02:54:01.555 INFO:tasks.workunit.client.0.smithi089.stdout:1/419: rmdir dc/d3a/d74 0 2024-09-13T02:54:01.556 INFO:tasks.workunit.client.0.smithi089.stdout:5/456: unlink d1/d7/f15 0 2024-09-13T02:54:01.557 INFO:tasks.workunit.client.0.smithi089.stdout:0/348: mkdir d2/d19/d1a/d4e/d7a 0 2024-09-13T02:54:01.562 INFO:tasks.workunit.client.0.smithi089.stdout:6/453: rename db/d43/d6e/d28/d2f/l5f to db/d43/d6e/d28/d46/d7e/l9d 0 2024-09-13T02:54:01.563 INFO:tasks.workunit.client.0.smithi089.stdout:9/409: mknod d3/d6/d2a/d4b/d77/c85 0 2024-09-13T02:54:01.564 INFO:tasks.workunit.client.0.smithi089.stdout:9/410: chown d3/d6/d2a/f78 3 1 2024-09-13T02:54:01.567 INFO:tasks.workunit.client.0.smithi089.stdout:0/349: mknod d2/d19/d1a/d4e/d7a/c7b 0 2024-09-13T02:54:01.567 INFO:tasks.workunit.client.0.smithi089.stdout:5/457: dread d1/f5e [0,4194304] 0 2024-09-13T02:54:01.568 INFO:tasks.workunit.client.0.smithi089.stdout:6/454: readlink db/d10/l32 0 2024-09-13T02:54:01.570 INFO:tasks.workunit.client.0.smithi089.stdout:8/508: rename de/d16/d1e/d27/c4a to de/d16/d1e/d3f/d5b/ca7 0 2024-09-13T02:54:01.571 INFO:tasks.workunit.client.0.smithi089.stdout:9/411: fdatasync d3/d6/f65 0 2024-09-13T02:54:01.571 INFO:tasks.workunit.client.0.smithi089.stdout:2/449: dwrite d13/f27 [0,4194304] 0 2024-09-13T02:54:01.572 INFO:tasks.workunit.client.0.smithi089.stdout:0/350: creat d2/d19/d1a/d3d/d4b/d4f/d59/f7c x:0 0 0 2024-09-13T02:54:01.574 INFO:tasks.workunit.client.0.smithi089.stdout:5/458: symlink d1/d4/d45/d6f/d4d/d7f/l95 0 2024-09-13T02:54:01.576 INFO:tasks.workunit.client.0.smithi089.stdout:0/351: fdatasync d2/f16 0 2024-09-13T02:54:01.578 INFO:tasks.workunit.client.0.smithi089.stdout:5/459: link d1/d4/d45/f82 d1/d4/d45/d6f/d4d/d7f/f96 0 2024-09-13T02:54:01.582 INFO:tasks.workunit.client.0.smithi089.stdout:9/412: creat d3/d4c/f86 x:0 0 0 2024-09-13T02:54:01.584 INFO:tasks.workunit.client.0.smithi089.stdout:2/450: write d13/d30/f3c [1592961,115447] 0 2024-09-13T02:54:01.584 INFO:tasks.workunit.client.0.smithi089.stdout:2/451: chown d13/d30/d4e/f65 7186755 1 2024-09-13T02:54:01.585 INFO:tasks.workunit.client.0.smithi089.stdout:0/352: getdents d2/d19/d1a/d4e 0 2024-09-13T02:54:01.587 INFO:tasks.workunit.client.0.smithi089.stdout:7/536: sync 2024-09-13T02:54:01.587 INFO:tasks.workunit.client.0.smithi089.stdout:4/528: sync 2024-09-13T02:54:01.588 INFO:tasks.workunit.client.0.smithi089.stdout:0/353: mknod d2/d19/d1a/d3d/c7d 0 2024-09-13T02:54:01.590 INFO:tasks.workunit.client.0.smithi089.stdout:2/452: getdents d13/d30 0 2024-09-13T02:54:01.590 INFO:tasks.workunit.client.0.smithi089.stdout:2/453: chown d13/d30/d4e/l8d 6 1 2024-09-13T02:54:01.591 INFO:tasks.workunit.client.0.smithi089.stdout:4/529: creat d2/d3/d5/fa8 x:0 0 0 2024-09-13T02:54:01.592 INFO:tasks.workunit.client.0.smithi089.stdout:2/454: truncate d13/d30/f47 56983 0 2024-09-13T02:54:01.592 INFO:tasks.workunit.client.0.smithi089.stdout:2/455: truncate d13/d30/d4e/d6f/f84 497110 0 2024-09-13T02:54:01.593 INFO:tasks.workunit.client.0.smithi089.stdout:4/530: getdents d2/d3/d5/d72 0 2024-09-13T02:54:01.597 INFO:tasks.workunit.client.0.smithi089.stdout:7/537: dread d3/d19/d2e/f4f [0,4194304] 0 2024-09-13T02:54:01.597 INFO:tasks.workunit.client.0.smithi089.stdout:7/538: read d3/f7c [3236537,36681] 0 2024-09-13T02:54:01.599 INFO:tasks.workunit.client.0.smithi089.stdout:7/539: rename d3/d19/d2e/d37/l9e to d3/d44/d85/d5e/laa 0 2024-09-13T02:54:01.599 INFO:tasks.workunit.client.0.smithi089.stdout:9/413: dread f2 [0,4194304] 0 2024-09-13T02:54:01.600 INFO:tasks.workunit.client.0.smithi089.stdout:7/540: unlink d3/d44/c4c 0 2024-09-13T02:54:01.601 INFO:tasks.workunit.client.0.smithi089.stdout:9/414: mkdir d3/d6/d2a/d4b/d77/d87 0 2024-09-13T02:54:01.601 INFO:tasks.workunit.client.0.smithi089.stdout:9/415: readlink d3/d6/df/l7b 0 2024-09-13T02:54:01.601 INFO:tasks.workunit.client.0.smithi089.stdout:9/416: fsync d3/d15/f3f 0 2024-09-13T02:54:01.601 INFO:tasks.workunit.client.0.smithi089.stdout:9/417: readlink d3/d6/df/d24/l46 0 2024-09-13T02:54:01.602 INFO:tasks.workunit.client.0.smithi089.stdout:0/354: read d2/d19/d1a/d1e/d42/f6a [1834357,25740] 0 2024-09-13T02:54:01.604 INFO:tasks.workunit.client.0.smithi089.stdout:8/509: dwrite de/d16/d1e/d27/d52/d61/d8e/f90 [0,4194304] 0 2024-09-13T02:54:01.604 INFO:tasks.workunit.client.0.smithi089.stdout:5/460: dwrite d1/d4/d45/d6f/f3b [0,4194304] 0 2024-09-13T02:54:01.611 INFO:tasks.workunit.client.0.smithi089.stdout:0/355: write d2/f6 [3395007,113509] 0 2024-09-13T02:54:01.611 INFO:tasks.workunit.client.0.smithi089.stdout:0/356: dread - d2/d19/d1a/f4d zero size 2024-09-13T02:54:01.613 INFO:tasks.workunit.client.0.smithi089.stdout:5/461: truncate d1/d4/d2b/f50 5901530 0 2024-09-13T02:54:01.613 INFO:tasks.workunit.client.0.smithi089.stdout:8/510: mkdir de/d16/d1e/d20/da8 0 2024-09-13T02:54:01.613 INFO:tasks.workunit.client.0.smithi089.stdout:8/511: chown de/d16/d1e/d20/d6c/f99 315191 1 2024-09-13T02:54:01.613 INFO:tasks.workunit.client.0.smithi089.stdout:8/512: write de/d16/d1e/d20/d6c/d6e/d7e/f82 [4859517,92228] 0 2024-09-13T02:54:01.616 INFO:tasks.workunit.client.0.smithi089.stdout:6/455: dwrite db/d10/d3a/f8a [0,4194304] 0 2024-09-13T02:54:01.616 INFO:tasks.workunit.client.0.smithi089.stdout:2/456: write d13/d30/d61/d78/d79/f85 [2634044,48634] 0 2024-09-13T02:54:01.616 INFO:tasks.workunit.client.0.smithi089.stdout:6/456: chown db/d43/d6e/d28/d2f/l3d 37895 1 2024-09-13T02:54:01.616 INFO:tasks.workunit.client.0.smithi089.stdout:2/457: dread - d13/d30/d4e/d7b/f92 zero size 2024-09-13T02:54:01.616 INFO:tasks.workunit.client.0.smithi089.stdout:5/462: unlink d1/d4/d45/d6f/f42 0 2024-09-13T02:54:01.616 INFO:tasks.workunit.client.0.smithi089.stdout:2/458: chown d13/d30/d4e/d6f/f7d 13260311 1 2024-09-13T02:54:01.617 INFO:tasks.workunit.client.0.smithi089.stdout:4/531: dread d2/d3/d5/f1e [0,4194304] 0 2024-09-13T02:54:01.617 INFO:tasks.workunit.client.0.smithi089.stdout:4/532: fdatasync d2/d22/da1/d62/d6c/d88/f90 0 2024-09-13T02:54:01.619 INFO:tasks.workunit.client.0.smithi089.stdout:6/457: symlink db/d10/d3a/l9e 0 2024-09-13T02:54:01.620 INFO:tasks.workunit.client.0.smithi089.stdout:2/459: unlink d13/d30/f40 0 2024-09-13T02:54:01.622 INFO:tasks.workunit.client.0.smithi089.stdout:2/460: read d13/d30/f75 [109603,97292] 0 2024-09-13T02:54:01.622 INFO:tasks.workunit.client.0.smithi089.stdout:2/461: readlink d13/d30/l21 0 2024-09-13T02:54:01.624 INFO:tasks.workunit.client.0.smithi089.stdout:7/541: dwrite d3/d19/d67/f80 [0,4194304] 0 2024-09-13T02:54:01.624 INFO:tasks.workunit.client.0.smithi089.stdout:7/542: chown d3/d44/d85/d5e/d6f/f89 29 1 2024-09-13T02:54:01.624 INFO:tasks.workunit.client.0.smithi089.stdout:4/533: creat d2/d3/d5/fa9 x:0 0 0 2024-09-13T02:54:01.625 INFO:tasks.workunit.client.0.smithi089.stdout:6/458: mkdir db/d43/d6e/d28/d46/d53/d83/d9f 0 2024-09-13T02:54:01.629 INFO:tasks.workunit.client.0.smithi089.stdout:9/418: dwrite d3/d6/df/d24/d32/f7d [0,4194304] 0 2024-09-13T02:54:01.629 INFO:tasks.workunit.client.0.smithi089.stdout:5/463: dread d1/d7/f27 [0,4194304] 0 2024-09-13T02:54:01.629 INFO:tasks.workunit.client.0.smithi089.stdout:5/464: truncate d1/d4/d45/d6f/d4d/d7f/d8f/f91 138040 0 2024-09-13T02:54:01.629 INFO:tasks.workunit.client.0.smithi089.stdout:5/465: truncate d1/d7/f21 948259 0 2024-09-13T02:54:01.629 INFO:tasks.workunit.client.0.smithi089.stdout:5/466: stat d1/d4/d2b/f2d 0 2024-09-13T02:54:01.633 INFO:tasks.workunit.client.0.smithi089.stdout:4/534: mknod d2/d3/d5/d49/caa 0 2024-09-13T02:54:01.633 INFO:tasks.workunit.client.0.smithi089.stdout:4/535: write d2/d3/d5/d43/f65 [364094,3905] 0 2024-09-13T02:54:01.668 INFO:tasks.workunit.client.0.smithi089.stdout:0/357: dwrite f1 [0,4194304] 0 2024-09-13T02:54:01.668 INFO:tasks.workunit.client.0.smithi089.stdout:0/358: write d2/d19/f1c [607611,61528] 0 2024-09-13T02:54:01.668 INFO:tasks.workunit.client.0.smithi089.stdout:0/359: dread - d2/d19/d1a/d3d/d4b/d4f/d59/d6b/f6c zero size 2024-09-13T02:54:01.669 INFO:tasks.workunit.client.0.smithi089.stdout:2/462: dwrite d13/d30/d59/f5b [0,4194304] 0 2024-09-13T02:54:01.671 INFO:tasks.workunit.client.0.smithi089.stdout:5/467: dwrite d1/d4/d45/d6f/d4d/d7f/d49/d5a/f8b [0,4194304] 0 2024-09-13T02:54:01.672 INFO:tasks.workunit.client.0.smithi089.stdout:4/536: dwrite d2/d3/d5/f70 [0,4194304] 0 2024-09-13T02:54:01.672 INFO:tasks.workunit.client.0.smithi089.stdout:8/513: dwrite de/d16/d1e/d20/d6c/d6e/f7d [0,4194304] 0 2024-09-13T02:54:01.672 INFO:tasks.workunit.client.0.smithi089.stdout:6/459: dwrite db/d43/d6e/d28/d2f/f50 [0,4194304] 0 2024-09-13T02:54:01.673 INFO:tasks.workunit.client.0.smithi089.stdout:0/360: dread d2/d19/d1a/d1e/f43 [0,4194304] 0 2024-09-13T02:54:01.673 INFO:tasks.workunit.client.0.smithi089.stdout:9/419: dwrite d3/d6/fe [0,4194304] 0 2024-09-13T02:54:01.673 INFO:tasks.workunit.client.0.smithi089.stdout:9/420: chown d3/d6/d2a 1415176 1 2024-09-13T02:54:01.679 INFO:tasks.workunit.client.0.smithi089.stdout:9/421: dread d3/d6/df/d24/d32/f4a [0,4194304] 0 2024-09-13T02:54:01.680 INFO:tasks.workunit.client.0.smithi089.stdout:9/422: truncate d3/d6/df/d24/f69 201408 0 2024-09-13T02:54:01.681 INFO:tasks.workunit.client.0.smithi089.stdout:5/468: read d1/d4/d45/d6f/f3b [621204,6437] 0 2024-09-13T02:54:01.681 INFO:tasks.workunit.client.0.smithi089.stdout:5/469: chown d1/d7/f21 4190 1 2024-09-13T02:54:01.682 INFO:tasks.workunit.client.0.smithi089.stdout:3/461: sync 2024-09-13T02:54:01.686 INFO:tasks.workunit.client.0.smithi089.stdout:6/460: rmdir db/d10 39 2024-09-13T02:54:01.687 INFO:tasks.workunit.client.0.smithi089.stdout:6/461: readlink db/d43/d60/d74/l86 0 2024-09-13T02:54:01.689 INFO:tasks.workunit.client.0.smithi089.stdout:0/361: mkdir d2/d19/d1a/d1e/d42/d7e 0 2024-09-13T02:54:01.689 INFO:tasks.workunit.client.0.smithi089.stdout:0/362: truncate d2/d19/d1a/f56 1271191 0 2024-09-13T02:54:01.694 INFO:tasks.workunit.client.0.smithi089.stdout:5/470: dread d1/f69 [0,4194304] 0 2024-09-13T02:54:01.695 INFO:tasks.workunit.client.0.smithi089.stdout:5/471: fdatasync d1/d4/d45/d6f/d4d/d7f/d49/d5a/f8b 0 2024-09-13T02:54:01.695 INFO:tasks.workunit.client.0.smithi089.stdout:5/472: readlink d1/d7/l20 0 2024-09-13T02:54:01.696 INFO:tasks.workunit.client.0.smithi089.stdout:1/420: sync 2024-09-13T02:54:01.697 INFO:tasks.workunit.client.0.smithi089.stdout:8/514: rmdir de/d16/d1e 39 2024-09-13T02:54:01.698 INFO:tasks.workunit.client.0.smithi089.stdout:2/463: dwrite d13/f8c [0,4194304] 0 2024-09-13T02:54:01.698 INFO:tasks.workunit.client.0.smithi089.stdout:6/462: creat db/d10/fa0 x:0 0 0 2024-09-13T02:54:01.699 INFO:tasks.workunit.client.0.smithi089.stdout:9/423: getdents d3/d4c 0 2024-09-13T02:54:01.699 INFO:tasks.workunit.client.0.smithi089.stdout:4/537: dwrite d2/f53 [0,4194304] 0 2024-09-13T02:54:01.701 INFO:tasks.workunit.client.0.smithi089.stdout:2/464: creat d13/d30/d61/d78/d9c/f9d x:0 0 0 2024-09-13T02:54:01.701 INFO:tasks.workunit.client.0.smithi089.stdout:2/465: read - d13/d30/f73 zero size 2024-09-13T02:54:01.701 INFO:tasks.workunit.client.0.smithi089.stdout:6/463: unlink db/d43/d6e/f30 0 2024-09-13T02:54:01.702 INFO:tasks.workunit.client.0.smithi089.stdout:9/424: truncate d3/d6/d2a/f78 3354398 0 2024-09-13T02:54:01.706 INFO:tasks.workunit.client.0.smithi089.stdout:6/464: mkdir db/d43/d6e/d28/d46/d7e/da1 0 2024-09-13T02:54:01.708 INFO:tasks.workunit.client.0.smithi089.stdout:5/473: dread d1/fd [0,4194304] 0 2024-09-13T02:54:01.708 INFO:tasks.workunit.client.0.smithi089.stdout:9/425: unlink d3/d6/d2a/c4d 0 2024-09-13T02:54:01.709 INFO:tasks.workunit.client.0.smithi089.stdout:6/465: creat db/d10/fa2 x:0 0 0 2024-09-13T02:54:01.709 INFO:tasks.workunit.client.0.smithi089.stdout:6/466: truncate db/d43/d6e/d28/d2f/f35 484190 0 2024-09-13T02:54:01.709 INFO:tasks.workunit.client.0.smithi089.stdout:6/467: creat db/d43/d6e/d28/d37/fa3 x:0 0 0 2024-09-13T02:54:01.710 INFO:tasks.workunit.client.0.smithi089.stdout:6/468: fsync db/d43/d6e/f55 0 2024-09-13T02:54:01.712 INFO:tasks.workunit.client.0.smithi089.stdout:1/421: dread dc/f1a [0,4194304] 0 2024-09-13T02:54:01.712 INFO:tasks.workunit.client.0.smithi089.stdout:0/363: dwrite d2/d19/d1a/d3d/d4b/d4f/f5b [0,4194304] 0 2024-09-13T02:54:01.712 INFO:tasks.workunit.client.0.smithi089.stdout:0/364: write d2/d19/f32 [1286204,27389] 0 2024-09-13T02:54:01.713 INFO:tasks.workunit.client.0.smithi089.stdout:5/474: rmdir d1/d7 39 2024-09-13T02:54:01.713 INFO:tasks.workunit.client.0.smithi089.stdout:5/475: readlink d1/d4/d45/d6f/d4d/l66 0 2024-09-13T02:54:01.714 INFO:tasks.workunit.client.0.smithi089.stdout:8/515: dread de/d16/d1e/d27/d35/f74 [0,4194304] 0 2024-09-13T02:54:01.714 INFO:tasks.workunit.client.0.smithi089.stdout:8/516: fsync de/f11 0 2024-09-13T02:54:01.715 INFO:tasks.workunit.client.0.smithi089.stdout:8/517: dread de/d16/d1e/f87 [0,4194304] 0 2024-09-13T02:54:01.715 INFO:tasks.workunit.client.0.smithi089.stdout:0/365: symlink d2/d19/d1a/d4e/d7a/l7f 0 2024-09-13T02:54:01.716 INFO:tasks.workunit.client.0.smithi089.stdout:0/366: stat d2/f35 0 2024-09-13T02:54:01.716 INFO:tasks.workunit.client.0.smithi089.stdout:1/422: dread f3 [0,4194304] 0 2024-09-13T02:54:01.716 INFO:tasks.workunit.client.0.smithi089.stdout:1/423: fsync dc/d3a/d53/f23 0 2024-09-13T02:54:01.716 INFO:tasks.workunit.client.0.smithi089.stdout:5/476: creat d1/d4/f97 x:0 0 0 2024-09-13T02:54:01.717 INFO:tasks.workunit.client.0.smithi089.stdout:0/367: write d2/d19/d1a/d1e/f43 [45885,42622] 0 2024-09-13T02:54:01.717 INFO:tasks.workunit.client.0.smithi089.stdout:0/368: truncate d2/d19/d1a/d3d/d4b/d4f/d59/d6b/f6f 271652 0 2024-09-13T02:54:01.717 INFO:tasks.workunit.client.0.smithi089.stdout:8/518: truncate de/f4d 466882 0 2024-09-13T02:54:01.718 INFO:tasks.workunit.client.0.smithi089.stdout:7/543: sync 2024-09-13T02:54:01.718 INFO:tasks.workunit.client.0.smithi089.stdout:1/424: readlink l9 0 2024-09-13T02:54:01.721 INFO:tasks.workunit.client.0.smithi089.stdout:8/519: link de/d16/d1e/d3f/f49 de/d16/d1e/d20/da8/fa9 0 2024-09-13T02:54:01.721 INFO:tasks.workunit.client.0.smithi089.stdout:7/544: chown d3/d19/d75/d14/l7e 2 1 2024-09-13T02:54:01.722 INFO:tasks.workunit.client.0.smithi089.stdout:0/369: link d2/d19/d1a/d1e/d42/f6a d2/f80 0 2024-09-13T02:54:01.723 INFO:tasks.workunit.client.0.smithi089.stdout:8/520: creat de/d16/d1e/d20/d6c/d6e/faa x:0 0 0 2024-09-13T02:54:01.724 INFO:tasks.workunit.client.0.smithi089.stdout:8/521: truncate f5 2812126 0 2024-09-13T02:54:01.731 INFO:tasks.workunit.client.0.smithi089.stdout:7/545: dread d3/d19/d75/f29 [0,4194304] 0 2024-09-13T02:54:01.731 INFO:tasks.workunit.client.0.smithi089.stdout:1/425: dread dc/d44/f6a [0,4194304] 0 2024-09-13T02:54:01.731 INFO:tasks.workunit.client.0.smithi089.stdout:1/426: chown dc/d3a/d53/d2c/f2e 757060330 1 2024-09-13T02:54:01.733 INFO:tasks.workunit.client.0.smithi089.stdout:7/546: unlink d3/d19/d2e/d37/c61 0 2024-09-13T02:54:01.736 INFO:tasks.workunit.client.0.smithi089.stdout:1/427: mkdir dc/d44/d73/d86 0 2024-09-13T02:54:01.736 INFO:tasks.workunit.client.0.smithi089.stdout:1/428: creat dc/d3a/d53/f87 x:0 0 0 2024-09-13T02:54:01.736 INFO:tasks.workunit.client.0.smithi089.stdout:1/429: chown dc/d3a/d53/f87 218380090 1 2024-09-13T02:54:01.736 INFO:tasks.workunit.client.0.smithi089.stdout:7/547: rmdir d3/d19/d75/d14/d6c 0 2024-09-13T02:54:01.746 INFO:tasks.workunit.client.0.smithi089.stdout:1/430: read dc/d3a/d53/d2c/d34/f5f [3440310,79851] 0 2024-09-13T02:54:01.760 INFO:tasks.workunit.client.0.smithi089.stdout:4/538: dwrite d2/da/f30 [4194304,4194304] 0 2024-09-13T02:54:01.762 INFO:tasks.workunit.client.0.smithi089.stdout:6/469: dwrite db/d43/f95 [0,4194304] 0 2024-09-13T02:54:01.763 INFO:tasks.workunit.client.0.smithi089.stdout:9/426: dwrite d3/d6/df/d24/d32/f7d [0,4194304] 0 2024-09-13T02:54:01.763 INFO:tasks.workunit.client.0.smithi089.stdout:9/427: read - d3/d6/f65 zero size 2024-09-13T02:54:01.763 INFO:tasks.workunit.client.0.smithi089.stdout:9/428: creat d3/d6/df/d24/d29/f88 x:0 0 0 2024-09-13T02:54:01.763 INFO:tasks.workunit.client.0.smithi089.stdout:5/477: dwrite d1/d4/d45/d6f/d4d/f71 [0,4194304] 0 2024-09-13T02:54:01.763 INFO:tasks.workunit.client.0.smithi089.stdout:7/548: dwrite d3/d20/f32 [0,4194304] 0 2024-09-13T02:54:01.763 INFO:tasks.workunit.client.0.smithi089.stdout:5/478: fsync d1/f69 0 2024-09-13T02:54:01.763 INFO:tasks.workunit.client.0.smithi089.stdout:5/479: write d1/d4/d2b/f2d [946141,121904] 0 2024-09-13T02:54:01.763 INFO:tasks.workunit.client.0.smithi089.stdout:4/539: rename d2/d22/da1/d62/d6c/d88/f90 to d2/fab 0 2024-09-13T02:54:01.763 INFO:tasks.workunit.client.0.smithi089.stdout:0/370: dwrite d2/f18 [4194304,4194304] 0 2024-09-13T02:54:01.765 INFO:tasks.workunit.client.0.smithi089.stdout:6/470: creat db/d10/fa4 x:0 0 0 2024-09-13T02:54:01.776 INFO:tasks.workunit.client.0.smithi089.stdout:7/549: symlink d3/d19/d75/d63/lab 0 2024-09-13T02:54:01.777 INFO:tasks.workunit.client.0.smithi089.stdout:5/480: mkdir d1/d4/d45/d8c/d98 0 2024-09-13T02:54:01.777 INFO:tasks.workunit.client.0.smithi089.stdout:5/481: write d1/d4/f97 [80610,78286] 0 2024-09-13T02:54:01.778 INFO:tasks.workunit.client.0.smithi089.stdout:4/540: creat d2/d3/d5/d49/fac x:0 0 0 2024-09-13T02:54:01.778 INFO:tasks.workunit.client.0.smithi089.stdout:5/482: dread d1/d4/f5 [0,4194304] 0 2024-09-13T02:54:01.780 INFO:tasks.workunit.client.0.smithi089.stdout:0/371: rmdir d2/d19/d1a/d3d 39 2024-09-13T02:54:01.780 INFO:tasks.workunit.client.0.smithi089.stdout:0/372: write d2/d19/d1a/f3e [1311323,46654] 0 2024-09-13T02:54:01.780 INFO:tasks.workunit.client.0.smithi089.stdout:0/373: chown d2/d19/d1a/d63 1 1 2024-09-13T02:54:01.780 INFO:tasks.workunit.client.0.smithi089.stdout:0/374: creat d2/d19/d1a/d3d/d4b/d4f/f81 x:0 0 0 2024-09-13T02:54:01.780 INFO:tasks.workunit.client.0.smithi089.stdout:0/375: write d2/f6 [2221924,57925] 0 2024-09-13T02:54:01.781 INFO:tasks.workunit.client.0.smithi089.stdout:9/429: mknod d3/d3d/c89 0 2024-09-13T02:54:01.781 INFO:tasks.workunit.client.0.smithi089.stdout:9/430: write d3/d4c/f86 [106052,41382] 0 2024-09-13T02:54:01.781 INFO:tasks.workunit.client.0.smithi089.stdout:7/550: symlink d3/d19/d67/lac 0 2024-09-13T02:54:01.782 INFO:tasks.workunit.client.0.smithi089.stdout:4/541: symlink d2/d22/da1/lad 0 2024-09-13T02:54:01.784 INFO:tasks.workunit.client.0.smithi089.stdout:5/483: mkdir d1/d4/d45/d6f/d62/d72/d99 0 2024-09-13T02:54:01.787 INFO:tasks.workunit.client.0.smithi089.stdout:0/376: link d2/d19/l33 d2/d19/d1a/d3d/d4b/d4f/d59/l82 0 2024-09-13T02:54:01.788 INFO:tasks.workunit.client.0.smithi089.stdout:6/471: rmdir db/d43/d60/d74 39 2024-09-13T02:54:01.789 INFO:tasks.workunit.client.0.smithi089.stdout:9/431: symlink d3/d6/d2a/d4b/l8a 0 2024-09-13T02:54:01.789 INFO:tasks.workunit.client.0.smithi089.stdout:9/432: readlink d3/d6/df/d56/l83 0 2024-09-13T02:54:01.789 INFO:tasks.workunit.client.0.smithi089.stdout:9/433: fsync d3/d6/d2a/d4b/d54/f72 0 2024-09-13T02:54:01.790 INFO:tasks.workunit.client.0.smithi089.stdout:4/542: mknod d2/d3/d5/d43/d3b/d71/cae 0 2024-09-13T02:54:01.794 INFO:tasks.workunit.client.0.smithi089.stdout:0/377: creat d2/d19/d1a/d63/f83 x:0 0 0 2024-09-13T02:54:01.795 INFO:tasks.workunit.client.0.smithi089.stdout:7/551: getdents d3/d19/d2e/d37 0 2024-09-13T02:54:01.797 INFO:tasks.workunit.client.0.smithi089.stdout:5/484: getdents d1 0 2024-09-13T02:54:01.799 INFO:tasks.workunit.client.0.smithi089.stdout:0/378: unlink d2/c78 0 2024-09-13T02:54:01.801 INFO:tasks.workunit.client.0.smithi089.stdout:4/543: rmdir d2/d3/d5/d43/d3b/d71/d78/d9c 39 2024-09-13T02:54:01.802 INFO:tasks.workunit.client.0.smithi089.stdout:7/552: dread d3/f7c [0,4194304] 0 2024-09-13T02:54:01.802 INFO:tasks.workunit.client.0.smithi089.stdout:0/379: rename d2/d19/d1a/d1e/d42/c5f to d2/d19/d1a/d1e/d42/c84 0 2024-09-13T02:54:01.805 INFO:tasks.workunit.client.0.smithi089.stdout:4/544: rename d2/d3/d5/d43/d3b/d71/d7e to d2/d3/d5/d43/d3b/d71/d99/daf 0 2024-09-13T02:54:01.805 INFO:tasks.workunit.client.0.smithi089.stdout:4/545: chown d2/da/c11 13858988 1 2024-09-13T02:54:01.807 INFO:tasks.workunit.client.0.smithi089.stdout:7/553: mkdir d3/d19/d2e/d37/dad 0 2024-09-13T02:54:01.810 INFO:tasks.workunit.client.0.smithi089.stdout:7/554: rename d3/d44/f70 to d3/d44/d85/d5e/d6f/fae 0 2024-09-13T02:54:01.810 INFO:tasks.workunit.client.0.smithi089.stdout:7/555: fsync d3/d44/d85/d77/f8c 0 2024-09-13T02:54:01.822 INFO:tasks.workunit.client.0.smithi089.stdout:0/380: dread d2/f48 [0,4194304] 0 2024-09-13T02:54:01.823 INFO:tasks.workunit.client.0.smithi089.stdout:0/381: creat d2/f85 x:0 0 0 2024-09-13T02:54:01.824 INFO:tasks.workunit.client.0.smithi089.stdout:9/434: dwrite d3/d6/d2a/d4b/d6d/f82 [0,4194304] 0 2024-09-13T02:54:01.824 INFO:tasks.workunit.client.0.smithi089.stdout:9/435: fsync d3/d6/df/d24/d29/f52 0 2024-09-13T02:54:01.824 INFO:tasks.workunit.client.0.smithi089.stdout:6/472: dwrite db/d43/d6e/d28/d37/f51 [0,4194304] 0 2024-09-13T02:54:01.827 INFO:tasks.workunit.client.0.smithi089.stdout:9/436: truncate d3/f22 8902375 0 2024-09-13T02:54:01.827 INFO:tasks.workunit.client.0.smithi089.stdout:9/437: chown d3/d6/d2a/d4b/d54/l61 3211164 1 2024-09-13T02:54:01.827 INFO:tasks.workunit.client.0.smithi089.stdout:9/438: write d3/d6/df/d24/f48 [1754063,80362] 0 2024-09-13T02:54:01.827 INFO:tasks.workunit.client.0.smithi089.stdout:4/546: dwrite d2/d3/f25 [0,4194304] 0 2024-09-13T02:54:01.827 INFO:tasks.workunit.client.0.smithi089.stdout:5/485: dwrite d1/d4/d45/f4a [0,4194304] 0 2024-09-13T02:54:01.828 INFO:tasks.workunit.client.0.smithi089.stdout:0/382: mknod d2/c86 0 2024-09-13T02:54:01.828 INFO:tasks.workunit.client.0.smithi089.stdout:0/383: write d2/d19/d1a/f57 [1363137,35830] 0 2024-09-13T02:54:01.828 INFO:tasks.workunit.client.0.smithi089.stdout:9/439: dread d3/d6/df/d24/d32/f4a [0,4194304] 0 2024-09-13T02:54:01.829 INFO:tasks.workunit.client.0.smithi089.stdout:9/440: stat d3/d6/d2a/l37 0 2024-09-13T02:54:01.829 INFO:tasks.workunit.client.0.smithi089.stdout:7/556: getdents d3/d44/d85/d5e/d6f 0 2024-09-13T02:54:01.829 INFO:tasks.workunit.client.0.smithi089.stdout:7/557: write d3/d44/f58 [918111,46117] 0 2024-09-13T02:54:01.830 INFO:tasks.workunit.client.0.smithi089.stdout:6/473: truncate db/d43/d6e/d28/d2f/f35 61310 0 2024-09-13T02:54:01.834 INFO:tasks.workunit.client.0.smithi089.stdout:4/547: creat d2/d3/d5/fb0 x:0 0 0 2024-09-13T02:54:01.834 INFO:tasks.workunit.client.0.smithi089.stdout:4/548: write d2/f40 [5863420,27513] 0 2024-09-13T02:54:01.834 INFO:tasks.workunit.client.0.smithi089.stdout:4/549: creat d2/d3/d5/d43/d3b/d71/d99/fb1 x:0 0 0 2024-09-13T02:54:01.840 INFO:tasks.workunit.client.0.smithi089.stdout:5/486: link d1/f26 d1/d4/d45/d6f/d62/d72/d99/f9a 0 2024-09-13T02:54:01.840 INFO:tasks.workunit.client.0.smithi089.stdout:5/487: read d1/d7/f30 [832054,71968] 0 2024-09-13T02:54:01.840 INFO:tasks.workunit.client.0.smithi089.stdout:5/488: getdents d1 0 2024-09-13T02:54:01.841 INFO:tasks.workunit.client.0.smithi089.stdout:0/384: mkdir d2/d19/d1a/d3d/d4b/d4f/d59/d6b/d87 0 2024-09-13T02:54:01.843 INFO:tasks.workunit.client.0.smithi089.stdout:9/441: truncate d3/f58 3263248 0 2024-09-13T02:54:01.843 INFO:tasks.workunit.client.0.smithi089.stdout:4/550: getdents d2/d3/d86 0 2024-09-13T02:54:01.844 INFO:tasks.workunit.client.0.smithi089.stdout:4/551: readlink d2/d3/d5/l3c 0 2024-09-13T02:54:01.844 INFO:tasks.workunit.client.0.smithi089.stdout:7/558: dread d3/d19/d2e/f33 [0,4194304] 0 2024-09-13T02:54:01.844 INFO:tasks.workunit.client.0.smithi089.stdout:5/489: link d1/d4/d45/d6f/d4d/d7f/c2a d1/d4/d45/c9b 0 2024-09-13T02:54:01.845 INFO:tasks.workunit.client.0.smithi089.stdout:0/385: read d2/f17 [1509040,43132] 0 2024-09-13T02:54:01.845 INFO:tasks.workunit.client.0.smithi089.stdout:8/522: sync 2024-09-13T02:54:01.845 INFO:tasks.workunit.client.0.smithi089.stdout:1/431: sync 2024-09-13T02:54:01.845 INFO:tasks.workunit.client.0.smithi089.stdout:2/466: sync 2024-09-13T02:54:01.848 INFO:tasks.workunit.client.0.smithi089.stdout:9/442: rename d3/d6/df/d24/d6c to d3/d3d/d8b 0 2024-09-13T02:54:01.848 INFO:tasks.workunit.client.0.smithi089.stdout:5/490: symlink d1/d4/d45/d6f/d7c/l9c 0 2024-09-13T02:54:01.848 INFO:tasks.workunit.client.0.smithi089.stdout:5/491: stat d1/d4/d2b/l4e 0 2024-09-13T02:54:01.848 INFO:tasks.workunit.client.0.smithi089.stdout:5/492: dread - d1/d4/d45/d6f/f61 zero size 2024-09-13T02:54:01.849 INFO:tasks.workunit.client.0.smithi089.stdout:2/467: creat d13/d30/d64/f9e x:0 0 0 2024-09-13T02:54:01.849 INFO:tasks.workunit.client.0.smithi089.stdout:1/432: creat dc/d44/d73/d85/f88 x:0 0 0 2024-09-13T02:54:01.850 INFO:tasks.workunit.client.0.smithi089.stdout:8/523: creat de/d16/d1e/d27/d35/d91/fab x:0 0 0 2024-09-13T02:54:01.853 INFO:tasks.workunit.client.0.smithi089.stdout:3/462: sync 2024-09-13T02:54:01.853 INFO:tasks.workunit.client.0.smithi089.stdout:3/463: chown d2/d20/d23/d32 97 1 2024-09-13T02:54:01.853 INFO:tasks.workunit.client.0.smithi089.stdout:3/464: write d2/d20/d23/f73 [5080541,74170] 0 2024-09-13T02:54:01.853 INFO:tasks.workunit.client.0.smithi089.stdout:3/465: dread - d2/d20/d44/f58 zero size 2024-09-13T02:54:01.853 INFO:tasks.workunit.client.0.smithi089.stdout:3/466: write d2/d20/d23/d27/d51/d6c/f84 [1013293,63661] 0 2024-09-13T02:54:01.853 INFO:tasks.workunit.client.0.smithi089.stdout:2/468: creat d13/d30/d61/d78/d79/f9f x:0 0 0 2024-09-13T02:54:01.853 INFO:tasks.workunit.client.0.smithi089.stdout:2/469: write d13/f72 [340346,127374] 0 2024-09-13T02:54:01.853 INFO:tasks.workunit.client.0.smithi089.stdout:4/552: dread d2/d3/d5/d43/d84/f8a [0,4194304] 0 2024-09-13T02:54:01.854 INFO:tasks.workunit.client.0.smithi089.stdout:4/553: readlink d2/d55/l96 0 2024-09-13T02:54:01.854 INFO:tasks.workunit.client.0.smithi089.stdout:1/433: rename dc/d3a/d53/d2c/d36/f3d to dc/d46/f89 0 2024-09-13T02:54:01.854 INFO:tasks.workunit.client.0.smithi089.stdout:1/434: chown dc/d46/f79 147 1 2024-09-13T02:54:01.854 INFO:tasks.workunit.client.0.smithi089.stdout:1/435: read dc/f82 [1330821,36597] 0 2024-09-13T02:54:01.854 INFO:tasks.workunit.client.0.smithi089.stdout:7/559: dread d3/d19/d2e/f33 [0,4194304] 0 2024-09-13T02:54:01.855 INFO:tasks.workunit.client.0.smithi089.stdout:7/560: write d3/d19/d67/f7b [40559,108971] 0 2024-09-13T02:54:01.855 INFO:tasks.workunit.client.0.smithi089.stdout:8/524: mkdir de/d16/d1e/d20/da8/dac 0 2024-09-13T02:54:01.859 INFO:tasks.workunit.client.0.smithi089.stdout:9/443: dread d3/d6/f73 [0,4194304] 0 2024-09-13T02:54:01.860 INFO:tasks.workunit.client.0.smithi089.stdout:6/474: dwrite db/d43/d6e/d28/d46/d7e/f96 [0,4194304] 0 2024-09-13T02:54:01.861 INFO:tasks.workunit.client.0.smithi089.stdout:6/475: chown db/d43/d6e/d28/d37/f92 7474 1 2024-09-13T02:54:01.861 INFO:tasks.workunit.client.0.smithi089.stdout:3/467: symlink d2/d8/dc/l8e 0 2024-09-13T02:54:01.861 INFO:tasks.workunit.client.0.smithi089.stdout:2/470: mknod d13/d30/d4e/d7b/ca0 0 2024-09-13T02:54:01.862 INFO:tasks.workunit.client.0.smithi089.stdout:4/554: mkdir d2/d22/da1/d62/d6c/d88/db2 0 2024-09-13T02:54:01.862 INFO:tasks.workunit.client.0.smithi089.stdout:4/555: write d2/d3/d5/f2e [1353014,93318] 0 2024-09-13T02:54:01.865 INFO:tasks.workunit.client.0.smithi089.stdout:6/476: link db/d43/d6e/f68 db/d10/d3a/fa5 0 2024-09-13T02:54:01.866 INFO:tasks.workunit.client.0.smithi089.stdout:6/477: write db/d10/d3a/f47 [2736630,22431] 0 2024-09-13T02:54:01.867 INFO:tasks.workunit.client.0.smithi089.stdout:4/556: symlink d2/d22/lb3 0 2024-09-13T02:54:01.867 INFO:tasks.workunit.client.0.smithi089.stdout:4/557: fsync d2/d3/d5/d43/d3b/d71/f81 0 2024-09-13T02:54:01.868 INFO:tasks.workunit.client.0.smithi089.stdout:9/444: rename d3/d6/d2a/d4b/f59 to d3/d6/df/f8c 0 2024-09-13T02:54:01.869 INFO:tasks.workunit.client.0.smithi089.stdout:3/468: getdents d2/d20/d44 0 2024-09-13T02:54:01.870 INFO:tasks.workunit.client.0.smithi089.stdout:4/558: creat d2/d3/d5/d43/d3b/d71/d78/d9c/fb4 x:0 0 0 2024-09-13T02:54:01.870 INFO:tasks.workunit.client.0.smithi089.stdout:3/469: write d2/d20/d23/d27/f4e [827099,31067] 0 2024-09-13T02:54:01.872 INFO:tasks.workunit.client.0.smithi089.stdout:9/445: rename d3/d6/d2a/d4b/d77/d87 to d3/d15/d8d 0 2024-09-13T02:54:01.880 INFO:tasks.workunit.client.0.smithi089.stdout:0/386: dwrite d2/f48 [0,4194304] 0 2024-09-13T02:54:01.887 INFO:tasks.workunit.client.0.smithi089.stdout:5/493: dwrite d1/d4/d45/d6f/d4d/f58 [0,4194304] 0 2024-09-13T02:54:01.890 INFO:tasks.workunit.client.0.smithi089.stdout:5/494: mkdir d1/d4/d45/d6f/d4d/d9d 0 2024-09-13T02:54:01.890 INFO:tasks.workunit.client.0.smithi089.stdout:2/471: dwrite d13/d30/d59/f7e [0,4194304] 0 2024-09-13T02:54:01.892 INFO:tasks.workunit.client.0.smithi089.stdout:5/495: dread d1/d7/f30 [0,4194304] 0 2024-09-13T02:54:01.893 INFO:tasks.workunit.client.0.smithi089.stdout:2/472: truncate d13/d30/f2b 2419895 0 2024-09-13T02:54:01.893 INFO:tasks.workunit.client.0.smithi089.stdout:2/473: write d13/d30/d59/f5a [3177870,28231] 0 2024-09-13T02:54:01.893 INFO:tasks.workunit.client.0.smithi089.stdout:2/474: chown d13/l34 948 1 2024-09-13T02:54:01.895 INFO:tasks.workunit.client.0.smithi089.stdout:2/475: symlink d13/d30/d61/d78/d79/d7c/la1 0 2024-09-13T02:54:01.897 INFO:tasks.workunit.client.0.smithi089.stdout:2/476: mknod d13/ca2 0 2024-09-13T02:54:01.897 INFO:tasks.workunit.client.0.smithi089.stdout:2/477: write d13/d30/d64/f9e [704458,105617] 0 2024-09-13T02:54:01.897 INFO:tasks.workunit.client.0.smithi089.stdout:2/478: chown d13/d30/f2b 1899794523 1 2024-09-13T02:54:01.897 INFO:tasks.workunit.client.0.smithi089.stdout:2/479: symlink d13/d30/d4e/d6f/d76/la3 0 2024-09-13T02:54:01.897 INFO:tasks.workunit.client.0.smithi089.stdout:5/496: write d1/f26 [928330,44243] 0 2024-09-13T02:54:01.898 INFO:tasks.workunit.client.0.smithi089.stdout:2/480: getdents d13/d30/d61 0 2024-09-13T02:54:01.903 INFO:tasks.workunit.client.0.smithi089.stdout:6/478: dwrite db/d10/d3a/d7b/f7c [0,4194304] 0 2024-09-13T02:54:01.903 INFO:tasks.workunit.client.0.smithi089.stdout:6/479: chown db/d10/d3a/f84 0 1 2024-09-13T02:54:01.906 INFO:tasks.workunit.client.0.smithi089.stdout:3/470: dwrite d2/d8/dc/f2c [0,4194304] 0 2024-09-13T02:54:01.907 INFO:tasks.workunit.client.0.smithi089.stdout:3/471: stat d2/d8/dc/d57/c66 0 2024-09-13T02:54:01.907 INFO:tasks.workunit.client.0.smithi089.stdout:4/559: dwrite d2/d22/f7f [0,4194304] 0 2024-09-13T02:54:01.907 INFO:tasks.workunit.client.0.smithi089.stdout:0/387: dwrite d2/f35 [0,4194304] 0 2024-09-13T02:54:01.909 INFO:tasks.workunit.client.0.smithi089.stdout:9/446: rmdir d3/d15/d8d 0 2024-09-13T02:54:01.909 INFO:tasks.workunit.client.0.smithi089.stdout:9/447: fdatasync d3/d6/df/d24/d35/f7f 0 2024-09-13T02:54:01.909 INFO:tasks.workunit.client.0.smithi089.stdout:9/448: chown d3/d6/f65 2288 1 2024-09-13T02:54:01.909 INFO:tasks.workunit.client.0.smithi089.stdout:9/449: fsync d3/d6/d2a/f4f 0 2024-09-13T02:54:01.910 INFO:tasks.workunit.client.0.smithi089.stdout:3/472: write d2/d20/d23/d27/d51/d6c/f84 [822411,70909] 0 2024-09-13T02:54:01.910 INFO:tasks.workunit.client.0.smithi089.stdout:9/450: dread d3/d6/df/d24/f69 [0,4194304] 0 2024-09-13T02:54:01.912 INFO:tasks.workunit.client.0.smithi089.stdout:4/560: unlink d2/d3/d5/d49/c39 0 2024-09-13T02:54:01.912 INFO:tasks.workunit.client.0.smithi089.stdout:4/561: dread - d2/d22/da1/d62/f68 zero size 2024-09-13T02:54:01.913 INFO:tasks.workunit.client.0.smithi089.stdout:3/473: unlink d2/d20/d23/d27/d51/d6c/c74 0 2024-09-13T02:54:01.914 INFO:tasks.workunit.client.0.smithi089.stdout:3/474: write d2/d8/dc/d3c/d65/f87 [351671,90363] 0 2024-09-13T02:54:01.915 INFO:tasks.workunit.client.0.smithi089.stdout:9/451: mknod d3/d6/d2a/d4b/c8e 0 2024-09-13T02:54:01.916 INFO:tasks.workunit.client.0.smithi089.stdout:4/562: mkdir d2/d3/d5/d43/d3b/d71/d78/db5 0 2024-09-13T02:54:01.917 INFO:tasks.workunit.client.0.smithi089.stdout:9/452: truncate d3/d6/df/d24/d29/f52 2521298 0 2024-09-13T02:54:01.919 INFO:tasks.workunit.client.0.smithi089.stdout:9/453: symlink d3/l8f 0 2024-09-13T02:54:01.922 INFO:tasks.workunit.client.0.smithi089.stdout:0/388: write d2/d19/d1a/d1e/d42/f49 [690922,111925] 0 2024-09-13T02:54:01.924 INFO:tasks.workunit.client.0.smithi089.stdout:0/389: mknod d2/d19/d1a/d3d/d4b/d4f/d59/d6b/c88 0 2024-09-13T02:54:01.925 INFO:tasks.workunit.client.0.smithi089.stdout:0/390: getdents d2/d19/d1a/d3d/d4b 0 2024-09-13T02:54:01.929 INFO:tasks.workunit.client.0.smithi089.stdout:0/391: truncate d2/f14 2451505 0 2024-09-13T02:54:01.932 INFO:tasks.workunit.client.0.smithi089.stdout:5/497: dwrite d1/d7/f68 [0,4194304] 0 2024-09-13T02:54:01.932 INFO:tasks.workunit.client.0.smithi089.stdout:5/498: creat d1/d4/d45/d6f/d4d/d7f/d49/d5a/f9e x:0 0 0 2024-09-13T02:54:01.932 INFO:tasks.workunit.client.0.smithi089.stdout:5/499: write d1/d4/d45/d6f/f61 [28098,5813] 0 2024-09-13T02:54:01.932 INFO:tasks.workunit.client.0.smithi089.stdout:5/500: write d1/d4/d45/d6f/d4d/f7e [329887,121224] 0 2024-09-13T02:54:01.933 INFO:tasks.workunit.client.0.smithi089.stdout:2/481: dwrite d13/d30/f4a [0,4194304] 0 2024-09-13T02:54:01.933 INFO:tasks.workunit.client.0.smithi089.stdout:6/480: dwrite db/d10/d3a/fa5 [0,4194304] 0 2024-09-13T02:54:01.933 INFO:tasks.workunit.client.0.smithi089.stdout:0/392: rename d2/l15 to d2/d19/d1a/d3d/d4b/d4f/d59/d6b/l89 0 2024-09-13T02:54:01.933 INFO:tasks.workunit.client.0.smithi089.stdout:0/393: chown d2/d19/d1a/d1e/d42 534 1 2024-09-13T02:54:01.940 INFO:tasks.workunit.client.0.smithi089.stdout:2/482: mknod d13/d30/d61/d78/d79/ca4 0 2024-09-13T02:54:01.941 INFO:tasks.workunit.client.0.smithi089.stdout:9/454: dwrite d3/d4c/f86 [0,4194304] 0 2024-09-13T02:54:01.943 INFO:tasks.workunit.client.0.smithi089.stdout:6/481: creat db/d43/d6e/d28/d2f/d9b/fa6 x:0 0 0 2024-09-13T02:54:01.945 INFO:tasks.workunit.client.0.smithi089.stdout:4/563: getdents d2/d3/d5/d49 0 2024-09-13T02:54:01.945 INFO:tasks.workunit.client.0.smithi089.stdout:4/564: chown d2/d3/f25 2138 1 2024-09-13T02:54:01.945 INFO:tasks.workunit.client.0.smithi089.stdout:4/565: chown d2/d22/da1/d62/d6c/d88/f98 13 1 2024-09-13T02:54:01.953 INFO:tasks.workunit.client.0.smithi089.stdout:9/455: dread d3/d4c/f86 [0,4194304] 0 2024-09-13T02:54:01.954 INFO:tasks.workunit.client.0.smithi089.stdout:9/456: fsync d3/d6/df/d24/f69 0 2024-09-13T02:54:01.955 INFO:tasks.workunit.client.0.smithi089.stdout:6/482: read db/d43/d6e/d28/d37/f52 [1717724,43488] 0 2024-09-13T02:54:01.955 INFO:tasks.workunit.client.0.smithi089.stdout:4/566: symlink d2/d3/d5/d43/lb6 0 2024-09-13T02:54:01.955 INFO:tasks.workunit.client.0.smithi089.stdout:6/483: creat db/d43/d6e/d28/d46/d53/fa7 x:0 0 0 2024-09-13T02:54:01.956 INFO:tasks.workunit.client.0.smithi089.stdout:2/483: write d13/f8c [1168545,16039] 0 2024-09-13T02:54:01.962 INFO:tasks.workunit.client.0.smithi089.stdout:5/501: dwrite d1/d4/d2b/f52 [0,4194304] 0 2024-09-13T02:54:01.962 INFO:tasks.workunit.client.0.smithi089.stdout:5/502: truncate d1/d4/d45/d6f/d4d/f7a 451449 0 2024-09-13T02:54:01.963 INFO:tasks.workunit.client.0.smithi089.stdout:0/394: dwrite d2/f3a [0,4194304] 0 2024-09-13T02:54:01.963 INFO:tasks.workunit.client.0.smithi089.stdout:0/395: dread - d2/d19/d1a/d3d/d4b/d4f/f6d zero size 2024-09-13T02:54:01.963 INFO:tasks.workunit.client.0.smithi089.stdout:0/396: truncate d2/d19/d1a/d1e/d42/f74 991121 0 2024-09-13T02:54:01.964 INFO:tasks.workunit.client.0.smithi089.stdout:5/503: unlink d1/d4/d45/d6f/d4d/d7f/d49/c54 0 2024-09-13T02:54:01.965 INFO:tasks.workunit.client.0.smithi089.stdout:9/457: dread d3/d6/f14 [0,4194304] 0 2024-09-13T02:54:01.967 INFO:tasks.workunit.client.0.smithi089.stdout:2/484: dread d13/f1a [0,4194304] 0 2024-09-13T02:54:01.968 INFO:tasks.workunit.client.0.smithi089.stdout:4/567: dread d2/da/f13 [0,4194304] 0 2024-09-13T02:54:01.969 INFO:tasks.workunit.client.0.smithi089.stdout:0/397: mknod d2/d19/d1a/d3d/d4b/d4f/d59/c8a 0 2024-09-13T02:54:01.969 INFO:tasks.workunit.client.0.smithi089.stdout:0/398: creat d2/d19/d1a/d1e/d42/f8b x:0 0 0 2024-09-13T02:54:01.971 INFO:tasks.workunit.client.0.smithi089.stdout:5/504: mknod d1/d4/d45/d6f/d4d/c9f 0 2024-09-13T02:54:01.972 INFO:tasks.workunit.client.0.smithi089.stdout:5/505: fsync d1/d4/d45/d6f/d62/f79 0 2024-09-13T02:54:01.972 INFO:tasks.workunit.client.0.smithi089.stdout:5/506: chown d1/d4/f25 529458203 1 2024-09-13T02:54:01.972 INFO:tasks.workunit.client.0.smithi089.stdout:5/507: creat d1/d4/d45/d8c/fa0 x:0 0 0 2024-09-13T02:54:01.972 INFO:tasks.workunit.client.0.smithi089.stdout:5/508: truncate d1/d4/d45/d6f/d4d/d7f/d49/f6b 4619600 0 2024-09-13T02:54:01.973 INFO:tasks.workunit.client.0.smithi089.stdout:2/485: symlink d13/d30/d61/la5 0 2024-09-13T02:54:01.973 INFO:tasks.workunit.client.0.smithi089.stdout:2/486: chown d13/l6c 393384 1 2024-09-13T02:54:01.973 INFO:tasks.workunit.client.0.smithi089.stdout:2/487: write d13/d30/d64/f6e [3486935,41001] 0 2024-09-13T02:54:01.973 INFO:tasks.workunit.client.0.smithi089.stdout:4/568: rmdir d2/d22/da1/d62 39 2024-09-13T02:54:01.973 INFO:tasks.workunit.client.0.smithi089.stdout:0/399: link d2/d19/d1a/d1e/f31 d2/d19/d1a/f8c 0 2024-09-13T02:54:01.973 INFO:tasks.workunit.client.0.smithi089.stdout:0/400: readlink d2/d19/d1a/d3d/d4b/l60 0 2024-09-13T02:54:01.973 INFO:tasks.workunit.client.0.smithi089.stdout:0/401: dread - d2/d19/d1a/d63/f83 zero size 2024-09-13T02:54:01.974 INFO:tasks.workunit.client.0.smithi089.stdout:5/509: mknod d1/d4/d45/d8c/d98/ca1 0 2024-09-13T02:54:01.975 INFO:tasks.workunit.client.0.smithi089.stdout:6/484: dwrite db/d10/f4f [0,4194304] 0 2024-09-13T02:54:01.975 INFO:tasks.workunit.client.0.smithi089.stdout:6/485: write db/d43/d6e/d28/d37/f52 [2374883,99161] 0 2024-09-13T02:54:01.976 INFO:tasks.workunit.client.0.smithi089.stdout:2/488: mknod d13/d30/d61/d78/d79/d7c/ca6 0 2024-09-13T02:54:01.976 INFO:tasks.workunit.client.0.smithi089.stdout:2/489: chown d13/f27 1943 1 2024-09-13T02:54:01.976 INFO:tasks.workunit.client.0.smithi089.stdout:2/490: getdents d13/d30/d61/d78/d79/d90 0 2024-09-13T02:54:01.977 INFO:tasks.workunit.client.0.smithi089.stdout:0/402: mknod d2/d19/d1a/d3d/d4b/d4f/d59/d6b/d87/c8d 0 2024-09-13T02:54:01.977 INFO:tasks.workunit.client.0.smithi089.stdout:0/403: chown d2/d19/d1a/d3d/d4b/d4f/f5c 120235 1 2024-09-13T02:54:01.979 INFO:tasks.workunit.client.0.smithi089.stdout:5/510: link d1/d4/d2b/l4e d1/d4/d45/d6f/d4d/d9d/la2 0 2024-09-13T02:54:01.981 INFO:tasks.workunit.client.0.smithi089.stdout:7/561: sync 2024-09-13T02:54:01.981 INFO:tasks.workunit.client.0.smithi089.stdout:8/525: sync 2024-09-13T02:54:01.982 INFO:tasks.workunit.client.0.smithi089.stdout:1/436: sync 2024-09-13T02:54:01.982 INFO:tasks.workunit.client.0.smithi089.stdout:1/437: write dc/d44/f62 [1747198,17050] 0 2024-09-13T02:54:01.982 INFO:tasks.workunit.client.0.smithi089.stdout:9/458: read d3/d6/df/f38 [3175309,127033] 0 2024-09-13T02:54:01.982 INFO:tasks.workunit.client.0.smithi089.stdout:9/459: chown d3/d15/l19 13 1 2024-09-13T02:54:01.983 INFO:tasks.workunit.client.0.smithi089.stdout:4/569: rename d2/da/c14 to d2/cb7 0 2024-09-13T02:54:01.983 INFO:tasks.workunit.client.0.smithi089.stdout:4/570: truncate d2/d3/d5/d49/fac 1026915 0 2024-09-13T02:54:01.983 INFO:tasks.workunit.client.0.smithi089.stdout:8/526: dread de/d16/d1e/f83 [0,4194304] 0 2024-09-13T02:54:01.983 INFO:tasks.workunit.client.0.smithi089.stdout:4/571: dread - d2/d3/d5/fa8 zero size 2024-09-13T02:54:01.983 INFO:tasks.workunit.client.0.smithi089.stdout:4/572: readlink d2/d3/l66 0 2024-09-13T02:54:01.983 INFO:tasks.workunit.client.0.smithi089.stdout:8/527: chown de/d16/d1e/d27/d76/d8d/fa0 243243 1 2024-09-13T02:54:01.983 INFO:tasks.workunit.client.0.smithi089.stdout:8/528: readlink de/d16/d1e/d27/d76/l9d 0 2024-09-13T02:54:01.983 INFO:tasks.workunit.client.0.smithi089.stdout:2/491: mkdir d13/d30/d4e/d7b/d86/da7 0 2024-09-13T02:54:01.984 INFO:tasks.workunit.client.0.smithi089.stdout:7/562: mknod d3/d44/caf 0 2024-09-13T02:54:01.984 INFO:tasks.workunit.client.0.smithi089.stdout:9/460: symlink d3/d15/l90 0 2024-09-13T02:54:01.984 INFO:tasks.workunit.client.0.smithi089.stdout:9/461: fdatasync d3/d6/d2a/f4f 0 2024-09-13T02:54:01.985 INFO:tasks.workunit.client.0.smithi089.stdout:4/573: symlink d2/d3/lb8 0 2024-09-13T02:54:01.985 INFO:tasks.workunit.client.0.smithi089.stdout:8/529: symlink de/d16/d1e/d20/d6c/d6e/lad 0 2024-09-13T02:54:01.985 INFO:tasks.workunit.client.0.smithi089.stdout:8/530: write de/d16/d1e/d27/d52/f6b [543176,78329] 0 2024-09-13T02:54:01.986 INFO:tasks.workunit.client.0.smithi089.stdout:8/531: truncate de/d16/d1e/f83 1138209 0 2024-09-13T02:54:01.986 INFO:tasks.workunit.client.0.smithi089.stdout:8/532: chown de/d16/f86 43988 1 2024-09-13T02:54:01.986 INFO:tasks.workunit.client.0.smithi089.stdout:2/492: rmdir d13/d30/d61/d78 39 2024-09-13T02:54:01.986 INFO:tasks.workunit.client.0.smithi089.stdout:7/563: mkdir d3/d19/d75/d14/da0/db0 0 2024-09-13T02:54:01.986 INFO:tasks.workunit.client.0.smithi089.stdout:9/462: truncate d3/d6/d2a/d4b/d6d/f82 1318168 0 2024-09-13T02:54:01.987 INFO:tasks.workunit.client.0.smithi089.stdout:9/463: chown d3/d6/d2a/c76 696492 1 2024-09-13T02:54:01.987 INFO:tasks.workunit.client.0.smithi089.stdout:4/574: mknod d2/d22/da1/d62/cb9 0 2024-09-13T02:54:01.987 INFO:tasks.workunit.client.0.smithi089.stdout:4/575: chown d2/d3/d5/l3e 88140419 1 2024-09-13T02:54:01.987 INFO:tasks.workunit.client.0.smithi089.stdout:8/533: rmdir de/d16 39 2024-09-13T02:54:01.989 INFO:tasks.workunit.client.0.smithi089.stdout:7/564: getdents d3/d19/d2e/d68 0 2024-09-13T02:54:01.989 INFO:tasks.workunit.client.0.smithi089.stdout:7/565: readlink d3/d19/d75/d14/d71/l92 0 2024-09-13T02:54:01.989 INFO:tasks.workunit.client.0.smithi089.stdout:7/566: creat d3/d44/d85/d5e/fb1 x:0 0 0 2024-09-13T02:54:01.989 INFO:tasks.workunit.client.0.smithi089.stdout:5/511: read d1/d4/d45/d6f/f39 [4097782,84202] 0 2024-09-13T02:54:01.989 INFO:tasks.workunit.client.0.smithi089.stdout:5/512: fsync d1/d4/d45/d6f/f39 0 2024-09-13T02:54:01.989 INFO:tasks.workunit.client.0.smithi089.stdout:5/513: creat d1/d4/d45/d6f/d4d/d7f/d49/d5a/fa3 x:0 0 0 2024-09-13T02:54:01.989 INFO:tasks.workunit.client.0.smithi089.stdout:5/514: chown d1/d7/f19 232775732 1 2024-09-13T02:54:01.989 INFO:tasks.workunit.client.0.smithi089.stdout:5/515: fdatasync d1/d4/d45/d6f/d4d/f71 0 2024-09-13T02:54:01.989 INFO:tasks.workunit.client.0.smithi089.stdout:5/516: truncate d1/d4/d45/d6f/f88 343879 0 2024-09-13T02:54:01.989 INFO:tasks.workunit.client.0.smithi089.stdout:9/464: stat d3/d6/l5d 0 2024-09-13T02:54:01.990 INFO:tasks.workunit.client.0.smithi089.stdout:8/534: creat de/d16/d1e/d3f/fae x:0 0 0 2024-09-13T02:54:01.990 INFO:tasks.workunit.client.0.smithi089.stdout:7/567: mkdir d3/d19/d75/db2 0 2024-09-13T02:54:01.993 INFO:tasks.workunit.client.0.smithi089.stdout:5/517: creat d1/d4/d45/d6f/d4d/d7f/d49/fa4 x:0 0 0 2024-09-13T02:54:01.993 INFO:tasks.workunit.client.0.smithi089.stdout:5/518: fsync d1/d4/d45/d6f/d4d/f71 0 2024-09-13T02:54:01.994 INFO:tasks.workunit.client.0.smithi089.stdout:2/493: write d13/d30/f2b [229585,105022] 0 2024-09-13T02:54:01.995 INFO:tasks.workunit.client.0.smithi089.stdout:9/465: unlink d3/d6/d2a/d4b/c8e 0 2024-09-13T02:54:01.995 INFO:tasks.workunit.client.0.smithi089.stdout:5/519: symlink d1/d4/d45/d6f/d4d/d7f/la5 0 2024-09-13T02:54:01.996 INFO:tasks.workunit.client.0.smithi089.stdout:2/494: mknod d13/d30/d4e/d6f/d76/ca8 0 2024-09-13T02:54:01.996 INFO:tasks.workunit.client.0.smithi089.stdout:2/495: readlink d13/d30/d59/l94 0 2024-09-13T02:54:01.997 INFO:tasks.workunit.client.0.smithi089.stdout:9/466: mkdir d3/d4c/d91 0 2024-09-13T02:54:01.997 INFO:tasks.workunit.client.0.smithi089.stdout:7/568: dread f0 [0,4194304] 0 2024-09-13T02:54:01.998 INFO:tasks.workunit.client.0.smithi089.stdout:2/496: mkdir d13/da9 0 2024-09-13T02:54:01.998 INFO:tasks.workunit.client.0.smithi089.stdout:2/497: creat d13/d30/d59/faa x:0 0 0 2024-09-13T02:54:01.998 INFO:tasks.workunit.client.0.smithi089.stdout:2/498: chown d13/l34 18 1 2024-09-13T02:54:01.998 INFO:tasks.workunit.client.0.smithi089.stdout:2/499: truncate d13/d30/d4e/d6f/f84 993893 0 2024-09-13T02:54:01.998 INFO:tasks.workunit.client.0.smithi089.stdout:2/500: creat d13/fab x:0 0 0 2024-09-13T02:54:01.999 INFO:tasks.workunit.client.0.smithi089.stdout:2/501: creat d13/d30/d4e/d6f/fac x:0 0 0 2024-09-13T02:54:01.999 INFO:tasks.workunit.client.0.smithi089.stdout:2/502: fdatasync d13/f50 0 2024-09-13T02:54:02.001 INFO:tasks.workunit.client.0.smithi089.stdout:7/569: creat d3/fb3 x:0 0 0 2024-09-13T02:54:02.001 INFO:tasks.workunit.client.0.smithi089.stdout:7/570: chown d3/d44/d85/d5e/d6f/fa3 147140 1 2024-09-13T02:54:02.002 INFO:tasks.workunit.client.0.smithi089.stdout:7/571: rmdir d3/d19/d75/d14/d71 39 2024-09-13T02:54:02.002 INFO:tasks.workunit.client.0.smithi089.stdout:7/572: chown d3/d44/d85/c72 794792056 1 2024-09-13T02:54:02.003 INFO:tasks.workunit.client.0.smithi089.stdout:7/573: chown d3/d19/d2e 6542893 1 2024-09-13T02:54:02.003 INFO:tasks.workunit.client.0.smithi089.stdout:6/486: dwrite db/d10/f1f [0,4194304] 0 2024-09-13T02:54:02.005 INFO:tasks.workunit.client.0.smithi089.stdout:7/574: write d3/d19/f4d [1022171,119551] 0 2024-09-13T02:54:02.005 INFO:tasks.workunit.client.0.smithi089.stdout:7/575: fsync d3/d44/d85/d5e/d6f/fae 0 2024-09-13T02:54:02.005 INFO:tasks.workunit.client.0.smithi089.stdout:6/487: unlink db/d10/d3a/f5e 0 2024-09-13T02:54:02.005 INFO:tasks.workunit.client.0.smithi089.stdout:6/488: dread - db/d43/d6e/d28/d46/d53/fa7 zero size 2024-09-13T02:54:02.006 INFO:tasks.workunit.client.0.smithi089.stdout:8/535: write de/d16/d1e/d27/d52/d61/f94 [3125026,125518] 0 2024-09-13T02:54:02.009 INFO:tasks.workunit.client.0.smithi089.stdout:7/576: mkdir d3/d19/d75/d63/da1/db4 0 2024-09-13T02:54:02.015 INFO:tasks.workunit.client.0.smithi089.stdout:7/577: rename d3/d19/d75/d14/f1c to d3/d19/d75/d14/fb5 0 2024-09-13T02:54:02.017 INFO:tasks.workunit.client.0.smithi089.stdout:7/578: mknod d3/d20/cb6 0 2024-09-13T02:54:02.017 INFO:tasks.workunit.client.0.smithi089.stdout:0/404: dwrite d2/d19/d1a/d3d/d4b/d4f/d59/d6b/f6f [0,4194304] 0 2024-09-13T02:54:02.018 INFO:tasks.workunit.client.0.smithi089.stdout:0/405: write d2/d19/f1c [649771,104348] 0 2024-09-13T02:54:02.018 INFO:tasks.workunit.client.0.smithi089.stdout:1/438: dwrite f3 [0,4194304] 0 2024-09-13T02:54:02.019 INFO:tasks.workunit.client.0.smithi089.stdout:8/536: dread f0 [0,4194304] 0 2024-09-13T02:54:02.019 INFO:tasks.workunit.client.0.smithi089.stdout:8/537: chown de/d16/d1e/c88 30 1 2024-09-13T02:54:02.019 INFO:tasks.workunit.client.0.smithi089.stdout:8/538: creat de/faf x:0 0 0 2024-09-13T02:54:02.019 INFO:tasks.workunit.client.0.smithi089.stdout:8/539: fdatasync de/d16/d1e/d27/d35/d91/fab 0 2024-09-13T02:54:02.019 INFO:tasks.workunit.client.0.smithi089.stdout:1/439: write dc/d46/d6c/f71 [201727,42704] 0 2024-09-13T02:54:02.019 INFO:tasks.workunit.client.0.smithi089.stdout:1/440: stat dc/d44/l65 0 2024-09-13T02:54:02.021 INFO:tasks.workunit.client.0.smithi089.stdout:7/579: creat d3/d19/d75/d63/fb7 x:0 0 0 2024-09-13T02:54:02.022 INFO:tasks.workunit.client.0.smithi089.stdout:3/475: sync 2024-09-13T02:54:02.022 INFO:tasks.workunit.client.0.smithi089.stdout:3/476: truncate d2/d20/d23/f73 5481322 0 2024-09-13T02:54:02.022 INFO:tasks.workunit.client.0.smithi089.stdout:0/406: symlink d2/d19/d1a/d4e/l8e 0 2024-09-13T02:54:02.023 INFO:tasks.workunit.client.0.smithi089.stdout:0/407: creat d2/d19/d1a/f8f x:0 0 0 2024-09-13T02:54:02.025 INFO:tasks.workunit.client.0.smithi089.stdout:8/540: rename de/f40 to de/d16/d1e/d27/d52/fb0 0 2024-09-13T02:54:02.025 INFO:tasks.workunit.client.0.smithi089.stdout:8/541: chown f9 29969 1 2024-09-13T02:54:02.025 INFO:tasks.workunit.client.0.smithi089.stdout:8/542: chown de/d16/d1e/d3f/d71/c93 830762 1 2024-09-13T02:54:02.025 INFO:tasks.workunit.client.0.smithi089.stdout:1/441: mknod dc/d46/d6c/c8a 0 2024-09-13T02:54:02.026 INFO:tasks.workunit.client.0.smithi089.stdout:1/442: chown dc/d3a/d53/d2c/c31 151797094 1 2024-09-13T02:54:02.026 INFO:tasks.workunit.client.0.smithi089.stdout:7/580: symlink d3/d19/d75/d14/d71/lb8 0 2024-09-13T02:54:02.027 INFO:tasks.workunit.client.0.smithi089.stdout:7/581: write d3/d19/d75/d14/fb5 [2781923,20291] 0 2024-09-13T02:54:02.034 INFO:tasks.workunit.client.0.smithi089.stdout:1/443: mkdir dc/d3a/d53/d2c/d34/d8b 0 2024-09-13T02:54:02.034 INFO:tasks.workunit.client.0.smithi089.stdout:1/444: dread - dc/d46/f79 zero size 2024-09-13T02:54:02.034 INFO:tasks.workunit.client.0.smithi089.stdout:1/445: creat dc/d44/f8c x:0 0 0 2024-09-13T02:54:02.034 INFO:tasks.workunit.client.0.smithi089.stdout:1/446: stat dc/d44/f62 0 2024-09-13T02:54:02.036 INFO:tasks.workunit.client.0.smithi089.stdout:5/520: dwrite d1/d4/d45/d6f/d62/f8a [0,4194304] 0 2024-09-13T02:54:02.036 INFO:tasks.workunit.client.0.smithi089.stdout:5/521: truncate d1/d4/d45/d6f/d4d/d7f/d49/d5a/fa3 49129 0 2024-09-13T02:54:02.036 INFO:tasks.workunit.client.0.smithi089.stdout:5/522: read d1/d7/f30 [3599659,67275] 0 2024-09-13T02:54:02.036 INFO:tasks.workunit.client.0.smithi089.stdout:5/523: write d1/d4/d45/d8c/fa0 [959036,118431] 0 2024-09-13T02:54:02.036 INFO:tasks.workunit.client.0.smithi089.stdout:0/408: read d2/d19/d1a/d3d/d4b/d4f/f5b [3003343,36897] 0 2024-09-13T02:54:02.037 INFO:tasks.workunit.client.0.smithi089.stdout:2/503: dwrite d13/d30/d59/f7e [4194304,4194304] 0 2024-09-13T02:54:02.039 INFO:tasks.workunit.client.0.smithi089.stdout:0/409: link d2/d19/d1a/d3d/d4b/d4f/d59/d6b/f6c d2/d19/d1a/d4e/d7a/f90 0 2024-09-13T02:54:02.039 INFO:tasks.workunit.client.0.smithi089.stdout:0/410: fsync d2/d19/d1a/d3d/d4b/d4f/d59/d6b/f6f 0 2024-09-13T02:54:02.039 INFO:tasks.workunit.client.0.smithi089.stdout:0/411: chown d2/d19/d1a/d4e/d7a 3170568 1 2024-09-13T02:54:02.041 INFO:tasks.workunit.client.0.smithi089.stdout:2/504: rename d13/d30/d59/f5a to d13/d30/d61/d78/d79/d90/fad 0 2024-09-13T02:54:02.041 INFO:tasks.workunit.client.0.smithi089.stdout:9/467: dwrite d3/d6/d2a/f78 [0,4194304] 0 2024-09-13T02:54:02.042 INFO:tasks.workunit.client.0.smithi089.stdout:5/524: getdents d1/d4/d45/d8c 0 2024-09-13T02:54:02.042 INFO:tasks.workunit.client.0.smithi089.stdout:6/489: dwrite db/d10/fa4 [0,4194304] 0 2024-09-13T02:54:02.043 INFO:tasks.workunit.client.0.smithi089.stdout:0/412: getdents d2/d64 0 2024-09-13T02:54:02.043 INFO:tasks.workunit.client.0.smithi089.stdout:0/413: write d2/d19/d1a/d3d/d4b/d4f/f5b [2752045,122276] 0 2024-09-13T02:54:02.044 INFO:tasks.workunit.client.0.smithi089.stdout:3/477: dwrite d2/f16 [4194304,4194304] 0 2024-09-13T02:54:02.045 INFO:tasks.workunit.client.0.smithi089.stdout:5/525: symlink d1/d4/d45/d8c/la6 0 2024-09-13T02:54:02.135 INFO:tasks.workunit.client.0.smithi089.stdout:5/526: read d1/d4/d45/d6f/f39 [2330576,28941] 0 2024-09-13T02:54:02.135 INFO:tasks.workunit.client.0.smithi089.stdout:5/527: creat d1/d4/d45/d6f/d4d/d7f/d49/d5a/fa7 x:0 0 0 2024-09-13T02:54:02.135 INFO:tasks.workunit.client.0.smithi089.stdout:5/528: creat d1/d4/d45/d6f/d62/fa8 x:0 0 0 2024-09-13T02:54:02.143 INFO:tasks.workunit.client.0.smithi089.stdout:6/490: symlink db/d43/d6e/d28/d2f/d9b/la8 0 2024-09-13T02:54:02.143 INFO:tasks.workunit.client.0.smithi089.stdout:6/491: creat db/d43/d6e/d28/d37/d8b/fa9 x:0 0 0 2024-09-13T02:54:02.143 INFO:tasks.workunit.client.0.smithi089.stdout:1/447: dread dc/f1c [4194304,4194304] 0 2024-09-13T02:54:02.143 INFO:tasks.workunit.client.0.smithi089.stdout:1/448: write dc/d3a/d53/f87 [898336,51661] 0 2024-09-13T02:54:02.143 INFO:tasks.workunit.client.0.smithi089.stdout:2/505: dread d13/d30/f2b [0,4194304] 0 2024-09-13T02:54:02.143 INFO:tasks.workunit.client.0.smithi089.stdout:2/506: chown d13/d30/f49 1 1 2024-09-13T02:54:02.143 INFO:tasks.workunit.client.0.smithi089.stdout:2/507: chown d13/d30/f4a 52 1 2024-09-13T02:54:02.143 INFO:tasks.workunit.client.0.smithi089.stdout:2/508: creat d13/d30/d64/fae x:0 0 0 2024-09-13T02:54:02.144 INFO:tasks.workunit.client.0.smithi089.stdout:0/414: chown d2/cf 103151974 1 2024-09-13T02:54:02.144 INFO:tasks.workunit.client.0.smithi089.stdout:3/478: truncate d2/d20/d23/d27/d51/d6c/f7c 547235 0 2024-09-13T02:54:02.144 INFO:tasks.workunit.client.0.smithi089.stdout:5/529: truncate d1/d4/d45/f7b 1062974 0 2024-09-13T02:54:02.144 INFO:tasks.workunit.client.0.smithi089.stdout:5/530: truncate d1/d4/d45/d6f/d4d/d7f/d49/fa4 207511 0 2024-09-13T02:54:02.144 INFO:tasks.workunit.client.0.smithi089.stdout:6/492: creat db/d43/d60/d7d/faa x:0 0 0 2024-09-13T02:54:02.144 INFO:tasks.workunit.client.0.smithi089.stdout:6/493: truncate db/d43/d6e/d28/d2f/f87 901059 0 2024-09-13T02:54:02.144 INFO:tasks.workunit.client.0.smithi089.stdout:1/449: truncate dc/d3a/f5a 848 0 2024-09-13T02:54:02.144 INFO:tasks.workunit.client.0.smithi089.stdout:7/582: dwrite d3/d19/d67/f80 [0,4194304] 0 2024-09-13T02:54:02.144 INFO:tasks.workunit.client.0.smithi089.stdout:2/509: link d13/d30/d4e/c67 d13/d30/d4e/caf 0 2024-09-13T02:54:02.144 INFO:tasks.workunit.client.0.smithi089.stdout:2/510: fsync d13/d30/d61/d78/d79/f85 0 2024-09-13T02:54:02.144 INFO:tasks.workunit.client.0.smithi089.stdout:2/511: fsync d13/d30/d59/f7e 0 2024-09-13T02:54:02.144 INFO:tasks.workunit.client.0.smithi089.stdout:6/494: write db/d10/d3a/f5d [1583892,98956] 0 2024-09-13T02:54:02.145 INFO:tasks.workunit.client.0.smithi089.stdout:1/450: link dc/d3a/d53/d2c/d36/l7c dc/d3a/d53/d2c/d34/d8b/l8d 0 2024-09-13T02:54:02.145 INFO:tasks.workunit.client.0.smithi089.stdout:1/451: chown dc/d44 4522839 1 2024-09-13T02:54:02.145 INFO:tasks.workunit.client.0.smithi089.stdout:2/512: dread d13/f1a [0,4194304] 0 2024-09-13T02:54:02.145 INFO:tasks.workunit.client.0.smithi089.stdout:2/513: fdatasync d13/d30/d4e/f65 0 2024-09-13T02:54:02.145 INFO:tasks.workunit.client.0.smithi089.stdout:6/495: unlink db/d43/d6e/d28/d46/d53/c85 0 2024-09-13T02:54:02.145 INFO:tasks.workunit.client.0.smithi089.stdout:0/415: rmdir d2/d19/d1a/d1e/d42 39 2024-09-13T02:54:02.145 INFO:tasks.workunit.client.0.smithi089.stdout:6/496: creat db/d43/d6e/d28/d46/fab x:0 0 0 2024-09-13T02:54:02.145 INFO:tasks.workunit.client.0.smithi089.stdout:6/497: write db/d43/d6e/d28/d37/f52 [216127,82307] 0 2024-09-13T02:54:02.145 INFO:tasks.workunit.client.0.smithi089.stdout:6/498: chown db/d43/d6e/d28 26344 1 2024-09-13T02:54:02.145 INFO:tasks.workunit.client.0.smithi089.stdout:7/583: dread d3/f5 [4194304,4194304] 0 2024-09-13T02:54:02.145 INFO:tasks.workunit.client.0.smithi089.stdout:7/584: chown d3/d44/d85/d5e/d6f/l91 167777174 1 2024-09-13T02:54:02.145 INFO:tasks.workunit.client.0.smithi089.stdout:7/585: readlink d3/d19/d75/l42 0 2024-09-13T02:54:02.145 INFO:tasks.workunit.client.0.smithi089.stdout:7/586: truncate d3/d20/f32 2985302 0 2024-09-13T02:54:02.146 INFO:tasks.workunit.client.0.smithi089.stdout:7/587: creat d3/d19/d75/d63/d83/fb9 x:0 0 0 2024-09-13T02:54:02.146 INFO:tasks.workunit.client.0.smithi089.stdout:7/588: getdents d3/d19/d75/d63 0 2024-09-13T02:54:02.146 INFO:tasks.workunit.client.0.smithi089.stdout:9/468: dwrite d3/d15/f49 [0,4194304] 0 2024-09-13T02:54:02.146 INFO:tasks.workunit.client.0.smithi089.stdout:8/543: dwrite de/d16/d1e/d27/d52/d61/f94 [4194304,4194304] 0 2024-09-13T02:54:02.146 INFO:tasks.workunit.client.0.smithi089.stdout:9/469: symlink d3/d6/df/d24/d32/l92 0 2024-09-13T02:54:02.146 INFO:tasks.workunit.client.0.smithi089.stdout:8/544: mknod de/d16/d1e/d3f/d71/cb1 0 2024-09-13T02:54:02.146 INFO:tasks.workunit.client.0.smithi089.stdout:9/470: mknod d3/d15/c93 0 2024-09-13T02:54:02.146 INFO:tasks.workunit.client.0.smithi089.stdout:0/416: write d2/f3a [1404614,30844] 0 2024-09-13T02:54:02.146 INFO:tasks.workunit.client.0.smithi089.stdout:0/417: write d2/d19/f32 [2037625,13321] 0 2024-09-13T02:54:02.146 INFO:tasks.workunit.client.0.smithi089.stdout:8/545: rename de/d16/d1e/d27/d35/d91/c9e to de/d16/d1e/d20/cb2 0 2024-09-13T02:54:02.146 INFO:tasks.workunit.client.0.smithi089.stdout:8/546: fdatasync f0 0 2024-09-13T02:54:02.146 INFO:tasks.workunit.client.0.smithi089.stdout:8/547: mknod de/d16/d1e/d27/d35/d91/cb3 0 2024-09-13T02:54:02.146 INFO:tasks.workunit.client.0.smithi089.stdout:8/548: chown de/d16/d1e/d27/c43 70 1 2024-09-13T02:54:02.146 INFO:tasks.workunit.client.0.smithi089.stdout:3/479: dwrite d2/d20/d23/d32/d49/f67 [0,4194304] 0 2024-09-13T02:54:02.147 INFO:tasks.workunit.client.0.smithi089.stdout:8/549: creat de/d16/d1e/d27/d76/fb4 x:0 0 0 2024-09-13T02:54:02.147 INFO:tasks.workunit.client.0.smithi089.stdout:0/418: dread d2/f34 [0,4194304] 0 2024-09-13T02:54:02.147 INFO:tasks.workunit.client.0.smithi089.stdout:0/419: write d2/f80 [1916137,61152] 0 2024-09-13T02:54:02.147 INFO:tasks.workunit.client.0.smithi089.stdout:0/420: fdatasync d2/d19/d1a/d3d/d4b/d4f/f81 0 2024-09-13T02:54:02.147 INFO:tasks.workunit.client.0.smithi089.stdout:1/452: dwrite dc/d44/f8c [0,4194304] 0 2024-09-13T02:54:02.147 INFO:tasks.workunit.client.0.smithi089.stdout:6/499: dwrite db/d10/d3a/f84 [0,4194304] 0 2024-09-13T02:54:02.147 INFO:tasks.workunit.client.0.smithi089.stdout:3/480: symlink d2/d8b/l8f 0 2024-09-13T02:54:02.147 INFO:tasks.workunit.client.0.smithi089.stdout:5/531: dwrite d1/d4/f97 [0,4194304] 0 2024-09-13T02:54:02.147 INFO:tasks.workunit.client.0.smithi089.stdout:6/500: dread db/d10/f80 [0,4194304] 0 2024-09-13T02:54:02.147 INFO:tasks.workunit.client.0.smithi089.stdout:1/453: symlink dc/d3a/d53/d2c/d36/l8e 0 2024-09-13T02:54:02.147 INFO:tasks.workunit.client.0.smithi089.stdout:7/589: dwrite d3/d19/d75/f1d [0,4194304] 0 2024-09-13T02:54:02.147 INFO:tasks.workunit.client.0.smithi089.stdout:0/421: read f1 [2285916,112625] 0 2024-09-13T02:54:02.147 INFO:tasks.workunit.client.0.smithi089.stdout:0/422: fdatasync d2/d19/d1a/d3d/d4b/d4f/f5b 0 2024-09-13T02:54:02.147 INFO:tasks.workunit.client.0.smithi089.stdout:1/454: dread dc/d44/f49 [0,4194304] 0 2024-09-13T02:54:02.148 INFO:tasks.workunit.client.0.smithi089.stdout:9/471: rename d3/d6/df to d3/d6/d2a/d94 0 2024-09-13T02:54:02.148 INFO:tasks.workunit.client.0.smithi089.stdout:9/472: fdatasync d3/d6/f65 0 2024-09-13T02:54:02.148 INFO:tasks.workunit.client.0.smithi089.stdout:6/501: truncate db/d10/d3a/f5d 146367 0 2024-09-13T02:54:02.148 INFO:tasks.workunit.client.0.smithi089.stdout:3/481: mkdir d2/d90 0 2024-09-13T02:54:02.148 INFO:tasks.workunit.client.0.smithi089.stdout:7/590: mkdir d3/d44/d85/d55/dba 0 2024-09-13T02:54:02.148 INFO:tasks.workunit.client.0.smithi089.stdout:0/423: mkdir d2/d64/d91 0 2024-09-13T02:54:02.148 INFO:tasks.workunit.client.0.smithi089.stdout:1/455: mkdir dc/d3a/d53/d2c/d34/d8b/d8f 0 2024-09-13T02:54:02.148 INFO:tasks.workunit.client.0.smithi089.stdout:9/473: symlink d3/d6/d36/l95 0 2024-09-13T02:54:02.148 INFO:tasks.workunit.client.0.smithi089.stdout:3/482: rmdir d2/d20/d44 39 2024-09-13T02:54:02.148 INFO:tasks.workunit.client.0.smithi089.stdout:3/483: stat d2/d8/dc/d3c/f5d 0 2024-09-13T02:54:02.148 INFO:tasks.workunit.client.0.smithi089.stdout:0/424: mknod d2/d19/d1a/d3d/d4b/d4f/d59/c92 0 2024-09-13T02:54:02.148 INFO:tasks.workunit.client.0.smithi089.stdout:0/425: creat d2/d19/d1a/d3d/d4b/d4f/f93 x:0 0 0 2024-09-13T02:54:02.149 INFO:tasks.workunit.client.0.smithi089.stdout:1/456: rename dc/d44/f62 to dc/d3a/d53/d2c/d34/f90 0 2024-09-13T02:54:02.149 INFO:tasks.workunit.client.0.smithi089.stdout:5/532: dwrite d1/d4/d45/f7b [0,4194304] 0 2024-09-13T02:54:02.149 INFO:tasks.workunit.client.0.smithi089.stdout:5/533: chown d1/l46 212156 1 2024-09-13T02:54:02.149 INFO:tasks.workunit.client.0.smithi089.stdout:8/550: dwrite de/d16/d1e/d3f/d5b/f78 [0,4194304] 0 2024-09-13T02:54:02.149 INFO:tasks.workunit.client.0.smithi089.stdout:3/484: unlink d2/d8/d5f/f64 0 2024-09-13T02:54:02.149 INFO:tasks.workunit.client.0.smithi089.stdout:1/457: write dc/d44/f8c [4308796,43333] 0 2024-09-13T02:54:02.149 INFO:tasks.workunit.client.0.smithi089.stdout:1/458: fsync dc/d3a/d53/f26 0 2024-09-13T02:54:02.149 INFO:tasks.workunit.client.0.smithi089.stdout:1/459: write dc/d3a/d53/f87 [1361827,37954] 0 2024-09-13T02:54:02.149 INFO:tasks.workunit.client.0.smithi089.stdout:1/460: creat dc/f91 x:0 0 0 2024-09-13T02:54:02.149 INFO:tasks.workunit.client.0.smithi089.stdout:9/474: dread d3/d6/d2a/f4f [0,4194304] 0 2024-09-13T02:54:02.149 INFO:tasks.workunit.client.0.smithi089.stdout:8/551: creat de/d16/d1e/d27/d52/d61/d8e/fb5 x:0 0 0 2024-09-13T02:54:02.149 INFO:tasks.workunit.client.0.smithi089.stdout:8/552: write de/d16/d1e/d27/fa3 [22872,115353] 0 2024-09-13T02:54:02.150 INFO:tasks.workunit.client.0.smithi089.stdout:1/461: link dc/d3a/d53/f15 dc/d3a/d53/d2c/d36/f92 0 2024-09-13T02:54:02.150 INFO:tasks.workunit.client.0.smithi089.stdout:0/426: write d2/d19/d1a/d3d/d4b/f55 [1876034,89294] 0 2024-09-13T02:54:02.150 INFO:tasks.workunit.client.0.smithi089.stdout:9/475: truncate d3/d6/f14 1973879 0 2024-09-13T02:54:02.150 INFO:tasks.workunit.client.0.smithi089.stdout:3/485: symlink d2/l91 0 2024-09-13T02:54:02.151 INFO:tasks.workunit.client.0.smithi089.stdout:3/486: dread - d2/d20/d23/d32/f7e zero size 2024-09-13T02:54:02.151 INFO:tasks.workunit.client.0.smithi089.stdout:1/462: rmdir dc/d44/d73 39 2024-09-13T02:54:02.153 INFO:tasks.workunit.client.0.smithi089.stdout:1/463: rmdir dc/d3a/d53/d2c/d34/d8b/d8f 0 2024-09-13T02:54:02.153 INFO:tasks.workunit.client.0.smithi089.stdout:6/502: dwrite db/d10/f1f [0,4194304] 0 2024-09-13T02:54:02.154 INFO:tasks.workunit.client.0.smithi089.stdout:0/427: rmdir d2/d19/d1a/d63 39 2024-09-13T02:54:02.156 INFO:tasks.workunit.client.0.smithi089.stdout:1/464: readlink la 0 2024-09-13T02:54:02.158 INFO:tasks.workunit.client.0.smithi089.stdout:0/428: chown d2/c8 2 1 2024-09-13T02:54:02.158 INFO:tasks.workunit.client.0.smithi089.stdout:0/429: creat d2/d19/d1a/d3d/d4b/d4f/d59/f94 x:0 0 0 2024-09-13T02:54:02.160 INFO:tasks.workunit.client.0.smithi089.stdout:1/465: mkdir dc/d3a/d93 0 2024-09-13T02:54:02.160 INFO:tasks.workunit.client.0.smithi089.stdout:1/466: chown dc/d3a/d53/d2c/d34/d8b 3520735 1 2024-09-13T02:54:02.163 INFO:tasks.workunit.client.0.smithi089.stdout:0/430: creat d2/d19/d1a/d4e/d7a/f95 x:0 0 0 2024-09-13T02:54:02.163 INFO:tasks.workunit.client.0.smithi089.stdout:0/431: creat d2/d19/d1a/d3d/d4b/d4f/f96 x:0 0 0 2024-09-13T02:54:02.163 INFO:tasks.workunit.client.0.smithi089.stdout:1/467: truncate dc/d3a/d53/f15 3850204 0 2024-09-13T02:54:02.163 INFO:tasks.workunit.client.0.smithi089.stdout:1/468: chown dc/d3a/d53/d2c/d34/c63 4811040 1 2024-09-13T02:54:02.163 INFO:tasks.workunit.client.0.smithi089.stdout:1/469: chown dc/d3a/d53/d2c/d36 6977 1 2024-09-13T02:54:02.165 INFO:tasks.workunit.client.0.smithi089.stdout:0/432: mkdir d2/d64/d91/d97 0 2024-09-13T02:54:02.165 INFO:tasks.workunit.client.0.smithi089.stdout:4/576: sync 2024-09-13T02:54:02.165 INFO:tasks.workunit.client.0.smithi089.stdout:0/433: write d2/d19/d1a/d3d/d4b/d4f/f81 [615625,103142] 0 2024-09-13T02:54:02.165 INFO:tasks.workunit.client.0.smithi089.stdout:4/577: getdents d2/d3/d5/d43/d3b/d71/d78/db5 0 2024-09-13T02:54:02.166 INFO:tasks.workunit.client.0.smithi089.stdout:1/470: mkdir dc/d3a/d53/d2c/d94 0 2024-09-13T02:54:02.166 INFO:tasks.workunit.client.0.smithi089.stdout:1/471: dread - dc/d46/f89 zero size 2024-09-13T02:54:02.166 INFO:tasks.workunit.client.0.smithi089.stdout:1/472: chown dc/d3a/d53/d2c/d36/f38 154771 1 2024-09-13T02:54:02.166 INFO:tasks.workunit.client.0.smithi089.stdout:1/473: write dc/d3a/d53/f26 [5224682,92408] 0 2024-09-13T02:54:02.166 INFO:tasks.workunit.client.0.smithi089.stdout:1/474: fsync dc/f1c 0 2024-09-13T02:54:02.166 INFO:tasks.workunit.client.0.smithi089.stdout:0/434: rmdir d2/d64/d91/d97 0 2024-09-13T02:54:02.167 INFO:tasks.workunit.client.0.smithi089.stdout:7/591: dwrite d3/d44/d85/d55/f6b [0,4194304] 0 2024-09-13T02:54:02.167 INFO:tasks.workunit.client.0.smithi089.stdout:5/534: dwrite d1/d4/d45/d8c/fa0 [0,4194304] 0 2024-09-13T02:54:02.168 INFO:tasks.workunit.client.0.smithi089.stdout:5/535: chown d1/d7/f27 258 1 2024-09-13T02:54:02.168 INFO:tasks.workunit.client.0.smithi089.stdout:4/578: link d2/d3/d5/d43/f82 d2/d3/fba 0 2024-09-13T02:54:02.168 INFO:tasks.workunit.client.0.smithi089.stdout:0/435: creat d2/f98 x:0 0 0 2024-09-13T02:54:02.168 INFO:tasks.workunit.client.0.smithi089.stdout:6/503: write db/d10/fa4 [1997750,34605] 0 2024-09-13T02:54:02.170 INFO:tasks.workunit.client.0.smithi089.stdout:7/592: link d3/d19/d75/cf d3/d44/d85/d77/cbb 0 2024-09-13T02:54:02.171 INFO:tasks.workunit.client.0.smithi089.stdout:9/476: dwrite d3/d6/d2a/d94/d24/d29/f52 [0,4194304] 0 2024-09-13T02:54:02.171 INFO:tasks.workunit.client.0.smithi089.stdout:9/477: readlink d3/d6/d2a/d4b/d54/l61 0 2024-09-13T02:54:02.171 INFO:tasks.workunit.client.0.smithi089.stdout:8/553: dwrite de/d16/d1e/d20/f37 [0,4194304] 0 2024-09-13T02:54:02.173 INFO:tasks.workunit.client.0.smithi089.stdout:5/536: mkdir d1/d4/d2b/da9 0 2024-09-13T02:54:02.173 INFO:tasks.workunit.client.0.smithi089.stdout:5/537: dread - d1/d4/d45/d6f/d4d/d7f/f96 zero size 2024-09-13T02:54:02.173 INFO:tasks.workunit.client.0.smithi089.stdout:5/538: fsync d1/d4/d45/d6f/d4d/f7a 0 2024-09-13T02:54:02.176 INFO:tasks.workunit.client.0.smithi089.stdout:4/579: creat d2/d3/d86/fbb x:0 0 0 2024-09-13T02:54:02.182 INFO:tasks.workunit.client.0.smithi089.stdout:6/504: dread db/d43/d6e/d28/d37/f4e [0,4194304] 0 2024-09-13T02:54:02.185 INFO:tasks.workunit.client.0.smithi089.stdout:1/475: read dc/d3a/d53/d2c/d34/f39 [2240839,2314] 0 2024-09-13T02:54:02.186 INFO:tasks.workunit.client.0.smithi089.stdout:1/476: mkdir dc/d3a/d53/d2c/d34/d8b/d95 0 2024-09-13T02:54:02.188 INFO:tasks.workunit.client.0.smithi089.stdout:1/477: unlink dc/d3a/d53/d2c/d34/l72 0 2024-09-13T02:54:02.188 INFO:tasks.workunit.client.0.smithi089.stdout:1/478: write dc/d3a/d53/d2c/d34/f5f [2930821,126999] 0 2024-09-13T02:54:02.188 INFO:tasks.workunit.client.0.smithi089.stdout:1/479: chown dc/d3a/d53/c27 116 1 2024-09-13T02:54:02.190 INFO:tasks.workunit.client.0.smithi089.stdout:1/480: creat dc/d3a/d53/d2c/d94/f96 x:0 0 0 2024-09-13T02:54:02.192 INFO:tasks.workunit.client.0.smithi089.stdout:3/487: dwrite d2/d8/dc/d3c/d65/f87 [0,4194304] 0 2024-09-13T02:54:02.193 INFO:tasks.workunit.client.0.smithi089.stdout:0/436: write d2/f35 [3060286,35039] 0 2024-09-13T02:54:02.193 INFO:tasks.workunit.client.0.smithi089.stdout:0/437: chown d2/f98 11 1 2024-09-13T02:54:02.196 INFO:tasks.workunit.client.0.smithi089.stdout:3/488: mkdir d2/d20/d23/d32/d5b/d71/d92 0 2024-09-13T02:54:02.197 INFO:tasks.workunit.client.0.smithi089.stdout:3/489: write d2/d8/dc/f30 [134333,43113] 0 2024-09-13T02:54:02.205 INFO:tasks.workunit.client.0.smithi089.stdout:6/505: read db/d10/d3a/f81 [3710605,38083] 0 2024-09-13T02:54:02.206 INFO:tasks.workunit.client.0.smithi089.stdout:4/580: write d2/f4c [1015783,8187] 0 2024-09-13T02:54:02.207 INFO:tasks.workunit.client.0.smithi089.stdout:6/506: dread db/d43/d6e/d28/d2f/f4c [0,4194304] 0 2024-09-13T02:54:02.207 INFO:tasks.workunit.client.0.smithi089.stdout:4/581: mknod d2/d3/d5/d43/d3b/d71/d99/cbc 0 2024-09-13T02:54:02.207 INFO:tasks.workunit.client.0.smithi089.stdout:4/582: write d2/d3/d5/fa8 [540299,24219] 0 2024-09-13T02:54:02.208 INFO:tasks.workunit.client.0.smithi089.stdout:6/507: symlink db/d43/d6e/d28/d46/d7e/lac 0 2024-09-13T02:54:02.210 INFO:tasks.workunit.client.0.smithi089.stdout:4/583: link d2/d3/d5/d43/d3b/f54 d2/d22/da1/d62/fbd 0 2024-09-13T02:54:02.213 INFO:tasks.workunit.client.0.smithi089.stdout:7/593: dwrite d3/d19/d75/d14/f97 [0,4194304] 0 2024-09-13T02:54:02.213 INFO:tasks.workunit.client.0.smithi089.stdout:7/594: chown d3/d44/f58 800385 1 2024-09-13T02:54:02.216 INFO:tasks.workunit.client.0.smithi089.stdout:8/554: dwrite de/d16/f86 [0,4194304] 0 2024-09-13T02:54:02.216 INFO:tasks.workunit.client.0.smithi089.stdout:8/555: fdatasync de/d16/d1e/d3f/f73 0 2024-09-13T02:54:02.219 INFO:tasks.workunit.client.0.smithi089.stdout:5/539: dwrite d1/d4/f5 [0,4194304] 0 2024-09-13T02:54:02.219 INFO:tasks.workunit.client.0.smithi089.stdout:5/540: read - d1/d4/d45/d6f/d62/d72/f92 zero size 2024-09-13T02:54:02.219 INFO:tasks.workunit.client.0.smithi089.stdout:7/595: creat d3/fbc x:0 0 0 2024-09-13T02:54:02.219 INFO:tasks.workunit.client.0.smithi089.stdout:7/596: readlink d3/d19/d75/d14/d71/l92 0 2024-09-13T02:54:02.219 INFO:tasks.workunit.client.0.smithi089.stdout:7/597: write d3/fb3 [635069,98825] 0 2024-09-13T02:54:02.219 INFO:tasks.workunit.client.0.smithi089.stdout:7/598: dread - d3/d54/f87 zero size 2024-09-13T02:54:02.220 INFO:tasks.workunit.client.0.smithi089.stdout:0/438: fdatasync d2/f35 0 2024-09-13T02:54:02.220 INFO:tasks.workunit.client.0.smithi089.stdout:0/439: truncate d2/d19/d1a/d3d/d4b/d4f/d59/f94 148115 0 2024-09-13T02:54:02.221 INFO:tasks.workunit.client.0.smithi089.stdout:8/556: symlink de/d16/d1e/d67/lb6 0 2024-09-13T02:54:02.222 INFO:tasks.workunit.client.0.smithi089.stdout:1/481: dwrite dc/d44/d73/d85/f88 [0,4194304] 0 2024-09-13T02:54:02.224 INFO:tasks.workunit.client.0.smithi089.stdout:5/541: mkdir d1/d4/d45/d6f/d4d/d9d/daa 0 2024-09-13T02:54:02.224 INFO:tasks.workunit.client.0.smithi089.stdout:6/508: dread db/d43/d6e/d28/d46/d7e/f96 [0,4194304] 0 2024-09-13T02:54:02.226 INFO:tasks.workunit.client.0.smithi089.stdout:7/599: rename d3/d19/d2e/d68 to d3/d44/d85/dbd 0 2024-09-13T02:54:02.226 INFO:tasks.workunit.client.0.smithi089.stdout:7/600: write d3/d19/f4d [1083950,49955] 0 2024-09-13T02:54:02.232 INFO:tasks.workunit.client.0.smithi089.stdout:4/584: dwrite d2/d22/f7f [0,4194304] 0 2024-09-13T02:54:02.232 INFO:tasks.workunit.client.0.smithi089.stdout:4/585: creat d2/d55/fbe x:0 0 0 2024-09-13T02:54:02.232 INFO:tasks.workunit.client.0.smithi089.stdout:0/440: creat d2/d19/d1a/d3d/d4b/d4f/d59/d6b/f99 x:0 0 0 2024-09-13T02:54:02.232 INFO:tasks.workunit.client.0.smithi089.stdout:4/586: truncate d2/d3/d5/d43/d3b/d71/d78/d9c/fa4 655077 0 2024-09-13T02:54:02.232 INFO:tasks.workunit.client.0.smithi089.stdout:8/557: mkdir de/d16/d1e/d20/d6c/d6e/d7e/db7 0 2024-09-13T02:54:02.232 INFO:tasks.workunit.client.0.smithi089.stdout:8/558: dread - de/d16/d1e/d3f/fae zero size 2024-09-13T02:54:02.235 INFO:tasks.workunit.client.0.smithi089.stdout:1/482: rmdir dc/d3a/d53/d2c/d34/d8b/d95 0 2024-09-13T02:54:02.235 INFO:tasks.workunit.client.0.smithi089.stdout:1/483: write dc/f82 [5611387,105600] 0 2024-09-13T02:54:02.236 INFO:tasks.workunit.client.0.smithi089.stdout:6/509: mknod db/d43/d60/d7d/cad 0 2024-09-13T02:54:02.236 INFO:tasks.workunit.client.0.smithi089.stdout:6/510: chown db/d43/d6e/d28/d37/f51 93443 1 2024-09-13T02:54:02.240 INFO:tasks.workunit.client.0.smithi089.stdout:0/441: unlink d2/f6 0 2024-09-13T02:54:02.240 INFO:tasks.workunit.client.0.smithi089.stdout:0/442: write d2/f98 [987455,122775] 0 2024-09-13T02:54:02.243 INFO:tasks.workunit.client.0.smithi089.stdout:1/484: symlink dc/d3a/d93/l97 0 2024-09-13T02:54:02.243 INFO:tasks.workunit.client.0.smithi089.stdout:1/485: getdents dc/d6e 0 2024-09-13T02:54:02.243 INFO:tasks.workunit.client.0.smithi089.stdout:1/486: dread - dc/d3a/d53/d2c/d94/f96 zero size 2024-09-13T02:54:02.245 INFO:tasks.workunit.client.0.smithi089.stdout:6/511: symlink db/d43/d60/d74/lae 0 2024-09-13T02:54:02.245 INFO:tasks.workunit.client.0.smithi089.stdout:6/512: fdatasync db/d43/d6e/f55 0 2024-09-13T02:54:02.245 INFO:tasks.workunit.client.0.smithi089.stdout:6/513: chown db/d43/l45 1436788 1 2024-09-13T02:54:02.245 INFO:tasks.workunit.client.0.smithi089.stdout:6/514: write db/d10/d3a/d7b/f91 [4705407,123885] 0 2024-09-13T02:54:02.246 INFO:tasks.workunit.client.0.smithi089.stdout:0/443: mkdir d2/d19/d1a/d4e/d9a 0 2024-09-13T02:54:02.246 INFO:tasks.workunit.client.0.smithi089.stdout:0/444: write d2/d19/d1a/d3d/d4b/d4f/d59/d6b/f6c [380124,110403] 0 2024-09-13T02:54:02.246 INFO:tasks.workunit.client.0.smithi089.stdout:0/445: write d2/d19/d1a/d1e/f31 [133465,79243] 0 2024-09-13T02:54:02.246 INFO:tasks.workunit.client.0.smithi089.stdout:0/446: dread - d2/d19/d1a/f8f zero size 2024-09-13T02:54:02.247 INFO:tasks.workunit.client.0.smithi089.stdout:2/514: sync 2024-09-13T02:54:02.248 INFO:tasks.workunit.client.0.smithi089.stdout:1/487: dread dc/d3a/d53/d2c/d34/f39 [0,4194304] 0 2024-09-13T02:54:02.249 INFO:tasks.workunit.client.0.smithi089.stdout:3/490: dwrite d2/d8/dc/f30 [0,4194304] 0 2024-09-13T02:54:02.249 INFO:tasks.workunit.client.0.smithi089.stdout:6/515: creat db/d43/d6e/faf x:0 0 0 2024-09-13T02:54:02.249 INFO:tasks.workunit.client.0.smithi089.stdout:6/516: dread - db/d10/fa0 zero size 2024-09-13T02:54:02.250 INFO:tasks.workunit.client.0.smithi089.stdout:0/447: rename d2/d19/d1a/d63 to d2/d19/d1a/d4e/d7a/d9b 0 2024-09-13T02:54:02.250 INFO:tasks.workunit.client.0.smithi089.stdout:0/448: dread - d2/d19/d1a/d1e/d42/f8b zero size 2024-09-13T02:54:02.251 INFO:tasks.workunit.client.0.smithi089.stdout:0/449: write d2/d19/d1a/d1e/d42/f5d [12843,16873] 0 2024-09-13T02:54:02.251 INFO:tasks.workunit.client.0.smithi089.stdout:2/515: mknod d13/d30/d61/d78/cb0 0 2024-09-13T02:54:02.251 INFO:tasks.workunit.client.0.smithi089.stdout:2/516: write d13/f1a [1596777,275] 0 2024-09-13T02:54:02.253 INFO:tasks.workunit.client.0.smithi089.stdout:6/517: mknod db/d43/d6e/cb0 0 2024-09-13T02:54:02.254 INFO:tasks.workunit.client.0.smithi089.stdout:1/488: write dc/d3a/d53/d2c/d36/f92 [714925,62080] 0 2024-09-13T02:54:02.255 INFO:tasks.workunit.client.0.smithi089.stdout:2/517: mkdir d13/d30/db1 0 2024-09-13T02:54:02.255 INFO:tasks.workunit.client.0.smithi089.stdout:2/518: readlink d13/d30/d4e/d6f/d76/l6d 0 2024-09-13T02:54:02.255 INFO:tasks.workunit.client.0.smithi089.stdout:2/519: fdatasync d13/d30/d4e/d7b/f8e 0 2024-09-13T02:54:02.255 INFO:tasks.workunit.client.0.smithi089.stdout:6/518: truncate db/d43/d6e/f68 3097030 0 2024-09-13T02:54:02.256 INFO:tasks.workunit.client.0.smithi089.stdout:6/519: write db/d43/d6e/d28/d37/f52 [4366004,51311] 0 2024-09-13T02:54:02.256 INFO:tasks.workunit.client.0.smithi089.stdout:6/520: chown db/d43/d6e/d28/d46/d53/c77 410 1 2024-09-13T02:54:02.257 INFO:tasks.workunit.client.0.smithi089.stdout:1/489: mkdir dc/d46/d6c/d98 0 2024-09-13T02:54:02.257 INFO:tasks.workunit.client.0.smithi089.stdout:1/490: chown dc/d3a/d53/l25 10025 1 2024-09-13T02:54:02.257 INFO:tasks.workunit.client.0.smithi089.stdout:1/491: truncate dc/d44/d73/f69 809261 0 2024-09-13T02:54:02.259 INFO:tasks.workunit.client.0.smithi089.stdout:2/520: mknod d13/d30/d4e/d7b/cb2 0 2024-09-13T02:54:02.259 INFO:tasks.workunit.client.0.smithi089.stdout:5/542: dwrite d1/d4/d45/d6f/d4d/f7e [0,4194304] 0 2024-09-13T02:54:02.259 INFO:tasks.workunit.client.0.smithi089.stdout:2/521: rename d13 to d13/d30/d4e/d7b/d86/db3 22 2024-09-13T02:54:02.259 INFO:tasks.workunit.client.0.smithi089.stdout:8/559: dwrite de/d16/d1e/d3f/fae [0,4194304] 0 2024-09-13T02:54:02.262 INFO:tasks.workunit.client.0.smithi089.stdout:2/522: creat d13/da9/fb4 x:0 0 0 2024-09-13T02:54:02.262 INFO:tasks.workunit.client.0.smithi089.stdout:2/523: write fc [6379629,101752] 0 2024-09-13T02:54:02.266 INFO:tasks.workunit.client.0.smithi089.stdout:8/560: unlink de/d16/d1e/d20/d39/f8a 0 2024-09-13T02:54:02.266 INFO:tasks.workunit.client.0.smithi089.stdout:8/561: dread - de/d16/d1e/d20/f80 zero size 2024-09-13T02:54:02.267 INFO:tasks.workunit.client.0.smithi089.stdout:6/521: getdents db/d43/d6e/d28/d37/d8b 0 2024-09-13T02:54:02.269 INFO:tasks.workunit.client.0.smithi089.stdout:3/491: dwrite d2/d20/d23/d27/d51/d6c/f84 [0,4194304] 0 2024-09-13T02:54:02.273 INFO:tasks.workunit.client.0.smithi089.stdout:8/562: symlink de/d16/d1e/d27/lb8 0 2024-09-13T02:54:02.273 INFO:tasks.workunit.client.0.smithi089.stdout:8/563: chown de/d56/f8c 50039 1 2024-09-13T02:54:02.274 INFO:tasks.workunit.client.0.smithi089.stdout:1/492: dwrite dc/d3a/d53/d2c/d36/f40 [0,4194304] 0 2024-09-13T02:54:02.274 INFO:tasks.workunit.client.0.smithi089.stdout:1/493: chown dc/d44/d73/d85/c61 6258578 1 2024-09-13T02:54:02.274 INFO:tasks.workunit.client.0.smithi089.stdout:1/494: creat dc/d44/f99 x:0 0 0 2024-09-13T02:54:02.274 INFO:tasks.workunit.client.0.smithi089.stdout:1/495: write dc/d3a/d53/d2c/d36/f58 [3480835,108179] 0 2024-09-13T02:54:02.274 INFO:tasks.workunit.client.0.smithi089.stdout:1/496: stat dc/d3a/d53/d2c/d36/f58 0 2024-09-13T02:54:02.275 INFO:tasks.workunit.client.0.smithi089.stdout:6/522: unlink db/d43/d6e/d28/d46/d7e/f96 0 2024-09-13T02:54:02.279 INFO:tasks.workunit.client.0.smithi089.stdout:3/492: rename d2/d20/d23/d27/d51/d6c/f7c to d2/d20/d23/d32/d5b/d71/f93 0 2024-09-13T02:54:02.283 INFO:tasks.workunit.client.0.smithi089.stdout:2/524: dwrite d13/d30/d4e/d6f/f7d [0,4194304] 0 2024-09-13T02:54:02.283 INFO:tasks.workunit.client.0.smithi089.stdout:2/525: fsync d13/f54 0 2024-09-13T02:54:02.286 INFO:tasks.workunit.client.0.smithi089.stdout:8/564: unlink de/d16/d1e/d20/d6c/f99 0 2024-09-13T02:54:02.290 INFO:tasks.workunit.client.0.smithi089.stdout:4/587: truncate d2/d22/f7f 113459 0 2024-09-13T02:54:02.290 INFO:tasks.workunit.client.0.smithi089.stdout:1/497: mkdir dc/d44/d73/d9a 0 2024-09-13T02:54:02.292 INFO:tasks.workunit.client.0.smithi089.stdout:6/523: mkdir db/d43/d6e/d28/d46/d53/d83/d9f/db1 0 2024-09-13T02:54:02.295 INFO:tasks.workunit.client.0.smithi089.stdout:2/526: mknod d13/d30/d4e/d6f/cb5 0 2024-09-13T02:54:02.296 INFO:tasks.workunit.client.0.smithi089.stdout:8/565: mknod de/d16/d1e/d67/cb9 0 2024-09-13T02:54:02.297 INFO:tasks.workunit.client.0.smithi089.stdout:8/566: dread - de/d16/d1e/d27/d76/f98 zero size 2024-09-13T02:54:02.297 INFO:tasks.workunit.client.0.smithi089.stdout:8/567: getdents de/d16/d1e/d20/da8/dac 0 2024-09-13T02:54:02.297 INFO:tasks.workunit.client.0.smithi089.stdout:1/498: read dc/f22 [8250416,125424] 0 2024-09-13T02:54:02.297 INFO:tasks.workunit.client.0.smithi089.stdout:4/588: mkdir d2/d3/d5/d43/d3b/d71/d78/d9c/dbf 0 2024-09-13T02:54:02.299 INFO:tasks.workunit.client.0.smithi089.stdout:6/524: mkdir db/db2 0 2024-09-13T02:54:02.299 INFO:tasks.workunit.client.0.smithi089.stdout:6/525: creat db/d43/d6e/d28/d2f/d9b/fb3 x:0 0 0 2024-09-13T02:54:02.300 INFO:tasks.workunit.client.0.smithi089.stdout:3/493: getdents d2/d20/d23 0 2024-09-13T02:54:02.300 INFO:tasks.workunit.client.0.smithi089.stdout:3/494: write d2/d8/dc/d3c/f5d [1372078,121895] 0 2024-09-13T02:54:02.300 INFO:tasks.workunit.client.0.smithi089.stdout:8/568: truncate de/d16/d1e/d27/d52/d61/d8e/f90 4145591 0 2024-09-13T02:54:02.302 INFO:tasks.workunit.client.0.smithi089.stdout:6/526: readlink db/d10/l78 0 2024-09-13T02:54:02.302 INFO:tasks.workunit.client.0.smithi089.stdout:6/527: write db/d10/f80 [347164,98814] 0 2024-09-13T02:54:02.304 INFO:tasks.workunit.client.0.smithi089.stdout:3/495: unlink d2/d20/d23/d32/d49/l70 0 2024-09-13T02:54:02.305 INFO:tasks.workunit.client.0.smithi089.stdout:6/528: unlink db/d43/f95 0 2024-09-13T02:54:02.306 INFO:tasks.workunit.client.0.smithi089.stdout:1/499: dread dc/d3a/d53/f26 [0,4194304] 0 2024-09-13T02:54:02.306 INFO:tasks.workunit.client.0.smithi089.stdout:3/496: mkdir d2/d20/d23/d32/d5b/d94 0 2024-09-13T02:54:02.306 INFO:tasks.workunit.client.0.smithi089.stdout:3/497: creat d2/d8/f95 x:0 0 0 2024-09-13T02:54:02.308 INFO:tasks.workunit.client.0.smithi089.stdout:6/529: symlink db/d43/d60/d74/lb4 0 2024-09-13T02:54:02.316 INFO:tasks.workunit.client.0.smithi089.stdout:1/500: dread dc/d3a/d53/d2c/d34/f39 [0,4194304] 0 2024-09-13T02:54:02.318 INFO:tasks.workunit.client.0.smithi089.stdout:1/501: rmdir dc/d3a/d93 39 2024-09-13T02:54:02.318 INFO:tasks.workunit.client.0.smithi089.stdout:1/502: write dc/f21 [9380,1503] 0 2024-09-13T02:54:02.318 INFO:tasks.workunit.client.0.smithi089.stdout:1/503: chown dc/d3a/d53/d2c/d34/c37 25 1 2024-09-13T02:54:02.318 INFO:tasks.workunit.client.0.smithi089.stdout:1/504: write dc/d3a/d53/d2c/d36/f3b [433204,38842] 0 2024-09-13T02:54:02.322 INFO:tasks.workunit.client.0.smithi089.stdout:4/589: dwrite d2/da/f45 [0,4194304] 0 2024-09-13T02:54:02.324 INFO:tasks.workunit.client.0.smithi089.stdout:1/505: mkdir dc/d3a/d53/d2c/d34/d9b 0 2024-09-13T02:54:02.324 INFO:tasks.workunit.client.0.smithi089.stdout:1/506: stat dc/f1a 0 2024-09-13T02:54:02.324 INFO:tasks.workunit.client.0.smithi089.stdout:1/507: stat dc/d3a/d53/d2c/d36/c54 0 2024-09-13T02:54:02.326 INFO:tasks.workunit.client.0.smithi089.stdout:4/590: getdents d2/d3/d86 0 2024-09-13T02:54:02.336 INFO:tasks.workunit.client.0.smithi089.stdout:4/591: dread d2/f53 [0,4194304] 0 2024-09-13T02:54:02.352 INFO:tasks.workunit.client.0.smithi089.stdout:4/592: dwrite d2/d3/f7c [4194304,4194304] 0 2024-09-13T02:54:02.369 INFO:tasks.workunit.client.1.smithi131.stdout:4/420: sync 2024-09-13T02:54:02.369 INFO:tasks.workunit.client.1.smithi131.stdout:4/421: creat d1/d18/d81/f8a x:0 0 0 2024-09-13T02:54:02.370 INFO:tasks.workunit.client.0.smithi089.stdout:6/530: getdents db 0 2024-09-13T02:54:02.370 INFO:tasks.workunit.client.0.smithi089.stdout:8/569: dwrite de/d16/d1e/d27/f3b [0,4194304] 0 2024-09-13T02:54:02.371 INFO:tasks.workunit.client.0.smithi089.stdout:4/593: creat d2/d22/da1/fc0 x:0 0 0 2024-09-13T02:54:02.371 INFO:tasks.workunit.client.1.smithi131.stdout:4/422: link d1/d8/d13/f44 d1/d18/d81/f8b 0 2024-09-13T02:54:02.372 INFO:tasks.workunit.client.0.smithi089.stdout:3/498: dwrite d2/d20/d23/d32/f7e [0,4194304] 0 2024-09-13T02:54:02.373 INFO:tasks.workunit.client.0.smithi089.stdout:6/531: mknod db/d10/d3a/cb5 0 2024-09-13T02:54:02.374 INFO:tasks.workunit.client.0.smithi089.stdout:8/570: creat de/d16/d1e/d27/d52/fba x:0 0 0 2024-09-13T02:54:02.380 INFO:tasks.workunit.client.0.smithi089.stdout:4/594: rename d2/d22/f7f to d2/d3/d86/fc1 0 2024-09-13T02:54:02.381 INFO:tasks.workunit.client.0.smithi089.stdout:4/595: chown d2/d3/d5/d43/d3b/d71/d78 229 1 2024-09-13T02:54:02.381 INFO:tasks.workunit.client.0.smithi089.stdout:4/596: write d2/d3/d5/d43/d3b/f6f [753851,10296] 0 2024-09-13T02:54:02.383 INFO:tasks.workunit.client.0.smithi089.stdout:3/499: symlink d2/d20/d23/d32/d5b/d71/d92/l96 0 2024-09-13T02:54:02.384 INFO:tasks.workunit.client.1.smithi131.stdout:4/423: dread d1/d8/f15 [0,4194304] 0 2024-09-13T02:54:02.384 INFO:tasks.workunit.client.0.smithi089.stdout:8/571: link de/f12 de/d16/d1e/d27/d52/fbb 0 2024-09-13T02:54:02.385 INFO:tasks.workunit.client.1.smithi131.stdout:4/424: getdents d1 0 2024-09-13T02:54:02.385 INFO:tasks.workunit.client.0.smithi089.stdout:4/597: rmdir d2/d3/d5/d72 39 2024-09-13T02:54:02.386 INFO:tasks.workunit.client.1.smithi131.stdout:4/425: truncate d1/dc/f3b 1672488 0 2024-09-13T02:54:02.386 INFO:tasks.workunit.client.0.smithi089.stdout:8/572: symlink de/d56/lbc 0 2024-09-13T02:54:02.387 INFO:tasks.workunit.client.1.smithi131.stdout:4/426: dread d1/dc/d19/d29/f2b [0,4194304] 0 2024-09-13T02:54:02.389 INFO:tasks.workunit.client.0.smithi089.stdout:4/598: rename d2/d3/d5/fb0 to d2/d3/d5/d43/d3b/d71/d99/fc2 0 2024-09-13T02:54:02.390 INFO:tasks.workunit.client.0.smithi089.stdout:8/573: link de/d16/d1e/d27/l2c de/d16/d1e/d20/d6c/d6e/d7e/lbd 0 2024-09-13T02:54:02.391 INFO:tasks.workunit.client.0.smithi089.stdout:4/599: creat d2/d3/d5/fc3 x:0 0 0 2024-09-13T02:54:02.391 INFO:tasks.workunit.client.0.smithi089.stdout:4/600: chown d2/d3/d5/d43/d3b/d71 2 1 2024-09-13T02:54:02.392 INFO:tasks.workunit.client.0.smithi089.stdout:8/574: truncate de/f5e 565917 0 2024-09-13T02:54:02.393 INFO:tasks.workunit.client.0.smithi089.stdout:4/601: truncate d2/d3/d5/f1e 1678002 0 2024-09-13T02:54:02.393 INFO:tasks.workunit.client.0.smithi089.stdout:6/532: dwrite db/d10/d3a/f81 [0,4194304] 0 2024-09-13T02:54:02.394 INFO:tasks.workunit.client.0.smithi089.stdout:8/575: mknod de/d16/d1e/d20/d39/cbe 0 2024-09-13T02:54:02.395 INFO:tasks.workunit.client.0.smithi089.stdout:4/602: truncate d2/d22/f35 1162724 0 2024-09-13T02:54:02.397 INFO:tasks.workunit.client.0.smithi089.stdout:3/500: read d2/d20/d23/d2b/f2f [653164,120199] 0 2024-09-13T02:54:02.398 INFO:tasks.workunit.client.1.smithi131.stdout:4/427: dread d1/dc/d22/f59 [0,4194304] 0 2024-09-13T02:54:02.399 INFO:tasks.workunit.client.1.smithi131.stdout:4/428: mknod d1/d18/d43/d65/c8c 0 2024-09-13T02:54:02.400 INFO:tasks.workunit.client.1.smithi131.stdout:4/429: mkdir d1/dc/d19/d29/d8d 0 2024-09-13T02:54:02.400 INFO:tasks.workunit.client.1.smithi131.stdout:4/430: creat d1/d18/d81/f8e x:0 0 0 2024-09-13T02:54:02.401 INFO:tasks.workunit.client.0.smithi089.stdout:8/576: link de/d16/d1e/d27/d52/d61/d8e/fa6 de/d16/d1e/d20/da8/fbf 0 2024-09-13T02:54:02.401 INFO:tasks.workunit.client.0.smithi089.stdout:8/577: readlink de/d56/l7c 0 2024-09-13T02:54:02.402 INFO:tasks.workunit.client.0.smithi089.stdout:6/533: getdents db/d43 0 2024-09-13T02:54:02.402 INFO:tasks.workunit.client.0.smithi089.stdout:6/534: creat db/d43/d60/d7d/fb6 x:0 0 0 2024-09-13T02:54:02.402 INFO:tasks.workunit.client.0.smithi089.stdout:6/535: getdents db 0 2024-09-13T02:54:02.403 INFO:tasks.workunit.client.0.smithi089.stdout:4/603: dread d2/d3/d5/d43/f50 [4194304,4194304] 0 2024-09-13T02:54:02.403 INFO:tasks.workunit.client.0.smithi089.stdout:8/578: creat de/d16/d1e/d3f/d71/fc0 x:0 0 0 2024-09-13T02:54:02.405 INFO:tasks.workunit.client.0.smithi089.stdout:6/536: creat db/db2/fb7 x:0 0 0 2024-09-13T02:54:02.407 INFO:tasks.workunit.client.0.smithi089.stdout:4/604: symlink d2/d22/lc4 0 2024-09-13T02:54:02.408 INFO:tasks.workunit.client.0.smithi089.stdout:6/537: symlink db/d43/d6e/d28/d46/d53/d83/d9f/db1/lb8 0 2024-09-13T02:54:02.409 INFO:tasks.workunit.client.0.smithi089.stdout:4/605: mknod d2/d3/d5/d43/d3b/d71/d99/cc5 0 2024-09-13T02:54:02.409 INFO:tasks.workunit.client.0.smithi089.stdout:3/501: dread d2/d8/dc/f30 [0,4194304] 0 2024-09-13T02:54:02.410 INFO:tasks.workunit.client.0.smithi089.stdout:7/601: sync 2024-09-13T02:54:02.410 INFO:tasks.workunit.client.0.smithi089.stdout:0/450: sync 2024-09-13T02:54:02.410 INFO:tasks.workunit.client.0.smithi089.stdout:9/478: sync 2024-09-13T02:54:02.410 INFO:tasks.workunit.client.0.smithi089.stdout:7/602: fdatasync d3/d19/d2e/f33 0 2024-09-13T02:54:02.410 INFO:tasks.workunit.client.0.smithi089.stdout:4/606: truncate d2/d3/d5/d43/f50 5469782 0 2024-09-13T02:54:02.410 INFO:tasks.workunit.client.0.smithi089.stdout:4/607: truncate d2/f8e 4405757 0 2024-09-13T02:54:02.411 INFO:tasks.workunit.client.0.smithi089.stdout:3/502: getdents d2/d20/d23/d32/d5b/d71/d92 0 2024-09-13T02:54:02.412 INFO:tasks.workunit.client.0.smithi089.stdout:9/479: dread d3/d6/d2a/d94/f6e [0,4194304] 0 2024-09-13T02:54:02.412 INFO:tasks.workunit.client.0.smithi089.stdout:0/451: creat d2/d64/f9c x:0 0 0 2024-09-13T02:54:02.413 INFO:tasks.workunit.client.0.smithi089.stdout:0/452: chown d2/d19/d1a/d3d/d4b/d4f/d59/d6b/f99 19745 1 2024-09-13T02:54:02.413 INFO:tasks.workunit.client.0.smithi089.stdout:0/453: chown d2/d64 1788 1 2024-09-13T02:54:02.413 INFO:tasks.workunit.client.0.smithi089.stdout:0/454: creat d2/d19/d1a/d3d/d4b/d4f/f9d x:0 0 0 2024-09-13T02:54:02.413 INFO:tasks.workunit.client.0.smithi089.stdout:7/603: mknod d3/d19/d2e/cbe 0 2024-09-13T02:54:02.413 INFO:tasks.workunit.client.0.smithi089.stdout:0/455: dread d2/d19/d1a/d1e/d42/f5d [0,4194304] 0 2024-09-13T02:54:02.415 INFO:tasks.workunit.client.0.smithi089.stdout:3/503: rename d2/d8/dc/l86 to d2/d8/d5f/d72/l97 0 2024-09-13T02:54:02.415 INFO:tasks.workunit.client.0.smithi089.stdout:3/504: chown d2/d20/d23/d2b/f3d 1427474 1 2024-09-13T02:54:02.415 INFO:tasks.workunit.client.0.smithi089.stdout:3/505: fsync d2/d20/d23/d27/d51/d6c/f84 0 2024-09-13T02:54:02.417 INFO:tasks.workunit.client.0.smithi089.stdout:9/480: symlink d3/d6/d36/l96 0 2024-09-13T02:54:02.418 INFO:tasks.workunit.client.0.smithi089.stdout:4/608: mkdir d2/d3/d5/d43/d3b/d71/d99/daf/dc6 0 2024-09-13T02:54:02.419 INFO:tasks.workunit.client.0.smithi089.stdout:0/456: truncate d2/d19/d1a/d3d/d4b/d4f/d59/f6e 2771747 0 2024-09-13T02:54:02.421 INFO:tasks.workunit.client.0.smithi089.stdout:6/538: read db/d10/d3a/f84 [3301733,124822] 0 2024-09-13T02:54:02.422 INFO:tasks.workunit.client.0.smithi089.stdout:6/539: fsync db/d43/d6e/d28/d46/d53/f5a 0 2024-09-13T02:54:02.422 INFO:tasks.workunit.client.0.smithi089.stdout:3/506: mkdir d2/d20/d23/d27/d51/d83/d98 0 2024-09-13T02:54:02.424 INFO:tasks.workunit.client.0.smithi089.stdout:9/481: creat d3/d3d/f97 x:0 0 0 2024-09-13T02:54:02.425 INFO:tasks.workunit.client.0.smithi089.stdout:4/609: creat d2/d22/da1/d62/d6c/d88/db2/fc7 x:0 0 0 2024-09-13T02:54:02.427 INFO:tasks.workunit.client.0.smithi089.stdout:6/540: rename db/d43/d60/f62 to db/fb9 0 2024-09-13T02:54:02.428 INFO:tasks.workunit.client.0.smithi089.stdout:3/507: mknod d2/d20/d23/d32/d49/d75/c99 0 2024-09-13T02:54:02.428 INFO:tasks.workunit.client.0.smithi089.stdout:3/508: write d2/d20/f4b [814184,85254] 0 2024-09-13T02:54:02.428 INFO:tasks.workunit.client.0.smithi089.stdout:3/509: chown d2/d20 489 1 2024-09-13T02:54:02.432 INFO:tasks.workunit.client.0.smithi089.stdout:9/482: creat d3/d6/d2a/d4b/d54/f98 x:0 0 0 2024-09-13T02:54:02.432 INFO:tasks.workunit.client.0.smithi089.stdout:4/610: creat d2/d3/d5/fc8 x:0 0 0 2024-09-13T02:54:02.433 INFO:tasks.workunit.client.0.smithi089.stdout:6/541: truncate db/d10/fa4 2017369 0 2024-09-13T02:54:02.433 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:02 smithi131 ceph-mon[34689]: pgmap v243: 65 pgs: 65 active+clean; 1.7 GiB data, 6.4 GiB used, 530 GiB / 536 GiB avail; 155 MiB/s rd, 206 MiB/s wr, 369 op/s 2024-09-13T02:54:02.436 INFO:tasks.workunit.client.0.smithi089.stdout:9/483: rename d3/l1d to d3/d3d/l99 0 2024-09-13T02:54:02.436 INFO:tasks.workunit.client.0.smithi089.stdout:9/484: truncate d3/d6/d2a/d94/d24/d35/f7f 230302 0 2024-09-13T02:54:02.446 INFO:tasks.workunit.client.0.smithi089.stdout:3/510: dread d2/d8/d5f/f62 [4194304,4194304] 0 2024-09-13T02:54:02.446 INFO:tasks.workunit.client.0.smithi089.stdout:6/542: dread db/d10/d3a/f81 [0,4194304] 0 2024-09-13T02:54:02.446 INFO:tasks.workunit.client.0.smithi089.stdout:6/543: write db/d43/d60/f73 [38423,79630] 0 2024-09-13T02:54:02.447 INFO:tasks.workunit.client.0.smithi089.stdout:6/544: creat db/d43/d6e/d28/d46/d7e/da1/fba x:0 0 0 2024-09-13T02:54:02.447 INFO:tasks.workunit.client.0.smithi089.stdout:6/545: creat db/d43/d6e/d28/d46/fbb x:0 0 0 2024-09-13T02:54:02.449 INFO:tasks.workunit.client.0.smithi089.stdout:6/546: rename c7 to db/d43/d6e/cbc 0 2024-09-13T02:54:02.449 INFO:tasks.workunit.client.1.smithi131.stdout:4/431: dwrite d1/dc/d22/d49/f61 [0,4194304] 0 2024-09-13T02:54:02.449 INFO:tasks.workunit.client.0.smithi089.stdout:3/511: dread d2/d20/d23/d32/d49/f56 [0,4194304] 0 2024-09-13T02:54:02.450 INFO:tasks.workunit.client.0.smithi089.stdout:3/512: stat d2/l9 0 2024-09-13T02:54:02.450 INFO:tasks.workunit.client.0.smithi089.stdout:3/513: mkdir d2/d8/dc/d9a 0 2024-09-13T02:54:02.451 INFO:tasks.workunit.client.0.smithi089.stdout:3/514: creat d2/f9b x:0 0 0 2024-09-13T02:54:02.456 INFO:tasks.workunit.client.0.smithi089.stdout:9/485: dread d3/f5 [0,4194304] 0 2024-09-13T02:54:02.456 INFO:tasks.workunit.client.0.smithi089.stdout:9/486: readlink d3/d6/d2a/d94/l30 0 2024-09-13T02:54:02.458 INFO:tasks.workunit.client.1.smithi131.stdout:4/432: dread d1/d8/f17 [0,4194304] 0 2024-09-13T02:54:02.458 INFO:tasks.workunit.client.0.smithi089.stdout:9/487: creat d3/d6/d2a/d94/d56/f9a x:0 0 0 2024-09-13T02:54:02.458 INFO:tasks.workunit.client.0.smithi089.stdout:9/488: dread - d3/d6/d2a/d4b/d54/f98 zero size 2024-09-13T02:54:02.459 INFO:tasks.workunit.client.1.smithi131.stdout:4/433: mknod d1/d18/d81/c8f 0 2024-09-13T02:54:02.460 INFO:tasks.workunit.client.0.smithi089.stdout:9/489: creat d3/d6/d2a/d94/d24/d32/f9b x:0 0 0 2024-09-13T02:54:02.462 INFO:tasks.workunit.client.0.smithi089.stdout:7/604: dwrite d3/d20/fa6 [0,4194304] 0 2024-09-13T02:54:02.462 INFO:tasks.workunit.client.0.smithi089.stdout:0/457: dwrite d2/d19/d1a/d4e/d7a/f90 [0,4194304] 0 2024-09-13T02:54:02.463 INFO:tasks.workunit.client.0.smithi089.stdout:4/611: dwrite d2/d3/d5/d43/d3b/f6f [0,4194304] 0 2024-09-13T02:54:02.466 INFO:tasks.workunit.client.0.smithi089.stdout:7/605: mkdir d3/d19/d75/dbf 0 2024-09-13T02:54:02.466 INFO:tasks.workunit.client.0.smithi089.stdout:7/606: write d3/d19/d75/f5a [3824379,93137] 0 2024-09-13T02:54:02.468 INFO:tasks.workunit.client.0.smithi089.stdout:0/458: symlink d2/d19/l9e 0 2024-09-13T02:54:02.470 INFO:tasks.workunit.client.0.smithi089.stdout:6/547: write db/d43/d6e/d28/d2f/f3c [3840704,43206] 0 2024-09-13T02:54:02.471 INFO:tasks.workunit.client.0.smithi089.stdout:0/459: mknod d2/d19/d1a/d4e/d7a/c9f 0 2024-09-13T02:54:02.483 INFO:tasks.workunit.client.0.smithi089.stdout:6/548: dread db/d43/d6e/d28/d46/d53/f5a [0,4194304] 0 2024-09-13T02:54:02.483 INFO:tasks.workunit.client.0.smithi089.stdout:6/549: truncate db/d43/d6e/d28/d2f/d9b/fa6 388816 0 2024-09-13T02:54:02.484 INFO:tasks.workunit.client.0.smithi089.stdout:6/550: creat db/d43/d6e/d28/fbd x:0 0 0 2024-09-13T02:54:02.484 INFO:tasks.workunit.client.0.smithi089.stdout:6/551: fdatasync db/fb9 0 2024-09-13T02:54:02.486 INFO:tasks.workunit.client.0.smithi089.stdout:6/552: getdents db/d43/d6e 0 2024-09-13T02:54:02.486 INFO:tasks.workunit.client.0.smithi089.stdout:6/553: readlink db/d43/d60/d74/lae 0 2024-09-13T02:54:02.486 INFO:tasks.workunit.client.0.smithi089.stdout:0/460: dread d2/d19/d1a/f4d [0,4194304] 0 2024-09-13T02:54:02.486 INFO:tasks.workunit.client.0.smithi089.stdout:0/461: chown d2/d19/d1a/d4e/l8e 8916055 1 2024-09-13T02:54:02.486 INFO:tasks.workunit.client.0.smithi089.stdout:0/462: chown d2/d19/d1a/d4e 217977302 1 2024-09-13T02:54:02.486 INFO:tasks.workunit.client.0.smithi089.stdout:0/463: creat d2/d19/d1a/fa0 x:0 0 0 2024-09-13T02:54:02.486 INFO:tasks.workunit.client.0.smithi089.stdout:6/554: symlink db/d43/d60/d7d/lbe 0 2024-09-13T02:54:02.487 INFO:tasks.workunit.client.0.smithi089.stdout:0/464: mknod d2/d19/ca1 0 2024-09-13T02:54:02.487 INFO:tasks.workunit.client.0.smithi089.stdout:0/465: chown d2/d19/d1a/d3d/d4b/d4f/d59/d6b/f99 7 1 2024-09-13T02:54:02.488 INFO:tasks.workunit.client.0.smithi089.stdout:6/555: rename db/d43/d6e/d28/d37/f51 to db/d43/d60/fbf 0 2024-09-13T02:54:02.492 INFO:tasks.workunit.client.0.smithi089.stdout:3/515: dwrite d2/d8/f48 [0,4194304] 0 2024-09-13T02:54:02.492 INFO:tasks.workunit.client.0.smithi089.stdout:3/516: fsync d2/d8/f21 0 2024-09-13T02:54:02.495 INFO:tasks.workunit.client.1.smithi131.stdout:4/434: dwrite d1/dc/f2e [0,4194304] 0 2024-09-13T02:54:02.496 INFO:tasks.workunit.client.0.smithi089.stdout:9/490: dwrite d3/d6/d2a/d94/f62 [0,4194304] 0 2024-09-13T02:54:02.498 INFO:tasks.workunit.client.0.smithi089.stdout:4/612: dwrite d2/da/f44 [0,4194304] 0 2024-09-13T02:54:02.498 INFO:tasks.workunit.client.0.smithi089.stdout:4/613: chown d2/d22/f34 31 1 2024-09-13T02:54:02.498 INFO:tasks.workunit.client.0.smithi089.stdout:4/614: truncate d2/d3/d5/d43/f65 656123 0 2024-09-13T02:54:02.502 INFO:tasks.workunit.client.0.smithi089.stdout:4/615: rmdir d2/d22/da1/d62 39 2024-09-13T02:54:02.502 INFO:tasks.workunit.client.0.smithi089.stdout:4/616: chown d2/da/la2 4805818 1 2024-09-13T02:54:02.502 INFO:tasks.workunit.client.0.smithi089.stdout:4/617: dread - d2/d3/d5/fc3 zero size 2024-09-13T02:54:02.503 INFO:tasks.workunit.client.0.smithi089.stdout:4/618: mknod d2/d22/da1/cc9 0 2024-09-13T02:54:02.505 INFO:tasks.workunit.client.0.smithi089.stdout:4/619: creat d2/fca x:0 0 0 2024-09-13T02:54:02.505 INFO:tasks.workunit.client.0.smithi089.stdout:4/620: truncate d2/f1f 1383348 0 2024-09-13T02:54:02.506 INFO:tasks.workunit.client.0.smithi089.stdout:4/621: creat d2/d3/d5/d72/fcb x:0 0 0 2024-09-13T02:54:02.508 INFO:tasks.workunit.client.0.smithi089.stdout:4/622: unlink d2/d3/d5/f1e 0 2024-09-13T02:54:02.510 INFO:tasks.workunit.client.0.smithi089.stdout:4/623: rename d2/l19 to d2/d3/d5/d43/d3b/d71/d99/daf/d8f/lcc 0 2024-09-13T02:54:02.513 INFO:tasks.workunit.client.0.smithi089.stdout:4/624: rmdir d2/d3/d5/d43/d3b/d71/d78/db5 0 2024-09-13T02:54:02.513 INFO:tasks.workunit.client.0.smithi089.stdout:4/625: creat d2/d22/da1/fcd x:0 0 0 2024-09-13T02:54:02.514 INFO:tasks.workunit.client.0.smithi089.stdout:4/626: link d2/d3/d5/d43/d3b/f6f d2/d3/d5/d43/d3b/d71/d99/daf/d8f/fce 0 2024-09-13T02:54:02.518 INFO:tasks.workunit.client.0.smithi089.stdout:3/517: dwrite d2/d20/d23/d32/d5b/f79 [0,4194304] 0 2024-09-13T02:54:02.518 INFO:tasks.workunit.client.0.smithi089.stdout:6/556: dwrite db/d10/f4f [0,4194304] 0 2024-09-13T02:54:02.518 INFO:tasks.workunit.client.0.smithi089.stdout:3/518: truncate d2/d8/dc/f1b 2978175 0 2024-09-13T02:54:02.518 INFO:tasks.workunit.client.0.smithi089.stdout:6/557: creat db/d43/d6e/d28/d46/d7e/da1/fc0 x:0 0 0 2024-09-13T02:54:02.518 INFO:tasks.workunit.client.0.smithi089.stdout:6/558: write db/d43/f67 [53869,111913] 0 2024-09-13T02:54:02.518 INFO:tasks.workunit.client.0.smithi089.stdout:4/627: creat d2/d3/fcf x:0 0 0 2024-09-13T02:54:02.528 INFO:tasks.workunit.client.0.smithi089.stdout:6/559: dread db/d10/f1f [0,4194304] 0 2024-09-13T02:54:02.529 INFO:tasks.workunit.client.0.smithi089.stdout:6/560: write db/d43/d6e/f55 [2249300,70601] 0 2024-09-13T02:54:02.529 INFO:tasks.workunit.client.0.smithi089.stdout:6/561: write db/d43/d6e/d28/d2f/d9b/fb3 [6242,61031] 0 2024-09-13T02:54:02.530 INFO:tasks.workunit.client.0.smithi089.stdout:6/562: fdatasync db/d10/f59 0 2024-09-13T02:54:02.530 INFO:tasks.workunit.client.0.smithi089.stdout:6/563: truncate db/d43/d6e/d28/d37/f8d 524225 0 2024-09-13T02:54:02.530 INFO:tasks.workunit.client.0.smithi089.stdout:4/628: write d2/d22/da1/d62/fbd [3911106,16730] 0 2024-09-13T02:54:02.531 INFO:tasks.workunit.client.0.smithi089.stdout:6/564: mkdir db/d10/dc1 0 2024-09-13T02:54:02.531 INFO:tasks.workunit.client.0.smithi089.stdout:6/565: write db/d10/fa2 [321525,8057] 0 2024-09-13T02:54:02.532 INFO:tasks.workunit.client.0.smithi089.stdout:6/566: mkdir db/d43/d6e/d28/d37/dc2 0 2024-09-13T02:54:02.534 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:02 smithi089 ceph-mon[27639]: pgmap v243: 65 pgs: 65 active+clean; 1.7 GiB data, 6.4 GiB used, 530 GiB / 536 GiB avail; 155 MiB/s rd, 206 MiB/s wr, 369 op/s 2024-09-13T02:54:02.539 INFO:tasks.workunit.client.0.smithi089.stdout:6/567: read db/d43/d6e/d28/f57 [440898,40251] 0 2024-09-13T02:54:02.622 INFO:tasks.workunit.client.0.smithi089.stdout:9/491: read d3/d6/d2a/d4b/d54/f72 [850709,69196] 0 2024-09-13T02:54:02.623 INFO:tasks.workunit.client.0.smithi089.stdout:9/492: creat d3/d6/d2a/d4b/f9c x:0 0 0 2024-09-13T02:54:02.625 INFO:tasks.workunit.client.0.smithi089.stdout:0/466: dwrite d2/d19/d1a/fa0 [0,4194304] 0 2024-09-13T02:54:02.625 INFO:tasks.workunit.client.0.smithi089.stdout:0/467: write d2/f80 [3758887,54265] 0 2024-09-13T02:54:02.625 INFO:tasks.workunit.client.0.smithi089.stdout:0/468: truncate d2/d19/d1a/d1e/d42/f8b 393479 0 2024-09-13T02:54:02.629 INFO:tasks.workunit.client.0.smithi089.stdout:6/568: dread db/f49 [0,4194304] 0 2024-09-13T02:54:02.629 INFO:tasks.workunit.client.0.smithi089.stdout:6/569: chown db/d10/d3a/l4a 36694 1 2024-09-13T02:54:02.629 INFO:tasks.workunit.client.0.smithi089.stdout:6/570: creat db/d43/d6e/d28/d37/fc3 x:0 0 0 2024-09-13T02:54:02.673 INFO:tasks.workunit.client.0.smithi089.stdout:0/469: creat d2/d19/d1a/d3d/d4b/fa2 x:0 0 0 2024-09-13T02:54:02.675 INFO:tasks.workunit.client.0.smithi089.stdout:6/571: rename db/d43/c88 to db/db2/cc4 0 2024-09-13T02:54:02.675 INFO:tasks.workunit.client.0.smithi089.stdout:6/572: readlink db/d43/d6e/d28/d2f/l3d 0 2024-09-13T02:54:02.675 INFO:tasks.workunit.client.0.smithi089.stdout:6/573: dread - db/d43/d6e/d28/d46/fab zero size 2024-09-13T02:54:02.675 INFO:tasks.workunit.client.0.smithi089.stdout:6/574: chown db/d43/d60/d7d 1557 1 2024-09-13T02:54:02.676 INFO:tasks.workunit.client.0.smithi089.stdout:0/470: link d2/d19/d1a/f8f d2/fa3 0 2024-09-13T02:54:02.677 INFO:tasks.workunit.client.0.smithi089.stdout:6/575: getdents db/d43/d6e/d28/d46/d7e 0 2024-09-13T02:54:02.677 INFO:tasks.workunit.client.0.smithi089.stdout:6/576: chown db/d10 3 1 2024-09-13T02:54:02.678 INFO:tasks.workunit.client.0.smithi089.stdout:0/471: mkdir d2/d19/d1a/da4 0 2024-09-13T02:54:02.678 INFO:tasks.workunit.client.0.smithi089.stdout:0/472: truncate d2/d19/d1a/d1e/d42/f8b 681076 0 2024-09-13T02:54:02.678 INFO:tasks.workunit.client.0.smithi089.stdout:0/473: truncate d2/f26 532357 0 2024-09-13T02:54:02.678 INFO:tasks.workunit.client.0.smithi089.stdout:0/474: chown d2/d19/d1a/d4e/d7a 205175 1 2024-09-13T02:54:02.681 INFO:tasks.workunit.client.0.smithi089.stdout:9/493: dwrite d3/d6/d2a/d94/d24/f69 [0,4194304] 0 2024-09-13T02:54:02.681 INFO:tasks.workunit.client.0.smithi089.stdout:9/494: fdatasync d3/d6/d36/f5c 0 2024-09-13T02:54:02.685 INFO:tasks.workunit.client.0.smithi089.stdout:3/519: dwrite d2/f9b [0,4194304] 0 2024-09-13T02:54:02.685 INFO:tasks.workunit.client.0.smithi089.stdout:3/520: chown d2/d20/d23/d32/d5b/d71/f8c 89937 1 2024-09-13T02:54:02.685 INFO:tasks.workunit.client.0.smithi089.stdout:3/521: chown d2/d20/f4b 7 1 2024-09-13T02:54:02.685 INFO:tasks.workunit.client.0.smithi089.stdout:9/495: rmdir d3/d3d/d8b 39 2024-09-13T02:54:02.690 INFO:tasks.workunit.client.0.smithi089.stdout:3/522: dread d2/d8/dc/f30 [0,4194304] 0 2024-09-13T02:54:02.690 INFO:tasks.workunit.client.0.smithi089.stdout:3/523: dread - d2/f41 zero size 2024-09-13T02:54:02.693 INFO:tasks.workunit.client.0.smithi089.stdout:6/577: dwrite db/d10/d3a/f81 [4194304,4194304] 0 2024-09-13T02:54:02.693 INFO:tasks.workunit.client.0.smithi089.stdout:6/578: chown db/d43/d60/d74/l86 20727580 1 2024-09-13T02:54:02.693 INFO:tasks.workunit.client.0.smithi089.stdout:6/579: fsync db/db2/fb7 0 2024-09-13T02:54:02.693 INFO:tasks.workunit.client.0.smithi089.stdout:6/580: chown db/d10/d3a 5166 1 2024-09-13T02:54:02.693 INFO:tasks.workunit.client.0.smithi089.stdout:6/581: fdatasync db/d43/d60/fbf 0 2024-09-13T02:54:02.695 INFO:tasks.workunit.client.0.smithi089.stdout:3/524: rename d2/d20/d23/d27/d51 to d2/d8/dc/d9a/d9c 0 2024-09-13T02:54:02.697 INFO:tasks.workunit.client.0.smithi089.stdout:9/496: dread d3/d6/d2a/d94/d24/d32/f7d [0,4194304] 0 2024-09-13T02:54:02.697 INFO:tasks.workunit.client.0.smithi089.stdout:9/497: chown d3/d4c 197848 1 2024-09-13T02:54:02.697 INFO:tasks.workunit.client.0.smithi089.stdout:2/527: sync 2024-09-13T02:54:02.697 INFO:tasks.workunit.client.0.smithi089.stdout:5/543: sync 2024-09-13T02:54:02.697 INFO:tasks.workunit.client.0.smithi089.stdout:7/607: sync 2024-09-13T02:54:02.697 INFO:tasks.workunit.client.0.smithi089.stdout:8/579: sync 2024-09-13T02:54:02.697 INFO:tasks.workunit.client.0.smithi089.stdout:1/508: sync 2024-09-13T02:54:02.697 INFO:tasks.workunit.client.0.smithi089.stdout:2/528: creat d13/d30/d61/d78/d79/fb6 x:0 0 0 2024-09-13T02:54:02.698 INFO:tasks.workunit.client.0.smithi089.stdout:1/509: write dc/d44/f45 [1686583,90429] 0 2024-09-13T02:54:02.699 INFO:tasks.workunit.client.0.smithi089.stdout:3/525: creat d2/d20/d23/d32/d5b/f9d x:0 0 0 2024-09-13T02:54:02.701 INFO:tasks.workunit.client.0.smithi089.stdout:7/608: mknod d3/d19/d75/db2/cc0 0 2024-09-13T02:54:02.702 INFO:tasks.workunit.client.0.smithi089.stdout:1/510: mknod dc/d46/d6c/c9c 0 2024-09-13T02:54:02.704 INFO:tasks.workunit.client.0.smithi089.stdout:1/511: mkdir dc/d44/d73/d86/d9d 0 2024-09-13T02:54:02.706 INFO:tasks.workunit.client.0.smithi089.stdout:6/582: dread db/d43/f3b [0,4194304] 0 2024-09-13T02:54:02.706 INFO:tasks.workunit.client.0.smithi089.stdout:1/512: symlink dc/d44/d73/d86/d9d/l9e 0 2024-09-13T02:54:02.708 INFO:tasks.workunit.client.0.smithi089.stdout:1/513: mknod dc/d44/d73/d86/d9d/c9f 0 2024-09-13T02:54:02.709 INFO:tasks.workunit.client.0.smithi089.stdout:1/514: write dc/d3a/d53/d2c/d34/f5f [26707,196] 0 2024-09-13T02:54:02.709 INFO:tasks.workunit.client.0.smithi089.stdout:1/515: chown dc/d3a/d53/d2c/d94/f96 1 1 2024-09-13T02:54:02.709 INFO:tasks.workunit.client.0.smithi089.stdout:9/498: read d3/d15/f3f [3693895,26697] 0 2024-09-13T02:54:02.712 INFO:tasks.workunit.client.0.smithi089.stdout:2/529: write d13/d30/d4e/f51 [3329227,402] 0 2024-09-13T02:54:02.712 INFO:tasks.workunit.client.0.smithi089.stdout:1/516: rename dc/d3a/d53/d2c/d36/c3c to dc/d44/d73/ca0 0 2024-09-13T02:54:02.713 INFO:tasks.workunit.client.0.smithi089.stdout:3/526: dread d2/d8/f21 [4194304,4194304] 0 2024-09-13T02:54:02.714 INFO:tasks.workunit.client.0.smithi089.stdout:2/530: mkdir d13/d30/d64/d82/db7 0 2024-09-13T02:54:02.715 INFO:tasks.workunit.client.0.smithi089.stdout:1/517: mkdir dc/d44/d73/d9a/da1 0 2024-09-13T02:54:02.715 INFO:tasks.workunit.client.0.smithi089.stdout:1/518: write dc/d44/f5e [1007628,85734] 0 2024-09-13T02:54:02.716 INFO:tasks.workunit.client.0.smithi089.stdout:3/527: rmdir d2/d8/dc/d9a/d9c/d83/d98 0 2024-09-13T02:54:02.718 INFO:tasks.workunit.client.0.smithi089.stdout:2/531: creat d13/d30/d4e/d6f/d76/fb8 x:0 0 0 2024-09-13T02:54:02.719 INFO:tasks.workunit.client.0.smithi089.stdout:3/528: mkdir d2/d8/dc/d3c/d9e 0 2024-09-13T02:54:02.719 INFO:tasks.workunit.client.0.smithi089.stdout:3/529: readlink d2/l5e 0 2024-09-13T02:54:02.719 INFO:tasks.workunit.client.0.smithi089.stdout:3/530: read - d2/d20/d23/d2b/f89 zero size 2024-09-13T02:54:02.721 INFO:tasks.workunit.client.0.smithi089.stdout:1/519: dread dc/d3a/d53/d2c/d36/f38 [0,4194304] 0 2024-09-13T02:54:02.722 INFO:tasks.workunit.client.0.smithi089.stdout:7/609: dread d3/d19/d67/f80 [0,4194304] 0 2024-09-13T02:54:02.723 INFO:tasks.workunit.client.0.smithi089.stdout:1/520: creat dc/d6e/fa2 x:0 0 0 2024-09-13T02:54:02.723 INFO:tasks.workunit.client.0.smithi089.stdout:1/521: chown dc/d3a/d53/f66 634604803 1 2024-09-13T02:54:02.723 INFO:tasks.workunit.client.0.smithi089.stdout:1/522: creat dc/d6e/fa3 x:0 0 0 2024-09-13T02:54:02.724 INFO:tasks.workunit.client.0.smithi089.stdout:7/610: truncate d3/d19/d75/f5a 2160216 0 2024-09-13T02:54:02.724 INFO:tasks.workunit.client.0.smithi089.stdout:7/611: truncate d3/f5 8622480 0 2024-09-13T02:54:02.724 INFO:tasks.workunit.client.0.smithi089.stdout:7/612: creat d3/d44/d85/fc1 x:0 0 0 2024-09-13T02:54:02.724 INFO:tasks.workunit.client.0.smithi089.stdout:5/544: dwrite d1/d4/d45/d6f/d4d/f58 [4194304,4194304] 0 2024-09-13T02:54:02.725 INFO:tasks.workunit.client.0.smithi089.stdout:8/580: dwrite de/d16/d1e/f30 [0,4194304] 0 2024-09-13T02:54:02.725 INFO:tasks.workunit.client.0.smithi089.stdout:8/581: chown de/d16/d1e/d20/d6c/d6e/lad 1840718 1 2024-09-13T02:54:02.726 INFO:tasks.workunit.client.0.smithi089.stdout:1/523: rename dc/d3a/d53/d2c/d34/f90 to dc/d44/d73/fa4 0 2024-09-13T02:54:02.726 INFO:tasks.workunit.client.0.smithi089.stdout:1/524: fsync dc/d46/f89 0 2024-09-13T02:54:02.726 INFO:tasks.workunit.client.0.smithi089.stdout:1/525: creat dc/d6e/fa5 x:0 0 0 2024-09-13T02:54:02.726 INFO:tasks.workunit.client.0.smithi089.stdout:1/526: chown dc/d3a/l7f 1135 1 2024-09-13T02:54:02.727 INFO:tasks.workunit.client.0.smithi089.stdout:0/475: dwrite d2/f26 [0,4194304] 0 2024-09-13T02:54:02.731 INFO:tasks.workunit.client.0.smithi089.stdout:5/545: link d1/d73/l90 d1/d4/d45/d6f/d62/d72/d99/lab 0 2024-09-13T02:54:02.731 INFO:tasks.workunit.client.0.smithi089.stdout:5/546: chown d1/d4/d2b/l84 0 1 2024-09-13T02:54:02.731 INFO:tasks.workunit.client.0.smithi089.stdout:5/547: creat d1/d4/d45/d6f/fac x:0 0 0 2024-09-13T02:54:02.731 INFO:tasks.workunit.client.0.smithi089.stdout:5/548: fsync d1/d4/d45/d6f/d4d/d7f/d49/d5a/fa3 0 2024-09-13T02:54:02.733 INFO:tasks.workunit.client.0.smithi089.stdout:8/582: unlink f5 0 2024-09-13T02:54:02.733 INFO:tasks.workunit.client.0.smithi089.stdout:8/583: read - de/d16/d1e/d27/d76/fb4 zero size 2024-09-13T02:54:02.734 INFO:tasks.workunit.client.0.smithi089.stdout:1/527: symlink dc/d46/d6c/la6 0 2024-09-13T02:54:02.736 INFO:tasks.workunit.client.0.smithi089.stdout:0/476: symlink d2/d19/d1a/d3d/d4b/d4f/d59/d6b/d87/la5 0 2024-09-13T02:54:02.737 INFO:tasks.workunit.client.0.smithi089.stdout:7/613: rmdir d3/d54 39 2024-09-13T02:54:02.737 INFO:tasks.workunit.client.0.smithi089.stdout:7/614: write d3/d44/d85/fa8 [5105319,102696] 0 2024-09-13T02:54:02.737 INFO:tasks.workunit.client.0.smithi089.stdout:7/615: write d3/fb3 [1751201,101710] 0 2024-09-13T02:54:02.737 INFO:tasks.workunit.client.0.smithi089.stdout:7/616: write d3/f5 [717513,13685] 0 2024-09-13T02:54:02.739 INFO:tasks.workunit.client.0.smithi089.stdout:5/549: mkdir d1/d4/d45/d6f/d4d/d7f/d8f/dad 0 2024-09-13T02:54:02.739 INFO:tasks.workunit.client.0.smithi089.stdout:3/531: dwrite d2/d20/d23/d32/d49/f67 [4194304,4194304] 0 2024-09-13T02:54:02.740 INFO:tasks.workunit.client.0.smithi089.stdout:3/532: readlink d2/l10 0 2024-09-13T02:54:02.740 INFO:tasks.workunit.client.0.smithi089.stdout:3/533: write d2/d20/d23/d32/d5b/d71/f8c [130670,82144] 0 2024-09-13T02:54:02.740 INFO:tasks.workunit.client.0.smithi089.stdout:1/528: truncate dc/d3a/d53/f23 2160074 0 2024-09-13T02:54:02.741 INFO:tasks.workunit.client.0.smithi089.stdout:2/532: rmdir d13 39 2024-09-13T02:54:02.741 INFO:tasks.workunit.client.0.smithi089.stdout:2/533: write d13/d30/d61/d78/d79/fb6 [1012841,16009] 0 2024-09-13T02:54:02.744 INFO:tasks.workunit.client.0.smithi089.stdout:0/477: mknod d2/d64/d91/ca6 0 2024-09-13T02:54:02.744 INFO:tasks.workunit.client.0.smithi089.stdout:0/478: truncate d2/d19/d1a/d3d/d4b/d4f/f96 715092 0 2024-09-13T02:54:02.746 INFO:tasks.workunit.client.0.smithi089.stdout:7/617: rename d3/d19/d75/f29 to d3/d19/d75/d14/d71/fc2 0 2024-09-13T02:54:02.746 INFO:tasks.workunit.client.0.smithi089.stdout:7/618: read - d3/d19/d75/d63/d83/fb9 zero size 2024-09-13T02:54:02.746 INFO:tasks.workunit.client.0.smithi089.stdout:8/584: dread de/d16/d1e/d3f/f4b [0,4194304] 0 2024-09-13T02:54:02.748 INFO:tasks.workunit.client.0.smithi089.stdout:7/619: creat d3/d44/d85/d5e/d6f/fc3 x:0 0 0 2024-09-13T02:54:02.750 INFO:tasks.workunit.client.0.smithi089.stdout:5/550: write d1/d4/d45/d6f/d4d/d7f/d49/f5d [669651,108460] 0 2024-09-13T02:54:02.750 INFO:tasks.workunit.client.0.smithi089.stdout:8/585: mkdir de/dc1 0 2024-09-13T02:54:02.752 INFO:tasks.workunit.client.0.smithi089.stdout:7/620: unlink d3/d44/d85/d77/cbb 0 2024-09-13T02:54:02.754 INFO:tasks.workunit.client.0.smithi089.stdout:5/551: symlink d1/d4/d45/d6f/d4d/d7f/d49/d5a/lae 0 2024-09-13T02:54:02.755 INFO:tasks.workunit.client.0.smithi089.stdout:0/479: dread d2/f21 [0,4194304] 0 2024-09-13T02:54:02.755 INFO:tasks.workunit.client.0.smithi089.stdout:0/480: read f1 [2247099,25376] 0 2024-09-13T02:54:02.755 INFO:tasks.workunit.client.0.smithi089.stdout:0/481: stat d2/d64/f9c 0 2024-09-13T02:54:02.755 INFO:tasks.workunit.client.0.smithi089.stdout:8/586: mkdir de/d16/d1e/d27/d52/dc2 0 2024-09-13T02:54:02.756 INFO:tasks.workunit.client.0.smithi089.stdout:7/621: rename d3/d54/f87 to d3/d19/d75/d63/da1/fc4 0 2024-09-13T02:54:02.760 INFO:tasks.workunit.client.0.smithi089.stdout:5/552: mkdir d1/d4/d45/d8c/d98/daf 0 2024-09-13T02:54:02.761 INFO:tasks.workunit.client.0.smithi089.stdout:0/482: creat d2/d19/d1a/d1e/d42/d7e/fa7 x:0 0 0 2024-09-13T02:54:02.761 INFO:tasks.workunit.client.0.smithi089.stdout:0/483: readlink d2/l75 0 2024-09-13T02:54:02.761 INFO:tasks.workunit.client.0.smithi089.stdout:0/484: creat d2/d19/d1a/d3d/d4b/d4f/d59/d6b/fa8 x:0 0 0 2024-09-13T02:54:02.761 INFO:tasks.workunit.client.0.smithi089.stdout:0/485: creat d2/d19/d1a/d3d/d4b/d4f/d59/fa9 x:0 0 0 2024-09-13T02:54:02.762 INFO:tasks.workunit.client.0.smithi089.stdout:7/622: mkdir d3/d44/d85/d55/d96/dc5 0 2024-09-13T02:54:02.762 INFO:tasks.workunit.client.0.smithi089.stdout:7/623: truncate d3/fbc 567092 0 2024-09-13T02:54:02.763 INFO:tasks.workunit.client.0.smithi089.stdout:3/534: dwrite d2/d20/f28 [0,4194304] 0 2024-09-13T02:54:02.764 INFO:tasks.workunit.client.0.smithi089.stdout:1/529: dwrite dc/d44/f99 [0,4194304] 0 2024-09-13T02:54:02.764 INFO:tasks.workunit.client.0.smithi089.stdout:1/530: write dc/f1e [742551,69842] 0 2024-09-13T02:54:02.764 INFO:tasks.workunit.client.0.smithi089.stdout:1/531: fsync dc/d46/f79 0 2024-09-13T02:54:02.764 INFO:tasks.workunit.client.0.smithi089.stdout:1/532: fsync dc/d46/f6b 0 2024-09-13T02:54:02.764 INFO:tasks.workunit.client.0.smithi089.stdout:1/533: write dc/d3a/d53/d2c/d34/f78 [815915,128182] 0 2024-09-13T02:54:02.764 INFO:tasks.workunit.client.0.smithi089.stdout:5/553: mknod d1/d4/d45/d6f/d4d/d7f/cb0 0 2024-09-13T02:54:02.767 INFO:tasks.workunit.client.0.smithi089.stdout:0/486: rmdir d2/d64/d91 39 2024-09-13T02:54:02.769 INFO:tasks.workunit.client.0.smithi089.stdout:8/587: rmdir de/d16/d1e/d20/d6c/d6e 39 2024-09-13T02:54:02.769 INFO:tasks.workunit.client.0.smithi089.stdout:8/588: fsync de/f4d 0 2024-09-13T02:54:02.770 INFO:tasks.workunit.client.0.smithi089.stdout:7/624: creat d3/d19/d75/d14/d71/fc6 x:0 0 0 2024-09-13T02:54:02.773 INFO:tasks.workunit.client.0.smithi089.stdout:1/534: symlink dc/d46/d6c/la7 0 2024-09-13T02:54:02.774 INFO:tasks.workunit.client.0.smithi089.stdout:0/487: symlink d2/d19/d1a/d3d/laa 0 2024-09-13T02:54:02.775 INFO:tasks.workunit.client.0.smithi089.stdout:7/625: mknod d3/d19/d75/db2/cc7 0 2024-09-13T02:54:02.777 INFO:tasks.workunit.client.0.smithi089.stdout:7/626: fdatasync d3/d19/d2e/f4f 0 2024-09-13T02:54:02.778 INFO:tasks.workunit.client.0.smithi089.stdout:0/488: chown d2/c12 3186319 1 2024-09-13T02:54:02.778 INFO:tasks.workunit.client.0.smithi089.stdout:0/489: chown d2/d19/d1a/d3d/d4b/d4f/f58 14988 1 2024-09-13T02:54:02.778 INFO:tasks.workunit.client.0.smithi089.stdout:0/490: write d2/d19/d1a/d3d/d4b/d4f/f6d [241539,120934] 0 2024-09-13T02:54:02.779 INFO:tasks.workunit.client.0.smithi089.stdout:0/491: chown d2/d19/d1a/d1e/d42 900 1 2024-09-13T02:54:02.780 INFO:tasks.workunit.client.0.smithi089.stdout:5/554: write d1/f47 [2051001,96692] 0 2024-09-13T02:54:02.780 INFO:tasks.workunit.client.0.smithi089.stdout:5/555: readlink d1/d4/d45/d6f/d4d/d7f/d49/l41 0 2024-09-13T02:54:02.781 INFO:tasks.workunit.client.0.smithi089.stdout:0/492: rename d2/d19/f22 to d2/d64/fab 0 2024-09-13T02:54:02.781 INFO:tasks.workunit.client.0.smithi089.stdout:0/493: chown d2/d19/d1a/d1e/d42/d7e 6 1 2024-09-13T02:54:02.781 INFO:tasks.workunit.client.0.smithi089.stdout:0/494: dread - d2/d19/d1a/d3d/d4b/d4f/f9d zero size 2024-09-13T02:54:02.781 INFO:tasks.workunit.client.0.smithi089.stdout:0/495: fsync d2/d19/d1a/d3d/d4b/d4f/d59/f7c 0 2024-09-13T02:54:02.782 INFO:tasks.workunit.client.0.smithi089.stdout:5/556: symlink d1/d4/d45/d6f/d62/lb1 0 2024-09-13T02:54:02.782 INFO:tasks.workunit.client.0.smithi089.stdout:5/557: chown d1/d7/c6c 111423544 1 2024-09-13T02:54:02.784 INFO:tasks.workunit.client.0.smithi089.stdout:5/558: mkdir d1/d4/d45/d6f/d7c/db2 0 2024-09-13T02:54:02.784 INFO:tasks.workunit.client.0.smithi089.stdout:5/559: fdatasync d1/d4/d45/d6f/d4d/f58 0 2024-09-13T02:54:02.788 INFO:tasks.workunit.client.0.smithi089.stdout:3/535: dwrite d2/f41 [0,4194304] 0 2024-09-13T02:54:02.788 INFO:tasks.workunit.client.0.smithi089.stdout:3/536: write d2/d8/d5f/f62 [9387775,50036] 0 2024-09-13T02:54:02.789 INFO:tasks.workunit.client.0.smithi089.stdout:8/589: dwrite de/d16/d1e/d27/d76/f89 [0,4194304] 0 2024-09-13T02:54:02.792 INFO:tasks.workunit.client.0.smithi089.stdout:3/537: symlink d2/d8/dc/d9a/d9c/d6c/l9f 0 2024-09-13T02:54:02.793 INFO:tasks.workunit.client.0.smithi089.stdout:3/538: fdatasync d2/d20/d23/d32/d5b/f8a 0 2024-09-13T02:54:02.793 INFO:tasks.workunit.client.0.smithi089.stdout:3/539: write d2/d20/d44/f58 [477790,129022] 0 2024-09-13T02:54:02.793 INFO:tasks.workunit.client.0.smithi089.stdout:8/590: dread de/d16/d1e/f4e [0,4194304] 0 2024-09-13T02:54:02.797 INFO:tasks.workunit.client.0.smithi089.stdout:7/627: getdents d3/d19/d75/db2 0 2024-09-13T02:54:02.808 INFO:tasks.workunit.client.0.smithi089.stdout:3/540: read d2/d20/d23/d32/d5b/f79 [1519195,69306] 0 2024-09-13T02:54:02.810 INFO:tasks.workunit.client.0.smithi089.stdout:3/541: mkdir d2/da0 0 2024-09-13T02:54:02.810 INFO:tasks.workunit.client.0.smithi089.stdout:3/542: creat d2/d20/fa1 x:0 0 0 2024-09-13T02:54:02.810 INFO:tasks.workunit.client.0.smithi089.stdout:8/591: dread de/d16/d1e/d20/d6c/d6e/f7d [0,4194304] 0 2024-09-13T02:54:02.813 INFO:tasks.workunit.client.0.smithi089.stdout:1/535: dwrite dc/f21 [0,4194304] 0 2024-09-13T02:54:02.814 INFO:tasks.workunit.client.0.smithi089.stdout:1/536: creat dc/d44/d73/fa8 x:0 0 0 2024-09-13T02:54:02.815 INFO:tasks.workunit.client.0.smithi089.stdout:1/537: rmdir dc/d3a/d53/d2c/d34/d8b 39 2024-09-13T02:54:02.816 INFO:tasks.workunit.client.0.smithi089.stdout:0/496: dwrite d2/f28 [0,4194304] 0 2024-09-13T02:54:02.817 INFO:tasks.workunit.client.0.smithi089.stdout:5/560: dwrite d1/d4/d45/d6f/f74 [0,4194304] 0 2024-09-13T02:54:02.817 INFO:tasks.workunit.client.0.smithi089.stdout:5/561: creat d1/d4/d45/d6f/d4d/d7f/d49/fb3 x:0 0 0 2024-09-13T02:54:02.817 INFO:tasks.workunit.client.0.smithi089.stdout:7/628: dwrite d3/d44/d85/d77/f8c [0,4194304] 0 2024-09-13T02:54:02.822 INFO:tasks.workunit.client.0.smithi089.stdout:0/497: rename d2/d19/d1a/f57 to d2/d19/d1a/d3d/fac 0 2024-09-13T02:54:02.823 INFO:tasks.workunit.client.0.smithi089.stdout:5/562: stat d1/d7/l40 0 2024-09-13T02:54:02.823 INFO:tasks.workunit.client.0.smithi089.stdout:5/563: dread - d1/d4/d45/d6f/d62/d72/f92 zero size 2024-09-13T02:54:02.825 INFO:tasks.workunit.client.0.smithi089.stdout:3/543: dwrite d2/d8/dc/f2c [0,4194304] 0 2024-09-13T02:54:02.826 INFO:tasks.workunit.client.0.smithi089.stdout:0/498: unlink d2/d19/d1a/d3d/l50 0 2024-09-13T02:54:02.827 INFO:tasks.workunit.client.0.smithi089.stdout:5/564: symlink d1/d4/d45/d6f/lb4 0 2024-09-13T02:54:02.829 INFO:tasks.workunit.client.0.smithi089.stdout:3/544: creat d2/d8/dc/fa2 x:0 0 0 2024-09-13T02:54:02.830 INFO:tasks.workunit.client.0.smithi089.stdout:5/565: creat d1/d4/d45/d6f/d4d/d7f/d8f/dad/fb5 x:0 0 0 2024-09-13T02:54:02.832 INFO:tasks.workunit.client.0.smithi089.stdout:3/545: link d2/d8/dc/c11 d2/d8/dc/d57/ca3 0 2024-09-13T02:54:02.832 INFO:tasks.workunit.client.0.smithi089.stdout:3/546: readlink d2/d20/l46 0 2024-09-13T02:54:02.832 INFO:tasks.workunit.client.0.smithi089.stdout:3/547: fdatasync d2/d8/d5f/f62 0 2024-09-13T02:54:02.833 INFO:tasks.workunit.client.0.smithi089.stdout:5/566: link d1/d7/f30 d1/fb6 0 2024-09-13T02:54:02.833 INFO:tasks.workunit.client.0.smithi089.stdout:5/567: chown d1/d4 29 1 2024-09-13T02:54:02.833 INFO:tasks.workunit.client.0.smithi089.stdout:5/568: readlink d1/d7/l40 0 2024-09-13T02:54:02.835 INFO:tasks.workunit.client.0.smithi089.stdout:3/548: mkdir d2/d20/d23/d32/d5b/d71/d92/da4 0 2024-09-13T02:54:02.836 INFO:tasks.workunit.client.0.smithi089.stdout:5/569: unlink d1/d4/d45/d6f/f61 0 2024-09-13T02:54:02.837 INFO:tasks.workunit.client.0.smithi089.stdout:3/549: truncate d2/d20/d23/d32/d5b/f79 3422639 0 2024-09-13T02:54:02.837 INFO:tasks.workunit.client.0.smithi089.stdout:3/550: write d2/d20/d23/d27/f4e [812322,111300] 0 2024-09-13T02:54:02.837 INFO:tasks.workunit.client.0.smithi089.stdout:3/551: fsync d2/d20/d23/f88 0 2024-09-13T02:54:02.838 INFO:tasks.workunit.client.0.smithi089.stdout:5/570: mknod d1/d4/d2b/da9/cb7 0 2024-09-13T02:54:02.838 INFO:tasks.workunit.client.0.smithi089.stdout:5/571: write d1/d4/d45/d6f/d4d/d7f/d49/d5a/fa3 [825995,14759] 0 2024-09-13T02:54:02.839 INFO:tasks.workunit.client.0.smithi089.stdout:3/552: creat d2/d20/d23/d32/d5b/d71/fa5 x:0 0 0 2024-09-13T02:54:02.840 INFO:tasks.workunit.client.0.smithi089.stdout:5/572: creat d1/d4/d45/d6f/d7c/fb8 x:0 0 0 2024-09-13T02:54:02.841 INFO:tasks.workunit.client.0.smithi089.stdout:3/553: unlink d2/d8/dc/d57/c66 0 2024-09-13T02:54:02.841 INFO:tasks.workunit.client.0.smithi089.stdout:3/554: truncate d2/d20/d23/d32/d5b/f8a 1021504 0 2024-09-13T02:54:02.842 INFO:tasks.workunit.client.0.smithi089.stdout:3/555: creat d2/d8/dc/fa6 x:0 0 0 2024-09-13T02:54:02.842 INFO:tasks.workunit.client.0.smithi089.stdout:5/573: creat d1/d4/d45/d8c/d98/fb9 x:0 0 0 2024-09-13T02:54:02.844 INFO:tasks.workunit.client.0.smithi089.stdout:5/574: rename d1/d4/f14 to d1/d4/d45/d6f/d7c/fba 0 2024-09-13T02:54:02.846 INFO:tasks.workunit.client.0.smithi089.stdout:7/629: dwrite d3/d19/f36 [0,4194304] 0 2024-09-13T02:54:02.846 INFO:tasks.workunit.client.0.smithi089.stdout:7/630: chown d3/d19/d2e/f6e 28285870 1 2024-09-13T02:54:02.846 INFO:tasks.workunit.client.0.smithi089.stdout:0/499: dwrite d2/d19/d1a/d3d/d4b/d4f/f5e [0,4194304] 0 2024-09-13T02:54:02.846 INFO:tasks.workunit.client.0.smithi089.stdout:0/500: chown d2/d19/d1a/d3d/d4b/l60 1297578 1 2024-09-13T02:54:02.847 INFO:tasks.workunit.client.0.smithi089.stdout:5/575: creat d1/d4/d45/d8c/fbb x:0 0 0 2024-09-13T02:54:02.847 INFO:tasks.workunit.client.0.smithi089.stdout:5/576: creat d1/d4/d45/d6f/d4d/d7f/d49/fbc x:0 0 0 2024-09-13T02:54:02.847 INFO:tasks.workunit.client.0.smithi089.stdout:3/556: fsync d2/d20/d23/d32/d49/f56 0 2024-09-13T02:54:02.848 INFO:tasks.workunit.client.0.smithi089.stdout:0/501: symlink d2/d19/d1a/d1e/lad 0 2024-09-13T02:54:02.849 INFO:tasks.workunit.client.0.smithi089.stdout:5/577: creat d1/d7/fbd x:0 0 0 2024-09-13T02:54:02.850 INFO:tasks.workunit.client.0.smithi089.stdout:4/629: sync 2024-09-13T02:54:02.851 INFO:tasks.workunit.client.0.smithi089.stdout:4/630: write d2/d3/d5/d43/f65 [563476,106909] 0 2024-09-13T02:54:02.852 INFO:tasks.workunit.client.0.smithi089.stdout:3/557: rename d2/d20/d44/f58 to d2/d8/dc/fa7 0 2024-09-13T02:54:02.852 INFO:tasks.workunit.client.0.smithi089.stdout:3/558: chown d2/l5e 99718149 1 2024-09-13T02:54:02.853 INFO:tasks.workunit.client.0.smithi089.stdout:0/502: symlink d2/d19/d1a/d4e/lae 0 2024-09-13T02:54:02.853 INFO:tasks.workunit.client.0.smithi089.stdout:5/578: symlink d1/d73/lbe 0 2024-09-13T02:54:02.856 INFO:tasks.workunit.client.0.smithi089.stdout:3/559: rename d2/d20/d23/d27/c2e to d2/d8/dc/d3c/d65/ca8 0 2024-09-13T02:54:02.857 INFO:tasks.workunit.client.0.smithi089.stdout:5/579: mkdir d1/d4/d45/d6f/d7c/db2/dbf 0 2024-09-13T02:54:02.858 INFO:tasks.workunit.client.0.smithi089.stdout:5/580: dread - d1/d4/d45/d6f/fac zero size 2024-09-13T02:54:02.858 INFO:tasks.workunit.client.0.smithi089.stdout:7/631: dread d3/d44/f39 [0,4194304] 0 2024-09-13T02:54:02.862 INFO:tasks.workunit.client.0.smithi089.stdout:4/631: read d2/f73 [3199635,22970] 0 2024-09-13T02:54:02.864 INFO:tasks.workunit.client.0.smithi089.stdout:3/560: dread d2/f9b [0,4194304] 0 2024-09-13T02:54:02.864 INFO:tasks.workunit.client.0.smithi089.stdout:7/632: rename d3/d19/d75/d63/d83 to d3/d19/dc8 0 2024-09-13T02:54:02.865 INFO:tasks.workunit.client.0.smithi089.stdout:3/561: write d2/d20/d23/f88 [181848,14208] 0 2024-09-13T02:54:02.865 INFO:tasks.workunit.client.0.smithi089.stdout:3/562: write d2/d20/f4b [900331,117443] 0 2024-09-13T02:54:02.866 INFO:tasks.workunit.client.0.smithi089.stdout:4/632: unlink d2/d3/d5/l57 0 2024-09-13T02:54:02.869 INFO:tasks.workunit.client.0.smithi089.stdout:5/581: write d1/d4/d45/d6f/d62/f8a [3974405,63835] 0 2024-09-13T02:54:02.869 INFO:tasks.workunit.client.0.smithi089.stdout:7/633: dread d3/d19/d75/f4e [0,4194304] 0 2024-09-13T02:54:02.869 INFO:tasks.workunit.client.0.smithi089.stdout:0/503: dwrite d2/d19/d1a/d3d/d4b/d4f/f6d [0,4194304] 0 2024-09-13T02:54:02.874 INFO:tasks.workunit.client.0.smithi089.stdout:0/504: mknod d2/d19/d1a/d4e/d9a/caf 0 2024-09-13T02:54:02.875 INFO:tasks.workunit.client.0.smithi089.stdout:3/563: getdents d2/d20/d23/d27 0 2024-09-13T02:54:02.877 INFO:tasks.workunit.client.0.smithi089.stdout:5/582: dread d1/f69 [0,4194304] 0 2024-09-13T02:54:02.880 INFO:tasks.workunit.client.0.smithi089.stdout:0/505: creat d2/fb0 x:0 0 0 2024-09-13T02:54:02.880 INFO:tasks.workunit.client.0.smithi089.stdout:3/564: rmdir d2/d8/dc/d9a/d9c 39 2024-09-13T02:54:02.881 INFO:tasks.workunit.client.0.smithi089.stdout:0/506: fsync d2/f13 0 2024-09-13T02:54:02.881 INFO:tasks.workunit.client.0.smithi089.stdout:0/507: write d2/d19/d1a/d1e/d42/f45 [648561,2356] 0 2024-09-13T02:54:02.881 INFO:tasks.workunit.client.0.smithi089.stdout:0/508: write d2/d19/d1a/d1e/d42/f8b [1378467,63483] 0 2024-09-13T02:54:02.885 INFO:tasks.workunit.client.0.smithi089.stdout:7/634: write d3/d44/d85/fa8 [3831673,124229] 0 2024-09-13T02:54:02.885 INFO:tasks.workunit.client.0.smithi089.stdout:0/509: dread d2/d19/d1a/d3d/d4b/d4f/f81 [0,4194304] 0 2024-09-13T02:54:02.885 INFO:tasks.workunit.client.0.smithi089.stdout:0/510: truncate d2/d19/d1a/d3d/d4b/d4f/d59/d6b/f99 652101 0 2024-09-13T02:54:02.886 INFO:tasks.workunit.client.0.smithi089.stdout:5/583: dread d1/d4/d45/d6f/d4d/f7e [0,4194304] 0 2024-09-13T02:54:02.886 INFO:tasks.workunit.client.0.smithi089.stdout:5/584: chown d1/fd 39841631 1 2024-09-13T02:54:02.886 INFO:tasks.workunit.client.0.smithi089.stdout:3/565: dread d2/d8/dc/d3c/f5d [0,4194304] 0 2024-09-13T02:54:02.887 INFO:tasks.workunit.client.0.smithi089.stdout:3/566: fsync d2/d8/f21 0 2024-09-13T02:54:02.887 INFO:tasks.workunit.client.0.smithi089.stdout:7/635: readlink d3/d19/l2b 0 2024-09-13T02:54:02.887 INFO:tasks.workunit.client.0.smithi089.stdout:0/511: mkdir d2/d64/db1 0 2024-09-13T02:54:02.888 INFO:tasks.workunit.client.0.smithi089.stdout:5/585: link d1/d4/d45/d6f/d4d/f7a d1/d4/d45/d6f/d4d/d9d/daa/fc0 0 2024-09-13T02:54:02.888 INFO:tasks.workunit.client.0.smithi089.stdout:5/586: readlink d1/d4/d45/d6f/d4d/d7f/l95 0 2024-09-13T02:54:02.888 INFO:tasks.workunit.client.0.smithi089.stdout:5/587: write d1/d4/d45/d8c/d98/fb9 [798235,69870] 0 2024-09-13T02:54:02.888 INFO:tasks.workunit.client.0.smithi089.stdout:5/588: fdatasync d1/d4/d45/d6f/d4d/f71 0 2024-09-13T02:54:02.888 INFO:tasks.workunit.client.0.smithi089.stdout:5/589: readlink d1/d73/l90 0 2024-09-13T02:54:02.889 INFO:tasks.workunit.client.0.smithi089.stdout:3/567: link d2/d8/dc/f30 d2/d90/fa9 0 2024-09-13T02:54:02.889 INFO:tasks.workunit.client.0.smithi089.stdout:7/636: symlink d3/d19/d75/d63/da1/db4/lc9 0 2024-09-13T02:54:02.891 INFO:tasks.workunit.client.0.smithi089.stdout:3/568: unlink d2/d8/dc/d3c/d65/f81 0 2024-09-13T02:54:02.892 INFO:tasks.workunit.client.0.smithi089.stdout:3/569: chown d2/d20/d23/d32/d49 5 1 2024-09-13T02:54:02.892 INFO:tasks.workunit.client.0.smithi089.stdout:7/637: mkdir d3/d44/dca 0 2024-09-13T02:54:02.892 INFO:tasks.workunit.client.0.smithi089.stdout:7/638: fsync d3/d44/d85/d5e/d6f/fae 0 2024-09-13T02:54:02.894 INFO:tasks.workunit.client.0.smithi089.stdout:3/570: unlink d2/d20/d44/c5c 0 2024-09-13T02:54:02.894 INFO:tasks.workunit.client.0.smithi089.stdout:7/639: truncate d3/d44/d85/d5e/d6f/fa3 1934761 0 2024-09-13T02:54:02.894 INFO:tasks.workunit.client.0.smithi089.stdout:7/640: truncate d3/d19/d75/d63/fb7 472275 0 2024-09-13T02:54:02.894 INFO:tasks.workunit.client.0.smithi089.stdout:7/641: creat d3/d19/d75/d63/da1/fcb x:0 0 0 2024-09-13T02:54:02.894 INFO:tasks.workunit.client.0.smithi089.stdout:5/590: write d1/f5e [3010576,73440] 0 2024-09-13T02:54:02.897 INFO:tasks.workunit.client.0.smithi089.stdout:0/512: read d2/d19/d1a/d3d/d4b/d4f/f58 [372494,128152] 0 2024-09-13T02:54:02.897 INFO:tasks.workunit.client.0.smithi089.stdout:0/513: truncate d2/fa3 250320 0 2024-09-13T02:54:02.897 INFO:tasks.workunit.client.0.smithi089.stdout:4/633: dwrite d2/d22/f34 [0,4194304] 0 2024-09-13T02:54:02.898 INFO:tasks.workunit.client.0.smithi089.stdout:5/591: rename d1/d4/d45/d6f/f88 to d1/d4/d45/d6f/d7c/fc1 0 2024-09-13T02:54:02.899 INFO:tasks.workunit.client.0.smithi089.stdout:5/592: write d1/d7/f65 [115888,13731] 0 2024-09-13T02:54:02.899 INFO:tasks.workunit.client.0.smithi089.stdout:5/593: truncate d1/d4/d45/d6f/d62/d72/f92 364321 0 2024-09-13T02:54:02.899 INFO:tasks.workunit.client.0.smithi089.stdout:5/594: creat d1/d4/d45/d6f/fc2 x:0 0 0 2024-09-13T02:54:02.899 INFO:tasks.workunit.client.0.smithi089.stdout:0/514: mknod d2/d19/d1a/d3d/d4b/d4f/d59/d6b/cb2 0 2024-09-13T02:54:02.907 INFO:tasks.workunit.client.0.smithi089.stdout:4/634: creat d2/d3/d5/d43/d3b/d71/d99/daf/dc6/fd0 x:0 0 0 2024-09-13T02:54:02.907 INFO:tasks.workunit.client.0.smithi089.stdout:4/635: chown d2/d3/d5/d43/d84 52489 1 2024-09-13T02:54:02.908 INFO:tasks.workunit.client.0.smithi089.stdout:0/515: mkdir d2/d64/db3 0 2024-09-13T02:54:02.909 INFO:tasks.workunit.client.0.smithi089.stdout:4/636: symlink d2/d3/d5/d43/d3b/d71/d99/daf/dc6/ld1 0 2024-09-13T02:54:02.909 INFO:tasks.workunit.client.0.smithi089.stdout:4/637: chown d2/d3/d5/d43/d3b/d71/d99/daf/d8f/fce 23627 1 2024-09-13T02:54:02.910 INFO:tasks.workunit.client.0.smithi089.stdout:0/516: rename f1 to d2/d19/d1a/d3d/d4b/d4f/d59/d6b/fb4 0 2024-09-13T02:54:02.912 INFO:tasks.workunit.client.0.smithi089.stdout:4/638: rename d2/f1f to d2/d3/d5/d43/d3b/fd2 0 2024-09-13T02:54:02.912 INFO:tasks.workunit.client.0.smithi089.stdout:4/639: chown d2/d3/d5/fc8 58047 1 2024-09-13T02:54:02.913 INFO:tasks.workunit.client.0.smithi089.stdout:0/517: mkdir d2/d19/d1a/d4e/d7a/d9b/db5 0 2024-09-13T02:54:02.914 INFO:tasks.workunit.client.0.smithi089.stdout:4/640: unlink d2/d3/d5/d43/d3b/d71/d99/cbc 0 2024-09-13T02:54:02.915 INFO:tasks.workunit.client.0.smithi089.stdout:4/641: symlink d2/d3/ld3 0 2024-09-13T02:54:02.915 INFO:tasks.workunit.client.0.smithi089.stdout:4/642: write d2/d3/d5/d49/fac [1066643,117409] 0 2024-09-13T02:54:02.916 INFO:tasks.workunit.client.0.smithi089.stdout:4/643: getdents d2/d3/d5/d43/d84 0 2024-09-13T02:54:02.916 INFO:tasks.workunit.client.0.smithi089.stdout:4/644: write d2/d3/d5/d43/d3b/fd2 [1782767,84592] 0 2024-09-13T02:54:02.916 INFO:tasks.workunit.client.0.smithi089.stdout:4/645: write d2/d3/d5/d43/d3b/f54 [3289632,124744] 0 2024-09-13T02:54:02.916 INFO:tasks.workunit.client.0.smithi089.stdout:4/646: fsync d2/d3/d5/d43/d3b/d71/d99/fb1 0 2024-09-13T02:54:02.916 INFO:tasks.workunit.client.0.smithi089.stdout:4/647: fdatasync d2/d3/d5/d43/d3b/d71/d99/fa3 0 2024-09-13T02:54:02.917 INFO:tasks.workunit.client.0.smithi089.stdout:4/648: symlink d2/d22/ld4 0 2024-09-13T02:54:02.917 INFO:tasks.workunit.client.0.smithi089.stdout:4/649: fsync d2/d22/da1/f95 0 2024-09-13T02:54:02.917 INFO:tasks.workunit.client.0.smithi089.stdout:4/650: write d2/d3/d5/fc8 [145234,52266] 0 2024-09-13T02:54:02.917 INFO:tasks.workunit.client.0.smithi089.stdout:4/651: write d2/d3/fba [245469,129198] 0 2024-09-13T02:54:02.919 INFO:tasks.workunit.client.0.smithi089.stdout:0/518: dread d2/d19/f32 [0,4194304] 0 2024-09-13T02:54:02.919 INFO:tasks.workunit.client.0.smithi089.stdout:0/519: write d2/d19/d1a/d3d/d4b/d4f/d59/fa9 [717041,44061] 0 2024-09-13T02:54:02.919 INFO:tasks.workunit.client.0.smithi089.stdout:0/520: mkdir d2/d19/d1a/d4e/d7a/d9b/db5/db6 0 2024-09-13T02:54:02.920 INFO:tasks.workunit.client.0.smithi089.stdout:0/521: creat d2/d19/d1a/d4e/d7a/d9b/db5/fb7 x:0 0 0 2024-09-13T02:54:02.921 INFO:tasks.workunit.client.0.smithi089.stdout:0/522: creat d2/d19/d1a/d4e/fb8 x:0 0 0 2024-09-13T02:54:02.923 INFO:tasks.workunit.client.0.smithi089.stdout:0/523: creat d2/d19/d1a/da4/fb9 x:0 0 0 2024-09-13T02:54:02.923 INFO:tasks.workunit.client.0.smithi089.stdout:0/524: fsync d2/d19/d1a/d3d/d4b/d4f/f5e 0 2024-09-13T02:54:02.923 INFO:tasks.workunit.client.0.smithi089.stdout:6/583: sync 2024-09-13T02:54:02.925 INFO:tasks.workunit.client.0.smithi089.stdout:3/571: dwrite d2/f9b [4194304,4194304] 0 2024-09-13T02:54:02.925 INFO:tasks.workunit.client.0.smithi089.stdout:0/525: creat d2/fba x:0 0 0 2024-09-13T02:54:02.925 INFO:tasks.workunit.client.0.smithi089.stdout:7/642: dwrite d3/d19/d75/d14/d71/fc2 [0,4194304] 0 2024-09-13T02:54:02.925 INFO:tasks.workunit.client.0.smithi089.stdout:7/643: truncate d3/d19/d75/fa7 12485 0 2024-09-13T02:54:02.925 INFO:tasks.workunit.client.0.smithi089.stdout:7/644: truncate d3/d19/d75/d14/d71/fc6 448424 0 2024-09-13T02:54:02.925 INFO:tasks.workunit.client.0.smithi089.stdout:5/595: dwrite d1/d4/d45/d6f/d7c/fc1 [0,4194304] 0 2024-09-13T02:54:02.925 INFO:tasks.workunit.client.0.smithi089.stdout:5/596: dread - d1/d4/d45/d6f/d4d/d7f/d49/d5a/f89 zero size 2024-09-13T02:54:02.926 INFO:tasks.workunit.client.0.smithi089.stdout:0/526: rmdir d2/d19/d1a/d4e/d7a/d9b/db5/db6 0 2024-09-13T02:54:02.926 INFO:tasks.workunit.client.0.smithi089.stdout:3/572: creat d2/d8/dc/d9a/d9c/faa x:0 0 0 2024-09-13T02:54:02.927 INFO:tasks.workunit.client.0.smithi089.stdout:4/652: write d2/d22/f3f [1496311,70815] 0 2024-09-13T02:54:02.928 INFO:tasks.workunit.client.0.smithi089.stdout:7/645: symlink d3/d44/lcc 0 2024-09-13T02:54:02.933 INFO:tasks.workunit.client.0.smithi089.stdout:6/584: write db/d10/d3a/f8a [1327101,120502] 0 2024-09-13T02:54:02.941 INFO:tasks.workunit.client.0.smithi089.stdout:0/527: unlink d2/d19/d1a/d4e/d7a/c9f 0 2024-09-13T02:54:02.941 INFO:tasks.workunit.client.0.smithi089.stdout:0/528: readlink d2/d19/d1a/d4e/d7a/d9b/l76 0 2024-09-13T02:54:02.943 INFO:tasks.workunit.client.0.smithi089.stdout:3/573: mkdir d2/d8/dc/d9a/d9c/dab 0 2024-09-13T02:54:02.945 INFO:tasks.workunit.client.0.smithi089.stdout:4/653: mknod d2/d22/da1/d62/d6c/d88/db2/cd5 0 2024-09-13T02:54:02.947 INFO:tasks.workunit.client.0.smithi089.stdout:7/646: link d3/d19/d75/l48 d3/d44/d85/d55/lcd 0 2024-09-13T02:54:02.947 INFO:tasks.workunit.client.0.smithi089.stdout:7/647: read d3/d19/d75/f4a [154964,65370] 0 2024-09-13T02:54:02.947 INFO:tasks.workunit.client.0.smithi089.stdout:7/648: dread - d3/d44/d85/d5e/fb1 zero size 2024-09-13T02:54:02.947 INFO:tasks.workunit.client.0.smithi089.stdout:7/649: write d3/d44/d85/f50 [2153506,24694] 0 2024-09-13T02:54:02.948 INFO:tasks.workunit.client.0.smithi089.stdout:6/585: chown db/d10/l70 27268 1 2024-09-13T02:54:02.948 INFO:tasks.workunit.client.0.smithi089.stdout:6/586: chown db/d10/fa4 12 1 2024-09-13T02:54:02.951 INFO:tasks.workunit.client.0.smithi089.stdout:0/529: rename d2/d19/d1a/d3d/d4b/d4f/d59/d6b/cb2 to d2/d19/d1a/d1e/d42/cbb 0 2024-09-13T02:54:02.951 INFO:tasks.workunit.client.0.smithi089.stdout:0/530: readlink d2/d19/l9e 0 2024-09-13T02:54:02.952 INFO:tasks.workunit.client.0.smithi089.stdout:0/531: readlink d2/d19/d1a/d3d/d4b/d4f/d59/d6b/d87/la5 0 2024-09-13T02:54:02.952 INFO:tasks.workunit.client.0.smithi089.stdout:5/597: dread d1/d4/f17 [0,4194304] 0 2024-09-13T02:54:02.952 INFO:tasks.workunit.client.0.smithi089.stdout:3/574: mknod d2/d20/d23/d32/d49/cac 0 2024-09-13T02:54:02.952 INFO:tasks.workunit.client.0.smithi089.stdout:3/575: creat d2/d20/d23/d2b/fad x:0 0 0 2024-09-13T02:54:02.952 INFO:tasks.workunit.client.0.smithi089.stdout:3/576: readlink d2/d20/l40 0 2024-09-13T02:54:02.952 INFO:tasks.workunit.client.0.smithi089.stdout:3/577: stat d2/d20/f39 0 2024-09-13T02:54:02.952 INFO:tasks.workunit.client.0.smithi089.stdout:4/654: truncate d2/d22/f34 3067456 0 2024-09-13T02:54:02.952 INFO:tasks.workunit.client.0.smithi089.stdout:6/587: rmdir db 39 2024-09-13T02:54:02.957 INFO:tasks.workunit.client.0.smithi089.stdout:0/532: unlink d2/d19/d1a/d1e/d42/c84 0 2024-09-13T02:54:02.957 INFO:tasks.workunit.client.0.smithi089.stdout:7/650: read d3/d44/d85/d77/f8c [3162693,103833] 0 2024-09-13T02:54:02.960 INFO:tasks.workunit.client.0.smithi089.stdout:3/578: link d2/d20/d23/d2b/f89 d2/d8/dc/d57/fae 0 2024-09-13T02:54:02.964 INFO:tasks.workunit.client.0.smithi089.stdout:4/655: mknod d2/d3/d5/d43/d3b/d71/d99/cd6 0 2024-09-13T02:54:02.964 INFO:tasks.workunit.client.0.smithi089.stdout:7/651: creat d3/d44/d85/d55/d96/dc5/fce x:0 0 0 2024-09-13T02:54:02.965 INFO:tasks.workunit.client.0.smithi089.stdout:3/579: rename d2/d20/d23/d32/d5b/d94 to d2/d8b/daf 0 2024-09-13T02:54:02.967 INFO:tasks.workunit.client.0.smithi089.stdout:1/538: sync 2024-09-13T02:54:02.967 INFO:tasks.workunit.client.0.smithi089.stdout:2/534: sync 2024-09-13T02:54:02.967 INFO:tasks.workunit.client.0.smithi089.stdout:9/499: sync 2024-09-13T02:54:02.967 INFO:tasks.workunit.client.0.smithi089.stdout:8/592: sync 2024-09-13T02:54:02.968 INFO:tasks.workunit.client.0.smithi089.stdout:7/652: mknod d3/d54/ccf 0 2024-09-13T02:54:02.969 INFO:tasks.workunit.client.0.smithi089.stdout:3/580: mknod d2/d20/d23/d2b/cb0 0 2024-09-13T02:54:02.971 INFO:tasks.workunit.client.0.smithi089.stdout:4/656: symlink d2/d3/d5/d43/d3b/d71/d99/daf/ld7 0 2024-09-13T02:54:02.971 INFO:tasks.workunit.client.0.smithi089.stdout:4/657: dread - d2/d3/d5/d72/fcb zero size 2024-09-13T02:54:02.973 INFO:tasks.workunit.client.0.smithi089.stdout:2/535: link d13/c36 d13/d30/d59/cb9 0 2024-09-13T02:54:02.973 INFO:tasks.workunit.client.0.smithi089.stdout:3/581: dread d2/f9b [0,4194304] 0 2024-09-13T02:54:02.973 INFO:tasks.workunit.client.0.smithi089.stdout:3/582: truncate d2/d20/d23/d27/f4e 1060751 0 2024-09-13T02:54:02.974 INFO:tasks.workunit.client.0.smithi089.stdout:1/539: mknod dc/d3a/ca9 0 2024-09-13T02:54:02.976 INFO:tasks.workunit.client.0.smithi089.stdout:8/593: mknod de/d16/d1e/d20/d6c/d6e/cc3 0 2024-09-13T02:54:02.977 INFO:tasks.workunit.client.0.smithi089.stdout:5/598: dwrite d1/d4/d2b/f52 [0,4194304] 0 2024-09-13T02:54:02.977 INFO:tasks.workunit.client.0.smithi089.stdout:5/599: creat d1/d4/d45/d6f/d4d/d7f/d8f/dad/fc3 x:0 0 0 2024-09-13T02:54:02.977 INFO:tasks.workunit.client.0.smithi089.stdout:5/600: truncate d1/d4/d45/d6f/d4d/d7f/f96 146458 0 2024-09-13T02:54:02.978 INFO:tasks.workunit.client.0.smithi089.stdout:7/653: creat d3/d19/d75/d14/da0/db0/fd0 x:0 0 0 2024-09-13T02:54:02.978 INFO:tasks.workunit.client.0.smithi089.stdout:7/654: creat d3/d44/d85/d55/d96/dc5/fd1 x:0 0 0 2024-09-13T02:54:02.978 INFO:tasks.workunit.client.0.smithi089.stdout:7/655: creat d3/d20/fd2 x:0 0 0 2024-09-13T02:54:02.980 INFO:tasks.workunit.client.0.smithi089.stdout:4/658: rename d2/d3/d5/fc3 to d2/d3/d5/d43/d3b/d71/d78/fd8 0 2024-09-13T02:54:02.980 INFO:tasks.workunit.client.0.smithi089.stdout:3/583: rename d2/d20/d23 to d2/d20/d23/d32/d5b/d71/d92/db1 22 2024-09-13T02:54:02.981 INFO:tasks.workunit.client.0.smithi089.stdout:2/536: symlink d13/d30/lba 0 2024-09-13T02:54:02.985 INFO:tasks.workunit.client.0.smithi089.stdout:9/500: dwrite d3/d6/d2a/d94/f8c [0,4194304] 0 2024-09-13T02:54:02.986 INFO:tasks.workunit.client.0.smithi089.stdout:5/601: creat d1/d4/d45/d6f/d4d/d9d/daa/fc4 x:0 0 0 2024-09-13T02:54:02.989 INFO:tasks.workunit.client.0.smithi089.stdout:1/540: rename dc/d6e/c75 to dc/d3a/d53/d2c/d34/caa 0 2024-09-13T02:54:02.994 INFO:tasks.workunit.client.0.smithi089.stdout:8/594: rmdir de/d16/d1e/d27/d76 39 2024-09-13T02:54:02.994 INFO:tasks.workunit.client.0.smithi089.stdout:5/602: dread d1/d4/d45/d6f/d4d/f58 [4194304,4194304] 0 2024-09-13T02:54:02.994 INFO:tasks.workunit.client.0.smithi089.stdout:9/501: mkdir d3/d6/d36/d9d 0 2024-09-13T02:54:02.996 INFO:tasks.workunit.client.0.smithi089.stdout:7/656: rename d3/d19/dc8 to d3/d19/d75/d63/da1/db4/dd3 0 2024-09-13T02:54:02.996 INFO:tasks.workunit.client.0.smithi089.stdout:7/657: creat d3/d44/d85/d5e/d6f/fd4 x:0 0 0 2024-09-13T02:54:02.998 INFO:tasks.workunit.client.0.smithi089.stdout:1/541: symlink dc/d44/d73/d9a/da1/lab 0 2024-09-13T02:54:02.999 INFO:tasks.workunit.client.0.smithi089.stdout:1/542: dread - dc/d46/f76 zero size 2024-09-13T02:54:02.999 INFO:tasks.workunit.client.0.smithi089.stdout:1/543: readlink dc/d44/d73/d85/l6d 0 2024-09-13T02:54:02.999 INFO:tasks.workunit.client.0.smithi089.stdout:3/584: symlink d2/lb2 0 2024-09-13T02:54:03.000 INFO:tasks.workunit.client.0.smithi089.stdout:8/595: truncate de/d16/d1e/d3f/f73 1459191 0 2024-09-13T02:54:03.001 INFO:tasks.workunit.client.0.smithi089.stdout:5/603: write d1/d4/d45/d6f/d4d/d7f/d49/f38 [3991938,24048] 0 2024-09-13T02:54:03.001 INFO:tasks.workunit.client.0.smithi089.stdout:9/502: mknod d3/d4c/d91/c9e 0 2024-09-13T02:54:03.003 INFO:tasks.workunit.client.0.smithi089.stdout:2/537: rename d13/c20 to d13/d30/d61/d78/d9c/cbb 0 2024-09-13T02:54:03.003 INFO:tasks.workunit.client.0.smithi089.stdout:2/538: dread - d13/fab zero size 2024-09-13T02:54:03.003 INFO:tasks.workunit.client.0.smithi089.stdout:2/539: readlink d13/d30/d4e/l63 0 2024-09-13T02:54:03.005 INFO:tasks.workunit.client.0.smithi089.stdout:7/658: symlink d3/d44/d85/dbd/ld5 0 2024-09-13T02:54:03.006 INFO:tasks.workunit.client.0.smithi089.stdout:1/544: symlink dc/d44/d73/lac 0 2024-09-13T02:54:03.006 INFO:tasks.workunit.client.0.smithi089.stdout:1/545: truncate dc/d3a/d53/f52 1177652 0 2024-09-13T02:54:03.007 INFO:tasks.workunit.client.0.smithi089.stdout:8/596: write de/f4d [405646,25567] 0 2024-09-13T02:54:03.008 INFO:tasks.workunit.client.0.smithi089.stdout:5/604: getdents d1/d4/d45/d6f/d4d/d9d 0 2024-09-13T02:54:03.008 INFO:tasks.workunit.client.0.smithi089.stdout:5/605: read - d1/d4/d45/d8c/fbb zero size 2024-09-13T02:54:03.008 INFO:tasks.workunit.client.0.smithi089.stdout:5/606: fsync d1/d4/d45/f7b 0 2024-09-13T02:54:03.008 INFO:tasks.workunit.client.0.smithi089.stdout:5/607: write d1/d7/f30 [2963112,63313] 0 2024-09-13T02:54:03.008 INFO:tasks.workunit.client.0.smithi089.stdout:5/608: creat d1/d4/d45/d6f/d62/d72/fc5 x:0 0 0 2024-09-13T02:54:03.008 INFO:tasks.workunit.client.0.smithi089.stdout:7/659: creat d3/d44/d85/d77/fd6 x:0 0 0 2024-09-13T02:54:03.009 INFO:tasks.workunit.client.0.smithi089.stdout:1/546: getdents dc/d44/d73/d9a 0 2024-09-13T02:54:03.010 INFO:tasks.workunit.client.0.smithi089.stdout:8/597: mkdir de/d16/d1e/d67/dc4 0 2024-09-13T02:54:03.010 INFO:tasks.workunit.client.0.smithi089.stdout:8/598: stat de/c60 0 2024-09-13T02:54:03.011 INFO:tasks.workunit.client.0.smithi089.stdout:4/659: dwrite d2/f4 [4194304,4194304] 0 2024-09-13T02:54:03.013 INFO:tasks.workunit.client.0.smithi089.stdout:7/660: rename d3/d44/dca to d3/d44/d85/d77/dd7 0 2024-09-13T02:54:03.017 INFO:tasks.workunit.client.0.smithi089.stdout:8/599: mknod de/d16/d1e/d3f/cc5 0 2024-09-13T02:54:03.018 INFO:tasks.workunit.client.0.smithi089.stdout:7/661: dread d3/d44/d85/f50 [0,4194304] 0 2024-09-13T02:54:03.021 INFO:tasks.workunit.client.0.smithi089.stdout:8/600: getdents de/d16/d1e/d27/d35 0 2024-09-13T02:54:03.021 INFO:tasks.workunit.client.0.smithi089.stdout:8/601: creat de/d56/fc6 x:0 0 0 2024-09-13T02:54:03.022 INFO:tasks.workunit.client.0.smithi089.stdout:7/662: creat d3/d19/d75/db2/fd8 x:0 0 0 2024-09-13T02:54:03.022 INFO:tasks.workunit.client.0.smithi089.stdout:7/663: creat d3/d19/d75/db2/fd9 x:0 0 0 2024-09-13T02:54:03.022 INFO:tasks.workunit.client.0.smithi089.stdout:1/547: write dc/d3a/f41 [1289928,120835] 0 2024-09-13T02:54:03.023 INFO:tasks.workunit.client.0.smithi089.stdout:8/602: stat de/d56/l7c 0 2024-09-13T02:54:03.023 INFO:tasks.workunit.client.0.smithi089.stdout:8/603: fdatasync de/d16/d1e/d27/d76/d8d/fa0 0 2024-09-13T02:54:03.023 INFO:tasks.workunit.client.0.smithi089.stdout:8/604: readlink de/d16/d1e/d27/l9c 0 2024-09-13T02:54:03.023 INFO:tasks.workunit.client.0.smithi089.stdout:8/605: dread - de/d16/d1e/d27/d52/f5f zero size 2024-09-13T02:54:03.024 INFO:tasks.workunit.client.0.smithi089.stdout:7/664: mknod d3/d19/d67/cda 0 2024-09-13T02:54:03.024 INFO:tasks.workunit.client.0.smithi089.stdout:7/665: truncate d3/d19/d75/f4a 1334574 0 2024-09-13T02:54:03.024 INFO:tasks.workunit.client.0.smithi089.stdout:7/666: readlink d3/d19/d75/d14/l7e 0 2024-09-13T02:54:03.024 INFO:tasks.workunit.client.0.smithi089.stdout:7/667: write d3/fbc [597622,77709] 0 2024-09-13T02:54:03.025 INFO:tasks.workunit.client.0.smithi089.stdout:1/548: symlink dc/d3a/d93/lad 0 2024-09-13T02:54:03.026 INFO:tasks.workunit.client.0.smithi089.stdout:8/606: mkdir de/d16/d1e/dc7 0 2024-09-13T02:54:03.026 INFO:tasks.workunit.client.0.smithi089.stdout:3/585: dwrite d2/d8/dc/f30 [0,4194304] 0 2024-09-13T02:54:03.026 INFO:tasks.workunit.client.0.smithi089.stdout:4/660: dread d2/d3/d5/f42 [0,4194304] 0 2024-09-13T02:54:03.027 INFO:tasks.workunit.client.0.smithi089.stdout:1/549: mknod dc/d3a/d53/d2c/d36/cae 0 2024-09-13T02:54:03.027 INFO:tasks.workunit.client.0.smithi089.stdout:1/550: truncate dc/d6e/fa3 2597 0 2024-09-13T02:54:03.028 INFO:tasks.workunit.client.0.smithi089.stdout:4/661: creat d2/fd9 x:0 0 0 2024-09-13T02:54:03.028 INFO:tasks.workunit.client.0.smithi089.stdout:4/662: write d2/d22/da1/d62/d6c/d88/db2/fc7 [927893,894] 0 2024-09-13T02:54:03.028 INFO:tasks.workunit.client.0.smithi089.stdout:4/663: write d2/d3/d5/f85 [518954,130974] 0 2024-09-13T02:54:03.029 INFO:tasks.workunit.client.0.smithi089.stdout:3/586: creat d2/d20/d23/d27/fb3 x:0 0 0 2024-09-13T02:54:03.029 INFO:tasks.workunit.client.0.smithi089.stdout:1/551: symlink dc/d44/d73/d85/laf 0 2024-09-13T02:54:03.030 INFO:tasks.workunit.client.0.smithi089.stdout:1/552: write dc/d3a/d53/f23 [2194278,82098] 0 2024-09-13T02:54:03.031 INFO:tasks.workunit.client.0.smithi089.stdout:4/664: rmdir d2/d3/d5/d43/d3b/d71/d99/daf/d8f 39 2024-09-13T02:54:03.032 INFO:tasks.workunit.client.0.smithi089.stdout:4/665: chown d2/d3/d5/d49 1 1 2024-09-13T02:54:03.032 INFO:tasks.workunit.client.0.smithi089.stdout:4/666: stat d2/d22/da1/fc0 0 2024-09-13T02:54:03.032 INFO:tasks.workunit.client.0.smithi089.stdout:4/667: chown d2/d3/d5/d43/d3b/d71/d78/d9c/fb4 2664356 1 2024-09-13T02:54:03.034 INFO:tasks.workunit.client.0.smithi089.stdout:8/607: dread de/d16/d1e/d3f/d71/f81 [0,4194304] 0 2024-09-13T02:54:03.034 INFO:tasks.workunit.client.0.smithi089.stdout:8/608: write de/d16/d1e/d27/d52/d61/f75 [1005391,42238] 0 2024-09-13T02:54:03.034 INFO:tasks.workunit.client.0.smithi089.stdout:7/668: dread d3/d19/d75/f5a [0,4194304] 0 2024-09-13T02:54:03.034 INFO:tasks.workunit.client.0.smithi089.stdout:7/669: write d3/d44/d85/d55/d96/dc5/fce [234726,8495] 0 2024-09-13T02:54:03.034 INFO:tasks.workunit.client.0.smithi089.stdout:7/670: truncate d3/d44/d85/d55/d96/dc5/fd1 802971 0 2024-09-13T02:54:03.035 INFO:tasks.workunit.client.0.smithi089.stdout:7/671: creat d3/d19/d75/fdb x:0 0 0 2024-09-13T02:54:03.035 INFO:tasks.workunit.client.0.smithi089.stdout:7/672: chown d3/c2f 1926918 1 2024-09-13T02:54:03.036 INFO:tasks.workunit.client.0.smithi089.stdout:8/609: creat de/d16/d1e/d27/d52/d61/fc8 x:0 0 0 2024-09-13T02:54:03.036 INFO:tasks.workunit.client.0.smithi089.stdout:8/610: dread - de/d16/d1e/d20/d6c/d6e/faa zero size 2024-09-13T02:54:03.036 INFO:tasks.workunit.client.0.smithi089.stdout:8/611: readlink de/d16/d1e/d20/d39/la4 0 2024-09-13T02:54:03.038 INFO:tasks.workunit.client.0.smithi089.stdout:7/673: rename d3/d44/d85/d5e/c5f to d3/d44/d85/d5e/d6f/cdc 0 2024-09-13T02:54:03.040 INFO:tasks.workunit.client.0.smithi089.stdout:3/587: write d2/d8/f48 [2900725,97701] 0 2024-09-13T02:54:03.043 INFO:tasks.workunit.client.0.smithi089.stdout:8/612: mknod de/d16/d1e/d20/d6c/d6e/cc9 0 2024-09-13T02:54:03.043 INFO:tasks.workunit.client.0.smithi089.stdout:8/613: truncate de/d16/d1e/d27/f79 327714 0 2024-09-13T02:54:03.044 INFO:tasks.workunit.client.0.smithi089.stdout:7/674: fdatasync d3/d19/f38 0 2024-09-13T02:54:03.045 INFO:tasks.workunit.client.0.smithi089.stdout:3/588: creat d2/d8/dc/d9a/fb4 x:0 0 0 2024-09-13T02:54:03.046 INFO:tasks.workunit.client.0.smithi089.stdout:7/675: mkdir d3/d19/d75/d63/ddd 0 2024-09-13T02:54:03.047 INFO:tasks.workunit.client.0.smithi089.stdout:3/589: mknod d2/d20/d23/d27/cb5 0 2024-09-13T02:54:03.048 INFO:tasks.workunit.client.0.smithi089.stdout:3/590: dread - d2/d20/d23/d32/d5b/f9d zero size 2024-09-13T02:54:03.049 INFO:tasks.workunit.client.0.smithi089.stdout:3/591: rmdir d2/da0 0 2024-09-13T02:54:03.051 INFO:tasks.workunit.client.0.smithi089.stdout:4/668: dwrite d2/d3/d5/f2e [0,4194304] 0 2024-09-13T02:54:03.051 INFO:tasks.workunit.client.0.smithi089.stdout:4/669: readlink d2/da/l21 0 2024-09-13T02:54:03.063 INFO:tasks.workunit.client.0.smithi089.stdout:4/670: read d2/d22/da1/f33 [798133,66676] 0 2024-09-13T02:54:03.063 INFO:tasks.workunit.client.0.smithi089.stdout:4/671: write d2/da/f45 [4359444,113017] 0 2024-09-13T02:54:03.083 INFO:tasks.workunit.client.0.smithi089.stdout:3/592: dwrite d2/d8/dc/f2c [0,4194304] 0 2024-09-13T02:54:03.083 INFO:tasks.workunit.client.0.smithi089.stdout:3/593: chown d2/d8/dc/d9a/d9c/d6c/f84 321689944 1 2024-09-13T02:54:03.083 INFO:tasks.workunit.client.0.smithi089.stdout:3/594: write d2/d20/f25 [2299613,102194] 0 2024-09-13T02:54:03.084 INFO:tasks.workunit.client.0.smithi089.stdout:8/614: dwrite de/d16/d1e/d27/f68 [0,4194304] 0 2024-09-13T02:54:03.084 INFO:tasks.workunit.client.0.smithi089.stdout:7/676: dwrite d3/d19/d75/db2/fd9 [0,4194304] 0 2024-09-13T02:54:03.085 INFO:tasks.workunit.client.0.smithi089.stdout:4/672: dwrite d2/d3/d5/d43/d3b/d71/d99/fa3 [0,4194304] 0 2024-09-13T02:54:03.085 INFO:tasks.workunit.client.0.smithi089.stdout:3/595: rename d2/d8/dc/d9a/d9c/d6c to d2/d8/dc/d9a/d9c/d83/db6 0 2024-09-13T02:54:03.085 INFO:tasks.workunit.client.0.smithi089.stdout:8/615: write de/d16/d1e/d27/d52/d61/d8e/fa6 [833227,94279] 0 2024-09-13T02:54:03.088 INFO:tasks.workunit.client.0.smithi089.stdout:7/677: mkdir d3/d19/d2e/d37/dad/dde 0 2024-09-13T02:54:03.088 INFO:tasks.workunit.client.0.smithi089.stdout:7/678: write d3/d44/d85/d55/f8d [5589534,92378] 0 2024-09-13T02:54:03.092 INFO:tasks.workunit.client.0.smithi089.stdout:4/673: creat d2/d3/d86/fda x:0 0 0 2024-09-13T02:54:03.093 INFO:tasks.workunit.client.0.smithi089.stdout:3/596: rename d2/d20/d23/d32/d49/c77 to d2/d20/d23/d32/d5b/d71/cb7 0 2024-09-13T02:54:03.094 INFO:tasks.workunit.client.0.smithi089.stdout:7/679: creat d3/d19/d2e/d37/fdf x:0 0 0 2024-09-13T02:54:03.095 INFO:tasks.workunit.client.0.smithi089.stdout:6/588: sync 2024-09-13T02:54:03.095 INFO:tasks.workunit.client.0.smithi089.stdout:0/533: sync 2024-09-13T02:54:03.095 INFO:tasks.workunit.client.0.smithi089.stdout:7/680: creat d3/d19/d75/dbf/fe0 x:0 0 0 2024-09-13T02:54:03.096 INFO:tasks.workunit.client.0.smithi089.stdout:7/681: fsync d3/d19/f41 0 2024-09-13T02:54:03.097 INFO:tasks.workunit.client.0.smithi089.stdout:7/682: creat d3/fe1 x:0 0 0 2024-09-13T02:54:03.097 INFO:tasks.workunit.client.0.smithi089.stdout:7/683: fsync d3/d19/d75/fa7 0 2024-09-13T02:54:03.097 INFO:tasks.workunit.client.0.smithi089.stdout:7/684: write d3/d44/f43 [1804909,91766] 0 2024-09-13T02:54:03.098 INFO:tasks.workunit.client.0.smithi089.stdout:7/685: chown d3/d44/d85/d5e/fb1 61551 1 2024-09-13T02:54:03.100 INFO:tasks.workunit.client.0.smithi089.stdout:7/686: rmdir d3/d19/d75/d63/da1 39 2024-09-13T02:54:03.102 INFO:tasks.workunit.client.0.smithi089.stdout:7/687: symlink d3/d19/d2e/le2 0 2024-09-13T02:54:03.102 INFO:tasks.workunit.client.0.smithi089.stdout:7/688: write f0 [1446973,128959] 0 2024-09-13T02:54:03.105 INFO:tasks.workunit.client.0.smithi089.stdout:0/534: read d2/f48 [1810768,89861] 0 2024-09-13T02:54:03.107 INFO:tasks.workunit.client.0.smithi089.stdout:6/589: read db/d43/f3b [250120,91639] 0 2024-09-13T02:54:03.108 INFO:tasks.workunit.client.0.smithi089.stdout:0/535: rmdir d2/d19/d1a/da4 39 2024-09-13T02:54:03.110 INFO:tasks.workunit.client.0.smithi089.stdout:4/674: dwrite d2/d3/f7c [4194304,4194304] 0 2024-09-13T02:54:03.110 INFO:tasks.workunit.client.0.smithi089.stdout:4/675: fdatasync d2/da/f75 0 2024-09-13T02:54:03.110 INFO:tasks.workunit.client.0.smithi089.stdout:4/676: write d2/fab [4675595,106653] 0 2024-09-13T02:54:03.110 INFO:tasks.workunit.client.0.smithi089.stdout:6/590: link db/c4d db/d43/d6e/d28/d37/dc2/cc5 0 2024-09-13T02:54:03.111 INFO:tasks.workunit.client.0.smithi089.stdout:6/591: creat db/db2/fc6 x:0 0 0 2024-09-13T02:54:03.111 INFO:tasks.workunit.client.0.smithi089.stdout:6/592: write db/db2/fc6 [557124,8315] 0 2024-09-13T02:54:03.111 INFO:tasks.workunit.client.0.smithi089.stdout:6/593: fsync db/d43/d6e/d28/fbd 0 2024-09-13T02:54:03.111 INFO:tasks.workunit.client.0.smithi089.stdout:6/594: chown db/d10 3011217 1 2024-09-13T02:54:03.114 INFO:tasks.workunit.client.0.smithi089.stdout:7/689: dread d3/d19/d2e/f33 [0,4194304] 0 2024-09-13T02:54:03.114 INFO:tasks.workunit.client.0.smithi089.stdout:7/690: readlink d3/d44/d85/d55/lcd 0 2024-09-13T02:54:03.116 INFO:tasks.workunit.client.0.smithi089.stdout:7/691: dread d3/d44/f58 [0,4194304] 0 2024-09-13T02:54:03.116 INFO:tasks.workunit.client.0.smithi089.stdout:7/692: fdatasync d3/d19/d75/d63/da1/fc4 0 2024-09-13T02:54:03.117 INFO:tasks.workunit.client.0.smithi089.stdout:6/595: getdents db/d43/d6e/d28/d46 0 2024-09-13T02:54:03.117 INFO:tasks.workunit.client.0.smithi089.stdout:6/596: chown db/c4d 980108 1 2024-09-13T02:54:03.119 INFO:tasks.workunit.client.0.smithi089.stdout:3/597: dwrite d2/d8/f95 [0,4194304] 0 2024-09-13T02:54:03.119 INFO:tasks.workunit.client.0.smithi089.stdout:3/598: getdents d2/d8b/daf 0 2024-09-13T02:54:03.127 INFO:tasks.workunit.client.0.smithi089.stdout:3/599: truncate d2/d8/f21 5736419 0 2024-09-13T02:54:03.127 INFO:tasks.workunit.client.0.smithi089.stdout:3/600: creat d2/d8/dc/d9a/fb8 x:0 0 0 2024-09-13T02:54:03.128 INFO:tasks.workunit.client.0.smithi089.stdout:3/601: write d2/d20/f25 [2511477,70699] 0 2024-09-13T02:54:03.137 INFO:tasks.workunit.client.0.smithi089.stdout:7/693: dwrite d3/d19/d75/dbf/fe0 [0,4194304] 0 2024-09-13T02:54:03.140 INFO:tasks.workunit.client.0.smithi089.stdout:7/694: unlink d3/d19/d75/db2/fd8 0 2024-09-13T02:54:03.140 INFO:tasks.workunit.client.0.smithi089.stdout:7/695: creat d3/d19/d75/d14/da0/db0/fe3 x:0 0 0 2024-09-13T02:54:03.140 INFO:tasks.workunit.client.0.smithi089.stdout:7/696: readlink d3/d44/d85/dbd/ld5 0 2024-09-13T02:54:03.143 INFO:tasks.workunit.client.0.smithi089.stdout:0/536: dwrite d2/d19/d1a/d3d/d4b/d4f/d59/d6b/f6f [4194304,4194304] 0 2024-09-13T02:54:03.143 INFO:tasks.workunit.client.0.smithi089.stdout:0/537: write d2/d19/d1a/d3d/d4b/d4f/f9d [728466,95328] 0 2024-09-13T02:54:03.145 INFO:tasks.workunit.client.0.smithi089.stdout:0/538: rename d2/f34 to d2/d19/d1a/d4e/fbc 0 2024-09-13T02:54:03.146 INFO:tasks.workunit.client.0.smithi089.stdout:0/539: chown d2/f85 0 1 2024-09-13T02:54:03.153 INFO:tasks.workunit.client.0.smithi089.stdout:4/677: dwrite d2/f4c [8388608,4194304] 0 2024-09-13T02:54:03.153 INFO:tasks.workunit.client.0.smithi089.stdout:4/678: creat d2/d3/d5/d43/fdb x:0 0 0 2024-09-13T02:54:03.153 INFO:tasks.workunit.client.0.smithi089.stdout:4/679: chown d2/f53 47 1 2024-09-13T02:54:03.159 INFO:tasks.workunit.client.0.smithi089.stdout:4/680: symlink d2/d22/da1/d62/d6c/ldc 0 2024-09-13T02:54:03.161 INFO:tasks.workunit.client.0.smithi089.stdout:4/681: mknod d2/d22/da1/d62/d6c/cdd 0 2024-09-13T02:54:03.161 INFO:tasks.workunit.client.0.smithi089.stdout:4/682: truncate d2/da/f6d 302470 0 2024-09-13T02:54:03.161 INFO:tasks.workunit.client.0.smithi089.stdout:4/683: dread - d2/d22/da1/d62/f68 zero size 2024-09-13T02:54:03.161 INFO:tasks.workunit.client.0.smithi089.stdout:4/684: write d2/d3/d5/d43/d3b/d71/d99/daf/d8f/fce [4826342,62624] 0 2024-09-13T02:54:03.161 INFO:tasks.workunit.client.0.smithi089.stdout:4/685: chown d2/da/f30 175131819 1 2024-09-13T02:54:03.162 INFO:tasks.workunit.client.0.smithi089.stdout:4/686: rmdir d2/d22/da1/d62/d6c/d88/db2 39 2024-09-13T02:54:03.163 INFO:tasks.workunit.client.0.smithi089.stdout:4/687: creat d2/d22/da1/d62/d6c/fde x:0 0 0 2024-09-13T02:54:03.168 INFO:tasks.workunit.client.0.smithi089.stdout:7/697: dwrite d3/d44/d85/d55/f8d [0,4194304] 0 2024-09-13T02:54:03.168 INFO:tasks.workunit.client.0.smithi089.stdout:7/698: unlink d3/d19/d75/d14/d71/c73 0 2024-09-13T02:54:03.172 INFO:tasks.workunit.client.0.smithi089.stdout:7/699: dread d3/d44/d85/f50 [0,4194304] 0 2024-09-13T02:54:03.172 INFO:tasks.workunit.client.0.smithi089.stdout:7/700: stat d3/d19/d75/d63/da1/fa2 0 2024-09-13T02:54:03.174 INFO:tasks.workunit.client.0.smithi089.stdout:9/503: sync 2024-09-13T02:54:03.174 INFO:tasks.workunit.client.0.smithi089.stdout:2/540: sync 2024-09-13T02:54:03.174 INFO:tasks.workunit.client.0.smithi089.stdout:9/504: readlink d3/d6/d2a/d94/d24/l46 0 2024-09-13T02:54:03.174 INFO:tasks.workunit.client.0.smithi089.stdout:9/505: truncate d3/d6/f73 4933616 0 2024-09-13T02:54:03.175 INFO:tasks.workunit.client.0.smithi089.stdout:0/540: dwrite d2/d19/d1a/d1e/d42/f49 [0,4194304] 0 2024-09-13T02:54:03.175 INFO:tasks.workunit.client.0.smithi089.stdout:4/688: dread d2/f53 [0,4194304] 0 2024-09-13T02:54:03.175 INFO:tasks.workunit.client.0.smithi089.stdout:7/701: dread d3/d19/d2e/f4f [0,4194304] 0 2024-09-13T02:54:03.176 INFO:tasks.workunit.client.0.smithi089.stdout:7/702: truncate d3/d19/d75/f12 9340626 0 2024-09-13T02:54:03.176 INFO:tasks.workunit.client.0.smithi089.stdout:2/541: rename d13/d30/l7a to d13/d30/d4e/d6f/lbc 0 2024-09-13T02:54:03.176 INFO:tasks.workunit.client.0.smithi089.stdout:2/542: truncate d13/d30/f37 797229 0 2024-09-13T02:54:03.176 INFO:tasks.workunit.client.0.smithi089.stdout:9/506: mknod d3/d6/d2a/d4b/d77/c9f 0 2024-09-13T02:54:03.176 INFO:tasks.workunit.client.0.smithi089.stdout:0/541: creat d2/d64/db1/fbd x:0 0 0 2024-09-13T02:54:03.178 INFO:tasks.workunit.client.0.smithi089.stdout:4/689: link d2/d3/d5/f38 d2/d3/d5/d43/d3b/d71/d78/d9c/fdf 0 2024-09-13T02:54:03.178 INFO:tasks.workunit.client.0.smithi089.stdout:4/690: read d2/d3/d5/f70 [76837,92996] 0 2024-09-13T02:54:03.178 INFO:tasks.workunit.client.0.smithi089.stdout:4/691: creat d2/d3/d5/d43/d3b/d71/d99/daf/dc6/fe0 x:0 0 0 2024-09-13T02:54:03.180 INFO:tasks.workunit.client.0.smithi089.stdout:2/543: rename d13/d30/d4e/l4f to d13/d30/d61/d78/d79/d7c/lbd 0 2024-09-13T02:54:03.181 INFO:tasks.workunit.client.0.smithi089.stdout:4/692: symlink d2/d3/d5/d43/d3b/d71/d78/d9c/le1 0 2024-09-13T02:54:03.186 INFO:tasks.workunit.client.0.smithi089.stdout:2/544: mkdir d13/d30/d59/dbe 0 2024-09-13T02:54:03.186 INFO:tasks.workunit.client.0.smithi089.stdout:2/545: write d13/d30/f47 [157396,28132] 0 2024-09-13T02:54:03.187 INFO:tasks.workunit.client.0.smithi089.stdout:4/693: rename d2/d3/d5/d43/lb6 to d2/d22/da1/d62/le2 0 2024-09-13T02:54:03.189 INFO:tasks.workunit.client.0.smithi089.stdout:4/694: unlink d2/d22/f3f 0 2024-09-13T02:54:03.190 INFO:tasks.workunit.client.0.smithi089.stdout:4/695: creat d2/da/fe3 x:0 0 0 2024-09-13T02:54:03.197 INFO:tasks.workunit.client.0.smithi089.stdout:7/703: read d3/d19/d75/f1d [974510,2620] 0 2024-09-13T02:54:03.197 INFO:tasks.workunit.client.0.smithi089.stdout:2/546: dread d13/d30/d4e/d6f/f84 [0,4194304] 0 2024-09-13T02:54:03.197 INFO:tasks.workunit.client.0.smithi089.stdout:9/507: write d3/f22 [1493210,115444] 0 2024-09-13T02:54:03.197 INFO:tasks.workunit.client.0.smithi089.stdout:9/508: creat d3/d6/d36/fa0 x:0 0 0 2024-09-13T02:54:03.198 INFO:tasks.workunit.client.0.smithi089.stdout:7/704: mkdir d3/d19/d2e/d37/de4 0 2024-09-13T02:54:03.198 INFO:tasks.workunit.client.0.smithi089.stdout:7/705: fsync d3/d19/d75/db2/fd9 0 2024-09-13T02:54:03.198 INFO:tasks.workunit.client.0.smithi089.stdout:7/706: fsync d3/d44/d85/d55/f6b 0 2024-09-13T02:54:03.200 INFO:tasks.workunit.client.0.smithi089.stdout:7/707: unlink d3/fb3 0 2024-09-13T02:54:03.202 INFO:tasks.workunit.client.0.smithi089.stdout:7/708: getdents d3/d19/d75/db2 0 2024-09-13T02:54:03.202 INFO:tasks.workunit.client.0.smithi089.stdout:0/542: dwrite d2/d19/d1a/d4e/d7a/d9b/f83 [0,4194304] 0 2024-09-13T02:54:03.202 INFO:tasks.workunit.client.0.smithi089.stdout:4/696: write d2/d3/d5/d43/d3b/f6f [1912780,87682] 0 2024-09-13T02:54:03.202 INFO:tasks.workunit.client.0.smithi089.stdout:0/543: fdatasync d2/f16 0 2024-09-13T02:54:03.203 INFO:tasks.workunit.client.0.smithi089.stdout:0/544: rmdir d2/d19 39 2024-09-13T02:54:03.204 INFO:tasks.workunit.client.0.smithi089.stdout:0/545: write d2/d19/d1a/d3d/d4b/d4f/d59/f6e [3261667,46173] 0 2024-09-13T02:54:03.204 INFO:tasks.workunit.client.0.smithi089.stdout:4/697: mknod d2/d3/d5/d49/ce4 0 2024-09-13T02:54:03.208 INFO:tasks.workunit.client.0.smithi089.stdout:9/509: write d3/d6/d2a/d94/d24/d32/f7d [139379,125988] 0 2024-09-13T02:54:03.216 INFO:tasks.workunit.client.0.smithi089.stdout:2/547: dwrite f3 [0,4194304] 0 2024-09-13T02:54:03.216 INFO:tasks.workunit.client.0.smithi089.stdout:4/698: dread d2/d3/d5/d43/d3b/f5b [0,4194304] 0 2024-09-13T02:54:03.219 INFO:tasks.workunit.client.0.smithi089.stdout:2/548: creat d13/d30/d59/dbe/fbf x:0 0 0 2024-09-13T02:54:03.221 INFO:tasks.workunit.client.0.smithi089.stdout:2/549: mkdir d13/d30/d4e/d7b/d86/dc0 0 2024-09-13T02:54:03.223 INFO:tasks.workunit.client.0.smithi089.stdout:2/550: link d13/d30/f31 d13/d30/d64/fc1 0 2024-09-13T02:54:03.223 INFO:tasks.workunit.client.0.smithi089.stdout:2/551: chown d13/c2f 97602 1 2024-09-13T02:54:03.223 INFO:tasks.workunit.client.0.smithi089.stdout:2/552: truncate d13/f32 5469073 0 2024-09-13T02:54:03.223 INFO:tasks.workunit.client.0.smithi089.stdout:2/553: chown d13/d30/d64/fae 10252 1 2024-09-13T02:54:03.223 INFO:tasks.workunit.client.0.smithi089.stdout:2/554: chown d13/d30/d61/d78/d79/ca4 64 1 2024-09-13T02:54:03.224 INFO:tasks.workunit.client.0.smithi089.stdout:2/555: mkdir d13/d30/d4e/dc2 0 2024-09-13T02:54:03.224 INFO:tasks.workunit.client.0.smithi089.stdout:2/556: fdatasync d13/d30/d59/faa 0 2024-09-13T02:54:03.224 INFO:tasks.workunit.client.0.smithi089.stdout:2/557: mknod d13/d30/d4e/dc2/cc3 0 2024-09-13T02:54:03.225 INFO:tasks.workunit.client.0.smithi089.stdout:2/558: chown d13/d30/d61/d78/d79 1 1 2024-09-13T02:54:03.225 INFO:tasks.workunit.client.0.smithi089.stdout:2/559: getdents d13/d30/d4e/d6f 0 2024-09-13T02:54:03.237 INFO:tasks.workunit.client.0.smithi089.stdout:0/546: dwrite d2/d64/f9c [0,4194304] 0 2024-09-13T02:54:03.237 INFO:tasks.workunit.client.0.smithi089.stdout:0/547: dread - d2/d19/d1a/d4e/fb8 zero size 2024-09-13T02:54:03.246 INFO:tasks.workunit.client.0.smithi089.stdout:7/709: dwrite d3/d19/d75/f18 [4194304,4194304] 0 2024-09-13T02:54:03.248 INFO:tasks.workunit.client.0.smithi089.stdout:9/510: dwrite d3/d3d/f97 [0,4194304] 0 2024-09-13T02:54:03.248 INFO:tasks.workunit.client.0.smithi089.stdout:9/511: readlink d3/d6/d2a/d94/d24/d32/l68 0 2024-09-13T02:54:03.248 INFO:tasks.workunit.client.0.smithi089.stdout:9/512: fsync d3/d6/d2a/d4b/d54/f72 0 2024-09-13T02:54:03.249 INFO:tasks.workunit.client.0.smithi089.stdout:9/513: dread - d3/d6/d36/fa0 zero size 2024-09-13T02:54:03.249 INFO:tasks.workunit.client.0.smithi089.stdout:7/710: unlink d3/d19/d75/d14/f97 0 2024-09-13T02:54:03.249 INFO:tasks.workunit.client.0.smithi089.stdout:7/711: chown d3/d44/d85/dbd/ld5 259783456 1 2024-09-13T02:54:03.250 INFO:tasks.workunit.client.0.smithi089.stdout:0/548: write d2/d19/f2d [1132856,105574] 0 2024-09-13T02:54:03.254 INFO:tasks.workunit.client.0.smithi089.stdout:9/514: mkdir d3/d6/d2a/d4b/d54/da1 0 2024-09-13T02:54:03.258 INFO:tasks.workunit.client.0.smithi089.stdout:7/712: truncate d3/d44/d85/d55/d96/dc5/fd1 230718 0 2024-09-13T02:54:03.259 INFO:tasks.workunit.client.0.smithi089.stdout:0/549: truncate d2/f3a 792787 0 2024-09-13T02:54:03.259 INFO:tasks.workunit.client.0.smithi089.stdout:0/550: fsync d2/f14 0 2024-09-13T02:54:03.261 INFO:tasks.workunit.client.0.smithi089.stdout:7/713: creat d3/d44/d85/dbd/fe5 x:0 0 0 2024-09-13T02:54:03.262 INFO:tasks.workunit.client.0.smithi089.stdout:0/551: mkdir d2/d19/d1a/dbe 0 2024-09-13T02:54:03.262 INFO:tasks.workunit.client.0.smithi089.stdout:5/609: sync 2024-09-13T02:54:03.262 INFO:tasks.workunit.client.0.smithi089.stdout:8/616: sync 2024-09-13T02:54:03.262 INFO:tasks.workunit.client.0.smithi089.stdout:1/553: sync 2024-09-13T02:54:03.262 INFO:tasks.workunit.client.0.smithi089.stdout:9/515: getdents d3/d6/d2a/d4b/d6d 0 2024-09-13T02:54:03.264 INFO:tasks.workunit.client.0.smithi089.stdout:7/714: mkdir d3/d19/d2e/de6 0 2024-09-13T02:54:03.264 INFO:tasks.workunit.client.0.smithi089.stdout:7/715: write d3/f1b [2811348,2361] 0 2024-09-13T02:54:03.265 INFO:tasks.workunit.client.0.smithi089.stdout:1/554: getdents dc/d3a/d53/d2c/d6f 0 2024-09-13T02:54:03.265 INFO:tasks.workunit.client.0.smithi089.stdout:1/555: chown l9 200084 1 2024-09-13T02:54:03.265 INFO:tasks.workunit.client.0.smithi089.stdout:1/556: dread - dc/d46/f89 zero size 2024-09-13T02:54:03.265 INFO:tasks.workunit.client.0.smithi089.stdout:1/557: creat dc/d46/fb0 x:0 0 0 2024-09-13T02:54:03.265 INFO:tasks.workunit.client.0.smithi089.stdout:1/558: fdatasync f3 0 2024-09-13T02:54:03.266 INFO:tasks.workunit.client.0.smithi089.stdout:8/617: creat de/d16/d1e/d27/d76/d8d/fca x:0 0 0 2024-09-13T02:54:03.267 INFO:tasks.workunit.client.0.smithi089.stdout:9/516: dread d3/d6/d2a/d94/d24/d32/f7d [0,4194304] 0 2024-09-13T02:54:03.269 INFO:tasks.workunit.client.0.smithi089.stdout:1/559: creat dc/d46/d6c/d98/fb1 x:0 0 0 2024-09-13T02:54:03.269 INFO:tasks.workunit.client.0.smithi089.stdout:1/560: write dc/d3a/d53/f66 [1707994,23778] 0 2024-09-13T02:54:03.269 INFO:tasks.workunit.client.0.smithi089.stdout:1/561: fdatasync dc/f1e 0 2024-09-13T02:54:03.269 INFO:tasks.workunit.client.0.smithi089.stdout:1/562: readlink dc/d3a/l59 0 2024-09-13T02:54:03.269 INFO:tasks.workunit.client.0.smithi089.stdout:8/618: mknod de/dc1/ccb 0 2024-09-13T02:54:03.271 INFO:tasks.workunit.client.0.smithi089.stdout:8/619: getdents de/d56 0 2024-09-13T02:54:03.271 INFO:tasks.workunit.client.0.smithi089.stdout:8/620: write de/d16/d1e/d20/da8/fbf [626441,95918] 0 2024-09-13T02:54:03.277 INFO:tasks.workunit.client.0.smithi089.stdout:8/621: dread de/d16/d1e/d3f/f73 [0,4194304] 0 2024-09-13T02:54:03.278 INFO:tasks.workunit.client.0.smithi089.stdout:7/716: dread d3/f5 [0,4194304] 0 2024-09-13T02:54:03.278 INFO:tasks.workunit.client.0.smithi089.stdout:7/717: readlink d3/d19/d75/d63/lab 0 2024-09-13T02:54:03.278 INFO:tasks.workunit.client.0.smithi089.stdout:7/718: stat d3/d19/f4d 0 2024-09-13T02:54:03.279 INFO:tasks.workunit.client.0.smithi089.stdout:8/622: creat de/d16/d1e/dc7/fcc x:0 0 0 2024-09-13T02:54:03.279 INFO:tasks.workunit.client.0.smithi089.stdout:8/623: truncate de/d16/d1e/d3f/f54 559525 0 2024-09-13T02:54:03.281 INFO:tasks.workunit.client.0.smithi089.stdout:1/563: write dc/d3a/d53/d2c/d36/f51 [2830347,122116] 0 2024-09-13T02:54:03.281 INFO:tasks.workunit.client.0.smithi089.stdout:8/624: rename de/d16/d1e/d3f/f54 to de/fcd 0 2024-09-13T02:54:03.285 INFO:tasks.workunit.client.0.smithi089.stdout:1/564: symlink dc/d3a/d53/d2c/d94/lb2 0 2024-09-13T02:54:03.285 INFO:tasks.workunit.client.0.smithi089.stdout:1/565: write dc/d44/f99 [4825377,125704] 0 2024-09-13T02:54:03.287 INFO:tasks.workunit.client.0.smithi089.stdout:1/566: creat dc/d3a/d53/d2c/d34/d8b/fb3 x:0 0 0 2024-09-13T02:54:03.288 INFO:tasks.workunit.client.0.smithi089.stdout:1/567: creat dc/d3a/d53/d2c/d34/d9b/fb4 x:0 0 0 2024-09-13T02:54:03.289 INFO:tasks.workunit.client.0.smithi089.stdout:8/625: write de/d16/d1e/f4e [245035,82131] 0 2024-09-13T02:54:03.292 INFO:tasks.workunit.client.0.smithi089.stdout:8/626: unlink de/d16/d1e/d20/d6c/d6e/cc3 0 2024-09-13T02:54:03.292 INFO:tasks.workunit.client.0.smithi089.stdout:1/568: getdents dc/d6e 0 2024-09-13T02:54:03.298 INFO:tasks.workunit.client.0.smithi089.stdout:5/610: dwrite d1/d4/d45/f82 [0,4194304] 0 2024-09-13T02:54:03.298 INFO:tasks.workunit.client.0.smithi089.stdout:5/611: fdatasync d1/d4/d45/d6f/d4d/f7a 0 2024-09-13T02:54:03.298 INFO:tasks.workunit.client.0.smithi089.stdout:5/612: write d1/d4/d2b/f2d [2434358,91638] 0 2024-09-13T02:54:03.298 INFO:tasks.workunit.client.0.smithi089.stdout:0/552: dwrite d2/d19/d1a/d3d/d4b/fa2 [0,4194304] 0 2024-09-13T02:54:03.298 INFO:tasks.workunit.client.0.smithi089.stdout:0/553: fsync d2/d19/d1a/d3d/d4b/d4f/d59/fa9 0 2024-09-13T02:54:03.298 INFO:tasks.workunit.client.0.smithi089.stdout:7/719: dwrite d3/d19/d75/d14/d71/fc6 [0,4194304] 0 2024-09-13T02:54:03.298 INFO:tasks.workunit.client.0.smithi089.stdout:7/720: chown d3/d19/l2b 216 1 2024-09-13T02:54:03.306 INFO:tasks.workunit.client.0.smithi089.stdout:0/554: creat d2/d19/d1a/d3d/d4b/d4f/d59/d6b/d87/fbf x:0 0 0 2024-09-13T02:54:03.306 INFO:tasks.workunit.client.0.smithi089.stdout:0/555: write d2/fa3 [530762,42090] 0 2024-09-13T02:54:03.306 INFO:tasks.workunit.client.0.smithi089.stdout:0/556: creat d2/d64/db1/fc0 x:0 0 0 2024-09-13T02:54:03.308 INFO:tasks.workunit.client.0.smithi089.stdout:7/721: readlink d3/d19/l3e 0 2024-09-13T02:54:03.309 INFO:tasks.workunit.client.0.smithi089.stdout:0/557: mknod d2/d19/d1a/d4e/d9a/cc1 0 2024-09-13T02:54:03.313 INFO:tasks.workunit.client.0.smithi089.stdout:1/569: dwrite dc/d44/d73/f5b [0,4194304] 0 2024-09-13T02:54:03.313 INFO:tasks.workunit.client.0.smithi089.stdout:1/570: truncate dc/d44/f45 2710567 0 2024-09-13T02:54:03.323 INFO:tasks.workunit.client.0.smithi089.stdout:7/722: dwrite d3/d19/d75/f4a [0,4194304] 0 2024-09-13T02:54:03.324 INFO:tasks.workunit.client.0.smithi089.stdout:7/723: write d3/d19/d2e/d37/fdf [115834,65007] 0 2024-09-13T02:54:03.324 INFO:tasks.workunit.client.0.smithi089.stdout:7/724: write d3/d19/d75/fdb [398115,100820] 0 2024-09-13T02:54:03.326 INFO:tasks.workunit.client.0.smithi089.stdout:3/602: sync 2024-09-13T02:54:03.326 INFO:tasks.workunit.client.0.smithi089.stdout:6/597: sync 2024-09-13T02:54:03.335 INFO:tasks.workunit.client.0.smithi089.stdout:1/571: dwrite dc/d3a/d53/d2c/d6f/f84 [0,4194304] 0 2024-09-13T02:54:03.338 INFO:tasks.workunit.client.0.smithi089.stdout:1/572: rename dc/d44/d73/d86 to dc/d3a/d53/d2c/d34/d8b/db5 0 2024-09-13T02:54:03.338 INFO:tasks.workunit.client.0.smithi089.stdout:1/573: creat dc/d44/fb6 x:0 0 0 2024-09-13T02:54:03.340 INFO:tasks.workunit.client.0.smithi089.stdout:1/574: symlink dc/d46/d6c/d98/lb7 0 2024-09-13T02:54:03.341 INFO:tasks.workunit.client.0.smithi089.stdout:1/575: link dc/d3a/d93/l97 dc/d3a/d53/d2c/d36/lb8 0 2024-09-13T02:54:03.351 INFO:tasks.workunit.client.0.smithi089.stdout:7/725: dwrite d3/d19/d75/f12 [4194304,4194304] 0 2024-09-13T02:54:03.351 INFO:tasks.workunit.client.0.smithi089.stdout:6/598: dwrite db/d43/d6e/d28/d2f/f33 [0,4194304] 0 2024-09-13T02:54:03.352 INFO:tasks.workunit.client.0.smithi089.stdout:6/599: symlink db/d43/d6e/d28/d2f/lc7 0 2024-09-13T02:54:03.352 INFO:tasks.workunit.client.0.smithi089.stdout:7/726: write d3/d44/f58 [12433,65472] 0 2024-09-13T02:54:03.353 INFO:tasks.workunit.client.0.smithi089.stdout:6/600: mkdir db/d43/d6e/d28/d2f/dc8 0 2024-09-13T02:54:03.354 INFO:tasks.workunit.client.0.smithi089.stdout:6/601: read db/d10/f80 [275636,108823] 0 2024-09-13T02:54:03.355 INFO:tasks.workunit.client.0.smithi089.stdout:1/576: dwrite dc/d6e/fa2 [0,4194304] 0 2024-09-13T02:54:03.356 INFO:tasks.workunit.client.0.smithi089.stdout:7/727: symlink d3/d19/le7 0 2024-09-13T02:54:03.356 INFO:tasks.workunit.client.0.smithi089.stdout:6/602: rmdir db/d43/d6e/d28/d46/d7e/da1 39 2024-09-13T02:54:03.358 INFO:tasks.workunit.client.0.smithi089.stdout:1/577: symlink dc/d3a/d53/d2c/d36/lb9 0 2024-09-13T02:54:03.358 INFO:tasks.workunit.client.0.smithi089.stdout:1/578: stat dc/d44/d73/d9a/da1/lab 0 2024-09-13T02:54:03.358 INFO:tasks.workunit.client.0.smithi089.stdout:6/603: chown db/d10/f1e 7 1 2024-09-13T02:54:03.361 INFO:tasks.workunit.client.0.smithi089.stdout:7/728: dread d3/d19/d2e/f88 [0,4194304] 0 2024-09-13T02:54:03.361 INFO:tasks.workunit.client.0.smithi089.stdout:7/729: write d3/d44/f43 [1368767,121681] 0 2024-09-13T02:54:03.361 INFO:tasks.workunit.client.0.smithi089.stdout:7/730: dread - d3/d44/d85/fc1 zero size 2024-09-13T02:54:03.373 INFO:tasks.workunit.client.0.smithi089.stdout:7/731: dread d3/d19/d75/d14/d71/fc2 [0,4194304] 0 2024-09-13T02:54:03.374 INFO:tasks.workunit.client.0.smithi089.stdout:7/732: symlink d3/d19/d75/dbf/le8 0 2024-09-13T02:54:03.392 INFO:tasks.workunit.client.0.smithi089.stdout:6/604: dwrite db/d10/d3a/d7b/f91 [0,4194304] 0 2024-09-13T02:54:03.393 INFO:tasks.workunit.client.0.smithi089.stdout:1/579: dwrite dc/d44/f5e [0,4194304] 0 2024-09-13T02:54:03.398 INFO:tasks.workunit.client.0.smithi089.stdout:7/733: dwrite d3/d19/d75/f5a [0,4194304] 0 2024-09-13T02:54:03.398 INFO:tasks.workunit.client.0.smithi089.stdout:7/734: readlink d3/d44/d85/d55/lcd 0 2024-09-13T02:54:03.401 INFO:tasks.workunit.client.0.smithi089.stdout:7/735: mkdir d3/d19/d2e/d37/de9 0 2024-09-13T02:54:03.408 INFO:tasks.workunit.client.0.smithi089.stdout:7/736: dread d3/d19/d75/f18 [0,4194304] 0 2024-09-13T02:54:03.408 INFO:tasks.workunit.client.0.smithi089.stdout:1/580: dread dc/d46/f6b [0,4194304] 0 2024-09-13T02:54:03.409 INFO:tasks.workunit.client.0.smithi089.stdout:7/737: rename d3/d19/d2e/f33 to d3/d19/d75/fea 0 2024-09-13T02:54:03.415 INFO:tasks.workunit.client.0.smithi089.stdout:6/605: dwrite db/d43/d60/d74/f98 [0,4194304] 0 2024-09-13T02:54:03.415 INFO:tasks.workunit.client.0.smithi089.stdout:6/606: fsync db/d43/d6e/d28/d2f/f87 0 2024-09-13T02:54:03.415 INFO:tasks.workunit.client.0.smithi089.stdout:6/607: chown db/d43/d60/d7d/lbe 686018128 1 2024-09-13T02:54:03.416 INFO:tasks.workunit.client.0.smithi089.stdout:4/699: sync 2024-09-13T02:54:03.419 INFO:tasks.workunit.client.0.smithi089.stdout:4/700: symlink d2/d3/d5/d43/d84/le5 0 2024-09-13T02:54:03.421 INFO:tasks.workunit.client.0.smithi089.stdout:4/701: symlink d2/da/le6 0 2024-09-13T02:54:03.421 INFO:tasks.workunit.client.0.smithi089.stdout:4/702: truncate d2/d3/d5/fa9 945566 0 2024-09-13T02:54:03.421 INFO:tasks.workunit.client.0.smithi089.stdout:1/581: dread dc/f21 [0,4194304] 0 2024-09-13T02:54:03.422 INFO:tasks.workunit.client.0.smithi089.stdout:4/703: truncate d2/d3/d5/d43/d3b/d71/d99/daf/d8f/fce 2578076 0 2024-09-13T02:54:03.423 INFO:tasks.workunit.client.0.smithi089.stdout:7/738: dwrite d3/d19/d75/d63/da1/fc4 [0,4194304] 0 2024-09-13T02:54:03.424 INFO:tasks.workunit.client.0.smithi089.stdout:1/582: mkdir dc/d3a/d53/dba 0 2024-09-13T02:54:03.424 INFO:tasks.workunit.client.0.smithi089.stdout:4/704: rmdir d2/d3/d5 39 2024-09-13T02:54:03.424 INFO:tasks.workunit.client.0.smithi089.stdout:4/705: fsync d2/d55/f9f 0 2024-09-13T02:54:03.426 INFO:tasks.workunit.client.0.smithi089.stdout:6/608: write db/f49 [3613718,55315] 0 2024-09-13T02:54:03.426 INFO:tasks.workunit.client.0.smithi089.stdout:6/609: write db/d43/d6e/d28/d2f/d9b/fa6 [1317918,7931] 0 2024-09-13T02:54:03.427 INFO:tasks.workunit.client.0.smithi089.stdout:1/583: creat dc/d3a/d93/fbb x:0 0 0 2024-09-13T02:54:03.427 INFO:tasks.workunit.client.0.smithi089.stdout:1/584: creat dc/d3a/d53/d2c/d34/fbc x:0 0 0 2024-09-13T02:54:03.427 INFO:tasks.workunit.client.0.smithi089.stdout:1/585: chown dc/d3a/d53/d2c/d36/f40 1 1 2024-09-13T02:54:03.427 INFO:tasks.workunit.client.0.smithi089.stdout:1/586: read - dc/d6e/fa5 zero size 2024-09-13T02:54:03.427 INFO:tasks.workunit.client.0.smithi089.stdout:4/706: link d2/d3/d5/d43/d3b/d71/f81 d2/d3/fe7 0 2024-09-13T02:54:03.429 INFO:tasks.workunit.client.0.smithi089.stdout:7/739: write d3/d20/f32 [2261819,92016] 0 2024-09-13T02:54:03.430 INFO:tasks.workunit.client.0.smithi089.stdout:6/610: rename l1 to db/d10/d3a/d7b/lc9 0 2024-09-13T02:54:03.436 INFO:tasks.workunit.client.0.smithi089.stdout:7/740: creat d3/d19/d75/d63/ddd/feb x:0 0 0 2024-09-13T02:54:03.436 INFO:tasks.workunit.client.0.smithi089.stdout:7/741: write d3/d19/d67/f7b [287560,8584] 0 2024-09-13T02:54:03.436 INFO:tasks.workunit.client.0.smithi089.stdout:1/587: getdents dc/d44/d73 0 2024-09-13T02:54:03.437 INFO:tasks.workunit.client.0.smithi089.stdout:7/742: write d3/d19/d75/fdb [180769,123395] 0 2024-09-13T02:54:03.442 INFO:tasks.workunit.client.0.smithi089.stdout:2/560: sync 2024-09-13T02:54:03.442 INFO:tasks.workunit.client.0.smithi089.stdout:9/517: sync 2024-09-13T02:54:03.442 INFO:tasks.workunit.client.0.smithi089.stdout:2/561: fdatasync d13/f72 0 2024-09-13T02:54:03.442 INFO:tasks.workunit.client.0.smithi089.stdout:2/562: chown d13/d30/d4e/d7b/d86/da7 733210 1 2024-09-13T02:54:03.442 INFO:tasks.workunit.client.0.smithi089.stdout:2/563: dread - d13/d30/d4e/d7b/f92 zero size 2024-09-13T02:54:03.442 INFO:tasks.workunit.client.0.smithi089.stdout:4/707: rmdir d2/d22 39 2024-09-13T02:54:03.443 INFO:tasks.workunit.client.0.smithi089.stdout:7/743: mknod d3/d19/d75/d14/cec 0 2024-09-13T02:54:03.444 INFO:tasks.workunit.client.0.smithi089.stdout:9/518: creat d3/d6/d36/d9d/fa2 x:0 0 0 2024-09-13T02:54:03.445 INFO:tasks.workunit.client.0.smithi089.stdout:2/564: unlink d13/d30/d4e/d7b/d86/f98 0 2024-09-13T02:54:03.446 INFO:tasks.workunit.client.0.smithi089.stdout:2/565: truncate d13/d30/d4e/d7b/f92 433506 0 2024-09-13T02:54:03.446 INFO:tasks.workunit.client.0.smithi089.stdout:7/744: symlink d3/d20/led 0 2024-09-13T02:54:03.447 INFO:tasks.workunit.client.0.smithi089.stdout:9/519: mknod d3/d6/d2a/d94/d24/ca3 0 2024-09-13T02:54:03.448 INFO:tasks.workunit.client.0.smithi089.stdout:9/520: read f2 [2803789,82212] 0 2024-09-13T02:54:03.448 INFO:tasks.workunit.client.0.smithi089.stdout:2/566: link d13/d30/d59/c77 d13/d30/d64/cc4 0 2024-09-13T02:54:03.449 INFO:tasks.workunit.client.0.smithi089.stdout:6/611: dwrite db/d10/d3a/f47 [0,4194304] 0 2024-09-13T02:54:03.450 INFO:tasks.workunit.client.0.smithi089.stdout:9/521: unlink d3/d3d/l6b 0 2024-09-13T02:54:03.452 INFO:tasks.workunit.client.0.smithi089.stdout:2/567: rename d13/d30/d4e/c67 to d13/d30/d64/cc5 0 2024-09-13T02:54:03.454 INFO:tasks.workunit.client.0.smithi089.stdout:6/612: mknod db/d43/d60/cca 0 2024-09-13T02:54:03.454 INFO:tasks.workunit.client.0.smithi089.stdout:6/613: write db/d43/d6e/d28/d2f/f50 [5157191,67217] 0 2024-09-13T02:54:03.455 INFO:tasks.workunit.client.0.smithi089.stdout:9/522: mknod d3/d6/d2a/d94/d24/d32/ca4 0 2024-09-13T02:54:03.457 INFO:tasks.workunit.client.0.smithi089.stdout:6/614: truncate db/d10/f80 227260 0 2024-09-13T02:54:03.457 INFO:tasks.workunit.client.0.smithi089.stdout:6/615: fdatasync db/d10/f59 0 2024-09-13T02:54:03.459 INFO:tasks.workunit.client.0.smithi089.stdout:6/616: rmdir db/d43/d6e/d28/d2f/d9b 39 2024-09-13T02:54:03.459 INFO:tasks.workunit.client.0.smithi089.stdout:6/617: fsync db/d43/d6e/d28/d46/fbb 0 2024-09-13T02:54:03.459 INFO:tasks.workunit.client.0.smithi089.stdout:6/618: creat db/d10/d3a/fcb x:0 0 0 2024-09-13T02:54:03.462 INFO:tasks.workunit.client.0.smithi089.stdout:2/568: dread d13/f32 [0,4194304] 0 2024-09-13T02:54:03.465 INFO:tasks.workunit.client.0.smithi089.stdout:2/569: rename d13/f8c to d13/d30/d61/d78/d79/fc6 0 2024-09-13T02:54:03.469 INFO:tasks.workunit.client.0.smithi089.stdout:5/613: sync 2024-09-13T02:54:03.469 INFO:tasks.workunit.client.0.smithi089.stdout:8/627: sync 2024-09-13T02:54:03.469 INFO:tasks.workunit.client.0.smithi089.stdout:3/603: sync 2024-09-13T02:54:03.469 INFO:tasks.workunit.client.0.smithi089.stdout:0/558: sync 2024-09-13T02:54:03.469 INFO:tasks.workunit.client.0.smithi089.stdout:3/604: fsync d2/d20/d23/f88 0 2024-09-13T02:54:03.469 INFO:tasks.workunit.client.0.smithi089.stdout:3/605: fsync d2/d20/d23/d2b/f2f 0 2024-09-13T02:54:03.469 INFO:tasks.workunit.client.0.smithi089.stdout:8/628: write de/d16/d1e/d67/f7a [134856,26889] 0 2024-09-13T02:54:03.469 INFO:tasks.workunit.client.0.smithi089.stdout:0/559: creat d2/d19/d1a/fc2 x:0 0 0 2024-09-13T02:54:03.470 INFO:tasks.workunit.client.0.smithi089.stdout:0/560: write d2/d19/d1a/d1e/d42/f74 [854029,6936] 0 2024-09-13T02:54:03.470 INFO:tasks.workunit.client.0.smithi089.stdout:7/745: dwrite d3/d44/d85/d77/fd6 [0,4194304] 0 2024-09-13T02:54:03.470 INFO:tasks.workunit.client.0.smithi089.stdout:5/614: rmdir d1/d4/d45/d6f/d7c/db2/dbf 0 2024-09-13T02:54:03.471 INFO:tasks.workunit.client.0.smithi089.stdout:3/606: creat d2/d8/d5f/d72/fb9 x:0 0 0 2024-09-13T02:54:03.471 INFO:tasks.workunit.client.0.smithi089.stdout:8/629: link de/d16/d1e/d3f/f73 de/d16/d1e/d20/d6c/d6e/d7e/fce 0 2024-09-13T02:54:03.472 INFO:tasks.workunit.client.0.smithi089.stdout:8/630: fdatasync de/d16/d1e/d27/d52/d61/d8e/f90 0 2024-09-13T02:54:03.473 INFO:tasks.workunit.client.0.smithi089.stdout:0/561: stat d2/c25 0 2024-09-13T02:54:03.473 INFO:tasks.workunit.client.0.smithi089.stdout:3/607: dread d2/d8/dc/d3c/f5d [0,4194304] 0 2024-09-13T02:54:03.474 INFO:tasks.workunit.client.0.smithi089.stdout:7/746: rmdir d3/d19/d2e/d37/dad/dde 0 2024-09-13T02:54:03.475 INFO:tasks.workunit.client.0.smithi089.stdout:7/747: write d3/d44/d85/d55/d96/dc5/fd1 [133641,106087] 0 2024-09-13T02:54:03.476 INFO:tasks.workunit.client.0.smithi089.stdout:8/631: mkdir de/d16/d1e/d27/d52/d61/d8e/dcf 0 2024-09-13T02:54:03.476 INFO:tasks.workunit.client.0.smithi089.stdout:2/570: dread d13/f50 [0,4194304] 0 2024-09-13T02:54:03.477 INFO:tasks.workunit.client.0.smithi089.stdout:6/619: dwrite db/d10/d3a/f5d [0,4194304] 0 2024-09-13T02:54:03.477 INFO:tasks.workunit.client.0.smithi089.stdout:0/562: unlink d2/d19/d1a/fa0 0 2024-09-13T02:54:03.479 INFO:tasks.workunit.client.0.smithi089.stdout:3/608: rename d2/d20/d23/d27/fb3 to d2/d20/d23/d32/d49/fba 0 2024-09-13T02:54:03.479 INFO:tasks.workunit.client.0.smithi089.stdout:3/609: truncate d2/d20/d23/d2b/f89 793658 0 2024-09-13T02:54:03.480 INFO:tasks.workunit.client.0.smithi089.stdout:7/748: creat d3/d19/d2e/d37/dad/fee x:0 0 0 2024-09-13T02:54:03.480 INFO:tasks.workunit.client.0.smithi089.stdout:8/632: creat de/d16/d1e/d20/d6c/d6e/d7e/db7/fd0 x:0 0 0 2024-09-13T02:54:03.481 INFO:tasks.workunit.client.0.smithi089.stdout:2/571: symlink d13/d30/d4e/d6f/d76/lc7 0 2024-09-13T02:54:03.485 INFO:tasks.workunit.client.0.smithi089.stdout:3/610: write d2/d20/d23/d32/d5b/d71/f93 [397375,123868] 0 2024-09-13T02:54:03.486 INFO:tasks.workunit.client.0.smithi089.stdout:3/611: symlink d2/d8/d5f/d72/lbb 0 2024-09-13T02:54:03.486 INFO:tasks.workunit.client.0.smithi089.stdout:5/615: dwrite d1/d4/d45/d6f/d4d/d7f/d49/d5a/f94 [0,4194304] 0 2024-09-13T02:54:03.486 INFO:tasks.workunit.client.0.smithi089.stdout:3/612: read d2/d20/d23/d2b/f89 [38942,64413] 0 2024-09-13T02:54:03.490 INFO:tasks.workunit.client.0.smithi089.stdout:8/633: dread de/d16/d1e/d27/d52/d61/f75 [0,4194304] 0 2024-09-13T02:54:03.490 INFO:tasks.workunit.client.0.smithi089.stdout:8/634: write de/d16/d1e/d27/d35/f8b [1850701,105149] 0 2024-09-13T02:54:03.490 INFO:tasks.workunit.client.0.smithi089.stdout:5/616: mknod d1/d4/cc6 0 2024-09-13T02:54:03.490 INFO:tasks.workunit.client.0.smithi089.stdout:5/617: chown d1/d4/d2b/l84 65434 1 2024-09-13T02:54:03.490 INFO:tasks.workunit.client.0.smithi089.stdout:5/618: fdatasync d1/d4/d45/d6f/f74 0 2024-09-13T02:54:03.493 INFO:tasks.workunit.client.0.smithi089.stdout:3/613: link d2/d8/dc/d57/f68 d2/d20/d23/d32/d49/d75/fbc 0 2024-09-13T02:54:03.494 INFO:tasks.workunit.client.0.smithi089.stdout:3/614: write d2/d20/d23/d32/d49/d75/f78 [442911,2113] 0 2024-09-13T02:54:03.494 INFO:tasks.workunit.client.0.smithi089.stdout:3/615: creat d2/d20/d23/d32/d5b/fbd x:0 0 0 2024-09-13T02:54:03.494 INFO:tasks.workunit.client.0.smithi089.stdout:7/749: read d3/d19/f38 [3969534,92885] 0 2024-09-13T02:54:03.495 INFO:tasks.workunit.client.0.smithi089.stdout:8/635: mkdir de/d16/d1e/d20/da8/dd1 0 2024-09-13T02:54:03.498 INFO:tasks.workunit.client.0.smithi089.stdout:3/616: mkdir d2/d8/dc/dbe 0 2024-09-13T02:54:03.499 INFO:tasks.workunit.client.0.smithi089.stdout:8/636: creat de/d16/d1e/d3f/d5b/fd2 x:0 0 0 2024-09-13T02:54:03.499 INFO:tasks.workunit.client.0.smithi089.stdout:8/637: write de/d16/d1e/d27/d76/fb4 [360613,43169] 0 2024-09-13T02:54:03.499 INFO:tasks.workunit.client.0.smithi089.stdout:8/638: creat de/d16/d1e/d27/d35/d91/fd3 x:0 0 0 2024-09-13T02:54:03.500 INFO:tasks.workunit.client.0.smithi089.stdout:5/619: dread d1/d7/f30 [0,4194304] 0 2024-09-13T02:54:03.502 INFO:tasks.workunit.client.0.smithi089.stdout:3/617: rmdir d2/d8d 0 2024-09-13T02:54:03.502 INFO:tasks.workunit.client.0.smithi089.stdout:3/618: chown d2/d20/d23/d27/f4e 10 1 2024-09-13T02:54:03.509 INFO:tasks.workunit.client.0.smithi089.stdout:8/639: link de/d16/d1e/d27/d76/l9d de/d16/d1e/d20/d6c/d6e/d7e/ld4 0 2024-09-13T02:54:03.510 INFO:tasks.workunit.client.0.smithi089.stdout:8/640: dread - de/d16/d1e/d27/d35/f5a zero size 2024-09-13T02:54:03.510 INFO:tasks.workunit.client.0.smithi089.stdout:8/641: creat de/d16/d1e/d27/d76/d8d/fd5 x:0 0 0 2024-09-13T02:54:03.510 INFO:tasks.workunit.client.0.smithi089.stdout:8/642: chown de/d16/d1e/d27/d76/l62 8239805 1 2024-09-13T02:54:03.510 INFO:tasks.workunit.client.0.smithi089.stdout:8/643: truncate de/d16/d1e/d20/f6a 327154 0 2024-09-13T02:54:03.510 INFO:tasks.workunit.client.0.smithi089.stdout:8/644: truncate de/d16/d1e/d3f/d5b/fa5 102589 0 2024-09-13T02:54:03.510 INFO:tasks.workunit.client.0.smithi089.stdout:8/645: chown de/d16/f6f 23930 1 2024-09-13T02:54:03.516 INFO:tasks.workunit.client.0.smithi089.stdout:8/646: mknod de/d16/d1e/d27/d52/d61/d8e/cd6 0 2024-09-13T02:54:03.517 INFO:tasks.workunit.client.0.smithi089.stdout:8/647: truncate de/f10 156238 0 2024-09-13T02:54:03.517 INFO:tasks.workunit.client.0.smithi089.stdout:8/648: truncate de/d16/d1e/d27/d52/fbb 4235390 0 2024-09-13T02:54:03.517 INFO:tasks.workunit.client.0.smithi089.stdout:8/649: mknod de/cd7 0 2024-09-13T02:54:03.518 INFO:tasks.workunit.client.0.smithi089.stdout:8/650: symlink de/d16/d1e/d3f/ld8 0 2024-09-13T02:54:03.520 INFO:tasks.workunit.client.0.smithi089.stdout:0/563: dwrite d2/f3 [0,4194304] 0 2024-09-13T02:54:03.520 INFO:tasks.workunit.client.0.smithi089.stdout:8/651: mkdir de/d16/d1e/d3f/dd9 0 2024-09-13T02:54:03.520 INFO:tasks.workunit.client.0.smithi089.stdout:8/652: mknod de/d16/d1e/d20/da8/dd1/cda 0 2024-09-13T02:54:03.521 INFO:tasks.workunit.client.0.smithi089.stdout:8/653: mkdir de/d16/d1e/d20/ddb 0 2024-09-13T02:54:03.521 INFO:tasks.workunit.client.0.smithi089.stdout:8/654: dread - de/d16/d1e/d20/f80 zero size 2024-09-13T02:54:03.521 INFO:tasks.workunit.client.0.smithi089.stdout:8/655: write de/d16/d1e/d27/f79 [885713,21357] 0 2024-09-13T02:54:03.522 INFO:tasks.workunit.client.0.smithi089.stdout:8/656: symlink de/d16/d1e/d20/d39/ldc 0 2024-09-13T02:54:03.526 INFO:tasks.workunit.client.0.smithi089.stdout:7/750: dwrite d3/d44/d85/d5e/d6f/f89 [0,4194304] 0 2024-09-13T02:54:03.527 INFO:tasks.workunit.client.0.smithi089.stdout:3/619: dwrite d2/d8/dc/d57/fae [0,4194304] 0 2024-09-13T02:54:03.527 INFO:tasks.workunit.client.0.smithi089.stdout:3/620: read - d2/d8/dc/fa2 zero size 2024-09-13T02:54:03.527 INFO:tasks.workunit.client.0.smithi089.stdout:2/572: dwrite d13/d30/d4e/f65 [0,4194304] 0 2024-09-13T02:54:03.528 INFO:tasks.workunit.client.0.smithi089.stdout:3/621: write d2/d20/d23/d2b/f2f [4815048,89897] 0 2024-09-13T02:54:03.529 INFO:tasks.workunit.client.0.smithi089.stdout:7/751: creat d3/d44/d85/d77/dd7/fef x:0 0 0 2024-09-13T02:54:03.532 INFO:tasks.workunit.client.0.smithi089.stdout:2/573: creat d13/d30/fc8 x:0 0 0 2024-09-13T02:54:03.539 INFO:tasks.workunit.client.0.smithi089.stdout:2/574: mknod d13/d30/d59/dbe/cc9 0 2024-09-13T02:54:03.539 INFO:tasks.workunit.client.0.smithi089.stdout:2/575: chown d13/d30/f48 3469 1 2024-09-13T02:54:03.541 INFO:tasks.workunit.client.0.smithi089.stdout:2/576: mkdir d13/d30/d61/dca 0 2024-09-13T02:54:03.541 INFO:tasks.workunit.client.0.smithi089.stdout:2/577: readlink d13/d30/lba 0 2024-09-13T02:54:03.542 INFO:tasks.workunit.client.0.smithi089.stdout:2/578: creat d13/d30/d4e/d6f/fcb x:0 0 0 2024-09-13T02:54:03.549 INFO:tasks.workunit.client.0.smithi089.stdout:2/579: dread d13/d30/d4e/f51 [0,4194304] 0 2024-09-13T02:54:03.551 INFO:tasks.workunit.client.0.smithi089.stdout:3/622: dwrite d2/d8/dc/fa2 [0,4194304] 0 2024-09-13T02:54:03.551 INFO:tasks.workunit.client.0.smithi089.stdout:3/623: dread - d2/d20/d23/d32/d49/fba zero size 2024-09-13T02:54:03.551 INFO:tasks.workunit.client.0.smithi089.stdout:8/657: dwrite de/d16/d1e/d3f/fae [0,4194304] 0 2024-09-13T02:54:03.552 INFO:tasks.workunit.client.0.smithi089.stdout:7/752: dwrite d3/d19/d75/d63/da1/fc4 [0,4194304] 0 2024-09-13T02:54:03.552 INFO:tasks.workunit.client.0.smithi089.stdout:7/753: fdatasync d3/d19/d75/db2/fd9 0 2024-09-13T02:54:03.554 INFO:tasks.workunit.client.0.smithi089.stdout:8/658: unlink de/d16/d1e/d27/d35/f74 0 2024-09-13T02:54:03.555 INFO:tasks.workunit.client.0.smithi089.stdout:7/754: symlink d3/d44/d85/d55/lf0 0 2024-09-13T02:54:03.557 INFO:tasks.workunit.client.0.smithi089.stdout:8/659: rename de/d16/d1e/d3f/c9a to de/d16/d1e/d27/d52/dc2/cdd 0 2024-09-13T02:54:03.557 INFO:tasks.workunit.client.0.smithi089.stdout:8/660: dread - de/d16/d1e/d27/d76/d8d/fa0 zero size 2024-09-13T02:54:03.559 INFO:tasks.workunit.client.0.smithi089.stdout:7/755: link d3/d19/f4d d3/d19/d75/d63/da1/db4/dd3/ff1 0 2024-09-13T02:54:03.559 INFO:tasks.workunit.client.0.smithi089.stdout:1/588: sync 2024-09-13T02:54:03.559 INFO:tasks.workunit.client.0.smithi089.stdout:4/708: sync 2024-09-13T02:54:03.559 INFO:tasks.workunit.client.0.smithi089.stdout:1/589: write dc/d3a/f41 [2870564,120812] 0 2024-09-13T02:54:03.559 INFO:tasks.workunit.client.0.smithi089.stdout:4/709: write d2/da/f6d [1041795,63119] 0 2024-09-13T02:54:03.559 INFO:tasks.workunit.client.0.smithi089.stdout:1/590: dread - dc/f30 zero size 2024-09-13T02:54:03.560 INFO:tasks.workunit.client.0.smithi089.stdout:1/591: chown dc/c11 7827145 1 2024-09-13T02:54:03.560 INFO:tasks.workunit.client.0.smithi089.stdout:8/661: mknod de/d56/cde 0 2024-09-13T02:54:03.562 INFO:tasks.workunit.client.0.smithi089.stdout:7/756: creat d3/d54/ff2 x:0 0 0 2024-09-13T02:54:03.562 INFO:tasks.workunit.client.0.smithi089.stdout:7/757: fdatasync d3/d44/d85/d5e/d6f/fae 0 2024-09-13T02:54:03.564 INFO:tasks.workunit.client.0.smithi089.stdout:1/592: creat dc/d3a/d53/dba/fbd x:0 0 0 2024-09-13T02:54:03.564 INFO:tasks.workunit.client.0.smithi089.stdout:1/593: creat dc/d3a/d53/d2c/d34/d8b/fbe x:0 0 0 2024-09-13T02:54:03.565 INFO:tasks.workunit.client.0.smithi089.stdout:3/624: write d2/d20/d23/d2b/f89 [3835747,49408] 0 2024-09-13T02:54:03.565 INFO:tasks.workunit.client.0.smithi089.stdout:3/625: fdatasync d2/d20/f4b 0 2024-09-13T02:54:03.567 INFO:tasks.workunit.client.0.smithi089.stdout:1/594: unlink dc/d46/d6c/d98/lb7 0 2024-09-13T02:54:03.567 INFO:tasks.workunit.client.0.smithi089.stdout:1/595: write dc/d46/f79 [913419,17972] 0 2024-09-13T02:54:03.568 INFO:tasks.workunit.client.0.smithi089.stdout:7/758: rmdir d3/d19/d75/d14/d71 39 2024-09-13T02:54:03.570 INFO:tasks.workunit.client.0.smithi089.stdout:3/626: creat d2/d8/dc/dbe/fbf x:0 0 0 2024-09-13T02:54:03.571 INFO:tasks.workunit.client.0.smithi089.stdout:3/627: readlink d2/d20/l46 0 2024-09-13T02:54:03.571 INFO:tasks.workunit.client.0.smithi089.stdout:3/628: truncate d2/d20/d23/d2b/f53 184065 0 2024-09-13T02:54:03.571 INFO:tasks.workunit.client.0.smithi089.stdout:3/629: chown d2/d8/dc 1 1 2024-09-13T02:54:03.571 INFO:tasks.workunit.client.0.smithi089.stdout:3/630: creat d2/d20/fc0 x:0 0 0 2024-09-13T02:54:03.571 INFO:tasks.workunit.client.0.smithi089.stdout:1/596: truncate dc/f22 157819 0 2024-09-13T02:54:03.571 INFO:tasks.workunit.client.0.smithi089.stdout:7/759: mknod d3/d19/d75/d63/da1/db4/dd3/cf3 0 2024-09-13T02:54:03.572 INFO:tasks.workunit.client.0.smithi089.stdout:7/760: write d3/d19/d75/d14/da0/db0/fd0 [944858,59715] 0 2024-09-13T02:54:03.573 INFO:tasks.workunit.client.0.smithi089.stdout:3/631: mknod d2/d20/d23/d32/cc1 0 2024-09-13T02:54:03.573 INFO:tasks.workunit.client.0.smithi089.stdout:7/761: symlink d3/d19/d75/d14/da0/lf4 0 2024-09-13T02:54:03.573 INFO:tasks.workunit.client.0.smithi089.stdout:7/762: read - d3/d54/f98 zero size 2024-09-13T02:54:03.574 INFO:tasks.workunit.client.0.smithi089.stdout:3/632: symlink d2/d8/dc/d3c/d65/lc2 0 2024-09-13T02:54:03.574 INFO:tasks.workunit.client.0.smithi089.stdout:7/763: truncate d3/d44/d85/d77/f8c 2954034 0 2024-09-13T02:54:03.575 INFO:tasks.workunit.client.0.smithi089.stdout:3/633: mknod d2/d8/dc/d3c/cc3 0 2024-09-13T02:54:03.577 INFO:tasks.workunit.client.0.smithi089.stdout:8/662: write de/d16/d1e/d27/f3b [1792895,102986] 0 2024-09-13T02:54:03.577 INFO:tasks.workunit.client.0.smithi089.stdout:8/663: creat de/d16/d1e/d3f/fdf x:0 0 0 2024-09-13T02:54:03.577 INFO:tasks.workunit.client.0.smithi089.stdout:3/634: link d2/d8/dc/d3c/l4c d2/lc4 0 2024-09-13T02:54:03.577 INFO:tasks.workunit.client.0.smithi089.stdout:2/580: dwrite d13/d30/d59/faa [0,4194304] 0 2024-09-13T02:54:03.579 INFO:tasks.workunit.client.0.smithi089.stdout:8/664: mknod de/d16/d1e/d3f/ce0 0 2024-09-13T02:54:03.579 INFO:tasks.workunit.client.0.smithi089.stdout:8/665: readlink de/d16/d1e/d3f/d5b/l63 0 2024-09-13T02:54:03.579 INFO:tasks.workunit.client.0.smithi089.stdout:3/635: creat d2/d8/dc/d3c/d9e/fc5 x:0 0 0 2024-09-13T02:54:03.581 INFO:tasks.workunit.client.0.smithi089.stdout:2/581: rename d13/d30/d59/cb9 to d13/d30/ccc 0 2024-09-13T02:54:03.583 INFO:tasks.workunit.client.0.smithi089.stdout:8/666: symlink de/d16/le1 0 2024-09-13T02:54:03.584 INFO:tasks.workunit.client.0.smithi089.stdout:8/667: mkdir de/d16/d1e/d3f/de2 0 2024-09-13T02:54:03.584 INFO:tasks.workunit.client.0.smithi089.stdout:1/597: dread dc/f1a [0,4194304] 0 2024-09-13T02:54:03.584 INFO:tasks.workunit.client.0.smithi089.stdout:8/668: rename de/d16/d1e/d20 to de/d16/d1e/d20/de3 22 2024-09-13T02:54:03.586 INFO:tasks.workunit.client.0.smithi089.stdout:8/669: symlink de/d16/le4 0 2024-09-13T02:54:03.586 INFO:tasks.workunit.client.0.smithi089.stdout:4/710: dwrite d2/d22/da1/f36 [0,4194304] 0 2024-09-13T02:54:03.588 INFO:tasks.workunit.client.0.smithi089.stdout:8/670: rename de/d16/d1e/d20/d6c/d6e/faa to de/d16/d1e/d20/da8/dac/fe5 0 2024-09-13T02:54:03.589 INFO:tasks.workunit.client.0.smithi089.stdout:4/711: mkdir d2/d22/da1/d62/de8 0 2024-09-13T02:54:03.589 INFO:tasks.workunit.client.0.smithi089.stdout:4/712: write d2/da/f6d [1805398,84820] 0 2024-09-13T02:54:03.591 INFO:tasks.workunit.client.0.smithi089.stdout:2/582: dread f1 [0,4194304] 0 2024-09-13T02:54:03.592 INFO:tasks.workunit.client.0.smithi089.stdout:2/583: getdents d13/d30/d61/dca 0 2024-09-13T02:54:03.592 INFO:tasks.workunit.client.0.smithi089.stdout:2/584: write d13/d30/d4e/d6f/fcb [964175,24160] 0 2024-09-13T02:54:03.592 INFO:tasks.workunit.client.0.smithi089.stdout:8/671: link de/d16/d1e/d20/d6c/d6e/cc9 de/d16/d1e/d3f/de2/ce6 0 2024-09-13T02:54:03.593 INFO:tasks.workunit.client.0.smithi089.stdout:7/764: dwrite d3/d19/d75/dbf/fe0 [0,4194304] 0 2024-09-13T02:54:03.597 INFO:tasks.workunit.client.0.smithi089.stdout:2/585: symlink d13/d30/d4e/d7b/d86/lcd 0 2024-09-13T02:54:03.598 INFO:tasks.workunit.client.0.smithi089.stdout:8/672: mkdir de/d16/d1e/d20/d6c/d6e/d7e/de7 0 2024-09-13T02:54:03.600 INFO:tasks.workunit.client.0.smithi089.stdout:7/765: mknod d3/d44/d85/d55/d96/cf5 0 2024-09-13T02:54:03.602 INFO:tasks.workunit.client.0.smithi089.stdout:4/713: rename d2/d3/d5/fc8 to d2/d3/fe9 0 2024-09-13T02:54:03.602 INFO:tasks.workunit.client.0.smithi089.stdout:4/714: chown d2/d22/da1 3 1 2024-09-13T02:54:03.602 INFO:tasks.workunit.client.0.smithi089.stdout:1/598: dwrite dc/d3a/d53/d2c/d36/f3b [0,4194304] 0 2024-09-13T02:54:03.602 INFO:tasks.workunit.client.0.smithi089.stdout:1/599: readlink dc/d44/d73/l64 0 2024-09-13T02:54:03.604 INFO:tasks.workunit.client.0.smithi089.stdout:2/586: symlink d13/d30/d4e/d7b/d86/lce 0 2024-09-13T02:54:03.604 INFO:tasks.workunit.client.0.smithi089.stdout:2/587: chown d13/d30/fc8 0 1 2024-09-13T02:54:03.604 INFO:tasks.workunit.client.0.smithi089.stdout:2/588: chown d13/d30/d64/d82/db7 92458 1 2024-09-13T02:54:03.604 INFO:tasks.workunit.client.0.smithi089.stdout:8/673: symlink de/d16/d1e/d27/d52/d61/le8 0 2024-09-13T02:54:03.604 INFO:tasks.workunit.client.0.smithi089.stdout:8/674: fsync de/d16/d1e/d20/f2b 0 2024-09-13T02:54:03.604 INFO:tasks.workunit.client.0.smithi089.stdout:8/675: chown de/d16/d1e/d20/d6c/d6e/d7e/de7 2 1 2024-09-13T02:54:03.606 INFO:tasks.workunit.client.0.smithi089.stdout:4/715: mknod d2/d22/cea 0 2024-09-13T02:54:03.607 INFO:tasks.workunit.client.0.smithi089.stdout:8/676: symlink de/d16/d1e/d27/d76/d8d/le9 0 2024-09-13T02:54:03.609 INFO:tasks.workunit.client.0.smithi089.stdout:1/600: dread dc/d46/f6b [0,4194304] 0 2024-09-13T02:54:03.609 INFO:tasks.workunit.client.0.smithi089.stdout:1/601: chown dc/d46/f6b 24 1 2024-09-13T02:54:03.609 INFO:tasks.workunit.client.0.smithi089.stdout:4/716: creat d2/d22/da1/d62/de8/feb x:0 0 0 2024-09-13T02:54:03.609 INFO:tasks.workunit.client.0.smithi089.stdout:8/677: mkdir de/d16/d1e/d27/d52/dc2/dea 0 2024-09-13T02:54:03.610 INFO:tasks.workunit.client.0.smithi089.stdout:4/717: symlink d2/d3/d5/d43/d3b/d71/d78/d9c/dbf/lec 0 2024-09-13T02:54:03.614 INFO:tasks.workunit.client.0.smithi089.stdout:4/718: rmdir d2/d3/d5/d72 39 2024-09-13T02:54:03.614 INFO:tasks.workunit.client.0.smithi089.stdout:4/719: dread - d2/d3/d5/d43/d3b/d71/d99/daf/dc6/fe0 zero size 2024-09-13T02:54:03.614 INFO:tasks.workunit.client.0.smithi089.stdout:4/720: dread - d2/d3/d5/d43/d3b/d71/d99/daf/dc6/fe0 zero size 2024-09-13T02:54:03.616 INFO:tasks.workunit.client.0.smithi089.stdout:4/721: creat d2/d22/da1/d62/d6c/d88/db2/fed x:0 0 0 2024-09-13T02:54:03.616 INFO:tasks.workunit.client.0.smithi089.stdout:4/722: fsync d2/d22/f94 0 2024-09-13T02:54:03.616 INFO:tasks.workunit.client.0.smithi089.stdout:4/723: stat d2/d22/da1/d62/f68 0 2024-09-13T02:54:03.616 INFO:tasks.workunit.client.0.smithi089.stdout:4/724: chown d2/d3/d5/d43/fdb 272118055 1 2024-09-13T02:54:03.621 INFO:tasks.workunit.client.0.smithi089.stdout:7/766: dwrite d3/d44/d85/fc1 [0,4194304] 0 2024-09-13T02:54:03.623 INFO:tasks.workunit.client.0.smithi089.stdout:2/589: dwrite d13/d30/d4e/d6f/f8f [0,4194304] 0 2024-09-13T02:54:03.629 INFO:tasks.workunit.client.0.smithi089.stdout:2/590: link d13/l3d d13/d30/d64/lcf 0 2024-09-13T02:54:03.633 INFO:tasks.workunit.client.0.smithi089.stdout:2/591: getdents d13/d30/d61/d78 0 2024-09-13T02:54:03.654 INFO:tasks.workunit.client.0.smithi089.stdout:8/678: dwrite de/d16/d1e/d67/f7f [0,4194304] 0 2024-09-13T02:54:03.654 INFO:tasks.workunit.client.0.smithi089.stdout:1/602: dwrite dc/d46/d6c/d98/fb1 [0,4194304] 0 2024-09-13T02:54:03.654 INFO:tasks.workunit.client.0.smithi089.stdout:1/603: chown dc/d44/l7b 0 1 2024-09-13T02:54:03.654 INFO:tasks.workunit.client.0.smithi089.stdout:1/604: creat dc/d44/d73/d85/fbf x:0 0 0 2024-09-13T02:54:03.654 INFO:tasks.workunit.client.0.smithi089.stdout:1/605: read dc/f17 [140992,30924] 0 2024-09-13T02:54:03.654 INFO:tasks.workunit.client.0.smithi089.stdout:4/725: dwrite d2/d22/da1/fc0 [0,4194304] 0 2024-09-13T02:54:03.654 INFO:tasks.workunit.client.0.smithi089.stdout:7/767: dwrite d3/d44/d85/d55/f8d [0,4194304] 0 2024-09-13T02:54:03.654 INFO:tasks.workunit.client.0.smithi089.stdout:7/768: truncate d3/d44/d85/d55/d96/dc5/fd1 901183 0 2024-09-13T02:54:03.662 INFO:tasks.workunit.client.0.smithi089.stdout:1/606: dread dc/d3a/d53/f28 [0,4194304] 0 2024-09-13T02:54:03.665 INFO:tasks.workunit.client.0.smithi089.stdout:4/726: rename d2/d3/d5/d43/d3b/f54 to d2/d3/d5/d43/d3b/d71/fee 0 2024-09-13T02:54:03.667 INFO:tasks.workunit.client.0.smithi089.stdout:1/607: mkdir dc/d44/d73/dc0 0 2024-09-13T02:54:03.670 INFO:tasks.workunit.client.0.smithi089.stdout:1/608: link dc/d3a/l7f dc/d44/d73/d85/lc1 0 2024-09-13T02:54:03.673 INFO:tasks.workunit.client.0.smithi089.stdout:9/523: sync 2024-09-13T02:54:03.673 INFO:tasks.workunit.client.0.smithi089.stdout:9/524: getdents d3/d6/d2a/d4b/d54/da1 0 2024-09-13T02:54:03.673 INFO:tasks.workunit.client.0.smithi089.stdout:9/525: chown d3/d6/d36/d9d 11607 1 2024-09-13T02:54:03.673 INFO:tasks.workunit.client.0.smithi089.stdout:4/727: write d2/d3/d5/d43/d3b/d71/d99/fa3 [1926540,108967] 0 2024-09-13T02:54:03.675 INFO:tasks.workunit.client.0.smithi089.stdout:4/728: truncate d2/d3/d5/d43/f50 1397340 0 2024-09-13T02:54:03.677 INFO:tasks.workunit.client.0.smithi089.stdout:4/729: symlink d2/d3/lef 0 2024-09-13T02:54:03.679 INFO:tasks.workunit.client.0.smithi089.stdout:0/564: sync 2024-09-13T02:54:03.679 INFO:tasks.workunit.client.0.smithi089.stdout:6/620: sync 2024-09-13T02:54:03.688 INFO:tasks.workunit.client.0.smithi089.stdout:9/526: dread d3/d6/d2a/d94/f38 [0,4194304] 0 2024-09-13T02:54:03.689 INFO:tasks.workunit.client.0.smithi089.stdout:9/527: getdents d3/d4c/d91 0 2024-09-13T02:54:03.689 INFO:tasks.workunit.client.0.smithi089.stdout:9/528: write d3/d6/d2a/d94/d24/d35/f80 [4122566,114983] 0 2024-09-13T02:54:03.690 INFO:tasks.workunit.client.0.smithi089.stdout:2/592: dwrite d13/d30/d4e/d6f/fcb [0,4194304] 0 2024-09-13T02:54:03.690 INFO:tasks.workunit.client.0.smithi089.stdout:8/679: dwrite de/d16/d1e/d20/da8/fbf [0,4194304] 0 2024-09-13T02:54:03.692 INFO:tasks.workunit.client.0.smithi089.stdout:9/529: mknod d3/d6/d36/ca5 0 2024-09-13T02:54:03.693 INFO:tasks.workunit.client.0.smithi089.stdout:2/593: symlink d13/d30/d4e/ld0 0 2024-09-13T02:54:03.694 INFO:tasks.workunit.client.0.smithi089.stdout:7/769: dwrite d3/d19/d75/fa7 [0,4194304] 0 2024-09-13T02:54:03.694 INFO:tasks.workunit.client.0.smithi089.stdout:4/730: write d2/d22/f9b [4106577,108545] 0 2024-09-13T02:54:03.696 INFO:tasks.workunit.client.0.smithi089.stdout:8/680: mknod de/d16/d1e/d20/da8/ceb 0 2024-09-13T02:54:03.697 INFO:tasks.workunit.client.0.smithi089.stdout:5/620: sync 2024-09-13T02:54:03.697 INFO:tasks.workunit.client.0.smithi089.stdout:5/621: truncate d1/f69 5209956 0 2024-09-13T02:54:03.699 INFO:tasks.workunit.client.0.smithi089.stdout:7/770: creat d3/d19/d2e/ff6 x:0 0 0 2024-09-13T02:54:03.699 INFO:tasks.workunit.client.0.smithi089.stdout:7/771: write d3/d19/d75/d63/da1/fcb [88067,63353] 0 2024-09-13T02:54:03.699 INFO:tasks.workunit.client.0.smithi089.stdout:2/594: getdents d13/d30/d4e/d7b/d86 0 2024-09-13T02:54:03.701 INFO:tasks.workunit.client.0.smithi089.stdout:5/622: truncate d1/d4/f97 2355501 0 2024-09-13T02:54:03.702 INFO:tasks.workunit.client.0.smithi089.stdout:7/772: unlink d3/d44/d85/d77/c9b 0 2024-09-13T02:54:03.704 INFO:tasks.workunit.client.0.smithi089.stdout:7/773: truncate d3/d44/d85/f50 907361 0 2024-09-13T02:54:03.704 INFO:tasks.workunit.client.0.smithi089.stdout:9/530: dread d3/d6/d2a/f4f [0,4194304] 0 2024-09-13T02:54:03.705 INFO:tasks.workunit.client.0.smithi089.stdout:9/531: creat d3/d6/d2a/d4b/fa6 x:0 0 0 2024-09-13T02:54:03.706 INFO:tasks.workunit.client.0.smithi089.stdout:7/774: rename d3/d44/d85/d77/dd7/fef to d3/d44/ff7 0 2024-09-13T02:54:03.707 INFO:tasks.workunit.client.0.smithi089.stdout:9/532: truncate d3/f22 1807136 0 2024-09-13T02:54:03.711 INFO:tasks.workunit.client.0.smithi089.stdout:9/533: rename d3/d6/d2a/d94/d24/d29/d81 to d3/d6/d2a/d94/da7 0 2024-09-13T02:54:03.711 INFO:tasks.workunit.client.0.smithi089.stdout:9/534: write d3/d6/d2a/d94/d24/f48 [1062088,1192] 0 2024-09-13T02:54:03.712 INFO:tasks.workunit.client.0.smithi089.stdout:9/535: readlink d3/lb 0 2024-09-13T02:54:03.712 INFO:tasks.workunit.client.0.smithi089.stdout:9/536: chown d3/d6/d36/fa0 1 1 2024-09-13T02:54:03.713 INFO:tasks.workunit.client.0.smithi089.stdout:9/537: chown d3/d6/d2a/d4b/d6d 206298376 1 2024-09-13T02:54:03.713 INFO:tasks.workunit.client.0.smithi089.stdout:9/538: readlink d3/d6/d2a/d94/l7e 0 2024-09-13T02:54:03.715 INFO:tasks.workunit.client.0.smithi089.stdout:2/595: write d13/f32 [629048,125521] 0 2024-09-13T02:54:03.716 INFO:tasks.workunit.client.0.smithi089.stdout:2/596: truncate fc 2433680 0 2024-09-13T02:54:03.717 INFO:tasks.workunit.client.0.smithi089.stdout:2/597: mknod d13/d30/d64/cd1 0 2024-09-13T02:54:03.717 INFO:tasks.workunit.client.0.smithi089.stdout:2/598: readlink d13/l6c 0 2024-09-13T02:54:03.719 INFO:tasks.workunit.client.0.smithi089.stdout:2/599: link d13/d30/d59/f96 d13/d30/d4e/fd2 0 2024-09-13T02:54:03.720 INFO:tasks.workunit.client.0.smithi089.stdout:2/600: rename d13/d30/d61/d78/d79/d7c to d13/d30/d61/d78/dd3 0 2024-09-13T02:54:03.728 INFO:tasks.workunit.client.0.smithi089.stdout:6/621: dwrite db/d43/d6e/d28/d37/f72 [0,4194304] 0 2024-09-13T02:54:03.728 INFO:tasks.workunit.client.0.smithi089.stdout:0/565: dwrite d2/d19/d1a/d3d/d4b/d4f/f9d [0,4194304] 0 2024-09-13T02:54:03.728 INFO:tasks.workunit.client.0.smithi089.stdout:0/566: truncate d2/fb0 652834 0 2024-09-13T02:54:03.730 INFO:tasks.workunit.client.0.smithi089.stdout:6/622: creat db/d43/fcc x:0 0 0 2024-09-13T02:54:03.733 INFO:tasks.workunit.client.0.smithi089.stdout:5/623: dwrite d1/d4/d45/d6f/d62/f79 [0,4194304] 0 2024-09-13T02:54:03.735 INFO:tasks.workunit.client.0.smithi089.stdout:7/775: dwrite d3/d54/ff2 [0,4194304] 0 2024-09-13T02:54:03.737 INFO:tasks.workunit.client.0.smithi089.stdout:4/731: dwrite d2/fab [4194304,4194304] 0 2024-09-13T02:54:03.737 INFO:tasks.workunit.client.0.smithi089.stdout:8/681: dwrite de/d16/d1e/d3f/f46 [0,4194304] 0 2024-09-13T02:54:03.737 INFO:tasks.workunit.client.0.smithi089.stdout:8/682: truncate de/d16/d1e/d20/f2b 590874 0 2024-09-13T02:54:03.738 INFO:tasks.workunit.client.0.smithi089.stdout:8/683: stat de/f1a 0 2024-09-13T02:54:03.738 INFO:tasks.workunit.client.0.smithi089.stdout:3/636: sync 2024-09-13T02:54:03.741 INFO:tasks.workunit.client.0.smithi089.stdout:4/732: mkdir d2/d3/d5/d43/d3b/d71/d99/daf/d8f/df0 0 2024-09-13T02:54:03.743 INFO:tasks.workunit.client.0.smithi089.stdout:3/637: symlink d2/d8/dc/d3c/d9e/lc6 0 2024-09-13T02:54:03.744 INFO:tasks.workunit.client.0.smithi089.stdout:6/623: write db/d10/f1e [2545785,52836] 0 2024-09-13T02:54:03.744 INFO:tasks.workunit.client.0.smithi089.stdout:6/624: dread - db/d43/d6e/d28/d46/fab zero size 2024-09-13T02:54:03.744 INFO:tasks.workunit.client.0.smithi089.stdout:4/733: mkdir d2/d3/d5/d43/d84/df1 0 2024-09-13T02:54:03.746 INFO:tasks.workunit.client.0.smithi089.stdout:3/638: unlink d2/d20/d44/l4f 0 2024-09-13T02:54:03.747 INFO:tasks.workunit.client.0.smithi089.stdout:3/639: write d2/d8/f95 [4753084,101127] 0 2024-09-13T02:54:03.747 INFO:tasks.workunit.client.0.smithi089.stdout:3/640: truncate d2/d20/d23/d32/d5b/f9d 762906 0 2024-09-13T02:54:03.747 INFO:tasks.workunit.client.0.smithi089.stdout:8/684: dread de/d16/d1e/d20/d39/f70 [0,4194304] 0 2024-09-13T02:54:03.750 INFO:tasks.workunit.client.0.smithi089.stdout:0/567: dwrite d2/fa3 [0,4194304] 0 2024-09-13T02:54:03.753 INFO:tasks.workunit.client.0.smithi089.stdout:4/734: unlink d2/d22/da1/f95 0 2024-09-13T02:54:03.755 INFO:tasks.workunit.client.0.smithi089.stdout:3/641: mknod d2/d8/dc/d9a/d9c/dab/cc7 0 2024-09-13T02:54:03.757 INFO:tasks.workunit.client.0.smithi089.stdout:3/642: dread d2/d20/d23/d32/d5b/f9d [0,4194304] 0 2024-09-13T02:54:03.757 INFO:tasks.workunit.client.0.smithi089.stdout:8/685: symlink de/d16/d1e/d27/d52/d61/lec 0 2024-09-13T02:54:03.759 INFO:tasks.workunit.client.0.smithi089.stdout:6/625: rename db/d43/d60 to db/d43/d6e/d28/d37/d8b/dcd 0 2024-09-13T02:54:03.762 INFO:tasks.workunit.client.0.smithi089.stdout:5/624: dwrite d1/f78 [0,4194304] 0 2024-09-13T02:54:03.762 INFO:tasks.workunit.client.0.smithi089.stdout:5/625: write d1/d4/d45/d6f/d4d/d7f/d49/fb3 [738587,79081] 0 2024-09-13T02:54:03.764 INFO:tasks.workunit.client.0.smithi089.stdout:7/776: dwrite d3/d20/f5d [4194304,4194304] 0 2024-09-13T02:54:03.764 INFO:tasks.workunit.client.0.smithi089.stdout:7/777: truncate d3/d44/d85/d5e/d6f/fae 4639444 0 2024-09-13T02:54:03.765 INFO:tasks.workunit.client.0.smithi089.stdout:4/735: mkdir d2/d22/da1/d62/d6c/d88/db2/df2 0 2024-09-13T02:54:03.765 INFO:tasks.workunit.client.0.smithi089.stdout:4/736: truncate d2/d3/d5/d72/fcb 151113 0 2024-09-13T02:54:03.766 INFO:tasks.workunit.client.0.smithi089.stdout:3/643: mkdir d2/d8/dc/dbe/dc8 0 2024-09-13T02:54:03.766 INFO:tasks.workunit.client.0.smithi089.stdout:3/644: write d2/d20/fc0 [104313,96256] 0 2024-09-13T02:54:03.767 INFO:tasks.workunit.client.0.smithi089.stdout:8/686: truncate de/d16/f86 1247459 0 2024-09-13T02:54:03.767 INFO:tasks.workunit.client.0.smithi089.stdout:8/687: chown de/d16/d1e/d27/d76/d8d/fd5 57144274 1 2024-09-13T02:54:03.769 INFO:tasks.workunit.client.0.smithi089.stdout:5/626: mkdir d1/d4/d45/dc7 0 2024-09-13T02:54:03.770 INFO:tasks.workunit.client.0.smithi089.stdout:7/778: dread d3/d44/d85/d77/f8c [0,4194304] 0 2024-09-13T02:54:03.771 INFO:tasks.workunit.client.0.smithi089.stdout:7/779: chown d3/d19/d75/d14/d71/l92 325106643 1 2024-09-13T02:54:03.771 INFO:tasks.workunit.client.0.smithi089.stdout:7/780: readlink d3/l59 0 2024-09-13T02:54:03.771 INFO:tasks.workunit.client.0.smithi089.stdout:7/781: stat d3/c2a 0 2024-09-13T02:54:03.771 INFO:tasks.workunit.client.0.smithi089.stdout:8/688: creat de/d16/d1e/d27/d76/fed x:0 0 0 2024-09-13T02:54:03.772 INFO:tasks.workunit.client.0.smithi089.stdout:8/689: dread - de/d16/d1e/dc7/fcc zero size 2024-09-13T02:54:03.775 INFO:tasks.workunit.client.0.smithi089.stdout:7/782: creat d3/d44/d85/d55/ff8 x:0 0 0 2024-09-13T02:54:03.775 INFO:tasks.workunit.client.0.smithi089.stdout:7/783: chown d3/d44/d85/d5e/d6f/fd4 1172766 1 2024-09-13T02:54:03.776 INFO:tasks.workunit.client.0.smithi089.stdout:0/568: dwrite d2/d19/d1a/d1e/d42/f5d [0,4194304] 0 2024-09-13T02:54:03.776 INFO:tasks.workunit.client.0.smithi089.stdout:5/627: getdents d1/d4/d45/d8c 0 2024-09-13T02:54:03.776 INFO:tasks.workunit.client.0.smithi089.stdout:5/628: write d1/d4/d45/d6f/d62/fa8 [898655,36352] 0 2024-09-13T02:54:03.780 INFO:tasks.workunit.client.0.smithi089.stdout:7/784: truncate f0 1236989 0 2024-09-13T02:54:03.780 INFO:tasks.workunit.client.0.smithi089.stdout:7/785: truncate d3/d19/d75/d14/d71/fc6 4199719 0 2024-09-13T02:54:03.781 INFO:tasks.workunit.client.0.smithi089.stdout:0/569: mknod d2/d19/d1a/d4e/cc3 0 2024-09-13T02:54:03.781 INFO:tasks.workunit.client.0.smithi089.stdout:0/570: creat d2/d19/d1a/d4e/d7a/d9b/db5/fc4 x:0 0 0 2024-09-13T02:54:03.783 INFO:tasks.workunit.client.0.smithi089.stdout:5/629: mkdir d1/d4/d45/d6f/d4d/d7f/d49/dc8 0 2024-09-13T02:54:03.783 INFO:tasks.workunit.client.0.smithi089.stdout:5/630: truncate d1/d4/d2b/f2d 4911804 0 2024-09-13T02:54:03.784 INFO:tasks.workunit.client.0.smithi089.stdout:5/631: chown d1/d4/d45/d6f/d62/d72/d99/f9a 13248397 1 2024-09-13T02:54:03.784 INFO:tasks.workunit.client.0.smithi089.stdout:7/786: dread d3/d19/f4d [0,4194304] 0 2024-09-13T02:54:03.784 INFO:tasks.workunit.client.0.smithi089.stdout:7/787: chown d3/d19/d75/d14/l26 90 1 2024-09-13T02:54:03.787 INFO:tasks.workunit.client.0.smithi089.stdout:3/645: dwrite d2/d8/dc/d57/f68 [0,4194304] 0 2024-09-13T02:54:03.796 INFO:tasks.workunit.client.0.smithi089.stdout:8/690: dwrite de/d16/d1e/d27/d52/d61/f75 [0,4194304] 0 2024-09-13T02:54:03.797 INFO:tasks.workunit.client.0.smithi089.stdout:7/788: mkdir d3/d44/d85/d77/dd7/df9 0 2024-09-13T02:54:03.800 INFO:tasks.workunit.client.0.smithi089.stdout:3/646: mknod d2/d8/dc/d9a/cc9 0 2024-09-13T02:54:03.800 INFO:tasks.workunit.client.0.smithi089.stdout:3/647: readlink d2/d20/l40 0 2024-09-13T02:54:03.800 INFO:tasks.workunit.client.0.smithi089.stdout:3/648: fdatasync d2/d20/d23/d32/d5b/f7a 0 2024-09-13T02:54:03.801 INFO:tasks.workunit.client.0.smithi089.stdout:0/571: rename d2/d19/d1a/d4e/d7a/d9b/db5/fc4 to d2/d19/d1a/fc5 0 2024-09-13T02:54:03.802 INFO:tasks.workunit.client.0.smithi089.stdout:0/572: chown d2/d19/d1a/d3d/d4b/d4f/f81 67313 1 2024-09-13T02:54:03.803 INFO:tasks.workunit.client.0.smithi089.stdout:8/691: mknod de/d16/d1e/d20/d6c/d6e/d7e/cee 0 2024-09-13T02:54:03.803 INFO:tasks.workunit.client.0.smithi089.stdout:8/692: getdents de/d16/d1e/d20/ddb 0 2024-09-13T02:54:03.803 INFO:tasks.workunit.client.0.smithi089.stdout:8/693: write de/d16/d1e/d27/d76/d8d/fca [787070,25424] 0 2024-09-13T02:54:03.804 INFO:tasks.workunit.client.0.smithi089.stdout:7/789: dread d3/d19/d75/f4a [0,4194304] 0 2024-09-13T02:54:03.805 INFO:tasks.workunit.client.0.smithi089.stdout:3/649: rename d2/d8/l2a to d2/d20/d23/d32/d5b/d71/lca 0 2024-09-13T02:54:03.805 INFO:tasks.workunit.client.0.smithi089.stdout:0/573: mkdir d2/d64/db3/dc6 0 2024-09-13T02:54:03.806 INFO:tasks.workunit.client.0.smithi089.stdout:0/574: stat d2/d19/d1a/d1e/d42/l5a 0 2024-09-13T02:54:03.806 INFO:tasks.workunit.client.0.smithi089.stdout:0/575: dread d2/d19/d1a/d3d/d4b/d4f/f96 [0,4194304] 0 2024-09-13T02:54:03.806 INFO:tasks.workunit.client.0.smithi089.stdout:8/694: mknod de/d16/d1e/d27/d52/d61/cef 0 2024-09-13T02:54:03.807 INFO:tasks.workunit.client.0.smithi089.stdout:3/650: creat d2/d90/fcb x:0 0 0 2024-09-13T02:54:03.809 INFO:tasks.workunit.client.0.smithi089.stdout:5/632: dwrite d1/d4/d45/d6f/d4d/d7f/d49/d5a/f89 [0,4194304] 0 2024-09-13T02:54:03.809 INFO:tasks.workunit.client.0.smithi089.stdout:0/576: link d2/d19/d1a/fc2 d2/d19/d1a/d1e/d42/fc7 0 2024-09-13T02:54:03.809 INFO:tasks.workunit.client.0.smithi089.stdout:0/577: dread - d2/d19/d1a/d4e/d7a/d9b/db5/fb7 zero size 2024-09-13T02:54:03.809 INFO:tasks.workunit.client.0.smithi089.stdout:0/578: creat d2/d19/d1a/d3d/d4b/d4f/fc8 x:0 0 0 2024-09-13T02:54:03.810 INFO:tasks.workunit.client.0.smithi089.stdout:0/579: read - d2/d19/d1a/d1e/d42/d7e/fa7 zero size 2024-09-13T02:54:03.810 INFO:tasks.workunit.client.0.smithi089.stdout:5/633: dread d1/d4/d45/d6f/d4d/d7f/d49/fb3 [0,4194304] 0 2024-09-13T02:54:03.811 INFO:tasks.workunit.client.0.smithi089.stdout:8/695: creat de/d16/d1e/d20/d6c/d6e/d7e/ff0 x:0 0 0 2024-09-13T02:54:03.811 INFO:tasks.workunit.client.0.smithi089.stdout:8/696: chown de/d16/d1e/d20/d6c/d6e/lad 225 1 2024-09-13T02:54:03.815 INFO:tasks.workunit.client.0.smithi089.stdout:3/651: creat d2/d20/d23/d32/d5b/d71/d92/fcc x:0 0 0 2024-09-13T02:54:03.815 INFO:tasks.workunit.client.0.smithi089.stdout:3/652: stat d2/d8/dc/d57/f68 0 2024-09-13T02:54:03.816 INFO:tasks.workunit.client.0.smithi089.stdout:7/790: write d3/d19/d75/f5a [3300927,79777] 0 2024-09-13T02:54:03.820 INFO:tasks.workunit.client.0.smithi089.stdout:5/634: symlink d1/d4/d45/d6f/d4d/d9d/daa/lc9 0 2024-09-13T02:54:03.821 INFO:tasks.workunit.client.0.smithi089.stdout:3/653: mkdir d2/d8/d5f/d72/dcd 0 2024-09-13T02:54:03.825 INFO:tasks.workunit.client.0.smithi089.stdout:7/791: creat d3/d19/d75/d63/da1/ffa x:0 0 0 2024-09-13T02:54:03.825 INFO:tasks.workunit.client.0.smithi089.stdout:0/580: write d2/d19/d1a/d4e/d7a/f90 [3756854,125875] 0 2024-09-13T02:54:03.825 INFO:tasks.workunit.client.0.smithi089.stdout:0/581: fsync d2/d64/db1/fbd 0 2024-09-13T02:54:03.825 INFO:tasks.workunit.client.0.smithi089.stdout:0/582: dread - d2/d64/db1/fc0 zero size 2024-09-13T02:54:03.825 INFO:tasks.workunit.client.0.smithi089.stdout:0/583: fdatasync d2/d19/d1a/d1e/d42/f72 0 2024-09-13T02:54:03.825 INFO:tasks.workunit.client.0.smithi089.stdout:0/584: truncate d2/d19/d1a/d1e/d42/f5d 4367385 0 2024-09-13T02:54:03.826 INFO:tasks.workunit.client.0.smithi089.stdout:5/635: creat d1/d4/d45/d6f/d4d/d7f/d49/dc8/fca x:0 0 0 2024-09-13T02:54:03.826 INFO:tasks.workunit.client.0.smithi089.stdout:5/636: chown d1/d4/d2b 1007 1 2024-09-13T02:54:03.830 INFO:tasks.workunit.client.0.smithi089.stdout:5/637: stat d1/d4/d45/d6f/d4d/d9d/la2 0 2024-09-13T02:54:03.830 INFO:tasks.workunit.client.0.smithi089.stdout:8/697: dwrite de/d16/d1e/d27/d35/d91/fab [0,4194304] 0 2024-09-13T02:54:03.830 INFO:tasks.workunit.client.0.smithi089.stdout:8/698: chown de/d16/d1e/d20/da8/fa9 103601 1 2024-09-13T02:54:03.832 INFO:tasks.workunit.client.0.smithi089.stdout:7/792: getdents d3/d20 0 2024-09-13T02:54:03.834 INFO:tasks.workunit.client.0.smithi089.stdout:5/638: symlink d1/d4/d45/d6f/d4d/d7f/d49/lcb 0 2024-09-13T02:54:03.838 INFO:tasks.workunit.client.0.smithi089.stdout:8/699: creat de/d56/ff1 x:0 0 0 2024-09-13T02:54:03.840 INFO:tasks.workunit.client.0.smithi089.stdout:5/639: unlink d1/f5e 0 2024-09-13T02:54:03.841 INFO:tasks.workunit.client.0.smithi089.stdout:8/700: creat de/d16/d1e/d67/dc4/ff2 x:0 0 0 2024-09-13T02:54:03.842 INFO:tasks.workunit.client.0.smithi089.stdout:5/640: rename d1/d4/d45/d6f/f74 to d1/d4/d45/d6f/d4d/d9d/daa/fcc 0 2024-09-13T02:54:03.842 INFO:tasks.workunit.client.0.smithi089.stdout:5/641: chown d1/fb6 4636084 1 2024-09-13T02:54:03.844 INFO:tasks.workunit.client.0.smithi089.stdout:8/701: symlink de/d16/d1e/d27/lf3 0 2024-09-13T02:54:03.845 INFO:tasks.workunit.client.0.smithi089.stdout:5/642: mkdir d1/d73/dcd 0 2024-09-13T02:54:03.846 INFO:tasks.workunit.client.0.smithi089.stdout:5/643: creat d1/d4/d45/d6f/d4d/d9d/fce x:0 0 0 2024-09-13T02:54:03.847 INFO:tasks.workunit.client.0.smithi089.stdout:5/644: symlink d1/d4/d45/lcf 0 2024-09-13T02:54:03.847 INFO:tasks.workunit.client.0.smithi089.stdout:5/645: write d1/d4/d45/d6f/d7c/fba [2236733,6476] 0 2024-09-13T02:54:03.848 INFO:tasks.workunit.client.0.smithi089.stdout:0/585: dwrite d2/f98 [0,4194304] 0 2024-09-13T02:54:03.848 INFO:tasks.workunit.client.0.smithi089.stdout:5/646: link d1/d4/d45/d6f/l63 d1/d4/ld0 0 2024-09-13T02:54:03.850 INFO:tasks.workunit.client.0.smithi089.stdout:7/793: dwrite d3/d19/d75/d63/ddd/feb [0,4194304] 0 2024-09-13T02:54:03.856 INFO:tasks.workunit.client.0.smithi089.stdout:7/794: mkdir d3/d19/d75/d14/da0/dfb 0 2024-09-13T02:54:03.857 INFO:tasks.workunit.client.0.smithi089.stdout:8/702: dread de/d16/d1e/d27/d52/fbb [0,4194304] 0 2024-09-13T02:54:03.857 INFO:tasks.workunit.client.0.smithi089.stdout:8/703: chown de/d16/d1e/d20/d6c/d6e/d7e/f82 28 1 2024-09-13T02:54:03.857 INFO:tasks.workunit.client.0.smithi089.stdout:8/704: fsync de/d16/d1e/d20/d6c/d6e/f7d 0 2024-09-13T02:54:03.857 INFO:tasks.workunit.client.0.smithi089.stdout:8/705: write de/d16/d1e/d27/d52/d61/f75 [4317290,25964] 0 2024-09-13T02:54:03.857 INFO:tasks.workunit.client.0.smithi089.stdout:7/795: rmdir d3/d19/d75/d14/da0 39 2024-09-13T02:54:03.860 INFO:tasks.workunit.client.0.smithi089.stdout:0/586: rename d2/d19/d1a/d4e/d7a/d9b/db5 to d2/d64/db3/dc9 0 2024-09-13T02:54:03.860 INFO:tasks.workunit.client.0.smithi089.stdout:0/587: write d2/d19/d1a/d4e/d7a/f90 [49420,111260] 0 2024-09-13T02:54:03.860 INFO:tasks.workunit.client.0.smithi089.stdout:0/588: creat d2/d19/d1a/d3d/d4b/fca x:0 0 0 2024-09-13T02:54:03.861 INFO:tasks.workunit.client.0.smithi089.stdout:8/706: creat de/d16/d1e/d20/ff4 x:0 0 0 2024-09-13T02:54:03.863 INFO:tasks.workunit.client.0.smithi089.stdout:8/707: mkdir de/d16/d1e/d20/d39/df5 0 2024-09-13T02:54:03.865 INFO:tasks.workunit.client.0.smithi089.stdout:5/647: dwrite d1/d4/d45/d6f/d4d/d7f/d49/d5a/f94 [0,4194304] 0 2024-09-13T02:54:03.868 INFO:tasks.workunit.client.0.smithi089.stdout:5/648: symlink d1/d73/ld1 0 2024-09-13T02:54:03.868 INFO:tasks.workunit.client.0.smithi089.stdout:5/649: write d1/d4/d45/d6f/d62/d72/fc5 [182827,29943] 0 2024-09-13T02:54:03.870 INFO:tasks.workunit.client.0.smithi089.stdout:8/708: mknod de/d16/d1e/d20/cf6 0 2024-09-13T02:54:03.870 INFO:tasks.workunit.client.0.smithi089.stdout:8/709: dread - de/d16/d1e/d27/d52/d61/d8e/fb5 zero size 2024-09-13T02:54:03.870 INFO:tasks.workunit.client.0.smithi089.stdout:8/710: creat de/d16/d1e/d27/d76/d8d/ff7 x:0 0 0 2024-09-13T02:54:03.870 INFO:tasks.workunit.client.0.smithi089.stdout:8/711: creat de/d16/d1e/d27/d76/ff8 x:0 0 0 2024-09-13T02:54:03.871 INFO:tasks.workunit.client.0.smithi089.stdout:7/796: read d3/d19/d75/db2/fd9 [3572128,77513] 0 2024-09-13T02:54:03.871 INFO:tasks.workunit.client.0.smithi089.stdout:7/797: truncate d3/d44/d85/d55/d96/dc5/fce 561022 0 2024-09-13T02:54:03.871 INFO:tasks.workunit.client.0.smithi089.stdout:5/650: creat d1/d4/d45/dc7/fd2 x:0 0 0 2024-09-13T02:54:03.873 INFO:tasks.workunit.client.0.smithi089.stdout:7/798: unlink d3/d19/d2e/cbe 0 2024-09-13T02:54:03.875 INFO:tasks.workunit.client.0.smithi089.stdout:7/799: dread d3/d19/d2e/f88 [0,4194304] 0 2024-09-13T02:54:03.876 INFO:tasks.workunit.client.0.smithi089.stdout:8/712: dread de/f4d [0,4194304] 0 2024-09-13T02:54:03.876 INFO:tasks.workunit.client.0.smithi089.stdout:1/609: sync 2024-09-13T02:54:03.877 INFO:tasks.workunit.client.0.smithi089.stdout:8/713: creat de/d16/d1e/d27/ff9 x:0 0 0 2024-09-13T02:54:03.879 INFO:tasks.workunit.client.0.smithi089.stdout:8/714: rename de/d16/d1e/f87 to de/d16/d1e/d27/d35/ffa 0 2024-09-13T02:54:03.879 INFO:tasks.workunit.client.0.smithi089.stdout:8/715: fsync de/d16/d1e/d3f/f46 0 2024-09-13T02:54:03.881 INFO:tasks.workunit.client.0.smithi089.stdout:8/716: creat de/d16/d1e/d20/da8/ffb x:0 0 0 2024-09-13T02:54:03.887 INFO:tasks.workunit.client.0.smithi089.stdout:1/610: write f7 [1404815,62691] 0 2024-09-13T02:54:03.887 INFO:tasks.workunit.client.0.smithi089.stdout:1/611: chown dc/d3a/d53/d2c/d34/f39 535377 1 2024-09-13T02:54:03.887 INFO:tasks.workunit.client.0.smithi089.stdout:1/612: creat dc/d3a/d53/fc2 x:0 0 0 2024-09-13T02:54:03.889 INFO:tasks.workunit.client.0.smithi089.stdout:1/613: unlink dc/d3a/d93/l97 0 2024-09-13T02:54:03.890 INFO:tasks.workunit.client.0.smithi089.stdout:1/614: write dc/d3a/d53/d2c/d6f/f84 [4450609,85765] 0 2024-09-13T02:54:03.891 INFO:tasks.workunit.client.0.smithi089.stdout:1/615: read dc/d3a/d53/d2c/d36/f38 [312449,27888] 0 2024-09-13T02:54:03.893 INFO:tasks.workunit.client.0.smithi089.stdout:1/616: link dc/d44/d73/d85/laf dc/d3a/d53/d2c/d34/d8b/lc3 0 2024-09-13T02:54:03.894 INFO:tasks.workunit.client.0.smithi089.stdout:1/617: rename dc/d3a/d53/d2c/c31 to dc/d44/d73/dc0/cc4 0 2024-09-13T02:54:03.894 INFO:tasks.workunit.client.0.smithi089.stdout:0/589: dwrite d2/d19/d1a/d3d/d4b/d4f/f5c [0,4194304] 0 2024-09-13T02:54:03.895 INFO:tasks.workunit.client.0.smithi089.stdout:0/590: truncate d2/d19/d1a/d1e/d42/f46 688967 0 2024-09-13T02:54:03.895 INFO:tasks.workunit.client.0.smithi089.stdout:1/618: link dc/d3a/d53/fc2 dc/d3a/d53/d2c/d34/d8b/fc5 0 2024-09-13T02:54:03.903 INFO:tasks.workunit.client.0.smithi089.stdout:5/651: dwrite d1/d7/f68 [0,4194304] 0 2024-09-13T02:54:03.903 INFO:tasks.workunit.client.0.smithi089.stdout:7/800: dwrite d3/d19/d2e/f6e [0,4194304] 0 2024-09-13T02:54:03.904 INFO:tasks.workunit.client.0.smithi089.stdout:8/717: dwrite de/f11 [0,4194304] 0 2024-09-13T02:54:03.906 INFO:tasks.workunit.client.0.smithi089.stdout:7/801: symlink d3/d19/d75/db2/lfc 0 2024-09-13T02:54:03.906 INFO:tasks.workunit.client.0.smithi089.stdout:7/802: creat d3/d19/d2e/d37/ffd x:0 0 0 2024-09-13T02:54:03.906 INFO:tasks.workunit.client.0.smithi089.stdout:7/803: chown d3/d19/f41 1099332 1 2024-09-13T02:54:03.908 INFO:tasks.workunit.client.0.smithi089.stdout:0/591: write d2/d64/f9c [2251904,21652] 0 2024-09-13T02:54:03.910 INFO:tasks.workunit.client.0.smithi089.stdout:0/592: link d2/d19/d1a/d1e/d42/fc7 d2/d64/d91/fcb 0 2024-09-13T02:54:03.913 INFO:tasks.workunit.client.0.smithi089.stdout:5/652: dread d1/d4/d45/d6f/f39 [0,4194304] 0 2024-09-13T02:54:03.913 INFO:tasks.workunit.client.0.smithi089.stdout:1/619: rmdir dc/d3a/d93 39 2024-09-13T02:54:03.913 INFO:tasks.workunit.client.0.smithi089.stdout:5/653: read - d1/d4/d45/d6f/f5f zero size 2024-09-13T02:54:03.913 INFO:tasks.workunit.client.0.smithi089.stdout:5/654: chown d1/d4/d45/d6f/d4d/f58 88579 1 2024-09-13T02:54:03.914 INFO:tasks.workunit.client.0.smithi089.stdout:5/655: fsync d1/d7/f27 0 2024-09-13T02:54:03.914 INFO:tasks.workunit.client.0.smithi089.stdout:1/620: write dc/d44/f49 [1424660,129140] 0 2024-09-13T02:54:03.917 INFO:tasks.workunit.client.0.smithi089.stdout:5/656: symlink d1/d4/d45/ld3 0 2024-09-13T02:54:03.921 INFO:tasks.workunit.client.0.smithi089.stdout:2/601: sync 2024-09-13T02:54:03.921 INFO:tasks.workunit.client.0.smithi089.stdout:6/626: sync 2024-09-13T02:54:03.921 INFO:tasks.workunit.client.0.smithi089.stdout:9/539: sync 2024-09-13T02:54:03.921 INFO:tasks.workunit.client.0.smithi089.stdout:4/737: sync 2024-09-13T02:54:03.923 INFO:tasks.workunit.client.0.smithi089.stdout:9/540: creat d3/d6/d2a/d94/d24/fa8 x:0 0 0 2024-09-13T02:54:03.924 INFO:tasks.workunit.client.0.smithi089.stdout:4/738: mkdir d2/d3/d5/d72/df3 0 2024-09-13T02:54:03.924 INFO:tasks.workunit.client.0.smithi089.stdout:6/627: getdents db/d43/d6e/d28/d46/d53/d83 0 2024-09-13T02:54:03.925 INFO:tasks.workunit.client.0.smithi089.stdout:4/739: symlink d2/d3/d5/d43/lf4 0 2024-09-13T02:54:03.927 INFO:tasks.workunit.client.0.smithi089.stdout:6/628: rename db/l6f to db/d43/d6e/d28/d37/d8b/dcd/lce 0 2024-09-13T02:54:03.927 INFO:tasks.workunit.client.0.smithi089.stdout:6/629: chown db/db2/fb7 71 1 2024-09-13T02:54:03.929 INFO:tasks.workunit.client.0.smithi089.stdout:4/740: link d2/d3/d5/f37 d2/d3/d5/d43/d3b/d71/d99/ff5 0 2024-09-13T02:54:03.931 INFO:tasks.workunit.client.0.smithi089.stdout:4/741: rmdir d2/d3/d5/d43/d3b/d71/d78 39 2024-09-13T02:54:03.931 INFO:tasks.workunit.client.0.smithi089.stdout:4/742: fsync d2/f53 0 2024-09-13T02:54:03.931 INFO:tasks.workunit.client.0.smithi089.stdout:4/743: creat d2/d3/d86/ff6 x:0 0 0 2024-09-13T02:54:03.933 INFO:tasks.workunit.client.0.smithi089.stdout:6/630: dread f0 [0,4194304] 0 2024-09-13T02:54:03.933 INFO:tasks.workunit.client.0.smithi089.stdout:6/631: fsync db/d43/d6e/d28/d37/f4e 0 2024-09-13T02:54:03.933 INFO:tasks.workunit.client.0.smithi089.stdout:2/602: write d13/d30/d4e/d6f/f8f [4131459,75409] 0 2024-09-13T02:54:03.933 INFO:tasks.workunit.client.0.smithi089.stdout:4/744: rmdir d2/d22/da1/d62/de8 39 2024-09-13T02:54:03.935 INFO:tasks.workunit.client.0.smithi089.stdout:5/657: dread d1/f47 [0,4194304] 0 2024-09-13T02:54:03.935 INFO:tasks.workunit.client.0.smithi089.stdout:5/658: truncate d1/d4/d45/d6f/d4d/f7a 801807 0 2024-09-13T02:54:03.935 INFO:tasks.workunit.client.0.smithi089.stdout:5/659: write d1/d4/d45/d6f/d7c/fba [4048656,47915] 0 2024-09-13T02:54:03.935 INFO:tasks.workunit.client.0.smithi089.stdout:5/660: write d1/d4/d45/d6f/d4d/f71 [5066214,53820] 0 2024-09-13T02:54:03.935 INFO:tasks.workunit.client.0.smithi089.stdout:5/661: creat d1/d4/d45/d6f/d62/fd4 x:0 0 0 2024-09-13T02:54:03.935 INFO:tasks.workunit.client.0.smithi089.stdout:5/662: fdatasync d1/fd 0 2024-09-13T02:54:03.935 INFO:tasks.workunit.client.0.smithi089.stdout:6/632: mknod db/d43/ccf 0 2024-09-13T02:54:03.935 INFO:tasks.workunit.client.0.smithi089.stdout:6/633: readlink db/d10/l70 0 2024-09-13T02:54:03.936 INFO:tasks.workunit.client.0.smithi089.stdout:4/745: getdents d2/d3/d5 0 2024-09-13T02:54:03.939 INFO:tasks.workunit.client.0.smithi089.stdout:6/634: creat db/d43/d6e/d28/d46/d53/d83/fd0 x:0 0 0 2024-09-13T02:54:03.940 INFO:tasks.workunit.client.0.smithi089.stdout:4/746: mknod d2/d3/d5/d43/d3b/d71/d78/d9c/cf7 0 2024-09-13T02:54:03.941 INFO:tasks.workunit.client.0.smithi089.stdout:8/718: dwrite de/f11 [0,4194304] 0 2024-09-13T02:54:03.943 INFO:tasks.workunit.client.0.smithi089.stdout:7/804: dwrite d3/d19/d75/d63/da1/fa2 [0,4194304] 0 2024-09-13T02:54:03.943 INFO:tasks.workunit.client.0.smithi089.stdout:7/805: truncate d3/d19/d75/f1d 4458730 0 2024-09-13T02:54:03.943 INFO:tasks.workunit.client.0.smithi089.stdout:5/663: fsync d1/d4/d45/d6f/d4d/f71 0 2024-09-13T02:54:03.945 INFO:tasks.workunit.client.0.smithi089.stdout:0/593: dwrite d2/d19/d1a/d1e/d42/f5d [0,4194304] 0 2024-09-13T02:54:03.947 INFO:tasks.workunit.client.0.smithi089.stdout:8/719: mkdir de/d16/d1e/d27/d52/d61/d8e/dfc 0 2024-09-13T02:54:03.953 INFO:tasks.workunit.client.0.smithi089.stdout:5/664: link d1/d4/d45/d6f/d4d/d7f/d49/d5a/f89 d1/d4/d45/fd5 0 2024-09-13T02:54:03.953 INFO:tasks.workunit.client.0.smithi089.stdout:5/665: write d1/d4/d45/d6f/d4d/d7f/d49/fa4 [877297,53517] 0 2024-09-13T02:54:03.954 INFO:tasks.workunit.client.0.smithi089.stdout:2/603: dwrite d13/d30/f3c [0,4194304] 0 2024-09-13T02:54:03.954 INFO:tasks.workunit.client.0.smithi089.stdout:2/604: write d13/d30/d61/d78/d79/f9f [470077,94273] 0 2024-09-13T02:54:03.955 INFO:tasks.workunit.client.0.smithi089.stdout:0/594: symlink d2/d19/d1a/d3d/lcc 0 2024-09-13T02:54:03.955 INFO:tasks.workunit.client.0.smithi089.stdout:0/595: write d2/d19/d1a/d3d/d4b/d4f/d59/d6b/d87/fbf [1038748,75617] 0 2024-09-13T02:54:03.960 INFO:tasks.workunit.client.0.smithi089.stdout:2/605: creat d13/d30/d59/fd4 x:0 0 0 2024-09-13T02:54:03.961 INFO:tasks.workunit.client.0.smithi089.stdout:0/596: dread d2/f14 [0,4194304] 0 2024-09-13T02:54:03.961 INFO:tasks.workunit.client.0.smithi089.stdout:8/720: write de/d16/d1e/d27/f68 [670861,30587] 0 2024-09-13T02:54:03.961 INFO:tasks.workunit.client.0.smithi089.stdout:8/721: dread - de/d16/d1e/d20/da8/ffb zero size 2024-09-13T02:54:03.962 INFO:tasks.workunit.client.0.smithi089.stdout:8/722: creat de/d16/d1e/d3f/d5b/ffd x:0 0 0 2024-09-13T02:54:03.962 INFO:tasks.workunit.client.0.smithi089.stdout:2/606: link d13/d30/d59/f96 d13/d30/d64/d82/db7/fd5 0 2024-09-13T02:54:03.963 INFO:tasks.workunit.client.0.smithi089.stdout:5/666: rmdir d1/d4/d45/d6f/d7c/db2 0 2024-09-13T02:54:03.966 INFO:tasks.workunit.client.0.smithi089.stdout:8/723: getdents de/d16/d1e 0 2024-09-13T02:54:03.968 INFO:tasks.workunit.client.0.smithi089.stdout:8/724: creat de/d16/d1e/d20/d6c/d6e/d7e/ffe x:0 0 0 2024-09-13T02:54:03.969 INFO:tasks.workunit.client.0.smithi089.stdout:4/747: dwrite d2/da/f45 [0,4194304] 0 2024-09-13T02:54:03.969 INFO:tasks.workunit.client.0.smithi089.stdout:6/635: dwrite db/d10/d3a/f36 [4194304,4194304] 0 2024-09-13T02:54:03.969 INFO:tasks.workunit.client.0.smithi089.stdout:3/654: sync 2024-09-13T02:54:03.969 INFO:tasks.workunit.client.0.smithi089.stdout:3/655: truncate d2/d8/dc/d3c/d65/f87 4604429 0 2024-09-13T02:54:03.971 INFO:tasks.workunit.client.0.smithi089.stdout:5/667: link d1/d4/d45/lcf d1/d4/d45/d6f/ld6 0 2024-09-13T02:54:03.971 INFO:tasks.workunit.client.0.smithi089.stdout:5/668: read - d1/d7/fbd zero size 2024-09-13T02:54:03.978 INFO:tasks.workunit.client.0.smithi089.stdout:6/636: symlink db/d43/d6e/d28/d2f/dc8/ld1 0 2024-09-13T02:54:03.978 INFO:tasks.workunit.client.0.smithi089.stdout:6/637: write db/fb9 [267738,68578] 0 2024-09-13T02:54:03.978 INFO:tasks.workunit.client.0.smithi089.stdout:6/638: write db/d43/d6e/d28/d46/d7e/da1/fc0 [595519,72634] 0 2024-09-13T02:54:03.978 INFO:tasks.workunit.client.0.smithi089.stdout:8/725: dread de/f5e [0,4194304] 0 2024-09-13T02:54:03.978 INFO:tasks.workunit.client.0.smithi089.stdout:8/726: readlink de/d16/le1 0 2024-09-13T02:54:03.978 INFO:tasks.workunit.client.0.smithi089.stdout:8/727: truncate de/d16/d1e/d27/d52/f6b 1259340 0 2024-09-13T02:54:03.979 INFO:tasks.workunit.client.0.smithi089.stdout:8/728: write de/d16/f1f [5010709,29737] 0 2024-09-13T02:54:03.979 INFO:tasks.workunit.client.0.smithi089.stdout:8/729: read de/d16/f6f [247166,20146] 0 2024-09-13T02:54:03.983 INFO:tasks.workunit.client.0.smithi089.stdout:5/669: creat d1/d4/d45/d6f/d62/d72/d99/fd7 x:0 0 0 2024-09-13T02:54:03.983 INFO:tasks.workunit.client.0.smithi089.stdout:5/670: chown d1/d73/c86 7 1 2024-09-13T02:54:03.988 INFO:tasks.workunit.client.0.smithi089.stdout:3/656: dread d2/d90/fa9 [0,4194304] 0 2024-09-13T02:54:03.988 INFO:tasks.workunit.client.0.smithi089.stdout:3/657: fsync d2/d8/dc/d9a/d9c/faa 0 2024-09-13T02:54:03.988 INFO:tasks.workunit.client.0.smithi089.stdout:3/658: readlink d2/d8/dc/l8e 0 2024-09-13T02:54:03.989 INFO:tasks.workunit.client.0.smithi089.stdout:3/659: unlink d2/d20/d23/f88 0 2024-09-13T02:54:03.989 INFO:tasks.workunit.client.0.smithi089.stdout:3/660: write d2/d20/d23/d32/d49/fba [33293,74743] 0 2024-09-13T02:54:03.990 INFO:tasks.workunit.client.0.smithi089.stdout:3/661: mknod d2/d8/dc/dbe/cce 0 2024-09-13T02:54:03.990 INFO:tasks.workunit.client.0.smithi089.stdout:3/662: readlink d2/lc4 0 2024-09-13T02:54:03.997 INFO:tasks.workunit.client.0.smithi089.stdout:2/607: dwrite d13/d30/d59/dbe/fbf [0,4194304] 0 2024-09-13T02:54:03.999 INFO:tasks.workunit.client.0.smithi089.stdout:2/608: mkdir d13/d30/d4e/d6f/d76/dd6 0 2024-09-13T02:54:03.999 INFO:tasks.workunit.client.0.smithi089.stdout:3/663: write d2/d8/dc/d9a/d9c/d83/db6/f84 [1232231,53125] 0 2024-09-13T02:54:04.000 INFO:tasks.workunit.client.0.smithi089.stdout:3/664: write d2/d8/f48 [3522882,67713] 0 2024-09-13T02:54:04.001 INFO:tasks.workunit.client.0.smithi089.stdout:2/609: creat d13/d30/d61/d78/fd7 x:0 0 0 2024-09-13T02:54:04.001 INFO:tasks.workunit.client.0.smithi089.stdout:2/610: chown d13/d30/f47 17585679 1 2024-09-13T02:54:04.003 INFO:tasks.workunit.client.0.smithi089.stdout:3/665: mknod d2/d20/d23/d32/d5b/d71/ccf 0 2024-09-13T02:54:04.014 INFO:tasks.workunit.client.0.smithi089.stdout:0/597: dwrite d2/d19/f2d [0,4194304] 0 2024-09-13T02:54:04.014 INFO:tasks.workunit.client.0.smithi089.stdout:0/598: fdatasync d2/d64/db1/fbd 0 2024-09-13T02:54:04.014 INFO:tasks.workunit.client.0.smithi089.stdout:0/599: write d2/f3 [5131642,111444] 0 2024-09-13T02:54:04.014 INFO:tasks.workunit.client.0.smithi089.stdout:0/600: write d2/fb0 [1033600,20096] 0 2024-09-13T02:54:04.014 INFO:tasks.workunit.client.0.smithi089.stdout:5/671: dread d1/d4/d45/d6f/d7c/fc1 [0,4194304] 0 2024-09-13T02:54:04.014 INFO:tasks.workunit.client.0.smithi089.stdout:3/666: dread d2/d20/d23/d32/d49/d75/fbc [0,4194304] 0 2024-09-13T02:54:04.015 INFO:tasks.workunit.client.0.smithi089.stdout:5/672: symlink d1/d4/d45/ld8 0 2024-09-13T02:54:04.015 INFO:tasks.workunit.client.0.smithi089.stdout:3/667: mknod d2/d8/cd0 0 2024-09-13T02:54:04.017 INFO:tasks.workunit.client.0.smithi089.stdout:5/673: unlink d1/d4/d45/d6f/d7c/fc1 0 2024-09-13T02:54:04.018 INFO:tasks.workunit.client.0.smithi089.stdout:2/611: write d13/d30/d59/f7e [4370548,90698] 0 2024-09-13T02:54:04.018 INFO:tasks.workunit.client.0.smithi089.stdout:2/612: creat d13/d30/d59/dbe/fd8 x:0 0 0 2024-09-13T02:54:04.018 INFO:tasks.workunit.client.0.smithi089.stdout:4/748: dwrite d2/d3/fe7 [0,4194304] 0 2024-09-13T02:54:04.019 INFO:tasks.workunit.client.0.smithi089.stdout:3/668: mknod d2/d20/cd1 0 2024-09-13T02:54:04.019 INFO:tasks.workunit.client.0.smithi089.stdout:5/674: symlink d1/d4/d45/ld9 0 2024-09-13T02:54:04.019 INFO:tasks.workunit.client.0.smithi089.stdout:3/669: read d2/d20/d23/d2b/f2f [89205,114427] 0 2024-09-13T02:54:04.026 INFO:tasks.workunit.client.0.smithi089.stdout:4/749: mknod d2/d3/d5/d43/d3b/d71/d99/daf/dc6/cf8 0 2024-09-13T02:54:04.026 INFO:tasks.workunit.client.0.smithi089.stdout:0/601: dread d2/d19/d1a/d3d/d4b/d4f/f5e [0,4194304] 0 2024-09-13T02:54:04.028 INFO:tasks.workunit.client.0.smithi089.stdout:3/670: link d2/d20/d23/d32/d49/f67 d2/d8/fd2 0 2024-09-13T02:54:04.033 INFO:tasks.workunit.client.0.smithi089.stdout:5/675: getdents d1/d4/d45 0 2024-09-13T02:54:04.033 INFO:tasks.workunit.client.0.smithi089.stdout:5/676: dread - d1/d4/d45/d6f/d62/d72/d99/fd7 zero size 2024-09-13T02:54:04.033 INFO:tasks.workunit.client.0.smithi089.stdout:5/677: chown d1/c10 26 1 2024-09-13T02:54:04.033 INFO:tasks.workunit.client.0.smithi089.stdout:5/678: readlink d1/d4/d45/d6f/d4d/d7f/d49/lcb 0 2024-09-13T02:54:04.033 INFO:tasks.workunit.client.0.smithi089.stdout:5/679: symlink d1/d4/d45/d8c/d98/daf/lda 0 2024-09-13T02:54:04.035 INFO:tasks.workunit.client.0.smithi089.stdout:2/613: dwrite d13/d30/d4e/f51 [0,4194304] 0 2024-09-13T02:54:04.035 INFO:tasks.workunit.client.0.smithi089.stdout:7/806: sync 2024-09-13T02:54:04.035 INFO:tasks.workunit.client.0.smithi089.stdout:9/541: sync 2024-09-13T02:54:04.036 INFO:tasks.workunit.client.0.smithi089.stdout:1/621: sync 2024-09-13T02:54:04.036 INFO:tasks.workunit.client.0.smithi089.stdout:9/542: chown d3/d6/d2a/d4b/l71 8430 1 2024-09-13T02:54:04.038 INFO:tasks.workunit.client.0.smithi089.stdout:9/543: creat d3/d6/d2a/d94/d24/d29/fa9 x:0 0 0 2024-09-13T02:54:04.038 INFO:tasks.workunit.client.0.smithi089.stdout:9/544: dread - d3/d6/d36/fa0 zero size 2024-09-13T02:54:04.038 INFO:tasks.workunit.client.0.smithi089.stdout:1/622: write dc/d3a/d53/f87 [138210,48154] 0 2024-09-13T02:54:04.039 INFO:tasks.workunit.client.0.smithi089.stdout:9/545: mknod d3/d6/d2a/d94/d24/caa 0 2024-09-13T02:54:04.040 INFO:tasks.workunit.client.0.smithi089.stdout:1/623: link dc/c1f dc/d44/d73/d9a/da1/cc6 0 2024-09-13T02:54:04.040 INFO:tasks.workunit.client.0.smithi089.stdout:1/624: chown dc/d44/d73/d85/fbf 707733039 1 2024-09-13T02:54:04.040 INFO:tasks.workunit.client.0.smithi089.stdout:1/625: chown dc/d3a/d53/d2c/d34/f67 94 1 2024-09-13T02:54:04.041 INFO:tasks.workunit.client.0.smithi089.stdout:0/602: dread d2/d19/d1a/d3d/d4b/d4f/f6d [0,4194304] 0 2024-09-13T02:54:04.041 INFO:tasks.workunit.client.0.smithi089.stdout:1/626: truncate dc/d3a/d53/d2c/d36/f92 524233 0 2024-09-13T02:54:04.044 INFO:tasks.workunit.client.0.smithi089.stdout:5/680: dread d1/d7/f68 [0,4194304] 0 2024-09-13T02:54:04.044 INFO:tasks.workunit.client.0.smithi089.stdout:5/681: truncate d1/d4/d45/d6f/d4d/d7f/d8f/f91 1040553 0 2024-09-13T02:54:04.044 INFO:tasks.workunit.client.0.smithi089.stdout:5/682: write d1/d4/d45/d6f/d4d/d7f/d49/fa4 [1922727,27349] 0 2024-09-13T02:54:04.046 INFO:tasks.workunit.client.0.smithi089.stdout:7/807: write d3/d19/d75/dbf/fe0 [3819298,18931] 0 2024-09-13T02:54:04.046 INFO:tasks.workunit.client.0.smithi089.stdout:0/603: mknod d2/d19/d1a/d3d/d4b/d4f/d59/ccd 0 2024-09-13T02:54:04.046 INFO:tasks.workunit.client.0.smithi089.stdout:7/808: truncate d3/fbc 1484736 0 2024-09-13T02:54:04.049 INFO:tasks.workunit.client.0.smithi089.stdout:1/627: read dc/d44/f6a [2327799,69487] 0 2024-09-13T02:54:04.049 INFO:tasks.workunit.client.0.smithi089.stdout:9/546: dread d3/d6/d2a/d94/d24/d35/f80 [0,4194304] 0 2024-09-13T02:54:04.052 INFO:tasks.workunit.client.0.smithi089.stdout:1/628: rmdir dc/d46 39 2024-09-13T02:54:04.052 INFO:tasks.workunit.client.0.smithi089.stdout:7/809: dread d3/d19/d75/db2/fd9 [0,4194304] 0 2024-09-13T02:54:04.053 INFO:tasks.workunit.client.0.smithi089.stdout:7/810: readlink d3/d44/d85/d5e/d6f/l84 0 2024-09-13T02:54:04.056 INFO:tasks.workunit.client.0.smithi089.stdout:4/750: dwrite d2/f73 [0,4194304] 0 2024-09-13T02:54:04.056 INFO:tasks.workunit.client.0.smithi089.stdout:2/614: dwrite d13/f3b [0,4194304] 0 2024-09-13T02:54:04.058 INFO:tasks.workunit.client.0.smithi089.stdout:5/683: dread d1/d4/d45/d8c/fa0 [0,4194304] 0 2024-09-13T02:54:04.058 INFO:tasks.workunit.client.0.smithi089.stdout:5/684: fsync d1/d4/d45/f82 0 2024-09-13T02:54:04.060 INFO:tasks.workunit.client.0.smithi089.stdout:0/604: write d2/d19/d1a/d3d/d4b/d4f/f9d [393679,6492] 0 2024-09-13T02:54:04.061 INFO:tasks.workunit.client.0.smithi089.stdout:0/605: fsync d2/d19/d1a/fc2 0 2024-09-13T02:54:04.062 INFO:tasks.workunit.client.0.smithi089.stdout:2/615: rename d13/d30/d59/dbe/fd8 to d13/d30/d61/fd9 0 2024-09-13T02:54:04.062 INFO:tasks.workunit.client.0.smithi089.stdout:9/547: dread d3/d6/d2a/f78 [0,4194304] 0 2024-09-13T02:54:04.064 INFO:tasks.workunit.client.0.smithi089.stdout:5/685: dread d1/d4/d45/d8c/fa0 [0,4194304] 0 2024-09-13T02:54:04.066 INFO:tasks.workunit.client.0.smithi089.stdout:4/751: rmdir d2/d3/d5/d43 39 2024-09-13T02:54:04.069 INFO:tasks.workunit.client.0.smithi089.stdout:5/686: mkdir d1/d4/ddb 0 2024-09-13T02:54:04.072 INFO:tasks.workunit.client.0.smithi089.stdout:9/548: symlink d3/lab 0 2024-09-13T02:54:04.082 INFO:tasks.workunit.client.0.smithi089.stdout:4/752: dread d2/d22/da1/f2d [0,4194304] 0 2024-09-13T02:54:04.084 INFO:tasks.workunit.client.0.smithi089.stdout:4/753: creat d2/d22/da1/d62/d6c/ff9 x:0 0 0 2024-09-13T02:54:04.085 INFO:tasks.workunit.client.0.smithi089.stdout:4/754: rmdir d2/d3/d5/d43/d3b 39 2024-09-13T02:54:04.087 INFO:tasks.workunit.client.0.smithi089.stdout:4/755: truncate d2/d3/d5/d43/d3b/d71/f81 2089273 0 2024-09-13T02:54:04.087 INFO:tasks.workunit.client.0.smithi089.stdout:4/756: fsync d2/d22/f35 0 2024-09-13T02:54:04.087 INFO:tasks.workunit.client.0.smithi089.stdout:4/757: fsync d2/d22/fa6 0 2024-09-13T02:54:04.090 INFO:tasks.workunit.client.0.smithi089.stdout:4/758: link d2/d22/da1/cc9 d2/d3/d5/d43/d3b/d71/d78/d9c/cfa 0 2024-09-13T02:54:04.092 INFO:tasks.workunit.client.0.smithi089.stdout:4/759: link d2/d3/d5/d43/d3b/f6f d2/d3/d5/d72/df3/ffb 0 2024-09-13T02:54:04.092 INFO:tasks.workunit.client.0.smithi089.stdout:4/760: chown d2/d3/d5/d43/d3b/d71/d99/daf/d8f/df0 83 1 2024-09-13T02:54:04.098 INFO:tasks.workunit.client.0.smithi089.stdout:4/761: dread d2/d3/d5/f70 [0,4194304] 0 2024-09-13T02:54:04.099 INFO:tasks.workunit.client.0.smithi089.stdout:4/762: creat d2/d3/d5/d43/d3b/d71/d99/daf/dc6/ffc x:0 0 0 2024-09-13T02:54:04.113 INFO:tasks.workunit.client.0.smithi089.stdout:1/629: dwrite dc/d3a/d53/f26 [0,4194304] 0 2024-09-13T02:54:04.113 INFO:tasks.workunit.client.0.smithi089.stdout:5/687: dwrite d1/d4/d45/d6f/d4d/d7f/d49/fbc [0,4194304] 0 2024-09-13T02:54:04.113 INFO:tasks.workunit.client.0.smithi089.stdout:2/616: dwrite d13/f54 [0,4194304] 0 2024-09-13T02:54:04.114 INFO:tasks.workunit.client.0.smithi089.stdout:1/630: symlink dc/d3a/d53/d2c/d34/d9b/lc7 0 2024-09-13T02:54:04.114 INFO:tasks.workunit.client.0.smithi089.stdout:0/606: dwrite d2/d19/d1a/d4e/fbc [4194304,4194304] 0 2024-09-13T02:54:04.115 INFO:tasks.workunit.client.0.smithi089.stdout:0/607: creat d2/d19/d1a/d3d/d4b/d4f/d59/fce x:0 0 0 2024-09-13T02:54:04.115 INFO:tasks.workunit.client.0.smithi089.stdout:9/549: dwrite d3/d6/d2a/d94/d24/d29/f88 [0,4194304] 0 2024-09-13T02:54:04.119 INFO:tasks.workunit.client.0.smithi089.stdout:2/617: rmdir d13/d30/d64/d82/db7 39 2024-09-13T02:54:04.119 INFO:tasks.workunit.client.0.smithi089.stdout:2/618: read - d13/d30/d61/d78/d9c/f9d zero size 2024-09-13T02:54:04.121 INFO:tasks.workunit.client.0.smithi089.stdout:4/763: rename d2/d3/d5/d43/d3b/d71/d78/d9c to d2/d3/d86/dfd 0 2024-09-13T02:54:04.122 INFO:tasks.workunit.client.0.smithi089.stdout:1/631: creat dc/d44/d73/d9a/da1/fc8 x:0 0 0 2024-09-13T02:54:04.128 INFO:tasks.workunit.client.0.smithi089.stdout:0/608: mknod d2/d19/d1a/da4/ccf 0 2024-09-13T02:54:04.130 INFO:tasks.workunit.client.0.smithi089.stdout:9/550: creat d3/fac x:0 0 0 2024-09-13T02:54:04.132 INFO:tasks.workunit.client.0.smithi089.stdout:5/688: rmdir d1/d4/d45/d6f/d62/d72 39 2024-09-13T02:54:04.132 INFO:tasks.workunit.client.0.smithi089.stdout:5/689: chown d1/d4/d45/d6f/d4d/d7f/d49/d5a 4094057 1 2024-09-13T02:54:04.132 INFO:tasks.workunit.client.0.smithi089.stdout:5/690: truncate d1/d4/d45/d6f/f93 265111 0 2024-09-13T02:54:04.132 INFO:tasks.workunit.client.0.smithi089.stdout:5/691: chown d1/d4/cc6 9143975 1 2024-09-13T02:54:04.134 INFO:tasks.workunit.client.0.smithi089.stdout:2/619: symlink d13/d30/d61/d78/d79/lda 0 2024-09-13T02:54:04.135 INFO:tasks.workunit.client.0.smithi089.stdout:6/639: sync 2024-09-13T02:54:04.135 INFO:tasks.workunit.client.0.smithi089.stdout:8/730: sync 2024-09-13T02:54:04.136 INFO:tasks.workunit.client.0.smithi089.stdout:9/551: unlink d3/d6/d2a/d94/c5b 0 2024-09-13T02:54:04.136 INFO:tasks.workunit.client.0.smithi089.stdout:9/552: chown d3/d15/l90 8614 1 2024-09-13T02:54:04.136 INFO:tasks.workunit.client.0.smithi089.stdout:9/553: readlink d3/l8f 0 2024-09-13T02:54:04.136 INFO:tasks.workunit.client.0.smithi089.stdout:9/554: fdatasync d3/d6/d2a/d4b/d6d/f82 0 2024-09-13T02:54:04.138 INFO:tasks.workunit.client.0.smithi089.stdout:0/609: mkdir d2/dd0 0 2024-09-13T02:54:04.139 INFO:tasks.workunit.client.0.smithi089.stdout:6/640: mkdir db/dd2 0 2024-09-13T02:54:04.141 INFO:tasks.workunit.client.0.smithi089.stdout:5/692: getdents d1/d4/d45/d6f/d4d/d9d 0 2024-09-13T02:54:04.142 INFO:tasks.workunit.client.0.smithi089.stdout:9/555: dread d3/d6/d2a/d94/d24/d35/f80 [0,4194304] 0 2024-09-13T02:54:04.143 INFO:tasks.workunit.client.0.smithi089.stdout:0/610: link d2/d19/d1a/d3d/d4b/d4f/d59/f6e d2/d64/db3/dc6/fd1 0 2024-09-13T02:54:04.144 INFO:tasks.workunit.client.0.smithi089.stdout:3/671: sync 2024-09-13T02:54:04.144 INFO:tasks.workunit.client.0.smithi089.stdout:3/672: fdatasync d2/d20/d23/d32/d5b/fbd 0 2024-09-13T02:54:04.145 INFO:tasks.workunit.client.0.smithi089.stdout:3/673: write d2/d8/dc/d9a/d9c/faa [523165,61019] 0 2024-09-13T02:54:04.145 INFO:tasks.workunit.client.0.smithi089.stdout:1/632: dwrite dc/d3a/d53/d2c/d34/f78 [0,4194304] 0 2024-09-13T02:54:04.145 INFO:tasks.workunit.client.0.smithi089.stdout:6/641: creat db/d43/d6e/fd3 x:0 0 0 2024-09-13T02:54:04.150 INFO:tasks.workunit.client.0.smithi089.stdout:5/693: unlink d1/d4/l3d 0 2024-09-13T02:54:04.150 INFO:tasks.workunit.client.0.smithi089.stdout:3/674: mknod d2/d8/dc/d9a/d9c/d83/db6/cd3 0 2024-09-13T02:54:04.153 INFO:tasks.workunit.client.0.smithi089.stdout:1/633: truncate dc/d44/d73/f69 239328 0 2024-09-13T02:54:04.155 INFO:tasks.workunit.client.0.smithi089.stdout:8/731: rename de/d16/d1e/d27/d52 to de/d16/d1e/d20/d39/df5/dff 0 2024-09-13T02:54:04.155 INFO:tasks.workunit.client.0.smithi089.stdout:8/732: chown de/d56/f8c 2 1 2024-09-13T02:54:04.155 INFO:tasks.workunit.client.0.smithi089.stdout:8/733: creat de/d16/d1e/dc7/f100 x:0 0 0 2024-09-13T02:54:04.157 INFO:tasks.workunit.client.0.smithi089.stdout:0/611: rename d2/d19/d1a/l37 to d2/d19/d1a/d4e/ld2 0 2024-09-13T02:54:04.157 INFO:tasks.workunit.client.0.smithi089.stdout:6/642: rename db to db/d43/d6e/d28/d46/d7e/da1/dd4 22 2024-09-13T02:54:04.158 INFO:tasks.workunit.client.0.smithi089.stdout:3/675: getdents d2/d8/dc/dbe 0 2024-09-13T02:54:04.160 INFO:tasks.workunit.client.0.smithi089.stdout:0/612: unlink d2/f21 0 2024-09-13T02:54:04.160 INFO:tasks.workunit.client.0.smithi089.stdout:0/613: fsync d2/d19/d1a/d1e/d42/f5d 0 2024-09-13T02:54:04.160 INFO:tasks.workunit.client.0.smithi089.stdout:0/614: dread - d2/d19/d1a/d4e/fb8 zero size 2024-09-13T02:54:04.161 INFO:tasks.workunit.client.0.smithi089.stdout:8/734: rename de/d16/d1e/d27/d35/d91/fab to de/dc1/f101 0 2024-09-13T02:54:04.162 INFO:tasks.workunit.client.0.smithi089.stdout:3/676: symlink d2/d8/d5f/d72/ld4 0 2024-09-13T02:54:04.163 INFO:tasks.workunit.client.0.smithi089.stdout:8/735: dread de/f14 [0,4194304] 0 2024-09-13T02:54:04.163 INFO:tasks.workunit.client.0.smithi089.stdout:0/615: unlink d2/d19/d1a/d3d/d4b/d4f/d59/f7c 0 2024-09-13T02:54:04.163 INFO:tasks.workunit.client.0.smithi089.stdout:8/736: write de/d16/d1e/d20/da8/fbf [4928234,5190] 0 2024-09-13T02:54:04.163 INFO:tasks.workunit.client.0.smithi089.stdout:0/616: creat d2/d64/db1/fd3 x:0 0 0 2024-09-13T02:54:04.164 INFO:tasks.workunit.client.0.smithi089.stdout:3/677: creat d2/d8/dc/dbe/fd5 x:0 0 0 2024-09-13T02:54:04.166 INFO:tasks.workunit.client.0.smithi089.stdout:0/617: mkdir d2/d19/d1a/d1e/d42/dd4 0 2024-09-13T02:54:04.167 INFO:tasks.workunit.client.0.smithi089.stdout:5/694: read d1/d4/f5 [1851383,106828] 0 2024-09-13T02:54:04.167 INFO:tasks.workunit.client.0.smithi089.stdout:1/634: rmdir dc/d44 39 2024-09-13T02:54:04.168 INFO:tasks.workunit.client.0.smithi089.stdout:5/695: mknod d1/d4/d45/d6f/d7c/cdc 0 2024-09-13T02:54:04.170 INFO:tasks.workunit.client.0.smithi089.stdout:5/696: rmdir d1/d4/d45/d8c 39 2024-09-13T02:54:04.172 INFO:tasks.workunit.client.0.smithi089.stdout:0/618: dread d2/f3a [0,4194304] 0 2024-09-13T02:54:04.173 INFO:tasks.workunit.client.0.smithi089.stdout:7/811: sync 2024-09-13T02:54:04.174 INFO:tasks.workunit.client.0.smithi089.stdout:7/812: write d3/d44/ff7 [518737,35562] 0 2024-09-13T02:54:04.174 INFO:tasks.workunit.client.0.smithi089.stdout:3/678: dread d2/d20/d23/d32/d5b/f7a [0,4194304] 0 2024-09-13T02:54:04.174 INFO:tasks.workunit.client.0.smithi089.stdout:0/619: creat d2/d19/d1a/dbe/fd5 x:0 0 0 2024-09-13T02:54:04.174 INFO:tasks.workunit.client.0.smithi089.stdout:0/620: write d2/d19/d1a/d3d/d4b/d4f/f5b [706631,119376] 0 2024-09-13T02:54:04.174 INFO:tasks.workunit.client.0.smithi089.stdout:0/621: write d2/d19/f32 [2783946,109400] 0 2024-09-13T02:54:04.174 INFO:tasks.workunit.client.0.smithi089.stdout:0/622: write d2/f16 [264340,71121] 0 2024-09-13T02:54:04.175 INFO:tasks.workunit.client.0.smithi089.stdout:2/620: dwrite d13/d30/d59/f7e [0,4194304] 0 2024-09-13T02:54:04.175 INFO:tasks.workunit.client.0.smithi089.stdout:2/621: truncate d13/d30/f4a 4286067 0 2024-09-13T02:54:04.175 INFO:tasks.workunit.client.0.smithi089.stdout:2/622: truncate d13/d30/f73 376965 0 2024-09-13T02:54:04.176 INFO:tasks.workunit.client.0.smithi089.stdout:0/623: unlink d2/f3 0 2024-09-13T02:54:04.177 INFO:tasks.workunit.client.0.smithi089.stdout:0/624: getdents d2/d19/d1a/d4e/d7a/d9b 0 2024-09-13T02:54:04.179 INFO:tasks.workunit.client.0.smithi089.stdout:1/635: write dc/d3a/d53/f26 [1471868,15533] 0 2024-09-13T02:54:04.180 INFO:tasks.workunit.client.0.smithi089.stdout:3/679: write d2/d8/dc/f30 [3909455,110205] 0 2024-09-13T02:54:04.180 INFO:tasks.workunit.client.0.smithi089.stdout:3/680: write d2/d20/d23/d32/d49/f56 [694170,6163] 0 2024-09-13T02:54:04.180 INFO:tasks.workunit.client.0.smithi089.stdout:4/764: dwrite d2/f4b [0,4194304] 0 2024-09-13T02:54:04.181 INFO:tasks.workunit.client.0.smithi089.stdout:6/643: dwrite db/d43/d6e/d28/d37/f4e [0,4194304] 0 2024-09-13T02:54:04.182 INFO:tasks.workunit.client.0.smithi089.stdout:9/556: dwrite d3/d6/d2a/d94/d24/fa8 [0,4194304] 0 2024-09-13T02:54:04.182 INFO:tasks.workunit.client.0.smithi089.stdout:9/557: fsync d3/f22 0 2024-09-13T02:54:04.182 INFO:tasks.workunit.client.0.smithi089.stdout:5/697: dread d1/d7/f27 [0,4194304] 0 2024-09-13T02:54:04.186 INFO:tasks.workunit.client.0.smithi089.stdout:2/623: dread d13/f17 [0,4194304] 0 2024-09-13T02:54:04.186 INFO:tasks.workunit.client.0.smithi089.stdout:2/624: dread - d13/d30/d4e/d6f/d76/fb8 zero size 2024-09-13T02:54:04.191 INFO:tasks.workunit.client.0.smithi089.stdout:8/737: dwrite de/f14 [0,4194304] 0 2024-09-13T02:54:04.191 INFO:tasks.workunit.client.0.smithi089.stdout:7/813: dread d3/d20/fa6 [0,4194304] 0 2024-09-13T02:54:04.191 INFO:tasks.workunit.client.0.smithi089.stdout:7/814: write d3/fbc [2516906,59136] 0 2024-09-13T02:54:04.194 INFO:tasks.workunit.client.0.smithi089.stdout:6/644: read db/d43/d6e/d28/d2f/f4c [214148,78847] 0 2024-09-13T02:54:04.194 INFO:tasks.workunit.client.0.smithi089.stdout:6/645: chown db/d43/d6e/d28/d37/d8b/dcd/d7d/l8f 181 1 2024-09-13T02:54:04.197 INFO:tasks.workunit.client.0.smithi089.stdout:1/636: link lb dc/d44/d73/d9a/lc9 0 2024-09-13T02:54:04.208 INFO:tasks.workunit.client.0.smithi089.stdout:9/558: creat d3/d6/d2a/d4b/d54/da1/fad x:0 0 0 2024-09-13T02:54:04.208 INFO:tasks.workunit.client.0.smithi089.stdout:9/559: creat d3/d6/d2a/d4b/d54/fae x:0 0 0 2024-09-13T02:54:04.212 INFO:tasks.workunit.client.0.smithi089.stdout:0/625: dwrite d2/f26 [4194304,4194304] 0 2024-09-13T02:54:04.212 INFO:tasks.workunit.client.0.smithi089.stdout:4/765: dwrite d2/d3/d5/d43/d3b/d71/fee [0,4194304] 0 2024-09-13T02:54:04.216 INFO:tasks.workunit.client.0.smithi089.stdout:6/646: dwrite db/d43/d6e/faf [0,4194304] 0 2024-09-13T02:54:04.216 INFO:tasks.workunit.client.0.smithi089.stdout:6/647: chown db/d43/d6e/d28/c4b 436090 1 2024-09-13T02:54:04.220 INFO:tasks.workunit.client.0.smithi089.stdout:2/625: creat d13/d30/d4e/d7b/fdb x:0 0 0 2024-09-13T02:54:04.232 INFO:tasks.workunit.client.0.smithi089.stdout:4/766: dwrite d2/d3/d5/d43/d3b/d71/d99/fa3 [0,4194304] 0 2024-09-13T02:54:04.232 INFO:tasks.workunit.client.0.smithi089.stdout:4/767: chown d2/da/f44 107 1 2024-09-13T02:54:04.233 INFO:tasks.workunit.client.0.smithi089.stdout:9/560: dwrite d3/d15/f3f [0,4194304] 0 2024-09-13T02:54:04.241 INFO:tasks.workunit.client.0.smithi089.stdout:6/648: dwrite db/d43/d6e/d28/d2f/f33 [0,4194304] 0 2024-09-13T02:54:04.254 INFO:tasks.workunit.client.0.smithi089.stdout:7/815: fdatasync d3/d19/f3d 0 2024-09-13T02:54:04.255 INFO:tasks.workunit.client.0.smithi089.stdout:9/561: dwrite d3/d6/d2a/d94/d24/d29/fa9 [0,4194304] 0 2024-09-13T02:54:04.259 INFO:tasks.workunit.client.0.smithi089.stdout:6/649: dwrite db/d43/d6e/d28/d37/f52 [0,4194304] 0 2024-09-13T02:54:04.269 INFO:tasks.workunit.client.0.smithi089.stdout:7/816: dwrite d3/d19/d75/d63/da1/fc4 [4194304,4194304] 0 2024-09-13T02:54:04.274 INFO:tasks.workunit.client.0.smithi089.stdout:1/637: creat dc/d46/d6c/fca x:0 0 0 2024-09-13T02:54:04.278 INFO:tasks.workunit.client.0.smithi089.stdout:5/698: rmdir d1/d4/d45/dc7 39 2024-09-13T02:54:04.278 INFO:tasks.workunit.client.0.smithi089.stdout:5/699: fsync d1/fb6 0 2024-09-13T02:54:04.280 INFO:tasks.workunit.client.0.smithi089.stdout:0/626: write d2/d19/d1a/d3d/d4b/d4f/d59/d6b/fa8 [746744,36531] 0 2024-09-13T02:54:04.284 INFO:tasks.workunit.client.0.smithi089.stdout:2/626: creat d13/d30/d4e/d6f/d76/fdc x:0 0 0 2024-09-13T02:54:04.286 INFO:tasks.workunit.client.0.smithi089.stdout:4/768: symlink d2/d3/d5/d72/lfe 0 2024-09-13T02:54:04.289 INFO:tasks.workunit.client.0.smithi089.stdout:8/738: rmdir de/d16/d1e/d3f 39 2024-09-13T02:54:04.289 INFO:tasks.workunit.client.0.smithi089.stdout:8/739: chown de/d16/le4 16384 1 2024-09-13T02:54:04.291 INFO:tasks.workunit.client.0.smithi089.stdout:7/817: dwrite d3/d19/d75/f5a [0,4194304] 0 2024-09-13T02:54:04.296 INFO:tasks.workunit.client.0.smithi089.stdout:5/700: creat d1/d4/d45/d6f/d4d/d9d/fdd x:0 0 0 2024-09-13T02:54:04.298 INFO:tasks.workunit.client.0.smithi089.stdout:0/627: dread - d2/d64/fab zero size 2024-09-13T02:54:04.301 INFO:tasks.workunit.client.0.smithi089.stdout:2/627: mkdir d13/d30/d61/d78/d79/ddd 0 2024-09-13T02:54:04.301 INFO:tasks.workunit.client.0.smithi089.stdout:2/628: stat d13/d30/d4e/d7b/d86/dc0 0 2024-09-13T02:54:04.301 INFO:tasks.workunit.client.0.smithi089.stdout:2/629: readlink d13/d30/l21 0 2024-09-13T02:54:04.302 INFO:tasks.workunit.client.0.smithi089.stdout:8/740: creat de/d16/d1e/d20/d39/df5/dff/dc2/f102 x:0 0 0 2024-09-13T02:54:04.306 INFO:tasks.workunit.client.0.smithi089.stdout:5/701: symlink d1/d4/d45/d8c/d98/lde 0 2024-09-13T02:54:04.306 INFO:tasks.workunit.client.0.smithi089.stdout:5/702: truncate d1/d4/d45/d6f/d4d/d7f/d49/f5d 4584037 0 2024-09-13T02:54:04.306 INFO:tasks.workunit.client.0.smithi089.stdout:5/703: chown d1/d7/c6c 18030 1 2024-09-13T02:54:04.307 INFO:tasks.workunit.client.0.smithi089.stdout:5/704: write d1/d4/d45/d6f/d4d/d7f/d49/f6b [2101633,24440] 0 2024-09-13T02:54:04.307 INFO:tasks.workunit.client.0.smithi089.stdout:5/705: read - d1/d4/d45/d6f/d4d/d7f/d49/dc8/fca zero size 2024-09-13T02:54:04.307 INFO:tasks.workunit.client.0.smithi089.stdout:5/706: fsync d1/d4/d45/f82 0 2024-09-13T02:54:04.307 INFO:tasks.workunit.client.0.smithi089.stdout:2/630: symlink d13/d30/d4e/d7b/lde 0 2024-09-13T02:54:04.308 INFO:tasks.workunit.client.0.smithi089.stdout:3/681: rename d2/l91 to d2/d8/dc/d57/ld6 0 2024-09-13T02:54:04.308 INFO:tasks.workunit.client.0.smithi089.stdout:6/650: rename db to db/d43/d6e/dd5 22 2024-09-13T02:54:04.308 INFO:tasks.workunit.client.0.smithi089.stdout:3/682: write d2/d8/dc/dbe/fd5 [705138,44894] 0 2024-09-13T02:54:04.310 INFO:tasks.workunit.client.0.smithi089.stdout:5/707: creat d1/d4/d2b/da9/fdf x:0 0 0 2024-09-13T02:54:04.311 INFO:tasks.workunit.client.0.smithi089.stdout:4/769: dwrite d2/fd9 [0,4194304] 0 2024-09-13T02:54:04.311 INFO:tasks.workunit.client.0.smithi089.stdout:9/562: symlink d3/laf 0 2024-09-13T02:54:04.312 INFO:tasks.workunit.client.0.smithi089.stdout:9/563: creat d3/d6/d2a/d94/d24/d32/fb0 x:0 0 0 2024-09-13T02:54:04.312 INFO:tasks.workunit.client.0.smithi089.stdout:3/683: getdents d2/d20/d23 0 2024-09-13T02:54:04.314 INFO:tasks.workunit.client.0.smithi089.stdout:5/708: mknod d1/ce0 0 2024-09-13T02:54:04.316 INFO:tasks.workunit.client.0.smithi089.stdout:1/638: rename dc/d3a/d53/d2c/d36/l8e to dc/d3a/d93/lcb 0 2024-09-13T02:54:04.318 INFO:tasks.workunit.client.0.smithi089.stdout:2/631: dread fd [0,4194304] 0 2024-09-13T02:54:04.319 INFO:tasks.workunit.client.0.smithi089.stdout:0/628: dwrite d2/d19/d1a/d3d/d4b/d4f/d59/fce [0,4194304] 0 2024-09-13T02:54:04.319 INFO:tasks.workunit.client.0.smithi089.stdout:7/818: dwrite d3/d19/d2e/f4f [0,4194304] 0 2024-09-13T02:54:04.319 INFO:tasks.workunit.client.0.smithi089.stdout:7/819: stat d3/d19/d2e/f6e 0 2024-09-13T02:54:04.319 INFO:tasks.workunit.client.0.smithi089.stdout:7/820: write d3/d19/d75/d63/da1/db4/dd3/ff1 [627554,15395] 0 2024-09-13T02:54:04.319 INFO:tasks.workunit.client.0.smithi089.stdout:7/821: fsync d3/d20/f5d 0 2024-09-13T02:54:04.320 INFO:tasks.workunit.client.0.smithi089.stdout:9/564: creat d3/fb1 x:0 0 0 2024-09-13T02:54:04.320 INFO:tasks.workunit.client.0.smithi089.stdout:9/565: chown d3/d6/d2a/d4b 49310119 1 2024-09-13T02:54:04.322 INFO:tasks.workunit.client.0.smithi089.stdout:6/651: dread db/d43/d6e/d28/d46/d53/f5a [0,4194304] 0 2024-09-13T02:54:04.322 INFO:tasks.workunit.client.0.smithi089.stdout:6/652: creat db/db2/fd6 x:0 0 0 2024-09-13T02:54:04.322 INFO:tasks.workunit.client.0.smithi089.stdout:6/653: getdents db/d10/dc1 0 2024-09-13T02:54:04.322 INFO:tasks.workunit.client.0.smithi089.stdout:6/654: write db/d43/d6e/d28/d2f/f4c [893227,58432] 0 2024-09-13T02:54:04.322 INFO:tasks.workunit.client.0.smithi089.stdout:5/709: creat d1/d4/d45/d6f/d4d/fe1 x:0 0 0 2024-09-13T02:54:04.323 INFO:tasks.workunit.client.0.smithi089.stdout:1/639: getdents dc/d44/d73/d9a/da1 0 2024-09-13T02:54:04.325 INFO:tasks.workunit.client.0.smithi089.stdout:2/632: creat d13/fdf x:0 0 0 2024-09-13T02:54:04.325 INFO:tasks.workunit.client.0.smithi089.stdout:2/633: fsync f1 0 2024-09-13T02:54:04.325 INFO:tasks.workunit.client.0.smithi089.stdout:2/634: chown d13/d30/d59/dbe/fbf 501957350 1 2024-09-13T02:54:04.325 INFO:tasks.workunit.client.0.smithi089.stdout:2/635: read - d13/d30/d4e/d7b/f83 zero size 2024-09-13T02:54:04.326 INFO:tasks.workunit.client.0.smithi089.stdout:4/770: dread d2/d22/f34 [0,4194304] 0 2024-09-13T02:54:04.327 INFO:tasks.workunit.client.0.smithi089.stdout:1/640: dread dc/d44/f6a [0,4194304] 0 2024-09-13T02:54:04.327 INFO:tasks.workunit.client.0.smithi089.stdout:1/641: fsync dc/d44/f49 0 2024-09-13T02:54:04.327 INFO:tasks.workunit.client.0.smithi089.stdout:1/642: chown dc/l14 233941879 1 2024-09-13T02:54:04.329 INFO:tasks.workunit.client.0.smithi089.stdout:7/822: mkdir d3/d19/d75/db2/dfe 0 2024-09-13T02:54:04.331 INFO:tasks.workunit.client.0.smithi089.stdout:9/566: symlink d3/d6/d2a/d4b/d77/lb2 0 2024-09-13T02:54:04.334 INFO:tasks.workunit.client.0.smithi089.stdout:3/684: dwrite d2/d20/d23/d32/d49/f67 [4194304,4194304] 0 2024-09-13T02:54:04.335 INFO:tasks.workunit.client.0.smithi089.stdout:1/643: dread dc/d3a/d53/d2c/d34/f39 [0,4194304] 0 2024-09-13T02:54:04.335 INFO:tasks.workunit.client.0.smithi089.stdout:1/644: readlink dc/d44/l65 0 2024-09-13T02:54:04.335 INFO:tasks.workunit.client.0.smithi089.stdout:1/645: fsync dc/d46/f89 0 2024-09-13T02:54:04.336 INFO:tasks.workunit.client.0.smithi089.stdout:6/655: creat db/d43/d6e/d28/d2f/dc8/fd7 x:0 0 0 2024-09-13T02:54:04.336 INFO:tasks.workunit.client.0.smithi089.stdout:6/656: write db/d10/d3a/f8a [1430148,66220] 0 2024-09-13T02:54:04.337 INFO:tasks.workunit.client.0.smithi089.stdout:5/710: truncate d1/d4/d45/d6f/d4d/d7f/d49/fa4 262604 0 2024-09-13T02:54:04.339 INFO:tasks.workunit.client.0.smithi089.stdout:2/636: link d13/f72 d13/d30/d4e/d6f/fe0 0 2024-09-13T02:54:04.339 INFO:tasks.workunit.client.0.smithi089.stdout:2/637: dread - d13/f9a zero size 2024-09-13T02:54:04.352 INFO:tasks.workunit.client.0.smithi089.stdout:6/657: read db/d43/d6e/d28/d37/f72 [2478865,74893] 0 2024-09-13T02:54:04.352 INFO:tasks.workunit.client.0.smithi089.stdout:4/771: dwrite d2/fca [0,4194304] 0 2024-09-13T02:54:04.355 INFO:tasks.workunit.client.0.smithi089.stdout:7/823: symlink d3/d19/d75/d63/lff 0 2024-09-13T02:54:04.357 INFO:tasks.workunit.client.0.smithi089.stdout:9/567: unlink d3/d6/d2a/d94/d24/l6a 0 2024-09-13T02:54:04.358 INFO:tasks.workunit.client.0.smithi089.stdout:3/685: unlink d2/d8/dc/dbe/fd5 0 2024-09-13T02:54:04.359 INFO:tasks.workunit.client.0.smithi089.stdout:1/646: creat dc/d3a/d53/fcc x:0 0 0 2024-09-13T02:54:04.360 INFO:tasks.workunit.client.0.smithi089.stdout:2/638: dwrite d13/d30/d59/f96 [0,4194304] 0 2024-09-13T02:54:04.360 INFO:tasks.workunit.client.0.smithi089.stdout:5/711: getdents d1/d73 0 2024-09-13T02:54:04.365 INFO:tasks.workunit.client.0.smithi089.stdout:4/772: creat d2/d22/da1/d62/fff x:0 0 0 2024-09-13T02:54:04.366 INFO:tasks.workunit.client.0.smithi089.stdout:7/824: truncate d3/d19/d75/d63/ddd/feb 1115555 0 2024-09-13T02:54:04.368 INFO:tasks.workunit.client.0.smithi089.stdout:9/568: truncate d3/f22 1574476 0 2024-09-13T02:54:04.368 INFO:tasks.workunit.client.0.smithi089.stdout:9/569: truncate d3/fac 185056 0 2024-09-13T02:54:04.368 INFO:tasks.workunit.client.0.smithi089.stdout:3/686: rmdir d2/d8/dc 39 2024-09-13T02:54:04.371 INFO:tasks.workunit.client.0.smithi089.stdout:5/712: write d1/d4/d45/d6f/d4d/f58 [1418096,45514] 0 2024-09-13T02:54:04.371 INFO:tasks.workunit.client.0.smithi089.stdout:2/639: creat d13/d30/d61/d78/d9c/fe1 x:0 0 0 2024-09-13T02:54:04.372 INFO:tasks.workunit.client.0.smithi089.stdout:2/640: chown d13/d30/d64/c81 2711317 1 2024-09-13T02:54:04.372 INFO:tasks.workunit.client.0.smithi089.stdout:2/641: truncate d13/f27 4667398 0 2024-09-13T02:54:04.372 INFO:tasks.workunit.client.0.smithi089.stdout:2/642: stat d13/d30/f48 0 2024-09-13T02:54:04.373 INFO:tasks.workunit.client.0.smithi089.stdout:6/658: rmdir db/d10/d3a 39 2024-09-13T02:54:04.375 INFO:tasks.workunit.client.0.smithi089.stdout:9/570: write d3/d6/d2a/d94/d24/d32/f4a [286538,107940] 0 2024-09-13T02:54:04.375 INFO:tasks.workunit.client.0.smithi089.stdout:1/647: dwrite dc/d3a/d53/d2c/d34/f67 [0,4194304] 0 2024-09-13T02:54:04.377 INFO:tasks.workunit.client.0.smithi089.stdout:6/659: creat db/d10/d3a/fd8 x:0 0 0 2024-09-13T02:54:04.380 INFO:tasks.workunit.client.0.smithi089.stdout:9/571: creat d3/d15/fb3 x:0 0 0 2024-09-13T02:54:04.381 INFO:tasks.workunit.client.0.smithi089.stdout:5/713: dread d1/d4/d45/d6f/d7c/fba [0,4194304] 0 2024-09-13T02:54:04.381 INFO:tasks.workunit.client.0.smithi089.stdout:5/714: chown d1/d4/d45/d6f/fc2 177452 1 2024-09-13T02:54:04.381 INFO:tasks.workunit.client.0.smithi089.stdout:1/648: rmdir dc/d44/d73/d9a 39 2024-09-13T02:54:04.382 INFO:tasks.workunit.client.0.smithi089.stdout:3/687: rmdir d2/d8/dc/d3c/d9e 39 2024-09-13T02:54:04.383 INFO:tasks.workunit.client.0.smithi089.stdout:6/660: symlink db/d43/d6e/d28/d46/d53/d83/d9f/ld9 0 2024-09-13T02:54:04.385 INFO:tasks.workunit.client.0.smithi089.stdout:3/688: creat d2/d8/dc/d9a/d9c/d83/fd7 x:0 0 0 2024-09-13T02:54:04.385 INFO:tasks.workunit.client.0.smithi089.stdout:3/689: write d2/d20/d23/d32/d5b/d71/f93 [734859,33506] 0 2024-09-13T02:54:04.386 INFO:tasks.workunit.client.0.smithi089.stdout:6/661: symlink db/lda 0 2024-09-13T02:54:04.387 INFO:tasks.workunit.client.0.smithi089.stdout:3/690: mkdir d2/d8/dc/dbe/dd8 0 2024-09-13T02:54:04.387 INFO:tasks.workunit.client.0.smithi089.stdout:3/691: readlink d2/d20/d23/d32/d5b/d71/d92/l96 0 2024-09-13T02:54:04.388 INFO:tasks.workunit.client.0.smithi089.stdout:6/662: mknod db/d43/d6e/d28/d37/dc2/cdb 0 2024-09-13T02:54:04.388 INFO:tasks.workunit.client.0.smithi089.stdout:6/663: fsync db/db2/fb7 0 2024-09-13T02:54:04.389 INFO:tasks.workunit.client.0.smithi089.stdout:3/692: unlink d2/d8/dc/dbe/cce 0 2024-09-13T02:54:04.389 INFO:tasks.workunit.client.0.smithi089.stdout:9/572: write d3/d15/f49 [2664650,78252] 0 2024-09-13T02:54:04.390 INFO:tasks.workunit.client.0.smithi089.stdout:9/573: creat d3/d6/d2a/d4b/d54/fb4 x:0 0 0 2024-09-13T02:54:04.390 INFO:tasks.workunit.client.0.smithi089.stdout:9/574: fdatasync d3/d6/d2a/d4b/d54/fae 0 2024-09-13T02:54:04.390 INFO:tasks.workunit.client.0.smithi089.stdout:3/693: unlink d2/d20/fa1 0 2024-09-13T02:54:04.391 INFO:tasks.workunit.client.0.smithi089.stdout:5/715: dread d1/d4/d45/d6f/f3b [0,4194304] 0 2024-09-13T02:54:04.392 INFO:tasks.workunit.client.0.smithi089.stdout:5/716: symlink d1/d4/d45/d6f/d4d/d9d/daa/le2 0 2024-09-13T02:54:04.392 INFO:tasks.workunit.client.0.smithi089.stdout:5/717: readlink d1/d4/d45/d6f/d4d/d9d/daa/le2 0 2024-09-13T02:54:04.394 INFO:tasks.workunit.client.0.smithi089.stdout:5/718: symlink d1/d4/d2b/le3 0 2024-09-13T02:54:04.396 INFO:tasks.workunit.client.0.smithi089.stdout:1/649: dread dc/d3a/d53/d2c/d36/f51 [0,4194304] 0 2024-09-13T02:54:04.397 INFO:tasks.workunit.client.0.smithi089.stdout:7/825: dwrite d3/d19/d67/f80 [0,4194304] 0 2024-09-13T02:54:04.397 INFO:tasks.workunit.client.0.smithi089.stdout:7/826: write d3/fbc [3212423,21653] 0 2024-09-13T02:54:04.397 INFO:tasks.workunit.client.0.smithi089.stdout:7/827: fsync d3/d44/d85/d77/fd6 0 2024-09-13T02:54:04.397 INFO:tasks.workunit.client.0.smithi089.stdout:0/629: rename d2/fa3 to d2/d19/d1a/d4e/d7a/d9b/fd6 0 2024-09-13T02:54:04.400 INFO:tasks.workunit.client.0.smithi089.stdout:6/664: dread db/d10/d3a/fa5 [0,4194304] 0 2024-09-13T02:54:04.401 INFO:tasks.workunit.client.0.smithi089.stdout:1/650: symlink dc/d3a/d53/lcd 0 2024-09-13T02:54:04.401 INFO:tasks.workunit.client.0.smithi089.stdout:6/665: stat db/d43/d6e/d28/d2f/d9b/fa6 0 2024-09-13T02:54:04.401 INFO:tasks.workunit.client.0.smithi089.stdout:6/666: stat db/d43/d6e/f55 0 2024-09-13T02:54:04.401 INFO:tasks.workunit.client.0.smithi089.stdout:9/575: dread d3/d6/d2a/d4b/d54/f72 [0,4194304] 0 2024-09-13T02:54:04.401 INFO:tasks.workunit.client.0.smithi089.stdout:2/643: dwrite d13/d30/d64/f9e [0,4194304] 0 2024-09-13T02:54:04.401 INFO:tasks.workunit.client.0.smithi089.stdout:9/576: chown d3/d6/d2a/d4b/d54/fb4 265 1 2024-09-13T02:54:04.403 INFO:tasks.workunit.client.0.smithi089.stdout:7/828: unlink d3/d44/d85/d77/f8c 0 2024-09-13T02:54:04.403 INFO:tasks.workunit.client.0.smithi089.stdout:0/630: truncate d2/f85 1034928 0 2024-09-13T02:54:04.404 INFO:tasks.workunit.client.0.smithi089.stdout:0/631: chown d2/d19/d1a/d4e/cc3 0 1 2024-09-13T02:54:04.405 INFO:tasks.workunit.client.0.smithi089.stdout:4/773: rename d2/d22/da1/d62/cb9 to d2/d22/da1/d62/d6c/d88/db2/c100 0 2024-09-13T02:54:04.406 INFO:tasks.workunit.client.0.smithi089.stdout:1/651: creat dc/d3a/d53/d2c/fce x:0 0 0 2024-09-13T02:54:04.416 INFO:tasks.workunit.client.0.smithi089.stdout:6/667: dread db/f1d [4194304,4194304] 0 2024-09-13T02:54:04.417 INFO:tasks.workunit.client.0.smithi089.stdout:3/694: dwrite d2/d20/d23/d2b/f89 [4194304,4194304] 0 2024-09-13T02:54:04.417 INFO:tasks.workunit.client.0.smithi089.stdout:3/695: rename d2/d20 to d2/d20/d44/dd9 22 2024-09-13T02:54:04.417 INFO:tasks.workunit.client.0.smithi089.stdout:3/696: write d2/d8/d5f/d72/fb9 [955313,2269] 0 2024-09-13T02:54:04.417 INFO:tasks.workunit.client.0.smithi089.stdout:3/697: fdatasync d2/d20/d23/d32/d5b/d71/fa5 0 2024-09-13T02:54:04.420 INFO:tasks.workunit.client.0.smithi089.stdout:7/829: write d3/d44/d85/d5e/d6f/fa3 [163588,114056] 0 2024-09-13T02:54:04.424 INFO:tasks.workunit.client.0.smithi089.stdout:6/668: truncate db/d10/d3a/d7b/f7c 2759417 0 2024-09-13T02:54:04.424 INFO:tasks.workunit.client.0.smithi089.stdout:7/830: dread d3/d19/d75/d63/da1/fcb [0,4194304] 0 2024-09-13T02:54:04.425 INFO:tasks.workunit.client.0.smithi089.stdout:7/831: creat d3/d44/d85/d55/f100 x:0 0 0 2024-09-13T02:54:04.425 INFO:tasks.workunit.client.0.smithi089.stdout:3/698: symlink d2/d8b/lda 0 2024-09-13T02:54:04.426 INFO:tasks.workunit.client.0.smithi089.stdout:6/669: mkdir db/d43/d6e/d28/d46/d53/d83/ddc 0 2024-09-13T02:54:04.429 INFO:tasks.workunit.client.0.smithi089.stdout:7/832: link d3/d19/d2e/f88 d3/d19/d75/d14/d71/f101 0 2024-09-13T02:54:04.430 INFO:tasks.workunit.client.0.smithi089.stdout:3/699: getdents d2/d8 0 2024-09-13T02:54:04.432 INFO:tasks.workunit.client.0.smithi089.stdout:6/670: creat db/d43/d6e/d28/d46/d7e/da1/fdd x:0 0 0 2024-09-13T02:54:04.434 INFO:tasks.workunit.client.0.smithi089.stdout:7/833: truncate d3/d20/fa6 1098983 0 2024-09-13T02:54:04.434 INFO:tasks.workunit.client.0.smithi089.stdout:7/834: dread - d3/d19/d2e/d37/ffd zero size 2024-09-13T02:54:04.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:04 smithi131 ceph-mon[34689]: pgmap v244: 65 pgs: 65 active+clean; 1.8 GiB data, 7.0 GiB used, 529 GiB / 536 GiB avail; 179 MiB/s rd, 238 MiB/s wr, 369 op/s 2024-09-13T02:54:04.435 INFO:tasks.workunit.client.0.smithi089.stdout:3/700: symlink d2/d8b/daf/ldb 0 2024-09-13T02:54:04.436 INFO:tasks.workunit.client.0.smithi089.stdout:6/671: mknod db/d43/d6e/d28/d2f/d9b/cde 0 2024-09-13T02:54:04.438 INFO:tasks.workunit.client.0.smithi089.stdout:6/672: symlink db/d43/d6e/d28/d46/d53/d83/d9f/db1/ldf 0 2024-09-13T02:54:04.449 INFO:tasks.workunit.client.0.smithi089.stdout:7/835: read d3/d19/d75/f5a [3632082,116939] 0 2024-09-13T02:54:04.449 INFO:tasks.workunit.client.0.smithi089.stdout:7/836: creat d3/d44/d85/dbd/f102 x:0 0 0 2024-09-13T02:54:04.449 INFO:tasks.workunit.client.0.smithi089.stdout:3/701: write d2/f41 [2905043,42834] 0 2024-09-13T02:54:04.450 INFO:tasks.workunit.client.0.smithi089.stdout:3/702: write d2/d20/d23/d2b/f53 [277210,93519] 0 2024-09-13T02:54:04.450 INFO:tasks.workunit.client.0.smithi089.stdout:5/719: dwrite d1/d4/d45/d6f/d4d/f7e [0,4194304] 0 2024-09-13T02:54:04.451 INFO:tasks.workunit.client.0.smithi089.stdout:2/644: dwrite d13/d30/f75 [0,4194304] 0 2024-09-13T02:54:04.451 INFO:tasks.workunit.client.0.smithi089.stdout:2/645: getdents d13/d30/d4e/d7b/d86/da7 0 2024-09-13T02:54:04.451 INFO:tasks.workunit.client.0.smithi089.stdout:4/774: dwrite d2/d3/d5/fa9 [0,4194304] 0 2024-09-13T02:54:04.451 INFO:tasks.workunit.client.0.smithi089.stdout:4/775: dread - d2/d3/d5/d43/d3b/d71/d99/fc2 zero size 2024-09-13T02:54:04.451 INFO:tasks.workunit.client.0.smithi089.stdout:4/776: chown d2/d3/d5/d43/d3b/l48 8 1 2024-09-13T02:54:04.453 INFO:tasks.workunit.client.0.smithi089.stdout:3/703: mkdir d2/d20/d23/d27/ddc 0 2024-09-13T02:54:04.454 INFO:tasks.workunit.client.0.smithi089.stdout:4/777: dread d2/d22/da1/d62/d6c/d88/f98 [0,4194304] 0 2024-09-13T02:54:04.455 INFO:tasks.workunit.client.0.smithi089.stdout:9/577: dwrite d3/d6/f14 [0,4194304] 0 2024-09-13T02:54:04.456 INFO:tasks.workunit.client.0.smithi089.stdout:0/632: dwrite d2/f28 [4194304,4194304] 0 2024-09-13T02:54:04.456 INFO:tasks.workunit.client.0.smithi089.stdout:0/633: chown d2/d19/d1a/d4e/cc3 1780868911 1 2024-09-13T02:54:04.457 INFO:tasks.workunit.client.0.smithi089.stdout:0/634: fdatasync d2/d19/d1a/d4e/d7a/f90 0 2024-09-13T02:54:04.457 INFO:tasks.workunit.client.0.smithi089.stdout:8/741: sync 2024-09-13T02:54:04.457 INFO:tasks.workunit.client.0.smithi089.stdout:8/742: truncate de/d16/d1e/d27/d76/d8d/fa0 248395 0 2024-09-13T02:54:04.457 INFO:tasks.workunit.client.0.smithi089.stdout:3/704: dread d2/d20/d23/d32/d49/fba [0,4194304] 0 2024-09-13T02:54:04.457 INFO:tasks.workunit.client.0.smithi089.stdout:3/705: chown d2/d8/c18 205 1 2024-09-13T02:54:04.458 INFO:tasks.workunit.client.0.smithi089.stdout:1/652: dwrite dc/d3a/d53/d2c/d36/f38 [0,4194304] 0 2024-09-13T02:54:04.458 INFO:tasks.workunit.client.0.smithi089.stdout:6/673: dwrite db/d43/d6e/d28/d37/fa3 [0,4194304] 0 2024-09-13T02:54:04.458 INFO:tasks.workunit.client.0.smithi089.stdout:6/674: chown l4 560359 1 2024-09-13T02:54:04.460 INFO:tasks.workunit.client.0.smithi089.stdout:0/635: mknod d2/d19/d1a/d3d/cd7 0 2024-09-13T02:54:04.464 INFO:tasks.workunit.client.0.smithi089.stdout:3/706: truncate d2/d8/f21 2735259 0 2024-09-13T02:54:04.464 INFO:tasks.workunit.client.0.smithi089.stdout:9/578: rename d3/d6/d2a/d94/d24/d29/l7c to d3/d6/d2a/d94/lb5 0 2024-09-13T02:54:04.465 INFO:tasks.workunit.client.0.smithi089.stdout:7/837: write d3/d19/d75/fa7 [508184,1342] 0 2024-09-13T02:54:04.466 INFO:tasks.workunit.client.0.smithi089.stdout:6/675: mkdir db/d43/d6e/d28/d46/d53/d83/d9f/de0 0 2024-09-13T02:54:04.468 INFO:tasks.workunit.client.0.smithi089.stdout:0/636: creat d2/d19/d1a/d1e/d42/fd8 x:0 0 0 2024-09-13T02:54:04.468 INFO:tasks.workunit.client.0.smithi089.stdout:0/637: truncate d2/d64/db1/fc0 997210 0 2024-09-13T02:54:04.470 INFO:tasks.workunit.client.0.smithi089.stdout:0/638: write d2/d19/d1a/f56 [325648,35204] 0 2024-09-13T02:54:04.475 INFO:tasks.workunit.client.0.smithi089.stdout:6/676: mknod db/d43/d6e/d28/d2f/ce1 0 2024-09-13T02:54:04.475 INFO:tasks.workunit.client.0.smithi089.stdout:6/677: write db/d43/d6e/d28/d37/d8b/fa9 [698443,99318] 0 2024-09-13T02:54:04.475 INFO:tasks.workunit.client.0.smithi089.stdout:8/743: write de/d16/d1e/d27/d76/f55 [458832,10137] 0 2024-09-13T02:54:04.477 INFO:tasks.workunit.client.0.smithi089.stdout:3/707: write d2/d20/d23/d32/d49/f67 [1718520,101691] 0 2024-09-13T02:54:04.477 INFO:tasks.workunit.client.0.smithi089.stdout:8/744: dread de/fcd [0,4194304] 0 2024-09-13T02:54:04.480 INFO:tasks.workunit.client.0.smithi089.stdout:7/838: write d3/d20/fa6 [2092128,110657] 0 2024-09-13T02:54:04.480 INFO:tasks.workunit.client.0.smithi089.stdout:7/839: chown d3/f1b 79321 1 2024-09-13T02:54:04.480 INFO:tasks.workunit.client.0.smithi089.stdout:0/639: dread d2/d19/d1a/d3d/d4b/d4f/d59/d6b/f6c [0,4194304] 0 2024-09-13T02:54:04.482 INFO:tasks.workunit.client.0.smithi089.stdout:0/640: mkdir d2/d19/d1a/d3d/d4b/d4f/d59/dd9 0 2024-09-13T02:54:04.484 INFO:tasks.workunit.client.0.smithi089.stdout:6/678: rename db/d43/d6e/d28/d37/f8d to db/d10/fe2 0 2024-09-13T02:54:04.484 INFO:tasks.workunit.client.0.smithi089.stdout:6/679: write db/d10/d3a/fcb [460145,57270] 0 2024-09-13T02:54:04.484 INFO:tasks.workunit.client.0.smithi089.stdout:6/680: write db/d43/d6e/d28/d37/f4e [4605166,41668] 0 2024-09-13T02:54:04.485 INFO:tasks.workunit.client.0.smithi089.stdout:0/641: dread d2/d19/d1a/d3d/d4b/d4f/f5e [0,4194304] 0 2024-09-13T02:54:04.486 INFO:tasks.workunit.client.0.smithi089.stdout:6/681: creat db/d43/d6e/d28/fe3 x:0 0 0 2024-09-13T02:54:04.486 INFO:tasks.workunit.client.0.smithi089.stdout:0/642: rmdir d2/d19/d1a/d4e/d9a 39 2024-09-13T02:54:04.487 INFO:tasks.workunit.client.0.smithi089.stdout:6/682: mkdir db/d10/dc1/de4 0 2024-09-13T02:54:04.488 INFO:tasks.workunit.client.0.smithi089.stdout:0/643: symlink d2/d19/d1a/d1e/lda 0 2024-09-13T02:54:04.488 INFO:tasks.workunit.client.0.smithi089.stdout:0/644: chown d2/d19/d1a/d3d/d4b 63 1 2024-09-13T02:54:04.490 INFO:tasks.workunit.client.0.smithi089.stdout:0/645: link d2/d19/d1a/d1e/d42/f46 d2/d64/fdb 0 2024-09-13T02:54:04.490 INFO:tasks.workunit.client.0.smithi089.stdout:0/646: chown d2/d64/f9c 21731 1 2024-09-13T02:54:04.491 INFO:tasks.workunit.client.0.smithi089.stdout:0/647: rename d2/d19/d1a/d4e/d7a/f95 to d2/d19/d1a/d3d/d4b/d4f/fdc 0 2024-09-13T02:54:04.491 INFO:tasks.workunit.client.0.smithi089.stdout:0/648: readlink d2/d19/d1a/d1e/lad 0 2024-09-13T02:54:04.494 INFO:tasks.workunit.client.0.smithi089.stdout:0/649: rmdir d2/d19/d1a/d3d/d4b/d4f/d59/d6b/d87 39 2024-09-13T02:54:04.505 INFO:tasks.workunit.client.0.smithi089.stdout:4/778: dwrite d2/d22/f94 [0,4194304] 0 2024-09-13T02:54:04.506 INFO:tasks.workunit.client.0.smithi089.stdout:7/840: write d3/d19/d67/f80 [1176014,48761] 0 2024-09-13T02:54:04.508 INFO:tasks.workunit.client.0.smithi089.stdout:4/779: creat d2/d22/da1/d62/de8/f101 x:0 0 0 2024-09-13T02:54:04.508 INFO:tasks.workunit.client.0.smithi089.stdout:4/780: read - d2/d3/d5/d43/d3b/d71/d78/fd8 zero size 2024-09-13T02:54:04.508 INFO:tasks.workunit.client.0.smithi089.stdout:4/781: chown d2/d3/d5/d72/fcb 807 1 2024-09-13T02:54:04.508 INFO:tasks.workunit.client.0.smithi089.stdout:3/708: dread d2/d20/f28 [0,4194304] 0 2024-09-13T02:54:04.508 INFO:tasks.workunit.client.0.smithi089.stdout:7/841: mknod d3/d44/d85/c103 0 2024-09-13T02:54:04.509 INFO:tasks.workunit.client.0.smithi089.stdout:4/782: mknod d2/d3/d86/c102 0 2024-09-13T02:54:04.509 INFO:tasks.workunit.client.0.smithi089.stdout:3/709: mknod d2/d20/d23/d27/ddc/cdd 0 2024-09-13T02:54:04.510 INFO:tasks.workunit.client.0.smithi089.stdout:9/579: dwrite d3/d6/d2a/d94/d24/f69 [0,4194304] 0 2024-09-13T02:54:04.510 INFO:tasks.workunit.client.0.smithi089.stdout:4/783: link d2/d55/l8c d2/d55/l103 0 2024-09-13T02:54:04.511 INFO:tasks.workunit.client.0.smithi089.stdout:5/720: dwrite d1/d4/d45/d6f/f5f [0,4194304] 0 2024-09-13T02:54:04.511 INFO:tasks.workunit.client.0.smithi089.stdout:5/721: chown d1/d73/lbe 1033 1 2024-09-13T02:54:04.512 INFO:tasks.workunit.client.0.smithi089.stdout:2/646: dwrite d13/d30/d64/f6e [0,4194304] 0 2024-09-13T02:54:04.512 INFO:tasks.workunit.client.0.smithi089.stdout:8/745: dwrite de/d16/d1e/f83 [0,4194304] 0 2024-09-13T02:54:04.512 INFO:tasks.workunit.client.0.smithi089.stdout:8/746: dread - de/d16/d1e/d20/d6c/d6e/d7e/ffe zero size 2024-09-13T02:54:04.512 INFO:tasks.workunit.client.0.smithi089.stdout:7/842: read d3/d19/d75/f4a [1306100,16358] 0 2024-09-13T02:54:04.512 INFO:tasks.workunit.client.0.smithi089.stdout:3/710: symlink d2/d20/d23/d2b/lde 0 2024-09-13T02:54:04.513 INFO:tasks.workunit.client.0.smithi089.stdout:9/580: mkdir d3/d6/d36/d9d/db6 0 2024-09-13T02:54:04.516 INFO:tasks.workunit.client.0.smithi089.stdout:4/784: rename d2/d3/d5/d43/d3b/d71/d99/fc2 to d2/d22/da1/d62/d6c/d88/f104 0 2024-09-13T02:54:04.517 INFO:tasks.workunit.client.0.smithi089.stdout:4/785: chown d2/d22/da1/d62/d6c/ff9 504201151 1 2024-09-13T02:54:04.517 INFO:tasks.workunit.client.0.smithi089.stdout:6/683: dwrite db/d43/d6e/d28/d37/fc3 [0,4194304] 0 2024-09-13T02:54:04.517 INFO:tasks.workunit.client.0.smithi089.stdout:6/684: write db/f1d [5391675,95062] 0 2024-09-13T02:54:04.525 INFO:tasks.workunit.client.0.smithi089.stdout:2/647: unlink d13/f44 0 2024-09-13T02:54:04.530 INFO:tasks.workunit.client.0.smithi089.stdout:9/581: symlink d3/d6/d2a/d94/d24/lb7 0 2024-09-13T02:54:04.532 INFO:tasks.workunit.client.0.smithi089.stdout:5/722: dwrite d1/d4/d45/d6f/d4d/f7e [4194304,4194304] 0 2024-09-13T02:54:04.534 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:04 smithi089 ceph-mon[27639]: pgmap v244: 65 pgs: 65 active+clean; 1.8 GiB data, 7.0 GiB used, 529 GiB / 536 GiB avail; 179 MiB/s rd, 238 MiB/s wr, 369 op/s 2024-09-13T02:54:04.538 INFO:tasks.workunit.client.0.smithi089.stdout:8/747: dwrite de/d16/f1f [0,4194304] 0 2024-09-13T02:54:04.539 INFO:tasks.workunit.client.0.smithi089.stdout:6/685: link db/d43/d6e/d28/d37/f4e db/d43/d6e/d28/d37/d8b/dcd/fe5 0 2024-09-13T02:54:04.539 INFO:tasks.workunit.client.0.smithi089.stdout:6/686: read - db/d10/d3a/fd8 zero size 2024-09-13T02:54:04.539 INFO:tasks.workunit.client.0.smithi089.stdout:2/648: symlink d13/d30/d61/d78/d79/ddd/le2 0 2024-09-13T02:54:04.539 INFO:tasks.workunit.client.0.smithi089.stdout:2/649: fsync d13/d30/f95 0 2024-09-13T02:54:04.539 INFO:tasks.workunit.client.0.smithi089.stdout:6/687: fdatasync db/d43/d6e/d28/d46/d53/d83/fd0 0 2024-09-13T02:54:04.539 INFO:tasks.workunit.client.0.smithi089.stdout:2/650: dread - d13/d30/d61/f8a zero size 2024-09-13T02:54:04.541 INFO:tasks.workunit.client.0.smithi089.stdout:5/723: creat d1/d73/dcd/fe4 x:0 0 0 2024-09-13T02:54:04.541 INFO:tasks.workunit.client.0.smithi089.stdout:5/724: creat d1/d4/d45/d6f/d4d/d7f/d49/d5a/fe5 x:0 0 0 2024-09-13T02:54:04.543 INFO:tasks.workunit.client.0.smithi089.stdout:8/748: creat de/d16/d1e/d20/d39/df5/dff/d61/d8e/f103 x:0 0 0 2024-09-13T02:54:04.545 INFO:tasks.workunit.client.0.smithi089.stdout:7/843: dwrite d3/d20/f5d [4194304,4194304] 0 2024-09-13T02:54:04.546 INFO:tasks.workunit.client.0.smithi089.stdout:6/688: getdents db/d43/d6e/d28/d37/dc2 0 2024-09-13T02:54:04.546 INFO:tasks.workunit.client.0.smithi089.stdout:6/689: write db/d43/d6e/d28/d46/d53/f5a [4530698,59185] 0 2024-09-13T02:54:04.546 INFO:tasks.workunit.client.0.smithi089.stdout:6/690: readlink db/d43/d6e/d28/d2f/dc8/ld1 0 2024-09-13T02:54:04.547 INFO:tasks.workunit.client.0.smithi089.stdout:6/691: chown db/d43/d6e/d28/fe3 19604 1 2024-09-13T02:54:04.548 INFO:tasks.workunit.client.0.smithi089.stdout:2/651: mkdir d13/d30/d64/d82/db7/de3 0 2024-09-13T02:54:04.549 INFO:tasks.workunit.client.0.smithi089.stdout:5/725: read d1/d4/d45/d6f/d4d/d7f/d49/d5a/f94 [1783576,51504] 0 2024-09-13T02:54:04.549 INFO:tasks.workunit.client.0.smithi089.stdout:5/726: truncate d1/f47 4895255 0 2024-09-13T02:54:04.549 INFO:tasks.workunit.client.0.smithi089.stdout:5/727: chown d1/d4/d45/d6f/d7c 62 1 2024-09-13T02:54:04.549 INFO:tasks.workunit.client.0.smithi089.stdout:9/582: rename d3/d3d/c89 to d3/d6/cb8 0 2024-09-13T02:54:04.552 INFO:tasks.workunit.client.0.smithi089.stdout:2/652: write d13/f89 [4035837,15094] 0 2024-09-13T02:54:04.553 INFO:tasks.workunit.client.0.smithi089.stdout:6/692: symlink db/d43/d6e/d28/d37/le6 0 2024-09-13T02:54:04.560 INFO:tasks.workunit.client.0.smithi089.stdout:8/749: rename de/d56/fc6 to de/d16/d1e/d20/d6c/d6e/d7e/db7/f104 0 2024-09-13T02:54:04.560 INFO:tasks.workunit.client.0.smithi089.stdout:5/728: rename d1/d4 to d1/d4/de6 22 2024-09-13T02:54:04.563 INFO:tasks.workunit.client.0.smithi089.stdout:6/693: creat db/d43/d6e/d28/d46/d53/d83/d9f/de0/fe7 x:0 0 0 2024-09-13T02:54:04.563 INFO:tasks.workunit.client.0.smithi089.stdout:6/694: chown db/d43/d6e/d28/d37/fa3 98 1 2024-09-13T02:54:04.566 INFO:tasks.workunit.client.0.smithi089.stdout:2/653: rename d13/d30/d4e/d6f/fcb to d13/d30/d61/d78/d79/fe4 0 2024-09-13T02:54:04.566 INFO:tasks.workunit.client.0.smithi089.stdout:2/654: chown d13/d30/d61/c66 64198 1 2024-09-13T02:54:04.566 INFO:tasks.workunit.client.0.smithi089.stdout:2/655: readlink d13/d30/d4e/d7b/d86/lce 0 2024-09-13T02:54:04.566 INFO:tasks.workunit.client.0.smithi089.stdout:2/656: fdatasync d13/d30/d64/f6e 0 2024-09-13T02:54:04.567 INFO:tasks.workunit.client.0.smithi089.stdout:8/750: link de/d16/d1e/d20/d39/cbe de/d16/d1e/d27/d76/d8d/c105 0 2024-09-13T02:54:04.568 INFO:tasks.workunit.client.0.smithi089.stdout:9/583: dwrite d3/d6/d2a/d4b/f9c [0,4194304] 0 2024-09-13T02:54:04.568 INFO:tasks.workunit.client.0.smithi089.stdout:6/695: creat db/d43/d6e/d28/d37/d8b/dcd/d7d/fe8 x:0 0 0 2024-09-13T02:54:04.569 INFO:tasks.workunit.client.0.smithi089.stdout:2/657: creat d13/da9/fe5 x:0 0 0 2024-09-13T02:54:04.572 INFO:tasks.workunit.client.0.smithi089.stdout:2/658: getdents d13/d30/d64 0 2024-09-13T02:54:04.573 INFO:tasks.workunit.client.0.smithi089.stdout:5/729: write d1/f69 [669263,14886] 0 2024-09-13T02:54:04.573 INFO:tasks.workunit.client.0.smithi089.stdout:5/730: chown d1/f78 123 1 2024-09-13T02:54:04.573 INFO:tasks.workunit.client.0.smithi089.stdout:9/584: rename d3/d6/l64 to d3/d15/lb9 0 2024-09-13T02:54:04.574 INFO:tasks.workunit.client.0.smithi089.stdout:2/659: rmdir d13/d30/d4e/d7b/d86 39 2024-09-13T02:54:04.577 INFO:tasks.workunit.client.0.smithi089.stdout:9/585: mkdir d3/d3d/d8b/dba 0 2024-09-13T02:54:04.578 INFO:tasks.workunit.client.0.smithi089.stdout:2/660: mkdir d13/d30/d4e/d6f/d76/de6 0 2024-09-13T02:54:04.578 INFO:tasks.workunit.client.0.smithi089.stdout:2/661: chown d13/d30/d4e/d7b/d86/l97 3354 1 2024-09-13T02:54:04.578 INFO:tasks.workunit.client.0.smithi089.stdout:2/662: write d13/d30/d4e/d6f/d76/fdc [11019,51396] 0 2024-09-13T02:54:04.580 INFO:tasks.workunit.client.0.smithi089.stdout:5/731: dread d1/d4/d45/d6f/d4d/d7f/d49/fbc [0,4194304] 0 2024-09-13T02:54:04.583 INFO:tasks.workunit.client.0.smithi089.stdout:5/732: truncate d1/d4/d45/d8c/d98/fb9 38848 0 2024-09-13T02:54:04.583 INFO:tasks.workunit.client.0.smithi089.stdout:5/733: chown d1/d4/d45/d6f/d4d/d7f/f96 586 1 2024-09-13T02:54:04.584 INFO:tasks.workunit.client.0.smithi089.stdout:8/751: dwrite de/d16/d1e/d20/d39/df5/dff/d61/d8e/fb5 [0,4194304] 0 2024-09-13T02:54:04.584 INFO:tasks.workunit.client.0.smithi089.stdout:8/752: write de/d16/f1c [1466320,98475] 0 2024-09-13T02:54:04.584 INFO:tasks.workunit.client.0.smithi089.stdout:8/753: write de/d16/d1e/d27/d76/d8d/fd5 [115057,86006] 0 2024-09-13T02:54:04.584 INFO:tasks.workunit.client.0.smithi089.stdout:8/754: fsync de/d16/d1e/d3f/fdf 0 2024-09-13T02:54:04.584 INFO:tasks.workunit.client.0.smithi089.stdout:5/734: mknod d1/d4/d45/d6f/d7c/ce7 0 2024-09-13T02:54:04.587 INFO:tasks.workunit.client.0.smithi089.stdout:5/735: dread d1/d4/d2b/f2e [0,4194304] 0 2024-09-13T02:54:04.588 INFO:tasks.workunit.client.0.smithi089.stdout:8/755: mkdir de/d16/d1e/d3f/d106 0 2024-09-13T02:54:04.588 INFO:tasks.workunit.client.0.smithi089.stdout:8/756: write de/d16/d1e/d20/d39/df5/dff/d61/f95 [432906,30440] 0 2024-09-13T02:54:04.589 INFO:tasks.workunit.client.0.smithi089.stdout:8/757: symlink de/d16/d1e/d20/d39/df5/l107 0 2024-09-13T02:54:04.593 INFO:tasks.workunit.client.0.smithi089.stdout:0/650: sync 2024-09-13T02:54:04.593 INFO:tasks.workunit.client.0.smithi089.stdout:1/653: sync 2024-09-13T02:54:04.595 INFO:tasks.workunit.client.0.smithi089.stdout:0/651: unlink d2/d19/d1a/d3d/d4b/l60 0 2024-09-13T02:54:04.600 INFO:tasks.workunit.client.0.smithi089.stdout:8/758: write de/d16/d1e/d20/d39/df5/dff/d61/f94 [4183621,93197] 0 2024-09-13T02:54:04.600 INFO:tasks.workunit.client.0.smithi089.stdout:6/696: rename db/d43/d6e/d28/d46 to db/d10/de9 0 2024-09-13T02:54:04.600 INFO:tasks.workunit.client.0.smithi089.stdout:8/759: rmdir de/d16/d1e/d20/d39/df5/dff/d61 39 2024-09-13T02:54:04.604 INFO:tasks.workunit.client.0.smithi089.stdout:9/586: rename d3/l8f to d3/d6/d2a/d94/lbb 0 2024-09-13T02:54:04.606 INFO:tasks.workunit.client.0.smithi089.stdout:9/587: rmdir d3/d6/d2a 39 2024-09-13T02:54:04.607 INFO:tasks.workunit.client.0.smithi089.stdout:8/760: dread de/d16/d1e/d3f/f73 [0,4194304] 0 2024-09-13T02:54:04.611 INFO:tasks.workunit.client.0.smithi089.stdout:6/697: write db/d43/d6e/d28/d2f/f50 [1213973,43582] 0 2024-09-13T02:54:04.611 INFO:tasks.workunit.client.0.smithi089.stdout:6/698: chown db/d43/d6e/d28/fbd 52 1 2024-09-13T02:54:04.612 INFO:tasks.workunit.client.0.smithi089.stdout:6/699: creat db/d43/fea x:0 0 0 2024-09-13T02:54:04.612 INFO:tasks.workunit.client.0.smithi089.stdout:8/761: rename de/d16/d1e/d27/d35/d91 to de/d16/d1e/d20/d39/df5/dff/d61/d8e/d108 0 2024-09-13T02:54:04.612 INFO:tasks.workunit.client.0.smithi089.stdout:8/762: fdatasync de/d16/d1e/d20/f6a 0 2024-09-13T02:54:04.613 INFO:tasks.workunit.client.0.smithi089.stdout:6/700: symlink db/d10/de9/d53/d83/d9f/leb 0 2024-09-13T02:54:04.614 INFO:tasks.workunit.client.0.smithi089.stdout:6/701: dread - db/d10/de9/d53/fa7 zero size 2024-09-13T02:54:04.614 INFO:tasks.workunit.client.0.smithi089.stdout:8/763: unlink de/d16/le4 0 2024-09-13T02:54:04.614 INFO:tasks.workunit.client.0.smithi089.stdout:8/764: fsync de/d16/d1e/f2a 0 2024-09-13T02:54:04.615 INFO:tasks.workunit.client.0.smithi089.stdout:3/711: sync 2024-09-13T02:54:04.615 INFO:tasks.workunit.client.0.smithi089.stdout:8/765: dread de/d16/d1e/d20/f6a [0,4194304] 0 2024-09-13T02:54:04.616 INFO:tasks.workunit.client.0.smithi089.stdout:8/766: dread de/d16/d1e/d67/f7a [0,4194304] 0 2024-09-13T02:54:04.616 INFO:tasks.workunit.client.0.smithi089.stdout:8/767: write de/d16/d1e/d3f/f73 [1918649,115329] 0 2024-09-13T02:54:04.621 INFO:tasks.workunit.client.0.smithi089.stdout:6/702: dread db/d43/d6e/d28/d37/fa3 [0,4194304] 0 2024-09-13T02:54:04.629 INFO:tasks.workunit.client.0.smithi089.stdout:6/703: dread db/d10/d3a/f47 [0,4194304] 0 2024-09-13T02:54:04.639 INFO:tasks.workunit.client.0.smithi089.stdout:5/736: dwrite d1/d4/d45/d6f/d62/f8a [4194304,4194304] 0 2024-09-13T02:54:04.645 INFO:tasks.workunit.client.0.smithi089.stdout:6/704: dread db/d43/d6e/d28/d37/f4e [0,4194304] 0 2024-09-13T02:54:04.646 INFO:tasks.workunit.client.0.smithi089.stdout:8/768: dread de/d16/d1e/d27/d76/f89 [0,4194304] 0 2024-09-13T02:54:04.647 INFO:tasks.workunit.client.0.smithi089.stdout:6/705: link db/d10/d3a/f81 db/dd2/fec 0 2024-09-13T02:54:04.647 INFO:tasks.workunit.client.0.smithi089.stdout:6/706: chown db/d10/d3a/c65 160818 1 2024-09-13T02:54:04.648 INFO:tasks.workunit.client.0.smithi089.stdout:0/652: dwrite d2/d19/d1a/d3d/d4b/fca [0,4194304] 0 2024-09-13T02:54:04.650 INFO:tasks.workunit.client.0.smithi089.stdout:8/769: mkdir de/d16/d1e/d20/d39/df5/dff/d61/d8e/d109 0 2024-09-13T02:54:04.652 INFO:tasks.workunit.client.0.smithi089.stdout:6/707: rmdir db/db2 39 2024-09-13T02:54:04.652 INFO:tasks.workunit.client.0.smithi089.stdout:6/708: chown db/d43/d6e/d28/d37/d8b/dcd/d7d/lbe 43301 1 2024-09-13T02:54:04.661 INFO:tasks.workunit.client.0.smithi089.stdout:7/844: sync 2024-09-13T02:54:04.661 INFO:tasks.workunit.client.0.smithi089.stdout:4/786: sync 2024-09-13T02:54:04.662 INFO:tasks.workunit.client.0.smithi089.stdout:7/845: truncate d3/d19/d75/d63/da1/db4/dd3/ff1 1537427 0 2024-09-13T02:54:04.662 INFO:tasks.workunit.client.0.smithi089.stdout:7/846: dread - d3/d19/d2e/ff6 zero size 2024-09-13T02:54:04.664 INFO:tasks.workunit.client.0.smithi089.stdout:4/787: mkdir d2/d3/d5/d43/d3b/d71/d99/daf/d105 0 2024-09-13T02:54:04.665 INFO:tasks.workunit.client.0.smithi089.stdout:5/737: dwrite d1/d4/d45/d6f/d62/fd4 [0,4194304] 0 2024-09-13T02:54:04.665 INFO:tasks.workunit.client.0.smithi089.stdout:8/770: write de/f22 [1577394,118690] 0 2024-09-13T02:54:04.665 INFO:tasks.workunit.client.0.smithi089.stdout:7/847: symlink d3/d19/l104 0 2024-09-13T02:54:04.665 INFO:tasks.workunit.client.0.smithi089.stdout:5/738: stat d1/d4/d45/d6f/d4d/d7f/c5c 0 2024-09-13T02:54:04.665 INFO:tasks.workunit.client.0.smithi089.stdout:5/739: readlink d1/d4/d45/d6f/lb4 0 2024-09-13T02:54:04.666 INFO:tasks.workunit.client.0.smithi089.stdout:4/788: mknod d2/d3/d5/d43/d84/df1/c106 0 2024-09-13T02:54:04.666 INFO:tasks.workunit.client.0.smithi089.stdout:4/789: chown d2/d3/d5/d43/d3b/d71/d99/daf/dc6/ffc 291676372 1 2024-09-13T02:54:04.666 INFO:tasks.workunit.client.0.smithi089.stdout:4/790: readlink d2/d3/d5/d43/d3b/d71/d99/daf/d8f/lcc 0 2024-09-13T02:54:04.667 INFO:tasks.workunit.client.0.smithi089.stdout:0/653: write d2/f26 [3201427,18944] 0 2024-09-13T02:54:04.667 INFO:tasks.workunit.client.0.smithi089.stdout:0/654: readlink d2/d19/d1a/d4e/lae 0 2024-09-13T02:54:04.668 INFO:tasks.workunit.client.0.smithi089.stdout:7/848: mkdir d3/d19/d75/db2/d105 0 2024-09-13T02:54:04.668 INFO:tasks.workunit.client.0.smithi089.stdout:7/849: chown d3/ld 1 1 2024-09-13T02:54:04.668 INFO:tasks.workunit.client.0.smithi089.stdout:7/850: creat d3/d44/d85/d77/f106 x:0 0 0 2024-09-13T02:54:04.668 INFO:tasks.workunit.client.0.smithi089.stdout:4/791: getdents d2/d3/d86/dfd/dbf 0 2024-09-13T02:54:04.668 INFO:tasks.workunit.client.0.smithi089.stdout:4/792: chown d2/d22/da1/d62/d6c/d88/fa7 6116 1 2024-09-13T02:54:04.668 INFO:tasks.workunit.client.0.smithi089.stdout:8/771: symlink de/d16/d1e/d20/l10a 0 2024-09-13T02:54:04.669 INFO:tasks.workunit.client.0.smithi089.stdout:5/740: dread d1/d4/d45/d8c/fa0 [0,4194304] 0 2024-09-13T02:54:04.669 INFO:tasks.workunit.client.0.smithi089.stdout:5/741: getdents d1/d4/d45/d8c 0 2024-09-13T02:54:04.671 INFO:tasks.workunit.client.0.smithi089.stdout:4/793: mknod d2/d22/da1/d62/d6c/d88/db2/df2/c107 0 2024-09-13T02:54:04.671 INFO:tasks.workunit.client.0.smithi089.stdout:4/794: chown d2/d3/d86/dfd/cfa 718448 1 2024-09-13T02:54:04.671 INFO:tasks.workunit.client.0.smithi089.stdout:4/795: stat d2/d3/d5/f70 0 2024-09-13T02:54:04.671 INFO:tasks.workunit.client.0.smithi089.stdout:6/709: write db/d43/d6e/d28/d37/fc3 [145603,21536] 0 2024-09-13T02:54:04.672 INFO:tasks.workunit.client.0.smithi089.stdout:6/710: read db/d43/d6e/d28/d37/d8b/fa9 [153632,67732] 0 2024-09-13T02:54:04.672 INFO:tasks.workunit.client.0.smithi089.stdout:6/711: write db/d10/d3a/f42 [834617,123882] 0 2024-09-13T02:54:04.672 INFO:tasks.workunit.client.0.smithi089.stdout:8/772: link de/d16/d1e/f83 de/d16/d1e/d20/d39/df5/dff/d61/d8e/d109/f10b 0 2024-09-13T02:54:04.673 INFO:tasks.workunit.client.0.smithi089.stdout:5/742: creat d1/fe8 x:0 0 0 2024-09-13T02:54:04.675 INFO:tasks.workunit.client.0.smithi089.stdout:0/655: rename d2/l75 to d2/d64/ldd 0 2024-09-13T02:54:04.677 INFO:tasks.workunit.client.0.smithi089.stdout:6/712: truncate db/d43/d6e/d28/d37/f4e 1834531 0 2024-09-13T02:54:04.678 INFO:tasks.workunit.client.0.smithi089.stdout:5/743: mknod d1/d4/ddb/ce9 0 2024-09-13T02:54:04.678 INFO:tasks.workunit.client.0.smithi089.stdout:5/744: stat d1/d4/d45/d6f/d4d/d7f/d49/d5a/fa7 0 2024-09-13T02:54:04.680 INFO:tasks.workunit.client.0.smithi089.stdout:0/656: link d2/d19/d1a/d1e/d42/l68 d2/d19/d1a/lde 0 2024-09-13T02:54:04.682 INFO:tasks.workunit.client.0.smithi089.stdout:4/796: dread d2/d22/f9b [0,4194304] 0 2024-09-13T02:54:04.682 INFO:tasks.workunit.client.0.smithi089.stdout:5/745: dread d1/d4/d45/d8c/d98/fb9 [0,4194304] 0 2024-09-13T02:54:04.682 INFO:tasks.workunit.client.0.smithi089.stdout:6/713: mkdir db/d43/d6e/d28/d2f/d9b/ded 0 2024-09-13T02:54:04.683 INFO:tasks.workunit.client.0.smithi089.stdout:7/851: rename d3/d19/d75/d63 to d3/d44/d85/d77/d107 0 2024-09-13T02:54:04.683 INFO:tasks.workunit.client.0.smithi089.stdout:7/852: getdents d3/d19/d2e/de6 0 2024-09-13T02:54:04.684 INFO:tasks.workunit.client.0.smithi089.stdout:0/657: write d2/f48 [4197522,22491] 0 2024-09-13T02:54:04.684 INFO:tasks.workunit.client.0.smithi089.stdout:0/658: dread - d2/d19/d1a/d4e/f79 zero size 2024-09-13T02:54:04.685 INFO:tasks.workunit.client.0.smithi089.stdout:5/746: unlink d1/d4/d45/d6f/d4d/d7f/d49/fbc 0 2024-09-13T02:54:04.685 INFO:tasks.workunit.client.0.smithi089.stdout:5/747: stat d1/d4/d45/d6f/d4d/d7f/c3c 0 2024-09-13T02:54:04.686 INFO:tasks.workunit.client.0.smithi089.stdout:5/748: write d1/d4/d45/d6f/d4d/d7f/d49/dc8/fca [449335,63970] 0 2024-09-13T02:54:04.686 INFO:tasks.workunit.client.0.smithi089.stdout:6/714: symlink db/d43/d6e/d28/d2f/d9b/lee 0 2024-09-13T02:54:04.686 INFO:tasks.workunit.client.0.smithi089.stdout:6/715: write db/d10/de9/d53/f94 [46431,25217] 0 2024-09-13T02:54:04.686 INFO:tasks.workunit.client.0.smithi089.stdout:6/716: fdatasync db/d43/d6e/d28/d37/d8b/dcd/d74/f98 0 2024-09-13T02:54:04.687 INFO:tasks.workunit.client.0.smithi089.stdout:4/797: rename d2/d3/fe9 to d2/d3/d5/d43/d84/f108 0 2024-09-13T02:54:04.688 INFO:tasks.workunit.client.0.smithi089.stdout:0/659: mkdir d2/d19/d1a/d3d/d4b/ddf 0 2024-09-13T02:54:04.688 INFO:tasks.workunit.client.0.smithi089.stdout:6/717: stat db/d43/d6e/d28/d37/d8b/dcd/d7d/l8f 0 2024-09-13T02:54:04.688 INFO:tasks.workunit.client.0.smithi089.stdout:6/718: chown db/d10/d3a/l9e 213506 1 2024-09-13T02:54:04.689 INFO:tasks.workunit.client.0.smithi089.stdout:0/660: mkdir d2/d64/db3/de0 0 2024-09-13T02:54:04.689 INFO:tasks.workunit.client.0.smithi089.stdout:6/719: mknod db/d43/cef 0 2024-09-13T02:54:04.690 INFO:tasks.workunit.client.0.smithi089.stdout:6/720: write db/d10/d3a/fd8 [990936,66370] 0 2024-09-13T02:54:04.691 INFO:tasks.workunit.client.0.smithi089.stdout:0/661: creat d2/fe1 x:0 0 0 2024-09-13T02:54:04.692 INFO:tasks.workunit.client.0.smithi089.stdout:8/773: dwrite de/d56/ff1 [0,4194304] 0 2024-09-13T02:54:04.692 INFO:tasks.workunit.client.0.smithi089.stdout:8/774: write de/d16/d1e/d3f/fa2 [538994,62133] 0 2024-09-13T02:54:04.692 INFO:tasks.workunit.client.0.smithi089.stdout:6/721: rename db/d43/d6e/d28/d37/d8b/dcd/d74 to db/d10/de9/d53/d83/ddc/df0 0 2024-09-13T02:54:04.694 INFO:tasks.workunit.client.0.smithi089.stdout:0/662: mknod d2/d64/db3/de0/ce2 0 2024-09-13T02:54:04.697 INFO:tasks.workunit.client.0.smithi089.stdout:7/853: write d3/d19/d75/f12 [5810097,110702] 0 2024-09-13T02:54:04.698 INFO:tasks.workunit.client.0.smithi089.stdout:0/663: dread d2/d19/d1a/d1e/d42/f74 [0,4194304] 0 2024-09-13T02:54:04.698 INFO:tasks.workunit.client.0.smithi089.stdout:0/664: write d2/d19/d1a/d3d/d4b/d4f/d59/f94 [686544,34286] 0 2024-09-13T02:54:04.698 INFO:tasks.workunit.client.0.smithi089.stdout:0/665: write d2/d19/d1a/d3d/d4b/d4f/fdc [543494,54185] 0 2024-09-13T02:54:04.706 INFO:tasks.workunit.client.0.smithi089.stdout:8/775: creat de/d16/d1e/d3f/f10c x:0 0 0 2024-09-13T02:54:04.707 INFO:tasks.workunit.client.0.smithi089.stdout:6/722: getdents db/d10/de9/d53/d83/d9f/de0 0 2024-09-13T02:54:04.708 INFO:tasks.workunit.client.0.smithi089.stdout:7/854: mkdir d3/d44/d85/d77/d108 0 2024-09-13T02:54:04.709 INFO:tasks.workunit.client.0.smithi089.stdout:0/666: truncate d2/d19/d1a/d3d/d4b/d4f/f6d 2385913 0 2024-09-13T02:54:04.711 INFO:tasks.workunit.client.0.smithi089.stdout:6/723: creat db/db2/ff1 x:0 0 0 2024-09-13T02:54:04.713 INFO:tasks.workunit.client.0.smithi089.stdout:4/798: dwrite d2/d3/d86/ff6 [0,4194304] 0 2024-09-13T02:54:04.714 INFO:tasks.workunit.client.0.smithi089.stdout:5/749: dwrite d1/d4/d45/f82 [4194304,4194304] 0 2024-09-13T02:54:04.715 INFO:tasks.workunit.client.0.smithi089.stdout:6/724: mkdir db/d43/d6e/d28/d2f/dc8/df2 0 2024-09-13T02:54:04.715 INFO:tasks.workunit.client.0.smithi089.stdout:6/725: chown db/d43/d6e/d28/d2f/dc8/df2 8620907 1 2024-09-13T02:54:04.715 INFO:tasks.workunit.client.0.smithi089.stdout:6/726: getdents db/d10/de9 0 2024-09-13T02:54:04.717 INFO:tasks.workunit.client.0.smithi089.stdout:4/799: dread d2/d3/d5/d43/d3b/fd2 [0,4194304] 0 2024-09-13T02:54:04.719 INFO:tasks.workunit.client.0.smithi089.stdout:7/855: dread d3/d19/d2e/f6e [0,4194304] 0 2024-09-13T02:54:04.720 INFO:tasks.workunit.client.0.smithi089.stdout:9/588: sync 2024-09-13T02:54:04.720 INFO:tasks.workunit.client.0.smithi089.stdout:3/712: sync 2024-09-13T02:54:04.720 INFO:tasks.workunit.client.0.smithi089.stdout:2/663: sync 2024-09-13T02:54:04.720 INFO:tasks.workunit.client.0.smithi089.stdout:1/654: sync 2024-09-13T02:54:04.720 INFO:tasks.workunit.client.0.smithi089.stdout:1/655: chown dc/d3a/d53/d2c/d34/f78 5657 1 2024-09-13T02:54:04.721 INFO:tasks.workunit.client.0.smithi089.stdout:6/727: unlink db/d43/d6e/d28/d37/f4e 0 2024-09-13T02:54:04.724 INFO:tasks.workunit.client.0.smithi089.stdout:7/856: mkdir d3/d19/d2e/d37/dad/d109 0 2024-09-13T02:54:04.724 INFO:tasks.workunit.client.0.smithi089.stdout:7/857: fsync d3/d19/d75/d14/da0/db0/fe3 0 2024-09-13T02:54:04.724 INFO:tasks.workunit.client.0.smithi089.stdout:7/858: read d3/d19/d75/db2/fd9 [3040170,88213] 0 2024-09-13T02:54:04.724 INFO:tasks.workunit.client.0.smithi089.stdout:8/776: dread de/d16/d1e/d20/d39/df5/dff/d61/d8e/f90 [0,4194304] 0 2024-09-13T02:54:04.725 INFO:tasks.workunit.client.0.smithi089.stdout:2/664: rename d13/d30/d64/d82 to d13/d30/d61/d78/dd3/de7 0 2024-09-13T02:54:04.727 INFO:tasks.workunit.client.0.smithi089.stdout:4/800: write d2/fca [934148,67110] 0 2024-09-13T02:54:04.727 INFO:tasks.workunit.client.0.smithi089.stdout:6/728: link db/d43/c97 db/d43/d6e/d28/cf3 0 2024-09-13T02:54:04.728 INFO:tasks.workunit.client.0.smithi089.stdout:7/859: truncate d3/d44/d85/fc1 3050439 0 2024-09-13T02:54:04.730 INFO:tasks.workunit.client.0.smithi089.stdout:1/656: dread dc/d3a/d53/f7d [0,4194304] 0 2024-09-13T02:54:04.730 INFO:tasks.workunit.client.0.smithi089.stdout:1/657: creat dc/d3a/d53/d2c/d94/fcf x:0 0 0 2024-09-13T02:54:04.735 INFO:tasks.workunit.client.0.smithi089.stdout:8/777: creat de/d16/d1e/d20/d39/df5/dff/d61/d8e/d109/f10d x:0 0 0 2024-09-13T02:54:04.735 INFO:tasks.workunit.client.0.smithi089.stdout:4/801: mknod d2/d3/d5/d43/c109 0 2024-09-13T02:54:04.735 INFO:tasks.workunit.client.0.smithi089.stdout:4/802: readlink d2/l9e 0 2024-09-13T02:54:04.735 INFO:tasks.workunit.client.0.smithi089.stdout:4/803: chown d2/d22/da1/d62/d6c/ff9 1 1 2024-09-13T02:54:04.735 INFO:tasks.workunit.client.0.smithi089.stdout:6/729: mkdir db/d10/de9/d7e/da1/df4 0 2024-09-13T02:54:04.736 INFO:tasks.workunit.client.0.smithi089.stdout:7/860: symlink d3/d19/d75/dbf/l10a 0 2024-09-13T02:54:04.736 INFO:tasks.workunit.client.0.smithi089.stdout:5/750: dwrite d1/d7/f19 [0,4194304] 0 2024-09-13T02:54:04.737 INFO:tasks.workunit.client.0.smithi089.stdout:8/778: creat de/d16/f10e x:0 0 0 2024-09-13T02:54:04.738 INFO:tasks.workunit.client.0.smithi089.stdout:4/804: creat d2/d3/d5/f10a x:0 0 0 2024-09-13T02:54:04.738 INFO:tasks.workunit.client.0.smithi089.stdout:2/665: dread d13/f3b [0,4194304] 0 2024-09-13T02:54:04.738 INFO:tasks.workunit.client.0.smithi089.stdout:2/666: stat d13/d30/d61/d78/d79/f85 0 2024-09-13T02:54:04.739 INFO:tasks.workunit.client.0.smithi089.stdout:7/861: mkdir d3/d19/d75/d14/d71/d10b 0 2024-09-13T02:54:04.740 INFO:tasks.workunit.client.0.smithi089.stdout:5/751: link d1/d4/ld0 d1/d4/d45/d6f/lea 0 2024-09-13T02:54:04.740 INFO:tasks.workunit.client.0.smithi089.stdout:5/752: chown d1/d4/d45/d6f/d4d/d7f/cb0 963966044 1 2024-09-13T02:54:04.741 INFO:tasks.workunit.client.0.smithi089.stdout:5/753: fdatasync d1/d7/f68 0 2024-09-13T02:54:04.744 INFO:tasks.workunit.client.0.smithi089.stdout:9/589: dwrite d3/d3d/f97 [0,4194304] 0 2024-09-13T02:54:04.744 INFO:tasks.workunit.client.0.smithi089.stdout:9/590: chown d3/d6/d2a 951 1 2024-09-13T02:54:04.745 INFO:tasks.workunit.client.0.smithi089.stdout:5/754: unlink d1/d4/d45/d6f/l29 0 2024-09-13T02:54:04.747 INFO:tasks.workunit.client.0.smithi089.stdout:7/862: rmdir d3/d19/d2e/d37 39 2024-09-13T02:54:04.752 INFO:tasks.workunit.client.0.smithi089.stdout:8/779: rename de/d16/d1e/d20/d6c/d6e/d7e/db7 to de/d16/d1e/d20/d6c/d10f 0 2024-09-13T02:54:04.752 INFO:tasks.workunit.client.0.smithi089.stdout:8/780: creat de/d16/d1e/d20/d6c/d6e/d7e/f110 x:0 0 0 2024-09-13T02:54:04.758 INFO:tasks.workunit.client.0.smithi089.stdout:8/781: creat de/d16/d1e/d20/d6c/d10f/f111 x:0 0 0 2024-09-13T02:54:04.760 INFO:tasks.workunit.client.0.smithi089.stdout:7/863: getdents d3/d44/d85/d5e 0 2024-09-13T02:54:04.760 INFO:tasks.workunit.client.0.smithi089.stdout:7/864: chown d3/d19/d2e/f88 7 1 2024-09-13T02:54:04.761 INFO:tasks.workunit.client.0.smithi089.stdout:7/865: creat d3/d19/d2e/de6/f10c x:0 0 0 2024-09-13T02:54:04.762 INFO:tasks.workunit.client.0.smithi089.stdout:7/866: creat d3/d44/d85/d77/d107/ddd/f10d x:0 0 0 2024-09-13T02:54:04.767 INFO:tasks.workunit.client.0.smithi089.stdout:8/782: write de/d16/d1e/d20/d39/df5/dff/d61/d8e/fa6 [2372719,33977] 0 2024-09-13T02:54:04.767 INFO:tasks.workunit.client.0.smithi089.stdout:8/783: truncate de/f57 29179 0 2024-09-13T02:54:04.767 INFO:tasks.workunit.client.0.smithi089.stdout:4/805: dwrite d2/d3/d5/f42 [4194304,4194304] 0 2024-09-13T02:54:04.769 INFO:tasks.workunit.client.0.smithi089.stdout:8/784: rename de/d16/d1e/d27/d76/d8d/fca to de/d16/d1e/d20/d6c/d10f/f112 0 2024-09-13T02:54:04.772 INFO:tasks.workunit.client.0.smithi089.stdout:2/667: dwrite d13/d30/d4e/d6f/d76/fb8 [0,4194304] 0 2024-09-13T02:54:04.772 INFO:tasks.workunit.client.0.smithi089.stdout:6/730: dwrite db/d10/f11 [4194304,4194304] 0 2024-09-13T02:54:04.772 INFO:tasks.workunit.client.0.smithi089.stdout:8/785: mknod de/dc1/c113 0 2024-09-13T02:54:04.772 INFO:tasks.workunit.client.0.smithi089.stdout:8/786: dread - de/d16/d1e/d27/d76/ff8 zero size 2024-09-13T02:54:04.772 INFO:tasks.workunit.client.0.smithi089.stdout:8/787: stat de/d16/d1e/d20/d39/df5/dff/dc2 0 2024-09-13T02:54:04.772 INFO:tasks.workunit.client.0.smithi089.stdout:8/788: dread - de/d16/d1e/d27/d76/fed zero size 2024-09-13T02:54:04.777 INFO:tasks.workunit.client.0.smithi089.stdout:2/668: mknod d13/d30/d59/dbe/ce8 0 2024-09-13T02:54:04.777 INFO:tasks.workunit.client.0.smithi089.stdout:7/867: getdents d3/d19/d2e/de6 0 2024-09-13T02:54:04.781 INFO:tasks.workunit.client.0.smithi089.stdout:6/731: symlink db/d43/d6e/d28/d2f/dc8/lf5 0 2024-09-13T02:54:04.781 INFO:tasks.workunit.client.0.smithi089.stdout:6/732: write db/d43/d6e/d28/d2f/d9b/fb3 [527977,14039] 0 2024-09-13T02:54:04.782 INFO:tasks.workunit.client.0.smithi089.stdout:8/789: truncate de/d16/d1e/d20/d39/df5/dff/d61/f95 110330 0 2024-09-13T02:54:04.782 INFO:tasks.workunit.client.0.smithi089.stdout:8/790: write de/d16/d1e/d67/f7f [4209257,63324] 0 2024-09-13T02:54:04.785 INFO:tasks.workunit.client.0.smithi089.stdout:7/868: symlink d3/d44/d85/d77/d107/da1/db4/l10e 0 2024-09-13T02:54:04.785 INFO:tasks.workunit.client.0.smithi089.stdout:4/806: dwrite d2/d3/d5/f42 [0,4194304] 0 2024-09-13T02:54:04.785 INFO:tasks.workunit.client.0.smithi089.stdout:4/807: dread - d2/d22/fa6 zero size 2024-09-13T02:54:04.786 INFO:tasks.workunit.client.0.smithi089.stdout:8/791: creat de/d16/d1e/d20/d6c/d10f/f114 x:0 0 0 2024-09-13T02:54:04.788 INFO:tasks.workunit.client.0.smithi089.stdout:4/808: link d2/d22/f34 d2/d3/d5/d43/d84/df1/f10b 0 2024-09-13T02:54:04.821 INFO:tasks.workunit.client.0.smithi089.stdout:7/869: dwrite d3/d44/d85/d77/d107/ddd/feb [0,4194304] 0 2024-09-13T02:54:04.821 INFO:tasks.workunit.client.0.smithi089.stdout:8/792: dwrite de/d16/d1e/f21 [0,4194304] 0 2024-09-13T02:54:04.821 INFO:tasks.workunit.client.0.smithi089.stdout:8/793: dread - de/d16/d1e/d27/d35/f5a zero size 2024-09-13T02:54:04.821 INFO:tasks.workunit.client.0.smithi089.stdout:2/669: dwrite d13/d30/d4e/d6f/d76/fb8 [0,4194304] 0 2024-09-13T02:54:04.821 INFO:tasks.workunit.client.0.smithi089.stdout:8/794: write de/d16/d1e/dc7/fcc [458358,87556] 0 2024-09-13T02:54:04.821 INFO:tasks.workunit.client.0.smithi089.stdout:8/795: dread - de/d16/d1e/d3f/d71/fc0 zero size 2024-09-13T02:54:04.821 INFO:tasks.workunit.client.0.smithi089.stdout:8/796: read de/d16/f85 [268348,31874] 0 2024-09-13T02:54:04.821 INFO:tasks.workunit.client.0.smithi089.stdout:4/809: dwrite d2/da/f75 [0,4194304] 0 2024-09-13T02:54:04.821 INFO:tasks.workunit.client.0.smithi089.stdout:4/810: truncate d2/d3/d86/fbb 532846 0 2024-09-13T02:54:04.821 INFO:tasks.workunit.client.0.smithi089.stdout:7/870: truncate d3/f5 6566391 0 2024-09-13T02:54:04.825 INFO:tasks.workunit.client.0.smithi089.stdout:8/797: unlink de/f4d 0 2024-09-13T02:54:04.826 INFO:tasks.workunit.client.0.smithi089.stdout:7/871: mkdir d3/d19/d67/d10f 0 2024-09-13T02:54:04.832 INFO:tasks.workunit.client.0.smithi089.stdout:4/811: write d2/d3/d5/fa9 [2506150,12436] 0 2024-09-13T02:54:04.836 INFO:tasks.workunit.client.0.smithi089.stdout:4/812: unlink d2/d3/d5/f42 0 2024-09-13T02:54:04.836 INFO:tasks.workunit.client.0.smithi089.stdout:4/813: fsync d2/d22/da1/f2d 0 2024-09-13T02:54:04.836 INFO:tasks.workunit.client.0.smithi089.stdout:4/814: chown d2/d22/da1/d62/fbd 8067622 1 2024-09-13T02:54:04.836 INFO:tasks.workunit.client.0.smithi089.stdout:4/815: readlink d2/d22/l7b 0 2024-09-13T02:54:04.838 INFO:tasks.workunit.client.0.smithi089.stdout:4/816: creat d2/d3/d5/d43/d3b/f10c x:0 0 0 2024-09-13T02:54:04.838 INFO:tasks.workunit.client.0.smithi089.stdout:8/798: dread de/f1a [0,4194304] 0 2024-09-13T02:54:04.846 INFO:tasks.workunit.client.0.smithi089.stdout:7/872: dwrite d3/fe1 [0,4194304] 0 2024-09-13T02:54:04.847 INFO:tasks.workunit.client.0.smithi089.stdout:2/670: dwrite d13/d30/d61/d78/fd7 [0,4194304] 0 2024-09-13T02:54:04.848 INFO:tasks.workunit.client.0.smithi089.stdout:4/817: write d2/d3/d5/d43/d3b/f60 [2119814,29292] 0 2024-09-13T02:54:04.849 INFO:tasks.workunit.client.0.smithi089.stdout:7/873: truncate d3/d44/d85/d55/f6b 638994 0 2024-09-13T02:54:04.849 INFO:tasks.workunit.client.0.smithi089.stdout:7/874: creat d3/d19/d75/dbf/f110 x:0 0 0 2024-09-13T02:54:04.851 INFO:tasks.workunit.client.0.smithi089.stdout:7/875: mkdir d3/d44/d85/d55/d96/dc5/d111 0 2024-09-13T02:54:04.851 INFO:tasks.workunit.client.0.smithi089.stdout:7/876: truncate d3/d19/d75/d14/da0/db0/fe3 481806 0 2024-09-13T02:54:04.851 INFO:tasks.workunit.client.0.smithi089.stdout:7/877: getdents d3/d44/d85/d77/d107/da1 0 2024-09-13T02:54:04.852 INFO:tasks.workunit.client.0.smithi089.stdout:7/878: rename d3/d44/d85/d77/d107/da1/fcb to d3/d44/d85/d77/d107/f112 0 2024-09-13T02:54:04.854 INFO:tasks.workunit.client.0.smithi089.stdout:7/879: rename d3/d19/d75/f5a to d3/d44/d85/d55/f113 0 2024-09-13T02:54:04.854 INFO:tasks.workunit.client.0.smithi089.stdout:2/671: dread d13/d30/d4e/fd2 [0,4194304] 0 2024-09-13T02:54:04.856 INFO:tasks.workunit.client.0.smithi089.stdout:7/880: dread d3/d44/d85/d77/d107/fb7 [0,4194304] 0 2024-09-13T02:54:04.856 INFO:tasks.workunit.client.0.smithi089.stdout:4/818: dread d2/d3/d5/f38 [0,4194304] 0 2024-09-13T02:54:04.857 INFO:tasks.workunit.client.0.smithi089.stdout:8/799: dwrite de/d16/d1e/d20/d6c/d6e/f7d [0,4194304] 0 2024-09-13T02:54:04.858 INFO:tasks.workunit.client.0.smithi089.stdout:7/881: mknod d3/d44/d85/c114 0 2024-09-13T02:54:04.858 INFO:tasks.workunit.client.0.smithi089.stdout:7/882: creat d3/d44/d85/d77/f115 x:0 0 0 2024-09-13T02:54:04.858 INFO:tasks.workunit.client.0.smithi089.stdout:4/819: unlink d2/d3/d5/fa8 0 2024-09-13T02:54:04.863 INFO:tasks.workunit.client.0.smithi089.stdout:4/820: rename d2/d3/d5/d43/d3b/d71/d99 to d2/d3/d5/d43/d3b/d71/d10d 0 2024-09-13T02:54:04.865 INFO:tasks.workunit.client.0.smithi089.stdout:4/821: mknod d2/d22/da1/d62/d6c/c10e 0 2024-09-13T02:54:04.866 INFO:tasks.workunit.client.0.smithi089.stdout:7/883: dread d3/d19/f38 [0,4194304] 0 2024-09-13T02:54:04.867 INFO:tasks.workunit.client.0.smithi089.stdout:4/822: symlink d2/d3/d5/d72/l10f 0 2024-09-13T02:54:04.868 INFO:tasks.workunit.client.0.smithi089.stdout:7/884: mkdir d3/d19/d75/d14/da0/db0/d116 0 2024-09-13T02:54:04.868 INFO:tasks.workunit.client.0.smithi089.stdout:7/885: read d3/d19/f4d [834628,20540] 0 2024-09-13T02:54:04.871 INFO:tasks.workunit.client.0.smithi089.stdout:4/823: getdents d2/d3/d5 0 2024-09-13T02:54:04.871 INFO:tasks.workunit.client.0.smithi089.stdout:4/824: chown d2/d3/d5/d43/d3b/d71/d10d/daf/d8f 12 1 2024-09-13T02:54:04.874 INFO:tasks.workunit.client.0.smithi089.stdout:3/713: sync 2024-09-13T02:54:04.874 INFO:tasks.workunit.client.0.smithi089.stdout:0/667: sync 2024-09-13T02:54:04.874 INFO:tasks.workunit.client.0.smithi089.stdout:0/668: fdatasync d2/d19/d1a/d4e/fb8 0 2024-09-13T02:54:04.876 INFO:tasks.workunit.client.0.smithi089.stdout:0/669: read d2/f35 [2010946,74140] 0 2024-09-13T02:54:04.876 INFO:tasks.workunit.client.0.smithi089.stdout:0/670: write d2/d64/f9c [4374625,67221] 0 2024-09-13T02:54:04.878 INFO:tasks.workunit.client.0.smithi089.stdout:2/672: dwrite f3 [0,4194304] 0 2024-09-13T02:54:04.878 INFO:tasks.workunit.client.0.smithi089.stdout:2/673: stat d13/d30/d4e/l80 0 2024-09-13T02:54:04.878 INFO:tasks.workunit.client.0.smithi089.stdout:2/674: creat d13/d30/d4e/d7b/fe9 x:0 0 0 2024-09-13T02:54:04.878 INFO:tasks.workunit.client.0.smithi089.stdout:4/825: dread d2/f4c [0,4194304] 0 2024-09-13T02:54:04.878 INFO:tasks.workunit.client.0.smithi089.stdout:4/826: chown d2/d3/d5/d43/d3b/d71/d10d/cc5 83 1 2024-09-13T02:54:04.879 INFO:tasks.workunit.client.0.smithi089.stdout:0/671: creat d2/d64/db3/de0/fe3 x:0 0 0 2024-09-13T02:54:04.880 INFO:tasks.workunit.client.0.smithi089.stdout:8/800: dwrite de/d16/d1e/f30 [4194304,4194304] 0 2024-09-13T02:54:04.880 INFO:tasks.workunit.client.0.smithi089.stdout:2/675: mknod d13/d30/d4e/d7b/d86/dc0/cea 0 2024-09-13T02:54:04.880 INFO:tasks.workunit.client.0.smithi089.stdout:4/827: getdents d2/d3/d5/d43/d3b/d71 0 2024-09-13T02:54:04.881 INFO:tasks.workunit.client.0.smithi089.stdout:4/828: dread d2/d3/d5/d72/fcb [0,4194304] 0 2024-09-13T02:54:04.882 INFO:tasks.workunit.client.0.smithi089.stdout:4/829: dread d2/d3/d86/fbb [0,4194304] 0 2024-09-13T02:54:04.882 INFO:tasks.workunit.client.0.smithi089.stdout:0/672: rename d2/d19/d1a/d3d/lcc to d2/d64/db3/de0/le4 0 2024-09-13T02:54:04.885 INFO:tasks.workunit.client.0.smithi089.stdout:3/714: dread d2/f9b [0,4194304] 0 2024-09-13T02:54:04.885 INFO:tasks.workunit.client.0.smithi089.stdout:3/715: chown d2/l9 29104 1 2024-09-13T02:54:04.885 INFO:tasks.workunit.client.0.smithi089.stdout:8/801: truncate de/f11 1240516 0 2024-09-13T02:54:04.885 INFO:tasks.workunit.client.0.smithi089.stdout:2/676: creat d13/d30/d61/d78/dd3/de7/db7/de3/feb x:0 0 0 2024-09-13T02:54:04.886 INFO:tasks.workunit.client.0.smithi089.stdout:3/716: dread d2/d20/d23/d32/d49/d75/f78 [0,4194304] 0 2024-09-13T02:54:04.887 INFO:tasks.workunit.client.0.smithi089.stdout:2/677: mkdir d13/d30/d59/dbe/dec 0 2024-09-13T02:54:04.887 INFO:tasks.workunit.client.0.smithi089.stdout:2/678: chown f3 223184646 1 2024-09-13T02:54:04.887 INFO:tasks.workunit.client.0.smithi089.stdout:2/679: truncate d13/d30/d61/d78/d79/fb6 1554092 0 2024-09-13T02:54:04.887 INFO:tasks.workunit.client.0.smithi089.stdout:2/680: chown d13/d30/d4e/d6f/d76/ca8 11359816 1 2024-09-13T02:54:04.888 INFO:tasks.workunit.client.0.smithi089.stdout:3/717: mkdir d2/d8b/daf/ddf 0 2024-09-13T02:54:04.889 INFO:tasks.workunit.client.0.smithi089.stdout:3/718: write d2/d20/d23/d32/d5b/d71/f8c [40822,68019] 0 2024-09-13T02:54:04.889 INFO:tasks.workunit.client.0.smithi089.stdout:3/719: fdatasync d2/d8/dc/d9a/d9c/d83/db6/f84 0 2024-09-13T02:54:04.889 INFO:tasks.workunit.client.0.smithi089.stdout:3/720: truncate d2/d20/f4b 1741023 0 2024-09-13T02:54:04.890 INFO:tasks.workunit.client.0.smithi089.stdout:1/658: sync 2024-09-13T02:54:04.890 INFO:tasks.workunit.client.0.smithi089.stdout:9/591: sync 2024-09-13T02:54:04.890 INFO:tasks.workunit.client.0.smithi089.stdout:6/733: sync 2024-09-13T02:54:04.891 INFO:tasks.workunit.client.0.smithi089.stdout:5/755: sync 2024-09-13T02:54:04.891 INFO:tasks.workunit.client.0.smithi089.stdout:9/592: dread - d3/d15/fb3 zero size 2024-09-13T02:54:04.892 INFO:tasks.workunit.client.0.smithi089.stdout:6/734: write db/d43/f67 [17055,18652] 0 2024-09-13T02:54:04.895 INFO:tasks.workunit.client.0.smithi089.stdout:3/721: dread d2/d20/d23/d27/f4e [0,4194304] 0 2024-09-13T02:54:04.895 INFO:tasks.workunit.client.0.smithi089.stdout:9/593: rmdir d3/d6/d36 39 2024-09-13T02:54:04.895 INFO:tasks.workunit.client.0.smithi089.stdout:9/594: dread - d3/d6/d2a/d4b/fa6 zero size 2024-09-13T02:54:04.895 INFO:tasks.workunit.client.0.smithi089.stdout:9/595: fdatasync d3/d6/d2a/d94/f38 0 2024-09-13T02:54:04.895 INFO:tasks.workunit.client.0.smithi089.stdout:6/735: truncate db/d10/d3a/d7b/f91 1493343 0 2024-09-13T02:54:04.896 INFO:tasks.workunit.client.0.smithi089.stdout:6/736: stat db/d10/d3a/cb5 0 2024-09-13T02:54:04.898 INFO:tasks.workunit.client.0.smithi089.stdout:7/886: dwrite d3/d44/d85/d5e/d6f/fd4 [0,4194304] 0 2024-09-13T02:54:04.899 INFO:tasks.workunit.client.0.smithi089.stdout:0/673: dread d2/d19/d1a/d4e/d7a/d9b/fd6 [0,4194304] 0 2024-09-13T02:54:04.899 INFO:tasks.workunit.client.0.smithi089.stdout:8/802: write de/d16/d1e/d20/d39/df5/dff/d61/d8e/d109/f10b [1999490,15341] 0 2024-09-13T02:54:04.900 INFO:tasks.workunit.client.0.smithi089.stdout:2/681: read d13/f54 [3611322,58532] 0 2024-09-13T02:54:04.901 INFO:tasks.workunit.client.0.smithi089.stdout:0/674: mkdir d2/dd0/de5 0 2024-09-13T02:54:04.902 INFO:tasks.workunit.client.0.smithi089.stdout:0/675: readlink d2/la 0 2024-09-13T02:54:04.904 INFO:tasks.workunit.client.0.smithi089.stdout:5/756: dread d1/d4/d45/fd5 [0,4194304] 0 2024-09-13T02:54:04.905 INFO:tasks.workunit.client.0.smithi089.stdout:0/676: creat d2/dd0/fe6 x:0 0 0 2024-09-13T02:54:04.907 INFO:tasks.workunit.client.0.smithi089.stdout:0/677: link d2/d19/d1a/d3d/d4b/d4f/f96 d2/d64/db3/dc6/fe7 0 2024-09-13T02:54:04.909 INFO:tasks.workunit.client.0.smithi089.stdout:0/678: mknod d2/d64/db3/dc6/ce8 0 2024-09-13T02:54:04.910 INFO:tasks.workunit.client.0.smithi089.stdout:8/803: dread f0 [0,4194304] 0 2024-09-13T02:54:04.910 INFO:tasks.workunit.client.0.smithi089.stdout:8/804: stat de/d16/d1e/d20/d6c 0 2024-09-13T02:54:04.912 INFO:tasks.workunit.client.0.smithi089.stdout:9/596: dread d3/d3d/f97 [0,4194304] 0 2024-09-13T02:54:04.913 INFO:tasks.workunit.client.0.smithi089.stdout:0/679: truncate d2/d19/d1a/d3d/d4b/d4f/d59/d6b/f6f 3228846 0 2024-09-13T02:54:04.913 INFO:tasks.workunit.client.0.smithi089.stdout:0/680: chown d2/d19/l33 978721561 1 2024-09-13T02:54:04.914 INFO:tasks.workunit.client.0.smithi089.stdout:8/805: symlink de/d16/d1e/d20/d6c/d6e/d7e/de7/l115 0 2024-09-13T02:54:04.916 INFO:tasks.workunit.client.0.smithi089.stdout:9/597: creat d3/d6/fbc x:0 0 0 2024-09-13T02:54:04.916 INFO:tasks.workunit.client.0.smithi089.stdout:5/757: dread d1/fb6 [0,4194304] 0 2024-09-13T02:54:04.916 INFO:tasks.workunit.client.0.smithi089.stdout:5/758: stat d1/d4/d2b/f2e 0 2024-09-13T02:54:04.916 INFO:tasks.workunit.client.0.smithi089.stdout:0/681: chown d2/f98 13415655 1 2024-09-13T02:54:04.916 INFO:tasks.workunit.client.0.smithi089.stdout:0/682: write d2/d19/d1a/d1e/d42/f46 [1633393,78084] 0 2024-09-13T02:54:04.917 INFO:tasks.workunit.client.0.smithi089.stdout:8/806: mknod de/d16/d1e/d20/d39/df5/dff/d61/d8e/c116 0 2024-09-13T02:54:04.917 INFO:tasks.workunit.client.0.smithi089.stdout:8/807: readlink de/d16/d1e/d3f/d5b/l63 0 2024-09-13T02:54:04.918 INFO:tasks.workunit.client.0.smithi089.stdout:0/683: creat d2/d19/d1a/d4e/d7a/d9b/fe9 x:0 0 0 2024-09-13T02:54:04.918 INFO:tasks.workunit.client.0.smithi089.stdout:0/684: creat d2/d64/fea x:0 0 0 2024-09-13T02:54:04.918 INFO:tasks.workunit.client.0.smithi089.stdout:0/685: chown d2/d19/d1a/d1e/l53 36032 1 2024-09-13T02:54:04.919 INFO:tasks.workunit.client.0.smithi089.stdout:8/808: mkdir de/d16/d1e/d3f/d106/d117 0 2024-09-13T02:54:04.919 INFO:tasks.workunit.client.0.smithi089.stdout:8/809: readlink de/d16/d1e/d3f/ld8 0 2024-09-13T02:54:04.921 INFO:tasks.workunit.client.0.smithi089.stdout:3/722: dwrite d2/d20/d23/d32/d5b/f8a [0,4194304] 0 2024-09-13T02:54:04.921 INFO:tasks.workunit.client.0.smithi089.stdout:4/830: dwrite d2/d22/da1/d62/fff [0,4194304] 0 2024-09-13T02:54:04.921 INFO:tasks.workunit.client.0.smithi089.stdout:4/831: write d2/d3/f7c [867032,129133] 0 2024-09-13T02:54:04.921 INFO:tasks.workunit.client.0.smithi089.stdout:6/737: dread db/d43/d6e/f55 [0,4194304] 0 2024-09-13T02:54:04.921 INFO:tasks.workunit.client.0.smithi089.stdout:4/832: write d2/d3/f7c [2417131,34303] 0 2024-09-13T02:54:04.921 INFO:tasks.workunit.client.0.smithi089.stdout:4/833: fsync d2/d3/f25 0 2024-09-13T02:54:04.922 INFO:tasks.workunit.client.0.smithi089.stdout:0/686: rename d2/d19/d1a/d3d/d4b/d4f/d59/c92 to d2/d19/d1a/d3d/d4b/d4f/ceb 0 2024-09-13T02:54:04.922 INFO:tasks.workunit.client.0.smithi089.stdout:2/682: dread d13/d30/d64/f9e [0,4194304] 0 2024-09-13T02:54:04.923 INFO:tasks.workunit.client.0.smithi089.stdout:8/810: rmdir de/d16/d1e/d20/d39/df5/dff/d61/d8e/dcf 0 2024-09-13T02:54:04.923 INFO:tasks.workunit.client.0.smithi089.stdout:8/811: write de/f10 [628602,99206] 0 2024-09-13T02:54:04.923 INFO:tasks.workunit.client.0.smithi089.stdout:8/812: read - de/d16/d1e/d67/dc4/ff2 zero size 2024-09-13T02:54:04.931 INFO:tasks.workunit.client.0.smithi089.stdout:6/738: symlink db/dd2/lf6 0 2024-09-13T02:54:04.932 INFO:tasks.workunit.client.0.smithi089.stdout:4/834: symlink d2/d3/d5/d43/d3b/d71/d10d/daf/dc6/l110 0 2024-09-13T02:54:04.932 INFO:tasks.workunit.client.0.smithi089.stdout:2/683: dread f5 [0,4194304] 0 2024-09-13T02:54:04.932 INFO:tasks.workunit.client.0.smithi089.stdout:2/684: write d13/d30/f41 [149348,45776] 0 2024-09-13T02:54:04.932 INFO:tasks.workunit.client.0.smithi089.stdout:2/685: read - d13/d30/f6b zero size 2024-09-13T02:54:04.933 INFO:tasks.workunit.client.0.smithi089.stdout:2/686: fdatasync d13/d30/f49 0 2024-09-13T02:54:04.933 INFO:tasks.workunit.client.0.smithi089.stdout:0/687: write d2/f17 [4154600,11450] 0 2024-09-13T02:54:04.933 INFO:tasks.workunit.client.0.smithi089.stdout:0/688: chown d2/d19/d1a/f4d 643707 1 2024-09-13T02:54:04.935 INFO:tasks.workunit.client.0.smithi089.stdout:3/723: rename d2/d20/d23/d32/d49/d75/f78 to d2/d20/d23/d32/d5b/d71/fe0 0 2024-09-13T02:54:04.937 INFO:tasks.workunit.client.0.smithi089.stdout:8/813: mknod de/d56/c118 0 2024-09-13T02:54:04.937 INFO:tasks.workunit.client.0.smithi089.stdout:8/814: write de/d16/d1e/d27/f68 [797285,28725] 0 2024-09-13T02:54:04.937 INFO:tasks.workunit.client.0.smithi089.stdout:3/724: write d2/d8/dc/d3c/f5d [1174181,63893] 0 2024-09-13T02:54:04.939 INFO:tasks.workunit.client.0.smithi089.stdout:2/687: creat d13/d30/d61/d78/dd3/de7/fed x:0 0 0 2024-09-13T02:54:04.942 INFO:tasks.workunit.client.0.smithi089.stdout:6/739: rename db/d43/d6e/d28/d2f/d9b/ded to db/db2/df7 0 2024-09-13T02:54:04.942 INFO:tasks.workunit.client.0.smithi089.stdout:6/740: creat db/d43/d6e/d28/d2f/dc8/ff8 x:0 0 0 2024-09-13T02:54:04.944 INFO:tasks.workunit.client.0.smithi089.stdout:3/725: creat d2/d8/dc/dbe/dd8/fe1 x:0 0 0 2024-09-13T02:54:04.945 INFO:tasks.workunit.client.0.smithi089.stdout:2/688: creat d13/d30/d61/d78/d79/d90/fee x:0 0 0 2024-09-13T02:54:04.946 INFO:tasks.workunit.client.0.smithi089.stdout:0/689: getdents d2/d19/d1a/d3d/d4b/d4f 0 2024-09-13T02:54:04.949 INFO:tasks.workunit.client.0.smithi089.stdout:6/741: stat db/d10/c39 0 2024-09-13T02:54:04.949 INFO:tasks.workunit.client.0.smithi089.stdout:6/742: chown db/d10/d3a/l9e 560530860 1 2024-09-13T02:54:04.950 INFO:tasks.workunit.client.0.smithi089.stdout:3/726: creat d2/d8/fe2 x:0 0 0 2024-09-13T02:54:04.950 INFO:tasks.workunit.client.0.smithi089.stdout:3/727: chown d2/d8b/l8f 91228 1 2024-09-13T02:54:04.950 INFO:tasks.workunit.client.0.smithi089.stdout:9/598: dwrite d3/d15/f49 [0,4194304] 0 2024-09-13T02:54:04.950 INFO:tasks.workunit.client.0.smithi089.stdout:9/599: dread - d3/d6/f65 zero size 2024-09-13T02:54:04.951 INFO:tasks.workunit.client.0.smithi089.stdout:2/689: creat d13/d30/d61/d78/d79/fef x:0 0 0 2024-09-13T02:54:04.953 INFO:tasks.workunit.client.0.smithi089.stdout:6/743: mknod db/d10/de9/d53/d83/d9f/de0/cf9 0 2024-09-13T02:54:04.954 INFO:tasks.workunit.client.0.smithi089.stdout:3/728: mknod d2/d20/d23/d32/d49/ce3 0 2024-09-13T02:54:04.954 INFO:tasks.workunit.client.0.smithi089.stdout:7/887: dwrite d3/d44/d85/d55/f113 [0,4194304] 0 2024-09-13T02:54:04.955 INFO:tasks.workunit.client.0.smithi089.stdout:5/759: dwrite d1/d4/d45/d6f/d4d/d7f/d49/d5a/fe5 [0,4194304] 0 2024-09-13T02:54:04.956 INFO:tasks.workunit.client.0.smithi089.stdout:5/760: dread - d1/d4/d45/d8c/fbb zero size 2024-09-13T02:54:04.956 INFO:tasks.workunit.client.0.smithi089.stdout:4/835: dwrite d2/da/f6d [0,4194304] 0 2024-09-13T02:54:04.956 INFO:tasks.workunit.client.0.smithi089.stdout:4/836: creat d2/d22/da1/d62/de8/f111 x:0 0 0 2024-09-13T02:54:04.956 INFO:tasks.workunit.client.0.smithi089.stdout:9/600: mknod d3/d6/d2a/d4b/cbd 0 2024-09-13T02:54:04.957 INFO:tasks.workunit.client.0.smithi089.stdout:7/888: dread d3/d44/d85/d55/d96/dc5/fd1 [0,4194304] 0 2024-09-13T02:54:04.957 INFO:tasks.workunit.client.0.smithi089.stdout:7/889: chown d3/d19/d75/d14/da0 58631 1 2024-09-13T02:54:04.957 INFO:tasks.workunit.client.0.smithi089.stdout:7/890: readlink d3/d19/d75/dbf/le8 0 2024-09-13T02:54:04.957 INFO:tasks.workunit.client.0.smithi089.stdout:7/891: stat d3/d44/d85/d5e/d6f/fc3 0 2024-09-13T02:54:04.957 INFO:tasks.workunit.client.0.smithi089.stdout:7/892: stat d3/d44/d85/d55/ff8 0 2024-09-13T02:54:04.957 INFO:tasks.workunit.client.0.smithi089.stdout:0/690: truncate d2/f80 2801500 0 2024-09-13T02:54:04.957 INFO:tasks.workunit.client.0.smithi089.stdout:4/837: read d2/d3/d5/d49/fac [829501,51778] 0 2024-09-13T02:54:04.958 INFO:tasks.workunit.client.0.smithi089.stdout:6/744: truncate db/d10/d3a/d7b/f7c 929894 0 2024-09-13T02:54:04.959 INFO:tasks.workunit.client.0.smithi089.stdout:3/729: symlink d2/d20/d23/le4 0 2024-09-13T02:54:04.966 INFO:tasks.workunit.client.0.smithi089.stdout:5/761: dread d1/d4/d45/d6f/d4d/d7f/d49/f38 [0,4194304] 0 2024-09-13T02:54:04.973 INFO:tasks.workunit.client.0.smithi089.stdout:3/730: rename d2/d8/dc/l31 to d2/d20/d23/le5 0 2024-09-13T02:54:04.974 INFO:tasks.workunit.client.0.smithi089.stdout:5/762: mkdir d1/d4/d2b/da9/deb 0 2024-09-13T02:54:04.975 INFO:tasks.workunit.client.0.smithi089.stdout:9/601: mknod d3/d6/cbe 0 2024-09-13T02:54:04.976 INFO:tasks.workunit.client.0.smithi089.stdout:6/745: getdents db/d43 0 2024-09-13T02:54:04.978 INFO:tasks.workunit.client.0.smithi089.stdout:5/763: mknod d1/cec 0 2024-09-13T02:54:04.978 INFO:tasks.workunit.client.0.smithi089.stdout:5/764: chown d1/d4/ce 495245 1 2024-09-13T02:54:04.978 INFO:tasks.workunit.client.0.smithi089.stdout:5/765: chown d1/l81 6472 1 2024-09-13T02:54:04.978 INFO:tasks.workunit.client.0.smithi089.stdout:4/838: read d2/d3/d5/f37 [2609179,103885] 0 2024-09-13T02:54:04.980 INFO:tasks.workunit.client.0.smithi089.stdout:5/766: creat d1/d73/fed x:0 0 0 2024-09-13T02:54:04.980 INFO:tasks.workunit.client.0.smithi089.stdout:5/767: creat d1/fee x:0 0 0 2024-09-13T02:54:04.984 INFO:tasks.workunit.client.0.smithi089.stdout:5/768: creat d1/d4/d2b/fef x:0 0 0 2024-09-13T02:54:04.986 INFO:tasks.workunit.client.0.smithi089.stdout:5/769: symlink d1/d73/dcd/lf0 0 2024-09-13T02:54:04.989 INFO:tasks.workunit.client.0.smithi089.stdout:5/770: rename d1/d7/f19 to d1/d4/d2b/da9/ff1 0 2024-09-13T02:54:04.989 INFO:tasks.workunit.client.0.smithi089.stdout:5/771: truncate d1/d4/d45/d6f/d4d/d7f/d8f/dad/fb5 112278 0 2024-09-13T02:54:04.990 INFO:tasks.workunit.client.0.smithi089.stdout:5/772: creat d1/d4/d2b/ff2 x:0 0 0 2024-09-13T02:54:04.990 INFO:tasks.workunit.client.0.smithi089.stdout:5/773: chown d1/d4/d45/d6f/d4d/d7f/d49/fa4 43872978 1 2024-09-13T02:54:04.993 INFO:tasks.workunit.client.0.smithi089.stdout:5/774: rmdir d1/d4 39 2024-09-13T02:54:04.993 INFO:tasks.workunit.client.0.smithi089.stdout:5/775: fdatasync d1/d4/f25 0 2024-09-13T02:54:04.996 INFO:tasks.workunit.client.0.smithi089.stdout:5/776: unlink d1/d4/d45/d6f/d4d/d7f/d49/lcb 0 2024-09-13T02:54:04.998 INFO:tasks.workunit.client.0.smithi089.stdout:5/777: unlink d1/d4/d45/d6f/d4d/f7a 0 2024-09-13T02:54:05.000 INFO:tasks.workunit.client.0.smithi089.stdout:5/778: mkdir d1/d4/ddb/df3 0 2024-09-13T02:54:05.002 INFO:tasks.workunit.client.0.smithi089.stdout:6/746: dread db/d10/f1e [0,4194304] 0 2024-09-13T02:54:05.003 INFO:tasks.workunit.client.0.smithi089.stdout:6/747: symlink db/d43/d6e/lfa 0 2024-09-13T02:54:05.004 INFO:tasks.workunit.client.0.smithi089.stdout:6/748: symlink db/d10/lfb 0 2024-09-13T02:54:05.005 INFO:tasks.workunit.client.0.smithi089.stdout:6/749: creat db/ffc x:0 0 0 2024-09-13T02:54:05.005 INFO:tasks.workunit.client.0.smithi089.stdout:6/750: stat db/d43/cef 0 2024-09-13T02:54:05.008 INFO:tasks.workunit.client.0.smithi089.stdout:0/691: dwrite d2/d64/d91/fcb [0,4194304] 0 2024-09-13T02:54:05.008 INFO:tasks.workunit.client.0.smithi089.stdout:3/731: dwrite d2/d20/d23/d32/d5b/d71/d92/fcc [0,4194304] 0 2024-09-13T02:54:05.008 INFO:tasks.workunit.client.0.smithi089.stdout:3/732: stat d2/d20/d23/d32/d5b/d71/d92 0 2024-09-13T02:54:05.008 INFO:tasks.workunit.client.0.smithi089.stdout:7/893: dwrite d3/d19/d2e/d37/fdf [0,4194304] 0 2024-09-13T02:54:05.008 INFO:tasks.workunit.client.0.smithi089.stdout:7/894: fdatasync d3/d19/f38 0 2024-09-13T02:54:05.013 INFO:tasks.workunit.client.0.smithi089.stdout:5/779: dread d1/d4/d45/f82 [4194304,4194304] 0 2024-09-13T02:54:05.015 INFO:tasks.workunit.client.0.smithi089.stdout:9/602: dwrite d3/d6/fe [0,4194304] 0 2024-09-13T02:54:05.017 INFO:tasks.workunit.client.0.smithi089.stdout:7/895: rename d3/d19/d75/d14 to d3/d19/d75/db2/d105/d117 0 2024-09-13T02:54:05.019 INFO:tasks.workunit.client.0.smithi089.stdout:9/603: mknod d3/d3d/d8b/cbf 0 2024-09-13T02:54:05.020 INFO:tasks.workunit.client.0.smithi089.stdout:3/733: dread d2/d20/d23/d32/d5b/f79 [0,4194304] 0 2024-09-13T02:54:05.020 INFO:tasks.workunit.client.0.smithi089.stdout:3/734: write d2/d8/dc/fa6 [340275,75036] 0 2024-09-13T02:54:05.021 INFO:tasks.workunit.client.0.smithi089.stdout:4/839: dwrite d2/d3/f41 [0,4194304] 0 2024-09-13T02:54:05.022 INFO:tasks.workunit.client.0.smithi089.stdout:4/840: fsync d2/f73 0 2024-09-13T02:54:05.022 INFO:tasks.workunit.client.0.smithi089.stdout:3/735: getdents d2/d20/d44 0 2024-09-13T02:54:05.023 INFO:tasks.workunit.client.0.smithi089.stdout:5/780: write d1/d4/d45/d6f/d4d/f58 [5919322,21440] 0 2024-09-13T02:54:05.030 INFO:tasks.workunit.client.0.smithi089.stdout:4/841: unlink d2/d22/c5e 0 2024-09-13T02:54:05.030 INFO:tasks.workunit.client.0.smithi089.stdout:4/842: readlink d2/d55/l8c 0 2024-09-13T02:54:05.030 INFO:tasks.workunit.client.0.smithi089.stdout:4/843: creat d2/d22/da1/d62/d6c/d88/db2/f112 x:0 0 0 2024-09-13T02:54:05.030 INFO:tasks.workunit.client.0.smithi089.stdout:4/844: stat d2/d22/da1/d62/d6c/cdd 0 2024-09-13T02:54:05.030 INFO:tasks.workunit.client.0.smithi089.stdout:4/845: fsync d2/d3/d86/dfd/fb4 0 2024-09-13T02:54:05.031 INFO:tasks.workunit.client.0.smithi089.stdout:3/736: link d2/d20/d23/d2b/f3d d2/d8/dc/fe6 0 2024-09-13T02:54:05.033 INFO:tasks.workunit.client.0.smithi089.stdout:6/751: dwrite db/db2/fb7 [0,4194304] 0 2024-09-13T02:54:05.033 INFO:tasks.workunit.client.0.smithi089.stdout:6/752: chown db/d10/d3a/l4a 13 1 2024-09-13T02:54:05.033 INFO:tasks.workunit.client.0.smithi089.stdout:6/753: dread - db/d10/de9/d53/fa7 zero size 2024-09-13T02:54:05.033 INFO:tasks.workunit.client.0.smithi089.stdout:5/781: creat d1/d4/d45/ff4 x:0 0 0 2024-09-13T02:54:05.033 INFO:tasks.workunit.client.0.smithi089.stdout:5/782: write d1/d4/d45/d8c/fbb [321107,125656] 0 2024-09-13T02:54:05.033 INFO:tasks.workunit.client.0.smithi089.stdout:0/692: dwrite d2/d19/d1a/d3d/d4b/d4f/d59/f94 [0,4194304] 0 2024-09-13T02:54:05.038 INFO:tasks.workunit.client.0.smithi089.stdout:3/737: mknod d2/d8b/daf/ddf/ce7 0 2024-09-13T02:54:05.038 INFO:tasks.workunit.client.0.smithi089.stdout:3/738: truncate d2/d20/d23/d32/d5b/fbd 373804 0 2024-09-13T02:54:05.040 INFO:tasks.workunit.client.0.smithi089.stdout:6/754: dread db/d10/d3a/f36 [0,4194304] 0 2024-09-13T02:54:05.041 INFO:tasks.workunit.client.0.smithi089.stdout:5/783: rename d1/d4/f25 to d1/d73/ff5 0 2024-09-13T02:54:05.041 INFO:tasks.workunit.client.0.smithi089.stdout:5/784: chown d1/d73 2519686 1 2024-09-13T02:54:05.041 INFO:tasks.workunit.client.0.smithi089.stdout:5/785: chown d1/d4/d2b/f2e 10090 1 2024-09-13T02:54:05.041 INFO:tasks.workunit.client.0.smithi089.stdout:5/786: chown d1/l81 87303568 1 2024-09-13T02:54:05.042 INFO:tasks.workunit.client.0.smithi089.stdout:9/604: truncate d3/d6/fe 554330 0 2024-09-13T02:54:05.042 INFO:tasks.workunit.client.0.smithi089.stdout:9/605: write d3/d6/d2a/d4b/d6d/f82 [1383582,101237] 0 2024-09-13T02:54:05.043 INFO:tasks.workunit.client.0.smithi089.stdout:7/896: dwrite d3/d19/d67/f80 [4194304,4194304] 0 2024-09-13T02:54:05.045 INFO:tasks.workunit.client.0.smithi089.stdout:0/693: unlink d2/d64/d91/fcb 0 2024-09-13T02:54:05.047 INFO:tasks.workunit.client.0.smithi089.stdout:0/694: dread d2/d19/d1a/d1e/d42/f72 [0,4194304] 0 2024-09-13T02:54:05.048 INFO:tasks.workunit.client.0.smithi089.stdout:3/739: symlink d2/d8/le8 0 2024-09-13T02:54:05.048 INFO:tasks.workunit.client.0.smithi089.stdout:9/606: dread d3/d3d/f97 [0,4194304] 0 2024-09-13T02:54:05.048 INFO:tasks.workunit.client.0.smithi089.stdout:6/755: rmdir db/d10 39 2024-09-13T02:54:05.049 INFO:tasks.workunit.client.0.smithi089.stdout:5/787: mknod d1/d4/d45/d6f/d7c/cf6 0 2024-09-13T02:54:05.050 INFO:tasks.workunit.client.0.smithi089.stdout:6/756: dread db/d10/d3a/fcb [0,4194304] 0 2024-09-13T02:54:05.050 INFO:tasks.workunit.client.0.smithi089.stdout:6/757: stat db/lda 0 2024-09-13T02:54:05.056 INFO:tasks.workunit.client.0.smithi089.stdout:1/659: sync 2024-09-13T02:54:05.056 INFO:tasks.workunit.client.0.smithi089.stdout:7/897: mknod d3/d44/d85/d55/dba/c118 0 2024-09-13T02:54:05.059 INFO:tasks.workunit.client.0.smithi089.stdout:0/695: unlink d2/d19/d1a/d3d/d4b/c61 0 2024-09-13T02:54:05.060 INFO:tasks.workunit.client.0.smithi089.stdout:0/696: readlink d2/d19/d1a/d4e/d7a/d9b/l76 0 2024-09-13T02:54:05.060 INFO:tasks.workunit.client.0.smithi089.stdout:0/697: write d2/d19/d1a/d1e/d42/f72 [1507423,126760] 0 2024-09-13T02:54:05.060 INFO:tasks.workunit.client.0.smithi089.stdout:0/698: write d2/d19/d1a/d3d/d4b/d4f/fc8 [871842,97477] 0 2024-09-13T02:54:05.060 INFO:tasks.workunit.client.0.smithi089.stdout:0/699: write d2/d19/d1a/fc5 [914867,24850] 0 2024-09-13T02:54:05.060 INFO:tasks.workunit.client.0.smithi089.stdout:0/700: fsync d2/d19/d1a/d1e/d42/f49 0 2024-09-13T02:54:05.060 INFO:tasks.workunit.client.0.smithi089.stdout:0/701: chown d2/d19/d1a/d3d/c7d 155 1 2024-09-13T02:54:05.061 INFO:tasks.workunit.client.0.smithi089.stdout:3/740: creat d2/d8b/daf/fe9 x:0 0 0 2024-09-13T02:54:05.063 INFO:tasks.workunit.client.0.smithi089.stdout:5/788: link d1/d4/c4c d1/d4/d45/d6f/d4d/d7f/d8f/cf7 0 2024-09-13T02:54:05.063 INFO:tasks.workunit.client.0.smithi089.stdout:5/789: chown d1/d4/l60 1 1 2024-09-13T02:54:05.064 INFO:tasks.workunit.client.0.smithi089.stdout:9/607: rename d3/d6/d36/d9d/fa2 to d3/d6/d2a/d94/fc0 0 2024-09-13T02:54:05.065 INFO:tasks.workunit.client.0.smithi089.stdout:5/790: symlink d1/d73/lf8 0 2024-09-13T02:54:05.069 INFO:tasks.workunit.client.0.smithi089.stdout:5/791: creat d1/d4/ddb/df3/ff9 x:0 0 0 2024-09-13T02:54:05.070 INFO:tasks.workunit.client.0.smithi089.stdout:2/690: sync 2024-09-13T02:54:05.070 INFO:tasks.workunit.client.0.smithi089.stdout:8/815: sync 2024-09-13T02:54:05.070 INFO:tasks.workunit.client.0.smithi089.stdout:8/816: dread - de/d16/d1e/d20/d6c/d6e/d7e/ff0 zero size 2024-09-13T02:54:05.072 INFO:tasks.workunit.client.0.smithi089.stdout:6/758: dwrite db/d10/d3a/f47 [0,4194304] 0 2024-09-13T02:54:05.072 INFO:tasks.workunit.client.0.smithi089.stdout:6/759: creat db/ffd x:0 0 0 2024-09-13T02:54:05.072 INFO:tasks.workunit.client.0.smithi089.stdout:6/760: write db/fb9 [830958,26720] 0 2024-09-13T02:54:05.073 INFO:tasks.workunit.client.0.smithi089.stdout:2/691: unlink d13/f2d 0 2024-09-13T02:54:05.074 INFO:tasks.workunit.client.0.smithi089.stdout:2/692: read d13/f72 [237642,90473] 0 2024-09-13T02:54:05.074 INFO:tasks.workunit.client.0.smithi089.stdout:2/693: write d13/d30/d4e/d7b/fdb [1010367,38739] 0 2024-09-13T02:54:05.075 INFO:tasks.workunit.client.0.smithi089.stdout:2/694: creat d13/d30/d61/d78/dd3/de7/db7/de3/ff0 x:0 0 0 2024-09-13T02:54:05.076 INFO:tasks.workunit.client.0.smithi089.stdout:6/761: unlink f0 0 2024-09-13T02:54:05.077 INFO:tasks.workunit.client.0.smithi089.stdout:3/741: rename d2/d8/dc/dbe to d2/d20/d23/d32/d49/dea 0 2024-09-13T02:54:05.077 INFO:tasks.workunit.client.0.smithi089.stdout:3/742: fdatasync d2/d8b/daf/fe9 0 2024-09-13T02:54:05.078 INFO:tasks.workunit.client.0.smithi089.stdout:6/762: creat db/d10/de9/ffe x:0 0 0 2024-09-13T02:54:05.078 INFO:tasks.workunit.client.0.smithi089.stdout:6/763: dread - db/d10/de9/ffe zero size 2024-09-13T02:54:05.079 INFO:tasks.workunit.client.0.smithi089.stdout:0/702: dread d2/d19/d1a/d3d/d4b/fca [0,4194304] 0 2024-09-13T02:54:05.079 INFO:tasks.workunit.client.0.smithi089.stdout:3/743: symlink d2/d8/dc/leb 0 2024-09-13T02:54:05.079 INFO:tasks.workunit.client.0.smithi089.stdout:3/744: readlink d2/d20/l3f 0 2024-09-13T02:54:05.081 INFO:tasks.workunit.client.0.smithi089.stdout:9/608: rename d3/d6/d2a/d94/d24/d32 to d3/d6/d2a/d4b/d54/dc1 0 2024-09-13T02:54:05.082 INFO:tasks.workunit.client.0.smithi089.stdout:8/817: rename de/d16/d1e/d20/d39/df5/dff/d61/d8e/l8f to de/d16/d1e/d20/d39/df5/l119 0 2024-09-13T02:54:05.083 INFO:tasks.workunit.client.0.smithi089.stdout:2/695: rename d13/d30/d61/d78/d79/ca4 to d13/d30/d61/dca/cf1 0 2024-09-13T02:54:05.084 INFO:tasks.workunit.client.0.smithi089.stdout:2/696: write d13/d30/f73 [592056,22918] 0 2024-09-13T02:54:05.085 INFO:tasks.workunit.client.0.smithi089.stdout:2/697: unlink f5 0 2024-09-13T02:54:05.085 INFO:tasks.workunit.client.0.smithi089.stdout:2/698: chown d13/d30/d4e/d6f/f84 191357 1 2024-09-13T02:54:05.088 INFO:tasks.workunit.client.0.smithi089.stdout:7/898: dwrite d3/d44/d85/d55/d96/dc5/fce [0,4194304] 0 2024-09-13T02:54:05.088 INFO:tasks.workunit.client.0.smithi089.stdout:1/660: dwrite dc/d44/f45 [0,4194304] 0 2024-09-13T02:54:05.088 INFO:tasks.workunit.client.0.smithi089.stdout:2/699: mkdir d13/d30/d59/dbe/df2 0 2024-09-13T02:54:05.091 INFO:tasks.workunit.client.0.smithi089.stdout:6/764: write db/d10/f4f [3931118,18254] 0 2024-09-13T02:54:05.091 INFO:tasks.workunit.client.0.smithi089.stdout:6/765: chown db/d10/de9/d53/d83/d9f/db1/lb8 13631 1 2024-09-13T02:54:05.093 INFO:tasks.workunit.client.0.smithi089.stdout:7/899: rename d3/d44/d85/d55/d96/la9 to d3/d44/d85/d55/d96/dc5/l119 0 2024-09-13T02:54:05.095 INFO:tasks.workunit.client.0.smithi089.stdout:9/609: write d3/d6/d2a/d94/d24/fa8 [2219110,102851] 0 2024-09-13T02:54:05.095 INFO:tasks.workunit.client.0.smithi089.stdout:9/610: dread - d3/d15/fb3 zero size 2024-09-13T02:54:05.096 INFO:tasks.workunit.client.0.smithi089.stdout:1/661: getdents dc/d3a/d53/d2c/d34 0 2024-09-13T02:54:05.096 INFO:tasks.workunit.client.0.smithi089.stdout:1/662: fdatasync dc/d44/d73/fa4 0 2024-09-13T02:54:05.097 INFO:tasks.workunit.client.0.smithi089.stdout:9/611: mknod d3/d6/d2a/d4b/cc2 0 2024-09-13T02:54:05.097 INFO:tasks.workunit.client.0.smithi089.stdout:1/663: mknod dc/d46/d6c/cd0 0 2024-09-13T02:54:05.098 INFO:tasks.workunit.client.0.smithi089.stdout:8/818: dread de/f12 [0,4194304] 0 2024-09-13T02:54:05.098 INFO:tasks.workunit.client.0.smithi089.stdout:1/664: creat dc/d3a/d53/d2c/d6f/fd1 x:0 0 0 2024-09-13T02:54:05.100 INFO:tasks.workunit.client.0.smithi089.stdout:2/700: write d13/d30/f48 [1320724,48073] 0 2024-09-13T02:54:05.101 INFO:tasks.workunit.client.0.smithi089.stdout:8/819: symlink de/d16/d1e/d20/d39/df5/dff/d61/d8e/d108/l11a 0 2024-09-13T02:54:05.103 INFO:tasks.workunit.client.0.smithi089.stdout:2/701: unlink d13/d30/d4e/d7b/d86/dc0/cea 0 2024-09-13T02:54:05.106 INFO:tasks.workunit.client.0.smithi089.stdout:9/612: dread d3/d15/f1b [0,4194304] 0 2024-09-13T02:54:05.106 INFO:tasks.workunit.client.0.smithi089.stdout:8/820: link de/d16/f6f de/d16/d1e/d3f/d106/d117/f11b 0 2024-09-13T02:54:05.108 INFO:tasks.workunit.client.0.smithi089.stdout:3/745: dwrite d2/d20/d23/d32/d5b/f79 [0,4194304] 0 2024-09-13T02:54:05.109 INFO:tasks.workunit.client.0.smithi089.stdout:9/613: mknod d3/d6/d2a/d4b/cc3 0 2024-09-13T02:54:05.109 INFO:tasks.workunit.client.0.smithi089.stdout:9/614: getdents d3/d6/d36/d9d/db6 0 2024-09-13T02:54:05.109 INFO:tasks.workunit.client.0.smithi089.stdout:9/615: truncate d3/d6/fbc 473310 0 2024-09-13T02:54:05.112 INFO:tasks.workunit.client.0.smithi089.stdout:7/900: write d3/d19/f3d [4072904,34634] 0 2024-09-13T02:54:05.113 INFO:tasks.workunit.client.0.smithi089.stdout:7/901: chown d3/d19/d75/dbf/f110 675 1 2024-09-13T02:54:05.113 INFO:tasks.workunit.client.0.smithi089.stdout:9/616: creat d3/fc4 x:0 0 0 2024-09-13T02:54:05.117 INFO:tasks.workunit.client.0.smithi089.stdout:7/902: link d3/d44/d85/d77/f115 d3/d44/d85/d77/d107/da1/db4/f11a 0 2024-09-13T02:54:05.118 INFO:tasks.workunit.client.0.smithi089.stdout:7/903: stat d3/d44/d85/d5e/d6f/fc3 0 2024-09-13T02:54:05.118 INFO:tasks.workunit.client.0.smithi089.stdout:7/904: creat d3/d44/d85/d5e/d6f/f11b x:0 0 0 2024-09-13T02:54:05.124 INFO:tasks.workunit.client.0.smithi089.stdout:3/746: write d2/d20/d23/d32/d5b/d71/d92/fcc [1590985,117173] 0 2024-09-13T02:54:05.126 INFO:tasks.workunit.client.0.smithi089.stdout:7/905: getdents d3/d19/d2e/d37 0 2024-09-13T02:54:05.126 INFO:tasks.workunit.client.0.smithi089.stdout:7/906: chown d3/d19/d75/db2/d105/d117/da0/lf4 0 1 2024-09-13T02:54:05.129 INFO:tasks.workunit.client.0.smithi089.stdout:7/907: read d3/d44/ff7 [29327,48967] 0 2024-09-13T02:54:05.129 INFO:tasks.workunit.client.0.smithi089.stdout:6/766: dwrite db/d43/d6e/f2c [0,4194304] 0 2024-09-13T02:54:05.129 INFO:tasks.workunit.client.0.smithi089.stdout:7/908: chown d3/d19/d75/f12 134893 1 2024-09-13T02:54:05.129 INFO:tasks.workunit.client.0.smithi089.stdout:6/767: fdatasync db/d10/d3a/fa5 0 2024-09-13T02:54:05.130 INFO:tasks.workunit.client.0.smithi089.stdout:6/768: fdatasync db/d43/fea 0 2024-09-13T02:54:05.130 INFO:tasks.workunit.client.0.smithi089.stdout:7/909: write d3/d44/d85/d5e/d6f/fa3 [2020857,50824] 0 2024-09-13T02:54:05.136 INFO:tasks.workunit.client.0.smithi089.stdout:7/910: dread f0 [0,4194304] 0 2024-09-13T02:54:05.137 INFO:tasks.workunit.client.0.smithi089.stdout:1/665: dwrite dc/d3a/d93/fbb [0,4194304] 0 2024-09-13T02:54:05.140 INFO:tasks.workunit.client.0.smithi089.stdout:1/666: mknod dc/d3a/d53/d2c/cd2 0 2024-09-13T02:54:05.141 INFO:tasks.workunit.client.0.smithi089.stdout:1/667: mknod dc/d3a/d53/d2c/cd3 0 2024-09-13T02:54:05.141 INFO:tasks.workunit.client.0.smithi089.stdout:6/769: dread db/d43/d6e/d28/d37/d8b/dcd/fe5 [0,4194304] 0 2024-09-13T02:54:05.147 INFO:tasks.workunit.client.0.smithi089.stdout:9/617: dwrite d3/fc4 [0,4194304] 0 2024-09-13T02:54:05.148 INFO:tasks.workunit.client.0.smithi089.stdout:8/821: dwrite de/faf [0,4194304] 0 2024-09-13T02:54:05.149 INFO:tasks.workunit.client.0.smithi089.stdout:3/747: dwrite d2/d8/dc/f30 [4194304,4194304] 0 2024-09-13T02:54:05.154 INFO:tasks.workunit.client.0.smithi089.stdout:8/822: link de/d16/d1e/d20/d39/df5/dff/d61/d8e/f90 de/d16/d1e/d20/d6c/f11c 0 2024-09-13T02:54:05.155 INFO:tasks.workunit.client.0.smithi089.stdout:1/668: write dc/d46/d6c/d98/fb1 [655507,122059] 0 2024-09-13T02:54:05.155 INFO:tasks.workunit.client.0.smithi089.stdout:1/669: truncate dc/f17 1247506 0 2024-09-13T02:54:05.155 INFO:tasks.workunit.client.0.smithi089.stdout:1/670: dread - dc/d44/d73/d85/fbf zero size 2024-09-13T02:54:05.155 INFO:tasks.workunit.client.0.smithi089.stdout:1/671: fdatasync dc/d3a/d53/fc2 0 2024-09-13T02:54:05.157 INFO:tasks.workunit.client.0.smithi089.stdout:3/748: rmdir d2/d8/dc/d9a/d9c/dab 39 2024-09-13T02:54:05.160 INFO:tasks.workunit.client.0.smithi089.stdout:8/823: creat de/d16/d1e/d20/d39/df5/f11d x:0 0 0 2024-09-13T02:54:05.161 INFO:tasks.workunit.client.0.smithi089.stdout:8/824: read de/d16/d1e/d20/da8/fa9 [118789,85001] 0 2024-09-13T02:54:05.161 INFO:tasks.workunit.client.0.smithi089.stdout:3/749: symlink d2/d20/d23/lec 0 2024-09-13T02:54:05.164 INFO:tasks.workunit.client.0.smithi089.stdout:1/672: truncate dc/d3a/d53/d2c/d36/f58 483220 0 2024-09-13T02:54:05.168 INFO:tasks.workunit.client.0.smithi089.stdout:8/825: dread de/d16/d1e/f2a [0,4194304] 0 2024-09-13T02:54:05.168 INFO:tasks.workunit.client.0.smithi089.stdout:1/673: unlink dc/d3a/d53/d2c/d36/c54 0 2024-09-13T02:54:05.168 INFO:tasks.workunit.client.0.smithi089.stdout:1/674: readlink dc/d3a/l7f 0 2024-09-13T02:54:05.168 INFO:tasks.workunit.client.0.smithi089.stdout:1/675: write dc/d44/fb6 [295175,113] 0 2024-09-13T02:54:05.169 INFO:tasks.workunit.client.0.smithi089.stdout:1/676: symlink dc/d3a/d93/ld4 0 2024-09-13T02:54:05.169 INFO:tasks.workunit.client.0.smithi089.stdout:1/677: chown dc/d3a/d53/d2c/d34/d8b/db5 3494300 1 2024-09-13T02:54:05.169 INFO:tasks.workunit.client.0.smithi089.stdout:1/678: fdatasync dc/f21 0 2024-09-13T02:54:05.169 INFO:tasks.workunit.client.0.smithi089.stdout:1/679: chown dc/d44/d73/lac 3560 1 2024-09-13T02:54:05.170 INFO:tasks.workunit.client.0.smithi089.stdout:7/911: dwrite d3/d44/d85/d77/fd6 [0,4194304] 0 2024-09-13T02:54:05.171 INFO:tasks.workunit.client.0.smithi089.stdout:6/770: dwrite db/d43/d6e/d28/d2f/f87 [0,4194304] 0 2024-09-13T02:54:05.171 INFO:tasks.workunit.client.0.smithi089.stdout:6/771: truncate db/d10/d3a/d7b/f91 1871627 0 2024-09-13T02:54:05.171 INFO:tasks.workunit.client.0.smithi089.stdout:6/772: dread - db/d43/d6e/d28/d37/f92 zero size 2024-09-13T02:54:05.171 INFO:tasks.workunit.client.0.smithi089.stdout:9/618: dwrite d3/d6/d2a/d4b/f9c [0,4194304] 0 2024-09-13T02:54:05.172 INFO:tasks.workunit.client.0.smithi089.stdout:8/826: dread de/d16/d1e/d27/d35/f8b [0,4194304] 0 2024-09-13T02:54:05.174 INFO:tasks.workunit.client.0.smithi089.stdout:7/912: creat d3/d19/d75/db2/dfe/f11c x:0 0 0 2024-09-13T02:54:05.178 INFO:tasks.workunit.client.0.smithi089.stdout:9/619: unlink d3/d6/d2a/d94/d24/l46 0 2024-09-13T02:54:05.184 INFO:tasks.workunit.client.0.smithi089.stdout:7/913: rmdir d3/d19/d2e/d37 39 2024-09-13T02:54:05.184 INFO:tasks.workunit.client.0.smithi089.stdout:6/773: dread db/d43/d6e/d28/d2f/f50 [4194304,4194304] 0 2024-09-13T02:54:05.184 INFO:tasks.workunit.client.0.smithi089.stdout:6/774: chown db/d43/d6e/c31 6 1 2024-09-13T02:54:05.189 INFO:tasks.workunit.client.0.smithi089.stdout:8/827: rename de/d16/d1e/d27/d76/d8d to de/d16/d1e/d3f/d71/d11e 0 2024-09-13T02:54:05.190 INFO:tasks.workunit.client.0.smithi089.stdout:1/680: dwrite dc/d44/f99 [4194304,4194304] 0 2024-09-13T02:54:05.190 INFO:tasks.workunit.client.0.smithi089.stdout:6/775: rename db/d43/d6e/d28/f57 to db/d10/de9/d7e/fff 0 2024-09-13T02:54:05.192 INFO:tasks.workunit.client.0.smithi089.stdout:8/828: creat de/d16/d1e/d20/d39/df5/dff/d61/d8e/d108/f11f x:0 0 0 2024-09-13T02:54:05.192 INFO:tasks.workunit.client.0.smithi089.stdout:8/829: write de/d16/d1e/d27/d35/f5a [240127,61264] 0 2024-09-13T02:54:05.195 INFO:tasks.workunit.client.0.smithi089.stdout:6/776: getdents db/dd2 0 2024-09-13T02:54:05.205 INFO:tasks.workunit.client.0.smithi089.stdout:9/620: dwrite d3/d6/d2a/d94/d24/fa8 [4194304,4194304] 0 2024-09-13T02:54:05.206 INFO:tasks.workunit.client.0.smithi089.stdout:1/681: write dc/f21 [356541,94415] 0 2024-09-13T02:54:05.209 INFO:tasks.workunit.client.0.smithi089.stdout:7/914: dwrite d3/d44/d85/d77/d107/da1/ffa [0,4194304] 0 2024-09-13T02:54:05.209 INFO:tasks.workunit.client.0.smithi089.stdout:7/915: getdents d3/d19/d2e/d37 0 2024-09-13T02:54:05.209 INFO:tasks.workunit.client.0.smithi089.stdout:7/916: write d3/d19/d67/f7b [336183,108782] 0 2024-09-13T02:54:05.216 INFO:tasks.workunit.client.0.smithi089.stdout:8/830: dwrite de/d16/d1e/f83 [0,4194304] 0 2024-09-13T02:54:05.217 INFO:tasks.workunit.client.0.smithi089.stdout:9/621: rmdir d3/d6/d2a/d94/d24/d35 39 2024-09-13T02:54:05.217 INFO:tasks.workunit.client.0.smithi089.stdout:9/622: getdents d3/d6/d36/d9d/db6 0 2024-09-13T02:54:05.217 INFO:tasks.workunit.client.0.smithi089.stdout:9/623: creat d3/d6/d2a/d94/d24/d29/fc5 x:0 0 0 2024-09-13T02:54:05.218 INFO:tasks.workunit.client.0.smithi089.stdout:1/682: mknod dc/d44/d73/cd5 0 2024-09-13T02:54:05.218 INFO:tasks.workunit.client.0.smithi089.stdout:1/683: readlink dc/d3a/l7f 0 2024-09-13T02:54:05.219 INFO:tasks.workunit.client.0.smithi089.stdout:6/777: dwrite db/d10/d3a/f36 [4194304,4194304] 0 2024-09-13T02:54:05.221 INFO:tasks.workunit.client.0.smithi089.stdout:7/917: link d3/d44/d85/d77/d107/l9f d3/d19/d75/db2/d105/l11d 0 2024-09-13T02:54:05.222 INFO:tasks.workunit.client.0.smithi089.stdout:8/831: mknod de/d16/d1e/d20/d39/df5/dff/d61/d8e/d108/c120 0 2024-09-13T02:54:05.225 INFO:tasks.workunit.client.0.smithi089.stdout:1/684: unlink dc/d44/f8c 0 2024-09-13T02:54:05.225 INFO:tasks.workunit.client.0.smithi089.stdout:7/918: truncate d3/d20/f32 2696083 0 2024-09-13T02:54:05.227 INFO:tasks.workunit.client.0.smithi089.stdout:1/685: mkdir dc/d44/d73/d85/dd6 0 2024-09-13T02:54:05.229 INFO:tasks.workunit.client.0.smithi089.stdout:7/919: rename d3/d19/d75/dbf/f110 to d3/d19/d2e/d37/dad/d109/f11e 0 2024-09-13T02:54:05.229 INFO:tasks.workunit.client.0.smithi089.stdout:9/624: write d3/d6/d2a/d94/d24/d29/f52 [421533,124013] 0 2024-09-13T02:54:05.229 INFO:tasks.workunit.client.0.smithi089.stdout:9/625: readlink d3/d6/d2a/d94/d24/l2c 0 2024-09-13T02:54:05.229 INFO:tasks.workunit.client.0.smithi089.stdout:1/686: mkdir dc/d44/d73/d85/dd6/dd7 0 2024-09-13T02:54:05.230 INFO:tasks.workunit.client.0.smithi089.stdout:1/687: write dc/d6e/fa5 [164528,60839] 0 2024-09-13T02:54:05.232 INFO:tasks.workunit.client.0.smithi089.stdout:7/920: rmdir d3/d20 39 2024-09-13T02:54:05.232 INFO:tasks.workunit.client.0.smithi089.stdout:7/921: fsync d3/d44/d85/d5e/d6f/f89 0 2024-09-13T02:54:05.232 INFO:tasks.workunit.client.0.smithi089.stdout:7/922: creat d3/d44/d85/d55/f11f x:0 0 0 2024-09-13T02:54:05.232 INFO:tasks.workunit.client.0.smithi089.stdout:7/923: creat d3/d54/f120 x:0 0 0 2024-09-13T02:54:05.232 INFO:tasks.workunit.client.0.smithi089.stdout:4/846: sync 2024-09-13T02:54:05.235 INFO:tasks.workunit.client.0.smithi089.stdout:1/688: mkdir dc/d3a/d53/d2c/d34/d9b/dd8 0 2024-09-13T02:54:05.235 INFO:tasks.workunit.client.0.smithi089.stdout:1/689: write dc/d44/d73/d85/fbf [692215,103867] 0 2024-09-13T02:54:05.237 INFO:tasks.workunit.client.0.smithi089.stdout:5/792: sync 2024-09-13T02:54:05.238 INFO:tasks.workunit.client.0.smithi089.stdout:7/924: creat d3/d19/d75/db2/d105/d117/d71/f121 x:0 0 0 2024-09-13T02:54:05.238 INFO:tasks.workunit.client.0.smithi089.stdout:7/925: chown d3/d44/d85/d55/d96/cf5 8210 1 2024-09-13T02:54:05.238 INFO:tasks.workunit.client.0.smithi089.stdout:1/690: symlink dc/d3a/d53/d2c/d34/d8b/ld9 0 2024-09-13T02:54:05.239 INFO:tasks.workunit.client.0.smithi089.stdout:5/793: unlink d1/l46 0 2024-09-13T02:54:05.239 INFO:tasks.workunit.client.0.smithi089.stdout:5/794: dread - d1/d73/dcd/fe4 zero size 2024-09-13T02:54:05.240 INFO:tasks.workunit.client.0.smithi089.stdout:7/926: symlink d3/d19/d75/dbf/l122 0 2024-09-13T02:54:05.240 INFO:tasks.workunit.client.0.smithi089.stdout:7/927: write d3/d44/d85/d55/d96/dc5/fce [4204937,57875] 0 2024-09-13T02:54:05.241 INFO:tasks.workunit.client.0.smithi089.stdout:1/691: getdents dc/d44/d73 0 2024-09-13T02:54:05.241 INFO:tasks.workunit.client.0.smithi089.stdout:9/626: write d3/d6/d2a/d94/d24/d29/f88 [2015913,17957] 0 2024-09-13T02:54:05.241 INFO:tasks.workunit.client.0.smithi089.stdout:1/692: mkdir dc/d3a/d53/d2c/d6f/dda 0 2024-09-13T02:54:05.242 INFO:tasks.workunit.client.0.smithi089.stdout:1/693: readlink dc/d3a/d53/lcd 0 2024-09-13T02:54:05.242 INFO:tasks.workunit.client.0.smithi089.stdout:1/694: write dc/f30 [1029848,97710] 0 2024-09-13T02:54:05.242 INFO:tasks.workunit.client.0.smithi089.stdout:9/627: mknod d3/d6/d2a/d94/d56/cc6 0 2024-09-13T02:54:05.243 INFO:tasks.workunit.client.0.smithi089.stdout:1/695: symlink dc/d3a/d53/d2c/d34/d8b/db5/ldb 0 2024-09-13T02:54:05.243 INFO:tasks.workunit.client.0.smithi089.stdout:1/696: write dc/d3a/d53/d2c/d94/f96 [939484,42671] 0 2024-09-13T02:54:05.243 INFO:tasks.workunit.client.0.smithi089.stdout:1/697: dread - dc/d3a/d53/d2c/d34/d8b/fbe zero size 2024-09-13T02:54:05.245 INFO:tasks.workunit.client.0.smithi089.stdout:4/847: dread d2/d3/f25 [0,4194304] 0 2024-09-13T02:54:05.245 INFO:tasks.workunit.client.0.smithi089.stdout:1/698: getdents dc/d3a 0 2024-09-13T02:54:05.245 INFO:tasks.workunit.client.0.smithi089.stdout:1/699: truncate dc/d3a/d53/d2c/d34/d8b/fc5 949571 0 2024-09-13T02:54:05.246 INFO:tasks.workunit.client.0.smithi089.stdout:4/848: mkdir d2/d22/da1/d113 0 2024-09-13T02:54:05.246 INFO:tasks.workunit.client.0.smithi089.stdout:4/849: truncate d2/d3/d5/d72/fcb 366841 0 2024-09-13T02:54:05.246 INFO:tasks.workunit.client.0.smithi089.stdout:4/850: dread - d2/d55/fbe zero size 2024-09-13T02:54:05.246 INFO:tasks.workunit.client.0.smithi089.stdout:1/700: rmdir dc/d3a 39 2024-09-13T02:54:05.246 INFO:tasks.workunit.client.0.smithi089.stdout:4/851: mknod d2/d55/c114 0 2024-09-13T02:54:05.246 INFO:tasks.workunit.client.0.smithi089.stdout:4/852: creat d2/d22/da1/d62/de8/f115 x:0 0 0 2024-09-13T02:54:05.247 INFO:tasks.workunit.client.0.smithi089.stdout:4/853: mknod d2/d3/d5/d43/d3b/d71/d10d/daf/d105/c116 0 2024-09-13T02:54:05.250 INFO:tasks.workunit.client.0.smithi089.stdout:1/701: dread dc/d44/d73/fa4 [0,4194304] 0 2024-09-13T02:54:05.250 INFO:tasks.workunit.client.0.smithi089.stdout:1/702: truncate dc/d3a/d53/f66 2261749 0 2024-09-13T02:54:05.250 INFO:tasks.workunit.client.0.smithi089.stdout:1/703: getdents dc/d44/d73 0 2024-09-13T02:54:05.250 INFO:tasks.workunit.client.0.smithi089.stdout:1/704: creat dc/d3a/d53/d2c/d94/fdc x:0 0 0 2024-09-13T02:54:05.250 INFO:tasks.workunit.client.0.smithi089.stdout:4/854: rename d2/d3/d5/d49/fac to d2/d3/d5/d43/d3b/d71/d10d/daf/dc6/f117 0 2024-09-13T02:54:05.250 INFO:tasks.workunit.client.0.smithi089.stdout:1/705: write dc/d3a/d53/d2c/d34/d8b/fb3 [882301,23976] 0 2024-09-13T02:54:05.250 INFO:tasks.workunit.client.0.smithi089.stdout:4/855: write d2/d55/f9f [645390,91854] 0 2024-09-13T02:54:05.250 INFO:tasks.workunit.client.0.smithi089.stdout:8/832: dwrite de/f10 [0,4194304] 0 2024-09-13T02:54:05.250 INFO:tasks.workunit.client.0.smithi089.stdout:6/778: dwrite db/d43/d6e/d28/d2f/f87 [0,4194304] 0 2024-09-13T02:54:05.254 INFO:tasks.workunit.client.0.smithi089.stdout:1/706: symlink dc/d44/d73/d9a/da1/ldd 0 2024-09-13T02:54:05.254 INFO:tasks.workunit.client.0.smithi089.stdout:1/707: chown dc/c35 58 1 2024-09-13T02:54:05.254 INFO:tasks.workunit.client.0.smithi089.stdout:1/708: rename dc to dc/d46/d6c/dde 22 2024-09-13T02:54:05.255 INFO:tasks.workunit.client.0.smithi089.stdout:5/795: write d1/d4/d45/d6f/d4d/d7f/d49/d5a/fe5 [3413266,35312] 0 2024-09-13T02:54:05.255 INFO:tasks.workunit.client.0.smithi089.stdout:6/779: link db/d43/d6e/d28/d2f/d9b/cde db/d10/de9/d53/d83/d9f/db1/c100 0 2024-09-13T02:54:05.257 INFO:tasks.workunit.client.0.smithi089.stdout:1/709: mkdir dc/d44/d73/d85/dd6/ddf 0 2024-09-13T02:54:05.262 INFO:tasks.workunit.client.0.smithi089.stdout:4/856: dread d2/d22/da1/d62/fbd [0,4194304] 0 2024-09-13T02:54:05.262 INFO:tasks.workunit.client.0.smithi089.stdout:4/857: chown d2/d22/da1/d62/d6c/ldc 110522267 1 2024-09-13T02:54:05.262 INFO:tasks.workunit.client.0.smithi089.stdout:4/858: truncate d2/d22/fa6 971911 0 2024-09-13T02:54:05.262 INFO:tasks.workunit.client.0.smithi089.stdout:4/859: write d2/d3/d5/d43/d3b/d71/d10d/daf/dc6/fe0 [133600,35762] 0 2024-09-13T02:54:05.262 INFO:tasks.workunit.client.0.smithi089.stdout:4/860: creat d2/d3/d5/d43/d3b/f118 x:0 0 0 2024-09-13T02:54:05.264 INFO:tasks.workunit.client.0.smithi089.stdout:9/628: dwrite d3/fc4 [0,4194304] 0 2024-09-13T02:54:05.265 INFO:tasks.workunit.client.0.smithi089.stdout:7/928: dwrite d3/d44/d85/d77/d107/f112 [0,4194304] 0 2024-09-13T02:54:05.270 INFO:tasks.workunit.client.0.smithi089.stdout:6/780: mkdir db/d43/d6e/d28/d101 0 2024-09-13T02:54:05.270 INFO:tasks.workunit.client.0.smithi089.stdout:6/781: stat db/d43/d6e/d28/d37/f52 0 2024-09-13T02:54:05.271 INFO:tasks.workunit.client.0.smithi089.stdout:1/710: rmdir dc/d44/d73/d85 39 2024-09-13T02:54:05.272 INFO:tasks.workunit.client.0.smithi089.stdout:6/782: dread db/d10/de9/d53/f94 [0,4194304] 0 2024-09-13T02:54:05.272 INFO:tasks.workunit.client.0.smithi089.stdout:6/783: truncate db/fb9 1566673 0 2024-09-13T02:54:05.272 INFO:tasks.workunit.client.0.smithi089.stdout:6/784: chown db/d43/ccf 515713 1 2024-09-13T02:54:05.278 INFO:tasks.workunit.client.0.smithi089.stdout:1/711: dread dc/d46/f55 [0,4194304] 0 2024-09-13T02:54:05.328 INFO:tasks.workunit.client.0.smithi089.stdout:5/796: rmdir d1/d4/d45/d6f 39 2024-09-13T02:54:05.331 INFO:tasks.workunit.client.0.smithi089.stdout:4/861: mknod d2/d22/da1/d62/de8/c119 0 2024-09-13T02:54:05.333 INFO:tasks.workunit.client.0.smithi089.stdout:9/629: creat d3/d15/d5a/fc7 x:0 0 0 2024-09-13T02:54:05.335 INFO:tasks.workunit.client.0.smithi089.stdout:5/797: dread d1/d4/d45/d6f/d4d/d7f/d49/d5a/fe5 [0,4194304] 0 2024-09-13T02:54:05.337 INFO:tasks.workunit.client.0.smithi089.stdout:7/929: link d3/d19/d75/f1d d3/d19/d75/db2/d105/d117/d71/d10b/f123 0 2024-09-13T02:54:05.337 INFO:tasks.workunit.client.0.smithi089.stdout:7/930: creat d3/d19/d75/db2/d105/d117/d71/f124 x:0 0 0 2024-09-13T02:54:05.337 INFO:tasks.workunit.client.0.smithi089.stdout:7/931: fdatasync d3/d19/d2e/f4f 0 2024-09-13T02:54:05.338 INFO:tasks.workunit.client.0.smithi089.stdout:6/785: truncate db/d43/d6e/d28/d37/d8b/dcd/d7d/fe8 61688 0 2024-09-13T02:54:05.340 INFO:tasks.workunit.client.0.smithi089.stdout:9/630: dread d3/d6/d2a/d4b/d54/dc1/f7d [0,4194304] 0 2024-09-13T02:54:05.341 INFO:tasks.workunit.client.0.smithi089.stdout:1/712: mkdir dc/d6e/de0 0 2024-09-13T02:54:05.342 INFO:tasks.workunit.client.0.smithi089.stdout:0/703: sync 2024-09-13T02:54:05.342 INFO:tasks.workunit.client.0.smithi089.stdout:2/702: sync 2024-09-13T02:54:05.352 INFO:tasks.workunit.client.0.smithi089.stdout:4/862: dwrite d2/d3/d5/d43/d3b/f10c [0,4194304] 0 2024-09-13T02:54:05.371 INFO:tasks.workunit.client.0.smithi089.stdout:3/750: sync 2024-09-13T02:54:05.372 INFO:tasks.workunit.client.0.smithi089.stdout:4/863: dwrite d2/da/f75 [4194304,4194304] 0 2024-09-13T02:54:05.372 INFO:tasks.workunit.client.0.smithi089.stdout:4/864: creat d2/d55/f11a x:0 0 0 2024-09-13T02:54:05.373 INFO:tasks.workunit.client.0.smithi089.stdout:4/865: chown d2/d3/d5/d43/d3b/f118 5853577 1 2024-09-13T02:54:05.373 INFO:tasks.workunit.client.0.smithi089.stdout:4/866: readlink d2/da/l21 0 2024-09-13T02:54:05.398 INFO:tasks.workunit.client.0.smithi089.stdout:5/798: rename d1/d4/d45/f82 to d1/d7/ffa 0 2024-09-13T02:54:05.398 INFO:tasks.workunit.client.0.smithi089.stdout:5/799: truncate d1/d4/fc 5628868 0 2024-09-13T02:54:05.399 INFO:tasks.workunit.client.0.smithi089.stdout:7/932: creat d3/d19/d75/db2/f125 x:0 0 0 2024-09-13T02:54:05.400 INFO:tasks.workunit.client.0.smithi089.stdout:6/786: mkdir db/d10/dc1/d102 0 2024-09-13T02:54:05.401 INFO:tasks.workunit.client.0.smithi089.stdout:1/713: mkdir dc/d44/d73/d85/dd6/dd7/de1 0 2024-09-13T02:54:05.402 INFO:tasks.workunit.client.0.smithi089.stdout:0/704: mknod d2/d19/d1a/d4e/cec 0 2024-09-13T02:54:05.403 INFO:tasks.workunit.client.0.smithi089.stdout:5/800: read d1/d4/d2b/f52 [3461181,74994] 0 2024-09-13T02:54:05.415 INFO:tasks.workunit.client.0.smithi089.stdout:1/714: dwrite dc/d46/f89 [0,4194304] 0 2024-09-13T02:54:05.425 INFO:tasks.workunit.client.0.smithi089.stdout:1/715: write dc/d44/d73/f5b [1523991,122405] 0 2024-09-13T02:54:05.450 INFO:tasks.workunit.client.0.smithi089.stdout:8/833: sync 2024-09-13T02:54:05.815 INFO:tasks.workunit.client.0.smithi089.stdout:4/867: unlink d2/d3/d5/d43/d3b/fd2 0 2024-09-13T02:54:05.817 INFO:tasks.workunit.client.0.smithi089.stdout:3/751: rename d2/d8/dc/d9a/d9c/d83/db6/f84 to d2/d8/d5f/fed 0 2024-09-13T02:54:05.817 INFO:tasks.workunit.client.0.smithi089.stdout:3/752: readlink d2/d20/l61 0 2024-09-13T02:54:05.817 INFO:tasks.workunit.client.0.smithi089.stdout:3/753: write d2/d20/d23/d32/d5b/f9d [906058,54353] 0 2024-09-13T02:54:05.818 INFO:tasks.workunit.client.0.smithi089.stdout:7/933: symlink d3/d19/d75/db2/l126 0 2024-09-13T02:54:05.819 INFO:tasks.workunit.client.0.smithi089.stdout:9/631: getdents d3/d6/d2a/d94/d24 0 2024-09-13T02:54:05.820 INFO:tasks.workunit.client.0.smithi089.stdout:2/703: mknod d13/d30/db1/cf3 0 2024-09-13T02:54:05.821 INFO:tasks.workunit.client.0.smithi089.stdout:5/801: symlink d1/d4/d45/d6f/d4d/d9d/lfb 0 2024-09-13T02:54:05.824 INFO:tasks.workunit.client.0.smithi089.stdout:1/716: truncate dc/d3a/d53/d2c/d34/f39 2946157 0 2024-09-13T02:54:05.824 INFO:tasks.workunit.client.0.smithi089.stdout:1/717: stat dc/d3a/d53/d2c/d34/d8b/db5/d9d/l9e 0 2024-09-13T02:54:05.828 INFO:tasks.workunit.client.0.smithi089.stdout:8/834: creat de/d16/d1e/d3f/d106/d117/f121 x:0 0 0 2024-09-13T02:54:05.828 INFO:tasks.workunit.client.0.smithi089.stdout:8/835: stat de/fcd 0 2024-09-13T02:54:05.837 INFO:tasks.workunit.client.0.smithi089.stdout:6/787: rename db/d43/d6e/d28/d2f/d9b/lee to db/db2/l103 0 2024-09-13T02:54:05.838 INFO:tasks.workunit.client.0.smithi089.stdout:1/718: write dc/d3a/d53/d2c/d34/f78 [2353601,25505] 0 2024-09-13T02:54:05.838 INFO:tasks.workunit.client.0.smithi089.stdout:1/719: getdents dc/d44/d73/d85/dd6/dd7/de1 0 2024-09-13T02:54:05.838 INFO:tasks.workunit.client.0.smithi089.stdout:1/720: fdatasync dc/d46/d6c/f71 0 2024-09-13T02:54:05.838 INFO:tasks.workunit.client.0.smithi089.stdout:1/721: chown dc/d3a/d53/d2c/f2e 39095 1 2024-09-13T02:54:05.839 INFO:tasks.workunit.client.0.smithi089.stdout:9/632: link d3/d6/d2a/f60 d3/d6/d2a/d94/d24/d35/fc8 0 2024-09-13T02:54:05.839 INFO:tasks.workunit.client.0.smithi089.stdout:1/722: dread dc/d6e/fa3 [0,4194304] 0 2024-09-13T02:54:05.839 INFO:tasks.workunit.client.0.smithi089.stdout:2/704: truncate d13/d30/d61/d78/d79/f85 851890 0 2024-09-13T02:54:05.841 INFO:tasks.workunit.client.0.smithi089.stdout:0/705: link d2/fe d2/d64/db3/dc6/fed 0 2024-09-13T02:54:05.841 INFO:tasks.workunit.client.0.smithi089.stdout:0/706: truncate d2/d19/d1a/d1e/d42/f74 1764328 0 2024-09-13T02:54:05.842 INFO:tasks.workunit.client.0.smithi089.stdout:0/707: dread - d2/d64/db3/de0/fe3 zero size 2024-09-13T02:54:05.842 INFO:tasks.workunit.client.0.smithi089.stdout:7/934: rename d3/d19/d75/db2/lfc to d3/d19/d2e/d37/l127 0 2024-09-13T02:54:05.842 INFO:tasks.workunit.client.0.smithi089.stdout:7/935: chown d3/d19/d75/fea 1172238 1 2024-09-13T02:54:05.845 INFO:tasks.workunit.client.0.smithi089.stdout:1/723: truncate dc/d46/f79 408588 0 2024-09-13T02:54:05.845 INFO:tasks.workunit.client.0.smithi089.stdout:1/724: write dc/d6e/fa3 [924081,123318] 0 2024-09-13T02:54:05.845 INFO:tasks.workunit.client.0.smithi089.stdout:4/868: dwrite d2/d22/da1/d62/d6c/d88/db2/f112 [0,4194304] 0 2024-09-13T02:54:05.845 INFO:tasks.workunit.client.0.smithi089.stdout:7/936: unlink d3/d19/d67/f7b 0 2024-09-13T02:54:05.847 INFO:tasks.workunit.client.0.smithi089.stdout:5/802: rename d1/l81 to d1/d4/d45/d6f/lfc 0 2024-09-13T02:54:05.848 INFO:tasks.workunit.client.0.smithi089.stdout:6/788: rmdir db/d10/d3a 39 2024-09-13T02:54:05.848 INFO:tasks.workunit.client.0.smithi089.stdout:6/789: write db/d10/d3a/fa5 [3130869,95366] 0 2024-09-13T02:54:05.849 INFO:tasks.workunit.client.0.smithi089.stdout:1/725: creat dc/d46/d6c/d98/fe2 x:0 0 0 2024-09-13T02:54:05.850 INFO:tasks.workunit.client.0.smithi089.stdout:3/754: dwrite d2/d8/dc/d3c/f5d [0,4194304] 0 2024-09-13T02:54:05.850 INFO:tasks.workunit.client.0.smithi089.stdout:3/755: creat d2/d90/fee x:0 0 0 2024-09-13T02:54:05.851 INFO:tasks.workunit.client.0.smithi089.stdout:3/756: write d2/d20/d23/d2b/f2f [5578890,35300] 0 2024-09-13T02:54:05.853 INFO:tasks.workunit.client.0.smithi089.stdout:4/869: mkdir d2/d3/d5/d43/d11b 0 2024-09-13T02:54:05.853 INFO:tasks.workunit.client.0.smithi089.stdout:4/870: chown d2/d3/d5/d43/d3b/d71/d10d/daf/d8f/lcc 5787345 1 2024-09-13T02:54:05.853 INFO:tasks.workunit.client.0.smithi089.stdout:4/871: creat d2/d22/da1/d62/de8/f11c x:0 0 0 2024-09-13T02:54:05.855 INFO:tasks.workunit.client.0.smithi089.stdout:7/937: creat d3/d19/d75/db2/d105/d117/da0/db0/d116/f128 x:0 0 0 2024-09-13T02:54:05.855 INFO:tasks.workunit.client.0.smithi089.stdout:7/938: stat d3/d44/d85/d55/f8d 0 2024-09-13T02:54:05.856 INFO:tasks.workunit.client.0.smithi089.stdout:8/836: rename de/d16/d1e/d20/d39/df5/dff/fba to de/d16/d1e/d3f/d106/f122 0 2024-09-13T02:54:05.858 INFO:tasks.workunit.client.0.smithi089.stdout:4/872: dread d2/d3/d86/fc1 [0,4194304] 0 2024-09-13T02:54:05.858 INFO:tasks.workunit.client.0.smithi089.stdout:4/873: chown d2/d22/f35 113 1 2024-09-13T02:54:05.859 INFO:tasks.workunit.client.0.smithi089.stdout:0/708: write d2/d19/d1a/d1e/d42/f5d [563275,93472] 0 2024-09-13T02:54:05.861 INFO:tasks.workunit.client.0.smithi089.stdout:5/803: dread d1/d4/d45/d6f/d7c/fba [0,4194304] 0 2024-09-13T02:54:05.861 INFO:tasks.workunit.client.0.smithi089.stdout:5/804: chown d1/f26 54840 1 2024-09-13T02:54:05.866 INFO:tasks.workunit.client.0.smithi089.stdout:6/790: dwrite db/d10/de9/d53/f5a [4194304,4194304] 0 2024-09-13T02:54:05.867 INFO:tasks.workunit.client.0.smithi089.stdout:1/726: dread dc/d3a/d53/d2c/d34/f5f [0,4194304] 0 2024-09-13T02:54:05.867 INFO:tasks.workunit.client.0.smithi089.stdout:1/727: stat dc/d3a/d53/d2c/d34/c37 0 2024-09-13T02:54:05.872 INFO:tasks.workunit.client.0.smithi089.stdout:9/633: dwrite d3/d3d/f67 [0,4194304] 0 2024-09-13T02:54:05.872 INFO:tasks.workunit.client.0.smithi089.stdout:9/634: write d3/d6/f65 [842965,64395] 0 2024-09-13T02:54:05.872 INFO:tasks.workunit.client.0.smithi089.stdout:9/635: chown d3/d6/d2a/c76 1 1 2024-09-13T02:54:05.872 INFO:tasks.workunit.client.0.smithi089.stdout:9/636: fdatasync d3/d6/d2a/d94/d24/f69 0 2024-09-13T02:54:05.886 INFO:tasks.workunit.client.0.smithi089.stdout:8/837: dwrite de/d16/d1e/f83 [0,4194304] 0 2024-09-13T02:54:05.886 INFO:tasks.workunit.client.0.smithi089.stdout:8/838: fdatasync de/fcd 0 2024-09-13T02:54:05.886 INFO:tasks.workunit.client.0.smithi089.stdout:5/805: dwrite d1/d4/d45/fd5 [0,4194304] 0 2024-09-13T02:54:05.886 INFO:tasks.workunit.client.0.smithi089.stdout:5/806: stat d1/d4/f97 0 2024-09-13T02:54:05.890 INFO:tasks.workunit.client.0.smithi089.stdout:5/807: dread d1/d4/d2b/f52 [0,4194304] 0 2024-09-13T02:54:06.057 INFO:tasks.workunit.client.0.smithi089.stdout:3/757: unlink d2/d20/d44/c6d 0 2024-09-13T02:54:06.057 INFO:tasks.workunit.client.0.smithi089.stdout:3/758: write d2/d8/dc/fa6 [790452,33133] 0 2024-09-13T02:54:06.057 INFO:tasks.workunit.client.0.smithi089.stdout:3/759: chown d2/d8/d5f/d72 32055 1 2024-09-13T02:54:06.057 INFO:tasks.workunit.client.0.smithi089.stdout:3/760: creat d2/d8/dc/d3c/fef x:0 0 0 2024-09-13T02:54:06.057 INFO:tasks.workunit.client.0.smithi089.stdout:3/761: fdatasync d2/f9b 0 2024-09-13T02:54:06.059 INFO:tasks.workunit.client.0.smithi089.stdout:7/939: mkdir d3/d19/d75/d129 0 2024-09-13T02:54:06.059 INFO:tasks.workunit.client.0.smithi089.stdout:7/940: chown d3/d44/d85/d5e/d6f/cdc 1 1 2024-09-13T02:54:06.061 INFO:tasks.workunit.client.0.smithi089.stdout:2/705: rename d13/d30/d61/d78/fd7 to d13/d30/d4e/ff4 0 2024-09-13T02:54:06.063 INFO:tasks.workunit.client.0.smithi089.stdout:4/874: truncate d2/d3/d5/f2e 385067 0 2024-09-13T02:54:06.065 INFO:tasks.workunit.client.0.smithi089.stdout:0/709: rmdir d2/d19/d1a/d1e 39 2024-09-13T02:54:06.068 INFO:tasks.workunit.client.0.smithi089.stdout:6/791: link db/d43/d6e/d28/d2f/f50 db/d10/d3a/d7b/f104 0 2024-09-13T02:54:06.069 INFO:tasks.workunit.client.0.smithi089.stdout:1/728: mkdir dc/d3a/d53/d2c/d34/d9b/dd8/de3 0 2024-09-13T02:54:06.072 INFO:tasks.workunit.client.0.smithi089.stdout:7/941: write d3/d44/d85/d5e/d6f/f89 [333329,127711] 0 2024-09-13T02:54:06.074 INFO:tasks.workunit.client.0.smithi089.stdout:9/637: creat d3/d3d/d8b/dba/fc9 x:0 0 0 2024-09-13T02:54:06.075 INFO:tasks.workunit.client.0.smithi089.stdout:4/875: write d2/fd9 [4084944,95080] 0 2024-09-13T02:54:06.075 INFO:tasks.workunit.client.0.smithi089.stdout:8/839: unlink de/d16/f10e 0 2024-09-13T02:54:06.080 INFO:tasks.workunit.client.0.smithi089.stdout:5/808: symlink d1/d4/ddb/lfd 0 2024-09-13T02:54:06.089 INFO:tasks.workunit.client.0.smithi089.stdout:2/706: mknod d13/d30/d59/dbe/dec/cf5 0 2024-09-13T02:54:06.090 INFO:tasks.workunit.client.0.smithi089.stdout:0/710: rmdir d2/d19/d1a/d3d/d4b/ddf 0 2024-09-13T02:54:06.091 INFO:tasks.workunit.client.0.smithi089.stdout:0/711: creat d2/d64/fee x:0 0 0 2024-09-13T02:54:06.092 INFO:tasks.workunit.client.0.smithi089.stdout:6/792: mknod db/d43/d6e/d28/d2f/d9b/c105 0 2024-09-13T02:54:06.093 INFO:tasks.workunit.client.0.smithi089.stdout:6/793: fdatasync db/db2/fb7 0 2024-09-13T02:54:06.093 INFO:tasks.workunit.client.0.smithi089.stdout:6/794: creat db/f106 x:0 0 0 2024-09-13T02:54:06.093 INFO:tasks.workunit.client.0.smithi089.stdout:6/795: fsync db/d43/d6e/d28/d37/f52 0 2024-09-13T02:54:06.093 INFO:tasks.workunit.client.0.smithi089.stdout:7/942: mkdir d3/d19/d75/db2/d12a 0 2024-09-13T02:54:06.095 INFO:tasks.workunit.client.0.smithi089.stdout:9/638: creat d3/d6/d2a/d94/d24/fca x:0 0 0 2024-09-13T02:54:06.096 INFO:tasks.workunit.client.0.smithi089.stdout:1/729: dwrite dc/f13 [0,4194304] 0 2024-09-13T02:54:06.098 INFO:tasks.workunit.client.0.smithi089.stdout:8/840: dwrite de/d16/d1e/d20/d6c/d10f/f114 [0,4194304] 0 2024-09-13T02:54:06.099 INFO:tasks.workunit.client.0.smithi089.stdout:4/876: unlink d2/d3/d5/d43/d3b/d71/d10d/daf/d8f/lcc 0 2024-09-13T02:54:06.100 INFO:tasks.workunit.client.0.smithi089.stdout:3/762: unlink d2/d8/dc/d3c/fef 0 2024-09-13T02:54:06.101 INFO:tasks.workunit.client.0.smithi089.stdout:2/707: mknod d13/d30/d4e/d7b/d86/cf6 0 2024-09-13T02:54:06.101 INFO:tasks.workunit.client.0.smithi089.stdout:2/708: dread - d13/fdf zero size 2024-09-13T02:54:06.101 INFO:tasks.workunit.client.0.smithi089.stdout:2/709: read d13/d30/d4e/d6f/f8f [797627,32092] 0 2024-09-13T02:54:06.104 INFO:tasks.workunit.client.0.smithi089.stdout:0/712: mkdir d2/d19/def 0 2024-09-13T02:54:06.105 INFO:tasks.workunit.client.0.smithi089.stdout:7/943: unlink d3/d19/d75/db2/d105/d117/d71/fc2 0 2024-09-13T02:54:06.107 INFO:tasks.workunit.client.0.smithi089.stdout:9/639: write d3/d6/f14 [2063839,44403] 0 2024-09-13T02:54:06.107 INFO:tasks.workunit.client.0.smithi089.stdout:9/640: chown d3/d6/d2a/d4b/d54/da1/fad 21726 1 2024-09-13T02:54:06.108 INFO:tasks.workunit.client.0.smithi089.stdout:9/641: truncate d3/d6/d2a/d4b/d54/dc1/f4a 2059819 0 2024-09-13T02:54:06.108 INFO:tasks.workunit.client.0.smithi089.stdout:1/730: symlink dc/d3a/d53/d2c/d34/d9b/dd8/le4 0 2024-09-13T02:54:06.108 INFO:tasks.workunit.client.0.smithi089.stdout:1/731: readlink dc/l2a 0 2024-09-13T02:54:06.112 INFO:tasks.workunit.client.0.smithi089.stdout:3/763: write d2/d20/d23/d27/f4e [574099,80828] 0 2024-09-13T02:54:06.117 INFO:tasks.workunit.client.0.smithi089.stdout:4/877: unlink d2/d3/d86/ff6 0 2024-09-13T02:54:06.119 INFO:tasks.workunit.client.0.smithi089.stdout:7/944: symlink d3/d44/d85/d77/d107/l12b 0 2024-09-13T02:54:06.120 INFO:tasks.workunit.client.0.smithi089.stdout:1/732: mknod dc/d6e/de0/ce5 0 2024-09-13T02:54:06.122 INFO:tasks.workunit.client.0.smithi089.stdout:8/841: dwrite de/d16/d1e/d3f/d106/d117/f11b [0,4194304] 0 2024-09-13T02:54:06.122 INFO:tasks.workunit.client.0.smithi089.stdout:2/710: dwrite d13/d30/f95 [0,4194304] 0 2024-09-13T02:54:06.123 INFO:tasks.workunit.client.0.smithi089.stdout:3/764: mkdir d2/d8/dc/d3c/d65/df0 0 2024-09-13T02:54:06.124 INFO:tasks.workunit.client.0.smithi089.stdout:0/713: getdents d2/d19/d1a/dbe 0 2024-09-13T02:54:06.125 INFO:tasks.workunit.client.0.smithi089.stdout:7/945: fsync d3/d44/d85/d77/d107/da1/fc4 0 2024-09-13T02:54:06.131 INFO:tasks.workunit.client.0.smithi089.stdout:2/711: mkdir d13/d30/d4e/d7b/df7 0 2024-09-13T02:54:06.133 INFO:tasks.workunit.client.0.smithi089.stdout:3/765: creat d2/d20/d23/d27/ddc/ff1 x:0 0 0 2024-09-13T02:54:06.133 INFO:tasks.workunit.client.0.smithi089.stdout:3/766: creat d2/d8/dc/d57/ff2 x:0 0 0 2024-09-13T02:54:06.135 INFO:tasks.workunit.client.0.smithi089.stdout:2/712: symlink d13/d30/d4e/d7b/lf8 0 2024-09-13T02:54:06.137 INFO:tasks.workunit.client.0.smithi089.stdout:0/714: getdents d2/d19/d1a/d4e 0 2024-09-13T02:54:06.140 INFO:tasks.workunit.client.0.smithi089.stdout:4/878: rename d2/d3/d5/d43/d3b/d71/d10d/daf/dc6/ld1 to d2/l11d 0 2024-09-13T02:54:06.143 INFO:tasks.workunit.client.0.smithi089.stdout:8/842: rename f9 to de/d16/d1e/d3f/d5b/f123 0 2024-09-13T02:54:06.146 INFO:tasks.workunit.client.0.smithi089.stdout:7/946: rename d3/d19/d75/c49 to d3/d44/d85/d55/d96/dc5/d111/c12c 0 2024-09-13T02:54:06.147 INFO:tasks.workunit.client.0.smithi089.stdout:8/843: link de/d16/d1e/d20/l25 de/d16/d1e/d20/d39/l124 0 2024-09-13T02:54:06.150 INFO:tasks.workunit.client.0.smithi089.stdout:0/715: rename d2/d19/c70 to d2/d64/db3/dc6/cf0 0 2024-09-13T02:54:06.150 INFO:tasks.workunit.client.0.smithi089.stdout:0/716: dread - d2/d19/d1a/d3d/d4b/d4f/f93 zero size 2024-09-13T02:54:06.152 INFO:tasks.workunit.client.0.smithi089.stdout:4/879: rename d2/d3/d5/d43/d3b/f60 to d2/d3/d5/d43/d3b/d71/d10d/daf/dc6/f11e 0 2024-09-13T02:54:06.152 INFO:tasks.workunit.client.0.smithi089.stdout:0/717: rmdir d2/d19/d1a/da4 39 2024-09-13T02:54:06.154 INFO:tasks.workunit.client.0.smithi089.stdout:4/880: symlink d2/d3/d5/d49/l11f 0 2024-09-13T02:54:06.154 INFO:tasks.workunit.client.0.smithi089.stdout:4/881: chown d2/d3/d5/d43/d3b/d71/d10d/daf/d105/c116 757 1 2024-09-13T02:54:06.156 INFO:tasks.workunit.client.0.smithi089.stdout:2/713: dwrite d13/d30/f4a [4194304,4194304] 0 2024-09-13T02:54:06.157 INFO:tasks.workunit.client.0.smithi089.stdout:0/718: rename d2/c86 to d2/d64/db3/dc6/cf1 0 2024-09-13T02:54:06.158 INFO:tasks.workunit.client.0.smithi089.stdout:2/714: link d13/d30/d61/d78/d79/d90/fad d13/d30/ff9 0 2024-09-13T02:54:06.161 INFO:tasks.workunit.client.0.smithi089.stdout:0/719: link d2/d19/f2d d2/d19/d1a/ff2 0 2024-09-13T02:54:06.161 INFO:tasks.workunit.client.0.smithi089.stdout:0/720: write d2/d19/d1a/d4e/d7a/d9b/fe9 [339686,73079] 0 2024-09-13T02:54:06.161 INFO:tasks.workunit.client.0.smithi089.stdout:7/947: dread d3/d19/d75/f4a [0,4194304] 0 2024-09-13T02:54:06.162 INFO:tasks.workunit.client.0.smithi089.stdout:7/948: chown d3/d19/d75/db2/d105/d117/da0/c74 3068657 1 2024-09-13T02:54:06.162 INFO:tasks.workunit.client.0.smithi089.stdout:8/844: write de/faf [2129428,126661] 0 2024-09-13T02:54:06.162 INFO:tasks.workunit.client.0.smithi089.stdout:3/767: dwrite d2/d20/fc0 [0,4194304] 0 2024-09-13T02:54:06.162 INFO:tasks.workunit.client.0.smithi089.stdout:3/768: creat d2/d8/ff3 x:0 0 0 2024-09-13T02:54:06.162 INFO:tasks.workunit.client.0.smithi089.stdout:3/769: chown d2/d20/d23/d2b/l3b 4 1 2024-09-13T02:54:06.163 INFO:tasks.workunit.client.0.smithi089.stdout:7/949: symlink d3/d19/d75/db2/dfe/l12d 0 2024-09-13T02:54:06.163 INFO:tasks.workunit.client.0.smithi089.stdout:7/950: fsync d3/d19/d75/dbf/fe0 0 2024-09-13T02:54:06.165 INFO:tasks.workunit.client.0.smithi089.stdout:8/845: mkdir de/d16/d1e/d20/d39/df5/dff/d61/d8e/d109/d125 0 2024-09-13T02:54:06.167 INFO:tasks.workunit.client.0.smithi089.stdout:3/770: creat d2/d8/dc/d9a/d9c/dab/ff4 x:0 0 0 2024-09-13T02:54:06.169 INFO:tasks.workunit.client.0.smithi089.stdout:7/951: creat d3/d44/d85/d77/dd7/f12e x:0 0 0 2024-09-13T02:54:06.170 INFO:tasks.workunit.client.0.smithi089.stdout:3/771: mknod d2/d20/d23/cf5 0 2024-09-13T02:54:06.173 INFO:tasks.workunit.client.0.smithi089.stdout:7/952: link d3/d19/d2e/l35 d3/d44/d85/d77/dd7/df9/l12f 0 2024-09-13T02:54:06.173 INFO:tasks.workunit.client.0.smithi089.stdout:7/953: stat d3/d19/d75/db2/fd9 0 2024-09-13T02:54:06.173 INFO:tasks.workunit.client.0.smithi089.stdout:7/954: write d3/d19/d75/f1d [799552,45721] 0 2024-09-13T02:54:06.174 INFO:tasks.workunit.client.0.smithi089.stdout:4/882: dwrite d2/d3/d86/dfd/fb4 [0,4194304] 0 2024-09-13T02:54:06.176 INFO:tasks.workunit.client.0.smithi089.stdout:3/772: symlink d2/d8/dc/d9a/d9c/lf6 0 2024-09-13T02:54:06.181 INFO:tasks.workunit.client.0.smithi089.stdout:4/883: write d2/d22/da1/d62/d6c/d88/db2/fc7 [1177763,42402] 0 2024-09-13T02:54:06.181 INFO:tasks.workunit.client.0.smithi089.stdout:4/884: dread - d2/d22/da1/d62/de8/f115 zero size 2024-09-13T02:54:06.182 INFO:tasks.workunit.client.0.smithi089.stdout:7/955: write d3/d44/d85/d55/d96/dc5/fd1 [408433,7509] 0 2024-09-13T02:54:06.183 INFO:tasks.workunit.client.0.smithi089.stdout:3/773: rename d2/d20/d23/c69 to d2/d20/d23/d32/d5b/cf7 0 2024-09-13T02:54:06.184 INFO:tasks.workunit.client.0.smithi089.stdout:4/885: chown d2/l9e 1 1 2024-09-13T02:54:06.184 INFO:tasks.workunit.client.0.smithi089.stdout:4/886: write d2/d22/da1/d62/d6c/d88/fa7 [305055,100768] 0 2024-09-13T02:54:06.184 INFO:tasks.workunit.client.0.smithi089.stdout:4/887: readlink d2/d3/d5/d43/d3b/d71/d10d/la0 0 2024-09-13T02:54:06.184 INFO:tasks.workunit.client.0.smithi089.stdout:4/888: dread - d2/d22/da1/d62/de8/f111 zero size 2024-09-13T02:54:06.185 INFO:tasks.workunit.client.0.smithi089.stdout:4/889: mkdir d2/d22/d120 0 2024-09-13T02:54:06.189 INFO:tasks.workunit.client.0.smithi089.stdout:3/774: dread d2/d20/f39 [0,4194304] 0 2024-09-13T02:54:06.190 INFO:tasks.workunit.client.0.smithi089.stdout:3/775: mkdir d2/d20/d23/df8 0 2024-09-13T02:54:06.196 INFO:tasks.workunit.client.0.smithi089.stdout:7/956: write d3/d44/d85/d55/d96/dc5/fce [1494633,115399] 0 2024-09-13T02:54:06.196 INFO:tasks.workunit.client.0.smithi089.stdout:7/957: chown d3/d19/d2e/d37/dad/d109 184 1 2024-09-13T02:54:06.196 INFO:tasks.workunit.client.0.smithi089.stdout:7/958: readlink d3/d19/d2e/d37/l7d 0 2024-09-13T02:54:06.196 INFO:tasks.workunit.client.0.smithi089.stdout:3/776: dread d2/d20/d23/d2b/f53 [0,4194304] 0 2024-09-13T02:54:06.197 INFO:tasks.workunit.client.0.smithi089.stdout:7/959: rmdir d3/d19/d75/db2/d105/d117 39 2024-09-13T02:54:06.197 INFO:tasks.workunit.client.0.smithi089.stdout:7/960: write d3/d19/d75/db2/d105/d117/da0/db0/fd0 [1285152,18909] 0 2024-09-13T02:54:06.199 INFO:tasks.workunit.client.0.smithi089.stdout:3/777: rmdir d2/d20/d23/d32/d49/dea/dc8 0 2024-09-13T02:54:06.201 INFO:tasks.workunit.client.0.smithi089.stdout:3/778: creat d2/d20/d23/df8/ff9 x:0 0 0 2024-09-13T02:54:06.201 INFO:tasks.workunit.client.0.smithi089.stdout:3/779: chown d2/d20/d23/d32/d49/dea/fbf 4146258 1 2024-09-13T02:54:06.201 INFO:tasks.workunit.client.0.smithi089.stdout:3/780: readlink d2/d20/d44/l76 0 2024-09-13T02:54:06.210 INFO:tasks.workunit.client.0.smithi089.stdout:8/846: dwrite de/d16/d1e/d20/d39/df5/dff/d61/fc8 [0,4194304] 0 2024-09-13T02:54:06.210 INFO:tasks.workunit.client.0.smithi089.stdout:2/715: dwrite fc [0,4194304] 0 2024-09-13T02:54:06.210 INFO:tasks.workunit.client.0.smithi089.stdout:8/847: dread - de/d16/d1e/d27/d76/f98 zero size 2024-09-13T02:54:06.210 INFO:tasks.workunit.client.0.smithi089.stdout:2/716: write d13/d30/d4e/ff4 [4602481,48107] 0 2024-09-13T02:54:06.210 INFO:tasks.workunit.client.0.smithi089.stdout:2/717: chown d13/f43 325 1 2024-09-13T02:54:06.211 INFO:tasks.workunit.client.0.smithi089.stdout:2/718: creat d13/d30/d61/d78/d9c/ffa x:0 0 0 2024-09-13T02:54:06.211 INFO:tasks.workunit.client.0.smithi089.stdout:0/721: dwrite d2/d19/d1a/d4e/d7a/f90 [4194304,4194304] 0 2024-09-13T02:54:06.211 INFO:tasks.workunit.client.0.smithi089.stdout:4/890: dwrite d2/d22/da1/f2d [0,4194304] 0 2024-09-13T02:54:06.215 INFO:tasks.workunit.client.0.smithi089.stdout:8/848: mknod de/d16/d1e/d3f/d106/d117/c126 0 2024-09-13T02:54:06.219 INFO:tasks.workunit.client.0.smithi089.stdout:4/891: unlink d2/d3/d86/dfd/le1 0 2024-09-13T02:54:06.219 INFO:tasks.workunit.client.0.smithi089.stdout:4/892: write d2/d3/d5/d43/d84/f108 [481746,58476] 0 2024-09-13T02:54:06.220 INFO:tasks.workunit.client.0.smithi089.stdout:3/781: dwrite d2/d90/fa9 [0,4194304] 0 2024-09-13T02:54:06.221 INFO:tasks.workunit.client.0.smithi089.stdout:8/849: creat de/d16/d1e/d3f/dd9/f127 x:0 0 0 2024-09-13T02:54:06.222 INFO:tasks.workunit.client.0.smithi089.stdout:0/722: getdents d2/d19/d1a/d3d/d4b/d4f/d59/d6b 0 2024-09-13T02:54:06.225 INFO:tasks.workunit.client.0.smithi089.stdout:3/782: rmdir d2/d8b 39 2024-09-13T02:54:06.225 INFO:tasks.workunit.client.0.smithi089.stdout:3/783: chown d2/d8/dc/d3c/d9e 181 1 2024-09-13T02:54:06.227 INFO:tasks.workunit.client.0.smithi089.stdout:8/850: mkdir de/d16/d1e/d27/d76/d128 0 2024-09-13T02:54:06.229 INFO:tasks.workunit.client.0.smithi089.stdout:8/851: write de/d16/f1c [210740,20348] 0 2024-09-13T02:54:06.229 INFO:tasks.workunit.client.0.smithi089.stdout:3/784: link d2/d8/dc/d57/ff2 d2/d8/d5f/ffa 0 2024-09-13T02:54:06.229 INFO:tasks.workunit.client.0.smithi089.stdout:8/852: fdatasync de/d16/d1e/d27/d76/fed 0 2024-09-13T02:54:06.229 INFO:tasks.workunit.client.0.smithi089.stdout:3/785: write d2/d8/dc/d9a/fb8 [1012810,71943] 0 2024-09-13T02:54:06.229 INFO:tasks.workunit.client.0.smithi089.stdout:3/786: chown d2/d20/l34 11044 1 2024-09-13T02:54:06.229 INFO:tasks.workunit.client.0.smithi089.stdout:3/787: creat d2/d8/d5f/ffb x:0 0 0 2024-09-13T02:54:06.229 INFO:tasks.workunit.client.0.smithi089.stdout:3/788: fsync d2/d20/d23/d27/f4e 0 2024-09-13T02:54:06.229 INFO:tasks.workunit.client.0.smithi089.stdout:3/789: read d2/d20/d23/d32/d5b/d71/f93 [137924,86731] 0 2024-09-13T02:54:06.231 INFO:tasks.workunit.client.0.smithi089.stdout:3/790: link d2/d20/d23/d32/d49/f56 d2/d20/d23/d32/d5b/d71/ffc 0 2024-09-13T02:54:06.231 INFO:tasks.workunit.client.0.smithi089.stdout:3/791: chown d2/d8/dc/d3c 1564518 1 2024-09-13T02:54:06.236 INFO:tasks.workunit.client.0.smithi089.stdout:0/723: dwrite d2/d19/d1a/d1e/d42/f74 [0,4194304] 0 2024-09-13T02:54:06.240 INFO:tasks.workunit.client.0.smithi089.stdout:8/853: dread de/d16/d1e/d20/f37 [0,4194304] 0 2024-09-13T02:54:06.240 INFO:tasks.workunit.client.0.smithi089.stdout:8/854: dread - de/d16/d1e/d27/d76/fed zero size 2024-09-13T02:54:06.240 INFO:tasks.workunit.client.0.smithi089.stdout:8/855: chown de/d16/d1e/d3f/d106/d117/f11b 84585049 1 2024-09-13T02:54:06.240 INFO:tasks.workunit.client.0.smithi089.stdout:8/856: chown de/d16/d1e/d27/d76/f98 0 1 2024-09-13T02:54:06.240 INFO:tasks.workunit.client.0.smithi089.stdout:8/857: readlink de/d16/d1e/d27/d76/l62 0 2024-09-13T02:54:06.241 INFO:tasks.workunit.client.0.smithi089.stdout:0/724: mkdir d2/d64/db3/de0/df3 0 2024-09-13T02:54:06.241 INFO:tasks.workunit.client.0.smithi089.stdout:0/725: fdatasync d2/d19/d1a/d1e/f31 0 2024-09-13T02:54:06.251 INFO:tasks.workunit.client.0.smithi089.stdout:8/858: dread de/d56/ff1 [0,4194304] 0 2024-09-13T02:54:06.252 INFO:tasks.workunit.client.0.smithi089.stdout:8/859: mkdir de/d16/d1e/d3f/dd9/d129 0 2024-09-13T02:54:06.252 INFO:tasks.workunit.client.0.smithi089.stdout:8/860: chown de/d16/d1e/d27/d76/l9d 4021279 1 2024-09-13T02:54:06.252 INFO:tasks.workunit.client.0.smithi089.stdout:8/861: dread de/d16/d1e/f47 [0,4194304] 0 2024-09-13T02:54:06.268 INFO:tasks.workunit.client.0.smithi089.stdout:0/726: dwrite d2/d64/db3/dc6/fe7 [0,4194304] 0 2024-09-13T02:54:06.268 INFO:tasks.workunit.client.0.smithi089.stdout:8/862: dwrite de/d16/d1e/d27/d76/f89 [0,4194304] 0 2024-09-13T02:54:06.268 INFO:tasks.workunit.client.0.smithi089.stdout:3/792: dwrite d2/d20/f39 [0,4194304] 0 2024-09-13T02:54:06.268 INFO:tasks.workunit.client.0.smithi089.stdout:8/863: fdatasync de/d16/d1e/d3f/f73 0 2024-09-13T02:54:06.272 INFO:tasks.workunit.client.0.smithi089.stdout:0/727: creat d2/d19/d1a/d1e/d42/dd4/ff4 x:0 0 0 2024-09-13T02:54:06.272 INFO:tasks.workunit.client.0.smithi089.stdout:0/728: readlink d2/d19/d1a/d1e/lda 0 2024-09-13T02:54:06.272 INFO:tasks.workunit.client.0.smithi089.stdout:0/729: fsync d2/d64/fee 0 2024-09-13T02:54:06.272 INFO:tasks.workunit.client.0.smithi089.stdout:0/730: fsync d2/d64/db1/fbd 0 2024-09-13T02:54:06.272 INFO:tasks.workunit.client.0.smithi089.stdout:0/731: creat d2/d19/d1a/d1e/d42/dd4/ff5 x:0 0 0 2024-09-13T02:54:06.273 INFO:tasks.workunit.client.0.smithi089.stdout:3/793: mknod d2/d8/d5f/cfd 0 2024-09-13T02:54:06.274 INFO:tasks.workunit.client.0.smithi089.stdout:3/794: creat d2/ffe x:0 0 0 2024-09-13T02:54:06.275 INFO:tasks.workunit.client.0.smithi089.stdout:8/864: getdents de/d16 0 2024-09-13T02:54:06.276 INFO:tasks.workunit.client.0.smithi089.stdout:3/795: symlink d2/d20/d23/lff 0 2024-09-13T02:54:06.278 INFO:tasks.workunit.client.0.smithi089.stdout:0/732: read d2/d19/d1a/d4e/d7a/d9b/fd6 [4120083,37780] 0 2024-09-13T02:54:06.278 INFO:tasks.workunit.client.0.smithi089.stdout:0/733: chown d2/d19/d1a/l41 112310632 1 2024-09-13T02:54:06.278 INFO:tasks.workunit.client.0.smithi089.stdout:8/865: rmdir de/d56 39 2024-09-13T02:54:06.278 INFO:tasks.workunit.client.0.smithi089.stdout:0/734: write d2/d19/d1a/d3d/d4b/d4f/d59/f6e [3604860,43543] 0 2024-09-13T02:54:06.279 INFO:tasks.workunit.client.0.smithi089.stdout:3/796: rmdir d2/d90 39 2024-09-13T02:54:06.279 INFO:tasks.workunit.client.0.smithi089.stdout:3/797: creat d2/d8/dc/d9a/d9c/dab/f100 x:0 0 0 2024-09-13T02:54:06.279 INFO:tasks.workunit.client.0.smithi089.stdout:3/798: write d2/d20/f39 [5153642,99464] 0 2024-09-13T02:54:06.280 INFO:tasks.workunit.client.0.smithi089.stdout:0/735: dread d2/d19/d1a/d4e/d7a/d9b/fe9 [0,4194304] 0 2024-09-13T02:54:06.280 INFO:tasks.workunit.client.0.smithi089.stdout:0/736: read - d2/d19/d1a/d1e/d42/dd4/ff5 zero size 2024-09-13T02:54:06.280 INFO:tasks.workunit.client.0.smithi089.stdout:8/866: mknod de/d16/d1e/d20/d39/c12a 0 2024-09-13T02:54:06.281 INFO:tasks.workunit.client.0.smithi089.stdout:3/799: creat d2/d20/d23/d32/d5b/d71/f101 x:0 0 0 2024-09-13T02:54:06.281 INFO:tasks.workunit.client.0.smithi089.stdout:3/800: readlink d2/d8b/l8f 0 2024-09-13T02:54:06.281 INFO:tasks.workunit.client.0.smithi089.stdout:3/801: readlink d2/d20/d23/lec 0 2024-09-13T02:54:06.281 INFO:tasks.workunit.client.0.smithi089.stdout:3/802: chown d2/d8/dc/l47 7016007 1 2024-09-13T02:54:06.282 INFO:tasks.workunit.client.0.smithi089.stdout:0/737: unlink d2/d19/f1c 0 2024-09-13T02:54:06.282 INFO:tasks.workunit.client.0.smithi089.stdout:0/738: dread - d2/d64/db3/de0/fe3 zero size 2024-09-13T02:54:06.282 INFO:tasks.workunit.client.0.smithi089.stdout:3/803: mknod d2/d8/dc/d9a/d9c/d83/db6/c102 0 2024-09-13T02:54:06.282 INFO:tasks.workunit.client.0.smithi089.stdout:3/804: truncate d2/d20/d23/d2b/fad 815217 0 2024-09-13T02:54:06.283 INFO:tasks.workunit.client.0.smithi089.stdout:0/739: mkdir d2/d19/d1a/d1e/d42/dd4/df6 0 2024-09-13T02:54:06.283 INFO:tasks.workunit.client.0.smithi089.stdout:0/740: write d2/d64/fea [760664,96482] 0 2024-09-13T02:54:06.284 INFO:tasks.workunit.client.0.smithi089.stdout:0/741: truncate d2/f80 914714 0 2024-09-13T02:54:06.286 INFO:tasks.workunit.client.0.smithi089.stdout:0/742: truncate d2/d19/f32 963289 0 2024-09-13T02:54:06.286 INFO:tasks.workunit.client.0.smithi089.stdout:0/743: getdents d2/d19/d1a/d1e/d42/dd4/df6 0 2024-09-13T02:54:06.286 INFO:tasks.workunit.client.0.smithi089.stdout:0/744: fdatasync d2/d19/d1a/fc5 0 2024-09-13T02:54:06.288 INFO:tasks.workunit.client.0.smithi089.stdout:0/745: rename d2/d19/c1d to d2/d19/d1a/cf7 0 2024-09-13T02:54:06.306 INFO:tasks.workunit.client.0.smithi089.stdout:8/867: dwrite de/d16/d1e/d27/d76/f55 [0,4194304] 0 2024-09-13T02:54:06.308 INFO:tasks.workunit.client.0.smithi089.stdout:8/868: mkdir de/d16/d12b 0 2024-09-13T02:54:06.308 INFO:tasks.workunit.client.0.smithi089.stdout:8/869: creat de/d16/d1e/d20/d39/df5/dff/dc2/f12c x:0 0 0 2024-09-13T02:54:06.309 INFO:tasks.workunit.client.0.smithi089.stdout:3/805: dwrite d2/d20/d23/d2b/f2f [0,4194304] 0 2024-09-13T02:54:06.309 INFO:tasks.workunit.client.0.smithi089.stdout:3/806: dread - d2/d8/dc/d9a/d9c/d83/fd7 zero size 2024-09-13T02:54:06.309 INFO:tasks.workunit.client.0.smithi089.stdout:3/807: creat d2/d8/dc/d9a/d9c/f103 x:0 0 0 2024-09-13T02:54:06.313 INFO:tasks.workunit.client.0.smithi089.stdout:8/870: creat de/d16/d1e/d20/da8/dd1/f12d x:0 0 0 2024-09-13T02:54:06.313 INFO:tasks.workunit.client.0.smithi089.stdout:8/871: fdatasync de/d16/d1e/dc7/fcc 0 2024-09-13T02:54:06.315 INFO:tasks.workunit.client.0.smithi089.stdout:3/808: rename d2/d20/l61 to d2/d20/d23/d32/l104 0 2024-09-13T02:54:06.315 INFO:tasks.workunit.client.0.smithi089.stdout:3/809: creat d2/d8/d5f/d72/f105 x:0 0 0 2024-09-13T02:54:06.315 INFO:tasks.workunit.client.0.smithi089.stdout:3/810: stat d2/d90/fee 0 2024-09-13T02:54:06.316 INFO:tasks.workunit.client.0.smithi089.stdout:3/811: link d2/d20/d23/d32/d5b/d71/f93 d2/d90/f106 0 2024-09-13T02:54:06.317 INFO:tasks.workunit.client.0.smithi089.stdout:3/812: creat d2/d8/dc/d9a/f107 x:0 0 0 2024-09-13T02:54:06.318 INFO:tasks.workunit.client.0.smithi089.stdout:3/813: dread d2/d20/d23/d32/d49/fba [0,4194304] 0 2024-09-13T02:54:06.325 INFO:tasks.workunit.client.0.smithi089.stdout:8/872: dwrite de/d16/d1e/d3f/d71/fc0 [0,4194304] 0 2024-09-13T02:54:06.328 INFO:tasks.workunit.client.0.smithi089.stdout:3/814: dread d2/f2d [0,4194304] 0 2024-09-13T02:54:06.433 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:06 smithi131 ceph-mon[34689]: pgmap v245: 65 pgs: 65 active+clean; 2.2 GiB data, 8.0 GiB used, 528 GiB / 536 GiB avail; 235 MiB/s rd, 290 MiB/s wr, 433 op/s 2024-09-13T02:54:06.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:06 smithi131 ceph-mon[34689]: fsmap cephfs:2 {0=cephfs.smithi089.rarddb=up:active,1=cephfs.smithi131.uasrkg=up:active} 2 up:standby-replay 2024-09-13T02:54:06.473 INFO:tasks.workunit.client.0.smithi089.stdout:5/809: sync 2024-09-13T02:54:06.475 INFO:tasks.workunit.client.0.smithi089.stdout:5/810: symlink d1/d4/d45/d6f/d62/d72/d99/lfe 0 2024-09-13T02:54:06.475 INFO:tasks.workunit.client.0.smithi089.stdout:5/811: truncate d1/fe8 454563 0 2024-09-13T02:54:06.475 INFO:tasks.workunit.client.0.smithi089.stdout:5/812: stat d1/d4/d45/c9b 0 2024-09-13T02:54:06.476 INFO:tasks.workunit.client.0.smithi089.stdout:5/813: getdents d1/d4/d45/d6f/d4d/d9d/daa 0 2024-09-13T02:54:06.478 INFO:tasks.workunit.client.0.smithi089.stdout:5/814: creat d1/d4/d45/d6f/d62/d72/d99/fff x:0 0 0 2024-09-13T02:54:06.534 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:06 smithi089 ceph-mon[27639]: pgmap v245: 65 pgs: 65 active+clean; 2.2 GiB data, 8.0 GiB used, 528 GiB / 536 GiB avail; 235 MiB/s rd, 290 MiB/s wr, 433 op/s 2024-09-13T02:54:06.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:06 smithi089 ceph-mon[27639]: fsmap cephfs:2 {0=cephfs.smithi089.rarddb=up:active,1=cephfs.smithi131.uasrkg=up:active} 2 up:standby-replay 2024-09-13T02:54:06.567 INFO:tasks.workunit.client.0.smithi089.stdout:9/642: sync 2024-09-13T02:54:06.567 INFO:tasks.workunit.client.0.smithi089.stdout:6/796: sync 2024-09-13T02:54:06.567 INFO:tasks.workunit.client.0.smithi089.stdout:1/733: sync 2024-09-13T02:54:06.567 INFO:tasks.workunit.client.0.smithi089.stdout:9/643: truncate d3/d6/d2a/d4b/d6d/f82 1617154 0 2024-09-13T02:54:06.567 INFO:tasks.workunit.client.0.smithi089.stdout:1/734: write dc/f22 [1010699,24799] 0 2024-09-13T02:54:06.568 INFO:tasks.workunit.client.0.smithi089.stdout:9/644: chown d3/d6/c25 26873 1 2024-09-13T02:54:06.568 INFO:tasks.workunit.client.0.smithi089.stdout:9/645: read d3/d6/d2a/d94/d24/d29/f52 [4125392,127999] 0 2024-09-13T02:54:06.570 INFO:tasks.workunit.client.0.smithi089.stdout:1/735: rmdir dc/d3a/d53/d2c/d34/d9b/dd8/de3 0 2024-09-13T02:54:06.570 INFO:tasks.workunit.client.0.smithi089.stdout:1/736: write dc/d3a/d53/d2c/d34/d8b/fc5 [1193710,75527] 0 2024-09-13T02:54:06.572 INFO:tasks.workunit.client.0.smithi089.stdout:1/737: rename dc/d44/d73/d85/f88 to dc/d6e/de0/fe6 0 2024-09-13T02:54:06.572 INFO:tasks.workunit.client.0.smithi089.stdout:1/738: creat dc/d3a/d53/d2c/d94/fe7 x:0 0 0 2024-09-13T02:54:06.575 INFO:tasks.workunit.client.0.smithi089.stdout:9/646: rmdir d3/d6/d2a/d94/d24 39 2024-09-13T02:54:06.576 INFO:tasks.workunit.client.0.smithi089.stdout:1/739: symlink dc/d46/d6c/d98/le8 0 2024-09-13T02:54:06.577 INFO:tasks.workunit.client.0.smithi089.stdout:9/647: mknod d3/d4c/ccb 0 2024-09-13T02:54:06.577 INFO:tasks.workunit.client.0.smithi089.stdout:9/648: write d3/d15/d5a/fc7 [483681,23264] 0 2024-09-13T02:54:06.577 INFO:tasks.workunit.client.0.smithi089.stdout:9/649: write d3/d6/d36/fa0 [22478,108601] 0 2024-09-13T02:54:06.578 INFO:tasks.workunit.client.0.smithi089.stdout:1/740: unlink dc/d46/d6c/la6 0 2024-09-13T02:54:06.579 INFO:tasks.workunit.client.0.smithi089.stdout:9/650: creat d3/d6/d2a/d4b/d77/fcc x:0 0 0 2024-09-13T02:54:06.580 INFO:tasks.workunit.client.0.smithi089.stdout:9/651: mkdir d3/d6/d2a/d4b/dcd 0 2024-09-13T02:54:06.580 INFO:tasks.workunit.client.0.smithi089.stdout:9/652: creat d3/d6/d2a/d94/d56/fce x:0 0 0 2024-09-13T02:54:06.582 INFO:tasks.workunit.client.0.smithi089.stdout:9/653: mkdir d3/dcf 0 2024-09-13T02:54:06.582 INFO:tasks.workunit.client.0.smithi089.stdout:9/654: stat d3/d6/d2a/l43 0 2024-09-13T02:54:06.582 INFO:tasks.workunit.client.0.smithi089.stdout:9/655: write d3/d6/d2a/d94/d24/d35/f7f [1170543,105650] 0 2024-09-13T02:54:06.585 INFO:tasks.workunit.client.0.smithi089.stdout:6/797: dwrite db/d10/d3a/fd8 [0,4194304] 0 2024-09-13T02:54:06.589 INFO:tasks.workunit.client.0.smithi089.stdout:9/656: fsync d3/d6/d2a/d4b/d77/fcc 0 2024-09-13T02:54:06.590 INFO:tasks.workunit.client.0.smithi089.stdout:9/657: rmdir d3/d6/d36 39 2024-09-13T02:54:06.591 INFO:tasks.workunit.client.0.smithi089.stdout:9/658: mkdir d3/d3d/d8b/dba/dd0 0 2024-09-13T02:54:06.591 INFO:tasks.workunit.client.0.smithi089.stdout:9/659: stat d3/d15/c93 0 2024-09-13T02:54:06.592 INFO:tasks.workunit.client.0.smithi089.stdout:9/660: link d3/d15/f1b d3/d6/d2a/d4b/d54/fd1 0 2024-09-13T02:54:06.593 INFO:tasks.workunit.client.0.smithi089.stdout:9/661: fdatasync d3/d15/f1b 0 2024-09-13T02:54:06.593 INFO:tasks.workunit.client.0.smithi089.stdout:6/798: write db/d43/d6e/d28/d2f/f33 [504137,51425] 0 2024-09-13T02:54:06.593 INFO:tasks.workunit.client.0.smithi089.stdout:9/662: unlink d3/d6/d36/l96 0 2024-09-13T02:54:06.596 INFO:tasks.workunit.client.0.smithi089.stdout:9/663: rmdir d3/d6/d2a/d4b/dcd 0 2024-09-13T02:54:06.596 INFO:tasks.workunit.client.0.smithi089.stdout:9/664: write d3/d6/d2a/d4b/d54/f98 [958882,18421] 0 2024-09-13T02:54:06.596 INFO:tasks.workunit.client.0.smithi089.stdout:1/741: dwrite dc/d46/d6c/fca [0,4194304] 0 2024-09-13T02:54:06.597 INFO:tasks.workunit.client.0.smithi089.stdout:6/799: getdents db 0 2024-09-13T02:54:06.597 INFO:tasks.workunit.client.0.smithi089.stdout:6/800: fdatasync db/d10/de9/d53/d83/ddc/df0/f98 0 2024-09-13T02:54:06.599 INFO:tasks.workunit.client.0.smithi089.stdout:9/665: unlink f2 0 2024-09-13T02:54:06.602 INFO:tasks.workunit.client.0.smithi089.stdout:1/742: creat dc/d44/d73/d85/dd6/dd7/fe9 x:0 0 0 2024-09-13T02:54:06.602 INFO:tasks.workunit.client.0.smithi089.stdout:1/743: fdatasync dc/d3a/d53/d2c/d36/f58 0 2024-09-13T02:54:06.605 INFO:tasks.workunit.client.0.smithi089.stdout:9/666: creat d3/d4c/fd2 x:0 0 0 2024-09-13T02:54:06.605 INFO:tasks.workunit.client.0.smithi089.stdout:9/667: fdatasync d3/d6/d2a/d94/d24/d35/f80 0 2024-09-13T02:54:06.606 INFO:tasks.workunit.client.0.smithi089.stdout:1/744: creat dc/d3a/d93/fea x:0 0 0 2024-09-13T02:54:06.608 INFO:tasks.workunit.client.0.smithi089.stdout:6/801: rmdir db/d10/de9 39 2024-09-13T02:54:06.613 INFO:tasks.workunit.client.0.smithi089.stdout:6/802: truncate db/d10/de9/d53/d83/ddc/df0/f98 3743957 0 2024-09-13T02:54:06.621 INFO:tasks.workunit.client.0.smithi089.stdout:6/803: dread db/d43/d6e/d28/d37/d8b/dcd/f79 [0,4194304] 0 2024-09-13T02:54:06.646 INFO:tasks.workunit.client.0.smithi089.stdout:9/668: dwrite d3/d3d/d8b/dba/fc9 [0,4194304] 0 2024-09-13T02:54:06.646 INFO:tasks.workunit.client.0.smithi089.stdout:9/669: chown d3/d6/d2a/d94/l7b 53089 1 2024-09-13T02:54:06.646 INFO:tasks.workunit.client.0.smithi089.stdout:9/670: creat d3/d3d/fd3 x:0 0 0 2024-09-13T02:54:06.648 INFO:tasks.workunit.client.0.smithi089.stdout:6/804: dwrite db/d43/d6e/fd3 [0,4194304] 0 2024-09-13T02:54:06.649 INFO:tasks.workunit.client.0.smithi089.stdout:9/671: mknod d3/d3d/d8b/dba/cd4 0 2024-09-13T02:54:06.652 INFO:tasks.workunit.client.0.smithi089.stdout:6/805: creat db/d10/dc1/d102/f107 x:0 0 0 2024-09-13T02:54:06.652 INFO:tasks.workunit.client.0.smithi089.stdout:6/806: stat db/d43/d6e/d28/d2f/d9b/la8 0 2024-09-13T02:54:06.652 INFO:tasks.workunit.client.0.smithi089.stdout:7/961: sync 2024-09-13T02:54:06.652 INFO:tasks.workunit.client.0.smithi089.stdout:8/873: sync 2024-09-13T02:54:06.652 INFO:tasks.workunit.client.0.smithi089.stdout:0/746: sync 2024-09-13T02:54:06.652 INFO:tasks.workunit.client.0.smithi089.stdout:4/893: sync 2024-09-13T02:54:06.652 INFO:tasks.workunit.client.0.smithi089.stdout:2/719: sync 2024-09-13T02:54:06.652 INFO:tasks.workunit.client.0.smithi089.stdout:4/894: fsync d2/d22/f35 0 2024-09-13T02:54:06.652 INFO:tasks.workunit.client.0.smithi089.stdout:8/874: stat de/d16/d1e/d3f/d106/f122 0 2024-09-13T02:54:06.653 INFO:tasks.workunit.client.0.smithi089.stdout:3/815: sync 2024-09-13T02:54:06.653 INFO:tasks.workunit.client.0.smithi089.stdout:9/672: creat d3/d4c/d91/fd5 x:0 0 0 2024-09-13T02:54:06.653 INFO:tasks.workunit.client.0.smithi089.stdout:7/962: fsync d3/d19/f3f 0 2024-09-13T02:54:06.654 INFO:tasks.workunit.client.0.smithi089.stdout:7/963: chown d3/d44/f58 69924 1 2024-09-13T02:54:06.654 INFO:tasks.workunit.client.0.smithi089.stdout:7/964: write d3/d44/d85/d5e/f95 [107313,47282] 0 2024-09-13T02:54:06.654 INFO:tasks.workunit.client.0.smithi089.stdout:7/965: getdents d3/d19/d67/d10f 0 2024-09-13T02:54:06.654 INFO:tasks.workunit.client.0.smithi089.stdout:2/720: unlink d13/d30/f6b 0 2024-09-13T02:54:06.656 INFO:tasks.workunit.client.0.smithi089.stdout:3/816: creat d2/d8/dc/d3c/d65/df0/f108 x:0 0 0 2024-09-13T02:54:06.658 INFO:tasks.workunit.client.0.smithi089.stdout:2/721: symlink d13/d30/d4e/d7b/d86/dc0/lfb 0 2024-09-13T02:54:06.658 INFO:tasks.workunit.client.0.smithi089.stdout:2/722: chown d13/d30/d61/d78/d79/c87 966254956 1 2024-09-13T02:54:06.658 INFO:tasks.workunit.client.0.smithi089.stdout:9/673: dread d3/f22 [0,4194304] 0 2024-09-13T02:54:06.659 INFO:tasks.workunit.client.0.smithi089.stdout:3/817: mknod d2/d20/d23/df8/c109 0 2024-09-13T02:54:06.661 INFO:tasks.workunit.client.0.smithi089.stdout:6/807: write db/d10/f1f [1312301,21564] 0 2024-09-13T02:54:06.661 INFO:tasks.workunit.client.0.smithi089.stdout:0/747: dread d2/d64/db3/dc6/fd1 [0,4194304] 0 2024-09-13T02:54:06.661 INFO:tasks.workunit.client.0.smithi089.stdout:9/674: unlink d3/fb1 0 2024-09-13T02:54:06.661 INFO:tasks.workunit.client.0.smithi089.stdout:3/818: mkdir d2/d90/d10a 0 2024-09-13T02:54:06.662 INFO:tasks.workunit.client.0.smithi089.stdout:3/819: fsync d2/d8/dc/d9a/d9c/d83/fd7 0 2024-09-13T02:54:06.662 INFO:tasks.workunit.client.0.smithi089.stdout:3/820: fdatasync d2/d20/d23/d2b/fad 0 2024-09-13T02:54:06.662 INFO:tasks.workunit.client.0.smithi089.stdout:3/821: write d2/d20/f4b [1565462,18811] 0 2024-09-13T02:54:06.662 INFO:tasks.workunit.client.0.smithi089.stdout:4/895: write d2/f4 [10093071,42304] 0 2024-09-13T02:54:06.665 INFO:tasks.workunit.client.0.smithi089.stdout:2/723: rmdir d13/d30/d61/d78 39 2024-09-13T02:54:06.665 INFO:tasks.workunit.client.0.smithi089.stdout:8/875: dread de/f22 [0,4194304] 0 2024-09-13T02:54:06.665 INFO:tasks.workunit.client.0.smithi089.stdout:3/822: dread d2/d8/dc/d3c/d65/f87 [4194304,4194304] 0 2024-09-13T02:54:06.666 INFO:tasks.workunit.client.0.smithi089.stdout:9/675: truncate d3/d6/d2a/d4b/d54/da1/fad 530274 0 2024-09-13T02:54:06.667 INFO:tasks.workunit.client.0.smithi089.stdout:3/823: write d2/d20/d23/d32/d5b/f9d [280174,69995] 0 2024-09-13T02:54:06.668 INFO:tasks.workunit.client.0.smithi089.stdout:4/896: creat d2/d3/d5/d72/f121 x:0 0 0 2024-09-13T02:54:06.668 INFO:tasks.workunit.client.0.smithi089.stdout:4/897: creat d2/d3/d5/d43/d3b/f122 x:0 0 0 2024-09-13T02:54:06.669 INFO:tasks.workunit.client.0.smithi089.stdout:8/876: mkdir de/d16/d12b/d12e 0 2024-09-13T02:54:06.671 INFO:tasks.workunit.client.0.smithi089.stdout:9/676: creat d3/d3d/d8b/dba/dd0/fd6 x:0 0 0 2024-09-13T02:54:06.672 INFO:tasks.workunit.client.0.smithi089.stdout:3/824: rename d2/d8/dc/d9a/cc9 to d2/d20/d23/d2b/c10b 0 2024-09-13T02:54:06.672 INFO:tasks.workunit.client.0.smithi089.stdout:3/825: write d2/d90/fcb [934067,125754] 0 2024-09-13T02:54:06.672 INFO:tasks.workunit.client.0.smithi089.stdout:3/826: stat d2/d8/dc/f30 0 2024-09-13T02:54:06.674 INFO:tasks.workunit.client.0.smithi089.stdout:2/724: dread d13/d30/d4e/d7b/fdb [0,4194304] 0 2024-09-13T02:54:06.674 INFO:tasks.workunit.client.0.smithi089.stdout:8/877: creat de/d16/d1e/d20/d39/f12f x:0 0 0 2024-09-13T02:54:06.674 INFO:tasks.workunit.client.0.smithi089.stdout:3/827: rename d2/d8/dc/d3c/c6b to d2/d8/d5f/d72/c10c 0 2024-09-13T02:54:06.676 INFO:tasks.workunit.client.0.smithi089.stdout:6/808: write db/db2/fb7 [3277943,68724] 0 2024-09-13T02:54:06.676 INFO:tasks.workunit.client.0.smithi089.stdout:6/809: write db/d10/de9/d53/f94 [1108750,61717] 0 2024-09-13T02:54:06.676 INFO:tasks.workunit.client.0.smithi089.stdout:2/725: link d13/d30/d64/lcf d13/d30/d4e/d6f/d76/dd6/lfc 0 2024-09-13T02:54:06.676 INFO:tasks.workunit.client.0.smithi089.stdout:2/726: chown fc 28 1 2024-09-13T02:54:06.676 INFO:tasks.workunit.client.0.smithi089.stdout:3/828: mkdir d2/d8/dc/d3c/d65/df0/d10d 0 2024-09-13T02:54:06.679 INFO:tasks.workunit.client.0.smithi089.stdout:6/810: mknod db/d43/c108 0 2024-09-13T02:54:06.679 INFO:tasks.workunit.client.0.smithi089.stdout:6/811: truncate db/db2/ff1 254940 0 2024-09-13T02:54:06.679 INFO:tasks.workunit.client.0.smithi089.stdout:2/727: truncate d13/f89 6652797 0 2024-09-13T02:54:06.689 INFO:tasks.workunit.client.0.smithi089.stdout:3/829: dread d2/d20/d23/d32/d49/f67 [0,4194304] 0 2024-09-13T02:54:06.690 INFO:tasks.workunit.client.0.smithi089.stdout:3/830: symlink d2/d8/dc/d9a/d9c/dab/l10e 0 2024-09-13T02:54:06.690 INFO:tasks.workunit.client.0.smithi089.stdout:8/878: dread de/d16/d1e/d20/d39/df5/dff/d61/fc8 [0,4194304] 0 2024-09-13T02:54:06.690 INFO:tasks.workunit.client.0.smithi089.stdout:8/879: dread - de/d16/d1e/d20/d39/df5/dff/dc2/f12c zero size 2024-09-13T02:54:06.692 INFO:tasks.workunit.client.0.smithi089.stdout:3/831: link d2/d20/d23/d32/d5b/f7a d2/d8/dc/d9a/d9c/f10f 0 2024-09-13T02:54:06.692 INFO:tasks.workunit.client.0.smithi089.stdout:3/832: getdents d2/d8/dc/d3c/d65/df0/d10d 0 2024-09-13T02:54:06.692 INFO:tasks.workunit.client.0.smithi089.stdout:3/833: truncate d2/f2d 5016021 0 2024-09-13T02:54:06.692 INFO:tasks.workunit.client.0.smithi089.stdout:8/880: mknod de/d16/d1e/d20/d39/df5/dff/d61/d8e/dfc/c130 0 2024-09-13T02:54:06.693 INFO:tasks.workunit.client.0.smithi089.stdout:3/834: getdents d2/d8/dc/d3c/d65/df0 0 2024-09-13T02:54:06.693 INFO:tasks.workunit.client.0.smithi089.stdout:2/728: dread d13/d30/d61/d78/d79/d90/fad [0,4194304] 0 2024-09-13T02:54:06.694 INFO:tasks.workunit.client.0.smithi089.stdout:3/835: creat d2/d90/d10a/f110 x:0 0 0 2024-09-13T02:54:06.694 INFO:tasks.workunit.client.0.smithi089.stdout:4/898: dwrite d2/d3/fba [0,4194304] 0 2024-09-13T02:54:06.696 INFO:tasks.workunit.client.0.smithi089.stdout:3/836: creat d2/d8/dc/d3c/d65/df0/f111 x:0 0 0 2024-09-13T02:54:06.700 INFO:tasks.workunit.client.0.smithi089.stdout:3/837: truncate d2/d90/fa9 6214179 0 2024-09-13T02:54:06.701 INFO:tasks.workunit.client.0.smithi089.stdout:0/748: dwrite d2/d19/d1a/f4d [8388608,4194304] 0 2024-09-13T02:54:06.701 INFO:tasks.workunit.client.0.smithi089.stdout:0/749: fsync d2/d19/d1a/d4e/fbc 0 2024-09-13T02:54:06.701 INFO:tasks.workunit.client.0.smithi089.stdout:4/899: getdents d2/d3/d86 0 2024-09-13T02:54:06.705 INFO:tasks.workunit.client.0.smithi089.stdout:0/750: mkdir d2/d19/d1a/d1e/d42/dd4/df6/df8 0 2024-09-13T02:54:06.713 INFO:tasks.workunit.client.0.smithi089.stdout:4/900: dread d2/d3/d86/dfd/fb4 [0,4194304] 0 2024-09-13T02:54:06.713 INFO:tasks.workunit.client.0.smithi089.stdout:4/901: write d2/d3/d5/d43/d3b/d71/d10d/daf/dc6/f11e [4858148,3496] 0 2024-09-13T02:54:06.716 INFO:tasks.workunit.client.0.smithi089.stdout:9/677: dwrite d3/d6/fe [0,4194304] 0 2024-09-13T02:54:06.716 INFO:tasks.workunit.client.0.smithi089.stdout:9/678: chown d3/d15/f49 90 1 2024-09-13T02:54:06.717 INFO:tasks.workunit.client.0.smithi089.stdout:9/679: mkdir d3/d6/d2a/d94/d56/dd7 0 2024-09-13T02:54:06.719 INFO:tasks.workunit.client.0.smithi089.stdout:9/680: unlink d3/d15/l19 0 2024-09-13T02:54:06.721 INFO:tasks.workunit.client.0.smithi089.stdout:9/681: mkdir d3/d6/d2a/d4b/d54/dc1/dd8 0 2024-09-13T02:54:06.721 INFO:tasks.workunit.client.0.smithi089.stdout:9/682: write d3/d15/f1b [1206316,126006] 0 2024-09-13T02:54:06.723 INFO:tasks.workunit.client.0.smithi089.stdout:9/683: mkdir d3/d3d/dd9 0 2024-09-13T02:54:06.725 INFO:tasks.workunit.client.0.smithi089.stdout:8/881: dwrite de/d16/d1e/d20/d6c/d6e/d7e/fce [0,4194304] 0 2024-09-13T02:54:06.726 INFO:tasks.workunit.client.0.smithi089.stdout:8/882: mkdir de/d16/d131 0 2024-09-13T02:54:06.726 INFO:tasks.workunit.client.0.smithi089.stdout:8/883: write de/d16/d1e/d3f/dd9/f127 [957897,90564] 0 2024-09-13T02:54:06.727 INFO:tasks.workunit.client.0.smithi089.stdout:8/884: unlink de/d16/d1e/d20/d6c/d6e/d7e/ld4 0 2024-09-13T02:54:06.727 INFO:tasks.workunit.client.0.smithi089.stdout:8/885: fdatasync de/d16/f6f 0 2024-09-13T02:54:06.727 INFO:tasks.workunit.client.0.smithi089.stdout:8/886: getdents de/d16/d1e/d20/ddb 0 2024-09-13T02:54:06.728 INFO:tasks.workunit.client.0.smithi089.stdout:8/887: creat de/dc1/f132 x:0 0 0 2024-09-13T02:54:06.740 INFO:tasks.workunit.client.0.smithi089.stdout:9/684: write d3/d6/d2a/d94/f8c [247507,111428] 0 2024-09-13T02:54:06.740 INFO:tasks.workunit.client.0.smithi089.stdout:9/685: write d3/d4c/d91/fd5 [453463,61546] 0 2024-09-13T02:54:06.740 INFO:tasks.workunit.client.0.smithi089.stdout:9/686: read d3/d4c/d91/fd5 [309131,81054] 0 2024-09-13T02:54:06.740 INFO:tasks.workunit.client.0.smithi089.stdout:9/687: write d3/f22 [815610,123716] 0 2024-09-13T02:54:06.740 INFO:tasks.workunit.client.0.smithi089.stdout:9/688: getdents d3/d6/d36/d9d 0 2024-09-13T02:54:06.741 INFO:tasks.workunit.client.0.smithi089.stdout:9/689: truncate d3/d15/f3f 1035777 0 2024-09-13T02:54:06.742 INFO:tasks.workunit.client.0.smithi089.stdout:9/690: creat d3/d6/d2a/d94/fda x:0 0 0 2024-09-13T02:54:06.744 INFO:tasks.workunit.client.0.smithi089.stdout:3/838: dwrite d2/d20/d23/d32/d5b/f79 [0,4194304] 0 2024-09-13T02:54:06.744 INFO:tasks.workunit.client.0.smithi089.stdout:2/729: dwrite d13/d30/d59/f96 [0,4194304] 0 2024-09-13T02:54:06.744 INFO:tasks.workunit.client.0.smithi089.stdout:3/839: write d2/d8b/daf/fe9 [1002970,12110] 0 2024-09-13T02:54:06.744 INFO:tasks.workunit.client.0.smithi089.stdout:2/730: fsync d13/d30/d4e/d7b/fdb 0 2024-09-13T02:54:06.744 INFO:tasks.workunit.client.0.smithi089.stdout:2/731: write fc [4569192,90776] 0 2024-09-13T02:54:06.744 INFO:tasks.workunit.client.0.smithi089.stdout:0/751: dwrite d2/f3a [0,4194304] 0 2024-09-13T02:54:06.744 INFO:tasks.workunit.client.0.smithi089.stdout:0/752: fsync d2/d19/d1a/d3d/d4b/f55 0 2024-09-13T02:54:06.744 INFO:tasks.workunit.client.0.smithi089.stdout:4/902: dwrite d2/d3/d5/d43/d84/f108 [0,4194304] 0 2024-09-13T02:54:06.744 INFO:tasks.workunit.client.0.smithi089.stdout:4/903: write d2/d3/d5/d43/d3b/d71/d10d/daf/dc6/fd0 [693727,48257] 0 2024-09-13T02:54:06.745 INFO:tasks.workunit.client.0.smithi089.stdout:9/691: fsync d3/d4c/d91/fd5 0 2024-09-13T02:54:06.746 INFO:tasks.workunit.client.0.smithi089.stdout:9/692: write d3/d6/d2a/d4b/d54/da1/fad [303100,96965] 0 2024-09-13T02:54:06.746 INFO:tasks.workunit.client.0.smithi089.stdout:9/693: write d3/d6/d2a/d94/d24/d29/f88 [4715514,25786] 0 2024-09-13T02:54:06.746 INFO:tasks.workunit.client.0.smithi089.stdout:9/694: readlink d3/d6/d2a/d94/lbb 0 2024-09-13T02:54:06.746 INFO:tasks.workunit.client.0.smithi089.stdout:9/695: chown d3/d6/d2a/d94/f38 1092 1 2024-09-13T02:54:06.746 INFO:tasks.workunit.client.0.smithi089.stdout:9/696: getdents d3/dcf 0 2024-09-13T02:54:06.746 INFO:tasks.workunit.client.0.smithi089.stdout:9/697: fsync d3/d6/f65 0 2024-09-13T02:54:06.746 INFO:tasks.workunit.client.0.smithi089.stdout:9/698: chown d3/d4c 0 1 2024-09-13T02:54:06.747 INFO:tasks.workunit.client.0.smithi089.stdout:3/840: creat d2/d8/dc/d3c/d65/d7d/f112 x:0 0 0 2024-09-13T02:54:06.747 INFO:tasks.workunit.client.0.smithi089.stdout:3/841: fdatasync d2/d8/dc/fa7 0 2024-09-13T02:54:06.747 INFO:tasks.workunit.client.0.smithi089.stdout:3/842: write d2/d20/d23/d2b/f3d [300155,107996] 0 2024-09-13T02:54:06.747 INFO:tasks.workunit.client.0.smithi089.stdout:3/843: fdatasync d2/d20/d23/d32/d5b/f8a 0 2024-09-13T02:54:06.747 INFO:tasks.workunit.client.0.smithi089.stdout:0/753: link d2/dd0/fe6 d2/d19/d1a/d3d/d4b/d4f/d59/dd9/ff9 0 2024-09-13T02:54:06.753 INFO:tasks.workunit.client.0.smithi089.stdout:2/732: write d13/d30/f75 [2001145,33960] 0 2024-09-13T02:54:06.762 INFO:tasks.workunit.client.0.smithi089.stdout:9/699: creat d3/d3d/d8b/fdb x:0 0 0 2024-09-13T02:54:06.762 INFO:tasks.workunit.client.0.smithi089.stdout:9/700: truncate d3/d6/d2a/d94/f6e 2004732 0 2024-09-13T02:54:06.762 INFO:tasks.workunit.client.0.smithi089.stdout:9/701: readlink d3/d6/d2a/d94/d56/l83 0 2024-09-13T02:54:06.762 INFO:tasks.workunit.client.0.smithi089.stdout:9/702: chown d3/d6/d2a/l43 1930 1 2024-09-13T02:54:06.768 INFO:tasks.workunit.client.0.smithi089.stdout:0/754: mknod d2/d19/d1a/d3d/d4b/cfa 0 2024-09-13T02:54:06.768 INFO:tasks.workunit.client.0.smithi089.stdout:0/755: chown d2/d19/d1a/d3d/d4b/d4f/d59/l82 218179382 1 2024-09-13T02:54:06.769 INFO:tasks.workunit.client.0.smithi089.stdout:4/904: dwrite d2/d3/d5/d43/d84/df1/f10b [0,4194304] 0 2024-09-13T02:54:06.771 INFO:tasks.workunit.client.0.smithi089.stdout:9/703: rename d3/d15/d5a/c66 to d3/d4c/d91/cdc 0 2024-09-13T02:54:06.771 INFO:tasks.workunit.client.0.smithi089.stdout:9/704: readlink d3/d6/d2a/d94/l57 0 2024-09-13T02:54:06.772 INFO:tasks.workunit.client.0.smithi089.stdout:3/844: rmdir d2/d20/d23/d32/d5b 39 2024-09-13T02:54:06.773 INFO:tasks.workunit.client.0.smithi089.stdout:4/905: mknod d2/d22/da1/d62/d6c/d88/c123 0 2024-09-13T02:54:06.773 INFO:tasks.workunit.client.0.smithi089.stdout:4/906: getdents d2/d3/d5/d43/d3b/d71 0 2024-09-13T02:54:06.774 INFO:tasks.workunit.client.0.smithi089.stdout:0/756: rename d2/d19/d1a/d1e/d42/c52 to d2/d19/d1a/d3d/d4b/d4f/cfb 0 2024-09-13T02:54:06.775 INFO:tasks.workunit.client.0.smithi089.stdout:3/845: symlink d2/d8/d5f/l113 0 2024-09-13T02:54:06.775 INFO:tasks.workunit.client.0.smithi089.stdout:3/846: fsync d2/d20/d23/d32/d5b/d71/fa5 0 2024-09-13T02:54:06.775 INFO:tasks.workunit.client.0.smithi089.stdout:3/847: fsync d2/f16 0 2024-09-13T02:54:06.777 INFO:tasks.workunit.client.0.smithi089.stdout:0/757: symlink d2/d19/d1a/d3d/d4b/d4f/lfc 0 2024-09-13T02:54:06.777 INFO:tasks.workunit.client.0.smithi089.stdout:0/758: chown d2/d19/d1a/d4e/f79 1341981119 1 2024-09-13T02:54:06.777 INFO:tasks.workunit.client.0.smithi089.stdout:0/759: creat d2/d19/d1a/d1e/d42/ffd x:0 0 0 2024-09-13T02:54:06.777 INFO:tasks.workunit.client.0.smithi089.stdout:2/733: dwrite d13/da9/fb4 [0,4194304] 0 2024-09-13T02:54:06.778 INFO:tasks.workunit.client.0.smithi089.stdout:2/734: write d13/d30/f47 [124782,30494] 0 2024-09-13T02:54:06.778 INFO:tasks.workunit.client.0.smithi089.stdout:3/848: rmdir d2/d8b/daf 39 2024-09-13T02:54:06.782 INFO:tasks.workunit.client.0.smithi089.stdout:4/907: rename d2/d55/l96 to d2/d3/d86/l124 0 2024-09-13T02:54:06.784 INFO:tasks.workunit.client.0.smithi089.stdout:5/815: sync 2024-09-13T02:54:06.784 INFO:tasks.workunit.client.0.smithi089.stdout:5/816: creat d1/d4/d2b/f100 x:0 0 0 2024-09-13T02:54:06.786 INFO:tasks.workunit.client.0.smithi089.stdout:3/849: mkdir d2/d20/d23/d2b/d114 0 2024-09-13T02:54:06.786 INFO:tasks.workunit.client.0.smithi089.stdout:3/850: dread - d2/d20/d23/d27/ddc/ff1 zero size 2024-09-13T02:54:06.793 INFO:tasks.workunit.client.0.smithi089.stdout:0/760: rmdir d2/d19/d1a/d3d/d4b/d4f/d59 39 2024-09-13T02:54:06.794 INFO:tasks.workunit.client.0.smithi089.stdout:5/817: dread d1/d7/ffa [4194304,4194304] 0 2024-09-13T02:54:06.794 INFO:tasks.workunit.client.0.smithi089.stdout:9/705: dwrite d3/d6/d2a/d4b/d54/dc1/f7d [0,4194304] 0 2024-09-13T02:54:06.794 INFO:tasks.workunit.client.0.smithi089.stdout:5/818: fsync d1/d4/d45/d6f/d4d/d9d/daa/fcc 0 2024-09-13T02:54:06.794 INFO:tasks.workunit.client.0.smithi089.stdout:5/819: truncate d1/d4/d45/d6f/fac 478906 0 2024-09-13T02:54:06.795 INFO:tasks.workunit.client.0.smithi089.stdout:3/851: creat d2/d8b/daf/f115 x:0 0 0 2024-09-13T02:54:06.795 INFO:tasks.workunit.client.0.smithi089.stdout:3/852: dread - d2/d8/dc/d9a/f107 zero size 2024-09-13T02:54:06.795 INFO:tasks.workunit.client.0.smithi089.stdout:3/853: chown d2/d20/d23/d32/d49/c80 7889849 1 2024-09-13T02:54:06.795 INFO:tasks.workunit.client.0.smithi089.stdout:3/854: fsync d2/d8/dc/fa2 0 2024-09-13T02:54:06.797 INFO:tasks.workunit.client.0.smithi089.stdout:4/908: rmdir d2/d22/da1/d62 39 2024-09-13T02:54:06.802 INFO:tasks.workunit.client.0.smithi089.stdout:0/761: unlink d2/d19/f32 0 2024-09-13T02:54:06.803 INFO:tasks.workunit.client.0.smithi089.stdout:9/706: unlink d3/d6/fbc 0 2024-09-13T02:54:06.806 INFO:tasks.workunit.client.0.smithi089.stdout:4/909: creat d2/d22/da1/d62/d6c/d88/f125 x:0 0 0 2024-09-13T02:54:06.807 INFO:tasks.workunit.client.0.smithi089.stdout:0/762: write d2/f14 [2272904,78425] 0 2024-09-13T02:54:06.809 INFO:tasks.workunit.client.0.smithi089.stdout:3/855: rmdir d2/d8/d5f 39 2024-09-13T02:54:06.810 INFO:tasks.workunit.client.0.smithi089.stdout:4/910: creat d2/d3/d86/dfd/dbf/f126 x:0 0 0 2024-09-13T02:54:06.812 INFO:tasks.workunit.client.0.smithi089.stdout:0/763: truncate d2/d19/d1a/d3d/d4b/d4f/d59/d6b/f6c 10990439 0 2024-09-13T02:54:06.812 INFO:tasks.workunit.client.0.smithi089.stdout:9/707: mknod d3/cdd 0 2024-09-13T02:54:06.814 INFO:tasks.workunit.client.0.smithi089.stdout:3/856: mknod d2/d8/dc/d3c/d9e/c116 0 2024-09-13T02:54:06.814 INFO:tasks.workunit.client.0.smithi089.stdout:3/857: rename d2/d8 to d2/d8/dc/d3c/d9e/d117 22 2024-09-13T02:54:06.814 INFO:tasks.workunit.client.0.smithi089.stdout:3/858: write d2/d8/dc/d9a/fb4 [281759,11059] 0 2024-09-13T02:54:06.814 INFO:tasks.workunit.client.0.smithi089.stdout:3/859: write d2/d20/d23/d32/d5b/d71/d92/fcc [2251338,79698] 0 2024-09-13T02:54:06.814 INFO:tasks.workunit.client.0.smithi089.stdout:4/911: getdents d2/d3/d5/d72/df3 0 2024-09-13T02:54:06.816 INFO:tasks.workunit.client.0.smithi089.stdout:9/708: mknod d3/d6/d2a/d94/d24/d35/cde 0 2024-09-13T02:54:06.818 INFO:tasks.workunit.client.0.smithi089.stdout:3/860: creat d2/d20/d23/d32/d49/f118 x:0 0 0 2024-09-13T02:54:06.822 INFO:tasks.workunit.client.0.smithi089.stdout:4/912: mknod d2/d3/d5/d43/d3b/d71/d10d/c127 0 2024-09-13T02:54:06.823 INFO:tasks.workunit.client.0.smithi089.stdout:0/764: read d2/d19/d1a/d1e/d42/fc7 [2160469,51395] 0 2024-09-13T02:54:06.823 INFO:tasks.workunit.client.0.smithi089.stdout:3/861: rmdir d2/d20/d23/d32/d49/dea 39 2024-09-13T02:54:06.825 INFO:tasks.workunit.client.0.smithi089.stdout:4/913: creat d2/d22/da1/d62/f128 x:0 0 0 2024-09-13T02:54:06.828 INFO:tasks.workunit.client.0.smithi089.stdout:4/914: dread d2/d22/da1/d62/d6c/d88/db2/fc7 [0,4194304] 0 2024-09-13T02:54:06.830 INFO:tasks.workunit.client.0.smithi089.stdout:4/915: rename d2/d3/d5/d43/d3b/d71/d10d/daf/ld7 to d2/d3/d5/d43/d11b/l129 0 2024-09-13T02:54:06.832 INFO:tasks.workunit.client.0.smithi089.stdout:9/709: truncate d3/d6/d2a/d4b/d54/dc1/f7d 3703631 0 2024-09-13T02:54:06.832 INFO:tasks.workunit.client.0.smithi089.stdout:9/710: creat d3/d6/d2a/d4b/fdf x:0 0 0 2024-09-13T02:54:06.832 INFO:tasks.workunit.client.0.smithi089.stdout:9/711: stat d3/d6/d2a/d94/d24/fca 0 2024-09-13T02:54:06.832 INFO:tasks.workunit.client.0.smithi089.stdout:9/712: creat d3/d6/d2a/d94/d56/fe0 x:0 0 0 2024-09-13T02:54:06.832 INFO:tasks.workunit.client.0.smithi089.stdout:9/713: fsync d3/d6/f73 0 2024-09-13T02:54:06.832 INFO:tasks.workunit.client.0.smithi089.stdout:9/714: creat d3/d6/d2a/d4b/fe1 x:0 0 0 2024-09-13T02:54:06.836 INFO:tasks.workunit.client.0.smithi089.stdout:9/715: creat d3/d6/d2a/d94/d24/d35/fe2 x:0 0 0 2024-09-13T02:54:06.836 INFO:tasks.workunit.client.0.smithi089.stdout:9/716: write d3/d3d/fd3 [904261,74015] 0 2024-09-13T02:54:06.836 INFO:tasks.workunit.client.0.smithi089.stdout:9/717: chown d3/d15 3670 1 2024-09-13T02:54:06.837 INFO:tasks.workunit.client.0.smithi089.stdout:9/718: mkdir d3/d6/d36/d9d/db6/de3 0 2024-09-13T02:54:06.837 INFO:tasks.workunit.client.0.smithi089.stdout:9/719: creat d3/d15/fe4 x:0 0 0 2024-09-13T02:54:06.837 INFO:tasks.workunit.client.0.smithi089.stdout:9/720: readlink d3/d6/d2a/d94/l7b 0 2024-09-13T02:54:06.837 INFO:tasks.workunit.client.0.smithi089.stdout:9/721: creat d3/d3d/d8b/dba/fe5 x:0 0 0 2024-09-13T02:54:06.838 INFO:tasks.workunit.client.0.smithi089.stdout:0/765: dread d2/f18 [0,4194304] 0 2024-09-13T02:54:06.841 INFO:tasks.workunit.client.0.smithi089.stdout:9/722: link d3/d6/d2a/d94/d24/d29/fa9 d3/d15/fe6 0 2024-09-13T02:54:06.843 INFO:tasks.workunit.client.0.smithi089.stdout:9/723: mknod d3/d6/d2a/d4b/ce7 0 2024-09-13T02:54:06.843 INFO:tasks.workunit.client.0.smithi089.stdout:0/766: getdents d2/d64/db1 0 2024-09-13T02:54:06.843 INFO:tasks.workunit.client.0.smithi089.stdout:0/767: fsync d2/dd0/fe6 0 2024-09-13T02:54:06.848 INFO:tasks.workunit.client.0.smithi089.stdout:9/724: mkdir d3/d6/d2a/d4b/d54/da1/de8 0 2024-09-13T02:54:06.848 INFO:tasks.workunit.client.0.smithi089.stdout:9/725: rename d3/d6/d2a/d4b/d54/dc1/dd8 to d3/d6/d36/d9d/db6/de9 0 2024-09-13T02:54:06.850 INFO:tasks.workunit.client.0.smithi089.stdout:9/726: mkdir d3/d6/d2a/d4b/d6d/dea 0 2024-09-13T02:54:06.851 INFO:tasks.workunit.client.0.smithi089.stdout:3/862: dwrite d2/d20/d23/d32/d49/f56 [0,4194304] 0 2024-09-13T02:54:06.851 INFO:tasks.workunit.client.0.smithi089.stdout:3/863: creat d2/d8/dc/d3c/d65/df0/f119 x:0 0 0 2024-09-13T02:54:06.853 INFO:tasks.workunit.client.0.smithi089.stdout:3/864: symlink d2/d8/dc/d3c/d9e/l11a 0 2024-09-13T02:54:06.855 INFO:tasks.workunit.client.0.smithi089.stdout:4/916: dwrite d2/d3/f25 [0,4194304] 0 2024-09-13T02:54:06.858 INFO:tasks.workunit.client.0.smithi089.stdout:3/865: getdents d2/d8 0 2024-09-13T02:54:06.862 INFO:tasks.workunit.client.0.smithi089.stdout:9/727: rmdir d3/d3d 39 2024-09-13T02:54:06.866 INFO:tasks.workunit.client.0.smithi089.stdout:1/745: sync 2024-09-13T02:54:06.866 INFO:tasks.workunit.client.0.smithi089.stdout:1/746: creat dc/d3a/d53/d2c/d6f/feb x:0 0 0 2024-09-13T02:54:06.867 INFO:tasks.workunit.client.0.smithi089.stdout:9/728: getdents d3/d6/d2a/d4b/d77 0 2024-09-13T02:54:06.868 INFO:tasks.workunit.client.0.smithi089.stdout:1/747: mknod dc/d3a/d53/d2c/cec 0 2024-09-13T02:54:06.871 INFO:tasks.workunit.client.0.smithi089.stdout:1/748: unlink dc/d3a/ca9 0 2024-09-13T02:54:06.871 INFO:tasks.workunit.client.0.smithi089.stdout:1/749: write dc/f13 [5151533,57915] 0 2024-09-13T02:54:06.874 INFO:tasks.workunit.client.0.smithi089.stdout:1/750: link dc/d3a/d53/d2c/d36/lb8 dc/d3a/d53/d2c/d34/d8b/db5/d9d/led 0 2024-09-13T02:54:06.876 INFO:tasks.workunit.client.0.smithi089.stdout:1/751: rename dc/d3a/d53/d2c/d34/f39 to dc/d44/d73/dc0/fee 0 2024-09-13T02:54:06.878 INFO:tasks.workunit.client.0.smithi089.stdout:1/752: symlink dc/d3a/d53/d2c/d34/d8b/db5/lef 0 2024-09-13T02:54:06.880 INFO:tasks.workunit.client.0.smithi089.stdout:9/729: dread d3/d6/fe [0,4194304] 0 2024-09-13T02:54:06.880 INFO:tasks.workunit.client.0.smithi089.stdout:9/730: dread - d3/d6/d2a/d94/d24/d35/fe2 zero size 2024-09-13T02:54:06.881 INFO:tasks.workunit.client.0.smithi089.stdout:9/731: dread - d3/d6/d2a/d4b/fdf zero size 2024-09-13T02:54:06.882 INFO:tasks.workunit.client.0.smithi089.stdout:9/732: link d3/d6/d2a/d94/d56/cc6 d3/d6/d36/d9d/ceb 0 2024-09-13T02:54:06.885 INFO:tasks.workunit.client.0.smithi089.stdout:9/733: rename d3/d15/l90 to d3/d6/lec 0 2024-09-13T02:54:06.886 INFO:tasks.workunit.client.0.smithi089.stdout:3/866: dwrite d2/d20/d23/d32/d49/f67 [0,4194304] 0 2024-09-13T02:54:06.887 INFO:tasks.workunit.client.0.smithi089.stdout:4/917: dwrite d2/d22/f34 [0,4194304] 0 2024-09-13T02:54:06.888 INFO:tasks.workunit.client.0.smithi089.stdout:9/734: creat d3/d6/d2a/fed x:0 0 0 2024-09-13T02:54:06.889 INFO:tasks.workunit.client.0.smithi089.stdout:3/867: creat d2/d20/d23/d32/d49/d75/f11b x:0 0 0 2024-09-13T02:54:06.889 INFO:tasks.workunit.client.0.smithi089.stdout:3/868: dread - d2/d8/ff3 zero size 2024-09-13T02:54:06.889 INFO:tasks.workunit.client.0.smithi089.stdout:3/869: fdatasync d2/d20/d23/d2b/f2f 0 2024-09-13T02:54:06.895 INFO:tasks.workunit.client.0.smithi089.stdout:4/918: dread d2/d22/f35 [0,4194304] 0 2024-09-13T02:54:06.899 INFO:tasks.workunit.client.0.smithi089.stdout:1/753: dwrite dc/f17 [0,4194304] 0 2024-09-13T02:54:06.902 INFO:tasks.workunit.client.0.smithi089.stdout:1/754: getdents dc/d44/d73/d9a/da1 0 2024-09-13T02:54:06.908 INFO:tasks.workunit.client.0.smithi089.stdout:3/870: write d2/f2d [3316712,54509] 0 2024-09-13T02:54:06.908 INFO:tasks.workunit.client.0.smithi089.stdout:3/871: write d2/d8b/daf/fe9 [2048099,117792] 0 2024-09-13T02:54:06.910 INFO:tasks.workunit.client.0.smithi089.stdout:9/735: dwrite d3/d3d/f67 [0,4194304] 0 2024-09-13T02:54:06.912 INFO:tasks.workunit.client.0.smithi089.stdout:4/919: dread d2/d3/d5/d43/d84/f108 [0,4194304] 0 2024-09-13T02:54:06.916 INFO:tasks.workunit.client.0.smithi089.stdout:9/736: creat d3/d6/d2a/d94/da7/fee x:0 0 0 2024-09-13T02:54:06.916 INFO:tasks.workunit.client.0.smithi089.stdout:9/737: chown d3/d6/d2a/d4b/f9c 7370158 1 2024-09-13T02:54:06.916 INFO:tasks.workunit.client.0.smithi089.stdout:9/738: fdatasync d3/d3d/f97 0 2024-09-13T02:54:06.920 INFO:tasks.workunit.client.0.smithi089.stdout:9/739: stat d3/d6/d36/d9d/ceb 0 2024-09-13T02:54:06.921 INFO:tasks.workunit.client.0.smithi089.stdout:9/740: chown d3/d3d/f67 361 1 2024-09-13T02:54:06.922 INFO:tasks.workunit.client.0.smithi089.stdout:4/920: rmdir d2/d22/da1 39 2024-09-13T02:54:06.922 INFO:tasks.workunit.client.0.smithi089.stdout:4/921: chown d2/d3/f41 223152 1 2024-09-13T02:54:06.924 INFO:tasks.workunit.client.0.smithi089.stdout:9/741: link d3/d6/d2a/d4b/f9c d3/d3d/fef 0 2024-09-13T02:54:06.929 INFO:tasks.workunit.client.0.smithi089.stdout:4/922: link d2/da/f75 d2/d3/d86/dfd/dbf/f12a 0 2024-09-13T02:54:06.930 INFO:tasks.workunit.client.0.smithi089.stdout:4/923: stat d2/d3/d5/d43/d84/df1/c106 0 2024-09-13T02:54:06.930 INFO:tasks.workunit.client.0.smithi089.stdout:4/924: dread - d2/d22/da1/d62/d6c/fde zero size 2024-09-13T02:54:06.930 INFO:tasks.workunit.client.0.smithi089.stdout:4/925: fdatasync d2/da/f13 0 2024-09-13T02:54:06.930 INFO:tasks.workunit.client.0.smithi089.stdout:4/926: write d2/d3/d5/f70 [5093773,79031] 0 2024-09-13T02:54:06.930 INFO:tasks.workunit.client.0.smithi089.stdout:9/742: getdents d3/d15/d5a 0 2024-09-13T02:54:06.930 INFO:tasks.workunit.client.0.smithi089.stdout:3/872: dwrite d2/f16 [4194304,4194304] 0 2024-09-13T02:54:06.932 INFO:tasks.workunit.client.0.smithi089.stdout:4/927: fsync d2/f53 0 2024-09-13T02:54:06.932 INFO:tasks.workunit.client.0.smithi089.stdout:4/928: fdatasync d2/d3/d86/dfd/fb4 0 2024-09-13T02:54:06.932 INFO:tasks.workunit.client.0.smithi089.stdout:9/743: unlink d3/d6/d2a/d4b/cc2 0 2024-09-13T02:54:06.936 INFO:tasks.workunit.client.0.smithi089.stdout:4/929: link d2/d3/d5/d43/d3b/d71/d10d/daf/dc6/f117 d2/d3/f12b 0 2024-09-13T02:54:06.936 INFO:tasks.workunit.client.0.smithi089.stdout:4/930: getdents d2/d3/d5/d43/d3b/d71/d10d/daf/d8f/df0 0 2024-09-13T02:54:06.938 INFO:tasks.workunit.client.0.smithi089.stdout:9/744: symlink d3/d3d/d8b/dba/dd0/lf0 0 2024-09-13T02:54:06.939 INFO:tasks.workunit.client.0.smithi089.stdout:9/745: write d3/d6/d2a/d4b/fe1 [910678,127807] 0 2024-09-13T02:54:06.939 INFO:tasks.workunit.client.0.smithi089.stdout:3/873: rmdir d2/d20/d23/d2b 39 2024-09-13T02:54:06.955 INFO:tasks.workunit.client.0.smithi089.stdout:3/874: read d2/d20/d23/d32/f7e [1817023,12697] 0 2024-09-13T02:54:06.958 INFO:tasks.workunit.client.0.smithi089.stdout:9/746: write d3/d3d/f67 [643739,50181] 0 2024-09-13T02:54:06.958 INFO:tasks.workunit.client.0.smithi089.stdout:9/747: write d3/d6/d2a/f60 [949631,459] 0 2024-09-13T02:54:06.958 INFO:tasks.workunit.client.0.smithi089.stdout:9/748: creat d3/d4c/d91/ff1 x:0 0 0 2024-09-13T02:54:06.973 INFO:tasks.workunit.client.0.smithi089.stdout:4/931: dwrite d2/d22/da1/fcd [0,4194304] 0 2024-09-13T02:54:06.976 INFO:tasks.workunit.client.0.smithi089.stdout:3/875: dwrite d2/d20/d23/d32/d49/f67 [8388608,4194304] 0 2024-09-13T02:54:06.988 INFO:tasks.workunit.client.0.smithi089.stdout:3/876: write d2/d8/dc/d57/fae [6932672,66713] 0 2024-09-13T02:54:07.003 INFO:tasks.workunit.client.0.smithi089.stdout:3/877: dread d2/d20/d23/d27/f4e [0,4194304] 0 2024-09-13T02:54:07.003 INFO:tasks.workunit.client.0.smithi089.stdout:3/878: readlink d2/d20/d44/l76 0 2024-09-13T02:54:07.003 INFO:tasks.workunit.client.0.smithi089.stdout:3/879: stat d2/d8/dc/d3c/f5d 0 2024-09-13T02:54:08.180 INFO:tasks.workunit.client.0.smithi089.stdout:9/749: symlink d3/d6/d36/d9d/db6/lf2 0 2024-09-13T02:54:08.180 INFO:tasks.workunit.client.0.smithi089.stdout:9/750: dread - d3/d6/d2a/d4b/d54/dc1/fb0 zero size 2024-09-13T02:54:08.180 INFO:tasks.workunit.client.0.smithi089.stdout:9/751: chown d3/d6/d2a/d4b/d54/dc1/c84 247306676 1 2024-09-13T02:54:08.184 INFO:tasks.workunit.client.0.smithi089.stdout:4/932: unlink d2/d55/c114 0 2024-09-13T02:54:08.195 INFO:tasks.workunit.client.0.smithi089.stdout:3/880: mknod d2/d20/d23/c11c 0 2024-09-13T02:54:08.195 INFO:tasks.workunit.client.0.smithi089.stdout:9/752: mkdir d3/d6/d2a/d4b/d6d/dea/df3 0 2024-09-13T02:54:08.195 INFO:tasks.workunit.client.0.smithi089.stdout:3/881: dread - d2/d8/dc/d57/ff2 zero size 2024-09-13T02:54:08.196 INFO:tasks.workunit.client.0.smithi089.stdout:3/882: mkdir d2/d8b/daf/ddf/d11d 0 2024-09-13T02:54:08.197 INFO:tasks.workunit.client.0.smithi089.stdout:9/753: read d3/d6/d2a/d4b/fe1 [44616,63494] 0 2024-09-13T02:54:08.198 INFO:tasks.workunit.client.0.smithi089.stdout:3/883: symlink d2/d20/d23/d27/ddc/l11e 0 2024-09-13T02:54:08.200 INFO:tasks.workunit.client.0.smithi089.stdout:3/884: rename d2/d20/d23/c11c to d2/d20/d23/c11f 0 2024-09-13T02:54:08.201 INFO:tasks.workunit.client.0.smithi089.stdout:3/885: rename d2/d20/d23/d2b/f53 to d2/d20/d23/d2b/d114/f120 0 2024-09-13T02:54:08.203 INFO:tasks.workunit.client.0.smithi089.stdout:9/754: dread d3/f22 [0,4194304] 0 2024-09-13T02:54:08.203 INFO:tasks.workunit.client.0.smithi089.stdout:9/755: creat d3/d6/d2a/d4b/d54/da1/ff4 x:0 0 0 2024-09-13T02:54:08.203 INFO:tasks.workunit.client.0.smithi089.stdout:4/933: dwrite d2/d22/da1/d62/fff [4194304,4194304] 0 2024-09-13T02:54:08.205 INFO:tasks.workunit.client.0.smithi089.stdout:4/934: truncate d2/d3/d5/f70 5145181 0 2024-09-13T02:54:08.206 INFO:tasks.workunit.client.0.smithi089.stdout:9/756: symlink d3/lf5 0 2024-09-13T02:54:08.206 INFO:tasks.workunit.client.0.smithi089.stdout:9/757: dread - d3/d6/d2a/d4b/d54/dc1/fb0 zero size 2024-09-13T02:54:08.207 INFO:tasks.workunit.client.0.smithi089.stdout:7/966: sync 2024-09-13T02:54:08.207 INFO:tasks.workunit.client.0.smithi089.stdout:6/812: sync 2024-09-13T02:54:08.207 INFO:tasks.workunit.client.0.smithi089.stdout:2/735: sync 2024-09-13T02:54:08.207 INFO:tasks.workunit.client.0.smithi089.stdout:2/736: chown d13/d30/d4e/d7b/f83 237857 1 2024-09-13T02:54:08.207 INFO:tasks.workunit.client.0.smithi089.stdout:2/737: chown d13/da9/fb4 1593 1 2024-09-13T02:54:08.207 INFO:tasks.workunit.client.0.smithi089.stdout:4/935: write d2/d22/da1/f36 [4727474,77760] 0 2024-09-13T02:54:08.207 INFO:tasks.workunit.client.0.smithi089.stdout:1/755: sync 2024-09-13T02:54:08.207 INFO:tasks.workunit.client.0.smithi089.stdout:0/768: sync 2024-09-13T02:54:08.207 INFO:tasks.workunit.client.0.smithi089.stdout:5/820: sync 2024-09-13T02:54:08.207 INFO:tasks.workunit.client.0.smithi089.stdout:1/756: creat dc/d46/d6c/d98/ff0 x:0 0 0 2024-09-13T02:54:08.207 INFO:tasks.workunit.client.0.smithi089.stdout:8/888: sync 2024-09-13T02:54:08.208 INFO:tasks.workunit.client.0.smithi089.stdout:7/967: mkdir d3/d19/d75/db2/d105/d117/d71/d130 0 2024-09-13T02:54:08.210 INFO:tasks.workunit.client.1.smithi131.stdout:2/367: sync 2024-09-13T02:54:08.211 INFO:tasks.workunit.client.0.smithi089.stdout:6/813: creat db/d43/d6e/d28/d101/f109 x:0 0 0 2024-09-13T02:54:08.216 INFO:tasks.workunit.client.0.smithi089.stdout:4/936: creat d2/da/f12c x:0 0 0 2024-09-13T02:54:08.216 INFO:tasks.workunit.client.0.smithi089.stdout:4/937: truncate d2/d3/d5/d43/d3b/d71/d10d/fa3 4974328 0 2024-09-13T02:54:08.221 INFO:tasks.workunit.client.0.smithi089.stdout:2/738: dread d13/d30/d59/dbe/fbf [0,4194304] 0 2024-09-13T02:54:08.221 INFO:tasks.workunit.client.0.smithi089.stdout:0/769: link d2/d19/d1a/cf7 d2/d64/db3/dc6/cfe 0 2024-09-13T02:54:08.225 INFO:tasks.workunit.client.0.smithi089.stdout:1/757: creat dc/d3a/d53/d2c/d34/d8b/db5/d9d/ff1 x:0 0 0 2024-09-13T02:54:08.226 INFO:tasks.workunit.client.0.smithi089.stdout:8/889: mkdir de/d16/d12b/d12e/d133 0 2024-09-13T02:54:08.226 INFO:tasks.workunit.client.0.smithi089.stdout:8/890: stat de/d16/d1e/d3f/d71/d11e/le9 0 2024-09-13T02:54:08.226 INFO:tasks.workunit.client.0.smithi089.stdout:9/758: mkdir d3/df6 0 2024-09-13T02:54:08.228 INFO:tasks.workunit.client.0.smithi089.stdout:7/968: mknod d3/d44/d85/d77/d107/da1/db4/c131 0 2024-09-13T02:54:08.228 INFO:tasks.workunit.client.0.smithi089.stdout:6/814: fsync db/d43/d6e/d28/d37/d8b/dcd/f73 0 2024-09-13T02:54:08.228 INFO:tasks.workunit.client.0.smithi089.stdout:6/815: chown db/d10/de9/d7e/l9d 116483978 1 2024-09-13T02:54:08.228 INFO:tasks.workunit.client.0.smithi089.stdout:6/816: chown db/d10/d3a/f42 3229117 1 2024-09-13T02:54:08.231 INFO:tasks.workunit.client.0.smithi089.stdout:2/739: rename d13/d30/d4e/d7b/d86/dc0/lfb to d13/d30/d61/d78/d9c/lfd 0 2024-09-13T02:54:08.232 INFO:tasks.workunit.client.0.smithi089.stdout:8/891: rmdir de/d16/d1e/d3f/de2 39 2024-09-13T02:54:08.232 INFO:tasks.workunit.client.0.smithi089.stdout:8/892: truncate de/d16/d1e/d27/d76/fed 691103 0 2024-09-13T02:54:08.232 INFO:tasks.workunit.client.0.smithi089.stdout:9/759: link d3/d6/d2a/d4b/d54/dc1/l92 d3/d6/d2a/d94/d56/lf7 0 2024-09-13T02:54:08.233 INFO:tasks.workunit.client.0.smithi089.stdout:7/969: mknod d3/d19/d75/db2/d105/d117/da0/db0/c132 0 2024-09-13T02:54:08.234 INFO:tasks.workunit.client.0.smithi089.stdout:6/817: truncate db/d43/f3b 3114277 0 2024-09-13T02:54:08.235 INFO:tasks.workunit.client.0.smithi089.stdout:2/740: rmdir d13/d30/d61/d78/dd3/de7/db7/de3 39 2024-09-13T02:54:08.235 INFO:tasks.workunit.client.0.smithi089.stdout:2/741: readlink d13/d30/d61/d78/d9c/lfd 0 2024-09-13T02:54:08.235 INFO:tasks.workunit.client.0.smithi089.stdout:2/742: write d13/f70 [982198,75150] 0 2024-09-13T02:54:08.236 INFO:tasks.workunit.client.0.smithi089.stdout:9/760: truncate d3/fc4 1415129 0 2024-09-13T02:54:08.237 INFO:tasks.workunit.client.0.smithi089.stdout:7/970: symlink d3/d44/d85/d77/d107/l133 0 2024-09-13T02:54:08.238 INFO:tasks.workunit.client.0.smithi089.stdout:6/818: mknod db/dd2/c10a 0 2024-09-13T02:54:08.240 INFO:tasks.workunit.client.0.smithi089.stdout:8/893: rmdir de/d16/d1e/d20/d39/df5 39 2024-09-13T02:54:08.241 INFO:tasks.workunit.client.0.smithi089.stdout:8/894: fsync de/d16/d1e/d67/f7f 0 2024-09-13T02:54:08.241 INFO:tasks.workunit.client.0.smithi089.stdout:8/895: dread - de/d16/d1e/d20/d6c/d10f/f111 zero size 2024-09-13T02:54:08.241 INFO:tasks.workunit.client.0.smithi089.stdout:8/896: truncate de/d16/d1e/dc7/f100 693563 0 2024-09-13T02:54:08.241 INFO:tasks.workunit.client.0.smithi089.stdout:8/897: chown de/d16/d1e/dc7 7 1 2024-09-13T02:54:08.241 INFO:tasks.workunit.client.0.smithi089.stdout:9/761: dread - d3/d6/d2a/d4b/d54/fb4 zero size 2024-09-13T02:54:08.242 INFO:tasks.workunit.client.0.smithi089.stdout:8/898: getdents de/d16/d1e/d3f/de2 0 2024-09-13T02:54:08.242 INFO:tasks.workunit.client.0.smithi089.stdout:5/821: dwrite d1/d7/ffa [0,4194304] 0 2024-09-13T02:54:08.242 INFO:tasks.workunit.client.0.smithi089.stdout:5/822: creat d1/f101 x:0 0 0 2024-09-13T02:54:08.243 INFO:tasks.workunit.client.0.smithi089.stdout:8/899: truncate de/d16/d1e/d20/d39/df5/dff/fbb 4081993 0 2024-09-13T02:54:08.245 INFO:tasks.workunit.client.0.smithi089.stdout:9/762: getdents d3/d6/d2a/d4b/d54/da1 0 2024-09-13T02:54:08.245 INFO:tasks.workunit.client.0.smithi089.stdout:9/763: chown d3/d6/d2a/d4b/fa6 10 1 2024-09-13T02:54:08.246 INFO:tasks.workunit.client.0.smithi089.stdout:9/764: dread - d3/d15/fb3 zero size 2024-09-13T02:54:08.246 INFO:tasks.workunit.client.0.smithi089.stdout:9/765: write d3/d6/d36/fa0 [629974,124942] 0 2024-09-13T02:54:08.247 INFO:tasks.workunit.client.0.smithi089.stdout:7/971: rmdir d3/d19/d67/d10f 0 2024-09-13T02:54:08.249 INFO:tasks.workunit.client.0.smithi089.stdout:2/743: write d13/d30/d4e/fd2 [2038699,51711] 0 2024-09-13T02:54:08.249 INFO:tasks.workunit.client.0.smithi089.stdout:2/744: write d13/d30/d4e/d7b/f8e [5173068,90039] 0 2024-09-13T02:54:08.252 INFO:tasks.workunit.client.1.smithi131.stdout:2/368: dwrite d5/f47 [0,4194304] 0 2024-09-13T02:54:08.253 INFO:tasks.workunit.client.0.smithi089.stdout:4/938: dwrite d2/d3/d86/fbb [0,4194304] 0 2024-09-13T02:54:08.255 INFO:tasks.workunit.client.0.smithi089.stdout:1/758: dwrite dc/d46/d6c/d98/ff0 [0,4194304] 0 2024-09-13T02:54:08.255 INFO:tasks.workunit.client.0.smithi089.stdout:1/759: readlink dc/d46/d6c/la7 0 2024-09-13T02:54:08.255 INFO:tasks.workunit.client.0.smithi089.stdout:1/760: stat dc/d6e 0 2024-09-13T02:54:08.256 INFO:tasks.workunit.client.0.smithi089.stdout:2/745: mknod d13/d30/d61/dca/cfe 0 2024-09-13T02:54:08.258 INFO:tasks.workunit.client.0.smithi089.stdout:9/766: symlink d3/lf8 0 2024-09-13T02:54:08.258 INFO:tasks.workunit.client.0.smithi089.stdout:9/767: truncate d3/d6/d2a/d94/fda 838840 0 2024-09-13T02:54:08.258 INFO:tasks.workunit.client.0.smithi089.stdout:9/768: read - d3/d6/d2a/d94/d56/fe0 zero size 2024-09-13T02:54:08.264 INFO:tasks.workunit.client.0.smithi089.stdout:1/761: write dc/d6e/fa2 [2952458,25511] 0 2024-09-13T02:54:08.264 INFO:tasks.workunit.client.0.smithi089.stdout:1/762: creat dc/d3a/d53/d2c/d34/d9b/ff2 x:0 0 0 2024-09-13T02:54:08.264 INFO:tasks.workunit.client.0.smithi089.stdout:1/763: stat f3 0 2024-09-13T02:54:08.264 INFO:tasks.workunit.client.1.smithi131.stdout:2/369: dread d5/d31/d1d/d32/f5e [0,4194304] 0 2024-09-13T02:54:08.266 INFO:tasks.workunit.client.0.smithi089.stdout:7/972: rmdir d3/d19/d75/db2 39 2024-09-13T02:54:08.269 INFO:tasks.workunit.client.0.smithi089.stdout:4/939: creat d2/d3/d86/dfd/f12d x:0 0 0 2024-09-13T02:54:08.271 INFO:tasks.workunit.client.0.smithi089.stdout:8/900: dwrite de/d16/d1e/d27/ff9 [0,4194304] 0 2024-09-13T02:54:08.271 INFO:tasks.workunit.client.0.smithi089.stdout:6/819: dwrite db/d10/fa0 [0,4194304] 0 2024-09-13T02:54:08.275 INFO:tasks.workunit.client.0.smithi089.stdout:2/746: rename d13/d30/d61/d78/dd3/de7/c8b to d13/d30/d4e/d7b/df7/cff 0 2024-09-13T02:54:08.276 INFO:tasks.workunit.client.0.smithi089.stdout:9/769: creat d3/df6/ff9 x:0 0 0 2024-09-13T02:54:08.284 INFO:tasks.workunit.client.0.smithi089.stdout:7/973: symlink d3/d19/d75/db2/d105/d117/d71/l134 0 2024-09-13T02:54:08.284 INFO:tasks.workunit.client.0.smithi089.stdout:7/974: dread - d3/d44/d85/dbd/fe5 zero size 2024-09-13T02:54:08.284 INFO:tasks.workunit.client.0.smithi089.stdout:7/975: fsync d3/d19/f41 0 2024-09-13T02:54:08.284 INFO:tasks.workunit.client.0.smithi089.stdout:8/901: rmdir de/d16/d1e/d20/d39/df5 39 2024-09-13T02:54:08.286 INFO:tasks.workunit.client.0.smithi089.stdout:2/747: rename d13/d30/d4e/d6f/d76/fb8 to d13/d30/d4e/d6f/d76/dd6/f100 0 2024-09-13T02:54:08.287 INFO:tasks.workunit.client.0.smithi089.stdout:9/770: mkdir d3/d6/d2a/d4b/d77/dfa 0 2024-09-13T02:54:08.287 INFO:tasks.workunit.client.0.smithi089.stdout:9/771: creat d3/d6/d2a/d94/d24/d35/ffb x:0 0 0 2024-09-13T02:54:08.288 INFO:tasks.workunit.client.0.smithi089.stdout:1/764: getdents dc/d3a/d53 0 2024-09-13T02:54:08.288 INFO:tasks.workunit.client.0.smithi089.stdout:1/765: write dc/d3a/d53/d2c/d34/d9b/ff2 [23377,88740] 0 2024-09-13T02:54:08.289 INFO:tasks.workunit.client.0.smithi089.stdout:7/976: mkdir d3/d44/d85/d77/d107/d135 0 2024-09-13T02:54:08.289 INFO:tasks.workunit.client.0.smithi089.stdout:4/940: getdents d2/d55 0 2024-09-13T02:54:08.289 INFO:tasks.workunit.client.0.smithi089.stdout:4/941: write d2/d22/da1/f2d [4305951,89496] 0 2024-09-13T02:54:08.292 INFO:tasks.workunit.client.0.smithi089.stdout:2/748: symlink d13/d30/d61/dca/l101 0 2024-09-13T02:54:08.293 INFO:tasks.workunit.client.0.smithi089.stdout:6/820: dwrite db/d10/d3a/d7b/f104 [0,4194304] 0 2024-09-13T02:54:08.296 INFO:tasks.workunit.client.0.smithi089.stdout:7/977: symlink d3/d44/d85/d77/d107/da1/db4/dd3/l136 0 2024-09-13T02:54:08.298 INFO:tasks.workunit.client.0.smithi089.stdout:4/942: creat d2/d3/d5/d49/f12e x:0 0 0 2024-09-13T02:54:08.298 INFO:tasks.workunit.client.0.smithi089.stdout:4/943: readlink d2/d3/d5/d49/l63 0 2024-09-13T02:54:08.302 INFO:tasks.workunit.client.0.smithi089.stdout:6/821: symlink db/d43/d6e/d28/d2f/dc8/df2/l10b 0 2024-09-13T02:54:08.302 INFO:tasks.workunit.client.0.smithi089.stdout:7/978: getdents d3/d19/d75/db2/d105/d117/d71 0 2024-09-13T02:54:08.302 INFO:tasks.workunit.client.0.smithi089.stdout:4/944: mkdir d2/d22/d120/d12f 0 2024-09-13T02:54:08.306 INFO:tasks.workunit.client.0.smithi089.stdout:6/822: unlink db/d10/de9/d53/fa7 0 2024-09-13T02:54:08.306 INFO:tasks.workunit.client.0.smithi089.stdout:6/823: chown db/d10/de9/d53/f94 1856490 1 2024-09-13T02:54:08.306 INFO:tasks.workunit.client.0.smithi089.stdout:6/824: fsync db/d43/d6e/d28/d2f/f35 0 2024-09-13T02:54:08.306 INFO:tasks.workunit.client.0.smithi089.stdout:7/979: dread f0 [0,4194304] 0 2024-09-13T02:54:08.307 INFO:tasks.workunit.client.0.smithi089.stdout:4/945: rename d2/d3/d5/d43/d3b/d71/d10d/fa3 to d2/da/f130 0 2024-09-13T02:54:08.309 INFO:tasks.workunit.client.0.smithi089.stdout:6/825: unlink db/d43/d6e/d28/fe3 0 2024-09-13T02:54:08.310 INFO:tasks.workunit.client.0.smithi089.stdout:7/980: rmdir d3/d44/d85 39 2024-09-13T02:54:08.310 INFO:tasks.workunit.client.0.smithi089.stdout:8/902: dwrite de/d16/f6f [0,4194304] 0 2024-09-13T02:54:08.310 INFO:tasks.workunit.client.0.smithi089.stdout:8/903: fdatasync de/d16/d1e/d20/d39/df5/f11d 0 2024-09-13T02:54:08.311 INFO:tasks.workunit.client.0.smithi089.stdout:4/946: symlink d2/d3/d5/d43/d3b/d71/d10d/daf/d105/l131 0 2024-09-13T02:54:08.311 INFO:tasks.workunit.client.0.smithi089.stdout:4/947: chown d2/d3/d86 1 1 2024-09-13T02:54:08.311 INFO:tasks.workunit.client.0.smithi089.stdout:4/948: chown d2/d22/c77 19 1 2024-09-13T02:54:08.311 INFO:tasks.workunit.client.0.smithi089.stdout:6/826: creat db/d43/d6e/d28/d2f/f10c x:0 0 0 2024-09-13T02:54:08.312 INFO:tasks.workunit.client.0.smithi089.stdout:7/981: rename d3/d19/d75/f4a to d3/d19/d75/db2/f137 0 2024-09-13T02:54:08.314 INFO:tasks.workunit.client.0.smithi089.stdout:4/949: rename d2/d3/d5/d43/d84/df1 to d2/d22/d120/d12f/d132 0 2024-09-13T02:54:08.315 INFO:tasks.workunit.client.0.smithi089.stdout:7/982: getdents d3/d19/d2e 0 2024-09-13T02:54:08.315 INFO:tasks.workunit.client.0.smithi089.stdout:7/983: chown d3/d44/d85/d77/d107/da1/db4/dd3/cf3 1788645 1 2024-09-13T02:54:08.315 INFO:tasks.workunit.client.0.smithi089.stdout:7/984: fsync d3/d44/d85/d5e/d6f/f11b 0 2024-09-13T02:54:08.315 INFO:tasks.workunit.client.0.smithi089.stdout:7/985: fdatasync d3/d44/d85/d5e/d6f/f11b 0 2024-09-13T02:54:08.315 INFO:tasks.workunit.client.0.smithi089.stdout:6/827: symlink db/d10/l10d 0 2024-09-13T02:54:08.316 INFO:tasks.workunit.client.0.smithi089.stdout:4/950: symlink d2/d3/l133 0 2024-09-13T02:54:08.317 INFO:tasks.workunit.client.0.smithi089.stdout:4/951: stat d2/d3/d5/d43/d3b/c79 0 2024-09-13T02:54:08.317 INFO:tasks.workunit.client.0.smithi089.stdout:4/952: fdatasync d2/f40 0 2024-09-13T02:54:08.323 INFO:tasks.workunit.client.0.smithi089.stdout:4/953: dread d2/f4c [0,4194304] 0 2024-09-13T02:54:08.325 INFO:tasks.workunit.client.0.smithi089.stdout:9/772: dwrite d3/d6/d2a/d94/f38 [0,4194304] 0 2024-09-13T02:54:08.325 INFO:tasks.workunit.client.0.smithi089.stdout:2/749: dwrite d13/d30/d64/f6e [4194304,4194304] 0 2024-09-13T02:54:08.325 INFO:tasks.workunit.client.0.smithi089.stdout:8/904: dread de/d16/d1e/f83 [0,4194304] 0 2024-09-13T02:54:08.326 INFO:tasks.workunit.client.0.smithi089.stdout:8/905: write de/d16/d1e/d20/d39/f12f [74135,30202] 0 2024-09-13T02:54:08.326 INFO:tasks.workunit.client.0.smithi089.stdout:8/906: chown de/d16/d1e/d20/d39/df5/dff/d61/d8e/d108/cb3 510741 1 2024-09-13T02:54:08.327 INFO:tasks.workunit.client.0.smithi089.stdout:4/954: creat d2/d22/da1/d62/d6c/f134 x:0 0 0 2024-09-13T02:54:08.330 INFO:tasks.workunit.client.0.smithi089.stdout:4/955: read d2/f53 [3005929,112278] 0 2024-09-13T02:54:08.331 INFO:tasks.workunit.client.0.smithi089.stdout:9/773: rename d3/d6/d2a/d4b/cbd to d3/d6/d2a/d4b/d6d/dea/cfc 0 2024-09-13T02:54:08.333 INFO:tasks.workunit.client.0.smithi089.stdout:7/986: dwrite d3/d44/d85/d77/d107/ddd/feb [0,4194304] 0 2024-09-13T02:54:08.336 INFO:tasks.workunit.client.0.smithi089.stdout:8/907: creat de/d16/d1e/d20/d39/df5/dff/dc2/f134 x:0 0 0 2024-09-13T02:54:08.340 INFO:tasks.workunit.client.0.smithi089.stdout:7/987: mkdir d3/d44/d85/d77/d107/da1/db4/d138 0 2024-09-13T02:54:08.344 INFO:tasks.workunit.client.0.smithi089.stdout:7/988: rename d3/d44/d85/d77/d107/da1/db4/dd3/ff1 to d3/d44/d85/d55/d96/dc5/f139 0 2024-09-13T02:54:08.348 INFO:tasks.workunit.client.0.smithi089.stdout:8/908: write de/d16/d1e/d3f/d5b/f78 [2752073,65411] 0 2024-09-13T02:54:08.350 INFO:tasks.workunit.client.0.smithi089.stdout:8/909: creat de/d16/d12b/f135 x:0 0 0 2024-09-13T02:54:08.352 INFO:tasks.workunit.client.0.smithi089.stdout:2/750: dwrite d13/d30/d4e/d7b/f8e [0,4194304] 0 2024-09-13T02:54:08.352 INFO:tasks.workunit.client.0.smithi089.stdout:4/956: dread d2/fca [0,4194304] 0 2024-09-13T02:54:08.352 INFO:tasks.workunit.client.0.smithi089.stdout:4/957: chown d2/d3/d5/d43/c8d 432374704 1 2024-09-13T02:54:08.352 INFO:tasks.workunit.client.0.smithi089.stdout:4/958: truncate d2/da/f130 5775304 0 2024-09-13T02:54:08.352 INFO:tasks.workunit.client.0.smithi089.stdout:9/774: dwrite d3/d6/d2a/d4b/d6d/f82 [0,4194304] 0 2024-09-13T02:54:08.352 INFO:tasks.workunit.client.0.smithi089.stdout:9/775: write d3/d6/d2a/d4b/f9c [4896877,122447] 0 2024-09-13T02:54:08.355 INFO:tasks.workunit.client.1.smithi131.stdout:2/370: mknod d5/d31/d1d/d32/d3b/d67/c79 0 2024-09-13T02:54:08.355 INFO:tasks.workunit.client.1.smithi131.stdout:2/371: read - d5/d31/d26/f77 zero size 2024-09-13T02:54:08.355 INFO:tasks.workunit.client.0.smithi089.stdout:2/751: unlink d13/d30/d64/lcf 0 2024-09-13T02:54:08.357 INFO:tasks.workunit.client.0.smithi089.stdout:2/752: creat d13/d30/d4e/d6f/d76/dd6/f102 x:0 0 0 2024-09-13T02:54:08.357 INFO:tasks.workunit.client.1.smithi131.stdout:2/372: creat d5/d34/f7a x:0 0 0 2024-09-13T02:54:08.358 INFO:tasks.workunit.client.1.smithi131.stdout:2/373: chown d5/d31/d1d/d32/d3b/d67 494280 1 2024-09-13T02:54:08.358 INFO:tasks.workunit.client.1.smithi131.stdout:2/374: creat d5/d18/f7b x:0 0 0 2024-09-13T02:54:08.359 INFO:tasks.workunit.client.0.smithi089.stdout:2/753: rename d13/d30/d4e/d7b/d86/lce to d13/d30/d59/l103 0 2024-09-13T02:54:08.371 INFO:tasks.workunit.client.0.smithi089.stdout:7/989: dwrite d3/d19/d75/db2/d105/d117/da0/db0/fd0 [0,4194304] 0 2024-09-13T02:54:08.371 INFO:tasks.workunit.client.0.smithi089.stdout:7/990: chown d3/d44/l2c 233 1 2024-09-13T02:54:08.371 INFO:tasks.workunit.client.0.smithi089.stdout:7/991: chown d3/d19/d75/db2/d105/d117/d71/l92 2078 1 2024-09-13T02:54:08.371 INFO:tasks.workunit.client.0.smithi089.stdout:7/992: fsync d3/d19/d2e/d37/fdf 0 2024-09-13T02:54:08.371 INFO:tasks.workunit.client.0.smithi089.stdout:7/993: read d3/d19/d75/db2/d105/d117/d71/d10b/f123 [3514995,35270] 0 2024-09-13T02:54:08.371 INFO:tasks.workunit.client.0.smithi089.stdout:7/994: dread - d3/d44/d85/d5e/d6f/f11b zero size 2024-09-13T02:54:08.371 INFO:tasks.workunit.client.0.smithi089.stdout:7/995: stat d3/d19/d75/db2/d105/d117/da0/db0/c132 0 2024-09-13T02:54:08.373 INFO:tasks.workunit.client.0.smithi089.stdout:2/754: dread d13/d30/f49 [0,4194304] 0 2024-09-13T02:54:08.373 INFO:tasks.workunit.client.0.smithi089.stdout:2/755: truncate d13/d30/d4e/f56 104637 0 2024-09-13T02:54:08.374 INFO:tasks.workunit.client.0.smithi089.stdout:7/996: rename d3/d19/d2e/d37/fdf to d3/d44/d85/d77/d107/d135/f13a 0 2024-09-13T02:54:08.374 INFO:tasks.workunit.client.0.smithi089.stdout:7/997: chown d3/d44/d85/d77/d107/da1/db4/d138 5 1 2024-09-13T02:54:08.381 INFO:tasks.workunit.client.0.smithi089.stdout:8/910: dwrite de/f18 [0,4194304] 0 2024-09-13T02:54:08.381 INFO:tasks.workunit.client.0.smithi089.stdout:8/911: fdatasync de/d16/d1e/d27/fa3 0 2024-09-13T02:54:08.382 INFO:tasks.workunit.client.0.smithi089.stdout:8/912: dread de/d16/d1e/dc7/f100 [0,4194304] 0 2024-09-13T02:54:08.386 INFO:tasks.workunit.client.0.smithi089.stdout:4/959: dwrite d2/d3/fe7 [0,4194304] 0 2024-09-13T02:54:08.386 INFO:tasks.workunit.client.0.smithi089.stdout:4/960: chown d2/d3/d5/d43/l6e 2040260 1 2024-09-13T02:54:08.386 INFO:tasks.workunit.client.0.smithi089.stdout:4/961: fdatasync d2/d3/d86/fc1 0 2024-09-13T02:54:08.386 INFO:tasks.workunit.client.0.smithi089.stdout:4/962: fsync d2/d3/d86/dfd/fa4 0 2024-09-13T02:54:08.387 INFO:tasks.workunit.client.0.smithi089.stdout:4/963: write d2/da/fe3 [526081,67141] 0 2024-09-13T02:54:08.387 INFO:tasks.workunit.client.0.smithi089.stdout:4/964: chown d2/d3/d86/dfd/f12d 0 1 2024-09-13T02:54:08.388 INFO:tasks.workunit.client.0.smithi089.stdout:4/965: rmdir d2/d22/da1/d62/d6c/d88/db2 39 2024-09-13T02:54:08.388 INFO:tasks.workunit.client.0.smithi089.stdout:4/966: readlink d2/d22/l74 0 2024-09-13T02:54:08.388 INFO:tasks.workunit.client.0.smithi089.stdout:4/967: dread - d2/d3/d5/d72/f121 zero size 2024-09-13T02:54:08.391 INFO:tasks.workunit.client.0.smithi089.stdout:7/998: read d3/d44/d85/d77/d107/da1/fa2 [1363524,109780] 0 2024-09-13T02:54:08.391 INFO:tasks.workunit.client.0.smithi089.stdout:7/999: fsync d3/d44/d85/d5e/d6f/fd4 0 2024-09-13T02:54:08.399 INFO:tasks.workunit.client.0.smithi089.stdout:4/968: write d2/d22/da1/d62/fff [2617725,96696] 0 2024-09-13T02:54:08.399 INFO:tasks.workunit.client.0.smithi089.stdout:4/969: chown d2/d3/lb8 22 1 2024-09-13T02:54:08.400 INFO:tasks.workunit.client.0.smithi089.stdout:2/756: dwrite d13/d30/d61/d78/d79/d90/fad [0,4194304] 0 2024-09-13T02:54:08.400 INFO:tasks.workunit.client.1.smithi131.stdout:2/375: dwrite d5/f3a [4194304,4194304] 0 2024-09-13T02:54:08.401 INFO:tasks.workunit.client.1.smithi131.stdout:2/376: chown d5/f47 16863 1 2024-09-13T02:54:08.401 INFO:tasks.workunit.client.1.smithi131.stdout:2/377: chown d5/d1e/d48 33 1 2024-09-13T02:54:08.402 INFO:tasks.workunit.client.0.smithi089.stdout:4/970: read d2/f40 [2335800,76064] 0 2024-09-13T02:54:08.402 INFO:tasks.workunit.client.1.smithi131.stdout:2/378: mkdir d5/d31/d1d/d37/d7c 0 2024-09-13T02:54:08.403 INFO:tasks.workunit.client.0.smithi089.stdout:8/913: dwrite de/d16/d1e/d20/d6c/f11c [0,4194304] 0 2024-09-13T02:54:08.403 INFO:tasks.workunit.client.0.smithi089.stdout:8/914: write de/d16/d1e/d20/d39/df5/dff/d61/f75 [4126053,87436] 0 2024-09-13T02:54:08.406 INFO:tasks.workunit.client.0.smithi089.stdout:8/915: mkdir de/d16/d1e/d20/d6c/d136 0 2024-09-13T02:54:08.410 INFO:tasks.workunit.client.0.smithi089.stdout:8/916: link de/d16/d1e/d3f/d106/f122 de/d16/d1e/d67/f137 0 2024-09-13T02:54:08.410 INFO:tasks.workunit.client.0.smithi089.stdout:8/917: fdatasync de/d16/d1e/f30 0 2024-09-13T02:54:08.410 INFO:tasks.workunit.client.0.smithi089.stdout:8/918: write de/d16/d1e/d20/d6c/d6e/d7e/f110 [1009803,103476] 0 2024-09-13T02:54:08.410 INFO:tasks.workunit.client.0.smithi089.stdout:8/919: fdatasync de/f1a 0 2024-09-13T02:54:08.410 INFO:tasks.workunit.client.0.smithi089.stdout:8/920: fsync de/d16/d1e/d27/d35/f5a 0 2024-09-13T02:54:08.413 INFO:tasks.workunit.client.1.smithi131.stdout:2/379: dread d5/d18/f1b [4194304,4194304] 0 2024-09-13T02:54:08.415 INFO:tasks.workunit.client.1.smithi131.stdout:2/380: mkdir d5/d31/d1d/d32/d7d 0 2024-09-13T02:54:08.417 INFO:tasks.workunit.client.1.smithi131.stdout:2/381: rmdir d5/d31/d21/d57/d5c 0 2024-09-13T02:54:08.417 INFO:tasks.workunit.client.1.smithi131.stdout:2/382: chown d5/d31/d26/c58 388850 1 2024-09-13T02:54:08.417 INFO:tasks.workunit.client.0.smithi089.stdout:2/757: dwrite d13/d30/d4e/d6f/f7d [0,4194304] 0 2024-09-13T02:54:08.418 INFO:tasks.workunit.client.0.smithi089.stdout:2/758: creat d13/d30/d4e/d6f/d76/dd6/f104 x:0 0 0 2024-09-13T02:54:08.418 INFO:tasks.workunit.client.0.smithi089.stdout:2/759: write d13/d30/d61/d78/dd3/de7/fed [761606,82219] 0 2024-09-13T02:54:08.418 INFO:tasks.workunit.client.1.smithi131.stdout:2/383: symlink d5/d34/d42/l7e 0 2024-09-13T02:54:08.418 INFO:tasks.workunit.client.1.smithi131.stdout:2/384: chown d5/d33/d66/c6a 74 1 2024-09-13T02:54:08.418 INFO:tasks.workunit.client.1.smithi131.stdout:2/385: creat d5/d31/d26/f7f x:0 0 0 2024-09-13T02:54:08.419 INFO:tasks.workunit.client.1.smithi131.stdout:2/386: rename d5/d33/d41/f44 to d5/d31/d1d/d37/d7c/f80 0 2024-09-13T02:54:08.426 INFO:tasks.workunit.client.0.smithi089.stdout:2/760: write d13/f89 [5652984,98875] 0 2024-09-13T02:54:08.426 INFO:tasks.workunit.client.0.smithi089.stdout:8/921: dwrite de/f18 [0,4194304] 0 2024-09-13T02:54:08.428 INFO:tasks.workunit.client.1.smithi131.stdout:2/387: rmdir d5/d31/d26 39 2024-09-13T02:54:08.429 INFO:tasks.workunit.client.0.smithi089.stdout:8/922: rename de/d16/d1e/d20/l25 to de/d16/d12b/d12e/l138 0 2024-09-13T02:54:08.430 INFO:tasks.workunit.client.1.smithi131.stdout:2/388: link d5/d31/d26/c46 d5/d4f/c81 0 2024-09-13T02:54:08.430 INFO:tasks.workunit.client.1.smithi131.stdout:2/389: write d5/d31/d26/f77 [841298,114632] 0 2024-09-13T02:54:08.430 INFO:tasks.workunit.client.0.smithi089.stdout:8/923: mknod de/d16/d1e/d3f/dd9/c139 0 2024-09-13T02:54:08.430 INFO:tasks.workunit.client.0.smithi089.stdout:8/924: fsync de/f57 0 2024-09-13T02:54:08.431 INFO:tasks.workunit.client.0.smithi089.stdout:8/925: chown de/d16/d1e/d20/d6c/d6e/d7e/lbd 65345 1 2024-09-13T02:54:08.431 INFO:tasks.workunit.client.1.smithi131.stdout:2/390: symlink d5/d31/d4e/l82 0 2024-09-13T02:54:08.432 INFO:tasks.workunit.client.0.smithi089.stdout:8/926: rename de/d16/d1e/d3f/d5b to de/d16/d1e/d13a 0 2024-09-13T02:54:08.433 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:08 smithi131 ceph-mon[34689]: pgmap v246: 65 pgs: 65 active+clean; 2.5 GiB data, 8.6 GiB used, 528 GiB / 536 GiB avail; 237 MiB/s rd, 292 MiB/s wr, 379 op/s 2024-09-13T02:54:08.434 INFO:tasks.workunit.client.0.smithi089.stdout:8/927: symlink de/d16/d12b/d12e/d133/l13b 0 2024-09-13T02:54:08.435 INFO:tasks.workunit.client.0.smithi089.stdout:8/928: rmdir de/d16/d1e/d20/d39/df5/dff/d61/d8e/d109/d125 0 2024-09-13T02:54:08.435 INFO:tasks.workunit.client.0.smithi089.stdout:8/929: dread - de/d16/d1e/d3f/d106/d117/f121 zero size 2024-09-13T02:54:08.436 INFO:tasks.workunit.client.0.smithi089.stdout:8/930: stat de/d16/d1e/d27/d35/ffa 0 2024-09-13T02:54:08.436 INFO:tasks.workunit.client.0.smithi089.stdout:2/761: write d13/d30/d61/d78/d79/fe4 [147633,86256] 0 2024-09-13T02:54:08.436 INFO:tasks.workunit.client.0.smithi089.stdout:8/931: creat de/d16/d1e/d20/d39/df5/dff/d61/d8e/dfc/f13c x:0 0 0 2024-09-13T02:54:08.440 INFO:tasks.workunit.client.0.smithi089.stdout:8/932: mknod de/d16/d1e/d3f/de2/c13d 0 2024-09-13T02:54:08.440 INFO:tasks.workunit.client.1.smithi131.stdout:2/391: dread d5/f28 [0,4194304] 0 2024-09-13T02:54:08.441 INFO:tasks.workunit.client.1.smithi131.stdout:2/392: mknod d5/d33/d41/c83 0 2024-09-13T02:54:08.441 INFO:tasks.workunit.client.1.smithi131.stdout:2/393: chown d5/d31/d1d/d32/f49 26549 1 2024-09-13T02:54:08.442 INFO:tasks.workunit.client.1.smithi131.stdout:2/394: truncate d5/d1e/f4d 259946 0 2024-09-13T02:54:08.445 INFO:tasks.workunit.client.1.smithi131.stdout:2/395: rename d5/d18/f7b to d5/d1e/d48/d4c/f84 0 2024-09-13T02:54:08.446 INFO:tasks.workunit.client.1.smithi131.stdout:2/396: creat d5/d18/d68/f85 x:0 0 0 2024-09-13T02:54:08.455 INFO:tasks.workunit.client.0.smithi089.stdout:8/933: dwrite de/d16/d1e/f2a [0,4194304] 0 2024-09-13T02:54:08.455 INFO:tasks.workunit.client.0.smithi089.stdout:8/934: write de/d16/d1e/d20/d39/df5/dff/d61/f75 [1251891,82627] 0 2024-09-13T02:54:08.456 INFO:tasks.workunit.client.0.smithi089.stdout:8/935: creat de/d16/d131/f13e x:0 0 0 2024-09-13T02:54:08.457 INFO:tasks.workunit.client.0.smithi089.stdout:8/936: rename de/d16/d1e/d20/da8/dd1/f12d to de/d16/d1e/d20/da8/dd1/f13f 0 2024-09-13T02:54:08.470 INFO:tasks.workunit.client.1.smithi131.stdout:2/397: dwrite d5/d31/d1d/d32/f5e [4194304,4194304] 0 2024-09-13T02:54:08.470 INFO:tasks.workunit.client.1.smithi131.stdout:2/398: readlink d5/l11 0 2024-09-13T02:54:08.471 INFO:tasks.workunit.client.1.smithi131.stdout:2/399: truncate d5/d18/d4b/f40 202457 0 2024-09-13T02:54:08.478 INFO:tasks.workunit.client.0.smithi089.stdout:8/937: dwrite de/d16/d1e/d3f/f46 [0,4194304] 0 2024-09-13T02:54:08.479 INFO:tasks.workunit.client.0.smithi089.stdout:8/938: creat de/d16/d1e/d27/f140 x:0 0 0 2024-09-13T02:54:08.480 INFO:tasks.workunit.client.0.smithi089.stdout:8/939: symlink de/d16/d131/l141 0 2024-09-13T02:54:08.480 INFO:tasks.workunit.client.0.smithi089.stdout:8/940: dread - de/d16/d1e/d13a/fd2 zero size 2024-09-13T02:54:08.481 INFO:tasks.workunit.client.0.smithi089.stdout:8/941: creat de/d16/d1e/d20/d6c/d6e/d7e/de7/f142 x:0 0 0 2024-09-13T02:54:08.483 INFO:tasks.workunit.client.0.smithi089.stdout:8/942: dread de/d16/d1e/d20/d39/df5/dff/fb0 [0,4194304] 0 2024-09-13T02:54:08.483 INFO:tasks.workunit.client.0.smithi089.stdout:8/943: chown de/d16/d1e/d20/d39/df5/l107 7 1 2024-09-13T02:54:08.483 INFO:tasks.workunit.client.0.smithi089.stdout:8/944: stat de/f14 0 2024-09-13T02:54:08.504 INFO:tasks.workunit.client.1.smithi131.stdout:2/400: dwrite d5/d31/d1d/d32/f5e [0,4194304] 0 2024-09-13T02:54:08.504 INFO:tasks.workunit.client.1.smithi131.stdout:2/401: write d5/d18/d68/f85 [476279,13845] 0 2024-09-13T02:54:08.505 INFO:tasks.workunit.client.1.smithi131.stdout:2/402: chown d5/d34/d42/f64 154929 1 2024-09-13T02:54:08.505 INFO:tasks.workunit.client.0.smithi089.stdout:8/945: dwrite de/d16/d1e/f31 [0,4194304] 0 2024-09-13T02:54:08.505 INFO:tasks.workunit.client.0.smithi089.stdout:8/946: fdatasync de/d16/d1e/d20/d39/df5/dff/f5f 0 2024-09-13T02:54:08.505 INFO:tasks.workunit.client.0.smithi089.stdout:8/947: stat de/d16/d1e/d3f 0 2024-09-13T02:54:08.505 INFO:tasks.workunit.client.0.smithi089.stdout:8/948: write de/d16/d1e/d20/da8/fbf [1418323,105882] 0 2024-09-13T02:54:08.505 INFO:tasks.workunit.client.0.smithi089.stdout:8/949: truncate de/d16/d1e/d13a/ffd 456668 0 2024-09-13T02:54:08.514 INFO:tasks.workunit.client.1.smithi131.stdout:2/403: write d5/d31/d21/f24 [3101390,79557] 0 2024-09-13T02:54:08.516 INFO:tasks.workunit.client.1.smithi131.stdout:2/404: truncate d5/d33/d66/f73 568777 0 2024-09-13T02:54:08.534 INFO:tasks.workunit.client.1.smithi131.stdout:2/405: dwrite d5/d31/d1d/f54 [0,4194304] 0 2024-09-13T02:54:08.534 INFO:tasks.workunit.client.0.smithi089.stdout:8/950: dwrite de/d16/d1e/d20/da8/fbf [0,4194304] 0 2024-09-13T02:54:08.534 INFO:tasks.workunit.client.0.smithi089.stdout:8/951: chown de/d16/d1e/d20/d39/df5/dff/d61/le8 182190596 1 2024-09-13T02:54:08.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:08 smithi089 ceph-mon[27639]: pgmap v246: 65 pgs: 65 active+clean; 2.5 GiB data, 8.6 GiB used, 528 GiB / 536 GiB avail; 237 MiB/s rd, 292 MiB/s wr, 379 op/s 2024-09-13T02:54:08.536 INFO:tasks.workunit.client.1.smithi131.stdout:2/406: creat d5/d31/d26/f86 x:0 0 0 2024-09-13T02:54:08.537 INFO:tasks.workunit.client.1.smithi131.stdout:2/407: mkdir d5/d31/d1d/d32/d3b/d67/d87 0 2024-09-13T02:54:08.537 INFO:tasks.workunit.client.1.smithi131.stdout:2/408: symlink d5/d31/d1d/d37/l88 0 2024-09-13T02:54:08.537 INFO:tasks.workunit.client.1.smithi131.stdout:2/409: chown d5/d31/d1d/f54 0 1 2024-09-13T02:54:08.541 INFO:tasks.workunit.client.1.smithi131.stdout:2/410: dread d5/d18/d4b/f40 [0,4194304] 0 2024-09-13T02:54:08.543 INFO:tasks.workunit.client.1.smithi131.stdout:2/411: rename d5/fe to d5/d18/d4b/f89 0 2024-09-13T02:54:08.543 INFO:tasks.workunit.client.1.smithi131.stdout:2/412: chown d5/d33/d66/f73 27016 1 2024-09-13T02:54:08.543 INFO:tasks.workunit.client.1.smithi131.stdout:2/413: creat d5/d33/d66/f8a x:0 0 0 2024-09-13T02:54:08.544 INFO:tasks.workunit.client.1.smithi131.stdout:2/414: symlink d5/d31/d1d/l8b 0 2024-09-13T02:54:08.552 INFO:tasks.workunit.client.0.smithi089.stdout:8/952: dwrite de/f14 [0,4194304] 0 2024-09-13T02:54:08.553 INFO:tasks.workunit.client.0.smithi089.stdout:8/953: mkdir de/d16/d1e/dc7/d143 0 2024-09-13T02:54:08.553 INFO:tasks.workunit.client.0.smithi089.stdout:8/954: creat de/d16/d1e/d20/d39/df5/dff/d61/d8e/dfc/f144 x:0 0 0 2024-09-13T02:54:08.554 INFO:tasks.workunit.client.0.smithi089.stdout:8/955: truncate de/d16/d1e/d27/f3b 3482694 0 2024-09-13T02:54:08.554 INFO:tasks.workunit.client.0.smithi089.stdout:8/956: creat de/d16/d1e/d20/d39/df5/dff/dc2/f145 x:0 0 0 2024-09-13T02:54:08.568 INFO:tasks.workunit.client.0.smithi089.stdout:8/957: dwrite de/f10 [4194304,4194304] 0 2024-09-13T02:54:08.570 INFO:tasks.workunit.client.0.smithi089.stdout:8/958: link de/d16/d1e/d3f/fdf de/d16/d1e/d13a/f146 0 2024-09-13T02:54:08.571 INFO:tasks.workunit.client.0.smithi089.stdout:8/959: write de/d16/d1e/d27/d76/ff8 [909718,110527] 0 2024-09-13T02:54:08.575 INFO:tasks.workunit.client.0.smithi089.stdout:8/960: dread de/d16/d1e/d27/d35/ffa [0,4194304] 0 2024-09-13T02:54:08.576 INFO:tasks.workunit.client.0.smithi089.stdout:8/961: unlink de/dc1/f101 0 2024-09-13T02:54:08.577 INFO:tasks.workunit.client.0.smithi089.stdout:8/962: readlink de/d16/d1e/d20/d39/df5/dff/d61/l84 0 2024-09-13T02:54:08.592 INFO:tasks.workunit.client.0.smithi089.stdout:8/963: dwrite de/d16/d1e/d20/d39/df5/dff/d61/d8e/f90 [0,4194304] 0 2024-09-13T02:54:08.593 INFO:tasks.workunit.client.0.smithi089.stdout:8/964: mknod de/d16/d12b/d12e/d133/c147 0 2024-09-13T02:54:08.594 INFO:tasks.workunit.client.0.smithi089.stdout:8/965: mkdir de/d16/d1e/d3f/d106/d117/d148 0 2024-09-13T02:54:08.594 INFO:tasks.workunit.client.0.smithi089.stdout:8/966: write de/f5e [748756,23147] 0 2024-09-13T02:54:08.595 INFO:tasks.workunit.client.0.smithi089.stdout:8/967: rmdir de/d16/d1e/d20/d39/df5 39 2024-09-13T02:54:08.595 INFO:tasks.workunit.client.0.smithi089.stdout:8/968: fsync de/d16/d1e/d20/d39/df5/dff/dc2/f12c 0 2024-09-13T02:54:08.595 INFO:tasks.workunit.client.0.smithi089.stdout:8/969: chown de/f1a 68254 1 2024-09-13T02:54:08.595 INFO:tasks.workunit.client.0.smithi089.stdout:8/970: truncate de/d16/d1e/d3f/d71/f81 2401774 0 2024-09-13T02:54:08.598 INFO:tasks.workunit.client.0.smithi089.stdout:8/971: getdents de/d16/d1e/d13a 0 2024-09-13T02:54:08.599 INFO:tasks.workunit.client.0.smithi089.stdout:8/972: symlink de/d16/d1e/d20/da8/l149 0 2024-09-13T02:54:08.600 INFO:tasks.workunit.client.0.smithi089.stdout:8/973: creat de/d16/d1e/d20/d39/df5/dff/f14a x:0 0 0 2024-09-13T02:54:08.600 INFO:tasks.workunit.client.0.smithi089.stdout:8/974: truncate de/d16/d1e/d20/d6c/d10f/fd0 824024 0 2024-09-13T02:54:08.601 INFO:tasks.workunit.client.0.smithi089.stdout:8/975: rename de/d16/d1e/d3f/d71/fc0 to de/d16/d1e/d20/d39/df5/dff/f14b 0 2024-09-13T02:54:08.603 INFO:tasks.workunit.client.0.smithi089.stdout:8/976: read de/d16/d1e/d27/d35/f8b [249109,49138] 0 2024-09-13T02:54:09.028 INFO:tasks.workunit.client.0.smithi089.stdout:1/766: sync 2024-09-13T02:54:09.028 INFO:tasks.workunit.client.0.smithi089.stdout:8/977: sync 2024-09-13T02:54:09.028 INFO:tasks.workunit.client.0.smithi089.stdout:5/823: sync 2024-09-13T02:54:09.028 INFO:tasks.workunit.client.0.smithi089.stdout:0/770: sync 2024-09-13T02:54:09.028 INFO:tasks.workunit.client.0.smithi089.stdout:8/978: chown de/d16/d1e/d27/l9c 457 1 2024-09-13T02:54:09.028 INFO:tasks.workunit.client.0.smithi089.stdout:2/762: sync 2024-09-13T02:54:09.028 INFO:tasks.workunit.client.0.smithi089.stdout:4/971: sync 2024-09-13T02:54:09.028 INFO:tasks.workunit.client.0.smithi089.stdout:9/776: sync 2024-09-13T02:54:09.028 INFO:tasks.workunit.client.0.smithi089.stdout:9/777: dread - d3/d6/d2a/d94/d56/fe0 zero size 2024-09-13T02:54:09.028 INFO:tasks.workunit.client.0.smithi089.stdout:6/828: sync 2024-09-13T02:54:09.028 INFO:tasks.workunit.client.0.smithi089.stdout:3/886: sync 2024-09-13T02:54:09.029 INFO:tasks.workunit.client.0.smithi089.stdout:6/829: fdatasync db/d43/d6e/f2c 0 2024-09-13T02:54:09.029 INFO:tasks.workunit.client.0.smithi089.stdout:9/778: write d3/d6/d2a/d94/d56/f9a [613490,69441] 0 2024-09-13T02:54:09.029 INFO:tasks.workunit.client.0.smithi089.stdout:1/767: symlink dc/d3a/d53/d2c/d34/lf3 0 2024-09-13T02:54:09.029 INFO:tasks.workunit.client.0.smithi089.stdout:1/768: truncate dc/d3a/d53/d2c/d94/fcf 136621 0 2024-09-13T02:54:09.029 INFO:tasks.workunit.client.0.smithi089.stdout:1/769: creat dc/d46/d6c/ff4 x:0 0 0 2024-09-13T02:54:09.030 INFO:tasks.workunit.client.0.smithi089.stdout:5/824: mknod d1/d4/d45/d6f/d62/d72/d99/c102 0 2024-09-13T02:54:09.030 INFO:tasks.workunit.client.0.smithi089.stdout:2/763: mkdir d13/d30/d59/dbe/df2/d105 0 2024-09-13T02:54:09.030 INFO:tasks.workunit.client.0.smithi089.stdout:2/764: readlink d13/d30/d4e/l80 0 2024-09-13T02:54:09.032 INFO:tasks.workunit.client.0.smithi089.stdout:3/887: creat d2/d20/d44/f121 x:0 0 0 2024-09-13T02:54:09.032 INFO:tasks.workunit.client.0.smithi089.stdout:3/888: stat d2/d8/d5f/fed 0 2024-09-13T02:54:09.032 INFO:tasks.workunit.client.0.smithi089.stdout:3/889: chown d2/d20/d23/d2b/cb0 9 1 2024-09-13T02:54:09.032 INFO:tasks.workunit.client.0.smithi089.stdout:6/830: mknod db/d10/de9/d53/d83/c10e 0 2024-09-13T02:54:09.032 INFO:tasks.workunit.client.0.smithi089.stdout:6/831: readlink db/d43/l45 0 2024-09-13T02:54:09.034 INFO:tasks.workunit.client.0.smithi089.stdout:9/779: dread d3/d6/d2a/d94/d24/f48 [0,4194304] 0 2024-09-13T02:54:09.036 INFO:tasks.workunit.client.0.smithi089.stdout:1/770: creat dc/d44/d73/d85/dd6/ddf/ff5 x:0 0 0 2024-09-13T02:54:09.036 INFO:tasks.workunit.client.0.smithi089.stdout:1/771: creat dc/d46/d6c/ff6 x:0 0 0 2024-09-13T02:54:09.037 INFO:tasks.workunit.client.0.smithi089.stdout:0/771: dread d2/d19/d1a/d3d/d4b/d4f/f58 [0,4194304] 0 2024-09-13T02:54:09.038 INFO:tasks.workunit.client.0.smithi089.stdout:4/972: rmdir d2/d3/d86/dfd/dbf 39 2024-09-13T02:54:09.042 INFO:tasks.workunit.client.0.smithi089.stdout:3/890: creat d2/f122 x:0 0 0 2024-09-13T02:54:09.042 INFO:tasks.workunit.client.0.smithi089.stdout:3/891: dread - d2/d8/dc/d57/ff2 zero size 2024-09-13T02:54:09.042 INFO:tasks.workunit.client.0.smithi089.stdout:3/892: chown d2/d20/d23/d2b/fad 452091 1 2024-09-13T02:54:09.044 INFO:tasks.workunit.client.0.smithi089.stdout:6/832: mkdir db/d43/d6e/d28/d37/d10f 0 2024-09-13T02:54:09.048 INFO:tasks.workunit.client.0.smithi089.stdout:0/772: unlink d2/d64/db3/dc6/fd1 0 2024-09-13T02:54:09.048 INFO:tasks.workunit.client.0.smithi089.stdout:4/973: symlink d2/d3/d5/d43/d3b/d71/d10d/daf/dc6/l135 0 2024-09-13T02:54:09.049 INFO:tasks.workunit.client.0.smithi089.stdout:3/893: creat d2/d90/f123 x:0 0 0 2024-09-13T02:54:09.050 INFO:tasks.workunit.client.0.smithi089.stdout:6/833: mkdir db/d10/de9/d53/d83/ddc/d110 0 2024-09-13T02:54:09.052 INFO:tasks.workunit.client.0.smithi089.stdout:9/780: rename d3/d6/d2a/d4b/d6d/f82 to d3/d6/ffd 0 2024-09-13T02:54:09.055 INFO:tasks.workunit.client.0.smithi089.stdout:6/834: link db/d10/c1b db/d43/d6e/d28/d37/d8b/dcd/d7d/c111 0 2024-09-13T02:54:09.055 INFO:tasks.workunit.client.0.smithi089.stdout:6/835: chown db/db2/fb7 110 1 2024-09-13T02:54:09.056 INFO:tasks.workunit.client.0.smithi089.stdout:6/836: write db/d10/f80 [279885,45278] 0 2024-09-13T02:54:09.056 INFO:tasks.workunit.client.0.smithi089.stdout:6/837: truncate db/db2/fb7 4235345 0 2024-09-13T02:54:09.058 INFO:tasks.workunit.client.0.smithi089.stdout:9/781: rename d3/d6/d2a/d4b/d54/dc1 to d3/dfe 0 2024-09-13T02:54:09.059 INFO:tasks.workunit.client.0.smithi089.stdout:6/838: creat db/d10/de9/d53/d83/d9f/de0/f112 x:0 0 0 2024-09-13T02:54:09.061 INFO:tasks.workunit.client.0.smithi089.stdout:6/839: mkdir db/d43/d6e/d28/d37/d8b/d113 0 2024-09-13T02:54:09.061 INFO:tasks.workunit.client.0.smithi089.stdout:6/840: readlink db/d10/de9/d53/d83/d9f/leb 0 2024-09-13T02:54:09.062 INFO:tasks.workunit.client.0.smithi089.stdout:2/765: dwrite d13/d30/d61/d78/d79/d90/fad [0,4194304] 0 2024-09-13T02:54:09.062 INFO:tasks.workunit.client.0.smithi089.stdout:2/766: dread - d13/d30/d4e/d6f/fac zero size 2024-09-13T02:54:09.064 INFO:tasks.workunit.client.0.smithi089.stdout:2/767: symlink d13/d30/l106 0 2024-09-13T02:54:09.064 INFO:tasks.workunit.client.0.smithi089.stdout:2/768: stat d13/d30/d59/dbe/fbf 0 2024-09-13T02:54:09.064 INFO:tasks.workunit.client.0.smithi089.stdout:6/841: rmdir db/d10/dc1/d102 39 2024-09-13T02:54:09.064 INFO:tasks.workunit.client.0.smithi089.stdout:6/842: chown db/d43/d6e/d28/d37/d8b/dcd/d7d/fb6 390 1 2024-09-13T02:54:09.065 INFO:tasks.workunit.client.0.smithi089.stdout:2/769: mknod d13/d30/d4e/d7b/df7/c107 0 2024-09-13T02:54:09.065 INFO:tasks.workunit.client.0.smithi089.stdout:2/770: creat d13/da9/f108 x:0 0 0 2024-09-13T02:54:09.065 INFO:tasks.workunit.client.0.smithi089.stdout:3/894: write d2/f9b [4891999,88207] 0 2024-09-13T02:54:09.068 INFO:tasks.workunit.client.0.smithi089.stdout:2/771: dread d13/d30/d4e/d7b/fdb [0,4194304] 0 2024-09-13T02:54:09.069 INFO:tasks.workunit.client.0.smithi089.stdout:2/772: chown d13/d30/d4e/ff4 186287 1 2024-09-13T02:54:09.069 INFO:tasks.workunit.client.0.smithi089.stdout:3/895: write d2/d8/dc/d9a/fb8 [975581,76002] 0 2024-09-13T02:54:09.070 INFO:tasks.workunit.client.0.smithi089.stdout:3/896: mknod d2/d8/dc/d3c/d9e/c124 0 2024-09-13T02:54:09.072 INFO:tasks.workunit.client.0.smithi089.stdout:5/825: dwrite d1/d4/d2b/fef [0,4194304] 0 2024-09-13T02:54:09.072 INFO:tasks.workunit.client.0.smithi089.stdout:2/773: unlink f3 0 2024-09-13T02:54:09.072 INFO:tasks.workunit.client.0.smithi089.stdout:2/774: fdatasync d13/d30/d61/d78/d79/d90/fee 0 2024-09-13T02:54:09.073 INFO:tasks.workunit.client.0.smithi089.stdout:5/826: dread d1/d4/d45/d8c/d98/fb9 [0,4194304] 0 2024-09-13T02:54:09.073 INFO:tasks.workunit.client.0.smithi089.stdout:3/897: link d2/d20/d23/d32/d5b/f79 d2/d8b/daf/ddf/d11d/f125 0 2024-09-13T02:54:09.073 INFO:tasks.workunit.client.0.smithi089.stdout:1/772: dwrite dc/d3a/d53/f26 [0,4194304] 0 2024-09-13T02:54:09.074 INFO:tasks.workunit.client.0.smithi089.stdout:8/979: dwrite de/d16/d1e/d20/f2b [0,4194304] 0 2024-09-13T02:54:09.075 INFO:tasks.workunit.client.0.smithi089.stdout:0/773: dwrite d2/d19/d1a/d3d/d4b/d4f/f5c [0,4194304] 0 2024-09-13T02:54:09.075 INFO:tasks.workunit.client.0.smithi089.stdout:3/898: write d2/d8/dc/d9a/d9c/f10f [4488976,69816] 0 2024-09-13T02:54:09.075 INFO:tasks.workunit.client.0.smithi089.stdout:3/899: creat d2/d8b/daf/f126 x:0 0 0 2024-09-13T02:54:09.076 INFO:tasks.workunit.client.0.smithi089.stdout:2/775: truncate d13/d30/d4e/d6f/f7d 2251154 0 2024-09-13T02:54:09.078 INFO:tasks.workunit.client.0.smithi089.stdout:5/827: link d1/ce0 d1/d4/d45/d6f/d4d/d7f/d49/c103 0 2024-09-13T02:54:09.078 INFO:tasks.workunit.client.0.smithi089.stdout:5/828: chown d1/d4 164 1 2024-09-13T02:54:09.080 INFO:tasks.workunit.client.0.smithi089.stdout:1/773: creat dc/d44/d73/d9a/ff7 x:0 0 0 2024-09-13T02:54:09.080 INFO:tasks.workunit.client.0.smithi089.stdout:1/774: chown dc/d3a/d53/d2c/d94/fdc 235807 1 2024-09-13T02:54:09.080 INFO:tasks.workunit.client.0.smithi089.stdout:1/775: readlink dc/d44/d73/d9a/da1/lab 0 2024-09-13T02:54:09.083 INFO:tasks.workunit.client.0.smithi089.stdout:8/980: symlink de/d16/d1e/d3f/d106/l14c 0 2024-09-13T02:54:09.090 INFO:tasks.workunit.client.0.smithi089.stdout:8/981: dread de/d16/d1e/d20/d6c/d6e/d7e/f82 [0,4194304] 0 2024-09-13T02:54:09.091 INFO:tasks.workunit.client.0.smithi089.stdout:6/843: dwrite db/d10/d3a/f8a [4194304,4194304] 0 2024-09-13T02:54:09.094 INFO:tasks.workunit.client.0.smithi089.stdout:8/982: dread f0 [0,4194304] 0 2024-09-13T02:54:09.095 INFO:tasks.workunit.client.0.smithi089.stdout:3/900: mkdir d2/d8/d5f/d127 0 2024-09-13T02:54:09.096 INFO:tasks.workunit.client.0.smithi089.stdout:2/776: creat d13/d30/d4e/d7b/d86/dc0/f109 x:0 0 0 2024-09-13T02:54:09.097 INFO:tasks.workunit.client.0.smithi089.stdout:5/829: rmdir d1/d4/d45/d6f/d4d/d9d 39 2024-09-13T02:54:09.100 INFO:tasks.workunit.client.0.smithi089.stdout:6/844: symlink db/db2/df7/l114 0 2024-09-13T02:54:09.100 INFO:tasks.workunit.client.0.smithi089.stdout:6/845: write db/d10/d3a/d7b/f7c [1830170,94650] 0 2024-09-13T02:54:09.104 INFO:tasks.workunit.client.0.smithi089.stdout:8/983: mkdir de/d16/d1e/d20/d39/df5/dff/d14d 0 2024-09-13T02:54:09.104 INFO:tasks.workunit.client.0.smithi089.stdout:0/774: dwrite d2/f26 [4194304,4194304] 0 2024-09-13T02:54:09.105 INFO:tasks.workunit.client.0.smithi089.stdout:0/775: stat d2/d19/f2d 0 2024-09-13T02:54:09.105 INFO:tasks.workunit.client.0.smithi089.stdout:1/776: dwrite dc/d3a/d53/d2c/f2e [0,4194304] 0 2024-09-13T02:54:09.105 INFO:tasks.workunit.client.0.smithi089.stdout:3/901: unlink d2/d90/fa9 0 2024-09-13T02:54:09.107 INFO:tasks.workunit.client.0.smithi089.stdout:8/984: dread de/d16/d1e/d27/fa3 [0,4194304] 0 2024-09-13T02:54:09.107 INFO:tasks.workunit.client.0.smithi089.stdout:2/777: unlink d13/d30/d61/d78/dd3/de7/fed 0 2024-09-13T02:54:09.108 INFO:tasks.workunit.client.0.smithi089.stdout:5/830: symlink d1/d4/d45/dc7/l104 0 2024-09-13T02:54:09.108 INFO:tasks.workunit.client.0.smithi089.stdout:5/831: chown d1/d4/d45/d6f/d62/d72/d99/lfe 1689007 1 2024-09-13T02:54:09.111 INFO:tasks.workunit.client.0.smithi089.stdout:6/846: write db/d10/f59 [3315881,22369] 0 2024-09-13T02:54:09.112 INFO:tasks.workunit.client.0.smithi089.stdout:0/776: creat d2/d64/d91/fff x:0 0 0 2024-09-13T02:54:09.117 INFO:tasks.workunit.client.0.smithi089.stdout:1/777: mknod dc/d3a/d53/cf8 0 2024-09-13T02:54:09.117 INFO:tasks.workunit.client.0.smithi089.stdout:8/985: mkdir de/d16/d1e/d20/da8/dd1/d14e 0 2024-09-13T02:54:09.117 INFO:tasks.workunit.client.0.smithi089.stdout:1/778: write dc/d3a/d53/d2c/d36/f92 [904232,87974] 0 2024-09-13T02:54:09.119 INFO:tasks.workunit.client.0.smithi089.stdout:6/847: creat db/d10/de9/d7e/da1/df4/f115 x:0 0 0 2024-09-13T02:54:09.122 INFO:tasks.workunit.client.0.smithi089.stdout:5/832: dread d1/d4/d45/d6f/d4d/d7f/d49/f6b [0,4194304] 0 2024-09-13T02:54:09.128 INFO:tasks.workunit.client.0.smithi089.stdout:8/986: dread de/d16/d1e/d20/d39/df5/dff/d61/f94 [0,4194304] 0 2024-09-13T02:54:09.134 INFO:tasks.workunit.client.0.smithi089.stdout:3/902: dwrite d2/f122 [0,4194304] 0 2024-09-13T02:54:09.136 INFO:tasks.workunit.client.0.smithi089.stdout:0/777: rmdir d2/d19 39 2024-09-13T02:54:09.137 INFO:tasks.workunit.client.0.smithi089.stdout:5/833: mkdir d1/d4/d45/d6f/d4d/d7f/d105 0 2024-09-13T02:54:09.137 INFO:tasks.workunit.client.0.smithi089.stdout:5/834: chown d1/d4/d2b/f2e 553579328 1 2024-09-13T02:54:09.138 INFO:tasks.workunit.client.0.smithi089.stdout:8/987: truncate de/d16/d1e/d3f/d106/d117/f11b 3398550 0 2024-09-13T02:54:09.138 INFO:tasks.workunit.client.0.smithi089.stdout:8/988: write de/fcd [259942,63630] 0 2024-09-13T02:54:09.139 INFO:tasks.workunit.client.0.smithi089.stdout:3/903: rmdir d2/d20/d23/d32 39 2024-09-13T02:54:09.140 INFO:tasks.workunit.client.0.smithi089.stdout:3/904: chown d2/d20/d23/d2b/lde 57463 1 2024-09-13T02:54:09.141 INFO:tasks.workunit.client.0.smithi089.stdout:5/835: symlink d1/d4/d2b/l106 0 2024-09-13T02:54:09.141 INFO:tasks.workunit.client.0.smithi089.stdout:8/989: mkdir de/d56/d14f 0 2024-09-13T02:54:09.141 INFO:tasks.workunit.client.0.smithi089.stdout:8/990: write de/d16/d1e/d67/f7a [846216,123557] 0 2024-09-13T02:54:09.142 INFO:tasks.workunit.client.0.smithi089.stdout:3/905: creat d2/d20/d23/d32/d5b/d71/f128 x:0 0 0 2024-09-13T02:54:09.142 INFO:tasks.workunit.client.0.smithi089.stdout:3/906: creat d2/d8/dc/d3c/d65/df0/f129 x:0 0 0 2024-09-13T02:54:09.143 INFO:tasks.workunit.client.0.smithi089.stdout:5/836: rename d1/d4/d2b/f52 to d1/d4/d2b/f107 0 2024-09-13T02:54:09.144 INFO:tasks.workunit.client.0.smithi089.stdout:8/991: mknod de/d16/d1e/d20/da8/dac/c150 0 2024-09-13T02:54:09.145 INFO:tasks.workunit.client.0.smithi089.stdout:3/907: rename d2/d20/l34 to d2/d8b/l12a 0 2024-09-13T02:54:09.146 INFO:tasks.workunit.client.0.smithi089.stdout:8/992: truncate de/d16/d1e/f31 2089317 0 2024-09-13T02:54:09.148 INFO:tasks.workunit.client.0.smithi089.stdout:5/837: rename d1/c28 to d1/d4/d45/dc7/c108 0 2024-09-13T02:54:09.149 INFO:tasks.workunit.client.0.smithi089.stdout:3/908: creat d2/d8/d5f/d127/f12b x:0 0 0 2024-09-13T02:54:09.151 INFO:tasks.workunit.client.0.smithi089.stdout:0/778: dread d2/d19/d1a/d1e/d42/f5d [0,4194304] 0 2024-09-13T02:54:09.151 INFO:tasks.workunit.client.0.smithi089.stdout:1/779: dwrite dc/d3a/d53/f28 [0,4194304] 0 2024-09-13T02:54:09.151 INFO:tasks.workunit.client.0.smithi089.stdout:1/780: read - dc/d3a/d53/d2c/d34/fbc zero size 2024-09-13T02:54:09.152 INFO:tasks.workunit.client.0.smithi089.stdout:2/778: dwrite d13/d30/d59/fd4 [0,4194304] 0 2024-09-13T02:54:09.152 INFO:tasks.workunit.client.0.smithi089.stdout:6/848: dwrite db/d43/d6e/fd3 [0,4194304] 0 2024-09-13T02:54:09.152 INFO:tasks.workunit.client.0.smithi089.stdout:5/838: truncate d1/d4/d45/fd5 2794526 0 2024-09-13T02:54:09.152 INFO:tasks.workunit.client.0.smithi089.stdout:6/849: creat db/d43/d6e/d28/f116 x:0 0 0 2024-09-13T02:54:09.154 INFO:tasks.workunit.client.0.smithi089.stdout:3/909: dread d2/d8/dc/fa6 [0,4194304] 0 2024-09-13T02:54:09.157 INFO:tasks.workunit.client.0.smithi089.stdout:2/779: creat d13/d30/d61/d78/d79/ddd/f10a x:0 0 0 2024-09-13T02:54:09.162 INFO:tasks.workunit.client.0.smithi089.stdout:1/781: dread dc/d46/f55 [0,4194304] 0 2024-09-13T02:54:09.171 INFO:tasks.workunit.client.0.smithi089.stdout:6/850: mknod db/c117 0 2024-09-13T02:54:09.173 INFO:tasks.workunit.client.0.smithi089.stdout:8/993: rename de/d16/f6f to de/d16/d1e/d20/da8/f151 0 2024-09-13T02:54:09.176 INFO:tasks.workunit.client.0.smithi089.stdout:3/910: rename d2/d8/dc/d9a/fb8 to d2/d8b/daf/ddf/f12c 0 2024-09-13T02:54:09.182 INFO:tasks.workunit.client.0.smithi089.stdout:6/851: write db/d10/de9/d53/f5a [4998189,99280] 0 2024-09-13T02:54:09.184 INFO:tasks.workunit.client.0.smithi089.stdout:3/911: mkdir d2/d20/d23/d32/d5b/d71/d92/da4/d12d 0 2024-09-13T02:54:09.184 INFO:tasks.workunit.client.0.smithi089.stdout:3/912: dread - d2/d8/dc/d9a/d9c/dab/ff4 zero size 2024-09-13T02:54:09.193 INFO:tasks.workunit.client.0.smithi089.stdout:0/779: dwrite d2/f26 [8388608,4194304] 0 2024-09-13T02:54:09.193 INFO:tasks.workunit.client.0.smithi089.stdout:0/780: stat d2/d19/d1a/d3d/d4b/d4f/d59/ccd 0 2024-09-13T02:54:09.193 INFO:tasks.workunit.client.0.smithi089.stdout:0/781: write d2/d19/d1a/d1e/d42/f49 [4350065,25522] 0 2024-09-13T02:54:09.193 INFO:tasks.workunit.client.0.smithi089.stdout:0/782: write d2/d19/d1a/fc5 [1209296,2722] 0 2024-09-13T02:54:09.193 INFO:tasks.workunit.client.0.smithi089.stdout:0/783: readlink d2/d19/l3b 0 2024-09-13T02:54:09.206 INFO:tasks.workunit.client.0.smithi089.stdout:5/839: dwrite d1/f101 [0,4194304] 0 2024-09-13T02:54:09.207 INFO:tasks.workunit.client.0.smithi089.stdout:8/994: dwrite de/d16/d1e/d3f/d106/d117/f11b [0,4194304] 0 2024-09-13T02:54:09.207 INFO:tasks.workunit.client.0.smithi089.stdout:5/840: dread - d1/d4/d45/d6f/f6d zero size 2024-09-13T02:54:09.207 INFO:tasks.workunit.client.0.smithi089.stdout:2/780: dwrite d13/d30/d59/faa [0,4194304] 0 2024-09-13T02:54:09.207 INFO:tasks.workunit.client.0.smithi089.stdout:1/782: dwrite dc/d46/f76 [0,4194304] 0 2024-09-13T02:54:09.207 INFO:tasks.workunit.client.0.smithi089.stdout:2/781: write d13/d30/f62 [4924631,114914] 0 2024-09-13T02:54:09.207 INFO:tasks.workunit.client.0.smithi089.stdout:1/783: write dc/d6e/fa2 [4494553,104965] 0 2024-09-13T02:54:09.208 INFO:tasks.workunit.client.0.smithi089.stdout:5/841: dread d1/d4/d2b/f2e [0,4194304] 0 2024-09-13T02:54:09.208 INFO:tasks.workunit.client.0.smithi089.stdout:5/842: creat d1/d73/dcd/f109 x:0 0 0 2024-09-13T02:54:09.208 INFO:tasks.workunit.client.0.smithi089.stdout:5/843: creat d1/d4/ddb/df3/f10a x:0 0 0 2024-09-13T02:54:09.220 INFO:tasks.workunit.client.0.smithi089.stdout:5/844: dread d1/f26 [0,4194304] 0 2024-09-13T02:54:09.220 INFO:tasks.workunit.client.0.smithi089.stdout:5/845: fdatasync d1/d4/f5 0 2024-09-13T02:54:09.225 INFO:tasks.workunit.client.0.smithi089.stdout:3/913: creat d2/d8/f12e x:0 0 0 2024-09-13T02:54:09.225 INFO:tasks.workunit.client.0.smithi089.stdout:3/914: chown d2/d8b/daf/ddf/d11d/f125 224867 1 2024-09-13T02:54:09.225 INFO:tasks.workunit.client.0.smithi089.stdout:3/915: chown d2/d20/d23/d32/d49/d75/f11b 513866 1 2024-09-13T02:54:09.237 INFO:tasks.workunit.client.0.smithi089.stdout:3/916: write d2/f122 [3386840,23301] 0 2024-09-13T02:54:09.252 INFO:tasks.workunit.client.0.smithi089.stdout:4/974: sync 2024-09-13T02:54:09.252 INFO:tasks.workunit.client.0.smithi089.stdout:9/782: sync 2024-09-13T02:54:09.254 INFO:tasks.workunit.client.0.smithi089.stdout:3/917: dwrite d2/d8b/daf/f115 [0,4194304] 0 2024-09-13T02:54:09.280 INFO:tasks.workunit.client.0.smithi089.stdout:8/995: link de/d16/d1e/d27/d76/l9d de/d56/l152 0 2024-09-13T02:54:09.284 INFO:tasks.workunit.client.0.smithi089.stdout:2/782: link d13/d30/f48 d13/d30/d4e/d7b/d86/da7/f10b 0 2024-09-13T02:54:09.286 INFO:tasks.workunit.client.0.smithi089.stdout:1/784: mknod dc/d46/cf9 0 2024-09-13T02:54:09.289 INFO:tasks.workunit.client.0.smithi089.stdout:8/996: read de/d56/f8c [2744790,109025] 0 2024-09-13T02:54:09.293 INFO:tasks.workunit.client.0.smithi089.stdout:2/783: write d13/d30/d4e/f5d [1113823,80103] 0 2024-09-13T02:54:09.311 INFO:tasks.workunit.client.0.smithi089.stdout:2/784: dwrite d13/d30/f31 [4194304,4194304] 0 2024-09-13T02:54:09.311 INFO:tasks.workunit.client.0.smithi089.stdout:2/785: creat d13/d30/d4e/d6f/d76/dd6/f10c x:0 0 0 2024-09-13T02:54:09.316 INFO:tasks.workunit.client.0.smithi089.stdout:2/786: unlink d13/d30/d61/d78/d9c/fe1 0 2024-09-13T02:54:09.317 INFO:tasks.workunit.client.0.smithi089.stdout:2/787: mkdir d13/d30/d4e/d6f/d76/dd6/d10d 0 2024-09-13T02:54:09.317 INFO:tasks.workunit.client.0.smithi089.stdout:2/788: write d13/da9/f108 [348037,108421] 0 2024-09-13T02:54:09.318 INFO:tasks.workunit.client.0.smithi089.stdout:4/975: write d2/fab [3489593,102075] 0 2024-09-13T02:54:09.318 INFO:tasks.workunit.client.0.smithi089.stdout:4/976: fsync d2/d3/fba 0 2024-09-13T02:54:09.321 INFO:tasks.workunit.client.0.smithi089.stdout:4/977: symlink d2/d22/l136 0 2024-09-13T02:54:09.321 INFO:tasks.workunit.client.0.smithi089.stdout:2/789: read d13/f17 [2071102,15491] 0 2024-09-13T02:54:09.321 INFO:tasks.workunit.client.0.smithi089.stdout:2/790: creat d13/d30/d4e/d7b/d86/dc0/f10e x:0 0 0 2024-09-13T02:54:09.322 INFO:tasks.workunit.client.0.smithi089.stdout:4/978: mkdir d2/d22/d120/d12f/d132/d137 0 2024-09-13T02:54:09.326 INFO:tasks.workunit.client.0.smithi089.stdout:2/791: symlink d13/d30/l10f 0 2024-09-13T02:54:09.326 INFO:tasks.workunit.client.0.smithi089.stdout:2/792: fsync d13/d30/d61/fd9 0 2024-09-13T02:54:09.326 INFO:tasks.workunit.client.0.smithi089.stdout:2/793: dread - d13/d30/d4e/d7b/fe9 zero size 2024-09-13T02:54:09.328 INFO:tasks.workunit.client.0.smithi089.stdout:2/794: symlink d13/d30/d61/d78/dd3/de7/l110 0 2024-09-13T02:54:09.338 INFO:tasks.workunit.client.0.smithi089.stdout:2/795: mkdir d13/d30/d61/d111 0 2024-09-13T02:54:09.345 INFO:tasks.workunit.client.0.smithi089.stdout:5/846: symlink d1/d4/d45/d6f/d4d/l10b 0 2024-09-13T02:54:09.346 INFO:tasks.workunit.client.0.smithi089.stdout:2/796: dread d13/d30/d4e/d6f/f7d [0,4194304] 0 2024-09-13T02:54:09.346 INFO:tasks.workunit.client.0.smithi089.stdout:0/784: creat d2/d19/d1a/d3d/d4b/d4f/f100 x:0 0 0 2024-09-13T02:54:09.346 INFO:tasks.workunit.client.0.smithi089.stdout:0/785: chown d2/f28 261565157 1 2024-09-13T02:54:09.346 INFO:tasks.workunit.client.0.smithi089.stdout:0/786: fdatasync d2/d19/d1a/d3d/d4b/d4f/d59/fce 0 2024-09-13T02:54:09.346 INFO:tasks.workunit.client.0.smithi089.stdout:0/787: write d2/d19/d1a/d4e/d7a/d9b/fe9 [1018124,68669] 0 2024-09-13T02:54:09.346 INFO:tasks.workunit.client.0.smithi089.stdout:5/847: rmdir d1/d4/ddb 39 2024-09-13T02:54:09.346 INFO:tasks.workunit.client.0.smithi089.stdout:2/797: symlink d13/d30/d59/dbe/df2/d105/l112 0 2024-09-13T02:54:09.347 INFO:tasks.workunit.client.0.smithi089.stdout:2/798: chown d13/d30/d59/f96 186124 1 2024-09-13T02:54:09.347 INFO:tasks.workunit.client.0.smithi089.stdout:2/799: fdatasync d13/d30/ff9 0 2024-09-13T02:54:09.348 INFO:tasks.workunit.client.0.smithi089.stdout:4/979: dwrite d2/d22/f34 [0,4194304] 0 2024-09-13T02:54:09.348 INFO:tasks.workunit.client.0.smithi089.stdout:0/788: dread d2/d19/d1a/d1e/d42/f8b [0,4194304] 0 2024-09-13T02:54:09.351 INFO:tasks.workunit.client.0.smithi089.stdout:4/980: symlink d2/d3/d5/d43/d3b/d71/d10d/daf/l138 0 2024-09-13T02:54:09.352 INFO:tasks.workunit.client.0.smithi089.stdout:0/789: getdents d2/dd0 0 2024-09-13T02:54:09.354 INFO:tasks.workunit.client.0.smithi089.stdout:4/981: mkdir d2/d3/d5/d43/d84/d139 0 2024-09-13T02:54:09.359 INFO:tasks.workunit.client.0.smithi089.stdout:9/783: rename d3/d6/d36/fa0 to d3/d6/d36/d9d/db6/de9/fff 0 2024-09-13T02:54:09.359 INFO:tasks.workunit.client.0.smithi089.stdout:9/784: fsync d3/d6/d2a/fed 0 2024-09-13T02:54:09.362 INFO:tasks.workunit.client.0.smithi089.stdout:3/918: rename d2/d8/dc/d57/ld6 to d2/d8/dc/d3c/d9e/l12f 0 2024-09-13T02:54:09.363 INFO:tasks.workunit.client.0.smithi089.stdout:4/982: dread d2/da/f44 [0,4194304] 0 2024-09-13T02:54:09.363 INFO:tasks.workunit.client.0.smithi089.stdout:9/785: mkdir d3/df6/d100 0 2024-09-13T02:54:09.363 INFO:tasks.workunit.client.0.smithi089.stdout:4/983: readlink d2/d3/d5/d49/l63 0 2024-09-13T02:54:09.365 INFO:tasks.workunit.client.0.smithi089.stdout:1/785: rename dc/c16 to dc/d3a/d53/d2c/d34/d8b/db5/cfa 0 2024-09-13T02:54:09.365 INFO:tasks.workunit.client.0.smithi089.stdout:1/786: chown dc/d3a/d53/d2c/d36/f58 3747938 1 2024-09-13T02:54:09.365 INFO:tasks.workunit.client.0.smithi089.stdout:1/787: dread - dc/d3a/d53/fcc zero size 2024-09-13T02:54:09.365 INFO:tasks.workunit.client.0.smithi089.stdout:1/788: readlink dc/l2a 0 2024-09-13T02:54:09.365 INFO:tasks.workunit.client.0.smithi089.stdout:3/919: symlink d2/d20/d23/d32/d5b/d71/d92/da4/l130 0 2024-09-13T02:54:09.366 INFO:tasks.workunit.client.0.smithi089.stdout:9/786: creat d3/d6/d2a/d94/da7/f101 x:0 0 0 2024-09-13T02:54:09.367 INFO:tasks.workunit.client.0.smithi089.stdout:4/984: symlink d2/d22/da1/l13a 0 2024-09-13T02:54:09.369 INFO:tasks.workunit.client.0.smithi089.stdout:5/848: dwrite d1/f47 [0,4194304] 0 2024-09-13T02:54:09.370 INFO:tasks.workunit.client.0.smithi089.stdout:8/997: rename de/f10 to de/d56/d14f/f153 0 2024-09-13T02:54:09.370 INFO:tasks.workunit.client.0.smithi089.stdout:8/998: readlink de/d16/d1e/d27/l5c 0 2024-09-13T02:54:09.370 INFO:tasks.workunit.client.0.smithi089.stdout:8/999: fdatasync de/d16/d1e/d20/d39/f12f 0 2024-09-13T02:54:09.371 INFO:tasks.workunit.client.0.smithi089.stdout:1/789: creat dc/d44/d73/d85/dd6/dd7/de1/ffb x:0 0 0 2024-09-13T02:54:09.372 INFO:tasks.workunit.client.0.smithi089.stdout:9/787: mknod d3/dcf/c102 0 2024-09-13T02:54:09.374 INFO:tasks.workunit.client.0.smithi089.stdout:4/985: symlink d2/d22/d120/l13b 0 2024-09-13T02:54:09.377 INFO:tasks.workunit.client.0.smithi089.stdout:0/790: dwrite d2/dd0/fe6 [0,4194304] 0 2024-09-13T02:54:09.379 INFO:tasks.workunit.client.0.smithi089.stdout:5/849: rename d1/fb6 to d1/d4/d45/d6f/d4d/d9d/daa/f10c 0 2024-09-13T02:54:09.380 INFO:tasks.workunit.client.0.smithi089.stdout:9/788: dread d3/f22 [0,4194304] 0 2024-09-13T02:54:09.380 INFO:tasks.workunit.client.0.smithi089.stdout:9/789: chown d3/d3d/d8b/dba/cd4 33 1 2024-09-13T02:54:09.384 INFO:tasks.workunit.client.0.smithi089.stdout:0/791: symlink d2/d64/db3/de0/l101 0 2024-09-13T02:54:09.384 INFO:tasks.workunit.client.0.smithi089.stdout:0/792: truncate d2/d19/d1a/d3d/d4b/d4f/f9d 4387778 0 2024-09-13T02:54:09.384 INFO:tasks.workunit.client.0.smithi089.stdout:9/790: dread - d3/d6/d2a/d4b/d54/fae zero size 2024-09-13T02:54:09.386 INFO:tasks.workunit.client.0.smithi089.stdout:0/793: creat d2/d19/d1a/d1e/d42/d7e/f102 x:0 0 0 2024-09-13T02:54:09.387 INFO:tasks.workunit.client.0.smithi089.stdout:9/791: getdents d3/d6/d2a/d4b/d77 0 2024-09-13T02:54:09.387 INFO:tasks.workunit.client.0.smithi089.stdout:9/792: readlink d3/d6/d36/d9d/db6/lf2 0 2024-09-13T02:54:09.388 INFO:tasks.workunit.client.0.smithi089.stdout:0/794: mknod d2/d19/d1a/d3d/d4b/d4f/d59/dd9/c103 0 2024-09-13T02:54:09.390 INFO:tasks.workunit.client.0.smithi089.stdout:0/795: unlink d2/d19/d1a/l41 0 2024-09-13T02:54:09.393 INFO:tasks.workunit.client.0.smithi089.stdout:0/796: symlink d2/dd0/de5/l104 0 2024-09-13T02:54:09.393 INFO:tasks.workunit.client.0.smithi089.stdout:5/850: write d1/d4/d2b/f50 [1226996,27218] 0 2024-09-13T02:54:09.393 INFO:tasks.workunit.client.0.smithi089.stdout:3/920: dwrite d2/d8/dc/d9a/d9c/dab/f100 [0,4194304] 0 2024-09-13T02:54:09.394 INFO:tasks.workunit.client.0.smithi089.stdout:1/790: dwrite dc/d44/fb6 [0,4194304] 0 2024-09-13T02:54:09.394 INFO:tasks.workunit.client.0.smithi089.stdout:1/791: fdatasync dc/d44/d73/f69 0 2024-09-13T02:54:09.394 INFO:tasks.workunit.client.0.smithi089.stdout:4/986: creat d2/d22/da1/d62/d6c/f13c x:0 0 0 2024-09-13T02:54:09.394 INFO:tasks.workunit.client.0.smithi089.stdout:4/987: chown d2/da/f30 17605 1 2024-09-13T02:54:09.394 INFO:tasks.workunit.client.0.smithi089.stdout:4/988: chown d2/d3/d5/d49/l11f 452692513 1 2024-09-13T02:54:09.394 INFO:tasks.workunit.client.0.smithi089.stdout:4/989: fdatasync d2/d3/d5/f70 0 2024-09-13T02:54:09.395 INFO:tasks.workunit.client.0.smithi089.stdout:0/797: symlink d2/d64/db3/dc6/l105 0 2024-09-13T02:54:09.395 INFO:tasks.workunit.client.0.smithi089.stdout:5/851: mknod d1/d4/d2b/c10d 0 2024-09-13T02:54:09.400 INFO:tasks.workunit.client.0.smithi089.stdout:0/798: symlink d2/d19/d1a/d3d/d4b/d4f/l106 0 2024-09-13T02:54:09.402 INFO:tasks.workunit.client.0.smithi089.stdout:6/852: mknod db/d43/d6e/d28/d37/c118 0 2024-09-13T02:54:09.402 INFO:tasks.workunit.client.0.smithi089.stdout:6/853: truncate db/d10/d3a/f84 4688245 0 2024-09-13T02:54:09.402 INFO:tasks.workunit.client.0.smithi089.stdout:6/854: chown db/d10/de9/d53/d83/d9f/db1/c100 23 1 2024-09-13T02:54:09.405 INFO:tasks.workunit.client.0.smithi089.stdout:2/800: creat d13/d30/d4e/d6f/f113 x:0 0 0 2024-09-13T02:54:09.407 INFO:tasks.workunit.client.0.smithi089.stdout:1/792: write dc/d3a/d53/d2c/d34/f67 [2123665,13313] 0 2024-09-13T02:54:09.408 INFO:tasks.workunit.client.0.smithi089.stdout:2/801: creat d13/d30/db1/f114 x:0 0 0 2024-09-13T02:54:09.408 INFO:tasks.workunit.client.0.smithi089.stdout:2/802: readlink d13/d30/l46 0 2024-09-13T02:54:09.408 INFO:tasks.workunit.client.0.smithi089.stdout:3/921: dread d2/d8/dc/d3c/d65/f87 [0,4194304] 0 2024-09-13T02:54:09.409 INFO:tasks.workunit.client.0.smithi089.stdout:9/793: dwrite d3/dfe/f9b [0,4194304] 0 2024-09-13T02:54:09.409 INFO:tasks.workunit.client.0.smithi089.stdout:9/794: write d3/fc4 [2442191,36129] 0 2024-09-13T02:54:09.410 INFO:tasks.workunit.client.0.smithi089.stdout:1/793: rename dc/d44/d73/d9a/da1 to dc/d44/d73/d85/dd6/ddf/dfc 0 2024-09-13T02:54:09.411 INFO:tasks.workunit.client.0.smithi089.stdout:2/803: mknod d13/d30/d4e/d6f/d76/dd6/c115 0 2024-09-13T02:54:09.411 INFO:tasks.workunit.client.0.smithi089.stdout:2/804: write d13/da9/fe5 [748539,124621] 0 2024-09-13T02:54:09.414 INFO:tasks.workunit.client.0.smithi089.stdout:3/922: link d2/d20/f28 d2/d8/dc/d57/f131 0 2024-09-13T02:54:09.420 INFO:tasks.workunit.client.0.smithi089.stdout:9/795: symlink d3/d6/d2a/d4b/d54/da1/l103 0 2024-09-13T02:54:09.422 INFO:tasks.workunit.client.0.smithi089.stdout:4/990: dwrite d2/d55/f9f [0,4194304] 0 2024-09-13T02:54:09.422 INFO:tasks.workunit.client.0.smithi089.stdout:1/794: symlink dc/d3a/d53/d2c/d34/lfd 0 2024-09-13T02:54:09.424 INFO:tasks.workunit.client.0.smithi089.stdout:9/796: truncate d3/d15/f49 2907517 0 2024-09-13T02:54:09.424 INFO:tasks.workunit.client.0.smithi089.stdout:9/797: truncate d3/d6/d2a/d94/d24/d35/f80 4421578 0 2024-09-13T02:54:09.428 INFO:tasks.workunit.client.0.smithi089.stdout:4/991: mkdir d2/d3/d5/d49/d13d 0 2024-09-13T02:54:09.429 INFO:tasks.workunit.client.0.smithi089.stdout:1/795: getdents dc/d6e/de0 0 2024-09-13T02:54:09.431 INFO:tasks.workunit.client.0.smithi089.stdout:9/798: creat d3/d6/d2a/d94/d24/f104 x:0 0 0 2024-09-13T02:54:09.433 INFO:tasks.workunit.client.0.smithi089.stdout:4/992: mknod d2/d3/d5/d43/d3b/d71/c13e 0 2024-09-13T02:54:09.434 INFO:tasks.workunit.client.0.smithi089.stdout:9/799: creat d3/d6/d36/d9d/db6/de3/f105 x:0 0 0 2024-09-13T02:54:09.434 INFO:tasks.workunit.client.0.smithi089.stdout:9/800: truncate d3/d3d/d8b/dba/dd0/fd6 638881 0 2024-09-13T02:54:09.434 INFO:tasks.workunit.client.0.smithi089.stdout:9/801: truncate d3/d15/fe4 581104 0 2024-09-13T02:54:09.435 INFO:tasks.workunit.client.0.smithi089.stdout:9/802: write d3/d6/d2a/d94/d56/fe0 [482113,78678] 0 2024-09-13T02:54:09.435 INFO:tasks.workunit.client.0.smithi089.stdout:4/993: rmdir d2/d22/da1 39 2024-09-13T02:54:09.437 INFO:tasks.workunit.client.0.smithi089.stdout:9/803: symlink d3/d3d/d8b/l106 0 2024-09-13T02:54:09.441 INFO:tasks.workunit.client.0.smithi089.stdout:9/804: dread d3/f22 [0,4194304] 0 2024-09-13T02:54:09.441 INFO:tasks.workunit.client.0.smithi089.stdout:9/805: chown d3/d3d/d8b/c7a 3089996 1 2024-09-13T02:54:09.441 INFO:tasks.workunit.client.0.smithi089.stdout:4/994: dread d2/da/fe3 [0,4194304] 0 2024-09-13T02:54:09.446 INFO:tasks.workunit.client.0.smithi089.stdout:5/852: dwrite d1/f47 [0,4194304] 0 2024-09-13T02:54:09.446 INFO:tasks.workunit.client.0.smithi089.stdout:0/799: dwrite d2/d19/d1a/d3d/d4b/d4f/f5c [0,4194304] 0 2024-09-13T02:54:09.447 INFO:tasks.workunit.client.0.smithi089.stdout:0/800: truncate d2/d19/d1a/d3d/d4b/d4f/d59/d6b/f6f 784785 0 2024-09-13T02:54:09.454 INFO:tasks.workunit.client.0.smithi089.stdout:1/796: dwrite dc/d3a/f5a [0,4194304] 0 2024-09-13T02:54:09.455 INFO:tasks.workunit.client.0.smithi089.stdout:6/855: dwrite db/d43/d6e/d28/d37/d8b/dcd/d7d/faa [0,4194304] 0 2024-09-13T02:54:09.455 INFO:tasks.workunit.client.0.smithi089.stdout:3/923: dwrite d2/d8/dc/d9a/d9c/dab/ff4 [0,4194304] 0 2024-09-13T02:54:09.455 INFO:tasks.workunit.client.0.smithi089.stdout:2/805: dwrite d13/d30/f3c [0,4194304] 0 2024-09-13T02:54:09.456 INFO:tasks.workunit.client.0.smithi089.stdout:1/797: link dc/d3a/d53/d2c/cd2 dc/d44/d73/d85/dd6/dd7/de1/cfe 0 2024-09-13T02:54:09.458 INFO:tasks.workunit.client.0.smithi089.stdout:5/853: dread d1/d4/d45/d6f/d4d/d9d/daa/f10c [0,4194304] 0 2024-09-13T02:54:09.459 INFO:tasks.workunit.client.0.smithi089.stdout:6/856: mknod db/c119 0 2024-09-13T02:54:09.464 INFO:tasks.workunit.client.0.smithi089.stdout:2/806: rename d13/d30/d4e/d6f/d76/dd6/lfc to d13/d30/d61/d78/dd3/de7/db7/l116 0 2024-09-13T02:54:09.467 INFO:tasks.workunit.client.0.smithi089.stdout:0/801: dwrite d2/d19/d1a/d1e/d42/dd4/ff4 [0,4194304] 0 2024-09-13T02:54:09.467 INFO:tasks.workunit.client.0.smithi089.stdout:3/924: dread d2/d8b/daf/ddf/d11d/f125 [0,4194304] 0 2024-09-13T02:54:09.471 INFO:tasks.workunit.client.0.smithi089.stdout:6/857: mknod db/d10/de9/d53/d83/d9f/c11a 0 2024-09-13T02:54:09.473 INFO:tasks.workunit.client.0.smithi089.stdout:5/854: rename d1/d4/d45/d6f/f5f to d1/d4/d45/d6f/d4d/d7f/d49/d5a/f10e 0 2024-09-13T02:54:09.475 INFO:tasks.workunit.client.0.smithi089.stdout:2/807: unlink d13/d30/d4e/d7b/fe9 0 2024-09-13T02:54:09.475 INFO:tasks.workunit.client.0.smithi089.stdout:2/808: dread - d13/d30/d61/d78/d79/ddd/f10a zero size 2024-09-13T02:54:09.475 INFO:tasks.workunit.client.0.smithi089.stdout:2/809: write d13/d30/d4e/d7b/d86/da7/f10b [5200290,42740] 0 2024-09-13T02:54:09.475 INFO:tasks.workunit.client.0.smithi089.stdout:2/810: write d13/d30/d4e/f65 [5739674,115113] 0 2024-09-13T02:54:09.475 INFO:tasks.workunit.client.0.smithi089.stdout:3/925: dread d2/d20/d23/d32/d49/d75/fbc [0,4194304] 0 2024-09-13T02:54:09.476 INFO:tasks.workunit.client.0.smithi089.stdout:0/802: getdents d2/d19/d1a/da4 0 2024-09-13T02:54:09.477 INFO:tasks.workunit.client.0.smithi089.stdout:2/811: dread d13/d30/f41 [0,4194304] 0 2024-09-13T02:54:09.477 INFO:tasks.workunit.client.0.smithi089.stdout:2/812: chown d13/d30/d61/dca/l101 986178 1 2024-09-13T02:54:09.477 INFO:tasks.workunit.client.0.smithi089.stdout:2/813: creat d13/d30/d4e/d6f/d76/dd6/f117 x:0 0 0 2024-09-13T02:54:09.478 INFO:tasks.workunit.client.0.smithi089.stdout:2/814: dread - d13/d30/d61/d78/dd3/de7/db7/de3/ff0 zero size 2024-09-13T02:54:09.478 INFO:tasks.workunit.client.0.smithi089.stdout:2/815: read d13/d30/d4e/f5d [128914,10564] 0 2024-09-13T02:54:09.478 INFO:tasks.workunit.client.0.smithi089.stdout:2/816: fdatasync d13/d30/d61/f8a 0 2024-09-13T02:54:09.479 INFO:tasks.workunit.client.0.smithi089.stdout:5/855: creat d1/d4/d45/d6f/d4d/f10f x:0 0 0 2024-09-13T02:54:09.479 INFO:tasks.workunit.client.0.smithi089.stdout:6/858: dread db/d10/d3a/fa5 [0,4194304] 0 2024-09-13T02:54:09.480 INFO:tasks.workunit.client.0.smithi089.stdout:0/803: creat d2/d19/d1a/da4/f107 x:0 0 0 2024-09-13T02:54:09.480 INFO:tasks.workunit.client.0.smithi089.stdout:0/804: fsync d2/d19/d1a/d3d/d4b/d4f/f5c 0 2024-09-13T02:54:09.483 INFO:tasks.workunit.client.0.smithi089.stdout:2/817: mkdir d13/d30/d61/d118 0 2024-09-13T02:54:09.483 INFO:tasks.workunit.client.0.smithi089.stdout:6/859: write db/d43/d6e/f68 [2144117,3148] 0 2024-09-13T02:54:09.483 INFO:tasks.workunit.client.0.smithi089.stdout:0/805: dread d2/d64/fea [0,4194304] 0 2024-09-13T02:54:09.483 INFO:tasks.workunit.client.0.smithi089.stdout:6/860: write db/d43/d6e/d28/d37/d8b/dcd/f73 [875850,1429] 0 2024-09-13T02:54:09.483 INFO:tasks.workunit.client.0.smithi089.stdout:5/856: link d1/d73/l90 d1/d4/d45/d6f/d4d/d7f/d49/l110 0 2024-09-13T02:54:09.484 INFO:tasks.workunit.client.0.smithi089.stdout:5/857: chown d1/d4/d45/fd5 477679 1 2024-09-13T02:54:09.486 INFO:tasks.workunit.client.0.smithi089.stdout:2/818: rename d13/d30/f49 to d13/d30/d4e/d6f/f119 0 2024-09-13T02:54:09.487 INFO:tasks.workunit.client.0.smithi089.stdout:5/858: creat d1/d4/d45/d6f/d4d/d9d/f111 x:0 0 0 2024-09-13T02:54:09.490 INFO:tasks.workunit.client.0.smithi089.stdout:6/861: rename db/d10/fa2 to db/d10/d3a/d7b/f11b 0 2024-09-13T02:54:09.490 INFO:tasks.workunit.client.0.smithi089.stdout:2/819: symlink d13/d30/d59/dbe/df2/l11a 0 2024-09-13T02:54:09.490 INFO:tasks.workunit.client.0.smithi089.stdout:2/820: creat d13/da9/f11b x:0 0 0 2024-09-13T02:54:09.492 INFO:tasks.workunit.client.0.smithi089.stdout:6/862: rename db/d10/de9/d53/d83/d9f/de0/cf9 to db/d43/d6e/c11c 0 2024-09-13T02:54:09.493 INFO:tasks.workunit.client.0.smithi089.stdout:3/926: dwrite d2/d8/d5f/d72/f105 [0,4194304] 0 2024-09-13T02:54:09.494 INFO:tasks.workunit.client.0.smithi089.stdout:0/806: write d2/d19/d1a/d4e/d7a/d9b/f83 [1448462,111249] 0 2024-09-13T02:54:09.494 INFO:tasks.workunit.client.0.smithi089.stdout:6/863: link db/d10/de9/d53/d83/d9f/db1/ldf db/d10/de9/d53/d83/ddc/d110/l11d 0 2024-09-13T02:54:09.497 INFO:tasks.workunit.client.0.smithi089.stdout:0/807: creat d2/d19/d1a/d3d/d4b/d4f/d59/dd9/f108 x:0 0 0 2024-09-13T02:54:09.500 INFO:tasks.workunit.client.0.smithi089.stdout:6/864: unlink db/d43/d6e/cb0 0 2024-09-13T02:54:09.500 INFO:tasks.workunit.client.0.smithi089.stdout:2/821: dread d13/d30/d4e/fd2 [0,4194304] 0 2024-09-13T02:54:09.500 INFO:tasks.workunit.client.0.smithi089.stdout:6/865: write db/d43/fea [3795,68511] 0 2024-09-13T02:54:09.500 INFO:tasks.workunit.client.0.smithi089.stdout:6/866: fsync db/d10/de9/d53/d83/d9f/de0/f112 0 2024-09-13T02:54:09.500 INFO:tasks.workunit.client.0.smithi089.stdout:2/822: write d13/d30/f75 [1128024,129953] 0 2024-09-13T02:54:09.500 INFO:tasks.workunit.client.0.smithi089.stdout:6/867: write db/f1d [7425087,105625] 0 2024-09-13T02:54:09.500 INFO:tasks.workunit.client.0.smithi089.stdout:2/823: chown d13/d30/d4e/d7b/d86/da7/f10b 8 1 2024-09-13T02:54:09.501 INFO:tasks.workunit.client.0.smithi089.stdout:6/868: truncate db/d10/dc1/d102/f107 382890 0 2024-09-13T02:54:09.501 INFO:tasks.workunit.client.0.smithi089.stdout:3/927: mkdir d2/d132 0 2024-09-13T02:54:09.502 INFO:tasks.workunit.client.0.smithi089.stdout:0/808: rename d2/d19/d1a/d3d/d4b/d4f/d59/d6b/d87/c8d to d2/d19/d1a/d1e/d42/dd4/df6/df8/c109 0 2024-09-13T02:54:09.505 INFO:tasks.workunit.client.0.smithi089.stdout:2/824: mknod d13/d30/d61/d78/dd3/de7/db7/c11c 0 2024-09-13T02:54:09.507 INFO:tasks.workunit.client.0.smithi089.stdout:5/859: dwrite d1/d4/d45/d6f/d4d/d7f/d49/d5a/f94 [0,4194304] 0 2024-09-13T02:54:09.507 INFO:tasks.workunit.client.0.smithi089.stdout:3/928: mknod d2/d20/d23/d2b/c133 0 2024-09-13T02:54:09.507 INFO:tasks.workunit.client.0.smithi089.stdout:5/860: creat d1/d73/dcd/f112 x:0 0 0 2024-09-13T02:54:09.507 INFO:tasks.workunit.client.0.smithi089.stdout:5/861: truncate d1/f26 8739141 0 2024-09-13T02:54:09.507 INFO:tasks.workunit.client.0.smithi089.stdout:5/862: chown d1/d4/ddb/df3 79084 1 2024-09-13T02:54:09.509 INFO:tasks.workunit.client.0.smithi089.stdout:5/863: symlink d1/d4/d45/d6f/d4d/d7f/l113 0 2024-09-13T02:54:09.512 INFO:tasks.workunit.client.0.smithi089.stdout:2/825: dread d13/d30/d61/f68 [0,4194304] 0 2024-09-13T02:54:09.515 INFO:tasks.workunit.client.0.smithi089.stdout:6/869: write db/d43/d6e/d28/d2f/f50 [2278487,2218] 0 2024-09-13T02:54:09.518 INFO:tasks.workunit.client.0.smithi089.stdout:5/864: read d1/d4/d45/d6f/d62/f8a [7571177,128906] 0 2024-09-13T02:54:09.522 INFO:tasks.workunit.client.0.smithi089.stdout:2/826: creat d13/d30/d59/dbe/df2/f11d x:0 0 0 2024-09-13T02:54:09.523 INFO:tasks.workunit.client.0.smithi089.stdout:3/929: dwrite d2/d8/f36 [0,4194304] 0 2024-09-13T02:54:09.524 INFO:tasks.workunit.client.0.smithi089.stdout:5/865: creat d1/d4/d45/d8c/f114 x:0 0 0 2024-09-13T02:54:09.569 INFO:tasks.workunit.client.0.smithi089.stdout:2/827: mknod d13/d30/c11e 0 2024-09-13T02:54:09.569 INFO:tasks.workunit.client.0.smithi089.stdout:2/828: fdatasync d13/d30/d61/d78/d79/f9f 0 2024-09-13T02:54:09.572 INFO:tasks.workunit.client.0.smithi089.stdout:3/930: dwrite d2/d8/dc/d57/fae [4194304,4194304] 0 2024-09-13T02:54:09.574 INFO:tasks.workunit.client.0.smithi089.stdout:6/870: getdents db/d43/d6e 0 2024-09-13T02:54:09.581 INFO:tasks.workunit.client.0.smithi089.stdout:2/829: symlink d13/d30/d4e/d7b/l11f 0 2024-09-13T02:54:09.582 INFO:tasks.workunit.client.0.smithi089.stdout:5/866: rmdir d1/d4/d2b/da9 39 2024-09-13T02:54:09.584 INFO:tasks.workunit.client.0.smithi089.stdout:3/931: unlink d2/d20/d23/d27/f4e 0 2024-09-13T02:54:09.584 INFO:tasks.workunit.client.0.smithi089.stdout:3/932: stat d2/d20/d23/d32/d49/ce3 0 2024-09-13T02:54:09.586 INFO:tasks.workunit.client.0.smithi089.stdout:6/871: creat db/d10/de9/d53/f11e x:0 0 0 2024-09-13T02:54:09.587 INFO:tasks.workunit.client.0.smithi089.stdout:2/830: mkdir d13/d30/d61/d78/d79/d120 0 2024-09-13T02:54:09.587 INFO:tasks.workunit.client.0.smithi089.stdout:2/831: fdatasync d13/d30/d4e/fd2 0 2024-09-13T02:54:09.588 INFO:tasks.workunit.client.0.smithi089.stdout:5/867: symlink d1/d4/d45/d6f/d4d/d7f/d105/l115 0 2024-09-13T02:54:09.588 INFO:tasks.workunit.client.0.smithi089.stdout:3/933: creat d2/d20/d23/d2b/d114/f134 x:0 0 0 2024-09-13T02:54:09.589 INFO:tasks.workunit.client.0.smithi089.stdout:6/872: mkdir db/d10/dc1/de4/d11f 0 2024-09-13T02:54:09.590 INFO:tasks.workunit.client.0.smithi089.stdout:2/832: rename d13/d30/d64/fc1 to d13/d30/d61/d78/d9c/f121 0 2024-09-13T02:54:09.591 INFO:tasks.workunit.client.0.smithi089.stdout:2/833: read d13/d30/d4e/f74 [71791,37220] 0 2024-09-13T02:54:09.591 INFO:tasks.workunit.client.0.smithi089.stdout:5/868: truncate d1/fd 1767647 0 2024-09-13T02:54:09.593 INFO:tasks.workunit.client.0.smithi089.stdout:6/873: link db/d43/d6e/d28/d2f/f35 db/d43/d6e/d28/d37/d8b/f120 0 2024-09-13T02:54:09.593 INFO:tasks.workunit.client.0.smithi089.stdout:5/869: mknod d1/d4/d45/d6f/d62/c116 0 2024-09-13T02:54:09.594 INFO:tasks.workunit.client.0.smithi089.stdout:6/874: mkdir db/d43/d6e/d121 0 2024-09-13T02:54:09.595 INFO:tasks.workunit.client.0.smithi089.stdout:5/870: symlink d1/d4/d45/d6f/d62/l117 0 2024-09-13T02:54:09.597 INFO:tasks.workunit.client.0.smithi089.stdout:6/875: rename db/d43/d6e/d28/d2f/f50 to db/d10/de9/d53/d83/ddc/df0/f122 0 2024-09-13T02:54:09.597 INFO:tasks.workunit.client.0.smithi089.stdout:6/876: dread - db/d10/de9/d7e/da1/df4/f115 zero size 2024-09-13T02:54:09.599 INFO:tasks.workunit.client.0.smithi089.stdout:5/871: mknod d1/d73/dcd/c118 0 2024-09-13T02:54:09.599 INFO:tasks.workunit.client.0.smithi089.stdout:5/872: write d1/d4/d2b/f2e [359556,50715] 0 2024-09-13T02:54:09.599 INFO:tasks.workunit.client.0.smithi089.stdout:5/873: truncate d1/d73/dcd/f112 62264 0 2024-09-13T02:54:09.599 INFO:tasks.workunit.client.0.smithi089.stdout:5/874: creat d1/d73/dcd/f119 x:0 0 0 2024-09-13T02:54:09.600 INFO:tasks.workunit.client.0.smithi089.stdout:5/875: stat d1/d4/ddb 0 2024-09-13T02:54:09.600 INFO:tasks.workunit.client.0.smithi089.stdout:5/876: write d1/d4/f97 [3209909,5302] 0 2024-09-13T02:54:09.600 INFO:tasks.workunit.client.0.smithi089.stdout:0/809: sync 2024-09-13T02:54:09.600 INFO:tasks.workunit.client.0.smithi089.stdout:9/806: sync 2024-09-13T02:54:09.600 INFO:tasks.workunit.client.0.smithi089.stdout:1/798: sync 2024-09-13T02:54:09.600 INFO:tasks.workunit.client.0.smithi089.stdout:4/995: sync 2024-09-13T02:54:09.600 INFO:tasks.workunit.client.0.smithi089.stdout:1/799: fdatasync dc/f1a 0 2024-09-13T02:54:09.600 INFO:tasks.workunit.client.0.smithi089.stdout:6/877: truncate db/d43/d6e/f68 1269222 0 2024-09-13T02:54:09.600 INFO:tasks.workunit.client.0.smithi089.stdout:6/878: readlink db/d43/d6e/d28/d37/d8b/dcd/d7d/l8f 0 2024-09-13T02:54:09.601 INFO:tasks.workunit.client.0.smithi089.stdout:2/834: write fc [2887983,84677] 0 2024-09-13T02:54:09.601 INFO:tasks.workunit.client.0.smithi089.stdout:2/835: creat d13/d30/db1/f122 x:0 0 0 2024-09-13T02:54:09.603 INFO:tasks.workunit.client.0.smithi089.stdout:5/877: mknod d1/d4/d45/d6f/d4d/c11a 0 2024-09-13T02:54:09.603 INFO:tasks.workunit.client.0.smithi089.stdout:0/810: dread d2/d19/d1a/d3d/d4b/d4f/fdc [0,4194304] 0 2024-09-13T02:54:09.603 INFO:tasks.workunit.client.0.smithi089.stdout:0/811: fsync d2/d19/d1a/d3d/d4b/d4f/f96 0 2024-09-13T02:54:09.603 INFO:tasks.workunit.client.0.smithi089.stdout:1/800: mknod dc/d44/d73/cff 0 2024-09-13T02:54:09.603 INFO:tasks.workunit.client.0.smithi089.stdout:6/879: dread db/d10/de9/d7e/da1/fc0 [0,4194304] 0 2024-09-13T02:54:09.603 INFO:tasks.workunit.client.0.smithi089.stdout:1/801: write dc/d3a/d53/f4b [795634,82778] 0 2024-09-13T02:54:09.604 INFO:tasks.workunit.client.0.smithi089.stdout:4/996: symlink d2/d3/d5/d43/d3b/l13f 0 2024-09-13T02:54:09.609 INFO:tasks.workunit.client.0.smithi089.stdout:5/878: symlink d1/d4/d45/d6f/d4d/d7f/l11b 0 2024-09-13T02:54:09.609 INFO:tasks.workunit.client.0.smithi089.stdout:5/879: creat d1/d4/d45/d8c/d98/f11c x:0 0 0 2024-09-13T02:54:09.609 INFO:tasks.workunit.client.0.smithi089.stdout:5/880: fsync d1/d4/d45/d6f/d62/d72/f92 0 2024-09-13T02:54:09.609 INFO:tasks.workunit.client.0.smithi089.stdout:5/881: fdatasync d1/d4/d45/d6f/d4d/f10f 0 2024-09-13T02:54:09.609 INFO:tasks.workunit.client.0.smithi089.stdout:0/812: mkdir d2/d19/d1a/d1e/d42/d10a 0 2024-09-13T02:54:09.611 INFO:tasks.workunit.client.0.smithi089.stdout:6/880: rmdir db/d10/dc1/de4/d11f 0 2024-09-13T02:54:09.611 INFO:tasks.workunit.client.0.smithi089.stdout:6/881: fdatasync db/d10/f80 0 2024-09-13T02:54:09.612 INFO:tasks.workunit.client.0.smithi089.stdout:1/802: rename dc/d3a/d53/d2c/d34/d8b/fc5 to dc/d44/d73/d9a/f100 0 2024-09-13T02:54:09.612 INFO:tasks.workunit.client.0.smithi089.stdout:1/803: chown dc/d3a/d53/d2c/d34/d9b/lc7 844971 1 2024-09-13T02:54:09.617 INFO:tasks.workunit.client.0.smithi089.stdout:5/882: creat d1/d4/d2b/f11d x:0 0 0 2024-09-13T02:54:09.621 INFO:tasks.workunit.client.0.smithi089.stdout:6/882: creat db/d43/d6e/d28/d37/d8b/dcd/f123 x:0 0 0 2024-09-13T02:54:09.621 INFO:tasks.workunit.client.0.smithi089.stdout:6/883: fdatasync db/d10/d3a/d7b/f11b 0 2024-09-13T02:54:09.621 INFO:tasks.workunit.client.0.smithi089.stdout:5/883: creat d1/d4/d45/d6f/d4d/d7f/d8f/dad/f11e x:0 0 0 2024-09-13T02:54:09.621 INFO:tasks.workunit.client.0.smithi089.stdout:5/884: chown d1/d4/d45/d6f/d4d/d9d/daa/f10c 97095 1 2024-09-13T02:54:09.623 INFO:tasks.workunit.client.0.smithi089.stdout:5/885: mkdir d1/d4/d45/d8c/d98/d11f 0 2024-09-13T02:54:09.635 INFO:tasks.workunit.client.0.smithi089.stdout:6/884: write db/d10/d3a/f81 [513921,101016] 0 2024-09-13T02:54:09.641 INFO:tasks.workunit.client.0.smithi089.stdout:2/836: dwrite d13/f54 [0,4194304] 0 2024-09-13T02:54:09.641 INFO:tasks.workunit.client.0.smithi089.stdout:1/804: dwrite dc/d46/d6c/d98/fe2 [0,4194304] 0 2024-09-13T02:54:09.641 INFO:tasks.workunit.client.0.smithi089.stdout:9/807: dwrite d3/d6/d2a/d4b/d54/fae [0,4194304] 0 2024-09-13T02:54:09.642 INFO:tasks.workunit.client.0.smithi089.stdout:9/808: dread - d3/d3d/d8b/dba/fe5 zero size 2024-09-13T02:54:09.642 INFO:tasks.workunit.client.0.smithi089.stdout:0/813: dwrite d2/d19/d1a/fc5 [0,4194304] 0 2024-09-13T02:54:09.646 INFO:tasks.workunit.client.0.smithi089.stdout:9/809: link d3/d3d/d8b/l70 d3/d3d/d8b/dba/l107 0 2024-09-13T02:54:09.649 INFO:tasks.workunit.client.0.smithi089.stdout:1/805: rename dc/d44/d73/ca0 to dc/d3a/d53/d2c/d36/c101 0 2024-09-13T02:54:09.649 INFO:tasks.workunit.client.0.smithi089.stdout:1/806: stat dc/d44/d73/l64 0 2024-09-13T02:54:09.649 INFO:tasks.workunit.client.0.smithi089.stdout:1/807: chown dc/d3a/d53/d2c/d94/fe7 2 1 2024-09-13T02:54:09.649 INFO:tasks.workunit.client.0.smithi089.stdout:1/808: fdatasync dc/d44/f6a 0 2024-09-13T02:54:09.653 INFO:tasks.workunit.client.0.smithi089.stdout:2/837: dread d13/f89 [0,4194304] 0 2024-09-13T02:54:09.655 INFO:tasks.workunit.client.0.smithi089.stdout:6/885: dwrite db/d43/d6e/f55 [0,4194304] 0 2024-09-13T02:54:09.655 INFO:tasks.workunit.client.0.smithi089.stdout:6/886: readlink db/d10/de9/d7e/l9d 0 2024-09-13T02:54:09.655 INFO:tasks.workunit.client.0.smithi089.stdout:6/887: fsync db/d10/d3a/f47 0 2024-09-13T02:54:09.658 INFO:tasks.workunit.client.0.smithi089.stdout:9/810: dread d3/dfe/f9b [0,4194304] 0 2024-09-13T02:54:09.659 INFO:tasks.workunit.client.0.smithi089.stdout:9/811: chown d3/d6/d2a/d94/l7b 0 1 2024-09-13T02:54:09.662 INFO:tasks.workunit.client.0.smithi089.stdout:2/838: getdents d13 0 2024-09-13T02:54:09.664 INFO:tasks.workunit.client.0.smithi089.stdout:2/839: symlink d13/d30/d61/d78/dd3/de7/db7/de3/l123 0 2024-09-13T02:54:09.667 INFO:tasks.workunit.client.0.smithi089.stdout:2/840: rmdir d13/d30/d61/d118 0 2024-09-13T02:54:09.672 INFO:tasks.workunit.client.0.smithi089.stdout:1/809: rename dc/d3a/d53 to dc/d44/d73/dc0/d102 0 2024-09-13T02:54:09.683 INFO:tasks.workunit.client.0.smithi089.stdout:6/888: dwrite db/d10/de9/d53/d83/ddc/df0/f122 [0,4194304] 0 2024-09-13T02:54:09.686 INFO:tasks.workunit.client.0.smithi089.stdout:6/889: rename db/d10/de9/d53/c77 to db/d43/d6e/d28/d37/d8b/d113/c124 0 2024-09-13T02:54:09.687 INFO:tasks.workunit.client.0.smithi089.stdout:6/890: chown db/d10/de9/d53/d83/ddc/d110 36117 1 2024-09-13T02:54:09.687 INFO:tasks.workunit.client.0.smithi089.stdout:6/891: write db/f106 [751324,74578] 0 2024-09-13T02:54:09.687 INFO:tasks.workunit.client.0.smithi089.stdout:6/892: dread - db/d10/de9/d7e/da1/fba zero size 2024-09-13T02:54:09.693 INFO:tasks.workunit.client.0.smithi089.stdout:6/893: dread db/dd2/fec [0,4194304] 0 2024-09-13T02:54:09.693 INFO:tasks.workunit.client.0.smithi089.stdout:6/894: chown db/d43/d6e/d28/d37/f92 49034550 1 2024-09-13T02:54:09.694 INFO:tasks.workunit.client.0.smithi089.stdout:9/812: dwrite d3/d15/f1b [0,4194304] 0 2024-09-13T02:54:09.694 INFO:tasks.workunit.client.0.smithi089.stdout:9/813: write d3/d6/d36/d9d/db6/de3/f105 [18321,35121] 0 2024-09-13T02:54:09.694 INFO:tasks.workunit.client.0.smithi089.stdout:2/841: dwrite d13/d30/d4e/d6f/f84 [0,4194304] 0 2024-09-13T02:54:09.694 INFO:tasks.workunit.client.0.smithi089.stdout:1/810: dwrite dc/d46/d6c/d98/ff0 [0,4194304] 0 2024-09-13T02:54:09.695 INFO:tasks.workunit.client.0.smithi089.stdout:6/895: mkdir db/d43/d6e/d28/d37/d10f/d125 0 2024-09-13T02:54:09.695 INFO:tasks.workunit.client.0.smithi089.stdout:6/896: dread - db/d10/de9/d53/d83/d9f/de0/f112 zero size 2024-09-13T02:54:09.695 INFO:tasks.workunit.client.0.smithi089.stdout:6/897: chown db/d43/d6e/d28/d101/f109 381 1 2024-09-13T02:54:09.698 INFO:tasks.workunit.client.0.smithi089.stdout:6/898: mknod db/d43/d6e/d121/c126 0 2024-09-13T02:54:09.699 INFO:tasks.workunit.client.0.smithi089.stdout:6/899: mkdir db/d10/de9/d7e/d127 0 2024-09-13T02:54:09.699 INFO:tasks.workunit.client.0.smithi089.stdout:9/814: dread d3/dfe/f7d [0,4194304] 0 2024-09-13T02:54:09.701 INFO:tasks.workunit.client.0.smithi089.stdout:6/900: rename db/d10/l32 to db/d10/dc1/l128 0 2024-09-13T02:54:09.704 INFO:tasks.workunit.client.0.smithi089.stdout:1/811: write dc/d44/f5e [180069,129607] 0 2024-09-13T02:54:09.706 INFO:tasks.workunit.client.0.smithi089.stdout:1/812: mknod dc/d44/d73/c103 0 2024-09-13T02:54:09.708 INFO:tasks.workunit.client.0.smithi089.stdout:2/842: write d13/f27 [3213982,43022] 0 2024-09-13T02:54:09.708 INFO:tasks.workunit.client.0.smithi089.stdout:2/843: creat d13/d30/d61/d78/d79/ddd/f124 x:0 0 0 2024-09-13T02:54:09.710 INFO:tasks.workunit.client.0.smithi089.stdout:1/813: dread dc/d6e/fa2 [0,4194304] 0 2024-09-13T02:54:09.712 INFO:tasks.workunit.client.0.smithi089.stdout:2/844: rename fd to d13/d30/d64/f125 0 2024-09-13T02:54:09.712 INFO:tasks.workunit.client.0.smithi089.stdout:2/845: truncate d13/d30/d61/d78/d9c/ffa 749291 0 2024-09-13T02:54:09.712 INFO:tasks.workunit.client.0.smithi089.stdout:1/814: stat dc/d44/d73/dc0/d102/c2d 0 2024-09-13T02:54:09.713 INFO:tasks.workunit.client.0.smithi089.stdout:1/815: dread - dc/d44/d73/d85/dd6/dd7/de1/ffb zero size 2024-09-13T02:54:09.716 INFO:tasks.workunit.client.0.smithi089.stdout:3/934: sync 2024-09-13T02:54:09.717 INFO:tasks.workunit.client.0.smithi089.stdout:2/846: dread d13/d30/d59/f96 [0,4194304] 0 2024-09-13T02:54:09.717 INFO:tasks.workunit.client.0.smithi089.stdout:2/847: fsync d13/d30/d4e/f51 0 2024-09-13T02:54:09.717 INFO:tasks.workunit.client.0.smithi089.stdout:2/848: read d13/d30/f75 [2500964,16213] 0 2024-09-13T02:54:09.717 INFO:tasks.workunit.client.0.smithi089.stdout:2/849: truncate d13/d30/d64/fae 887151 0 2024-09-13T02:54:09.717 INFO:tasks.workunit.client.0.smithi089.stdout:2/850: dread - d13/d30/d61/d78/d9c/f9d zero size 2024-09-13T02:54:09.717 INFO:tasks.workunit.client.0.smithi089.stdout:3/935: creat d2/d8b/f135 x:0 0 0 2024-09-13T02:54:09.717 INFO:tasks.workunit.client.0.smithi089.stdout:2/851: rename d13/c2f to d13/d30/d61/d78/dd3/de7/c126 0 2024-09-13T02:54:09.719 INFO:tasks.workunit.client.0.smithi089.stdout:2/852: dread d13/f32 [0,4194304] 0 2024-09-13T02:54:09.721 INFO:tasks.workunit.client.0.smithi089.stdout:2/853: rename d13/da9 to d13/d30/d61/d111/d127 0 2024-09-13T02:54:09.722 INFO:tasks.workunit.client.0.smithi089.stdout:2/854: truncate d13/f1a 1002395 0 2024-09-13T02:54:09.723 INFO:tasks.workunit.client.0.smithi089.stdout:2/855: chown d13/d30/d61/d78/dd3/de7/db7 5751 1 2024-09-13T02:54:09.727 INFO:tasks.workunit.client.0.smithi089.stdout:1/816: dread dc/d3a/f41 [0,4194304] 0 2024-09-13T02:54:09.728 INFO:tasks.workunit.client.0.smithi089.stdout:1/817: creat dc/d44/d73/d9a/f104 x:0 0 0 2024-09-13T02:54:09.729 INFO:tasks.workunit.client.0.smithi089.stdout:1/818: truncate dc/fe 3505524 0 2024-09-13T02:54:09.730 INFO:tasks.workunit.client.0.smithi089.stdout:3/936: write d2/d20/fc0 [3250306,103510] 0 2024-09-13T02:54:09.730 INFO:tasks.workunit.client.0.smithi089.stdout:6/901: dwrite db/d10/de9/d53/d83/d9f/de0/f112 [0,4194304] 0 2024-09-13T02:54:09.731 INFO:tasks.workunit.client.0.smithi089.stdout:9/815: dwrite d3/fac [0,4194304] 0 2024-09-13T02:54:09.731 INFO:tasks.workunit.client.0.smithi089.stdout:9/816: chown d3/d6/d2a/d94/d24 23812 1 2024-09-13T02:54:09.736 INFO:tasks.workunit.client.0.smithi089.stdout:2/856: dread d13/d30/d64/f9e [0,4194304] 0 2024-09-13T02:54:09.744 INFO:tasks.workunit.client.0.smithi089.stdout:6/902: symlink db/d10/l129 0 2024-09-13T02:54:09.744 INFO:tasks.workunit.client.0.smithi089.stdout:6/903: truncate db/d43/fea 383041 0 2024-09-13T02:54:09.746 INFO:tasks.workunit.client.0.smithi089.stdout:6/904: read db/d43/d6e/d28/d2f/f4c [743711,1048] 0 2024-09-13T02:54:09.746 INFO:tasks.workunit.client.0.smithi089.stdout:2/857: mkdir d13/d30/d4e/d7b/d86/dc0/d128 0 2024-09-13T02:54:09.746 INFO:tasks.workunit.client.0.smithi089.stdout:6/905: readlink db/d10/de9/d53/d83/d9f/db1/lb8 0 2024-09-13T02:54:09.748 INFO:tasks.workunit.client.0.smithi089.stdout:6/906: symlink db/d10/l12a 0 2024-09-13T02:54:09.748 INFO:tasks.workunit.client.0.smithi089.stdout:6/907: write db/ffc [319406,94854] 0 2024-09-13T02:54:09.749 INFO:tasks.workunit.client.0.smithi089.stdout:9/817: dread d3/d4c/f86 [0,4194304] 0 2024-09-13T02:54:09.750 INFO:tasks.workunit.client.0.smithi089.stdout:6/908: mknod db/d10/c12b 0 2024-09-13T02:54:09.752 INFO:tasks.workunit.client.0.smithi089.stdout:9/818: creat d3/d15/f108 x:0 0 0 2024-09-13T02:54:09.752 INFO:tasks.workunit.client.0.smithi089.stdout:9/819: dread - d3/d6/d2a/fed zero size 2024-09-13T02:54:09.752 INFO:tasks.workunit.client.0.smithi089.stdout:9/820: fdatasync d3/d6/d2a/d94/d56/fe0 0 2024-09-13T02:54:09.752 INFO:tasks.workunit.client.0.smithi089.stdout:9/821: rmdir d3/d6/d2a/d4b/d54 39 2024-09-13T02:54:09.753 INFO:tasks.workunit.client.0.smithi089.stdout:9/822: creat d3/d6/d36/d9d/f109 x:0 0 0 2024-09-13T02:54:09.753 INFO:tasks.workunit.client.0.smithi089.stdout:9/823: creat d3/d15/f10a x:0 0 0 2024-09-13T02:54:09.759 INFO:tasks.workunit.client.0.smithi089.stdout:1/819: dwrite dc/d46/f89 [0,4194304] 0 2024-09-13T02:54:09.759 INFO:tasks.workunit.client.0.smithi089.stdout:1/820: write dc/d44/d73/dc0/fee [3110687,127323] 0 2024-09-13T02:54:09.760 INFO:tasks.workunit.client.0.smithi089.stdout:4/997: sync 2024-09-13T02:54:09.760 INFO:tasks.workunit.client.0.smithi089.stdout:4/998: fsync d2/d22/da1/f2d 0 2024-09-13T02:54:09.761 INFO:tasks.workunit.client.0.smithi089.stdout:2/858: dread d13/f3b [0,4194304] 0 2024-09-13T02:54:09.761 INFO:tasks.workunit.client.0.smithi089.stdout:3/937: dwrite d2/d20/d23/d2b/d114/f120 [0,4194304] 0 2024-09-13T02:54:09.768 INFO:tasks.workunit.client.0.smithi089.stdout:1/821: dread dc/d46/d6c/d98/fe2 [0,4194304] 0 2024-09-13T02:54:09.769 INFO:tasks.workunit.client.0.smithi089.stdout:1/822: chown dc/d6e/fa3 0 1 2024-09-13T02:54:09.771 INFO:tasks.workunit.client.0.smithi089.stdout:1/823: rename dc/d44/d73/f69 to dc/d3a/d93/f105 0 2024-09-13T02:54:09.772 INFO:tasks.workunit.client.0.smithi089.stdout:1/824: fdatasync dc/d44/d73/fa4 0 2024-09-13T02:54:09.772 INFO:tasks.workunit.client.0.smithi089.stdout:1/825: fsync f7 0 2024-09-13T02:54:09.772 INFO:tasks.workunit.client.0.smithi089.stdout:2/859: dread d13/d30/f4a [0,4194304] 0 2024-09-13T02:54:09.772 INFO:tasks.workunit.client.0.smithi089.stdout:2/860: chown d13/d30/d61/d78/d9c/cbb 472268448 1 2024-09-13T02:54:09.772 INFO:tasks.workunit.client.0.smithi089.stdout:1/826: mknod dc/d44/d73/dc0/d102/d2c/c106 0 2024-09-13T02:54:09.773 INFO:tasks.workunit.client.0.smithi089.stdout:2/861: symlink d13/d30/d59/dbe/df2/d105/l129 0 2024-09-13T02:54:09.773 INFO:tasks.workunit.client.0.smithi089.stdout:4/999: dread d2/d22/da1/f2d [0,4194304] 0 2024-09-13T02:54:09.774 INFO:tasks.workunit.client.0.smithi089.stdout:1/827: creat dc/d44/d73/dc0/d102/d2c/d34/d9b/dd8/f107 x:0 0 0 2024-09-13T02:54:09.775 INFO:tasks.workunit.client.0.smithi089.stdout:2/862: truncate d13/f3b 760752 0 2024-09-13T02:54:09.776 INFO:tasks.workunit.client.0.smithi089.stdout:1/828: getdents dc/d44/d73/dc0/d102 0 2024-09-13T02:54:09.777 INFO:tasks.workunit.client.0.smithi089.stdout:9/824: dwrite d3/dfe/f9b [4194304,4194304] 0 2024-09-13T02:54:09.778 INFO:tasks.workunit.client.0.smithi089.stdout:2/863: symlink d13/d30/d4e/d7b/l12a 0 2024-09-13T02:54:09.779 INFO:tasks.workunit.client.0.smithi089.stdout:3/938: dwrite d2/d20/d23/d32/d5b/d71/f128 [0,4194304] 0 2024-09-13T02:54:09.779 INFO:tasks.workunit.client.0.smithi089.stdout:3/939: creat d2/d20/d44/f136 x:0 0 0 2024-09-13T02:54:09.779 INFO:tasks.workunit.client.0.smithi089.stdout:1/829: creat dc/d44/d73/dc0/d102/f108 x:0 0 0 2024-09-13T02:54:09.782 INFO:tasks.workunit.client.0.smithi089.stdout:9/825: mkdir d3/d3d/d8b/dba/d10b 0 2024-09-13T02:54:09.783 INFO:tasks.workunit.client.0.smithi089.stdout:2/864: symlink d13/d30/d64/l12b 0 2024-09-13T02:54:09.783 INFO:tasks.workunit.client.0.smithi089.stdout:2/865: dread - d13/d30/d61/d78/dd3/de7/db7/de3/ff0 zero size 2024-09-13T02:54:09.783 INFO:tasks.workunit.client.0.smithi089.stdout:2/866: readlink d13/d30/l106 0 2024-09-13T02:54:09.787 INFO:tasks.workunit.client.0.smithi089.stdout:9/826: creat d3/d3d/d8b/f10c x:0 0 0 2024-09-13T02:54:09.787 INFO:tasks.workunit.client.0.smithi089.stdout:9/827: stat d3/d6/d2a/d94/d24/d29/f88 0 2024-09-13T02:54:09.788 INFO:tasks.workunit.client.0.smithi089.stdout:5/886: sync 2024-09-13T02:54:09.788 INFO:tasks.workunit.client.0.smithi089.stdout:0/814: sync 2024-09-13T02:54:09.791 INFO:tasks.workunit.client.0.smithi089.stdout:0/815: write d2/fb0 [527295,119815] 0 2024-09-13T02:54:09.792 INFO:tasks.workunit.client.0.smithi089.stdout:5/887: truncate d1/f47 3181800 0 2024-09-13T02:54:09.792 INFO:tasks.workunit.client.0.smithi089.stdout:5/888: fsync d1/d4/d2b/fef 0 2024-09-13T02:54:09.792 INFO:tasks.workunit.client.0.smithi089.stdout:5/889: write d1/d4/d45/d6f/d4d/d7f/d49/d5a/f9e [933027,49734] 0 2024-09-13T02:54:09.793 INFO:tasks.workunit.client.0.smithi089.stdout:0/816: dread d2/f80 [0,4194304] 0 2024-09-13T02:54:09.793 INFO:tasks.workunit.client.0.smithi089.stdout:0/817: write d2/d64/fab [768326,111511] 0 2024-09-13T02:54:09.794 INFO:tasks.workunit.client.0.smithi089.stdout:5/890: truncate d1/f101 104010 0 2024-09-13T02:54:09.804 INFO:tasks.workunit.client.0.smithi089.stdout:5/891: dread d1/d4/d45/d6f/d4d/d7f/d49/d5a/f89 [0,4194304] 0 2024-09-13T02:54:09.805 INFO:tasks.workunit.client.0.smithi089.stdout:0/818: dread d2/d64/db3/dc6/fed [0,4194304] 0 2024-09-13T02:54:09.805 INFO:tasks.workunit.client.0.smithi089.stdout:0/819: truncate d2/d19/d1a/d1e/d42/fd8 821959 0 2024-09-13T02:54:09.812 INFO:tasks.workunit.client.0.smithi089.stdout:3/940: dwrite d2/d8/dc/d3c/d65/f87 [0,4194304] 0 2024-09-13T02:54:09.815 INFO:tasks.workunit.client.0.smithi089.stdout:3/941: mkdir d2/d20/d23/d32/d5b/d71/d92/d137 0 2024-09-13T02:54:09.816 INFO:tasks.workunit.client.0.smithi089.stdout:5/892: dread d1/d4/d45/f4a [0,4194304] 0 2024-09-13T02:54:09.817 INFO:tasks.workunit.client.0.smithi089.stdout:5/893: getdents d1/d4/d45/d6f/d62/d72/d99 0 2024-09-13T02:54:09.821 INFO:tasks.workunit.client.0.smithi089.stdout:1/830: dwrite dc/d44/d73/f5b [0,4194304] 0 2024-09-13T02:54:09.821 INFO:tasks.workunit.client.0.smithi089.stdout:0/820: dwrite d2/d19/d1a/d3d/d4b/d4f/d59/f94 [0,4194304] 0 2024-09-13T02:54:09.821 INFO:tasks.workunit.client.0.smithi089.stdout:9/828: dwrite d3/d6/d2a/d94/d24/f104 [0,4194304] 0 2024-09-13T02:54:09.821 INFO:tasks.workunit.client.0.smithi089.stdout:9/829: chown d3/d15 6958 1 2024-09-13T02:54:09.824 INFO:tasks.workunit.client.0.smithi089.stdout:3/942: dread d2/d20/d23/d32/d49/d75/fbc [0,4194304] 0 2024-09-13T02:54:09.824 INFO:tasks.workunit.client.0.smithi089.stdout:3/943: readlink d2/d8/l4a 0 2024-09-13T02:54:09.824 INFO:tasks.workunit.client.0.smithi089.stdout:3/944: write d2/d8/d5f/d127/f12b [152232,119349] 0 2024-09-13T02:54:09.826 INFO:tasks.workunit.client.0.smithi089.stdout:0/821: mknod d2/d19/d1a/d3d/d4b/d4f/c10b 0 2024-09-13T02:54:09.826 INFO:tasks.workunit.client.0.smithi089.stdout:0/822: read d2/f48 [2768244,13607] 0 2024-09-13T02:54:09.826 INFO:tasks.workunit.client.0.smithi089.stdout:0/823: chown d2/dd0/de5 15293 1 2024-09-13T02:54:09.826 INFO:tasks.workunit.client.0.smithi089.stdout:5/894: dread d1/d4/d45/d6f/d4d/d7f/d49/d5a/f94 [0,4194304] 0 2024-09-13T02:54:09.826 INFO:tasks.workunit.client.0.smithi089.stdout:5/895: stat d1/d4/d45/d6f/d4d/f71 0 2024-09-13T02:54:09.826 INFO:tasks.workunit.client.0.smithi089.stdout:9/830: mknod d3/dcf/c10d 0 2024-09-13T02:54:09.826 INFO:tasks.workunit.client.0.smithi089.stdout:9/831: stat d3/lb 0 2024-09-13T02:54:09.831 INFO:tasks.workunit.client.0.smithi089.stdout:1/831: getdents dc/d44/d73/dc0/d102/d2c/d94 0 2024-09-13T02:54:09.832 INFO:tasks.workunit.client.0.smithi089.stdout:3/945: mkdir d2/d8/d5f/d138 0 2024-09-13T02:54:09.835 INFO:tasks.workunit.client.0.smithi089.stdout:9/832: creat d3/d6/d36/d9d/db6/f10e x:0 0 0 2024-09-13T02:54:09.836 INFO:tasks.workunit.client.0.smithi089.stdout:9/833: chown d3/d15/f10a 0 1 2024-09-13T02:54:09.836 INFO:tasks.workunit.client.0.smithi089.stdout:9/834: dread d3/d3d/d8b/dba/dd0/fd6 [0,4194304] 0 2024-09-13T02:54:09.837 INFO:tasks.workunit.client.0.smithi089.stdout:1/832: mkdir dc/d109 0 2024-09-13T02:54:09.837 INFO:tasks.workunit.client.0.smithi089.stdout:1/833: readlink dc/d44/d73/dc0/d102/d2c/d34/l68 0 2024-09-13T02:54:09.837 INFO:tasks.workunit.client.0.smithi089.stdout:1/834: chown dc/d44/d73/cff 53822043 1 2024-09-13T02:54:09.837 INFO:tasks.workunit.client.0.smithi089.stdout:1/835: fdatasync dc/d44/d73/fa8 0 2024-09-13T02:54:09.838 INFO:tasks.workunit.client.0.smithi089.stdout:0/824: getdents d2/d19/d1a 0 2024-09-13T02:54:09.838 INFO:tasks.workunit.client.0.smithi089.stdout:0/825: dread - d2/d64/d91/fff zero size 2024-09-13T02:54:09.839 INFO:tasks.workunit.client.0.smithi089.stdout:5/896: dwrite d1/d4/d45/d6f/f39 [4194304,4194304] 0 2024-09-13T02:54:09.839 INFO:tasks.workunit.client.0.smithi089.stdout:1/836: rename dc/d44/d73/dc0/d102/d2c/d94/lb2 to dc/d44/d73/d85/dd6/ddf/l10a 0 2024-09-13T02:54:09.842 INFO:tasks.workunit.client.0.smithi089.stdout:0/826: rmdir d2/d19/d1a/d1e/d42/d10a 0 2024-09-13T02:54:09.844 INFO:tasks.workunit.client.0.smithi089.stdout:5/897: mknod d1/d4/d45/d6f/d4d/d9d/daa/c120 0 2024-09-13T02:54:09.845 INFO:tasks.workunit.client.0.smithi089.stdout:5/898: fsync d1/fe8 0 2024-09-13T02:54:09.847 INFO:tasks.workunit.client.0.smithi089.stdout:1/837: unlink dc/d46/d6c/f71 0 2024-09-13T02:54:09.849 INFO:tasks.workunit.client.0.smithi089.stdout:0/827: creat d2/d19/d1a/d3d/d4b/d4f/d59/d6b/d87/f10c x:0 0 0 2024-09-13T02:54:09.849 INFO:tasks.workunit.client.0.smithi089.stdout:0/828: write d2/f17 [1212723,115115] 0 2024-09-13T02:54:09.849 INFO:tasks.workunit.client.0.smithi089.stdout:5/899: dread d1/d4/d45/d6f/d62/fa8 [0,4194304] 0 2024-09-13T02:54:09.849 INFO:tasks.workunit.client.0.smithi089.stdout:0/829: write d2/d19/d1a/dbe/fd5 [894866,75623] 0 2024-09-13T02:54:09.849 INFO:tasks.workunit.client.0.smithi089.stdout:5/900: read - d1/d4/d45/d6f/d62/d72/d99/fd7 zero size 2024-09-13T02:54:09.849 INFO:tasks.workunit.client.0.smithi089.stdout:5/901: creat d1/d4/d45/d6f/d4d/f121 x:0 0 0 2024-09-13T02:54:09.851 INFO:tasks.workunit.client.0.smithi089.stdout:6/909: sync 2024-09-13T02:54:09.858 INFO:tasks.workunit.client.0.smithi089.stdout:3/946: dwrite d2/f122 [0,4194304] 0 2024-09-13T02:54:09.861 INFO:tasks.workunit.client.0.smithi089.stdout:9/835: dwrite d3/d4c/f86 [0,4194304] 0 2024-09-13T02:54:09.861 INFO:tasks.workunit.client.0.smithi089.stdout:9/836: chown d3/dfe/c33 518 1 2024-09-13T02:54:09.861 INFO:tasks.workunit.client.0.smithi089.stdout:9/837: dread - d3/d3d/d8b/f10c zero size 2024-09-13T02:54:09.864 INFO:tasks.workunit.client.0.smithi089.stdout:9/838: readlink d3/d6/d2a/d94/l2f 0 2024-09-13T02:54:09.864 INFO:tasks.workunit.client.0.smithi089.stdout:9/839: truncate d3/d6/d2a/d94/d24/f48 696428 0 2024-09-13T02:54:09.865 INFO:tasks.workunit.client.0.smithi089.stdout:9/840: write d3/d6/d2a/d4b/d54/da1/ff4 [569811,27336] 0 2024-09-13T02:54:09.865 INFO:tasks.workunit.client.0.smithi089.stdout:9/841: truncate d3/d6/d36/d9d/db6/de3/f105 443676 0 2024-09-13T02:54:09.865 INFO:tasks.workunit.client.0.smithi089.stdout:9/842: creat d3/d6/d2a/d94/f10f x:0 0 0 2024-09-13T02:54:10.024 INFO:tasks.workunit.client.0.smithi089.stdout:0/830: dread d2/d19/d1a/dbe/fd5 [0,4194304] 0 2024-09-13T02:54:10.024 INFO:tasks.workunit.client.0.smithi089.stdout:2/867: sync 2024-09-13T02:54:10.028 INFO:tasks.workunit.client.0.smithi089.stdout:9/843: dread d3/d6/fe [0,4194304] 0 2024-09-13T02:54:10.028 INFO:tasks.workunit.client.0.smithi089.stdout:9/844: dread - d3/d6/d2a/d4b/d54/fb4 zero size 2024-09-13T02:54:10.029 INFO:tasks.workunit.client.0.smithi089.stdout:1/838: dwrite dc/d44/d73/d9a/ff7 [0,4194304] 0 2024-09-13T02:54:10.030 INFO:tasks.workunit.client.0.smithi089.stdout:1/839: write dc/f17 [4505201,56113] 0 2024-09-13T02:54:10.030 INFO:tasks.workunit.client.0.smithi089.stdout:1/840: readlink dc/d46/d6c/la7 0 2024-09-13T02:54:10.030 INFO:tasks.workunit.client.0.smithi089.stdout:1/841: creat dc/d46/d6c/d98/f10b x:0 0 0 2024-09-13T02:54:10.030 INFO:tasks.workunit.client.0.smithi089.stdout:2/868: unlink d13/d30/d61/f8a 0 2024-09-13T02:54:10.030 INFO:tasks.workunit.client.0.smithi089.stdout:2/869: write d13/d30/f73 [828890,19250] 0 2024-09-13T02:54:10.031 INFO:tasks.workunit.client.0.smithi089.stdout:9/845: creat d3/d3d/f110 x:0 0 0 2024-09-13T02:54:10.035 INFO:tasks.workunit.client.0.smithi089.stdout:9/846: mkdir d3/d6/d2a/d4b/d54/da1/d111 0 2024-09-13T02:54:10.037 INFO:tasks.workunit.client.0.smithi089.stdout:2/870: dread d13/f1a [0,4194304] 0 2024-09-13T02:54:10.037 INFO:tasks.workunit.client.0.smithi089.stdout:2/871: chown d13/d30/d4e/f5d 6 1 2024-09-13T02:54:10.037 INFO:tasks.workunit.client.0.smithi089.stdout:2/872: fdatasync d13/f3b 0 2024-09-13T02:54:10.039 INFO:tasks.workunit.client.0.smithi089.stdout:2/873: creat d13/d30/d61/d78/f12c x:0 0 0 2024-09-13T02:54:10.040 INFO:tasks.workunit.client.0.smithi089.stdout:2/874: read d13/f3b [53289,63518] 0 2024-09-13T02:54:10.041 INFO:tasks.workunit.client.0.smithi089.stdout:2/875: creat d13/d30/d61/d78/f12d x:0 0 0 2024-09-13T02:54:10.044 INFO:tasks.workunit.client.0.smithi089.stdout:1/842: dread dc/fe [0,4194304] 0 2024-09-13T02:54:10.045 INFO:tasks.workunit.client.0.smithi089.stdout:1/843: unlink dc/d44/d73/dc0/d102/d2c/d34/c3e 0 2024-09-13T02:54:10.047 INFO:tasks.workunit.client.0.smithi089.stdout:1/844: creat dc/d44/d73/dc0/d102/d2c/d36/f10c x:0 0 0 2024-09-13T02:54:10.048 INFO:tasks.workunit.client.0.smithi089.stdout:1/845: creat dc/d44/d73/dc0/d102/d2c/d34/d9b/f10d x:0 0 0 2024-09-13T02:54:10.055 INFO:tasks.workunit.client.0.smithi089.stdout:6/910: dwrite db/d10/d3a/f47 [0,4194304] 0 2024-09-13T02:54:10.055 INFO:tasks.workunit.client.0.smithi089.stdout:9/847: dread d3/d6/d2a/d94/f62 [0,4194304] 0 2024-09-13T02:54:10.057 INFO:tasks.workunit.client.0.smithi089.stdout:6/911: truncate db/d43/d6e/f68 999036 0 2024-09-13T02:54:10.057 INFO:tasks.workunit.client.0.smithi089.stdout:6/912: chown db/d43/d6e/f2c 246849 1 2024-09-13T02:54:10.058 INFO:tasks.workunit.client.0.smithi089.stdout:6/913: creat db/d10/d3a/f12c x:0 0 0 2024-09-13T02:54:10.067 INFO:tasks.workunit.client.0.smithi089.stdout:3/947: dwrite d2/d8/dc/d3c/d65/df0/f108 [0,4194304] 0 2024-09-13T02:54:10.068 INFO:tasks.workunit.client.0.smithi089.stdout:5/902: dwrite d1/d4/fc [0,4194304] 0 2024-09-13T02:54:10.070 INFO:tasks.workunit.client.0.smithi089.stdout:3/948: rename d2/d8/dc/d9a/d9c/dab/l10e to d2/d8/d5f/d72/dcd/l139 0 2024-09-13T02:54:10.072 INFO:tasks.workunit.client.0.smithi089.stdout:5/903: unlink d1/d4/d45/d6f/d4d/d7f/c2a 0 2024-09-13T02:54:10.072 INFO:tasks.workunit.client.0.smithi089.stdout:5/904: creat d1/d73/f122 x:0 0 0 2024-09-13T02:54:10.072 INFO:tasks.workunit.client.0.smithi089.stdout:5/905: chown d1/d4/d45/d6f/d4d/d7f/d8f/cf7 294009844 1 2024-09-13T02:54:10.072 INFO:tasks.workunit.client.0.smithi089.stdout:3/949: mkdir d2/d8/dc/d57/d13a 0 2024-09-13T02:54:10.072 INFO:tasks.workunit.client.0.smithi089.stdout:9/848: read d3/d3d/d8b/dba/fc9 [2167211,35613] 0 2024-09-13T02:54:10.073 INFO:tasks.workunit.client.0.smithi089.stdout:5/906: creat d1/d4/d45/d8c/d98/d11f/f123 x:0 0 0 2024-09-13T02:54:10.073 INFO:tasks.workunit.client.0.smithi089.stdout:5/907: dread - d1/d4/d45/d6f/d4d/d9d/fce zero size 2024-09-13T02:54:10.074 INFO:tasks.workunit.client.0.smithi089.stdout:1/846: dwrite dc/d44/d73/dc0/d102/d2c/d34/d9b/f10d [0,4194304] 0 2024-09-13T02:54:10.074 INFO:tasks.workunit.client.0.smithi089.stdout:1/847: truncate dc/d44/d73/d85/dd6/ddf/dfc/fc8 496805 0 2024-09-13T02:54:10.074 INFO:tasks.workunit.client.0.smithi089.stdout:6/914: dwrite db/d10/f11 [8388608,4194304] 0 2024-09-13T02:54:10.074 INFO:tasks.workunit.client.0.smithi089.stdout:5/908: dread d1/d4/d45/d6f/fac [0,4194304] 0 2024-09-13T02:54:10.074 INFO:tasks.workunit.client.0.smithi089.stdout:2/876: dwrite d13/f3b [0,4194304] 0 2024-09-13T02:54:10.078 INFO:tasks.workunit.client.0.smithi089.stdout:5/909: rename d1/d4/d45/d6f/d4d/d7f/d105 to d1/d4/d45/d6f/d62/d124 0 2024-09-13T02:54:10.079 INFO:tasks.workunit.client.0.smithi089.stdout:1/848: symlink dc/d44/d73/dc0/d102/d2c/d36/l10e 0 2024-09-13T02:54:10.081 INFO:tasks.workunit.client.0.smithi089.stdout:3/950: write d2/d90/f106 [3153508,87711] 0 2024-09-13T02:54:10.081 INFO:tasks.workunit.client.0.smithi089.stdout:3/951: fsync d2/d8/dc/d3c/d65/df0/f108 0 2024-09-13T02:54:10.081 INFO:tasks.workunit.client.0.smithi089.stdout:3/952: dread - d2/d20/d44/f121 zero size 2024-09-13T02:54:10.081 INFO:tasks.workunit.client.0.smithi089.stdout:3/953: write d2/d8/d5f/d127/f12b [318961,4116] 0 2024-09-13T02:54:10.081 INFO:tasks.workunit.client.0.smithi089.stdout:5/910: symlink d1/d4/d45/d6f/d7c/l125 0 2024-09-13T02:54:10.081 INFO:tasks.workunit.client.0.smithi089.stdout:5/911: write d1/f69 [2890180,117045] 0 2024-09-13T02:54:10.092 INFO:tasks.workunit.client.0.smithi089.stdout:1/849: write dc/d44/d73/dc0/d102/f26 [954797,119993] 0 2024-09-13T02:54:10.096 INFO:tasks.workunit.client.0.smithi089.stdout:1/850: creat dc/d44/d73/dc0/f10f x:0 0 0 2024-09-13T02:54:10.096 INFO:tasks.workunit.client.0.smithi089.stdout:1/851: chown dc/d44/d73/dc0/d102/d2c 181 1 2024-09-13T02:54:10.096 INFO:tasks.workunit.client.0.smithi089.stdout:1/852: creat dc/d44/d73/dc0/d102/d2c/d34/d9b/dd8/f110 x:0 0 0 2024-09-13T02:54:10.096 INFO:tasks.workunit.client.0.smithi089.stdout:1/853: write dc/d3a/d93/fea [367284,16721] 0 2024-09-13T02:54:10.096 INFO:tasks.workunit.client.0.smithi089.stdout:1/854: fdatasync dc/d44/d73/d9a/f104 0 2024-09-13T02:54:10.102 INFO:tasks.workunit.client.0.smithi089.stdout:3/954: read d2/d8/d5f/f62 [1002883,113415] 0 2024-09-13T02:54:10.107 INFO:tasks.workunit.client.0.smithi089.stdout:1/855: dread dc/d6e/de0/fe6 [0,4194304] 0 2024-09-13T02:54:10.110 INFO:tasks.workunit.client.0.smithi089.stdout:6/915: dwrite db/d10/fa0 [0,4194304] 0 2024-09-13T02:54:10.110 INFO:tasks.workunit.client.0.smithi089.stdout:6/916: dread - db/d10/de9/fbb zero size 2024-09-13T02:54:10.111 INFO:tasks.workunit.client.0.smithi089.stdout:6/917: readlink db/d10/l78 0 2024-09-13T02:54:10.111 INFO:tasks.workunit.client.0.smithi089.stdout:9/849: dwrite d3/d4c/fd2 [0,4194304] 0 2024-09-13T02:54:10.113 INFO:tasks.workunit.client.0.smithi089.stdout:2/877: dwrite d13/d30/d59/fd4 [0,4194304] 0 2024-09-13T02:54:10.113 INFO:tasks.workunit.client.0.smithi089.stdout:2/878: stat d13/d30/d4e/d7b/d86 0 2024-09-13T02:54:10.119 INFO:tasks.workunit.client.0.smithi089.stdout:3/955: dread d2/f16 [0,4194304] 0 2024-09-13T02:54:10.124 INFO:tasks.workunit.client.0.smithi089.stdout:3/956: rmdir d2/d8/dc/d3c/d65 39 2024-09-13T02:54:10.126 INFO:tasks.workunit.client.0.smithi089.stdout:3/957: mknod d2/d20/d23/d27/c13b 0 2024-09-13T02:54:10.129 INFO:tasks.workunit.client.0.smithi089.stdout:0/831: sync 2024-09-13T02:54:10.130 INFO:tasks.workunit.client.0.smithi089.stdout:0/832: chown d2/d64/db3/de0/le4 123458 1 2024-09-13T02:54:10.130 INFO:tasks.workunit.client.0.smithi089.stdout:0/833: dread - d2/d64/d91/fff zero size 2024-09-13T02:54:10.142 INFO:tasks.workunit.client.0.smithi089.stdout:0/834: dread d2/f48 [0,4194304] 0 2024-09-13T02:54:10.143 INFO:tasks.workunit.client.0.smithi089.stdout:0/835: mkdir d2/d19/d1a/d4e/d7a/d10d 0 2024-09-13T02:54:10.143 INFO:tasks.workunit.client.0.smithi089.stdout:0/836: getdents d2/dd0 0 2024-09-13T02:54:10.143 INFO:tasks.workunit.client.0.smithi089.stdout:0/837: chown d2/d19/d1a/dbe/fd5 479885 1 2024-09-13T02:54:10.143 INFO:tasks.workunit.client.0.smithi089.stdout:0/838: dread d2/d64/db1/fc0 [0,4194304] 0 2024-09-13T02:54:10.160 INFO:tasks.workunit.client.0.smithi089.stdout:6/918: dwrite db/d10/d3a/f42 [0,4194304] 0 2024-09-13T02:54:10.160 INFO:tasks.workunit.client.0.smithi089.stdout:6/919: chown db/c6c 10309 1 2024-09-13T02:54:10.161 INFO:tasks.workunit.client.0.smithi089.stdout:6/920: truncate db/d43/d6e/d28/d2f/f35 275407 0 2024-09-13T02:54:10.161 INFO:tasks.workunit.client.0.smithi089.stdout:3/958: dwrite d2/d8/ff3 [0,4194304] 0 2024-09-13T02:54:10.161 INFO:tasks.workunit.client.0.smithi089.stdout:1/856: dwrite dc/d44/d73/dc0/d102/d2c/d6f/feb [0,4194304] 0 2024-09-13T02:54:10.161 INFO:tasks.workunit.client.0.smithi089.stdout:3/959: chown d2/d8/dc/d3c/d65/df0/f111 24 1 2024-09-13T02:54:10.161 INFO:tasks.workunit.client.0.smithi089.stdout:0/839: dwrite d2/d19/d1a/d3d/d4b/d4f/d59/dd9/ff9 [0,4194304] 0 2024-09-13T02:54:10.161 INFO:tasks.workunit.client.0.smithi089.stdout:0/840: chown d2/d19/d1a/d1e/d42/l68 8 1 2024-09-13T02:54:10.161 INFO:tasks.workunit.client.0.smithi089.stdout:9/850: dwrite d3/d15/fe6 [0,4194304] 0 2024-09-13T02:54:10.164 INFO:tasks.workunit.client.0.smithi089.stdout:3/960: creat d2/d132/f13c x:0 0 0 2024-09-13T02:54:10.165 INFO:tasks.workunit.client.0.smithi089.stdout:0/841: rmdir d2/d19/d1a/d4e/d7a 39 2024-09-13T02:54:10.167 INFO:tasks.workunit.client.0.smithi089.stdout:9/851: creat d3/d6/d2a/d4b/d6d/f112 x:0 0 0 2024-09-13T02:54:10.169 INFO:tasks.workunit.client.0.smithi089.stdout:1/857: truncate dc/d44/d73/dc0/d102/fc2 944807 0 2024-09-13T02:54:10.171 INFO:tasks.workunit.client.0.smithi089.stdout:3/961: creat d2/d20/d23/d32/d5b/d71/d92/f13d x:0 0 0 2024-09-13T02:54:10.171 INFO:tasks.workunit.client.0.smithi089.stdout:3/962: read - d2/d20/d23/d2b/d114/f134 zero size 2024-09-13T02:54:10.172 INFO:tasks.workunit.client.0.smithi089.stdout:0/842: rename d2/d19/d1a/d3d/d4b/d4f/f93 to d2/d64/db3/f10e 0 2024-09-13T02:54:10.173 INFO:tasks.workunit.client.0.smithi089.stdout:9/852: rename d3/d6/d2a/d94/d24/l2c to d3/d15/d5a/l113 0 2024-09-13T02:54:10.174 INFO:tasks.workunit.client.0.smithi089.stdout:9/853: mknod d3/dfe/c114 0 2024-09-13T02:54:10.174 INFO:tasks.workunit.client.0.smithi089.stdout:9/854: dread - d3/d6/d2a/d94/da7/fee zero size 2024-09-13T02:54:10.175 INFO:tasks.workunit.client.0.smithi089.stdout:9/855: creat d3/d6/d2a/d4b/d77/f115 x:0 0 0 2024-09-13T02:54:10.176 INFO:tasks.workunit.client.0.smithi089.stdout:9/856: rmdir d3/d6/d36/d9d/db6 39 2024-09-13T02:54:10.176 INFO:tasks.workunit.client.0.smithi089.stdout:9/857: write d3/d6/d2a/d4b/d54/da1/ff4 [1264292,61751] 0 2024-09-13T02:54:10.177 INFO:tasks.workunit.client.0.smithi089.stdout:9/858: truncate d3/d6/d2a/d94/d24/d35/f80 1581056 0 2024-09-13T02:54:10.177 INFO:tasks.workunit.client.0.smithi089.stdout:9/859: dread - d3/d6/d2a/d94/d24/d35/fe2 zero size 2024-09-13T02:54:10.178 INFO:tasks.workunit.client.0.smithi089.stdout:9/860: getdents d3/d6/d2a/d4b/d54 0 2024-09-13T02:54:10.178 INFO:tasks.workunit.client.0.smithi089.stdout:9/861: write d3/d3d/d8b/dba/fe5 [91142,42414] 0 2024-09-13T02:54:10.178 INFO:tasks.workunit.client.0.smithi089.stdout:9/862: write d3/d15/fb3 [991474,91954] 0 2024-09-13T02:54:10.178 INFO:tasks.workunit.client.0.smithi089.stdout:6/921: dwrite db/d10/d3a/d7b/f104 [8388608,4194304] 0 2024-09-13T02:54:10.182 INFO:tasks.workunit.client.0.smithi089.stdout:6/922: mknod db/d43/d6e/d28/d37/d10f/d125/c12d 0 2024-09-13T02:54:10.183 INFO:tasks.workunit.client.0.smithi089.stdout:6/923: readlink db/d43/d6e/d28/d37/l6d 0 2024-09-13T02:54:10.184 INFO:tasks.workunit.client.0.smithi089.stdout:1/858: write dc/d44/f45 [2006344,33411] 0 2024-09-13T02:54:10.185 INFO:tasks.workunit.client.0.smithi089.stdout:6/924: mknod db/d43/d6e/d28/d2f/d9b/c12e 0 2024-09-13T02:54:10.185 INFO:tasks.workunit.client.0.smithi089.stdout:0/843: read d2/d19/d1a/d3d/d4b/d4f/f96 [907924,112815] 0 2024-09-13T02:54:10.186 INFO:tasks.workunit.client.0.smithi089.stdout:1/859: mkdir dc/d6e/de0/d111 0 2024-09-13T02:54:10.187 INFO:tasks.workunit.client.0.smithi089.stdout:0/844: mkdir d2/dd0/de5/d10f 0 2024-09-13T02:54:10.187 INFO:tasks.workunit.client.0.smithi089.stdout:3/963: read d2/d20/f28 [340522,95336] 0 2024-09-13T02:54:10.188 INFO:tasks.workunit.client.0.smithi089.stdout:0/845: getdents d2/d19/d1a/d4e/d9a 0 2024-09-13T02:54:10.188 INFO:tasks.workunit.client.0.smithi089.stdout:0/846: write d2/d19/d1a/d1e/d42/dd4/ff5 [353592,15134] 0 2024-09-13T02:54:10.189 INFO:tasks.workunit.client.0.smithi089.stdout:3/964: mknod d2/d20/d23/d32/d5b/d71/d92/d137/c13e 0 2024-09-13T02:54:10.192 INFO:tasks.workunit.client.0.smithi089.stdout:0/847: creat d2/d19/d1a/d1e/d42/dd4/df6/f110 x:0 0 0 2024-09-13T02:54:10.192 INFO:tasks.workunit.client.0.smithi089.stdout:0/848: dread - d2/d64/d91/fff zero size 2024-09-13T02:54:10.194 INFO:tasks.workunit.client.0.smithi089.stdout:0/849: rename d2/d19/d1a/d1e/d42/d7e/f102 to d2/d19/d1a/d1e/f111 0 2024-09-13T02:54:10.195 INFO:tasks.workunit.client.0.smithi089.stdout:0/850: truncate d2/fb0 571079 0 2024-09-13T02:54:10.195 INFO:tasks.workunit.client.0.smithi089.stdout:6/925: read db/d10/f11 [9513446,130826] 0 2024-09-13T02:54:10.196 INFO:tasks.workunit.client.0.smithi089.stdout:6/926: dread - db/d43/d6e/d28/d37/d8b/dcd/f123 zero size 2024-09-13T02:54:10.196 INFO:tasks.workunit.client.0.smithi089.stdout:0/851: mknod d2/dd0/c112 0 2024-09-13T02:54:10.196 INFO:tasks.workunit.client.0.smithi089.stdout:0/852: creat d2/d64/db3/de0/f113 x:0 0 0 2024-09-13T02:54:10.197 INFO:tasks.workunit.client.0.smithi089.stdout:0/853: write d2/d19/d1a/d3d/d4b/d4f/f81 [1318851,44955] 0 2024-09-13T02:54:10.197 INFO:tasks.workunit.client.0.smithi089.stdout:6/927: truncate db/d10/fa0 2698354 0 2024-09-13T02:54:10.198 INFO:tasks.workunit.client.0.smithi089.stdout:6/928: dread db/d10/dc1/d102/f107 [0,4194304] 0 2024-09-13T02:54:10.198 INFO:tasks.workunit.client.0.smithi089.stdout:6/929: fdatasync db/d43/d6e/d28/d2f/dc8/ff8 0 2024-09-13T02:54:10.198 INFO:tasks.workunit.client.0.smithi089.stdout:6/930: write db/d43/d6e/d28/f116 [852356,20674] 0 2024-09-13T02:54:10.199 INFO:tasks.workunit.client.0.smithi089.stdout:5/912: sync 2024-09-13T02:54:10.199 INFO:tasks.workunit.client.0.smithi089.stdout:0/854: symlink d2/dd0/l114 0 2024-09-13T02:54:10.200 INFO:tasks.workunit.client.0.smithi089.stdout:6/931: link db/db2/cc4 db/d43/d6e/d28/d37/d8b/d113/c12f 0 2024-09-13T02:54:10.202 INFO:tasks.workunit.client.0.smithi089.stdout:3/965: dread d2/d8/dc/d57/fae [4194304,4194304] 0 2024-09-13T02:54:10.202 INFO:tasks.workunit.client.0.smithi089.stdout:3/966: read - d2/d8/d5f/ffa zero size 2024-09-13T02:54:10.202 INFO:tasks.workunit.client.0.smithi089.stdout:9/863: dwrite d3/d6/d2a/d94/da7/fee [0,4194304] 0 2024-09-13T02:54:10.202 INFO:tasks.workunit.client.0.smithi089.stdout:0/855: creat d2/f115 x:0 0 0 2024-09-13T02:54:10.203 INFO:tasks.workunit.client.0.smithi089.stdout:0/856: chown d2/d19/d1a/d3d/d4b/d4f/f5e 175 1 2024-09-13T02:54:10.203 INFO:tasks.workunit.client.0.smithi089.stdout:0/857: truncate d2/f80 1580217 0 2024-09-13T02:54:10.203 INFO:tasks.workunit.client.0.smithi089.stdout:6/932: symlink db/d10/de9/d53/d83/ddc/d110/l130 0 2024-09-13T02:54:10.206 INFO:tasks.workunit.client.0.smithi089.stdout:1/860: dwrite dc/d44/d73/dc0/d102/f52 [0,4194304] 0 2024-09-13T02:54:10.206 INFO:tasks.workunit.client.0.smithi089.stdout:1/861: dread - dc/d44/d73/dc0/d102/d2c/d94/fe7 zero size 2024-09-13T02:54:10.206 INFO:tasks.workunit.client.0.smithi089.stdout:5/913: symlink d1/d4/d45/d6f/d4d/d7f/d8f/dad/l126 0 2024-09-13T02:54:10.206 INFO:tasks.workunit.client.0.smithi089.stdout:5/914: truncate d1/d73/dcd/f112 133149 0 2024-09-13T02:54:10.206 INFO:tasks.workunit.client.0.smithi089.stdout:5/915: dread - d1/d4/d45/d6f/d4d/d9d/f111 zero size 2024-09-13T02:54:10.210 INFO:tasks.workunit.client.0.smithi089.stdout:0/858: dread d2/d64/db3/dc6/fe7 [0,4194304] 0 2024-09-13T02:54:10.210 INFO:tasks.workunit.client.0.smithi089.stdout:0/859: write d2/d64/fea [1685060,77746] 0 2024-09-13T02:54:10.214 INFO:tasks.workunit.client.0.smithi089.stdout:5/916: link d1/d4/d45/d6f/d62/d72/d99/lab d1/d4/d45/d6f/d62/d72/d99/l127 0 2024-09-13T02:54:10.215 INFO:tasks.workunit.client.0.smithi089.stdout:0/860: mkdir d2/d19/d1a/d3d/d4b/d4f/d116 0 2024-09-13T02:54:10.216 INFO:tasks.workunit.client.0.smithi089.stdout:3/967: write d2/d8/dc/d3c/f5d [1624412,45088] 0 2024-09-13T02:54:10.216 INFO:tasks.workunit.client.0.smithi089.stdout:3/968: read d2/f41 [2385627,57776] 0 2024-09-13T02:54:10.216 INFO:tasks.workunit.client.0.smithi089.stdout:3/969: getdents d2/d8/d5f/d138 0 2024-09-13T02:54:10.221 INFO:tasks.workunit.client.0.smithi089.stdout:3/970: link d2/d20/d23/d32/d49/f56 d2/d8b/daf/ddf/f13f 0 2024-09-13T02:54:10.221 INFO:tasks.workunit.client.0.smithi089.stdout:3/971: chown d2/d20/d23/d32/cc1 2352 1 2024-09-13T02:54:10.221 INFO:tasks.workunit.client.0.smithi089.stdout:2/879: sync 2024-09-13T02:54:10.223 INFO:tasks.workunit.client.0.smithi089.stdout:6/933: dwrite db/db2/ff1 [0,4194304] 0 2024-09-13T02:54:10.223 INFO:tasks.workunit.client.0.smithi089.stdout:3/972: mkdir d2/d20/d23/d140 0 2024-09-13T02:54:10.227 INFO:tasks.workunit.client.0.smithi089.stdout:3/973: unlink d2/d8/d5f/d72/c10c 0 2024-09-13T02:54:10.227 INFO:tasks.workunit.client.0.smithi089.stdout:5/917: dread d1/d4/d45/d6f/d4d/d7f/d49/d5a/f8b [0,4194304] 0 2024-09-13T02:54:10.234 INFO:tasks.workunit.client.0.smithi089.stdout:0/861: dwrite d2/d19/d1a/d3d/d4b/d4f/f58 [0,4194304] 0 2024-09-13T02:54:10.234 INFO:tasks.workunit.client.0.smithi089.stdout:0/862: dread - d2/d19/d1a/d4e/fb8 zero size 2024-09-13T02:54:10.235 INFO:tasks.workunit.client.0.smithi089.stdout:3/974: read d2/d8/dc/d57/f68 [1526508,5294] 0 2024-09-13T02:54:10.237 INFO:tasks.workunit.client.0.smithi089.stdout:0/863: unlink d2/d19/d1a/d4e/l8e 0 2024-09-13T02:54:10.240 INFO:tasks.workunit.client.0.smithi089.stdout:3/975: rename d2/d20/d23/d32 to d2/d8/d5f/d138/d141 0 2024-09-13T02:54:10.247 INFO:tasks.workunit.client.0.smithi089.stdout:0/864: dread d2/f35 [0,4194304] 0 2024-09-13T02:54:10.247 INFO:tasks.workunit.client.0.smithi089.stdout:0/865: chown d2/fe1 15 1 2024-09-13T02:54:10.247 INFO:tasks.workunit.client.0.smithi089.stdout:0/866: chown d2/d19/d1a/d3d/d4b/d4f/f9d 3 1 2024-09-13T02:54:10.248 INFO:tasks.workunit.client.0.smithi089.stdout:0/867: dread d2/d19/d1a/d3d/d4b/d4f/fdc [0,4194304] 0 2024-09-13T02:54:10.249 INFO:tasks.workunit.client.0.smithi089.stdout:0/868: symlink d2/d19/d1a/d1e/d42/dd4/l117 0 2024-09-13T02:54:10.250 INFO:tasks.workunit.client.0.smithi089.stdout:0/869: unlink d2/d19/d1a/d3d/d4b/d4f/d59/d6b/d87/fbf 0 2024-09-13T02:54:10.251 INFO:tasks.workunit.client.0.smithi089.stdout:6/934: dwrite db/d10/de9/d53/d83/ddc/df0/f98 [4194304,4194304] 0 2024-09-13T02:54:10.251 INFO:tasks.workunit.client.0.smithi089.stdout:6/935: chown db/d43/d6e/d28/d37/le6 23 1 2024-09-13T02:54:10.251 INFO:tasks.workunit.client.0.smithi089.stdout:2/880: dwrite d13/d30/d61/d78/d79/fe4 [4194304,4194304] 0 2024-09-13T02:54:10.252 INFO:tasks.workunit.client.0.smithi089.stdout:5/918: dwrite d1/d4/d45/dc7/fd2 [0,4194304] 0 2024-09-13T02:54:10.252 INFO:tasks.workunit.client.0.smithi089.stdout:5/919: chown d1/d4/d45/d6f/d4d/d7f/d49/d5a/f10e 8833604 1 2024-09-13T02:54:10.252 INFO:tasks.workunit.client.0.smithi089.stdout:0/870: rmdir d2/d19/d1a/d1e/d42/d7e 39 2024-09-13T02:54:10.253 INFO:tasks.workunit.client.0.smithi089.stdout:0/871: truncate d2/d19/d1a/d3d/d4b/d4f/d59/d6b/fa8 795128 0 2024-09-13T02:54:10.253 INFO:tasks.workunit.client.0.smithi089.stdout:6/936: mknod db/d43/d6e/d28/d101/c131 0 2024-09-13T02:54:10.253 INFO:tasks.workunit.client.0.smithi089.stdout:5/920: dread d1/f101 [0,4194304] 0 2024-09-13T02:54:10.253 INFO:tasks.workunit.client.0.smithi089.stdout:5/921: write d1/d4/d45/d6f/d4d/f10f [516952,82435] 0 2024-09-13T02:54:10.255 INFO:tasks.workunit.client.0.smithi089.stdout:2/881: mkdir d13/d30/d59/d12e 0 2024-09-13T02:54:10.258 INFO:tasks.workunit.client.0.smithi089.stdout:0/872: truncate d2/d19/d1a/da4/fb9 275288 0 2024-09-13T02:54:10.261 INFO:tasks.workunit.client.0.smithi089.stdout:2/882: creat d13/d30/d61/d78/d79/d90/f12f x:0 0 0 2024-09-13T02:54:10.264 INFO:tasks.workunit.client.0.smithi089.stdout:0/873: mkdir d2/d19/d1a/d1e/d42/dd4/df6/d118 0 2024-09-13T02:54:10.266 INFO:tasks.workunit.client.0.smithi089.stdout:6/937: rename db/d10/f11 to db/d43/d6e/d28/d37/d8b/dcd/f132 0 2024-09-13T02:54:10.267 INFO:tasks.workunit.client.0.smithi089.stdout:0/874: mkdir d2/d19/d1a/d1e/d42/d119 0 2024-09-13T02:54:10.267 INFO:tasks.workunit.client.0.smithi089.stdout:0/875: chown d2/d19/def 1 1 2024-09-13T02:54:10.269 INFO:tasks.workunit.client.0.smithi089.stdout:2/883: dread d13/d30/f4a [4194304,4194304] 0 2024-09-13T02:54:10.269 INFO:tasks.workunit.client.0.smithi089.stdout:6/938: creat db/dd2/f133 x:0 0 0 2024-09-13T02:54:10.269 INFO:tasks.workunit.client.0.smithi089.stdout:6/939: write db/d10/f59 [2768913,111573] 0 2024-09-13T02:54:10.269 INFO:tasks.workunit.client.0.smithi089.stdout:2/884: creat d13/d30/d61/d78/d9c/f130 x:0 0 0 2024-09-13T02:54:10.271 INFO:tasks.workunit.client.0.smithi089.stdout:6/940: rmdir db/db2 39 2024-09-13T02:54:10.271 INFO:tasks.workunit.client.0.smithi089.stdout:6/941: fdatasync db/d10/d3a/f81 0 2024-09-13T02:54:10.272 INFO:tasks.workunit.client.0.smithi089.stdout:6/942: mknod db/d10/de9/d7e/da1/df4/c134 0 2024-09-13T02:54:10.272 INFO:tasks.workunit.client.0.smithi089.stdout:6/943: chown db/d43/d6e/d28/d37/d8b/dcd/d7d/faa 2195479 1 2024-09-13T02:54:10.273 INFO:tasks.workunit.client.0.smithi089.stdout:6/944: getdents db/d10/de9/d53/d83/d9f/db1 0 2024-09-13T02:54:10.275 INFO:tasks.workunit.client.0.smithi089.stdout:6/945: mkdir db/d43/d6e/d28/d37/d8b/dcd/d7d/d135 0 2024-09-13T02:54:10.275 INFO:tasks.workunit.client.0.smithi089.stdout:6/946: fdatasync db/d43/d6e/d28/f116 0 2024-09-13T02:54:10.275 INFO:tasks.workunit.client.0.smithi089.stdout:6/947: stat db/db2/fd6 0 2024-09-13T02:54:10.275 INFO:tasks.workunit.client.0.smithi089.stdout:6/948: truncate db/d43/d6e/d28/d37/d8b/f120 596706 0 2024-09-13T02:54:10.281 INFO:tasks.workunit.client.0.smithi089.stdout:5/922: dwrite d1/fee [0,4194304] 0 2024-09-13T02:54:10.281 INFO:tasks.workunit.client.0.smithi089.stdout:5/923: dread - d1/d4/d45/d6f/d7c/fb8 zero size 2024-09-13T02:54:10.282 INFO:tasks.workunit.client.0.smithi089.stdout:3/976: dwrite d2/d8/dc/d3c/f5d [0,4194304] 0 2024-09-13T02:54:10.284 INFO:tasks.workunit.client.0.smithi089.stdout:5/924: symlink d1/l128 0 2024-09-13T02:54:10.284 INFO:tasks.workunit.client.0.smithi089.stdout:5/925: creat d1/d4/d45/d6f/d4d/f129 x:0 0 0 2024-09-13T02:54:10.285 INFO:tasks.workunit.client.0.smithi089.stdout:3/977: mknod d2/d8/dc/d3c/d9e/c142 0 2024-09-13T02:54:10.286 INFO:tasks.workunit.client.0.smithi089.stdout:3/978: truncate d2/d20/d23/d2b/f3d 5057871 0 2024-09-13T02:54:10.288 INFO:tasks.workunit.client.0.smithi089.stdout:5/926: symlink d1/d4/d45/d6f/d62/d124/l12a 0 2024-09-13T02:54:10.288 INFO:tasks.workunit.client.0.smithi089.stdout:6/949: dread db/d43/d6e/d28/d37/d8b/dcd/f132 [0,4194304] 0 2024-09-13T02:54:10.288 INFO:tasks.workunit.client.0.smithi089.stdout:6/950: truncate db/d43/d6e/d28/d37/d8b/dcd/f123 801054 0 2024-09-13T02:54:10.290 INFO:tasks.workunit.client.0.smithi089.stdout:3/979: symlink d2/d20/l143 0 2024-09-13T02:54:10.290 INFO:tasks.workunit.client.0.smithi089.stdout:3/980: dread - d2/d8b/f135 zero size 2024-09-13T02:54:10.290 INFO:tasks.workunit.client.0.smithi089.stdout:3/981: dread - d2/d8/dc/d3c/d65/df0/f129 zero size 2024-09-13T02:54:10.291 INFO:tasks.workunit.client.0.smithi089.stdout:0/876: dwrite d2/fe1 [0,4194304] 0 2024-09-13T02:54:10.294 INFO:tasks.workunit.client.0.smithi089.stdout:0/877: rename d2/d19/d1a/d3d/d4b/d4f/d59/f94 to d2/d64/db3/de0/f11a 0 2024-09-13T02:54:10.296 INFO:tasks.workunit.client.0.smithi089.stdout:0/878: getdents d2/d19/d1a/d1e/d42/d7e 0 2024-09-13T02:54:10.299 INFO:tasks.workunit.client.0.smithi089.stdout:0/879: creat d2/d19/d1a/d1e/d42/dd4/df6/d118/f11b x:0 0 0 2024-09-13T02:54:10.299 INFO:tasks.workunit.client.0.smithi089.stdout:0/880: stat d2/d64/c73 0 2024-09-13T02:54:10.309 INFO:tasks.workunit.client.0.smithi089.stdout:0/881: unlink d2/d64/db3/de0/ce2 0 2024-09-13T02:54:10.310 INFO:tasks.workunit.client.0.smithi089.stdout:0/882: mkdir d2/d19/d1a/d1e/d42/dd4/df6/d11c 0 2024-09-13T02:54:10.311 INFO:tasks.workunit.client.0.smithi089.stdout:0/883: creat d2/d19/d1a/d4e/d7a/f11d x:0 0 0 2024-09-13T02:54:10.311 INFO:tasks.workunit.client.0.smithi089.stdout:0/884: read d2/f35 [3902569,122688] 0 2024-09-13T02:54:10.312 INFO:tasks.workunit.client.0.smithi089.stdout:6/951: dwrite db/d10/dc1/d102/f107 [0,4194304] 0 2024-09-13T02:54:10.312 INFO:tasks.workunit.client.0.smithi089.stdout:2/885: dwrite d13/f1a [0,4194304] 0 2024-09-13T02:54:10.312 INFO:tasks.workunit.client.0.smithi089.stdout:0/885: mkdir d2/d19/d11e 0 2024-09-13T02:54:10.316 INFO:tasks.workunit.client.0.smithi089.stdout:0/886: rename d2/d19/d1a/d4e/d7a/f11d to d2/d19/d1a/d4e/d7a/d10d/f11f 0 2024-09-13T02:54:10.316 INFO:tasks.workunit.client.0.smithi089.stdout:0/887: fsync d2/d19/d1a/d4e/fbc 0 2024-09-13T02:54:10.316 INFO:tasks.workunit.client.0.smithi089.stdout:0/888: fdatasync d2/d19/d1a/d1e/d42/fd8 0 2024-09-13T02:54:10.317 INFO:tasks.workunit.client.0.smithi089.stdout:0/889: mkdir d2/d64/db3/dc9/d120 0 2024-09-13T02:54:10.319 INFO:tasks.workunit.client.0.smithi089.stdout:0/890: rmdir d2/d19/d11e 0 2024-09-13T02:54:10.319 INFO:tasks.workunit.client.0.smithi089.stdout:0/891: write d2/f35 [1874052,42256] 0 2024-09-13T02:54:10.319 INFO:tasks.workunit.client.0.smithi089.stdout:0/892: chown d2/d64/db1/fbd 41 1 2024-09-13T02:54:10.321 INFO:tasks.workunit.client.0.smithi089.stdout:2/886: dread d13/d30/d4e/f51 [0,4194304] 0 2024-09-13T02:54:10.321 INFO:tasks.workunit.client.0.smithi089.stdout:2/887: read - d13/d30/d61/d111/d127/f11b zero size 2024-09-13T02:54:10.321 INFO:tasks.workunit.client.0.smithi089.stdout:2/888: readlink d13/d30/d59/l94 0 2024-09-13T02:54:10.321 INFO:tasks.workunit.client.0.smithi089.stdout:2/889: stat d13/d30/d4e/d6f/d76/dd6 0 2024-09-13T02:54:10.322 INFO:tasks.workunit.client.0.smithi089.stdout:0/893: mknod d2/d19/d1a/d3d/d4b/c121 0 2024-09-13T02:54:10.322 INFO:tasks.workunit.client.0.smithi089.stdout:3/982: dwrite d2/d8/dc/d3c/d65/f87 [0,4194304] 0 2024-09-13T02:54:10.324 INFO:tasks.workunit.client.0.smithi089.stdout:0/894: creat d2/d19/d1a/d3d/d4b/d4f/d59/d6b/f122 x:0 0 0 2024-09-13T02:54:10.325 INFO:tasks.workunit.client.0.smithi089.stdout:6/952: read db/d43/d6e/fd3 [2645289,49532] 0 2024-09-13T02:54:10.325 INFO:tasks.workunit.client.0.smithi089.stdout:6/953: readlink l4 0 2024-09-13T02:54:10.325 INFO:tasks.workunit.client.0.smithi089.stdout:6/954: stat db/d43/d6e/c31 0 2024-09-13T02:54:10.325 INFO:tasks.workunit.client.0.smithi089.stdout:6/955: fdatasync db/db2/ff1 0 2024-09-13T02:54:10.326 INFO:tasks.workunit.client.0.smithi089.stdout:0/895: link d2/f35 d2/d19/d1a/d4e/d9a/f123 0 2024-09-13T02:54:10.328 INFO:tasks.workunit.client.0.smithi089.stdout:6/956: mknod db/d10/c136 0 2024-09-13T02:54:10.331 INFO:tasks.workunit.client.0.smithi089.stdout:6/957: creat db/d10/de9/d53/d83/ddc/f137 x:0 0 0 2024-09-13T02:54:10.332 INFO:tasks.workunit.client.0.smithi089.stdout:6/958: mkdir db/dd2/d138 0 2024-09-13T02:54:10.334 INFO:tasks.workunit.client.0.smithi089.stdout:6/959: truncate db/d43/d6e/d28/d37/d8b/dcd/fbf 1050982 0 2024-09-13T02:54:10.337 INFO:tasks.workunit.client.0.smithi089.stdout:6/960: creat db/d10/de9/d7e/f139 x:0 0 0 2024-09-13T02:54:10.337 INFO:tasks.workunit.client.0.smithi089.stdout:6/961: readlink db/d10/de9/d7e/l9d 0 2024-09-13T02:54:10.339 INFO:tasks.workunit.client.0.smithi089.stdout:6/962: rename db/ld to db/d10/dc1/l13a 0 2024-09-13T02:54:10.339 INFO:tasks.workunit.client.0.smithi089.stdout:6/963: truncate db/d10/f1f 4473787 0 2024-09-13T02:54:10.343 INFO:tasks.workunit.client.0.smithi089.stdout:2/890: dwrite d13/d30/d64/f125 [0,4194304] 0 2024-09-13T02:54:10.344 INFO:tasks.workunit.client.0.smithi089.stdout:2/891: mkdir d13/d30/d61/d131 0 2024-09-13T02:54:10.345 INFO:tasks.workunit.client.0.smithi089.stdout:9/864: sync 2024-09-13T02:54:10.345 INFO:tasks.workunit.client.0.smithi089.stdout:1/862: sync 2024-09-13T02:54:10.346 INFO:tasks.workunit.client.0.smithi089.stdout:9/865: chown d3/d6/d2a/d94/l53 381002382 1 2024-09-13T02:54:10.349 INFO:tasks.workunit.client.0.smithi089.stdout:9/866: symlink d3/d6/d2a/l116 0 2024-09-13T02:54:10.352 INFO:tasks.workunit.client.0.smithi089.stdout:0/896: dwrite d2/d19/d1a/d1e/d42/dd4/ff5 [0,4194304] 0 2024-09-13T02:54:10.353 INFO:tasks.workunit.client.0.smithi089.stdout:1/863: rmdir dc/d44/d73/dc0/d102 39 2024-09-13T02:54:10.353 INFO:tasks.workunit.client.0.smithi089.stdout:1/864: creat dc/d44/d73/d85/dd6/dd7/f112 x:0 0 0 2024-09-13T02:54:10.356 INFO:tasks.workunit.client.0.smithi089.stdout:6/964: dread db/d43/d6e/d28/d37/f72 [0,4194304] 0 2024-09-13T02:54:10.356 INFO:tasks.workunit.client.0.smithi089.stdout:6/965: truncate db/d43/d6e/d28/d2f/dc8/fd7 130785 0 2024-09-13T02:54:10.358 INFO:tasks.workunit.client.0.smithi089.stdout:0/897: creat d2/d19/d1a/d1e/d42/dd4/df6/df8/f124 x:0 0 0 2024-09-13T02:54:10.359 INFO:tasks.workunit.client.0.smithi089.stdout:6/966: dread db/fb9 [0,4194304] 0 2024-09-13T02:54:10.360 INFO:tasks.workunit.client.0.smithi089.stdout:9/867: symlink d3/d6/d2a/d94/l117 0 2024-09-13T02:54:10.360 INFO:tasks.workunit.client.0.smithi089.stdout:9/868: chown d3/d6/d2a/d4b/d54/fae 15004 1 2024-09-13T02:54:10.360 INFO:tasks.workunit.client.0.smithi089.stdout:9/869: chown d3/d6/d2a/d4b/ce7 876 1 2024-09-13T02:54:10.360 INFO:tasks.workunit.client.0.smithi089.stdout:9/870: stat d3/df6/ff9 0 2024-09-13T02:54:10.360 INFO:tasks.workunit.client.0.smithi089.stdout:9/871: creat d3/d6/d2a/d94/d24/d35/f118 x:0 0 0 2024-09-13T02:54:10.361 INFO:tasks.workunit.client.0.smithi089.stdout:6/967: truncate db/d43/d6e/d28/d37/d8b/dcd/f79 457567 0 2024-09-13T02:54:10.361 INFO:tasks.workunit.client.0.smithi089.stdout:6/968: fsync db/d43/d6e/d28/d37/fc3 0 2024-09-13T02:54:10.361 INFO:tasks.workunit.client.0.smithi089.stdout:9/872: rmdir d3/d6/d2a/d4b/d54/da1 39 2024-09-13T02:54:10.363 INFO:tasks.workunit.client.0.smithi089.stdout:6/969: creat db/d43/d6e/d28/d2f/d9b/f13b x:0 0 0 2024-09-13T02:54:10.368 INFO:tasks.workunit.client.0.smithi089.stdout:2/892: dwrite d13/d30/f3c [4194304,4194304] 0 2024-09-13T02:54:10.373 INFO:tasks.workunit.client.0.smithi089.stdout:6/970: write db/d10/d3a/f84 [2029055,14505] 0 2024-09-13T02:54:10.375 INFO:tasks.workunit.client.0.smithi089.stdout:6/971: mknod db/d10/dc1/c13c 0 2024-09-13T02:54:10.376 INFO:tasks.workunit.client.0.smithi089.stdout:2/893: rename d13/d30/d59/dbe/df2 to d13/d30/d61/d78/d79/d120/d132 0 2024-09-13T02:54:10.377 INFO:tasks.workunit.client.0.smithi089.stdout:2/894: rename d13/d30/d61 to d13/d30/d61/d78/d9c/d133 22 2024-09-13T02:54:10.377 INFO:tasks.workunit.client.0.smithi089.stdout:2/895: fdatasync d13/d30/d4e/d6f/fe0 0 2024-09-13T02:54:10.377 INFO:tasks.workunit.client.0.smithi089.stdout:1/865: write dc/d3a/d93/fbb [1454280,57454] 0 2024-09-13T02:54:10.378 INFO:tasks.workunit.client.0.smithi089.stdout:2/896: rmdir d13/d30/d4e/d7b/df7 39 2024-09-13T02:54:10.378 INFO:tasks.workunit.client.0.smithi089.stdout:0/898: write d2/d19/f2d [3333703,27080] 0 2024-09-13T02:54:10.379 INFO:tasks.workunit.client.0.smithi089.stdout:1/866: link dc/d44/d73/dc0/d102/d2c/d34/f78 dc/d46/d6c/d98/f113 0 2024-09-13T02:54:10.380 INFO:tasks.workunit.client.0.smithi089.stdout:6/972: dread db/d43/f67 [0,4194304] 0 2024-09-13T02:54:10.380 INFO:tasks.workunit.client.0.smithi089.stdout:6/973: write db/d43/d6e/d28/d37/f92 [1026482,71909] 0 2024-09-13T02:54:10.380 INFO:tasks.workunit.client.0.smithi089.stdout:6/974: truncate db/db2/ff1 170386 0 2024-09-13T02:54:10.382 INFO:tasks.workunit.client.0.smithi089.stdout:6/975: symlink db/d43/d6e/d121/l13d 0 2024-09-13T02:54:10.383 INFO:tasks.workunit.client.0.smithi089.stdout:6/976: mkdir db/db2/df7/d13e 0 2024-09-13T02:54:10.384 INFO:tasks.workunit.client.0.smithi089.stdout:1/867: write f3 [4243872,124277] 0 2024-09-13T02:54:10.384 INFO:tasks.workunit.client.0.smithi089.stdout:1/868: truncate dc/f22 1642719 0 2024-09-13T02:54:10.384 INFO:tasks.workunit.client.0.smithi089.stdout:6/977: mkdir db/d43/d6e/d28/d37/d10f/d125/d13f 0 2024-09-13T02:54:10.386 INFO:tasks.workunit.client.0.smithi089.stdout:6/978: link db/d10/d3a/f81 db/d10/d3a/d7b/f140 0 2024-09-13T02:54:10.386 INFO:tasks.workunit.client.0.smithi089.stdout:6/979: creat db/d43/d6e/d28/d101/f141 x:0 0 0 2024-09-13T02:54:10.388 INFO:tasks.workunit.client.0.smithi089.stdout:6/980: symlink db/d10/de9/d7e/d127/l142 0 2024-09-13T02:54:10.388 INFO:tasks.workunit.client.0.smithi089.stdout:6/981: chown db/d10/de9/d7e/da1/fc0 23293579 1 2024-09-13T02:54:10.389 INFO:tasks.workunit.client.0.smithi089.stdout:6/982: creat db/d10/de9/d53/d83/ddc/df0/f143 x:0 0 0 2024-09-13T02:54:10.389 INFO:tasks.workunit.client.0.smithi089.stdout:6/983: chown db/ffd 0 1 2024-09-13T02:54:10.389 INFO:tasks.workunit.client.0.smithi089.stdout:6/984: fdatasync db/d10/de9/d7e/f139 0 2024-09-13T02:54:10.389 INFO:tasks.workunit.client.0.smithi089.stdout:6/985: getdents db/d43 0 2024-09-13T02:54:10.397 INFO:tasks.workunit.client.0.smithi089.stdout:6/986: write db/d10/de9/d53/f5a [51984,41728] 0 2024-09-13T02:54:10.397 INFO:tasks.workunit.client.0.smithi089.stdout:6/987: creat db/d10/de9/d53/f144 x:0 0 0 2024-09-13T02:54:10.398 INFO:tasks.workunit.client.0.smithi089.stdout:6/988: creat db/d43/d6e/d28/d37/d10f/d125/f145 x:0 0 0 2024-09-13T02:54:10.402 INFO:tasks.workunit.client.0.smithi089.stdout:9/873: dwrite d3/d15/f3f [0,4194304] 0 2024-09-13T02:54:10.405 INFO:tasks.workunit.client.0.smithi089.stdout:2/897: dwrite d13/d30/f3c [0,4194304] 0 2024-09-13T02:54:10.405 INFO:tasks.workunit.client.0.smithi089.stdout:2/898: fdatasync d13/d30/d4e/d6f/f84 0 2024-09-13T02:54:10.406 INFO:tasks.workunit.client.0.smithi089.stdout:2/899: readlink d13/d30/d61/d78/d79/ddd/le2 0 2024-09-13T02:54:10.406 INFO:tasks.workunit.client.0.smithi089.stdout:2/900: chown d13/d30/d59/d12e 6 1 2024-09-13T02:54:10.406 INFO:tasks.workunit.client.0.smithi089.stdout:2/901: fdatasync d13/d30/f22 0 2024-09-13T02:54:10.406 INFO:tasks.workunit.client.0.smithi089.stdout:2/902: write d13/f27 [3479396,38545] 0 2024-09-13T02:54:10.406 INFO:tasks.workunit.client.0.smithi089.stdout:0/899: dwrite d2/d19/d1a/d1e/d42/dd4/ff4 [0,4194304] 0 2024-09-13T02:54:10.406 INFO:tasks.workunit.client.0.smithi089.stdout:0/900: chown d2/f35 803519629 1 2024-09-13T02:54:10.413 INFO:tasks.workunit.client.0.smithi089.stdout:9/874: rename d3/d15/d5a/l113 to d3/d6/d2a/l119 0 2024-09-13T02:54:10.416 INFO:tasks.workunit.client.0.smithi089.stdout:1/869: truncate f7 1136524 0 2024-09-13T02:54:10.417 INFO:tasks.workunit.client.0.smithi089.stdout:6/989: dwrite db/d10/dc1/d102/f107 [0,4194304] 0 2024-09-13T02:54:10.419 INFO:tasks.workunit.client.0.smithi089.stdout:2/903: rename d13/d30/d4e/d7b/d86/cf6 to d13/d30/d61/d111/c134 0 2024-09-13T02:54:10.420 INFO:tasks.workunit.client.0.smithi089.stdout:9/875: creat d3/d6/d2a/d4b/d77/dfa/f11a x:0 0 0 2024-09-13T02:54:10.420 INFO:tasks.workunit.client.0.smithi089.stdout:9/876: stat d3/d6/d2a/d4b/l71 0 2024-09-13T02:54:10.422 INFO:tasks.workunit.client.0.smithi089.stdout:1/870: mkdir dc/d44/d73/dc0/d102/d2c/d34/d8b/d114 0 2024-09-13T02:54:10.422 INFO:tasks.workunit.client.0.smithi089.stdout:1/871: write dc/d44/d73/dc0/d102/d2c/d34/d8b/fb3 [1236866,118565] 0 2024-09-13T02:54:10.423 INFO:tasks.workunit.client.0.smithi089.stdout:6/990: symlink db/d43/d6e/d28/l146 0 2024-09-13T02:54:10.427 INFO:tasks.workunit.client.0.smithi089.stdout:9/877: symlink d3/d6/d2a/d94/d24/l11b 0 2024-09-13T02:54:10.427 INFO:tasks.workunit.client.0.smithi089.stdout:9/878: chown d3/d6/d2a/d94/d24/d29 1 1 2024-09-13T02:54:10.431 INFO:tasks.workunit.client.0.smithi089.stdout:5/927: sync 2024-09-13T02:54:10.431 INFO:tasks.workunit.client.0.smithi089.stdout:3/983: sync 2024-09-13T02:54:10.431 INFO:tasks.workunit.client.0.smithi089.stdout:5/928: truncate d1/d4/d45/d6f/d62/d72/d99/fff 90729 0 2024-09-13T02:54:10.432 INFO:tasks.workunit.client.0.smithi089.stdout:0/901: dwrite d2/d19/d1a/d4e/d7a/d9b/f83 [0,4194304] 0 2024-09-13T02:54:10.432 INFO:tasks.workunit.client.0.smithi089.stdout:3/984: mknod d2/d90/c144 0 2024-09-13T02:54:10.432 INFO:tasks.workunit.client.0.smithi089.stdout:3/985: write d2/d8/d5f/d138/d141/d5b/d71/d92/f13d [747244,27369] 0 2024-09-13T02:54:10.433 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:10 smithi131 ceph-mon[34689]: pgmap v247: 65 pgs: 65 active+clean; 2.8 GiB data, 9.7 GiB used, 527 GiB / 536 GiB avail; 258 MiB/s rd, 305 MiB/s wr, 446 op/s 2024-09-13T02:54:10.434 INFO:tasks.workunit.client.0.smithi089.stdout:5/929: creat d1/d4/d45/d6f/d4d/d7f/f12b x:0 0 0 2024-09-13T02:54:10.436 INFO:tasks.workunit.client.0.smithi089.stdout:3/986: creat d2/d8/dc/d9a/f145 x:0 0 0 2024-09-13T02:54:10.439 INFO:tasks.workunit.client.0.smithi089.stdout:0/902: rename d2/cf to d2/d19/d1a/d3d/d4b/d4f/c125 0 2024-09-13T02:54:10.441 INFO:tasks.workunit.client.0.smithi089.stdout:1/872: dread dc/d44/d73/dc0/d102/d2c/d36/f3b [0,4194304] 0 2024-09-13T02:54:10.442 INFO:tasks.workunit.client.0.smithi089.stdout:5/930: mknod d1/d4/d45/d8c/d98/d11f/c12c 0 2024-09-13T02:54:10.442 INFO:tasks.workunit.client.0.smithi089.stdout:5/931: readlink d1/d4/d45/d6f/d62/lb1 0 2024-09-13T02:54:10.442 INFO:tasks.workunit.client.0.smithi089.stdout:5/932: creat d1/d4/ddb/df3/f12d x:0 0 0 2024-09-13T02:54:10.442 INFO:tasks.workunit.client.0.smithi089.stdout:0/903: truncate d2/d19/d1a/d3d/d4b/f55 3975481 0 2024-09-13T02:54:10.446 INFO:tasks.workunit.client.0.smithi089.stdout:1/873: dread dc/f30 [0,4194304] 0 2024-09-13T02:54:10.446 INFO:tasks.workunit.client.0.smithi089.stdout:1/874: read dc/d46/d6c/d98/f113 [2482456,39684] 0 2024-09-13T02:54:10.446 INFO:tasks.workunit.client.0.smithi089.stdout:1/875: fdatasync dc/d44/d73/dc0/d102/d2c/d34/d9b/dd8/f107 0 2024-09-13T02:54:10.447 INFO:tasks.workunit.client.0.smithi089.stdout:1/876: rename dc/d44/d73/d85/lc1 to dc/d44/d73/dc0/d102/d2c/d34/d8b/db5/d9d/l115 0 2024-09-13T02:54:10.447 INFO:tasks.workunit.client.0.smithi089.stdout:1/877: dread - dc/d44/d73/dc0/d102/d2c/d6f/fd1 zero size 2024-09-13T02:54:10.448 INFO:tasks.workunit.client.0.smithi089.stdout:1/878: mknod dc/d44/d73/d9a/c116 0 2024-09-13T02:54:10.457 INFO:tasks.workunit.client.0.smithi089.stdout:5/933: write d1/d4/d2b/da9/ff1 [274317,119368] 0 2024-09-13T02:54:10.459 INFO:tasks.workunit.client.0.smithi089.stdout:5/934: creat d1/d4/ddb/f12e x:0 0 0 2024-09-13T02:54:10.459 INFO:tasks.workunit.client.0.smithi089.stdout:5/935: write d1/d4/d45/d6f/f39 [8974191,13173] 0 2024-09-13T02:54:10.459 INFO:tasks.workunit.client.0.smithi089.stdout:5/936: write d1/d4/d45/d6f/d4d/d7f/d49/f6b [134051,112720] 0 2024-09-13T02:54:10.471 INFO:tasks.workunit.client.0.smithi089.stdout:2/904: dwrite d13/d30/d61/d78/d9c/f121 [0,4194304] 0 2024-09-13T02:54:10.471 INFO:tasks.workunit.client.0.smithi089.stdout:9/879: dwrite d3/d3d/f110 [0,4194304] 0 2024-09-13T02:54:10.472 INFO:tasks.workunit.client.0.smithi089.stdout:3/987: dwrite d2/d8/d5f/d72/f105 [0,4194304] 0 2024-09-13T02:54:10.472 INFO:tasks.workunit.client.0.smithi089.stdout:1/879: dwrite dc/d46/d6c/d98/ff0 [0,4194304] 0 2024-09-13T02:54:10.474 INFO:tasks.workunit.client.0.smithi089.stdout:9/880: mkdir d3/d6/d2a/d4b/d77/dfa/d11c 0 2024-09-13T02:54:10.474 INFO:tasks.workunit.client.0.smithi089.stdout:9/881: creat d3/d6/d2a/d4b/d77/f11d x:0 0 0 2024-09-13T02:54:10.477 INFO:tasks.workunit.client.0.smithi089.stdout:3/988: rename d2/d20/d23/c11f to d2/d8b/daf/ddf/c146 0 2024-09-13T02:54:10.479 INFO:tasks.workunit.client.0.smithi089.stdout:9/882: unlink d3/d4c/d91/ff1 0 2024-09-13T02:54:10.481 INFO:tasks.workunit.client.0.smithi089.stdout:3/989: creat d2/d8/dc/d3c/f147 x:0 0 0 2024-09-13T02:54:10.483 INFO:tasks.workunit.client.0.smithi089.stdout:9/883: creat d3/d6/d2a/d94/da7/f11e x:0 0 0 2024-09-13T02:54:10.483 INFO:tasks.workunit.client.0.smithi089.stdout:9/884: truncate d3/dfe/f9b 9163677 0 2024-09-13T02:54:10.484 INFO:tasks.workunit.client.0.smithi089.stdout:3/990: symlink d2/d8/dc/d3c/l148 0 2024-09-13T02:54:10.484 INFO:tasks.workunit.client.0.smithi089.stdout:3/991: chown d2/d8/dc/d9a/d9c/d83/db6 14870843 1 2024-09-13T02:54:10.484 INFO:tasks.workunit.client.0.smithi089.stdout:3/992: truncate d2/d132/f13c 560782 0 2024-09-13T02:54:10.484 INFO:tasks.workunit.client.0.smithi089.stdout:3/993: read - d2/d8/dc/d3c/d9e/fc5 zero size 2024-09-13T02:54:10.487 INFO:tasks.workunit.client.0.smithi089.stdout:3/994: rename d2/d8/d5f/d72/fb9 to d2/d20/d23/f149 0 2024-09-13T02:54:10.489 INFO:tasks.workunit.client.0.smithi089.stdout:3/995: mknod d2/d8b/daf/c14a 0 2024-09-13T02:54:10.490 INFO:tasks.workunit.client.0.smithi089.stdout:3/996: mkdir d2/d8/d5f/d138/d141/d49/d75/d14b 0 2024-09-13T02:54:10.495 INFO:tasks.workunit.client.0.smithi089.stdout:2/905: dwrite d13/d30/f3c [0,4194304] 0 2024-09-13T02:54:10.500 INFO:tasks.workunit.client.0.smithi089.stdout:1/880: dwrite dc/d46/fb0 [0,4194304] 0 2024-09-13T02:54:10.504 INFO:tasks.workunit.client.0.smithi089.stdout:1/881: link dc/d46/cf9 dc/d44/d73/dc0/d102/d2c/d34/c117 0 2024-09-13T02:54:10.504 INFO:tasks.workunit.client.0.smithi089.stdout:1/882: readlink dc/d44/d73/dc0/d102/d2c/d34/d8b/lc3 0 2024-09-13T02:54:10.504 INFO:tasks.workunit.client.0.smithi089.stdout:3/997: dread d2/d8/fd2 [0,4194304] 0 2024-09-13T02:54:10.505 INFO:tasks.workunit.client.0.smithi089.stdout:1/883: truncate dc/d44/d73/dc0/d102/d2c/d36/f51 218223 0 2024-09-13T02:54:10.507 INFO:tasks.workunit.client.0.smithi089.stdout:3/998: creat d2/d8/dc/d3c/d65/f14c x:0 0 0 2024-09-13T02:54:10.507 INFO:tasks.workunit.client.0.smithi089.stdout:3/999: write d2/d8/d5f/d127/f12b [1042980,46155] 0 2024-09-13T02:54:10.510 INFO:tasks.workunit.client.0.smithi089.stdout:1/884: mkdir dc/d44/d73/dc0/d102/d2c/d36/d118 0 2024-09-13T02:54:10.510 INFO:tasks.workunit.client.0.smithi089.stdout:1/885: write dc/d46/d6c/d98/f10b [163701,103077] 0 2024-09-13T02:54:10.511 INFO:tasks.workunit.client.0.smithi089.stdout:1/886: mknod dc/d44/d73/dc0/d102/d2c/d34/d8b/d114/c119 0 2024-09-13T02:54:10.517 INFO:tasks.workunit.client.0.smithi089.stdout:9/885: dwrite d3/d6/d2a/d94/f38 [0,4194304] 0 2024-09-13T02:54:10.517 INFO:tasks.workunit.client.0.smithi089.stdout:2/906: dwrite d13/d30/d61/d78/d9c/f130 [0,4194304] 0 2024-09-13T02:54:10.517 INFO:tasks.workunit.client.0.smithi089.stdout:2/907: readlink d13/l14 0 2024-09-13T02:54:10.517 INFO:tasks.workunit.client.0.smithi089.stdout:2/908: fsync d13/d30/f4a 0 2024-09-13T02:54:10.517 INFO:tasks.workunit.client.0.smithi089.stdout:2/909: creat d13/d30/db1/f135 x:0 0 0 2024-09-13T02:54:10.518 INFO:tasks.workunit.client.0.smithi089.stdout:9/886: mknod d3/d6/d2a/d4b/d77/dfa/c11f 0 2024-09-13T02:54:10.522 INFO:tasks.workunit.client.0.smithi089.stdout:2/910: link d13/d30/d61/d78/d79/fef d13/d30/d4e/d6f/f136 0 2024-09-13T02:54:10.524 INFO:tasks.workunit.client.0.smithi089.stdout:2/911: truncate d13/d30/d59/f5b 1491923 0 2024-09-13T02:54:10.525 INFO:tasks.workunit.client.0.smithi089.stdout:0/904: dwrite d2/d19/d1a/d3d/d4b/d4f/f9d [0,4194304] 0 2024-09-13T02:54:10.526 INFO:tasks.workunit.client.0.smithi089.stdout:0/905: read d2/d19/d1a/ff2 [2723772,123577] 0 2024-09-13T02:54:10.526 INFO:tasks.workunit.client.0.smithi089.stdout:0/906: fdatasync d2/d19/d1a/f3e 0 2024-09-13T02:54:10.527 INFO:tasks.workunit.client.0.smithi089.stdout:0/907: mkdir d2/d19/d1a/d3d/d4b/d4f/d116/d126 0 2024-09-13T02:54:10.529 INFO:tasks.workunit.client.0.smithi089.stdout:0/908: getdents d2/d19/d1a/d1e/d42 0 2024-09-13T02:54:10.534 INFO:tasks.workunit.client.0.smithi089.stdout:2/912: write d13/d30/d61/d78/d79/fc6 [2155504,125253] 0 2024-09-13T02:54:10.534 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:10 smithi089 ceph-mon[27639]: pgmap v247: 65 pgs: 65 active+clean; 2.8 GiB data, 9.7 GiB used, 527 GiB / 536 GiB avail; 258 MiB/s rd, 305 MiB/s wr, 446 op/s 2024-09-13T02:54:10.535 INFO:tasks.workunit.client.0.smithi089.stdout:2/913: read f1 [303585,73157] 0 2024-09-13T02:54:10.537 INFO:tasks.workunit.client.0.smithi089.stdout:9/887: dwrite d3/d6/d2a/d94/f6e [0,4194304] 0 2024-09-13T02:54:10.538 INFO:tasks.workunit.client.0.smithi089.stdout:1/887: dwrite dc/d44/d73/dc0/d102/dba/fbd [0,4194304] 0 2024-09-13T02:54:10.538 INFO:tasks.workunit.client.0.smithi089.stdout:1/888: readlink dc/d44/d73/lac 0 2024-09-13T02:54:10.540 INFO:tasks.workunit.client.0.smithi089.stdout:9/888: mknod d3/d3d/d8b/dba/d10b/c120 0 2024-09-13T02:54:10.544 INFO:tasks.workunit.client.0.smithi089.stdout:1/889: creat dc/d44/d73/dc0/d102/dba/f11a x:0 0 0 2024-09-13T02:54:10.545 INFO:tasks.workunit.client.0.smithi089.stdout:9/889: truncate d3/d6/d2a/d94/d24/d29/f52 1223628 0 2024-09-13T02:54:10.545 INFO:tasks.workunit.client.0.smithi089.stdout:2/914: dread d13/d30/d61/d78/d9c/f121 [4194304,4194304] 0 2024-09-13T02:54:10.546 INFO:tasks.workunit.client.0.smithi089.stdout:9/890: unlink d3/d6/d2a/c76 0 2024-09-13T02:54:10.548 INFO:tasks.workunit.client.0.smithi089.stdout:2/915: creat d13/d30/d61/d111/d127/f137 x:0 0 0 2024-09-13T02:54:10.549 INFO:tasks.workunit.client.0.smithi089.stdout:9/891: creat d3/d6/d2a/d4b/d54/da1/f121 x:0 0 0 2024-09-13T02:54:10.549 INFO:tasks.workunit.client.0.smithi089.stdout:0/909: dwrite d2/d19/d1a/fc5 [0,4194304] 0 2024-09-13T02:54:10.550 INFO:tasks.workunit.client.0.smithi089.stdout:1/890: dread dc/f1e [0,4194304] 0 2024-09-13T02:54:10.550 INFO:tasks.workunit.client.0.smithi089.stdout:1/891: write dc/d3a/d93/fea [586365,36386] 0 2024-09-13T02:54:10.550 INFO:tasks.workunit.client.0.smithi089.stdout:1/892: readlink dc/d44/l7b 0 2024-09-13T02:54:10.551 INFO:tasks.workunit.client.0.smithi089.stdout:9/892: creat d3/df6/d100/f122 x:0 0 0 2024-09-13T02:54:10.551 INFO:tasks.workunit.client.0.smithi089.stdout:2/916: dread d13/d30/d61/d78/d79/f9f [0,4194304] 0 2024-09-13T02:54:10.552 INFO:tasks.workunit.client.0.smithi089.stdout:9/893: dread d3/d6/f73 [4194304,4194304] 0 2024-09-13T02:54:10.555 INFO:tasks.workunit.client.0.smithi089.stdout:2/917: creat d13/d30/d61/f138 x:0 0 0 2024-09-13T02:54:10.558 INFO:tasks.workunit.client.0.smithi089.stdout:6/991: sync 2024-09-13T02:54:10.600 INFO:tasks.workunit.client.0.smithi089.stdout:5/937: sync 2024-09-13T02:54:10.600 INFO:tasks.workunit.client.0.smithi089.stdout:5/938: chown d1/d4/d45/d6f/d62/d72/d99/lfe 153 1 2024-09-13T02:54:10.606 INFO:tasks.workunit.client.0.smithi089.stdout:0/910: read d2/d19/d1a/fc5 [1411722,25099] 0 2024-09-13T02:54:10.606 INFO:tasks.workunit.client.0.smithi089.stdout:6/992: write db/d43/d6e/d28/d2f/dc8/fd7 [38677,2932] 0 2024-09-13T02:54:10.607 INFO:tasks.workunit.client.0.smithi089.stdout:6/993: mknod db/d43/d6e/d28/d2f/c147 0 2024-09-13T02:54:10.607 INFO:tasks.workunit.client.0.smithi089.stdout:6/994: write db/f1d [3601686,57540] 0 2024-09-13T02:54:10.608 INFO:tasks.workunit.client.0.smithi089.stdout:0/911: creat d2/d19/def/f127 x:0 0 0 2024-09-13T02:54:10.611 INFO:tasks.workunit.client.0.smithi089.stdout:0/912: write d2/d64/fea [573897,100896] 0 2024-09-13T02:54:10.617 INFO:tasks.workunit.client.0.smithi089.stdout:0/913: dread d2/d19/d1a/d3d/d4b/d4f/f6d [0,4194304] 0 2024-09-13T02:54:10.618 INFO:tasks.workunit.client.0.smithi089.stdout:0/914: write d2/d64/fee [954329,33860] 0 2024-09-13T02:54:10.621 INFO:tasks.workunit.client.0.smithi089.stdout:9/894: dwrite d3/d15/f108 [0,4194304] 0 2024-09-13T02:54:10.622 INFO:tasks.workunit.client.0.smithi089.stdout:1/893: dwrite dc/f10 [0,4194304] 0 2024-09-13T02:54:10.622 INFO:tasks.workunit.client.0.smithi089.stdout:1/894: write dc/d44/f6a [323668,112879] 0 2024-09-13T02:54:10.623 INFO:tasks.workunit.client.0.smithi089.stdout:2/918: dwrite d13/d30/d59/fd4 [0,4194304] 0 2024-09-13T02:54:10.623 INFO:tasks.workunit.client.0.smithi089.stdout:2/919: fdatasync d13/f17 0 2024-09-13T02:54:10.633 INFO:tasks.workunit.client.0.smithi089.stdout:2/920: dread d13/d30/f4a [4194304,4194304] 0 2024-09-13T02:54:10.633 INFO:tasks.workunit.client.0.smithi089.stdout:2/921: write d13/d30/d61/d78/d79/d90/fee [108301,1287] 0 2024-09-13T02:54:10.633 INFO:tasks.workunit.client.0.smithi089.stdout:2/922: creat d13/d30/d61/d78/f139 x:0 0 0 2024-09-13T02:54:10.634 INFO:tasks.workunit.client.0.smithi089.stdout:2/923: chown d13/d30/d61/d78/d9c 233279 1 2024-09-13T02:54:10.634 INFO:tasks.workunit.client.0.smithi089.stdout:2/924: creat d13/d30/db1/f13a x:0 0 0 2024-09-13T02:54:10.638 INFO:tasks.workunit.client.0.smithi089.stdout:2/925: rename d13/d30/d61/d111/d127/f108 to d13/d30/d59/dbe/f13b 0 2024-09-13T02:54:10.641 INFO:tasks.workunit.client.0.smithi089.stdout:2/926: link d13/d30/d4e/f71 d13/d30/d4e/f13c 0 2024-09-13T02:54:10.643 INFO:tasks.workunit.client.0.smithi089.stdout:2/927: symlink d13/d30/d4e/d6f/l13d 0 2024-09-13T02:54:10.645 INFO:tasks.workunit.client.0.smithi089.stdout:2/928: rename d13/d30/f31 to d13/d30/d59/dbe/f13e 0 2024-09-13T02:54:10.645 INFO:tasks.workunit.client.0.smithi089.stdout:2/929: truncate d13/f9a 661525 0 2024-09-13T02:54:10.646 INFO:tasks.workunit.client.0.smithi089.stdout:2/930: mknod d13/d30/d61/d78/d9c/c13f 0 2024-09-13T02:54:10.647 INFO:tasks.workunit.client.0.smithi089.stdout:0/915: dwrite d2/d19/d1a/d4e/f79 [0,4194304] 0 2024-09-13T02:54:10.647 INFO:tasks.workunit.client.0.smithi089.stdout:0/916: chown d2/d64/db1 249915779 1 2024-09-13T02:54:10.647 INFO:tasks.workunit.client.0.smithi089.stdout:2/931: truncate d13/f27 1095904 0 2024-09-13T02:54:10.650 INFO:tasks.workunit.client.0.smithi089.stdout:2/932: creat d13/d30/d4e/dc2/f140 x:0 0 0 2024-09-13T02:54:10.650 INFO:tasks.workunit.client.0.smithi089.stdout:2/933: write d13/f17 [1566320,71388] 0 2024-09-13T02:54:10.650 INFO:tasks.workunit.client.0.smithi089.stdout:0/917: rmdir d2/d19/d1a/da4 39 2024-09-13T02:54:10.650 INFO:tasks.workunit.client.0.smithi089.stdout:0/918: chown d2/d19/d1a/d3d/d4b/d4f/d59/d6b/f99 880792 1 2024-09-13T02:54:10.650 INFO:tasks.workunit.client.0.smithi089.stdout:0/919: mknod d2/d19/d1a/d1e/d42/dd4/c128 0 2024-09-13T02:54:10.651 INFO:tasks.workunit.client.0.smithi089.stdout:0/920: mkdir d2/d19/d1a/d3d/d4b/d129 0 2024-09-13T02:54:10.653 INFO:tasks.workunit.client.0.smithi089.stdout:0/921: rename d2/f85 to d2/d19/d1a/d3d/d4b/d4f/d59/dd9/f12a 0 2024-09-13T02:54:10.653 INFO:tasks.workunit.client.0.smithi089.stdout:0/922: creat d2/d19/d1a/d1e/d42/dd4/df6/d118/f12b x:0 0 0 2024-09-13T02:54:10.654 INFO:tasks.workunit.client.0.smithi089.stdout:0/923: creat d2/d64/db3/dc9/f12c x:0 0 0 2024-09-13T02:54:10.656 INFO:tasks.workunit.client.0.smithi089.stdout:0/924: mkdir d2/d19/d1a/d3d/d4b/d4f/d59/d12d 0 2024-09-13T02:54:10.656 INFO:tasks.workunit.client.0.smithi089.stdout:0/925: chown d2/d19/d1a/f8f 96 1 2024-09-13T02:54:10.656 INFO:tasks.workunit.client.0.smithi089.stdout:0/926: write d2/d19/d1a/d1e/d42/ffd [673204,63069] 0 2024-09-13T02:54:10.656 INFO:tasks.workunit.client.0.smithi089.stdout:0/927: creat d2/d19/d1a/d1e/d42/dd4/df6/d118/f12e x:0 0 0 2024-09-13T02:54:10.657 INFO:tasks.workunit.client.0.smithi089.stdout:0/928: mkdir d2/d19/d1a/d1e/d42/dd4/df6/d12f 0 2024-09-13T02:54:10.658 INFO:tasks.workunit.client.0.smithi089.stdout:0/929: truncate d2/f48 2200482 0 2024-09-13T02:54:10.659 INFO:tasks.workunit.client.0.smithi089.stdout:0/930: creat d2/d19/d1a/d3d/d4b/d129/f130 x:0 0 0 2024-09-13T02:54:10.661 INFO:tasks.workunit.client.0.smithi089.stdout:2/934: dread d13/d30/d4e/f5d [0,4194304] 0 2024-09-13T02:54:10.663 INFO:tasks.workunit.client.0.smithi089.stdout:6/995: dwrite db/d43/f3b [0,4194304] 0 2024-09-13T02:54:10.663 INFO:tasks.workunit.client.0.smithi089.stdout:6/996: chown db/d43/d6e/d28/d37/d8b/dcd/d7d/d135 190491514 1 2024-09-13T02:54:10.663 INFO:tasks.workunit.client.0.smithi089.stdout:2/935: creat d13/d30/d64/f141 x:0 0 0 2024-09-13T02:54:10.663 INFO:tasks.workunit.client.0.smithi089.stdout:9/895: dwrite d3/d6/d36/d9d/db6/de9/fff [0,4194304] 0 2024-09-13T02:54:10.663 INFO:tasks.workunit.client.0.smithi089.stdout:1/895: dwrite dc/d44/d73/dc0/d102/f26 [0,4194304] 0 2024-09-13T02:54:10.664 INFO:tasks.workunit.client.0.smithi089.stdout:6/997: creat db/d10/dc1/f148 x:0 0 0 2024-09-13T02:54:10.664 INFO:tasks.workunit.client.0.smithi089.stdout:6/998: truncate db/d10/f4f 5037452 0 2024-09-13T02:54:10.667 INFO:tasks.workunit.client.0.smithi089.stdout:9/896: mkdir d3/d6/d36/d9d/d123 0 2024-09-13T02:54:10.669 INFO:tasks.workunit.client.0.smithi089.stdout:6/999: mknod db/d43/d6e/d28/d37/d8b/c149 0 2024-09-13T02:54:10.671 INFO:tasks.workunit.client.0.smithi089.stdout:1/896: dread dc/d46/d6c/d98/ff0 [0,4194304] 0 2024-09-13T02:54:10.671 INFO:tasks.workunit.client.0.smithi089.stdout:1/897: write dc/d44/d73/dc0/d102/d2c/d34/d9b/fb4 [1377,25120] 0 2024-09-13T02:54:10.671 INFO:tasks.workunit.client.0.smithi089.stdout:9/897: creat d3/d6/d2a/d4b/d54/da1/d111/f124 x:0 0 0 2024-09-13T02:54:10.676 INFO:tasks.workunit.client.0.smithi089.stdout:0/931: dwrite d2/fe [4194304,4194304] 0 2024-09-13T02:54:10.676 INFO:tasks.workunit.client.0.smithi089.stdout:1/898: getdents dc/d44/d73/dc0/d102/d2c/d36 0 2024-09-13T02:54:10.677 INFO:tasks.workunit.client.0.smithi089.stdout:2/936: write d13/d30/d4e/d6f/d76/dd6/f100 [619042,115678] 0 2024-09-13T02:54:10.685 INFO:tasks.workunit.client.0.smithi089.stdout:0/932: truncate d2/d19/d1a/d1e/d42/dd4/ff4 507312 0 2024-09-13T02:54:10.685 INFO:tasks.workunit.client.0.smithi089.stdout:2/937: mknod d13/d30/d61/d78/c142 0 2024-09-13T02:54:10.688 INFO:tasks.workunit.client.0.smithi089.stdout:0/933: creat d2/f131 x:0 0 0 2024-09-13T02:54:10.689 INFO:tasks.workunit.client.0.smithi089.stdout:2/938: creat d13/d30/d61/d131/f143 x:0 0 0 2024-09-13T02:54:10.690 INFO:tasks.workunit.client.0.smithi089.stdout:0/934: mkdir d2/d19/d1a/d3d/d4b/d129/d132 0 2024-09-13T02:54:10.691 INFO:tasks.workunit.client.0.smithi089.stdout:2/939: link d13/d30/d64/l12b d13/d30/d4e/d6f/d76/dd6/l144 0 2024-09-13T02:54:10.692 INFO:tasks.workunit.client.0.smithi089.stdout:2/940: creat d13/d30/d4e/d7b/d86/da7/f145 x:0 0 0 2024-09-13T02:54:10.692 INFO:tasks.workunit.client.0.smithi089.stdout:2/941: truncate d13/d30/d59/faa 4884163 0 2024-09-13T02:54:10.692 INFO:tasks.workunit.client.0.smithi089.stdout:2/942: fsync d13/f54 0 2024-09-13T02:54:10.693 INFO:tasks.workunit.client.0.smithi089.stdout:5/939: sync 2024-09-13T02:54:10.694 INFO:tasks.workunit.client.0.smithi089.stdout:5/940: getdents d1/d4/d45/d6f/d62/d72 0 2024-09-13T02:54:10.695 INFO:tasks.workunit.client.0.smithi089.stdout:5/941: mkdir d1/d4/d45/d6f/d4d/d12f 0 2024-09-13T02:54:10.696 INFO:tasks.workunit.client.0.smithi089.stdout:5/942: mkdir d1/d4/d45/d6f/d4d/d7f/d8f/d130 0 2024-09-13T02:54:10.697 INFO:tasks.workunit.client.0.smithi089.stdout:5/943: mknod d1/d4/d45/d8c/c131 0 2024-09-13T02:54:10.698 INFO:tasks.workunit.client.0.smithi089.stdout:5/944: write d1/d73/dcd/f119 [85169,22219] 0 2024-09-13T02:54:10.700 INFO:tasks.workunit.client.0.smithi089.stdout:5/945: rmdir d1/d4/ddb 39 2024-09-13T02:54:10.700 INFO:tasks.workunit.client.0.smithi089.stdout:5/946: fdatasync d1/d4/d45/d8c/fbb 0 2024-09-13T02:54:10.701 INFO:tasks.workunit.client.0.smithi089.stdout:5/947: truncate d1/d4/fc 2464669 0 2024-09-13T02:54:10.701 INFO:tasks.workunit.client.0.smithi089.stdout:5/948: dread - d1/d4/ddb/f12e zero size 2024-09-13T02:54:10.701 INFO:tasks.workunit.client.0.smithi089.stdout:5/949: fdatasync d1/d4/d45/d6f/d4d/d9d/daa/fcc 0 2024-09-13T02:54:10.708 INFO:tasks.workunit.client.0.smithi089.stdout:0/935: dwrite d2/d19/d1a/d1e/d42/f45 [0,4194304] 0 2024-09-13T02:54:10.710 INFO:tasks.workunit.client.0.smithi089.stdout:0/936: unlink d2/d19/d1a/d3d/d4b/d4f/d59/c8a 0 2024-09-13T02:54:10.710 INFO:tasks.workunit.client.0.smithi089.stdout:0/937: write d2/d19/d1a/d1e/d42/dd4/df6/d118/f12b [966099,29433] 0 2024-09-13T02:54:10.710 INFO:tasks.workunit.client.0.smithi089.stdout:0/938: fsync d2/d19/d1a/d4e/f79 0 2024-09-13T02:54:10.719 INFO:tasks.workunit.client.0.smithi089.stdout:5/950: dwrite d1/d7/ffa [0,4194304] 0 2024-09-13T02:54:10.719 INFO:tasks.workunit.client.0.smithi089.stdout:5/951: fdatasync d1/d4/d45/d6f/d4d/d7f/d49/d5a/f94 0 2024-09-13T02:54:10.728 INFO:tasks.workunit.client.0.smithi089.stdout:0/939: dwrite d2/d19/d1a/d3d/d4b/d4f/d59/f6e [0,4194304] 0 2024-09-13T02:54:10.730 INFO:tasks.workunit.client.0.smithi089.stdout:0/940: rename d2/d19/d1a/d3d/d4b/d4f/d59/d6b/f6f to d2/d19/d1a/d1e/d42/dd4/df6/f133 0 2024-09-13T02:54:10.730 INFO:tasks.workunit.client.0.smithi089.stdout:0/941: rmdir d2/dd0/de5 39 2024-09-13T02:54:10.741 INFO:tasks.workunit.client.0.smithi089.stdout:5/952: dwrite d1/d4/d45/d6f/d62/fd4 [4194304,4194304] 0 2024-09-13T02:54:10.745 INFO:tasks.workunit.client.0.smithi089.stdout:5/953: symlink d1/d73/l132 0 2024-09-13T02:54:10.745 INFO:tasks.workunit.client.0.smithi089.stdout:5/954: chown d1/d7/fbd 989735 1 2024-09-13T02:54:10.750 INFO:tasks.workunit.client.0.smithi089.stdout:0/942: dwrite d2/d64/db3/f10e [0,4194304] 0 2024-09-13T02:54:10.752 INFO:tasks.workunit.client.0.smithi089.stdout:5/955: write d1/f55 [399228,8751] 0 2024-09-13T02:54:10.756 INFO:tasks.workunit.client.0.smithi089.stdout:5/956: creat d1/d4/f133 x:0 0 0 2024-09-13T02:54:10.756 INFO:tasks.workunit.client.0.smithi089.stdout:5/957: fdatasync d1/d4/d45/d6f/d62/d72/fc5 0 2024-09-13T02:54:10.756 INFO:tasks.workunit.client.0.smithi089.stdout:5/958: creat d1/d4/d45/d8c/d98/f134 x:0 0 0 2024-09-13T02:54:10.758 INFO:tasks.workunit.client.0.smithi089.stdout:5/959: chown d1/d4/d45/fd5 3904246 1 2024-09-13T02:54:10.774 INFO:tasks.workunit.client.0.smithi089.stdout:0/943: dwrite d2/d19/d1a/d1e/d42/dd4/df6/df8/f124 [0,4194304] 0 2024-09-13T02:54:10.774 INFO:tasks.workunit.client.0.smithi089.stdout:5/960: dwrite d1/d4/d45/d8c/d98/f11c [0,4194304] 0 2024-09-13T02:54:10.776 INFO:tasks.workunit.client.0.smithi089.stdout:0/944: truncate d2/d19/d1a/d3d/d4b/d4f/d59/d6b/f99 56383 0 2024-09-13T02:54:10.779 INFO:tasks.workunit.client.0.smithi089.stdout:5/961: rename d1/fee to d1/d4/ddb/f135 0 2024-09-13T02:54:10.779 INFO:tasks.workunit.client.0.smithi089.stdout:5/962: chown d1/d4/d45/fd5 0 1 2024-09-13T02:54:10.780 INFO:tasks.workunit.client.0.smithi089.stdout:5/963: symlink d1/d4/d45/d6f/d62/l136 0 2024-09-13T02:54:10.780 INFO:tasks.workunit.client.0.smithi089.stdout:9/898: sync 2024-09-13T02:54:10.781 INFO:tasks.workunit.client.0.smithi089.stdout:5/964: creat d1/d4/d45/d8c/d98/daf/f137 x:0 0 0 2024-09-13T02:54:10.782 INFO:tasks.workunit.client.0.smithi089.stdout:5/965: getdents d1/d4/d45/d6f/d62/d72/d99 0 2024-09-13T02:54:10.782 INFO:tasks.workunit.client.0.smithi089.stdout:5/966: chown d1/d4/d45/d6f/d4d/d9d/fce 281 1 2024-09-13T02:54:10.782 INFO:tasks.workunit.client.0.smithi089.stdout:5/967: creat d1/d4/d45/d6f/d4d/f138 x:0 0 0 2024-09-13T02:54:10.784 INFO:tasks.workunit.client.0.smithi089.stdout:5/968: creat d1/d4/d45/d6f/d4d/d7f/d49/dc8/f139 x:0 0 0 2024-09-13T02:54:10.805 INFO:tasks.workunit.client.0.smithi089.stdout:9/899: dwrite d3/d6/d2a/d4b/d54/fae [0,4194304] 0 2024-09-13T02:54:10.807 INFO:tasks.workunit.client.0.smithi089.stdout:9/900: truncate d3/d3d/f67 3680889 0 2024-09-13T02:54:10.807 INFO:tasks.workunit.client.0.smithi089.stdout:9/901: dread - d3/df6/d100/f122 zero size 2024-09-13T02:54:10.807 INFO:tasks.workunit.client.0.smithi089.stdout:9/902: mknod d3/df6/c125 0 2024-09-13T02:54:10.808 INFO:tasks.workunit.client.0.smithi089.stdout:9/903: creat d3/d6/d2a/d4b/d6d/dea/f126 x:0 0 0 2024-09-13T02:54:10.899 INFO:tasks.workunit.client.0.smithi089.stdout:5/969: rename d1/d4/d45/d6f/d62 to d1/d4/d45/d6f/d4d/d7f/d49/dc8/d13a 0 2024-09-13T02:54:10.899 INFO:tasks.workunit.client.0.smithi089.stdout:5/970: readlink d1/d73/lf8 0 2024-09-13T02:54:10.901 INFO:tasks.workunit.client.0.smithi089.stdout:0/945: dwrite d2/d19/d1a/d4e/d7a/f90 [4194304,4194304] 0 2024-09-13T02:54:10.901 INFO:tasks.workunit.client.0.smithi089.stdout:0/946: creat d2/d19/d1a/d1e/d42/dd4/df6/df8/f134 x:0 0 0 2024-09-13T02:54:10.901 INFO:tasks.workunit.client.0.smithi089.stdout:0/947: chown d2/d19/d1a/d4e/d7a/d10d 34 1 2024-09-13T02:54:10.901 INFO:tasks.workunit.client.0.smithi089.stdout:0/948: chown d2/d19/d1a/d3d/d4b/d4f/d59/d6b/f122 2301 1 2024-09-13T02:54:10.901 INFO:tasks.workunit.client.0.smithi089.stdout:0/949: chown d2/d19/d1a/d3d/d4b/d4f/f5c 384 1 2024-09-13T02:54:10.902 INFO:tasks.workunit.client.0.smithi089.stdout:0/950: mknod d2/d64/db3/dc9/d120/c135 0 2024-09-13T02:54:10.902 INFO:tasks.workunit.client.0.smithi089.stdout:0/951: getdents d2/d19/d1a/d1e/d42/dd4/df6/d11c 0 2024-09-13T02:54:10.903 INFO:tasks.workunit.client.0.smithi089.stdout:0/952: creat d2/d19/d1a/d1e/d42/dd4/df6/f136 x:0 0 0 2024-09-13T02:54:10.903 INFO:tasks.workunit.client.0.smithi089.stdout:0/953: readlink d2/d19/d1a/d1e/lad 0 2024-09-13T02:54:10.903 INFO:tasks.workunit.client.0.smithi089.stdout:0/954: creat d2/d19/d1a/d4e/d7a/f137 x:0 0 0 2024-09-13T02:54:10.904 INFO:tasks.workunit.client.0.smithi089.stdout:0/955: truncate d2/f48 1683883 0 2024-09-13T02:54:10.904 INFO:tasks.workunit.client.0.smithi089.stdout:0/956: write d2/d64/db3/dc9/fb7 [47331,70458] 0 2024-09-13T02:54:10.904 INFO:tasks.workunit.client.0.smithi089.stdout:0/957: truncate d2/d19/d1a/f8c 634084 0 2024-09-13T02:54:10.904 INFO:tasks.workunit.client.0.smithi089.stdout:0/958: chown d2/d19/d1a 38 1 2024-09-13T02:54:10.905 INFO:tasks.workunit.client.0.smithi089.stdout:0/959: getdents d2/d19/d1a/da4 0 2024-09-13T02:54:10.906 INFO:tasks.workunit.client.0.smithi089.stdout:0/960: truncate d2/d19/d1a/fc2 3082485 0 2024-09-13T02:54:10.906 INFO:tasks.workunit.client.0.smithi089.stdout:0/961: read d2/d19/d1a/d3d/d4b/d4f/f5b [1722029,27138] 0 2024-09-13T02:54:10.907 INFO:tasks.workunit.client.0.smithi089.stdout:0/962: creat d2/dd0/f138 x:0 0 0 2024-09-13T02:54:10.907 INFO:tasks.workunit.client.0.smithi089.stdout:0/963: symlink d2/d19/d1a/d3d/d4b/d4f/l139 0 2024-09-13T02:54:10.908 INFO:tasks.workunit.client.0.smithi089.stdout:0/964: chown d2/d19/d1a/d4e/cc3 370296117 1 2024-09-13T02:54:10.909 INFO:tasks.workunit.client.0.smithi089.stdout:0/965: creat d2/d64/db3/dc9/d120/f13a x:0 0 0 2024-09-13T02:54:10.909 INFO:tasks.workunit.client.0.smithi089.stdout:0/966: getdents d2/d19/d1a/d1e/d42 0 2024-09-13T02:54:10.909 INFO:tasks.workunit.client.0.smithi089.stdout:0/967: chown d2/d19 77058274 1 2024-09-13T02:54:10.909 INFO:tasks.workunit.client.0.smithi089.stdout:0/968: dread - d2/f115 zero size 2024-09-13T02:54:10.910 INFO:tasks.workunit.client.0.smithi089.stdout:0/969: rmdir d2/d19/d1a/d3d/d4b/d129/d132 0 2024-09-13T02:54:10.911 INFO:tasks.workunit.client.0.smithi089.stdout:0/970: creat d2/d19/d1a/d3d/d4b/d4f/d59/f13b x:0 0 0 2024-09-13T02:54:10.911 INFO:tasks.workunit.client.0.smithi089.stdout:0/971: mkdir d2/d19/d1a/d4e/d9a/d13c 0 2024-09-13T02:54:10.912 INFO:tasks.workunit.client.0.smithi089.stdout:0/972: mknod d2/d19/d1a/d1e/d42/dd4/df6/c13d 0 2024-09-13T02:54:10.912 INFO:tasks.workunit.client.0.smithi089.stdout:1/899: sync 2024-09-13T02:54:10.913 INFO:tasks.workunit.client.0.smithi089.stdout:0/973: dread - d2/fba zero size 2024-09-13T02:54:10.913 INFO:tasks.workunit.client.0.smithi089.stdout:1/900: creat dc/d44/d73/dc0/d102/d2c/d34/d8b/db5/f11b x:0 0 0 2024-09-13T02:54:10.914 INFO:tasks.workunit.client.0.smithi089.stdout:0/974: creat d2/d64/f13e x:0 0 0 2024-09-13T02:54:10.914 INFO:tasks.workunit.client.0.smithi089.stdout:0/975: symlink d2/d19/d1a/dbe/l13f 0 2024-09-13T02:54:10.916 INFO:tasks.workunit.client.0.smithi089.stdout:0/976: symlink d2/d19/d1a/d1e/d42/dd4/df6/d12f/l140 0 2024-09-13T02:54:10.916 INFO:tasks.workunit.client.0.smithi089.stdout:0/977: creat d2/d19/d1a/d3d/d4b/d4f/d59/dd9/f141 x:0 0 0 2024-09-13T02:54:10.916 INFO:tasks.workunit.client.0.smithi089.stdout:5/971: dwrite d1/d4/d45/d6f/d4d/d7f/d49/dc8/d13a/d72/d99/fd7 [0,4194304] 0 2024-09-13T02:54:10.916 INFO:tasks.workunit.client.0.smithi089.stdout:5/972: creat d1/d4/d45/d6f/d4d/d9d/f13b x:0 0 0 2024-09-13T02:54:10.916 INFO:tasks.workunit.client.0.smithi089.stdout:5/973: creat d1/d4/f13c x:0 0 0 2024-09-13T02:54:10.916 INFO:tasks.workunit.client.0.smithi089.stdout:5/974: truncate d1/d4/d45/d6f/d4d/d9d/fce 14009 0 2024-09-13T02:54:10.916 INFO:tasks.workunit.client.0.smithi089.stdout:5/975: truncate d1/d4/d45/d8c/d98/d11f/f123 369577 0 2024-09-13T02:54:10.918 INFO:tasks.workunit.client.0.smithi089.stdout:0/978: rmdir d2/d19/d1a/dbe 39 2024-09-13T02:54:10.919 INFO:tasks.workunit.client.0.smithi089.stdout:0/979: chown d2/d19/d1a/d3d/c7d 1733315 1 2024-09-13T02:54:10.921 INFO:tasks.workunit.client.0.smithi089.stdout:2/943: sync 2024-09-13T02:54:10.921 INFO:tasks.workunit.client.0.smithi089.stdout:0/980: read d2/d19/d1a/d1e/d42/fc7 [273872,65710] 0 2024-09-13T02:54:10.922 INFO:tasks.workunit.client.0.smithi089.stdout:1/901: write dc/d46/d6c/fca [1482230,108935] 0 2024-09-13T02:54:10.923 INFO:tasks.workunit.client.0.smithi089.stdout:5/976: rename d1/d4/d45/d8c/d98/fb9 to d1/d4/ddb/df3/f13d 0 2024-09-13T02:54:10.923 INFO:tasks.workunit.client.0.smithi089.stdout:0/981: write d2/d64/fea [1438096,103946] 0 2024-09-13T02:54:10.924 INFO:tasks.workunit.client.0.smithi089.stdout:2/944: symlink d13/d30/d4e/d6f/d76/dd6/l146 0 2024-09-13T02:54:10.924 INFO:tasks.workunit.client.0.smithi089.stdout:2/945: dread - d13/d30/d61/d78/f12c zero size 2024-09-13T02:54:10.924 INFO:tasks.workunit.client.0.smithi089.stdout:2/946: creat d13/d30/d4e/d6f/d76/f147 x:0 0 0 2024-09-13T02:54:10.925 INFO:tasks.workunit.client.0.smithi089.stdout:5/977: mknod d1/d4/d45/d6f/d4d/d7f/d49/dc8/c13e 0 2024-09-13T02:54:10.926 INFO:tasks.workunit.client.0.smithi089.stdout:5/978: chown d1/d4/d45/d8c/d98/f134 163055935 1 2024-09-13T02:54:10.927 INFO:tasks.workunit.client.0.smithi089.stdout:0/982: creat d2/d19/d1a/d3d/d4b/d4f/d59/d12d/f142 x:0 0 0 2024-09-13T02:54:10.927 INFO:tasks.workunit.client.0.smithi089.stdout:0/983: write d2/d19/d1a/d1e/d42/f46 [2741965,26306] 0 2024-09-13T02:54:10.928 INFO:tasks.workunit.client.0.smithi089.stdout:0/984: dread d2/d19/d1a/d3d/d4b/d4f/d59/dd9/f12a [0,4194304] 0 2024-09-13T02:54:10.928 INFO:tasks.workunit.client.0.smithi089.stdout:2/947: rename d13/d30/f4a to d13/d30/d61/d78/dd3/de7/f148 0 2024-09-13T02:54:10.930 INFO:tasks.workunit.client.0.smithi089.stdout:5/979: creat d1/d4/d45/d6f/d4d/d7f/d49/f13f x:0 0 0 2024-09-13T02:54:10.931 INFO:tasks.workunit.client.0.smithi089.stdout:0/985: symlink d2/d19/d1a/d4e/d7a/d9b/l143 0 2024-09-13T02:54:10.936 INFO:tasks.workunit.client.0.smithi089.stdout:0/986: dread d2/d19/d1a/f3e [0,4194304] 0 2024-09-13T02:54:10.939 INFO:tasks.workunit.client.0.smithi089.stdout:1/902: dwrite dc/d44/d73/dc0/d102/d2c/d34/f67 [0,4194304] 0 2024-09-13T02:54:10.941 INFO:tasks.workunit.client.0.smithi089.stdout:1/903: mknod dc/d44/d73/dc0/d102/d2c/d6f/dda/c11c 0 2024-09-13T02:54:10.942 INFO:tasks.workunit.client.0.smithi089.stdout:2/948: dread d13/d30/d4e/f13c [0,4194304] 0 2024-09-13T02:54:10.946 INFO:tasks.workunit.client.0.smithi089.stdout:2/949: dread d13/f17 [0,4194304] 0 2024-09-13T02:54:10.947 INFO:tasks.workunit.client.0.smithi089.stdout:2/950: chown d13/f32 40970729 1 2024-09-13T02:54:10.949 INFO:tasks.workunit.client.0.smithi089.stdout:1/904: read dc/d44/d73/dc0/d102/d2c/d6f/f84 [554733,128981] 0 2024-09-13T02:54:10.957 INFO:tasks.workunit.client.0.smithi089.stdout:0/987: dwrite d2/d64/db3/de0/f113 [0,4194304] 0 2024-09-13T02:54:10.958 INFO:tasks.workunit.client.0.smithi089.stdout:2/951: dread d13/d30/f48 [0,4194304] 0 2024-09-13T02:54:10.962 INFO:tasks.workunit.client.0.smithi089.stdout:1/905: write dc/d44/d73/dc0/d102/f28 [1131917,12987] 0 2024-09-13T02:54:10.962 INFO:tasks.workunit.client.0.smithi089.stdout:1/906: fdatasync dc/f1e 0 2024-09-13T02:54:10.963 INFO:tasks.workunit.client.0.smithi089.stdout:1/907: creat dc/d6e/f11d x:0 0 0 2024-09-13T02:54:10.963 INFO:tasks.workunit.client.0.smithi089.stdout:1/908: write dc/d44/d73/dc0/d102/d2c/d34/d9b/ff2 [122767,28523] 0 2024-09-13T02:54:10.963 INFO:tasks.workunit.client.0.smithi089.stdout:1/909: truncate dc/d3a/f5a 65292 0 2024-09-13T02:54:10.964 INFO:tasks.workunit.client.0.smithi089.stdout:0/988: write d2/f3a [1997138,87290] 0 2024-09-13T02:54:10.967 INFO:tasks.workunit.client.0.smithi089.stdout:0/989: mknod d2/d19/d1a/d3d/d4b/d4f/d116/c144 0 2024-09-13T02:54:10.967 INFO:tasks.workunit.client.0.smithi089.stdout:9/904: sync 2024-09-13T02:54:10.967 INFO:tasks.workunit.client.0.smithi089.stdout:9/905: chown d3/d6/d2a/d94/d24/caa 7 1 2024-09-13T02:54:10.967 INFO:tasks.workunit.client.0.smithi089.stdout:9/906: chown d3/d6/d2a/d94/fc0 0 1 2024-09-13T02:54:10.968 INFO:tasks.workunit.client.0.smithi089.stdout:1/910: dread dc/d46/d6c/d98/ff0 [0,4194304] 0 2024-09-13T02:54:10.969 INFO:tasks.workunit.client.0.smithi089.stdout:9/907: mkdir d3/d6/d2a/d4b/d77/d127 0 2024-09-13T02:54:10.970 INFO:tasks.workunit.client.0.smithi089.stdout:9/908: write d3/d6/d2a/d4b/fe1 [1652635,106747] 0 2024-09-13T02:54:10.972 INFO:tasks.workunit.client.0.smithi089.stdout:9/909: mkdir d3/d6/d2a/d4b/d77/d127/d128 0 2024-09-13T02:54:10.983 INFO:tasks.workunit.client.0.smithi089.stdout:2/952: dwrite d13/d30/d61/d78/d79/d90/fee [0,4194304] 0 2024-09-13T02:54:10.983 INFO:tasks.workunit.client.0.smithi089.stdout:2/953: chown d13/d30/f22 54141 1 2024-09-13T02:54:10.987 INFO:tasks.workunit.client.0.smithi089.stdout:2/954: symlink d13/d30/d59/l149 0 2024-09-13T02:54:10.987 INFO:tasks.workunit.client.0.smithi089.stdout:2/955: chown d13/f54 1827056 1 2024-09-13T02:54:10.987 INFO:tasks.workunit.client.0.smithi089.stdout:2/956: truncate d13/d30/d59/f7e 8397517 0 2024-09-13T02:54:10.987 INFO:tasks.workunit.client.0.smithi089.stdout:9/910: write d3/d6/d2a/d94/f62 [2270097,110517] 0 2024-09-13T02:54:10.988 INFO:tasks.workunit.client.0.smithi089.stdout:2/957: creat d13/d30/f14a x:0 0 0 2024-09-13T02:54:10.989 INFO:tasks.workunit.client.0.smithi089.stdout:9/911: unlink d3/d6/d2a/d4b/d54/da1/l103 0 2024-09-13T02:54:10.991 INFO:tasks.workunit.client.0.smithi089.stdout:9/912: rename d3/fc4 to d3/d6/d2a/d4b/d77/dfa/d11c/f129 0 2024-09-13T02:54:10.991 INFO:tasks.workunit.client.0.smithi089.stdout:9/913: stat d3/d6/d36/l55 0 2024-09-13T02:54:10.995 INFO:tasks.workunit.client.0.smithi089.stdout:0/990: dwrite d2/d19/d1a/d1e/d42/dd4/df6/f110 [0,4194304] 0 2024-09-13T02:54:10.997 INFO:tasks.workunit.client.0.smithi089.stdout:1/911: dwrite dc/f22 [0,4194304] 0 2024-09-13T02:54:10.997 INFO:tasks.workunit.client.0.smithi089.stdout:1/912: fdatasync dc/d44/d73/dc0/d102/d2c/d94/fe7 0 2024-09-13T02:54:10.999 INFO:tasks.workunit.client.0.smithi089.stdout:9/914: write d3/d15/f49 [571995,81450] 0 2024-09-13T02:54:11.001 INFO:tasks.workunit.client.0.smithi089.stdout:9/915: link d3/d6/d2a/d94/f10f d3/d6/d2a/d94/d24/d29/f12a 0 2024-09-13T02:54:11.003 INFO:tasks.workunit.client.0.smithi089.stdout:9/916: rename d3/d6/d2a/d94/d24/ca3 to d3/d6/d2a/d4b/d6d/c12b 0 2024-09-13T02:54:11.004 INFO:tasks.workunit.client.0.smithi089.stdout:1/913: write dc/d44/f99 [1485587,60147] 0 2024-09-13T02:54:11.004 INFO:tasks.workunit.client.0.smithi089.stdout:1/914: chown dc/d44/d73/dc0/d102/d2c/d36/f10c 144865 1 2024-09-13T02:54:11.005 INFO:tasks.workunit.client.0.smithi089.stdout:9/917: fsync d3/d6/d2a/d4b/d77/dfa/d11c/f129 0 2024-09-13T02:54:11.006 INFO:tasks.workunit.client.0.smithi089.stdout:0/991: write d2/d19/d1a/d3d/d4b/d4f/d59/d6b/f6c [4572529,130670] 0 2024-09-13T02:54:11.006 INFO:tasks.workunit.client.0.smithi089.stdout:9/918: write d3/d4c/d91/fd5 [914409,47675] 0 2024-09-13T02:54:11.006 INFO:tasks.workunit.client.0.smithi089.stdout:0/992: mknod d2/dd0/de5/d10f/c145 0 2024-09-13T02:54:11.007 INFO:tasks.workunit.client.0.smithi089.stdout:9/919: mkdir d3/df6/d100/d12c 0 2024-09-13T02:54:11.007 INFO:tasks.workunit.client.0.smithi089.stdout:5/980: sync 2024-09-13T02:54:11.008 INFO:tasks.workunit.client.0.smithi089.stdout:1/915: dread dc/d46/d6c/d98/ff0 [0,4194304] 0 2024-09-13T02:54:11.009 INFO:tasks.workunit.client.0.smithi089.stdout:9/920: symlink d3/d6/d2a/d4b/d54/da1/l12d 0 2024-09-13T02:54:11.009 INFO:tasks.workunit.client.0.smithi089.stdout:9/921: creat d3/d3d/f12e x:0 0 0 2024-09-13T02:54:11.009 INFO:tasks.workunit.client.0.smithi089.stdout:9/922: write d3/dfe/fb0 [857465,39414] 0 2024-09-13T02:54:11.009 INFO:tasks.workunit.client.0.smithi089.stdout:9/923: chown d3/d6/c25 66534296 1 2024-09-13T02:54:11.010 INFO:tasks.workunit.client.0.smithi089.stdout:1/916: symlink dc/d44/d73/d85/dd6/ddf/l11e 0 2024-09-13T02:54:11.010 INFO:tasks.workunit.client.0.smithi089.stdout:1/917: truncate dc/d44/d73/fa8 691866 0 2024-09-13T02:54:11.011 INFO:tasks.workunit.client.0.smithi089.stdout:1/918: write dc/d44/d73/d9a/f104 [401716,24570] 0 2024-09-13T02:54:11.012 INFO:tasks.workunit.client.0.smithi089.stdout:9/924: creat d3/d6/d2a/d4b/d54/f12f x:0 0 0 2024-09-13T02:54:11.013 INFO:tasks.workunit.client.0.smithi089.stdout:1/919: truncate dc/d46/fb0 1736751 0 2024-09-13T02:54:11.013 INFO:tasks.workunit.client.0.smithi089.stdout:1/920: write dc/d44/d73/dc0/f10f [1001635,43435] 0 2024-09-13T02:54:11.013 INFO:tasks.workunit.client.0.smithi089.stdout:9/925: unlink d3/d4c/d91/c9e 0 2024-09-13T02:54:11.015 INFO:tasks.workunit.client.0.smithi089.stdout:9/926: unlink d3/d6/d2a/d4b/d54/da1/fad 0 2024-09-13T02:54:11.016 INFO:tasks.workunit.client.0.smithi089.stdout:9/927: symlink d3/d6/d2a/d4b/l130 0 2024-09-13T02:54:11.018 INFO:tasks.workunit.client.0.smithi089.stdout:9/928: mknod d3/d6/c131 0 2024-09-13T02:54:11.019 INFO:tasks.workunit.client.0.smithi089.stdout:9/929: symlink d3/d6/d2a/d94/d56/l132 0 2024-09-13T02:54:11.019 INFO:tasks.workunit.client.0.smithi089.stdout:9/930: fsync d3/d6/d2a/d94/d24/d29/fc5 0 2024-09-13T02:54:11.044 INFO:tasks.workunit.client.0.smithi089.stdout:1/921: dwrite dc/d44/d73/dc0/d102/fcc [0,4194304] 0 2024-09-13T02:54:11.044 INFO:tasks.workunit.client.0.smithi089.stdout:1/922: read - dc/d44/d73/dc0/d102/d2c/d34/d8b/fbe zero size 2024-09-13T02:54:11.045 INFO:tasks.workunit.client.0.smithi089.stdout:0/993: dwrite d2/d19/d1a/d1e/d42/dd4/ff5 [0,4194304] 0 2024-09-13T02:54:11.045 INFO:tasks.workunit.client.0.smithi089.stdout:0/994: fsync d2/d19/d1a/d3d/d4b/f55 0 2024-09-13T02:54:11.045 INFO:tasks.workunit.client.0.smithi089.stdout:5/981: dwrite d1/d4/d45/f7b [4194304,4194304] 0 2024-09-13T02:54:11.047 INFO:tasks.workunit.client.0.smithi089.stdout:0/995: dread d2/d19/d1a/d1e/d42/f5d [0,4194304] 0 2024-09-13T02:54:11.048 INFO:tasks.workunit.client.0.smithi089.stdout:0/996: read - d2/d19/d1a/d1e/d42/d7e/fa7 zero size 2024-09-13T02:54:11.048 INFO:tasks.workunit.client.0.smithi089.stdout:1/923: creat dc/d44/d73/d85/dd6/f11f x:0 0 0 2024-09-13T02:54:11.050 INFO:tasks.workunit.client.0.smithi089.stdout:5/982: symlink d1/d4/d2b/da9/l140 0 2024-09-13T02:54:11.051 INFO:tasks.workunit.client.0.smithi089.stdout:5/983: mknod d1/d4/d45/d6f/d4d/d9d/daa/c141 0 2024-09-13T02:54:11.052 INFO:tasks.workunit.client.0.smithi089.stdout:5/984: unlink d1/d4/d45/d8c/d98/lde 0 2024-09-13T02:54:11.053 INFO:tasks.workunit.client.0.smithi089.stdout:5/985: link d1/d4/d45/d6f/d4d/d7f/c80 d1/d4/d45/d8c/d98/c142 0 2024-09-13T02:54:11.058 INFO:tasks.workunit.client.0.smithi089.stdout:1/924: dread dc/d44/d73/dc0/d102/d2c/d6f/feb [0,4194304] 0 2024-09-13T02:54:11.058 INFO:tasks.workunit.client.0.smithi089.stdout:1/925: chown dc/d44/d73/dc0/d102/d2c/fce 6 1 2024-09-13T02:54:11.058 INFO:tasks.workunit.client.0.smithi089.stdout:1/926: write dc/d44/d73/dc0/fee [4072955,22994] 0 2024-09-13T02:54:11.061 INFO:tasks.workunit.client.0.smithi089.stdout:0/997: dwrite d2/f3a [0,4194304] 0 2024-09-13T02:54:11.082 INFO:tasks.workunit.client.0.smithi089.stdout:5/986: dwrite d1/d4/d45/d6f/d4d/d7f/d8f/dad/f11e [0,4194304] 0 2024-09-13T02:54:11.084 INFO:tasks.workunit.client.0.smithi089.stdout:1/927: dwrite dc/d44/d73/d85/dd6/dd7/de1/ffb [0,4194304] 0 2024-09-13T02:54:11.085 INFO:tasks.workunit.client.0.smithi089.stdout:5/987: truncate d1/d4/d45/d6f/d4d/d9d/daa/f10c 414796 0 2024-09-13T02:54:11.085 INFO:tasks.workunit.client.0.smithi089.stdout:5/988: fdatasync d1/d4/d2b/f11d 0 2024-09-13T02:54:11.086 INFO:tasks.workunit.client.0.smithi089.stdout:5/989: dread d1/d4/d45/d6f/d4d/d7f/d49/fa4 [0,4194304] 0 2024-09-13T02:54:11.087 INFO:tasks.workunit.client.0.smithi089.stdout:2/958: sync 2024-09-13T02:54:11.095 INFO:tasks.workunit.client.0.smithi089.stdout:2/959: dread d13/d30/d4e/d6f/f8f [0,4194304] 0 2024-09-13T02:54:11.096 INFO:tasks.workunit.client.0.smithi089.stdout:2/960: mknod d13/d30/d59/c14b 0 2024-09-13T02:54:11.096 INFO:tasks.workunit.client.0.smithi089.stdout:2/961: chown d13/d30/d4e/d7b/df7/cff 32045861 1 2024-09-13T02:54:11.098 INFO:tasks.workunit.client.0.smithi089.stdout:5/990: dread d1/d4/d45/d6f/d4d/f58 [0,4194304] 0 2024-09-13T02:54:11.098 INFO:tasks.workunit.client.0.smithi089.stdout:5/991: mkdir d1/d4/d45/d6f/d4d/d143 0 2024-09-13T02:54:11.100 INFO:tasks.workunit.client.0.smithi089.stdout:5/992: rename d1/d73/ff5 to d1/d4/d45/d6f/d7c/f144 0 2024-09-13T02:54:11.101 INFO:tasks.workunit.client.0.smithi089.stdout:5/993: mkdir d1/d4/d45/d6f/d4d/d9d/daa/d145 0 2024-09-13T02:54:11.102 INFO:tasks.workunit.client.0.smithi089.stdout:1/928: dwrite dc/d44/d73/dc0/d102/f26 [4194304,4194304] 0 2024-09-13T02:54:11.103 INFO:tasks.workunit.client.0.smithi089.stdout:5/994: rename d1/d4/d45/d6f/d4d/d7f/d8f/dad to d1/d4/d45/d6f/d4d/d7f/d8f/d146 0 2024-09-13T02:54:11.104 INFO:tasks.workunit.client.0.smithi089.stdout:1/929: creat dc/d3a/f120 x:0 0 0 2024-09-13T02:54:11.105 INFO:tasks.workunit.client.0.smithi089.stdout:5/995: rename d1/d4/d45/d6f/d4d/d7f/f12b to d1/d4/d45/d6f/d4d/d9d/daa/d145/f147 0 2024-09-13T02:54:11.105 INFO:tasks.workunit.client.0.smithi089.stdout:1/930: symlink dc/d46/d6c/d98/l121 0 2024-09-13T02:54:11.107 INFO:tasks.workunit.client.0.smithi089.stdout:1/931: unlink dc/d3a/d93/lad 0 2024-09-13T02:54:11.108 INFO:tasks.workunit.client.0.smithi089.stdout:1/932: rename dc/d44/d73/fa8 to dc/f122 0 2024-09-13T02:54:11.110 INFO:tasks.workunit.client.0.smithi089.stdout:2/962: dwrite d13/fdf [0,4194304] 0 2024-09-13T02:54:11.116 INFO:tasks.workunit.client.0.smithi089.stdout:2/963: write d13/d30/d4e/f13c [3316408,66728] 0 2024-09-13T02:54:11.120 INFO:tasks.workunit.client.0.smithi089.stdout:1/933: dread dc/d44/d73/f5b [0,4194304] 0 2024-09-13T02:54:11.120 INFO:tasks.workunit.client.0.smithi089.stdout:1/934: creat dc/d44/d73/d85/dd6/dd7/f123 x:0 0 0 2024-09-13T02:54:11.122 INFO:tasks.workunit.client.0.smithi089.stdout:5/996: dwrite d1/d4/d2b/ff2 [0,4194304] 0 2024-09-13T02:54:11.122 INFO:tasks.workunit.client.0.smithi089.stdout:5/997: dread - d1/d4/d45/d6f/d7c/fb8 zero size 2024-09-13T02:54:11.122 INFO:tasks.workunit.client.0.smithi089.stdout:9/931: sync 2024-09-13T02:54:11.122 INFO:tasks.workunit.client.0.smithi089.stdout:9/932: dread - d3/d3d/d8b/fdb zero size 2024-09-13T02:54:11.122 INFO:tasks.workunit.client.0.smithi089.stdout:9/933: chown d3/d6/d2a/c2d 1044140 1 2024-09-13T02:54:11.122 INFO:tasks.workunit.client.0.smithi089.stdout:1/935: mknod dc/d44/d73/dc0/c124 0 2024-09-13T02:54:11.124 INFO:tasks.workunit.client.0.smithi089.stdout:5/998: creat d1/d4/ddb/df3/f148 x:0 0 0 2024-09-13T02:54:11.126 INFO:tasks.workunit.client.0.smithi089.stdout:5/999: unlink d1/d4/d2b/f11d 0 2024-09-13T02:54:11.127 INFO:tasks.workunit.client.0.smithi089.stdout:1/936: rmdir dc/d44/d73/dc0/d102/d2c/d34/d8b/db5 39 2024-09-13T02:54:11.127 INFO:tasks.workunit.client.0.smithi089.stdout:2/964: write d13/d30/d4e/f74 [1283047,53228] 0 2024-09-13T02:54:11.127 INFO:tasks.workunit.client.0.smithi089.stdout:2/965: fdatasync d13/d30/d4e/d7b/fdb 0 2024-09-13T02:54:11.127 INFO:tasks.workunit.client.0.smithi089.stdout:1/937: creat dc/d44/f125 x:0 0 0 2024-09-13T02:54:11.128 INFO:tasks.workunit.client.0.smithi089.stdout:9/934: read d3/d6/d2a/d94/da7/fee [1532974,11145] 0 2024-09-13T02:54:11.130 INFO:tasks.workunit.client.0.smithi089.stdout:2/966: unlink d13/d30/d4e/d6f/lbc 0 2024-09-13T02:54:11.130 INFO:tasks.workunit.client.0.smithi089.stdout:0/998: sync 2024-09-13T02:54:11.130 INFO:tasks.workunit.client.0.smithi089.stdout:2/967: dread - d13/d30/d61/d78/dd3/de7/db7/de3/ff0 zero size 2024-09-13T02:54:11.130 INFO:tasks.workunit.client.0.smithi089.stdout:0/999: chown d2/d19/d1a/d3d/d4b/d4f/f6d 0 1 2024-09-13T02:54:11.131 INFO:tasks.workunit.client.0.smithi089.stdout:9/935: dread d3/d6/d2a/d4b/d54/da1/ff4 [0,4194304] 0 2024-09-13T02:54:11.131 INFO:tasks.workunit.client.0.smithi089.stdout:9/936: fsync d3/d6/d2a/fed 0 2024-09-13T02:54:11.136 INFO:tasks.workunit.client.0.smithi089.stdout:2/968: read d13/f1a [1605048,399] 0 2024-09-13T02:54:11.136 INFO:tasks.workunit.client.0.smithi089.stdout:2/969: write d13/d30/db1/f135 [598962,6372] 0 2024-09-13T02:54:11.137 INFO:tasks.workunit.client.0.smithi089.stdout:2/970: dread d13/d30/f41 [0,4194304] 0 2024-09-13T02:54:11.138 INFO:tasks.workunit.client.0.smithi089.stdout:1/938: dread dc/f10 [0,4194304] 0 2024-09-13T02:54:11.138 INFO:tasks.workunit.client.0.smithi089.stdout:2/971: mkdir d13/d30/d4e/d6f/d14c 0 2024-09-13T02:54:11.138 INFO:tasks.workunit.client.0.smithi089.stdout:2/972: chown d13/d30/d61/dca 30050 1 2024-09-13T02:54:11.139 INFO:tasks.workunit.client.0.smithi089.stdout:1/939: symlink dc/d46/l126 0 2024-09-13T02:54:11.139 INFO:tasks.workunit.client.0.smithi089.stdout:2/973: symlink d13/d30/d61/d131/l14d 0 2024-09-13T02:54:11.141 INFO:tasks.workunit.client.0.smithi089.stdout:1/940: write dc/d44/d73/d9a/f104 [138853,55156] 0 2024-09-13T02:54:11.141 INFO:tasks.workunit.client.0.smithi089.stdout:2/974: mkdir d13/d30/d4e/d6f/d14e 0 2024-09-13T02:54:11.141 INFO:tasks.workunit.client.0.smithi089.stdout:9/937: write d3/d6/d2a/d94/d24/d35/f80 [723747,71170] 0 2024-09-13T02:54:11.141 INFO:tasks.workunit.client.0.smithi089.stdout:9/938: readlink d3/dfe/l51 0 2024-09-13T02:54:11.142 INFO:tasks.workunit.client.0.smithi089.stdout:9/939: symlink d3/d6/d2a/d94/d24/d35/l133 0 2024-09-13T02:54:11.171 INFO:tasks.workunit.client.0.smithi089.stdout:2/975: dwrite d13/d30/d4e/d6f/f7d [0,4194304] 0 2024-09-13T02:54:11.171 INFO:tasks.workunit.client.0.smithi089.stdout:1/941: dwrite dc/d44/f125 [0,4194304] 0 2024-09-13T02:54:11.171 INFO:tasks.workunit.client.0.smithi089.stdout:2/976: readlink d13/l3d 0 2024-09-13T02:54:11.171 INFO:tasks.workunit.client.0.smithi089.stdout:2/977: write d13/d30/d4e/d6f/f136 [486027,125081] 0 2024-09-13T02:54:11.173 INFO:tasks.workunit.client.0.smithi089.stdout:9/940: dwrite d3/d6/d2a/d94/d24/f69 [0,4194304] 0 2024-09-13T02:54:11.173 INFO:tasks.workunit.client.0.smithi089.stdout:9/941: fsync d3/d6/d2a/d4b/d54/da1/ff4 0 2024-09-13T02:54:11.173 INFO:tasks.workunit.client.0.smithi089.stdout:1/942: creat dc/d44/d73/dc0/d102/d2c/d6f/dda/f127 x:0 0 0 2024-09-13T02:54:11.173 INFO:tasks.workunit.client.0.smithi089.stdout:1/943: dread - dc/d46/d6c/ff4 zero size 2024-09-13T02:54:11.174 INFO:tasks.workunit.client.0.smithi089.stdout:9/942: symlink d3/d6/d2a/d4b/d6d/dea/l134 0 2024-09-13T02:54:11.175 INFO:tasks.workunit.client.0.smithi089.stdout:9/943: fdatasync d3/dfe/f9b 0 2024-09-13T02:54:11.176 INFO:tasks.workunit.client.0.smithi089.stdout:9/944: creat d3/d6/d36/f135 x:0 0 0 2024-09-13T02:54:11.176 INFO:tasks.workunit.client.0.smithi089.stdout:9/945: creat d3/d6/d2a/d4b/d54/da1/d111/f136 x:0 0 0 2024-09-13T02:54:11.176 INFO:tasks.workunit.client.0.smithi089.stdout:9/946: fdatasync d3/d6/d2a/d94/f10f 0 2024-09-13T02:54:11.190 INFO:tasks.workunit.client.0.smithi089.stdout:2/978: dwrite d13/f27 [0,4194304] 0 2024-09-13T02:54:11.205 INFO:tasks.workunit.client.0.smithi089.stdout:1/944: dwrite dc/f91 [0,4194304] 0 2024-09-13T02:54:11.205 INFO:tasks.workunit.client.0.smithi089.stdout:9/947: dwrite d3/d15/d5a/fc7 [0,4194304] 0 2024-09-13T02:54:11.207 INFO:tasks.workunit.client.0.smithi089.stdout:1/945: symlink dc/d46/d6c/l128 0 2024-09-13T02:54:11.208 INFO:tasks.workunit.client.0.smithi089.stdout:1/946: stat dc/d44/d73/dc0/d102/d2c/d36/f40 0 2024-09-13T02:54:11.208 INFO:tasks.workunit.client.0.smithi089.stdout:1/947: chown dc/d44/d73/dc0/d102/d2c/d6f/feb 16 1 2024-09-13T02:54:11.214 INFO:tasks.workunit.client.0.smithi089.stdout:1/948: link dc/d44/d73/dc0/d102/l25 dc/d44/d73/d85/dd6/ddf/l129 0 2024-09-13T02:54:11.214 INFO:tasks.workunit.client.0.smithi089.stdout:1/949: creat dc/d44/d73/d85/dd6/ddf/f12a x:0 0 0 2024-09-13T02:54:11.215 INFO:tasks.workunit.client.0.smithi089.stdout:1/950: write f7 [2127589,103221] 0 2024-09-13T02:54:11.217 INFO:tasks.workunit.client.0.smithi089.stdout:1/951: rmdir dc/d6e/de0/d111 0 2024-09-13T02:54:11.217 INFO:tasks.workunit.client.0.smithi089.stdout:1/952: write dc/d3a/d93/fea [1549935,46129] 0 2024-09-13T02:54:11.222 INFO:tasks.workunit.client.0.smithi089.stdout:9/948: dwrite d3/d6/ffd [0,4194304] 0 2024-09-13T02:54:11.222 INFO:tasks.workunit.client.0.smithi089.stdout:9/949: read - d3/d3d/d8b/f10c zero size 2024-09-13T02:54:11.223 INFO:tasks.workunit.client.0.smithi089.stdout:1/953: fdatasync dc/d3a/d93/fea 0 2024-09-13T02:54:11.223 INFO:tasks.workunit.client.0.smithi089.stdout:1/954: dread dc/f122 [0,4194304] 0 2024-09-13T02:54:11.224 INFO:tasks.workunit.client.0.smithi089.stdout:1/955: creat dc/d44/d73/dc0/d102/d2c/d34/d9b/dd8/f12b x:0 0 0 2024-09-13T02:54:11.225 INFO:tasks.workunit.client.0.smithi089.stdout:1/956: truncate dc/d44/d73/d85/dd6/ddf/dfc/fc8 219684 0 2024-09-13T02:54:11.225 INFO:tasks.workunit.client.0.smithi089.stdout:1/957: chown dc 69148 1 2024-09-13T02:54:11.226 INFO:tasks.workunit.client.0.smithi089.stdout:1/958: link dc/d44/d73/dc0/d102/d2c/f2e dc/d6e/f12c 0 2024-09-13T02:54:11.226 INFO:tasks.workunit.client.0.smithi089.stdout:1/959: rmdir dc/d44/d73/dc0/d102/d2c/d34/d8b 39 2024-09-13T02:54:11.227 INFO:tasks.workunit.client.0.smithi089.stdout:1/960: getdents dc/d44/d73/dc0/d102/d2c/d94 0 2024-09-13T02:54:11.227 INFO:tasks.workunit.client.0.smithi089.stdout:1/961: stat dc/d44/d73/dc0/d102/d2c/d34/d9b/dd8/f12b 0 2024-09-13T02:54:11.227 INFO:tasks.workunit.client.0.smithi089.stdout:1/962: creat dc/d44/d73/d85/dd6/dd7/de1/f12d x:0 0 0 2024-09-13T02:54:11.228 INFO:tasks.workunit.client.0.smithi089.stdout:1/963: creat dc/d44/d73/d85/dd6/ddf/dfc/f12e x:0 0 0 2024-09-13T02:54:11.229 INFO:tasks.workunit.client.0.smithi089.stdout:1/964: creat dc/d44/d73/dc0/d102/d2c/d94/f12f x:0 0 0 2024-09-13T02:54:11.230 INFO:tasks.workunit.client.0.smithi089.stdout:1/965: write dc/d44/d73/dc0/d102/f4b [486031,22953] 0 2024-09-13T02:54:11.234 INFO:tasks.workunit.client.0.smithi089.stdout:9/950: dread d3/d6/d2a/d94/d24/d29/f88 [0,4194304] 0 2024-09-13T02:54:11.234 INFO:tasks.workunit.client.0.smithi089.stdout:9/951: fsync d3/d15/fb3 0 2024-09-13T02:54:11.234 INFO:tasks.workunit.client.0.smithi089.stdout:9/952: fdatasync d3/d6/d36/d9d/f109 0 2024-09-13T02:54:11.234 INFO:tasks.workunit.client.0.smithi089.stdout:9/953: rmdir d3/d3d/d8b/dba 39 2024-09-13T02:54:11.257 INFO:tasks.workunit.client.0.smithi089.stdout:9/954: dwrite d3/d6/d2a/d94/d24/d29/f88 [0,4194304] 0 2024-09-13T02:54:11.258 INFO:tasks.workunit.client.0.smithi089.stdout:1/966: dwrite dc/d44/d73/dc0/d102/d2c/d36/f51 [0,4194304] 0 2024-09-13T02:54:11.261 INFO:tasks.workunit.client.0.smithi089.stdout:1/967: unlink dc/d3a/d93/fbb 0 2024-09-13T02:54:11.261 INFO:tasks.workunit.client.0.smithi089.stdout:1/968: dread - dc/d3a/f120 zero size 2024-09-13T02:54:11.262 INFO:tasks.workunit.client.0.smithi089.stdout:1/969: truncate dc/f10 2160043 0 2024-09-13T02:54:11.265 INFO:tasks.workunit.client.0.smithi089.stdout:2/979: sync 2024-09-13T02:54:11.267 INFO:tasks.workunit.client.0.smithi089.stdout:2/980: mknod d13/d30/d61/d78/d79/ddd/c14f 0 2024-09-13T02:54:11.268 INFO:tasks.workunit.client.0.smithi089.stdout:2/981: mknod d13/d30/d4e/d7b/d86/da7/c150 0 2024-09-13T02:54:11.272 INFO:tasks.workunit.client.0.smithi089.stdout:1/970: write dc/d44/d73/f5b [64450,58302] 0 2024-09-13T02:54:11.272 INFO:tasks.workunit.client.0.smithi089.stdout:1/971: symlink dc/d46/d6c/l130 0 2024-09-13T02:54:11.279 INFO:tasks.workunit.client.0.smithi089.stdout:9/955: dwrite d3/fac [0,4194304] 0 2024-09-13T02:54:11.279 INFO:tasks.workunit.client.0.smithi089.stdout:9/956: creat d3/d6/d36/d9d/f137 x:0 0 0 2024-09-13T02:54:11.282 INFO:tasks.workunit.client.0.smithi089.stdout:9/957: creat d3/d6/f138 x:0 0 0 2024-09-13T02:54:11.284 INFO:tasks.workunit.client.0.smithi089.stdout:2/982: dread d13/d30/d4e/d6f/f119 [0,4194304] 0 2024-09-13T02:54:11.284 INFO:tasks.workunit.client.0.smithi089.stdout:2/983: read d13/d30/d4e/d6f/f84 [1496392,93088] 0 2024-09-13T02:54:11.293 INFO:tasks.workunit.client.0.smithi089.stdout:9/958: dread d3/d3d/f67 [0,4194304] 0 2024-09-13T02:54:11.305 INFO:tasks.workunit.client.0.smithi089.stdout:9/959: dread d3/d6/d2a/f78 [0,4194304] 0 2024-09-13T02:54:11.305 INFO:tasks.workunit.client.0.smithi089.stdout:2/984: dwrite d13/d30/d64/f6e [0,4194304] 0 2024-09-13T02:54:11.305 INFO:tasks.workunit.client.0.smithi089.stdout:9/960: creat d3/d6/d2a/d4b/d77/dfa/f139 x:0 0 0 2024-09-13T02:54:11.307 INFO:tasks.workunit.client.0.smithi089.stdout:9/961: mknod d3/d6/d2a/d4b/d54/da1/d111/c13a 0 2024-09-13T02:54:11.322 INFO:tasks.workunit.client.0.smithi089.stdout:2/985: dwrite d13/d30/fc8 [0,4194304] 0 2024-09-13T02:54:11.325 INFO:tasks.workunit.client.0.smithi089.stdout:9/962: dwrite d3/d6/d2a/d94/d56/fce [0,4194304] 0 2024-09-13T02:54:11.328 INFO:tasks.workunit.client.0.smithi089.stdout:9/963: creat d3/d6/d2a/d4b/d77/d127/f13b x:0 0 0 2024-09-13T02:54:11.330 INFO:tasks.workunit.client.0.smithi089.stdout:9/964: creat d3/dfe/f13c x:0 0 0 2024-09-13T02:54:11.330 INFO:tasks.workunit.client.0.smithi089.stdout:9/965: stat d3/d15/l20 0 2024-09-13T02:54:11.330 INFO:tasks.workunit.client.0.smithi089.stdout:9/966: truncate d3/d6/d2a/d94/d24/fca 648800 0 2024-09-13T02:54:11.330 INFO:tasks.workunit.client.0.smithi089.stdout:9/967: readlink d3/d6/d2a/l116 0 2024-09-13T02:54:11.330 INFO:tasks.workunit.client.0.smithi089.stdout:9/968: truncate d3/d6/d2a/d4b/d77/dfa/f11a 34540 0 2024-09-13T02:54:11.331 INFO:tasks.workunit.client.0.smithi089.stdout:9/969: mknod d3/d6/d36/d9d/db6/de9/c13d 0 2024-09-13T02:54:11.331 INFO:tasks.workunit.client.0.smithi089.stdout:9/970: chown d3/d3d/d8b/fdb 1590035294 1 2024-09-13T02:54:11.331 INFO:tasks.workunit.client.0.smithi089.stdout:9/971: mknod d3/df6/c13e 0 2024-09-13T02:54:11.333 INFO:tasks.workunit.client.0.smithi089.stdout:9/972: truncate d3/d6/d2a/d4b/f9c 1230923 0 2024-09-13T02:54:11.333 INFO:tasks.workunit.client.0.smithi089.stdout:9/973: creat d3/d3d/d8b/dba/f13f x:0 0 0 2024-09-13T02:54:11.337 INFO:tasks.workunit.client.0.smithi089.stdout:2/986: dwrite d13/f50 [4194304,4194304] 0 2024-09-13T02:54:11.337 INFO:tasks.workunit.client.0.smithi089.stdout:2/987: creat d13/d30/f151 x:0 0 0 2024-09-13T02:54:11.337 INFO:tasks.workunit.client.0.smithi089.stdout:2/988: dread - d13/d30/d4e/d6f/d76/dd6/f104 zero size 2024-09-13T02:54:11.337 INFO:tasks.workunit.client.0.smithi089.stdout:2/989: chown d13/d30/d61/d78/d79/f85 274965 1 2024-09-13T02:54:11.338 INFO:tasks.workunit.client.0.smithi089.stdout:2/990: chown d13/d30/d61/dca/l101 123621 1 2024-09-13T02:54:11.340 INFO:tasks.workunit.client.0.smithi089.stdout:2/991: mkdir d13/d30/d61/d78/d79/ddd/d152 0 2024-09-13T02:54:11.340 INFO:tasks.workunit.client.0.smithi089.stdout:2/992: chown f1 85 1 2024-09-13T02:54:11.340 INFO:tasks.workunit.client.0.smithi089.stdout:2/993: stat d13/d30/d61/d78/d79/d120/d132/d105/l129 0 2024-09-13T02:54:11.349 INFO:tasks.workunit.client.0.smithi089.stdout:2/994: dread d13/d30/d61/d78/d79/d90/fee [0,4194304] 0 2024-09-13T02:54:11.349 INFO:tasks.workunit.client.0.smithi089.stdout:2/995: fdatasync d13/d30/d4e/d6f/f8f 0 2024-09-13T02:54:11.350 INFO:tasks.workunit.client.0.smithi089.stdout:2/996: link d13/d30/d4e/d6f/d76/lc7 d13/d30/d61/d78/l153 0 2024-09-13T02:54:11.350 INFO:tasks.workunit.client.0.smithi089.stdout:2/997: dread - d13/d30/d4e/d6f/f113 zero size 2024-09-13T02:54:11.367 INFO:tasks.workunit.client.0.smithi089.stdout:2/998: dwrite d13/f72 [0,4194304] 0 2024-09-13T02:54:11.367 INFO:tasks.workunit.client.0.smithi089.stdout:2/999: stat d13/d30/d61/d78/f139 0 2024-09-13T02:54:11.380 INFO:tasks.workunit.client.0.smithi089.stdout:1/972: sync 2024-09-13T02:54:11.381 INFO:tasks.workunit.client.0.smithi089.stdout:1/973: symlink dc/d44/d73/dc0/d102/d2c/d36/d118/l131 0 2024-09-13T02:54:11.382 INFO:tasks.workunit.client.0.smithi089.stdout:1/974: mkdir dc/d44/d73/dc0/d102/d2c/d34/d132 0 2024-09-13T02:54:11.383 INFO:tasks.workunit.client.0.smithi089.stdout:1/975: link dc/d6e/fa2 dc/d44/d73/dc0/d102/d2c/d34/f133 0 2024-09-13T02:54:11.441 INFO:tasks.workunit.client.1.smithi131.stdout:0/544: sync 2024-09-13T02:54:11.441 INFO:tasks.workunit.client.1.smithi131.stdout:4/435: sync 2024-09-13T02:54:11.441 INFO:tasks.workunit.client.1.smithi131.stdout:8/361: sync 2024-09-13T02:54:11.441 INFO:tasks.workunit.client.1.smithi131.stdout:2/415: sync 2024-09-13T02:54:11.441 INFO:tasks.workunit.client.1.smithi131.stdout:9/347: sync 2024-09-13T02:54:11.441 INFO:tasks.workunit.client.1.smithi131.stdout:3/370: sync 2024-09-13T02:54:11.441 INFO:tasks.workunit.client.1.smithi131.stdout:7/383: sync 2024-09-13T02:54:11.441 INFO:tasks.workunit.client.1.smithi131.stdout:7/384: fsync f4 0 2024-09-13T02:54:11.441 INFO:tasks.workunit.client.1.smithi131.stdout:6/471: sync 2024-09-13T02:54:11.442 INFO:tasks.workunit.client.1.smithi131.stdout:5/332: sync 2024-09-13T02:54:11.442 INFO:tasks.workunit.client.1.smithi131.stdout:7/385: write d1b/d3b/d31/d5f/f79 [723149,38672] 0 2024-09-13T02:54:11.442 INFO:tasks.workunit.client.1.smithi131.stdout:1/386: sync 2024-09-13T02:54:11.442 INFO:tasks.workunit.client.1.smithi131.stdout:1/387: chown dd/d26/d44/f67 8 1 2024-09-13T02:54:11.442 INFO:tasks.workunit.client.1.smithi131.stdout:1/388: creat dd/d33/d80/f8c x:0 0 0 2024-09-13T02:54:11.442 INFO:tasks.workunit.client.1.smithi131.stdout:1/389: write dd/d33/d42/f48 [955896,42256] 0 2024-09-13T02:54:11.442 INFO:tasks.workunit.client.1.smithi131.stdout:0/545: mkdir d0/de/d1f/d22/d31/d39/d67/db5/dc9 0 2024-09-13T02:54:11.442 INFO:tasks.workunit.client.1.smithi131.stdout:4/436: mknod d1/d8/c90 0 2024-09-13T02:54:11.446 INFO:tasks.workunit.client.1.smithi131.stdout:8/362: creat db/d1d/d1f/d67/f6b x:0 0 0 2024-09-13T02:54:11.446 INFO:tasks.workunit.client.1.smithi131.stdout:2/416: symlink d5/d31/d1d/l8c 0 2024-09-13T02:54:11.446 INFO:tasks.workunit.client.1.smithi131.stdout:8/363: fsync db/d2e/f43 0 2024-09-13T02:54:11.446 INFO:tasks.workunit.client.1.smithi131.stdout:5/333: rename d1/f2c to d1/d21/f6d 0 2024-09-13T02:54:11.446 INFO:tasks.workunit.client.1.smithi131.stdout:3/371: truncate d2/d4/f23 735844 0 2024-09-13T02:54:11.447 INFO:tasks.workunit.client.1.smithi131.stdout:1/390: creat dd/d26/f8d x:0 0 0 2024-09-13T02:54:11.447 INFO:tasks.workunit.client.1.smithi131.stdout:1/391: readlink dd/d51/d5a/l66 0 2024-09-13T02:54:11.450 INFO:tasks.workunit.client.1.smithi131.stdout:6/472: rename d1/d8/d9/db/d2a to d1/d8/d9/db/d15/d26/d1c/d4e/d97 0 2024-09-13T02:54:11.451 INFO:tasks.workunit.client.1.smithi131.stdout:5/334: mknod d1/c6e 0 2024-09-13T02:54:11.452 INFO:tasks.workunit.client.1.smithi131.stdout:3/372: truncate d2/d4/d1a/f37 4183654 0 2024-09-13T02:54:11.452 INFO:tasks.workunit.client.1.smithi131.stdout:7/386: read d1b/d23/d54/f65 [650307,122137] 0 2024-09-13T02:54:11.453 INFO:tasks.workunit.client.1.smithi131.stdout:1/392: truncate f4 3333235 0 2024-09-13T02:54:11.453 INFO:tasks.workunit.client.1.smithi131.stdout:9/348: dread d0/d3/d14/d1a/f23 [4194304,4194304] 0 2024-09-13T02:54:11.456 INFO:tasks.workunit.client.1.smithi131.stdout:5/335: creat d1/d29/d39/f6f x:0 0 0 2024-09-13T02:54:11.456 INFO:tasks.workunit.client.1.smithi131.stdout:3/373: creat d2/dc/d39/d61/f87 x:0 0 0 2024-09-13T02:54:11.461 INFO:tasks.workunit.client.1.smithi131.stdout:7/387: rename d1b/l52 to d1b/d3b/d46/d4b/d57/d7b/l82 0 2024-09-13T02:54:11.461 INFO:tasks.workunit.client.1.smithi131.stdout:1/393: link dd/d26/d2a/d2c/l81 dd/d33/d42/d47/l8e 0 2024-09-13T02:54:11.461 INFO:tasks.workunit.client.1.smithi131.stdout:5/336: link d1/c18 d1/d29/d39/c70 0 2024-09-13T02:54:11.461 INFO:tasks.workunit.client.1.smithi131.stdout:7/388: getdents d1b/d3b/d51 0 2024-09-13T02:54:11.461 INFO:tasks.workunit.client.1.smithi131.stdout:7/389: chown d1b/d3b/d31/c3f 470331 1 2024-09-13T02:54:11.463 INFO:tasks.workunit.client.1.smithi131.stdout:6/473: dread d1/fe [0,4194304] 0 2024-09-13T02:54:11.463 INFO:tasks.workunit.client.1.smithi131.stdout:1/394: creat dd/d33/f8f x:0 0 0 2024-09-13T02:54:11.463 INFO:tasks.workunit.client.1.smithi131.stdout:1/395: write dd/d51/f70 [664962,14314] 0 2024-09-13T02:54:11.464 INFO:tasks.workunit.client.1.smithi131.stdout:5/337: mkdir d1/d2f/d71 0 2024-09-13T02:54:11.464 INFO:tasks.workunit.client.1.smithi131.stdout:9/349: dread d0/f33 [0,4194304] 0 2024-09-13T02:54:11.465 INFO:tasks.workunit.client.1.smithi131.stdout:9/350: getdents d0/d3/d14/d1a/d2a/d5e 0 2024-09-13T02:54:11.467 INFO:tasks.workunit.client.1.smithi131.stdout:6/474: truncate d1/d8/d9/db/f36 160904 0 2024-09-13T02:54:11.468 INFO:tasks.workunit.client.1.smithi131.stdout:6/475: rename d1/d8/d9/fd to d1/d8/d9/db/d15/d26/d1c/d4e/d97/d3b/f98 0 2024-09-13T02:54:11.469 INFO:tasks.workunit.client.1.smithi131.stdout:6/476: creat d1/d8/d9/db/d15/d26/d1c/d4e/f99 x:0 0 0 2024-09-13T02:54:11.470 INFO:tasks.workunit.client.1.smithi131.stdout:6/477: dread - d1/f6e zero size 2024-09-13T02:54:11.474 INFO:tasks.workunit.client.1.smithi131.stdout:1/396: write dd/d26/d44/f23 [3478613,26257] 0 2024-09-13T02:54:11.474 INFO:tasks.workunit.client.1.smithi131.stdout:1/397: chown dd/d26/d2a/d2c/c38 1582907630 1 2024-09-13T02:54:11.474 INFO:tasks.workunit.client.1.smithi131.stdout:1/398: rename dd to dd/d26/d7d/d90 22 2024-09-13T02:54:11.477 INFO:tasks.workunit.client.1.smithi131.stdout:1/399: mkdir dd/d26/d2a/d2c/d91 0 2024-09-13T02:54:11.482 INFO:tasks.workunit.client.1.smithi131.stdout:7/390: dread d1b/d23/f2d [0,4194304] 0 2024-09-13T02:54:11.482 INFO:tasks.workunit.client.1.smithi131.stdout:7/391: fdatasync d1b/d3b/f3e 0 2024-09-13T02:54:11.482 INFO:tasks.workunit.client.1.smithi131.stdout:7/392: write d1b/d3b/d41/f59 [1056789,106945] 0 2024-09-13T02:54:11.483 INFO:tasks.workunit.client.1.smithi131.stdout:7/393: write d1b/d3b/f55 [527644,127297] 0 2024-09-13T02:54:11.483 INFO:tasks.workunit.client.1.smithi131.stdout:7/394: chown d1b/d73/c67 5747674 1 2024-09-13T02:54:11.485 INFO:tasks.workunit.client.1.smithi131.stdout:7/395: rename d1b/d73/c72 to d1b/d3b/d31/d7c/c83 0 2024-09-13T02:54:11.487 INFO:tasks.workunit.client.1.smithi131.stdout:7/396: rename d1b/d3b/d41/c5a to d1b/d3b/d46/c84 0 2024-09-13T02:54:11.487 INFO:tasks.workunit.client.1.smithi131.stdout:7/397: fsync d1b/d23/f33 0 2024-09-13T02:54:11.488 INFO:tasks.workunit.client.1.smithi131.stdout:5/338: dread d1/d5/fa [0,4194304] 0 2024-09-13T02:54:11.489 INFO:tasks.workunit.client.1.smithi131.stdout:7/398: link d1b/f21 d1b/d73/f85 0 2024-09-13T02:54:11.489 INFO:tasks.workunit.client.1.smithi131.stdout:7/399: stat f4 0 2024-09-13T02:54:11.490 INFO:tasks.workunit.client.1.smithi131.stdout:5/339: truncate d1/d1c/f3b 1108703 0 2024-09-13T02:54:11.491 INFO:tasks.workunit.client.1.smithi131.stdout:6/478: dread d1/d8/f38 [0,4194304] 0 2024-09-13T02:54:11.492 INFO:tasks.workunit.client.1.smithi131.stdout:5/340: rename d1/d5/f13 to d1/d29/d39/f72 0 2024-09-13T02:54:11.492 INFO:tasks.workunit.client.1.smithi131.stdout:8/364: dwrite db/d1d/d1f/d41/f55 [4194304,4194304] 0 2024-09-13T02:54:11.493 INFO:tasks.workunit.client.1.smithi131.stdout:5/341: read d1/d2f/f69 [382363,66061] 0 2024-09-13T02:54:11.493 INFO:tasks.workunit.client.1.smithi131.stdout:8/365: getdents db/d2e 0 2024-09-13T02:54:11.494 INFO:tasks.workunit.client.1.smithi131.stdout:5/342: dread - d1/d29/d39/d45/f6c zero size 2024-09-13T02:54:11.494 INFO:tasks.workunit.client.1.smithi131.stdout:8/366: fdatasync db/f19 0 2024-09-13T02:54:11.494 INFO:tasks.workunit.client.1.smithi131.stdout:8/367: truncate db/d1d/d1f/d5c/f64 971855 0 2024-09-13T02:54:11.495 INFO:tasks.workunit.client.1.smithi131.stdout:1/400: write dd/f15 [822141,123003] 0 2024-09-13T02:54:11.497 INFO:tasks.workunit.client.1.smithi131.stdout:1/401: rename dd/l24 to dd/d26/d7d/l92 0 2024-09-13T02:54:11.497 INFO:tasks.workunit.client.1.smithi131.stdout:1/402: dread - dd/d33/d80/f8b zero size 2024-09-13T02:54:11.497 INFO:tasks.workunit.client.1.smithi131.stdout:0/546: dwrite d0/de/d1f/d22/d31/d39/f74 [0,4194304] 0 2024-09-13T02:54:11.498 INFO:tasks.workunit.client.1.smithi131.stdout:0/547: chown d0/c34 2469 1 2024-09-13T02:54:11.498 INFO:tasks.workunit.client.1.smithi131.stdout:3/374: dwrite d2/d4/d1a/f7b [0,4194304] 0 2024-09-13T02:54:11.499 INFO:tasks.workunit.client.1.smithi131.stdout:3/375: readlink d2/dc/l11 0 2024-09-13T02:54:11.499 INFO:tasks.workunit.client.1.smithi131.stdout:3/376: chown d2/d4/d1a/f1e 598 1 2024-09-13T02:54:11.499 INFO:tasks.workunit.client.1.smithi131.stdout:1/403: rename dd/ff to dd/d51/d8a/f93 0 2024-09-13T02:54:11.499 INFO:tasks.workunit.client.1.smithi131.stdout:1/404: chown dd/d26/d7d/l92 269901020 1 2024-09-13T02:54:11.499 INFO:tasks.workunit.client.1.smithi131.stdout:0/548: creat d0/d2/d62/fca x:0 0 0 2024-09-13T02:54:11.500 INFO:tasks.workunit.client.0.smithi089.stdout:9/974: sync 2024-09-13T02:54:11.501 INFO:tasks.workunit.client.0.smithi089.stdout:9/975: write d3/d6/d2a/d94/da7/f101 [235586,100113] 0 2024-09-13T02:54:11.501 INFO:tasks.workunit.client.0.smithi089.stdout:9/976: chown d3/d6/d2a/d4b/l71 54 1 2024-09-13T02:54:11.501 INFO:tasks.workunit.client.0.smithi089.stdout:9/977: dread - d3/d6/d2a/d94/da7/f11e zero size 2024-09-13T02:54:11.501 INFO:tasks.workunit.client.0.smithi089.stdout:1/976: sync 2024-09-13T02:54:11.501 INFO:tasks.workunit.client.0.smithi089.stdout:1/977: chown dc/d46/f6b 46 1 2024-09-13T02:54:11.501 INFO:tasks.workunit.client.1.smithi131.stdout:3/377: truncate d2/d4/d2d/f33 759794 0 2024-09-13T02:54:11.502 INFO:tasks.workunit.client.1.smithi131.stdout:3/378: write d2/dc/d39/d61/f87 [885104,115525] 0 2024-09-13T02:54:11.502 INFO:tasks.workunit.client.0.smithi089.stdout:9/978: symlink d3/d15/d5a/l140 0 2024-09-13T02:54:11.502 INFO:tasks.workunit.client.0.smithi089.stdout:1/978: symlink dc/d44/d73/dc0/l134 0 2024-09-13T02:54:11.503 INFO:tasks.workunit.client.1.smithi131.stdout:1/405: rename dd/d26/d2a/d2c/d91 to dd/d33/d94 0 2024-09-13T02:54:11.504 INFO:tasks.workunit.client.1.smithi131.stdout:0/549: mknod d0/de/d45/d5a/ccb 0 2024-09-13T02:54:11.504 INFO:tasks.workunit.client.1.smithi131.stdout:0/550: chown d0/de/d1f/d22/f53 332 1 2024-09-13T02:54:11.504 INFO:tasks.workunit.client.1.smithi131.stdout:0/551: write d0/fc6 [5479259,60825] 0 2024-09-13T02:54:11.504 INFO:tasks.workunit.client.1.smithi131.stdout:0/552: fsync d0/d2/d41/f79 0 2024-09-13T02:54:11.504 INFO:tasks.workunit.client.1.smithi131.stdout:0/553: readlink d0/d2/l15 0 2024-09-13T02:54:11.506 INFO:tasks.workunit.client.1.smithi131.stdout:6/479: dread d1/d8/f62 [0,4194304] 0 2024-09-13T02:54:11.506 INFO:tasks.workunit.client.1.smithi131.stdout:2/417: dwrite d5/fa [0,4194304] 0 2024-09-13T02:54:11.506 INFO:tasks.workunit.client.1.smithi131.stdout:6/480: chown d1/d8/d9/db/d15/f3d 1 1 2024-09-13T02:54:11.506 INFO:tasks.workunit.client.1.smithi131.stdout:6/481: chown d1/d8/d9/db/d15/d26/d1c/d4e/d97/f6b 30286446 1 2024-09-13T02:54:11.507 INFO:tasks.workunit.client.0.smithi089.stdout:1/979: read dc/fe [53925,81307] 0 2024-09-13T02:54:11.507 INFO:tasks.workunit.client.0.smithi089.stdout:1/980: dread - dc/d3a/f120 zero size 2024-09-13T02:54:11.508 INFO:tasks.workunit.client.1.smithi131.stdout:4/437: dwrite d1/d18/f75 [0,4194304] 0 2024-09-13T02:54:11.508 INFO:tasks.workunit.client.1.smithi131.stdout:8/368: write db/d2b/d39/d56/f60 [690133,75414] 0 2024-09-13T02:54:11.509 INFO:tasks.workunit.client.1.smithi131.stdout:9/351: dwrite d0/d3/d14/d17/d32/d39/f4a [4194304,4194304] 0 2024-09-13T02:54:11.509 INFO:tasks.workunit.client.1.smithi131.stdout:6/482: symlink d1/d8/d9/l9a 0 2024-09-13T02:54:11.509 INFO:tasks.workunit.client.0.smithi089.stdout:1/981: creat dc/d46/f135 x:0 0 0 2024-09-13T02:54:11.509 INFO:tasks.workunit.client.0.smithi089.stdout:1/982: write dc/d44/d73/dc0/d102/d2c/d34/f67 [4696465,115938] 0 2024-09-13T02:54:11.511 INFO:tasks.workunit.client.0.smithi089.stdout:1/983: mknod dc/d44/d73/dc0/d102/d2c/d34/d8b/c136 0 2024-09-13T02:54:11.515 INFO:tasks.workunit.client.1.smithi131.stdout:8/369: mkdir db/d1d/d1f/d5c/d6c 0 2024-09-13T02:54:11.515 INFO:tasks.workunit.client.1.smithi131.stdout:4/438: symlink d1/d18/d81/l91 0 2024-09-13T02:54:11.517 INFO:tasks.workunit.client.1.smithi131.stdout:1/406: write dd/d26/d44/f25 [2534246,11300] 0 2024-09-13T02:54:11.517 INFO:tasks.workunit.client.1.smithi131.stdout:2/418: read d5/d31/d21/f24 [4194199,43140] 0 2024-09-13T02:54:11.518 INFO:tasks.workunit.client.1.smithi131.stdout:2/419: fsync d5/f9 0 2024-09-13T02:54:11.525 INFO:tasks.workunit.client.1.smithi131.stdout:7/400: dwrite d1b/d3b/d46/d4b/d57/d7b/f53 [0,4194304] 0 2024-09-13T02:54:11.526 INFO:tasks.workunit.client.1.smithi131.stdout:9/352: rename d0/d3/d14/d1a/d2a/l2c to d0/d3/d14/d17/l6b 0 2024-09-13T02:54:11.526 INFO:tasks.workunit.client.1.smithi131.stdout:9/353: chown d0/d3/c4c 498 1 2024-09-13T02:54:11.526 INFO:tasks.workunit.client.1.smithi131.stdout:6/483: creat d1/d8/d9/d4b/f9b x:0 0 0 2024-09-13T02:54:11.526 INFO:tasks.workunit.client.1.smithi131.stdout:9/354: chown d0/d4d/c52 873694565 1 2024-09-13T02:54:11.528 INFO:tasks.workunit.client.1.smithi131.stdout:1/407: mkdir dd/d51/d8a/d95 0 2024-09-13T02:54:11.531 INFO:tasks.workunit.client.1.smithi131.stdout:4/439: write d1/dc/d22/d49/f4d [3190146,31884] 0 2024-09-13T02:54:11.531 INFO:tasks.workunit.client.1.smithi131.stdout:6/484: creat d1/d8/d9/db/d15/d26/d1c/d79/d92/f9c x:0 0 0 2024-09-13T02:54:11.532 INFO:tasks.workunit.client.1.smithi131.stdout:9/355: mknod d0/d3f/c6c 0 2024-09-13T02:54:11.534 INFO:tasks.workunit.client.1.smithi131.stdout:7/401: rename d1b/d73/l78 to d1b/d3b/d46/d4b/d57/l86 0 2024-09-13T02:54:11.540 INFO:tasks.workunit.client.0.smithi089.stdout:9/979: dwrite d3/d6/d2a/d4b/d77/fcc [0,4194304] 0 2024-09-13T02:54:11.542 INFO:tasks.workunit.client.1.smithi131.stdout:4/440: link d1/dc/d19/d29/d33/f37 d1/d18/d43/d7d/f92 0 2024-09-13T02:54:11.542 INFO:tasks.workunit.client.1.smithi131.stdout:4/441: fsync d1/d8/f68 0 2024-09-13T02:54:11.543 INFO:tasks.workunit.client.1.smithi131.stdout:9/356: creat d0/d4d/f6d x:0 0 0 2024-09-13T02:54:11.544 INFO:tasks.workunit.client.1.smithi131.stdout:3/379: dread d2/d4/f23 [0,4194304] 0 2024-09-13T02:54:11.547 INFO:tasks.workunit.client.1.smithi131.stdout:6/485: rename d1/d8/d9/db/d15/d26/d1c/d79/f8c to d1/d8/d9/db/d40/f9d 0 2024-09-13T02:54:11.548 INFO:tasks.workunit.client.1.smithi131.stdout:7/402: truncate d1b/d73/f85 2618496 0 2024-09-13T02:54:11.549 INFO:tasks.workunit.client.0.smithi089.stdout:9/980: rmdir d3/d6 39 2024-09-13T02:54:11.551 INFO:tasks.workunit.client.1.smithi131.stdout:0/554: dwrite d0/de/d1f/d22/fb2 [0,4194304] 0 2024-09-13T02:54:11.551 INFO:tasks.workunit.client.0.smithi089.stdout:9/981: mkdir d3/d6/d2a/d4b/d77/dfa/d11c/d141 0 2024-09-13T02:54:11.551 INFO:tasks.workunit.client.0.smithi089.stdout:1/984: dwrite dc/d44/d73/dc0/d102/d2c/d36/f40 [0,4194304] 0 2024-09-13T02:54:11.553 INFO:tasks.workunit.client.1.smithi131.stdout:8/370: dwrite db/d2e/f43 [0,4194304] 0 2024-09-13T02:54:11.554 INFO:tasks.workunit.client.0.smithi089.stdout:9/982: dread d3/d6/f65 [0,4194304] 0 2024-09-13T02:54:11.556 INFO:tasks.workunit.client.0.smithi089.stdout:1/985: dread dc/d44/d73/d85/dd6/ddf/dfc/fc8 [0,4194304] 0 2024-09-13T02:54:11.556 INFO:tasks.workunit.client.0.smithi089.stdout:9/983: rmdir d3/d6/d2a/d94/d24/d29 39 2024-09-13T02:54:11.558 INFO:tasks.workunit.client.0.smithi089.stdout:9/984: link d3/d6/d2a/d4b/fa6 d3/dfe/f142 0 2024-09-13T02:54:11.559 INFO:tasks.workunit.client.0.smithi089.stdout:1/986: dread dc/d44/d73/dc0/d102/d2c/d34/d9b/fb4 [0,4194304] 0 2024-09-13T02:54:11.560 INFO:tasks.workunit.client.0.smithi089.stdout:9/985: rename d3/d6/d2a/d4b/d54/fb4 to d3/d3d/d8b/dba/f143 0 2024-09-13T02:54:11.562 INFO:tasks.workunit.client.1.smithi131.stdout:9/357: mkdir d0/d3/d14/d67/d6e 0 2024-09-13T02:54:11.562 INFO:tasks.workunit.client.1.smithi131.stdout:4/442: dwrite d1/f5 [4194304,4194304] 0 2024-09-13T02:54:11.562 INFO:tasks.workunit.client.0.smithi089.stdout:1/987: creat dc/d44/d73/dc0/d102/d2c/f137 x:0 0 0 2024-09-13T02:54:11.564 INFO:tasks.workunit.client.0.smithi089.stdout:9/986: rename d3/d6/d2a/d94/l53 to d3/d6/d2a/d94/l144 0 2024-09-13T02:54:11.564 INFO:tasks.workunit.client.1.smithi131.stdout:3/380: unlink d2/d4/d7/d1d/d24/d7e/f85 0 2024-09-13T02:54:11.565 INFO:tasks.workunit.client.1.smithi131.stdout:1/408: dwrite dd/d33/f8f [0,4194304] 0 2024-09-13T02:54:11.565 INFO:tasks.workunit.client.1.smithi131.stdout:1/409: truncate dd/d26/f87 428959 0 2024-09-13T02:54:11.566 INFO:tasks.workunit.client.1.smithi131.stdout:0/555: write d0/de/f4f [668835,124592] 0 2024-09-13T02:54:11.567 INFO:tasks.workunit.client.1.smithi131.stdout:8/371: write db/f23 [4829744,89256] 0 2024-09-13T02:54:11.568 INFO:tasks.workunit.client.1.smithi131.stdout:7/403: symlink d1b/d3b/d46/l87 0 2024-09-13T02:54:11.568 INFO:tasks.workunit.client.1.smithi131.stdout:7/404: stat d1b/d3b/l35 0 2024-09-13T02:54:11.568 INFO:tasks.workunit.client.1.smithi131.stdout:7/405: stat d1b/d3b/d41/d81 0 2024-09-13T02:54:11.570 INFO:tasks.workunit.client.1.smithi131.stdout:9/358: creat d0/d3/d14/f6f x:0 0 0 2024-09-13T02:54:11.576 INFO:tasks.workunit.client.0.smithi089.stdout:1/988: dread dc/d46/d6c/d98/fe2 [0,4194304] 0 2024-09-13T02:54:11.576 INFO:tasks.workunit.client.1.smithi131.stdout:1/410: mknod dd/d51/d5a/c96 0 2024-09-13T02:54:11.577 INFO:tasks.workunit.client.0.smithi089.stdout:1/989: rmdir dc/d44/d73/dc0/d102/d2c/d34 39 2024-09-13T02:54:11.579 INFO:tasks.workunit.client.1.smithi131.stdout:4/443: read d1/dc/d19/d29/f4a [1920901,92116] 0 2024-09-13T02:54:11.580 INFO:tasks.workunit.client.1.smithi131.stdout:7/406: creat d1b/f88 x:0 0 0 2024-09-13T02:54:11.580 INFO:tasks.workunit.client.1.smithi131.stdout:4/444: write d1/dc/d22/d49/f54 [111557,61385] 0 2024-09-13T02:54:11.581 INFO:tasks.workunit.client.1.smithi131.stdout:9/359: truncate d0/d3/d14/d17/d32/d39/f50 812874 0 2024-09-13T02:54:11.583 INFO:tasks.workunit.client.1.smithi131.stdout:1/411: rename dd/d33/d42/f5d to dd/d33/d94/f97 0 2024-09-13T02:54:11.584 INFO:tasks.workunit.client.1.smithi131.stdout:0/556: getdents d0/de/d1f/d22/d3d/d87 0 2024-09-13T02:54:11.584 INFO:tasks.workunit.client.1.smithi131.stdout:0/557: fdatasync d0/de/d1f/d22/d3d/d43/f5f 0 2024-09-13T02:54:11.585 INFO:tasks.workunit.client.1.smithi131.stdout:7/407: mkdir d1b/d23/d89 0 2024-09-13T02:54:11.586 INFO:tasks.workunit.client.1.smithi131.stdout:6/486: dwrite d1/d8/d9/db/d15/f3d [4194304,4194304] 0 2024-09-13T02:54:11.586 INFO:tasks.workunit.client.1.smithi131.stdout:6/487: dread - d1/f6e zero size 2024-09-13T02:54:11.586 INFO:tasks.workunit.client.1.smithi131.stdout:8/372: dread f2 [4194304,4194304] 0 2024-09-13T02:54:11.586 INFO:tasks.workunit.client.1.smithi131.stdout:8/373: write db/d1d/d1f/d41/f55 [1856758,53381] 0 2024-09-13T02:54:11.588 INFO:tasks.workunit.client.1.smithi131.stdout:9/360: rename d0/d3/d14/d67/d6e to d0/d3/d14/d3c/d70 0 2024-09-13T02:54:11.589 INFO:tasks.workunit.client.1.smithi131.stdout:0/558: mknod d0/de/d1f/d22/d3d/ccc 0 2024-09-13T02:54:11.591 INFO:tasks.workunit.client.1.smithi131.stdout:7/408: unlink d1b/c45 0 2024-09-13T02:54:11.592 INFO:tasks.workunit.client.1.smithi131.stdout:8/374: creat db/d2b/f6d x:0 0 0 2024-09-13T02:54:11.592 INFO:tasks.workunit.client.1.smithi131.stdout:5/343: dwrite d1/d1c/f3b [0,4194304] 0 2024-09-13T02:54:11.593 INFO:tasks.workunit.client.0.smithi089.stdout:9/987: dwrite d3/d6/d36/d9d/db6/de9/fff [4194304,4194304] 0 2024-09-13T02:54:11.595 INFO:tasks.workunit.client.1.smithi131.stdout:4/445: write d1/d8/f15 [4154673,78743] 0 2024-09-13T02:54:11.596 INFO:tasks.workunit.client.1.smithi131.stdout:4/446: truncate d1/d18/f5c 1030165 0 2024-09-13T02:54:11.596 INFO:tasks.workunit.client.1.smithi131.stdout:3/381: dwrite d2/d4/d1a/f66 [0,4194304] 0 2024-09-13T02:54:11.604 INFO:tasks.workunit.client.0.smithi089.stdout:9/988: dread d3/d6/d2a/d94/f38 [0,4194304] 0 2024-09-13T02:54:11.604 INFO:tasks.workunit.client.0.smithi089.stdout:9/989: readlink d3/lb 0 2024-09-13T02:54:11.605 INFO:tasks.workunit.client.1.smithi131.stdout:9/361: rmdir d0 39 2024-09-13T02:54:11.605 INFO:tasks.workunit.client.0.smithi089.stdout:9/990: mkdir d3/dcf/d145 0 2024-09-13T02:54:11.607 INFO:tasks.workunit.client.1.smithi131.stdout:6/488: rename d1/d8/d9/db/l1f to d1/d8/d9/l9e 0 2024-09-13T02:54:11.607 INFO:tasks.workunit.client.1.smithi131.stdout:6/489: truncate d1/d8/d9/db/d15/d26/d1c/d4e/f81 457387 0 2024-09-13T02:54:11.608 INFO:tasks.workunit.client.0.smithi089.stdout:9/991: dread d3/d6/d2a/d4b/d54/f98 [0,4194304] 0 2024-09-13T02:54:11.608 INFO:tasks.workunit.client.1.smithi131.stdout:0/559: truncate d0/de/d45/d86/f8a 1082934 0 2024-09-13T02:54:11.610 INFO:tasks.workunit.client.1.smithi131.stdout:7/409: creat d1b/d3b/d46/d4b/d57/f8a x:0 0 0 2024-09-13T02:54:11.612 INFO:tasks.workunit.client.0.smithi089.stdout:9/992: rename d3/f5 to d3/dcf/f146 0 2024-09-13T02:54:11.612 INFO:tasks.workunit.client.0.smithi089.stdout:9/993: truncate d3/d6/d2a/d94/d24/d35/fc8 1998540 0 2024-09-13T02:54:11.612 INFO:tasks.workunit.client.0.smithi089.stdout:9/994: chown d3/d6/d2a/d4b/l71 3086 1 2024-09-13T02:54:11.612 INFO:tasks.workunit.client.1.smithi131.stdout:8/375: mknod db/d2e/c6e 0 2024-09-13T02:54:11.612 INFO:tasks.workunit.client.1.smithi131.stdout:5/344: mknod d1/d2f/d71/c73 0 2024-09-13T02:54:11.617 INFO:tasks.workunit.client.1.smithi131.stdout:6/490: creat d1/d14/f9f x:0 0 0 2024-09-13T02:54:11.617 INFO:tasks.workunit.client.1.smithi131.stdout:3/382: write d2/d4/d1a/f7b [1964043,40819] 0 2024-09-13T02:54:11.619 INFO:tasks.workunit.client.1.smithi131.stdout:0/560: creat d0/de/d1f/d22/d31/d39/da8/fcd x:0 0 0 2024-09-13T02:54:11.619 INFO:tasks.workunit.client.1.smithi131.stdout:0/561: dread - d0/de/d1f/d22/d31/d39/fad zero size 2024-09-13T02:54:11.620 INFO:tasks.workunit.client.1.smithi131.stdout:7/410: mkdir d1b/d3b/d51/d8b 0 2024-09-13T02:54:11.622 INFO:tasks.workunit.client.1.smithi131.stdout:8/376: link db/d2e/d40/f53 db/d2b/f6f 0 2024-09-13T02:54:11.622 INFO:tasks.workunit.client.1.smithi131.stdout:6/491: truncate d1/d8/d9/db/d15/d26/d1c/d4e/d97/d3b/f48 4455355 0 2024-09-13T02:54:11.623 INFO:tasks.workunit.client.1.smithi131.stdout:6/492: stat d1/d8/f2c 0 2024-09-13T02:54:11.623 INFO:tasks.workunit.client.1.smithi131.stdout:6/493: stat d1/d8/c96 0 2024-09-13T02:54:11.624 INFO:tasks.workunit.client.0.smithi089.stdout:1/990: dwrite dc/d44/d73/dc0/d102/d2c/d34/d8b/db5/f11b [0,4194304] 0 2024-09-13T02:54:11.624 INFO:tasks.workunit.client.0.smithi089.stdout:1/991: chown dc/d44/d73/d85/dd6/ddf/l11e 25600759 1 2024-09-13T02:54:11.624 INFO:tasks.workunit.client.0.smithi089.stdout:1/992: creat dc/d44/d73/d85/dd6/ddf/f138 x:0 0 0 2024-09-13T02:54:11.626 INFO:tasks.workunit.client.1.smithi131.stdout:3/383: link d2/d4/d7/d1d/f21 d2/d4/d7/d1d/d24/d6f/d7f/f88 0 2024-09-13T02:54:11.626 INFO:tasks.workunit.client.1.smithi131.stdout:3/384: dread - d2/dc/d39/d61/f6c zero size 2024-09-13T02:54:11.626 INFO:tasks.workunit.client.1.smithi131.stdout:3/385: fdatasync d2/d4/d7/d1d/d24/d6f/f7c 0 2024-09-13T02:54:11.626 INFO:tasks.workunit.client.1.smithi131.stdout:3/386: stat d2/d4/d1a/l29 0 2024-09-13T02:54:11.626 INFO:tasks.workunit.client.1.smithi131.stdout:0/562: getdents d0 0 2024-09-13T02:54:11.627 INFO:tasks.workunit.client.1.smithi131.stdout:7/411: mkdir d1b/d3b/d46/d4b/d57/d8c 0 2024-09-13T02:54:11.628 INFO:tasks.workunit.client.0.smithi089.stdout:1/993: unlink dc/d44/d73/cff 0 2024-09-13T02:54:11.629 INFO:tasks.workunit.client.1.smithi131.stdout:8/377: creat db/d1d/d34/f70 x:0 0 0 2024-09-13T02:54:11.633 INFO:tasks.workunit.client.1.smithi131.stdout:3/387: rename d2/d4/f9 to d2/d4/d7/d1d/d24/d6f/f89 0 2024-09-13T02:54:11.634 INFO:tasks.workunit.client.1.smithi131.stdout:3/388: readlink d2/d4/l82 0 2024-09-13T02:54:11.634 INFO:tasks.workunit.client.1.smithi131.stdout:3/389: fsync d2/d4/d7/d8/d41/d5c/f35 0 2024-09-13T02:54:11.634 INFO:tasks.workunit.client.1.smithi131.stdout:0/563: creat d0/d2/fce x:0 0 0 2024-09-13T02:54:11.636 INFO:tasks.workunit.client.1.smithi131.stdout:7/412: link d1b/d3b/d31/d5f/l7f d1b/d23/l8d 0 2024-09-13T02:54:11.638 INFO:tasks.workunit.client.1.smithi131.stdout:3/390: rmdir d2/d4 39 2024-09-13T02:54:11.640 INFO:tasks.workunit.client.1.smithi131.stdout:0/564: mknod d0/de/d1f/d22/d3d/d55/d63/d95/ccf 0 2024-09-13T02:54:11.640 INFO:tasks.workunit.client.1.smithi131.stdout:0/565: chown d0/de/c91 115 1 2024-09-13T02:54:11.640 INFO:tasks.workunit.client.1.smithi131.stdout:0/566: fsync d0/de/d1f/f33 0 2024-09-13T02:54:11.641 INFO:tasks.workunit.client.1.smithi131.stdout:3/391: symlink d2/d4/d1a/d31/d48/l8a 0 2024-09-13T02:54:11.641 INFO:tasks.workunit.client.1.smithi131.stdout:3/392: truncate d2/d4/d7/d8/d41/d5c/f35 543130 0 2024-09-13T02:54:11.641 INFO:tasks.workunit.client.1.smithi131.stdout:3/393: write d2/d4/d7/d8/d41/d5c/d49/f4a [1999942,7213] 0 2024-09-13T02:54:11.642 INFO:tasks.workunit.client.0.smithi089.stdout:1/994: write dc/d44/d73/dc0/d102/d2c/d36/f38 [2319416,77326] 0 2024-09-13T02:54:11.642 INFO:tasks.workunit.client.1.smithi131.stdout:7/413: rmdir d1b/d23/d54 39 2024-09-13T02:54:11.644 INFO:tasks.workunit.client.1.smithi131.stdout:8/378: read db/d2b/f6f [420322,21272] 0 2024-09-13T02:54:11.645 INFO:tasks.workunit.client.0.smithi089.stdout:1/995: write dc/d46/d6c/d98/fe2 [1687140,71269] 0 2024-09-13T02:54:11.645 INFO:tasks.workunit.client.0.smithi089.stdout:1/996: chown dc/d3a/d93/fea 9 1 2024-09-13T02:54:11.646 INFO:tasks.workunit.client.0.smithi089.stdout:9/995: dwrite d3/d6/d2a/d94/f6e [0,4194304] 0 2024-09-13T02:54:11.646 INFO:tasks.workunit.client.0.smithi089.stdout:9/996: stat d3/d6/d2a/d4b/d6d/f112 0 2024-09-13T02:54:11.646 INFO:tasks.workunit.client.1.smithi131.stdout:4/447: dwrite d1/dc/d22/d73/f87 [0,4194304] 0 2024-09-13T02:54:11.647 INFO:tasks.workunit.client.1.smithi131.stdout:4/448: fsync d1/d18/f55 0 2024-09-13T02:54:11.647 INFO:tasks.workunit.client.1.smithi131.stdout:7/414: dread d1b/d3b/f5b [0,4194304] 0 2024-09-13T02:54:11.647 INFO:tasks.workunit.client.1.smithi131.stdout:7/415: fdatasync d1b/d3b/d31/d38/f50 0 2024-09-13T02:54:11.647 INFO:tasks.workunit.client.1.smithi131.stdout:1/412: dwrite fc [0,4194304] 0 2024-09-13T02:54:11.647 INFO:tasks.workunit.client.0.smithi089.stdout:1/997: symlink dc/d44/d73/dc0/d102/dba/l139 0 2024-09-13T02:54:11.648 INFO:tasks.workunit.client.0.smithi089.stdout:9/997: creat d3/d6/d2a/d4b/d6d/dea/f147 x:0 0 0 2024-09-13T02:54:11.649 INFO:tasks.workunit.client.0.smithi089.stdout:9/998: creat d3/d3d/d8b/dba/dd0/f148 x:0 0 0 2024-09-13T02:54:11.651 INFO:tasks.workunit.client.0.smithi089.stdout:9/999: link d3/d6/d2a/d4b/d54/fd1 d3/d6/d36/f149 0 2024-09-13T02:54:11.652 INFO:tasks.workunit.client.1.smithi131.stdout:0/567: dread d0/f90 [0,4194304] 0 2024-09-13T02:54:11.657 INFO:tasks.workunit.client.1.smithi131.stdout:5/345: dwrite d1/d29/d39/d45/f5c [0,4194304] 0 2024-09-13T02:54:11.657 INFO:tasks.workunit.client.1.smithi131.stdout:9/362: dwrite d0/f11 [0,4194304] 0 2024-09-13T02:54:11.658 INFO:tasks.workunit.client.1.smithi131.stdout:5/346: mkdir d1/d21/d74 0 2024-09-13T02:54:11.659 INFO:tasks.workunit.client.1.smithi131.stdout:5/347: write d1/d29/d39/f4a [728109,34323] 0 2024-09-13T02:54:11.660 INFO:tasks.workunit.client.1.smithi131.stdout:6/494: getdents d1/d8/d9/db 0 2024-09-13T02:54:11.660 INFO:tasks.workunit.client.1.smithi131.stdout:6/495: write d1/d8/f7a [873367,87906] 0 2024-09-13T02:54:11.660 INFO:tasks.workunit.client.1.smithi131.stdout:6/496: write d1/d8/d9/db/d40/f47 [336362,60041] 0 2024-09-13T02:54:11.661 INFO:tasks.workunit.client.1.smithi131.stdout:8/379: dread db/d1d/d1f/f2d [0,4194304] 0 2024-09-13T02:54:11.661 INFO:tasks.workunit.client.1.smithi131.stdout:9/363: creat d0/d3/d14/d17/d32/f71 x:0 0 0 2024-09-13T02:54:11.661 INFO:tasks.workunit.client.1.smithi131.stdout:9/364: readlink d0/d3/l45 0 2024-09-13T02:54:11.661 INFO:tasks.workunit.client.1.smithi131.stdout:1/413: dread dd/d26/d44/f32 [0,4194304] 0 2024-09-13T02:54:11.662 INFO:tasks.workunit.client.1.smithi131.stdout:6/497: mknod d1/d8/d9/db/d15/d26/d1c/d4e/d97/d3b/ca0 0 2024-09-13T02:54:11.664 INFO:tasks.workunit.client.1.smithi131.stdout:9/365: unlink d0/d3/d14/d1a/f30 0 2024-09-13T02:54:11.664 INFO:tasks.workunit.client.1.smithi131.stdout:9/366: dread - d0/d3/d14/d17/d32/f6a zero size 2024-09-13T02:54:11.666 INFO:tasks.workunit.client.1.smithi131.stdout:0/568: write d0/de/d1f/d22/d31/d39/f74 [3361826,106549] 0 2024-09-13T02:54:11.666 INFO:tasks.workunit.client.1.smithi131.stdout:1/414: unlink dd/d33/l7f 0 2024-09-13T02:54:11.666 INFO:tasks.workunit.client.1.smithi131.stdout:1/415: write dd/d26/d44/f23 [574294,25036] 0 2024-09-13T02:54:11.666 INFO:tasks.workunit.client.1.smithi131.stdout:1/416: dread - dd/d26/f8d zero size 2024-09-13T02:54:11.667 INFO:tasks.workunit.client.1.smithi131.stdout:7/416: dwrite d1b/d3b/d31/d5f/f74 [0,4194304] 0 2024-09-13T02:54:11.667 INFO:tasks.workunit.client.1.smithi131.stdout:7/417: write d1b/f88 [37654,44327] 0 2024-09-13T02:54:11.668 INFO:tasks.workunit.client.1.smithi131.stdout:6/498: link d1/d8/f7f d1/d8/d9/d4b/fa1 0 2024-09-13T02:54:11.668 INFO:tasks.workunit.client.1.smithi131.stdout:6/499: chown d1/d8/f2c 988 1 2024-09-13T02:54:11.674 INFO:tasks.workunit.client.0.smithi089.stdout:1/998: dread dc/f91 [0,4194304] 0 2024-09-13T02:54:11.679 INFO:tasks.workunit.client.1.smithi131.stdout:9/367: symlink d0/d3/d14/d3c/l72 0 2024-09-13T02:54:11.682 INFO:tasks.workunit.client.1.smithi131.stdout:5/348: dwrite d1/d29/d39/d45/f5c [4194304,4194304] 0 2024-09-13T02:54:11.683 INFO:tasks.workunit.client.1.smithi131.stdout:0/569: unlink d0/d2/d41/f4a 0 2024-09-13T02:54:11.684 INFO:tasks.workunit.client.0.smithi089.stdout:1/999: dread f3 [0,4194304] 0 2024-09-13T02:54:11.684 INFO:tasks.workunit.client.1.smithi131.stdout:0/570: dread d0/d2/d41/f7e [0,4194304] 0 2024-09-13T02:54:11.684 INFO:tasks.workunit.client.1.smithi131.stdout:1/417: symlink dd/d51/d5a/l98 0 2024-09-13T02:54:11.687 INFO:tasks.workunit.client.1.smithi131.stdout:6/500: mkdir d1/d14/da2 0 2024-09-13T02:54:11.687 INFO:tasks.workunit.client.1.smithi131.stdout:6/501: getdents d1/d8/d9/db/d93 0 2024-09-13T02:54:11.688 INFO:tasks.workunit.client.1.smithi131.stdout:6/502: write d1/d8/d9/db/d15/d26/d1c/d4e/d97/f33 [339809,100873] 0 2024-09-13T02:54:11.689 INFO:tasks.workunit.client.1.smithi131.stdout:9/368: mknod d0/d3f/c73 0 2024-09-13T02:54:11.689 INFO:tasks.workunit.client.0.smithi089.stderr:+ rm -rf -- ./tmp.kmnIbmwQkg 2024-09-13T02:54:11.690 INFO:tasks.workunit.client.1.smithi131.stdout:1/418: mknod dd/d68/c99 0 2024-09-13T02:54:11.690 INFO:tasks.workunit.client.1.smithi131.stdout:4/449: truncate d1/dc/d22/d73/f87 2793158 0 2024-09-13T02:54:11.692 INFO:tasks.workunit.client.1.smithi131.stdout:6/503: rename d1/d8/d9/db/d15/d26/d1c/d4e/d97/d3b/l6a to d1/d53/la3 0 2024-09-13T02:54:11.693 INFO:tasks.workunit.client.1.smithi131.stdout:9/369: creat d0/d3/d14/d17/f74 x:0 0 0 2024-09-13T02:54:11.693 INFO:tasks.workunit.client.1.smithi131.stdout:9/370: chown d0/d3/d14/d1a/d2a/f62 43 1 2024-09-13T02:54:11.694 INFO:tasks.workunit.client.1.smithi131.stdout:5/349: write d1/d29/d39/d45/f5c [1935905,97454] 0 2024-09-13T02:54:11.694 INFO:tasks.workunit.client.1.smithi131.stdout:5/350: fsync d1/d29/d39/d45/f6c 0 2024-09-13T02:54:11.695 INFO:tasks.workunit.client.1.smithi131.stdout:4/450: creat d1/d18/d34/d4e/f93 x:0 0 0 2024-09-13T02:54:11.695 INFO:tasks.workunit.client.1.smithi131.stdout:0/571: dread d0/de/d1f/d22/d3d/d55/f58 [0,4194304] 0 2024-09-13T02:54:11.696 INFO:tasks.workunit.client.1.smithi131.stdout:1/419: dread f8 [0,4194304] 0 2024-09-13T02:54:11.696 INFO:tasks.workunit.client.1.smithi131.stdout:6/504: mknod d1/d53/ca4 0 2024-09-13T02:54:11.696 INFO:tasks.workunit.client.1.smithi131.stdout:9/371: mkdir d0/d3/d14/d1a/d2a/d75 0 2024-09-13T02:54:11.697 INFO:tasks.workunit.client.1.smithi131.stdout:8/380: dwrite db/f18 [0,4194304] 0 2024-09-13T02:54:11.697 INFO:tasks.workunit.client.1.smithi131.stdout:1/420: read dd/d33/d42/f48 [504269,129776] 0 2024-09-13T02:54:11.697 INFO:tasks.workunit.client.1.smithi131.stdout:7/418: dwrite f7 [4194304,4194304] 0 2024-09-13T02:54:11.698 INFO:tasks.workunit.client.1.smithi131.stdout:5/351: rename d1/d29/d39/f6f to d1/d2f/d33/f75 0 2024-09-13T02:54:11.699 INFO:tasks.workunit.client.1.smithi131.stdout:9/372: mkdir d0/d4d/d55/d76 0 2024-09-13T02:54:11.700 INFO:tasks.workunit.client.1.smithi131.stdout:8/381: mkdir db/d1d/d71 0 2024-09-13T02:54:11.702 INFO:tasks.workunit.client.1.smithi131.stdout:1/421: creat dd/d51/f9a x:0 0 0 2024-09-13T02:54:11.703 INFO:tasks.workunit.client.1.smithi131.stdout:4/451: rename d1/d8/ff to d1/dc/d22/d49/f94 0 2024-09-13T02:54:11.707 INFO:tasks.workunit.client.1.smithi131.stdout:9/373: unlink d0/d3/d14/d17/d32/f56 0 2024-09-13T02:54:11.707 INFO:tasks.workunit.client.1.smithi131.stdout:9/374: creat d0/d3/d14/d3c/f77 x:0 0 0 2024-09-13T02:54:11.708 INFO:tasks.workunit.client.1.smithi131.stdout:8/382: mknod db/d1d/d1f/d41/c72 0 2024-09-13T02:54:11.709 INFO:tasks.workunit.client.1.smithi131.stdout:6/505: rename d1/d53/ca4 to d1/d8/d9/db/d15/d26/d1c/d79/ca5 0 2024-09-13T02:54:11.711 INFO:tasks.workunit.client.1.smithi131.stdout:0/572: dread d0/fc6 [0,4194304] 0 2024-09-13T02:54:11.714 INFO:tasks.workunit.client.1.smithi131.stdout:7/419: rename d1b/d3b/d46/l87 to d1b/d3b/d31/d60/l8e 0 2024-09-13T02:54:11.716 INFO:tasks.workunit.client.1.smithi131.stdout:4/452: rename d1/d18/d34/d62/l85 to d1/d18/d43/d7d/l95 0 2024-09-13T02:54:11.717 INFO:tasks.workunit.client.1.smithi131.stdout:7/420: mkdir d1b/d3b/d51/d8f 0 2024-09-13T02:54:11.718 INFO:tasks.workunit.client.1.smithi131.stdout:9/375: write d0/f11 [2762083,81233] 0 2024-09-13T02:54:11.718 INFO:tasks.workunit.client.1.smithi131.stdout:4/453: symlink d1/dc/d22/l96 0 2024-09-13T02:54:11.720 INFO:tasks.workunit.client.1.smithi131.stdout:7/421: rename d1b/d23/f61 to d1b/d23/d89/f90 0 2024-09-13T02:54:11.721 INFO:tasks.workunit.client.1.smithi131.stdout:9/376: mknod d0/d3/d14/d1a/d2a/c78 0 2024-09-13T02:54:11.722 INFO:tasks.workunit.client.1.smithi131.stdout:9/377: dread - d0/d3/d14/f6f zero size 2024-09-13T02:54:11.722 INFO:tasks.workunit.client.1.smithi131.stdout:4/454: rmdir d1/d18/d43/d65 39 2024-09-13T02:54:11.724 INFO:tasks.workunit.client.1.smithi131.stdout:1/422: dwrite dd/d26/d2a/f61 [0,4194304] 0 2024-09-13T02:54:11.727 INFO:tasks.workunit.client.1.smithi131.stdout:5/352: dwrite d1/d2f/d33/f5b [0,4194304] 0 2024-09-13T02:54:11.728 INFO:tasks.workunit.client.1.smithi131.stdout:9/378: dread d0/f33 [0,4194304] 0 2024-09-13T02:54:11.728 INFO:tasks.workunit.client.1.smithi131.stdout:9/379: fdatasync d0/d3/d14/d1a/d2a/f4f 0 2024-09-13T02:54:11.729 INFO:tasks.workunit.client.1.smithi131.stdout:4/455: mkdir d1/d18/d43/d97 0 2024-09-13T02:54:11.729 INFO:tasks.workunit.client.1.smithi131.stdout:4/456: chown d1/dc 341 1 2024-09-13T02:54:11.732 INFO:tasks.workunit.client.1.smithi131.stdout:1/423: link dd/d26/d2a/d69/f83 dd/d68/f9b 0 2024-09-13T02:54:11.732 INFO:tasks.workunit.client.1.smithi131.stdout:1/424: getdents dd/d26/d44/d6d/d7c 0 2024-09-13T02:54:11.735 INFO:tasks.workunit.client.1.smithi131.stdout:5/353: link d1/d5/f16 d1/d1c/f76 0 2024-09-13T02:54:11.736 INFO:tasks.workunit.client.1.smithi131.stdout:4/457: unlink d1/dc/d19/d29/d33/f67 0 2024-09-13T02:54:11.738 INFO:tasks.workunit.client.1.smithi131.stdout:9/380: dread d0/d3/d14/d17/f31 [0,4194304] 0 2024-09-13T02:54:11.738 INFO:tasks.workunit.client.1.smithi131.stdout:1/425: link lb dd/d26/d44/d6d/l9c 0 2024-09-13T02:54:11.738 INFO:tasks.workunit.client.1.smithi131.stdout:1/426: fsync dd/f77 0 2024-09-13T02:54:11.739 INFO:tasks.workunit.client.1.smithi131.stdout:4/458: link d1/d8/c52 d1/d18/d34/d62/d78/c98 0 2024-09-13T02:54:11.740 INFO:tasks.workunit.client.1.smithi131.stdout:9/381: unlink d0/l29 0 2024-09-13T02:54:11.740 INFO:tasks.workunit.client.1.smithi131.stdout:9/382: chown d0/l4b 4 1 2024-09-13T02:54:11.742 INFO:tasks.workunit.client.1.smithi131.stdout:1/427: link dd/d51/d5a/l66 dd/d26/d44/d6d/d7c/l9d 0 2024-09-13T02:54:11.743 INFO:tasks.workunit.client.1.smithi131.stdout:9/383: mkdir d0/d3/d14/d1a/d2a/d5e/d79 0 2024-09-13T02:54:11.744 INFO:tasks.workunit.client.1.smithi131.stdout:9/384: symlink d0/d3/d14/d1a/d2a/l7a 0 2024-09-13T02:54:11.748 INFO:tasks.workunit.client.1.smithi131.stdout:9/385: dread d0/d3/d14/d17/f31 [0,4194304] 0 2024-09-13T02:54:11.748 INFO:tasks.workunit.client.1.smithi131.stdout:9/386: stat d0/d3/d14/d3c/l72 0 2024-09-13T02:54:11.750 INFO:tasks.workunit.client.1.smithi131.stdout:9/387: getdents d0/d3/d14/d1a 0 2024-09-13T02:54:11.752 INFO:tasks.workunit.client.1.smithi131.stdout:9/388: unlink d0/d3/d14/d1a/d2a/c38 0 2024-09-13T02:54:11.762 INFO:tasks.workunit.client.1.smithi131.stdout:8/383: dwrite db/d1d/d1f/f52 [0,4194304] 0 2024-09-13T02:54:11.776 INFO:tasks.workunit.client.1.smithi131.stdout:0/573: dwrite d0/de/d45/d5a/f5b [0,4194304] 0 2024-09-13T02:54:11.776 INFO:tasks.workunit.client.1.smithi131.stdout:7/422: dwrite f7 [0,4194304] 0 2024-09-13T02:54:11.776 INFO:tasks.workunit.client.1.smithi131.stdout:7/423: dread - d1b/d3b/d31/f5c zero size 2024-09-13T02:54:11.776 INFO:tasks.workunit.client.1.smithi131.stdout:7/424: fdatasync d1b/d3b/d31/d5f/f74 0 2024-09-13T02:54:11.777 INFO:tasks.workunit.client.1.smithi131.stdout:0/574: read d0/de/d1f/d22/d31/fba [507193,56026] 0 2024-09-13T02:54:11.778 INFO:tasks.workunit.client.1.smithi131.stdout:0/575: rename d0/de/d45/d78/fbe to d0/de/d1f/d22/d31/d39/d40/fd0 0 2024-09-13T02:54:11.782 INFO:tasks.workunit.client.1.smithi131.stdout:4/459: dwrite d1/dc/d22/f69 [0,4194304] 0 2024-09-13T02:54:11.783 INFO:tasks.workunit.client.1.smithi131.stdout:6/506: dwrite d1/f7 [0,4194304] 0 2024-09-13T02:54:11.785 INFO:tasks.workunit.client.1.smithi131.stdout:5/354: fsync d1/d5/f16 0 2024-09-13T02:54:11.785 INFO:tasks.workunit.client.1.smithi131.stdout:5/355: chown d1/d21/d22/f55 2354058 1 2024-09-13T02:54:11.787 INFO:tasks.workunit.client.1.smithi131.stdout:1/428: dwrite dd/d26/d44/f25 [0,4194304] 0 2024-09-13T02:54:11.787 INFO:tasks.workunit.client.1.smithi131.stdout:1/429: chown dd/c19 64539416 1 2024-09-13T02:54:11.787 INFO:tasks.workunit.client.1.smithi131.stdout:1/430: fdatasync dd/d26/d2a/f61 0 2024-09-13T02:54:11.788 INFO:tasks.workunit.client.1.smithi131.stdout:1/431: chown dd/d26/d2a/d69/f83 0 1 2024-09-13T02:54:11.788 INFO:tasks.workunit.client.1.smithi131.stdout:4/460: creat d1/d8/f99 x:0 0 0 2024-09-13T02:54:11.790 INFO:tasks.workunit.client.1.smithi131.stdout:7/425: dread d1b/f1f [4194304,4194304] 0 2024-09-13T02:54:11.790 INFO:tasks.workunit.client.1.smithi131.stdout:7/426: chown d1b/d23/l3c 154567509 1 2024-09-13T02:54:11.790 INFO:tasks.workunit.client.1.smithi131.stdout:9/389: dwrite d0/d3/d14/d1a/d2a/f62 [0,4194304] 0 2024-09-13T02:54:11.790 INFO:tasks.workunit.client.1.smithi131.stdout:9/390: chown d0/d3/d14/d1a/d2a/c41 14076 1 2024-09-13T02:54:11.793 INFO:tasks.workunit.client.1.smithi131.stdout:1/432: write dd/d33/f6a [276020,45802] 0 2024-09-13T02:54:11.794 INFO:tasks.workunit.client.1.smithi131.stdout:5/356: truncate d1/d21/f25 3245264 0 2024-09-13T02:54:11.794 INFO:tasks.workunit.client.1.smithi131.stdout:5/357: read d1/d21/d22/f26 [37600,11816] 0 2024-09-13T02:54:11.794 INFO:tasks.workunit.client.1.smithi131.stdout:5/358: chown d1/d21/l28 724 1 2024-09-13T02:54:11.795 INFO:tasks.workunit.client.1.smithi131.stdout:4/461: truncate d1/dc/d22/d49/f6e 2437611 0 2024-09-13T02:54:11.795 INFO:tasks.workunit.client.1.smithi131.stdout:4/462: stat d1/d18/d43/d65 0 2024-09-13T02:54:11.798 INFO:tasks.workunit.client.1.smithi131.stdout:7/427: mknod d1b/d73/c91 0 2024-09-13T02:54:11.798 INFO:tasks.workunit.client.1.smithi131.stdout:7/428: readlink d1b/d23/d54/l7d 0 2024-09-13T02:54:11.799 INFO:tasks.workunit.client.1.smithi131.stdout:5/359: symlink d1/d21/l77 0 2024-09-13T02:54:11.800 INFO:tasks.workunit.client.1.smithi131.stdout:7/429: mkdir d1b/d3b/d46/d4b/d57/d7b/d92 0 2024-09-13T02:54:11.809 INFO:tasks.workunit.client.1.smithi131.stdout:1/433: dread dd/d26/d44/f28 [0,4194304] 0 2024-09-13T02:54:11.809 INFO:tasks.workunit.client.1.smithi131.stdout:4/463: dread d1/d8/d13/f44 [0,4194304] 0 2024-09-13T02:54:11.809 INFO:tasks.workunit.client.1.smithi131.stdout:4/464: write d1/dc/d22/d49/f94 [4738729,94480] 0 2024-09-13T02:54:11.810 INFO:tasks.workunit.client.1.smithi131.stdout:0/576: dwrite d0/de/d1f/d22/d31/d39/d67/f5e [0,4194304] 0 2024-09-13T02:54:11.810 INFO:tasks.workunit.client.1.smithi131.stdout:1/434: symlink dd/d33/d42/d6f/l9e 0 2024-09-13T02:54:11.810 INFO:tasks.workunit.client.1.smithi131.stdout:1/435: dread - dd/f77 zero size 2024-09-13T02:54:11.811 INFO:tasks.workunit.client.1.smithi131.stdout:4/465: creat d1/d18/f9a x:0 0 0 2024-09-13T02:54:11.811 INFO:tasks.workunit.client.1.smithi131.stdout:4/466: rename d1/dc/d19/d29/d33 to d1/dc/d19/d29/d33/d3a/d9b 22 2024-09-13T02:54:11.811 INFO:tasks.workunit.client.1.smithi131.stdout:0/577: rmdir d0/de 39 2024-09-13T02:54:11.813 INFO:tasks.workunit.client.1.smithi131.stdout:4/467: creat d1/d18/d34/d62/f9c x:0 0 0 2024-09-13T02:54:11.814 INFO:tasks.workunit.client.1.smithi131.stdout:7/430: dread d1b/d3b/d31/d5f/f74 [0,4194304] 0 2024-09-13T02:54:11.815 INFO:tasks.workunit.client.1.smithi131.stdout:0/578: unlink d0/de/d1f/d22/d3d/d43/d4b/f51 0 2024-09-13T02:54:11.817 INFO:tasks.workunit.client.1.smithi131.stdout:1/436: rmdir dd/d26/d2a/d69 39 2024-09-13T02:54:11.817 INFO:tasks.workunit.client.1.smithi131.stdout:4/468: mknod d1/dc/d19/d29/d8d/c9d 0 2024-09-13T02:54:11.817 INFO:tasks.workunit.client.1.smithi131.stdout:4/469: readlink d1/d18/d43/d65/l88 0 2024-09-13T02:54:11.818 INFO:tasks.workunit.client.1.smithi131.stdout:0/579: mknod d0/de/d1f/d22/d3d/d43/d4b/cd1 0 2024-09-13T02:54:11.819 INFO:tasks.workunit.client.1.smithi131.stdout:0/580: write d0/de/d45/d86/f88 [1138726,85689] 0 2024-09-13T02:54:11.822 INFO:tasks.workunit.client.1.smithi131.stdout:1/437: dread dd/d33/d42/f48 [0,4194304] 0 2024-09-13T02:54:11.823 INFO:tasks.workunit.client.1.smithi131.stdout:9/391: dwrite d0/f9 [4194304,4194304] 0 2024-09-13T02:54:11.823 INFO:tasks.workunit.client.1.smithi131.stdout:9/392: dread - d0/f63 zero size 2024-09-13T02:54:11.824 INFO:tasks.workunit.client.1.smithi131.stdout:6/507: dwrite d1/d8/d9/d4b/fa1 [0,4194304] 0 2024-09-13T02:54:11.824 INFO:tasks.workunit.client.1.smithi131.stdout:6/508: fsync d1/d8/d9/db/d15/d26/d1c/d4e/d97/d3b/f48 0 2024-09-13T02:54:11.824 INFO:tasks.workunit.client.1.smithi131.stdout:6/509: chown d1/d8/d9/db/d15/d26/d1c/d4e 2289 1 2024-09-13T02:54:11.824 INFO:tasks.workunit.client.1.smithi131.stdout:1/438: rename dd/d26/d44/d6d/d7c/l9d to dd/d51/d8a/d95/l9f 0 2024-09-13T02:54:11.824 INFO:tasks.workunit.client.1.smithi131.stdout:5/360: dwrite d1/d29/d3e/f42 [0,4194304] 0 2024-09-13T02:54:11.831 INFO:tasks.workunit.client.1.smithi131.stdout:4/470: write d1/dc/d22/d49/f61 [2530319,82432] 0 2024-09-13T02:54:11.831 INFO:tasks.workunit.client.1.smithi131.stdout:1/439: symlink dd/d26/d44/la0 0 2024-09-13T02:54:11.831 INFO:tasks.workunit.client.1.smithi131.stdout:1/440: chown dd/d26/f87 7 1 2024-09-13T02:54:11.832 INFO:tasks.workunit.client.1.smithi131.stdout:5/361: mkdir d1/d21/d74/d78 0 2024-09-13T02:54:11.833 INFO:tasks.workunit.client.1.smithi131.stdout:4/471: creat d1/dc/d19/d29/f9e x:0 0 0 2024-09-13T02:54:11.834 INFO:tasks.workunit.client.1.smithi131.stdout:4/472: dread - d1/d18/d81/f8e zero size 2024-09-13T02:54:11.834 INFO:tasks.workunit.client.1.smithi131.stdout:6/510: dread d1/d8/d9/f17 [0,4194304] 0 2024-09-13T02:54:11.834 INFO:tasks.workunit.client.1.smithi131.stdout:6/511: chown d1/d8/d9/db/d15/d26/d1c/d4e/f77 8 1 2024-09-13T02:54:11.834 INFO:tasks.workunit.client.1.smithi131.stdout:1/441: creat dd/d26/d2a/d2c/fa1 x:0 0 0 2024-09-13T02:54:11.835 INFO:tasks.workunit.client.1.smithi131.stdout:5/362: symlink d1/d2f/l79 0 2024-09-13T02:54:11.836 INFO:tasks.workunit.client.1.smithi131.stdout:4/473: mkdir d1/d18/d43/d7d/d9f 0 2024-09-13T02:54:11.836 INFO:tasks.workunit.client.1.smithi131.stdout:4/474: stat d1/dc/d22/d49/f4d 0 2024-09-13T02:54:11.837 INFO:tasks.workunit.client.1.smithi131.stdout:6/512: link d1/d8/d9/db/d15/f60 d1/d8/d9/db/d40/fa6 0 2024-09-13T02:54:11.838 INFO:tasks.workunit.client.1.smithi131.stdout:1/442: symlink dd/la2 0 2024-09-13T02:54:11.840 INFO:tasks.workunit.client.1.smithi131.stdout:5/363: link d1/d21/f6d d1/d21/d74/d78/f7a 0 2024-09-13T02:54:11.843 INFO:tasks.workunit.client.1.smithi131.stdout:6/513: creat d1/d8/fa7 x:0 0 0 2024-09-13T02:54:11.846 INFO:tasks.workunit.client.1.smithi131.stdout:9/393: dwrite d0/d3/d14/d17/d32/d39/f64 [0,4194304] 0 2024-09-13T02:54:11.846 INFO:tasks.workunit.client.1.smithi131.stdout:0/581: dwrite d0/de/d1f/d22/d31/f60 [0,4194304] 0 2024-09-13T02:54:11.846 INFO:tasks.workunit.client.1.smithi131.stdout:5/364: link d1/d29/d39/d45/f52 d1/d21/f7b 0 2024-09-13T02:54:11.847 INFO:tasks.workunit.client.1.smithi131.stdout:5/365: fsync d1/d2f/d33/f75 0 2024-09-13T02:54:11.850 INFO:tasks.workunit.client.1.smithi131.stdout:9/394: creat d0/d3/d14/d1a/d2a/d5e/d79/f7b x:0 0 0 2024-09-13T02:54:11.851 INFO:tasks.workunit.client.1.smithi131.stdout:0/582: mkdir d0/de/d1f/d22/d3d/d55/d63/dd2 0 2024-09-13T02:54:11.851 INFO:tasks.workunit.client.1.smithi131.stdout:0/583: readlink d0/de/d1f/d22/l28 0 2024-09-13T02:54:11.853 INFO:tasks.workunit.client.1.smithi131.stdout:6/514: write d1/d8/f7f [1915371,99324] 0 2024-09-13T02:54:11.853 INFO:tasks.workunit.client.1.smithi131.stdout:6/515: write d1/d8/d9/db/d15/d26/d1c/d4e/d97/d3b/f98 [335830,65649] 0 2024-09-13T02:54:11.855 INFO:tasks.workunit.client.1.smithi131.stdout:9/395: truncate d0/d3/d14/d1a/d2a/f4f 890815 0 2024-09-13T02:54:11.857 INFO:tasks.workunit.client.1.smithi131.stdout:2/420: sync 2024-09-13T02:54:11.857 INFO:tasks.workunit.client.1.smithi131.stdout:3/394: sync 2024-09-13T02:54:11.857 INFO:tasks.workunit.client.1.smithi131.stdout:0/584: unlink d0/de/d1f/d22/d31/d39/d40/lbf 0 2024-09-13T02:54:11.857 INFO:tasks.workunit.client.1.smithi131.stdout:3/395: write d2/d4/d7/d1d/f25 [584865,69785] 0 2024-09-13T02:54:11.857 INFO:tasks.workunit.client.1.smithi131.stdout:3/396: dread - d2/dc/d39/f72 zero size 2024-09-13T02:54:11.860 INFO:tasks.workunit.client.1.smithi131.stdout:6/516: mknod d1/d8/d9/db/d15/d26/d1c/d4e/d97/d3b/ca8 0 2024-09-13T02:54:11.860 INFO:tasks.workunit.client.1.smithi131.stdout:6/517: read d1/d14/f20 [3579638,80542] 0 2024-09-13T02:54:11.860 INFO:tasks.workunit.client.1.smithi131.stdout:6/518: fdatasync d1/d8/d9/f1d 0 2024-09-13T02:54:11.860 INFO:tasks.workunit.client.1.smithi131.stdout:6/519: fsync d1/d14/f20 0 2024-09-13T02:54:11.860 INFO:tasks.workunit.client.1.smithi131.stdout:9/396: mknod d0/d3/d14/d3c/d70/c7c 0 2024-09-13T02:54:11.861 INFO:tasks.workunit.client.1.smithi131.stdout:2/421: mkdir d5/d31/d26/d8d 0 2024-09-13T02:54:11.861 INFO:tasks.workunit.client.1.smithi131.stdout:0/585: mkdir d0/de/d1f/d22/d3d/d43/dc2/dd3 0 2024-09-13T02:54:11.861 INFO:tasks.workunit.client.1.smithi131.stdout:3/397: creat d2/d4/d1a/f8b x:0 0 0 2024-09-13T02:54:11.862 INFO:tasks.workunit.client.1.smithi131.stdout:9/397: dread d0/d3/f5b [0,4194304] 0 2024-09-13T02:54:11.863 INFO:tasks.workunit.client.1.smithi131.stdout:2/422: rename d5/d1e to d5/d18/d4b/d8e 0 2024-09-13T02:54:11.864 INFO:tasks.workunit.client.1.smithi131.stdout:0/586: truncate d0/de/d1f/d22/fb2 2453024 0 2024-09-13T02:54:11.866 INFO:tasks.workunit.client.1.smithi131.stdout:9/398: creat d0/d3/d14/d1a/d2a/f7d x:0 0 0 2024-09-13T02:54:11.866 INFO:tasks.workunit.client.1.smithi131.stdout:2/423: symlink d5/d31/d1d/d50/l8f 0 2024-09-13T02:54:11.866 INFO:tasks.workunit.client.1.smithi131.stdout:2/424: readlink d5/d31/d1d/d37/l88 0 2024-09-13T02:54:11.867 INFO:tasks.workunit.client.1.smithi131.stdout:0/587: mknod d0/de/d1f/d22/d3d/d55/d63/d94/cd4 0 2024-09-13T02:54:11.868 INFO:tasks.workunit.client.1.smithi131.stdout:9/399: symlink d0/d3/d14/d17/d66/l7e 0 2024-09-13T02:54:11.885 INFO:tasks.workunit.client.1.smithi131.stdout:4/475: dwrite d1/dc/f7e [0,4194304] 0 2024-09-13T02:54:11.886 INFO:tasks.workunit.client.1.smithi131.stdout:2/425: dread d5/d31/ff [0,4194304] 0 2024-09-13T02:54:11.886 INFO:tasks.workunit.client.1.smithi131.stdout:4/476: creat d1/d18/d43/d7d/d9f/fa0 x:0 0 0 2024-09-13T02:54:11.887 INFO:tasks.workunit.client.1.smithi131.stdout:2/426: mkdir d5/d31/d21/d57/d90 0 2024-09-13T02:54:11.889 INFO:tasks.workunit.client.1.smithi131.stdout:2/427: link d5/d31/d4e/f60 d5/d18/d4b/d8e/d48/d4c/f91 0 2024-09-13T02:54:11.890 INFO:tasks.workunit.client.1.smithi131.stdout:2/428: creat d5/d6e/f92 x:0 0 0 2024-09-13T02:54:11.891 INFO:tasks.workunit.client.1.smithi131.stdout:2/429: creat d5/d33/d41/f93 x:0 0 0 2024-09-13T02:54:11.895 INFO:tasks.workunit.client.1.smithi131.stdout:1/443: dwrite dd/d26/d2a/d2c/d4b/f5b [0,4194304] 0 2024-09-13T02:54:11.896 INFO:tasks.workunit.client.1.smithi131.stdout:7/431: dwrite d1b/d73/f85 [0,4194304] 0 2024-09-13T02:54:11.896 INFO:tasks.workunit.client.1.smithi131.stdout:1/444: mkdir dd/d51/d5a/da3 0 2024-09-13T02:54:11.898 INFO:tasks.workunit.client.1.smithi131.stdout:0/588: dwrite d0/d2/d41/fc7 [0,4194304] 0 2024-09-13T02:54:11.898 INFO:tasks.workunit.client.1.smithi131.stdout:1/445: rename fc to dd/d26/d44/d6d/d7c/fa4 0 2024-09-13T02:54:11.898 INFO:tasks.workunit.client.1.smithi131.stdout:1/446: write dd/d26/d2a/d2c/fa1 [923813,108800] 0 2024-09-13T02:54:11.900 INFO:tasks.workunit.client.1.smithi131.stdout:7/432: dread d1b/d3b/d31/d5f/f7e [0,4194304] 0 2024-09-13T02:54:11.902 INFO:tasks.workunit.client.1.smithi131.stdout:0/589: rmdir d0/de/d1f/d22/d3d/d55/d63 39 2024-09-13T02:54:11.903 INFO:tasks.workunit.client.1.smithi131.stdout:1/447: symlink dd/d51/d8a/la5 0 2024-09-13T02:54:11.905 INFO:tasks.workunit.client.1.smithi131.stdout:3/398: dwrite d2/dc/d39/d61/f87 [0,4194304] 0 2024-09-13T02:54:11.905 INFO:tasks.workunit.client.1.smithi131.stdout:3/399: creat d2/d4/d7/d1d/d24/d6f/f8c x:0 0 0 2024-09-13T02:54:11.905 INFO:tasks.workunit.client.1.smithi131.stdout:3/400: fdatasync d2/dc/f2a 0 2024-09-13T02:54:11.906 INFO:tasks.workunit.client.1.smithi131.stdout:7/433: link d1b/d3b/d31/d5f/l7f d1b/d3b/d46/d4b/d57/d8c/l93 0 2024-09-13T02:54:11.906 INFO:tasks.workunit.client.1.smithi131.stdout:9/400: dwrite d0/f33 [0,4194304] 0 2024-09-13T02:54:11.906 INFO:tasks.workunit.client.1.smithi131.stdout:4/477: dwrite d1/d18/f2a [4194304,4194304] 0 2024-09-13T02:54:11.906 INFO:tasks.workunit.client.1.smithi131.stdout:6/520: fsync d1/d8/d9/db/d40/fa6 0 2024-09-13T02:54:11.907 INFO:tasks.workunit.client.1.smithi131.stdout:0/590: creat d0/de/d1f/d22/d31/d39/d40/fd5 x:0 0 0 2024-09-13T02:54:11.909 INFO:tasks.workunit.client.1.smithi131.stdout:1/448: truncate dd/f20 1467511 0 2024-09-13T02:54:11.912 INFO:tasks.workunit.client.1.smithi131.stdout:5/366: rmdir d1/d29/d39/d45 39 2024-09-13T02:54:11.912 INFO:tasks.workunit.client.1.smithi131.stdout:5/367: read d1/d5/f3a [3410025,111624] 0 2024-09-13T02:54:11.915 INFO:tasks.workunit.client.1.smithi131.stdout:3/401: rename d2/d4/d7/d1d/f25 to d2/d4/d1a/d31/d48/d69/f8d 0 2024-09-13T02:54:11.917 INFO:tasks.workunit.client.1.smithi131.stdout:7/434: mknod d1b/c94 0 2024-09-13T02:54:11.917 INFO:tasks.workunit.client.1.smithi131.stdout:3/402: dread d2/d4/d7/d8/d41/d5c/f35 [0,4194304] 0 2024-09-13T02:54:11.918 INFO:tasks.workunit.client.1.smithi131.stdout:9/401: symlink d0/d3/d14/d1a/d2a/d5e/l7f 0 2024-09-13T02:54:11.920 INFO:tasks.workunit.client.1.smithi131.stdout:4/478: symlink d1/d18/d43/la1 0 2024-09-13T02:54:11.923 INFO:tasks.workunit.client.1.smithi131.stdout:6/521: dwrite d1/d8/d9/db/d15/d26/d1c/d4e/f73 [0,4194304] 0 2024-09-13T02:54:11.929 INFO:tasks.workunit.client.1.smithi131.stdout:5/368: dwrite d1/d1c/f76 [0,4194304] 0 2024-09-13T02:54:11.929 INFO:tasks.workunit.client.1.smithi131.stdout:5/369: fsync d1/d2f/f31 0 2024-09-13T02:54:11.929 INFO:tasks.workunit.client.1.smithi131.stdout:0/591: mkdir d0/d2/d41/dd6 0 2024-09-13T02:54:11.933 INFO:tasks.workunit.client.1.smithi131.stdout:9/402: creat d0/d3/d14/d1a/d2a/d5e/f80 x:0 0 0 2024-09-13T02:54:11.933 INFO:tasks.workunit.client.1.smithi131.stdout:9/403: fdatasync d0/d3/d14/d17/d32/f59 0 2024-09-13T02:54:11.933 INFO:tasks.workunit.client.1.smithi131.stdout:9/404: dread - d0/d3/d14/d3c/f77 zero size 2024-09-13T02:54:11.933 INFO:tasks.workunit.client.1.smithi131.stdout:9/405: dread - d0/f63 zero size 2024-09-13T02:54:11.935 INFO:tasks.workunit.client.1.smithi131.stdout:6/522: rename d1/f8f to d1/fa9 0 2024-09-13T02:54:11.935 INFO:tasks.workunit.client.1.smithi131.stdout:6/523: readlink d1/d8/d9/db/l45 0 2024-09-13T02:54:11.935 INFO:tasks.workunit.client.1.smithi131.stdout:6/524: dread - d1/d8/d9/db/d15/d26/d1c/d79/d92/f9c zero size 2024-09-13T02:54:11.936 INFO:tasks.workunit.client.1.smithi131.stdout:5/370: creat d1/d5/d57/f7c x:0 0 0 2024-09-13T02:54:11.938 INFO:tasks.workunit.client.1.smithi131.stdout:4/479: unlink d1/dc/f7e 0 2024-09-13T02:54:11.938 INFO:tasks.workunit.client.1.smithi131.stdout:1/449: getdents dd/d26/d44/d6d/d7c 0 2024-09-13T02:54:11.940 INFO:tasks.workunit.client.1.smithi131.stdout:6/525: creat d1/d8/d9/db/d40/faa x:0 0 0 2024-09-13T02:54:11.941 INFO:tasks.workunit.client.1.smithi131.stdout:1/450: dread dd/d51/d8a/f93 [0,4194304] 0 2024-09-13T02:54:11.942 INFO:tasks.workunit.client.1.smithi131.stdout:4/480: read d1/d18/d81/f8b [2271657,55971] 0 2024-09-13T02:54:11.943 INFO:tasks.workunit.client.1.smithi131.stdout:0/592: rename d0/de/d1f/f24 to d0/de/fd7 0 2024-09-13T02:54:11.943 INFO:tasks.workunit.client.1.smithi131.stdout:0/593: chown d0/f90 30 1 2024-09-13T02:54:11.944 INFO:tasks.workunit.client.1.smithi131.stdout:1/451: symlink dd/d68/la6 0 2024-09-13T02:54:11.945 INFO:tasks.workunit.client.1.smithi131.stdout:9/406: rename d0/l4b to d0/d3/d14/d17/l81 0 2024-09-13T02:54:11.946 INFO:tasks.workunit.client.1.smithi131.stdout:9/407: write d0/d3/d14/d1a/d2a/d5e/d79/f7b [645803,84475] 0 2024-09-13T02:54:11.946 INFO:tasks.workunit.client.1.smithi131.stdout:9/408: dread - d0/d3/d14/d3c/f69 zero size 2024-09-13T02:54:11.946 INFO:tasks.workunit.client.1.smithi131.stdout:0/594: getdents d0/de/d1f/d22/d3d/d55 0 2024-09-13T02:54:11.946 INFO:tasks.workunit.client.1.smithi131.stdout:0/595: fsync d0/d2/d62/f8f 0 2024-09-13T02:54:11.949 INFO:tasks.workunit.client.1.smithi131.stdout:9/409: mknod d0/d4d/d55/d76/c82 0 2024-09-13T02:54:11.949 INFO:tasks.workunit.client.1.smithi131.stdout:5/371: read d1/d21/f25 [432959,58522] 0 2024-09-13T02:54:11.951 INFO:tasks.workunit.client.1.smithi131.stdout:3/403: rmdir d2/d4/d1a 39 2024-09-13T02:54:11.951 INFO:tasks.workunit.client.1.smithi131.stdout:0/596: truncate d0/de/d1f/d22/d3d/d43/f9d 2047505 0 2024-09-13T02:54:11.952 INFO:tasks.workunit.client.1.smithi131.stdout:6/526: rmdir d1/d8/d9/db/d93 0 2024-09-13T02:54:11.953 INFO:tasks.workunit.client.1.smithi131.stdout:1/452: getdents dd/d26/d2a/d2c 0 2024-09-13T02:54:11.954 INFO:tasks.workunit.client.1.smithi131.stdout:1/453: readlink dd/d26/l2b 0 2024-09-13T02:54:11.955 INFO:tasks.workunit.client.1.smithi131.stdout:9/410: link d0/d3/d14/d1a/d2a/f7d d0/d3/d14/d1a/d2a/d5e/f83 0 2024-09-13T02:54:11.956 INFO:tasks.workunit.client.1.smithi131.stdout:3/404: unlink d2/dc/f65 0 2024-09-13T02:54:11.956 INFO:tasks.workunit.client.1.smithi131.stdout:3/405: readlink d2/d4/d7/d8/d41/d5c/l50 0 2024-09-13T02:54:11.956 INFO:tasks.workunit.client.1.smithi131.stdout:3/406: dread - d2/d4/d7/f62 zero size 2024-09-13T02:54:11.957 INFO:tasks.workunit.client.1.smithi131.stdout:0/597: creat d0/de/d1f/d22/d3d/d43/fd8 x:0 0 0 2024-09-13T02:54:11.959 INFO:tasks.workunit.client.1.smithi131.stdout:9/411: link d0/d3/c4c d0/d4d/c84 0 2024-09-13T02:54:11.959 INFO:tasks.workunit.client.1.smithi131.stdout:9/412: chown d0/d3/d14/d1a/d2a/f4f 6571 1 2024-09-13T02:54:11.959 INFO:tasks.workunit.client.1.smithi131.stdout:0/598: creat d0/de/d1f/fd9 x:0 0 0 2024-09-13T02:54:11.959 INFO:tasks.workunit.client.1.smithi131.stdout:0/599: fdatasync d0/de/d45/d5a/f5b 0 2024-09-13T02:54:11.967 INFO:tasks.workunit.client.1.smithi131.stdout:5/372: write d1/d1c/f53 [1431698,33819] 0 2024-09-13T02:54:11.967 INFO:tasks.workunit.client.1.smithi131.stdout:5/373: chown d1/d1c 5 1 2024-09-13T02:54:11.967 INFO:tasks.workunit.client.1.smithi131.stdout:4/481: dwrite d1/dc/d19/d29/f60 [0,4194304] 0 2024-09-13T02:54:11.967 INFO:tasks.workunit.client.1.smithi131.stdout:6/527: dread d1/d8/d9/db/d15/d26/d1c/d4e/d97/d3b/f98 [0,4194304] 0 2024-09-13T02:54:11.970 INFO:tasks.workunit.client.1.smithi131.stdout:5/374: rename d1/d21/d74/d78/f7a to d1/d50/f7d 0 2024-09-13T02:54:11.974 INFO:tasks.workunit.client.1.smithi131.stdout:6/528: mknod d1/d8/d9/db/d15/d26/d1c/d4e/d97/cab 0 2024-09-13T02:54:11.974 INFO:tasks.workunit.client.1.smithi131.stdout:6/529: stat d1/fe 0 2024-09-13T02:54:11.974 INFO:tasks.workunit.client.1.smithi131.stdout:6/530: write d1/d8/d9/db/d40/f9d [27508,91961] 0 2024-09-13T02:54:11.976 INFO:tasks.workunit.client.1.smithi131.stdout:4/482: truncate d1/dc/f3b 2459019 0 2024-09-13T02:54:11.976 INFO:tasks.workunit.client.1.smithi131.stdout:4/483: read d1/dc/d22/d49/f94 [3894433,42126] 0 2024-09-13T02:54:11.976 INFO:tasks.workunit.client.1.smithi131.stdout:4/484: chown d1/dc/d19 454577 1 2024-09-13T02:54:11.976 INFO:tasks.workunit.client.1.smithi131.stdout:4/485: stat d1/c12 0 2024-09-13T02:54:11.976 INFO:tasks.workunit.client.1.smithi131.stdout:4/486: dread - d1/d18/d81/f8a zero size 2024-09-13T02:54:11.980 INFO:tasks.workunit.client.1.smithi131.stdout:6/531: symlink d1/d8/d9/d8d/lac 0 2024-09-13T02:54:11.981 INFO:tasks.workunit.client.1.smithi131.stdout:4/487: symlink d1/dc/d19/d29/d8d/la2 0 2024-09-13T02:54:11.981 INFO:tasks.workunit.client.1.smithi131.stdout:4/488: dread - d1/d8/d13/f30 zero size 2024-09-13T02:54:11.988 INFO:tasks.workunit.client.1.smithi131.stdout:1/454: dwrite dd/d26/d2a/f61 [0,4194304] 0 2024-09-13T02:54:11.991 INFO:tasks.workunit.client.1.smithi131.stdout:1/455: creat dd/d26/d2a/d69/fa7 x:0 0 0 2024-09-13T02:54:11.992 INFO:tasks.workunit.client.1.smithi131.stdout:1/456: rmdir dd/d51/d8a 39 2024-09-13T02:54:11.999 INFO:tasks.workunit.client.1.smithi131.stdout:3/407: dwrite d2/d4/d7/d1d/d24/d6f/f8c [0,4194304] 0 2024-09-13T02:54:11.999 INFO:tasks.workunit.client.1.smithi131.stdout:3/408: chown d2/dc/f2a 105358 1 2024-09-13T02:54:12.000 INFO:tasks.workunit.client.1.smithi131.stdout:5/375: dwrite d1/d21/d22/f55 [0,4194304] 0 2024-09-13T02:54:12.000 INFO:tasks.workunit.client.1.smithi131.stdout:9/413: dwrite d0/d3/d14/d1a/d2a/d5e/f83 [0,4194304] 0 2024-09-13T02:54:12.000 INFO:tasks.workunit.client.1.smithi131.stdout:9/414: truncate d0/d3/d14/d17/f74 521855 0 2024-09-13T02:54:12.000 INFO:tasks.workunit.client.1.smithi131.stdout:9/415: chown d0/d3/d14/d1a 3485 1 2024-09-13T02:54:12.004 INFO:tasks.workunit.client.1.smithi131.stdout:3/409: creat d2/d4/d1a/d31/d48/d69/f8e x:0 0 0 2024-09-13T02:54:12.006 INFO:tasks.workunit.client.1.smithi131.stdout:3/410: symlink d2/d4/d7/l8f 0 2024-09-13T02:54:12.013 INFO:tasks.workunit.client.1.smithi131.stdout:5/376: dread d1/d29/d39/d45/f5c [4194304,4194304] 0 2024-09-13T02:54:12.013 INFO:tasks.workunit.client.1.smithi131.stdout:5/377: chown d1/d29/d39 13490 1 2024-09-13T02:54:12.014 INFO:tasks.workunit.client.1.smithi131.stdout:5/378: mkdir d1/d1c/d7e 0 2024-09-13T02:54:12.016 INFO:tasks.workunit.client.1.smithi131.stdout:5/379: rename d1/d1c/l5f to d1/d5/l7f 0 2024-09-13T02:54:12.016 INFO:tasks.workunit.client.1.smithi131.stdout:5/380: readlink d1/l1f 0 2024-09-13T02:54:12.017 INFO:tasks.workunit.client.1.smithi131.stdout:5/381: creat d1/d21/d74/f80 x:0 0 0 2024-09-13T02:54:12.017 INFO:tasks.workunit.client.1.smithi131.stdout:5/382: dread - d1/d21/f7b zero size 2024-09-13T02:54:12.017 INFO:tasks.workunit.client.1.smithi131.stdout:5/383: creat d1/d2f/d33/f81 x:0 0 0 2024-09-13T02:54:12.018 INFO:tasks.workunit.client.1.smithi131.stdout:5/384: fdatasync d1/d29/d39/d45/f48 0 2024-09-13T02:54:12.018 INFO:tasks.workunit.client.1.smithi131.stdout:5/385: dread - d1/d21/f7b zero size 2024-09-13T02:54:12.018 INFO:tasks.workunit.client.1.smithi131.stdout:6/532: dwrite d1/d8/d9/db/d15/d26/f3a [0,4194304] 0 2024-09-13T02:54:12.018 INFO:tasks.workunit.client.1.smithi131.stdout:6/533: dread - d1/d8/fa7 zero size 2024-09-13T02:54:12.018 INFO:tasks.workunit.client.1.smithi131.stdout:5/386: symlink d1/d21/d22/l82 0 2024-09-13T02:54:12.019 INFO:tasks.workunit.client.1.smithi131.stdout:5/387: symlink d1/d2f/l83 0 2024-09-13T02:54:12.020 INFO:tasks.workunit.client.1.smithi131.stdout:5/388: creat d1/d21/f84 x:0 0 0 2024-09-13T02:54:12.020 INFO:tasks.workunit.client.1.smithi131.stdout:5/389: readlink d1/d5/l7f 0 2024-09-13T02:54:12.021 INFO:tasks.workunit.client.1.smithi131.stdout:5/390: rename d1/d5/c15 to d1/d29/d39/c85 0 2024-09-13T02:54:12.037 INFO:tasks.workunit.client.1.smithi131.stdout:5/391: write d1/d2f/d33/f5b [3390450,42423] 0 2024-09-13T02:54:12.037 INFO:tasks.workunit.client.1.smithi131.stdout:0/600: dwrite d0/de/d45/d86/f8a [0,4194304] 0 2024-09-13T02:54:12.037 INFO:tasks.workunit.client.1.smithi131.stdout:0/601: stat d0/de/d1f/d22/d3d/d55/d63/d94/da5 0 2024-09-13T02:54:12.039 INFO:tasks.workunit.client.1.smithi131.stdout:5/392: mknod d1/c86 0 2024-09-13T02:54:12.039 INFO:tasks.workunit.client.1.smithi131.stdout:5/393: chown d1/l10 5458 1 2024-09-13T02:54:12.039 INFO:tasks.workunit.client.1.smithi131.stdout:4/489: dwrite d1/d18/f21 [0,4194304] 0 2024-09-13T02:54:12.040 INFO:tasks.workunit.client.1.smithi131.stdout:9/416: dwrite d0/f9 [0,4194304] 0 2024-09-13T02:54:12.040 INFO:tasks.workunit.client.1.smithi131.stdout:9/417: chown d0/d3/d14/d17/l6b 306161 1 2024-09-13T02:54:12.042 INFO:tasks.workunit.client.1.smithi131.stdout:6/534: dwrite d1/d8/d9/f17 [4194304,4194304] 0 2024-09-13T02:54:12.042 INFO:tasks.workunit.client.1.smithi131.stdout:3/411: dwrite d2/d4/d7/d1d/d24/d6f/f70 [0,4194304] 0 2024-09-13T02:54:12.042 INFO:tasks.workunit.client.1.smithi131.stdout:3/412: chown d2/d4/d1a/d31 92 1 2024-09-13T02:54:12.042 INFO:tasks.workunit.client.1.smithi131.stdout:3/413: readlink d2/d4/d7/d8/d41/l64 0 2024-09-13T02:54:12.042 INFO:tasks.workunit.client.1.smithi131.stdout:6/535: read d1/d8/d9/db/f36 [1725,44451] 0 2024-09-13T02:54:12.042 INFO:tasks.workunit.client.1.smithi131.stdout:6/536: write d1/d8/d9/d4b/fa1 [1287359,116722] 0 2024-09-13T02:54:12.042 INFO:tasks.workunit.client.1.smithi131.stdout:5/394: rename d1/d1c/d7e to d1/d1c/d87 0 2024-09-13T02:54:12.042 INFO:tasks.workunit.client.1.smithi131.stdout:0/602: dread d0/de/f14 [0,4194304] 0 2024-09-13T02:54:12.042 INFO:tasks.workunit.client.1.smithi131.stdout:0/603: chown d0/de/d45/d5a/f7f 25632436 1 2024-09-13T02:54:12.043 INFO:tasks.workunit.client.1.smithi131.stdout:9/418: dread d0/d3/f5b [0,4194304] 0 2024-09-13T02:54:12.043 INFO:tasks.workunit.client.1.smithi131.stdout:4/490: mkdir d1/d18/d34/d62/da3 0 2024-09-13T02:54:12.043 INFO:tasks.workunit.client.1.smithi131.stdout:0/604: dread d0/de/f14 [0,4194304] 0 2024-09-13T02:54:12.047 INFO:tasks.workunit.client.1.smithi131.stdout:3/414: unlink d2/dc/c1c 0 2024-09-13T02:54:12.048 INFO:tasks.workunit.client.1.smithi131.stdout:6/537: creat d1/d8/d9/db/fad x:0 0 0 2024-09-13T02:54:12.048 INFO:tasks.workunit.client.1.smithi131.stdout:6/538: fdatasync d1/d8/d9/db/d15/d26/d1c/d4e/f81 0 2024-09-13T02:54:12.048 INFO:tasks.workunit.client.1.smithi131.stdout:6/539: fsync d1/d8/d9/f6f 0 2024-09-13T02:54:12.049 INFO:tasks.workunit.client.1.smithi131.stdout:5/395: symlink d1/l88 0 2024-09-13T02:54:12.050 INFO:tasks.workunit.client.1.smithi131.stdout:9/419: symlink d0/d3f/l85 0 2024-09-13T02:54:12.052 INFO:tasks.workunit.client.1.smithi131.stdout:0/605: dread d0/de/d1f/d22/d31/f3a [0,4194304] 0 2024-09-13T02:54:12.052 INFO:tasks.workunit.client.1.smithi131.stdout:0/606: fsync d0/de/f59 0 2024-09-13T02:54:12.054 INFO:tasks.workunit.client.1.smithi131.stdout:4/491: rename d1/dc/d19/d29/d33/f4c to d1/d18/d43/d65/fa4 0 2024-09-13T02:54:12.054 INFO:tasks.workunit.client.1.smithi131.stdout:3/415: creat d2/d4/d7/d1d/d24/d6f/d7a/f90 x:0 0 0 2024-09-13T02:54:12.054 INFO:tasks.workunit.client.1.smithi131.stdout:4/492: write d1/dc/d22/d73/f87 [3348551,109590] 0 2024-09-13T02:54:12.056 INFO:tasks.workunit.client.1.smithi131.stdout:0/607: mkdir d0/de/d45/d5a/dda 0 2024-09-13T02:54:12.056 INFO:tasks.workunit.client.1.smithi131.stdout:0/608: chown d0/de/d1f/d22/d3d/d55/d63/d95 95 1 2024-09-13T02:54:12.056 INFO:tasks.workunit.client.1.smithi131.stdout:0/609: fsync d0/de/d1f/d22/d31/d39/d67/f5e 0 2024-09-13T02:54:12.056 INFO:tasks.workunit.client.1.smithi131.stdout:0/610: write d0/de/d1f/d22/d31/d39/f74 [752884,79340] 0 2024-09-13T02:54:12.058 INFO:tasks.workunit.client.1.smithi131.stdout:4/493: rename d1/d18/d34/d4e/f5e to d1/d18/d43/d97/fa5 0 2024-09-13T02:54:12.063 INFO:tasks.workunit.client.1.smithi131.stdout:0/611: rename d0/de/d1f/l7a to d0/de/d1f/d22/d3d/d55/d63/d95/ldb 0 2024-09-13T02:54:12.064 INFO:tasks.workunit.client.1.smithi131.stdout:9/420: dwrite d0/d4d/f68 [0,4194304] 0 2024-09-13T02:54:12.068 INFO:tasks.workunit.client.1.smithi131.stdout:9/421: symlink d0/d3/l86 0 2024-09-13T02:54:12.069 INFO:tasks.workunit.client.1.smithi131.stdout:9/422: creat d0/d3/d14/d1a/d2a/d5e/d79/f87 x:0 0 0 2024-09-13T02:54:12.069 INFO:tasks.workunit.client.1.smithi131.stdout:9/423: fsync d0/d3/d14/d1a/d2a/f62 0 2024-09-13T02:54:12.069 INFO:tasks.workunit.client.1.smithi131.stdout:9/424: chown d0/d3/d14/d17/c46 135818531 1 2024-09-13T02:54:12.071 INFO:tasks.workunit.client.1.smithi131.stdout:9/425: getdents d0/d3/d14/d1a/d2a 0 2024-09-13T02:54:12.073 INFO:tasks.workunit.client.1.smithi131.stdout:9/426: mknod d0/d3/d14/d67/c88 0 2024-09-13T02:54:12.073 INFO:tasks.workunit.client.1.smithi131.stdout:9/427: mknod d0/d3/d14/d17/c89 0 2024-09-13T02:54:12.076 INFO:tasks.workunit.client.1.smithi131.stdout:9/428: rename d0/d3/d14/d17/d66 to d0/d3/d14/d3c/d8a 0 2024-09-13T02:54:12.076 INFO:tasks.workunit.client.1.smithi131.stdout:0/612: dwrite d0/de/d1f/d22/d3d/d55/fc0 [0,4194304] 0 2024-09-13T02:54:12.077 INFO:tasks.workunit.client.1.smithi131.stdout:6/540: write d1/d8/d9/db/f36 [1139804,111476] 0 2024-09-13T02:54:12.078 INFO:tasks.workunit.client.1.smithi131.stdout:4/494: rmdir d1/d18 39 2024-09-13T02:54:12.079 INFO:tasks.workunit.client.1.smithi131.stdout:4/495: stat d1/d18/d34/d62/d78/l83 0 2024-09-13T02:54:12.079 INFO:tasks.workunit.client.1.smithi131.stdout:4/496: fsync d1/dc/f3e 0 2024-09-13T02:54:12.080 INFO:tasks.workunit.client.1.smithi131.stdout:4/497: dread d1/d18/f76 [0,4194304] 0 2024-09-13T02:54:12.080 INFO:tasks.workunit.client.1.smithi131.stdout:6/541: mknod d1/d14/da2/cae 0 2024-09-13T02:54:12.081 INFO:tasks.workunit.client.1.smithi131.stdout:6/542: write d1/d53/f8a [146540,43090] 0 2024-09-13T02:54:12.081 INFO:tasks.workunit.client.1.smithi131.stdout:6/543: getdents d1/d8/d9/d8d 0 2024-09-13T02:54:12.084 INFO:tasks.workunit.client.1.smithi131.stdout:6/544: creat d1/d8/d9/db/d15/d26/d1c/d4e/d97/d3b/faf x:0 0 0 2024-09-13T02:54:12.084 INFO:tasks.workunit.client.1.smithi131.stdout:6/545: creat d1/d8/d9/db/d15/d26/d1c/d4e/fb0 x:0 0 0 2024-09-13T02:54:12.084 INFO:tasks.workunit.client.1.smithi131.stdout:6/546: stat d1/d8/l21 0 2024-09-13T02:54:12.084 INFO:tasks.workunit.client.1.smithi131.stdout:6/547: chown d1/d8/d9/c80 43 1 2024-09-13T02:54:12.110 INFO:tasks.workunit.client.1.smithi131.stdout:0/613: dwrite d0/fc6 [4194304,4194304] 0 2024-09-13T02:54:12.115 INFO:tasks.workunit.client.1.smithi131.stdout:6/548: dwrite d1/d8/d9/db/d15/d26/d1c/d4e/d97/d3b/f98 [0,4194304] 0 2024-09-13T02:54:12.115 INFO:tasks.workunit.client.1.smithi131.stdout:9/429: dwrite d0/d4d/f6d [0,4194304] 0 2024-09-13T02:54:12.115 INFO:tasks.workunit.client.1.smithi131.stdout:9/430: fsync d0/d3/d14/d17/d32/d39/f50 0 2024-09-13T02:54:12.116 INFO:tasks.workunit.client.1.smithi131.stdout:4/498: dwrite d1/d18/d81/f8e [0,4194304] 0 2024-09-13T02:54:12.117 INFO:tasks.workunit.client.1.smithi131.stdout:6/549: creat d1/d8/d9/db/d15/fb1 x:0 0 0 2024-09-13T02:54:12.117 INFO:tasks.workunit.client.1.smithi131.stdout:6/550: truncate d1/d14/f7c 985932 0 2024-09-13T02:54:12.118 INFO:tasks.workunit.client.1.smithi131.stdout:6/551: creat d1/d8/d9/db/fb2 x:0 0 0 2024-09-13T02:54:12.120 INFO:tasks.workunit.client.1.smithi131.stdout:9/431: unlink d0/d3f/c6c 0 2024-09-13T02:54:12.120 INFO:tasks.workunit.client.1.smithi131.stdout:9/432: fsync d0/d3/d14/d1a/d2a/d5e/f80 0 2024-09-13T02:54:12.120 INFO:tasks.workunit.client.1.smithi131.stdout:9/433: write d0/d3/d14/d17/f74 [761293,67696] 0 2024-09-13T02:54:12.120 INFO:tasks.workunit.client.1.smithi131.stdout:9/434: write d0/d3/d14/d17/d32/f6a [848804,93899] 0 2024-09-13T02:54:12.121 INFO:tasks.workunit.client.1.smithi131.stdout:4/499: rmdir d1/d18/d43/d7d 39 2024-09-13T02:54:12.122 INFO:tasks.workunit.client.1.smithi131.stdout:4/500: readlink d1/l4 0 2024-09-13T02:54:12.124 INFO:tasks.workunit.client.1.smithi131.stdout:9/435: link d0/l28 d0/d4d/d55/l8b 0 2024-09-13T02:54:12.124 INFO:tasks.workunit.client.1.smithi131.stdout:9/436: stat d0/d4d/d55/d76/c82 0 2024-09-13T02:54:12.124 INFO:tasks.workunit.client.1.smithi131.stdout:9/437: creat d0/d3/d14/d1a/d2a/d5e/f8c x:0 0 0 2024-09-13T02:54:12.124 INFO:tasks.workunit.client.1.smithi131.stdout:4/501: mkdir d1/d18/d34/d62/da3/da6 0 2024-09-13T02:54:12.127 INFO:tasks.workunit.client.1.smithi131.stdout:9/438: symlink d0/d3/d14/d1a/d2a/d5e/d79/l8d 0 2024-09-13T02:54:12.127 INFO:tasks.workunit.client.1.smithi131.stdout:4/502: symlink d1/d18/d34/d62/d78/la7 0 2024-09-13T02:54:12.128 INFO:tasks.workunit.client.1.smithi131.stdout:9/439: creat d0/d3/d14/d3c/d8a/f8e x:0 0 0 2024-09-13T02:54:12.128 INFO:tasks.workunit.client.1.smithi131.stdout:9/440: read d0/f11 [1648382,16229] 0 2024-09-13T02:54:12.130 INFO:tasks.workunit.client.1.smithi131.stdout:4/503: mkdir d1/dc/d19/d29/d33/d3a/da8 0 2024-09-13T02:54:12.131 INFO:tasks.workunit.client.1.smithi131.stdout:4/504: symlink d1/dc/d19/d29/d8d/la9 0 2024-09-13T02:54:12.132 INFO:tasks.workunit.client.1.smithi131.stdout:4/505: mknod d1/dc/d19/d29/d33/d3a/caa 0 2024-09-13T02:54:12.133 INFO:tasks.workunit.client.1.smithi131.stdout:0/614: dwrite d0/d2/fce [0,4194304] 0 2024-09-13T02:54:12.134 INFO:tasks.workunit.client.1.smithi131.stdout:0/615: fdatasync d0/de/d1f/d22/d31/d39/d67/f5e 0 2024-09-13T02:54:12.134 INFO:tasks.workunit.client.1.smithi131.stdout:4/506: unlink d1/dc/d22/l46 0 2024-09-13T02:54:12.136 INFO:tasks.workunit.client.1.smithi131.stdout:4/507: mknod d1/dc/cab 0 2024-09-13T02:54:12.137 INFO:tasks.workunit.client.1.smithi131.stdout:4/508: rename d1/d18/c48 to d1/d18/d81/cac 0 2024-09-13T02:54:12.137 INFO:tasks.workunit.client.1.smithi131.stdout:4/509: symlink d1/d8/lad 0 2024-09-13T02:54:12.138 INFO:tasks.workunit.client.1.smithi131.stdout:4/510: creat d1/dc/fae x:0 0 0 2024-09-13T02:54:12.138 INFO:tasks.workunit.client.1.smithi131.stdout:4/511: chown d1/d18/d34/d62/d78/c98 30752544 1 2024-09-13T02:54:12.141 INFO:tasks.workunit.client.1.smithi131.stdout:0/616: dread d0/de/d1f/fbd [0,4194304] 0 2024-09-13T02:54:12.141 INFO:tasks.workunit.client.1.smithi131.stdout:0/617: fsync d0/d2/d41/f79 0 2024-09-13T02:54:12.141 INFO:tasks.workunit.client.1.smithi131.stdout:6/552: dwrite d1/fe [0,4194304] 0 2024-09-13T02:54:12.142 INFO:tasks.workunit.client.1.smithi131.stdout:9/441: dwrite d0/f63 [0,4194304] 0 2024-09-13T02:54:12.143 INFO:tasks.workunit.client.1.smithi131.stdout:6/553: symlink d1/d14/da2/lb3 0 2024-09-13T02:54:12.144 INFO:tasks.workunit.client.1.smithi131.stdout:9/442: symlink d0/d4d/d55/l8f 0 2024-09-13T02:54:12.146 INFO:tasks.workunit.client.1.smithi131.stdout:9/443: link d0/f11 d0/f90 0 2024-09-13T02:54:12.146 INFO:tasks.workunit.client.1.smithi131.stdout:9/444: write d0/d3/d14/d3c/d8a/f8e [491999,77372] 0 2024-09-13T02:54:12.147 INFO:tasks.workunit.client.1.smithi131.stdout:9/445: truncate d0/d3/d14/d1a/d2a/d5e/d79/f87 682266 0 2024-09-13T02:54:12.151 INFO:tasks.workunit.client.1.smithi131.stdout:0/618: write d0/d2/d62/f85 [3532625,129960] 0 2024-09-13T02:54:12.154 INFO:tasks.workunit.client.1.smithi131.stdout:4/512: dwrite d1/d8/f1d [0,4194304] 0 2024-09-13T02:54:12.156 INFO:tasks.workunit.client.1.smithi131.stdout:4/513: mknod d1/d18/d34/caf 0 2024-09-13T02:54:12.156 INFO:tasks.workunit.client.1.smithi131.stdout:4/514: read - d1/d8/d13/f30 zero size 2024-09-13T02:54:12.156 INFO:tasks.workunit.client.1.smithi131.stdout:4/515: chown d1/d18/d34/d4e 30417181 1 2024-09-13T02:54:12.156 INFO:tasks.workunit.client.1.smithi131.stdout:4/516: readlink d1/dc/d19/d29/l3c 0 2024-09-13T02:54:12.157 INFO:tasks.workunit.client.1.smithi131.stdout:0/619: dread d0/de/fd7 [0,4194304] 0 2024-09-13T02:54:12.157 INFO:tasks.workunit.client.1.smithi131.stdout:6/554: read d1/d8/d9/db/d15/d26/f3a [1384648,32905] 0 2024-09-13T02:54:12.157 INFO:tasks.workunit.client.1.smithi131.stdout:6/555: creat d1/d8/d9/db/d40/fb4 x:0 0 0 2024-09-13T02:54:12.158 INFO:tasks.workunit.client.1.smithi131.stdout:0/620: creat d0/de/da3/fdc x:0 0 0 2024-09-13T02:54:12.160 INFO:tasks.workunit.client.1.smithi131.stdout:0/621: truncate d0/f90 3943514 0 2024-09-13T02:54:12.165 INFO:tasks.workunit.client.1.smithi131.stdout:9/446: dwrite d0/d3/d14/d1a/d2a/f5a [0,4194304] 0 2024-09-13T02:54:12.187 INFO:tasks.workunit.client.1.smithi131.stdout:0/622: dwrite d0/de/d1f/d22/d31/d39/f74 [0,4194304] 0 2024-09-13T02:54:12.187 INFO:tasks.workunit.client.1.smithi131.stdout:0/623: chown d0/de/d1f/d22/l5c 65797009 1 2024-09-13T02:54:12.187 INFO:tasks.workunit.client.1.smithi131.stdout:0/624: write d0/de/d1f/fbd [813931,20113] 0 2024-09-13T02:54:12.187 INFO:tasks.workunit.client.1.smithi131.stdout:6/556: dwrite d1/d8/d9/db/d15/f3c [0,4194304] 0 2024-09-13T02:54:12.187 INFO:tasks.workunit.client.1.smithi131.stdout:6/557: creat d1/d8/d9/db/d15/d26/d1c/d79/d92/fb5 x:0 0 0 2024-09-13T02:54:12.198 INFO:tasks.workunit.client.1.smithi131.stdout:0/625: write d0/de/d1f/d22/d31/d39/d40/f7c [2842105,67109] 0 2024-09-13T02:54:12.200 INFO:tasks.workunit.client.1.smithi131.stdout:0/626: readlink d0/de/d1f/l6a 0 2024-09-13T02:54:12.201 INFO:tasks.workunit.client.1.smithi131.stdout:8/384: sync 2024-09-13T02:54:12.203 INFO:tasks.workunit.client.1.smithi131.stdout:6/558: dwrite d1/d8/d9/db/d40/fb4 [0,4194304] 0 2024-09-13T02:54:12.203 INFO:tasks.workunit.client.1.smithi131.stdout:6/559: readlink d1/d8/d9/db/d40/l4a 0 2024-09-13T02:54:12.203 INFO:tasks.workunit.client.1.smithi131.stdout:6/560: chown d1/d8/d9/db/d15/d26/d1c/d79/d92/fb5 116776701 1 2024-09-13T02:54:12.204 INFO:tasks.workunit.client.1.smithi131.stdout:6/561: chown d1/d8/f62 1771826314 1 2024-09-13T02:54:12.206 INFO:tasks.workunit.client.1.smithi131.stdout:6/562: rmdir d1/d8/d9/d4b/d8e 39 2024-09-13T02:54:12.216 INFO:tasks.workunit.client.1.smithi131.stdout:0/627: read d0/de/d1f/d22/d31/f60 [3338771,26550] 0 2024-09-13T02:54:12.227 INFO:tasks.workunit.client.1.smithi131.stdout:8/385: dwrite db/d1d/d1f/d41/f62 [0,4194304] 0 2024-09-13T02:54:12.227 INFO:tasks.workunit.client.1.smithi131.stdout:8/386: write db/f30 [1240500,40385] 0 2024-09-13T02:54:12.234 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.232+0000 7f2606ffd640 1 -- 172.21.15.89:0/3515808943 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f25f0032610 con 0x7f2608064b00 2024-09-13T02:54:12.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.233+0000 7f260db52640 1 -- 172.21.15.89:0/3515808943 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2608064b00 msgr2=0x7f26080fb0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:12.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.233+0000 7f260db52640 1 --2- 172.21.15.89:0/3515808943 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2608064b00 0x7f26080fb0f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f25f0004810 tx=0x7f25f0009da0 comp rx=0 tx=0).stop 2024-09-13T02:54:12.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.233+0000 7f260db52640 1 -- 172.21.15.89:0/3515808943 shutdown_connections 2024-09-13T02:54:12.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.233+0000 7f260db52640 1 --2- 172.21.15.89:0/3515808943 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2608064b00 0x7f26080fb0f0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:12.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.233+0000 7f260db52640 1 --2- 172.21.15.89:0/3515808943 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f26080646f0 0x7f26080fabb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:12.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.233+0000 7f260db52640 1 -- 172.21.15.89:0/3515808943 >> 172.21.15.89:0/3515808943 conn(0x7f26080f6390 msgr2=0x7f26080f87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:54:12.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.234+0000 7f260db52640 1 -- 172.21.15.89:0/3515808943 shutdown_connections 2024-09-13T02:54:12.236 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.235+0000 7f260db52640 1 -- 172.21.15.89:0/3515808943 wait complete. 2024-09-13T02:54:12.237 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.236+0000 7f260db52640 1 Processor -- start 2024-09-13T02:54:12.237 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.236+0000 7f260db52640 1 -- start start 2024-09-13T02:54:12.238 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.236+0000 7f260db52640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f26080646f0 0x7f260810f270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:54:12.238 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.236+0000 7f260db52640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2608064b00 0x7f260810f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:54:12.238 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.236+0000 7f260db52640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f260810fe00 con 0x7f26080646f0 2024-09-13T02:54:12.238 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.236+0000 7f260db52640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2608110620 con 0x7f2608064b00 2024-09-13T02:54:12.239 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.237+0000 7f26077fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f26080646f0 0x7f260810f270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:54:12.239 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.237+0000 7f26077fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f26080646f0 0x7f260810f270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:46334/0 (socket says 172.21.15.89:46334) 2024-09-13T02:54:12.239 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.237+0000 7f26077fe640 1 -- 172.21.15.89:0/3951446514 learned_addr learned my addr 172.21.15.89:0/3951446514 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:54:12.239 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.237+0000 7f25feffd640 1 --2- 172.21.15.89:0/3951446514 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2608064b00 0x7f260810f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:54:12.239 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.237+0000 7f26077fe640 1 -- 172.21.15.89:0/3951446514 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2608064b00 msgr2=0x7f260810f7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:12.239 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.237+0000 7f26077fe640 1 --2- 172.21.15.89:0/3951446514 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2608064b00 0x7f260810f7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:12.239 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.237+0000 7f26077fe640 1 -- 172.21.15.89:0/3951446514 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25f0005040 con 0x7f26080646f0 2024-09-13T02:54:12.240 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.238+0000 7f26077fe640 1 --2- 172.21.15.89:0/3951446514 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f26080646f0 0x7f260810f270 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f25f8002a50 tx=0x7f25f8009f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:54:12.240 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.238+0000 7f2604ff9640 1 -- 172.21.15.89:0/3951446514 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f25f8007c30 con 0x7f26080646f0 2024-09-13T02:54:12.240 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.238+0000 7f2604ff9640 1 -- 172.21.15.89:0/3951446514 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f25f800f040 con 0x7f26080646f0 2024-09-13T02:54:12.240 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.238+0000 7f260db52640 1 -- 172.21.15.89:0/3951446514 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26081108b0 con 0x7f26080646f0 2024-09-13T02:54:12.241 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.238+0000 7f2604ff9640 1 -- 172.21.15.89:0/3951446514 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f25f80094b0 con 0x7f26080646f0 2024-09-13T02:54:12.241 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.238+0000 7f260db52640 1 -- 172.21.15.89:0/3951446514 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2608110e50 con 0x7f26080646f0 2024-09-13T02:54:12.241 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.240+0000 7f260db52640 1 -- 172.21.15.89:0/3951446514 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26080fa010 con 0x7f26080646f0 2024-09-13T02:54:12.242 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.241+0000 7f2604ff9640 1 -- 172.21.15.89:0/3951446514 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f25f8009630 con 0x7f26080646f0 2024-09-13T02:54:12.242 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.241+0000 7f2604ff9640 1 --2- 172.21.15.89:0/3951446514 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f25f406ed50 0x7f25f4071200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:54:12.243 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.241+0000 7f2604ff9640 1 -- 172.21.15.89:0/3951446514 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f25f808d9e0 con 0x7f26080646f0 2024-09-13T02:54:12.243 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.242+0000 7f25feffd640 1 --2- 172.21.15.89:0/3951446514 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f25f406ed50 0x7f25f4071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:54:12.244 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.243+0000 7f25feffd640 1 --2- 172.21.15.89:0/3951446514 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f25f406ed50 0x7f25f4071200 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f260810f020 tx=0x7f25f0035040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:54:12.248 INFO:tasks.workunit.client.1.smithi131.stdout:8/387: dwrite db/d1d/d1f/d41/f62 [0,4194304] 0 2024-09-13T02:54:12.248 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.247+0000 7f2604ff9640 1 -- 172.21.15.89:0/3951446514 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f25f804d2a0 con 0x7f26080646f0 2024-09-13T02:54:12.258 INFO:tasks.workunit.client.1.smithi131.stdout:8/388: dread db/d1d/d1f/f52 [0,4194304] 0 2024-09-13T02:54:12.259 INFO:tasks.workunit.client.1.smithi131.stdout:8/389: creat db/d2b/d39/d56/f73 x:0 0 0 2024-09-13T02:54:12.260 INFO:tasks.workunit.client.1.smithi131.stdout:8/390: mknod db/d1d/d1f/c74 0 2024-09-13T02:54:12.261 INFO:tasks.workunit.client.1.smithi131.stdout:8/391: symlink db/l75 0 2024-09-13T02:54:12.271 INFO:tasks.workunit.client.1.smithi131.stdout:8/392: write db/d2e/f43 [2387389,118598] 0 2024-09-13T02:54:12.274 INFO:tasks.workunit.client.1.smithi131.stdout:8/393: rename db/d1d/d34/f3f to db/d1d/d1f/f76 0 2024-09-13T02:54:12.276 INFO:tasks.workunit.client.1.smithi131.stdout:8/394: truncate db/d1d/f28 1460461 0 2024-09-13T02:54:12.278 INFO:tasks.workunit.client.1.smithi131.stdout:8/395: creat db/d2b/d39/f77 x:0 0 0 2024-09-13T02:54:12.283 INFO:tasks.workunit.client.1.smithi131.stdout:8/396: write f2 [8165266,39443] 0 2024-09-13T02:54:12.284 INFO:tasks.workunit.client.1.smithi131.stdout:8/397: truncate db/d1d/d1f/d5c/f64 969276 0 2024-09-13T02:54:12.284 INFO:tasks.workunit.client.1.smithi131.stdout:8/398: fsync db/d1d/d1f/d41/f55 0 2024-09-13T02:54:12.285 INFO:tasks.workunit.client.1.smithi131.stdout:8/399: fdatasync db/d1d/f28 0 2024-09-13T02:54:12.299 INFO:tasks.workunit.client.1.smithi131.stdout:8/400: dwrite db/d1d/d1f/d41/f5d [0,4194304] 0 2024-09-13T02:54:12.301 INFO:tasks.workunit.client.1.smithi131.stdout:8/401: mknod db/d1d/d1f/d66/c78 0 2024-09-13T02:54:12.309 INFO:tasks.workunit.client.1.smithi131.stdout:8/402: dread db/f18 [0,4194304] 0 2024-09-13T02:54:12.350 INFO:tasks.workunit.client.1.smithi131.stdout:7/435: sync 2024-09-13T02:54:12.350 INFO:tasks.workunit.client.1.smithi131.stdout:2/430: sync 2024-09-13T02:54:12.351 INFO:tasks.workunit.client.1.smithi131.stdout:2/431: mkdir d5/d31/d21/d57/d94 0 2024-09-13T02:54:12.356 INFO:tasks.workunit.client.1.smithi131.stdout:2/432: write d5/d18/d4b/d8e/f4d [816782,84002] 0 2024-09-13T02:54:12.358 INFO:tasks.workunit.client.1.smithi131.stdout:2/433: link d5/d18/d4b/d8e/l6d d5/d33/d41/l95 0 2024-09-13T02:54:12.358 INFO:tasks.workunit.client.1.smithi131.stdout:2/434: write d5/d31/d1d/d32/f6f [514809,118315] 0 2024-09-13T02:54:12.358 INFO:tasks.workunit.client.1.smithi131.stdout:2/435: fsync d5/f9 0 2024-09-13T02:54:12.359 INFO:tasks.workunit.client.1.smithi131.stdout:2/436: dread d5/d34/f65 [0,4194304] 0 2024-09-13T02:54:12.367 INFO:tasks.workunit.client.1.smithi131.stdout:2/437: dread d5/d31/d1d/d32/f6f [0,4194304] 0 2024-09-13T02:54:12.368 INFO:tasks.workunit.client.1.smithi131.stdout:2/438: truncate d5/d31/d1d/d32/f49 545899 0 2024-09-13T02:54:12.368 INFO:tasks.workunit.client.1.smithi131.stdout:2/439: truncate d5/d6e/f92 455672 0 2024-09-13T02:54:12.368 INFO:tasks.workunit.client.1.smithi131.stdout:2/440: chown d5/d31/d26/c58 189414426 1 2024-09-13T02:54:12.368 INFO:tasks.workunit.client.1.smithi131.stdout:2/441: chown d5/d31/d21/d57/d94 7 1 2024-09-13T02:54:12.376 INFO:tasks.workunit.client.1.smithi131.stdout:7/436: dwrite d1b/f2f [0,4194304] 0 2024-09-13T02:54:12.376 INFO:tasks.workunit.client.1.smithi131.stdout:2/442: dread d5/d31/d1d/d37/d7c/f80 [0,4194304] 0 2024-09-13T02:54:12.376 INFO:tasks.workunit.client.1.smithi131.stdout:2/443: chown d5/d33/d41/f4a 157370 1 2024-09-13T02:54:12.377 INFO:tasks.workunit.client.1.smithi131.stdout:7/437: creat d1b/d3b/d31/f95 x:0 0 0 2024-09-13T02:54:12.378 INFO:tasks.workunit.client.1.smithi131.stdout:2/444: creat d5/d31/d4e/d76/f96 x:0 0 0 2024-09-13T02:54:12.378 INFO:tasks.workunit.client.1.smithi131.stdout:2/445: chown d5/d31/d1d/l1f 101 1 2024-09-13T02:54:12.379 INFO:tasks.workunit.client.1.smithi131.stdout:7/438: creat d1b/d3b/d46/d4b/d57/d7b/d92/f96 x:0 0 0 2024-09-13T02:54:12.380 INFO:tasks.workunit.client.1.smithi131.stdout:2/446: creat d5/d31/d26/d8d/f97 x:0 0 0 2024-09-13T02:54:12.381 INFO:tasks.workunit.client.1.smithi131.stdout:7/439: creat d1b/d3b/d41/d81/f97 x:0 0 0 2024-09-13T02:54:12.381 INFO:tasks.workunit.client.1.smithi131.stdout:7/440: chown d1b/l1c 43 1 2024-09-13T02:54:12.382 INFO:tasks.workunit.client.1.smithi131.stdout:2/447: creat d5/d18/d4b/d8e/f98 x:0 0 0 2024-09-13T02:54:12.384 INFO:tasks.workunit.client.1.smithi131.stdout:7/441: unlink d1b/d23/f33 0 2024-09-13T02:54:12.386 INFO:tasks.workunit.client.1.smithi131.stdout:7/442: rename d1b/d3b/d31/d38/f50 to d1b/d3b/d46/f98 0 2024-09-13T02:54:12.386 INFO:tasks.workunit.client.1.smithi131.stdout:7/443: chown d1b/d3b/l35 11889 1 2024-09-13T02:54:12.394 INFO:tasks.workunit.client.1.smithi131.stdout:7/444: dread d1b/d23/f28 [0,4194304] 0 2024-09-13T02:54:12.396 INFO:tasks.workunit.client.1.smithi131.stdout:7/445: truncate f4 3098684 0 2024-09-13T02:54:12.406 INFO:tasks.workunit.client.1.smithi131.stdout:7/446: read d1b/d3b/d46/f6e [3438701,43615] 0 2024-09-13T02:54:12.407 INFO:tasks.workunit.client.1.smithi131.stdout:7/447: mkdir d1b/d3b/d51/d8b/d99 0 2024-09-13T02:54:12.408 INFO:tasks.workunit.client.1.smithi131.stdout:7/448: link d1b/c25 d1b/d23/d89/c9a 0 2024-09-13T02:54:12.409 INFO:tasks.workunit.client.1.smithi131.stdout:7/449: link d1b/d3b/d31/d38/l49 d1b/d3b/d51/d62/l9b 0 2024-09-13T02:54:12.409 INFO:tasks.workunit.client.1.smithi131.stdout:7/450: creat d1b/d3b/d31/d5f/f9c x:0 0 0 2024-09-13T02:54:12.431 INFO:tasks.workunit.client.1.smithi131.stdout:7/451: dwrite d1b/f21 [0,4194304] 0 2024-09-13T02:54:12.431 INFO:tasks.workunit.client.1.smithi131.stdout:7/452: fdatasync d1b/d23/f28 0 2024-09-13T02:54:12.457 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.455+0000 7f260db52640 1 -- 172.21.15.89:0/3951446514 --> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f26081111a0 con 0x7f25f406ed50 2024-09-13T02:54:12.457 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:12 smithi089 ceph-mon[27639]: pgmap v248: 65 pgs: 65 active+clean; 2.8 GiB data, 9.8 GiB used, 527 GiB / 536 GiB avail; 200 MiB/s rd, 227 MiB/s wr, 336 op/s 2024-09-13T02:54:12.458 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.456+0000 7f2604ff9640 1 -- 172.21.15.89:0/3951446514 <== mgr.14204 v2:172.21.15.89:6800/1506060926 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7f26081111a0 con 0x7f25f406ed50 2024-09-13T02:54:12.460 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.458+0000 7f260db52640 1 -- 172.21.15.89:0/3951446514 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f25f406ed50 msgr2=0x7f25f4071200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:12.460 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.458+0000 7f260db52640 1 --2- 172.21.15.89:0/3951446514 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f25f406ed50 0x7f25f4071200 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f260810f020 tx=0x7f25f0035040 comp rx=0 tx=0).stop 2024-09-13T02:54:12.460 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.458+0000 7f260db52640 1 -- 172.21.15.89:0/3951446514 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f26080646f0 msgr2=0x7f260810f270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:12.460 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.458+0000 7f260db52640 1 --2- 172.21.15.89:0/3951446514 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f26080646f0 0x7f260810f270 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f25f8002a50 tx=0x7f25f8009f50 comp rx=0 tx=0).stop 2024-09-13T02:54:12.460 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.458+0000 7f260db52640 1 -- 172.21.15.89:0/3951446514 shutdown_connections 2024-09-13T02:54:12.460 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.459+0000 7f260db52640 1 --2- 172.21.15.89:0/3951446514 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f25f406ed50 0x7f25f4071200 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:12.461 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.459+0000 7f260db52640 1 --2- 172.21.15.89:0/3951446514 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2608064b00 0x7f260810f7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:12.461 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.459+0000 7f260db52640 1 --2- 172.21.15.89:0/3951446514 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f26080646f0 0x7f260810f270 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:12.461 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.459+0000 7f260db52640 1 -- 172.21.15.89:0/3951446514 >> 172.21.15.89:0/3951446514 conn(0x7f26080f6390 msgr2=0x7f26080f7880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:54:12.461 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.459+0000 7f260db52640 1 -- 172.21.15.89:0/3951446514 shutdown_connections 2024-09-13T02:54:12.461 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.459+0000 7f260db52640 1 -- 172.21.15.89:0/3951446514 wait complete. 2024-09-13T02:54:12.468 INFO:teuthology.orchestra.run.smithi089.stdout:true 2024-09-13T02:54:12.543 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.541+0000 7f65f6dc7640 1 -- 172.21.15.89:0/3635355085 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65f00ff6e0 msgr2=0x7f65f0101ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:12.543 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.541+0000 7f65f6dc7640 1 --2- 172.21.15.89:0/3635355085 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65f00ff6e0 0x7f65f0101ac0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f65e0009c50 tx=0x7f65e0004d10 comp rx=0 tx=0).stop 2024-09-13T02:54:12.543 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.542+0000 7f65f6dc7640 1 -- 172.21.15.89:0/3635355085 shutdown_connections 2024-09-13T02:54:12.543 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.542+0000 7f65f6dc7640 1 --2- 172.21.15.89:0/3635355085 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65f00ff6e0 0x7f65f0101ac0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:12.544 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.542+0000 7f65f6dc7640 1 --2- 172.21.15.89:0/3635355085 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f65f0065be0 0x7f65f00ff1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:12.544 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.542+0000 7f65f6dc7640 1 -- 172.21.15.89:0/3635355085 >> 172.21.15.89:0/3635355085 conn(0x7f65f00f6c10 msgr2=0x7f65f00f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:54:12.544 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.542+0000 7f65f6dc7640 1 -- 172.21.15.89:0/3635355085 shutdown_connections 2024-09-13T02:54:12.544 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.542+0000 7f65f6dc7640 1 -- 172.21.15.89:0/3635355085 wait complete. 2024-09-13T02:54:12.544 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.542+0000 7f65f6dc7640 1 Processor -- start 2024-09-13T02:54:12.544 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.542+0000 7f65f6dc7640 1 -- start start 2024-09-13T02:54:12.546 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.542+0000 7f65f6dc7640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f65f0065be0 0x7f65f00fcbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:54:12.546 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.542+0000 7f65f6dc7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65f00ff6e0 0x7f65f00fb0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:54:12.546 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.542+0000 7f65f6dc7640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65f00fb630 con 0x7f65f00ff6e0 2024-09-13T02:54:12.546 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.542+0000 7f65f6dc7640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65f00fb770 con 0x7f65f0065be0 2024-09-13T02:54:12.546 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.543+0000 7f65effff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65f00ff6e0 0x7f65f00fb0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:54:12.546 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.543+0000 7f65effff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65f00ff6e0 0x7f65f00fb0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:46354/0 (socket says 172.21.15.89:46354) 2024-09-13T02:54:12.546 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.543+0000 7f65effff640 1 -- 172.21.15.89:0/488581607 learned_addr learned my addr 172.21.15.89:0/488581607 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:54:12.546 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.543+0000 7f65f4b63640 1 --2- 172.21.15.89:0/488581607 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f65f0065be0 0x7f65f00fcbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:54:12.546 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.543+0000 7f65effff640 1 -- 172.21.15.89:0/488581607 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f65f0065be0 msgr2=0x7f65f00fcbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:12.546 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.543+0000 7f65effff640 1 --2- 172.21.15.89:0/488581607 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f65f0065be0 0x7f65f00fcbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:12.546 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.543+0000 7f65effff640 1 -- 172.21.15.89:0/488581607 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65e00098b0 con 0x7f65f00ff6e0 2024-09-13T02:54:12.547 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.543+0000 7f65effff640 1 --2- 172.21.15.89:0/488581607 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65f00ff6e0 0x7f65f00fb0a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f65e0004a30 tx=0x7f65e0004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:54:12.547 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.543+0000 7f65ed7fa640 1 -- 172.21.15.89:0/488581607 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f65e0032a60 con 0x7f65f00ff6e0 2024-09-13T02:54:12.547 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.543+0000 7f65ed7fa640 1 -- 172.21.15.89:0/488581607 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f65e0008f00 con 0x7f65f00ff6e0 2024-09-13T02:54:12.547 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.543+0000 7f65f6dc7640 1 -- 172.21.15.89:0/488581607 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65f00fb9f0 con 0x7f65f00ff6e0 2024-09-13T02:54:12.547 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.543+0000 7f65ed7fa640 1 -- 172.21.15.89:0/488581607 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f65e00313d0 con 0x7f65f00ff6e0 2024-09-13T02:54:12.547 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.543+0000 7f65f6dc7640 1 -- 172.21.15.89:0/488581607 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65f01150a0 con 0x7f65f00ff6e0 2024-09-13T02:54:12.547 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.545+0000 7f65f6dc7640 1 -- 172.21.15.89:0/488581607 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65f00fa890 con 0x7f65f00ff6e0 2024-09-13T02:54:12.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.545+0000 7f65ed7fa640 1 -- 172.21.15.89:0/488581607 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f65e002f030 con 0x7f65f00ff6e0 2024-09-13T02:54:12.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.545+0000 7f65ed7fa640 1 --2- 172.21.15.89:0/488581607 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f65dc06ed60 0x7f65dc071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:54:12.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.545+0000 7f65ed7fa640 1 -- 172.21.15.89:0/488581607 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f65e00afb70 con 0x7f65f00ff6e0 2024-09-13T02:54:12.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.545+0000 7f65f4b63640 1 --2- 172.21.15.89:0/488581607 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f65dc06ed60 0x7f65dc071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:54:12.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.546+0000 7f65f4b63640 1 --2- 172.21.15.89:0/488581607 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f65dc06ed60 0x7f65dc071210 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f65f00fc960 tx=0x7f65d800b040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:54:12.550 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.549+0000 7f65ed7fa640 1 -- 172.21.15.89:0/488581607 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f65e007cc40 con 0x7f65f00ff6e0 2024-09-13T02:54:12.560 INFO:tasks.workunit.client.1.smithi131.stdout:1/457: sync 2024-09-13T02:54:12.573 INFO:tasks.workunit.client.1.smithi131.stdout:1/458: dwrite dd/d33/d42/f48 [0,4194304] 0 2024-09-13T02:54:12.583 INFO:tasks.workunit.client.1.smithi131.stdout:1/459: write dd/d26/d44/f25 [657860,9441] 0 2024-09-13T02:54:12.585 INFO:tasks.workunit.client.1.smithi131.stdout:1/460: rmdir dd/d33/d80 39 2024-09-13T02:54:12.683 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:12 smithi131 ceph-mon[34689]: pgmap v248: 65 pgs: 65 active+clean; 2.8 GiB data, 9.8 GiB used, 527 GiB / 536 GiB avail; 200 MiB/s rd, 227 MiB/s wr, 336 op/s 2024-09-13T02:54:12.719 INFO:tasks.workunit.client.1.smithi131.stdout:5/396: sync 2024-09-13T02:54:12.720 INFO:tasks.workunit.client.1.smithi131.stdout:5/397: rename d1/d29/d39/d45/f6c to d1/d2f/d33/f89 0 2024-09-13T02:54:12.721 INFO:tasks.workunit.client.1.smithi131.stdout:5/398: fsync d1/d29/f2e 0 2024-09-13T02:54:12.721 INFO:tasks.workunit.client.1.smithi131.stdout:5/399: unlink d1/d1c/f53 0 2024-09-13T02:54:12.722 INFO:tasks.workunit.client.1.smithi131.stdout:5/400: fdatasync d1/d2f/d33/f81 0 2024-09-13T02:54:12.722 INFO:tasks.workunit.client.1.smithi131.stdout:5/401: symlink d1/d29/l8a 0 2024-09-13T02:54:12.734 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.732+0000 7f65f6dc7640 1 -- 172.21.15.89:0/488581607 --> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f65f00f8700 con 0x7f65dc06ed60 2024-09-13T02:54:12.735 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.733+0000 7f65ed7fa640 1 -- 172.21.15.89:0/488581607 <== mgr.14204 v2:172.21.15.89:6800/1506060926 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7f65f00f8700 con 0x7f65dc06ed60 2024-09-13T02:54:12.737 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.735+0000 7f65f6dc7640 1 -- 172.21.15.89:0/488581607 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f65dc06ed60 msgr2=0x7f65dc071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:12.737 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.736+0000 7f65f6dc7640 1 --2- 172.21.15.89:0/488581607 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f65dc06ed60 0x7f65dc071210 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f65f00fc960 tx=0x7f65d800b040 comp rx=0 tx=0).stop 2024-09-13T02:54:12.737 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.736+0000 7f65f6dc7640 1 -- 172.21.15.89:0/488581607 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65f00ff6e0 msgr2=0x7f65f00fb0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:12.737 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.736+0000 7f65f6dc7640 1 --2- 172.21.15.89:0/488581607 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65f00ff6e0 0x7f65f00fb0a0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f65e0004a30 tx=0x7f65e0004d10 comp rx=0 tx=0).stop 2024-09-13T02:54:12.737 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.736+0000 7f65f6dc7640 1 -- 172.21.15.89:0/488581607 shutdown_connections 2024-09-13T02:54:12.738 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.736+0000 7f65f6dc7640 1 --2- 172.21.15.89:0/488581607 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f65f00ff6e0 0x7f65f00fb0a0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:12.738 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.736+0000 7f65f6dc7640 1 --2- 172.21.15.89:0/488581607 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f65dc06ed60 0x7f65dc071210 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:12.738 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.736+0000 7f65f6dc7640 1 --2- 172.21.15.89:0/488581607 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f65f0065be0 0x7f65f00fcbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:12.738 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.736+0000 7f65f6dc7640 1 -- 172.21.15.89:0/488581607 >> 172.21.15.89:0/488581607 conn(0x7f65f00f6c10 msgr2=0x7f65f00f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:54:12.738 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.736+0000 7f65f6dc7640 1 -- 172.21.15.89:0/488581607 shutdown_connections 2024-09-13T02:54:12.738 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.736+0000 7f65f6dc7640 1 -- 172.21.15.89:0/488581607 wait complete. 2024-09-13T02:54:12.739 INFO:tasks.workunit.client.1.smithi131.stdout:5/402: dwrite d1/d1c/f1d [4194304,4194304] 0 2024-09-13T02:54:12.749 INFO:tasks.workunit.client.1.smithi131.stdout:5/403: dread d1/d5/f12 [0,4194304] 0 2024-09-13T02:54:12.763 INFO:tasks.workunit.client.1.smithi131.stdout:5/404: dwrite d1/d29/d39/d45/f43 [4194304,4194304] 0 2024-09-13T02:54:12.764 INFO:tasks.workunit.client.1.smithi131.stdout:5/405: fsync d1/d5/fa 0 2024-09-13T02:54:12.765 INFO:tasks.workunit.client.1.smithi131.stdout:5/406: rename d1/d21/c5e to d1/d21/d74/d78/c8b 0 2024-09-13T02:54:12.766 INFO:tasks.workunit.client.1.smithi131.stdout:5/407: truncate d1/d21/f51 2653410 0 2024-09-13T02:54:12.767 INFO:tasks.workunit.client.1.smithi131.stdout:5/408: mkdir d1/d2f/d8c 0 2024-09-13T02:54:12.783 INFO:tasks.workunit.client.1.smithi131.stdout:5/409: dwrite d1/d1c/f3b [0,4194304] 0 2024-09-13T02:54:12.784 INFO:tasks.workunit.client.1.smithi131.stdout:5/410: creat d1/d29/f8d x:0 0 0 2024-09-13T02:54:12.785 INFO:tasks.workunit.client.1.smithi131.stdout:5/411: truncate d1/d29/d39/f72 1738620 0 2024-09-13T02:54:12.786 INFO:tasks.workunit.client.1.smithi131.stdout:5/412: rename d1/d29/d39/d45 to d1/d1c/d8e 0 2024-09-13T02:54:12.830 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.827+0000 7fe5ee391640 1 -- 172.21.15.89:0/2013659893 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe5e80fc700 msgr2=0x7fe5e80fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:12.830 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.827+0000 7fe5ee391640 1 --2- 172.21.15.89:0/2013659893 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe5e80fc700 0x7fe5e80fcb70 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fe5dc0048d0 tx=0x7fe5dc009da0 comp rx=0 tx=0).stop 2024-09-13T02:54:12.830 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.827+0000 7fe5ee391640 1 -- 172.21.15.89:0/2013659893 shutdown_connections 2024-09-13T02:54:12.830 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.827+0000 7fe5ee391640 1 --2- 172.21.15.89:0/2013659893 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe5e80fc700 0x7fe5e80fcb70 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:12.830 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.827+0000 7fe5ee391640 1 --2- 172.21.15.89:0/2013659893 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe5e80fb430 0x7fe5e80fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:12.830 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.827+0000 7fe5ee391640 1 -- 172.21.15.89:0/2013659893 >> 172.21.15.89:0/2013659893 conn(0x7fe5e80f6c10 msgr2=0x7fe5e80f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:54:12.830 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.827+0000 7fe5ee391640 1 -- 172.21.15.89:0/2013659893 shutdown_connections 2024-09-13T02:54:12.831 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.827+0000 7fe5ee391640 1 -- 172.21.15.89:0/2013659893 wait complete. 2024-09-13T02:54:12.831 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.827+0000 7fe5ee391640 1 Processor -- start 2024-09-13T02:54:12.831 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.827+0000 7fe5ee391640 1 -- start start 2024-09-13T02:54:12.831 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.828+0000 7fe5ee391640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe5e80fb430 0x7fe5e810fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:54:12.831 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.828+0000 7fe5ee391640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe5e80fc700 0x7fe5e81122d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:54:12.831 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.828+0000 7fe5ee391640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e8065c60 con 0x7fe5e80fb430 2024-09-13T02:54:12.831 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.828+0000 7fe5ee391640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e8065dd0 con 0x7fe5e80fc700 2024-09-13T02:54:12.831 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.828+0000 7fe5e7fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe5e80fb430 0x7fe5e810fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:54:12.831 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.828+0000 7fe5e7fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe5e80fb430 0x7fe5e810fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:46368/0 (socket says 172.21.15.89:46368) 2024-09-13T02:54:12.831 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.828+0000 7fe5e7fff640 1 -- 172.21.15.89:0/4144262455 learned_addr learned my addr 172.21.15.89:0/4144262455 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:54:12.831 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.828+0000 7fe5e77fe640 1 --2- 172.21.15.89:0/4144262455 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe5e80fc700 0x7fe5e81122d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:54:12.831 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.828+0000 7fe5e7fff640 1 -- 172.21.15.89:0/4144262455 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe5e80fc700 msgr2=0x7fe5e81122d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:12.832 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.828+0000 7fe5e7fff640 1 --2- 172.21.15.89:0/4144262455 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe5e80fc700 0x7fe5e81122d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:12.832 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.828+0000 7fe5e7fff640 1 -- 172.21.15.89:0/4144262455 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5dc005040 con 0x7fe5e80fb430 2024-09-13T02:54:12.832 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.828+0000 7fe5e7fff640 1 --2- 172.21.15.89:0/4144262455 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe5e80fb430 0x7fe5e810fd80 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fe5d8002a80 tx=0x7fe5d8004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:54:12.832 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.828+0000 7fe5e4ff9640 1 -- 172.21.15.89:0/4144262455 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe5d8007c30 con 0x7fe5e80fb430 2024-09-13T02:54:12.832 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.828+0000 7fe5e4ff9640 1 -- 172.21.15.89:0/4144262455 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe5d800f040 con 0x7fe5e80fb430 2024-09-13T02:54:12.832 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.828+0000 7fe5e4ff9640 1 -- 172.21.15.89:0/4144262455 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe5d800dab0 con 0x7fe5e80fb430 2024-09-13T02:54:12.832 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.828+0000 7fe5ee391640 1 -- 172.21.15.89:0/4144262455 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5e8112870 con 0x7fe5e80fb430 2024-09-13T02:54:12.832 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.829+0000 7fe5ee391640 1 -- 172.21.15.89:0/4144262455 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5e8112d10 con 0x7fe5e80fb430 2024-09-13T02:54:12.833 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.829+0000 7fe5ee391640 1 -- 172.21.15.89:0/4144262455 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5e80fa890 con 0x7fe5e80fb430 2024-09-13T02:54:12.833 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.830+0000 7fe5e4ff9640 1 -- 172.21.15.89:0/4144262455 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fe5d800dc10 con 0x7fe5e80fb430 2024-09-13T02:54:12.833 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.830+0000 7fe5e4ff9640 1 --2- 172.21.15.89:0/4144262455 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fe5d006ed60 0x7fe5d0071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:54:12.833 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.831+0000 7fe5e77fe640 1 --2- 172.21.15.89:0/4144262455 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fe5d006ed60 0x7fe5d0071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:54:12.834 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.831+0000 7fe5e4ff9640 1 -- 172.21.15.89:0/4144262455 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fe5d808da50 con 0x7fe5e80fb430 2024-09-13T02:54:12.834 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.831+0000 7fe5e77fe640 1 --2- 172.21.15.89:0/4144262455 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fe5d006ed60 0x7fe5d0071210 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe5dc00b020 tx=0x7fe5dc035040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:54:12.836 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:12.835+0000 7fe5e4ff9640 1 -- 172.21.15.89:0/4144262455 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fe5d804d2a0 con 0x7fe5e80fb430 2024-09-13T02:54:12.978 INFO:tasks.workunit.client.1.smithi131.stdout:4/517: sync 2024-09-13T02:54:12.978 INFO:tasks.workunit.client.1.smithi131.stdout:3/416: sync 2024-09-13T02:54:12.978 INFO:tasks.workunit.client.1.smithi131.stdout:3/417: stat d2/d4/d7/d8/d41/f68 0 2024-09-13T02:54:12.979 INFO:tasks.workunit.client.1.smithi131.stdout:4/518: creat d1/d18/d34/d4e/fb0 x:0 0 0 2024-09-13T02:54:12.979 INFO:tasks.workunit.client.1.smithi131.stdout:4/519: write d1/f27 [919709,108616] 0 2024-09-13T02:54:12.979 INFO:tasks.workunit.client.1.smithi131.stdout:4/520: chown d1/dc/d19/d29/d33/d3a/f74 755474964 1 2024-09-13T02:54:12.980 INFO:tasks.workunit.client.1.smithi131.stdout:4/521: creat d1/d18/d34/d62/da3/da6/fb1 x:0 0 0 2024-09-13T02:54:12.985 INFO:tasks.workunit.client.1.smithi131.stdout:4/522: dread d1/dc/d19/d29/f2b [0,4194304] 0 2024-09-13T02:54:12.993 INFO:tasks.workunit.client.1.smithi131.stdout:4/523: read d1/dc/d22/d73/f87 [3345021,112776] 0 2024-09-13T02:54:12.993 INFO:tasks.workunit.client.1.smithi131.stdout:4/524: write d1/d8/f17 [2062153,88003] 0 2024-09-13T02:54:12.993 INFO:tasks.workunit.client.1.smithi131.stdout:4/525: rename d1/d18 to d1/d18/d34/d62/da3/db2 22 2024-09-13T02:54:12.993 INFO:tasks.workunit.client.1.smithi131.stdout:4/526: truncate d1/d18/d34/d62/f9c 213849 0 2024-09-13T02:54:12.993 INFO:tasks.workunit.client.1.smithi131.stdout:4/527: write d1/dc/d19/d29/f4a [755036,76910] 0 2024-09-13T02:54:12.993 INFO:tasks.workunit.client.1.smithi131.stdout:4/528: write d1/d8/d13/f30 [880360,77295] 0 2024-09-13T02:54:12.994 INFO:tasks.workunit.client.1.smithi131.stdout:3/418: dwrite d2/d4/d1a/f7b [0,4194304] 0 2024-09-13T02:54:12.995 INFO:tasks.workunit.client.1.smithi131.stdout:4/529: unlink d1/dc/d19/d29/f2b 0 2024-09-13T02:54:12.995 INFO:tasks.workunit.client.1.smithi131.stdout:3/419: dread d2/d4/d7/f53 [0,4194304] 0 2024-09-13T02:54:12.997 INFO:tasks.workunit.client.1.smithi131.stdout:4/530: unlink d1/d18/f76 0 2024-09-13T02:54:12.998 INFO:tasks.workunit.client.1.smithi131.stdout:3/420: unlink d2/dc/f78 0 2024-09-13T02:54:12.998 INFO:tasks.workunit.client.1.smithi131.stdout:3/421: write d2/d4/d1a/f1e [1126151,102276] 0 2024-09-13T02:54:12.998 INFO:tasks.workunit.client.1.smithi131.stdout:3/422: chown d2/dc/d39/d61/f6c 1950328672 1 2024-09-13T02:54:12.998 INFO:tasks.workunit.client.1.smithi131.stdout:3/423: chown d2/d4/d1a/d31/d48 11 1 2024-09-13T02:54:12.998 INFO:tasks.workunit.client.1.smithi131.stdout:4/531: mknod d1/dc/d22/d73/cb3 0 2024-09-13T02:54:12.999 INFO:tasks.workunit.client.1.smithi131.stdout:3/424: mkdir d2/dc/d91 0 2024-09-13T02:54:13.018 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.017+0000 7fe5ee391640 1 -- 172.21.15.89:0/4144262455 --> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe5e8100bb0 con 0x7fe5d006ed60 2024-09-13T02:54:13.023 INFO:tasks.workunit.client.1.smithi131.stdout:4/532: dwrite d1/dc/d19/d29/d33/f64 [0,4194304] 0 2024-09-13T02:54:13.023 INFO:tasks.workunit.client.1.smithi131.stdout:3/425: dwrite d2/d4/f34 [0,4194304] 0 2024-09-13T02:54:13.023 INFO:tasks.workunit.client.1.smithi131.stdout:3/426: fsync d2/d4/d7/d1d/d24/f58 0 2024-09-13T02:54:13.023 INFO:tasks.workunit.client.1.smithi131.stdout:4/533: creat d1/d8/fb4 x:0 0 0 2024-09-13T02:54:13.025 INFO:tasks.workunit.client.1.smithi131.stdout:4/534: creat d1/d18/d34/fb5 x:0 0 0 2024-09-13T02:54:13.026 INFO:tasks.workunit.client.1.smithi131.stdout:4/535: mkdir d1/d18/d34/d62/d78/db6 0 2024-09-13T02:54:13.027 INFO:tasks.workunit.client.1.smithi131.stdout:4/536: creat d1/d18/d34/d62/d78/db6/fb7 x:0 0 0 2024-09-13T02:54:13.029 INFO:tasks.workunit.client.1.smithi131.stdout:3/427: rename d2/d4/d7/d1d/d24/d6f/d7a to d2/d4/d2d/d92 0 2024-09-13T02:54:13.030 INFO:tasks.workunit.client.1.smithi131.stdout:4/537: creat d1/d18/d81/fb8 x:0 0 0 2024-09-13T02:54:13.031 INFO:tasks.workunit.client.1.smithi131.stdout:3/428: creat d2/d4/d7/d8/d41/d5c/d71/f93 x:0 0 0 2024-09-13T02:54:13.032 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.031+0000 7fe5e4ff9640 1 -- 172.21.15.89:0/4144262455 <== mgr.14204 v2:172.21.15.89:6800/1506060926 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7fe5e8100bb0 con 0x7fe5d006ed60 2024-09-13T02:54:13.033 INFO:teuthology.orchestra.run.smithi089.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T02:54:13.033 INFO:teuthology.orchestra.run.smithi089.stdout:alertmanager.smithi089 smithi089 *:9093,9094 running (6m) 2m ago 7m 24.9M - 0.25.0 c8568f914cd2 e0d15812dfa4 2024-09-13T02:54:13.033 INFO:teuthology.orchestra.run.smithi089.stdout:crash.smithi089 smithi089 running (7m) 2m ago 7m 6895k - 17.2.7-1627-gbbdadfa3 a994b00deb3a e8994cd5600e 2024-09-13T02:54:13.033 INFO:teuthology.orchestra.run.smithi089.stdout:crash.smithi131 smithi131 running (7m) 2m ago 7m 6895k - 17.2.7-1627-gbbdadfa3 a994b00deb3a dcbb0a9d5261 2024-09-13T02:54:13.033 INFO:teuthology.orchestra.run.smithi089.stdout:grafana.smithi089 smithi089 *:3000 running (6m) 2m ago 7m 83.4M - 9.4.7 954c08fa6188 bb04115ceb76 2024-09-13T02:54:13.033 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi089.qjoitb smithi089 running (2m) 2m ago 2m 11.9M - 17.2.7-1627-gbbdadfa3 a994b00deb3a ff9b59ec5107 2024-09-13T02:54:13.033 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi089.rarddb smithi089 running (2m) 2m ago 2m 15.2M - 17.2.7-1627-gbbdadfa3 a994b00deb3a db2dc502c1ba 2024-09-13T02:54:13.033 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi131.rbovzc smithi131 running (2m) 2m ago 2m 14.9M - 17.2.7-1627-gbbdadfa3 a994b00deb3a d071b6d99537 2024-09-13T02:54:13.033 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi131.uasrkg smithi131 running (2m) 2m ago 2m 14.2M - 17.2.7-1627-gbbdadfa3 a994b00deb3a 0b3d4ffa6ce5 2024-09-13T02:54:13.033 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.smithi089.guohvs smithi089 *:9283,8765,8443 running (9m) 2m ago 9m 449M - 17.2.7-1627-gbbdadfa3 a994b00deb3a 32ceefe7e647 2024-09-13T02:54:13.033 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.smithi131.aunbqd smithi131 *:8443,9283 running (6m) 2m ago 6m 401M - 17.2.7-1627-gbbdadfa3 a994b00deb3a a950da375271 2024-09-13T02:54:13.034 INFO:teuthology.orchestra.run.smithi089.stdout:mon.smithi089 smithi089 running (9m) 2m ago 9m 47.2M 2048M 17.2.7-1627-gbbdadfa3 a994b00deb3a d2f18141b2af 2024-09-13T02:54:13.034 INFO:teuthology.orchestra.run.smithi089.stdout:mon.smithi131 smithi131 running (6m) 2m ago 6m 38.8M 2048M 17.2.7-1627-gbbdadfa3 a994b00deb3a 1191e59dc7a0 2024-09-13T02:54:13.034 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.smithi089 smithi089 *:9100 running (7m) 2m ago 7m 16.2M - 1.5.0 0da6a335fe13 c5dbf820b035 2024-09-13T02:54:13.034 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.smithi131 smithi131 *:9100 running (6m) 2m ago 6m 16.8M - 1.5.0 0da6a335fe13 c3309019f407 2024-09-13T02:54:13.034 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0 smithi089 running (6m) 2m ago 6m 48.0M 4287M 17.2.7-1627-gbbdadfa3 a994b00deb3a b9404e2bc82c 2024-09-13T02:54:13.034 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1 smithi089 running (5m) 2m ago 5m 45.8M 4287M 17.2.7-1627-gbbdadfa3 a994b00deb3a af6538730e42 2024-09-13T02:54:13.034 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2 smithi089 running (5m) 2m ago 5m 46.4M 4287M 17.2.7-1627-gbbdadfa3 a994b00deb3a 447cf103114b 2024-09-13T02:54:13.034 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3 smithi131 running (4m) 2m ago 4m 46.1M 5312M 17.2.7-1627-gbbdadfa3 a994b00deb3a 0b80a4dea862 2024-09-13T02:54:13.034 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4 smithi131 running (4m) 2m ago 4m 42.8M 5312M 17.2.7-1627-gbbdadfa3 a994b00deb3a 06ec44680b00 2024-09-13T02:54:13.034 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5 smithi131 running (3m) 2m ago 3m 43.1M 5312M 17.2.7-1627-gbbdadfa3 a994b00deb3a ace4b45e5873 2024-09-13T02:54:13.035 INFO:teuthology.orchestra.run.smithi089.stdout:prometheus.smithi089 smithi089 *:9095 running (6m) 2m ago 7m 52.8M - 2.43.0 a07b618ecd1d 003f13763491 2024-09-13T02:54:13.035 INFO:tasks.workunit.client.1.smithi131.stdout:3/429: creat d2/d4/d7/f94 x:0 0 0 2024-09-13T02:54:13.036 INFO:tasks.workunit.client.1.smithi131.stdout:3/430: chown d2/d4/f5d 2838 1 2024-09-13T02:54:13.036 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.034+0000 7fe5ee391640 1 -- 172.21.15.89:0/4144262455 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fe5d006ed60 msgr2=0x7fe5d0071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:13.036 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.034+0000 7fe5ee391640 1 --2- 172.21.15.89:0/4144262455 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fe5d006ed60 0x7fe5d0071210 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe5dc00b020 tx=0x7fe5dc035040 comp rx=0 tx=0).stop 2024-09-13T02:54:13.036 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.034+0000 7fe5ee391640 1 -- 172.21.15.89:0/4144262455 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe5e80fb430 msgr2=0x7fe5e810fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:13.036 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.034+0000 7fe5ee391640 1 --2- 172.21.15.89:0/4144262455 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe5e80fb430 0x7fe5e810fd80 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fe5d8002a80 tx=0x7fe5d8004600 comp rx=0 tx=0).stop 2024-09-13T02:54:13.036 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.034+0000 7fe5ee391640 1 -- 172.21.15.89:0/4144262455 shutdown_connections 2024-09-13T02:54:13.036 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.034+0000 7fe5ee391640 1 --2- 172.21.15.89:0/4144262455 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fe5d006ed60 0x7fe5d0071210 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:13.036 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.034+0000 7fe5ee391640 1 --2- 172.21.15.89:0/4144262455 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe5e80fc700 0x7fe5e81122d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:13.036 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.034+0000 7fe5ee391640 1 --2- 172.21.15.89:0/4144262455 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe5e80fb430 0x7fe5e810fd80 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:13.036 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.034+0000 7fe5ee391640 1 -- 172.21.15.89:0/4144262455 >> 172.21.15.89:0/4144262455 conn(0x7fe5e80f6c10 msgr2=0x7fe5e80f83b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:54:13.036 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.034+0000 7fe5ee391640 1 -- 172.21.15.89:0/4144262455 shutdown_connections 2024-09-13T02:54:13.037 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.034+0000 7fe5ee391640 1 -- 172.21.15.89:0/4144262455 wait complete. 2024-09-13T02:54:13.040 INFO:tasks.workunit.client.1.smithi131.stdout:3/431: link d2/d4/d7/f53 d2/f95 0 2024-09-13T02:54:13.043 INFO:tasks.workunit.client.1.smithi131.stdout:3/432: mkdir d2/d4/d7/d1d/d24/d96 0 2024-09-13T02:54:13.043 INFO:tasks.workunit.client.1.smithi131.stdout:3/433: write d2/dc/d39/f72 [816757,2303] 0 2024-09-13T02:54:13.045 INFO:tasks.workunit.client.1.smithi131.stdout:4/538: dwrite d1/d8/f15 [0,4194304] 0 2024-09-13T02:54:13.045 INFO:tasks.workunit.client.1.smithi131.stdout:4/539: stat d1/d18/d43/d65/fa4 0 2024-09-13T02:54:13.053 INFO:tasks.workunit.client.1.smithi131.stdout:4/540: link d1/f27 d1/dc/d22/fb9 0 2024-09-13T02:54:13.055 INFO:tasks.workunit.client.1.smithi131.stdout:9/447: sync 2024-09-13T02:54:13.071 INFO:tasks.workunit.client.1.smithi131.stdout:4/541: dwrite d1/dc/fae [0,4194304] 0 2024-09-13T02:54:13.071 INFO:tasks.workunit.client.1.smithi131.stdout:4/542: fsync d1/d18/f9a 0 2024-09-13T02:54:13.071 INFO:tasks.workunit.client.1.smithi131.stdout:4/543: read - d1/d8/d13/f57 zero size 2024-09-13T02:54:13.077 INFO:tasks.workunit.client.1.smithi131.stdout:4/544: rename d1/dc to d1/d18/d43/d97/dba 0 2024-09-13T02:54:13.078 INFO:tasks.workunit.client.1.smithi131.stdout:4/545: dread - d1/d18/d34/d4e/fb0 zero size 2024-09-13T02:54:13.078 INFO:tasks.workunit.client.1.smithi131.stdout:4/546: write d1/d18/d81/f82 [1036168,29110] 0 2024-09-13T02:54:13.078 INFO:tasks.workunit.client.1.smithi131.stdout:4/547: rmdir d1/d18/d43/d97/dba/d22/d49 39 2024-09-13T02:54:13.078 INFO:tasks.workunit.client.1.smithi131.stdout:4/548: creat d1/d18/d34/fbb x:0 0 0 2024-09-13T02:54:13.078 INFO:tasks.workunit.client.1.smithi131.stdout:4/549: unlink d1/d8/f15 0 2024-09-13T02:54:13.087 INFO:tasks.workunit.client.1.smithi131.stdout:4/550: read d1/f5 [3385414,59710] 0 2024-09-13T02:54:13.088 INFO:tasks.workunit.client.1.smithi131.stdout:4/551: mknod d1/d18/d34/d62/d78/cbc 0 2024-09-13T02:54:13.089 INFO:tasks.workunit.client.1.smithi131.stdout:4/552: mkdir d1/d18/d43/d65/dbd 0 2024-09-13T02:54:13.089 INFO:tasks.workunit.client.1.smithi131.stdout:4/553: dread - d1/d18/d34/fbb zero size 2024-09-13T02:54:13.089 INFO:tasks.workunit.client.1.smithi131.stdout:4/554: mkdir d1/dbe 0 2024-09-13T02:54:13.090 INFO:tasks.workunit.client.1.smithi131.stdout:4/555: mkdir d1/d18/d43/d97/dba/d7a/dbf 0 2024-09-13T02:54:13.090 INFO:tasks.workunit.client.1.smithi131.stdout:4/556: creat d1/d18/d34/d62/da3/da6/fc0 x:0 0 0 2024-09-13T02:54:13.091 INFO:tasks.workunit.client.1.smithi131.stdout:4/557: chown d1/d18/d43/d97/dba/cab 149749164 1 2024-09-13T02:54:13.096 INFO:tasks.workunit.client.1.smithi131.stdout:4/558: rename d1/d8 to d1/d18/d43/d65/dbd/dc1 0 2024-09-13T02:54:13.096 INFO:tasks.workunit.client.1.smithi131.stdout:4/559: getdents d1/dbe 0 2024-09-13T02:54:13.096 INFO:tasks.workunit.client.1.smithi131.stdout:4/560: creat d1/d18/d43/d7d/d9f/fc2 x:0 0 0 2024-09-13T02:54:13.097 INFO:tasks.workunit.client.1.smithi131.stdout:4/561: stat d1/d18/d43/d65/dbd/dc1/lad 0 2024-09-13T02:54:13.110 INFO:tasks.workunit.client.1.smithi131.stdout:9/448: dwrite d0/d3/d14/d17/f31 [0,4194304] 0 2024-09-13T02:54:13.114 INFO:tasks.workunit.client.1.smithi131.stdout:4/562: dwrite d1/d18/d43/d97/dba/d22/d49/f94 [4194304,4194304] 0 2024-09-13T02:54:13.114 INFO:tasks.workunit.client.1.smithi131.stdout:4/563: stat d1/d18/d43/d65/dbd/dc1/d13/l26 0 2024-09-13T02:54:13.115 INFO:tasks.workunit.client.1.smithi131.stdout:4/564: dread d1/d18/d34/f5a [0,4194304] 0 2024-09-13T02:54:13.119 INFO:tasks.workunit.client.1.smithi131.stdout:9/449: dread d0/d3/d14/d1a/f23 [0,4194304] 0 2024-09-13T02:54:13.135 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.131+0000 7f5b38ef3640 1 -- 172.21.15.89:0/95578491 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b340fc6f0 msgr2=0x7f5b340fcb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:13.135 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.131+0000 7f5b38ef3640 1 --2- 172.21.15.89:0/95578491 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b340fc6f0 0x7f5b340fcb60 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c0048d0 tx=0x7f5b1c009da0 comp rx=0 tx=0).stop 2024-09-13T02:54:13.135 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.131+0000 7f5b38ef3640 1 -- 172.21.15.89:0/95578491 shutdown_connections 2024-09-13T02:54:13.135 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.131+0000 7f5b38ef3640 1 --2- 172.21.15.89:0/95578491 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b340fc6f0 0x7f5b340fcb60 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:13.135 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.131+0000 7f5b38ef3640 1 --2- 172.21.15.89:0/95578491 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5b340fb420 0x7f5b340fb830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:13.136 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.131+0000 7f5b38ef3640 1 -- 172.21.15.89:0/95578491 >> 172.21.15.89:0/95578491 conn(0x7f5b340f6c00 msgr2=0x7f5b340f9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:54:13.136 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.131+0000 7f5b38ef3640 1 -- 172.21.15.89:0/95578491 shutdown_connections 2024-09-13T02:54:13.136 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.131+0000 7f5b38ef3640 1 -- 172.21.15.89:0/95578491 wait complete. 2024-09-13T02:54:13.136 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.132+0000 7f5b38ef3640 1 Processor -- start 2024-09-13T02:54:13.136 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.132+0000 7f5b38ef3640 1 -- start start 2024-09-13T02:54:13.136 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.132+0000 7f5b38ef3640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5b340fb420 0x7f5b3410fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:54:13.136 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.132+0000 7f5b38ef3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b340fc6f0 0x7f5b341122a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:54:13.136 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.132+0000 7f5b38ef3640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b34066550 con 0x7f5b340fc6f0 2024-09-13T02:54:13.136 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.132+0000 7f5b38ef3640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b340666c0 con 0x7f5b340fb420 2024-09-13T02:54:13.136 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.133+0000 7f5b29d9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b340fc6f0 0x7f5b341122a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:54:13.136 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.133+0000 7f5b29d9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b340fc6f0 0x7f5b341122a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:46382/0 (socket says 172.21.15.89:46382) 2024-09-13T02:54:13.136 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.133+0000 7f5b29d9b640 1 -- 172.21.15.89:0/2787260550 learned_addr learned my addr 172.21.15.89:0/2787260550 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:54:13.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.133+0000 7f5b3259c640 1 --2- 172.21.15.89:0/2787260550 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5b340fb420 0x7f5b3410fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:54:13.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.133+0000 7f5b29d9b640 1 -- 172.21.15.89:0/2787260550 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5b340fb420 msgr2=0x7f5b3410fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:13.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.133+0000 7f5b29d9b640 1 --2- 172.21.15.89:0/2787260550 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5b340fb420 0x7f5b3410fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:13.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.133+0000 7f5b29d9b640 1 -- 172.21.15.89:0/2787260550 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b1c005040 con 0x7f5b340fc6f0 2024-09-13T02:54:13.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.133+0000 7f5b3259c640 1 --2- 172.21.15.89:0/2787260550 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5b340fb420 0x7f5b3410fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T02:54:13.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.133+0000 7f5b29d9b640 1 --2- 172.21.15.89:0/2787260550 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b340fc6f0 0x7f5b341122a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c0048a0 tx=0x7f5b1c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:54:13.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.133+0000 7f5b2b7fe640 1 -- 172.21.15.89:0/2787260550 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b1c038070 con 0x7f5b340fc6f0 2024-09-13T02:54:13.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.133+0000 7f5b2b7fe640 1 -- 172.21.15.89:0/2787260550 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f5b1c004290 con 0x7f5b340fc6f0 2024-09-13T02:54:13.138 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.133+0000 7f5b2b7fe640 1 -- 172.21.15.89:0/2787260550 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b1c033660 con 0x7f5b340fc6f0 2024-09-13T02:54:13.138 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.133+0000 7f5b38ef3640 1 -- 172.21.15.89:0/2787260550 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b34112840 con 0x7f5b340fc6f0 2024-09-13T02:54:13.138 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.134+0000 7f5b38ef3640 1 -- 172.21.15.89:0/2787260550 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b34112db0 con 0x7f5b340fc6f0 2024-09-13T02:54:13.139 INFO:tasks.workunit.client.1.smithi131.stdout:9/450: dwrite d0/d4d/f68 [4194304,4194304] 0 2024-09-13T02:54:13.139 INFO:tasks.workunit.client.1.smithi131.stdout:9/451: truncate d0/d3/d14/d1a/d2a/f62 381111 0 2024-09-13T02:54:13.139 INFO:tasks.workunit.client.1.smithi131.stdout:9/452: creat d0/d3/d14/d17/f91 x:0 0 0 2024-09-13T02:54:13.140 INFO:tasks.workunit.client.1.smithi131.stdout:9/453: read d0/f90 [3603998,32780] 0 2024-09-13T02:54:13.140 INFO:tasks.workunit.client.1.smithi131.stdout:9/454: link d0/d3/d14/d17/c43 d0/d3/d14/d67/c92 0 2024-09-13T02:54:13.140 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.135+0000 7f5b38ef3640 1 -- 172.21.15.89:0/2787260550 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b340fa880 con 0x7f5b340fc6f0 2024-09-13T02:54:13.140 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.135+0000 7f5b2b7fe640 1 -- 172.21.15.89:0/2787260550 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f5b1c030020 con 0x7f5b340fc6f0 2024-09-13T02:54:13.140 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.136+0000 7f5b2b7fe640 1 --2- 172.21.15.89:0/2787260550 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f5b2006ed60 0x7f5b20071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:54:13.140 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.136+0000 7f5b2b7fe640 1 -- 172.21.15.89:0/2787260550 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f5b1c0ae2b0 con 0x7f5b340fc6f0 2024-09-13T02:54:13.140 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.136+0000 7f5b3259c640 1 --2- 172.21.15.89:0/2787260550 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f5b2006ed60 0x7f5b20071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:54:13.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.136+0000 7f5b3259c640 1 --2- 172.21.15.89:0/2787260550 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f5b2006ed60 0x7f5b20071210 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f5b34066240 tx=0x7f5b2400b040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:54:13.145 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.143+0000 7f5b2b7fe640 1 -- 172.21.15.89:0/2787260550 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f5b1c07b400 con 0x7f5b340fc6f0 2024-09-13T02:54:13.147 INFO:tasks.workunit.client.1.smithi131.stdout:9/455: dread d0/d3/d14/d1a/d2a/d5e/f83 [0,4194304] 0 2024-09-13T02:54:13.147 INFO:tasks.workunit.client.1.smithi131.stdout:9/456: creat d0/d3/d14/d3c/f93 x:0 0 0 2024-09-13T02:54:13.149 INFO:tasks.workunit.client.1.smithi131.stdout:9/457: link d0/c3a d0/d3/d14/d67/c94 0 2024-09-13T02:54:13.149 INFO:tasks.workunit.client.1.smithi131.stdout:9/458: dread - d0/d3/d14/f6f zero size 2024-09-13T02:54:13.150 INFO:tasks.workunit.client.1.smithi131.stdout:9/459: mkdir d0/d3/d14/d95 0 2024-09-13T02:54:13.234 INFO:tasks.workunit.client.1.smithi131.stdout:1/461: sync 2024-09-13T02:54:13.234 INFO:tasks.workunit.client.1.smithi131.stdout:1/462: readlink dd/d26/d2a/d2c/l2e 0 2024-09-13T02:54:13.234 INFO:tasks.workunit.client.1.smithi131.stdout:0/628: sync 2024-09-13T02:54:13.235 INFO:tasks.workunit.client.1.smithi131.stdout:5/413: sync 2024-09-13T02:54:13.235 INFO:tasks.workunit.client.1.smithi131.stdout:2/448: sync 2024-09-13T02:54:13.235 INFO:tasks.workunit.client.1.smithi131.stdout:2/449: read - d5/d34/f7a zero size 2024-09-13T02:54:13.235 INFO:tasks.workunit.client.1.smithi131.stdout:5/414: write d1/d1c/d8e/f52 [25172,10615] 0 2024-09-13T02:54:13.235 INFO:tasks.workunit.client.1.smithi131.stdout:8/403: sync 2024-09-13T02:54:13.235 INFO:tasks.workunit.client.1.smithi131.stdout:7/453: sync 2024-09-13T02:54:13.235 INFO:tasks.workunit.client.1.smithi131.stdout:6/563: sync 2024-09-13T02:54:13.236 INFO:tasks.workunit.client.1.smithi131.stdout:0/629: truncate d0/de/d45/d86/f8a 1137514 0 2024-09-13T02:54:13.237 INFO:tasks.workunit.client.1.smithi131.stdout:0/630: read d0/d2/f2f [2695253,91604] 0 2024-09-13T02:54:13.238 INFO:tasks.workunit.client.1.smithi131.stdout:2/450: creat d5/d31/d4e/d78/f99 x:0 0 0 2024-09-13T02:54:13.238 INFO:tasks.workunit.client.1.smithi131.stdout:2/451: stat d5/d31 0 2024-09-13T02:54:13.238 INFO:tasks.workunit.client.1.smithi131.stdout:2/452: write d5/d31/d1d/d37/d7c/f80 [4407422,31423] 0 2024-09-13T02:54:13.238 INFO:tasks.workunit.client.1.smithi131.stdout:2/453: chown d5/d31/d1d/d32 2285 1 2024-09-13T02:54:13.239 INFO:tasks.workunit.client.1.smithi131.stdout:5/415: rename d1/d21/l77 to d1/d2f/d33/l8f 0 2024-09-13T02:54:13.239 INFO:tasks.workunit.client.1.smithi131.stdout:5/416: fdatasync d1/d29/d39/f72 0 2024-09-13T02:54:13.242 INFO:tasks.workunit.client.1.smithi131.stdout:6/564: link d1/d8/d9/db/f36 d1/d8/d9/d4b/fb6 0 2024-09-13T02:54:13.243 INFO:tasks.workunit.client.1.smithi131.stdout:0/631: rmdir d0/de/d1f/d22/d31 39 2024-09-13T02:54:13.244 INFO:tasks.workunit.client.1.smithi131.stdout:2/454: rename d5/d18/f51 to d5/d31/d1d/d32/d3b/f9a 0 2024-09-13T02:54:13.245 INFO:tasks.workunit.client.1.smithi131.stdout:1/463: write dd/f3c [3241853,117605] 0 2024-09-13T02:54:13.247 INFO:tasks.workunit.client.1.smithi131.stdout:5/417: unlink d1/l88 0 2024-09-13T02:54:13.247 INFO:tasks.workunit.client.1.smithi131.stdout:8/404: rmdir db/d2b/d39/d56 39 2024-09-13T02:54:13.248 INFO:tasks.workunit.client.1.smithi131.stdout:0/632: symlink d0/de/da3/ldd 0 2024-09-13T02:54:13.249 INFO:tasks.workunit.client.1.smithi131.stdout:0/633: dread - d0/de/d1f/d22/d31/d39/d40/fd5 zero size 2024-09-13T02:54:13.249 INFO:tasks.workunit.client.1.smithi131.stdout:0/634: write d0/de/da3/fdc [210090,93890] 0 2024-09-13T02:54:13.250 INFO:tasks.workunit.client.1.smithi131.stdout:2/455: creat d5/d31/d21/d57/d94/f9b x:0 0 0 2024-09-13T02:54:13.251 INFO:tasks.workunit.client.1.smithi131.stdout:1/464: creat dd/d26/d44/d6d/d7c/fa8 x:0 0 0 2024-09-13T02:54:13.253 INFO:tasks.workunit.client.1.smithi131.stdout:8/405: mknod db/d2b/d39/d56/c79 0 2024-09-13T02:54:13.253 INFO:tasks.workunit.client.1.smithi131.stdout:8/406: creat db/d1d/d34/f7a x:0 0 0 2024-09-13T02:54:13.254 INFO:tasks.workunit.client.1.smithi131.stdout:7/454: dwrite d1b/d3b/f5b [0,4194304] 0 2024-09-13T02:54:13.256 INFO:tasks.workunit.client.1.smithi131.stdout:0/635: unlink d0/de/f4f 0 2024-09-13T02:54:13.257 INFO:tasks.workunit.client.1.smithi131.stdout:0/636: dread d0/d2/d41/f50 [0,4194304] 0 2024-09-13T02:54:13.261 INFO:tasks.workunit.client.1.smithi131.stdout:2/456: rename d5/d53/f5b to d5/d31/d21/d57/d94/f9c 0 2024-09-13T02:54:13.261 INFO:tasks.workunit.client.1.smithi131.stdout:5/418: read d1/d2f/f3c [1012410,4587] 0 2024-09-13T02:54:13.262 INFO:tasks.workunit.client.1.smithi131.stdout:1/465: unlink dd/d26/d2a/d2c/c85 0 2024-09-13T02:54:13.265 INFO:tasks.workunit.client.1.smithi131.stdout:8/407: symlink db/d2e/d3a/l7b 0 2024-09-13T02:54:13.268 INFO:tasks.workunit.client.1.smithi131.stdout:7/455: mkdir d1b/d3b/d46/d4b/d57/d9d 0 2024-09-13T02:54:13.270 INFO:tasks.workunit.client.1.smithi131.stdout:5/419: mkdir d1/d21/d90 0 2024-09-13T02:54:13.272 INFO:tasks.workunit.client.1.smithi131.stdout:5/420: truncate d1/d5/f65 842781 0 2024-09-13T02:54:13.273 INFO:tasks.workunit.client.1.smithi131.stdout:0/637: dread d0/de/d1f/f92 [0,4194304] 0 2024-09-13T02:54:13.274 INFO:tasks.workunit.client.1.smithi131.stdout:0/638: truncate d0/d2/d41/f7e 1163350 0 2024-09-13T02:54:13.275 INFO:tasks.workunit.client.1.smithi131.stdout:6/565: dwrite d1/d8/d9/db/d15/d26/d1c/d4e/d97/f33 [0,4194304] 0 2024-09-13T02:54:13.275 INFO:tasks.workunit.client.1.smithi131.stdout:6/566: creat d1/d8/d9/db/d15/d26/d1c/d79/d92/fb7 x:0 0 0 2024-09-13T02:54:13.275 INFO:tasks.workunit.client.1.smithi131.stdout:6/567: fdatasync d1/d8/f7a 0 2024-09-13T02:54:13.276 INFO:tasks.workunit.client.1.smithi131.stdout:5/421: symlink d1/l91 0 2024-09-13T02:54:13.276 INFO:tasks.workunit.client.1.smithi131.stdout:5/422: creat d1/d2f/d33/f92 x:0 0 0 2024-09-13T02:54:13.276 INFO:tasks.workunit.client.1.smithi131.stdout:5/423: fsync d1/d21/f25 0 2024-09-13T02:54:13.280 INFO:tasks.workunit.client.1.smithi131.stdout:7/456: write d1b/d23/f2d [3970865,86254] 0 2024-09-13T02:54:13.280 INFO:tasks.workunit.client.1.smithi131.stdout:7/457: fsync d1b/d3b/f3e 0 2024-09-13T02:54:13.280 INFO:tasks.workunit.client.1.smithi131.stdout:7/458: chown d1b/f2f 13 1 2024-09-13T02:54:13.281 INFO:tasks.workunit.client.1.smithi131.stdout:6/568: mkdir d1/d8/d9/db8 0 2024-09-13T02:54:13.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:13 smithi089 ceph-mon[27639]: from='client.14618 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:54:13.288 INFO:tasks.workunit.client.1.smithi131.stdout:5/424: readlink d1/d5/d57/l61 0 2024-09-13T02:54:13.289 INFO:tasks.workunit.client.1.smithi131.stdout:7/459: mkdir d1b/d3b/d51/d62/d9e 0 2024-09-13T02:54:13.291 INFO:tasks.workunit.client.1.smithi131.stdout:5/425: creat d1/d50/f93 x:0 0 0 2024-09-13T02:54:13.293 INFO:tasks.workunit.client.1.smithi131.stdout:8/408: dwrite db/f30 [0,4194304] 0 2024-09-13T02:54:13.293 INFO:tasks.workunit.client.1.smithi131.stdout:5/426: symlink d1/d2f/l94 0 2024-09-13T02:54:13.294 INFO:tasks.workunit.client.1.smithi131.stdout:2/457: dwrite d5/f3a [0,4194304] 0 2024-09-13T02:54:13.296 INFO:tasks.workunit.client.1.smithi131.stdout:8/409: mknod db/d1d/d71/c7c 0 2024-09-13T02:54:13.299 INFO:tasks.workunit.client.1.smithi131.stdout:2/458: link d5/d31/d1d/d32/d3b/d67/c79 d5/d31/d1d/d32/d3b/d67/d87/c9d 0 2024-09-13T02:54:13.299 INFO:tasks.workunit.client.1.smithi131.stdout:2/459: chown d5/d18/d4b/d8e/l6d 251 1 2024-09-13T02:54:13.299 INFO:tasks.workunit.client.1.smithi131.stdout:2/460: readlink d5/d18/l15 0 2024-09-13T02:54:13.299 INFO:tasks.workunit.client.1.smithi131.stdout:2/461: write d5/d33/d66/f8a [1002308,78321] 0 2024-09-13T02:54:13.300 INFO:tasks.workunit.client.1.smithi131.stdout:2/462: chown d5/l11 838642397 1 2024-09-13T02:54:13.303 INFO:tasks.workunit.client.1.smithi131.stdout:0/639: dwrite d0/de/d1f/fbd [0,4194304] 0 2024-09-13T02:54:13.305 INFO:tasks.workunit.client.1.smithi131.stdout:0/640: creat d0/d2/d41/dd6/fde x:0 0 0 2024-09-13T02:54:13.305 INFO:tasks.workunit.client.1.smithi131.stdout:0/641: read d0/de/d1f/d22/d3d/f6c [1779755,88326] 0 2024-09-13T02:54:13.306 INFO:tasks.workunit.client.1.smithi131.stdout:5/427: write d1/d5/f12 [3083944,75956] 0 2024-09-13T02:54:13.306 INFO:tasks.workunit.client.1.smithi131.stdout:5/428: write d1/d1c/f3b [1924931,14411] 0 2024-09-13T02:54:13.308 INFO:tasks.workunit.client.1.smithi131.stdout:0/642: creat d0/de/da3/fdf x:0 0 0 2024-09-13T02:54:13.308 INFO:tasks.workunit.client.1.smithi131.stdout:5/429: truncate d1/d1c/f1d 7477658 0 2024-09-13T02:54:13.310 INFO:tasks.workunit.client.1.smithi131.stdout:8/410: dread db/f19 [0,4194304] 0 2024-09-13T02:54:13.310 INFO:tasks.workunit.client.1.smithi131.stdout:0/643: creat d0/de/d1f/d22/d3d/d43/d4b/fe0 x:0 0 0 2024-09-13T02:54:13.310 INFO:tasks.workunit.client.1.smithi131.stdout:0/644: chown d0/de/d1f/d22/d3d/d55/d63/d94/cd4 17527 1 2024-09-13T02:54:13.313 INFO:tasks.workunit.client.1.smithi131.stdout:0/645: creat d0/de/d1f/d22/d3d/d55/d63/dd2/fe1 x:0 0 0 2024-09-13T02:54:13.314 INFO:tasks.workunit.client.1.smithi131.stdout:0/646: truncate d0/de/f59 1167161 0 2024-09-13T02:54:13.314 INFO:tasks.workunit.client.1.smithi131.stdout:0/647: creat d0/d2/d41/fe2 x:0 0 0 2024-09-13T02:54:13.314 INFO:tasks.workunit.client.1.smithi131.stdout:0/648: dread - d0/de/d1f/d22/d31/d39/fad zero size 2024-09-13T02:54:13.315 INFO:tasks.workunit.client.1.smithi131.stdout:0/649: dread - d0/d2/d62/fca zero size 2024-09-13T02:54:13.316 INFO:tasks.workunit.client.1.smithi131.stdout:0/650: symlink d0/de/d1f/d22/d3d/d87/le3 0 2024-09-13T02:54:13.318 INFO:tasks.workunit.client.1.smithi131.stdout:0/651: creat d0/de/d1f/d22/d31/fe4 x:0 0 0 2024-09-13T02:54:13.318 INFO:tasks.workunit.client.1.smithi131.stdout:0/652: chown d0/de/d1f/d22/d3d/d55/f6b 220974 1 2024-09-13T02:54:13.320 INFO:tasks.workunit.client.1.smithi131.stdout:7/460: dwrite d1b/d3b/d31/d5f/f79 [0,4194304] 0 2024-09-13T02:54:13.322 INFO:tasks.workunit.client.1.smithi131.stdout:0/653: rmdir d0/de/d1f/d22/d3d/d80 39 2024-09-13T02:54:13.322 INFO:tasks.workunit.client.1.smithi131.stdout:0/654: write d0/de/d1f/d22/d31/d39/d40/f7c [4732852,59882] 0 2024-09-13T02:54:13.322 INFO:tasks.workunit.client.1.smithi131.stdout:0/655: write d0/de/d1f/d22/d31/fe4 [547647,129123] 0 2024-09-13T02:54:13.322 INFO:tasks.workunit.client.1.smithi131.stdout:0/656: fsync d0/de/d1f/d22/d3d/d55/f6b 0 2024-09-13T02:54:13.322 INFO:tasks.workunit.client.1.smithi131.stdout:0/657: chown d0/de/l1e 175228361 1 2024-09-13T02:54:13.322 INFO:tasks.workunit.client.1.smithi131.stdout:0/658: write d0/de/d1f/d22/d31/f60 [4268578,110173] 0 2024-09-13T02:54:13.322 INFO:tasks.workunit.client.1.smithi131.stdout:2/463: dwrite d5/f2e [0,4194304] 0 2024-09-13T02:54:13.324 INFO:tasks.workunit.client.1.smithi131.stdout:2/464: creat d5/d31/d21/d57/d90/f9e x:0 0 0 2024-09-13T02:54:13.324 INFO:tasks.workunit.client.1.smithi131.stdout:2/465: truncate d5/d31/d21/d57/d94/f9c 806805 0 2024-09-13T02:54:13.325 INFO:tasks.workunit.client.1.smithi131.stdout:2/466: fdatasync d5/d31/d1d/d37/f56 0 2024-09-13T02:54:13.325 INFO:tasks.workunit.client.1.smithi131.stdout:2/467: dread - d5/d31/d4e/d76/f96 zero size 2024-09-13T02:54:13.327 INFO:tasks.workunit.client.1.smithi131.stdout:2/468: link d5/d31/d1d/d32/d3b/f9a d5/d33/d41/f9f 0 2024-09-13T02:54:13.328 INFO:tasks.workunit.client.1.smithi131.stdout:2/469: mknod d5/d31/d1d/d32/d3b/ca0 0 2024-09-13T02:54:13.328 INFO:tasks.workunit.client.1.smithi131.stdout:2/470: fdatasync d5/d31/d26/f63 0 2024-09-13T02:54:13.328 INFO:tasks.workunit.client.1.smithi131.stdout:2/471: write d5/d33/d41/f4a [71223,25399] 0 2024-09-13T02:54:13.329 INFO:tasks.workunit.client.1.smithi131.stdout:7/461: dread d1b/f2f [0,4194304] 0 2024-09-13T02:54:13.329 INFO:tasks.workunit.client.1.smithi131.stdout:7/462: chown d1b/f2c 16299535 1 2024-09-13T02:54:13.330 INFO:tasks.workunit.client.1.smithi131.stdout:2/472: unlink d5/f47 0 2024-09-13T02:54:13.331 INFO:tasks.workunit.client.1.smithi131.stdout:7/463: rmdir d1b/d3b/d51/d62 39 2024-09-13T02:54:13.331 INFO:tasks.workunit.client.1.smithi131.stdout:5/430: dwrite d1/d29/f2e [4194304,4194304] 0 2024-09-13T02:54:13.334 INFO:tasks.workunit.client.1.smithi131.stdout:8/411: dwrite f2 [0,4194304] 0 2024-09-13T02:54:13.335 INFO:tasks.workunit.client.1.smithi131.stdout:7/464: rename d1b/d3b/d46/d4b/d57/d7b/c6c to d1b/d3b/d46/d4b/d57/d9d/c9f 0 2024-09-13T02:54:13.341 INFO:tasks.workunit.client.1.smithi131.stdout:8/412: rename db/fd to db/d1d/d1f/d41/d50/f7d 0 2024-09-13T02:54:13.343 INFO:tasks.workunit.client.1.smithi131.stdout:7/465: unlink d1b/d3b/d31/d38/c63 0 2024-09-13T02:54:13.345 INFO:tasks.workunit.client.1.smithi131.stdout:2/473: write d5/d31/d26/f39 [1671939,2613] 0 2024-09-13T02:54:13.345 INFO:tasks.workunit.client.1.smithi131.stdout:5/431: read d1/d5/f65 [320623,122168] 0 2024-09-13T02:54:13.346 INFO:tasks.workunit.client.1.smithi131.stdout:7/466: link d1b/d23/l8d d1b/d3b/d31/d5f/la0 0 2024-09-13T02:54:13.347 INFO:tasks.workunit.client.1.smithi131.stdout:0/659: dwrite d0/de/d45/d86/f8a [0,4194304] 0 2024-09-13T02:54:13.347 INFO:tasks.workunit.client.1.smithi131.stdout:0/660: write d0/de/d1f/d22/d31/d39/d67/f5e [4559846,389] 0 2024-09-13T02:54:13.349 INFO:tasks.workunit.client.1.smithi131.stdout:7/467: mkdir d1b/d3b/d51/d62/d6d/da1 0 2024-09-13T02:54:13.349 INFO:tasks.workunit.client.1.smithi131.stdout:7/468: chown d1b/d3b/d46/d4b/d57/d9d/c9f 15 1 2024-09-13T02:54:13.350 INFO:tasks.workunit.client.1.smithi131.stdout:7/469: readlink l14 0 2024-09-13T02:54:13.351 INFO:tasks.workunit.client.1.smithi131.stdout:2/474: dread d5/d31/d1d/d37/d7c/f80 [0,4194304] 0 2024-09-13T02:54:13.351 INFO:tasks.workunit.client.1.smithi131.stdout:2/475: fsync d5/d18/d4b/d8e/d48/d4c/f91 0 2024-09-13T02:54:13.351 INFO:tasks.workunit.client.1.smithi131.stdout:0/661: symlink d0/d2/d62/le5 0 2024-09-13T02:54:13.354 INFO:tasks.workunit.client.1.smithi131.stdout:7/470: mkdir d1b/d3b/d51/d62/d9e/da2 0 2024-09-13T02:54:13.354 INFO:tasks.workunit.client.1.smithi131.stdout:7/471: fdatasync d1b/f34 0 2024-09-13T02:54:13.354 INFO:tasks.workunit.client.1.smithi131.stdout:8/413: dread db/d2b/d39/d56/f60 [0,4194304] 0 2024-09-13T02:54:13.357 INFO:tasks.workunit.client.1.smithi131.stdout:2/476: rename d5/d34/d42/f64 to d5/d31/d26/d8d/fa1 0 2024-09-13T02:54:13.360 INFO:tasks.workunit.client.1.smithi131.stdout:0/662: link d0/de/ca1 d0/de/d1f/d22/d3d/d55/d63/ce6 0 2024-09-13T02:54:13.364 INFO:tasks.workunit.client.1.smithi131.stdout:8/414: mkdir db/d1d/d34/d4e/d7e 0 2024-09-13T02:54:13.365 INFO:tasks.workunit.client.1.smithi131.stdout:0/663: creat d0/fe7 x:0 0 0 2024-09-13T02:54:13.370 INFO:tasks.workunit.client.1.smithi131.stdout:0/664: rename d0/de/d45/d5a to d0/de/d45/d86/de8 0 2024-09-13T02:54:13.372 INFO:tasks.workunit.client.1.smithi131.stdout:0/665: chown d0/de/d1f/c57 6317 1 2024-09-13T02:54:13.372 INFO:tasks.workunit.client.1.smithi131.stdout:0/666: write d0/de/d1f/d22/d3d/f6c [97180,38528] 0 2024-09-13T02:54:13.372 INFO:tasks.workunit.client.1.smithi131.stdout:0/667: write d0/de/d45/d86/f88 [1448212,80113] 0 2024-09-13T02:54:13.374 INFO:tasks.workunit.client.1.smithi131.stdout:2/477: write d5/d31/d1d/f54 [1896622,31596] 0 2024-09-13T02:54:13.376 INFO:tasks.workunit.client.1.smithi131.stdout:5/432: dwrite d1/d5/f4e [0,4194304] 0 2024-09-13T02:54:13.377 INFO:tasks.workunit.client.1.smithi131.stdout:8/415: write db/d1d/d1f/d41/f5d [1126561,77627] 0 2024-09-13T02:54:13.377 INFO:tasks.workunit.client.1.smithi131.stdout:7/472: dwrite d1b/d23/d89/f90 [0,4194304] 0 2024-09-13T02:54:13.381 INFO:tasks.workunit.client.1.smithi131.stdout:0/668: getdents d0/de/d1f/d22/d3d/d55/d63 0 2024-09-13T02:54:13.382 INFO:tasks.workunit.client.1.smithi131.stdout:5/433: creat d1/d1c/d8e/f95 x:0 0 0 2024-09-13T02:54:13.382 INFO:tasks.workunit.client.1.smithi131.stdout:0/669: dread d0/de/d45/d86/f93 [0,4194304] 0 2024-09-13T02:54:13.383 INFO:tasks.workunit.client.1.smithi131.stdout:8/416: symlink db/d2b/d39/l7f 0 2024-09-13T02:54:13.384 INFO:tasks.workunit.client.1.smithi131.stdout:8/417: dread - db/d2b/f47 zero size 2024-09-13T02:54:13.387 INFO:tasks.workunit.client.1.smithi131.stdout:7/473: mknod d1b/d3b/d46/d4b/d57/d9d/ca3 0 2024-09-13T02:54:13.387 INFO:tasks.workunit.client.1.smithi131.stdout:7/474: fsync d1b/d23/d89/f90 0 2024-09-13T02:54:13.388 INFO:tasks.workunit.client.1.smithi131.stdout:5/434: link d1/d21/d22/l2d d1/d1c/d8e/l96 0 2024-09-13T02:54:13.388 INFO:tasks.workunit.client.1.smithi131.stdout:5/435: creat d1/d2f/d33/f97 x:0 0 0 2024-09-13T02:54:13.389 INFO:tasks.workunit.client.1.smithi131.stdout:0/670: mkdir d0/de/d45/d86/de9 0 2024-09-13T02:54:13.389 INFO:tasks.workunit.client.1.smithi131.stdout:0/671: write d0/de/d45/d86/de8/f64 [917748,30768] 0 2024-09-13T02:54:13.390 INFO:tasks.workunit.client.1.smithi131.stdout:8/418: rename db/d1d/d1f/d41/l4d to db/d1d/d1f/d66/l80 0 2024-09-13T02:54:13.391 INFO:tasks.workunit.client.1.smithi131.stdout:8/419: write db/f23 [3881744,108055] 0 2024-09-13T02:54:13.393 INFO:tasks.workunit.client.1.smithi131.stdout:0/672: mknod d0/de/d1f/d22/d3d/d43/cea 0 2024-09-13T02:54:13.393 INFO:tasks.workunit.client.1.smithi131.stdout:0/673: creat d0/d2/d41/feb x:0 0 0 2024-09-13T02:54:13.393 INFO:tasks.workunit.client.1.smithi131.stdout:0/674: dread - d0/de/d1f/d22/d31/d39/fad zero size 2024-09-13T02:54:13.394 INFO:tasks.workunit.client.1.smithi131.stdout:8/420: mkdir db/d1d/d1f/d67/d81 0 2024-09-13T02:54:13.397 INFO:tasks.workunit.client.1.smithi131.stdout:0/675: rename d0/de/da3/fdf to d0/de/d1f/d22/d31/d39/d67/fec 0 2024-09-13T02:54:13.397 INFO:tasks.workunit.client.1.smithi131.stdout:0/676: write d0/d2/d41/f79 [949402,83430] 0 2024-09-13T02:54:13.397 INFO:tasks.workunit.client.1.smithi131.stdout:0/677: creat d0/de/d1f/d22/d3d/d55/d63/dd2/fed x:0 0 0 2024-09-13T02:54:13.397 INFO:tasks.workunit.client.1.smithi131.stdout:0/678: stat d0/de/d1f/d22/l42 0 2024-09-13T02:54:13.397 INFO:tasks.workunit.client.1.smithi131.stdout:0/679: chown d0/de/d45/d86/de8/dda 12152 1 2024-09-13T02:54:13.399 INFO:tasks.workunit.client.1.smithi131.stdout:2/478: dwrite d5/d31/d1d/d37/f56 [0,4194304] 0 2024-09-13T02:54:13.399 INFO:tasks.workunit.client.1.smithi131.stdout:2/479: chown d5/fa 148742446 1 2024-09-13T02:54:13.399 INFO:tasks.workunit.client.1.smithi131.stdout:2/480: chown d5/f3a 6161 1 2024-09-13T02:54:13.403 INFO:tasks.workunit.client.1.smithi131.stdout:7/475: dread d1b/f1f [0,4194304] 0 2024-09-13T02:54:13.403 INFO:tasks.workunit.client.1.smithi131.stdout:7/476: dread - d1b/d3b/d41/d81/f97 zero size 2024-09-13T02:54:13.405 INFO:tasks.workunit.client.1.smithi131.stdout:2/481: symlink d5/d31/d26/la2 0 2024-09-13T02:54:13.406 INFO:tasks.workunit.client.1.smithi131.stdout:0/680: rmdir d0/de/d45/d78 39 2024-09-13T02:54:13.409 INFO:tasks.workunit.client.1.smithi131.stdout:8/421: dread db/d2b/f6f [0,4194304] 0 2024-09-13T02:54:13.411 INFO:tasks.workunit.client.1.smithi131.stdout:2/482: rename d5/d33 to d5/d31/d4e/d78/da3 0 2024-09-13T02:54:13.413 INFO:tasks.workunit.client.1.smithi131.stdout:8/422: mkdir db/d2b/d82 0 2024-09-13T02:54:13.414 INFO:tasks.workunit.client.1.smithi131.stdout:8/423: creat db/d1d/d34/d4e/d7e/f83 x:0 0 0 2024-09-13T02:54:13.414 INFO:tasks.workunit.client.1.smithi131.stdout:8/424: write db/f15 [2363582,122476] 0 2024-09-13T02:54:13.414 INFO:tasks.workunit.client.1.smithi131.stdout:8/425: chown l1 130152 1 2024-09-13T02:54:13.414 INFO:tasks.workunit.client.1.smithi131.stdout:8/426: chown db 200767420 1 2024-09-13T02:54:13.415 INFO:tasks.workunit.client.1.smithi131.stdout:8/427: symlink db/d1d/d1f/d67/l84 0 2024-09-13T02:54:13.416 INFO:tasks.workunit.client.1.smithi131.stdout:0/681: getdents d0/de/d45/d86 0 2024-09-13T02:54:13.426 INFO:tasks.workunit.client.1.smithi131.stdout:2/483: write d5/d31/d1d/f52 [1292753,113069] 0 2024-09-13T02:54:13.428 INFO:tasks.workunit.client.1.smithi131.stdout:2/484: mknod d5/d18/d4b/d8e/d48/d4c/ca4 0 2024-09-13T02:54:13.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:13 smithi131 ceph-mon[34689]: from='client.14618 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:54:13.437 INFO:tasks.workunit.client.1.smithi131.stdout:7/477: dwrite d1b/d3b/d41/f59 [0,4194304] 0 2024-09-13T02:54:13.445 INFO:tasks.workunit.client.1.smithi131.stdout:2/485: dread d5/f28 [0,4194304] 0 2024-09-13T02:54:13.445 INFO:tasks.workunit.client.1.smithi131.stdout:8/428: dwrite db/d1d/f5e [0,4194304] 0 2024-09-13T02:54:13.445 INFO:tasks.workunit.client.1.smithi131.stdout:8/429: chown db/lf 419089 1 2024-09-13T02:54:13.445 INFO:tasks.workunit.client.1.smithi131.stdout:8/430: creat db/d1d/d1f/d67/f85 x:0 0 0 2024-09-13T02:54:13.445 INFO:tasks.workunit.client.1.smithi131.stdout:8/431: stat db/d1d/d1f/d41/d50/l58 0 2024-09-13T02:54:13.457 INFO:tasks.workunit.client.1.smithi131.stdout:2/486: symlink d5/d18/d68/la5 0 2024-09-13T02:54:13.459 INFO:tasks.workunit.client.1.smithi131.stdout:2/487: truncate d5/d31/d1d/d32/f49 1304664 0 2024-09-13T02:54:13.459 INFO:tasks.workunit.client.1.smithi131.stdout:2/488: stat d5/d31/d1d/d32/d3b/d67/c69 0 2024-09-13T02:54:13.460 INFO:tasks.workunit.client.1.smithi131.stdout:7/478: dwrite f4 [0,4194304] 0 2024-09-13T02:54:13.485 INFO:tasks.workunit.client.1.smithi131.stdout:8/432: dwrite db/d2b/f6f [0,4194304] 0 2024-09-13T02:54:13.486 INFO:tasks.workunit.client.1.smithi131.stdout:8/433: getdents db/d1d/d1f/d5c 0 2024-09-13T02:54:13.486 INFO:tasks.workunit.client.1.smithi131.stdout:7/479: dwrite d1b/d3b/d41/f59 [0,4194304] 0 2024-09-13T02:54:13.491 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.490+0000 7f5b38ef3640 1 -- 172.21.15.89:0/2787260550 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f5b3404b720 con 0x7f5b340fc6f0 2024-09-13T02:54:13.491 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.490+0000 7f5b2b7fe640 1 -- 172.21.15.89:0/2787260550 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+643 (secure 0 0 0) 0x7f5b1c02c870 con 0x7f5b340fc6f0 2024-09-13T02:54:13.492 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-13T02:54:13.492 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": { 2024-09-13T02:54:13.492 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 2 2024-09-13T02:54:13.492 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T02:54:13.492 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": { 2024-09-13T02:54:13.492 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 2 2024-09-13T02:54:13.492 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T02:54:13.492 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": { 2024-09-13T02:54:13.492 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 6 2024-09-13T02:54:13.492 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T02:54:13.492 INFO:teuthology.orchestra.run.smithi089.stdout: "mds": { 2024-09-13T02:54:13.492 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 4 2024-09-13T02:54:13.493 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T02:54:13.493 INFO:teuthology.orchestra.run.smithi089.stdout: "overall": { 2024-09-13T02:54:13.493 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 14 2024-09-13T02:54:13.493 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-13T02:54:13.493 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-13T02:54:13.494 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.493+0000 7f5b38ef3640 1 -- 172.21.15.89:0/2787260550 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f5b2006ed60 msgr2=0x7f5b20071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:13.494 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.493+0000 7f5b38ef3640 1 --2- 172.21.15.89:0/2787260550 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f5b2006ed60 0x7f5b20071210 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f5b34066240 tx=0x7f5b2400b040 comp rx=0 tx=0).stop 2024-09-13T02:54:13.494 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.493+0000 7f5b38ef3640 1 -- 172.21.15.89:0/2787260550 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b340fc6f0 msgr2=0x7f5b341122a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:13.494 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.493+0000 7f5b38ef3640 1 --2- 172.21.15.89:0/2787260550 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b340fc6f0 0x7f5b341122a0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c0048a0 tx=0x7f5b1c009da0 comp rx=0 tx=0).stop 2024-09-13T02:54:13.494 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.493+0000 7f5b38ef3640 1 -- 172.21.15.89:0/2787260550 shutdown_connections 2024-09-13T02:54:13.494 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.493+0000 7f5b38ef3640 1 --2- 172.21.15.89:0/2787260550 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5b340fc6f0 0x7f5b341122a0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:13.494 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.493+0000 7f5b38ef3640 1 --2- 172.21.15.89:0/2787260550 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f5b2006ed60 0x7f5b20071210 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:13.494 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.493+0000 7f5b38ef3640 1 --2- 172.21.15.89:0/2787260550 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5b340fb420 0x7f5b3410fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:13.495 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.493+0000 7f5b38ef3640 1 -- 172.21.15.89:0/2787260550 >> 172.21.15.89:0/2787260550 conn(0x7f5b340f6c00 msgr2=0x7f5b340f83b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:54:13.495 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.493+0000 7f5b38ef3640 1 -- 172.21.15.89:0/2787260550 shutdown_connections 2024-09-13T02:54:13.495 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.493+0000 7f5b38ef3640 1 -- 172.21.15.89:0/2787260550 wait complete. 2024-09-13T02:54:13.496 INFO:tasks.workunit.client.1.smithi131.stdout:7/480: write d1b/d23/d89/f90 [3263128,78665] 0 2024-09-13T02:54:13.507 INFO:tasks.workunit.client.1.smithi131.stdout:7/481: write d1b/d3b/f5b [44080,49193] 0 2024-09-13T02:54:13.508 INFO:tasks.workunit.client.1.smithi131.stdout:8/434: dwrite db/d1d/f5e [0,4194304] 0 2024-09-13T02:54:13.510 INFO:tasks.workunit.client.1.smithi131.stdout:7/482: creat d1b/d3b/d51/d8f/fa4 x:0 0 0 2024-09-13T02:54:13.515 INFO:tasks.workunit.client.1.smithi131.stdout:8/435: write db/d1d/d1f/f52 [1802812,62331] 0 2024-09-13T02:54:13.515 INFO:tasks.workunit.client.1.smithi131.stdout:8/436: readlink db/d1d/d1f/d41/l5b 0 2024-09-13T02:54:13.531 INFO:tasks.workunit.client.1.smithi131.stdout:7/483: dwrite d1b/d3b/d41/f59 [0,4194304] 0 2024-09-13T02:54:13.531 INFO:tasks.workunit.client.1.smithi131.stdout:7/484: write d1b/d23/d54/f65 [4239275,6758] 0 2024-09-13T02:54:13.533 INFO:tasks.workunit.client.1.smithi131.stdout:7/485: mkdir d1b/d3b/d51/d62/d6d/da5 0 2024-09-13T02:54:13.535 INFO:tasks.workunit.client.1.smithi131.stdout:8/437: dwrite db/d2e/f43 [0,4194304] 0 2024-09-13T02:54:13.535 INFO:tasks.workunit.client.1.smithi131.stdout:7/486: rename d1b/f34 to d1b/d3b/d51/d62/d9e/da2/fa6 0 2024-09-13T02:54:13.535 INFO:tasks.workunit.client.1.smithi131.stdout:8/438: stat db/d1d/l1e 0 2024-09-13T02:54:13.536 INFO:tasks.workunit.client.1.smithi131.stdout:7/487: mkdir d1b/d3b/d41/da7 0 2024-09-13T02:54:13.536 INFO:tasks.workunit.client.1.smithi131.stdout:7/488: creat d1b/fa8 x:0 0 0 2024-09-13T02:54:13.538 INFO:tasks.workunit.client.1.smithi131.stdout:7/489: creat d1b/d3b/d51/d62/d9e/fa9 x:0 0 0 2024-09-13T02:54:13.538 INFO:tasks.workunit.client.1.smithi131.stdout:7/490: fsync d1b/f1f 0 2024-09-13T02:54:13.539 INFO:tasks.workunit.client.1.smithi131.stdout:7/491: link l15 d1b/d3b/d41/da7/laa 0 2024-09-13T02:54:13.539 INFO:tasks.workunit.client.1.smithi131.stdout:7/492: chown d1b/d3b/d41/da7 0 1 2024-09-13T02:54:13.539 INFO:tasks.workunit.client.1.smithi131.stdout:7/493: write d1b/fa8 [400189,81405] 0 2024-09-13T02:54:13.540 INFO:tasks.workunit.client.1.smithi131.stdout:7/494: symlink d1b/d3b/lab 0 2024-09-13T02:54:13.543 INFO:tasks.workunit.client.1.smithi131.stdout:7/495: getdents d1b/d3b/d51/d8f 0 2024-09-13T02:54:13.544 INFO:tasks.workunit.client.1.smithi131.stdout:7/496: mkdir d1b/d3b/d51/d62/d6d/dac 0 2024-09-13T02:54:13.546 INFO:tasks.workunit.client.1.smithi131.stdout:7/497: dread d1b/d23/f4c [0,4194304] 0 2024-09-13T02:54:13.555 INFO:tasks.workunit.client.1.smithi131.stdout:7/498: dread d1b/d3b/d41/f59 [0,4194304] 0 2024-09-13T02:54:13.556 INFO:tasks.workunit.client.1.smithi131.stdout:7/499: mknod d1b/d3b/d51/d8b/cad 0 2024-09-13T02:54:13.556 INFO:tasks.workunit.client.1.smithi131.stdout:7/500: stat d1b/d3b/d51/d8b/d99 0 2024-09-13T02:54:13.571 INFO:tasks.workunit.client.1.smithi131.stdout:7/501: dwrite d1b/d3b/d31/d5f/f9c [0,4194304] 0 2024-09-13T02:54:13.573 INFO:tasks.workunit.client.1.smithi131.stdout:7/502: rename d1b/d23/d54/f65 to d1b/d3b/d41/da7/fae 0 2024-09-13T02:54:13.574 INFO:tasks.workunit.client.1.smithi131.stdout:7/503: mknod d1b/d3b/d51/d8f/caf 0 2024-09-13T02:54:13.575 INFO:tasks.workunit.client.1.smithi131.stdout:7/504: truncate d1b/d3b/d41/da7/fae 2774010 0 2024-09-13T02:54:13.575 INFO:tasks.workunit.client.1.smithi131.stdout:7/505: stat d1b/d73/f70 0 2024-09-13T02:54:13.575 INFO:tasks.workunit.client.1.smithi131.stdout:7/506: fsync d1b/d3b/d41/f77 0 2024-09-13T02:54:13.576 INFO:tasks.workunit.client.1.smithi131.stdout:7/507: symlink d1b/d3b/d31/d7c/lb0 0 2024-09-13T02:54:13.577 INFO:tasks.workunit.client.1.smithi131.stdout:7/508: truncate d1b/f1f 4276845 0 2024-09-13T02:54:13.577 INFO:tasks.workunit.client.1.smithi131.stdout:7/509: symlink d1b/d3b/d31/d38/lb1 0 2024-09-13T02:54:13.589 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.586+0000 7f373db8f640 1 -- 172.21.15.89:0/2490734416 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37380fdb70 msgr2=0x7f37380fdf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:13.589 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.586+0000 7f373db8f640 1 --2- 172.21.15.89:0/2490734416 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37380fdb70 0x7f37380fdf80 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f37280048d0 tx=0x7f3728009da0 comp rx=0 tx=0).stop 2024-09-13T02:54:13.589 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.586+0000 7f373db8f640 1 -- 172.21.15.89:0/2490734416 shutdown_connections 2024-09-13T02:54:13.589 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.586+0000 7f373db8f640 1 --2- 172.21.15.89:0/2490734416 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f37380fe4c0 0x7f37380fa620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:13.589 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.586+0000 7f373db8f640 1 --2- 172.21.15.89:0/2490734416 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37380fdb70 0x7f37380fdf80 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:13.589 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.586+0000 7f373db8f640 1 -- 172.21.15.89:0/2490734416 >> 172.21.15.89:0/2490734416 conn(0x7f37380f6390 msgr2=0x7f37380f87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:54:13.589 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.586+0000 7f373db8f640 1 -- 172.21.15.89:0/2490734416 shutdown_connections 2024-09-13T02:54:13.589 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.586+0000 7f373db8f640 1 -- 172.21.15.89:0/2490734416 wait complete. 2024-09-13T02:54:13.590 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.587+0000 7f373db8f640 1 Processor -- start 2024-09-13T02:54:13.590 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.587+0000 7f373db8f640 1 -- start start 2024-09-13T02:54:13.590 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.587+0000 7f373db8f640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f37380fdb70 0x7f373810d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:54:13.590 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.587+0000 7f373db8f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37380fe4c0 0x7f373810d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:54:13.590 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.587+0000 7f373db8f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f373810dc00 con 0x7f37380fe4c0 2024-09-13T02:54:13.590 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.587+0000 7f373db8f640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f373810e420 con 0x7f37380fdb70 2024-09-13T02:54:13.590 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.587+0000 7f3736ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37380fe4c0 0x7f373810d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:54:13.590 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.587+0000 7f37377fe640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f37380fdb70 0x7f373810d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:54:13.590 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.587+0000 7f3736ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37380fe4c0 0x7f373810d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:46392/0 (socket says 172.21.15.89:46392) 2024-09-13T02:54:13.590 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.587+0000 7f37377fe640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f37380fdb70 0x7f373810d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.89:45716/0 (socket says 172.21.15.89:45716) 2024-09-13T02:54:13.590 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.587+0000 7f3736ffd640 1 -- 172.21.15.89:0/2894560358 learned_addr learned my addr 172.21.15.89:0/2894560358 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:54:13.590 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.588+0000 7f3736ffd640 1 -- 172.21.15.89:0/2894560358 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f37380fdb70 msgr2=0x7f373810d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:13.590 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.588+0000 7f3736ffd640 1 --2- 172.21.15.89:0/2894560358 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f37380fdb70 0x7f373810d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:13.591 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.588+0000 7f3736ffd640 1 -- 172.21.15.89:0/2894560358 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3728005040 con 0x7f37380fe4c0 2024-09-13T02:54:13.591 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.588+0000 7f3736ffd640 1 --2- 172.21.15.89:0/2894560358 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37380fe4c0 0x7f373810d5b0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f372c00eb70 tx=0x7f372c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:54:13.592 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.588+0000 7f371ffff640 1 -- 172.21.15.89:0/2894560358 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f372c007c30 con 0x7f37380fe4c0 2024-09-13T02:54:13.592 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.588+0000 7f373db8f640 1 -- 172.21.15.89:0/2894560358 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f373810e650 con 0x7f37380fe4c0 2024-09-13T02:54:13.592 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.588+0000 7f371ffff640 1 -- 172.21.15.89:0/2894560358 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f372c00f040 con 0x7f37380fe4c0 2024-09-13T02:54:13.592 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.588+0000 7f371ffff640 1 -- 172.21.15.89:0/2894560358 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f372c00c980 con 0x7f37380fe4c0 2024-09-13T02:54:13.592 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.588+0000 7f373db8f640 1 -- 172.21.15.89:0/2894560358 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f373810ebf0 con 0x7f37380fe4c0 2024-09-13T02:54:13.592 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.589+0000 7f373db8f640 1 -- 172.21.15.89:0/2894560358 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37380fa010 con 0x7f37380fe4c0 2024-09-13T02:54:13.592 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.590+0000 7f371ffff640 1 -- 172.21.15.89:0/2894560358 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f372c00cb40 con 0x7f37380fe4c0 2024-09-13T02:54:13.593 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.590+0000 7f371ffff640 1 --2- 172.21.15.89:0/2894560358 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f372006ed60 0x7f3720071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:54:13.593 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.590+0000 7f371ffff640 1 -- 172.21.15.89:0/2894560358 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f372c08dd70 con 0x7f37380fe4c0 2024-09-13T02:54:13.593 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.590+0000 7f37377fe640 1 --2- 172.21.15.89:0/2894560358 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f372006ed60 0x7f3720071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:54:13.593 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.591+0000 7f37377fe640 1 --2- 172.21.15.89:0/2894560358 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f372006ed60 0x7f3720071210 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3728004540 tx=0x7f3728035040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:54:13.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.595+0000 7f371ffff640 1 -- 172.21.15.89:0/2894560358 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f372c04e2a0 con 0x7f37380fe4c0 2024-09-13T02:54:13.708 INFO:tasks.workunit.client.1.smithi131.stdout:3/434: sync 2024-09-13T02:54:13.708 INFO:tasks.workunit.client.1.smithi131.stdout:3/435: creat d2/dc/d39/d61/f97 x:0 0 0 2024-09-13T02:54:13.708 INFO:tasks.workunit.client.1.smithi131.stdout:3/436: fsync d2/d4/f84 0 2024-09-13T02:54:13.709 INFO:tasks.workunit.client.1.smithi131.stdout:3/437: getdents d2/d4/d7/d8/d41/d5c 0 2024-09-13T02:54:13.709 INFO:tasks.workunit.client.1.smithi131.stdout:3/438: chown d2/d4/d1a/l29 9 1 2024-09-13T02:54:13.710 INFO:tasks.workunit.client.1.smithi131.stdout:3/439: dread - d2/d4/d7/d1d/d24/d6f/f7c zero size 2024-09-13T02:54:13.710 INFO:tasks.workunit.client.1.smithi131.stdout:3/440: rename d2/dc/d39/d61/f97 to d2/d4/d7/d1d/d24/d96/f98 0 2024-09-13T02:54:13.712 INFO:tasks.workunit.client.1.smithi131.stdout:3/441: link d2/dc/d39/c5f d2/d4/d76/c99 0 2024-09-13T02:54:13.718 INFO:tasks.workunit.client.1.smithi131.stdout:3/442: dread d2/d4/d7/d1d/d24/d6f/f8c [0,4194304] 0 2024-09-13T02:54:13.720 INFO:tasks.workunit.client.1.smithi131.stdout:3/443: link d2/d4/d7/d8/l2f d2/dc/d39/l9a 0 2024-09-13T02:54:13.721 INFO:tasks.workunit.client.1.smithi131.stdout:3/444: stat d2/dc/d39/d61/f6c 0 2024-09-13T02:54:13.722 INFO:tasks.workunit.client.1.smithi131.stdout:3/445: mknod d2/d4/d1a/d31/d48/c9b 0 2024-09-13T02:54:13.731 INFO:tasks.workunit.client.1.smithi131.stdout:3/446: dread d2/d4/d1a/d31/f42 [0,4194304] 0 2024-09-13T02:54:13.732 INFO:tasks.workunit.client.1.smithi131.stdout:3/447: mknod d2/c9c 0 2024-09-13T02:54:13.733 INFO:tasks.workunit.client.1.smithi131.stdout:3/448: symlink d2/d4/d7/d1d/d24/d6f/d73/l9d 0 2024-09-13T02:54:13.741 INFO:tasks.workunit.client.1.smithi131.stdout:3/449: dread d2/d4/d7/d1d/d24/d6f/f70 [0,4194304] 0 2024-09-13T02:54:13.743 INFO:tasks.workunit.client.1.smithi131.stdout:3/450: dread d2/d4/f23 [0,4194304] 0 2024-09-13T02:54:13.745 INFO:tasks.workunit.client.1.smithi131.stdout:3/451: getdents d2/d4/d7/d8/d41/d5c/d71 0 2024-09-13T02:54:13.745 INFO:tasks.workunit.client.1.smithi131.stdout:3/452: chown d2/d4/d1a/d31/d48/d69 831 1 2024-09-13T02:54:13.747 INFO:tasks.workunit.client.1.smithi131.stdout:3/453: rename d2/d4/d7/d8/c56 to d2/d4/d7/d8/d41/c9e 0 2024-09-13T02:54:13.753 INFO:tasks.workunit.client.1.smithi131.stdout:3/454: write d2/d4/f5d [3020939,18955] 0 2024-09-13T02:54:13.755 INFO:tasks.workunit.client.1.smithi131.stdout:3/455: rmdir d2/d4/d7/d1d/d24/d6f 39 2024-09-13T02:54:13.806 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.805+0000 7f373db8f640 1 -- 172.21.15.89:0/2894560358 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f373810eeb0 con 0x7f37380fe4c0 2024-09-13T02:54:13.807 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.805+0000 7f371ffff640 1 -- 172.21.15.89:0/2894560358 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1864 (secure 0 0 0) 0x7f372c05aef0 con 0x7f37380fe4c0 2024-09-13T02:54:13.807 INFO:teuthology.orchestra.run.smithi089.stdout:e21 2024-09-13T02:54:13.807 INFO:teuthology.orchestra.run.smithi089.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T02:54:13.807 INFO:teuthology.orchestra.run.smithi089.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:54:13.807 INFO:teuthology.orchestra.run.smithi089.stdout:legacy client fscid: 1 2024-09-13T02:54:13.807 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:54:13.807 INFO:teuthology.orchestra.run.smithi089.stdout:Filesystem 'cephfs' (1) 2024-09-13T02:54:13.808 INFO:teuthology.orchestra.run.smithi089.stdout:fs_name cephfs 2024-09-13T02:54:13.808 INFO:teuthology.orchestra.run.smithi089.stdout:epoch 21 2024-09-13T02:54:13.808 INFO:teuthology.orchestra.run.smithi089.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T02:54:13.808 INFO:teuthology.orchestra.run.smithi089.stdout:created 2024-09-13T02:51:40.657817+0000 2024-09-13T02:54:13.808 INFO:teuthology.orchestra.run.smithi089.stdout:modified 2024-09-13T02:54:05.118633+0000 2024-09-13T02:54:13.808 INFO:teuthology.orchestra.run.smithi089.stdout:tableserver 0 2024-09-13T02:54:13.808 INFO:teuthology.orchestra.run.smithi089.stdout:root 0 2024-09-13T02:54:13.808 INFO:teuthology.orchestra.run.smithi089.stdout:session_timeout 60 2024-09-13T02:54:13.808 INFO:teuthology.orchestra.run.smithi089.stdout:session_autoclose 300 2024-09-13T02:54:13.808 INFO:teuthology.orchestra.run.smithi089.stdout:max_file_size 1099511627776 2024-09-13T02:54:13.808 INFO:teuthology.orchestra.run.smithi089.stdout:required_client_features {} 2024-09-13T02:54:13.808 INFO:teuthology.orchestra.run.smithi089.stdout:last_failure 0 2024-09-13T02:54:13.808 INFO:teuthology.orchestra.run.smithi089.stdout:last_failure_osd_epoch 44 2024-09-13T02:54:13.809 INFO:teuthology.orchestra.run.smithi089.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:54:13.809 INFO:teuthology.orchestra.run.smithi089.stdout:max_mds 2 2024-09-13T02:54:13.809 INFO:teuthology.orchestra.run.smithi089.stdout:in 0,1 2024-09-13T02:54:13.809 INFO:teuthology.orchestra.run.smithi089.stdout:up {0=14480,1=24257} 2024-09-13T02:54:13.809 INFO:teuthology.orchestra.run.smithi089.stdout:failed 2024-09-13T02:54:13.809 INFO:teuthology.orchestra.run.smithi089.stdout:damaged 2024-09-13T02:54:13.809 INFO:teuthology.orchestra.run.smithi089.stdout:stopped 2024-09-13T02:54:13.809 INFO:teuthology.orchestra.run.smithi089.stdout:data_pools [3] 2024-09-13T02:54:13.809 INFO:teuthology.orchestra.run.smithi089.stdout:metadata_pool 2 2024-09-13T02:54:13.809 INFO:teuthology.orchestra.run.smithi089.stdout:inline_data disabled 2024-09-13T02:54:13.809 INFO:teuthology.orchestra.run.smithi089.stdout:balancer 2024-09-13T02:54:13.809 INFO:teuthology.orchestra.run.smithi089.stdout:standby_count_wanted 1 2024-09-13T02:54:13.809 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi089.rarddb{0:14480} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.89:6828/1561365213,v1:172.21.15.89:6829/1561365213] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:54:13.809 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi089.qjoitb{0:14488} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.89:6826/1464393547,v1:172.21.15.89:6827/1464393547] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:54:13.810 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi131.uasrkg{1:24257} state up:active seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.131:6824/260493836,v1:172.21.15.131:6825/260493836] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:54:13.810 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi131.rbovzc{1:24265} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.131:6826/665579373,v1:172.21.15.131:6827/665579373] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:54:13.810 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:54:13.810 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:54:13.810 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 21 2024-09-13T02:54:13.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.808+0000 7f373db8f640 1 -- 172.21.15.89:0/2894560358 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f372006ed60 msgr2=0x7f3720071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:13.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.808+0000 7f373db8f640 1 --2- 172.21.15.89:0/2894560358 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f372006ed60 0x7f3720071210 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f3728004540 tx=0x7f3728035040 comp rx=0 tx=0).stop 2024-09-13T02:54:13.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.808+0000 7f373db8f640 1 -- 172.21.15.89:0/2894560358 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37380fe4c0 msgr2=0x7f373810d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:13.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.808+0000 7f373db8f640 1 --2- 172.21.15.89:0/2894560358 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37380fe4c0 0x7f373810d5b0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f372c00eb70 tx=0x7f372c00b040 comp rx=0 tx=0).stop 2024-09-13T02:54:13.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.808+0000 7f373db8f640 1 -- 172.21.15.89:0/2894560358 shutdown_connections 2024-09-13T02:54:13.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.808+0000 7f373db8f640 1 --2- 172.21.15.89:0/2894560358 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f37380fe4c0 0x7f373810d5b0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:13.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.808+0000 7f373db8f640 1 --2- 172.21.15.89:0/2894560358 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f372006ed60 0x7f3720071210 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:13.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.808+0000 7f373db8f640 1 --2- 172.21.15.89:0/2894560358 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f37380fdb70 0x7f373810d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:13.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.808+0000 7f373db8f640 1 -- 172.21.15.89:0/2894560358 >> 172.21.15.89:0/2894560358 conn(0x7f37380f6390 msgr2=0x7f37380f7b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:54:13.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.808+0000 7f373db8f640 1 -- 172.21.15.89:0/2894560358 shutdown_connections 2024-09-13T02:54:13.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.808+0000 7f373db8f640 1 -- 172.21.15.89:0/2894560358 wait complete. 2024-09-13T02:54:13.820 INFO:tasks.workunit.client.1.smithi131.stdout:3/456: rename d2/d4/d7/d8 to d2/d4/d76/d9f 0 2024-09-13T02:54:13.843 INFO:tasks.workunit.client.1.smithi131.stdout:3/457: dwrite d2/d4/d1a/f6b [0,4194304] 0 2024-09-13T02:54:13.846 INFO:tasks.workunit.client.1.smithi131.stdout:3/458: creat d2/dc/d39/fa0 x:0 0 0 2024-09-13T02:54:13.847 INFO:tasks.workunit.client.1.smithi131.stdout:3/459: creat d2/dc/fa1 x:0 0 0 2024-09-13T02:54:13.848 INFO:tasks.workunit.client.1.smithi131.stdout:3/460: symlink d2/d4/d76/d9f/d41/d6e/la2 0 2024-09-13T02:54:13.851 INFO:tasks.workunit.client.1.smithi131.stdout:3/461: write d2/d4/d7/d1d/d24/d6f/f8c [310048,30387] 0 2024-09-13T02:54:13.853 INFO:tasks.workunit.client.1.smithi131.stdout:3/462: symlink d2/d4/d7/d1d/d80/la3 0 2024-09-13T02:54:13.855 INFO:tasks.workunit.client.1.smithi131.stdout:3/463: mknod d2/d4/d76/d9f/d41/d5c/d4f/ca4 0 2024-09-13T02:54:13.855 INFO:tasks.workunit.client.1.smithi131.stdout:3/464: write d2/d4/d1a/f1e [1650474,120822] 0 2024-09-13T02:54:13.855 INFO:tasks.workunit.client.1.smithi131.stdout:3/465: dread - d2/d4/d2d/d92/f90 zero size 2024-09-13T02:54:13.855 INFO:tasks.workunit.client.1.smithi131.stdout:3/466: truncate d2/d4/d76/d9f/d41/f68 838316 0 2024-09-13T02:54:13.855 INFO:tasks.workunit.client.1.smithi131.stdout:3/467: write d2/dc/d39/fa0 [543608,75395] 0 2024-09-13T02:54:13.855 INFO:tasks.workunit.client.1.smithi131.stdout:3/468: dread - d2/d4/d7/d1d/d24/d6f/f7c zero size 2024-09-13T02:54:13.855 INFO:tasks.workunit.client.1.smithi131.stdout:3/469: stat d2/d4/d76/d9f/d41/d5c/d4f 0 2024-09-13T02:54:13.856 INFO:tasks.workunit.client.1.smithi131.stdout:3/470: creat d2/d4/d76/d9f/d41/d5c/d49/fa5 x:0 0 0 2024-09-13T02:54:13.856 INFO:tasks.workunit.client.1.smithi131.stdout:3/471: chown d2/d4/d7/d1d/d24/d6f/d7f 2286931 1 2024-09-13T02:54:13.858 INFO:tasks.workunit.client.1.smithi131.stdout:3/472: rename d2/d4/d2d/f33 to d2/d4/d76/d9f/fa6 0 2024-09-13T02:54:13.858 INFO:tasks.workunit.client.1.smithi131.stdout:3/473: write d2/dc/fa1 [254462,79443] 0 2024-09-13T02:54:13.858 INFO:tasks.workunit.client.1.smithi131.stdout:3/474: write d2/dc/f2a [5534967,20586] 0 2024-09-13T02:54:13.859 INFO:tasks.workunit.client.1.smithi131.stdout:3/475: truncate d2/d4/d1a/f37 1147044 0 2024-09-13T02:54:13.866 INFO:tasks.workunit.client.1.smithi131.stdout:3/476: write d2/d4/d76/d9f/fa6 [1708011,33901] 0 2024-09-13T02:54:13.866 INFO:tasks.workunit.client.1.smithi131.stdout:3/477: truncate d2/dc/d39/f79 995112 0 2024-09-13T02:54:13.867 INFO:tasks.workunit.client.1.smithi131.stdout:3/478: rename d2/dc/d91 to d2/d4/d1a/d31/da7 0 2024-09-13T02:54:13.868 INFO:tasks.workunit.client.1.smithi131.stdout:3/479: getdents d2/dc/d39/d61 0 2024-09-13T02:54:13.868 INFO:tasks.workunit.client.1.smithi131.stdout:3/480: creat d2/dc/fa8 x:0 0 0 2024-09-13T02:54:13.870 INFO:tasks.workunit.client.1.smithi131.stdout:3/481: creat d2/d4/d76/d9f/d41/fa9 x:0 0 0 2024-09-13T02:54:13.871 INFO:tasks.workunit.client.1.smithi131.stdout:3/482: rename d2/d4/d7/c36 to d2/d4/d7/d1d/d24/d7e/caa 0 2024-09-13T02:54:13.898 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.896+0000 7f223249b640 1 -- 172.21.15.89:0/4091795227 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f222c0fc700 msgr2=0x7f222c0fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:13.898 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.896+0000 7f223249b640 1 --2- 172.21.15.89:0/4091795227 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f222c0fc700 0x7f222c0fcb70 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f22140048d0 tx=0x7f2214009da0 comp rx=0 tx=0).stop 2024-09-13T02:54:13.898 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.896+0000 7f223249b640 1 -- 172.21.15.89:0/4091795227 shutdown_connections 2024-09-13T02:54:13.898 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.896+0000 7f223249b640 1 --2- 172.21.15.89:0/4091795227 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f222c0fc700 0x7f222c0fcb70 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:13.899 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.896+0000 7f223249b640 1 --2- 172.21.15.89:0/4091795227 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f222c0fb430 0x7f222c0fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:13.899 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.896+0000 7f223249b640 1 -- 172.21.15.89:0/4091795227 >> 172.21.15.89:0/4091795227 conn(0x7f222c0f6c10 msgr2=0x7f222c0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:54:13.899 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.897+0000 7f223249b640 1 -- 172.21.15.89:0/4091795227 shutdown_connections 2024-09-13T02:54:13.899 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.897+0000 7f223249b640 1 -- 172.21.15.89:0/4091795227 wait complete. 2024-09-13T02:54:13.899 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.897+0000 7f223249b640 1 Processor -- start 2024-09-13T02:54:13.899 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.897+0000 7f223249b640 1 -- start start 2024-09-13T02:54:13.900 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.897+0000 7f223249b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f222c0fb430 0x7f222c10bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:54:13.900 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.897+0000 7f223249b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f222c0fc700 0x7f222c10c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:54:13.900 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.897+0000 7f223249b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f222c10d370 con 0x7f222c0fb430 2024-09-13T02:54:13.901 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.897+0000 7f223249b640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f222c10d4e0 con 0x7f222c0fc700 2024-09-13T02:54:13.901 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.897+0000 7f222bfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f222c0fb430 0x7f222c10bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:54:13.901 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.898+0000 7f222bfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f222c0fb430 0x7f222c10bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:46410/0 (socket says 172.21.15.89:46410) 2024-09-13T02:54:13.901 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.898+0000 7f222bfff640 1 -- 172.21.15.89:0/1784586472 learned_addr learned my addr 172.21.15.89:0/1784586472 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:54:13.901 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.898+0000 7f222b7fe640 1 --2- 172.21.15.89:0/1784586472 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f222c0fc700 0x7f222c10c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:54:13.901 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.898+0000 7f222bfff640 1 -- 172.21.15.89:0/1784586472 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f222c0fc700 msgr2=0x7f222c10c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:13.901 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.898+0000 7f222bfff640 1 --2- 172.21.15.89:0/1784586472 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f222c0fc700 0x7f222c10c500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:13.901 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.898+0000 7f222bfff640 1 -- 172.21.15.89:0/1784586472 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2214005040 con 0x7f222c0fb430 2024-09-13T02:54:13.901 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.898+0000 7f222b7fe640 1 --2- 172.21.15.89:0/1784586472 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f222c0fc700 0x7f222c10c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T02:54:13.901 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.898+0000 7f222bfff640 1 --2- 172.21.15.89:0/1784586472 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f222c0fb430 0x7f222c10bfc0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f221c00b790 tx=0x7f221c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:54:13.901 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.898+0000 7f2228ff9640 1 -- 172.21.15.89:0/1784586472 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f221c00c700 con 0x7f222c0fb430 2024-09-13T02:54:13.901 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.898+0000 7f223249b640 1 -- 172.21.15.89:0/1784586472 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f222c10d7c0 con 0x7f222c0fb430 2024-09-13T02:54:13.901 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.898+0000 7f2228ff9640 1 -- 172.21.15.89:0/1784586472 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f221c00cd00 con 0x7f222c0fb430 2024-09-13T02:54:13.902 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.898+0000 7f2228ff9640 1 -- 172.21.15.89:0/1784586472 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f221c015e70 con 0x7f222c0fb430 2024-09-13T02:54:13.902 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.898+0000 7f223249b640 1 -- 172.21.15.89:0/1784586472 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f222c10dce0 con 0x7f222c0fb430 2024-09-13T02:54:13.902 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.899+0000 7f223249b640 1 -- 172.21.15.89:0/1784586472 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f222c1046c0 con 0x7f222c0fb430 2024-09-13T02:54:13.902 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.900+0000 7f2228ff9640 1 -- 172.21.15.89:0/1784586472 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7f221c012070 con 0x7f222c0fb430 2024-09-13T02:54:13.902 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.900+0000 7f2228ff9640 1 --2- 172.21.15.89:0/1784586472 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f221806ed60 0x7f2218071210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:54:13.902 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.900+0000 7f2228ff9640 1 -- 172.21.15.89:0/1784586472 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7f221c08dd50 con 0x7f222c0fb430 2024-09-13T02:54:13.903 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.900+0000 7f222b7fe640 1 --2- 172.21.15.89:0/1784586472 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f221806ed60 0x7f2218071210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:54:13.903 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.901+0000 7f222b7fe640 1 --2- 172.21.15.89:0/1784586472 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f221806ed60 0x7f2218071210 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2214007ac0 tx=0x7f2214035040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:54:13.905 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:13.904+0000 7f2228ff9640 1 -- 172.21.15.89:0/1784586472 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7f221c05ae20 con 0x7f222c0fb430 2024-09-13T02:54:13.999 INFO:tasks.workunit.client.1.smithi131.stdout:4/565: sync 2024-09-13T02:54:14.012 INFO:tasks.workunit.client.1.smithi131.stdout:4/566: dwrite d1/d18/d43/d7d/d9f/fc2 [0,4194304] 0 2024-09-13T02:54:14.024 INFO:tasks.workunit.client.1.smithi131.stdout:4/567: dread d1/d18/d43/d97/dba/f2e [0,4194304] 0 2024-09-13T02:54:14.035 INFO:tasks.workunit.client.1.smithi131.stdout:4/568: dread d1/d18/d43/d97/dba/d22/d49/f61 [0,4194304] 0 2024-09-13T02:54:14.035 INFO:tasks.workunit.client.1.smithi131.stdout:4/569: write d1/d18/d34/d62/f9c [564580,102350] 0 2024-09-13T02:54:14.035 INFO:tasks.workunit.client.1.smithi131.stdout:4/570: read - d1/d18/f9a zero size 2024-09-13T02:54:14.050 INFO:tasks.workunit.client.1.smithi131.stdout:4/571: dwrite d1/d18/d43/d97/fa5 [0,4194304] 0 2024-09-13T02:54:14.052 INFO:tasks.workunit.client.1.smithi131.stdout:4/572: stat d1/d18/d43/d97/dba/f3b 0 2024-09-13T02:54:14.052 INFO:tasks.workunit.client.1.smithi131.stdout:4/573: write d1/d18/d43/d97/dba/d19/d29/d33/d3a/f74 [250603,81945] 0 2024-09-13T02:54:14.053 INFO:tasks.workunit.client.1.smithi131.stdout:4/574: creat d1/d18/d43/d97/dba/d22/d49/fc3 x:0 0 0 2024-09-13T02:54:14.053 INFO:tasks.workunit.client.1.smithi131.stdout:4/575: truncate d1/d18/f5c 623531 0 2024-09-13T02:54:14.055 INFO:tasks.workunit.client.1.smithi131.stdout:4/576: rmdir d1/d18/d43/d7d/d9f 39 2024-09-13T02:54:14.055 INFO:tasks.workunit.client.1.smithi131.stdout:4/577: stat d1/f5 0 2024-09-13T02:54:14.055 INFO:tasks.workunit.client.1.smithi131.stdout:4/578: read d1/f27 [477604,110965] 0 2024-09-13T02:54:14.059 INFO:tasks.workunit.client.1.smithi131.stdout:4/579: dread d1/d18/d43/d65/dbd/dc1/d13/f44 [0,4194304] 0 2024-09-13T02:54:14.066 INFO:tasks.workunit.client.1.smithi131.stdout:4/580: creat d1/d18/d43/d97/dba/d7a/fc4 x:0 0 0 2024-09-13T02:54:14.075 INFO:tasks.workunit.client.1.smithi131.stdout:4/581: mkdir d1/d18/d43/d97/dba/d7a/dc5 0 2024-09-13T02:54:14.075 INFO:tasks.workunit.client.1.smithi131.stdout:4/582: write d1/d18/f9a [815340,6915] 0 2024-09-13T02:54:14.089 INFO:tasks.workunit.client.1.smithi131.stdout:4/583: dwrite d1/d18/d43/d97/dba/d22/d49/f94 [4194304,4194304] 0 2024-09-13T02:54:14.091 INFO:tasks.workunit.client.1.smithi131.stdout:4/584: rename d1/d18/d43/d65/dbd/dc1/c89 to d1/d18/d43/d97/dba/d19/cc6 0 2024-09-13T02:54:14.096 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:14.095+0000 7f223249b640 1 -- 172.21.15.89:0/1784586472 --> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f222c10dfb0 con 0x7f221806ed60 2024-09-13T02:54:14.098 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:14.097+0000 7f2228ff9640 1 -- 172.21.15.89:0/1784586472 <== mgr.14204 v2:172.21.15.89:6800/1506060926 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+447 (secure 0 0 0) 0x7f222c10dfb0 con 0x7f221806ed60 2024-09-13T02:54:14.098 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-13T02:54:14.098 INFO:teuthology.orchestra.run.smithi089.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d", 2024-09-13T02:54:14.098 INFO:teuthology.orchestra.run.smithi089.stdout: "in_progress": true, 2024-09-13T02:54:14.098 INFO:teuthology.orchestra.run.smithi089.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T02:54:14.099 INFO:teuthology.orchestra.run.smithi089.stdout: "services_complete": [], 2024-09-13T02:54:14.099 INFO:teuthology.orchestra.run.smithi089.stdout: "progress": "0/21 daemons upgraded", 2024-09-13T02:54:14.099 INFO:teuthology.orchestra.run.smithi089.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d image on host smithi131", 2024-09-13T02:54:14.099 INFO:teuthology.orchestra.run.smithi089.stdout: "is_paused": false 2024-09-13T02:54:14.099 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-13T02:54:14.101 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:14.100+0000 7f223249b640 1 -- 172.21.15.89:0/1784586472 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f221806ed60 msgr2=0x7f2218071210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:14.102 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:14.100+0000 7f223249b640 1 --2- 172.21.15.89:0/1784586472 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f221806ed60 0x7f2218071210 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2214007ac0 tx=0x7f2214035040 comp rx=0 tx=0).stop 2024-09-13T02:54:14.102 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:14.100+0000 7f223249b640 1 -- 172.21.15.89:0/1784586472 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f222c0fb430 msgr2=0x7f222c10bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:14.102 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:14.100+0000 7f223249b640 1 --2- 172.21.15.89:0/1784586472 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f222c0fb430 0x7f222c10bfc0 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f221c00b790 tx=0x7f221c0091d0 comp rx=0 tx=0).stop 2024-09-13T02:54:14.102 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:14.100+0000 7f223249b640 1 -- 172.21.15.89:0/1784586472 shutdown_connections 2024-09-13T02:54:14.102 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:14.100+0000 7f223249b640 1 --2- 172.21.15.89:0/1784586472 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7f221806ed60 0x7f2218071210 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:14.102 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:14.100+0000 7f223249b640 1 --2- 172.21.15.89:0/1784586472 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f222c0fc700 0x7f222c10c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:14.102 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:14.100+0000 7f223249b640 1 --2- 172.21.15.89:0/1784586472 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f222c0fb430 0x7f222c10bfc0 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:14.102 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:14.100+0000 7f223249b640 1 -- 172.21.15.89:0/1784586472 >> 172.21.15.89:0/1784586472 conn(0x7f222c0f6c10 msgr2=0x7f222c0f83a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:54:14.102 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:14.100+0000 7f223249b640 1 -- 172.21.15.89:0/1784586472 shutdown_connections 2024-09-13T02:54:14.102 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:14.100+0000 7f223249b640 1 -- 172.21.15.89:0/1784586472 wait complete. 2024-09-13T02:54:14.103 INFO:tasks.workunit.client.1.smithi131.stdout:1/466: sync 2024-09-13T02:54:14.103 INFO:tasks.workunit.client.1.smithi131.stdout:9/460: sync 2024-09-13T02:54:14.103 INFO:tasks.workunit.client.1.smithi131.stdout:9/461: chown d0/d3/d14/l54 800 1 2024-09-13T02:54:14.104 INFO:tasks.workunit.client.1.smithi131.stdout:1/467: creat dd/d51/d5a/fa9 x:0 0 0 2024-09-13T02:54:14.109 INFO:tasks.workunit.client.1.smithi131.stdout:4/585: dwrite d1/d18/d43/d65/dbd/dc1/fb4 [0,4194304] 0 2024-09-13T02:54:14.113 INFO:tasks.workunit.client.1.smithi131.stdout:4/586: dread d1/d18/d81/f82 [0,4194304] 0 2024-09-13T02:54:14.114 INFO:tasks.workunit.client.1.smithi131.stdout:4/587: mkdir d1/d18/d43/d65/dc7 0 2024-09-13T02:54:14.114 INFO:tasks.workunit.client.1.smithi131.stdout:4/588: fdatasync d1/d18/d43/d65/dbd/dc1/f17 0 2024-09-13T02:54:14.123 INFO:tasks.workunit.client.1.smithi131.stdout:9/462: dwrite d0/d3/d14/d1a/d2a/f4f [0,4194304] 0 2024-09-13T02:54:14.125 INFO:tasks.workunit.client.1.smithi131.stdout:4/589: write d1/d18/d43/d65/dbd/dc1/f1d [3515829,6614] 0 2024-09-13T02:54:14.125 INFO:tasks.workunit.client.1.smithi131.stdout:1/468: dwrite dd/d51/f9a [0,4194304] 0 2024-09-13T02:54:14.126 INFO:tasks.workunit.client.1.smithi131.stdout:9/463: mkdir d0/d4d/d55/d76/d96 0 2024-09-13T02:54:14.128 INFO:tasks.workunit.client.1.smithi131.stdout:4/590: mknod d1/d18/d43/d65/dbd/dc1/d13/cc8 0 2024-09-13T02:54:14.130 INFO:tasks.workunit.client.1.smithi131.stdout:1/469: creat dd/d26/d2a/d2c/d4b/faa x:0 0 0 2024-09-13T02:54:14.130 INFO:tasks.workunit.client.1.smithi131.stdout:1/470: chown dd/la2 57 1 2024-09-13T02:54:14.131 INFO:tasks.workunit.client.1.smithi131.stdout:4/591: unlink d1/d18/d43/d65/dbd/dc1/f1d 0 2024-09-13T02:54:14.133 INFO:tasks.workunit.client.1.smithi131.stdout:1/471: rename dd/d26/f65 to dd/d26/d44/d6d/d7c/fab 0 2024-09-13T02:54:14.135 INFO:tasks.workunit.client.1.smithi131.stdout:4/592: fsync d1/d18/d43/d97/dba/d22/d49/f6e 0 2024-09-13T02:54:14.137 INFO:tasks.workunit.client.1.smithi131.stdout:1/472: link dd/d26/d2a/d69/f7b dd/d33/d80/fac 0 2024-09-13T02:54:14.137 INFO:tasks.workunit.client.1.smithi131.stdout:9/464: write d0/d3/d14/d17/d32/d39/f4a [5298950,103941] 0 2024-09-13T02:54:14.139 INFO:tasks.workunit.client.1.smithi131.stdout:4/593: rename d1/d18/d43/d7d/d9f to d1/d18/d43/d97/dba/d19/d29/d8d/dc9 0 2024-09-13T02:54:14.142 INFO:tasks.workunit.client.1.smithi131.stdout:1/473: truncate dd/d26/d44/f22 3007187 0 2024-09-13T02:54:14.145 INFO:tasks.workunit.client.1.smithi131.stdout:9/465: getdents d0/d3 0 2024-09-13T02:54:14.148 INFO:tasks.workunit.client.1.smithi131.stdout:6/569: sync 2024-09-13T02:54:14.148 INFO:tasks.workunit.client.1.smithi131.stdout:5/436: sync 2024-09-13T02:54:14.151 INFO:tasks.workunit.client.1.smithi131.stdout:1/474: mkdir dd/d51/dad 0 2024-09-13T02:54:14.151 INFO:tasks.workunit.client.1.smithi131.stdout:1/475: write dd/d33/f6a [504773,30598] 0 2024-09-13T02:54:14.152 INFO:tasks.workunit.client.1.smithi131.stdout:6/570: rename d1/d8/f7f to d1/d8/d9/db/d15/d26/d1c/d4e/d97/d3b/fb9 0 2024-09-13T02:54:14.154 INFO:tasks.workunit.client.1.smithi131.stdout:1/476: symlink dd/d33/lae 0 2024-09-13T02:54:14.154 INFO:tasks.workunit.client.1.smithi131.stdout:1/477: creat dd/d26/d44/d6d/d7c/faf x:0 0 0 2024-09-13T02:54:14.154 INFO:tasks.workunit.client.1.smithi131.stdout:1/478: chown dd/f3a 447852138 1 2024-09-13T02:54:14.157 INFO:tasks.workunit.client.1.smithi131.stdout:1/479: symlink dd/d26/d44/d6d/lb0 0 2024-09-13T02:54:14.157 INFO:tasks.workunit.client.1.smithi131.stdout:1/480: dread - dd/d26/d44/d6d/d7c/fab zero size 2024-09-13T02:54:14.157 INFO:tasks.workunit.client.1.smithi131.stdout:1/481: stat dd/d68/c99 0 2024-09-13T02:54:14.162 INFO:tasks.workunit.client.1.smithi131.stdout:9/466: write d0/d4d/d55/f61 [846672,104668] 0 2024-09-13T02:54:14.165 INFO:tasks.workunit.client.1.smithi131.stdout:9/467: rename d0/d3/d14/d17/c46 to d0/d3/d14/c97 0 2024-09-13T02:54:14.165 INFO:tasks.workunit.client.1.smithi131.stdout:9/468: readlink d0/d3/d14/l1b 0 2024-09-13T02:54:14.165 INFO:tasks.workunit.client.1.smithi131.stdout:9/469: chown d0/d3/d14/d17/l81 0 1 2024-09-13T02:54:14.166 INFO:tasks.workunit.client.1.smithi131.stdout:9/470: mkdir d0/d4d/d98 0 2024-09-13T02:54:14.166 INFO:tasks.workunit.client.1.smithi131.stdout:9/471: creat d0/d3/d14/d17/d32/f99 x:0 0 0 2024-09-13T02:54:14.166 INFO:tasks.workunit.client.1.smithi131.stdout:9/472: write d0/f90 [3461414,52812] 0 2024-09-13T02:54:14.166 INFO:tasks.workunit.client.1.smithi131.stdout:9/473: write d0/d3/d14/d17/d32/d39/f50 [1391785,19270] 0 2024-09-13T02:54:14.167 INFO:tasks.workunit.client.1.smithi131.stdout:4/594: dwrite d1/d18/d34/d62/d78/db6/fb7 [0,4194304] 0 2024-09-13T02:54:14.171 INFO:tasks.workunit.client.1.smithi131.stdout:6/571: getdents d1/d8 0 2024-09-13T02:54:14.171 INFO:tasks.workunit.client.1.smithi131.stdout:6/572: chown d1/d8/d9/db/f64 130541931 1 2024-09-13T02:54:14.180 INFO:tasks.workunit.client.1.smithi131.stdout:4/595: read d1/d18/f21 [2086671,108671] 0 2024-09-13T02:54:14.180 INFO:tasks.workunit.client.1.smithi131.stdout:9/474: write d0/f9 [8382942,37366] 0 2024-09-13T02:54:14.181 INFO:tasks.workunit.client.1.smithi131.stdout:5/437: dwrite d1/d5/f4e [0,4194304] 0 2024-09-13T02:54:14.182 INFO:tasks.workunit.client.1.smithi131.stdout:4/596: rename d1/d18/d34/d62/d78/c79 to d1/d18/d43/d97/dba/d19/d29/d8d/cca 0 2024-09-13T02:54:14.182 INFO:tasks.workunit.client.1.smithi131.stdout:4/597: truncate d1/d18/d43/d7d/f92 1355943 0 2024-09-13T02:54:14.182 INFO:tasks.workunit.client.1.smithi131.stdout:4/598: dread - d1/d18/d43/d97/dba/d19/d29/d8d/dc9/fa0 zero size 2024-09-13T02:54:14.182 INFO:tasks.workunit.client.1.smithi131.stdout:6/573: dread d1/f2b [4194304,4194304] 0 2024-09-13T02:54:14.182 INFO:tasks.workunit.client.1.smithi131.stdout:6/574: write d1/d8/d9/db/d15/d26/d1c/d79/d92/fb7 [793110,98663] 0 2024-09-13T02:54:14.182 INFO:tasks.workunit.client.1.smithi131.stdout:1/482: dwrite f0 [0,4194304] 0 2024-09-13T02:54:14.183 INFO:tasks.workunit.client.1.smithi131.stdout:9/475: link d0/d3/d14/c3e d0/d3/d14/d1a/d2a/d75/c9a 0 2024-09-13T02:54:14.186 INFO:tasks.workunit.client.1.smithi131.stdout:4/599: rename d1/d18/d43/d97/dba/d22/l96 to d1/d18/d43/d97/dba/d19/d29/d33/d3a/lcb 0 2024-09-13T02:54:14.192 INFO:tasks.workunit.client.1.smithi131.stdout:1/483: symlink dd/d26/d44/d6d/d7c/lb1 0 2024-09-13T02:54:14.192 INFO:tasks.workunit.client.1.smithi131.stdout:9/476: creat d0/d3f/f9b x:0 0 0 2024-09-13T02:54:14.192 INFO:tasks.workunit.client.1.smithi131.stdout:6/575: dread d1/d8/d9/db/d15/f3d [0,4194304] 0 2024-09-13T02:54:14.193 INFO:tasks.workunit.client.1.smithi131.stdout:5/438: write d1/d1c/d8e/f48 [1217890,92612] 0 2024-09-13T02:54:14.193 INFO:tasks.workunit.client.1.smithi131.stdout:5/439: write d1/d5/f65 [528957,9331] 0 2024-09-13T02:54:14.193 INFO:tasks.workunit.client.1.smithi131.stdout:5/440: write d1/d1c/d8e/f5c [9260502,102278] 0 2024-09-13T02:54:14.193 INFO:tasks.workunit.client.1.smithi131.stdout:5/441: readlink d1/l1f 0 2024-09-13T02:54:14.194 INFO:tasks.workunit.client.1.smithi131.stdout:9/477: rename d0/d3/c4c to d0/d4d/c9c 0 2024-09-13T02:54:14.195 INFO:tasks.workunit.client.1.smithi131.stdout:2/489: sync 2024-09-13T02:54:14.195 INFO:tasks.workunit.client.1.smithi131.stdout:2/490: truncate d5/d34/f65 961382 0 2024-09-13T02:54:14.195 INFO:tasks.workunit.client.1.smithi131.stdout:0/682: sync 2024-09-13T02:54:14.195 INFO:tasks.workunit.client.1.smithi131.stdout:2/491: write d5/d31/d26/f86 [165188,130361] 0 2024-09-13T02:54:14.196 INFO:tasks.workunit.client.1.smithi131.stdout:8/439: sync 2024-09-13T02:54:14.197 INFO:tasks.workunit.client.1.smithi131.stdout:3/483: sync 2024-09-13T02:54:14.197 INFO:tasks.workunit.client.1.smithi131.stdout:3/484: chown d2/c9c 8190241 1 2024-09-13T02:54:14.197 INFO:tasks.workunit.client.1.smithi131.stdout:7/510: sync 2024-09-13T02:54:14.199 INFO:tasks.workunit.client.1.smithi131.stdout:4/600: write d1/d18/d43/d97/dba/d19/d29/f60 [2727638,68733] 0 2024-09-13T02:54:14.202 INFO:tasks.workunit.client.1.smithi131.stdout:1/484: dread dd/d26/d44/d6d/d7c/fa4 [0,4194304] 0 2024-09-13T02:54:14.203 INFO:tasks.workunit.client.1.smithi131.stdout:1/485: write dd/d26/d2a/d2c/f6b [27843,107573] 0 2024-09-13T02:54:14.203 INFO:tasks.workunit.client.1.smithi131.stdout:6/576: mknod d1/d8/d9/db/d15/d26/d1c/d4e/d97/d3b/cba 0 2024-09-13T02:54:14.203 INFO:tasks.workunit.client.1.smithi131.stdout:9/478: rmdir d0/d3/d14/d1a/d2a/d75 39 2024-09-13T02:54:14.203 INFO:tasks.workunit.client.1.smithi131.stdout:9/479: fsync d0/d3/d14/d17/f21 0 2024-09-13T02:54:14.203 INFO:tasks.workunit.client.1.smithi131.stdout:9/480: creat d0/d4d/f9d x:0 0 0 2024-09-13T02:54:14.204 INFO:tasks.workunit.client.1.smithi131.stdout:3/485: link d2/d4/d7/d1d/d24/d6f/d73/l9d d2/d4/d7/lab 0 2024-09-13T02:54:14.204 INFO:tasks.workunit.client.1.smithi131.stdout:7/511: rename d1b/d3b/d51/d8b/cad to d1b/d3b/d41/cb2 0 2024-09-13T02:54:14.207 INFO:tasks.workunit.client.1.smithi131.stdout:4/601: mkdir d1/d18/d43/d97/dba/d19/d29/d33/dcc 0 2024-09-13T02:54:14.207 INFO:tasks.workunit.client.1.smithi131.stdout:1/486: creat dd/d33/d80/fb2 x:0 0 0 2024-09-13T02:54:14.208 INFO:tasks.workunit.client.1.smithi131.stdout:9/481: unlink d0/d3/l45 0 2024-09-13T02:54:14.209 INFO:tasks.workunit.client.1.smithi131.stdout:1/487: mkdir dd/d51/db3 0 2024-09-13T02:54:14.210 INFO:tasks.workunit.client.1.smithi131.stdout:3/486: rmdir d2/d4/d1a/d31/d48/d69 39 2024-09-13T02:54:14.212 INFO:tasks.workunit.client.1.smithi131.stdout:3/487: rmdir d2/d4/d76/d9f/d41/d5c/d71 39 2024-09-13T02:54:14.212 INFO:tasks.workunit.client.1.smithi131.stdout:3/488: dread - d2/d4/f28 zero size 2024-09-13T02:54:14.214 INFO:tasks.workunit.client.1.smithi131.stdout:3/489: mknod d2/d4/d1a/d31/da7/cac 0 2024-09-13T02:54:14.218 INFO:tasks.workunit.client.1.smithi131.stdout:9/482: dread d0/d3/d14/d1a/d2a/f7d [0,4194304] 0 2024-09-13T02:54:14.220 INFO:tasks.workunit.client.1.smithi131.stdout:3/490: write d2/d4/d76/d9f/d41/d5c/d49/f4a [1852096,62014] 0 2024-09-13T02:54:14.222 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:14.220+0000 7fce33122640 1 -- 172.21.15.89:0/1094629176 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fce2c0fca00 msgr2=0x7fce2c0fce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:14.222 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:14.220+0000 7fce33122640 1 --2- 172.21.15.89:0/1094629176 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fce2c0fca00 0x7fce2c0fce10 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fce200048d0 tx=0x7fce20009da0 comp rx=0 tx=0).stop 2024-09-13T02:54:14.222 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:14.220+0000 7fce33122640 1 -- 172.21.15.89:0/1094629176 shutdown_connections 2024-09-13T02:54:14.222 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:14.220+0000 7fce33122640 1 --2- 172.21.15.89:0/1094629176 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fce2c0fd350 0x7fce2c0fb750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:14.222 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:14.220+0000 7fce33122640 1 --2- 172.21.15.89:0/1094629176 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fce2c0fca00 0x7fce2c0fce10 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:14.222 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:14.220+0000 7fce33122640 1 -- 172.21.15.89:0/1094629176 >> 172.21.15.89:0/1094629176 conn(0x7fce2c0f6390 msgr2=0x7fce2c0f87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:54:14.222 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:14.220+0000 7fce33122640 1 -- 172.21.15.89:0/1094629176 shutdown_connections 2024-09-13T02:54:14.222 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:14.221+0000 7fce33122640 1 -- 172.21.15.89:0/1094629176 wait complete. 2024-09-13T02:54:14.223 INFO:tasks.workunit.client.1.smithi131.stdout:0/683: write d0/d2/d41/fc7 [2422513,9568] 0 2024-09-13T02:54:14.224 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:14.222+0000 7fce33122640 1 Processor -- start 2024-09-13T02:54:14.224 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:14.222+0000 7fce33122640 1 -- start start 2024-09-13T02:54:14.225 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:14.222+0000 7fce33122640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fce2c0fca00 0x7fce2c0ff590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:54:14.225 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:14.222+0000 7fce33122640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fce2c0fd350 0x7fce2c0fda80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:54:14.225 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:14.222+0000 7fce33122640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce2c0fe0a0 con 0x7fce2c0fd350 2024-09-13T02:54:14.225 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:14.222+0000 7fce33122640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce2c0fe1e0 con 0x7fce2c0fca00 2024-09-13T02:54:14.225 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:14.222+0000 7fce2bfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fce2c0fd350 0x7fce2c0fda80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:54:14.225 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:14.222+0000 7fce2bfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fce2c0fd350 0x7fce2c0fda80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:46430/0 (socket says 172.21.15.89:46430) 2024-09-13T02:54:14.225 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:14.222+0000 7fce2bfff640 1 -- 172.21.15.89:0/3340436433 learned_addr learned my addr 172.21.15.89:0/3340436433 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:54:14.225 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:14.223+0000 7fce30ebe640 1 --2- 172.21.15.89:0/3340436433 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fce2c0fca00 0x7fce2c0ff590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:54:14.225 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:14.223+0000 7fce2bfff640 1 -- 172.21.15.89:0/3340436433 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fce2c0fca00 msgr2=0x7fce2c0ff590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:14.225 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:14.223+0000 7fce2bfff640 1 --2- 172.21.15.89:0/3340436433 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fce2c0fca00 0x7fce2c0ff590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:14.225 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:14.223+0000 7fce2bfff640 1 -- 172.21.15.89:0/3340436433 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce20005040 con 0x7fce2c0fd350 2024-09-13T02:54:14.225 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:14.223+0000 7fce30ebe640 1 --2- 172.21.15.89:0/3340436433 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fce2c0fca00 0x7fce2c0ff590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T02:54:14.226 INFO:tasks.workunit.client.1.smithi131.stdout:3/491: rename d2/d4/d7/l8f to d2/dc/d39/lad 0 2024-09-13T02:54:14.227 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:14.224+0000 7fce2bfff640 1 --2- 172.21.15.89:0/3340436433 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fce2c0fd350 0x7fce2c0fda80 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fce1800b580 tx=0x7fce180091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:54:14.227 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:14.224+0000 7fce297fa640 1 -- 172.21.15.89:0/3340436433 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce1800f570 con 0x7fce2c0fd350 2024-09-13T02:54:14.227 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:14.224+0000 7fce33122640 1 -- 172.21.15.89:0/3340436433 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce2c0fe4c0 con 0x7fce2c0fd350 2024-09-13T02:54:14.227 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:14.224+0000 7fce33122640 1 -- 172.21.15.89:0/3340436433 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce2c115190 con 0x7fce2c0fd350 2024-09-13T02:54:14.227 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:14.224+0000 7fce297fa640 1 -- 172.21.15.89:0/3340436433 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fce1800fb70 con 0x7fce2c0fd350 2024-09-13T02:54:14.227 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:14.225+0000 7fce297fa640 1 -- 172.21.15.89:0/3340436433 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce18010cd0 con 0x7fce2c0fd350 2024-09-13T02:54:14.227 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:14.225+0000 7fce33122640 1 -- 172.21.15.89:0/3340436433 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce2c0fa010 con 0x7fce2c0fd350 2024-09-13T02:54:14.228 INFO:tasks.workunit.client.1.smithi131.stdout:1/488: dread f4 [0,4194304] 0 2024-09-13T02:54:14.228 INFO:tasks.workunit.client.1.smithi131.stdout:1/489: truncate dd/f3a 694925 0 2024-09-13T02:54:14.228 INFO:tasks.workunit.client.1.smithi131.stdout:1/490: fsync dd/d33/d42/f52 0 2024-09-13T02:54:14.228 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:14.227+0000 7fce297fa640 1 -- 172.21.15.89:0/3340436433 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 19) v1 ==== 90867+0+0 (secure 0 0 0) 0x7fce1801a460 con 0x7fce2c0fd350 2024-09-13T02:54:14.229 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:14.228+0000 7fce297fa640 1 --2- 172.21.15.89:0/3340436433 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fce1c06ed50 0x7fce1c071200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:54:14.230 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:14.228+0000 7fce30ebe640 1 --2- 172.21.15.89:0/3340436433 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fce1c06ed50 0x7fce1c071200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:54:14.230 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:14.228+0000 7fce297fa640 1 -- 172.21.15.89:0/3340436433 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5550+0+0 (secure 0 0 0) 0x7fce1805bd90 con 0x7fce2c0fd350 2024-09-13T02:54:14.230 INFO:tasks.workunit.client.1.smithi131.stdout:2/492: dread d5/d18/f1b [0,4194304] 0 2024-09-13T02:54:14.230 INFO:tasks.workunit.client.1.smithi131.stdout:0/684: rename d0/de/d1f/d22/d31/d39/d40/f7c to d0/de/d1f/d22/d3d/d43/dc2/dd3/fee 0 2024-09-13T02:54:14.232 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:14.230+0000 7fce30ebe640 1 --2- 172.21.15.89:0/3340436433 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fce1c06ed50 0x7fce1c071200 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fce2c0ff340 tx=0x7fce20035040 comp rx=0 tx=0).ready entity=mgr.14204 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:54:14.233 INFO:tasks.workunit.client.1.smithi131.stdout:9/483: dread d0/d3/d14/d17/d32/f59 [0,4194304] 0 2024-09-13T02:54:14.233 INFO:tasks.workunit.client.1.smithi131.stdout:9/484: write d0/d3/d14/d17/d32/d39/f50 [1809282,15832] 0 2024-09-13T02:54:14.233 INFO:tasks.workunit.client.1.smithi131.stdout:5/442: dwrite d1/d21/d74/f80 [0,4194304] 0 2024-09-13T02:54:14.237 INFO:tasks.workunit.client.1.smithi131.stdout:7/512: dwrite d1b/d3b/d46/d4b/d57/f8a [0,4194304] 0 2024-09-13T02:54:14.237 INFO:tasks.workunit.client.1.smithi131.stdout:7/513: readlink d1b/l32 0 2024-09-13T02:54:14.237 INFO:tasks.workunit.client.1.smithi131.stdout:7/514: chown d1b/d3b/d51/d8b/d99 1 1 2024-09-13T02:54:14.238 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:14.237+0000 7fce297fa640 1 -- 172.21.15.89:0/3340436433 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+176781 (secure 0 0 0) 0x7fce1805c050 con 0x7fce2c0fd350 2024-09-13T02:54:14.239 INFO:tasks.workunit.client.1.smithi131.stdout:5/443: mkdir d1/d21/d74/d78/d98 0 2024-09-13T02:54:14.239 INFO:tasks.workunit.client.1.smithi131.stdout:5/444: write d1/d2f/d33/f75 [851919,26212] 0 2024-09-13T02:54:14.239 INFO:tasks.workunit.client.1.smithi131.stdout:8/440: dwrite db/d2b/d39/d56/f73 [0,4194304] 0 2024-09-13T02:54:14.240 INFO:tasks.workunit.client.1.smithi131.stdout:8/441: write db/d2b/d39/f77 [407263,71674] 0 2024-09-13T02:54:14.244 INFO:tasks.workunit.client.1.smithi131.stdout:1/491: write dd/d26/d2a/d2c/f39 [1644600,88707] 0 2024-09-13T02:54:14.245 INFO:tasks.workunit.client.1.smithi131.stdout:8/442: link db/l22 db/d1d/d1f/d41/d50/l86 0 2024-09-13T02:54:14.246 INFO:tasks.workunit.client.1.smithi131.stdout:1/492: mkdir dd/d33/d94/db4 0 2024-09-13T02:54:14.249 INFO:tasks.workunit.client.1.smithi131.stdout:7/515: write d1b/d3b/d31/d5f/f74 [1871936,53590] 0 2024-09-13T02:54:14.249 INFO:tasks.workunit.client.1.smithi131.stdout:7/516: chown d1b/d3b/d46/d4b/d57/d9d 66017516 1 2024-09-13T02:54:14.249 INFO:tasks.workunit.client.1.smithi131.stdout:7/517: chown d1b/d73 202 1 2024-09-13T02:54:14.250 INFO:tasks.workunit.client.1.smithi131.stdout:8/443: unlink db/d2b/d39/d56/f60 0 2024-09-13T02:54:14.250 INFO:tasks.workunit.client.1.smithi131.stdout:8/444: chown db/f19 184721856 1 2024-09-13T02:54:14.252 INFO:tasks.workunit.client.1.smithi131.stdout:1/493: truncate dd/d33/d94/f97 3220594 0 2024-09-13T02:54:14.252 INFO:tasks.workunit.client.1.smithi131.stdout:1/494: chown dd/d33/d42/f52 16149 1 2024-09-13T02:54:14.253 INFO:tasks.workunit.client.1.smithi131.stdout:7/518: creat d1b/d3b/d51/d62/d9e/da2/fb3 x:0 0 0 2024-09-13T02:54:14.256 INFO:tasks.workunit.client.1.smithi131.stdout:8/445: mknod db/d2e/d40/c87 0 2024-09-13T02:54:14.256 INFO:tasks.workunit.client.1.smithi131.stdout:8/446: write db/d2b/d39/f3e [303850,47612] 0 2024-09-13T02:54:14.256 INFO:tasks.workunit.client.1.smithi131.stdout:8/447: fsync db/f23 0 2024-09-13T02:54:14.257 INFO:tasks.workunit.client.1.smithi131.stdout:8/448: truncate db/d2b/d39/f77 767702 0 2024-09-13T02:54:14.257 INFO:tasks.workunit.client.1.smithi131.stdout:8/449: stat f2 0 2024-09-13T02:54:14.257 INFO:tasks.workunit.client.1.smithi131.stdout:1/495: mknod dd/d33/d94/db4/cb5 0 2024-09-13T02:54:14.261 INFO:tasks.workunit.client.1.smithi131.stdout:8/450: mknod db/d2e/d3a/c88 0 2024-09-13T02:54:14.263 INFO:tasks.workunit.client.1.smithi131.stdout:1/496: truncate dd/d26/d44/f1e 962686 0 2024-09-13T02:54:14.264 INFO:tasks.workunit.client.1.smithi131.stdout:3/492: dwrite d2/dc/fa1 [0,4194304] 0 2024-09-13T02:54:14.264 INFO:tasks.workunit.client.1.smithi131.stdout:5/445: dwrite d1/d2f/f69 [0,4194304] 0 2024-09-13T02:54:14.264 INFO:tasks.workunit.client.1.smithi131.stdout:8/451: mkdir db/d89 0 2024-09-13T02:54:14.264 INFO:tasks.workunit.client.1.smithi131.stdout:8/452: write db/d1d/d34/f70 [205208,95184] 0 2024-09-13T02:54:14.264 INFO:tasks.workunit.client.1.smithi131.stdout:8/453: fsync db/d1d/d1f/d41/f55 0 2024-09-13T02:54:14.264 INFO:tasks.workunit.client.1.smithi131.stdout:2/493: dwrite d5/d31/d21/d57/d94/f9b [0,4194304] 0 2024-09-13T02:54:14.265 INFO:tasks.workunit.client.1.smithi131.stdout:2/494: creat d5/d6e/fa6 x:0 0 0 2024-09-13T02:54:14.266 INFO:tasks.workunit.client.1.smithi131.stdout:1/497: creat dd/fb6 x:0 0 0 2024-09-13T02:54:14.270 INFO:tasks.workunit.client.1.smithi131.stdout:3/493: creat d2/d4/d1a/d31/da7/fae x:0 0 0 2024-09-13T02:54:14.270 INFO:tasks.workunit.client.1.smithi131.stdout:3/494: chown d2/d4/l82 281161914 1 2024-09-13T02:54:14.270 INFO:tasks.workunit.client.1.smithi131.stdout:3/495: creat d2/dc/faf x:0 0 0 2024-09-13T02:54:14.272 INFO:tasks.workunit.client.1.smithi131.stdout:7/519: dwrite d1b/d3b/d31/d5f/f7e [0,4194304] 0 2024-09-13T02:54:14.272 INFO:tasks.workunit.client.1.smithi131.stdout:7/520: write d1b/d3b/d51/d8f/fa4 [655292,83417] 0 2024-09-13T02:54:14.273 INFO:tasks.workunit.client.1.smithi131.stdout:5/446: rmdir d1/d2f/d4f 39 2024-09-13T02:54:14.273 INFO:tasks.workunit.client.1.smithi131.stdout:8/454: symlink db/d1d/d34/d4e/l8a 0 2024-09-13T02:54:14.273 INFO:tasks.workunit.client.1.smithi131.stdout:8/455: write db/d1d/d1f/d41/f62 [4359859,122377] 0 2024-09-13T02:54:14.278 INFO:tasks.workunit.client.1.smithi131.stdout:2/495: link d5/d31/d1d/d32/f3d d5/d34/fa7 0 2024-09-13T02:54:14.282 INFO:tasks.workunit.client.1.smithi131.stdout:3/496: creat d2/d4/d7/d1d/d24/fb0 x:0 0 0 2024-09-13T02:54:14.283 INFO:tasks.workunit.client.1.smithi131.stdout:3/497: chown d2/dc/f1b 239 1 2024-09-13T02:54:14.285 INFO:tasks.workunit.client.1.smithi131.stdout:5/447: mknod d1/d29/c99 0 2024-09-13T02:54:14.286 INFO:tasks.workunit.client.1.smithi131.stdout:5/448: truncate d1/d5/fa 786865 0 2024-09-13T02:54:14.291 INFO:tasks.workunit.client.1.smithi131.stdout:7/521: dread d1b/d3b/d46/d4b/d57/f8a [0,4194304] 0 2024-09-13T02:54:14.291 INFO:tasks.workunit.client.1.smithi131.stdout:1/498: dwrite dd/d26/d2a/d2c/f5c [0,4194304] 0 2024-09-13T02:54:14.291 INFO:tasks.workunit.client.1.smithi131.stdout:1/499: creat dd/d26/fb7 x:0 0 0 2024-09-13T02:54:14.292 INFO:tasks.workunit.client.1.smithi131.stdout:7/522: mkdir d1b/d23/d89/db4 0 2024-09-13T02:54:14.297 INFO:tasks.workunit.client.1.smithi131.stdout:5/449: dread d1/d1c/d8e/f5c [0,4194304] 0 2024-09-13T02:54:14.298 INFO:tasks.workunit.client.1.smithi131.stdout:1/500: mkdir dd/d51/d8a/db8 0 2024-09-13T02:54:14.300 INFO:tasks.workunit.client.1.smithi131.stdout:7/523: mkdir d1b/d3b/d51/d62/d6d/db5 0 2024-09-13T02:54:14.301 INFO:tasks.workunit.client.1.smithi131.stdout:5/450: symlink d1/d2f/d8c/l9a 0 2024-09-13T02:54:14.304 INFO:tasks.workunit.client.1.smithi131.stdout:8/456: dwrite db/d1d/d1f/d67/f85 [0,4194304] 0 2024-09-13T02:54:14.307 INFO:tasks.workunit.client.1.smithi131.stdout:2/496: dwrite d5/d34/f65 [0,4194304] 0 2024-09-13T02:54:14.307 INFO:tasks.workunit.client.1.smithi131.stdout:2/497: chown d5/d31/d26/c70 188292071 1 2024-09-13T02:54:14.307 INFO:tasks.workunit.client.1.smithi131.stdout:7/524: creat d1b/d3b/fb6 x:0 0 0 2024-09-13T02:54:14.310 INFO:tasks.workunit.client.1.smithi131.stdout:1/501: rmdir dd/d26/d2a/d2c 39 2024-09-13T02:54:14.310 INFO:tasks.workunit.client.1.smithi131.stdout:1/502: dread - dd/d33/d80/f8c zero size 2024-09-13T02:54:14.314 INFO:tasks.workunit.client.1.smithi131.stdout:5/451: dread d1/d5/f4e [0,4194304] 0 2024-09-13T02:54:14.317 INFO:tasks.workunit.client.1.smithi131.stdout:8/457: unlink db/l10 0 2024-09-13T02:54:14.328 INFO:tasks.workunit.client.1.smithi131.stdout:2/498: rmdir d5/d31/d21/d57 39 2024-09-13T02:54:14.328 INFO:tasks.workunit.client.1.smithi131.stdout:2/499: stat d5/d31/d4e/f60 0 2024-09-13T02:54:14.330 INFO:tasks.workunit.client.1.smithi131.stdout:1/503: dwrite dd/d26/d44/d6d/d7c/fab [0,4194304] 0 2024-09-13T02:54:14.333 INFO:tasks.workunit.client.1.smithi131.stdout:5/452: rename d1/d1c/f76 to d1/d1c/d87/f9b 0 2024-09-13T02:54:14.333 INFO:tasks.workunit.client.1.smithi131.stdout:5/453: write d1/d2f/d33/f81 [556062,3406] 0 2024-09-13T02:54:14.333 INFO:tasks.workunit.client.1.smithi131.stdout:5/454: write d1/d1c/d8e/f43 [114278,90843] 0 2024-09-13T02:54:14.335 INFO:tasks.workunit.client.1.smithi131.stdout:8/458: dread db/d2e/f43 [0,4194304] 0 2024-09-13T02:54:14.335 INFO:tasks.workunit.client.1.smithi131.stdout:8/459: chown db/d2b/f6f 15 1 2024-09-13T02:54:14.336 INFO:tasks.workunit.client.1.smithi131.stdout:2/500: creat d5/d31/d1d/d32/d7d/fa8 x:0 0 0 2024-09-13T02:54:14.336 INFO:tasks.workunit.client.1.smithi131.stdout:2/501: creat d5/d53/fa9 x:0 0 0 2024-09-13T02:54:14.336 INFO:tasks.workunit.client.1.smithi131.stdout:2/502: fdatasync d5/d31/d26/f86 0 2024-09-13T02:54:14.336 INFO:tasks.workunit.client.1.smithi131.stdout:2/503: read d5/d6e/f92 [290215,16479] 0 2024-09-13T02:54:14.340 INFO:tasks.workunit.client.1.smithi131.stdout:1/504: unlink dd/d33/d80/fb2 0 2024-09-13T02:54:14.342 INFO:tasks.workunit.client.1.smithi131.stdout:8/460: truncate db/d1d/d1f/f52 2458543 0 2024-09-13T02:54:14.346 INFO:tasks.workunit.client.1.smithi131.stdout:1/505: rename dd/d26/d2a/d2c/fa1 to dd/d33/d94/db4/fb9 0 2024-09-13T02:54:14.361 INFO:tasks.workunit.client.1.smithi131.stdout:1/506: write dd/d51/f9a [4117538,54070] 0 2024-09-13T02:54:14.370 INFO:tasks.workunit.client.1.smithi131.stdout:2/504: dwrite d5/d6e/f92 [0,4194304] 0 2024-09-13T02:54:14.370 INFO:tasks.workunit.client.1.smithi131.stdout:2/505: read - d5/d18/d4b/d8e/d48/d4c/f84 zero size 2024-09-13T02:54:14.371 INFO:tasks.workunit.client.1.smithi131.stdout:2/506: read d5/d18/d4b/f40 [9937,422] 0 2024-09-13T02:54:14.371 INFO:tasks.workunit.client.1.smithi131.stdout:2/507: stat d5/d31/d4e/d78/da3/d41/f9f 0 2024-09-13T02:54:14.371 INFO:tasks.workunit.client.1.smithi131.stdout:5/455: dwrite d1/d21/f7b [0,4194304] 0 2024-09-13T02:54:14.375 INFO:tasks.workunit.client.1.smithi131.stdout:1/507: write dd/d26/f57 [494053,19770] 0 2024-09-13T02:54:14.376 INFO:tasks.workunit.client.1.smithi131.stdout:8/461: dwrite db/d1d/d1f/f2c [0,4194304] 0 2024-09-13T02:54:14.376 INFO:tasks.workunit.client.1.smithi131.stdout:8/462: stat db/c12 0 2024-09-13T02:54:14.377 INFO:tasks.workunit.client.1.smithi131.stdout:2/508: mknod d5/d18/d4b/d8e/d48/d4c/caa 0 2024-09-13T02:54:14.377 INFO:tasks.workunit.client.1.smithi131.stdout:2/509: stat d5/d6e 0 2024-09-13T02:54:14.377 INFO:tasks.workunit.client.1.smithi131.stdout:2/510: dread - d5/d53/fa9 zero size 2024-09-13T02:54:14.378 INFO:tasks.workunit.client.1.smithi131.stdout:2/511: dread - d5/d31/d26/d8d/f97 zero size 2024-09-13T02:54:14.379 INFO:tasks.workunit.client.1.smithi131.stdout:5/456: unlink d1/d21/d22/c27 0 2024-09-13T02:54:14.382 INFO:tasks.workunit.client.1.smithi131.stdout:1/508: mkdir dd/d68/dba 0 2024-09-13T02:54:14.385 INFO:tasks.workunit.client.1.smithi131.stdout:8/463: truncate db/d1d/f5e 4087881 0 2024-09-13T02:54:14.386 INFO:tasks.workunit.client.1.smithi131.stdout:5/457: getdents d1/d2f/d33 0 2024-09-13T02:54:14.388 INFO:tasks.workunit.client.1.smithi131.stdout:8/464: mkdir db/d1d/d1f/d67/d8b 0 2024-09-13T02:54:14.388 INFO:tasks.workunit.client.1.smithi131.stdout:5/458: mkdir d1/d9c 0 2024-09-13T02:54:14.389 INFO:tasks.workunit.client.1.smithi131.stdout:5/459: chown d1/d5/l7f 95288 1 2024-09-13T02:54:14.390 INFO:tasks.workunit.client.1.smithi131.stdout:5/460: write d1/d29/f8d [637531,65491] 0 2024-09-13T02:54:14.401 INFO:tasks.workunit.client.1.smithi131.stdout:2/512: dwrite d5/d18/d68/f85 [0,4194304] 0 2024-09-13T02:54:14.401 INFO:tasks.workunit.client.1.smithi131.stdout:8/465: dread f8 [0,4194304] 0 2024-09-13T02:54:14.401 INFO:tasks.workunit.client.1.smithi131.stdout:2/513: getdents d5/d18/d4b/d8e/d48 0 2024-09-13T02:54:14.403 INFO:tasks.workunit.client.1.smithi131.stdout:2/514: symlink d5/d18/d4b/d8e/lab 0 2024-09-13T02:54:14.404 INFO:tasks.workunit.client.1.smithi131.stdout:2/515: unlink d5/d18/d68/f85 0 2024-09-13T02:54:14.404 INFO:tasks.workunit.client.1.smithi131.stdout:2/516: chown d5/d18/c43 806 1 2024-09-13T02:54:14.408 INFO:tasks.workunit.client.1.smithi131.stdout:1/509: dwrite dd/f16 [0,4194304] 0 2024-09-13T02:54:14.409 INFO:tasks.workunit.client.1.smithi131.stdout:2/517: symlink d5/lac 0 2024-09-13T02:54:14.418 INFO:tasks.workunit.client.1.smithi131.stdout:1/510: dread dd/d26/d44/f25 [0,4194304] 0 2024-09-13T02:54:14.419 INFO:tasks.workunit.client.1.smithi131.stdout:1/511: symlink dd/d26/d44/d6d/lbb 0 2024-09-13T02:54:14.421 INFO:tasks.workunit.client.1.smithi131.stdout:8/466: dwrite db/d1d/d1f/d41/d50/f7d [0,4194304] 0 2024-09-13T02:54:14.421 INFO:tasks.workunit.client.1.smithi131.stdout:8/467: getdents db/d1d/d1f/d67/d81 0 2024-09-13T02:54:14.433 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:14 smithi131 ceph-mon[34689]: from='client.14622 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:54:14.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:14 smithi131 ceph-mon[34689]: from='client.14626 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:54:14.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:14 smithi131 ceph-mon[34689]: pgmap v249: 65 pgs: 65 active+clean; 2.9 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 204 MiB/s rd, 231 MiB/s wr, 337 op/s 2024-09-13T02:54:14.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:14 smithi131 ceph-mon[34689]: from='client.? 172.21.15.89:0/2787260550' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:54:14.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:14 smithi131 ceph-mon[34689]: from='client.? 172.21.15.89:0/2894560358' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T02:54:14.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:14 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:54:14.436 INFO:tasks.workunit.client.1.smithi131.stdout:8/468: dread db/d1d/f25 [0,4194304] 0 2024-09-13T02:54:14.436 INFO:tasks.workunit.client.1.smithi131.stdout:8/469: truncate f5 4664189 0 2024-09-13T02:54:14.441 INFO:tasks.workunit.client.1.smithi131.stdout:8/470: mkdir db/d2b/d8c 0 2024-09-13T02:54:14.441 INFO:tasks.workunit.client.1.smithi131.stdout:8/471: mkdir db/d1d/d34/d8d 0 2024-09-13T02:54:14.442 INFO:tasks.workunit.client.1.smithi131.stdout:8/472: mknod db/d2e/d40/c8e 0 2024-09-13T02:54:14.442 INFO:tasks.workunit.client.1.smithi131.stdout:8/473: rename db/c21 to db/d2e/c8f 0 2024-09-13T02:54:14.443 INFO:tasks.workunit.client.1.smithi131.stdout:8/474: rename db/d2b/d8c to db/d1d/d34/d4e/d7e/d90 0 2024-09-13T02:54:14.443 INFO:tasks.workunit.client.1.smithi131.stdout:8/475: stat db/d1d/d1f/d5c/f64 0 2024-09-13T02:54:14.443 INFO:tasks.workunit.client.1.smithi131.stdout:8/476: chown db/f15 2407239 1 2024-09-13T02:54:14.443 INFO:tasks.workunit.client.1.smithi131.stdout:8/477: mknod db/d1d/d1f/d5c/d6c/c91 0 2024-09-13T02:54:14.443 INFO:tasks.workunit.client.1.smithi131.stdout:8/478: read db/f19 [1317986,124609] 0 2024-09-13T02:54:14.443 INFO:tasks.workunit.client.1.smithi131.stdout:8/479: write db/d2b/d39/d56/f57 [503998,38245] 0 2024-09-13T02:54:14.443 INFO:tasks.workunit.client.1.smithi131.stdout:8/480: chown db/d2b/c42 695991237 1 2024-09-13T02:54:14.444 INFO:tasks.workunit.client.1.smithi131.stdout:8/481: write db/d1d/f28 [2043669,11604] 0 2024-09-13T02:54:14.444 INFO:tasks.workunit.client.1.smithi131.stdout:8/482: chown db/d1d/d1f/d41/f62 22395 1 2024-09-13T02:54:14.444 INFO:tasks.workunit.client.1.smithi131.stdout:8/483: fsync db/d2b/d39/d56/f73 0 2024-09-13T02:54:14.445 INFO:tasks.workunit.client.1.smithi131.stdout:1/512: dwrite dd/d26/d44/f32 [0,4194304] 0 2024-09-13T02:54:14.458 INFO:tasks.workunit.client.1.smithi131.stdout:1/513: write dd/d26/d2a/d2c/f5c [2430017,87846] 0 2024-09-13T02:54:14.458 INFO:tasks.workunit.client.1.smithi131.stdout:1/514: creat dd/d26/fbc x:0 0 0 2024-09-13T02:54:14.459 INFO:tasks.workunit.client.1.smithi131.stdout:1/515: symlink dd/d26/d2a/d2c/lbd 0 2024-09-13T02:54:14.459 INFO:tasks.workunit.client.1.smithi131.stdout:1/516: fdatasync dd/fb6 0 2024-09-13T02:54:14.460 INFO:tasks.workunit.client.1.smithi131.stdout:1/517: rename dd/d51/f9a to dd/d51/d8a/fbe 0 2024-09-13T02:54:14.461 INFO:tasks.workunit.client.1.smithi131.stdout:1/518: link dd/f16 dd/d26/fbf 0 2024-09-13T02:54:14.463 INFO:tasks.workunit.client.1.smithi131.stdout:1/519: rename dd/d68/dba to dd/d26/d2a/d69/dc0 0 2024-09-13T02:54:14.464 INFO:tasks.workunit.client.1.smithi131.stdout:8/484: dwrite db/d1d/f28 [0,4194304] 0 2024-09-13T02:54:14.465 INFO:tasks.workunit.client.1.smithi131.stdout:1/520: unlink dd/d26/d2a/c46 0 2024-09-13T02:54:14.465 INFO:tasks.workunit.client.1.smithi131.stdout:1/521: fsync dd/d51/f89 0 2024-09-13T02:54:14.465 INFO:tasks.workunit.client.1.smithi131.stdout:1/522: chown dd/d26/d2a/d2c/f5c 420473130 1 2024-09-13T02:54:14.466 INFO:tasks.workunit.client.1.smithi131.stdout:8/485: creat db/d1d/d34/d4e/f92 x:0 0 0 2024-09-13T02:54:14.466 INFO:tasks.workunit.client.1.smithi131.stdout:8/486: chown db/d1d/d1f/d5c/c33 34519690 1 2024-09-13T02:54:14.467 INFO:tasks.workunit.client.1.smithi131.stdout:1/523: mknod dd/d51/d5a/cc1 0 2024-09-13T02:54:14.467 INFO:tasks.workunit.client.1.smithi131.stdout:1/524: chown dd/d26/d44/d6d/d7c 5 1 2024-09-13T02:54:14.467 INFO:tasks.workunit.client.1.smithi131.stdout:8/487: symlink db/d1d/d34/d4e/d7e/d90/l93 0 2024-09-13T02:54:14.469 INFO:tasks.workunit.client.1.smithi131.stdout:8/488: creat db/d1d/d1f/d66/f94 x:0 0 0 2024-09-13T02:54:14.471 INFO:tasks.workunit.client.1.smithi131.stdout:8/489: creat db/d2b/d39/d56/f95 x:0 0 0 2024-09-13T02:54:14.471 INFO:tasks.workunit.client.1.smithi131.stdout:8/490: readlink db/d2b/d39/l7f 0 2024-09-13T02:54:14.478 INFO:tasks.workunit.client.1.smithi131.stdout:8/491: rename db/d2e/c8f to db/d1d/d1f/d67/c96 0 2024-09-13T02:54:14.484 INFO:tasks.workunit.client.1.smithi131.stdout:8/492: write f8 [1723874,85247] 0 2024-09-13T02:54:14.488 INFO:tasks.workunit.client.1.smithi131.stdout:8/493: mknod db/d1d/d34/d4e/d7e/c97 0 2024-09-13T02:54:14.488 INFO:tasks.workunit.client.1.smithi131.stdout:8/494: write db/d1d/d34/f70 [502973,70640] 0 2024-09-13T02:54:14.488 INFO:tasks.workunit.client.1.smithi131.stdout:8/495: write db/d1d/d34/f7a [905452,61358] 0 2024-09-13T02:54:14.489 INFO:tasks.workunit.client.1.smithi131.stdout:1/525: getdents dd/d68 0 2024-09-13T02:54:14.489 INFO:tasks.workunit.client.1.smithi131.stdout:8/496: creat db/d89/f98 x:0 0 0 2024-09-13T02:54:14.490 INFO:tasks.workunit.client.1.smithi131.stdout:8/497: creat db/d1d/d34/d4e/f99 x:0 0 0 2024-09-13T02:54:14.490 INFO:tasks.workunit.client.1.smithi131.stdout:8/498: write db/f23 [6550752,32873] 0 2024-09-13T02:54:14.496 INFO:tasks.workunit.client.1.smithi131.stdout:8/499: rmdir db/d1d/d1f/d67/d8b 0 2024-09-13T02:54:14.496 INFO:tasks.workunit.client.1.smithi131.stdout:8/500: chown db/d1d/d34/d8d 0 1 2024-09-13T02:54:14.496 INFO:tasks.workunit.client.1.smithi131.stdout:8/501: fsync db/d2b/d39/f3e 0 2024-09-13T02:54:14.523 INFO:tasks.workunit.client.1.smithi131.stdout:8/502: dwrite db/d1d/d34/d4e/d7e/f83 [0,4194304] 0 2024-09-13T02:54:14.524 INFO:tasks.workunit.client.1.smithi131.stdout:1/526: dwrite dd/f20 [0,4194304] 0 2024-09-13T02:54:14.525 INFO:tasks.workunit.client.1.smithi131.stdout:8/503: unlink db/d2b/d39/f3e 0 2024-09-13T02:54:14.528 INFO:tasks.workunit.client.1.smithi131.stdout:8/504: creat db/d1d/d1f/d41/d50/f9a x:0 0 0 2024-09-13T02:54:14.529 INFO:tasks.workunit.client.1.smithi131.stdout:8/505: creat db/d2e/d3a/f9b x:0 0 0 2024-09-13T02:54:14.533 INFO:tasks.workunit.client.1.smithi131.stdout:8/506: fsync db/d1d/d34/f70 0 2024-09-13T02:54:14.533 INFO:tasks.workunit.client.1.smithi131.stdout:8/507: fsync db/d1d/d1f/f2c 0 2024-09-13T02:54:14.534 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:14 smithi089 ceph-mon[27639]: from='client.14622 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:54:14.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:14 smithi089 ceph-mon[27639]: from='client.14626 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:54:14.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:14 smithi089 ceph-mon[27639]: pgmap v249: 65 pgs: 65 active+clean; 2.9 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 204 MiB/s rd, 231 MiB/s wr, 337 op/s 2024-09-13T02:54:14.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:14 smithi089 ceph-mon[27639]: from='client.? 172.21.15.89:0/2787260550' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:54:14.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:14 smithi089 ceph-mon[27639]: from='client.? 172.21.15.89:0/2894560358' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T02:54:14.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:14 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:54:14.544 INFO:tasks.workunit.client.1.smithi131.stdout:1/527: dwrite dd/d26/d2a/d2c/f6b [0,4194304] 0 2024-09-13T02:54:14.550 INFO:tasks.workunit.client.1.smithi131.stdout:8/508: dwrite db/d2e/d40/f48 [0,4194304] 0 2024-09-13T02:54:14.558 INFO:tasks.workunit.client.1.smithi131.stdout:8/509: dread db/d1d/d1f/d41/f55 [4194304,4194304] 0 2024-09-13T02:54:14.561 INFO:tasks.workunit.client.1.smithi131.stdout:8/510: write db/f18 [1686500,118959] 0 2024-09-13T02:54:14.561 INFO:tasks.workunit.client.1.smithi131.stdout:8/511: truncate db/d1d/d1f/d66/f94 73015 0 2024-09-13T02:54:14.562 INFO:tasks.workunit.client.1.smithi131.stdout:8/512: symlink db/d1d/l9c 0 2024-09-13T02:54:14.562 INFO:tasks.workunit.client.1.smithi131.stdout:8/513: chown l9 1 1 2024-09-13T02:54:14.563 INFO:tasks.workunit.client.1.smithi131.stdout:8/514: unlink db/c11 0 2024-09-13T02:54:14.565 INFO:tasks.workunit.client.1.smithi131.stdout:8/515: rename db/d2b/d39/l7f to db/d1d/d34/d4e/d7e/l9d 0 2024-09-13T02:54:14.565 INFO:tasks.workunit.client.1.smithi131.stdout:8/516: write db/d1d/f28 [4725879,108989] 0 2024-09-13T02:54:14.566 INFO:tasks.workunit.client.1.smithi131.stdout:8/517: mknod db/d89/c9e 0 2024-09-13T02:54:14.567 INFO:tasks.workunit.client.1.smithi131.stdout:8/518: write db/d2b/d39/d56/f57 [341203,46717] 0 2024-09-13T02:54:14.587 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:14.586+0000 7fce33122640 1 -- 172.21.15.89:0/3340436433 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fce2c104060 con 0x7fce2c0fd350 2024-09-13T02:54:14.588 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:14.586+0000 7fce297fa640 1 -- 172.21.15.89:0/3340436433 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fce1805b9f0 con 0x7fce2c0fd350 2024-09-13T02:54:14.588 INFO:teuthology.orchestra.run.smithi089.stdout:HEALTH_OK 2024-09-13T02:54:14.590 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:14.588+0000 7fce33122640 1 -- 172.21.15.89:0/3340436433 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fce1c06ed50 msgr2=0x7fce1c071200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:14.590 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:14.588+0000 7fce33122640 1 --2- 172.21.15.89:0/3340436433 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fce1c06ed50 0x7fce1c071200 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fce2c0ff340 tx=0x7fce20035040 comp rx=0 tx=0).stop 2024-09-13T02:54:14.590 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:14.589+0000 7fce33122640 1 -- 172.21.15.89:0/3340436433 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fce2c0fd350 msgr2=0x7fce2c0fda80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:14.590 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:14.589+0000 7fce33122640 1 --2- 172.21.15.89:0/3340436433 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fce2c0fd350 0x7fce2c0fda80 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fce1800b580 tx=0x7fce180091a0 comp rx=0 tx=0).stop 2024-09-13T02:54:14.590 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:14.589+0000 7fce33122640 1 -- 172.21.15.89:0/3340436433 shutdown_connections 2024-09-13T02:54:14.590 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:14.589+0000 7fce33122640 1 --2- 172.21.15.89:0/3340436433 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fce2c0fd350 0x7fce2c0fda80 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:14.590 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:14.589+0000 7fce33122640 1 --2- 172.21.15.89:0/3340436433 >> [v2:172.21.15.89:6800/1506060926,v1:172.21.15.89:6801/1506060926] conn(0x7fce1c06ed50 0x7fce1c071200 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:14.590 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:14.589+0000 7fce33122640 1 --2- 172.21.15.89:0/3340436433 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fce2c0fca00 0x7fce2c0ff590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:14.590 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:14.589+0000 7fce33122640 1 -- 172.21.15.89:0/3340436433 >> 172.21.15.89:0/3340436433 conn(0x7fce2c0f6390 msgr2=0x7fce2c0fad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:54:14.591 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:14.589+0000 7fce33122640 1 -- 172.21.15.89:0/3340436433 shutdown_connections 2024-09-13T02:54:14.591 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:14.589+0000 7fce33122640 1 -- 172.21.15.89:0/3340436433 wait complete. 2024-09-13T02:54:14.591 INFO:tasks.workunit.client.1.smithi131.stdout:8/519: dwrite db/d2b/f6f [0,4194304] 0 2024-09-13T02:54:14.600 INFO:tasks.workunit.client.1.smithi131.stdout:8/520: dread db/f23 [0,4194304] 0 2024-09-13T02:54:14.602 INFO:tasks.workunit.client.1.smithi131.stdout:8/521: mknod db/d1d/d1f/c9f 0 2024-09-13T02:54:14.604 INFO:tasks.workunit.client.1.smithi131.stdout:8/522: rename db/d1d/d1f/c46 to db/d1d/d34/ca0 0 2024-09-13T02:54:14.605 INFO:tasks.workunit.client.1.smithi131.stdout:8/523: mkdir db/d1d/d1f/d5c/da1 0 2024-09-13T02:54:14.605 INFO:tasks.workunit.client.1.smithi131.stdout:8/524: creat db/d2b/d39/fa2 x:0 0 0 2024-09-13T02:54:14.607 INFO:tasks.workunit.client.1.smithi131.stdout:8/525: creat db/d1d/d1f/d5c/da1/fa3 x:0 0 0 2024-09-13T02:54:14.607 INFO:tasks.workunit.client.1.smithi131.stdout:8/526: write db/d1d/d34/f7a [1408346,68708] 0 2024-09-13T02:54:14.607 INFO:tasks.workunit.client.1.smithi131.stdout:8/527: fsync db/f23 0 2024-09-13T02:54:14.608 INFO:tasks.workunit.client.1.smithi131.stdout:8/528: symlink db/d1d/la4 0 2024-09-13T02:54:14.608 INFO:tasks.workunit.client.1.smithi131.stdout:8/529: creat db/d1d/d1f/d5c/da1/fa5 x:0 0 0 2024-09-13T02:54:14.622 INFO:tasks.workunit.client.1.smithi131.stdout:8/530: dwrite db/d1d/d34/f7a [0,4194304] 0 2024-09-13T02:54:14.623 INFO:tasks.workunit.client.1.smithi131.stdout:8/531: creat db/d1d/d1f/d66/fa6 x:0 0 0 2024-09-13T02:54:14.625 INFO:tasks.workunit.client.1.smithi131.stdout:8/532: creat db/d1d/fa7 x:0 0 0 2024-09-13T02:54:14.649 INFO:tasks.workunit.client.1.smithi131.stdout:8/533: dwrite db/d2b/f6d [0,4194304] 0 2024-09-13T02:54:14.649 INFO:tasks.workunit.client.1.smithi131.stdout:8/534: read - db/d2b/d39/d56/f95 zero size 2024-09-13T02:54:14.652 INFO:tasks.workunit.client.1.smithi131.stdout:8/535: unlink db/d2e/c5f 0 2024-09-13T02:54:14.652 INFO:tasks.workunit.client.1.smithi131.stdout:8/536: creat db/d1d/d34/d4e/fa8 x:0 0 0 2024-09-13T02:54:14.652 INFO:tasks.workunit.client.1.smithi131.stdout:8/537: fsync db/d1d/d34/d4e/f99 0 2024-09-13T02:54:14.669 INFO:tasks.workunit.client.1.smithi131.stdout:8/538: dwrite db/d1d/d1f/f52 [0,4194304] 0 2024-09-13T02:54:14.669 INFO:tasks.workunit.client.1.smithi131.stdout:8/539: write db/f18 [1588644,130545] 0 2024-09-13T02:54:14.670 INFO:tasks.workunit.client.1.smithi131.stdout:8/540: creat db/fa9 x:0 0 0 2024-09-13T02:54:14.671 INFO:tasks.workunit.client.1.smithi131.stdout:8/541: mknod db/d1d/d1f/d5c/caa 0 2024-09-13T02:54:14.682 INFO:tasks.workunit.client.1.smithi131.stdout:8/542: write db/d1d/d1f/f52 [2513205,33834] 0 2024-09-13T02:54:14.682 INFO:tasks.workunit.client.1.smithi131.stdout:8/543: chown db/f18 32561 1 2024-09-13T02:54:14.682 INFO:tasks.workunit.client.1.smithi131.stdout:8/544: creat db/d1d/d34/fab x:0 0 0 2024-09-13T02:54:14.690 INFO:tasks.workunit.client.1.smithi131.stdout:8/545: write db/d1d/d34/f7a [3009946,69038] 0 2024-09-13T02:54:14.691 INFO:tasks.workunit.client.1.smithi131.stdout:8/546: write db/d2e/d3a/f9b [574455,115140] 0 2024-09-13T02:54:14.691 INFO:tasks.workunit.client.1.smithi131.stdout:8/547: symlink db/d2b/lac 0 2024-09-13T02:54:14.692 INFO:tasks.workunit.client.1.smithi131.stdout:8/548: symlink db/d1d/d1f/d66/lad 0 2024-09-13T02:54:14.695 INFO:tasks.workunit.client.1.smithi131.stdout:8/549: unlink db/d1d/d1f/d5c/da1/fa3 0 2024-09-13T02:54:14.713 INFO:tasks.workunit.client.1.smithi131.stdout:8/550: dwrite f2 [0,4194304] 0 2024-09-13T02:54:14.726 INFO:tasks.workunit.client.1.smithi131.stdout:8/551: dwrite db/d1d/d1f/f2c [4194304,4194304] 0 2024-09-13T02:54:14.728 INFO:tasks.workunit.client.1.smithi131.stdout:8/552: mkdir db/d1d/d34/dae 0 2024-09-13T02:54:14.728 INFO:tasks.workunit.client.1.smithi131.stdout:8/553: chown db/d2b/d39/d56 70 1 2024-09-13T02:54:14.729 INFO:tasks.workunit.client.1.smithi131.stdout:8/554: unlink db/d1d/l9c 0 2024-09-13T02:54:14.730 INFO:tasks.workunit.client.1.smithi131.stdout:8/555: write db/f19 [852750,109909] 0 2024-09-13T02:54:14.735 INFO:tasks.workunit.client.1.smithi131.stdout:8/556: read db/d2e/f43 [2184562,104922] 0 2024-09-13T02:54:14.737 INFO:tasks.workunit.client.1.smithi131.stdout:8/557: link db/d2e/f43 db/d1d/d34/faf 0 2024-09-13T02:54:14.738 INFO:tasks.workunit.client.1.smithi131.stdout:8/558: mknod db/d1d/cb0 0 2024-09-13T02:54:14.738 INFO:tasks.workunit.client.1.smithi131.stdout:8/559: write db/d1d/fa7 [811644,23106] 0 2024-09-13T02:54:14.739 INFO:tasks.workunit.client.1.smithi131.stdout:8/560: mknod db/d2b/cb1 0 2024-09-13T02:54:14.739 INFO:tasks.workunit.client.1.smithi131.stdout:8/561: fsync db/d1d/d1f/d67/f6b 0 2024-09-13T02:54:14.739 INFO:tasks.workunit.client.1.smithi131.stdout:8/562: write db/d1d/d34/d4e/f99 [928965,19744] 0 2024-09-13T02:54:14.740 INFO:tasks.workunit.client.1.smithi131.stdout:8/563: mkdir db/d1d/d1f/d41/d50/db2 0 2024-09-13T02:54:14.741 INFO:tasks.workunit.client.1.smithi131.stdout:8/564: write db/d1d/d1f/f76 [452131,115356] 0 2024-09-13T02:54:14.742 INFO:tasks.workunit.client.1.smithi131.stdout:8/565: mknod db/d1d/d34/d4e/cb3 0 2024-09-13T02:54:14.744 INFO:tasks.workunit.client.1.smithi131.stdout:8/566: rename db/d1d/d34/d4e/cb3 to db/d2e/cb4 0 2024-09-13T02:54:14.744 INFO:tasks.workunit.client.1.smithi131.stdout:8/567: creat db/d2b/fb5 x:0 0 0 2024-09-13T02:54:14.744 INFO:tasks.workunit.client.1.smithi131.stdout:8/568: chown db/c63 28 1 2024-09-13T02:54:14.744 INFO:tasks.workunit.client.1.smithi131.stdout:8/569: readlink db/l75 0 2024-09-13T02:54:14.748 INFO:tasks.workunit.client.1.smithi131.stdout:8/570: write db/d1d/d1f/f2d [3732398,70244] 0 2024-09-13T02:54:14.763 INFO:tasks.workunit.client.1.smithi131.stdout:8/571: dread db/d1d/d1f/d67/f85 [0,4194304] 0 2024-09-13T02:54:14.763 INFO:tasks.workunit.client.1.smithi131.stdout:8/572: chown l1 34732 1 2024-09-13T02:54:14.763 INFO:tasks.workunit.client.1.smithi131.stdout:8/573: chown db/d1d/d34/d4e/l8a 493463 1 2024-09-13T02:54:14.763 INFO:tasks.workunit.client.1.smithi131.stdout:8/574: write db/d1d/d1f/d5c/da1/fa5 [790316,118591] 0 2024-09-13T02:54:14.764 INFO:tasks.workunit.client.1.smithi131.stdout:8/575: symlink db/d2e/lb6 0 2024-09-13T02:54:14.765 INFO:tasks.workunit.client.1.smithi131.stdout:8/576: creat db/d1d/d1f/d67/d81/fb7 x:0 0 0 2024-09-13T02:54:14.767 INFO:tasks.workunit.client.1.smithi131.stdout:6/577: sync 2024-09-13T02:54:14.769 INFO:tasks.workunit.client.1.smithi131.stdout:8/577: fdatasync db/d2b/d39/d56/f57 0 2024-09-13T02:54:14.769 INFO:tasks.workunit.client.1.smithi131.stdout:8/578: write db/d1d/d1f/d67/f6b [270474,116051] 0 2024-09-13T02:54:14.769 INFO:tasks.workunit.client.1.smithi131.stdout:8/579: chown db/f23 128 1 2024-09-13T02:54:14.769 INFO:tasks.workunit.client.1.smithi131.stdout:8/580: dread - db/d1d/d34/d4e/f92 zero size 2024-09-13T02:54:14.780 INFO:tasks.workunit.client.1.smithi131.stdout:8/581: read db/d2b/d39/d56/f73 [833972,78439] 0 2024-09-13T02:54:14.781 INFO:tasks.workunit.client.1.smithi131.stdout:8/582: read db/d2b/d39/f77 [181936,8138] 0 2024-09-13T02:54:14.781 INFO:tasks.workunit.client.1.smithi131.stdout:8/583: mknod db/d2b/d39/d56/cb8 0 2024-09-13T02:54:14.791 INFO:tasks.workunit.client.1.smithi131.stdout:6/578: dwrite d1/d8/d9/db/f36 [0,4194304] 0 2024-09-13T02:54:14.794 INFO:tasks.workunit.client.1.smithi131.stdout:6/579: symlink d1/lbb 0 2024-09-13T02:54:14.803 INFO:tasks.workunit.client.1.smithi131.stdout:8/584: truncate db/d1d/d1f/f76 181038 0 2024-09-13T02:54:14.806 INFO:tasks.workunit.client.1.smithi131.stdout:8/585: creat db/d1d/d71/fb9 x:0 0 0 2024-09-13T02:54:14.809 INFO:tasks.workunit.client.1.smithi131.stdout:8/586: rename db/d1d/d34/d4e/d7e/l9d to db/d1d/d1f/d41/d50/lba 0 2024-09-13T02:54:14.818 INFO:tasks.workunit.client.1.smithi131.stdout:8/587: rmdir db/d1d/d71 39 2024-09-13T02:54:14.818 INFO:tasks.workunit.client.1.smithi131.stdout:8/588: stat db/d1d/fa7 0 2024-09-13T02:54:14.860 INFO:tasks.workunit.client.1.smithi131.stdout:4/602: sync 2024-09-13T02:54:14.861 INFO:tasks.workunit.client.1.smithi131.stdout:4/603: write d1/d18/d43/d97/dba/f3e [44028,37234] 0 2024-09-13T02:54:15.064 INFO:tasks.workunit.client.1.smithi131.stdout:0/685: sync 2024-09-13T02:54:15.064 INFO:tasks.workunit.client.1.smithi131.stdout:0/686: chown d0/c7 10272680 1 2024-09-13T02:54:15.065 INFO:tasks.workunit.client.1.smithi131.stdout:0/687: dread d0/d2/d41/f7e [0,4194304] 0 2024-09-13T02:54:15.066 INFO:tasks.workunit.client.1.smithi131.stdout:0/688: symlink d0/de/d1f/d22/d31/d39/d40/d68/lef 0 2024-09-13T02:54:15.067 INFO:tasks.workunit.client.1.smithi131.stdout:0/689: mkdir d0/de/d45/d78/df0 0 2024-09-13T02:54:15.073 INFO:tasks.workunit.client.1.smithi131.stdout:0/690: dread d0/de/d1f/d22/d3d/d55/fc0 [0,4194304] 0 2024-09-13T02:54:15.074 INFO:tasks.workunit.client.1.smithi131.stdout:0/691: creat d0/de/d1f/d22/d31/d39/ff1 x:0 0 0 2024-09-13T02:54:15.222 INFO:tasks.workunit.client.1.smithi131.stdout:9/485: sync 2024-09-13T02:54:15.239 INFO:tasks.workunit.client.1.smithi131.stdout:9/486: dwrite d0/d4d/f68 [4194304,4194304] 0 2024-09-13T02:54:15.239 INFO:tasks.workunit.client.1.smithi131.stdout:9/487: creat d0/d3/d14/d17/d32/d39/f9e x:0 0 0 2024-09-13T02:54:15.254 INFO:tasks.workunit.client.1.smithi131.stdout:0/692: sync 2024-09-13T02:54:15.254 INFO:tasks.workunit.client.1.smithi131.stdout:8/589: sync 2024-09-13T02:54:15.254 INFO:tasks.workunit.client.1.smithi131.stdout:6/580: sync 2024-09-13T02:54:15.254 INFO:tasks.workunit.client.1.smithi131.stdout:1/528: sync 2024-09-13T02:54:15.254 INFO:tasks.workunit.client.1.smithi131.stdout:4/604: sync 2024-09-13T02:54:15.254 INFO:tasks.workunit.client.1.smithi131.stdout:0/693: stat d0/de/d1f/d22/d31/d39/d40/fd0 0 2024-09-13T02:54:15.254 INFO:tasks.workunit.client.1.smithi131.stdout:3/498: sync 2024-09-13T02:54:15.254 INFO:tasks.workunit.client.1.smithi131.stdout:5/461: sync 2024-09-13T02:54:15.254 INFO:tasks.workunit.client.1.smithi131.stdout:2/518: sync 2024-09-13T02:54:15.254 INFO:tasks.workunit.client.1.smithi131.stdout:1/529: write dd/d26/d2a/f49 [9084543,65298] 0 2024-09-13T02:54:15.254 INFO:tasks.workunit.client.1.smithi131.stdout:3/499: chown d2/dc/d39/d61 0 1 2024-09-13T02:54:15.255 INFO:tasks.workunit.client.1.smithi131.stdout:2/519: chown d5/d34/fa7 156578 1 2024-09-13T02:54:15.255 INFO:tasks.workunit.client.1.smithi131.stdout:1/530: readlink dd/d26/d2a/d2c/l36 0 2024-09-13T02:54:15.255 INFO:tasks.workunit.client.1.smithi131.stdout:7/525: sync 2024-09-13T02:54:15.256 INFO:tasks.workunit.client.1.smithi131.stdout:5/462: dread d1/d2f/d33/f81 [0,4194304] 0 2024-09-13T02:54:15.256 INFO:tasks.workunit.client.1.smithi131.stdout:4/605: creat d1/d18/d43/d97/dba/d22/d73/fcd x:0 0 0 2024-09-13T02:54:15.258 INFO:tasks.workunit.client.1.smithi131.stdout:0/694: mknod d0/de/d1f/d22/d3d/d55/d63/d94/cf2 0 2024-09-13T02:54:15.262 INFO:tasks.workunit.client.1.smithi131.stdout:4/606: creat d1/d18/d43/d97/dba/d7a/dc5/fce x:0 0 0 2024-09-13T02:54:15.263 INFO:tasks.workunit.client.1.smithi131.stdout:0/695: link d0/de/d45/c83 d0/de/d45/d86/de8/cf3 0 2024-09-13T02:54:15.263 INFO:tasks.workunit.client.1.smithi131.stdout:0/696: readlink d0/l36 0 2024-09-13T02:54:15.265 INFO:tasks.workunit.client.1.smithi131.stdout:4/607: getdents d1/d18/d43/d97 0 2024-09-13T02:54:15.266 INFO:tasks.workunit.client.1.smithi131.stdout:0/697: creat d0/de/d1f/d22/d3d/d55/d63/d95/ff4 x:0 0 0 2024-09-13T02:54:15.268 INFO:tasks.workunit.client.1.smithi131.stdout:7/526: rename d1b/d3b/d41 to d1b/d3b/d31/d7c/db7 0 2024-09-13T02:54:15.270 INFO:tasks.workunit.client.1.smithi131.stdout:1/531: write dd/d68/f79 [3125057,22707] 0 2024-09-13T02:54:15.273 INFO:tasks.workunit.client.1.smithi131.stdout:8/590: dread db/d1d/d1f/d41/f62 [0,4194304] 0 2024-09-13T02:54:15.275 INFO:tasks.workunit.client.1.smithi131.stdout:8/591: link db/d1d/la4 db/d2b/lbb 0 2024-09-13T02:54:15.277 INFO:tasks.workunit.client.1.smithi131.stdout:8/592: truncate db/d2b/d39/d56/f73 2140436 0 2024-09-13T02:54:15.278 INFO:tasks.workunit.client.1.smithi131.stdout:8/593: dread - db/d2b/d39/fa2 zero size 2024-09-13T02:54:15.279 INFO:tasks.workunit.client.1.smithi131.stdout:2/520: dread d5/fa [0,4194304] 0 2024-09-13T02:54:15.279 INFO:tasks.workunit.client.1.smithi131.stdout:2/521: stat d5/d31/d1d/l8c 0 2024-09-13T02:54:15.279 INFO:tasks.workunit.client.1.smithi131.stdout:8/594: symlink db/d2b/lbc 0 2024-09-13T02:54:15.281 INFO:tasks.workunit.client.1.smithi131.stdout:2/522: creat d5/d34/d42/fad x:0 0 0 2024-09-13T02:54:15.284 INFO:tasks.workunit.client.1.smithi131.stdout:2/523: rename d5/d31/d21/d57/d90/f9e to d5/d18/d4b/d8e/fae 0 2024-09-13T02:54:15.284 INFO:tasks.workunit.client.1.smithi131.stdout:6/581: dwrite d1/d8/d9/db/d40/f47 [0,4194304] 0 2024-09-13T02:54:15.284 INFO:tasks.workunit.client.1.smithi131.stdout:2/524: chown d5/d31/d1d/d32/f3d 20266018 1 2024-09-13T02:54:15.287 INFO:tasks.workunit.client.1.smithi131.stdout:5/463: dwrite d1/d50/f93 [0,4194304] 0 2024-09-13T02:54:15.287 INFO:tasks.workunit.client.1.smithi131.stdout:5/464: chown d1/l91 236196 1 2024-09-13T02:54:15.288 INFO:tasks.workunit.client.1.smithi131.stdout:2/525: creat d5/d31/d1d/d32/faf x:0 0 0 2024-09-13T02:54:15.295 INFO:tasks.workunit.client.1.smithi131.stdout:5/465: read d1/d5/fa [272715,28098] 0 2024-09-13T02:54:15.319 INFO:tasks.workunit.client.1.smithi131.stdout:7/527: dwrite fb [0,4194304] 0 2024-09-13T02:54:15.321 INFO:tasks.workunit.client.1.smithi131.stdout:7/528: creat d1b/d3b/d51/d62/d6d/fb8 x:0 0 0 2024-09-13T02:54:15.321 INFO:tasks.workunit.client.1.smithi131.stdout:7/529: write d1b/d3b/d31/d7c/db7/da7/fae [1531725,130189] 0 2024-09-13T02:54:15.321 INFO:tasks.workunit.client.1.smithi131.stdout:7/530: truncate d1b/d3b/d46/d4b/d57/d7b/d92/f96 724510 0 2024-09-13T02:54:15.323 INFO:tasks.workunit.client.1.smithi131.stdout:0/698: dwrite d0/de/d45/d86/de8/f64 [0,4194304] 0 2024-09-13T02:54:15.323 INFO:tasks.workunit.client.1.smithi131.stdout:0/699: dread - d0/de/d1f/d22/d3d/d55/d63/dd2/fe1 zero size 2024-09-13T02:54:15.323 INFO:tasks.workunit.client.1.smithi131.stdout:0/700: dread - d0/d2/d41/fc4 zero size 2024-09-13T02:54:15.324 INFO:tasks.workunit.client.1.smithi131.stdout:7/531: rename d1b/d23/d54/f5e to d1b/d3b/d31/d7c/db7/fb9 0 2024-09-13T02:54:15.329 INFO:tasks.workunit.client.1.smithi131.stdout:0/701: rename d0/de/d45/d86/de8/c81 to d0/de/d1f/d22/d31/d39/cf5 0 2024-09-13T02:54:15.329 INFO:tasks.workunit.client.1.smithi131.stdout:1/532: write f4 [1483794,92550] 0 2024-09-13T02:54:15.329 INFO:tasks.workunit.client.1.smithi131.stdout:1/533: truncate dd/d26/fb7 455697 0 2024-09-13T02:54:15.330 INFO:tasks.workunit.client.1.smithi131.stdout:7/532: truncate d1b/f2c 1324207 0 2024-09-13T02:54:15.330 INFO:tasks.workunit.client.1.smithi131.stdout:7/533: fsync d1b/d3b/d46/f98 0 2024-09-13T02:54:15.331 INFO:tasks.workunit.client.1.smithi131.stdout:0/702: mknod d0/de/d1f/d22/d3d/d55/d63/cf6 0 2024-09-13T02:54:15.331 INFO:tasks.workunit.client.1.smithi131.stdout:1/534: rename dd/d68 to dd/dc2 0 2024-09-13T02:54:15.332 INFO:tasks.workunit.client.1.smithi131.stdout:1/535: stat dd/d26/d44/f40 0 2024-09-13T02:54:15.332 INFO:tasks.workunit.client.1.smithi131.stdout:3/500: dwrite d2/d4/d76/d9f/d41/f68 [0,4194304] 0 2024-09-13T02:54:15.333 INFO:tasks.workunit.client.1.smithi131.stdout:4/608: dwrite d1/d18/d34/d62/d78/db6/fb7 [0,4194304] 0 2024-09-13T02:54:15.333 INFO:tasks.workunit.client.1.smithi131.stdout:3/501: truncate d2/d4/f84 736693 0 2024-09-13T02:54:15.333 INFO:tasks.workunit.client.1.smithi131.stdout:7/534: mknod d1b/d3b/d31/d38/cba 0 2024-09-13T02:54:15.333 INFO:tasks.workunit.client.1.smithi131.stdout:7/535: write d1b/d3b/d51/d62/d6d/fb8 [840676,95412] 0 2024-09-13T02:54:15.333 INFO:tasks.workunit.client.1.smithi131.stdout:7/536: fdatasync d1b/d3b/d51/d62/f7a 0 2024-09-13T02:54:15.333 INFO:tasks.workunit.client.1.smithi131.stdout:7/537: dread - d1b/d3b/d51/d62/f7a zero size 2024-09-13T02:54:15.334 INFO:tasks.workunit.client.1.smithi131.stdout:6/582: dwrite d1/d8/d9/db/d15/d26/d1c/d79/d92/fb7 [0,4194304] 0 2024-09-13T02:54:15.334 INFO:tasks.workunit.client.1.smithi131.stdout:3/502: dread d2/f95 [0,4194304] 0 2024-09-13T02:54:15.334 INFO:tasks.workunit.client.1.smithi131.stdout:2/526: dwrite d5/d34/d42/fad [0,4194304] 0 2024-09-13T02:54:15.334 INFO:tasks.workunit.client.1.smithi131.stdout:3/503: write d2/d4/d7/f62 [161610,105550] 0 2024-09-13T02:54:15.334 INFO:tasks.workunit.client.1.smithi131.stdout:2/527: creat d5/d53/fb0 x:0 0 0 2024-09-13T02:54:15.335 INFO:tasks.workunit.client.1.smithi131.stdout:0/703: mkdir d0/de/d1f/d22/d3d/d55/d63/dd2/df7 0 2024-09-13T02:54:15.335 INFO:tasks.workunit.client.1.smithi131.stdout:0/704: chown d0/d2/d62/fca 0 1 2024-09-13T02:54:15.337 INFO:tasks.workunit.client.1.smithi131.stdout:5/466: dwrite d1/d1c/d8e/f5c [4194304,4194304] 0 2024-09-13T02:54:15.342 INFO:tasks.workunit.client.1.smithi131.stdout:4/609: truncate d1/d18/d43/d97/dba/d22/d49/f61 986488 0 2024-09-13T02:54:15.344 INFO:tasks.workunit.client.1.smithi131.stdout:4/610: write d1/d18/f9a [342006,104917] 0 2024-09-13T02:54:15.344 INFO:tasks.workunit.client.1.smithi131.stdout:7/538: mkdir d1b/d3b/d46/d4b/d57/d7b/d92/dbb 0 2024-09-13T02:54:15.344 INFO:tasks.workunit.client.1.smithi131.stdout:7/539: getdents d1b/d3b/d51/d8b/d99 0 2024-09-13T02:54:15.347 INFO:tasks.workunit.client.1.smithi131.stdout:6/583: mknod d1/d14/da2/cbc 0 2024-09-13T02:54:15.348 INFO:tasks.workunit.client.1.smithi131.stdout:7/540: dread d1b/d3b/f6b [0,4194304] 0 2024-09-13T02:54:15.351 INFO:tasks.workunit.client.1.smithi131.stdout:6/584: dread d1/f2b [0,4194304] 0 2024-09-13T02:54:15.352 INFO:tasks.workunit.client.1.smithi131.stdout:2/528: mkdir d5/d18/d4b/d8e/d48/d4c/db1 0 2024-09-13T02:54:15.353 INFO:tasks.workunit.client.1.smithi131.stdout:2/529: creat d5/d31/d4e/fb2 x:0 0 0 2024-09-13T02:54:15.353 INFO:tasks.workunit.client.1.smithi131.stdout:2/530: chown d5/d18/d4b/f89 7 1 2024-09-13T02:54:15.353 INFO:tasks.workunit.client.1.smithi131.stdout:0/705: unlink d0/c7 0 2024-09-13T02:54:15.354 INFO:tasks.workunit.client.1.smithi131.stdout:5/467: symlink d1/d29/d3e/l9d 0 2024-09-13T02:54:15.354 INFO:tasks.workunit.client.1.smithi131.stdout:5/468: chown d1/c58 759116728 1 2024-09-13T02:54:15.354 INFO:tasks.workunit.client.1.smithi131.stdout:5/469: write d1/d1c/d8e/f43 [2629953,58346] 0 2024-09-13T02:54:15.354 INFO:tasks.workunit.client.1.smithi131.stdout:5/470: creat d1/d29/d39/f9e x:0 0 0 2024-09-13T02:54:15.354 INFO:tasks.workunit.client.1.smithi131.stdout:4/611: symlink d1/d18/d43/d97/dba/d19/d29/d8d/dc9/lcf 0 2024-09-13T02:54:15.358 INFO:tasks.workunit.client.1.smithi131.stdout:2/531: symlink d5/d31/d4e/d78/da3/d41/lb3 0 2024-09-13T02:54:15.360 INFO:tasks.workunit.client.1.smithi131.stdout:4/612: mknod d1/d18/d43/d97/dba/d19/d29/d8d/dc9/cd0 0 2024-09-13T02:54:15.360 INFO:tasks.workunit.client.1.smithi131.stdout:4/613: dread - d1/d18/d43/d97/dba/d7a/dc5/fce zero size 2024-09-13T02:54:15.360 INFO:tasks.workunit.client.1.smithi131.stdout:1/536: dwrite dd/d33/d80/fac [0,4194304] 0 2024-09-13T02:54:15.362 INFO:tasks.workunit.client.1.smithi131.stdout:7/541: write d1b/d73/f85 [2313112,48153] 0 2024-09-13T02:54:15.362 INFO:tasks.workunit.client.1.smithi131.stdout:6/585: mkdir d1/d8/d9/db/d15/d26/dbd 0 2024-09-13T02:54:15.362 INFO:tasks.workunit.client.1.smithi131.stdout:7/542: creat d1b/d3b/fbc x:0 0 0 2024-09-13T02:54:15.367 INFO:tasks.workunit.client.1.smithi131.stdout:4/614: symlink d1/d18/d43/d97/dba/d7a/dbf/ld1 0 2024-09-13T02:54:15.367 INFO:tasks.workunit.client.1.smithi131.stdout:4/615: read d1/f5 [3841197,45602] 0 2024-09-13T02:54:15.367 INFO:tasks.workunit.client.1.smithi131.stdout:4/616: chown d1/d18/d43/d97/dba/l1e 338346 1 2024-09-13T02:54:15.369 INFO:tasks.workunit.client.1.smithi131.stdout:0/706: dread d0/de/d1f/d22/f53 [0,4194304] 0 2024-09-13T02:54:15.369 INFO:tasks.workunit.client.1.smithi131.stdout:0/707: fsync d0/fe7 0 2024-09-13T02:54:15.369 INFO:tasks.workunit.client.1.smithi131.stdout:2/532: dread d5/d31/d1d/d32/f49 [0,4194304] 0 2024-09-13T02:54:15.369 INFO:tasks.workunit.client.1.smithi131.stdout:2/533: fdatasync d5/d31/d26/f77 0 2024-09-13T02:54:15.369 INFO:tasks.workunit.client.1.smithi131.stdout:2/534: stat d5/d31 0 2024-09-13T02:54:15.371 INFO:tasks.workunit.client.1.smithi131.stdout:5/471: dread d1/d1c/d87/f9b [0,4194304] 0 2024-09-13T02:54:15.371 INFO:tasks.workunit.client.1.smithi131.stdout:5/472: chown d1/c4 482388 1 2024-09-13T02:54:15.371 INFO:tasks.workunit.client.1.smithi131.stdout:5/473: write d1/d5/fa [1655926,72604] 0 2024-09-13T02:54:15.371 INFO:tasks.workunit.client.1.smithi131.stdout:3/504: dwrite d2/d4/d7/d1d/f21 [4194304,4194304] 0 2024-09-13T02:54:15.371 INFO:tasks.workunit.client.1.smithi131.stdout:1/537: mknod dd/d33/d42/d6f/cc3 0 2024-09-13T02:54:15.375 INFO:tasks.workunit.client.1.smithi131.stdout:6/586: symlink d1/d14/lbe 0 2024-09-13T02:54:15.379 INFO:tasks.workunit.client.1.smithi131.stdout:2/535: getdents d5/d31/d21 0 2024-09-13T02:54:15.380 INFO:tasks.workunit.client.1.smithi131.stdout:2/536: fdatasync d5/d53/fb0 0 2024-09-13T02:54:15.382 INFO:tasks.workunit.client.1.smithi131.stdout:3/505: mkdir d2/dc/db1 0 2024-09-13T02:54:15.384 INFO:tasks.workunit.client.1.smithi131.stdout:5/474: dread d1/d21/f7b [0,4194304] 0 2024-09-13T02:54:15.384 INFO:tasks.workunit.client.1.smithi131.stdout:5/475: dread - d1/d2f/d33/f97 zero size 2024-09-13T02:54:15.384 INFO:tasks.workunit.client.1.smithi131.stdout:1/538: mknod dd/d26/d2a/d2c/d4b/cc4 0 2024-09-13T02:54:15.386 INFO:tasks.workunit.client.1.smithi131.stdout:5/476: mknod d1/d1c/c9f 0 2024-09-13T02:54:15.386 INFO:tasks.workunit.client.1.smithi131.stdout:1/539: rmdir dd/d33/d42 39 2024-09-13T02:54:15.388 INFO:tasks.workunit.client.1.smithi131.stdout:7/543: dwrite d1b/d3b/f3e [0,4194304] 0 2024-09-13T02:54:15.389 INFO:tasks.workunit.client.1.smithi131.stdout:5/477: rename d1/c86 to d1/d21/d74/ca0 0 2024-09-13T02:54:15.390 INFO:tasks.workunit.client.1.smithi131.stdout:1/540: symlink dd/d51/d5a/da3/lc5 0 2024-09-13T02:54:15.393 INFO:tasks.workunit.client.1.smithi131.stdout:5/478: creat d1/d2f/d4f/fa1 x:0 0 0 2024-09-13T02:54:15.395 INFO:tasks.workunit.client.1.smithi131.stdout:5/479: rename d1/d2f/f3c to d1/d5/d57/d60/fa2 0 2024-09-13T02:54:15.395 INFO:tasks.workunit.client.1.smithi131.stdout:2/537: dread d5/d31/d21/f72 [0,4194304] 0 2024-09-13T02:54:15.395 INFO:tasks.workunit.client.1.smithi131.stdout:5/480: readlink d1/d29/l8a 0 2024-09-13T02:54:15.396 INFO:tasks.workunit.client.1.smithi131.stdout:2/538: fsync d5/d31/d21/f72 0 2024-09-13T02:54:15.397 INFO:tasks.workunit.client.1.smithi131.stdout:2/539: mkdir d5/d31/d1d/d32/d3b/d67/d87/db4 0 2024-09-13T02:54:15.397 INFO:tasks.workunit.client.1.smithi131.stdout:2/540: chown d5/fa 181084 1 2024-09-13T02:54:15.398 INFO:tasks.workunit.client.1.smithi131.stdout:2/541: dread - d5/d53/fa9 zero size 2024-09-13T02:54:15.398 INFO:tasks.workunit.client.1.smithi131.stdout:5/481: dread d1/d2f/d33/f75 [0,4194304] 0 2024-09-13T02:54:15.399 INFO:tasks.workunit.client.1.smithi131.stdout:2/542: creat d5/d31/d1d/d37/fb5 x:0 0 0 2024-09-13T02:54:15.401 INFO:tasks.workunit.client.1.smithi131.stdout:4/617: dwrite d1/d18/d34/d62/d78/db6/fb7 [0,4194304] 0 2024-09-13T02:54:15.402 INFO:tasks.workunit.client.1.smithi131.stdout:4/618: chown d1/d18/d43/d7d/l95 0 1 2024-09-13T02:54:15.402 INFO:tasks.workunit.client.1.smithi131.stdout:4/619: chown d1/d18/f32 84 1 2024-09-13T02:54:15.403 INFO:tasks.workunit.client.1.smithi131.stdout:5/482: read d1/d21/f7b [3213247,90115] 0 2024-09-13T02:54:15.403 INFO:tasks.workunit.client.1.smithi131.stdout:5/483: readlink d1/l24 0 2024-09-13T02:54:15.403 INFO:tasks.workunit.client.1.smithi131.stdout:5/484: truncate d1/d2f/f31 4674852 0 2024-09-13T02:54:15.405 INFO:tasks.workunit.client.1.smithi131.stdout:5/485: rename d1/d1c/d87/f9b to d1/d50/fa3 0 2024-09-13T02:54:15.405 INFO:tasks.workunit.client.1.smithi131.stdout:5/486: write d1/d1c/d8e/f95 [207517,125469] 0 2024-09-13T02:54:15.406 INFO:tasks.workunit.client.1.smithi131.stdout:5/487: chown d1/d5/d57/d60/fa2 0 1 2024-09-13T02:54:15.406 INFO:tasks.workunit.client.1.smithi131.stdout:5/488: getdents d1/d29/d3e 0 2024-09-13T02:54:15.408 INFO:tasks.workunit.client.1.smithi131.stdout:5/489: link d1/d21/d74/d78/c8b d1/d2f/d71/ca4 0 2024-09-13T02:54:15.411 INFO:tasks.workunit.client.1.smithi131.stdout:5/490: mknod d1/d1c/d8e/ca5 0 2024-09-13T02:54:15.411 INFO:tasks.workunit.client.1.smithi131.stdout:0/708: dwrite d0/de/d45/d86/de8/f5b [0,4194304] 0 2024-09-13T02:54:15.411 INFO:tasks.workunit.client.1.smithi131.stdout:0/709: dread - d0/de/d1f/d22/d31/d39/d40/fd0 zero size 2024-09-13T02:54:15.411 INFO:tasks.workunit.client.1.smithi131.stdout:0/710: fsync d0/de/d1f/d22/d31/d39/d40/fd0 0 2024-09-13T02:54:15.413 INFO:tasks.workunit.client.1.smithi131.stdout:2/543: getdents d5/d31/d4e/d78/da3/d41 0 2024-09-13T02:54:15.413 INFO:tasks.workunit.client.1.smithi131.stdout:2/544: chown d5/d18/l29 5 1 2024-09-13T02:54:15.413 INFO:tasks.workunit.client.1.smithi131.stdout:4/620: dread d1/d18/d43/d97/dba/d22/d49/f6e [0,4194304] 0 2024-09-13T02:54:15.414 INFO:tasks.workunit.client.1.smithi131.stdout:5/491: rename d1/d21/c4b to d1/d29/ca6 0 2024-09-13T02:54:15.416 INFO:tasks.workunit.client.1.smithi131.stdout:1/541: dwrite dd/d26/fbf [4194304,4194304] 0 2024-09-13T02:54:15.416 INFO:tasks.workunit.client.1.smithi131.stdout:7/544: dwrite d1b/d3b/d51/d62/d9e/fa9 [0,4194304] 0 2024-09-13T02:54:15.417 INFO:tasks.workunit.client.1.smithi131.stdout:1/542: creat dd/d33/d80/fc6 x:0 0 0 2024-09-13T02:54:15.417 INFO:tasks.workunit.client.1.smithi131.stdout:0/711: symlink d0/de/d1f/d22/d3d/d55/d63/lf8 0 2024-09-13T02:54:15.417 INFO:tasks.workunit.client.1.smithi131.stdout:2/545: dread d5/d31/d26/d8d/fa1 [0,4194304] 0 2024-09-13T02:54:15.417 INFO:tasks.workunit.client.1.smithi131.stdout:2/546: creat d5/d6e/fb6 x:0 0 0 2024-09-13T02:54:15.418 INFO:tasks.workunit.client.1.smithi131.stdout:4/621: mknod d1/d18/cd2 0 2024-09-13T02:54:15.418 INFO:tasks.workunit.client.1.smithi131.stdout:5/492: dread d1/d5/fa [0,4194304] 0 2024-09-13T02:54:15.421 INFO:tasks.workunit.client.1.smithi131.stdout:7/545: mkdir d1b/d23/d89/dbd 0 2024-09-13T02:54:15.425 INFO:tasks.workunit.client.1.smithi131.stdout:1/543: rename dd/d26/d44/d6d/c86 to dd/d26/d2a/d69/dc0/cc7 0 2024-09-13T02:54:15.427 INFO:tasks.workunit.client.1.smithi131.stdout:0/712: link d0/de/d1f/d22/d3d/d55/d63/lf8 d0/de/d1f/d22/d31/d39/d40/d68/lf9 0 2024-09-13T02:54:15.427 INFO:tasks.workunit.client.1.smithi131.stdout:0/713: fsync d0/d2/f2f 0 2024-09-13T02:54:15.427 INFO:tasks.workunit.client.1.smithi131.stdout:0/714: fsync d0/de/da3/fdc 0 2024-09-13T02:54:15.431 INFO:tasks.workunit.client.1.smithi131.stdout:2/547: link d5/d31/d4e/c62 d5/d31/d1d/d32/d3b/d67/cb7 0 2024-09-13T02:54:15.432 INFO:tasks.workunit.client.1.smithi131.stdout:3/506: getdents d2/dc 0 2024-09-13T02:54:15.433 INFO:tasks.workunit.client.1.smithi131.stdout:7/546: creat d1b/d3b/d51/fbe x:0 0 0 2024-09-13T02:54:15.433 INFO:tasks.workunit.client.1.smithi131.stdout:7/547: write d1b/d3b/d51/d8f/fa4 [1068228,127931] 0 2024-09-13T02:54:15.433 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:15 smithi131 ceph-mon[34689]: from='client.14638 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:54:15.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:15 smithi131 ceph-mon[34689]: from='client.? 172.21.15.89:0/3340436433' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T02:54:15.434 INFO:tasks.workunit.client.1.smithi131.stdout:0/715: getdents d0/de/d1f/d22/d31/d39/d67/db5 0 2024-09-13T02:54:15.436 INFO:tasks.workunit.client.1.smithi131.stdout:2/548: symlink d5/d31/d21/d57/lb8 0 2024-09-13T02:54:15.436 INFO:tasks.workunit.client.1.smithi131.stdout:4/622: dwrite d1/d18/d34/d62/d78/db6/fb7 [4194304,4194304] 0 2024-09-13T02:54:15.437 INFO:tasks.workunit.client.1.smithi131.stdout:3/507: mkdir d2/d4/db2 0 2024-09-13T02:54:15.438 INFO:tasks.workunit.client.1.smithi131.stdout:3/508: fdatasync d2/dc/f2a 0 2024-09-13T02:54:15.438 INFO:tasks.workunit.client.1.smithi131.stdout:3/509: write d2/d4/d7/d1d/d24/f58 [412511,72090] 0 2024-09-13T02:54:15.440 INFO:tasks.workunit.client.1.smithi131.stdout:1/544: write dd/d26/d44/f3b [2245775,116476] 0 2024-09-13T02:54:15.440 INFO:tasks.workunit.client.1.smithi131.stdout:0/716: truncate d0/de/d1f/f33 3387166 0 2024-09-13T02:54:15.440 INFO:tasks.workunit.client.1.smithi131.stdout:0/717: stat d0/d2/d41/c82 0 2024-09-13T02:54:15.441 INFO:tasks.workunit.client.1.smithi131.stdout:4/623: getdents d1/d18/d43/d97/dba/d19/d29 0 2024-09-13T02:54:15.444 INFO:tasks.workunit.client.1.smithi131.stdout:7/548: write d1b/d23/f47 [1443782,119970] 0 2024-09-13T02:54:15.444 INFO:tasks.workunit.client.1.smithi131.stdout:7/549: write d1b/d3b/d51/d62/f7a [100506,8258] 0 2024-09-13T02:54:15.445 INFO:tasks.workunit.client.1.smithi131.stdout:7/550: write d1b/d23/f4c [10928,10999] 0 2024-09-13T02:54:15.446 INFO:tasks.workunit.client.1.smithi131.stdout:7/551: fdatasync fb 0 2024-09-13T02:54:15.450 INFO:tasks.workunit.client.1.smithi131.stdout:5/493: getdents d1/d2f/d71 0 2024-09-13T02:54:15.450 INFO:tasks.workunit.client.1.smithi131.stdout:2/549: write d5/f3a [6461550,53695] 0 2024-09-13T02:54:15.450 INFO:tasks.workunit.client.1.smithi131.stdout:2/550: chown d5/d31 53 1 2024-09-13T02:54:15.451 INFO:tasks.workunit.client.1.smithi131.stdout:3/510: link d2/d4/d76/d9f/d41/d5c/l50 d2/d4/d2d/d92/lb3 0 2024-09-13T02:54:15.452 INFO:tasks.workunit.client.1.smithi131.stdout:1/545: dread dd/d33/d80/fac [0,4194304] 0 2024-09-13T02:54:15.455 INFO:tasks.workunit.client.1.smithi131.stdout:4/624: mkdir d1/d18/d43/d97/dba/d7a/dd3 0 2024-09-13T02:54:15.455 INFO:tasks.workunit.client.1.smithi131.stdout:4/625: chown d1/d18/d43/d65/dbd/dc1/d13/l26 1167 1 2024-09-13T02:54:15.456 INFO:tasks.workunit.client.1.smithi131.stdout:5/494: fsync d1/d5/f3a 0 2024-09-13T02:54:15.457 INFO:tasks.workunit.client.1.smithi131.stdout:2/551: getdents d5/d18/d4b/d8e/d48/d4c 0 2024-09-13T02:54:15.458 INFO:tasks.workunit.client.1.smithi131.stdout:3/511: rmdir d2/d4/d76/d9f/d41/d5c/d4f 39 2024-09-13T02:54:15.458 INFO:tasks.workunit.client.1.smithi131.stdout:3/512: dread - d2/d4/d7/d1d/d24/d96/f98 zero size 2024-09-13T02:54:15.458 INFO:tasks.workunit.client.1.smithi131.stdout:3/513: write d2/d4/d7/d1d/d24/d6f/f89 [4625764,11666] 0 2024-09-13T02:54:15.458 INFO:tasks.workunit.client.1.smithi131.stdout:1/546: rename dd/d26/d2a/d2c/d4b/faa to dd/d33/fc8 0 2024-09-13T02:54:15.459 INFO:tasks.workunit.client.1.smithi131.stdout:0/718: getdents d0/de/d1f/d22/d3d/d43/d4b 0 2024-09-13T02:54:15.462 INFO:tasks.workunit.client.1.smithi131.stdout:2/552: link d5/d18/d4b/d8e/d48/d4c/ca4 d5/d31/d21/d57/d94/cb9 0 2024-09-13T02:54:15.464 INFO:tasks.workunit.client.1.smithi131.stdout:7/552: dread d1b/d3b/d31/d5f/f79 [0,4194304] 0 2024-09-13T02:54:15.464 INFO:tasks.workunit.client.1.smithi131.stdout:3/514: mkdir d2/d4/d7/d1d/db4 0 2024-09-13T02:54:15.467 INFO:tasks.workunit.client.1.smithi131.stdout:2/553: dread d5/d31/d26/d8d/fa1 [0,4194304] 0 2024-09-13T02:54:15.468 INFO:tasks.workunit.client.1.smithi131.stdout:2/554: readlink d5/d31/d1d/d37/l88 0 2024-09-13T02:54:15.472 INFO:tasks.workunit.client.1.smithi131.stdout:1/547: dread dd/f20 [0,4194304] 0 2024-09-13T02:54:15.472 INFO:tasks.workunit.client.1.smithi131.stdout:0/719: rename d0/d2/d41/dd6 to d0/de/d45/dfa 0 2024-09-13T02:54:15.476 INFO:tasks.workunit.client.1.smithi131.stdout:1/548: truncate dd/d33/d42/f48 398667 0 2024-09-13T02:54:15.477 INFO:tasks.workunit.client.1.smithi131.stdout:1/549: write dd/d51/d8a/fbe [428964,90708] 0 2024-09-13T02:54:15.477 INFO:tasks.workunit.client.1.smithi131.stdout:7/553: rename d1b/d3b/f5b to d1b/d3b/d31/d38/fbf 0 2024-09-13T02:54:15.477 INFO:tasks.workunit.client.1.smithi131.stdout:7/554: chown d1b/d3b/d46/d4b/d57/d9d/c9f 782054 1 2024-09-13T02:54:15.477 INFO:tasks.workunit.client.1.smithi131.stdout:1/550: link dd/d26/f8d dd/d26/d44/d6d/fc9 0 2024-09-13T02:54:15.480 INFO:tasks.workunit.client.1.smithi131.stdout:1/551: rename f0 to dd/d33/d94/fca 0 2024-09-13T02:54:15.480 INFO:tasks.workunit.client.1.smithi131.stdout:1/552: creat dd/d51/fcb x:0 0 0 2024-09-13T02:54:15.480 INFO:tasks.workunit.client.1.smithi131.stdout:1/553: chown dd/f3a 53 1 2024-09-13T02:54:15.480 INFO:tasks.workunit.client.1.smithi131.stdout:1/554: write dd/d51/d8a/fbe [2299612,32268] 0 2024-09-13T02:54:15.480 INFO:tasks.workunit.client.1.smithi131.stdout:3/515: write d2/d4/d1a/f66 [555236,50525] 0 2024-09-13T02:54:15.480 INFO:tasks.workunit.client.1.smithi131.stdout:0/720: dread d0/de/d1f/d22/d31/fe4 [0,4194304] 0 2024-09-13T02:54:15.482 INFO:tasks.workunit.client.1.smithi131.stdout:1/555: link dd/d26/d44/f22 dd/d51/d8a/fcc 0 2024-09-13T02:54:15.482 INFO:tasks.workunit.client.1.smithi131.stdout:1/556: creat dd/d26/d2a/d69/fcd x:0 0 0 2024-09-13T02:54:15.483 INFO:tasks.workunit.client.1.smithi131.stdout:3/516: unlink d2/c9c 0 2024-09-13T02:54:15.484 INFO:tasks.workunit.client.1.smithi131.stdout:5/495: dwrite d1/d21/f25 [0,4194304] 0 2024-09-13T02:54:15.494 INFO:tasks.workunit.client.1.smithi131.stdout:1/557: write dd/d26/d2a/d2c/d4b/f5b [177074,48405] 0 2024-09-13T02:54:15.494 INFO:tasks.workunit.client.1.smithi131.stdout:4/626: dwrite d1/d18/d43/d97/dba/d19/d29/d33/d3a/f74 [0,4194304] 0 2024-09-13T02:54:15.494 INFO:tasks.workunit.client.1.smithi131.stdout:4/627: fdatasync d1/d18/f2a 0 2024-09-13T02:54:15.494 INFO:tasks.workunit.client.1.smithi131.stdout:1/558: write f8 [1579768,20533] 0 2024-09-13T02:54:15.494 INFO:tasks.workunit.client.1.smithi131.stdout:1/559: creat dd/d33/d80/fce x:0 0 0 2024-09-13T02:54:15.501 INFO:tasks.workunit.client.1.smithi131.stdout:2/555: write d5/d31/d21/d57/d94/f9c [729791,50181] 0 2024-09-13T02:54:15.501 INFO:tasks.workunit.client.1.smithi131.stdout:2/556: fsync d5/d53/fa9 0 2024-09-13T02:54:15.501 INFO:tasks.workunit.client.1.smithi131.stdout:2/557: creat d5/d53/fba x:0 0 0 2024-09-13T02:54:15.501 INFO:tasks.workunit.client.1.smithi131.stdout:2/558: chown d5/d31/c3f 0 1 2024-09-13T02:54:15.501 INFO:tasks.workunit.client.1.smithi131.stdout:4/628: link d1/d18/d43/d97/dba/d19/d29/d8d/la9 d1/d18/d43/d65/dbd/dc1/d13/ld4 0 2024-09-13T02:54:15.501 INFO:tasks.workunit.client.1.smithi131.stdout:4/629: stat d1/d18/d43/d97/fa5 0 2024-09-13T02:54:15.503 INFO:tasks.workunit.client.1.smithi131.stdout:2/559: mkdir d5/d31/d1d/d37/d7c/dbb 0 2024-09-13T02:54:15.505 INFO:tasks.workunit.client.1.smithi131.stdout:4/630: creat d1/d18/d43/d97/fd5 x:0 0 0 2024-09-13T02:54:15.509 INFO:tasks.workunit.client.1.smithi131.stdout:1/560: dread dd/d33/d94/fca [0,4194304] 0 2024-09-13T02:54:15.509 INFO:tasks.workunit.client.1.smithi131.stdout:1/561: creat dd/d26/d2a/d69/fcf x:0 0 0 2024-09-13T02:54:15.511 INFO:tasks.workunit.client.1.smithi131.stdout:4/631: symlink d1/d18/d34/d62/d78/ld6 0 2024-09-13T02:54:15.512 INFO:tasks.workunit.client.1.smithi131.stdout:3/517: dwrite d2/d4/d1a/d31/d48/d69/f8e [0,4194304] 0 2024-09-13T02:54:15.513 INFO:tasks.workunit.client.1.smithi131.stdout:7/555: dwrite d1b/d3b/d31/d5f/f7e [0,4194304] 0 2024-09-13T02:54:15.514 INFO:tasks.workunit.client.1.smithi131.stdout:1/562: symlink dd/d26/d2a/ld0 0 2024-09-13T02:54:15.514 INFO:tasks.workunit.client.1.smithi131.stdout:5/496: dread d1/d2f/d33/f5b [0,4194304] 0 2024-09-13T02:54:15.514 INFO:tasks.workunit.client.1.smithi131.stdout:5/497: creat d1/d21/d74/fa7 x:0 0 0 2024-09-13T02:54:15.515 INFO:tasks.workunit.client.1.smithi131.stdout:7/556: write d1b/d3b/f6b [125,91702] 0 2024-09-13T02:54:15.518 INFO:tasks.workunit.client.1.smithi131.stdout:4/632: dread d1/d18/d43/d97/dba/d22/d49/f61 [0,4194304] 0 2024-09-13T02:54:15.524 INFO:tasks.workunit.client.1.smithi131.stdout:1/563: mkdir dd/d33/d42/d47/dd1 0 2024-09-13T02:54:15.524 INFO:tasks.workunit.client.1.smithi131.stdout:1/564: fdatasync dd/d51/f89 0 2024-09-13T02:54:15.524 INFO:tasks.workunit.client.1.smithi131.stdout:1/565: fsync dd/d33/d94/fca 0 2024-09-13T02:54:15.524 INFO:tasks.workunit.client.1.smithi131.stdout:1/566: chown dd/d26/d2a/d2c/l36 21191 1 2024-09-13T02:54:15.524 INFO:tasks.workunit.client.1.smithi131.stdout:1/567: dread - dd/d33/d42/f52 zero size 2024-09-13T02:54:15.525 INFO:tasks.workunit.client.1.smithi131.stdout:2/560: read d5/d31/d21/d57/d94/f9b [220092,117536] 0 2024-09-13T02:54:15.526 INFO:tasks.workunit.client.1.smithi131.stdout:5/498: creat d1/d21/d74/d78/d98/fa8 x:0 0 0 2024-09-13T02:54:15.526 INFO:tasks.workunit.client.1.smithi131.stdout:5/499: fsync d1/d50/fa3 0 2024-09-13T02:54:15.529 INFO:tasks.workunit.client.1.smithi131.stdout:7/557: dread f10 [0,4194304] 0 2024-09-13T02:54:15.529 INFO:tasks.workunit.client.1.smithi131.stdout:1/568: symlink dd/ld2 0 2024-09-13T02:54:15.529 INFO:tasks.workunit.client.1.smithi131.stdout:1/569: dread - dd/d33/d80/f8b zero size 2024-09-13T02:54:15.530 INFO:tasks.workunit.client.1.smithi131.stdout:1/570: truncate dd/d33/d94/fca 5186370 0 2024-09-13T02:54:15.530 INFO:tasks.workunit.client.1.smithi131.stdout:1/571: chown dd/d33/d80/fce 477895 1 2024-09-13T02:54:15.530 INFO:tasks.workunit.client.1.smithi131.stdout:1/572: creat dd/fd3 x:0 0 0 2024-09-13T02:54:15.532 INFO:tasks.workunit.client.1.smithi131.stdout:7/558: symlink d1b/d3b/d31/d38/lc0 0 2024-09-13T02:54:15.533 INFO:tasks.workunit.client.1.smithi131.stdout:3/518: dwrite d2/d4/d76/d9f/d41/d5c/d49/fa5 [0,4194304] 0 2024-09-13T02:54:15.533 INFO:tasks.workunit.client.1.smithi131.stdout:3/519: chown d2/d4/d76/d9f 57599 1 2024-09-13T02:54:15.534 INFO:tasks.workunit.client.1.smithi131.stdout:0/721: dwrite d0/de/d1f/d22/d3d/d55/f58 [4194304,4194304] 0 2024-09-13T02:54:15.534 INFO:tasks.workunit.client.1.smithi131.stdout:1/573: rename dd/d51/d5a/cc1 to dd/d26/d2a/d69/cd4 0 2024-09-13T02:54:15.534 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:15 smithi089 ceph-mon[27639]: from='client.14638 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:54:15.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:15 smithi089 ceph-mon[27639]: from='client.? 172.21.15.89:0/3340436433' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T02:54:15.539 INFO:tasks.workunit.client.1.smithi131.stdout:0/722: creat d0/de/d1f/d22/d3d/d43/dc2/dd3/ffb x:0 0 0 2024-09-13T02:54:15.539 INFO:tasks.workunit.client.1.smithi131.stdout:0/723: chown d0/de/cc3 4771364 1 2024-09-13T02:54:15.539 INFO:tasks.workunit.client.1.smithi131.stdout:0/724: chown d0/de/d1f/d22/d31/d39/d67/f5e 52 1 2024-09-13T02:54:15.539 INFO:tasks.workunit.client.1.smithi131.stdout:0/725: creat d0/de/d1f/d22/d31/d39/da8/ffc x:0 0 0 2024-09-13T02:54:15.539 INFO:tasks.workunit.client.1.smithi131.stdout:0/726: read - d0/de/d1f/d22/d3d/d43/dc2/dd3/ffb zero size 2024-09-13T02:54:15.539 INFO:tasks.workunit.client.1.smithi131.stdout:0/727: chown d0/l27 7817402 1 2024-09-13T02:54:15.540 INFO:tasks.workunit.client.1.smithi131.stdout:1/574: unlink dd/d26/d44/d6d/d7c/fa4 0 2024-09-13T02:54:15.544 INFO:tasks.workunit.client.1.smithi131.stdout:4/633: dwrite d1/d18/d43/f6c [0,4194304] 0 2024-09-13T02:54:15.545 INFO:tasks.workunit.client.1.smithi131.stdout:2/561: dwrite d5/d18/d4b/d8e/f4d [0,4194304] 0 2024-09-13T02:54:15.545 INFO:tasks.workunit.client.1.smithi131.stdout:2/562: chown d5/d31/d26/d8d 1286688 1 2024-09-13T02:54:15.547 INFO:tasks.workunit.client.1.smithi131.stdout:0/728: mkdir d0/de/d1f/d22/d3d/d55/dfd 0 2024-09-13T02:54:15.547 INFO:tasks.workunit.client.1.smithi131.stdout:0/729: fdatasync d0/d2/d41/f79 0 2024-09-13T02:54:15.548 INFO:tasks.workunit.client.1.smithi131.stdout:0/730: truncate d0/de/d1f/d22/d3d/d55/d63/d95/ff4 431908 0 2024-09-13T02:54:15.548 INFO:tasks.workunit.client.1.smithi131.stdout:0/731: dread d0/de/d1f/d22/d3d/d55/d63/d95/ff4 [0,4194304] 0 2024-09-13T02:54:15.549 INFO:tasks.workunit.client.1.smithi131.stdout:0/732: write d0/de/d1f/d22/d3d/d43/dc2/dd3/ffb [914147,105516] 0 2024-09-13T02:54:15.549 INFO:tasks.workunit.client.1.smithi131.stdout:0/733: chown d0/de/d1f/d22/d3d/d55/d63/d95 1 1 2024-09-13T02:54:15.549 INFO:tasks.workunit.client.1.smithi131.stdout:0/734: write d0/de/f59 [1581872,118495] 0 2024-09-13T02:54:15.549 INFO:tasks.workunit.client.1.smithi131.stdout:1/575: rename dd/f3c to dd/d33/d42/d47/fd5 0 2024-09-13T02:54:15.554 INFO:tasks.workunit.client.1.smithi131.stdout:2/563: rename d5/d18/d4b/d8e to d5/d31/d1d/d32/d3b/d67/d87/db4/dbc 0 2024-09-13T02:54:15.555 INFO:tasks.workunit.client.1.smithi131.stdout:2/564: read - d5/d31/d1d/d37/fb5 zero size 2024-09-13T02:54:15.557 INFO:tasks.workunit.client.1.smithi131.stdout:0/735: rename d0/d2/f2f to d0/de/d45/d86/de8/ffe 0 2024-09-13T02:54:15.559 INFO:tasks.workunit.client.1.smithi131.stdout:0/736: rename d0/de/d1f/d22/d31/d39/d67/f5e to d0/de/d1f/d22/d3d/fff 0 2024-09-13T02:54:15.561 INFO:tasks.workunit.client.1.smithi131.stdout:0/737: symlink d0/de/d45/l100 0 2024-09-13T02:54:15.569 INFO:tasks.workunit.client.1.smithi131.stdout:2/565: dwrite d5/d31/d4e/d78/da3/d41/f93 [0,4194304] 0 2024-09-13T02:54:15.574 INFO:tasks.workunit.client.1.smithi131.stdout:2/566: creat d5/d18/fbd x:0 0 0 2024-09-13T02:54:15.575 INFO:tasks.workunit.client.1.smithi131.stdout:2/567: rename d5/d31/d26/f63 to d5/d31/d21/fbe 0 2024-09-13T02:54:15.578 INFO:tasks.workunit.client.1.smithi131.stdout:0/738: rmdir d0/de/d1f/d22/d31 39 2024-09-13T02:54:15.586 INFO:tasks.workunit.client.1.smithi131.stdout:2/568: dread d5/d31/d4e/d78/da3/d66/f6c [0,4194304] 0 2024-09-13T02:54:15.587 INFO:tasks.workunit.client.1.smithi131.stdout:2/569: chown d5/d31/d4e/c62 0 1 2024-09-13T02:54:15.588 INFO:tasks.workunit.client.1.smithi131.stdout:2/570: mknod d5/d4f/cbf 0 2024-09-13T02:54:15.589 INFO:tasks.workunit.client.1.smithi131.stdout:2/571: symlink d5/d31/d4e/d78/da3/d66/lc0 0 2024-09-13T02:54:15.590 INFO:tasks.workunit.client.1.smithi131.stdout:2/572: write d5/d31/d1d/d32/d7d/fa8 [39834,9148] 0 2024-09-13T02:54:15.598 INFO:tasks.workunit.client.1.smithi131.stdout:0/739: dwrite d0/de/d1f/d22/d31/d39/da8/fcd [0,4194304] 0 2024-09-13T02:54:15.606 INFO:tasks.workunit.client.1.smithi131.stdout:2/573: dread d5/d31/d1d/f54 [0,4194304] 0 2024-09-13T02:54:15.606 INFO:tasks.workunit.client.1.smithi131.stdout:2/574: write d5/f9 [4411012,50296] 0 2024-09-13T02:54:15.607 INFO:tasks.workunit.client.1.smithi131.stdout:2/575: symlink d5/d31/d1d/d32/d3b/d67/d87/db4/dbc/lc1 0 2024-09-13T02:54:15.608 INFO:tasks.workunit.client.1.smithi131.stdout:2/576: creat d5/d18/d4b/fc2 x:0 0 0 2024-09-13T02:54:15.609 INFO:tasks.workunit.client.1.smithi131.stdout:2/577: symlink d5/d31/d1d/d32/d3b/d67/lc3 0 2024-09-13T02:54:15.609 INFO:tasks.workunit.client.1.smithi131.stdout:2/578: symlink d5/d31/d1d/d32/d3b/lc4 0 2024-09-13T02:54:15.627 INFO:tasks.workunit.client.1.smithi131.stdout:2/579: dwrite d5/d18/d4b/f40 [0,4194304] 0 2024-09-13T02:54:15.644 INFO:tasks.workunit.client.1.smithi131.stdout:2/580: dwrite d5/d31/d1d/d32/d3b/f9a [4194304,4194304] 0 2024-09-13T02:54:15.645 INFO:tasks.workunit.client.1.smithi131.stdout:2/581: link d5/d34/fa7 d5/d31/d1d/d32/d3b/d67/d87/db4/dbc/d48/d4c/db1/fc5 0 2024-09-13T02:54:15.646 INFO:tasks.workunit.client.1.smithi131.stdout:2/582: creat d5/d31/d4e/d78/fc6 x:0 0 0 2024-09-13T02:54:15.646 INFO:tasks.workunit.client.1.smithi131.stdout:2/583: readlink d5/d18/l29 0 2024-09-13T02:54:15.647 INFO:tasks.workunit.client.1.smithi131.stdout:2/584: rename d5/d31/d1d/l8c to d5/d31/d1d/d32/d3b/d67/lc7 0 2024-09-13T02:54:15.647 INFO:tasks.workunit.client.1.smithi131.stdout:2/585: fdatasync d5/d31/d1d/d37/d7c/f80 0 2024-09-13T02:54:15.647 INFO:tasks.workunit.client.1.smithi131.stdout:2/586: mkdir d5/d31/d21/d57/d90/dc8 0 2024-09-13T02:54:15.653 INFO:tasks.workunit.client.1.smithi131.stdout:2/587: dread d5/f3a [4194304,4194304] 0 2024-09-13T02:54:15.654 INFO:tasks.workunit.client.1.smithi131.stdout:2/588: mkdir d5/d31/d1d/d50/dc9 0 2024-09-13T02:54:15.654 INFO:tasks.workunit.client.1.smithi131.stdout:2/589: truncate d5/d31/d26/f59 3620118 0 2024-09-13T02:54:15.655 INFO:tasks.workunit.client.1.smithi131.stdout:2/590: mknod d5/d31/d26/cca 0 2024-09-13T02:54:15.656 INFO:tasks.workunit.client.1.smithi131.stdout:2/591: truncate d5/d31/d4e/d78/da3/d66/f73 1435761 0 2024-09-13T02:54:15.656 INFO:tasks.workunit.client.1.smithi131.stdout:2/592: chown d5/d31/d4e/d78/da3/d41/f4a 865173 1 2024-09-13T02:54:15.657 INFO:tasks.workunit.client.1.smithi131.stdout:2/593: rename d5/d31/d1d/d32/c36 to d5/d31/d1d/d32/d3b/d67/d87/db4/dbc/d48/d4c/ccb 0 2024-09-13T02:54:15.674 INFO:tasks.workunit.client.1.smithi131.stdout:2/594: dwrite d5/d31/d4e/d76/f96 [0,4194304] 0 2024-09-13T02:54:15.675 INFO:tasks.workunit.client.1.smithi131.stdout:2/595: creat d5/d31/d1d/d32/d3b/d67/d87/db4/dbc/fcc x:0 0 0 2024-09-13T02:54:15.676 INFO:tasks.workunit.client.1.smithi131.stdout:2/596: write d5/d34/f65 [4735960,111960] 0 2024-09-13T02:54:15.676 INFO:tasks.workunit.client.1.smithi131.stdout:2/597: dread - d5/d31/d4e/d78/f99 zero size 2024-09-13T02:54:15.680 INFO:tasks.workunit.client.1.smithi131.stdout:2/598: link d5/d31/d4e/d78/fc6 d5/d31/d1d/d32/d3b/d67/d87/db4/fcd 0 2024-09-13T02:54:15.680 INFO:tasks.workunit.client.1.smithi131.stdout:2/599: write d5/d18/d4b/f89 [4579802,44753] 0 2024-09-13T02:54:15.685 INFO:tasks.workunit.client.1.smithi131.stdout:2/600: write d5/d18/f1b [618349,53639] 0 2024-09-13T02:54:15.685 INFO:tasks.workunit.client.1.smithi131.stdout:2/601: getdents d5/d18/d4b 0 2024-09-13T02:54:15.701 INFO:tasks.workunit.client.1.smithi131.stdout:2/602: dwrite d5/d31/d1d/d32/d3b/d67/d87/db4/dbc/f98 [0,4194304] 0 2024-09-13T02:54:15.701 INFO:tasks.workunit.client.1.smithi131.stdout:2/603: truncate d5/d31/d26/f77 1088815 0 2024-09-13T02:54:15.714 INFO:tasks.workunit.client.1.smithi131.stdout:2/604: dwrite d5/d31/d1d/d32/d3b/d67/d87/db4/dbc/d48/d4c/f91 [0,4194304] 0 2024-09-13T02:54:15.714 INFO:tasks.workunit.client.1.smithi131.stdout:2/605: readlink d5/d31/d1d/d32/d3b/d67/d87/db4/dbc/lab 0 2024-09-13T02:54:15.723 INFO:tasks.workunit.client.1.smithi131.stdout:2/606: dread d5/d31/d1d/d32/f5e [4194304,4194304] 0 2024-09-13T02:54:15.724 INFO:tasks.workunit.client.1.smithi131.stdout:2/607: rmdir d5/d31/d1d/d32/d3b/d67/d87/db4/dbc 39 2024-09-13T02:54:15.726 INFO:tasks.workunit.client.1.smithi131.stdout:2/608: symlink d5/d31/d1d/d32/d3b/d67/lce 0 2024-09-13T02:54:15.726 INFO:tasks.workunit.client.1.smithi131.stdout:2/609: fdatasync d5/d31/d4e/d78/da3/d66/f74 0 2024-09-13T02:54:15.726 INFO:tasks.workunit.client.1.smithi131.stdout:2/610: creat d5/d31/d21/d57/fcf x:0 0 0 2024-09-13T02:54:15.728 INFO:tasks.workunit.client.1.smithi131.stdout:2/611: getdents d5/d31/d1d/d50 0 2024-09-13T02:54:15.728 INFO:tasks.workunit.client.1.smithi131.stdout:2/612: creat d5/d31/d1d/d32/d7d/fd0 x:0 0 0 2024-09-13T02:54:15.728 INFO:tasks.workunit.client.1.smithi131.stdout:2/613: chown d5/d31/d1d/d37/c61 55341 1 2024-09-13T02:54:15.728 INFO:tasks.workunit.client.1.smithi131.stdout:2/614: mknod d5/d31/d26/cd1 0 2024-09-13T02:54:15.729 INFO:tasks.workunit.client.1.smithi131.stdout:2/615: rename d5/d31/d1d/d32/f6f to d5/d31/d1d/d32/d3b/fd2 0 2024-09-13T02:54:15.729 INFO:tasks.workunit.client.1.smithi131.stdout:2/616: write d5/d31/d21/d57/d94/f9c [1616045,9767] 0 2024-09-13T02:54:15.729 INFO:tasks.workunit.client.1.smithi131.stdout:2/617: fsync d5/d6e/f92 0 2024-09-13T02:54:15.730 INFO:tasks.workunit.client.1.smithi131.stdout:2/618: readlink d5/d18/d68/la5 0 2024-09-13T02:54:15.730 INFO:tasks.workunit.client.1.smithi131.stdout:2/619: write d5/f9 [3357861,50495] 0 2024-09-13T02:54:15.730 INFO:tasks.workunit.client.1.smithi131.stdout:2/620: creat d5/d31/d1d/d37/fd3 x:0 0 0 2024-09-13T02:54:15.730 INFO:tasks.workunit.client.1.smithi131.stdout:2/621: read - d5/d18/fbd zero size 2024-09-13T02:54:15.730 INFO:tasks.workunit.client.1.smithi131.stdout:2/622: stat d5/d31/d4e/fb2 0 2024-09-13T02:54:15.736 INFO:tasks.workunit.client.1.smithi131.stdout:9/488: sync 2024-09-13T02:54:15.736 INFO:tasks.workunit.client.1.smithi131.stdout:8/595: sync 2024-09-13T02:54:15.737 INFO:tasks.workunit.client.1.smithi131.stdout:9/489: creat d0/d3/d14/d17/f9f x:0 0 0 2024-09-13T02:54:15.737 INFO:tasks.workunit.client.1.smithi131.stdout:8/596: write db/f23 [3786382,89186] 0 2024-09-13T02:54:15.737 INFO:tasks.workunit.client.1.smithi131.stdout:8/597: dread - db/fa9 zero size 2024-09-13T02:54:15.738 INFO:tasks.workunit.client.1.smithi131.stdout:9/490: mknod d0/d4d/d55/ca0 0 2024-09-13T02:54:15.738 INFO:tasks.workunit.client.1.smithi131.stdout:9/491: chown d0/d3/d14/d17/d32/d39/f50 233 1 2024-09-13T02:54:15.739 INFO:tasks.workunit.client.1.smithi131.stdout:9/492: creat d0/d3/fa1 x:0 0 0 2024-09-13T02:54:15.744 INFO:tasks.workunit.client.1.smithi131.stdout:9/493: rename d0/d3/d14/d17/d32 to d0/d3/d14/d1a/d2a/d5e/da2 0 2024-09-13T02:54:15.765 INFO:tasks.workunit.client.1.smithi131.stdout:9/494: dwrite d0/d3/d14/d17/f91 [0,4194304] 0 2024-09-13T02:54:15.766 INFO:tasks.workunit.client.1.smithi131.stdout:9/495: unlink d0/d3/d14/d1a/d2a/f5a 0 2024-09-13T02:54:15.767 INFO:tasks.workunit.client.1.smithi131.stdout:9/496: symlink d0/d3/la3 0 2024-09-13T02:54:15.768 INFO:tasks.workunit.client.1.smithi131.stdout:9/497: getdents d0/d4d/d55/d76 0 2024-09-13T02:54:15.769 INFO:tasks.workunit.client.1.smithi131.stdout:9/498: write d0/d3/d14/d3c/f93 [315196,7258] 0 2024-09-13T02:54:15.770 INFO:tasks.workunit.client.1.smithi131.stdout:9/499: creat d0/d3/d14/d95/fa4 x:0 0 0 2024-09-13T02:54:15.771 INFO:tasks.workunit.client.1.smithi131.stdout:9/500: symlink d0/d3/d14/d1a/d2a/d5e/la5 0 2024-09-13T02:54:15.771 INFO:tasks.workunit.client.1.smithi131.stdout:9/501: truncate d0/f11 3123159 0 2024-09-13T02:54:15.772 INFO:tasks.workunit.client.1.smithi131.stdout:9/502: creat d0/d3/d14/d1a/d2a/fa6 x:0 0 0 2024-09-13T02:54:15.774 INFO:tasks.workunit.client.1.smithi131.stdout:9/503: read d0/f11 [628389,59305] 0 2024-09-13T02:54:15.774 INFO:tasks.workunit.client.1.smithi131.stdout:9/504: chown d0/d3/d14/c27 5441480 1 2024-09-13T02:54:15.775 INFO:tasks.workunit.client.1.smithi131.stdout:9/505: creat d0/d4d/d55/d76/fa7 x:0 0 0 2024-09-13T02:54:15.790 INFO:tasks.workunit.client.1.smithi131.stdout:9/506: dwrite d0/d3/d14/d17/f31 [0,4194304] 0 2024-09-13T02:54:15.806 INFO:tasks.workunit.client.1.smithi131.stdout:9/507: dwrite d0/d3/d14/d1a/d2a/d5e/da2/f99 [0,4194304] 0 2024-09-13T02:54:15.823 INFO:tasks.workunit.client.1.smithi131.stdout:9/508: dwrite d0/f33 [0,4194304] 0 2024-09-13T02:54:15.823 INFO:tasks.workunit.client.1.smithi131.stdout:9/509: truncate d0/d3/f5b 1208440 0 2024-09-13T02:54:15.826 INFO:tasks.workunit.client.1.smithi131.stdout:9/510: dread d0/d3/d14/d3c/d8a/f8e [0,4194304] 0 2024-09-13T02:54:15.826 INFO:tasks.workunit.client.1.smithi131.stdout:9/511: creat d0/d3/d14/d95/fa8 x:0 0 0 2024-09-13T02:54:15.833 INFO:tasks.workunit.client.1.smithi131.stdout:9/512: dread d0/f12 [0,4194304] 0 2024-09-13T02:54:15.834 INFO:tasks.workunit.client.1.smithi131.stdout:9/513: rename d0/d4d/d55/d76/c82 to d0/d4d/ca9 0 2024-09-13T02:54:15.834 INFO:tasks.workunit.client.1.smithi131.stdout:9/514: symlink d0/d3/d14/d1a/d2a/d5e/da2/laa 0 2024-09-13T02:54:15.835 INFO:tasks.workunit.client.1.smithi131.stdout:9/515: chown d0/d4d/d55/f61 883815 1 2024-09-13T02:54:15.835 INFO:tasks.workunit.client.1.smithi131.stdout:9/516: rmdir d0/d4d/d55 39 2024-09-13T02:54:15.835 INFO:tasks.workunit.client.1.smithi131.stdout:9/517: chown d0/d3/d14/d1a/d2a/c78 31008 1 2024-09-13T02:54:15.836 INFO:tasks.workunit.client.1.smithi131.stdout:9/518: unlink d0/d3/d14/d95/fa4 0 2024-09-13T02:54:15.836 INFO:tasks.workunit.client.1.smithi131.stdout:9/519: dread - d0/d3/d14/d1a/d2a/d5e/f80 zero size 2024-09-13T02:54:15.836 INFO:tasks.workunit.client.1.smithi131.stdout:9/520: creat d0/d4d/fab x:0 0 0 2024-09-13T02:54:15.837 INFO:tasks.workunit.client.1.smithi131.stdout:9/521: mkdir d0/d3/dac 0 2024-09-13T02:54:15.837 INFO:tasks.workunit.client.1.smithi131.stdout:9/522: fsync d0/d3/d14/d1a/d2a/d5e/d79/f87 0 2024-09-13T02:54:15.838 INFO:tasks.workunit.client.1.smithi131.stdout:9/523: unlink d0/d3/d14/d1a/l51 0 2024-09-13T02:54:15.840 INFO:tasks.workunit.client.1.smithi131.stdout:9/524: mknod d0/d3/cad 0 2024-09-13T02:54:15.840 INFO:tasks.workunit.client.1.smithi131.stdout:9/525: chown d0/d3/d14/d67/c94 778424 1 2024-09-13T02:54:15.840 INFO:tasks.workunit.client.1.smithi131.stdout:9/526: rmdir d0/d3/d14/d1a/d2a/d5e/da2 39 2024-09-13T02:54:15.841 INFO:tasks.workunit.client.1.smithi131.stdout:9/527: mkdir d0/d3/d14/d1a/d2a/d5e/da2/d39/dae 0 2024-09-13T02:54:15.891 INFO:tasks.workunit.client.1.smithi131.stdout:5/500: sync 2024-09-13T02:54:15.891 INFO:tasks.workunit.client.1.smithi131.stdout:6/587: sync 2024-09-13T02:54:15.892 INFO:tasks.workunit.client.1.smithi131.stdout:5/501: truncate d1/d1c/f3b 2485464 0 2024-09-13T02:54:15.893 INFO:tasks.workunit.client.1.smithi131.stdout:6/588: truncate d1/d8/d9/db/d15/f31 354868 0 2024-09-13T02:54:15.894 INFO:tasks.workunit.client.1.smithi131.stdout:5/502: getdents d1/d50 0 2024-09-13T02:54:15.894 INFO:tasks.workunit.client.1.smithi131.stdout:5/503: chown d1/d1c/d8e/f5c 1311350 1 2024-09-13T02:54:15.895 INFO:tasks.workunit.client.1.smithi131.stdout:5/504: symlink d1/d50/la9 0 2024-09-13T02:54:15.895 INFO:tasks.workunit.client.1.smithi131.stdout:5/505: truncate d1/d1c/d8e/f5c 5626467 0 2024-09-13T02:54:15.897 INFO:tasks.workunit.client.1.smithi131.stdout:5/506: rename d1/l1f to d1/d1c/d8e/laa 0 2024-09-13T02:54:15.897 INFO:tasks.workunit.client.1.smithi131.stdout:5/507: chown d1/d21/d74/fa7 4571 1 2024-09-13T02:54:15.898 INFO:tasks.workunit.client.1.smithi131.stdout:5/508: rename d1/d21/d22/l2a to d1/d21/d22/lab 0 2024-09-13T02:54:15.898 INFO:tasks.workunit.client.1.smithi131.stdout:5/509: truncate d1/d2f/f69 4598734 0 2024-09-13T02:54:15.899 INFO:tasks.workunit.client.1.smithi131.stdout:5/510: mknod d1/d21/d74/d78/cac 0 2024-09-13T02:54:15.900 INFO:tasks.workunit.client.1.smithi131.stdout:6/589: dread d1/d14/f5c [0,4194304] 0 2024-09-13T02:54:15.902 INFO:tasks.workunit.client.1.smithi131.stdout:6/590: getdents d1/d8/d9/db/d15/d26/d1c/d4e 0 2024-09-13T02:54:15.912 INFO:tasks.workunit.client.1.smithi131.stdout:6/591: write d1/d8/d9/db/d15/d26/d1c/d4e/f72 [3534337,43093] 0 2024-09-13T02:54:15.913 INFO:tasks.workunit.client.1.smithi131.stdout:6/592: truncate d1/d8/d9/db/d15/d26/d1c/d4e/d97/d3b/f48 1405437 0 2024-09-13T02:54:15.913 INFO:tasks.workunit.client.1.smithi131.stdout:6/593: dread - d1/d8/d9/db/f68 zero size 2024-09-13T02:54:15.916 INFO:tasks.workunit.client.1.smithi131.stdout:6/594: dread d1/d8/f7a [0,4194304] 0 2024-09-13T02:54:15.917 INFO:tasks.workunit.client.1.smithi131.stdout:6/595: symlink d1/d14/lbf 0 2024-09-13T02:54:15.917 INFO:tasks.workunit.client.1.smithi131.stdout:6/596: dread - d1/d8/d9/db/d15/d26/d1c/d4e/f99 zero size 2024-09-13T02:54:15.917 INFO:tasks.workunit.client.1.smithi131.stdout:6/597: creat d1/d8/d9/db/d40/fc0 x:0 0 0 2024-09-13T02:54:15.917 INFO:tasks.workunit.client.1.smithi131.stdout:6/598: creat d1/d8/d9/db/fc1 x:0 0 0 2024-09-13T02:54:15.920 INFO:tasks.workunit.client.1.smithi131.stdout:6/599: rename d1/d8/d9/db/d15/d26/d1c/d4e/d97 to d1/d8/d9/db/d15/dc2 0 2024-09-13T02:54:15.943 INFO:tasks.workunit.client.1.smithi131.stdout:6/600: dwrite d1/d8/f62 [4194304,4194304] 0 2024-09-13T02:54:15.944 INFO:tasks.workunit.client.1.smithi131.stdout:6/601: write d1/d8/d9/db/f68 [36288,110797] 0 2024-09-13T02:54:15.960 INFO:tasks.workunit.client.1.smithi131.stdout:6/602: dwrite d1/d8/d9/db/d40/fc0 [0,4194304] 0 2024-09-13T02:54:15.960 INFO:tasks.workunit.client.1.smithi131.stdout:6/603: truncate d1/d8/d9/db/d15/d26/f91 874732 0 2024-09-13T02:54:15.960 INFO:tasks.workunit.client.1.smithi131.stdout:6/604: fsync d1/f7 0 2024-09-13T02:54:15.962 INFO:tasks.workunit.client.1.smithi131.stdout:6/605: rename d1/d14/da2/cbc to d1/d8/d9/db/d15/d26/d1c/d4e/cc3 0 2024-09-13T02:54:15.964 INFO:tasks.workunit.client.1.smithi131.stdout:6/606: symlink d1/d8/d9/db/d15/d26/d1c/d79/d92/lc4 0 2024-09-13T02:54:15.965 INFO:tasks.workunit.client.1.smithi131.stdout:6/607: creat d1/d8/d9/db/d15/d26/fc5 x:0 0 0 2024-09-13T02:54:15.966 INFO:tasks.workunit.client.1.smithi131.stdout:6/608: unlink d1/d8/d9/db/d40/l74 0 2024-09-13T02:54:15.970 INFO:tasks.workunit.client.1.smithi131.stdout:6/609: rmdir d1/d8/d9/db/d15 39 2024-09-13T02:54:15.989 INFO:tasks.workunit.client.1.smithi131.stdout:6/610: dwrite d1/d8/d9/db/d15/d26/d1c/d4e/f72 [0,4194304] 0 2024-09-13T02:54:15.990 INFO:tasks.workunit.client.1.smithi131.stdout:6/611: readlink d1/d8/d9/db/d15/d26/d1c/d4e/l51 0 2024-09-13T02:54:15.993 INFO:tasks.workunit.client.1.smithi131.stdout:6/612: mkdir d1/d8/d9/db/d15/d26/d1c/d79/d92/dc6 0 2024-09-13T02:54:15.995 INFO:tasks.workunit.client.1.smithi131.stdout:6/613: rename d1/d8/d9/db/d15/f31 to d1/d8/d9/db/d40/fc7 0 2024-09-13T02:54:15.997 INFO:tasks.workunit.client.1.smithi131.stdout:6/614: rename d1/d8/d9/d4b/fb6 to d1/d8/d9/db/d40/fc8 0 2024-09-13T02:54:15.998 INFO:tasks.workunit.client.1.smithi131.stdout:6/615: symlink d1/d14/lc9 0 2024-09-13T02:54:15.998 INFO:tasks.workunit.client.1.smithi131.stdout:6/616: fdatasync d1/d8/d9/d4b/fa1 0 2024-09-13T02:54:15.999 INFO:tasks.workunit.client.1.smithi131.stdout:6/617: chown d1/c24 231 1 2024-09-13T02:54:15.999 INFO:tasks.workunit.client.1.smithi131.stdout:6/618: truncate d1/d14/f5f 1515241 0 2024-09-13T02:54:16.000 INFO:tasks.workunit.client.1.smithi131.stdout:6/619: truncate d1/f7 3587810 0 2024-09-13T02:54:16.002 INFO:tasks.workunit.client.1.smithi131.stdout:6/620: creat d1/d8/d9/db/d15/d26/d1c/d79/d92/dc6/fca x:0 0 0 2024-09-13T02:54:16.002 INFO:tasks.workunit.client.1.smithi131.stdout:6/621: creat d1/d8/d9/db/d15/d26/d1c/d79/d92/dc6/fcb x:0 0 0 2024-09-13T02:54:16.003 INFO:tasks.workunit.client.1.smithi131.stdout:6/622: mknod d1/ccc 0 2024-09-13T02:54:16.005 INFO:tasks.workunit.client.1.smithi131.stdout:3/520: sync 2024-09-13T02:54:16.005 INFO:tasks.workunit.client.1.smithi131.stdout:7/559: sync 2024-09-13T02:54:16.005 INFO:tasks.workunit.client.1.smithi131.stdout:3/521: readlink d2/d4/d1a/l81 0 2024-09-13T02:54:16.005 INFO:tasks.workunit.client.1.smithi131.stdout:7/560: chown d1b/d73/f70 19 1 2024-09-13T02:54:16.006 INFO:tasks.workunit.client.1.smithi131.stdout:3/522: mknod d2/d4/d76/d9f/cb5 0 2024-09-13T02:54:16.007 INFO:tasks.workunit.client.1.smithi131.stdout:3/523: dread d2/d4/d76/d9f/d41/d5c/f35 [0,4194304] 0 2024-09-13T02:54:16.007 INFO:tasks.workunit.client.1.smithi131.stdout:3/524: creat d2/d4/d7/d1d/d24/fb6 x:0 0 0 2024-09-13T02:54:16.009 INFO:tasks.workunit.client.1.smithi131.stdout:3/525: mkdir d2/d4/db7 0 2024-09-13T02:54:16.014 INFO:tasks.workunit.client.1.smithi131.stdout:7/561: write d1b/d3b/d46/d4b/d57/f8a [2757854,79245] 0 2024-09-13T02:54:16.040 INFO:tasks.workunit.client.1.smithi131.stdout:7/562: dwrite d1b/d73/f85 [0,4194304] 0 2024-09-13T02:54:16.040 INFO:tasks.workunit.client.1.smithi131.stdout:7/563: readlink d1b/d3b/d31/d38/lc0 0 2024-09-13T02:54:16.041 INFO:tasks.workunit.client.1.smithi131.stdout:7/564: rename d1b/d3b/d31/d38/cba to d1b/d23/d89/dbd/cc1 0 2024-09-13T02:54:16.041 INFO:tasks.workunit.client.1.smithi131.stdout:6/623: dwrite d1/d14/f7c [0,4194304] 0 2024-09-13T02:54:16.042 INFO:tasks.workunit.client.1.smithi131.stdout:3/526: dwrite d2/d4/f23 [0,4194304] 0 2024-09-13T02:54:16.042 INFO:tasks.workunit.client.1.smithi131.stdout:3/527: chown d2/d4/d76/d9f/d41/d5c/c3c 7952 1 2024-09-13T02:54:16.043 INFO:tasks.workunit.client.1.smithi131.stdout:7/565: creat d1b/d3b/d51/d62/fc2 x:0 0 0 2024-09-13T02:54:16.043 INFO:tasks.workunit.client.1.smithi131.stdout:6/624: dread d1/d8/f7a [0,4194304] 0 2024-09-13T02:54:16.045 INFO:tasks.workunit.client.1.smithi131.stdout:6/625: creat d1/d8/d9/db/d15/d26/d1c/d4e/fcd x:0 0 0 2024-09-13T02:54:16.052 INFO:tasks.workunit.client.1.smithi131.stdout:6/626: read d1/d8/d9/db/d15/dc2/f6b [800516,92646] 0 2024-09-13T02:54:16.052 INFO:tasks.workunit.client.1.smithi131.stdout:6/627: truncate d1/d8/f38 4885492 0 2024-09-13T02:54:16.052 INFO:tasks.workunit.client.1.smithi131.stdout:6/628: creat d1/d53/fce x:0 0 0 2024-09-13T02:54:16.059 INFO:tasks.workunit.client.1.smithi131.stdout:6/629: write d1/d8/d9/db/d15/dc2/f88 [3211439,92973] 0 2024-09-13T02:54:16.060 INFO:tasks.workunit.client.1.smithi131.stdout:6/630: symlink d1/d8/d9/db/lcf 0 2024-09-13T02:54:16.061 INFO:tasks.workunit.client.1.smithi131.stdout:6/631: truncate d1/d8/d9/db/fb2 426683 0 2024-09-13T02:54:16.061 INFO:tasks.workunit.client.1.smithi131.stdout:6/632: write d1/d8/d9/db/d15/d26/d1c/d79/d92/f9c [945634,80428] 0 2024-09-13T02:54:16.061 INFO:tasks.workunit.client.1.smithi131.stdout:6/633: truncate d1/d8/d9/db/d40/fa6 786087 0 2024-09-13T02:54:16.071 INFO:tasks.workunit.client.1.smithi131.stdout:3/528: dwrite d2/d4/d7/d1d/d24/d6f/d7f/f88 [0,4194304] 0 2024-09-13T02:54:16.071 INFO:tasks.workunit.client.1.smithi131.stdout:7/566: dwrite d1b/f1f [0,4194304] 0 2024-09-13T02:54:16.072 INFO:tasks.workunit.client.1.smithi131.stdout:3/529: truncate d2/dc/f1b 4288693 0 2024-09-13T02:54:16.073 INFO:tasks.workunit.client.1.smithi131.stdout:3/530: write d2/d4/d7/f4d [796189,102962] 0 2024-09-13T02:54:16.073 INFO:tasks.workunit.client.1.smithi131.stdout:3/531: truncate d2/d4/f84 281123 0 2024-09-13T02:54:16.074 INFO:tasks.workunit.client.1.smithi131.stdout:3/532: chown d2/d4/d7/d1d/f2c 204 1 2024-09-13T02:54:16.079 INFO:tasks.workunit.client.1.smithi131.stdout:7/567: dread d1b/f2c [0,4194304] 0 2024-09-13T02:54:16.079 INFO:tasks.workunit.client.1.smithi131.stdout:7/568: readlink d1b/d23/l37 0 2024-09-13T02:54:16.080 INFO:tasks.workunit.client.1.smithi131.stdout:7/569: creat d1b/d3b/d31/d60/fc3 x:0 0 0 2024-09-13T02:54:16.080 INFO:tasks.workunit.client.1.smithi131.stdout:7/570: write d1b/d3b/d31/d60/fc3 [291196,62186] 0 2024-09-13T02:54:16.081 INFO:tasks.workunit.client.1.smithi131.stdout:6/634: dwrite d1/d8/d9/db/d15/d26/d1c/d79/d92/fb5 [0,4194304] 0 2024-09-13T02:54:16.082 INFO:tasks.workunit.client.1.smithi131.stdout:7/571: link d1b/d3b/d31/c3f d1b/d3b/d51/d62/d9e/da2/cc4 0 2024-09-13T02:54:16.082 INFO:tasks.workunit.client.1.smithi131.stdout:7/572: creat d1b/d3b/d31/fc5 x:0 0 0 2024-09-13T02:54:16.084 INFO:tasks.workunit.client.1.smithi131.stdout:6/635: dread d1/d8/f7a [0,4194304] 0 2024-09-13T02:54:16.086 INFO:tasks.workunit.client.1.smithi131.stdout:7/573: unlink d1b/d23/d89/f90 0 2024-09-13T02:54:16.086 INFO:tasks.workunit.client.1.smithi131.stdout:7/574: write d1b/d3b/f55 [1511632,11803] 0 2024-09-13T02:54:16.087 INFO:tasks.workunit.client.1.smithi131.stdout:3/533: write d2/d4/d7/d1d/d24/d6f/f70 [316599,40755] 0 2024-09-13T02:54:16.088 INFO:tasks.workunit.client.1.smithi131.stdout:6/636: mkdir d1/d8/d9/db/d15/dc2/d3b/dd0 0 2024-09-13T02:54:16.090 INFO:tasks.workunit.client.1.smithi131.stdout:6/637: mkdir d1/d8/d9/db/d15/d26/dd1 0 2024-09-13T02:54:16.092 INFO:tasks.workunit.client.1.smithi131.stdout:6/638: rename d1/d8/d9/f17 to d1/d8/d9/d4b/d8e/fd2 0 2024-09-13T02:54:16.092 INFO:tasks.workunit.client.1.smithi131.stdout:6/639: readlink d1/d8/d9/db/l6d 0 2024-09-13T02:54:16.093 INFO:tasks.workunit.client.1.smithi131.stdout:6/640: mknod d1/d14/cd3 0 2024-09-13T02:54:16.094 INFO:tasks.workunit.client.1.smithi131.stdout:6/641: read d1/d8/d9/db/d15/d26/f91 [440604,76782] 0 2024-09-13T02:54:16.095 INFO:tasks.workunit.client.1.smithi131.stdout:6/642: mkdir d1/d8/d9/db/d40/dd4 0 2024-09-13T02:54:16.096 INFO:tasks.workunit.client.1.smithi131.stdout:6/643: rename d1/d14/da2/cae to d1/cd5 0 2024-09-13T02:54:16.097 INFO:tasks.workunit.client.1.smithi131.stdout:3/534: write d2/d4/d76/d9f/d41/f68 [732135,54705] 0 2024-09-13T02:54:16.098 INFO:tasks.workunit.client.1.smithi131.stdout:6/644: rename d1/f55 to d1/d8/d9/db/d15/dc2/d3b/fd6 0 2024-09-13T02:54:16.098 INFO:tasks.workunit.client.1.smithi131.stdout:6/645: write d1/d8/d9/db/d15/dc2/d3b/faf [791516,30553] 0 2024-09-13T02:54:16.099 INFO:tasks.workunit.client.1.smithi131.stdout:6/646: mknod d1/d8/d9/db/d15/d26/d1c/d79/d92/dc6/cd7 0 2024-09-13T02:54:16.104 INFO:tasks.workunit.client.1.smithi131.stdout:7/575: dwrite d1b/d3b/d51/fbe [0,4194304] 0 2024-09-13T02:54:16.106 INFO:tasks.workunit.client.1.smithi131.stdout:7/576: mkdir d1b/d23/d54/dc6 0 2024-09-13T02:54:16.112 INFO:tasks.workunit.client.1.smithi131.stdout:6/647: write d1/d8/d9/db/d15/d26/d1c/d79/d92/fb5 [2502439,71388] 0 2024-09-13T02:54:16.121 INFO:tasks.workunit.client.1.smithi131.stdout:7/577: dwrite d1b/d3b/fbc [0,4194304] 0 2024-09-13T02:54:16.129 INFO:tasks.workunit.client.1.smithi131.stdout:6/648: dwrite d1/f7 [0,4194304] 0 2024-09-13T02:54:16.130 INFO:tasks.workunit.client.1.smithi131.stdout:6/649: creat d1/d8/d9/db/d15/fd8 x:0 0 0 2024-09-13T02:54:16.130 INFO:tasks.workunit.client.1.smithi131.stdout:6/650: dread - d1/f6e zero size 2024-09-13T02:54:16.131 INFO:tasks.workunit.client.1.smithi131.stdout:6/651: readlink d1/d14/lbf 0 2024-09-13T02:54:16.144 INFO:tasks.workunit.client.1.smithi131.stdout:6/652: dwrite d1/d8/d9/db/d40/fa6 [0,4194304] 0 2024-09-13T02:54:16.146 INFO:tasks.workunit.client.1.smithi131.stdout:6/653: mkdir d1/d8/d9/d4b/d8e/dd9 0 2024-09-13T02:54:16.146 INFO:tasks.workunit.client.1.smithi131.stdout:6/654: write d1/d8/d9/db/d15/d26/d1c/d79/d92/dc6/fca [152466,38832] 0 2024-09-13T02:54:16.146 INFO:tasks.workunit.client.1.smithi131.stdout:6/655: read - d1/d8/d9/db/d15/fb1 zero size 2024-09-13T02:54:16.146 INFO:tasks.workunit.client.1.smithi131.stdout:6/656: fdatasync d1/d8/d9/db/d15/dc2/d3b/fd6 0 2024-09-13T02:54:16.147 INFO:tasks.workunit.client.1.smithi131.stdout:6/657: symlink d1/d8/d9/d8d/lda 0 2024-09-13T02:54:16.147 INFO:tasks.workunit.client.1.smithi131.stdout:6/658: rename d1/d8/d9/db/fc1 to d1/d8/d9/db/d15/dc2/fdb 0 2024-09-13T02:54:16.149 INFO:tasks.workunit.client.1.smithi131.stdout:6/659: rename d1/d8/d9/db/d15/dc2/d3b/f98 to d1/d8/d9/db/d15/d26/d1c/d79/fdc 0 2024-09-13T02:54:16.150 INFO:tasks.workunit.client.1.smithi131.stdout:6/660: symlink d1/d8/ldd 0 2024-09-13T02:54:16.150 INFO:tasks.workunit.client.1.smithi131.stdout:6/661: readlink d1/d8/d9/l41 0 2024-09-13T02:54:16.151 INFO:tasks.workunit.client.1.smithi131.stdout:6/662: getdents d1/d8/d9/db/d15/d26/d1c/d4e 0 2024-09-13T02:54:16.153 INFO:tasks.workunit.client.1.smithi131.stdout:6/663: rename d1/d8/d9/d4b/d8e to d1/d8/d9/db/d15/d26/d1c/d4e/dde 0 2024-09-13T02:54:16.154 INFO:tasks.workunit.client.1.smithi131.stdout:6/664: mkdir d1/d8/d9/db/d15/d26/dbd/ddf 0 2024-09-13T02:54:16.155 INFO:tasks.workunit.client.1.smithi131.stdout:6/665: mknod d1/d8/d9/db/d15/d26/d1c/d4e/dde/dd9/ce0 0 2024-09-13T02:54:16.156 INFO:tasks.workunit.client.1.smithi131.stdout:6/666: unlink d1/d8/d9/db/d15/fd8 0 2024-09-13T02:54:16.158 INFO:tasks.workunit.client.1.smithi131.stdout:6/667: symlink d1/d8/d9/db/d15/d26/d1c/d4e/le1 0 2024-09-13T02:54:16.173 INFO:tasks.workunit.client.1.smithi131.stdout:6/668: dwrite d1/d8/d9/db/d15/d26/d1c/d4e/f73 [0,4194304] 0 2024-09-13T02:54:16.173 INFO:tasks.workunit.client.1.smithi131.stdout:6/669: chown d1/d8/d9/db/d40/c43 455 1 2024-09-13T02:54:16.174 INFO:tasks.workunit.client.1.smithi131.stdout:6/670: unlink d1/d8/d9/db/d15/dc2/cab 0 2024-09-13T02:54:16.193 INFO:tasks.workunit.client.1.smithi131.stdout:6/671: dwrite d1/d8/d9/db/d15/f3d [4194304,4194304] 0 2024-09-13T02:54:16.193 INFO:tasks.workunit.client.1.smithi131.stdout:6/672: write d1/d8/d9/db/d15/d26/f3a [1200273,33575] 0 2024-09-13T02:54:16.210 INFO:tasks.workunit.client.1.smithi131.stdout:6/673: dwrite d1/d8/d9/db/d15/d26/d1c/d79/d92/dc6/fcb [0,4194304] 0 2024-09-13T02:54:16.394 INFO:tasks.workunit.client.1.smithi131.stdout:4/634: sync 2024-09-13T02:54:16.394 INFO:tasks.workunit.client.1.smithi131.stdout:1/576: sync 2024-09-13T02:54:16.394 INFO:tasks.workunit.client.1.smithi131.stdout:0/740: sync 2024-09-13T02:54:16.396 INFO:tasks.workunit.client.1.smithi131.stdout:4/635: symlink d1/d18/d43/d97/dba/d19/d29/d33/d3a/ld7 0 2024-09-13T02:54:16.396 INFO:tasks.workunit.client.1.smithi131.stdout:4/636: fdatasync d1/d18/d43/d65/dbd/dc1/d13/f57 0 2024-09-13T02:54:16.396 INFO:tasks.workunit.client.1.smithi131.stdout:1/577: symlink dd/d33/d42/ld6 0 2024-09-13T02:54:16.398 INFO:tasks.workunit.client.1.smithi131.stdout:4/637: rename d1/d18/d34/d62/d78/db6/fb7 to d1/d18/d34/d62/d78/fd8 0 2024-09-13T02:54:16.398 INFO:tasks.workunit.client.1.smithi131.stdout:4/638: dread - d1/d18/d34/d4e/fb0 zero size 2024-09-13T02:54:16.398 INFO:tasks.workunit.client.1.smithi131.stdout:4/639: chown d1/d18/d81/f8a 1 1 2024-09-13T02:54:16.399 INFO:tasks.workunit.client.1.smithi131.stdout:1/578: rmdir dd/d51/d5a/da3 39 2024-09-13T02:54:16.400 INFO:tasks.workunit.client.1.smithi131.stdout:1/579: creat dd/d33/d94/fd7 x:0 0 0 2024-09-13T02:54:16.400 INFO:tasks.workunit.client.1.smithi131.stdout:1/580: chown dd/d33/d42/d47/c4d 1803861 1 2024-09-13T02:54:16.400 INFO:tasks.workunit.client.1.smithi131.stdout:1/581: stat dd/d51/d5a/da3/lc5 0 2024-09-13T02:54:16.400 INFO:tasks.workunit.client.1.smithi131.stdout:1/582: write dd/d26/d2a/d2c/d4b/f5b [241419,47060] 0 2024-09-13T02:54:16.401 INFO:tasks.workunit.client.1.smithi131.stdout:1/583: rmdir dd/d51/d8a 39 2024-09-13T02:54:16.402 INFO:tasks.workunit.client.1.smithi131.stdout:0/741: dread d0/de/d45/d86/de8/ffe [4194304,4194304] 0 2024-09-13T02:54:16.402 INFO:tasks.workunit.client.1.smithi131.stdout:1/584: unlink dd/f77 0 2024-09-13T02:54:16.403 INFO:tasks.workunit.client.1.smithi131.stdout:1/585: symlink dd/d33/d94/db4/ld8 0 2024-09-13T02:54:16.403 INFO:tasks.workunit.client.1.smithi131.stdout:0/742: symlink d0/de/d1f/d22/d3d/d55/d63/d94/l101 0 2024-09-13T02:54:16.404 INFO:tasks.workunit.client.1.smithi131.stdout:1/586: mknod dd/d26/d44/cd9 0 2024-09-13T02:54:16.404 INFO:tasks.workunit.client.1.smithi131.stdout:1/587: readlink dd/d33/d42/d47/l6e 0 2024-09-13T02:54:16.404 INFO:tasks.workunit.client.1.smithi131.stdout:1/588: creat dd/d26/fda x:0 0 0 2024-09-13T02:54:16.405 INFO:tasks.workunit.client.1.smithi131.stdout:0/743: getdents d0/de/d1f/d22/d31 0 2024-09-13T02:54:16.407 INFO:tasks.workunit.client.1.smithi131.stdout:1/589: creat dd/d33/d94/fdb x:0 0 0 2024-09-13T02:54:16.409 INFO:tasks.workunit.client.1.smithi131.stdout:0/744: creat d0/de/d1f/d22/d31/d39/d67/db5/f102 x:0 0 0 2024-09-13T02:54:16.409 INFO:tasks.workunit.client.1.smithi131.stdout:0/745: write d0/de/f59 [2091129,72192] 0 2024-09-13T02:54:16.411 INFO:tasks.workunit.client.1.smithi131.stdout:1/590: creat dd/d26/d2a/d2c/d4b/fdc x:0 0 0 2024-09-13T02:54:16.411 INFO:tasks.workunit.client.1.smithi131.stdout:1/591: chown dd/d26/fbc 14839 1 2024-09-13T02:54:16.413 INFO:tasks.workunit.client.1.smithi131.stdout:0/746: mkdir d0/de/d1f/d22/d31/d39/da8/d103 0 2024-09-13T02:54:16.413 INFO:tasks.workunit.client.1.smithi131.stdout:0/747: write d0/f90 [2860030,8170] 0 2024-09-13T02:54:16.413 INFO:tasks.workunit.client.1.smithi131.stdout:1/592: creat dd/d26/d44/d6d/fdd x:0 0 0 2024-09-13T02:54:16.415 INFO:tasks.workunit.client.1.smithi131.stdout:1/593: creat dd/d51/d5a/da3/fde x:0 0 0 2024-09-13T02:54:16.415 INFO:tasks.workunit.client.1.smithi131.stdout:1/594: chown dd/d33/d80/fac 2197 1 2024-09-13T02:54:16.415 INFO:tasks.workunit.client.1.smithi131.stdout:0/748: symlink d0/de/d1f/l104 0 2024-09-13T02:54:16.416 INFO:tasks.workunit.client.1.smithi131.stdout:4/640: dwrite d1/d18/d43/d97/dba/d22/d73/fcd [0,4194304] 0 2024-09-13T02:54:16.418 INFO:tasks.workunit.client.1.smithi131.stdout:1/595: truncate dd/f20 631241 0 2024-09-13T02:54:16.418 INFO:tasks.workunit.client.1.smithi131.stdout:1/596: readlink dd/d26/d44/d6d/lbb 0 2024-09-13T02:54:16.419 INFO:tasks.workunit.client.1.smithi131.stdout:0/749: rename d0/de/d1f/d22/l5c to d0/de/d1f/d22/d31/d39/d40/d68/l105 0 2024-09-13T02:54:16.419 INFO:tasks.workunit.client.1.smithi131.stdout:0/750: dread - d0/d2/d41/fc4 zero size 2024-09-13T02:54:16.424 INFO:tasks.workunit.client.1.smithi131.stdout:1/597: link dd/dc2/f9b dd/d51/fdf 0 2024-09-13T02:54:16.426 INFO:tasks.workunit.client.1.smithi131.stdout:0/751: truncate d0/de/d1f/d22/d3d/d43/dc2/dd3/fee 873743 0 2024-09-13T02:54:16.426 INFO:tasks.workunit.client.1.smithi131.stdout:0/752: read - d0/de/d1f/d22/d31/d39/d67/fec zero size 2024-09-13T02:54:16.426 INFO:tasks.workunit.client.1.smithi131.stdout:0/753: dread - d0/de/d1f/d22/d31/d39/d67/fec zero size 2024-09-13T02:54:16.427 INFO:tasks.workunit.client.1.smithi131.stdout:1/598: symlink dd/d51/db3/le0 0 2024-09-13T02:54:16.435 INFO:tasks.workunit.client.1.smithi131.stdout:4/641: dwrite d1/d18/d34/f6f [0,4194304] 0 2024-09-13T02:54:16.439 INFO:tasks.workunit.client.1.smithi131.stdout:4/642: rmdir d1/d18/d43/d97/dba/d19/d29/d33/dcc 0 2024-09-13T02:54:16.441 INFO:tasks.workunit.client.1.smithi131.stdout:4/643: mkdir d1/d18/d43/dd9 0 2024-09-13T02:54:16.441 INFO:tasks.workunit.client.1.smithi131.stdout:4/644: creat d1/d18/d43/d97/dba/d7a/fda x:0 0 0 2024-09-13T02:54:16.441 INFO:tasks.workunit.client.1.smithi131.stdout:4/645: truncate d1/d18/d43/d65/dbd/dc1/d13/f57 916554 0 2024-09-13T02:54:16.460 INFO:tasks.workunit.client.1.smithi131.stdout:4/646: dwrite d1/d18/f75 [0,4194304] 0 2024-09-13T02:54:16.460 INFO:tasks.workunit.client.1.smithi131.stdout:4/647: chown d1/d18/d43/d97/dba/d19/d29/d33/d3a/da8 0 1 2024-09-13T02:54:16.476 INFO:tasks.workunit.client.1.smithi131.stdout:4/648: dwrite d1/d18/d81/fb8 [0,4194304] 0 2024-09-13T02:54:16.479 INFO:tasks.workunit.client.1.smithi131.stdout:4/649: symlink d1/d18/d81/ldb 0 2024-09-13T02:54:16.480 INFO:tasks.workunit.client.1.smithi131.stdout:4/650: stat d1/d18/d43/d65/dbd/dc1/f2f 0 2024-09-13T02:54:16.483 INFO:tasks.workunit.client.1.smithi131.stdout:4/651: dread d1/d18/d43/d97/dba/f3e [0,4194304] 0 2024-09-13T02:54:16.484 INFO:tasks.workunit.client.1.smithi131.stdout:4/652: symlink d1/d18/d43/d97/dba/d22/d73/ldc 0 2024-09-13T02:54:16.507 INFO:tasks.workunit.client.1.smithi131.stdout:4/653: dwrite d1/d18/d43/d97/fd5 [0,4194304] 0 2024-09-13T02:54:16.509 INFO:tasks.workunit.client.1.smithi131.stdout:4/654: dread d1/d18/d43/d97/dba/d22/d49/f61 [0,4194304] 0 2024-09-13T02:54:16.517 INFO:tasks.workunit.client.1.smithi131.stdout:4/655: write d1/d18/d43/d97/dba/d19/d29/d8d/dc9/fc2 [3938359,57474] 0 2024-09-13T02:54:16.534 INFO:tasks.workunit.client.1.smithi131.stdout:4/656: dwrite d1/d18/d43/d97/dba/d22/d49/f6e [0,4194304] 0 2024-09-13T02:54:16.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:16 smithi089 ceph-mon[27639]: pgmap v250: 65 pgs: 65 active+clean; 3.2 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 218 MiB/s rd, 251 MiB/s wr, 372 op/s 2024-09-13T02:54:16.537 INFO:tasks.workunit.client.1.smithi131.stdout:4/657: creat d1/d18/d43/fdd x:0 0 0 2024-09-13T02:54:16.537 INFO:tasks.workunit.client.1.smithi131.stdout:4/658: chown d1 66936 1 2024-09-13T02:54:16.538 INFO:tasks.workunit.client.1.smithi131.stdout:4/659: truncate d1/d18/d43/d97/dba/d22/d73/fcd 1533941 0 2024-09-13T02:54:16.539 INFO:tasks.workunit.client.1.smithi131.stdout:4/660: mknod d1/d18/d34/d62/d78/cde 0 2024-09-13T02:54:16.540 INFO:tasks.workunit.client.1.smithi131.stdout:8/598: sync 2024-09-13T02:54:16.541 INFO:tasks.workunit.client.1.smithi131.stdout:2/623: sync 2024-09-13T02:54:16.541 INFO:tasks.workunit.client.1.smithi131.stdout:2/624: truncate d5/d31/d1d/d32/d3b/d67/d87/db4/dbc/d48/d4c/f84 965241 0 2024-09-13T02:54:16.542 INFO:tasks.workunit.client.1.smithi131.stdout:4/661: mkdir d1/d18/d43/d97/dba/d19/d29/d8d/ddf 0 2024-09-13T02:54:16.542 INFO:tasks.workunit.client.1.smithi131.stdout:4/662: dread - d1/d18/d43/d97/dba/d22/d73/f7b zero size 2024-09-13T02:54:16.542 INFO:tasks.workunit.client.1.smithi131.stdout:4/663: write d1/f27 [333196,81287] 0 2024-09-13T02:54:16.542 INFO:tasks.workunit.client.1.smithi131.stdout:4/664: write d1/d18/d43/d65/fa4 [652107,69391] 0 2024-09-13T02:54:16.543 INFO:tasks.workunit.client.1.smithi131.stdout:2/625: rename d5/d31/d1d/d37/f56 to d5/d31/d4e/d78/da3/d66/fd4 0 2024-09-13T02:54:16.545 INFO:tasks.workunit.client.1.smithi131.stdout:8/599: getdents db/d1d/d1f/d5c/da1 0 2024-09-13T02:54:16.547 INFO:tasks.workunit.client.1.smithi131.stdout:2/626: creat d5/d31/d1d/d32/d3b/d67/d87/db4/dbc/d48/d4c/db1/fd5 x:0 0 0 2024-09-13T02:54:16.548 INFO:tasks.workunit.client.1.smithi131.stdout:8/600: getdents db/d1d/d1f 0 2024-09-13T02:54:16.549 INFO:tasks.workunit.client.1.smithi131.stdout:2/627: mknod d5/d31/d4e/d78/da3/d66/cd6 0 2024-09-13T02:54:16.550 INFO:tasks.workunit.client.1.smithi131.stdout:2/628: mknod d5/d31/d21/d57/cd7 0 2024-09-13T02:54:16.550 INFO:tasks.workunit.client.1.smithi131.stdout:2/629: chown d5/d18/f1b 7 1 2024-09-13T02:54:16.550 INFO:tasks.workunit.client.1.smithi131.stdout:2/630: write d5/d31/d1d/d32/d3b/d67/d87/db4/dbc/d48/d4c/f84 [1285429,13673] 0 2024-09-13T02:54:16.550 INFO:tasks.workunit.client.1.smithi131.stdout:2/631: creat d5/d31/d1d/d32/d3b/d67/d87/fd8 x:0 0 0 2024-09-13T02:54:16.551 INFO:tasks.workunit.client.1.smithi131.stdout:2/632: read - d5/d31/d1d/d32/faf zero size 2024-09-13T02:54:16.551 INFO:tasks.workunit.client.1.smithi131.stdout:2/633: creat d5/d31/d1d/d32/d3b/fd9 x:0 0 0 2024-09-13T02:54:16.552 INFO:tasks.workunit.client.1.smithi131.stdout:2/634: mkdir d5/d6e/dda 0 2024-09-13T02:54:16.556 INFO:tasks.workunit.client.1.smithi131.stdout:4/665: dwrite d1/d18/d43/d97/dba/d19/d29/d33/f64 [0,4194304] 0 2024-09-13T02:54:16.558 INFO:tasks.workunit.client.1.smithi131.stdout:8/601: dread db/d1d/d1f/d41/f62 [0,4194304] 0 2024-09-13T02:54:16.560 INFO:tasks.workunit.client.1.smithi131.stdout:4/666: unlink d1/d18/d43/d97/dba/d22/d49/f54 0 2024-09-13T02:54:16.562 INFO:tasks.workunit.client.1.smithi131.stdout:4/667: truncate d1/d18/d34/d62/d78/fd8 7258941 0 2024-09-13T02:54:16.563 INFO:tasks.workunit.client.1.smithi131.stdout:4/668: mkdir d1/d18/d43/d97/dba/d22/d73/de0 0 2024-09-13T02:54:16.565 INFO:tasks.workunit.client.1.smithi131.stdout:4/669: creat d1/d18/d43/d97/dba/d22/d73/de0/fe1 x:0 0 0 2024-09-13T02:54:16.565 INFO:tasks.workunit.client.1.smithi131.stdout:4/670: truncate d1/d18/d34/d62/f9c 1606442 0 2024-09-13T02:54:16.565 INFO:tasks.workunit.client.1.smithi131.stdout:4/671: stat d1/d18/d43/d97/dba/d19/d29/d33/d3a/ld7 0 2024-09-13T02:54:16.566 INFO:tasks.workunit.client.1.smithi131.stdout:8/602: write db/f30 [287650,13915] 0 2024-09-13T02:54:16.566 INFO:tasks.workunit.client.1.smithi131.stdout:8/603: creat db/d1d/d1f/d66/fbd x:0 0 0 2024-09-13T02:54:16.573 INFO:tasks.workunit.client.1.smithi131.stdout:2/635: dwrite d5/d34/f7a [0,4194304] 0 2024-09-13T02:54:16.576 INFO:tasks.workunit.client.1.smithi131.stdout:2/636: creat d5/fdb x:0 0 0 2024-09-13T02:54:16.576 INFO:tasks.workunit.client.1.smithi131.stdout:2/637: read - d5/d31/d1d/d32/d7d/fd0 zero size 2024-09-13T02:54:16.580 INFO:tasks.workunit.client.1.smithi131.stdout:2/638: unlink d5/d31/d21/d57/d94/f9c 0 2024-09-13T02:54:16.581 INFO:tasks.workunit.client.1.smithi131.stdout:2/639: mknod d5/d18/d4b/cdc 0 2024-09-13T02:54:16.581 INFO:tasks.workunit.client.1.smithi131.stdout:2/640: getdents d5/d31/d1d/d32/d3b/d67/d87/db4/dbc 0 2024-09-13T02:54:16.582 INFO:tasks.workunit.client.1.smithi131.stdout:2/641: creat d5/d18/d4b/fdd x:0 0 0 2024-09-13T02:54:16.582 INFO:tasks.workunit.client.1.smithi131.stdout:4/672: dwrite d1/d18/d43/d97/dba/fae [0,4194304] 0 2024-09-13T02:54:16.608 INFO:tasks.workunit.client.1.smithi131.stdout:4/673: dwrite d1/d18/d43/d97/dba/d22/d73/f87 [0,4194304] 0 2024-09-13T02:54:16.608 INFO:tasks.workunit.client.1.smithi131.stdout:2/642: dwrite d5/d31/d1d/d32/f49 [0,4194304] 0 2024-09-13T02:54:16.630 INFO:tasks.workunit.client.1.smithi131.stdout:4/674: dwrite d1/d18/d43/d97/dba/d22/d73/de0/fe1 [0,4194304] 0 2024-09-13T02:54:16.630 INFO:tasks.workunit.client.1.smithi131.stdout:2/643: dwrite d5/d34/d42/fad [0,4194304] 0 2024-09-13T02:54:16.632 INFO:tasks.workunit.client.1.smithi131.stdout:4/675: creat d1/d18/d43/d97/dba/d19/d29/d8d/fe2 x:0 0 0 2024-09-13T02:54:16.633 INFO:tasks.workunit.client.1.smithi131.stdout:4/676: creat d1/d18/d43/d97/dba/d22/fe3 x:0 0 0 2024-09-13T02:54:16.634 INFO:tasks.workunit.client.1.smithi131.stdout:4/677: symlink d1/d18/d43/d97/dba/d22/d73/le4 0 2024-09-13T02:54:16.635 INFO:tasks.workunit.client.1.smithi131.stdout:4/678: symlink d1/d18/d43/d97/dba/d19/d29/d33/le5 0 2024-09-13T02:54:16.635 INFO:tasks.workunit.client.1.smithi131.stdout:4/679: read - d1/d18/d34/d4e/fb0 zero size 2024-09-13T02:54:16.635 INFO:tasks.workunit.client.1.smithi131.stdout:4/680: chown d1/d18/d43/d97/dba/d7a/dbf 230184 1 2024-09-13T02:54:16.637 INFO:tasks.workunit.client.1.smithi131.stdout:4/681: unlink d1/d18/d43/d97/dba/d19/d29/d8d/dc9/lcf 0 2024-09-13T02:54:16.639 INFO:tasks.workunit.client.1.smithi131.stdout:4/682: creat d1/d18/d43/d7d/fe6 x:0 0 0 2024-09-13T02:54:16.639 INFO:tasks.workunit.client.1.smithi131.stdout:4/683: dread - d1/d18/d34/d4e/f93 zero size 2024-09-13T02:54:16.640 INFO:tasks.workunit.client.1.smithi131.stdout:4/684: creat d1/d18/d43/d97/dba/d7a/dd3/fe7 x:0 0 0 2024-09-13T02:54:16.641 INFO:tasks.workunit.client.1.smithi131.stdout:4/685: creat d1/d18/d34/d62/d78/fe8 x:0 0 0 2024-09-13T02:54:16.642 INFO:tasks.workunit.client.1.smithi131.stdout:4/686: mknod d1/d18/d34/d62/da3/ce9 0 2024-09-13T02:54:16.646 INFO:tasks.workunit.client.1.smithi131.stdout:2/644: dwrite d5/d53/fa9 [0,4194304] 0 2024-09-13T02:54:16.649 INFO:tasks.workunit.client.1.smithi131.stdout:2/645: dread d5/d31/d1d/d32/d3b/d67/d87/db4/dbc/d48/d4c/db1/fc5 [0,4194304] 0 2024-09-13T02:54:16.649 INFO:tasks.workunit.client.1.smithi131.stdout:2/646: write d5/fa [1999551,98630] 0 2024-09-13T02:54:16.661 INFO:tasks.workunit.client.1.smithi131.stdout:2/647: dread d5/d31/d4e/d78/da3/d41/f4a [0,4194304] 0 2024-09-13T02:54:16.661 INFO:tasks.workunit.client.1.smithi131.stdout:4/687: dwrite d1/d18/d43/d97/dba/d22/d49/f4d [0,4194304] 0 2024-09-13T02:54:16.670 INFO:tasks.workunit.client.1.smithi131.stdout:2/648: dread d5/d31/ff [0,4194304] 0 2024-09-13T02:54:16.670 INFO:tasks.workunit.client.1.smithi131.stdout:2/649: write d5/fa [4943306,73990] 0 2024-09-13T02:54:16.671 INFO:tasks.workunit.client.1.smithi131.stdout:2/650: link d5/d31/d1d/d32/d3b/d67/d87/db4/dbc/fae d5/d4f/fde 0 2024-09-13T02:54:16.672 INFO:tasks.workunit.client.1.smithi131.stdout:4/688: dread d1/d18/d43/d97/dba/fae [0,4194304] 0 2024-09-13T02:54:16.673 INFO:tasks.workunit.client.1.smithi131.stdout:4/689: mknod d1/d18/d43/d97/dba/d7a/dd3/cea 0 2024-09-13T02:54:16.675 INFO:tasks.workunit.client.1.smithi131.stdout:4/690: unlink d1/d18/d43/d97/fd5 0 2024-09-13T02:54:16.675 INFO:tasks.workunit.client.1.smithi131.stdout:4/691: creat d1/d18/d34/d62/d78/feb x:0 0 0 2024-09-13T02:54:16.677 INFO:tasks.workunit.client.1.smithi131.stdout:4/692: symlink d1/d18/d43/d97/dba/d7a/dc5/lec 0 2024-09-13T02:54:16.677 INFO:tasks.workunit.client.1.smithi131.stdout:4/693: readlink d1/d18/d43/d7d/l95 0 2024-09-13T02:54:16.677 INFO:tasks.workunit.client.1.smithi131.stdout:4/694: write d1/d18/d43/d97/dba/d22/d49/fc3 [631768,14500] 0 2024-09-13T02:54:16.677 INFO:tasks.workunit.client.1.smithi131.stdout:4/695: dread - d1/d18/d43/d97/dba/d22/d73/f7b zero size 2024-09-13T02:54:16.683 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:16 smithi131 ceph-mon[34689]: pgmap v250: 65 pgs: 65 active+clean; 3.2 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 218 MiB/s rd, 251 MiB/s wr, 372 op/s 2024-09-13T02:54:16.684 INFO:tasks.workunit.client.1.smithi131.stdout:4/696: rmdir d1/d18/d34/d62/d78 39 2024-09-13T02:54:16.684 INFO:tasks.workunit.client.1.smithi131.stdout:4/697: chown d1/d18/d34/d62/d78/c98 127699 1 2024-09-13T02:54:16.686 INFO:tasks.workunit.client.1.smithi131.stdout:4/698: dread d1/d18/d34/d62/f9c [0,4194304] 0 2024-09-13T02:54:16.687 INFO:tasks.workunit.client.1.smithi131.stdout:4/699: mkdir d1/d18/d34/d62/da3/ded 0 2024-09-13T02:54:16.688 INFO:tasks.workunit.client.1.smithi131.stdout:4/700: mkdir d1/d18/d43/d97/dba/d19/dee 0 2024-09-13T02:54:16.689 INFO:tasks.workunit.client.1.smithi131.stdout:4/701: truncate d1/d18/d43/d97/dba/d19/d29/f4a 2449758 0 2024-09-13T02:54:16.689 INFO:tasks.workunit.client.1.smithi131.stdout:4/702: creat d1/fef x:0 0 0 2024-09-13T02:54:16.692 INFO:tasks.workunit.client.1.smithi131.stdout:2/651: dwrite d5/d31/d21/f24 [0,4194304] 0 2024-09-13T02:54:16.695 INFO:tasks.workunit.client.1.smithi131.stdout:2/652: mkdir d5/d31/d1d/d32/d3b/d67/d87/db4/dbc/ddf 0 2024-09-13T02:54:16.698 INFO:tasks.workunit.client.1.smithi131.stdout:2/653: dread d5/d31/d21/fbe [0,4194304] 0 2024-09-13T02:54:16.698 INFO:tasks.workunit.client.1.smithi131.stdout:2/654: read d5/d31/d21/d57/d94/f9b [2731699,39212] 0 2024-09-13T02:54:16.700 INFO:tasks.workunit.client.1.smithi131.stdout:2/655: creat d5/d4f/fe0 x:0 0 0 2024-09-13T02:54:16.701 INFO:tasks.workunit.client.1.smithi131.stdout:4/703: dread d1/f45 [0,4194304] 0 2024-09-13T02:54:16.709 INFO:tasks.workunit.client.1.smithi131.stdout:9/528: sync 2024-09-13T02:54:16.719 INFO:tasks.workunit.client.1.smithi131.stdout:4/704: dwrite d1/d18/d43/d97/dba/d22/d49/f4d [4194304,4194304] 0 2024-09-13T02:54:16.721 INFO:tasks.workunit.client.1.smithi131.stdout:4/705: link d1/d18/d34/f5a d1/d18/ff0 0 2024-09-13T02:54:16.721 INFO:tasks.workunit.client.1.smithi131.stdout:4/706: dread - d1/d18/d34/fb5 zero size 2024-09-13T02:54:16.722 INFO:tasks.workunit.client.1.smithi131.stdout:4/707: dread d1/d18/f5c [0,4194304] 0 2024-09-13T02:54:16.723 INFO:tasks.workunit.client.1.smithi131.stdout:4/708: write d1/d18/f55 [19357,77402] 0 2024-09-13T02:54:16.724 INFO:tasks.workunit.client.1.smithi131.stdout:4/709: link d1/d18/d43/d97/dba/d22/d73/f87 d1/d18/d43/d65/dbd/dc1/ff1 0 2024-09-13T02:54:16.725 INFO:tasks.workunit.client.1.smithi131.stdout:4/710: rename d1/d18/d43/d65/dbd/dc1/f17 to d1/d18/d43/d65/dbd/dc1/ff2 0 2024-09-13T02:54:16.727 INFO:tasks.workunit.client.1.smithi131.stdout:4/711: rename d1/d18/d43/d65/dbd/dc1/d13/ld4 to d1/d18/d43/d97/dba/d7a/dc5/lf3 0 2024-09-13T02:54:16.728 INFO:tasks.workunit.client.1.smithi131.stdout:9/529: dwrite d0/d4d/fab [0,4194304] 0 2024-09-13T02:54:16.728 INFO:tasks.workunit.client.1.smithi131.stdout:4/712: unlink d1/d18/d43/d97/dba/d19/d29/d8d/dc9/fa0 0 2024-09-13T02:54:16.728 INFO:tasks.workunit.client.1.smithi131.stdout:4/713: creat d1/ff4 x:0 0 0 2024-09-13T02:54:16.728 INFO:tasks.workunit.client.1.smithi131.stdout:4/714: fdatasync d1/d18/d43/d97/dba/d22/d49/fc3 0 2024-09-13T02:54:16.730 INFO:tasks.workunit.client.1.smithi131.stdout:9/530: mknod d0/d4d/caf 0 2024-09-13T02:54:16.733 INFO:tasks.workunit.client.1.smithi131.stdout:9/531: getdents d0/d3/d14/d1a/d2a/d5e/da2/d39 0 2024-09-13T02:54:16.733 INFO:tasks.workunit.client.1.smithi131.stdout:9/532: read d0/f90 [2612,17029] 0 2024-09-13T02:54:16.743 INFO:tasks.workunit.client.1.smithi131.stdout:9/533: dread d0/d3/d14/f34 [4194304,4194304] 0 2024-09-13T02:54:16.744 INFO:tasks.workunit.client.1.smithi131.stdout:4/715: dwrite d1/d18/d43/d97/dba/d7a/dd3/fe7 [0,4194304] 0 2024-09-13T02:54:16.755 INFO:tasks.workunit.client.1.smithi131.stdout:9/534: write d0/f9 [3607349,53589] 0 2024-09-13T02:54:16.756 INFO:tasks.workunit.client.1.smithi131.stdout:9/535: mkdir d0/d3/d14/d17/db0 0 2024-09-13T02:54:16.756 INFO:tasks.workunit.client.1.smithi131.stdout:9/536: write d0/d3/d14/d3c/f77 [946565,127609] 0 2024-09-13T02:54:16.757 INFO:tasks.workunit.client.1.smithi131.stdout:9/537: truncate d0/d3/d14/d1a/d2a/d5e/da2/f59 3380236 0 2024-09-13T02:54:16.757 INFO:tasks.workunit.client.1.smithi131.stdout:9/538: symlink d0/d3/d14/lb1 0 2024-09-13T02:54:16.757 INFO:tasks.workunit.client.1.smithi131.stdout:9/539: write d0/d3/d14/d1a/d2a/d5e/da2/d39/f4a [8263137,109362] 0 2024-09-13T02:54:16.759 INFO:tasks.workunit.client.1.smithi131.stdout:9/540: link d0/d3/d14/d3c/f69 d0/d3/d14/d1a/d2a/fb2 0 2024-09-13T02:54:16.759 INFO:tasks.workunit.client.1.smithi131.stdout:9/541: mkdir d0/d3f/db3 0 2024-09-13T02:54:16.765 INFO:tasks.workunit.client.1.smithi131.stdout:4/716: dwrite d1/d18/d43/d97/dba/d22/d73/f87 [0,4194304] 0 2024-09-13T02:54:16.765 INFO:tasks.workunit.client.1.smithi131.stdout:4/717: write d1/d18/d43/d65/dbd/dc1/f2f [277106,124609] 0 2024-09-13T02:54:16.766 INFO:tasks.workunit.client.1.smithi131.stdout:4/718: dread - d1/d18/d43/d97/dba/d19/d29/d8d/fe2 zero size 2024-09-13T02:54:16.766 INFO:tasks.workunit.client.1.smithi131.stdout:4/719: write d1/d18/d81/f8a [875138,43334] 0 2024-09-13T02:54:16.767 INFO:tasks.workunit.client.1.smithi131.stdout:4/720: symlink d1/d18/d43/d65/dbd/dc1/d13/lf5 0 2024-09-13T02:54:16.767 INFO:tasks.workunit.client.1.smithi131.stdout:4/721: readlink d1/d18/d43/d97/dba/d19/d29/l3c 0 2024-09-13T02:54:16.767 INFO:tasks.workunit.client.1.smithi131.stdout:4/722: creat d1/d18/d34/d4e/ff6 x:0 0 0 2024-09-13T02:54:16.767 INFO:tasks.workunit.client.1.smithi131.stdout:4/723: truncate d1/d18/d34/d62/d78/feb 2998 0 2024-09-13T02:54:16.767 INFO:tasks.workunit.client.1.smithi131.stdout:4/724: write d1/d18/f55 [266732,17129] 0 2024-09-13T02:54:16.767 INFO:tasks.workunit.client.1.smithi131.stdout:4/725: write d1/d18/d43/d97/dba/d7a/fc4 [860464,30511] 0 2024-09-13T02:54:16.767 INFO:tasks.workunit.client.1.smithi131.stdout:4/726: chown d1/d18/d34/d62/f9c 2 1 2024-09-13T02:54:16.768 INFO:tasks.workunit.client.1.smithi131.stdout:4/727: read - d1/d18/d34/d62/da3/da6/fc0 zero size 2024-09-13T02:54:16.768 INFO:tasks.workunit.client.1.smithi131.stdout:4/728: chown d1/d18/d81/ldb 3 1 2024-09-13T02:54:16.768 INFO:tasks.workunit.client.1.smithi131.stdout:4/729: getdents d1/d18/d43/dd9 0 2024-09-13T02:54:16.783 INFO:tasks.workunit.client.1.smithi131.stdout:9/542: dwrite d0/d3/d14/d1a/d2a/d5e/f8c [0,4194304] 0 2024-09-13T02:54:16.786 INFO:tasks.workunit.client.1.smithi131.stdout:9/543: truncate d0/d3/d14/d1a/d2a/d5e/f83 3093654 0 2024-09-13T02:54:16.803 INFO:tasks.workunit.client.1.smithi131.stdout:9/544: dwrite d0/f33 [0,4194304] 0 2024-09-13T02:54:16.803 INFO:tasks.workunit.client.1.smithi131.stdout:9/545: creat d0/d3/d14/fb4 x:0 0 0 2024-09-13T02:54:16.815 INFO:tasks.workunit.client.1.smithi131.stdout:9/546: dwrite d0/d4d/f9d [0,4194304] 0 2024-09-13T02:54:16.818 INFO:tasks.workunit.client.1.smithi131.stdout:9/547: symlink d0/d3/d14/d1a/d2a/d5e/lb5 0 2024-09-13T02:54:16.818 INFO:tasks.workunit.client.1.smithi131.stdout:9/548: stat d0/d3/d14/d1a/d2a/f62 0 2024-09-13T02:54:16.818 INFO:tasks.workunit.client.1.smithi131.stdout:9/549: chown d0/d3/d14/d1a/d2a/d5e/da2/f53 0 1 2024-09-13T02:54:16.818 INFO:tasks.workunit.client.1.smithi131.stdout:9/550: fdatasync d0/f11 0 2024-09-13T02:54:16.819 INFO:tasks.workunit.client.1.smithi131.stdout:9/551: mkdir d0/d3/d14/d1a/d2a/d5e/da2/d39/dae/db6 0 2024-09-13T02:54:16.819 INFO:tasks.workunit.client.1.smithi131.stdout:9/552: creat d0/d3f/fb7 x:0 0 0 2024-09-13T02:54:16.819 INFO:tasks.workunit.client.1.smithi131.stdout:9/553: fsync d0/d3/f5b 0 2024-09-13T02:54:16.821 INFO:tasks.workunit.client.1.smithi131.stdout:9/554: dread d0/d3/d14/d3c/f77 [0,4194304] 0 2024-09-13T02:54:16.821 INFO:tasks.workunit.client.1.smithi131.stdout:9/555: symlink d0/d3/d14/lb8 0 2024-09-13T02:54:16.823 INFO:tasks.workunit.client.1.smithi131.stdout:9/556: truncate d0/d3/d14/d17/f31 1434025 0 2024-09-13T02:54:16.823 INFO:tasks.workunit.client.1.smithi131.stdout:9/557: creat d0/d3/d14/fb9 x:0 0 0 2024-09-13T02:54:16.824 INFO:tasks.workunit.client.1.smithi131.stdout:9/558: truncate d0/d3/d14/d1a/d2a/d5e/da2/d39/f4a 1546222 0 2024-09-13T02:54:16.824 INFO:tasks.workunit.client.1.smithi131.stdout:9/559: stat d0/d3/d14/d1a/d2a/f7d 0 2024-09-13T02:54:16.825 INFO:tasks.workunit.client.1.smithi131.stdout:9/560: mkdir d0/d3/d14/d95/dba 0 2024-09-13T02:54:16.834 INFO:tasks.workunit.client.1.smithi131.stdout:9/561: dread d0/d3/d14/d1a/d2a/d5e/f83 [0,4194304] 0 2024-09-13T02:54:16.834 INFO:tasks.workunit.client.1.smithi131.stdout:9/562: write d0/d3/d14/d1a/d2a/f62 [481809,66826] 0 2024-09-13T02:54:16.838 INFO:tasks.workunit.client.1.smithi131.stdout:9/563: read d0/d3/d14/d1a/d2a/f7d [549444,13913] 0 2024-09-13T02:54:16.839 INFO:tasks.workunit.client.1.smithi131.stdout:9/564: mkdir d0/d4d/d98/dbb 0 2024-09-13T02:54:16.840 INFO:tasks.workunit.client.1.smithi131.stdout:9/565: mkdir d0/d3/d14/d1a/dbc 0 2024-09-13T02:54:16.840 INFO:tasks.workunit.client.1.smithi131.stdout:9/566: write d0/d3/d14/d1a/d2a/d5e/da2/d39/f9e [909831,88794] 0 2024-09-13T02:54:16.840 INFO:tasks.workunit.client.1.smithi131.stdout:9/567: readlink d0/d3/d14/d1a/d2a/d5e/da2/laa 0 2024-09-13T02:54:16.840 INFO:tasks.workunit.client.1.smithi131.stdout:9/568: chown d0/d4d/caf 24248204 1 2024-09-13T02:54:16.845 INFO:tasks.workunit.client.1.smithi131.stdout:3/535: sync 2024-09-13T02:54:16.846 INFO:tasks.workunit.client.1.smithi131.stdout:6/674: sync 2024-09-13T02:54:16.846 INFO:tasks.workunit.client.1.smithi131.stdout:7/578: sync 2024-09-13T02:54:16.846 INFO:tasks.workunit.client.1.smithi131.stdout:1/599: sync 2024-09-13T02:54:16.846 INFO:tasks.workunit.client.1.smithi131.stdout:8/604: sync 2024-09-13T02:54:16.846 INFO:tasks.workunit.client.1.smithi131.stdout:6/675: truncate d1/f6e 771548 0 2024-09-13T02:54:16.846 INFO:tasks.workunit.client.1.smithi131.stdout:0/754: sync 2024-09-13T02:54:16.846 INFO:tasks.workunit.client.1.smithi131.stdout:5/511: sync 2024-09-13T02:54:16.846 INFO:tasks.workunit.client.1.smithi131.stdout:5/512: chown d1/d1c/d8e/f48 10990 1 2024-09-13T02:54:16.849 INFO:tasks.workunit.client.1.smithi131.stdout:3/536: unlink d2/d4/d76/d9f/fa6 0 2024-09-13T02:54:16.849 INFO:tasks.workunit.client.1.smithi131.stdout:3/537: fdatasync d2/d4/f28 0 2024-09-13T02:54:16.849 INFO:tasks.workunit.client.1.smithi131.stdout:3/538: truncate d2/d4/d7/f4d 982228 0 2024-09-13T02:54:16.850 INFO:tasks.workunit.client.1.smithi131.stdout:7/579: creat d1b/d23/d54/dc6/fc7 x:0 0 0 2024-09-13T02:54:16.851 INFO:tasks.workunit.client.1.smithi131.stdout:8/605: creat db/d1d/d1f/fbe x:0 0 0 2024-09-13T02:54:16.852 INFO:tasks.workunit.client.1.smithi131.stdout:3/539: mkdir d2/d4/d7/db8 0 2024-09-13T02:54:16.854 INFO:tasks.workunit.client.1.smithi131.stdout:3/540: dread d2/d4/d76/d9f/d41/d5c/f4e [0,4194304] 0 2024-09-13T02:54:16.854 INFO:tasks.workunit.client.1.smithi131.stdout:3/541: fsync d2/d4/d7/d1d/d24/d6f/f70 0 2024-09-13T02:54:16.855 INFO:tasks.workunit.client.1.smithi131.stdout:7/580: dread d1b/d3b/d31/d38/fbf [0,4194304] 0 2024-09-13T02:54:16.855 INFO:tasks.workunit.client.1.smithi131.stdout:8/606: rename db/d1d/d1f/d66/f94 to db/d2b/d39/d56/fbf 0 2024-09-13T02:54:16.856 INFO:tasks.workunit.client.1.smithi131.stdout:5/513: link d1/d5/c1a d1/d9c/cad 0 2024-09-13T02:54:16.857 INFO:tasks.workunit.client.1.smithi131.stdout:3/542: mkdir d2/d4/d76/d9f/db9 0 2024-09-13T02:54:16.857 INFO:tasks.workunit.client.1.smithi131.stdout:7/581: mknod d1b/d23/d89/db4/cc8 0 2024-09-13T02:54:16.858 INFO:tasks.workunit.client.1.smithi131.stdout:5/514: mknod d1/d21/d74/cae 0 2024-09-13T02:54:16.859 INFO:tasks.workunit.client.1.smithi131.stdout:5/515: getdents d1/d21/d90 0 2024-09-13T02:54:16.859 INFO:tasks.workunit.client.1.smithi131.stdout:5/516: fdatasync d1/d2f/d33/f92 0 2024-09-13T02:54:16.859 INFO:tasks.workunit.client.1.smithi131.stdout:5/517: creat d1/d21/d74/faf x:0 0 0 2024-09-13T02:54:16.859 INFO:tasks.workunit.client.1.smithi131.stdout:7/582: truncate d1b/d3b/d51/d62/d9e/fa9 1807991 0 2024-09-13T02:54:16.860 INFO:tasks.workunit.client.1.smithi131.stdout:6/676: write d1/d8/d9/db/d15/d26/d1c/d79/d92/dc6/fcb [2718151,92945] 0 2024-09-13T02:54:16.860 INFO:tasks.workunit.client.1.smithi131.stdout:6/677: chown d1/d8/d9/l9a 1 1 2024-09-13T02:54:16.860 INFO:tasks.workunit.client.1.smithi131.stdout:6/678: write d1/d8/d9/db/fad [621520,124042] 0 2024-09-13T02:54:16.862 INFO:tasks.workunit.client.1.smithi131.stdout:5/518: creat d1/d21/d74/d78/fb0 x:0 0 0 2024-09-13T02:54:16.862 INFO:tasks.workunit.client.1.smithi131.stdout:3/543: unlink d2/d4/d1a/l20 0 2024-09-13T02:54:16.862 INFO:tasks.workunit.client.1.smithi131.stdout:3/544: fdatasync d2/dc/d39/f72 0 2024-09-13T02:54:16.862 INFO:tasks.workunit.client.1.smithi131.stdout:3/545: write d2/d4/d2d/d92/f90 [758065,35644] 0 2024-09-13T02:54:16.863 INFO:tasks.workunit.client.1.smithi131.stdout:7/583: rename d1b/c25 to d1b/d3b/d31/d38/cc9 0 2024-09-13T02:54:16.865 INFO:tasks.workunit.client.1.smithi131.stdout:7/584: read d1b/d3b/d46/d4b/d57/d7b/d92/f96 [718689,62368] 0 2024-09-13T02:54:16.865 INFO:tasks.workunit.client.1.smithi131.stdout:9/569: dwrite d0/d3/d14/d17/f21 [0,4194304] 0 2024-09-13T02:54:16.870 INFO:tasks.workunit.client.1.smithi131.stdout:1/600: dwrite dd/d33/d94/fd7 [0,4194304] 0 2024-09-13T02:54:16.870 INFO:tasks.workunit.client.1.smithi131.stdout:1/601: write dd/d26/d2a/d69/fa7 [733262,79736] 0 2024-09-13T02:54:16.870 INFO:tasks.workunit.client.1.smithi131.stdout:7/585: dread d1b/d3b/f6b [0,4194304] 0 2024-09-13T02:54:16.871 INFO:tasks.workunit.client.1.smithi131.stdout:7/586: read - d1b/d3b/d31/fc5 zero size 2024-09-13T02:54:16.876 INFO:tasks.workunit.client.1.smithi131.stdout:1/602: rmdir dd/d51/d5a 39 2024-09-13T02:54:16.878 INFO:tasks.workunit.client.1.smithi131.stdout:3/546: dread d2/d4/d7/d1d/d24/d6f/f89 [4194304,4194304] 0 2024-09-13T02:54:16.880 INFO:tasks.workunit.client.1.smithi131.stdout:1/603: creat dd/d51/d8a/fe1 x:0 0 0 2024-09-13T02:54:16.880 INFO:tasks.workunit.client.1.smithi131.stdout:1/604: read - dd/d33/d42/d6f/f71 zero size 2024-09-13T02:54:16.880 INFO:tasks.workunit.client.1.smithi131.stdout:1/605: creat dd/d26/d2a/d69/fe2 x:0 0 0 2024-09-13T02:54:16.880 INFO:tasks.workunit.client.1.smithi131.stdout:3/547: stat d2/dc/f1b 0 2024-09-13T02:54:16.880 INFO:tasks.workunit.client.1.smithi131.stdout:3/548: chown d2/d4/l82 22 1 2024-09-13T02:54:16.883 INFO:tasks.workunit.client.1.smithi131.stdout:1/606: creat dd/d26/d2a/fe3 x:0 0 0 2024-09-13T02:54:16.885 INFO:tasks.workunit.client.1.smithi131.stdout:1/607: truncate dd/d51/d8a/fcc 977591 0 2024-09-13T02:54:16.887 INFO:tasks.workunit.client.1.smithi131.stdout:8/607: dwrite db/f18 [0,4194304] 0 2024-09-13T02:54:16.887 INFO:tasks.workunit.client.1.smithi131.stdout:8/608: fdatasync db/fa9 0 2024-09-13T02:54:16.887 INFO:tasks.workunit.client.1.smithi131.stdout:1/608: rmdir dd/d51/d8a/db8 0 2024-09-13T02:54:16.892 INFO:tasks.workunit.client.1.smithi131.stdout:3/549: dread d2/d4/d7/d1d/f2e [0,4194304] 0 2024-09-13T02:54:16.892 INFO:tasks.workunit.client.1.smithi131.stdout:3/550: chown d2/d4/d76/d9f/d41/d6e/la2 400 1 2024-09-13T02:54:16.893 INFO:tasks.workunit.client.1.smithi131.stdout:3/551: symlink d2/d4/db7/lba 0 2024-09-13T02:54:16.901 INFO:tasks.workunit.client.1.smithi131.stdout:5/519: dwrite d1/d2f/d33/f89 [0,4194304] 0 2024-09-13T02:54:16.901 INFO:tasks.workunit.client.1.smithi131.stdout:5/520: fdatasync d1/d5/f3a 0 2024-09-13T02:54:16.902 INFO:tasks.workunit.client.1.smithi131.stdout:9/570: dwrite d0/f9 [0,4194304] 0 2024-09-13T02:54:16.902 INFO:tasks.workunit.client.1.smithi131.stdout:9/571: creat d0/d3/d14/fbd x:0 0 0 2024-09-13T02:54:16.903 INFO:tasks.workunit.client.1.smithi131.stdout:5/521: stat d1/d29/d39/c70 0 2024-09-13T02:54:16.903 INFO:tasks.workunit.client.1.smithi131.stdout:3/552: dread d2/d4/d76/d9f/d41/d5c/d49/fa5 [0,4194304] 0 2024-09-13T02:54:16.903 INFO:tasks.workunit.client.1.smithi131.stdout:6/679: dwrite d1/d8/d9/db/d15/dc2/f88 [0,4194304] 0 2024-09-13T02:54:16.904 INFO:tasks.workunit.client.1.smithi131.stdout:6/680: stat d1/d8/d9/db/d40/f47 0 2024-09-13T02:54:16.904 INFO:tasks.workunit.client.1.smithi131.stdout:3/553: dread - d2/d4/d7/d1d/d24/d96/f98 zero size 2024-09-13T02:54:16.907 INFO:tasks.workunit.client.1.smithi131.stdout:6/681: creat d1/d8/d9/db/d15/d26/fe2 x:0 0 0 2024-09-13T02:54:16.907 INFO:tasks.workunit.client.1.smithi131.stdout:6/682: chown d1/d8/d9/db/l45 17919 1 2024-09-13T02:54:16.908 INFO:tasks.workunit.client.1.smithi131.stdout:3/554: mknod d2/d4/d7/d1d/d24/cbb 0 2024-09-13T02:54:16.909 INFO:tasks.workunit.client.1.smithi131.stdout:5/522: symlink d1/d50/lb1 0 2024-09-13T02:54:16.911 INFO:tasks.workunit.client.1.smithi131.stdout:5/523: mknod d1/d1c/cb2 0 2024-09-13T02:54:16.913 INFO:tasks.workunit.client.1.smithi131.stdout:5/524: symlink d1/d21/d74/d78/lb3 0 2024-09-13T02:54:16.914 INFO:tasks.workunit.client.1.smithi131.stdout:9/572: dread d0/d4d/d55/f61 [0,4194304] 0 2024-09-13T02:54:16.914 INFO:tasks.workunit.client.1.smithi131.stdout:9/573: truncate d0/d4d/d55/d76/fa7 923383 0 2024-09-13T02:54:16.914 INFO:tasks.workunit.client.1.smithi131.stdout:9/574: stat d0/d3f/db3 0 2024-09-13T02:54:16.915 INFO:tasks.workunit.client.1.smithi131.stdout:5/525: unlink d1/d1c/f3b 0 2024-09-13T02:54:16.915 INFO:tasks.workunit.client.1.smithi131.stdout:9/575: mkdir d0/d3/d14/d1a/d2a/d5e/da2/d39/dbe 0 2024-09-13T02:54:16.917 INFO:tasks.workunit.client.1.smithi131.stdout:9/576: truncate d0/d3/d14/d1a/d2a/d5e/da2/d39/f4a 674562 0 2024-09-13T02:54:16.918 INFO:tasks.workunit.client.1.smithi131.stdout:9/577: mkdir d0/d3/d14/dbf 0 2024-09-13T02:54:16.924 INFO:tasks.workunit.client.1.smithi131.stdout:5/526: dread d1/d50/f93 [0,4194304] 0 2024-09-13T02:54:16.925 INFO:tasks.workunit.client.1.smithi131.stdout:5/527: truncate d1/d21/d74/f80 905236 0 2024-09-13T02:54:16.927 INFO:tasks.workunit.client.1.smithi131.stdout:5/528: creat d1/d29/d3e/fb4 x:0 0 0 2024-09-13T02:54:16.932 INFO:tasks.workunit.client.1.smithi131.stdout:9/578: dread d0/d3/d14/d1a/d2a/d5e/da2/f99 [0,4194304] 0 2024-09-13T02:54:16.932 INFO:tasks.workunit.client.1.smithi131.stdout:9/579: chown d0/d3/d14/d1a/f23 25375311 1 2024-09-13T02:54:16.933 INFO:tasks.workunit.client.1.smithi131.stdout:9/580: mkdir d0/d3/d14/d67/dc0 0 2024-09-13T02:54:16.934 INFO:tasks.workunit.client.1.smithi131.stdout:9/581: mknod d0/d3/d14/d1a/d2a/cc1 0 2024-09-13T02:54:16.934 INFO:tasks.workunit.client.1.smithi131.stdout:9/582: write d0/d4d/d55/f61 [5085748,52286] 0 2024-09-13T02:54:16.934 INFO:tasks.workunit.client.1.smithi131.stdout:9/583: dread - d0/d3/d14/d1a/d2a/d5e/da2/f53 zero size 2024-09-13T02:54:16.934 INFO:tasks.workunit.client.1.smithi131.stdout:3/555: dwrite d2/d4/d7/d1d/f21 [0,4194304] 0 2024-09-13T02:54:16.935 INFO:tasks.workunit.client.1.smithi131.stdout:9/584: truncate d0/d3/d14/d1a/f23 1760306 0 2024-09-13T02:54:16.936 INFO:tasks.workunit.client.1.smithi131.stdout:9/585: read d0/d3/d14/d1a/d2a/d5e/da2/f6a [711126,61573] 0 2024-09-13T02:54:16.953 INFO:tasks.workunit.client.1.smithi131.stdout:9/586: dwrite d0/d3/d14/d1a/d2a/d5e/da2/f6a [0,4194304] 0 2024-09-13T02:54:16.957 INFO:tasks.workunit.client.1.smithi131.stdout:9/587: dread d0/d3/d14/d1a/d2a/d5e/da2/d39/f9e [0,4194304] 0 2024-09-13T02:54:16.962 INFO:tasks.workunit.client.1.smithi131.stdout:9/588: dread d0/d3/d14/d1a/d2a/d5e/da2/f99 [0,4194304] 0 2024-09-13T02:54:16.969 INFO:tasks.workunit.client.1.smithi131.stdout:9/589: dread d0/f11 [0,4194304] 0 2024-09-13T02:54:16.969 INFO:tasks.workunit.client.1.smithi131.stdout:9/590: getdents d0/d3/d14/d67/dc0 0 2024-09-13T02:54:16.969 INFO:tasks.workunit.client.1.smithi131.stdout:9/591: chown d0/d4d/d98 300855553 1 2024-09-13T02:54:16.969 INFO:tasks.workunit.client.1.smithi131.stdout:9/592: stat d0/d3/d14/d95 0 2024-09-13T02:54:16.969 INFO:tasks.workunit.client.1.smithi131.stdout:9/593: write d0/d3/d14/d1a/d2a/f7d [506485,69436] 0 2024-09-13T02:54:16.969 INFO:tasks.workunit.client.1.smithi131.stdout:9/594: fdatasync d0/f63 0 2024-09-13T02:54:16.969 INFO:tasks.workunit.client.1.smithi131.stdout:9/595: truncate d0/d3/d14/d1a/d2a/d5e/f83 3539614 0 2024-09-13T02:54:16.970 INFO:tasks.workunit.client.1.smithi131.stdout:9/596: mkdir d0/d3/d14/d1a/d2a/d5e/da2/d39/dc2 0 2024-09-13T02:54:16.971 INFO:tasks.workunit.client.1.smithi131.stdout:9/597: mknod d0/d4d/d55/d76/d96/cc3 0 2024-09-13T02:54:16.971 INFO:tasks.workunit.client.1.smithi131.stdout:9/598: write d0/d3/d14/d95/fa8 [325961,34255] 0 2024-09-13T02:54:16.971 INFO:tasks.workunit.client.1.smithi131.stdout:9/599: fdatasync d0/f90 0 2024-09-13T02:54:16.971 INFO:tasks.workunit.client.1.smithi131.stdout:9/600: stat d0/d3/d14/l54 0 2024-09-13T02:54:17.004 INFO:tasks.workunit.client.1.smithi131.stdout:2/656: sync 2024-09-13T02:54:17.009 INFO:tasks.workunit.client.1.smithi131.stdout:2/657: write d5/d31/d1d/d32/f5e [7163871,29900] 0 2024-09-13T02:54:17.010 INFO:tasks.workunit.client.1.smithi131.stdout:2/658: symlink d5/d6e/le1 0 2024-09-13T02:54:17.010 INFO:tasks.workunit.client.1.smithi131.stdout:2/659: write d5/d31/d1d/d32/d3b/d67/d87/db4/dbc/d48/d4c/db1/fc5 [591999,29872] 0 2024-09-13T02:54:17.011 INFO:tasks.workunit.client.1.smithi131.stdout:2/660: mkdir d5/d31/d1d/d32/d7d/de2 0 2024-09-13T02:54:17.037 INFO:tasks.workunit.client.1.smithi131.stdout:2/661: dwrite d5/d31/d1d/d32/d3b/d67/d87/db4/dbc/f98 [0,4194304] 0 2024-09-13T02:54:17.046 INFO:tasks.workunit.client.1.smithi131.stdout:2/662: dread d5/d31/d21/f2b [0,4194304] 0 2024-09-13T02:54:17.063 INFO:tasks.workunit.client.1.smithi131.stdout:2/663: dwrite d5/f28 [0,4194304] 0 2024-09-13T02:54:17.260 INFO:tasks.workunit.client.1.smithi131.stdout:4/730: sync 2024-09-13T02:54:17.260 INFO:tasks.workunit.client.1.smithi131.stdout:4/731: chown d1/d18/d43/d65/dbd/dc1/ff1 0 1 2024-09-13T02:54:17.269 INFO:tasks.workunit.client.1.smithi131.stdout:4/732: write d1/d18/d43/d97/dba/d22/d49/f4d [7102312,27580] 0 2024-09-13T02:54:17.270 INFO:tasks.workunit.client.1.smithi131.stdout:4/733: rename d1/d18/d81/l91 to d1/d18/d43/d65/dbd/lf7 0 2024-09-13T02:54:17.270 INFO:tasks.workunit.client.1.smithi131.stdout:4/734: readlink d1/d18/d43/d65/dbd/dc1/lad 0 2024-09-13T02:54:17.271 INFO:tasks.workunit.client.1.smithi131.stdout:4/735: mkdir d1/d18/d34/df8 0 2024-09-13T02:54:17.271 INFO:tasks.workunit.client.1.smithi131.stdout:4/736: write d1/d18/d43/d7d/fe6 [207320,23593] 0 2024-09-13T02:54:17.272 INFO:tasks.workunit.client.1.smithi131.stdout:4/737: rmdir d1/d18/d43/d97/dba/d7a/dd3 39 2024-09-13T02:54:17.284 INFO:tasks.workunit.client.1.smithi131.stdout:4/738: dwrite d1/d18/d34/d62/f9c [0,4194304] 0 2024-09-13T02:54:17.285 INFO:tasks.workunit.client.1.smithi131.stdout:4/739: creat d1/d18/d43/d97/dba/d22/d73/ff9 x:0 0 0 2024-09-13T02:54:17.286 INFO:tasks.workunit.client.1.smithi131.stdout:4/740: rename d1/d18/d43/d7d/l95 to d1/d18/d43/d65/dbd/dc1/d13/lfa 0 2024-09-13T02:54:17.418 INFO:tasks.workunit.client.1.smithi131.stdout:0/755: sync 2024-09-13T02:54:17.524 INFO:tasks.workunit.client.1.smithi131.stdout:0/756: creat d0/de/d1f/d22/d31/d39/da8/d103/f106 x:0 0 0 2024-09-13T02:54:17.524 INFO:tasks.workunit.client.1.smithi131.stdout:0/757: write d0/d2/d41/fc4 [940914,90688] 0 2024-09-13T02:54:17.524 INFO:tasks.workunit.client.1.smithi131.stdout:0/758: fsync d0/de/d1f/d22/d31/d39/d67/db5/f102 0 2024-09-13T02:54:17.524 INFO:tasks.workunit.client.1.smithi131.stdout:0/759: mkdir d0/de/d1f/d22/d31/d39/da8/d107 0 2024-09-13T02:54:17.524 INFO:tasks.workunit.client.1.smithi131.stdout:0/760: dwrite d0/de/f47 [4194304,4194304] 0 2024-09-13T02:54:17.524 INFO:tasks.workunit.client.1.smithi131.stdout:0/761: symlink d0/de/d1f/d22/d31/d39/da8/l108 0 2024-09-13T02:54:17.525 INFO:tasks.workunit.client.1.smithi131.stdout:0/762: dwrite d0/de/f59 [0,4194304] 0 2024-09-13T02:54:17.525 INFO:tasks.workunit.client.1.smithi131.stdout:0/763: read - d0/de/d1f/d22/d31/d39/d40/fd5 zero size 2024-09-13T02:54:17.525 INFO:tasks.workunit.client.1.smithi131.stdout:0/764: link d0/de/d1f/d22/d31/d39/da8/d103/f106 d0/de/d1f/d22/d3d/d55/f109 0 2024-09-13T02:54:17.525 INFO:tasks.workunit.client.1.smithi131.stdout:0/765: write d0/de/d1f/d22/d3d/d43/fd8 [609109,121669] 0 2024-09-13T02:54:17.525 INFO:tasks.workunit.client.1.smithi131.stdout:7/587: sync 2024-09-13T02:54:17.525 INFO:tasks.workunit.client.1.smithi131.stdout:8/609: sync 2024-09-13T02:54:17.525 INFO:tasks.workunit.client.1.smithi131.stdout:7/588: creat d1b/d3b/d51/d8b/fca x:0 0 0 2024-09-13T02:54:17.525 INFO:tasks.workunit.client.1.smithi131.stdout:0/766: dwrite d0/d2/d41/f79 [0,4194304] 0 2024-09-13T02:54:17.525 INFO:tasks.workunit.client.1.smithi131.stdout:0/767: creat d0/de/d1f/d22/d3d/d43/f10a x:0 0 0 2024-09-13T02:54:17.525 INFO:tasks.workunit.client.1.smithi131.stdout:8/610: mkdir db/d1d/d1f/d66/dc0 0 2024-09-13T02:54:17.525 INFO:tasks.workunit.client.1.smithi131.stdout:7/589: mkdir d1b/d3b/d31/dcb 0 2024-09-13T02:54:17.525 INFO:tasks.workunit.client.1.smithi131.stdout:1/609: sync 2024-09-13T02:54:17.525 INFO:tasks.workunit.client.1.smithi131.stdout:3/556: sync 2024-09-13T02:54:17.526 INFO:tasks.workunit.client.1.smithi131.stdout:4/741: sync 2024-09-13T02:54:17.526 INFO:tasks.workunit.client.1.smithi131.stdout:3/557: chown d2/d4/d7/d1d/d24/fb0 104632666 1 2024-09-13T02:54:17.526 INFO:tasks.workunit.client.1.smithi131.stdout:2/664: sync 2024-09-13T02:54:17.526 INFO:tasks.workunit.client.1.smithi131.stdout:2/665: fsync d5/d31/d1d/d32/d3b/fd2 0 2024-09-13T02:54:17.526 INFO:tasks.workunit.client.1.smithi131.stdout:5/529: sync 2024-09-13T02:54:17.526 INFO:tasks.workunit.client.1.smithi131.stdout:9/601: sync 2024-09-13T02:54:17.526 INFO:tasks.workunit.client.1.smithi131.stdout:6/683: sync 2024-09-13T02:54:17.526 INFO:tasks.workunit.client.1.smithi131.stdout:6/684: chown d1/d8/d9/db/d40/f47 21110527 1 2024-09-13T02:54:17.526 INFO:tasks.workunit.client.1.smithi131.stdout:8/611: dread db/d2e/d40/f53 [0,4194304] 0 2024-09-13T02:54:17.526 INFO:tasks.workunit.client.1.smithi131.stdout:4/742: rename d1/d18/d43/f47 to d1/d18/d34/d62/d78/ffb 0 2024-09-13T02:54:17.526 INFO:tasks.workunit.client.1.smithi131.stdout:6/685: mkdir d1/d8/d9/db/d15/d26/dbd/ddf/de3 0 2024-09-13T02:54:17.527 INFO:tasks.workunit.client.1.smithi131.stdout:0/768: dread d0/de/d45/d86/de8/f5b [0,4194304] 0 2024-09-13T02:54:17.527 INFO:tasks.workunit.client.1.smithi131.stdout:2/666: rename d5/d31/d4e/d78/da3 to d5/d18/d68/de3 0 2024-09-13T02:54:17.527 INFO:tasks.workunit.client.1.smithi131.stdout:6/686: truncate d1/d14/f20 3868930 0 2024-09-13T02:54:17.527 INFO:tasks.workunit.client.1.smithi131.stdout:0/769: rmdir d0/de/d45/d78 39 2024-09-13T02:54:17.527 INFO:tasks.workunit.client.1.smithi131.stdout:6/687: creat d1/fe4 x:0 0 0 2024-09-13T02:54:17.527 INFO:tasks.workunit.client.1.smithi131.stdout:1/610: dread dd/d26/d44/f3b [0,4194304] 0 2024-09-13T02:54:17.527 INFO:tasks.workunit.client.1.smithi131.stdout:0/770: mkdir d0/de/d1f/d22/d31/d39/d67/db5/dc9/d10b 0 2024-09-13T02:54:17.527 INFO:tasks.workunit.client.1.smithi131.stdout:8/612: dread db/d1d/d34/d4e/f99 [0,4194304] 0 2024-09-13T02:54:17.527 INFO:tasks.workunit.client.1.smithi131.stdout:9/602: write d0/f33 [2730363,91563] 0 2024-09-13T02:54:17.527 INFO:tasks.workunit.client.1.smithi131.stdout:1/611: mknod dd/d33/ce4 0 2024-09-13T02:54:17.527 INFO:tasks.workunit.client.1.smithi131.stdout:1/612: chown dd/d26/d2a/d69/fe2 361933 1 2024-09-13T02:54:17.528 INFO:tasks.workunit.client.1.smithi131.stdout:1/613: fsync dd/dc2/f9b 0 2024-09-13T02:54:17.528 INFO:tasks.workunit.client.1.smithi131.stdout:9/603: creat d0/d4d/d98/fc4 x:0 0 0 2024-09-13T02:54:17.528 INFO:tasks.workunit.client.1.smithi131.stdout:9/604: write d0/d3/d14/d1a/d2a/f7d [2528775,53997] 0 2024-09-13T02:54:17.528 INFO:tasks.workunit.client.1.smithi131.stdout:9/605: write d0/d3/d14/d1a/d2a/d5e/da2/d39/f9e [1390037,59315] 0 2024-09-13T02:54:17.528 INFO:tasks.workunit.client.1.smithi131.stdout:1/614: rename dd/d26/d2a/d2c/f6b to dd/fe5 0 2024-09-13T02:54:17.528 INFO:tasks.workunit.client.1.smithi131.stdout:1/615: creat dd/d26/d2a/d69/fe6 x:0 0 0 2024-09-13T02:54:17.528 INFO:tasks.workunit.client.1.smithi131.stdout:1/616: fdatasync dd/f13 0 2024-09-13T02:54:17.528 INFO:tasks.workunit.client.1.smithi131.stdout:7/590: dwrite d1b/d3b/d51/d62/d9e/da2/fb3 [0,4194304] 0 2024-09-13T02:54:17.528 INFO:tasks.workunit.client.1.smithi131.stdout:9/606: creat d0/fc5 x:0 0 0 2024-09-13T02:54:17.528 INFO:tasks.workunit.client.1.smithi131.stdout:9/607: chown d0/d3/d14/d1a/d2a/l7a 5675924 1 2024-09-13T02:54:17.528 INFO:tasks.workunit.client.1.smithi131.stdout:9/608: chown d0/d3/d14/d1a/d2a/cc1 2015358 1 2024-09-13T02:54:17.528 INFO:tasks.workunit.client.1.smithi131.stdout:1/617: rmdir dd/dc2 39 2024-09-13T02:54:17.528 INFO:tasks.workunit.client.1.smithi131.stdout:1/618: truncate dd/d26/d2a/fe3 801590 0 2024-09-13T02:54:17.528 INFO:tasks.workunit.client.1.smithi131.stdout:7/591: dread d1b/d23/f4c [0,4194304] 0 2024-09-13T02:54:17.528 INFO:tasks.workunit.client.1.smithi131.stdout:6/688: dread d1/d8/d9/db/d15/dc2/d3b/fb9 [0,4194304] 0 2024-09-13T02:54:17.529 INFO:tasks.workunit.client.1.smithi131.stdout:3/558: dwrite d2/d4/f34 [0,4194304] 0 2024-09-13T02:54:17.529 INFO:tasks.workunit.client.1.smithi131.stdout:3/559: readlink d2/d4/d1a/l81 0 2024-09-13T02:54:17.529 INFO:tasks.workunit.client.1.smithi131.stdout:3/560: write d2/d4/d7/d1d/f2c [4659284,84766] 0 2024-09-13T02:54:17.529 INFO:tasks.workunit.client.1.smithi131.stdout:3/561: creat d2/d4/d7/d1d/d24/d7e/fbc x:0 0 0 2024-09-13T02:54:17.529 INFO:tasks.workunit.client.1.smithi131.stdout:3/562: write d2/d4/d7/d1d/f30 [1347838,9583] 0 2024-09-13T02:54:17.529 INFO:tasks.workunit.client.1.smithi131.stdout:9/609: rename d0/d3/d14/d3c to d0/d3/d14/d1a/dc6 0 2024-09-13T02:54:17.529 INFO:tasks.workunit.client.1.smithi131.stdout:7/592: mknod d1b/d3b/d51/d62/d6d/da5/ccc 0 2024-09-13T02:54:17.530 INFO:tasks.workunit.client.1.smithi131.stdout:9/610: creat d0/d3/d14/dbf/fc7 x:0 0 0 2024-09-13T02:54:17.530 INFO:tasks.workunit.client.1.smithi131.stdout:7/593: mknod d1b/d23/ccd 0 2024-09-13T02:54:17.530 INFO:tasks.workunit.client.1.smithi131.stdout:9/611: creat d0/d3/d14/d1a/dc6/fc8 x:0 0 0 2024-09-13T02:54:17.563 INFO:tasks.workunit.client.1.smithi131.stdout:5/530: dwrite d1/f23 [0,4194304] 0 2024-09-13T02:54:17.563 INFO:tasks.workunit.client.1.smithi131.stdout:5/531: creat d1/d29/d39/fb5 x:0 0 0 2024-09-13T02:54:17.564 INFO:tasks.workunit.client.1.smithi131.stdout:2/667: dwrite d5/d31/d4e/d78/fc6 [0,4194304] 0 2024-09-13T02:54:17.565 INFO:tasks.workunit.client.1.smithi131.stdout:4/743: dwrite d1/d18/d43/d97/dba/d22/d73/fcd [0,4194304] 0 2024-09-13T02:54:17.568 INFO:tasks.workunit.client.1.smithi131.stdout:2/668: creat d5/d18/d68/de3/d66/fe4 x:0 0 0 2024-09-13T02:54:17.569 INFO:tasks.workunit.client.1.smithi131.stdout:2/669: write d5/d53/fb0 [508129,22044] 0 2024-09-13T02:54:17.569 INFO:tasks.workunit.client.1.smithi131.stdout:2/670: creat d5/d31/d26/fe5 x:0 0 0 2024-09-13T02:54:17.569 INFO:tasks.workunit.client.1.smithi131.stdout:0/771: dwrite d0/de/d45/d86/f88 [0,4194304] 0 2024-09-13T02:54:17.570 INFO:tasks.workunit.client.1.smithi131.stdout:0/772: truncate d0/de/fd7 1901523 0 2024-09-13T02:54:17.570 INFO:tasks.workunit.client.1.smithi131.stdout:1/619: dwrite dd/d33/d94/db4/fb9 [0,4194304] 0 2024-09-13T02:54:17.570 INFO:tasks.workunit.client.1.smithi131.stdout:6/689: dwrite d1/d8/d9/db/d15/d26/d1c/d79/d92/dc6/fca [0,4194304] 0 2024-09-13T02:54:17.570 INFO:tasks.workunit.client.1.smithi131.stdout:5/532: link d1/d50/fa3 d1/d9c/fb6 0 2024-09-13T02:54:17.571 INFO:tasks.workunit.client.1.smithi131.stdout:8/613: dwrite db/d2b/d39/d56/f95 [0,4194304] 0 2024-09-13T02:54:17.571 INFO:tasks.workunit.client.1.smithi131.stdout:8/614: write db/d1d/d1f/fbe [808447,67548] 0 2024-09-13T02:54:17.572 INFO:tasks.workunit.client.1.smithi131.stdout:7/594: dwrite d1b/d3b/f6b [0,4194304] 0 2024-09-13T02:54:17.574 INFO:tasks.workunit.client.1.smithi131.stdout:9/612: dwrite d0/f9 [0,4194304] 0 2024-09-13T02:54:17.574 INFO:tasks.workunit.client.1.smithi131.stdout:9/613: read d0/d3/d14/d1a/f1d [3287846,112219] 0 2024-09-13T02:54:17.576 INFO:tasks.workunit.client.1.smithi131.stdout:8/615: dread db/d1d/d34/f70 [0,4194304] 0 2024-09-13T02:54:17.582 INFO:tasks.workunit.client.1.smithi131.stdout:0/773: creat d0/de/d1f/d22/d3d/d55/d63/f10c x:0 0 0 2024-09-13T02:54:17.585 INFO:tasks.workunit.client.1.smithi131.stdout:1/620: mknod dd/d33/ce7 0 2024-09-13T02:54:17.587 INFO:tasks.workunit.client.1.smithi131.stdout:7/595: write d1b/d3b/d31/d5f/f9c [1007850,22891] 0 2024-09-13T02:54:17.587 INFO:tasks.workunit.client.1.smithi131.stdout:7/596: fsync f4 0 2024-09-13T02:54:17.588 INFO:tasks.workunit.client.1.smithi131.stdout:2/671: dread d5/d18/d68/de3/d66/f73 [0,4194304] 0 2024-09-13T02:54:17.592 INFO:tasks.workunit.client.1.smithi131.stdout:9/614: mknod d0/d3/d14/d1a/dc6/d70/cc9 0 2024-09-13T02:54:17.592 INFO:tasks.workunit.client.1.smithi131.stdout:5/533: dread d1/d2f/d33/f89 [0,4194304] 0 2024-09-13T02:54:17.593 INFO:tasks.workunit.client.1.smithi131.stdout:1/621: rmdir dd/d26/d2a/d2c 39 2024-09-13T02:54:17.593 INFO:tasks.workunit.client.1.smithi131.stdout:4/744: dwrite d1/d18/d34/d4e/fb0 [0,4194304] 0 2024-09-13T02:54:17.593 INFO:tasks.workunit.client.1.smithi131.stdout:0/774: dread d0/de/d1f/d22/d31/fba [0,4194304] 0 2024-09-13T02:54:17.593 INFO:tasks.workunit.client.1.smithi131.stdout:4/745: chown d1/d18/d43/d65/dbd/dc1/d13/f30 12 1 2024-09-13T02:54:17.594 INFO:tasks.workunit.client.1.smithi131.stdout:5/534: rmdir d1/d2f 39 2024-09-13T02:54:17.594 INFO:tasks.workunit.client.1.smithi131.stdout:5/535: stat d1/d1c/d8e/f48 0 2024-09-13T02:54:17.598 INFO:tasks.workunit.client.1.smithi131.stdout:7/597: dread d1b/d3b/d51/d62/d9e/fa9 [0,4194304] 0 2024-09-13T02:54:17.599 INFO:tasks.workunit.client.1.smithi131.stdout:7/598: chown d1b/d3b/d31/d7c/db7/fb9 57 1 2024-09-13T02:54:17.599 INFO:tasks.workunit.client.1.smithi131.stdout:9/615: dread d0/d3/d14/d1a/d2a/d5e/da2/d39/f50 [0,4194304] 0 2024-09-13T02:54:17.599 INFO:tasks.workunit.client.1.smithi131.stdout:4/746: symlink d1/d18/d43/d97/dba/d19/d29/d8d/lfc 0 2024-09-13T02:54:17.600 INFO:tasks.workunit.client.1.smithi131.stdout:5/536: mkdir d1/d21/db7 0 2024-09-13T02:54:17.602 INFO:tasks.workunit.client.1.smithi131.stdout:0/775: rmdir d0/d2/d62 39 2024-09-13T02:54:17.602 INFO:tasks.workunit.client.1.smithi131.stdout:0/776: dread - d0/de/d1f/fd9 zero size 2024-09-13T02:54:17.602 INFO:tasks.workunit.client.1.smithi131.stdout:7/599: dread d1b/d3b/d31/d60/fc3 [0,4194304] 0 2024-09-13T02:54:17.604 INFO:tasks.workunit.client.1.smithi131.stdout:9/616: creat d0/d3f/db3/fca x:0 0 0 2024-09-13T02:54:17.604 INFO:tasks.workunit.client.1.smithi131.stdout:8/616: dwrite db/d1d/d1f/d67/f85 [0,4194304] 0 2024-09-13T02:54:17.605 INFO:tasks.workunit.client.1.smithi131.stdout:8/617: write db/d1d/d34/d4e/fa8 [467632,70051] 0 2024-09-13T02:54:17.607 INFO:tasks.workunit.client.1.smithi131.stdout:5/537: mkdir d1/d1c/d87/db8 0 2024-09-13T02:54:17.607 INFO:tasks.workunit.client.1.smithi131.stdout:0/777: unlink d0/de/d45/c9f 0 2024-09-13T02:54:17.607 INFO:tasks.workunit.client.1.smithi131.stdout:0/778: chown d0/de/d1f/d22/d3d/d55/d63 0 1 2024-09-13T02:54:17.610 INFO:tasks.workunit.client.1.smithi131.stdout:0/779: rename d0/d2/d41/f7e to d0/de/d1f/d22/d3d/d55/d63/d95/f10d 0 2024-09-13T02:54:17.615 INFO:tasks.workunit.client.1.smithi131.stdout:0/780: unlink d0/de/d1f/c32 0 2024-09-13T02:54:17.616 INFO:tasks.workunit.client.1.smithi131.stdout:4/747: dread d1/d18/d43/d97/dba/d7a/dd3/fe7 [0,4194304] 0 2024-09-13T02:54:17.616 INFO:tasks.workunit.client.1.smithi131.stdout:0/781: creat d0/de/d1f/f10e x:0 0 0 2024-09-13T02:54:17.618 INFO:tasks.workunit.client.1.smithi131.stdout:7/600: read d1b/d3b/f3e [1665050,92760] 0 2024-09-13T02:54:17.619 INFO:tasks.workunit.client.1.smithi131.stdout:1/622: dwrite dd/d26/d44/f32 [4194304,4194304] 0 2024-09-13T02:54:17.619 INFO:tasks.workunit.client.1.smithi131.stdout:1/623: getdents dd/dc2 0 2024-09-13T02:54:17.619 INFO:tasks.workunit.client.1.smithi131.stdout:7/601: creat d1b/d3b/d51/fce x:0 0 0 2024-09-13T02:54:17.619 INFO:tasks.workunit.client.1.smithi131.stdout:7/602: chown d1b/d3b/d51/d62/c66 343058086 1 2024-09-13T02:54:17.619 INFO:tasks.workunit.client.1.smithi131.stdout:7/603: write d1b/d23/f28 [4736841,79134] 0 2024-09-13T02:54:17.619 INFO:tasks.workunit.client.1.smithi131.stdout:4/748: rename d1/d18/f55 to d1/d18/d81/ffd 0 2024-09-13T02:54:17.619 INFO:tasks.workunit.client.1.smithi131.stdout:4/749: readlink d1/d18/d43/d65/l88 0 2024-09-13T02:54:17.620 INFO:tasks.workunit.client.1.smithi131.stdout:0/782: creat d0/de/d1f/d22/d31/d39/d40/f10f x:0 0 0 2024-09-13T02:54:17.624 INFO:tasks.workunit.client.1.smithi131.stdout:0/783: rename d0/de/d45/d86/cb4 to d0/de/d1f/d22/d3d/d43/dc2/dd3/c110 0 2024-09-13T02:54:17.644 INFO:tasks.workunit.client.1.smithi131.stdout:8/618: dwrite db/d2b/d39/fa2 [0,4194304] 0 2024-09-13T02:54:17.644 INFO:tasks.workunit.client.1.smithi131.stdout:9/617: dwrite d0/d3/d14/d1a/d2a/d5e/f80 [0,4194304] 0 2024-09-13T02:54:17.644 INFO:tasks.workunit.client.1.smithi131.stdout:9/618: chown d0/d3/d14/d17/f91 1861662 1 2024-09-13T02:54:17.644 INFO:tasks.workunit.client.1.smithi131.stdout:9/619: dread - d0/d3/d14/fbd zero size 2024-09-13T02:54:17.644 INFO:tasks.workunit.client.1.smithi131.stdout:5/538: dwrite d1/d2f/d33/f75 [0,4194304] 0 2024-09-13T02:54:17.644 INFO:tasks.workunit.client.1.smithi131.stdout:5/539: chown d1/d21/d74/fa7 11329 1 2024-09-13T02:54:17.646 INFO:tasks.workunit.client.1.smithi131.stdout:7/604: dwrite d1b/d3b/d51/d62/f7a [0,4194304] 0 2024-09-13T02:54:17.648 INFO:tasks.workunit.client.1.smithi131.stdout:0/784: dwrite d0/de/fd7 [0,4194304] 0 2024-09-13T02:54:17.648 INFO:tasks.workunit.client.1.smithi131.stdout:0/785: dread - d0/de/d1f/d22/d31/d39/d40/f10f zero size 2024-09-13T02:54:17.652 INFO:tasks.workunit.client.1.smithi131.stdout:9/620: mkdir d0/d3/d14/d1a/dcb 0 2024-09-13T02:54:17.655 INFO:tasks.workunit.client.1.smithi131.stdout:5/540: symlink d1/d2f/lb9 0 2024-09-13T02:54:17.655 INFO:tasks.workunit.client.1.smithi131.stdout:5/541: fdatasync d1/d21/d74/f80 0 2024-09-13T02:54:17.662 INFO:tasks.workunit.client.1.smithi131.stdout:0/786: getdents d0/de/d1f/d22/d31/d39/d40/d68 0 2024-09-13T02:54:17.663 INFO:tasks.workunit.client.1.smithi131.stdout:9/621: mknod d0/d3/d14/d17/ccc 0 2024-09-13T02:54:17.667 INFO:tasks.workunit.client.1.smithi131.stdout:8/619: dwrite db/d2b/d39/fa2 [0,4194304] 0 2024-09-13T02:54:17.668 INFO:tasks.workunit.client.1.smithi131.stdout:0/787: mknod d0/de/d1f/d22/d3d/d87/c111 0 2024-09-13T02:54:17.668 INFO:tasks.workunit.client.1.smithi131.stdout:0/788: chown d0/de/d1f/d22/d3d/c73 763948164 1 2024-09-13T02:54:17.669 INFO:tasks.workunit.client.1.smithi131.stdout:9/622: unlink d0/d3/d14/d1a/d2a/d5e/da2/f53 0 2024-09-13T02:54:17.671 INFO:tasks.workunit.client.1.smithi131.stdout:8/620: truncate db/d2b/f6d 415052 0 2024-09-13T02:54:17.672 INFO:tasks.workunit.client.1.smithi131.stdout:0/789: creat d0/de/d1f/d22/d3d/f112 x:0 0 0 2024-09-13T02:54:17.674 INFO:tasks.workunit.client.1.smithi131.stdout:7/605: dwrite d1b/d3b/d31/d5f/f79 [0,4194304] 0 2024-09-13T02:54:17.674 INFO:tasks.workunit.client.1.smithi131.stdout:7/606: chown d1b/d3b/d31/d7c/db7 1563965 1 2024-09-13T02:54:17.674 INFO:tasks.workunit.client.1.smithi131.stdout:8/621: rmdir db/d1d/d34/dae 0 2024-09-13T02:54:17.674 INFO:tasks.workunit.client.1.smithi131.stdout:8/622: readlink l1 0 2024-09-13T02:54:17.674 INFO:tasks.workunit.client.1.smithi131.stdout:8/623: write db/d1d/d1f/f52 [1050966,122923] 0 2024-09-13T02:54:17.675 INFO:tasks.workunit.client.1.smithi131.stdout:8/624: fdatasync db/f18 0 2024-09-13T02:54:17.676 INFO:tasks.workunit.client.1.smithi131.stdout:0/790: mkdir d0/de/d1f/d22/d31/d39/d67/db5/d113 0 2024-09-13T02:54:17.676 INFO:tasks.workunit.client.1.smithi131.stdout:0/791: write d0/de/d1f/d22/d3d/d55/d63/d95/ff4 [788521,4929] 0 2024-09-13T02:54:17.676 INFO:tasks.workunit.client.1.smithi131.stdout:7/607: mkdir d1b/d23/d89/dcf 0 2024-09-13T02:54:17.677 INFO:tasks.workunit.client.1.smithi131.stdout:7/608: truncate d1b/d3b/d31/d7c/db7/d81/f97 339076 0 2024-09-13T02:54:17.678 INFO:tasks.workunit.client.1.smithi131.stdout:0/792: rename d0/d2/cac to d0/de/d45/c114 0 2024-09-13T02:54:17.678 INFO:tasks.workunit.client.1.smithi131.stdout:0/793: chown d0/d2/d62/c98 1606 1 2024-09-13T02:54:17.686 INFO:tasks.workunit.client.1.smithi131.stdout:7/609: dread d1b/d3b/f55 [0,4194304] 0 2024-09-13T02:54:17.687 INFO:tasks.workunit.client.1.smithi131.stdout:7/610: creat d1b/d3b/d31/d7c/db7/fd0 x:0 0 0 2024-09-13T02:54:17.689 INFO:tasks.workunit.client.1.smithi131.stdout:8/625: write db/d1d/d1f/d67/f85 [3632390,51025] 0 2024-09-13T02:54:17.693 INFO:tasks.workunit.client.1.smithi131.stdout:9/623: dwrite d0/d3f/f9b [0,4194304] 0 2024-09-13T02:54:17.693 INFO:tasks.workunit.client.1.smithi131.stdout:0/794: dread d0/d2/d41/fc7 [0,4194304] 0 2024-09-13T02:54:17.699 INFO:tasks.workunit.client.1.smithi131.stdout:0/795: write d0/de/d1f/d22/d3d/d43/dc2/dd3/ffb [502687,76925] 0 2024-09-13T02:54:17.704 INFO:tasks.workunit.client.1.smithi131.stdout:0/796: rename d0/de/d1f/d22/d31/f60 to d0/de/f115 0 2024-09-13T02:54:17.704 INFO:tasks.workunit.client.1.smithi131.stdout:0/797: truncate d0/de/d1f/d22/d31/d39/d40/fd5 20503 0 2024-09-13T02:54:17.704 INFO:tasks.workunit.client.1.smithi131.stdout:0/798: symlink d0/de/d1f/d22/d3d/d55/d63/dd2/l116 0 2024-09-13T02:54:17.705 INFO:tasks.workunit.client.1.smithi131.stdout:0/799: link d0/de/d45/d86/de8/l77 d0/de/d1f/d22/d31/d39/d67/db5/dc9/l117 0 2024-09-13T02:54:17.705 INFO:tasks.workunit.client.1.smithi131.stdout:0/800: stat d0/de/d1f/d22/d31/d39/d40/c8b 0 2024-09-13T02:54:17.711 INFO:tasks.workunit.client.1.smithi131.stdout:7/611: dwrite d1b/d3b/d31/fc5 [0,4194304] 0 2024-09-13T02:54:17.714 INFO:tasks.workunit.client.1.smithi131.stdout:8/626: dwrite db/d1d/fa7 [0,4194304] 0 2024-09-13T02:54:17.714 INFO:tasks.workunit.client.1.smithi131.stdout:8/627: chown db/d2b/d39/d56 85146 1 2024-09-13T02:54:17.717 INFO:tasks.workunit.client.1.smithi131.stdout:8/628: getdents db/d2b/d39 0 2024-09-13T02:54:17.717 INFO:tasks.workunit.client.1.smithi131.stdout:8/629: write db/f23 [1925701,88054] 0 2024-09-13T02:54:17.717 INFO:tasks.workunit.client.1.smithi131.stdout:0/801: dread d0/de/d1f/d22/d3d/fff [0,4194304] 0 2024-09-13T02:54:17.718 INFO:tasks.workunit.client.1.smithi131.stdout:8/630: unlink db/d2b/d39/l59 0 2024-09-13T02:54:17.719 INFO:tasks.workunit.client.1.smithi131.stdout:8/631: write db/d89/f98 [757297,24193] 0 2024-09-13T02:54:17.719 INFO:tasks.workunit.client.1.smithi131.stdout:0/802: symlink d0/de/d1f/d22/d3d/d55/dfd/l118 0 2024-09-13T02:54:17.720 INFO:tasks.workunit.client.1.smithi131.stdout:8/632: link db/d2b/lbc db/d2b/lc1 0 2024-09-13T02:54:17.722 INFO:tasks.workunit.client.1.smithi131.stdout:0/803: mkdir d0/de/d45/dfa/d119 0 2024-09-13T02:54:17.722 INFO:tasks.workunit.client.1.smithi131.stdout:0/804: creat d0/f11a x:0 0 0 2024-09-13T02:54:17.722 INFO:tasks.workunit.client.1.smithi131.stdout:0/805: getdents d0/de/d1f/d22/d31/d39/d67/db5/d113 0 2024-09-13T02:54:17.726 INFO:tasks.workunit.client.1.smithi131.stdout:8/633: getdents db/d89 0 2024-09-13T02:54:17.729 INFO:tasks.workunit.client.1.smithi131.stdout:8/634: getdents db/d1d/d1f 0 2024-09-13T02:54:17.731 INFO:tasks.workunit.client.1.smithi131.stdout:8/635: link db/d2e/d3a/l69 db/d1d/d34/d4e/d7e/lc2 0 2024-09-13T02:54:17.733 INFO:tasks.workunit.client.1.smithi131.stdout:8/636: mknod db/d2e/cc3 0 2024-09-13T02:54:17.745 INFO:tasks.workunit.client.1.smithi131.stdout:8/637: dread db/d1d/d34/d4e/d7e/f83 [0,4194304] 0 2024-09-13T02:54:17.746 INFO:tasks.workunit.client.1.smithi131.stdout:0/806: dwrite d0/de/d1f/d22/d31/d39/f74 [0,4194304] 0 2024-09-13T02:54:17.746 INFO:tasks.workunit.client.1.smithi131.stdout:0/807: creat d0/de/d1f/d22/d3d/d43/f11b x:0 0 0 2024-09-13T02:54:17.755 INFO:tasks.workunit.client.1.smithi131.stdout:8/638: dread db/d2e/d40/f48 [0,4194304] 0 2024-09-13T02:54:17.756 INFO:tasks.workunit.client.1.smithi131.stdout:8/639: mkdir db/d1d/d34/d4e/d7e/dc4 0 2024-09-13T02:54:17.758 INFO:tasks.workunit.client.1.smithi131.stdout:8/640: link db/d2e/d3a/l7b db/d1d/d1f/lc5 0 2024-09-13T02:54:17.759 INFO:tasks.workunit.client.1.smithi131.stdout:8/641: write db/d1d/d34/f70 [14200,32740] 0 2024-09-13T02:54:17.766 INFO:tasks.workunit.client.1.smithi131.stdout:0/808: dwrite d0/de/d1f/d22/d31/d39/f74 [0,4194304] 0 2024-09-13T02:54:17.767 INFO:tasks.workunit.client.1.smithi131.stdout:0/809: chown d0/l36 0 1 2024-09-13T02:54:17.767 INFO:tasks.workunit.client.1.smithi131.stdout:8/642: rmdir db/d2e 39 2024-09-13T02:54:17.768 INFO:tasks.workunit.client.1.smithi131.stdout:0/810: getdents d0/de/d1f/d22/d31 0 2024-09-13T02:54:17.769 INFO:tasks.workunit.client.1.smithi131.stdout:8/643: mkdir db/d1d/dc6 0 2024-09-13T02:54:17.769 INFO:tasks.workunit.client.1.smithi131.stdout:0/811: mknod d0/de/d45/d78/df0/c11c 0 2024-09-13T02:54:17.769 INFO:tasks.workunit.client.1.smithi131.stdout:0/812: readlink d0/de/d1f/l6a 0 2024-09-13T02:54:17.769 INFO:tasks.workunit.client.1.smithi131.stdout:0/813: dread - d0/de/d1f/fd9 zero size 2024-09-13T02:54:17.771 INFO:tasks.workunit.client.1.smithi131.stdout:0/814: truncate d0/de/d1f/f72 2241787 0 2024-09-13T02:54:17.771 INFO:tasks.workunit.client.1.smithi131.stdout:0/815: creat d0/de/d1f/d22/d3d/d55/d63/dd2/f11d x:0 0 0 2024-09-13T02:54:17.799 INFO:tasks.workunit.client.1.smithi131.stdout:8/644: dwrite db/d2b/f6d [0,4194304] 0 2024-09-13T02:54:17.799 INFO:tasks.workunit.client.1.smithi131.stdout:0/816: dwrite d0/de/d1f/d22/d3d/d55/d63/dd2/f11d [0,4194304] 0 2024-09-13T02:54:17.799 INFO:tasks.workunit.client.1.smithi131.stdout:8/645: fdatasync db/d1d/d1f/d41/f62 0 2024-09-13T02:54:17.799 INFO:tasks.workunit.client.1.smithi131.stdout:8/646: write db/d1d/d1f/f76 [195379,17051] 0 2024-09-13T02:54:17.799 INFO:tasks.workunit.client.1.smithi131.stdout:0/817: write d0/de/d1f/d22/f29 [1344376,130539] 0 2024-09-13T02:54:17.799 INFO:tasks.workunit.client.1.smithi131.stdout:0/818: read d0/de/d1f/f72 [1712799,55959] 0 2024-09-13T02:54:17.802 INFO:tasks.workunit.client.1.smithi131.stdout:8/647: rmdir db/d1d/d34/d4e 39 2024-09-13T02:54:17.802 INFO:tasks.workunit.client.1.smithi131.stdout:8/648: chown db/d2b/d39/d56/c79 35445858 1 2024-09-13T02:54:17.802 INFO:tasks.workunit.client.1.smithi131.stdout:8/649: chown db/d89/c9e 974488 1 2024-09-13T02:54:17.802 INFO:tasks.workunit.client.1.smithi131.stdout:8/650: creat db/d2b/fc7 x:0 0 0 2024-09-13T02:54:17.805 INFO:tasks.workunit.client.1.smithi131.stdout:8/651: rmdir db/d2b/d39 39 2024-09-13T02:54:17.811 INFO:tasks.workunit.client.1.smithi131.stdout:0/819: write d0/d2/d41/f79 [371367,70034] 0 2024-09-13T02:54:17.811 INFO:tasks.workunit.client.1.smithi131.stdout:0/820: stat d0/de/d1f/d22/d3d/d55/d63/d94/cd4 0 2024-09-13T02:54:17.811 INFO:tasks.workunit.client.1.smithi131.stdout:0/821: fsync d0/de/d45/d86/f93 0 2024-09-13T02:54:17.811 INFO:tasks.workunit.client.1.smithi131.stdout:0/822: mkdir d0/de/d1f/d22/d31/d39/d67/db5/d113/d11e 0 2024-09-13T02:54:17.824 INFO:tasks.workunit.client.1.smithi131.stdout:8/652: dwrite db/d1d/d1f/d67/f6b [0,4194304] 0 2024-09-13T02:54:17.833 INFO:tasks.workunit.client.1.smithi131.stdout:0/823: dwrite d0/d2/d41/fc7 [0,4194304] 0 2024-09-13T02:54:17.835 INFO:tasks.workunit.client.1.smithi131.stdout:0/824: rmdir d0/de/d1f/d22/d31/d39/d67/db5/d113/d11e 0 2024-09-13T02:54:17.836 INFO:tasks.workunit.client.1.smithi131.stdout:0/825: chown d0/de/d1f/d22/d31/d39/d67/db5 42606 1 2024-09-13T02:54:17.836 INFO:tasks.workunit.client.1.smithi131.stdout:0/826: read - d0/de/d1f/d22/d31/d39/da8/fbb zero size 2024-09-13T02:54:17.837 INFO:tasks.workunit.client.1.smithi131.stdout:0/827: unlink d0/de/d45/d86/de8/f5b 0 2024-09-13T02:54:17.838 INFO:tasks.workunit.client.1.smithi131.stdout:0/828: symlink d0/de/d1f/d22/d3d/d87/l11f 0 2024-09-13T02:54:17.839 INFO:tasks.workunit.client.1.smithi131.stdout:0/829: creat d0/de/d45/d78/df0/f120 x:0 0 0 2024-09-13T02:54:17.839 INFO:tasks.workunit.client.1.smithi131.stdout:0/830: write d0/de/d1f/d22/d31/d39/fad [742368,44969] 0 2024-09-13T02:54:17.840 INFO:tasks.workunit.client.1.smithi131.stdout:0/831: rename d0/d2/f17 to d0/de/d1f/d22/d3d/d43/d4b/f121 0 2024-09-13T02:54:17.840 INFO:tasks.workunit.client.1.smithi131.stdout:0/832: chown d0/de/d1f/d22/d31/d39/d67/f69 13651243 1 2024-09-13T02:54:17.841 INFO:tasks.workunit.client.1.smithi131.stdout:0/833: link d0/de/d1f/d22/d31/d39/d67/fec d0/d2/d62/f122 0 2024-09-13T02:54:17.846 INFO:tasks.workunit.client.1.smithi131.stdout:8/653: dwrite db/d2e/d40/f48 [0,4194304] 0 2024-09-13T02:54:17.846 INFO:tasks.workunit.client.1.smithi131.stdout:8/654: write db/d1d/d34/faf [4473758,1795] 0 2024-09-13T02:54:17.852 INFO:tasks.workunit.client.1.smithi131.stdout:0/834: fsync d0/de/d1f/d22/d3d/d43/d4b/f121 0 2024-09-13T02:54:17.863 INFO:tasks.workunit.client.1.smithi131.stdout:8/655: dwrite f8 [4194304,4194304] 0 2024-09-13T02:54:17.865 INFO:tasks.workunit.client.1.smithi131.stdout:8/656: symlink db/d1d/d1f/d66/lc8 0 2024-09-13T02:54:17.865 INFO:tasks.workunit.client.1.smithi131.stdout:0/835: dread d0/de/d1f/d22/d31/d39/f74 [0,4194304] 0 2024-09-13T02:54:17.866 INFO:tasks.workunit.client.1.smithi131.stdout:8/657: symlink db/d1d/d1f/d66/lc9 0 2024-09-13T02:54:17.871 INFO:tasks.workunit.client.1.smithi131.stdout:0/836: dread d0/d2/d41/fc4 [0,4194304] 0 2024-09-13T02:54:17.871 INFO:tasks.workunit.client.1.smithi131.stdout:0/837: dread - d0/de/d1f/d22/d3d/d43/f11b zero size 2024-09-13T02:54:17.872 INFO:tasks.workunit.client.1.smithi131.stdout:8/658: write db/d1d/d34/d4e/d7e/f83 [1174449,36577] 0 2024-09-13T02:54:17.874 INFO:tasks.workunit.client.1.smithi131.stdout:8/659: link db/d1d/d34/c68 db/d1d/d1f/d5c/da1/cca 0 2024-09-13T02:54:17.877 INFO:tasks.workunit.client.1.smithi131.stdout:0/838: dread d0/de/d1f/d22/d3d/d43/dc2/dd3/ffb [0,4194304] 0 2024-09-13T02:54:17.877 INFO:tasks.workunit.client.1.smithi131.stdout:0/839: fsync d0/de/d1f/d22/d3d/d43/f11b 0 2024-09-13T02:54:17.878 INFO:tasks.workunit.client.1.smithi131.stdout:0/840: dread d0/de/d1f/d22/d31/d39/d40/fd5 [0,4194304] 0 2024-09-13T02:54:17.878 INFO:tasks.workunit.client.1.smithi131.stdout:0/841: write d0/de/d45/d78/df0/f120 [410483,15231] 0 2024-09-13T02:54:17.880 INFO:tasks.workunit.client.1.smithi131.stdout:0/842: rename d0/de/d1f/d22/d3d/d43/f5f to d0/de/d1f/d22/d3d/d80/f123 0 2024-09-13T02:54:17.882 INFO:tasks.workunit.client.1.smithi131.stdout:0/843: mknod d0/de/d1f/d22/d31/d39/d67/c124 0 2024-09-13T02:54:17.883 INFO:tasks.workunit.client.1.smithi131.stdout:0/844: mknod d0/de/d1f/d22/d31/c125 0 2024-09-13T02:54:17.884 INFO:tasks.workunit.client.1.smithi131.stdout:0/845: symlink d0/de/d1f/d22/d31/d39/da8/l126 0 2024-09-13T02:54:17.884 INFO:tasks.workunit.client.1.smithi131.stdout:0/846: truncate d0/de/d45/d86/f93 1297600 0 2024-09-13T02:54:17.884 INFO:tasks.workunit.client.1.smithi131.stdout:8/660: dread f2 [4194304,4194304] 0 2024-09-13T02:54:17.885 INFO:tasks.workunit.client.1.smithi131.stdout:0/847: symlink d0/de/d1f/d22/d31/d39/d67/db5/l127 0 2024-09-13T02:54:17.886 INFO:tasks.workunit.client.1.smithi131.stdout:0/848: symlink d0/de/d1f/d22/d31/d39/d40/d68/l128 0 2024-09-13T02:54:17.886 INFO:tasks.workunit.client.1.smithi131.stdout:0/849: fdatasync d0/de/d45/d86/de8/f7f 0 2024-09-13T02:54:17.886 INFO:tasks.workunit.client.1.smithi131.stdout:8/661: dread db/d2b/d39/f77 [0,4194304] 0 2024-09-13T02:54:17.887 INFO:tasks.workunit.client.1.smithi131.stdout:0/850: symlink d0/de/d1f/d22/d3d/d43/dc2/dd3/l129 0 2024-09-13T02:54:17.888 INFO:tasks.workunit.client.1.smithi131.stdout:8/662: mkdir db/d2b/d39/d56/dcb 0 2024-09-13T02:54:17.889 INFO:tasks.workunit.client.1.smithi131.stdout:0/851: mknod d0/de/d1f/d22/d3d/d55/d63/d94/da5/c12a 0 2024-09-13T02:54:17.890 INFO:tasks.workunit.client.1.smithi131.stdout:3/563: sync 2024-09-13T02:54:17.895 INFO:tasks.workunit.client.1.smithi131.stdout:3/564: symlink d2/d4/d76/d9f/d41/d5c/lbd 0 2024-09-13T02:54:17.896 INFO:tasks.workunit.client.1.smithi131.stdout:3/565: symlink d2/d4/d7/d1d/db4/lbe 0 2024-09-13T02:54:17.897 INFO:tasks.workunit.client.1.smithi131.stdout:3/566: truncate d2/d4/d1a/f8b 194312 0 2024-09-13T02:54:17.897 INFO:tasks.workunit.client.1.smithi131.stdout:3/567: read - d2/dc/faf zero size 2024-09-13T02:54:17.897 INFO:tasks.workunit.client.1.smithi131.stdout:3/568: stat d2/d4/d1a/f6b 0 2024-09-13T02:54:17.897 INFO:tasks.workunit.client.1.smithi131.stdout:3/569: readlink d2/dc/l44 0 2024-09-13T02:54:17.898 INFO:tasks.workunit.client.1.smithi131.stdout:3/570: symlink d2/d4/d7/d1d/d24/d7e/lbf 0 2024-09-13T02:54:17.907 INFO:tasks.workunit.client.1.smithi131.stdout:0/852: dwrite d0/de/d1f/d22/d3d/d43/d4b/fe0 [0,4194304] 0 2024-09-13T02:54:17.910 INFO:tasks.workunit.client.1.smithi131.stdout:0/853: creat d0/de/d1f/d22/d3d/d43/dc2/f12b x:0 0 0 2024-09-13T02:54:17.911 INFO:tasks.workunit.client.1.smithi131.stdout:0/854: symlink d0/de/d1f/d22/d31/d39/d67/l12c 0 2024-09-13T02:54:17.911 INFO:tasks.workunit.client.1.smithi131.stdout:0/855: truncate d0/de/d1f/d22/d3d/d43/dc2/dd3/fee 1882991 0 2024-09-13T02:54:17.912 INFO:tasks.workunit.client.1.smithi131.stdout:0/856: chown d0/de/d1f/c56 12147 1 2024-09-13T02:54:17.912 INFO:tasks.workunit.client.1.smithi131.stdout:3/571: dread d2/d4/d1a/f6b [0,4194304] 0 2024-09-13T02:54:17.913 INFO:tasks.workunit.client.1.smithi131.stdout:0/857: creat d0/de/d1f/d22/d31/d39/da8/f12d x:0 0 0 2024-09-13T02:54:17.914 INFO:tasks.workunit.client.1.smithi131.stdout:3/572: getdents d2/d4/d1a/d31/da7 0 2024-09-13T02:54:17.914 INFO:tasks.workunit.client.1.smithi131.stdout:3/573: dread - d2/dc/d39/d61/f6c zero size 2024-09-13T02:54:17.914 INFO:tasks.workunit.client.1.smithi131.stdout:0/858: stat d0/de/c91 0 2024-09-13T02:54:17.927 INFO:tasks.workunit.client.1.smithi131.stdout:3/574: dread d2/d4/d1a/f66 [0,4194304] 0 2024-09-13T02:54:17.928 INFO:tasks.workunit.client.1.smithi131.stdout:3/575: fdatasync d2/f12 0 2024-09-13T02:54:17.933 INFO:tasks.workunit.client.1.smithi131.stdout:0/859: dwrite d0/de/d1f/d22/d3d/d43/fd8 [0,4194304] 0 2024-09-13T02:54:17.934 INFO:tasks.workunit.client.1.smithi131.stdout:0/860: mknod d0/de/d1f/d22/d3d/d55/dfd/c12e 0 2024-09-13T02:54:17.935 INFO:tasks.workunit.client.1.smithi131.stdout:0/861: mknod d0/de/d1f/d22/d31/d39/d67/c12f 0 2024-09-13T02:54:17.937 INFO:tasks.workunit.client.1.smithi131.stdout:3/576: dread d2/d4/f34 [0,4194304] 0 2024-09-13T02:54:17.938 INFO:tasks.workunit.client.1.smithi131.stdout:3/577: rename d2/d4/d7/d1d/d24/d96/f98 to d2/d4/d76/d9f/d41/d6e/fc0 0 2024-09-13T02:54:17.940 INFO:tasks.workunit.client.1.smithi131.stdout:0/862: dread d0/de/d1f/d22/d3d/d80/f123 [0,4194304] 0 2024-09-13T02:54:17.940 INFO:tasks.workunit.client.1.smithi131.stdout:0/863: getdents d0/de/d1f/d22/d3d/d87 0 2024-09-13T02:54:17.957 INFO:tasks.workunit.client.1.smithi131.stdout:3/578: dwrite d2/d4/d76/d9f/d41/f68 [0,4194304] 0 2024-09-13T02:54:17.959 INFO:tasks.workunit.client.1.smithi131.stdout:3/579: truncate d2/d4/d7/d1d/d24/d6f/f89 2723648 0 2024-09-13T02:54:17.959 INFO:tasks.workunit.client.1.smithi131.stdout:3/580: chown d2/d4/d7/d1d/d80/la3 105007 1 2024-09-13T02:54:17.959 INFO:tasks.workunit.client.1.smithi131.stdout:3/581: stat d2/d4/d1a/d31/d48 0 2024-09-13T02:54:17.959 INFO:tasks.workunit.client.1.smithi131.stdout:3/582: mkdir d2/d4/d76/dc1 0 2024-09-13T02:54:17.964 INFO:tasks.workunit.client.1.smithi131.stdout:3/583: rmdir d2/d4/d7/d1d/d24 39 2024-09-13T02:54:17.964 INFO:tasks.workunit.client.1.smithi131.stdout:3/584: readlink d2/d4/d76/d9f/l2f 0 2024-09-13T02:54:17.970 INFO:tasks.workunit.client.1.smithi131.stdout:3/585: dread d2/d4/d7/d1d/d24/d6f/f70 [0,4194304] 0 2024-09-13T02:54:17.976 INFO:tasks.workunit.client.1.smithi131.stdout:3/586: write d2/dc/d39/f3d [1784337,124061] 0 2024-09-13T02:54:17.976 INFO:tasks.workunit.client.1.smithi131.stdout:3/587: truncate d2/d4/d7/f62 544399 0 2024-09-13T02:54:17.977 INFO:tasks.workunit.client.1.smithi131.stdout:3/588: symlink d2/dc/db1/lc2 0 2024-09-13T02:54:17.978 INFO:tasks.workunit.client.1.smithi131.stdout:3/589: creat d2/d4/d7/d1d/d24/d6f/d73/fc3 x:0 0 0 2024-09-13T02:54:17.980 INFO:tasks.workunit.client.1.smithi131.stdout:3/590: mkdir d2/d4/d7/d1d/d24/d6f/d73/dc4 0 2024-09-13T02:54:17.980 INFO:tasks.workunit.client.1.smithi131.stdout:3/591: dread - d2/d4/d7/d1d/d24/d6f/d73/fc3 zero size 2024-09-13T02:54:17.988 INFO:tasks.workunit.client.1.smithi131.stdout:3/592: dread d2/dc/d39/d61/f87 [0,4194304] 0 2024-09-13T02:54:17.988 INFO:tasks.workunit.client.1.smithi131.stdout:3/593: chown d2/d4/d1a/f66 22732303 1 2024-09-13T02:54:18.002 INFO:tasks.workunit.client.1.smithi131.stdout:3/594: dwrite d2/d4/d7/d1d/d24/d6f/f8c [0,4194304] 0 2024-09-13T02:54:18.012 INFO:tasks.workunit.client.1.smithi131.stdout:3/595: write d2/d4/d7/d1d/d24/d6f/d7f/f88 [1110952,114706] 0 2024-09-13T02:54:18.013 INFO:tasks.workunit.client.1.smithi131.stdout:3/596: symlink d2/d4/d76/d9f/d41/lc5 0 2024-09-13T02:54:18.014 INFO:tasks.workunit.client.1.smithi131.stdout:3/597: mknod d2/d4/d7/d1d/d24/d6f/d73/dc4/cc6 0 2024-09-13T02:54:18.014 INFO:tasks.workunit.client.1.smithi131.stdout:3/598: write d2/d4/d7/f94 [819798,53824] 0 2024-09-13T02:54:18.015 INFO:tasks.workunit.client.1.smithi131.stdout:3/599: getdents d2/d4/d7/d1d/d24/d96 0 2024-09-13T02:54:18.015 INFO:tasks.workunit.client.1.smithi131.stdout:3/600: stat d2/d4/d1a/d31/c6d 0 2024-09-13T02:54:18.015 INFO:tasks.workunit.client.1.smithi131.stdout:3/601: chown d2/d4/d76/d9f/cb5 0 1 2024-09-13T02:54:18.016 INFO:tasks.workunit.client.1.smithi131.stdout:3/602: symlink d2/d4/d76/d9f/d41/d5c/d71/lc7 0 2024-09-13T02:54:18.182 INFO:tasks.workunit.client.1.smithi131.stdout:4/750: sync 2024-09-13T02:54:18.182 INFO:tasks.workunit.client.1.smithi131.stdout:1/624: sync 2024-09-13T02:54:18.183 INFO:tasks.workunit.client.1.smithi131.stdout:6/690: sync 2024-09-13T02:54:18.183 INFO:tasks.workunit.client.1.smithi131.stdout:2/672: sync 2024-09-13T02:54:18.183 INFO:tasks.workunit.client.1.smithi131.stdout:2/673: stat d5/l11 0 2024-09-13T02:54:18.183 INFO:tasks.workunit.client.1.smithi131.stdout:4/751: write d1/d18/d43/d65/dbd/dc1/d13/f44 [4277132,33371] 0 2024-09-13T02:54:18.183 INFO:tasks.workunit.client.1.smithi131.stdout:4/752: creat d1/d18/d43/d97/dba/d19/d29/d8d/ffe x:0 0 0 2024-09-13T02:54:18.184 INFO:tasks.workunit.client.1.smithi131.stdout:6/691: mknod d1/d8/d9/d4b/ce5 0 2024-09-13T02:54:18.187 INFO:tasks.workunit.client.1.smithi131.stdout:2/674: creat d5/d31/d1d/d32/d3b/d67/fe6 x:0 0 0 2024-09-13T02:54:18.187 INFO:tasks.workunit.client.1.smithi131.stdout:2/675: dread - d5/d31/d1d/d32/d3b/d67/d87/fd8 zero size 2024-09-13T02:54:18.187 INFO:tasks.workunit.client.1.smithi131.stdout:2/676: write d5/d31/ff [1347408,110034] 0 2024-09-13T02:54:18.189 INFO:tasks.workunit.client.1.smithi131.stdout:4/753: mkdir d1/d18/d43/d97/dba/d19/d29/d33/d3a/da8/dff 0 2024-09-13T02:54:18.190 INFO:tasks.workunit.client.1.smithi131.stdout:1/625: rmdir dd/d33/d80 39 2024-09-13T02:54:18.193 INFO:tasks.workunit.client.1.smithi131.stdout:6/692: rename d1/fa9 to d1/d8/d9/db/d15/d26/d1c/d4e/dde/dd9/fe6 0 2024-09-13T02:54:18.193 INFO:tasks.workunit.client.1.smithi131.stdout:6/693: dread - d1/d8/d9/d4b/f9b zero size 2024-09-13T02:54:18.193 INFO:tasks.workunit.client.1.smithi131.stdout:6/694: chown d1/d8/d9/db/d15/d26/d1c/d79/d92 699 1 2024-09-13T02:54:18.194 INFO:tasks.workunit.client.1.smithi131.stdout:2/677: mkdir d5/d34/d42/de7 0 2024-09-13T02:54:18.195 INFO:tasks.workunit.client.1.smithi131.stdout:4/754: creat d1/d18/d43/dd9/f100 x:0 0 0 2024-09-13T02:54:18.198 INFO:tasks.workunit.client.1.smithi131.stdout:1/626: rename dd/d26/d44/d6d/lbb to dd/d33/d94/le8 0 2024-09-13T02:54:18.198 INFO:tasks.workunit.client.1.smithi131.stdout:1/627: chown dd/d33/d42/d47 516265442 1 2024-09-13T02:54:18.198 INFO:tasks.workunit.client.1.smithi131.stdout:1/628: read dd/d26/d2a/d2c/d4b/f5b [2645720,59876] 0 2024-09-13T02:54:18.198 INFO:tasks.workunit.client.1.smithi131.stdout:6/695: creat d1/d8/d9/db/d15/d26/d1c/d4e/dde/fe7 x:0 0 0 2024-09-13T02:54:18.199 INFO:tasks.workunit.client.1.smithi131.stdout:2/678: creat d5/d31/d4e/d76/fe8 x:0 0 0 2024-09-13T02:54:18.199 INFO:tasks.workunit.client.1.smithi131.stdout:4/755: symlink d1/d18/d43/dd9/l101 0 2024-09-13T02:54:18.200 INFO:tasks.workunit.client.1.smithi131.stdout:4/756: truncate d1/d18/d34/f5a 1370229 0 2024-09-13T02:54:18.200 INFO:tasks.workunit.client.1.smithi131.stdout:4/757: chown d1/d18/d81/ldb 1434 1 2024-09-13T02:54:18.201 INFO:tasks.workunit.client.1.smithi131.stdout:4/758: dread d1/d18/d43/d65/dbd/dc1/d13/f57 [0,4194304] 0 2024-09-13T02:54:18.201 INFO:tasks.workunit.client.1.smithi131.stdout:6/696: link d1/d8/l82 d1/d8/d9/db/d15/d26/d1c/d79/d92/dc6/le8 0 2024-09-13T02:54:18.203 INFO:tasks.workunit.client.1.smithi131.stdout:4/759: rename d1/d18/d43/d97/dba/d19/d29/d33/l7f to d1/d18/d43/d97/dba/d19/d29/d33/d3a/l102 0 2024-09-13T02:54:18.204 INFO:tasks.workunit.client.1.smithi131.stdout:6/697: dread d1/d8/d9/db/fad [0,4194304] 0 2024-09-13T02:54:18.206 INFO:tasks.workunit.client.1.smithi131.stdout:4/760: rename d1/d18/f32 to d1/d18/d43/d65/dbd/dc1/d13/f103 0 2024-09-13T02:54:18.206 INFO:tasks.workunit.client.1.smithi131.stdout:4/761: chown d1/d18/d43/d97/dba/f4f 37565585 1 2024-09-13T02:54:18.206 INFO:tasks.workunit.client.1.smithi131.stdout:4/762: readlink d1/d18/d43/d97/dba/d7a/dbf/ld1 0 2024-09-13T02:54:18.206 INFO:tasks.workunit.client.1.smithi131.stdout:4/763: readlink d1/d18/d43/d97/dba/d22/d73/ldc 0 2024-09-13T02:54:18.208 INFO:tasks.workunit.client.1.smithi131.stdout:4/764: creat d1/d18/d34/d62/d78/db6/f104 x:0 0 0 2024-09-13T02:54:18.209 INFO:tasks.workunit.client.1.smithi131.stdout:2/679: dread d5/d31/ff [0,4194304] 0 2024-09-13T02:54:18.214 INFO:tasks.workunit.client.1.smithi131.stdout:6/698: write d1/f7 [1120673,96489] 0 2024-09-13T02:54:18.217 INFO:tasks.workunit.client.1.smithi131.stdout:6/699: rename d1/d8/c96 to d1/d8/d9/db/d15/d26/ce9 0 2024-09-13T02:54:18.220 INFO:tasks.workunit.client.1.smithi131.stdout:6/700: link d1/d8/d9/db/d40/f47 d1/d8/d9/d8d/fea 0 2024-09-13T02:54:18.220 INFO:tasks.workunit.client.1.smithi131.stdout:6/701: chown d1/d8/d9/db/d40/l5a 3921471 1 2024-09-13T02:54:18.221 INFO:tasks.workunit.client.1.smithi131.stdout:6/702: mknod d1/d8/d9/db/d15/d26/ceb 0 2024-09-13T02:54:18.225 INFO:tasks.workunit.client.1.smithi131.stdout:2/680: write d5/d6e/f92 [3966016,77661] 0 2024-09-13T02:54:18.227 INFO:tasks.workunit.client.1.smithi131.stdout:2/681: write d5/d31/d1d/d32/d3b/d67/d87/db4/dbc/d48/d4c/f84 [524164,11790] 0 2024-09-13T02:54:18.228 INFO:tasks.workunit.client.1.smithi131.stdout:2/682: creat d5/d18/d68/fe9 x:0 0 0 2024-09-13T02:54:18.229 INFO:tasks.workunit.client.1.smithi131.stdout:2/683: symlink d5/d6e/dda/lea 0 2024-09-13T02:54:18.229 INFO:tasks.workunit.client.1.smithi131.stdout:2/684: stat d5/d31/d1d/c27 0 2024-09-13T02:54:18.233 INFO:tasks.workunit.client.1.smithi131.stdout:2/685: dread d5/d34/fa7 [0,4194304] 0 2024-09-13T02:54:18.233 INFO:tasks.workunit.client.1.smithi131.stdout:2/686: mknod d5/ceb 0 2024-09-13T02:54:18.234 INFO:tasks.workunit.client.1.smithi131.stdout:2/687: creat d5/d31/d21/d57/fec x:0 0 0 2024-09-13T02:54:18.234 INFO:tasks.workunit.client.1.smithi131.stdout:2/688: fsync d5/d6e/fb6 0 2024-09-13T02:54:18.235 INFO:tasks.workunit.client.1.smithi131.stdout:2/689: symlink d5/d34/d42/led 0 2024-09-13T02:54:18.236 INFO:tasks.workunit.client.1.smithi131.stdout:2/690: rename d5/d31/d21/f72 to d5/d18/d68/fee 0 2024-09-13T02:54:18.236 INFO:tasks.workunit.client.1.smithi131.stdout:2/691: truncate d5/d18/d68/de3/d66/f6c 2427621 0 2024-09-13T02:54:18.237 INFO:tasks.workunit.client.1.smithi131.stdout:2/692: truncate d5/d31/d1d/d32/d3b/fd9 73826 0 2024-09-13T02:54:18.244 INFO:tasks.workunit.client.1.smithi131.stdout:4/765: dwrite d1/d18/d43/fdd [0,4194304] 0 2024-09-13T02:54:18.245 INFO:tasks.workunit.client.1.smithi131.stdout:1/629: dwrite dd/d51/d8a/fcc [0,4194304] 0 2024-09-13T02:54:18.255 INFO:tasks.workunit.client.1.smithi131.stdout:1/630: dread dd/d33/d94/fd7 [0,4194304] 0 2024-09-13T02:54:18.256 INFO:tasks.workunit.client.1.smithi131.stdout:1/631: mknod dd/d26/d44/d6d/ce9 0 2024-09-13T02:54:18.257 INFO:tasks.workunit.client.1.smithi131.stdout:1/632: getdents dd/d51/d5a/da3 0 2024-09-13T02:54:18.258 INFO:tasks.workunit.client.1.smithi131.stdout:1/633: mkdir dd/d33/d42/d47/dd1/dea 0 2024-09-13T02:54:18.275 INFO:tasks.workunit.client.1.smithi131.stdout:4/766: dwrite d1/d18/f9a [0,4194304] 0 2024-09-13T02:54:18.276 INFO:tasks.workunit.client.1.smithi131.stdout:4/767: chown d1/d18/d34/fb5 0 1 2024-09-13T02:54:18.278 INFO:tasks.workunit.client.1.smithi131.stdout:4/768: mknod d1/d18/d43/d97/dba/d7a/dc5/c105 0 2024-09-13T02:54:18.278 INFO:tasks.workunit.client.1.smithi131.stdout:1/634: dwrite dd/d26/f87 [0,4194304] 0 2024-09-13T02:54:18.283 INFO:tasks.workunit.client.1.smithi131.stdout:1/635: link dd/f20 dd/d51/d5a/da3/feb 0 2024-09-13T02:54:18.284 INFO:tasks.workunit.client.1.smithi131.stdout:1/636: write dd/fe5 [5028819,10502] 0 2024-09-13T02:54:18.287 INFO:tasks.workunit.client.1.smithi131.stdout:1/637: getdents dd/d51/d8a 0 2024-09-13T02:54:18.287 INFO:tasks.workunit.client.1.smithi131.stdout:1/638: chown dd/d26/f5f 2068 1 2024-09-13T02:54:18.287 INFO:tasks.workunit.client.1.smithi131.stdout:1/639: creat dd/d26/d2a/fec x:0 0 0 2024-09-13T02:54:18.287 INFO:tasks.workunit.client.1.smithi131.stdout:1/640: read - dd/d33/d80/fc6 zero size 2024-09-13T02:54:18.287 INFO:tasks.workunit.client.1.smithi131.stdout:4/769: dread d1/d18/d43/d97/dba/d22/d73/f87 [0,4194304] 0 2024-09-13T02:54:18.288 INFO:tasks.workunit.client.1.smithi131.stdout:1/641: rename dd/ld2 to dd/d33/d94/db4/led 0 2024-09-13T02:54:18.289 INFO:tasks.workunit.client.1.smithi131.stdout:4/770: creat d1/d18/d43/d97/dba/d19/d29/d33/d3a/da8/dff/f106 x:0 0 0 2024-09-13T02:54:18.289 INFO:tasks.workunit.client.1.smithi131.stdout:4/771: write d1/d18/d43/d97/dba/d22/d49/f4d [6492220,129891] 0 2024-09-13T02:54:18.289 INFO:tasks.workunit.client.1.smithi131.stdout:1/642: creat dd/d33/d42/d47/dd1/fee x:0 0 0 2024-09-13T02:54:18.290 INFO:tasks.workunit.client.1.smithi131.stdout:1/643: fdatasync dd/f13 0 2024-09-13T02:54:18.290 INFO:tasks.workunit.client.1.smithi131.stdout:1/644: link dd/d33/d42/d47/l8e dd/d26/d2a/d69/lef 0 2024-09-13T02:54:18.296 INFO:tasks.workunit.client.1.smithi131.stdout:1/645: write dd/d33/d94/fd7 [1779273,34477] 0 2024-09-13T02:54:18.296 INFO:tasks.workunit.client.1.smithi131.stdout:1/646: creat dd/d26/d2a/d69/ff0 x:0 0 0 2024-09-13T02:54:18.299 INFO:tasks.workunit.client.1.smithi131.stdout:1/647: link dd/f16 dd/d26/d2a/ff1 0 2024-09-13T02:54:18.299 INFO:tasks.workunit.client.1.smithi131.stdout:1/648: creat dd/d26/d2a/d2c/d4b/ff2 x:0 0 0 2024-09-13T02:54:18.306 INFO:tasks.workunit.client.1.smithi131.stdout:4/772: dwrite d1/f45 [0,4194304] 0 2024-09-13T02:54:18.309 INFO:tasks.workunit.client.1.smithi131.stdout:4/773: rename d1/d18/d34/d62/d78/db6/f104 to d1/d18/d43/d65/dc7/f107 0 2024-09-13T02:54:18.317 INFO:tasks.workunit.client.1.smithi131.stdout:1/649: dwrite dd/d26/f35 [4194304,4194304] 0 2024-09-13T02:54:18.319 INFO:tasks.workunit.client.1.smithi131.stdout:4/774: rename d1/d18/d43/d97/dba/d19/d29 to d1/d18/d34/d4e/d108 0 2024-09-13T02:54:18.319 INFO:tasks.workunit.client.1.smithi131.stdout:4/775: chown d1/d18/d43/d65/dbd/dc1/d13 115115130 1 2024-09-13T02:54:18.321 INFO:tasks.workunit.client.1.smithi131.stdout:1/650: rename dd/d26/f2d to dd/d33/d42/d47/ff3 0 2024-09-13T02:54:18.322 INFO:tasks.workunit.client.1.smithi131.stdout:1/651: symlink dd/lf4 0 2024-09-13T02:54:18.323 INFO:tasks.workunit.client.1.smithi131.stdout:1/652: getdents dd/d51/d8a/d95 0 2024-09-13T02:54:18.323 INFO:tasks.workunit.client.1.smithi131.stdout:1/653: truncate dd/d51/f70 1491094 0 2024-09-13T02:54:18.328 INFO:tasks.workunit.client.1.smithi131.stdout:4/776: dread d1/d18/d43/d97/dba/d22/d73/de0/fe1 [0,4194304] 0 2024-09-13T02:54:18.330 INFO:tasks.workunit.client.1.smithi131.stdout:1/654: write dd/d33/f8f [1630370,73307] 0 2024-09-13T02:54:18.330 INFO:tasks.workunit.client.1.smithi131.stdout:1/655: chown dd/d26/d44/d6d/l9c 0 1 2024-09-13T02:54:18.330 INFO:tasks.workunit.client.1.smithi131.stdout:1/656: stat dd/d26/d44/f22 0 2024-09-13T02:54:18.331 INFO:tasks.workunit.client.1.smithi131.stdout:1/657: chown dd/d33/d42/d47/dd1/dea 22 1 2024-09-13T02:54:18.331 INFO:tasks.workunit.client.1.smithi131.stdout:1/658: fsync dd/d26/d2a/fe3 0 2024-09-13T02:54:18.331 INFO:tasks.workunit.client.1.smithi131.stdout:1/659: link dd/d26/d2a/d69/f7b dd/d26/d44/ff5 0 2024-09-13T02:54:18.332 INFO:tasks.workunit.client.1.smithi131.stdout:1/660: rename dd/d26/f35 to dd/d51/db3/ff6 0 2024-09-13T02:54:18.333 INFO:tasks.workunit.client.1.smithi131.stdout:1/661: mknod dd/d33/d80/cf7 0 2024-09-13T02:54:18.333 INFO:tasks.workunit.client.1.smithi131.stdout:1/662: readlink dd/d51/db3/le0 0 2024-09-13T02:54:18.337 INFO:tasks.workunit.client.1.smithi131.stdout:4/777: dread d1/d18/f9a [0,4194304] 0 2024-09-13T02:54:18.338 INFO:tasks.workunit.client.1.smithi131.stdout:4/778: mkdir d1/d18/d43/d97/d109 0 2024-09-13T02:54:18.338 INFO:tasks.workunit.client.1.smithi131.stdout:4/779: mknod d1/d18/d81/c10a 0 2024-09-13T02:54:18.339 INFO:tasks.workunit.client.1.smithi131.stdout:4/780: symlink d1/d18/d81/l10b 0 2024-09-13T02:54:18.339 INFO:tasks.workunit.client.1.smithi131.stdout:4/781: write d1/d18/d81/f8a [911641,7076] 0 2024-09-13T02:54:18.341 INFO:tasks.workunit.client.1.smithi131.stdout:1/663: write dd/d33/d94/db4/fb9 [256660,62896] 0 2024-09-13T02:54:18.342 INFO:tasks.workunit.client.1.smithi131.stdout:1/664: rename dd/d33/d42/d47/l6e to dd/d26/d44/lf8 0 2024-09-13T02:54:18.346 INFO:tasks.workunit.client.1.smithi131.stdout:1/665: dread dd/d26/d2a/d69/f7b [0,4194304] 0 2024-09-13T02:54:18.348 INFO:tasks.workunit.client.1.smithi131.stdout:1/666: unlink dd/d33/d42/f52 0 2024-09-13T02:54:18.357 INFO:tasks.workunit.client.1.smithi131.stdout:1/667: dread dd/d51/d8a/fbe [0,4194304] 0 2024-09-13T02:54:18.357 INFO:tasks.workunit.client.1.smithi131.stdout:1/668: write dd/d51/d5a/da3/fde [919188,50947] 0 2024-09-13T02:54:18.358 INFO:tasks.workunit.client.1.smithi131.stdout:4/782: dwrite d1/d18/d34/d4e/d108/d33/d3a/da8/dff/f106 [0,4194304] 0 2024-09-13T02:54:18.358 INFO:tasks.workunit.client.1.smithi131.stdout:4/783: readlink d1/d18/d34/d4e/d108/d8d/la9 0 2024-09-13T02:54:18.358 INFO:tasks.workunit.client.1.smithi131.stdout:1/669: unlink dd/d26/d44/d6d/fdd 0 2024-09-13T02:54:18.360 INFO:tasks.workunit.client.1.smithi131.stdout:4/784: mknod d1/d18/d43/d97/dba/d19/dee/c10c 0 2024-09-13T02:54:18.362 INFO:tasks.workunit.client.1.smithi131.stdout:8/663: sync 2024-09-13T02:54:18.362 INFO:tasks.workunit.client.1.smithi131.stdout:9/624: sync 2024-09-13T02:54:18.362 INFO:tasks.workunit.client.1.smithi131.stdout:5/542: sync 2024-09-13T02:54:18.362 INFO:tasks.workunit.client.1.smithi131.stdout:0/864: sync 2024-09-13T02:54:18.362 INFO:tasks.workunit.client.1.smithi131.stdout:9/625: dread - d0/d3/d14/fbd zero size 2024-09-13T02:54:18.362 INFO:tasks.workunit.client.1.smithi131.stdout:0/865: chown d0/de/d1f 566554 1 2024-09-13T02:54:18.362 INFO:tasks.workunit.client.1.smithi131.stdout:1/670: rename dd/d26/d2a/d69/f7b to dd/d26/d2a/d2c/d4b/ff9 0 2024-09-13T02:54:18.362 INFO:tasks.workunit.client.1.smithi131.stdout:9/626: creat d0/d3/d14/dbf/fcd x:0 0 0 2024-09-13T02:54:18.362 INFO:tasks.workunit.client.1.smithi131.stdout:3/603: sync 2024-09-13T02:54:18.362 INFO:tasks.workunit.client.1.smithi131.stdout:7/612: sync 2024-09-13T02:54:18.362 INFO:tasks.workunit.client.1.smithi131.stdout:7/613: truncate d1b/d73/f70 286340 0 2024-09-13T02:54:18.362 INFO:tasks.workunit.client.1.smithi131.stdout:3/604: truncate d2/d4/d7/d1d/d24/fb6 158358 0 2024-09-13T02:54:18.363 INFO:tasks.workunit.client.1.smithi131.stdout:5/543: mknod d1/d2f/d4f/cba 0 2024-09-13T02:54:18.363 INFO:tasks.workunit.client.1.smithi131.stdout:1/671: dread dd/d26/d2a/d2c/f34 [4194304,4194304] 0 2024-09-13T02:54:18.363 INFO:tasks.workunit.client.1.smithi131.stdout:8/664: mknod db/d1d/d1f/d67/d81/ccc 0 2024-09-13T02:54:18.365 INFO:tasks.workunit.client.1.smithi131.stdout:9/627: creat d0/d3/d14/d1a/d2a/d5e/da2/d39/dc2/fce x:0 0 0 2024-09-13T02:54:18.367 INFO:tasks.workunit.client.1.smithi131.stdout:5/544: link d1/d2f/l79 d1/d2f/d4f/lbb 0 2024-09-13T02:54:18.367 INFO:tasks.workunit.client.1.smithi131.stdout:5/545: creat d1/d2f/d4f/fbc x:0 0 0 2024-09-13T02:54:18.367 INFO:tasks.workunit.client.1.smithi131.stdout:5/546: fsync d1/d21/d74/d78/d98/fa8 0 2024-09-13T02:54:18.368 INFO:tasks.workunit.client.1.smithi131.stdout:3/605: dread d2/d4/d1a/f8b [0,4194304] 0 2024-09-13T02:54:18.368 INFO:tasks.workunit.client.1.smithi131.stdout:3/606: write d2/d4/d7/d1d/d24/f51 [503170,113951] 0 2024-09-13T02:54:18.368 INFO:tasks.workunit.client.1.smithi131.stdout:3/607: dread - d2/d4/d1a/d31/da7/fae zero size 2024-09-13T02:54:18.369 INFO:tasks.workunit.client.1.smithi131.stdout:3/608: chown d2/dc/c46 3 1 2024-09-13T02:54:18.369 INFO:tasks.workunit.client.1.smithi131.stdout:1/672: unlink dd/d51/d8a/fe1 0 2024-09-13T02:54:18.370 INFO:tasks.workunit.client.1.smithi131.stdout:8/665: creat db/d1d/d34/d4e/d7e/fcd x:0 0 0 2024-09-13T02:54:18.370 INFO:tasks.workunit.client.1.smithi131.stdout:8/666: write db/f30 [5042910,57930] 0 2024-09-13T02:54:18.370 INFO:tasks.workunit.client.1.smithi131.stdout:8/667: stat db/d1d 0 2024-09-13T02:54:18.370 INFO:tasks.workunit.client.1.smithi131.stdout:8/668: chown db/d1d/d34/d4e/d7e/lc2 1 1 2024-09-13T02:54:18.371 INFO:tasks.workunit.client.1.smithi131.stdout:4/785: dread d1/d18/d43/d97/dba/d22/d73/de0/fe1 [0,4194304] 0 2024-09-13T02:54:18.371 INFO:tasks.workunit.client.1.smithi131.stdout:9/628: symlink d0/d3/d14/d1a/d2a/d75/lcf 0 2024-09-13T02:54:18.371 INFO:tasks.workunit.client.1.smithi131.stdout:9/629: creat d0/d3/d14/d1a/d2a/fd0 x:0 0 0 2024-09-13T02:54:18.371 INFO:tasks.workunit.client.1.smithi131.stdout:9/630: fdatasync d0/d4d/f9d 0 2024-09-13T02:54:18.371 INFO:tasks.workunit.client.1.smithi131.stdout:9/631: creat d0/d3/d14/d1a/d2a/d5e/fd1 x:0 0 0 2024-09-13T02:54:18.371 INFO:tasks.workunit.client.1.smithi131.stdout:9/632: write d0/d3/d14/d95/fa8 [585676,37291] 0 2024-09-13T02:54:18.372 INFO:tasks.workunit.client.1.smithi131.stdout:9/633: chown d0/l22 1867869060 1 2024-09-13T02:54:18.372 INFO:tasks.workunit.client.1.smithi131.stdout:7/614: dread d1b/d3b/d31/d5f/f79 [0,4194304] 0 2024-09-13T02:54:18.373 INFO:tasks.workunit.client.1.smithi131.stdout:3/609: mkdir d2/d4/d7/dc8 0 2024-09-13T02:54:18.380 INFO:tasks.workunit.client.1.smithi131.stdout:0/866: dwrite d0/de/d45/d86/de8/f64 [0,4194304] 0 2024-09-13T02:54:18.381 INFO:tasks.workunit.client.1.smithi131.stdout:8/669: truncate db/d1d/d1f/d41/f55 2578030 0 2024-09-13T02:54:18.381 INFO:tasks.workunit.client.1.smithi131.stdout:8/670: creat db/d1d/d1f/d41/d50/fce x:0 0 0 2024-09-13T02:54:18.383 INFO:tasks.workunit.client.1.smithi131.stdout:9/634: creat d0/d3/d14/d1a/d2a/d75/fd2 x:0 0 0 2024-09-13T02:54:18.383 INFO:tasks.workunit.client.1.smithi131.stdout:7/615: mknod d1b/d73/cd1 0 2024-09-13T02:54:18.384 INFO:tasks.workunit.client.1.smithi131.stdout:3/610: rename d2/d4/d7/d1d/f30 to d2/d4/d1a/d31/d48/fc9 0 2024-09-13T02:54:18.384 INFO:tasks.workunit.client.1.smithi131.stdout:4/786: write d1/d18/d43/d97/dba/d7a/dd3/fe7 [2509193,21444] 0 2024-09-13T02:54:18.384 INFO:tasks.workunit.client.1.smithi131.stdout:4/787: write d1/d18/d81/f8e [4580586,31909] 0 2024-09-13T02:54:18.384 INFO:tasks.workunit.client.1.smithi131.stdout:4/788: stat d1/d18/d34/d4e/d108/d33/d3a/ld7 0 2024-09-13T02:54:18.384 INFO:tasks.workunit.client.1.smithi131.stdout:4/789: write d1/ff4 [574279,97042] 0 2024-09-13T02:54:18.385 INFO:tasks.workunit.client.1.smithi131.stdout:0/867: mknod d0/de/d1f/d22/d3d/d43/c130 0 2024-09-13T02:54:18.385 INFO:tasks.workunit.client.1.smithi131.stdout:0/868: fsync d0/de/d1f/d22/d3d/d87/f89 0 2024-09-13T02:54:18.387 INFO:tasks.workunit.client.1.smithi131.stdout:8/671: unlink db/cc 0 2024-09-13T02:54:18.387 INFO:tasks.workunit.client.1.smithi131.stdout:9/635: symlink d0/d4d/d98/dbb/ld3 0 2024-09-13T02:54:18.389 INFO:tasks.workunit.client.1.smithi131.stdout:7/616: unlink d1b/f2f 0 2024-09-13T02:54:18.389 INFO:tasks.workunit.client.1.smithi131.stdout:7/617: stat d1b 0 2024-09-13T02:54:18.390 INFO:tasks.workunit.client.1.smithi131.stdout:3/611: mkdir d2/dc/db1/dca 0 2024-09-13T02:54:18.402 INFO:tasks.workunit.client.1.smithi131.stdout:5/547: dwrite d1/d21/f6d [0,4194304] 0 2024-09-13T02:54:18.403 INFO:tasks.workunit.client.1.smithi131.stdout:0/869: dread d0/de/d1f/d22/d3d/d55/f6b [0,4194304] 0 2024-09-13T02:54:18.403 INFO:tasks.workunit.client.1.smithi131.stdout:9/636: read d0/d4d/f9d [145775,118199] 0 2024-09-13T02:54:18.406 INFO:tasks.workunit.client.1.smithi131.stdout:7/618: link d1b/d3b/d31/c58 d1b/d3b/d51/d62/d6d/db5/cd2 0 2024-09-13T02:54:18.407 INFO:tasks.workunit.client.1.smithi131.stdout:3/612: stat d2/d4/d76/d9f/d41/d5c/l50 0 2024-09-13T02:54:18.407 INFO:tasks.workunit.client.1.smithi131.stdout:0/870: rename d0/d2/d41/fe2 to d0/d2/d41/f131 0 2024-09-13T02:54:18.409 INFO:tasks.workunit.client.1.smithi131.stdout:5/548: mkdir d1/d1c/d87/dbd 0 2024-09-13T02:54:18.410 INFO:tasks.workunit.client.1.smithi131.stdout:9/637: mknod d0/d4d/d55/d76/d96/cd4 0 2024-09-13T02:54:18.413 INFO:tasks.workunit.client.1.smithi131.stdout:4/790: dwrite d1/d18/d43/d97/dba/d22/fe3 [0,4194304] 0 2024-09-13T02:54:18.413 INFO:tasks.workunit.client.1.smithi131.stdout:9/638: rename d0/d3/d14/d17/l2b to d0/d3/d14/d1a/d2a/d5e/d79/ld5 0 2024-09-13T02:54:18.417 INFO:tasks.workunit.client.1.smithi131.stdout:8/672: dwrite db/d1d/d34/f36 [0,4194304] 0 2024-09-13T02:54:18.418 INFO:tasks.workunit.client.1.smithi131.stdout:4/791: getdents d1/d18/d34 0 2024-09-13T02:54:18.418 INFO:tasks.workunit.client.1.smithi131.stdout:4/792: creat d1/d18/d43/d7d/f10d x:0 0 0 2024-09-13T02:54:18.430 INFO:tasks.workunit.client.1.smithi131.stdout:4/793: dread d1/d18/d43/d97/dba/d22/d73/fcd [0,4194304] 0 2024-09-13T02:54:18.431 INFO:tasks.workunit.client.1.smithi131.stdout:4/794: link d1/d18/d34/d62/f9c d1/d18/d43/d65/dbd/dc1/f10e 0 2024-09-13T02:54:18.436 INFO:tasks.workunit.client.1.smithi131.stdout:8/673: dread db/d1d/d34/f36 [0,4194304] 0 2024-09-13T02:54:18.437 INFO:tasks.workunit.client.1.smithi131.stdout:8/674: rename db/d1d/d1f/d41/d50/fce to db/d2b/d39/d56/fcf 0 2024-09-13T02:54:18.445 INFO:tasks.workunit.client.1.smithi131.stdout:5/549: write d1/d2f/d33/f75 [282329,48354] 0 2024-09-13T02:54:18.447 INFO:tasks.workunit.client.1.smithi131.stdout:5/550: rename d1/d2f/d8c to d1/d21/d74/d78/dbe 0 2024-09-13T02:54:18.447 INFO:tasks.workunit.client.1.smithi131.stdout:5/551: fdatasync d1/d2f/d33/f89 0 2024-09-13T02:54:18.447 INFO:tasks.workunit.client.1.smithi131.stdout:4/795: dread d1/d18/d81/f8e [0,4194304] 0 2024-09-13T02:54:18.447 INFO:tasks.workunit.client.1.smithi131.stdout:4/796: readlink d1/d18/d43/d65/dbd/dc1/lad 0 2024-09-13T02:54:18.447 INFO:tasks.workunit.client.1.smithi131.stdout:5/552: truncate d1/d50/fa3 995384 0 2024-09-13T02:54:18.448 INFO:tasks.workunit.client.1.smithi131.stdout:5/553: chown d1/d1c/d8e/f5c 506 1 2024-09-13T02:54:18.448 INFO:tasks.workunit.client.1.smithi131.stdout:4/797: unlink d1/d18/d34/d62/da3/da6/fc0 0 2024-09-13T02:54:18.449 INFO:tasks.workunit.client.1.smithi131.stdout:4/798: truncate d1/d18/d34/d62/d78/ffb 378221 0 2024-09-13T02:54:18.451 INFO:tasks.workunit.client.1.smithi131.stdout:1/673: dwrite dd/d33/d94/f97 [0,4194304] 0 2024-09-13T02:54:18.452 INFO:tasks.workunit.client.1.smithi131.stdout:1/674: write dd/d26/d2a/fe3 [380757,62125] 0 2024-09-13T02:54:18.453 INFO:tasks.workunit.client.1.smithi131.stdout:1/675: creat dd/d51/dad/ffa x:0 0 0 2024-09-13T02:54:18.455 INFO:tasks.workunit.client.1.smithi131.stdout:9/639: dwrite d0/d3/f5b [0,4194304] 0 2024-09-13T02:54:18.455 INFO:tasks.workunit.client.1.smithi131.stdout:7/619: dwrite f3 [0,4194304] 0 2024-09-13T02:54:18.456 INFO:tasks.workunit.client.1.smithi131.stdout:8/675: dwrite db/d1d/d1f/f76 [0,4194304] 0 2024-09-13T02:54:18.456 INFO:tasks.workunit.client.1.smithi131.stdout:0/871: dwrite d0/de/d1f/d22/d3d/d55/d63/d95/f10d [0,4194304] 0 2024-09-13T02:54:18.456 INFO:tasks.workunit.client.1.smithi131.stdout:0/872: stat d0/de/d1f/d22/d31/fe4 0 2024-09-13T02:54:18.458 INFO:tasks.workunit.client.1.smithi131.stdout:9/640: creat d0/d3/d14/d17/db0/fd6 x:0 0 0 2024-09-13T02:54:18.459 INFO:tasks.workunit.client.1.smithi131.stdout:7/620: unlink d1b/d3b/d46/d4b/d57/d9d/c9f 0 2024-09-13T02:54:18.460 INFO:tasks.workunit.client.1.smithi131.stdout:7/621: write d1b/d3b/d51/fce [521544,68568] 0 2024-09-13T02:54:18.460 INFO:tasks.workunit.client.1.smithi131.stdout:7/622: fsync d1b/d23/f47 0 2024-09-13T02:54:18.460 INFO:tasks.workunit.client.1.smithi131.stdout:7/623: stat d1b/d3b/d31/d38 0 2024-09-13T02:54:18.463 INFO:tasks.workunit.client.1.smithi131.stdout:8/676: symlink db/d1d/d1f/d41/d50/ld0 0 2024-09-13T02:54:18.464 INFO:tasks.workunit.client.1.smithi131.stdout:8/677: readlink db/d1d/d1f/d66/lc8 0 2024-09-13T02:54:18.464 INFO:tasks.workunit.client.1.smithi131.stdout:8/678: readlink db/d1d/d34/d4e/l8a 0 2024-09-13T02:54:18.464 INFO:tasks.workunit.client.1.smithi131.stdout:8/679: chown db/d1d/d34/d4e/d7e/dc4 59 1 2024-09-13T02:54:18.464 INFO:tasks.workunit.client.1.smithi131.stdout:8/680: write db/d2b/d39/d56/f57 [690160,31651] 0 2024-09-13T02:54:18.464 INFO:tasks.workunit.client.1.smithi131.stdout:8/681: write db/d2b/fc7 [470832,124984] 0 2024-09-13T02:54:18.464 INFO:tasks.workunit.client.1.smithi131.stdout:0/873: dread d0/de/d1f/d22/d3d/d43/dc2/dd3/fee [0,4194304] 0 2024-09-13T02:54:18.469 INFO:tasks.workunit.client.1.smithi131.stdout:9/641: rename d0/l19 to d0/d3/dac/ld7 0 2024-09-13T02:54:18.470 INFO:tasks.workunit.client.1.smithi131.stdout:7/624: mknod d1b/d3b/d31/dcb/cd3 0 2024-09-13T02:54:18.470 INFO:tasks.workunit.client.1.smithi131.stdout:7/625: fsync d1b/d3b/d51/d62/d6d/fb8 0 2024-09-13T02:54:18.470 INFO:tasks.workunit.client.1.smithi131.stdout:0/874: mknod d0/de/d45/d86/de8/dda/c132 0 2024-09-13T02:54:18.472 INFO:tasks.workunit.client.1.smithi131.stdout:9/642: truncate d0/d3/d14/d1a/f1d 1927118 0 2024-09-13T02:54:18.472 INFO:tasks.workunit.client.1.smithi131.stdout:9/643: write d0/d3/d14/d1a/dc6/d8a/f8e [815764,53221] 0 2024-09-13T02:54:18.472 INFO:tasks.workunit.client.1.smithi131.stdout:9/644: chown d0/d3/d14/d1a/d2a/d5e/l7f 720792308 1 2024-09-13T02:54:18.472 INFO:tasks.workunit.client.1.smithi131.stdout:9/645: truncate d0/d4d/d98/fc4 518392 0 2024-09-13T02:54:18.472 INFO:tasks.workunit.client.1.smithi131.stdout:7/626: rename d1b/d3b/d46/d4b/d57/d7b/l6f to d1b/d3b/d31/dcb/ld4 0 2024-09-13T02:54:18.473 INFO:tasks.workunit.client.1.smithi131.stdout:4/799: dwrite d1/d18/d43/d97/dba/d22/d73/fcd [0,4194304] 0 2024-09-13T02:54:18.473 INFO:tasks.workunit.client.1.smithi131.stdout:4/800: chown d1/d18/d43/d97/dba 578072 1 2024-09-13T02:54:18.474 INFO:tasks.workunit.client.1.smithi131.stdout:0/875: creat d0/de/d45/dfa/f133 x:0 0 0 2024-09-13T02:54:18.474 INFO:tasks.workunit.client.1.smithi131.stdout:8/682: dread db/d1d/d1f/d41/f62 [0,4194304] 0 2024-09-13T02:54:18.474 INFO:tasks.workunit.client.1.smithi131.stdout:9/646: truncate d0/d3/d14/d1a/d2a/d5e/da2/f6a 1606033 0 2024-09-13T02:54:18.476 INFO:tasks.workunit.client.1.smithi131.stdout:0/876: dread d0/de/d1f/d22/d31/fba [0,4194304] 0 2024-09-13T02:54:18.476 INFO:tasks.workunit.client.1.smithi131.stdout:0/877: stat d0/de/d45/d86/de8/f6f 0 2024-09-13T02:54:18.477 INFO:tasks.workunit.client.1.smithi131.stdout:1/676: dwrite dd/d51/d5a/f73 [0,4194304] 0 2024-09-13T02:54:18.479 INFO:tasks.workunit.client.1.smithi131.stdout:9/647: rename d0/d3f/l85 to d0/d3/d14/d67/ld8 0 2024-09-13T02:54:18.480 INFO:tasks.workunit.client.1.smithi131.stdout:0/878: mkdir d0/de/d1f/d22/d3d/d55/d63/d94/da5/d134 0 2024-09-13T02:54:18.481 INFO:tasks.workunit.client.1.smithi131.stdout:0/879: chown d0/de/d1f/d22/d3d/d87/c111 155053 1 2024-09-13T02:54:18.481 INFO:tasks.workunit.client.1.smithi131.stdout:0/880: chown d0/d2/d62/f8f 31753333 1 2024-09-13T02:54:18.481 INFO:tasks.workunit.client.1.smithi131.stdout:4/801: getdents d1/d18/d43/dd9 0 2024-09-13T02:54:18.485 INFO:tasks.workunit.client.1.smithi131.stdout:1/677: mkdir dd/d33/d94/dfb 0 2024-09-13T02:54:18.487 INFO:tasks.workunit.client.1.smithi131.stdout:8/683: dread db/d2b/d39/d56/f95 [0,4194304] 0 2024-09-13T02:54:18.487 INFO:tasks.workunit.client.1.smithi131.stdout:9/648: creat d0/d3/d14/d1a/d2a/d5e/da2/d39/fd9 x:0 0 0 2024-09-13T02:54:18.488 INFO:tasks.workunit.client.1.smithi131.stdout:0/881: rmdir d0/de/d1f/d22/d3d/d55/d63/d94/da5 39 2024-09-13T02:54:18.489 INFO:tasks.workunit.client.1.smithi131.stdout:4/802: symlink d1/d18/d43/dd9/l10f 0 2024-09-13T02:54:18.490 INFO:tasks.workunit.client.1.smithi131.stdout:9/649: dread d0/d3/d14/d1a/d2a/d5e/da2/d39/f9e [0,4194304] 0 2024-09-13T02:54:18.490 INFO:tasks.workunit.client.1.smithi131.stdout:1/678: symlink dd/d51/d8a/lfc 0 2024-09-13T02:54:18.491 INFO:tasks.workunit.client.1.smithi131.stdout:0/882: mkdir d0/de/d45/dfa/d119/d135 0 2024-09-13T02:54:18.492 INFO:tasks.workunit.client.1.smithi131.stdout:4/803: creat d1/d18/f110 x:0 0 0 2024-09-13T02:54:18.494 INFO:tasks.workunit.client.1.smithi131.stdout:9/650: unlink d0/d3/d14/d1a/d2a/d5e/da2/d39/dc2/fce 0 2024-09-13T02:54:18.497 INFO:tasks.workunit.client.1.smithi131.stdout:1/679: link dd/d33/d42/d6f/f71 dd/d33/d42/ffd 0 2024-09-13T02:54:18.497 INFO:tasks.workunit.client.1.smithi131.stdout:1/680: creat dd/ffe x:0 0 0 2024-09-13T02:54:18.497 INFO:tasks.workunit.client.1.smithi131.stdout:1/681: dread - dd/d26/f5f zero size 2024-09-13T02:54:18.500 INFO:tasks.workunit.client.1.smithi131.stdout:1/682: link dd/d26/d44/d6d/l9c dd/d51/db3/lff 0 2024-09-13T02:54:18.500 INFO:tasks.workunit.client.1.smithi131.stdout:1/683: write dd/d33/d42/f48 [995666,87633] 0 2024-09-13T02:54:18.500 INFO:tasks.workunit.client.1.smithi131.stdout:1/684: chown dd/d26/d2a/d69/l7a 2707740 1 2024-09-13T02:54:18.500 INFO:tasks.workunit.client.1.smithi131.stdout:1/685: write dd/d26/d44/ff5 [5046079,58803] 0 2024-09-13T02:54:18.501 INFO:tasks.workunit.client.1.smithi131.stdout:0/883: read d0/de/d45/d86/de8/f6f [1574461,18224] 0 2024-09-13T02:54:18.501 INFO:tasks.workunit.client.1.smithi131.stdout:0/884: dread - d0/f11a zero size 2024-09-13T02:54:18.502 INFO:tasks.workunit.client.1.smithi131.stdout:9/651: read d0/d3/d14/d17/f31 [892720,64088] 0 2024-09-13T02:54:18.502 INFO:tasks.workunit.client.1.smithi131.stdout:9/652: write d0/d3/d14/fb9 [930271,47510] 0 2024-09-13T02:54:18.503 INFO:tasks.workunit.client.1.smithi131.stdout:1/686: unlink dd/ce 0 2024-09-13T02:54:18.504 INFO:tasks.workunit.client.1.smithi131.stdout:4/804: read d1/d18/d43/d97/fa5 [2529710,50418] 0 2024-09-13T02:54:18.504 INFO:tasks.workunit.client.1.smithi131.stdout:9/653: symlink d0/d4d/d98/lda 0 2024-09-13T02:54:18.504 INFO:tasks.workunit.client.1.smithi131.stdout:9/654: stat d0/d3/d14/d1a/d2a/d5e/f83 0 2024-09-13T02:54:18.505 INFO:tasks.workunit.client.1.smithi131.stdout:0/885: mkdir d0/de/d136 0 2024-09-13T02:54:18.505 INFO:tasks.workunit.client.1.smithi131.stdout:4/805: mknod d1/d18/d34/d62/da3/ded/c111 0 2024-09-13T02:54:18.506 INFO:tasks.workunit.client.1.smithi131.stdout:9/655: symlink d0/d4d/d98/dbb/ldb 0 2024-09-13T02:54:18.506 INFO:tasks.workunit.client.1.smithi131.stdout:9/656: creat d0/fdc x:0 0 0 2024-09-13T02:54:18.506 INFO:tasks.workunit.client.1.smithi131.stdout:9/657: dread - d0/d3/d14/dbf/fc7 zero size 2024-09-13T02:54:18.507 INFO:tasks.workunit.client.1.smithi131.stdout:0/886: stat d0/de/d1f/d22/d3d/d55/d63/lf8 0 2024-09-13T02:54:18.509 INFO:tasks.workunit.client.1.smithi131.stdout:0/887: mkdir d0/de/d1f/d22/d31/d137 0 2024-09-13T02:54:18.509 INFO:tasks.workunit.client.1.smithi131.stdout:0/888: dread - d0/de/d1f/d22/d31/d39/da8/fbb zero size 2024-09-13T02:54:18.510 INFO:tasks.workunit.client.1.smithi131.stdout:0/889: symlink d0/de/l138 0 2024-09-13T02:54:18.517 INFO:tasks.workunit.client.1.smithi131.stdout:9/658: read d0/d3/d14/d17/f21 [3962186,68490] 0 2024-09-13T02:54:18.517 INFO:tasks.workunit.client.1.smithi131.stdout:8/684: dwrite db/d2b/f6f [0,4194304] 0 2024-09-13T02:54:18.519 INFO:tasks.workunit.client.1.smithi131.stdout:9/659: mknod d0/d3/d14/d1a/d2a/d5e/da2/d39/dc2/cdd 0 2024-09-13T02:54:18.520 INFO:tasks.workunit.client.1.smithi131.stdout:8/685: creat db/d1d/d1f/d5c/fd1 x:0 0 0 2024-09-13T02:54:18.522 INFO:tasks.workunit.client.1.smithi131.stdout:8/686: creat db/d1d/d34/d4e/d7e/d90/fd2 x:0 0 0 2024-09-13T02:54:18.522 INFO:tasks.workunit.client.1.smithi131.stdout:8/687: chown db/d1d/d1f/d67/d81 59706 1 2024-09-13T02:54:18.522 INFO:tasks.workunit.client.1.smithi131.stdout:8/688: write db/d1d/d1f/d5c/da1/fa5 [1526402,112292] 0 2024-09-13T02:54:18.523 INFO:tasks.workunit.client.1.smithi131.stdout:1/687: write dd/f3a [654171,22685] 0 2024-09-13T02:54:18.525 INFO:tasks.workunit.client.1.smithi131.stdout:4/806: write d1/d18/d34/d4e/d108/d33/f37 [1328086,29508] 0 2024-09-13T02:54:18.526 INFO:tasks.workunit.client.1.smithi131.stdout:4/807: creat d1/d18/d43/d65/f112 x:0 0 0 2024-09-13T02:54:18.529 INFO:tasks.workunit.client.1.smithi131.stdout:9/660: dread d0/d4d/f68 [0,4194304] 0 2024-09-13T02:54:18.532 INFO:tasks.workunit.client.1.smithi131.stdout:9/661: link d0/d4d/d98/dbb/ldb d0/d4d/d55/d76/lde 0 2024-09-13T02:54:18.532 INFO:tasks.workunit.client.1.smithi131.stdout:9/662: dread - d0/d3f/fb7 zero size 2024-09-13T02:54:18.532 INFO:tasks.workunit.client.1.smithi131.stdout:9/663: dread - d0/fdc zero size 2024-09-13T02:54:18.534 INFO:tasks.workunit.client.1.smithi131.stdout:1/688: dread dd/d26/d44/f32 [4194304,4194304] 0 2024-09-13T02:54:18.534 INFO:tasks.workunit.client.1.smithi131.stdout:1/689: write dd/d26/d44/ff5 [5957834,111797] 0 2024-09-13T02:54:18.534 INFO:tasks.workunit.client.1.smithi131.stdout:1/690: dread - dd/d51/fcb zero size 2024-09-13T02:54:18.534 INFO:tasks.workunit.client.1.smithi131.stdout:1/691: read - dd/d26/fda zero size 2024-09-13T02:54:18.534 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:18 smithi089 ceph-mon[27639]: pgmap v251: 65 pgs: 65 active+clean; 3.1 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 172 MiB/s rd, 206 MiB/s wr, 307 op/s 2024-09-13T02:54:18.536 INFO:tasks.workunit.client.1.smithi131.stdout:1/692: mknod dd/d51/dad/c100 0 2024-09-13T02:54:18.536 INFO:tasks.workunit.client.1.smithi131.stdout:1/693: chown dd/la2 59867768 1 2024-09-13T02:54:18.536 INFO:tasks.workunit.client.1.smithi131.stdout:1/694: write dd/d33/d94/fca [5746088,103304] 0 2024-09-13T02:54:18.537 INFO:tasks.workunit.client.1.smithi131.stdout:1/695: mkdir dd/d33/d42/d47/dd1/d101 0 2024-09-13T02:54:18.538 INFO:tasks.workunit.client.1.smithi131.stdout:1/696: creat dd/d26/d44/f102 x:0 0 0 2024-09-13T02:54:18.538 INFO:tasks.workunit.client.1.smithi131.stdout:1/697: getdents dd/d33/d42/d47/dd1/d101 0 2024-09-13T02:54:18.539 INFO:tasks.workunit.client.1.smithi131.stdout:1/698: creat dd/d51/d5a/f103 x:0 0 0 2024-09-13T02:54:18.539 INFO:tasks.workunit.client.1.smithi131.stdout:1/699: chown dd/d51/db3/ff6 435593 1 2024-09-13T02:54:18.539 INFO:tasks.workunit.client.1.smithi131.stdout:1/700: creat dd/d26/d2a/d2c/d4b/f104 x:0 0 0 2024-09-13T02:54:18.539 INFO:tasks.workunit.client.1.smithi131.stdout:1/701: creat dd/d26/d44/d6d/f105 x:0 0 0 2024-09-13T02:54:18.541 INFO:tasks.workunit.client.1.smithi131.stdout:8/689: dwrite db/fa9 [0,4194304] 0 2024-09-13T02:54:18.541 INFO:tasks.workunit.client.1.smithi131.stdout:8/690: readlink db/d1d/d1f/lc5 0 2024-09-13T02:54:18.541 INFO:tasks.workunit.client.1.smithi131.stdout:8/691: readlink db/d2b/d39/l3d 0 2024-09-13T02:54:18.542 INFO:tasks.workunit.client.1.smithi131.stdout:8/692: unlink db/d2e/d3a/c44 0 2024-09-13T02:54:18.543 INFO:tasks.workunit.client.1.smithi131.stdout:8/693: fdatasync db/d2b/d39/d56/f73 0 2024-09-13T02:54:18.543 INFO:tasks.workunit.client.1.smithi131.stdout:8/694: write db/d2b/d39/d56/f57 [1732137,24837] 0 2024-09-13T02:54:18.543 INFO:tasks.workunit.client.1.smithi131.stdout:8/695: truncate db/d1d/d34/d4e/d7e/f83 3863513 0 2024-09-13T02:54:18.543 INFO:tasks.workunit.client.1.smithi131.stdout:8/696: stat db/d1d/d1f/f2c 0 2024-09-13T02:54:18.544 INFO:tasks.workunit.client.1.smithi131.stdout:8/697: write db/d1d/d34/d4e/d7e/fcd [780145,104536] 0 2024-09-13T02:54:18.545 INFO:tasks.workunit.client.1.smithi131.stdout:8/698: creat db/d1d/dc6/fd3 x:0 0 0 2024-09-13T02:54:18.545 INFO:tasks.workunit.client.1.smithi131.stdout:8/699: readlink db/d1d/d1f/d66/lad 0 2024-09-13T02:54:18.545 INFO:tasks.workunit.client.1.smithi131.stdout:8/700: chown db/d1d/l1e 26 1 2024-09-13T02:54:18.545 INFO:tasks.workunit.client.1.smithi131.stdout:8/701: symlink db/d1d/d1f/d5c/ld4 0 2024-09-13T02:54:18.553 INFO:tasks.workunit.client.1.smithi131.stdout:4/808: dwrite d1/d18/d43/d65/dbd/dc1/d13/f44 [4194304,4194304] 0 2024-09-13T02:54:18.553 INFO:tasks.workunit.client.1.smithi131.stdout:4/809: readlink d1/d18/d43/d65/dbd/dc1/d13/l6d 0 2024-09-13T02:54:18.554 INFO:tasks.workunit.client.1.smithi131.stdout:9/664: dwrite d0/d3/d14/d17/f74 [0,4194304] 0 2024-09-13T02:54:18.554 INFO:tasks.workunit.client.1.smithi131.stdout:9/665: write d0/d3f/db3/fca [29654,36129] 0 2024-09-13T02:54:18.554 INFO:tasks.workunit.client.1.smithi131.stdout:9/666: creat d0/d4d/d98/fdf x:0 0 0 2024-09-13T02:54:18.554 INFO:tasks.workunit.client.1.smithi131.stdout:9/667: write d0/d3/fa1 [755225,13295] 0 2024-09-13T02:54:18.554 INFO:tasks.workunit.client.1.smithi131.stdout:4/810: dread d1/d18/f5c [0,4194304] 0 2024-09-13T02:54:18.557 INFO:tasks.workunit.client.1.smithi131.stdout:1/702: dread dd/d26/d44/f3b [0,4194304] 0 2024-09-13T02:54:18.558 INFO:tasks.workunit.client.1.smithi131.stdout:9/668: mknod d0/d3/d14/d1a/dcb/ce0 0 2024-09-13T02:54:18.558 INFO:tasks.workunit.client.1.smithi131.stdout:9/669: readlink d0/d3/d14/d17/l81 0 2024-09-13T02:54:18.559 INFO:tasks.workunit.client.1.smithi131.stdout:4/811: link d1/d18/d34/d4e/d108/d8d/la2 d1/d18/d43/d97/dba/l113 0 2024-09-13T02:54:18.560 INFO:tasks.workunit.client.1.smithi131.stdout:9/670: mknod d0/d3/d14/d1a/dc6/ce1 0 2024-09-13T02:54:18.561 INFO:tasks.workunit.client.1.smithi131.stdout:4/812: mknod d1/d18/c114 0 2024-09-13T02:54:18.561 INFO:tasks.workunit.client.1.smithi131.stdout:4/813: write d1/d18/d81/ffd [360982,44360] 0 2024-09-13T02:54:18.562 INFO:tasks.workunit.client.1.smithi131.stdout:9/671: truncate d0/d3/d14/d1a/d2a/d5e/da2/d39/f9e 577572 0 2024-09-13T02:54:18.562 INFO:tasks.workunit.client.1.smithi131.stdout:9/672: write d0/d3/d14/d1a/d2a/f7d [2315695,62704] 0 2024-09-13T02:54:18.563 INFO:tasks.workunit.client.1.smithi131.stdout:4/814: rmdir d1/d18/d34/d62/da3/ded 39 2024-09-13T02:54:18.565 INFO:tasks.workunit.client.1.smithi131.stdout:4/815: mkdir d1/d18/d34/d4e/d108/d8d/d115 0 2024-09-13T02:54:18.565 INFO:tasks.workunit.client.1.smithi131.stdout:4/816: fdatasync d1/d18/d43/d97/dba/d22/d73/fcd 0 2024-09-13T02:54:18.565 INFO:tasks.workunit.client.1.smithi131.stdout:1/703: dread dd/d33/d94/db4/fb9 [0,4194304] 0 2024-09-13T02:54:18.566 INFO:tasks.workunit.client.1.smithi131.stdout:9/673: rmdir d0/d3/d14/d95 39 2024-09-13T02:54:18.567 INFO:tasks.workunit.client.1.smithi131.stdout:4/817: truncate d1/d18/d43/d97/dba/d22/d49/f6e 2149145 0 2024-09-13T02:54:18.567 INFO:tasks.workunit.client.1.smithi131.stdout:4/818: readlink d1/d18/d34/d4e/d108/d33/d3a/l102 0 2024-09-13T02:54:18.567 INFO:tasks.workunit.client.1.smithi131.stdout:1/704: mkdir dd/d33/d94/d106 0 2024-09-13T02:54:18.567 INFO:tasks.workunit.client.1.smithi131.stdout:1/705: fdatasync dd/d33/d42/d47/fd5 0 2024-09-13T02:54:18.578 INFO:tasks.workunit.client.1.smithi131.stdout:4/819: write d1/d18/d34/d62/d78/fd8 [2176271,108479] 0 2024-09-13T02:54:18.578 INFO:tasks.workunit.client.1.smithi131.stdout:8/702: dwrite db/d2b/f6d [0,4194304] 0 2024-09-13T02:54:18.579 INFO:tasks.workunit.client.1.smithi131.stdout:4/820: write d1/d18/d43/d65/dbd/dc1/f2f [882310,11251] 0 2024-09-13T02:54:18.580 INFO:tasks.workunit.client.1.smithi131.stdout:4/821: readlink d1/d18/d81/ldb 0 2024-09-13T02:54:18.580 INFO:tasks.workunit.client.1.smithi131.stdout:8/703: mknod db/d2e/d3a/cd5 0 2024-09-13T02:54:18.580 INFO:tasks.workunit.client.1.smithi131.stdout:8/704: fsync db/fa9 0 2024-09-13T02:54:18.580 INFO:tasks.workunit.client.1.smithi131.stdout:9/674: write d0/d3/f5b [513716,107993] 0 2024-09-13T02:54:18.580 INFO:tasks.workunit.client.1.smithi131.stdout:9/675: write d0/d3/fa1 [565041,95396] 0 2024-09-13T02:54:18.580 INFO:tasks.workunit.client.1.smithi131.stdout:9/676: readlink d0/d3/d14/d1a/d2a/d5e/la5 0 2024-09-13T02:54:18.581 INFO:tasks.workunit.client.1.smithi131.stdout:4/822: mkdir d1/d18/d34/d4e/d108/d8d/dc9/d116 0 2024-09-13T02:54:18.582 INFO:tasks.workunit.client.1.smithi131.stdout:8/705: link db/d1d/dc6/fd3 db/d2e/d40/fd6 0 2024-09-13T02:54:18.584 INFO:tasks.workunit.client.1.smithi131.stdout:4/823: creat d1/d18/d34/d4e/d108/d8d/f117 x:0 0 0 2024-09-13T02:54:18.586 INFO:tasks.workunit.client.1.smithi131.stdout:8/706: mkdir db/d1d/d34/d4e/dd7 0 2024-09-13T02:54:18.586 INFO:tasks.workunit.client.1.smithi131.stdout:8/707: creat db/d2b/fd8 x:0 0 0 2024-09-13T02:54:18.587 INFO:tasks.workunit.client.1.smithi131.stdout:4/824: mknod d1/d18/d43/d97/dba/d22/d73/de0/c118 0 2024-09-13T02:54:18.587 INFO:tasks.workunit.client.1.smithi131.stdout:4/825: creat d1/d18/d43/f119 x:0 0 0 2024-09-13T02:54:18.587 INFO:tasks.workunit.client.1.smithi131.stdout:4/826: creat d1/d18/d34/d4e/f11a x:0 0 0 2024-09-13T02:54:18.587 INFO:tasks.workunit.client.1.smithi131.stdout:4/827: truncate d1/d18/d43/d65/dbd/dc1/d13/f30 1345057 0 2024-09-13T02:54:18.587 INFO:tasks.workunit.client.1.smithi131.stdout:4/828: fdatasync d1/d18/f9a 0 2024-09-13T02:54:18.588 INFO:tasks.workunit.client.1.smithi131.stdout:8/708: rmdir db/d89 39 2024-09-13T02:54:18.589 INFO:tasks.workunit.client.1.smithi131.stdout:1/706: dwrite dd/d26/d44/d6d/fc9 [0,4194304] 0 2024-09-13T02:54:18.591 INFO:tasks.workunit.client.1.smithi131.stdout:8/709: creat db/d1d/d34/d4e/d7e/d90/fd9 x:0 0 0 2024-09-13T02:54:18.591 INFO:tasks.workunit.client.1.smithi131.stdout:8/710: chown db/d1d/d34/ca0 1191 1 2024-09-13T02:54:18.592 INFO:tasks.workunit.client.1.smithi131.stdout:1/707: mkdir dd/d51/d8a/d107 0 2024-09-13T02:54:18.592 INFO:tasks.workunit.client.1.smithi131.stdout:1/708: chown dd/d33/d42/d47/l8e 66720026 1 2024-09-13T02:54:18.593 INFO:tasks.workunit.client.1.smithi131.stdout:8/711: creat db/d1d/d34/d4e/d7e/dc4/fda x:0 0 0 2024-09-13T02:54:18.608 INFO:tasks.workunit.client.1.smithi131.stdout:9/677: dwrite d0/d3/d14/d1a/d2a/f4e [0,4194304] 0 2024-09-13T02:54:18.608 INFO:tasks.workunit.client.1.smithi131.stdout:4/829: dwrite d1/d18/d81/fb8 [0,4194304] 0 2024-09-13T02:54:18.610 INFO:tasks.workunit.client.1.smithi131.stdout:9/678: rename d0/d4d/d55/l8b to d0/d3/d14/d1a/d2a/d5e/da2/d39/dae/le2 0 2024-09-13T02:54:18.614 INFO:tasks.workunit.client.1.smithi131.stdout:1/709: dwrite dd/d51/d8a/fcc [4194304,4194304] 0 2024-09-13T02:54:18.624 INFO:tasks.workunit.client.1.smithi131.stdout:9/679: mkdir d0/d4d/de3 0 2024-09-13T02:54:18.625 INFO:tasks.workunit.client.1.smithi131.stdout:9/680: truncate d0/d4d/f68 2081229 0 2024-09-13T02:54:18.626 INFO:tasks.workunit.client.1.smithi131.stdout:1/710: dread dd/d26/d2a/d2c/f39 [0,4194304] 0 2024-09-13T02:54:18.627 INFO:tasks.workunit.client.1.smithi131.stdout:1/711: rename dd/d26/d2a/d69/fcd to dd/d33/d42/d47/dd1/dea/f108 0 2024-09-13T02:54:18.628 INFO:tasks.workunit.client.1.smithi131.stdout:1/712: mknod dd/d26/d2a/d2c/d4b/c109 0 2024-09-13T02:54:18.629 INFO:tasks.workunit.client.1.smithi131.stdout:1/713: chown dd/d33/d94/dfb 1037835 1 2024-09-13T02:54:18.632 INFO:tasks.workunit.client.1.smithi131.stdout:9/681: dread d0/d3/d14/d1a/f1d [0,4194304] 0 2024-09-13T02:54:18.632 INFO:tasks.workunit.client.1.smithi131.stdout:9/682: truncate d0/d3/d14/d1a/d2a/d5e/d79/f7b 1674889 0 2024-09-13T02:54:18.634 INFO:tasks.workunit.client.1.smithi131.stdout:9/683: unlink d0/d3/d14/d1a/c26 0 2024-09-13T02:54:18.634 INFO:tasks.workunit.client.1.smithi131.stdout:9/684: write d0/d3/d14/d17/f9f [477114,64387] 0 2024-09-13T02:54:18.637 INFO:tasks.workunit.client.1.smithi131.stdout:8/712: dwrite f5 [0,4194304] 0 2024-09-13T02:54:18.637 INFO:tasks.workunit.client.1.smithi131.stdout:8/713: chown db/d1d/d34/d4e/dd7 436044 1 2024-09-13T02:54:18.637 INFO:tasks.workunit.client.1.smithi131.stdout:8/714: chown f6 16752 1 2024-09-13T02:54:18.644 INFO:tasks.workunit.client.1.smithi131.stdout:8/715: mknod db/d1d/d1f/d5c/d6c/cdb 0 2024-09-13T02:54:18.645 INFO:tasks.workunit.client.1.smithi131.stdout:1/714: dwrite dd/d33/d94/db4/fb9 [4194304,4194304] 0 2024-09-13T02:54:18.645 INFO:tasks.workunit.client.1.smithi131.stdout:1/715: fdatasync dd/dc2/f79 0 2024-09-13T02:54:18.646 INFO:tasks.workunit.client.1.smithi131.stdout:1/716: chown dd/d26/d2a/d69/l75 1 1 2024-09-13T02:54:18.646 INFO:tasks.workunit.client.1.smithi131.stdout:1/717: chown dd/d26/d2a/d69/l7a 3858 1 2024-09-13T02:54:18.648 INFO:tasks.workunit.client.1.smithi131.stdout:9/685: rename d0/d3 to d0/d4d/d98/dbb/de4 0 2024-09-13T02:54:18.649 INFO:tasks.workunit.client.1.smithi131.stdout:9/686: rename d0/d4d/d98/dbb/de4/d14/d95/dba to d0/d4d/d98/dbb/de4/d14/d1a/dc6/de5 0 2024-09-13T02:54:18.654 INFO:tasks.workunit.client.1.smithi131.stdout:8/716: read db/d2b/d39/fa2 [1455562,115856] 0 2024-09-13T02:54:18.654 INFO:tasks.workunit.client.1.smithi131.stdout:8/717: chown db/d2e/d40/f48 6690 1 2024-09-13T02:54:18.655 INFO:tasks.workunit.client.1.smithi131.stdout:6/703: sync 2024-09-13T02:54:18.655 INFO:tasks.workunit.client.1.smithi131.stdout:6/704: fsync d1/d8/d9/db/fb2 0 2024-09-13T02:54:18.657 INFO:tasks.workunit.client.1.smithi131.stdout:8/718: rename db/d1d/d1f/d67/c96 to db/d1d/d1f/d41/d50/cdc 0 2024-09-13T02:54:18.658 INFO:tasks.workunit.client.1.smithi131.stdout:8/719: chown db/d1d/d71/c7c 4 1 2024-09-13T02:54:18.658 INFO:tasks.workunit.client.1.smithi131.stdout:8/720: fdatasync f5 0 2024-09-13T02:54:18.658 INFO:tasks.workunit.client.1.smithi131.stdout:8/721: readlink db/d2b/lc1 0 2024-09-13T02:54:18.658 INFO:tasks.workunit.client.1.smithi131.stdout:1/718: dread dd/d26/f8d [0,4194304] 0 2024-09-13T02:54:18.660 INFO:tasks.workunit.client.1.smithi131.stdout:8/722: rmdir db/d2b/d39/d56/dcb 0 2024-09-13T02:54:18.661 INFO:tasks.workunit.client.1.smithi131.stdout:8/723: unlink db/d1d/d34/f4a 0 2024-09-13T02:54:18.667 INFO:tasks.workunit.client.1.smithi131.stdout:6/705: dread d1/d8/d9/db/d15/f3c [0,4194304] 0 2024-09-13T02:54:18.668 INFO:tasks.workunit.client.1.smithi131.stdout:6/706: mknod d1/d8/d9/db/d15/dc2/cec 0 2024-09-13T02:54:18.668 INFO:tasks.workunit.client.1.smithi131.stdout:6/707: chown d1/d8/d9/db/d15/dc2/cec 500925 1 2024-09-13T02:54:18.668 INFO:tasks.workunit.client.1.smithi131.stdout:6/708: truncate d1/d8/f2c 4964779 0 2024-09-13T02:54:18.673 INFO:tasks.workunit.client.1.smithi131.stdout:8/724: dread db/d1d/d1f/d5c/f64 [0,4194304] 0 2024-09-13T02:54:18.673 INFO:tasks.workunit.client.1.smithi131.stdout:8/725: symlink db/d1d/d1f/d66/ldd 0 2024-09-13T02:54:18.675 INFO:tasks.workunit.client.1.smithi131.stdout:8/726: mknod db/d1d/d1f/d67/d81/cde 0 2024-09-13T02:54:18.676 INFO:tasks.workunit.client.1.smithi131.stdout:8/727: mknod db/d89/cdf 0 2024-09-13T02:54:18.676 INFO:tasks.workunit.client.1.smithi131.stdout:8/728: chown db/d1d/d1f/d41/f5d 31760 1 2024-09-13T02:54:18.676 INFO:tasks.workunit.client.1.smithi131.stdout:8/729: dread - db/d1d/d34/d4e/f92 zero size 2024-09-13T02:54:18.677 INFO:tasks.workunit.client.1.smithi131.stdout:1/719: dwrite dd/d33/d94/fca [0,4194304] 0 2024-09-13T02:54:18.677 INFO:tasks.workunit.client.1.smithi131.stdout:1/720: write dd/d26/d44/d6d/f105 [557170,103546] 0 2024-09-13T02:54:18.677 INFO:tasks.workunit.client.1.smithi131.stdout:8/730: creat db/d1d/d1f/d5c/da1/fe0 x:0 0 0 2024-09-13T02:54:18.678 INFO:tasks.workunit.client.1.smithi131.stdout:1/721: rmdir dd/d26/d7d 39 2024-09-13T02:54:18.678 INFO:tasks.workunit.client.1.smithi131.stdout:8/731: symlink db/d2b/d82/le1 0 2024-09-13T02:54:18.680 INFO:tasks.workunit.client.1.smithi131.stdout:1/722: unlink dd/d51/d5a/c64 0 2024-09-13T02:54:18.680 INFO:tasks.workunit.client.1.smithi131.stdout:9/687: dwrite d0/d4d/d55/d76/fa7 [0,4194304] 0 2024-09-13T02:54:18.680 INFO:tasks.workunit.client.1.smithi131.stdout:6/709: write d1/d8/d9/db/d15/f3d [5686308,100540] 0 2024-09-13T02:54:18.680 INFO:tasks.workunit.client.1.smithi131.stdout:6/710: readlink d1/d8/d9/d8d/lda 0 2024-09-13T02:54:18.680 INFO:tasks.workunit.client.1.smithi131.stdout:6/711: write d1/d8/d9/db/d15/d26/d1c/d79/d92/dc6/fcb [3520730,45313] 0 2024-09-13T02:54:18.680 INFO:tasks.workunit.client.1.smithi131.stdout:9/688: write d0/d4d/d98/dbb/de4/fa1 [1595243,60424] 0 2024-09-13T02:54:18.680 INFO:tasks.workunit.client.1.smithi131.stdout:8/732: truncate db/d1d/d34/f70 448108 0 2024-09-13T02:54:18.681 INFO:tasks.workunit.client.1.smithi131.stdout:1/723: mkdir dd/d33/d42/d47/dd1/d10a 0 2024-09-13T02:54:18.681 INFO:tasks.workunit.client.1.smithi131.stdout:1/724: write dd/d26/d44/d6d/f105 [882457,94909] 0 2024-09-13T02:54:18.683 INFO:tasks.workunit.client.1.smithi131.stdout:8/733: dread db/d89/f98 [0,4194304] 0 2024-09-13T02:54:18.683 INFO:tasks.workunit.client.1.smithi131.stdout:8/734: chown db/d1d/d34/d4e/d7e/d90/fd2 0 1 2024-09-13T02:54:18.683 INFO:tasks.workunit.client.1.smithi131.stdout:8/735: chown db/d1d/d1f/d41/l4c 9 1 2024-09-13T02:54:18.683 INFO:tasks.workunit.client.1.smithi131.stdout:8/736: write db/d2e/d3a/f9b [1710189,55479] 0 2024-09-13T02:54:18.683 INFO:tasks.workunit.client.1.smithi131.stdout:8/737: creat db/d1d/d1f/d5c/fe2 x:0 0 0 2024-09-13T02:54:18.683 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:18 smithi131 ceph-mon[34689]: pgmap v251: 65 pgs: 65 active+clean; 3.1 GiB data, 11 GiB used, 526 GiB / 536 GiB avail; 172 MiB/s rd, 206 MiB/s wr, 307 op/s 2024-09-13T02:54:18.684 INFO:tasks.workunit.client.1.smithi131.stdout:9/689: rmdir d0/d4d/d98/dbb 39 2024-09-13T02:54:18.684 INFO:tasks.workunit.client.1.smithi131.stdout:9/690: chown d0/d4d/d98/dbb/de4/d14/d1a/dc6/fc8 95 1 2024-09-13T02:54:18.685 INFO:tasks.workunit.client.1.smithi131.stdout:6/712: symlink d1/d8/d9/db/d15/d26/d1c/d4e/dde/dd9/led 0 2024-09-13T02:54:18.687 INFO:tasks.workunit.client.1.smithi131.stdout:1/725: unlink dd/d26/fb7 0 2024-09-13T02:54:18.687 INFO:tasks.workunit.client.1.smithi131.stdout:1/726: truncate dd/d26/d2a/d69/fe6 874137 0 2024-09-13T02:54:18.687 INFO:tasks.workunit.client.1.smithi131.stdout:1/727: fsync dd/d26/d2a/d2c/f39 0 2024-09-13T02:54:18.688 INFO:tasks.workunit.client.1.smithi131.stdout:8/738: unlink db/d1d/d1f/l4f 0 2024-09-13T02:54:18.689 INFO:tasks.workunit.client.1.smithi131.stdout:8/739: fdatasync db/d1d/d71/fb9 0 2024-09-13T02:54:18.689 INFO:tasks.workunit.client.1.smithi131.stdout:9/691: creat d0/d4d/d98/dbb/de4/d14/d1a/dcb/fe6 x:0 0 0 2024-09-13T02:54:18.690 INFO:tasks.workunit.client.1.smithi131.stdout:9/692: chown d0/d4d/d98/dbb/de4/d14/d17/db0 697 1 2024-09-13T02:54:18.691 INFO:tasks.workunit.client.1.smithi131.stdout:1/728: mkdir dd/d26/d2a/d2c/d4b/d10b 0 2024-09-13T02:54:18.691 INFO:tasks.workunit.client.1.smithi131.stdout:1/729: write dd/d26/d2a/d2c/d4b/fdc [693238,101852] 0 2024-09-13T02:54:18.693 INFO:tasks.workunit.client.1.smithi131.stdout:6/713: write d1/d8/d9/db/d40/f47 [1902476,10718] 0 2024-09-13T02:54:18.695 INFO:tasks.workunit.client.1.smithi131.stdout:8/740: read db/d1d/d34/f36 [3825408,109185] 0 2024-09-13T02:54:18.699 INFO:tasks.workunit.client.1.smithi131.stdout:9/693: mkdir d0/d4d/d98/dbb/de4/d14/d67/dc0/de7 0 2024-09-13T02:54:18.700 INFO:tasks.workunit.client.1.smithi131.stdout:1/730: rename dd/l59 to dd/d33/d94/dfb/l10c 0 2024-09-13T02:54:18.700 INFO:tasks.workunit.client.1.smithi131.stdout:1/731: fdatasync dd/d33/d42/f6c 0 2024-09-13T02:54:18.701 INFO:tasks.workunit.client.1.smithi131.stdout:8/741: truncate db/d1d/f25 4333899 0 2024-09-13T02:54:18.705 INFO:tasks.workunit.client.1.smithi131.stdout:8/742: unlink db/d1d/d1f/d67/d81/ccc 0 2024-09-13T02:54:18.705 INFO:tasks.workunit.client.1.smithi131.stdout:8/743: write db/d2b/d39/d56/fcf [27721,15136] 0 2024-09-13T02:54:18.707 INFO:tasks.workunit.client.1.smithi131.stdout:6/714: rename d1/d8/d9/db/d15/d26/d1c/d4e/f72 to d1/d8/d9/db/d15/d26/d1c/d79/d92/dc6/fee 0 2024-09-13T02:54:18.707 INFO:tasks.workunit.client.1.smithi131.stdout:6/715: fsync d1/d8/d9/db/d15/d26/d1c/d79/d92/dc6/fca 0 2024-09-13T02:54:18.707 INFO:tasks.workunit.client.1.smithi131.stdout:6/716: stat d1/d8/d9/db/d15/d26/d1c/d79/d92/dc6/cd7 0 2024-09-13T02:54:18.709 INFO:tasks.workunit.client.1.smithi131.stdout:9/694: rename d0/d4d/d98/dbb/de4/d14/d1a/dcb/ce0 to d0/d4d/d98/ce8 0 2024-09-13T02:54:18.710 INFO:tasks.workunit.client.1.smithi131.stdout:6/717: creat d1/d8/d9/db/d15/d26/d1c/d4e/dde/dd9/fef x:0 0 0 2024-09-13T02:54:18.710 INFO:tasks.workunit.client.1.smithi131.stdout:6/718: stat d1/d8/d9/db/d15/dc2/d3b/dd0 0 2024-09-13T02:54:18.711 INFO:tasks.workunit.client.1.smithi131.stdout:9/695: creat d0/d4d/de3/fe9 x:0 0 0 2024-09-13T02:54:18.711 INFO:tasks.workunit.client.1.smithi131.stdout:1/732: write dd/d51/d5a/f73 [3146339,87247] 0 2024-09-13T02:54:18.712 INFO:tasks.workunit.client.1.smithi131.stdout:6/719: dread d1/d8/d9/db/fb2 [0,4194304] 0 2024-09-13T02:54:18.712 INFO:tasks.workunit.client.1.smithi131.stdout:6/720: creat d1/d8/d9/db/d15/d26/d1c/d4e/dde/ff0 x:0 0 0 2024-09-13T02:54:18.712 INFO:tasks.workunit.client.1.smithi131.stdout:1/733: symlink dd/d33/d42/d47/dd1/dea/l10d 0 2024-09-13T02:54:18.713 INFO:tasks.workunit.client.1.smithi131.stdout:9/696: dread d0/d4d/d98/dbb/de4/d14/d95/fa8 [0,4194304] 0 2024-09-13T02:54:18.713 INFO:tasks.workunit.client.1.smithi131.stdout:9/697: chown d0/d4d/d98/dbb/de4/d14/d1a/dcb 61416 1 2024-09-13T02:54:18.713 INFO:tasks.workunit.client.1.smithi131.stdout:9/698: write d0/d4d/d98/dbb/de4/d14/d17/f21 [5165164,35021] 0 2024-09-13T02:54:18.716 INFO:tasks.workunit.client.1.smithi131.stdout:6/721: creat d1/d8/d9/d8d/ff1 x:0 0 0 2024-09-13T02:54:18.716 INFO:tasks.workunit.client.1.smithi131.stdout:6/722: creat d1/d8/d9/d8d/ff2 x:0 0 0 2024-09-13T02:54:18.716 INFO:tasks.workunit.client.1.smithi131.stdout:6/723: creat d1/d14/ff3 x:0 0 0 2024-09-13T02:54:18.716 INFO:tasks.workunit.client.1.smithi131.stdout:6/724: dread - d1/d8/d9/db/d15/d26/fc5 zero size 2024-09-13T02:54:18.716 INFO:tasks.workunit.client.1.smithi131.stdout:6/725: dread - d1/d8/d9/db/d15/d26/d1c/d4e/dde/fe7 zero size 2024-09-13T02:54:18.717 INFO:tasks.workunit.client.1.smithi131.stdout:1/734: rmdir dd/d33/d80 39 2024-09-13T02:54:18.719 INFO:tasks.workunit.client.1.smithi131.stdout:9/699: mknod d0/d4d/d98/dbb/de4/d14/d67/dc0/cea 0 2024-09-13T02:54:18.721 INFO:tasks.workunit.client.1.smithi131.stdout:1/735: mknod dd/d33/d42/c10e 0 2024-09-13T02:54:18.722 INFO:tasks.workunit.client.1.smithi131.stdout:9/700: symlink d0/d4d/d98/dbb/de4/d14/d17/db0/leb 0 2024-09-13T02:54:18.722 INFO:tasks.workunit.client.1.smithi131.stdout:9/701: creat d0/d4d/de3/fec x:0 0 0 2024-09-13T02:54:18.723 INFO:tasks.workunit.client.1.smithi131.stdout:9/702: fdatasync d0/f9 0 2024-09-13T02:54:18.723 INFO:tasks.workunit.client.1.smithi131.stdout:9/703: fsync d0/d4d/d98/dbb/de4/d14/d1a/dc6/fc8 0 2024-09-13T02:54:18.723 INFO:tasks.workunit.client.1.smithi131.stdout:9/704: mknod d0/d4d/d98/dbb/de4/d14/d67/dc0/ced 0 2024-09-13T02:54:18.724 INFO:tasks.workunit.client.1.smithi131.stdout:9/705: getdents d0/d4d/d98/dbb/de4/d14/d1a/d2a 0 2024-09-13T02:54:18.725 INFO:tasks.workunit.client.1.smithi131.stdout:9/706: rename d0/d4d/d98/dbb/de4/d14/d17/l40 to d0/d4d/d98/dbb/de4/d14/d1a/lee 0 2024-09-13T02:54:18.726 INFO:tasks.workunit.client.1.smithi131.stdout:9/707: rmdir d0/d4d/d98/dbb/de4/d14/d95 39 2024-09-13T02:54:18.726 INFO:tasks.workunit.client.1.smithi131.stdout:9/708: creat d0/d4d/fef x:0 0 0 2024-09-13T02:54:18.727 INFO:tasks.workunit.client.1.smithi131.stdout:8/744: dwrite db/d1d/d34/d4e/d7e/fcd [0,4194304] 0 2024-09-13T02:54:18.728 INFO:tasks.workunit.client.1.smithi131.stdout:9/709: mkdir d0/d4d/d98/dbb/de4/d14/d1a/d2a/df0 0 2024-09-13T02:54:18.734 INFO:tasks.workunit.client.1.smithi131.stdout:8/745: rename db/d2b/d39/f77 to db/d1d/d1f/d66/dc0/fe3 0 2024-09-13T02:54:18.734 INFO:tasks.workunit.client.1.smithi131.stdout:8/746: chown db/d2b/d39/d56/fcf 4 1 2024-09-13T02:54:18.734 INFO:tasks.workunit.client.1.smithi131.stdout:8/747: dread - db/d1d/d1f/d66/fa6 zero size 2024-09-13T02:54:18.734 INFO:tasks.workunit.client.1.smithi131.stdout:8/748: dread - db/d1d/d1f/d66/fbd zero size 2024-09-13T02:54:18.735 INFO:tasks.workunit.client.1.smithi131.stdout:1/736: dwrite dd/d26/d2a/fe3 [0,4194304] 0 2024-09-13T02:54:18.736 INFO:tasks.workunit.client.1.smithi131.stdout:8/749: truncate db/d2b/f6f 554267 0 2024-09-13T02:54:18.736 INFO:tasks.workunit.client.1.smithi131.stdout:9/710: dread d0/d4d/d98/dbb/de4/d14/d1a/f23 [0,4194304] 0 2024-09-13T02:54:18.736 INFO:tasks.workunit.client.1.smithi131.stdout:6/726: getdents d1/d8/d9/db/d15/d26/d1c/d4e/dde 0 2024-09-13T02:54:18.737 INFO:tasks.workunit.client.1.smithi131.stdout:6/727: chown d1/c24 32739 1 2024-09-13T02:54:18.738 INFO:tasks.workunit.client.1.smithi131.stdout:1/737: truncate dd/d26/d2a/d2c/f34 3636965 0 2024-09-13T02:54:18.740 INFO:tasks.workunit.client.1.smithi131.stdout:9/711: rename d0/d4d/d98/dbb/de4/d14/d1a/d2a/d5e/l5f to d0/d4d/d98/dbb/de4/d14/d17/db0/lf1 0 2024-09-13T02:54:18.741 INFO:tasks.workunit.client.1.smithi131.stdout:6/728: mkdir d1/d8/d9/db/d15/dc2/d3b/df4 0 2024-09-13T02:54:18.743 INFO:tasks.workunit.client.1.smithi131.stdout:1/738: truncate dd/d33/d42/d47/ff3 1432298 0 2024-09-13T02:54:18.744 INFO:tasks.workunit.client.1.smithi131.stdout:6/729: dread d1/d8/f7a [0,4194304] 0 2024-09-13T02:54:18.744 INFO:tasks.workunit.client.1.smithi131.stdout:6/730: stat d1/d8/d9/db/d15/dc2/d3b/fd6 0 2024-09-13T02:54:18.745 INFO:tasks.workunit.client.1.smithi131.stdout:8/750: dread db/d1d/d1f/f76 [0,4194304] 0 2024-09-13T02:54:18.746 INFO:tasks.workunit.client.1.smithi131.stdout:6/731: rename d1/d8/d9/d4b/f9b to d1/d8/d9/d8d/ff5 0 2024-09-13T02:54:18.746 INFO:tasks.workunit.client.1.smithi131.stdout:6/732: truncate d1/d8/d9/db/d15/d26/fc5 998064 0 2024-09-13T02:54:18.746 INFO:tasks.workunit.client.1.smithi131.stdout:6/733: chown d1/d8/d9/db/d15/dc2/d3b/fb9 204081459 1 2024-09-13T02:54:18.746 INFO:tasks.workunit.client.1.smithi131.stdout:6/734: chown d1/d8/d9/db/d40 4618 1 2024-09-13T02:54:18.747 INFO:tasks.workunit.client.1.smithi131.stdout:6/735: chown d1/d8/d9/db/l6d 22 1 2024-09-13T02:54:18.747 INFO:tasks.workunit.client.1.smithi131.stdout:1/739: dread dd/d33/f6a [0,4194304] 0 2024-09-13T02:54:18.747 INFO:tasks.workunit.client.1.smithi131.stdout:8/751: mknod db/d1d/d1f/d5c/da1/ce4 0 2024-09-13T02:54:18.749 INFO:tasks.workunit.client.1.smithi131.stdout:6/736: symlink d1/d8/d9/db/d15/d26/dbd/ddf/de3/lf6 0 2024-09-13T02:54:18.751 INFO:tasks.workunit.client.1.smithi131.stdout:1/740: rmdir dd/d33/d42/d47 39 2024-09-13T02:54:18.752 INFO:tasks.workunit.client.1.smithi131.stdout:8/752: rename f8 to db/d2e/d3a/fe5 0 2024-09-13T02:54:18.752 INFO:tasks.workunit.client.1.smithi131.stdout:8/753: creat db/d2b/fe6 x:0 0 0 2024-09-13T02:54:18.752 INFO:tasks.workunit.client.1.smithi131.stdout:8/754: creat db/d1d/d34/d4e/d7e/dc4/fe7 x:0 0 0 2024-09-13T02:54:18.755 INFO:tasks.workunit.client.1.smithi131.stdout:8/755: link db/d1d/d1f/d5c/caa db/d1d/d34/ce8 0 2024-09-13T02:54:18.760 INFO:tasks.workunit.client.1.smithi131.stdout:1/741: write dd/d26/d44/f32 [7459594,8129] 0 2024-09-13T02:54:18.762 INFO:tasks.workunit.client.1.smithi131.stdout:1/742: unlink dd/fe5 0 2024-09-13T02:54:18.763 INFO:tasks.workunit.client.1.smithi131.stdout:1/743: creat dd/d26/d2a/d2c/d4b/d10b/f10f x:0 0 0 2024-09-13T02:54:18.764 INFO:tasks.workunit.client.1.smithi131.stdout:1/744: mkdir dd/d51/d8a/d110 0 2024-09-13T02:54:18.770 INFO:tasks.workunit.client.1.smithi131.stdout:9/712: dwrite d0/d4d/d98/dbb/de4/d14/d1a/d2a/d5e/da2/d39/f50 [0,4194304] 0 2024-09-13T02:54:18.770 INFO:tasks.workunit.client.1.smithi131.stdout:9/713: fsync d0/d4d/d98/dbb/de4/d14/f6f 0 2024-09-13T02:54:18.770 INFO:tasks.workunit.client.1.smithi131.stdout:9/714: fsync d0/d4d/d98/dbb/de4/d14/d1a/d2a/d5e/da2/f6a 0 2024-09-13T02:54:18.772 INFO:tasks.workunit.client.1.smithi131.stdout:9/715: unlink d0/d4d/d98/dbb/de4/d14/d1a/d2a/d75/fd2 0 2024-09-13T02:54:18.774 INFO:tasks.workunit.client.1.smithi131.stdout:9/716: rename d0/d4d/d98/dbb/de4/d14/d1a/d2a/d5e/f83 to d0/d4d/d98/dbb/de4/d14/d1a/dbc/ff2 0 2024-09-13T02:54:18.774 INFO:tasks.workunit.client.1.smithi131.stdout:6/737: dwrite d1/d8/d9/db/d15/dc2/f88 [0,4194304] 0 2024-09-13T02:54:18.775 INFO:tasks.workunit.client.1.smithi131.stdout:8/756: dwrite db/d1d/d34/fab [0,4194304] 0 2024-09-13T02:54:18.779 INFO:tasks.workunit.client.1.smithi131.stdout:8/757: symlink db/d2b/d39/le9 0 2024-09-13T02:54:18.780 INFO:tasks.workunit.client.1.smithi131.stdout:8/758: write db/d2b/f6f [1116129,17367] 0 2024-09-13T02:54:18.782 INFO:tasks.workunit.client.1.smithi131.stdout:8/759: mkdir db/d1d/d34/d8d/dea 0 2024-09-13T02:54:18.782 INFO:tasks.workunit.client.1.smithi131.stdout:2/693: sync 2024-09-13T02:54:18.786 INFO:tasks.workunit.client.1.smithi131.stdout:2/694: rename d5/d31/d4e/d76/f96 to d5/d31/d21/d57/d90/dc8/fef 0 2024-09-13T02:54:18.787 INFO:tasks.workunit.client.1.smithi131.stdout:2/695: mknod d5/d31/d4e/cf0 0 2024-09-13T02:54:18.789 INFO:tasks.workunit.client.1.smithi131.stdout:2/696: mknod d5/d31/d1d/d32/d3b/d67/cf1 0 2024-09-13T02:54:18.789 INFO:tasks.workunit.client.1.smithi131.stdout:2/697: chown d5/d31/d4e/fb2 5850 1 2024-09-13T02:54:18.793 INFO:tasks.workunit.client.1.smithi131.stdout:8/760: write f2 [2032631,116331] 0 2024-09-13T02:54:18.794 INFO:tasks.workunit.client.1.smithi131.stdout:8/761: creat db/d1d/d71/feb x:0 0 0 2024-09-13T02:54:18.797 INFO:tasks.workunit.client.1.smithi131.stdout:8/762: read db/d1d/d1f/d5c/da1/fa5 [411434,33275] 0 2024-09-13T02:54:18.797 INFO:tasks.workunit.client.1.smithi131.stdout:6/738: dwrite d1/d8/d9/d8d/fea [4194304,4194304] 0 2024-09-13T02:54:18.798 INFO:tasks.workunit.client.1.smithi131.stdout:9/717: dwrite d0/d4d/fab [0,4194304] 0 2024-09-13T02:54:18.798 INFO:tasks.workunit.client.1.smithi131.stdout:9/718: stat d0/d4d/d98/dbb/de4/d14/f6f 0 2024-09-13T02:54:18.798 INFO:tasks.workunit.client.1.smithi131.stdout:9/719: write d0/d4d/d98/dbb/de4/fa1 [1797782,84968] 0 2024-09-13T02:54:18.798 INFO:tasks.workunit.client.1.smithi131.stdout:9/720: write d0/d4d/d98/dbb/de4/d14/d1a/d2a/d5e/da2/f99 [4331417,91754] 0 2024-09-13T02:54:18.799 INFO:tasks.workunit.client.1.smithi131.stdout:8/763: mkdir db/d1d/d1f/d67/dec 0 2024-09-13T02:54:18.803 INFO:tasks.workunit.client.1.smithi131.stdout:9/721: creat d0/d4d/d98/dbb/de4/d14/d1a/d2a/d5e/da2/d39/dbe/ff3 x:0 0 0 2024-09-13T02:54:18.803 INFO:tasks.workunit.client.1.smithi131.stdout:6/739: truncate d1/d14/f5f 346201 0 2024-09-13T02:54:18.805 INFO:tasks.workunit.client.1.smithi131.stdout:2/698: dwrite d5/f28 [4194304,4194304] 0 2024-09-13T02:54:18.806 INFO:tasks.workunit.client.1.smithi131.stdout:6/740: mkdir d1/d8/d9/db/d40/dd4/df7 0 2024-09-13T02:54:18.810 INFO:tasks.workunit.client.1.smithi131.stdout:6/741: symlink d1/d8/d9/db/d15/d26/dbd/ddf/de3/lf8 0 2024-09-13T02:54:18.812 INFO:tasks.workunit.client.1.smithi131.stdout:6/742: rmdir d1/d8/d9/db/d15/d26/d1c/d79/d92/dc6 39 2024-09-13T02:54:18.813 INFO:tasks.workunit.client.1.smithi131.stdout:6/743: write d1/d8/d9/db/d15/d26/d1c/d4e/f81 [698665,12911] 0 2024-09-13T02:54:18.825 INFO:tasks.workunit.client.1.smithi131.stdout:9/722: dwrite d0/d4d/d98/dbb/de4/d14/d1a/dc6/f93 [0,4194304] 0 2024-09-13T02:54:18.826 INFO:tasks.workunit.client.1.smithi131.stdout:9/723: write d0/d4d/fef [600349,80974] 0 2024-09-13T02:54:18.826 INFO:tasks.workunit.client.1.smithi131.stdout:2/699: dwrite d5/d31/d26/f86 [0,4194304] 0 2024-09-13T02:54:18.828 INFO:tasks.workunit.client.1.smithi131.stdout:9/724: mkdir d0/d4d/d98/dbb/de4/d14/df4 0 2024-09-13T02:54:18.830 INFO:tasks.workunit.client.1.smithi131.stdout:9/725: write d0/d4d/d98/dbb/de4/fa1 [1440953,18345] 0 2024-09-13T02:54:18.833 INFO:tasks.workunit.client.1.smithi131.stdout:9/726: rename d0/d4d/d98/dbb/de4/d14/d1a/d2a/d5e/la5 to d0/d4d/d98/dbb/de4/dac/lf5 0 2024-09-13T02:54:18.833 INFO:tasks.workunit.client.1.smithi131.stdout:9/727: getdents d0/d4d/d98/dbb/de4/d14/d67/dc0/de7 0 2024-09-13T02:54:18.834 INFO:tasks.workunit.client.1.smithi131.stdout:2/700: rmdir d5/d31/d1d/d32/d3b/d67/d87 39 2024-09-13T02:54:18.835 INFO:tasks.workunit.client.1.smithi131.stdout:9/728: unlink d0/d4d/d98/dbb/de4/d14/d17/c43 0 2024-09-13T02:54:18.836 INFO:tasks.workunit.client.1.smithi131.stdout:2/701: symlink d5/d31/d21/d57/lf2 0 2024-09-13T02:54:18.838 INFO:tasks.workunit.client.1.smithi131.stdout:9/729: truncate d0/d4d/f9d 906254 0 2024-09-13T02:54:18.838 INFO:tasks.workunit.client.1.smithi131.stdout:9/730: dread - d0/d4d/de3/fec zero size 2024-09-13T02:54:18.838 INFO:tasks.workunit.client.1.smithi131.stdout:2/702: mknod d5/d4f/cf3 0 2024-09-13T02:54:18.839 INFO:tasks.workunit.client.1.smithi131.stdout:9/731: getdents d0/d4d/d55/d76/d96 0 2024-09-13T02:54:18.839 INFO:tasks.workunit.client.1.smithi131.stdout:9/732: stat d0/d4d/d98/dbb/de4/d14/d1a/d2a/d5e/d79/f7b 0 2024-09-13T02:54:18.839 INFO:tasks.workunit.client.1.smithi131.stdout:9/733: write d0/d4d/d98/dbb/de4/d14/d1a/d2a/d5e/f80 [4749364,110763] 0 2024-09-13T02:54:18.839 INFO:tasks.workunit.client.1.smithi131.stdout:9/734: chown d0/d4d/d98/dbb/de4/d14/d17/f9f 5555068 1 2024-09-13T02:54:18.839 INFO:tasks.workunit.client.1.smithi131.stdout:9/735: read d0/d4d/d98/dbb/de4/d14/d95/fa8 [583428,26152] 0 2024-09-13T02:54:18.849 INFO:tasks.workunit.client.1.smithi131.stdout:2/703: write d5/d31/d1d/d32/d3b/d67/d87/db4/fcd [1126585,80989] 0 2024-09-13T02:54:18.849 INFO:tasks.workunit.client.1.smithi131.stdout:2/704: creat d5/d31/d1d/d32/d3b/ff4 x:0 0 0 2024-09-13T02:54:18.870 INFO:tasks.workunit.client.1.smithi131.stdout:6/744: dwrite d1/d14/f20 [0,4194304] 0 2024-09-13T02:54:18.870 INFO:tasks.workunit.client.1.smithi131.stdout:6/745: readlink d1/d8/d9/db/d15/d26/dbd/ddf/de3/lf6 0 2024-09-13T02:54:18.870 INFO:tasks.workunit.client.1.smithi131.stdout:9/736: dwrite d0/f63 [0,4194304] 0 2024-09-13T02:54:18.870 INFO:tasks.workunit.client.1.smithi131.stdout:2/705: dwrite d5/d4f/fe0 [0,4194304] 0 2024-09-13T02:54:18.871 INFO:tasks.workunit.client.1.smithi131.stdout:6/746: rename d1/d14/c28 to d1/d8/d9/db/d15/dc2/cf9 0 2024-09-13T02:54:18.873 INFO:tasks.workunit.client.1.smithi131.stdout:2/706: rmdir d5/d31/d1d/d37/d7c/dbb 0 2024-09-13T02:54:18.873 INFO:tasks.workunit.client.1.smithi131.stdout:2/707: truncate d5/d31/d1d/d32/d3b/d67/d87/db4/dbc/d48/d4c/db1/fd5 719486 0 2024-09-13T02:54:18.873 INFO:tasks.workunit.client.1.smithi131.stdout:2/708: readlink d5/d6e/dda/lea 0 2024-09-13T02:54:18.874 INFO:tasks.workunit.client.1.smithi131.stdout:9/737: rename d0/d4d/d98/dbb/de4/d14/d1a/d2a/d5e/da2/f59 to d0/d4d/d98/dbb/de4/d14/d1a/dc6/de5/ff6 0 2024-09-13T02:54:18.875 INFO:tasks.workunit.client.1.smithi131.stdout:6/747: rename d1/cd5 to d1/cfa 0 2024-09-13T02:54:18.877 INFO:tasks.workunit.client.1.smithi131.stdout:9/738: mkdir d0/d4d/d98/dbb/de4/d14/d1a/d2a/d5e/df7 0 2024-09-13T02:54:18.878 INFO:tasks.workunit.client.1.smithi131.stdout:6/748: symlink d1/d8/d9/d4b/lfb 0 2024-09-13T02:54:18.878 INFO:tasks.workunit.client.1.smithi131.stdout:6/749: write d1/d8/d9/db/d15/dc2/d3b/f48 [939312,14273] 0 2024-09-13T02:54:18.878 INFO:tasks.workunit.client.1.smithi131.stdout:6/750: dread - d1/d8/d9/d8d/ff5 zero size 2024-09-13T02:54:18.879 INFO:tasks.workunit.client.1.smithi131.stdout:2/709: getdents d5/d6e 0 2024-09-13T02:54:18.879 INFO:tasks.workunit.client.1.smithi131.stdout:9/739: truncate d0/d4d/f68 1467456 0 2024-09-13T02:54:18.881 INFO:tasks.workunit.client.1.smithi131.stdout:2/710: rmdir d5/d31/d1d/d32/d3b/d67/d87 39 2024-09-13T02:54:18.882 INFO:tasks.workunit.client.1.smithi131.stdout:2/711: creat d5/d31/d1d/d50/dc9/ff5 x:0 0 0 2024-09-13T02:54:18.883 INFO:tasks.workunit.client.1.smithi131.stdout:2/712: mkdir d5/d18/d4b/df6 0 2024-09-13T02:54:18.891 INFO:tasks.workunit.client.1.smithi131.stdout:6/751: write d1/d8/d9/d8d/fea [7159630,103500] 0 2024-09-13T02:54:18.891 INFO:tasks.workunit.client.1.smithi131.stdout:6/752: chown d1/d8/d9/l9a 509626 1 2024-09-13T02:54:18.892 INFO:tasks.workunit.client.1.smithi131.stdout:9/740: dread d0/d4d/d98/dbb/de4/f5b [0,4194304] 0 2024-09-13T02:54:18.893 INFO:tasks.workunit.client.1.smithi131.stdout:6/753: unlink d1/d8/d9/db/d15/d26/d1c/d79/d92/dc6/cd7 0 2024-09-13T02:54:18.893 INFO:tasks.workunit.client.1.smithi131.stdout:2/713: dread d5/d18/d68/de3/d66/fd4 [0,4194304] 0 2024-09-13T02:54:18.894 INFO:tasks.workunit.client.1.smithi131.stdout:2/714: getdents d5/d31/d1d/d32/d3b/d67/d87 0 2024-09-13T02:54:18.904 INFO:tasks.workunit.client.1.smithi131.stdout:6/754: dread d1/d8/d9/db/d40/fb4 [0,4194304] 0 2024-09-13T02:54:18.906 INFO:tasks.workunit.client.1.smithi131.stdout:6/755: creat d1/d8/d9/db/d15/d26/d1c/d79/d92/dc6/ffc x:0 0 0 2024-09-13T02:54:18.906 INFO:tasks.workunit.client.1.smithi131.stdout:6/756: creat d1/d53/ffd x:0 0 0 2024-09-13T02:54:18.908 INFO:tasks.workunit.client.1.smithi131.stdout:6/757: rename d1/d8/f62 to d1/d8/d9/db/d15/d26/d1c/d4e/dde/dd9/ffe 0 2024-09-13T02:54:18.909 INFO:tasks.workunit.client.1.smithi131.stdout:6/758: dread - d1/d8/d9/db/d15/d26/d1c/d4e/dde/fe7 zero size 2024-09-13T02:54:18.918 INFO:tasks.workunit.client.1.smithi131.stdout:9/741: dwrite d0/d3f/f9b [0,4194304] 0 2024-09-13T02:54:18.918 INFO:tasks.workunit.client.1.smithi131.stdout:2/715: dwrite d5/d31/d1d/d32/d7d/fd0 [0,4194304] 0 2024-09-13T02:54:18.920 INFO:tasks.workunit.client.1.smithi131.stdout:2/716: mknod d5/cf7 0 2024-09-13T02:54:18.921 INFO:tasks.workunit.client.1.smithi131.stdout:9/742: link d0/d4d/d98/dbb/de4/d14/d67/c92 d0/d4d/d98/dbb/de4/cf8 0 2024-09-13T02:54:18.922 INFO:tasks.workunit.client.1.smithi131.stdout:2/717: unlink d5/d31/d26/fe5 0 2024-09-13T02:54:18.922 INFO:tasks.workunit.client.1.smithi131.stdout:2/718: fsync d5/d31/d1d/d32/d3b/ff4 0 2024-09-13T02:54:18.923 INFO:tasks.workunit.client.1.smithi131.stdout:2/719: creat d5/d18/d68/de3/d41/ff8 x:0 0 0 2024-09-13T02:54:18.923 INFO:tasks.workunit.client.1.smithi131.stdout:2/720: write d5/d18/d68/fe9 [272081,51995] 0 2024-09-13T02:54:18.925 INFO:tasks.workunit.client.1.smithi131.stdout:2/721: dread d5/d18/d68/de3/d66/f73 [0,4194304] 0 2024-09-13T02:54:18.928 INFO:tasks.workunit.client.1.smithi131.stdout:6/759: dwrite d1/d14/f20 [0,4194304] 0 2024-09-13T02:54:18.928 INFO:tasks.workunit.client.1.smithi131.stdout:2/722: fdatasync d5/d31/d1d/d32/d3b/d67/d87/db4/fcd 0 2024-09-13T02:54:18.928 INFO:tasks.workunit.client.1.smithi131.stdout:2/723: fsync d5/d6e/f92 0 2024-09-13T02:54:18.928 INFO:tasks.workunit.client.1.smithi131.stdout:2/724: fsync d5/d31/d21/f2b 0 2024-09-13T02:54:18.928 INFO:tasks.workunit.client.1.smithi131.stdout:2/725: fsync d5/f2e 0 2024-09-13T02:54:18.928 INFO:tasks.workunit.client.1.smithi131.stdout:2/726: read d5/d31/d1d/f54 [208721,84945] 0 2024-09-13T02:54:18.928 INFO:tasks.workunit.client.1.smithi131.stdout:2/727: read - d5/d31/d1d/d37/fd3 zero size 2024-09-13T02:54:18.930 INFO:tasks.workunit.client.1.smithi131.stdout:2/728: mknod d5/d31/d21/cf9 0 2024-09-13T02:54:18.931 INFO:tasks.workunit.client.1.smithi131.stdout:2/729: link d5/d31/d1d/f52 d5/d31/d21/ffa 0 2024-09-13T02:54:18.933 INFO:tasks.workunit.client.1.smithi131.stdout:2/730: rename d5/d31/d21/f24 to d5/d31/d4e/ffb 0 2024-09-13T02:54:18.935 INFO:tasks.workunit.client.1.smithi131.stdout:2/731: getdents d5/d18 0 2024-09-13T02:54:18.935 INFO:tasks.workunit.client.1.smithi131.stdout:2/732: fdatasync d5/d31/d1d/d32/d3b/d67/d87/db4/dbc/f4d 0 2024-09-13T02:54:18.938 INFO:tasks.workunit.client.1.smithi131.stdout:9/743: dwrite d0/d4d/de3/fec [0,4194304] 0 2024-09-13T02:54:18.938 INFO:tasks.workunit.client.1.smithi131.stdout:2/733: rename d5/d18/d68/fe9 to d5/d4f/ffc 0 2024-09-13T02:54:18.938 INFO:tasks.workunit.client.1.smithi131.stdout:2/734: chown d5/d31/d26/f86 94369828 1 2024-09-13T02:54:18.938 INFO:tasks.workunit.client.1.smithi131.stdout:2/735: truncate d5/d31/d1d/d32/d3b/d67/d87/db4/dbc/fae 840759 0 2024-09-13T02:54:18.940 INFO:tasks.workunit.client.1.smithi131.stdout:9/744: unlink d0/d4d/d98/dbb/de4/d14/d1a/d2a/d5e/da2/laa 0 2024-09-13T02:54:18.941 INFO:tasks.workunit.client.1.smithi131.stdout:2/736: rename d5/d31/d1d/d32/d3b/d67/d87/db4/dbc/d48/d4c/c55 to d5/d31/d1d/d32/d3b/d67/d87/db4/dbc/cfd 0 2024-09-13T02:54:18.947 INFO:tasks.workunit.client.1.smithi131.stdout:6/760: dwrite d1/d8/d9/db/d40/f9d [0,4194304] 0 2024-09-13T02:54:18.947 INFO:tasks.workunit.client.1.smithi131.stdout:6/761: dread - d1/fe4 zero size 2024-09-13T02:54:18.948 INFO:tasks.workunit.client.1.smithi131.stdout:6/762: read - d1/d14/ff3 zero size 2024-09-13T02:54:18.948 INFO:tasks.workunit.client.1.smithi131.stdout:6/763: write d1/d8/fa7 [172740,14473] 0 2024-09-13T02:54:18.953 INFO:tasks.workunit.client.1.smithi131.stdout:9/745: link d0/d4d/d98/dbb/de4/d14/d1a/d2a/d5e/da2/d39/f64 d0/d4d/d98/dbb/de4/ff9 0 2024-09-13T02:54:18.954 INFO:tasks.workunit.client.1.smithi131.stdout:6/764: mkdir d1/d8/d9/db/d15/dff 0 2024-09-13T02:54:18.954 INFO:tasks.workunit.client.1.smithi131.stdout:6/765: chown d1/d8/d9/db/d15/d26/d1c/d79/d92/dc6/fca 72060 1 2024-09-13T02:54:18.954 INFO:tasks.workunit.client.1.smithi131.stdout:6/766: fsync d1/d8/d9/db/d15/dc2/d3b/fd6 0 2024-09-13T02:54:18.955 INFO:tasks.workunit.client.1.smithi131.stdout:2/737: rmdir d5/d53 39 2024-09-13T02:54:18.955 INFO:tasks.workunit.client.1.smithi131.stdout:2/738: chown d5/d31/d1d/d37/d7c 325150492 1 2024-09-13T02:54:18.955 INFO:tasks.workunit.client.1.smithi131.stdout:6/767: symlink d1/d8/d9/db/d15/d26/dbd/ddf/de3/l100 0 2024-09-13T02:54:18.956 INFO:tasks.workunit.client.1.smithi131.stdout:6/768: creat d1/d8/d9/db/d15/d26/d1c/d79/d92/dc6/f101 x:0 0 0 2024-09-13T02:54:18.956 INFO:tasks.workunit.client.1.smithi131.stdout:9/746: link d0/d4d/d98/dbb/de4/d14/d1a/d2a/fa6 d0/d4d/d98/dbb/de4/d14/d67/dc0/ffa 0 2024-09-13T02:54:18.957 INFO:tasks.workunit.client.1.smithi131.stdout:2/739: mknod d5/d18/d68/de3/cfe 0 2024-09-13T02:54:18.957 INFO:tasks.workunit.client.1.smithi131.stdout:2/740: fdatasync d5/d18/d68/de3/d66/f73 0 2024-09-13T02:54:18.958 INFO:tasks.workunit.client.1.smithi131.stdout:6/769: symlink d1/d8/d9/l102 0 2024-09-13T02:54:18.959 INFO:tasks.workunit.client.1.smithi131.stdout:9/747: mkdir d0/dfb 0 2024-09-13T02:54:18.961 INFO:tasks.workunit.client.1.smithi131.stdout:2/741: mknod d5/d18/d68/de3/d66/cff 0 2024-09-13T02:54:18.961 INFO:tasks.workunit.client.1.smithi131.stdout:2/742: creat d5/d31/d21/d57/f100 x:0 0 0 2024-09-13T02:54:18.961 INFO:tasks.workunit.client.1.smithi131.stdout:2/743: write d5/d31/d1d/d32/d3b/d67/d87/db4/dbc/d48/d4c/db1/fd5 [1224816,127632] 0 2024-09-13T02:54:18.962 INFO:tasks.workunit.client.1.smithi131.stdout:9/748: mkdir d0/d4d/d98/dbb/de4/d14/d17/db0/dfc 0 2024-09-13T02:54:18.964 INFO:tasks.workunit.client.1.smithi131.stdout:2/744: creat d5/d31/d21/d57/d90/dc8/f101 x:0 0 0 2024-09-13T02:54:18.971 INFO:tasks.workunit.client.1.smithi131.stdout:6/770: rmdir d1 39 2024-09-13T02:54:18.973 INFO:tasks.workunit.client.1.smithi131.stdout:9/749: rename d0/d4d/d55/ca0 to d0/d4d/d98/dbb/de4/d14/d67/dc0/de7/cfd 0 2024-09-13T02:54:18.975 INFO:tasks.workunit.client.1.smithi131.stdout:6/771: creat d1/d8/d9/d8d/f103 x:0 0 0 2024-09-13T02:54:18.975 INFO:tasks.workunit.client.1.smithi131.stdout:6/772: write d1/d8/d9/db/d15/fb1 [119763,57212] 0 2024-09-13T02:54:18.975 INFO:tasks.workunit.client.1.smithi131.stdout:6/773: truncate d1/d8/d9/db/d15/d26/d1c/d4e/f81 1151657 0 2024-09-13T02:54:18.975 INFO:tasks.workunit.client.1.smithi131.stdout:9/750: read d0/d4d/d98/dbb/de4/d14/d1a/d2a/d5e/d79/f7b [1401278,41967] 0 2024-09-13T02:54:18.982 INFO:tasks.workunit.client.1.smithi131.stdout:9/751: dread d0/d4d/d98/dbb/de4/d14/d1a/d2a/f62 [0,4194304] 0 2024-09-13T02:54:18.986 INFO:tasks.workunit.client.1.smithi131.stdout:2/745: dwrite d5/d31/d1d/d32/f49 [0,4194304] 0 2024-09-13T02:54:18.987 INFO:tasks.workunit.client.1.smithi131.stdout:2/746: rmdir d5/d18/d68/de3/d66 39 2024-09-13T02:54:18.988 INFO:tasks.workunit.client.1.smithi131.stdout:2/747: creat d5/d31/d1d/f102 x:0 0 0 2024-09-13T02:54:18.991 INFO:tasks.workunit.client.1.smithi131.stdout:3/613: sync 2024-09-13T02:54:18.991 INFO:tasks.workunit.client.1.smithi131.stdout:5/554: sync 2024-09-13T02:54:18.991 INFO:tasks.workunit.client.1.smithi131.stdout:7/627: sync 2024-09-13T02:54:18.991 INFO:tasks.workunit.client.1.smithi131.stdout:5/555: fsync d1/d1c/d8e/f43 0 2024-09-13T02:54:18.992 INFO:tasks.workunit.client.1.smithi131.stdout:5/556: stat d1/d21/d74 0 2024-09-13T02:54:18.993 INFO:tasks.workunit.client.1.smithi131.stdout:3/614: link d2/d4/d1a/l29 d2/d4/d1a/d31/d48/lcb 0 2024-09-13T02:54:18.995 INFO:tasks.workunit.client.1.smithi131.stdout:2/748: dread d5/d18/d68/de3/d66/fd4 [0,4194304] 0 2024-09-13T02:54:18.995 INFO:tasks.workunit.client.1.smithi131.stdout:2/749: fdatasync d5/d31/d1d/d32/d3b/d67/d87/db4/dbc/fae 0 2024-09-13T02:54:18.995 INFO:tasks.workunit.client.1.smithi131.stdout:2/750: creat d5/d18/d68/f103 x:0 0 0 2024-09-13T02:54:18.997 INFO:tasks.workunit.client.1.smithi131.stdout:2/751: symlink d5/d18/d4b/l104 0 2024-09-13T02:54:18.998 INFO:tasks.workunit.client.1.smithi131.stdout:2/752: unlink d5/l2d 0 2024-09-13T02:54:19.001 INFO:tasks.workunit.client.1.smithi131.stdout:3/615: write d2/d4/d1a/f1e [83236,77415] 0 2024-09-13T02:54:19.003 INFO:tasks.workunit.client.1.smithi131.stdout:6/774: dwrite d1/d8/d9/db/d40/f47 [4194304,4194304] 0 2024-09-13T02:54:19.003 INFO:tasks.workunit.client.1.smithi131.stdout:9/752: dwrite d0/d4d/de3/fe9 [0,4194304] 0 2024-09-13T02:54:19.008 INFO:tasks.workunit.client.1.smithi131.stdout:6/775: mkdir d1/d53/d104 0 2024-09-13T02:54:19.008 INFO:tasks.workunit.client.1.smithi131.stdout:7/628: dread d1b/d3b/d31/d5f/f7e [0,4194304] 0 2024-09-13T02:54:19.010 INFO:tasks.workunit.client.1.smithi131.stdout:9/753: mknod d0/d4d/d98/dbb/de4/d14/d1a/d2a/d5e/da2/d39/dbe/cfe 0 2024-09-13T02:54:19.010 INFO:tasks.workunit.client.1.smithi131.stdout:7/629: symlink d1b/d3b/d46/d4b/d57/d7b/ld5 0 2024-09-13T02:54:19.011 INFO:tasks.workunit.client.1.smithi131.stdout:9/754: creat d0/d4d/d98/dbb/de4/d14/d1a/fff x:0 0 0 2024-09-13T02:54:19.012 INFO:tasks.workunit.client.1.smithi131.stdout:7/630: symlink d1b/d3b/d31/d38/ld6 0 2024-09-13T02:54:19.012 INFO:tasks.workunit.client.1.smithi131.stdout:7/631: fdatasync d1b/d3b/d31/d7c/db7/d81/f97 0 2024-09-13T02:54:19.015 INFO:tasks.workunit.client.1.smithi131.stdout:7/632: creat d1b/d3b/d46/d4b/d57/d7b/d92/dbb/fd7 x:0 0 0 2024-09-13T02:54:19.015 INFO:tasks.workunit.client.1.smithi131.stdout:3/616: read d2/d4/d7/d1d/f2c [3378744,114413] 0 2024-09-13T02:54:19.027 INFO:tasks.workunit.client.1.smithi131.stdout:7/633: write d1b/f21 [2164968,72673] 0 2024-09-13T02:54:19.029 INFO:tasks.workunit.client.1.smithi131.stdout:7/634: unlink d1b/fa8 0 2024-09-13T02:54:19.030 INFO:tasks.workunit.client.1.smithi131.stdout:7/635: chown d1b/d73/f85 6485751 1 2024-09-13T02:54:19.030 INFO:tasks.workunit.client.1.smithi131.stdout:7/636: dread - d1b/d3b/d51/d8b/fca zero size 2024-09-13T02:54:19.034 INFO:tasks.workunit.client.1.smithi131.stdout:5/557: dwrite d1/d5/f4e [0,4194304] 0 2024-09-13T02:54:19.034 INFO:tasks.workunit.client.1.smithi131.stdout:2/753: dwrite d5/d31/d1d/d32/faf [0,4194304] 0 2024-09-13T02:54:19.035 INFO:tasks.workunit.client.1.smithi131.stdout:6/776: dwrite d1/d8/d9/db/d15/dc2/d3b/fb9 [0,4194304] 0 2024-09-13T02:54:19.038 INFO:tasks.workunit.client.1.smithi131.stdout:5/558: dread d1/d2f/d33/f81 [0,4194304] 0 2024-09-13T02:54:19.038 INFO:tasks.workunit.client.1.smithi131.stdout:5/559: chown d1/cd 251523033 1 2024-09-13T02:54:19.038 INFO:tasks.workunit.client.1.smithi131.stdout:2/754: symlink d5/d31/d26/d8d/l105 0 2024-09-13T02:54:19.039 INFO:tasks.workunit.client.1.smithi131.stdout:6/777: mkdir d1/d8/d9/db/d15/dc2/d3b/df4/d105 0 2024-09-13T02:54:19.041 INFO:tasks.workunit.client.1.smithi131.stdout:2/755: creat d5/d31/d21/f106 x:0 0 0 2024-09-13T02:54:19.041 INFO:tasks.workunit.client.1.smithi131.stdout:2/756: write d5/d18/d68/f103 [667090,69104] 0 2024-09-13T02:54:19.041 INFO:tasks.workunit.client.1.smithi131.stdout:2/757: chown d5/d18/l29 0 1 2024-09-13T02:54:19.042 INFO:tasks.workunit.client.1.smithi131.stdout:2/758: mkdir d5/d6e/d107 0 2024-09-13T02:54:19.042 INFO:tasks.workunit.client.1.smithi131.stdout:2/759: fdatasync d5/d31/d1d/d32/d3b/f9a 0 2024-09-13T02:54:19.042 INFO:tasks.workunit.client.1.smithi131.stdout:2/760: chown d5/d31/d1d/d50/l8f 182 1 2024-09-13T02:54:19.044 INFO:tasks.workunit.client.1.smithi131.stdout:9/755: dwrite d0/f11 [0,4194304] 0 2024-09-13T02:54:19.044 INFO:tasks.workunit.client.1.smithi131.stdout:9/756: fdatasync d0/d3f/fb7 0 2024-09-13T02:54:19.044 INFO:tasks.workunit.client.1.smithi131.stdout:3/617: dwrite d2/d4/d7/d1d/d24/d6f/f89 [0,4194304] 0 2024-09-13T02:54:19.045 INFO:tasks.workunit.client.1.smithi131.stdout:9/757: symlink d0/d4d/d98/dbb/de4/d14/d17/db0/dfc/l100 0 2024-09-13T02:54:19.045 INFO:tasks.workunit.client.1.smithi131.stdout:9/758: write d0/d4d/d98/dbb/de4/d14/d17/f21 [9264492,87549] 0 2024-09-13T02:54:19.045 INFO:tasks.workunit.client.1.smithi131.stdout:3/618: rmdir d2/d4/d7/d1d/d24 39 2024-09-13T02:54:19.049 INFO:tasks.workunit.client.1.smithi131.stdout:9/759: creat d0/d4d/d98/dbb/de4/d14/d1a/d2a/d5e/f101 x:0 0 0 2024-09-13T02:54:19.049 INFO:tasks.workunit.client.1.smithi131.stdout:9/760: fdatasync d0/d4d/d98/dbb/de4/d14/d1a/d2a/d5e/da2/d39/fd9 0 2024-09-13T02:54:19.049 INFO:tasks.workunit.client.1.smithi131.stdout:5/560: dread d1/d21/f51 [0,4194304] 0 2024-09-13T02:54:19.050 INFO:tasks.workunit.client.1.smithi131.stdout:3/619: mkdir d2/d4/d7/d1d/db4/dcc 0 2024-09-13T02:54:19.051 INFO:tasks.workunit.client.1.smithi131.stdout:9/761: read d0/d4d/d98/dbb/de4/d14/d1a/d2a/f62 [117821,5018] 0 2024-09-13T02:54:19.052 INFO:tasks.workunit.client.1.smithi131.stdout:3/620: mknod d2/d4/d7/d1d/d24/d7e/ccd 0 2024-09-13T02:54:19.054 INFO:tasks.workunit.client.1.smithi131.stdout:9/762: unlink d0/d4d/d98/dbb/de4/d14/d1a/d2a/d5e/d79/ld5 0 2024-09-13T02:54:19.056 INFO:tasks.workunit.client.1.smithi131.stdout:7/637: truncate d1b/d73/f85 969119 0 2024-09-13T02:54:19.056 INFO:tasks.workunit.client.1.smithi131.stdout:7/638: write d1b/d3b/d31/d5f/f74 [493844,43664] 0 2024-09-13T02:54:19.056 INFO:tasks.workunit.client.1.smithi131.stdout:7/639: readlink l15 0 2024-09-13T02:54:19.057 INFO:tasks.workunit.client.1.smithi131.stdout:9/763: creat d0/d4d/d98/dbb/de4/d14/d17/db0/dfc/f102 x:0 0 0 2024-09-13T02:54:19.057 INFO:tasks.workunit.client.1.smithi131.stdout:2/761: dwrite d5/fdb [0,4194304] 0 2024-09-13T02:54:19.058 INFO:tasks.workunit.client.1.smithi131.stdout:2/762: write d5/d31/d1d/d32/faf [5130120,38489] 0 2024-09-13T02:54:19.060 INFO:tasks.workunit.client.1.smithi131.stdout:8/764: sync 2024-09-13T02:54:19.060 INFO:tasks.workunit.client.1.smithi131.stdout:1/745: sync 2024-09-13T02:54:19.060 INFO:tasks.workunit.client.1.smithi131.stdout:4/830: sync 2024-09-13T02:54:19.061 INFO:tasks.workunit.client.1.smithi131.stdout:0/890: sync 2024-09-13T02:54:19.061 INFO:tasks.workunit.client.1.smithi131.stdout:0/891: read - d0/de/d1f/d22/d31/d39/da8/ffc zero size 2024-09-13T02:54:19.061 INFO:tasks.workunit.client.1.smithi131.stdout:0/892: chown d0/de/d1f/d22/l28 1290492536 1 2024-09-13T02:54:19.072 INFO:tasks.workunit.client.1.smithi131.stdout:7/640: dread d1b/d3b/d46/f6e [0,4194304] 0 2024-09-13T02:54:19.073 INFO:tasks.workunit.client.1.smithi131.stdout:0/893: dread d0/de/d1f/d22/fb2 [0,4194304] 0 2024-09-13T02:54:19.083 INFO:tasks.workunit.client.1.smithi131.stdout:0/894: read d0/de/d45/d86/f8a [2884134,111205] 0 2024-09-13T02:54:19.083 INFO:tasks.workunit.client.1.smithi131.stdout:9/764: dwrite d0/d4d/d98/dbb/de4/d14/d1a/d2a/d5e/da2/d39/f50 [0,4194304] 0 2024-09-13T02:54:19.090 INFO:tasks.workunit.client.1.smithi131.stdout:1/746: unlink dd/d26/d44/d6d/ce9 0 2024-09-13T02:54:19.090 INFO:tasks.workunit.client.1.smithi131.stdout:1/747: read - dd/d33/d42/d47/dd1/fee zero size 2024-09-13T02:54:19.092 INFO:tasks.workunit.client.1.smithi131.stdout:4/831: mknod d1/d18/d34/d4e/d108/d33/d3a/da8/c11b 0 2024-09-13T02:54:19.108 INFO:tasks.workunit.client.1.smithi131.stdout:4/832: write d1/d18/d34/d4e/d108/d33/d3a/da8/dff/f106 [3139047,96359] 0 2024-09-13T02:54:19.109 INFO:tasks.workunit.client.1.smithi131.stdout:6/778: dwrite d1/d8/f2c [4194304,4194304] 0 2024-09-13T02:54:19.113 INFO:tasks.workunit.client.1.smithi131.stdout:5/561: dwrite d1/d21/f51 [0,4194304] 0 2024-09-13T02:54:19.113 INFO:tasks.workunit.client.1.smithi131.stdout:5/562: stat d1/d1c 0 2024-09-13T02:54:19.113 INFO:tasks.workunit.client.1.smithi131.stdout:5/563: chown d1/le 0 1 2024-09-13T02:54:19.115 INFO:tasks.workunit.client.1.smithi131.stdout:5/564: dread d1/d2f/f31 [4194304,4194304] 0 2024-09-13T02:54:19.127 INFO:tasks.workunit.client.1.smithi131.stdout:1/748: dwrite dd/d26/d44/f102 [0,4194304] 0 2024-09-13T02:54:19.133 INFO:tasks.workunit.client.1.smithi131.stdout:6/779: dwrite d1/d8/d9/f1d [0,4194304] 0 2024-09-13T02:54:19.181 INFO:tasks.workunit.client.1.smithi131.stdout:9/765: symlink d0/d4d/d98/dbb/de4/d14/d1a/d2a/d5e/d79/l103 0 2024-09-13T02:54:19.182 INFO:tasks.workunit.client.1.smithi131.stdout:3/621: rename d2/d4/d7/d1d/d24/d6f/d73 to d2/d4/d2d/dce 0 2024-09-13T02:54:19.184 INFO:tasks.workunit.client.1.smithi131.stdout:4/833: creat d1/d18/d34/d4e/d108/d8d/dc9/d116/f11c x:0 0 0 2024-09-13T02:54:19.184 INFO:tasks.workunit.client.1.smithi131.stdout:4/834: dread - d1/d18/d34/d62/da3/da6/fb1 zero size 2024-09-13T02:54:19.189 INFO:tasks.workunit.client.1.smithi131.stdout:1/749: link dd/d26/d2a/d69/fcf dd/d33/d42/d47/dd1/dea/f111 0 2024-09-13T02:54:19.189 INFO:tasks.workunit.client.1.smithi131.stdout:1/750: truncate dd/d51/d5a/fa9 50679 0 2024-09-13T02:54:19.191 INFO:tasks.workunit.client.1.smithi131.stdout:9/766: truncate d0/d4d/d98/dbb/de4/d14/d1a/dbc/ff2 2849140 0 2024-09-13T02:54:19.191 INFO:tasks.workunit.client.1.smithi131.stdout:9/767: chown d0/d4d/d98/dbb/de4/d14/d1a/dc6/d8a/f8e 973 1 2024-09-13T02:54:19.193 INFO:tasks.workunit.client.1.smithi131.stdout:3/622: creat d2/d4/d7/d1d/d24/d96/fcf x:0 0 0 2024-09-13T02:54:19.197 INFO:tasks.workunit.client.1.smithi131.stdout:5/565: getdents d1/d1c/d8e 0 2024-09-13T02:54:19.199 INFO:tasks.workunit.client.1.smithi131.stdout:9/768: mkdir d0/d4d/d98/dbb/de4/d14/d67/dc0/de7/d104 0 2024-09-13T02:54:19.201 INFO:tasks.workunit.client.1.smithi131.stdout:3/623: truncate d2/d4/d1a/f7b 64074 0 2024-09-13T02:54:19.202 INFO:tasks.workunit.client.1.smithi131.stdout:3/624: stat d2/d4/d76/d9f/d41/d5c 0 2024-09-13T02:54:19.206 INFO:tasks.workunit.client.1.smithi131.stdout:1/751: dwrite dd/d26/d2a/d69/fe6 [0,4194304] 0 2024-09-13T02:54:19.211 INFO:tasks.workunit.client.1.smithi131.stdout:1/752: dread f4 [0,4194304] 0 2024-09-13T02:54:19.211 INFO:tasks.workunit.client.1.smithi131.stdout:1/753: write dd/d26/d44/f3b [234870,120965] 0 2024-09-13T02:54:19.224 INFO:tasks.workunit.client.1.smithi131.stdout:4/835: mkdir d1/d18/d43/d7d/d11d 0 2024-09-13T02:54:19.227 INFO:tasks.workunit.client.1.smithi131.stdout:6/780: rename d1/d8/d9/db/d15/d26/d1c/d4e/dde to d1/d106 0 2024-09-13T02:54:19.227 INFO:tasks.workunit.client.1.smithi131.stdout:6/781: dread - d1/d8/d9/db/d15/d26/d1c/d79/d92/dc6/f101 zero size 2024-09-13T02:54:19.227 INFO:tasks.workunit.client.1.smithi131.stdout:6/782: chown d1/d8/d9/db/d15/d26/d1c 11552215 1 2024-09-13T02:54:19.229 INFO:tasks.workunit.client.1.smithi131.stdout:2/763: link d5/d31/d1d/d32/d3b/d67/d87/db4/dbc/d48/d4c/caa d5/d31/d4e/c108 0 2024-09-13T02:54:19.231 INFO:tasks.workunit.client.1.smithi131.stdout:2/764: creat d5/d18/d4b/f109 x:0 0 0 2024-09-13T02:54:19.233 INFO:tasks.workunit.client.1.smithi131.stdout:2/765: getdents d5/d31/d1d/d32/d7d 0 2024-09-13T02:54:19.236 INFO:tasks.workunit.client.1.smithi131.stdout:7/641: dwrite d1b/f2c [0,4194304] 0 2024-09-13T02:54:19.238 INFO:tasks.workunit.client.1.smithi131.stdout:1/754: dwrite dd/d51/fdf [0,4194304] 0 2024-09-13T02:54:19.242 INFO:tasks.workunit.client.1.smithi131.stdout:7/642: mkdir d1b/d3b/d51/d62/d6d/da5/dd8 0 2024-09-13T02:54:19.242 INFO:tasks.workunit.client.1.smithi131.stdout:7/643: write d1b/d3b/d31/f5c [384887,126626] 0 2024-09-13T02:54:19.257 INFO:tasks.workunit.client.1.smithi131.stdout:8/765: rmdir db/d1d/d1f 39 2024-09-13T02:54:19.258 INFO:tasks.workunit.client.1.smithi131.stdout:8/766: unlink db/d1d/d1f/d5c/fe2 0 2024-09-13T02:54:19.259 INFO:tasks.workunit.client.1.smithi131.stdout:8/767: creat db/d1d/fed x:0 0 0 2024-09-13T02:54:19.260 INFO:tasks.workunit.client.1.smithi131.stdout:5/566: rename d1/d21/l5a to d1/d29/d3e/lbf 0 2024-09-13T02:54:19.260 INFO:tasks.workunit.client.1.smithi131.stdout:8/768: mknod db/d1d/cee 0 2024-09-13T02:54:19.261 INFO:tasks.workunit.client.1.smithi131.stdout:6/783: dwrite d1/d8/d9/db/d15/d26/d1c/d4e/f81 [0,4194304] 0 2024-09-13T02:54:19.261 INFO:tasks.workunit.client.1.smithi131.stdout:2/766: dwrite d5/d31/d4e/ffb [0,4194304] 0 2024-09-13T02:54:19.261 INFO:tasks.workunit.client.1.smithi131.stdout:9/769: rename d0/d4d/d98/dbb/de4/d14/d1a/d2a/d5e/da2/d39/f64 to d0/d4d/d98/dbb/de4/d14/d17/db0/dfc/f105 0 2024-09-13T02:54:19.262 INFO:tasks.workunit.client.1.smithi131.stdout:5/567: symlink d1/d9c/lc0 0 2024-09-13T02:54:19.266 INFO:tasks.workunit.client.1.smithi131.stdout:3/625: rename d2/d4/f23 to d2/d4/d7/d1d/d24/d96/fd0 0 2024-09-13T02:54:19.269 INFO:tasks.workunit.client.1.smithi131.stdout:9/770: mkdir d0/d4d/d98/dbb/d106 0 2024-09-13T02:54:19.269 INFO:tasks.workunit.client.1.smithi131.stdout:9/771: chown d0/d4d/d98/dbb/de4/d14/fb4 440440 1 2024-09-13T02:54:19.270 INFO:tasks.workunit.client.1.smithi131.stdout:5/568: mknod d1/d21/d74/d78/d98/cc1 0 2024-09-13T02:54:19.270 INFO:tasks.workunit.client.1.smithi131.stdout:5/569: write d1/d21/f84 [713729,70770] 0 2024-09-13T02:54:19.270 INFO:tasks.workunit.client.1.smithi131.stdout:5/570: chown d1/d21/d74/d78/d98/fa8 702 1 2024-09-13T02:54:19.270 INFO:tasks.workunit.client.1.smithi131.stdout:5/571: write d1/d2f/d4f/fbc [965172,100991] 0 2024-09-13T02:54:19.271 INFO:tasks.workunit.client.1.smithi131.stdout:1/755: rename dd/d26/d44/d6d/d7c/fa8 to dd/d51/db3/f112 0 2024-09-13T02:54:19.274 INFO:tasks.workunit.client.1.smithi131.stdout:9/772: mkdir d0/d4d/d98/dbb/de4/d14/d17/d107 0 2024-09-13T02:54:19.274 INFO:tasks.workunit.client.1.smithi131.stdout:9/773: readlink d0/d4d/d98/dbb/de4/d14/lb1 0 2024-09-13T02:54:19.275 INFO:tasks.workunit.client.1.smithi131.stdout:0/895: dwrite d0/de/d1f/d22/d3d/d43/f9d [0,4194304] 0 2024-09-13T02:54:19.275 INFO:tasks.workunit.client.1.smithi131.stdout:0/896: dread - d0/de/d1f/d22/d31/d39/da8/f12d zero size 2024-09-13T02:54:19.276 INFO:tasks.workunit.client.1.smithi131.stdout:7/644: rename d1b/f1f to d1b/d23/fd9 0 2024-09-13T02:54:19.278 INFO:tasks.workunit.client.1.smithi131.stdout:1/756: creat dd/d51/d8a/d95/f113 x:0 0 0 2024-09-13T02:54:19.279 INFO:tasks.workunit.client.1.smithi131.stdout:9/774: truncate d0/d4d/d98/dbb/de4/f5b 127480 0 2024-09-13T02:54:19.281 INFO:tasks.workunit.client.1.smithi131.stdout:0/897: rmdir d0/d2 39 2024-09-13T02:54:19.283 INFO:tasks.workunit.client.1.smithi131.stdout:7/645: link d1b/d3b/c4f d1b/d3b/d31/dcb/cda 0 2024-09-13T02:54:19.284 INFO:tasks.workunit.client.1.smithi131.stdout:7/646: dread d1b/d3b/d31/d7c/db7/d81/f97 [0,4194304] 0 2024-09-13T02:54:19.285 INFO:tasks.workunit.client.1.smithi131.stdout:6/784: rename d1/d8/d9/db/d15/dc2/d3b/df4 to d1/d53/d107 0 2024-09-13T02:54:19.285 INFO:tasks.workunit.client.1.smithi131.stdout:6/785: dread - d1/d53/f85 zero size 2024-09-13T02:54:19.286 INFO:tasks.workunit.client.1.smithi131.stdout:9/775: symlink d0/d4d/d98/dbb/de4/d14/d1a/d2a/d5e/l108 0 2024-09-13T02:54:19.288 INFO:tasks.workunit.client.1.smithi131.stdout:0/898: link d0/de/d45/d86/f88 d0/de/d1f/d22/f139 0 2024-09-13T02:54:19.289 INFO:tasks.workunit.client.1.smithi131.stdout:8/769: dwrite db/d2b/fb5 [0,4194304] 0 2024-09-13T02:54:19.289 INFO:tasks.workunit.client.1.smithi131.stdout:2/767: dwrite d5/d31/d4e/d78/f99 [0,4194304] 0 2024-09-13T02:54:19.290 INFO:tasks.workunit.client.1.smithi131.stdout:7/647: rmdir d1b/d23/d89/dcf 0 2024-09-13T02:54:19.290 INFO:tasks.workunit.client.1.smithi131.stdout:7/648: dread - d1b/d3b/d51/d8b/fca zero size 2024-09-13T02:54:19.291 INFO:tasks.workunit.client.1.smithi131.stdout:1/757: read dd/d51/db3/ff6 [4897243,94835] 0 2024-09-13T02:54:19.291 INFO:tasks.workunit.client.1.smithi131.stdout:6/786: rmdir d1/d8/d9/db/d15/d26/dbd/ddf 39 2024-09-13T02:54:19.292 INFO:tasks.workunit.client.1.smithi131.stdout:0/899: truncate d0/de/d1f/d22/f4e 260997 0 2024-09-13T02:54:19.294 INFO:tasks.workunit.client.1.smithi131.stdout:5/572: dwrite d1/d1c/d8e/f48 [0,4194304] 0 2024-09-13T02:54:19.296 INFO:tasks.workunit.client.1.smithi131.stdout:2/768: symlink d5/d31/d1d/d32/d3b/d67/d87/db4/l10a 0 2024-09-13T02:54:19.298 INFO:tasks.workunit.client.1.smithi131.stdout:7/649: unlink d1b/d23/d54/f80 0 2024-09-13T02:54:19.298 INFO:tasks.workunit.client.1.smithi131.stdout:7/650: creat d1b/d3b/d51/d62/d9e/da2/fdb x:0 0 0 2024-09-13T02:54:19.298 INFO:tasks.workunit.client.1.smithi131.stdout:1/758: mkdir dd/d51/d5a/d114 0 2024-09-13T02:54:19.300 INFO:tasks.workunit.client.1.smithi131.stdout:9/776: getdents d0/d4d/d98/dbb/de4/d14/d1a/dcb 0 2024-09-13T02:54:19.300 INFO:tasks.workunit.client.1.smithi131.stdout:9/777: chown d0/dfb 6982 1 2024-09-13T02:54:19.301 INFO:tasks.workunit.client.1.smithi131.stdout:6/787: creat d1/d53/d107/d105/f108 x:0 0 0 2024-09-13T02:54:19.302 INFO:tasks.workunit.client.1.smithi131.stdout:7/651: dread d1b/d3b/d51/d62/d6d/fb8 [0,4194304] 0 2024-09-13T02:54:19.302 INFO:tasks.workunit.client.1.smithi131.stdout:0/900: write d0/de/d1f/d22/d31/d39/d67/f69 [524125,54599] 0 2024-09-13T02:54:19.302 INFO:tasks.workunit.client.1.smithi131.stdout:0/901: fsync d0/de/d1f/f10e 0 2024-09-13T02:54:19.303 INFO:tasks.workunit.client.1.smithi131.stdout:8/770: dwrite db/d1d/d1f/fbe [0,4194304] 0 2024-09-13T02:54:19.305 INFO:tasks.workunit.client.1.smithi131.stdout:5/573: mknod d1/d21/d74/d78/cc2 0 2024-09-13T02:54:19.305 INFO:tasks.workunit.client.1.smithi131.stdout:5/574: write d1/d5/f65 [1746897,110960] 0 2024-09-13T02:54:19.307 INFO:tasks.workunit.client.1.smithi131.stdout:1/759: mkdir dd/d26/d2a/d69/dc0/d115 0 2024-09-13T02:54:19.307 INFO:tasks.workunit.client.1.smithi131.stdout:3/626: write d2/d4/d1a/f37 [175842,77547] 0 2024-09-13T02:54:19.308 INFO:tasks.workunit.client.1.smithi131.stdout:9/778: mkdir d0/d4d/d98/dbb/de4/d14/d1a/d2a/d5e/da2/d39/dc2/d109 0 2024-09-13T02:54:19.309 INFO:tasks.workunit.client.1.smithi131.stdout:6/788: symlink d1/d8/d9/d8d/l109 0 2024-09-13T02:54:19.309 INFO:tasks.workunit.client.1.smithi131.stdout:6/789: chown d1/d53 98 1 2024-09-13T02:54:19.309 INFO:tasks.workunit.client.1.smithi131.stdout:1/760: dread dd/d26/d44/d6d/f105 [0,4194304] 0 2024-09-13T02:54:19.312 INFO:tasks.workunit.client.1.smithi131.stdout:0/902: creat d0/de/d45/f13a x:0 0 0 2024-09-13T02:54:19.312 INFO:tasks.workunit.client.1.smithi131.stdout:0/903: dread - d0/de/d1f/d22/d31/d39/da8/d103/f106 zero size 2024-09-13T02:54:19.316 INFO:tasks.workunit.client.1.smithi131.stdout:8/771: creat db/d1d/d34/d8d/fef x:0 0 0 2024-09-13T02:54:19.316 INFO:tasks.workunit.client.1.smithi131.stdout:8/772: fsync db/d2e/d3a/fe5 0 2024-09-13T02:54:19.317 INFO:tasks.workunit.client.1.smithi131.stdout:5/575: mknod d1/d1c/d87/cc3 0 2024-09-13T02:54:19.318 INFO:tasks.workunit.client.1.smithi131.stdout:9/779: mknod d0/dfb/c10a 0 2024-09-13T02:54:19.320 INFO:tasks.workunit.client.1.smithi131.stdout:6/790: creat d1/d8/d9/db/d15/d26/d1c/d79/d92/f10a x:0 0 0 2024-09-13T02:54:19.320 INFO:tasks.workunit.client.1.smithi131.stdout:6/791: write d1/d8/d9/db/f64 [210593,108741] 0 2024-09-13T02:54:19.320 INFO:tasks.workunit.client.1.smithi131.stdout:6/792: fsync d1/d8/f7a 0 2024-09-13T02:54:19.320 INFO:tasks.workunit.client.1.smithi131.stdout:2/769: dwrite d5/d18/d68/de3/d41/f9f [0,4194304] 0 2024-09-13T02:54:19.321 INFO:tasks.workunit.client.1.smithi131.stdout:1/761: mknod dd/d33/d94/c116 0 2024-09-13T02:54:19.321 INFO:tasks.workunit.client.1.smithi131.stdout:1/762: fsync dd/d26/d2a/d2c/d4b/ff2 0 2024-09-13T02:54:19.324 INFO:tasks.workunit.client.1.smithi131.stdout:8/773: unlink db/d1d/fa7 0 2024-09-13T02:54:19.325 INFO:tasks.workunit.client.1.smithi131.stdout:3/627: dwrite d2/d4/d76/d9f/f6a [0,4194304] 0 2024-09-13T02:54:19.326 INFO:tasks.workunit.client.1.smithi131.stdout:5/576: mknod d1/d29/d3e/cc4 0 2024-09-13T02:54:19.326 INFO:tasks.workunit.client.1.smithi131.stdout:5/577: chown d1/d1c/c9f 0 1 2024-09-13T02:54:19.326 INFO:tasks.workunit.client.1.smithi131.stdout:5/578: write d1/d29/d3e/fb4 [713756,32584] 0 2024-09-13T02:54:19.327 INFO:tasks.workunit.client.1.smithi131.stdout:9/780: creat d0/d4d/d98/dbb/de4/d14/d1a/d2a/d5e/da2/f10b x:0 0 0 2024-09-13T02:54:19.329 INFO:tasks.workunit.client.1.smithi131.stdout:7/652: rmdir d1b/d23/d54 39 2024-09-13T02:54:19.331 INFO:tasks.workunit.client.1.smithi131.stdout:1/763: mkdir dd/d26/d44/d117 0 2024-09-13T02:54:19.333 INFO:tasks.workunit.client.1.smithi131.stdout:0/904: getdents d0/de/d1f/d22/d31/d39/d67/db5 0 2024-09-13T02:54:19.335 INFO:tasks.workunit.client.1.smithi131.stdout:8/774: creat db/d1d/d34/d4e/ff0 x:0 0 0 2024-09-13T02:54:19.339 INFO:tasks.workunit.client.1.smithi131.stdout:3/628: rmdir d2/d4/d76/d9f 39 2024-09-13T02:54:19.339 INFO:tasks.workunit.client.1.smithi131.stdout:3/629: chown d2/d4/d76/d9f/d41/d6e/la2 662 1 2024-09-13T02:54:19.344 INFO:tasks.workunit.client.1.smithi131.stdout:1/764: rename dd/d26/d2a/d69/f83 to dd/d33/d42/d47/dd1/d101/f118 0 2024-09-13T02:54:19.348 INFO:tasks.workunit.client.1.smithi131.stdout:5/579: truncate d1/d50/f7d 4373064 0 2024-09-13T02:54:19.348 INFO:tasks.workunit.client.1.smithi131.stdout:5/580: readlink d1/d5/d57/l61 0 2024-09-13T02:54:19.350 INFO:tasks.workunit.client.1.smithi131.stdout:8/775: rename db/d2e/d3a/l69 to db/d1d/d1f/d67/lf1 0 2024-09-13T02:54:19.350 INFO:tasks.workunit.client.1.smithi131.stdout:0/905: read d0/de/d1f/d22/d3d/d87/f89 [2248860,61953] 0 2024-09-13T02:54:19.351 INFO:tasks.workunit.client.1.smithi131.stdout:5/581: creat d1/d2f/fc5 x:0 0 0 2024-09-13T02:54:19.351 INFO:tasks.workunit.client.1.smithi131.stdout:5/582: chown d1/d2f/d33/l4c 512600199 1 2024-09-13T02:54:19.351 INFO:tasks.workunit.client.1.smithi131.stdout:8/776: link db/d1d/d1f/lc5 db/d1d/d34/d8d/lf2 0 2024-09-13T02:54:19.354 INFO:tasks.workunit.client.1.smithi131.stdout:0/906: rename d0/de/d1f/d22/fb9 to d0/de/d1f/d22/d31/d39/d40/f13b 0 2024-09-13T02:54:19.354 INFO:tasks.workunit.client.1.smithi131.stdout:5/583: creat d1/fc6 x:0 0 0 2024-09-13T02:54:19.356 INFO:tasks.workunit.client.1.smithi131.stdout:8/777: truncate db/d1d/d1f/d41/f5d 7408012 0 2024-09-13T02:54:19.358 INFO:tasks.workunit.client.1.smithi131.stdout:5/584: rename d1/d2f/d33/l4c to d1/d21/d74/d78/d98/lc7 0 2024-09-13T02:54:19.361 INFO:tasks.workunit.client.1.smithi131.stdout:3/630: write d2/d4/d1a/f6b [1661702,34641] 0 2024-09-13T02:54:19.361 INFO:tasks.workunit.client.1.smithi131.stdout:2/770: dwrite d5/d31/d1d/d32/d3b/fd2 [0,4194304] 0 2024-09-13T02:54:19.361 INFO:tasks.workunit.client.1.smithi131.stdout:3/631: stat d2/d4/d76/d9f/l16 0 2024-09-13T02:54:19.364 INFO:tasks.workunit.client.1.smithi131.stdout:2/771: mknod d5/d53/c10b 0 2024-09-13T02:54:19.364 INFO:tasks.workunit.client.1.smithi131.stdout:2/772: getdents d5/d18/d4b/df6 0 2024-09-13T02:54:19.365 INFO:tasks.workunit.client.1.smithi131.stdout:3/632: rename d2/d4/d1a/d31/l60 to d2/d4/d1a/d31/ld1 0 2024-09-13T02:54:19.366 INFO:tasks.workunit.client.1.smithi131.stdout:2/773: mkdir d5/d31/d1d/d32/d3b/d67/d87/d10c 0 2024-09-13T02:54:19.369 INFO:tasks.workunit.client.1.smithi131.stdout:3/633: creat d2/d4/d1a/fd2 x:0 0 0 2024-09-13T02:54:19.371 INFO:tasks.workunit.client.1.smithi131.stdout:2/774: creat d5/d31/d1d/d32/d7d/f10d x:0 0 0 2024-09-13T02:54:19.371 INFO:tasks.workunit.client.1.smithi131.stdout:3/634: creat d2/d4/d7/fd3 x:0 0 0 2024-09-13T02:54:19.371 INFO:tasks.workunit.client.1.smithi131.stdout:2/775: rmdir d5/d31/d1d/d32/d3b/d67/d87/db4 39 2024-09-13T02:54:19.371 INFO:tasks.workunit.client.1.smithi131.stdout:2/776: chown d5/d31/d1d/d37/fd3 851672 1 2024-09-13T02:54:19.371 INFO:tasks.workunit.client.1.smithi131.stdout:3/635: creat d2/d4/d1a/d31/da7/fd4 x:0 0 0 2024-09-13T02:54:19.371 INFO:tasks.workunit.client.1.smithi131.stdout:5/585: dread d1/d1c/d8e/f43 [4194304,4194304] 0 2024-09-13T02:54:19.371 INFO:tasks.workunit.client.1.smithi131.stdout:5/586: getdents d1/d2f/d71 0 2024-09-13T02:54:19.371 INFO:tasks.workunit.client.1.smithi131.stdout:3/636: symlink d2/dc/db1/ld5 0 2024-09-13T02:54:19.371 INFO:tasks.workunit.client.1.smithi131.stdout:3/637: stat d2/d4/d1a/d31/d48 0 2024-09-13T02:54:19.371 INFO:tasks.workunit.client.1.smithi131.stdout:3/638: readlink d2/d4/d76/d9f/d41/d5c/d71/lc7 0 2024-09-13T02:54:19.376 INFO:tasks.workunit.client.1.smithi131.stdout:6/793: dwrite d1/d8/d9/db/d15/d26/d1c/d79/d92/dc6/ffc [0,4194304] 0 2024-09-13T02:54:19.379 INFO:tasks.workunit.client.1.smithi131.stdout:6/794: rename d1/d8/d9/db/d15 to d1/d14/d10b 0 2024-09-13T02:54:19.381 INFO:tasks.workunit.client.1.smithi131.stdout:6/795: truncate d1/d14/d10b/dc2/f33 608775 0 2024-09-13T02:54:19.382 INFO:tasks.workunit.client.1.smithi131.stdout:6/796: symlink d1/d14/d10b/dc2/l10c 0 2024-09-13T02:54:19.383 INFO:tasks.workunit.client.1.smithi131.stdout:9/781: dwrite d0/d4d/d98/dbb/de4/d14/d1a/d2a/f62 [0,4194304] 0 2024-09-13T02:54:19.383 INFO:tasks.workunit.client.1.smithi131.stdout:8/778: dwrite db/d2b/fc7 [0,4194304] 0 2024-09-13T02:54:19.384 INFO:tasks.workunit.client.1.smithi131.stdout:7/653: dwrite d1b/d23/d54/dc6/fc7 [0,4194304] 0 2024-09-13T02:54:19.384 INFO:tasks.workunit.client.1.smithi131.stdout:1/765: dwrite dd/dc2/f79 [0,4194304] 0 2024-09-13T02:54:19.384 INFO:tasks.workunit.client.1.smithi131.stdout:7/654: fsync d1b/d3b/f6b 0 2024-09-13T02:54:19.384 INFO:tasks.workunit.client.1.smithi131.stdout:0/907: dwrite d0/de/d1f/d22/d3d/d55/d63/f10c [0,4194304] 0 2024-09-13T02:54:19.384 INFO:tasks.workunit.client.1.smithi131.stdout:6/797: mkdir d1/d8/d9/d10d 0 2024-09-13T02:54:19.387 INFO:tasks.workunit.client.1.smithi131.stdout:9/782: creat d0/d4d/d98/dbb/de4/f10c x:0 0 0 2024-09-13T02:54:19.388 INFO:tasks.workunit.client.1.smithi131.stdout:8/779: dread db/d2e/d3a/f9b [0,4194304] 0 2024-09-13T02:54:19.394 INFO:tasks.workunit.client.1.smithi131.stdout:7/655: link d1b/d73/c67 d1b/cdc 0 2024-09-13T02:54:19.395 INFO:tasks.workunit.client.1.smithi131.stdout:1/766: creat dd/d26/d44/d6d/f119 x:0 0 0 2024-09-13T02:54:19.396 INFO:tasks.workunit.client.1.smithi131.stdout:9/783: read d0/f63 [1835764,82309] 0 2024-09-13T02:54:19.402 INFO:tasks.workunit.client.1.smithi131.stdout:6/798: rename d1/d53/d104 to d1/d8/d9/d10e 0 2024-09-13T02:54:19.402 INFO:tasks.workunit.client.1.smithi131.stdout:5/587: dwrite d1/d5/f65 [0,4194304] 0 2024-09-13T02:54:19.402 INFO:tasks.workunit.client.1.smithi131.stdout:8/780: mknod db/d1d/d34/d4e/d7e/dc4/cf3 0 2024-09-13T02:54:19.405 INFO:tasks.workunit.client.1.smithi131.stdout:7/656: mknod d1b/d3b/d51/d8f/cdd 0 2024-09-13T02:54:19.405 INFO:tasks.workunit.client.1.smithi131.stdout:5/588: dread d1/d21/f84 [0,4194304] 0 2024-09-13T02:54:19.408 INFO:tasks.workunit.client.1.smithi131.stdout:9/784: rename d0/d4d/d98/dbb/de4/cf8 to d0/d4d/d98/dbb/de4/d14/d95/c10d 0 2024-09-13T02:54:19.408 INFO:tasks.workunit.client.1.smithi131.stdout:9/785: readlink d0/l24 0 2024-09-13T02:54:19.409 INFO:tasks.workunit.client.1.smithi131.stdout:8/781: symlink db/d1d/d1f/d67/dec/lf4 0 2024-09-13T02:54:19.409 INFO:tasks.workunit.client.1.smithi131.stdout:8/782: creat db/d1d/d34/d4e/d7e/ff5 x:0 0 0 2024-09-13T02:54:19.409 INFO:tasks.workunit.client.1.smithi131.stdout:8/783: write db/d1d/fed [497511,34389] 0 2024-09-13T02:54:19.410 INFO:tasks.workunit.client.1.smithi131.stdout:8/784: chown db/d1d/d1f/d41/f62 856 1 2024-09-13T02:54:19.410 INFO:tasks.workunit.client.1.smithi131.stdout:8/785: truncate db/d1d/d1f/d66/dc0/fe3 1135747 0 2024-09-13T02:54:19.410 INFO:tasks.workunit.client.1.smithi131.stdout:0/908: dread d0/de/f115 [0,4194304] 0 2024-09-13T02:54:19.410 INFO:tasks.workunit.client.1.smithi131.stdout:1/767: getdents dd/d33/d42/d47/dd1 0 2024-09-13T02:54:19.412 INFO:tasks.workunit.client.1.smithi131.stdout:7/657: mknod d1b/d3b/d51/d62/d6d/cde 0 2024-09-13T02:54:19.412 INFO:tasks.workunit.client.1.smithi131.stdout:7/658: stat c9 0 2024-09-13T02:54:19.413 INFO:tasks.workunit.client.1.smithi131.stdout:9/786: rename d0/d4d/d98/dbb/de4/d14/d1a/d2a/l7a to d0/d4d/d98/dbb/de4/d14/d17/l10e 0 2024-09-13T02:54:19.417 INFO:tasks.workunit.client.1.smithi131.stdout:1/768: link dd/d51/d5a/da3/lc5 dd/d33/d42/d47/dd1/d10a/l11a 0 2024-09-13T02:54:19.418 INFO:tasks.workunit.client.1.smithi131.stdout:7/659: stat d1b/d3b/d46/d4b/d57/d7b/l82 0 2024-09-13T02:54:19.418 INFO:tasks.workunit.client.1.smithi131.stdout:6/799: dwrite d1/d106/ff0 [0,4194304] 0 2024-09-13T02:54:19.418 INFO:tasks.workunit.client.1.smithi131.stdout:9/787: mkdir d0/d4d/d55/d76/d10f 0 2024-09-13T02:54:19.419 INFO:tasks.workunit.client.1.smithi131.stdout:0/909: truncate d0/de/da3/fdc 89940 0 2024-09-13T02:54:19.421 INFO:tasks.workunit.client.1.smithi131.stdout:7/660: mkdir d1b/d3b/d31/d5f/ddf 0 2024-09-13T02:54:19.426 INFO:tasks.workunit.client.1.smithi131.stdout:6/800: rename d1/d8/d9/d8d/fea to d1/d14/d10b/d26/dbd/ddf/de3/f10f 0 2024-09-13T02:54:19.427 INFO:tasks.workunit.client.1.smithi131.stdout:9/788: mkdir d0/d4d/d98/dbb/de4/d14/d17/db0/dfc/d110 0 2024-09-13T02:54:19.428 INFO:tasks.workunit.client.1.smithi131.stdout:6/801: mknod d1/d8/d9/d10d/c110 0 2024-09-13T02:54:19.430 INFO:tasks.workunit.client.1.smithi131.stdout:6/802: rename d1/d14/d10b/fb1 to d1/d8/d9/d10d/f111 0 2024-09-13T02:54:19.430 INFO:tasks.workunit.client.1.smithi131.stdout:1/769: dread dd/d26/d2a/d2c/f34 [0,4194304] 0 2024-09-13T02:54:19.432 INFO:tasks.workunit.client.1.smithi131.stdout:6/803: mknod d1/d8/d9/db/d40/dd4/c112 0 2024-09-13T02:54:19.433 INFO:tasks.workunit.client.1.smithi131.stdout:1/770: truncate dd/d33/d42/f48 314990 0 2024-09-13T02:54:19.433 INFO:tasks.workunit.client.1.smithi131.stdout:1/771: chown dd/d33/d42 120115 1 2024-09-13T02:54:19.433 INFO:tasks.workunit.client.1.smithi131.stdout:1/772: write dd/d26/fda [332438,68792] 0 2024-09-13T02:54:19.433 INFO:tasks.workunit.client.1.smithi131.stdout:6/804: mknod d1/d106/c113 0 2024-09-13T02:54:19.434 INFO:tasks.workunit.client.1.smithi131.stdout:6/805: rmdir d1/d14/d10b/dc2 39 2024-09-13T02:54:19.436 INFO:tasks.workunit.client.1.smithi131.stdout:6/806: link d1/d14/d10b/dc2/d3b/c3f d1/d53/d107/d105/c114 0 2024-09-13T02:54:19.440 INFO:tasks.workunit.client.1.smithi131.stdout:8/786: dwrite db/d2b/f6f [0,4194304] 0 2024-09-13T02:54:19.440 INFO:tasks.workunit.client.1.smithi131.stdout:8/787: write db/d1d/d1f/d41/f55 [348376,19882] 0 2024-09-13T02:54:19.443 INFO:tasks.workunit.client.1.smithi131.stdout:8/788: symlink db/d1d/d1f/d66/dc0/lf6 0 2024-09-13T02:54:19.444 INFO:tasks.workunit.client.1.smithi131.stdout:5/589: truncate d1/d50/f7d 632761 0 2024-09-13T02:54:19.446 INFO:tasks.workunit.client.1.smithi131.stdout:8/789: mkdir db/d1d/d1f/d5c/da1/df7 0 2024-09-13T02:54:19.446 INFO:tasks.workunit.client.1.smithi131.stdout:8/790: write db/d2b/d39/d56/f57 [20502,105335] 0 2024-09-13T02:54:19.447 INFO:tasks.workunit.client.1.smithi131.stdout:9/789: dwrite d0/f9 [4194304,4194304] 0 2024-09-13T02:54:19.448 INFO:tasks.workunit.client.1.smithi131.stdout:9/790: truncate d0/d4d/d98/dbb/de4/d14/d1a/d2a/d5e/f80 4228893 0 2024-09-13T02:54:19.448 INFO:tasks.workunit.client.1.smithi131.stdout:9/791: chown d0/d4d/c84 33300552 1 2024-09-13T02:54:19.448 INFO:tasks.workunit.client.1.smithi131.stdout:9/792: stat d0/d4d/d98/dbb/de4/d14/d1a/d2a/d5e/da2/d39/dc2/d109 0 2024-09-13T02:54:19.449 INFO:tasks.workunit.client.1.smithi131.stdout:9/793: symlink d0/d4d/d98/dbb/de4/d14/d67/dc0/de7/d104/l111 0 2024-09-13T02:54:19.449 INFO:tasks.workunit.client.1.smithi131.stdout:9/794: write d0/d4d/d98/dbb/de4/d14/d17/db0/dfc/f102 [805296,33648] 0 2024-09-13T02:54:19.452 INFO:tasks.workunit.client.1.smithi131.stdout:9/795: link d0/d4d/d98/dbb/de4/d14/d17/f91 d0/d4d/d98/dbb/de4/d14/d17/d107/f112 0 2024-09-13T02:54:19.453 INFO:tasks.workunit.client.1.smithi131.stdout:6/807: getdents d1/d14/d10b/d26/dbd/ddf/de3 0 2024-09-13T02:54:19.453 INFO:tasks.workunit.client.1.smithi131.stdout:5/590: dread d1/d9c/fb6 [0,4194304] 0 2024-09-13T02:54:19.456 INFO:tasks.workunit.client.1.smithi131.stdout:9/796: rename d0/d4d/d98/dbb/de4/d14/d17/db0/dfc/d110 to d0/d4d/d98/dbb/de4/d14/d1a/d2a/d5e/da2/d39/dae/d113 0 2024-09-13T02:54:19.456 INFO:tasks.workunit.client.1.smithi131.stdout:9/797: creat d0/d4d/d98/dbb/de4/f114 x:0 0 0 2024-09-13T02:54:19.458 INFO:tasks.workunit.client.1.smithi131.stdout:1/773: dwrite dd/fb6 [0,4194304] 0 2024-09-13T02:54:19.459 INFO:tasks.workunit.client.1.smithi131.stdout:5/591: link d1/d2f/d33/f5b d1/d21/d74/d78/d98/fc8 0 2024-09-13T02:54:19.462 INFO:tasks.workunit.client.1.smithi131.stdout:6/808: rename d1/d14/d10b/dc2/cf9 to d1/d14/d10b/d26/dbd/c115 0 2024-09-13T02:54:19.469 INFO:tasks.workunit.client.1.smithi131.stdout:8/791: dwrite db/d1d/d1f/fbe [0,4194304] 0 2024-09-13T02:54:19.469 INFO:tasks.workunit.client.1.smithi131.stdout:9/798: dread d0/d4d/d98/dbb/de4/d14/d1a/d2a/d5e/da2/f99 [0,4194304] 0 2024-09-13T02:54:19.469 INFO:tasks.workunit.client.1.smithi131.stdout:9/799: chown d0/d4d/d98/dbb/de4/d14/d1a/dcb 11220427 1 2024-09-13T02:54:19.469 INFO:tasks.workunit.client.1.smithi131.stdout:9/800: fsync d0/d4d/f9d 0 2024-09-13T02:54:19.469 INFO:tasks.workunit.client.1.smithi131.stdout:9/801: read - d0/d4d/d98/dbb/de4/d14/d1a/d2a/fb2 zero size 2024-09-13T02:54:19.470 INFO:tasks.workunit.client.1.smithi131.stdout:1/774: rename dd/d26/d2a/d69/dc0/d115 to dd/d26/d7d/d11b 0 2024-09-13T02:54:19.473 INFO:tasks.workunit.client.1.smithi131.stdout:1/775: creat dd/d26/d2a/d69/dc0/f11c x:0 0 0 2024-09-13T02:54:19.473 INFO:tasks.workunit.client.1.smithi131.stdout:1/776: dread - dd/f7e zero size 2024-09-13T02:54:19.475 INFO:tasks.workunit.client.1.smithi131.stdout:8/792: rename db/d1d/d34/fab to db/d1d/d34/d8d/ff8 0 2024-09-13T02:54:19.502 INFO:tasks.workunit.client.1.smithi131.stdout:5/592: dwrite d1/d21/d74/faf [0,4194304] 0 2024-09-13T02:54:19.502 INFO:tasks.workunit.client.1.smithi131.stdout:5/593: fdatasync d1/d1c/d8e/f5c 0 2024-09-13T02:54:19.503 INFO:tasks.workunit.client.1.smithi131.stdout:6/809: dwrite d1/d14/d10b/dc2/f88 [0,4194304] 0 2024-09-13T02:54:19.506 INFO:tasks.workunit.client.1.smithi131.stdout:6/810: mknod d1/d14/d10b/d26/c116 0 2024-09-13T02:54:19.508 INFO:tasks.workunit.client.1.smithi131.stdout:5/594: rmdir d1/d21/d74/d78 39 2024-09-13T02:54:19.509 INFO:tasks.workunit.client.1.smithi131.stdout:8/793: dwrite db/d1d/fed [0,4194304] 0 2024-09-13T02:54:19.509 INFO:tasks.workunit.client.1.smithi131.stdout:5/595: rmdir d1/d21/d74/d78/dbe 39 2024-09-13T02:54:19.511 INFO:tasks.workunit.client.1.smithi131.stdout:5/596: getdents d1/d21/d74 0 2024-09-13T02:54:19.512 INFO:tasks.workunit.client.1.smithi131.stdout:5/597: unlink d1/d9c/lc0 0 2024-09-13T02:54:19.516 INFO:tasks.workunit.client.1.smithi131.stdout:8/794: dread db/d1d/d1f/d5c/da1/fa5 [0,4194304] 0 2024-09-13T02:54:19.516 INFO:tasks.workunit.client.1.smithi131.stdout:1/777: dwrite dd/d26/d2a/d2c/d4b/ff2 [0,4194304] 0 2024-09-13T02:54:19.517 INFO:tasks.workunit.client.1.smithi131.stdout:6/811: dread d1/d14/d10b/dc2/d3b/fb9 [0,4194304] 0 2024-09-13T02:54:19.522 INFO:tasks.workunit.client.1.smithi131.stdout:1/778: creat dd/d26/d7d/f11d x:0 0 0 2024-09-13T02:54:19.525 INFO:tasks.workunit.client.1.smithi131.stdout:8/795: write db/d2b/d39/d56/f95 [3357722,71649] 0 2024-09-13T02:54:19.525 INFO:tasks.workunit.client.1.smithi131.stdout:8/796: chown db/d2b/d39/d56/fcf 0 1 2024-09-13T02:54:19.525 INFO:tasks.workunit.client.1.smithi131.stdout:8/797: stat db/d1d/d1f/d41/d50/db2 0 2024-09-13T02:54:19.525 INFO:tasks.workunit.client.1.smithi131.stdout:8/798: read - db/d1d/d34/d4e/f92 zero size 2024-09-13T02:54:19.526 INFO:tasks.workunit.client.1.smithi131.stdout:6/812: mknod d1/d14/d10b/d26/d1c/d79/c117 0 2024-09-13T02:54:19.526 INFO:tasks.workunit.client.1.smithi131.stdout:6/813: stat d1/d14/f7c 0 2024-09-13T02:54:19.527 INFO:tasks.workunit.client.1.smithi131.stdout:1/779: creat dd/d51/f11e x:0 0 0 2024-09-13T02:54:19.527 INFO:tasks.workunit.client.1.smithi131.stdout:5/598: dread d1/d21/d22/f55 [0,4194304] 0 2024-09-13T02:54:19.527 INFO:tasks.workunit.client.1.smithi131.stdout:9/802: dwrite d0/d4d/d98/dbb/de4/f5b [0,4194304] 0 2024-09-13T02:54:19.528 INFO:tasks.workunit.client.1.smithi131.stdout:6/814: rmdir d1/d14/d10b 39 2024-09-13T02:54:19.528 INFO:tasks.workunit.client.1.smithi131.stdout:6/815: chown d1/d14/d10b/dc2/d3b 0 1 2024-09-13T02:54:19.528 INFO:tasks.workunit.client.1.smithi131.stdout:6/816: readlink d1/d8/d9/db/d40/l4a 0 2024-09-13T02:54:19.529 INFO:tasks.workunit.client.1.smithi131.stdout:1/780: creat dd/d51/d8a/d107/f11f x:0 0 0 2024-09-13T02:54:19.529 INFO:tasks.workunit.client.1.smithi131.stdout:5/599: mkdir d1/d21/d74/d78/d98/dc9 0 2024-09-13T02:54:19.529 INFO:tasks.workunit.client.1.smithi131.stdout:5/600: dread - d1/d21/d74/d78/fb0 zero size 2024-09-13T02:54:19.530 INFO:tasks.workunit.client.1.smithi131.stdout:6/817: creat d1/d14/d10b/d26/dbd/f118 x:0 0 0 2024-09-13T02:54:19.531 INFO:tasks.workunit.client.1.smithi131.stdout:1/781: rmdir dd/d26/d44 39 2024-09-13T02:54:19.533 INFO:tasks.workunit.client.1.smithi131.stdout:5/601: mkdir d1/d1c/d87/dbd/dca 0 2024-09-13T02:54:19.533 INFO:tasks.workunit.client.1.smithi131.stdout:5/602: chown d1/d21/d90 33957 1 2024-09-13T02:54:19.534 INFO:tasks.workunit.client.1.smithi131.stdout:6/818: mknod d1/d14/d10b/d26/dbd/ddf/de3/c119 0 2024-09-13T02:54:19.535 INFO:tasks.workunit.client.1.smithi131.stdout:5/603: creat d1/d21/d74/fcb x:0 0 0 2024-09-13T02:54:19.536 INFO:tasks.workunit.client.1.smithi131.stdout:1/782: fdatasync dd/d26/fda 0 2024-09-13T02:54:19.536 INFO:tasks.workunit.client.1.smithi131.stdout:1/783: write dd/d26/d2a/d2c/d4b/f5b [2837385,126226] 0 2024-09-13T02:54:19.538 INFO:tasks.workunit.client.1.smithi131.stdout:5/604: creat d1/d29/d39/fcc x:0 0 0 2024-09-13T02:54:19.538 INFO:tasks.workunit.client.1.smithi131.stdout:5/605: fsync d1/d29/d3e/fb4 0 2024-09-13T02:54:19.539 INFO:tasks.workunit.client.1.smithi131.stdout:8/799: dread db/d1d/f5e [0,4194304] 0 2024-09-13T02:54:19.546 INFO:tasks.workunit.client.1.smithi131.stdout:9/803: dwrite d0/d4d/d98/dbb/de4/d14/d1a/d2a/f4e [0,4194304] 0 2024-09-13T02:54:19.548 INFO:tasks.workunit.client.1.smithi131.stdout:6/819: read d1/d8/d9/db/f36 [1199286,70280] 0 2024-09-13T02:54:19.549 INFO:tasks.workunit.client.1.smithi131.stdout:9/804: rename d0/d3f/fb7 to d0/d4d/d98/dbb/f115 0 2024-09-13T02:54:19.549 INFO:tasks.workunit.client.1.smithi131.stdout:9/805: chown d0/d4d/d98/dbb/de4/d14/d1a/dc6/de5/ff6 3579155 1 2024-09-13T02:54:19.549 INFO:tasks.workunit.client.1.smithi131.stdout:9/806: dread - d0/d4d/d98/dbb/de4/f114 zero size 2024-09-13T02:54:19.552 INFO:tasks.workunit.client.1.smithi131.stdout:6/820: getdents d1/d8/d9/db/d40/dd4 0 2024-09-13T02:54:19.552 INFO:tasks.workunit.client.1.smithi131.stdout:1/784: write dd/d26/fbf [4869644,36795] 0 2024-09-13T02:54:19.552 INFO:tasks.workunit.client.1.smithi131.stdout:6/821: symlink d1/d14/d10b/l11a 0 2024-09-13T02:54:19.552 INFO:tasks.workunit.client.1.smithi131.stdout:6/822: chown d1/d14/l56 5023 1 2024-09-13T02:54:19.552 INFO:tasks.workunit.client.1.smithi131.stdout:6/823: fsync d1/d8/d9/f1d 0 2024-09-13T02:54:19.552 INFO:tasks.workunit.client.1.smithi131.stdout:1/785: mkdir dd/d26/d44/d6d/d7c/d120 0 2024-09-13T02:54:19.553 INFO:tasks.workunit.client.1.smithi131.stdout:1/786: chown dd/d33/c56 166334 1 2024-09-13T02:54:19.554 INFO:tasks.workunit.client.1.smithi131.stdout:6/824: creat d1/d14/d10b/dff/f11b x:0 0 0 2024-09-13T02:54:19.556 INFO:tasks.workunit.client.1.smithi131.stdout:5/606: dwrite d1/fc6 [0,4194304] 0 2024-09-13T02:54:19.564 INFO:tasks.workunit.client.1.smithi131.stdout:5/607: dread d1/d5/fa [0,4194304] 0 2024-09-13T02:54:19.565 INFO:tasks.workunit.client.1.smithi131.stdout:6/825: dread d1/d14/d10b/dc2/d3b/f48 [0,4194304] 0 2024-09-13T02:54:19.566 INFO:tasks.workunit.client.1.smithi131.stdout:6/826: symlink d1/d8/d9/d10d/l11c 0 2024-09-13T02:54:19.566 INFO:tasks.workunit.client.1.smithi131.stdout:6/827: truncate d1/d8/d9/d8d/f103 378813 0 2024-09-13T02:54:19.567 INFO:tasks.workunit.client.1.smithi131.stdout:5/608: mkdir d1/d5/dcd 0 2024-09-13T02:54:19.567 INFO:tasks.workunit.client.1.smithi131.stdout:5/609: readlink d1/d21/d22/l54 0 2024-09-13T02:54:19.572 INFO:tasks.workunit.client.1.smithi131.stdout:5/610: dread d1/d29/f8d [0,4194304] 0 2024-09-13T02:54:19.573 INFO:tasks.workunit.client.1.smithi131.stdout:6/828: dread d1/d8/d9/db/d40/fb4 [0,4194304] 0 2024-09-13T02:54:19.573 INFO:tasks.workunit.client.1.smithi131.stdout:6/829: fsync d1/d53/f85 0 2024-09-13T02:54:19.573 INFO:tasks.workunit.client.1.smithi131.stdout:5/611: creat d1/d2f/d71/fce x:0 0 0 2024-09-13T02:54:19.576 INFO:tasks.workunit.client.1.smithi131.stdout:1/787: dwrite dd/f16 [8388608,4194304] 0 2024-09-13T02:54:19.576 INFO:tasks.workunit.client.1.smithi131.stdout:8/800: dwrite db/f23 [0,4194304] 0 2024-09-13T02:54:19.580 INFO:tasks.workunit.client.1.smithi131.stdout:1/788: mknod dd/d33/d42/d47/dd1/d10a/c121 0 2024-09-13T02:54:19.584 INFO:tasks.workunit.client.1.smithi131.stdout:1/789: truncate dd/d26/d44/f67 453970 0 2024-09-13T02:54:19.590 INFO:tasks.workunit.client.1.smithi131.stdout:1/790: dread f8 [0,4194304] 0 2024-09-13T02:54:19.606 INFO:tasks.workunit.client.1.smithi131.stdout:1/791: dread dd/fb6 [0,4194304] 0 2024-09-13T02:54:19.606 INFO:tasks.workunit.client.1.smithi131.stdout:6/830: dwrite d1/d14/d10b/d26/fe2 [0,4194304] 0 2024-09-13T02:54:19.607 INFO:tasks.workunit.client.1.smithi131.stdout:8/801: dwrite db/d1d/d1f/d41/d50/f9a [0,4194304] 0 2024-09-13T02:54:19.608 INFO:tasks.workunit.client.1.smithi131.stdout:5/612: dwrite d1/d2f/d33/f97 [0,4194304] 0 2024-09-13T02:54:19.608 INFO:tasks.workunit.client.1.smithi131.stdout:5/613: readlink d1/d2f/d33/l8f 0 2024-09-13T02:54:19.609 INFO:tasks.workunit.client.1.smithi131.stdout:6/831: getdents d1/d14/d10b/dc2/d3b 0 2024-09-13T02:54:19.610 INFO:tasks.workunit.client.1.smithi131.stdout:6/832: readlink d1/d8/d9/db/l32 0 2024-09-13T02:54:19.620 INFO:tasks.workunit.client.1.smithi131.stdout:6/833: dread d1/d14/d10b/d26/d1c/d4e/f81 [0,4194304] 0 2024-09-13T02:54:19.620 INFO:tasks.workunit.client.1.smithi131.stdout:8/802: dread db/d1d/d34/d4e/d7e/f83 [0,4194304] 0 2024-09-13T02:54:19.623 INFO:tasks.workunit.client.1.smithi131.stdout:8/803: truncate db/d2e/d40/f48 1490832 0 2024-09-13T02:54:19.624 INFO:tasks.workunit.client.1.smithi131.stdout:6/834: mknod d1/d8/d9/db/d40/dd4/c11d 0 2024-09-13T02:54:19.625 INFO:tasks.workunit.client.1.smithi131.stdout:8/804: read db/d1d/d34/d4e/f99 [894654,94437] 0 2024-09-13T02:54:19.626 INFO:tasks.workunit.client.1.smithi131.stdout:8/805: unlink db/d1d/d1f/d67/f6b 0 2024-09-13T02:54:19.628 INFO:tasks.workunit.client.1.smithi131.stdout:8/806: unlink db/d1d/d1f/d41/d50/f9a 0 2024-09-13T02:54:19.629 INFO:tasks.workunit.client.1.smithi131.stdout:8/807: mknod db/d1d/d34/d8d/dea/cf9 0 2024-09-13T02:54:19.630 INFO:tasks.workunit.client.1.smithi131.stdout:8/808: truncate db/d1d/d34/d4e/d7e/fcd 2123845 0 2024-09-13T02:54:19.635 INFO:tasks.workunit.client.1.smithi131.stdout:1/792: dwrite dd/d26/d2a/d2c/f5c [0,4194304] 0 2024-09-13T02:54:19.635 INFO:tasks.workunit.client.1.smithi131.stdout:1/793: chown dd/d26/d44/f23 173043 1 2024-09-13T02:54:19.635 INFO:tasks.workunit.client.1.smithi131.stdout:1/794: dread - dd/d33/d42/d47/dd1/dea/f111 zero size 2024-09-13T02:54:19.636 INFO:tasks.workunit.client.1.smithi131.stdout:5/614: dwrite d1/d5/f4e [0,4194304] 0 2024-09-13T02:54:19.639 INFO:tasks.workunit.client.1.smithi131.stdout:5/615: creat d1/d21/d90/fcf x:0 0 0 2024-09-13T02:54:19.640 INFO:tasks.workunit.client.1.smithi131.stdout:5/616: rmdir d1/d21/d74/d78/dbe 39 2024-09-13T02:54:19.645 INFO:tasks.workunit.client.1.smithi131.stdout:5/617: write d1/d50/f7d [131574,113783] 0 2024-09-13T02:54:19.645 INFO:tasks.workunit.client.1.smithi131.stdout:8/809: write db/d1d/d1f/d41/d50/f7d [1167364,3259] 0 2024-09-13T02:54:19.645 INFO:tasks.workunit.client.1.smithi131.stdout:8/810: stat db/d1d/d34/d4e/d7e/dc4/fe7 0 2024-09-13T02:54:19.646 INFO:tasks.workunit.client.1.smithi131.stdout:8/811: fsync db/d2b/d39/d56/fbf 0 2024-09-13T02:54:19.647 INFO:tasks.workunit.client.1.smithi131.stdout:5/618: symlink d1/d29/d3e/ld0 0 2024-09-13T02:54:19.649 INFO:tasks.workunit.client.1.smithi131.stdout:8/812: rmdir db/d1d/d1f/d41/d50/db2 0 2024-09-13T02:54:19.649 INFO:tasks.workunit.client.1.smithi131.stdout:8/813: dread - db/d1d/d71/fb9 zero size 2024-09-13T02:54:19.649 INFO:tasks.workunit.client.1.smithi131.stdout:8/814: write db/d2b/d39/fa2 [5107217,123400] 0 2024-09-13T02:54:19.649 INFO:tasks.workunit.client.1.smithi131.stdout:5/619: rmdir d1/d50 39 2024-09-13T02:54:19.650 INFO:tasks.workunit.client.1.smithi131.stdout:8/815: creat db/d2e/ffa x:0 0 0 2024-09-13T02:54:19.651 INFO:tasks.workunit.client.1.smithi131.stdout:5/620: mkdir d1/d9c/dd1 0 2024-09-13T02:54:19.659 INFO:tasks.workunit.client.1.smithi131.stdout:1/795: dwrite dd/d33/d80/fac [4194304,4194304] 0 2024-09-13T02:54:19.662 INFO:tasks.workunit.client.1.smithi131.stdout:1/796: mkdir dd/d33/d94/d122 0 2024-09-13T02:54:19.662 INFO:tasks.workunit.client.1.smithi131.stdout:1/797: dread - dd/d33/d42/d47/dd1/dea/f111 zero size 2024-09-13T02:54:19.681 INFO:tasks.workunit.client.1.smithi131.stdout:1/798: write dd/f15 [8119222,129622] 0 2024-09-13T02:54:19.681 INFO:tasks.workunit.client.1.smithi131.stdout:1/799: chown dd/d33/c3e 59 1 2024-09-13T02:54:19.681 INFO:tasks.workunit.client.1.smithi131.stdout:1/800: stat dd/d33/d42/d6f/cc3 0 2024-09-13T02:54:19.681 INFO:tasks.workunit.client.1.smithi131.stdout:8/816: dwrite db/d1d/d34/d4e/d7e/dc4/fda [0,4194304] 0 2024-09-13T02:54:19.683 INFO:tasks.workunit.client.1.smithi131.stdout:1/801: truncate dd/fb6 318712 0 2024-09-13T02:54:19.685 INFO:tasks.workunit.client.1.smithi131.stdout:5/621: dwrite d1/d21/d22/f26 [0,4194304] 0 2024-09-13T02:54:19.691 INFO:tasks.workunit.client.1.smithi131.stdout:8/817: symlink db/d1d/dc6/lfb 0 2024-09-13T02:54:19.691 INFO:tasks.workunit.client.1.smithi131.stdout:8/818: chown db/d2e/c6e 2 1 2024-09-13T02:54:19.694 INFO:tasks.workunit.client.1.smithi131.stdout:1/802: rename dd/d26/d44/d6d/lb0 to dd/d51/d8a/d107/l123 0 2024-09-13T02:54:19.696 INFO:tasks.workunit.client.1.smithi131.stdout:5/622: symlink d1/d29/ld2 0 2024-09-13T02:54:19.696 INFO:tasks.workunit.client.1.smithi131.stdout:5/623: fdatasync d1/d21/d22/f26 0 2024-09-13T02:54:19.696 INFO:tasks.workunit.client.1.smithi131.stdout:5/624: creat d1/d2f/fd3 x:0 0 0 2024-09-13T02:54:19.707 INFO:tasks.workunit.client.1.smithi131.stdout:5/625: dread d1/d1c/f1d [0,4194304] 0 2024-09-13T02:54:19.708 INFO:tasks.workunit.client.1.smithi131.stdout:5/626: fdatasync d1/d29/d3e/f42 0 2024-09-13T02:54:19.711 INFO:tasks.workunit.client.1.smithi131.stdout:5/627: dread d1/d2f/d33/f75 [0,4194304] 0 2024-09-13T02:54:19.714 INFO:tasks.workunit.client.1.smithi131.stdout:1/803: dwrite dd/d26/d2a/d69/fcf [0,4194304] 0 2024-09-13T02:54:19.714 INFO:tasks.workunit.client.1.smithi131.stdout:1/804: creat dd/d51/dad/f124 x:0 0 0 2024-09-13T02:54:19.720 INFO:tasks.workunit.client.1.smithi131.stdout:8/819: rmdir db/d1d/d1f/d67/dec 39 2024-09-13T02:54:19.723 INFO:tasks.workunit.client.1.smithi131.stdout:5/628: mknod d1/cd4 0 2024-09-13T02:54:19.727 INFO:tasks.workunit.client.1.smithi131.stdout:1/805: mkdir dd/d51/d8a/d95/d125 0 2024-09-13T02:54:19.729 INFO:tasks.workunit.client.1.smithi131.stdout:1/806: unlink f8 0 2024-09-13T02:54:19.729 INFO:tasks.workunit.client.1.smithi131.stdout:1/807: chown dd/d51/c63 1 1 2024-09-13T02:54:19.729 INFO:tasks.workunit.client.1.smithi131.stdout:1/808: write dd/d26/d44/d6d/d7c/faf [536580,104193] 0 2024-09-13T02:54:19.730 INFO:tasks.workunit.client.1.smithi131.stdout:5/629: mknod d1/d5/cd5 0 2024-09-13T02:54:19.732 INFO:tasks.workunit.client.1.smithi131.stdout:1/809: symlink dd/d51/db3/l126 0 2024-09-13T02:54:19.733 INFO:tasks.workunit.client.1.smithi131.stdout:5/630: rename d1/c58 to d1/d21/d74/d78/cd6 0 2024-09-13T02:54:19.733 INFO:tasks.workunit.client.1.smithi131.stdout:5/631: chown d1/d29/d3e/lbf 470972391 1 2024-09-13T02:54:19.734 INFO:tasks.workunit.client.1.smithi131.stdout:1/810: mkdir dd/d51/d8a/d95/d127 0 2024-09-13T02:54:19.736 INFO:tasks.workunit.client.1.smithi131.stdout:1/811: unlink dd/d51/d8a/f93 0 2024-09-13T02:54:19.736 INFO:tasks.workunit.client.1.smithi131.stdout:1/812: creat dd/d51/f128 x:0 0 0 2024-09-13T02:54:19.738 INFO:tasks.workunit.client.1.smithi131.stdout:1/813: unlink dd/d26/d44/l1d 0 2024-09-13T02:54:19.738 INFO:tasks.workunit.client.1.smithi131.stdout:1/814: read - dd/d51/d8a/d107/f11f zero size 2024-09-13T02:54:19.743 INFO:tasks.workunit.client.1.smithi131.stdout:5/632: dread d1/d29/d3e/f42 [0,4194304] 0 2024-09-13T02:54:19.762 INFO:tasks.workunit.client.1.smithi131.stdout:1/815: dwrite dd/d33/d94/f97 [4194304,4194304] 0 2024-09-13T02:54:19.765 INFO:tasks.workunit.client.1.smithi131.stdout:1/816: rename dd/d33/d42/d47/dd1/dea to dd/d33/d42/d47/dd1/d10a/d129 0 2024-09-13T02:54:19.791 INFO:tasks.workunit.client.1.smithi131.stdout:1/817: dwrite dd/d51/d8a/fcc [4194304,4194304] 0 2024-09-13T02:54:19.791 INFO:tasks.workunit.client.1.smithi131.stdout:1/818: stat dd/d26/d2a/d2c/d4b/fdc 0 2024-09-13T02:54:19.791 INFO:tasks.workunit.client.1.smithi131.stdout:1/819: chown dd/d26/c58 0 1 2024-09-13T02:54:19.808 INFO:tasks.workunit.client.1.smithi131.stdout:1/820: dread dd/d33/d94/fca [0,4194304] 0 2024-09-13T02:54:19.810 INFO:tasks.workunit.client.1.smithi131.stdout:1/821: truncate dd/d33/d42/d47/dd1/d101/f118 319739 0 2024-09-13T02:54:19.810 INFO:tasks.workunit.client.1.smithi131.stdout:1/822: write dd/d26/d2a/d69/dc0/f11c [202620,4624] 0 2024-09-13T02:54:19.810 INFO:tasks.workunit.client.1.smithi131.stdout:1/823: write dd/d33/d42/d47/fd5 [309277,30228] 0 2024-09-13T02:54:19.810 INFO:tasks.workunit.client.1.smithi131.stdout:1/824: dread - dd/d33/d42/ffd zero size 2024-09-13T02:54:19.810 INFO:tasks.workunit.client.1.smithi131.stdout:1/825: chown dd/d33/d42/d47/dd1/d101/f118 235087402 1 2024-09-13T02:54:19.812 INFO:tasks.workunit.client.1.smithi131.stdout:1/826: rename dd/d26/d2a/d2c/c37 to dd/d33/d42/d47/dd1/d101/c12a 0 2024-09-13T02:54:19.813 INFO:tasks.workunit.client.1.smithi131.stdout:1/827: creat dd/d26/f12b x:0 0 0 2024-09-13T02:54:19.815 INFO:tasks.workunit.client.1.smithi131.stdout:1/828: symlink dd/d51/l12c 0 2024-09-13T02:54:19.817 INFO:tasks.workunit.client.1.smithi131.stdout:1/829: symlink dd/d33/d94/db4/l12d 0 2024-09-13T02:54:19.840 INFO:tasks.workunit.client.1.smithi131.stdout:1/830: dwrite dd/d33/f6a [0,4194304] 0 2024-09-13T02:54:19.845 INFO:tasks.workunit.client.1.smithi131.stdout:1/831: dread dd/d26/d2a/d2c/d4b/fdc [0,4194304] 0 2024-09-13T02:54:19.845 INFO:tasks.workunit.client.1.smithi131.stdout:1/832: creat dd/d26/d2a/d2c/d4b/f12e x:0 0 0 2024-09-13T02:54:19.846 INFO:tasks.workunit.client.1.smithi131.stdout:1/833: dread - dd/d33/d80/f8c zero size 2024-09-13T02:54:19.848 INFO:tasks.workunit.client.1.smithi131.stdout:1/834: unlink dd/d26/d2a/d2c/d4b/l4f 0 2024-09-13T02:54:19.848 INFO:tasks.workunit.client.1.smithi131.stdout:1/835: truncate dd/dc2/f9b 754338 0 2024-09-13T02:54:19.848 INFO:tasks.workunit.client.1.smithi131.stdout:1/836: dread - dd/fd3 zero size 2024-09-13T02:54:19.849 INFO:tasks.workunit.client.1.smithi131.stdout:1/837: mkdir dd/d33/d42/d47/d12f 0 2024-09-13T02:54:19.849 INFO:tasks.workunit.client.1.smithi131.stdout:1/838: dread - dd/d26/fbc zero size 2024-09-13T02:54:19.871 INFO:tasks.workunit.client.1.smithi131.stdout:1/839: dwrite dd/d33/d94/fd7 [4194304,4194304] 0 2024-09-13T02:54:19.873 INFO:tasks.workunit.client.1.smithi131.stdout:1/840: getdents dd/d26/d7d 0 2024-09-13T02:54:19.873 INFO:tasks.workunit.client.1.smithi131.stdout:1/841: truncate dd/d26/d44/d6d/fc9 4902555 0 2024-09-13T02:54:19.874 INFO:tasks.workunit.client.1.smithi131.stdout:1/842: creat dd/d26/d7d/d11b/f130 x:0 0 0 2024-09-13T02:54:19.874 INFO:tasks.workunit.client.1.smithi131.stdout:1/843: write dd/d33/d80/fc6 [518618,82966] 0 2024-09-13T02:54:19.875 INFO:tasks.workunit.client.1.smithi131.stdout:1/844: creat dd/d26/d7d/f131 x:0 0 0 2024-09-13T02:54:19.892 INFO:tasks.workunit.client.1.smithi131.stdout:1/845: dwrite dd/d51/d8a/d95/f113 [0,4194304] 0 2024-09-13T02:54:19.892 INFO:tasks.workunit.client.1.smithi131.stdout:1/846: dread - dd/d26/d7d/d11b/f130 zero size 2024-09-13T02:54:19.892 INFO:tasks.workunit.client.1.smithi131.stdout:1/847: stat dd/d26/d7d/d11b/f130 0 2024-09-13T02:54:20.080 INFO:tasks.workunit.client.1.smithi131.stdout:4/836: sync 2024-09-13T02:54:20.082 INFO:tasks.workunit.client.1.smithi131.stdout:4/837: mknod d1/d18/d34/df8/c11e 0 2024-09-13T02:54:20.083 INFO:tasks.workunit.client.1.smithi131.stdout:4/838: rename d1/d18/f110 to d1/d18/d43/d97/dba/d22/f11f 0 2024-09-13T02:54:20.084 INFO:tasks.workunit.client.1.smithi131.stdout:4/839: mknod d1/d18/d43/d97/d109/c120 0 2024-09-13T02:54:20.088 INFO:tasks.workunit.client.1.smithi131.stdout:4/840: rename d1/d18/d34/df8 to d1/dbe/d121 0 2024-09-13T02:54:20.088 INFO:tasks.workunit.client.1.smithi131.stdout:4/841: fdatasync d1/d18/d34/f6f 0 2024-09-13T02:54:20.089 INFO:tasks.workunit.client.1.smithi131.stdout:4/842: mkdir d1/d122 0 2024-09-13T02:54:20.090 INFO:tasks.workunit.client.1.smithi131.stdout:4/843: mknod d1/d18/d34/d4e/d108/d33/d3a/da8/c123 0 2024-09-13T02:54:20.092 INFO:tasks.workunit.client.1.smithi131.stdout:4/844: rename d1/d18/d43/d65/dbd/dc1/lad to d1/d18/d34/d62/da3/ded/l124 0 2024-09-13T02:54:20.092 INFO:tasks.workunit.client.1.smithi131.stdout:4/845: creat d1/d18/d81/f125 x:0 0 0 2024-09-13T02:54:20.093 INFO:tasks.workunit.client.1.smithi131.stdout:4/846: unlink d1/d18/d34/d62/c86 0 2024-09-13T02:54:20.093 INFO:tasks.workunit.client.1.smithi131.stdout:4/847: chown d1/d18/d81/f8b 1024 1 2024-09-13T02:54:20.093 INFO:tasks.workunit.client.1.smithi131.stdout:4/848: dread - d1/d18/d34/d62/d78/fe8 zero size 2024-09-13T02:54:20.094 INFO:tasks.workunit.client.1.smithi131.stdout:4/849: link d1/d18/d43/d97/dba/d22/d73/ldc d1/dbe/l126 0 2024-09-13T02:54:20.185 INFO:tasks.workunit.client.1.smithi131.stdout:2/777: sync 2024-09-13T02:54:20.185 INFO:tasks.workunit.client.1.smithi131.stdout:2/778: dread - d5/d31/d26/f7f zero size 2024-09-13T02:54:20.186 INFO:tasks.workunit.client.1.smithi131.stdout:2/779: rename d5/d31/d1d/d50/dc9 to d5/d31/d1d/d50/d10e 0 2024-09-13T02:54:20.187 INFO:tasks.workunit.client.1.smithi131.stdout:2/780: write d5/d31/d21/d57/f100 [883834,15670] 0 2024-09-13T02:54:20.187 INFO:tasks.workunit.client.1.smithi131.stdout:2/781: symlink d5/d31/d21/d57/d90/l10f 0 2024-09-13T02:54:20.188 INFO:tasks.workunit.client.1.smithi131.stdout:2/782: rename d5/d31/d1d/d32/d3b/d67/d87/db4/dbc/f4d to d5/d31/d4e/f110 0 2024-09-13T02:54:20.205 INFO:tasks.workunit.client.1.smithi131.stdout:2/783: dwrite d5/d6e/f92 [0,4194304] 0 2024-09-13T02:54:20.205 INFO:tasks.workunit.client.1.smithi131.stdout:2/784: chown d5/d31/c3c 0 1 2024-09-13T02:54:20.206 INFO:tasks.workunit.client.1.smithi131.stdout:2/785: mknod d5/d31/d1d/d32/d3b/d67/d87/db4/dbc/c111 0 2024-09-13T02:54:20.207 INFO:tasks.workunit.client.1.smithi131.stdout:2/786: mkdir d5/d31/d1d/d37/d112 0 2024-09-13T02:54:20.230 INFO:tasks.workunit.client.1.smithi131.stdout:2/787: dwrite d5/d31/d4e/ffb [4194304,4194304] 0 2024-09-13T02:54:20.230 INFO:tasks.workunit.client.1.smithi131.stdout:2/788: fdatasync d5/d31/d1d/d32/d3b/fd2 0 2024-09-13T02:54:20.230 INFO:tasks.workunit.client.1.smithi131.stdout:2/789: symlink d5/d31/d4e/l113 0 2024-09-13T02:54:20.234 INFO:tasks.workunit.client.1.smithi131.stdout:2/790: rename d5/d31/d1d/d32/d3b/d67/d87 to d5/d31/d1d/d37/d112/d114 0 2024-09-13T02:54:20.235 INFO:tasks.workunit.client.1.smithi131.stdout:2/791: write d5/d31/d1d/d37/d7c/f80 [4402561,73886] 0 2024-09-13T02:54:20.251 INFO:tasks.workunit.client.1.smithi131.stdout:2/792: dwrite d5/d31/d4e/f110 [0,4194304] 0 2024-09-13T02:54:20.251 INFO:tasks.workunit.client.1.smithi131.stdout:2/793: write d5/d34/fa7 [1128736,35919] 0 2024-09-13T02:54:20.252 INFO:tasks.workunit.client.1.smithi131.stdout:2/794: fdatasync d5/f28 0 2024-09-13T02:54:20.253 INFO:tasks.workunit.client.1.smithi131.stdout:2/795: mkdir d5/d18/d68/de3/d66/d115 0 2024-09-13T02:54:20.253 INFO:tasks.workunit.client.1.smithi131.stdout:2/796: symlink d5/d18/d68/de3/d41/l116 0 2024-09-13T02:54:20.254 INFO:tasks.workunit.client.1.smithi131.stdout:2/797: mknod d5/d31/d26/c117 0 2024-09-13T02:54:20.255 INFO:tasks.workunit.client.1.smithi131.stdout:2/798: rename d5/d34/d42/de7 to d5/d34/d118 0 2024-09-13T02:54:20.261 INFO:tasks.workunit.client.1.smithi131.stdout:2/799: dread d5/d18/d68/de3/d66/fd4 [0,4194304] 0 2024-09-13T02:54:20.262 INFO:tasks.workunit.client.1.smithi131.stdout:2/800: link d5/d34/d42/l7e d5/d31/d1d/d37/d112/d114/db4/dbc/d48/l119 0 2024-09-13T02:54:20.263 INFO:tasks.workunit.client.1.smithi131.stdout:2/801: mkdir d5/d31/d1d/d37/d112/d114/db4/dbc/ddf/d11a 0 2024-09-13T02:54:20.263 INFO:tasks.workunit.client.1.smithi131.stdout:2/802: write d5/d31/d4e/fb2 [448228,95758] 0 2024-09-13T02:54:20.264 INFO:tasks.workunit.client.1.smithi131.stdout:2/803: symlink d5/d31/d1d/l11b 0 2024-09-13T02:54:20.265 INFO:tasks.workunit.client.1.smithi131.stdout:2/804: rename d5/d31/d1d/d32/d3b/f9a to d5/d18/d4b/df6/f11c 0 2024-09-13T02:54:20.274 INFO:tasks.workunit.client.1.smithi131.stdout:2/805: write d5/d18/d4b/f40 [1747129,73607] 0 2024-09-13T02:54:20.274 INFO:tasks.workunit.client.1.smithi131.stdout:2/806: write d5/d31/d1d/d32/d3b/ff4 [622103,7112] 0 2024-09-13T02:54:20.275 INFO:tasks.workunit.client.1.smithi131.stdout:2/807: creat d5/d31/d1d/d37/d112/d114/db4/dbc/ddf/f11d x:0 0 0 2024-09-13T02:54:20.276 INFO:tasks.workunit.client.1.smithi131.stdout:2/808: symlink d5/d18/d68/de3/l11e 0 2024-09-13T02:54:20.276 INFO:tasks.workunit.client.1.smithi131.stdout:2/809: write d5/d18/d4b/f109 [1000146,71162] 0 2024-09-13T02:54:20.277 INFO:tasks.workunit.client.1.smithi131.stdout:2/810: creat d5/f11f x:0 0 0 2024-09-13T02:54:20.286 INFO:tasks.workunit.client.1.smithi131.stdout:2/811: dread d5/d31/d1d/d32/f49 [0,4194304] 0 2024-09-13T02:54:20.288 INFO:tasks.workunit.client.1.smithi131.stdout:2/812: rename d5/d31/d1d/d32/d3b/d67/cf1 to d5/d31/d1d/d32/d3b/d67/c120 0 2024-09-13T02:54:20.288 INFO:tasks.workunit.client.1.smithi131.stdout:2/813: mkdir d5/d31/d1d/d50/d121 0 2024-09-13T02:54:20.298 INFO:tasks.workunit.client.1.smithi131.stdout:3/639: sync 2024-09-13T02:54:20.299 INFO:tasks.workunit.client.1.smithi131.stdout:0/910: sync 2024-09-13T02:54:20.299 INFO:tasks.workunit.client.1.smithi131.stdout:7/661: sync 2024-09-13T02:54:20.299 INFO:tasks.workunit.client.1.smithi131.stdout:1/848: sync 2024-09-13T02:54:20.299 INFO:tasks.workunit.client.1.smithi131.stdout:1/849: truncate dd/d26/d44/f40 272287 0 2024-09-13T02:54:20.299 INFO:tasks.workunit.client.1.smithi131.stdout:4/850: sync 2024-09-13T02:54:20.299 INFO:tasks.workunit.client.1.smithi131.stdout:5/633: sync 2024-09-13T02:54:20.299 INFO:tasks.workunit.client.1.smithi131.stdout:1/850: fdatasync dd/d26/d44/d6d/f119 0 2024-09-13T02:54:20.299 INFO:tasks.workunit.client.1.smithi131.stdout:4/851: truncate d1/d18/f9a 4877142 0 2024-09-13T02:54:20.299 INFO:tasks.workunit.client.1.smithi131.stdout:4/852: stat d1/d18/d34/f5a 0 2024-09-13T02:54:20.299 INFO:tasks.workunit.client.1.smithi131.stdout:1/851: creat dd/d26/d2a/d2c/d4b/f132 x:0 0 0 2024-09-13T02:54:20.299 INFO:tasks.workunit.client.1.smithi131.stdout:6/835: sync 2024-09-13T02:54:20.299 INFO:tasks.workunit.client.1.smithi131.stdout:9/807: sync 2024-09-13T02:54:20.300 INFO:tasks.workunit.client.1.smithi131.stdout:8/820: sync 2024-09-13T02:54:20.300 INFO:tasks.workunit.client.1.smithi131.stdout:2/814: dread d5/d31/d21/d57/d90/dc8/fef [0,4194304] 0 2024-09-13T02:54:20.301 INFO:tasks.workunit.client.1.smithi131.stdout:3/640: mknod d2/d4/d7/d1d/d24/d7e/cd6 0 2024-09-13T02:54:20.303 INFO:tasks.workunit.client.1.smithi131.stdout:0/911: creat d0/d2/d62/f13c x:0 0 0 2024-09-13T02:54:20.304 INFO:tasks.workunit.client.1.smithi131.stdout:5/634: mknod d1/d29/d39/cd7 0 2024-09-13T02:54:20.305 INFO:tasks.workunit.client.1.smithi131.stdout:5/635: write d1/d21/d74/d78/d98/fa8 [264468,82603] 0 2024-09-13T02:54:20.307 INFO:tasks.workunit.client.1.smithi131.stdout:8/821: rename db/d2b/d39/d56/c79 to db/d1d/d34/d4e/dd7/cfc 0 2024-09-13T02:54:20.307 INFO:tasks.workunit.client.1.smithi131.stdout:8/822: creat db/d1d/d1f/d67/d81/ffd x:0 0 0 2024-09-13T02:54:20.312 INFO:tasks.workunit.client.1.smithi131.stdout:2/815: mkdir d5/d31/d1d/d37/d112/d114/d10c/d122 0 2024-09-13T02:54:20.312 INFO:tasks.workunit.client.1.smithi131.stdout:3/641: creat d2/d4/d7/d1d/d80/fd7 x:0 0 0 2024-09-13T02:54:20.313 INFO:tasks.workunit.client.1.smithi131.stdout:5/636: symlink d1/d21/ld8 0 2024-09-13T02:54:20.316 INFO:tasks.workunit.client.1.smithi131.stdout:1/852: dread dd/d26/d2a/d2c/f34 [0,4194304] 0 2024-09-13T02:54:20.317 INFO:tasks.workunit.client.1.smithi131.stdout:3/642: symlink d2/d4/d76/d9f/ld8 0 2024-09-13T02:54:20.317 INFO:tasks.workunit.client.1.smithi131.stdout:1/853: creat dd/d26/d2a/d2c/d4b/d10b/f133 x:0 0 0 2024-09-13T02:54:20.321 INFO:tasks.workunit.client.1.smithi131.stdout:7/662: dread f10 [0,4194304] 0 2024-09-13T02:54:20.324 INFO:tasks.workunit.client.1.smithi131.stdout:3/643: rename d2/dc/d39/c5f to d2/d4/d76/d9f/d41/cd9 0 2024-09-13T02:54:20.367 INFO:tasks.workunit.client.1.smithi131.stdout:6/836: dwrite d1/d14/d10b/d26/d1c/d4e/f81 [0,4194304] 0 2024-09-13T02:54:20.367 INFO:tasks.workunit.client.1.smithi131.stdout:0/912: dwrite d0/de/d1f/d22/d31/d39/f74 [0,4194304] 0 2024-09-13T02:54:20.367 INFO:tasks.workunit.client.1.smithi131.stdout:6/837: mknod d1/d14/d10b/c11e 0 2024-09-13T02:54:20.367 INFO:tasks.workunit.client.1.smithi131.stdout:6/838: dread - d1/d8/d9/d8d/ff2 zero size 2024-09-13T02:54:20.368 INFO:tasks.workunit.client.1.smithi131.stdout:0/913: symlink d0/de/d1f/d22/d31/l13d 0 2024-09-13T02:54:20.368 INFO:tasks.workunit.client.1.smithi131.stdout:0/914: chown d0/de/d1f 249 1 2024-09-13T02:54:20.369 INFO:tasks.workunit.client.1.smithi131.stdout:6/839: rename d1/d8/d9/d4b/lfb to d1/d14/d10b/d26/d1c/l11f 0 2024-09-13T02:54:20.369 INFO:tasks.workunit.client.1.smithi131.stdout:6/840: chown d1/d14/d10b/d26/d1c/d79/d92/fb7 94 1 2024-09-13T02:54:20.369 INFO:tasks.workunit.client.1.smithi131.stdout:6/841: fsync d1/d8/d9/db/d40/fc0 0 2024-09-13T02:54:20.369 INFO:tasks.workunit.client.1.smithi131.stdout:4/853: dwrite d1/d18/d34/d4e/d108/d8d/dc9/fc2 [4194304,4194304] 0 2024-09-13T02:54:20.370 INFO:tasks.workunit.client.1.smithi131.stdout:9/808: dwrite d0/d4d/d98/dbb/de4/d14/d17/db0/fd6 [0,4194304] 0 2024-09-13T02:54:20.370 INFO:tasks.workunit.client.1.smithi131.stdout:6/842: mkdir d1/d14/d10b/d26/d1c/d79/d120 0 2024-09-13T02:54:20.370 INFO:tasks.workunit.client.1.smithi131.stdout:1/854: dwrite dd/d33/d80/fc6 [0,4194304] 0 2024-09-13T02:54:20.370 INFO:tasks.workunit.client.1.smithi131.stdout:1/855: dread - dd/d26/d2a/d2c/d4b/f12e zero size 2024-09-13T02:54:20.370 INFO:tasks.workunit.client.1.smithi131.stdout:1/856: creat dd/d51/f134 x:0 0 0 2024-09-13T02:54:20.370 INFO:tasks.workunit.client.1.smithi131.stdout:7/663: dwrite d1b/d3b/d31/fc5 [0,4194304] 0 2024-09-13T02:54:20.370 INFO:tasks.workunit.client.1.smithi131.stdout:8/823: dwrite db/d2b/d39/d56/fcf [0,4194304] 0 2024-09-13T02:54:20.371 INFO:tasks.workunit.client.1.smithi131.stdout:3/644: dwrite d2/d4/d7/d1d/f2c [0,4194304] 0 2024-09-13T02:54:20.371 INFO:tasks.workunit.client.1.smithi131.stdout:4/854: creat d1/d18/d43/d97/dba/d22/d49/f127 x:0 0 0 2024-09-13T02:54:20.371 INFO:tasks.workunit.client.1.smithi131.stdout:4/855: truncate d1/d18/d34/d62/d78/feb 642732 0 2024-09-13T02:54:20.373 INFO:tasks.workunit.client.1.smithi131.stdout:9/809: mkdir d0/d4d/d98/dbb/de4/d14/d1a/d2a/d5e/da2/d39/dae/d116 0 2024-09-13T02:54:20.374 INFO:tasks.workunit.client.1.smithi131.stdout:6/843: mknod d1/d14/d10b/d26/d1c/d79/c121 0 2024-09-13T02:54:20.374 INFO:tasks.workunit.client.1.smithi131.stdout:6/844: getdents d1/d8/d9/db/d40/dd4/df7 0 2024-09-13T02:54:20.382 INFO:tasks.workunit.client.1.smithi131.stdout:8/824: dread db/d2b/f6d [0,4194304] 0 2024-09-13T02:54:20.388 INFO:tasks.workunit.client.1.smithi131.stdout:7/664: symlink d1b/d3b/d31/d5f/ddf/le0 0 2024-09-13T02:54:20.392 INFO:tasks.workunit.client.1.smithi131.stdout:3/645: mkdir d2/d4/db7/dda 0 2024-09-13T02:54:20.392 INFO:tasks.workunit.client.1.smithi131.stdout:3/646: truncate d2/d4/d7/d1d/d80/fd7 662961 0 2024-09-13T02:54:20.393 INFO:tasks.workunit.client.1.smithi131.stdout:3/647: fsync d2/d4/d1a/d31/da7/fae 0 2024-09-13T02:54:20.393 INFO:tasks.workunit.client.1.smithi131.stdout:3/648: fsync d2/d4/d7/d1d/f2e 0 2024-09-13T02:54:20.393 INFO:tasks.workunit.client.1.smithi131.stdout:9/810: rename d0/d3f/c73 to d0/d4d/d98/dbb/c117 0 2024-09-13T02:54:20.394 INFO:tasks.workunit.client.1.smithi131.stdout:0/915: dwrite d0/de/d1f/d22/d31/d39/d40/fd5 [0,4194304] 0 2024-09-13T02:54:20.394 INFO:tasks.workunit.client.1.smithi131.stdout:7/665: stat d1b/d3b/d31/d5f/la0 0 2024-09-13T02:54:20.395 INFO:tasks.workunit.client.1.smithi131.stdout:1/857: dwrite dd/d26/d2a/d69/fcf [0,4194304] 0 2024-09-13T02:54:20.396 INFO:tasks.workunit.client.1.smithi131.stdout:3/649: symlink d2/d4/d7/d1d/d24/d6f/d7f/ldb 0 2024-09-13T02:54:20.396 INFO:tasks.workunit.client.1.smithi131.stdout:9/811: rmdir d0/d4d 39 2024-09-13T02:54:20.397 INFO:tasks.workunit.client.1.smithi131.stdout:6/845: mknod d1/d14/d10b/d26/d1c/d4e/c122 0 2024-09-13T02:54:20.397 INFO:tasks.workunit.client.1.smithi131.stdout:6/846: chown d1/cfa 66698 1 2024-09-13T02:54:20.397 INFO:tasks.workunit.client.1.smithi131.stdout:6/847: fsync d1/d14/d10b/dc2/f33 0 2024-09-13T02:54:20.400 INFO:tasks.workunit.client.1.smithi131.stdout:7/666: rename d1b/d3b/d31/f95 to d1b/d3b/d31/fe1 0 2024-09-13T02:54:20.400 INFO:tasks.workunit.client.1.smithi131.stdout:7/667: fdatasync d1b/d3b/f6b 0 2024-09-13T02:54:20.401 INFO:tasks.workunit.client.1.smithi131.stdout:9/812: rmdir d0/d4d/d98/dbb/de4/d14/d95 39 2024-09-13T02:54:20.401 INFO:tasks.workunit.client.1.smithi131.stdout:9/813: fsync d0/d4d/fef 0 2024-09-13T02:54:20.403 INFO:tasks.workunit.client.1.smithi131.stdout:7/668: getdents d1b/d73 0 2024-09-13T02:54:20.404 INFO:tasks.workunit.client.1.smithi131.stdout:9/814: truncate d0/d4d/d98/dbb/de4/d14/d1a/d2a/d5e/f80 1453656 0 2024-09-13T02:54:20.404 INFO:tasks.workunit.client.1.smithi131.stdout:9/815: chown d0/d4d/d98/dbb/de4/d14/d1a/d2a/d5e/d79/l103 219721 1 2024-09-13T02:54:20.404 INFO:tasks.workunit.client.1.smithi131.stdout:9/816: fdatasync d0/d4d/d98/dbb/de4/d14/f34 0 2024-09-13T02:54:20.405 INFO:tasks.workunit.client.1.smithi131.stdout:7/669: symlink d1b/d3b/d46/d4b/le2 0 2024-09-13T02:54:20.407 INFO:tasks.workunit.client.1.smithi131.stdout:7/670: mkdir d1b/d3b/d51/d62/d6d/da5/dd8/de3 0 2024-09-13T02:54:20.410 INFO:tasks.workunit.client.1.smithi131.stdout:3/650: write d2/d4/d7/d1d/f21 [7851660,75840] 0 2024-09-13T02:54:20.411 INFO:tasks.workunit.client.1.smithi131.stdout:3/651: getdents d2/dc 0 2024-09-13T02:54:20.411 INFO:tasks.workunit.client.1.smithi131.stdout:7/671: rmdir d1b/d3b/d51/d8f 39 2024-09-13T02:54:20.412 INFO:tasks.workunit.client.1.smithi131.stdout:3/652: link d2/d4/d2d/d92/f90 d2/dc/d39/fdc 0 2024-09-13T02:54:20.413 INFO:tasks.workunit.client.1.smithi131.stdout:3/653: creat d2/d4/d76/d9f/d41/d5c/d4f/fdd x:0 0 0 2024-09-13T02:54:20.413 INFO:tasks.workunit.client.1.smithi131.stdout:3/654: truncate d2/dc/d39/f79 1616358 0 2024-09-13T02:54:20.414 INFO:tasks.workunit.client.1.smithi131.stdout:3/655: write d2/d4/d7/d1d/d24/d96/fcf [906280,94027] 0 2024-09-13T02:54:20.420 INFO:tasks.workunit.client.1.smithi131.stdout:7/672: dread d1b/f2c [0,4194304] 0 2024-09-13T02:54:20.420 INFO:tasks.workunit.client.1.smithi131.stdout:7/673: chown d1b/d23 679653 1 2024-09-13T02:54:20.422 INFO:tasks.workunit.client.1.smithi131.stdout:7/674: symlink d1b/d23/d54/dc6/le4 0 2024-09-13T02:54:20.422 INFO:tasks.workunit.client.1.smithi131.stdout:7/675: dread - d1b/d3b/d51/d62/d9e/da2/fdb zero size 2024-09-13T02:54:20.423 INFO:tasks.workunit.client.1.smithi131.stdout:7/676: mkdir d1b/de5 0 2024-09-13T02:54:20.425 INFO:tasks.workunit.client.1.smithi131.stdout:3/656: dread d2/d4/d7/d1d/d24/d6f/f89 [0,4194304] 0 2024-09-13T02:54:20.429 INFO:tasks.workunit.client.1.smithi131.stdout:7/677: dread d1b/d3b/d31/d7c/db7/da7/fae [0,4194304] 0 2024-09-13T02:54:20.433 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:20 smithi131 ceph-mon[34689]: pgmap v252: 65 pgs: 65 active+clean; 2.8 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 173 MiB/s rd, 206 MiB/s wr, 391 op/s 2024-09-13T02:54:20.466 INFO:tasks.workunit.client.1.smithi131.stdout:8/825: dwrite db/d2b/f6d [0,4194304] 0 2024-09-13T02:54:20.468 INFO:tasks.workunit.client.1.smithi131.stdout:4/856: dwrite d1/d18/d34/d62/d78/ffb [0,4194304] 0 2024-09-13T02:54:20.468 INFO:tasks.workunit.client.1.smithi131.stdout:4/857: write d1/fef [487239,1231] 0 2024-09-13T02:54:20.471 INFO:tasks.workunit.client.1.smithi131.stdout:4/858: mknod d1/d18/d34/d62/da3/c128 0 2024-09-13T02:54:20.471 INFO:tasks.workunit.client.1.smithi131.stdout:4/859: chown d1/d18/d43/d97/dba/f4f 8 1 2024-09-13T02:54:20.472 INFO:tasks.workunit.client.1.smithi131.stdout:4/860: truncate d1/f27 926643 0 2024-09-13T02:54:20.477 INFO:tasks.workunit.client.1.smithi131.stdout:9/817: rename d0/d4d/d98/dbb/de4 to d0/d4d/d55/d76/d96/d118 0 2024-09-13T02:54:20.478 INFO:tasks.workunit.client.1.smithi131.stdout:3/657: rename d2/d4/d7/d1d/d24/d7e to d2/d4/d7/d1d/d80/dde 0 2024-09-13T02:54:20.478 INFO:tasks.workunit.client.1.smithi131.stdout:3/658: read - d2/d4/d7/d1d/d24/fb0 zero size 2024-09-13T02:54:20.479 INFO:tasks.workunit.client.1.smithi131.stdout:9/818: link d0/fc5 d0/d4d/d55/d76/d96/d118/d14/d1a/d2a/d5e/da2/d39/f119 0 2024-09-13T02:54:20.481 INFO:tasks.workunit.client.1.smithi131.stdout:3/659: unlink d2/d4/d76/d9f/d41/cd9 0 2024-09-13T02:54:20.481 INFO:tasks.workunit.client.1.smithi131.stdout:3/660: getdents d2/d4/d7/d1d/db4/dcc 0 2024-09-13T02:54:20.483 INFO:tasks.workunit.client.1.smithi131.stdout:3/661: symlink d2/d4/d7/d1d/d80/ldf 0 2024-09-13T02:54:20.493 INFO:tasks.workunit.client.1.smithi131.stdout:3/662: dread d2/d4/d7/d1d/f2c [0,4194304] 0 2024-09-13T02:54:20.502 INFO:tasks.workunit.client.1.smithi131.stdout:7/678: dwrite d1b/f21 [0,4194304] 0 2024-09-13T02:54:20.503 INFO:tasks.workunit.client.1.smithi131.stdout:8/826: dwrite db/d2b/d39/fa2 [4194304,4194304] 0 2024-09-13T02:54:20.504 INFO:tasks.workunit.client.1.smithi131.stdout:8/827: unlink db/d1d/d34/ca0 0 2024-09-13T02:54:20.504 INFO:tasks.workunit.client.1.smithi131.stdout:8/828: stat db/d2e/f43 0 2024-09-13T02:54:20.505 INFO:tasks.workunit.client.1.smithi131.stdout:4/861: dwrite d1/d18/d81/f125 [0,4194304] 0 2024-09-13T02:54:20.505 INFO:tasks.workunit.client.1.smithi131.stdout:9/819: dwrite d0/d4d/fef [0,4194304] 0 2024-09-13T02:54:20.505 INFO:tasks.workunit.client.1.smithi131.stdout:7/679: creat d1b/d3b/d51/d62/d6d/da5/dd8/fe6 x:0 0 0 2024-09-13T02:54:20.506 INFO:tasks.workunit.client.1.smithi131.stdout:7/680: read d1b/d3b/d46/d4b/d57/d7b/d92/f96 [343113,24008] 0 2024-09-13T02:54:20.507 INFO:tasks.workunit.client.1.smithi131.stdout:3/663: dread d2/d4/d7/d1d/d24/d96/fd0 [0,4194304] 0 2024-09-13T02:54:20.507 INFO:tasks.workunit.client.1.smithi131.stdout:8/829: rename db/d2b/d39/l5a to db/d1d/d34/d4e/lfe 0 2024-09-13T02:54:20.507 INFO:tasks.workunit.client.1.smithi131.stdout:8/830: fdatasync db/d1d/d34/d4e/d7e/d90/fd9 0 2024-09-13T02:54:20.515 INFO:tasks.workunit.client.1.smithi131.stdout:9/820: dread d0/d4d/d55/d76/d96/d118/d14/d1a/d2a/f7d [0,4194304] 0 2024-09-13T02:54:20.515 INFO:tasks.workunit.client.1.smithi131.stdout:9/821: chown d0/d4d/d55/d76/d96/cd4 896069 1 2024-09-13T02:54:20.515 INFO:tasks.workunit.client.1.smithi131.stdout:9/822: write d0/d4d/d55/d76/d96/d118/d14/d1a/d2a/d5e/da2/d39/f119 [689864,10640] 0 2024-09-13T02:54:20.521 INFO:tasks.workunit.client.1.smithi131.stdout:3/664: symlink d2/d4/d7/d1d/d24/d6f/d7f/le0 0 2024-09-13T02:54:20.521 INFO:tasks.workunit.client.1.smithi131.stdout:3/665: chown d2/d4/d2d/dce/dc4/cc6 1839223 1 2024-09-13T02:54:20.521 INFO:tasks.workunit.client.1.smithi131.stdout:3/666: stat d2/dc/f2a 0 2024-09-13T02:54:20.521 INFO:tasks.workunit.client.1.smithi131.stdout:3/667: write d2/d4/d76/d9f/d41/fa9 [234891,64788] 0 2024-09-13T02:54:20.521 INFO:tasks.workunit.client.1.smithi131.stdout:3/668: stat d2/d4/d2d/dce 0 2024-09-13T02:54:20.523 INFO:tasks.workunit.client.1.smithi131.stdout:4/862: rename d1/d18/d34/d4e/ff6 to d1/d18/d34/d4e/d108/d33/d3a/f129 0 2024-09-13T02:54:20.524 INFO:tasks.workunit.client.1.smithi131.stdout:9/823: dread d0/f12 [0,4194304] 0 2024-09-13T02:54:20.527 INFO:tasks.workunit.client.1.smithi131.stdout:3/669: rename d2/d4/d1a/d31/f42 to d2/d4/d7/d1d/d80/dde/fe1 0 2024-09-13T02:54:20.528 INFO:tasks.workunit.client.1.smithi131.stdout:7/681: dwrite d1b/d3b/d31/fc5 [4194304,4194304] 0 2024-09-13T02:54:20.531 INFO:tasks.workunit.client.1.smithi131.stdout:7/682: creat d1b/d3b/d31/d7c/db7/d81/fe7 x:0 0 0 2024-09-13T02:54:20.531 INFO:tasks.workunit.client.1.smithi131.stdout:7/683: chown d1b/d3b/d31/d7c/lb0 1305 1 2024-09-13T02:54:20.532 INFO:tasks.workunit.client.1.smithi131.stdout:8/831: dwrite db/f18 [0,4194304] 0 2024-09-13T02:54:20.532 INFO:tasks.workunit.client.1.smithi131.stdout:8/832: write db/d1d/d34/d4e/d7e/d90/fd2 [178882,51286] 0 2024-09-13T02:54:20.534 INFO:tasks.workunit.client.1.smithi131.stdout:7/684: getdents d1b/d3b/d51/d62/d6d/da5/dd8 0 2024-09-13T02:54:20.534 INFO:tasks.workunit.client.1.smithi131.stdout:7/685: dread - d1b/d3b/d31/d7c/db7/fd0 zero size 2024-09-13T02:54:20.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:20 smithi089 ceph-mon[27639]: pgmap v252: 65 pgs: 65 active+clean; 2.8 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 173 MiB/s rd, 206 MiB/s wr, 391 op/s 2024-09-13T02:54:20.536 INFO:tasks.workunit.client.1.smithi131.stdout:8/833: truncate db/f23 1438123 0 2024-09-13T02:54:20.539 INFO:tasks.workunit.client.1.smithi131.stdout:8/834: symlink db/d1d/d34/d4e/d7e/dc4/lff 0 2024-09-13T02:54:20.539 INFO:tasks.workunit.client.1.smithi131.stdout:8/835: creat db/d1d/d34/d4e/d7e/f100 x:0 0 0 2024-09-13T02:54:20.546 INFO:tasks.workunit.client.1.smithi131.stdout:7/686: write d1b/d3b/d51/d62/f7a [835617,7106] 0 2024-09-13T02:54:20.547 INFO:tasks.workunit.client.1.smithi131.stdout:7/687: read d1b/d3b/d46/f6e [879419,1633] 0 2024-09-13T02:54:20.549 INFO:tasks.workunit.client.1.smithi131.stdout:7/688: dread d1b/d3b/d51/d62/d6d/fb8 [0,4194304] 0 2024-09-13T02:54:20.550 INFO:tasks.workunit.client.1.smithi131.stdout:7/689: mknod d1b/d3b/d46/d4b/d57/d7b/ce8 0 2024-09-13T02:54:20.550 INFO:tasks.workunit.client.1.smithi131.stdout:7/690: chown d1b/d3b/d46/d4b/d57/d9d/ca3 47 1 2024-09-13T02:54:20.553 INFO:tasks.workunit.client.1.smithi131.stdout:3/670: dwrite d2/d4/d76/d9f/d41/d5c/d71/f93 [0,4194304] 0 2024-09-13T02:54:20.553 INFO:tasks.workunit.client.1.smithi131.stdout:9/824: dwrite d0/d4d/d98/fdf [0,4194304] 0 2024-09-13T02:54:20.554 INFO:tasks.workunit.client.1.smithi131.stdout:8/836: truncate db/f23 2399468 0 2024-09-13T02:54:20.556 INFO:tasks.workunit.client.1.smithi131.stdout:7/691: dread d1b/d3b/d31/d5f/f7e [0,4194304] 0 2024-09-13T02:54:20.556 INFO:tasks.workunit.client.1.smithi131.stdout:7/692: fdatasync d1b/f21 0 2024-09-13T02:54:20.556 INFO:tasks.workunit.client.1.smithi131.stdout:3/671: symlink d2/d4/d76/d9f/d41/d5c/d4f/le2 0 2024-09-13T02:54:20.560 INFO:tasks.workunit.client.1.smithi131.stdout:9/825: rename d0/d4d/d55/d76/d96/d118/d14/d1a/dc6/d70/cc9 to d0/d4d/d55/d76/d96/d118/d14/d67/dc0/c11a 0 2024-09-13T02:54:20.561 INFO:tasks.workunit.client.1.smithi131.stdout:8/837: creat db/d2b/d39/f101 x:0 0 0 2024-09-13T02:54:20.561 INFO:tasks.workunit.client.1.smithi131.stdout:8/838: write db/d2b/d39/fa2 [9190958,73368] 0 2024-09-13T02:54:20.562 INFO:tasks.workunit.client.1.smithi131.stdout:3/672: symlink d2/d4/d76/d9f/d41/d5c/d71/le3 0 2024-09-13T02:54:20.565 INFO:tasks.workunit.client.1.smithi131.stdout:7/693: rename d1b/d3b/d31/dcb/cda to d1b/d3b/d46/d4b/d57/ce9 0 2024-09-13T02:54:20.565 INFO:tasks.workunit.client.1.smithi131.stdout:7/694: readlink d1b/l32 0 2024-09-13T02:54:20.565 INFO:tasks.workunit.client.1.smithi131.stdout:7/695: creat d1b/d3b/d51/d8b/fea x:0 0 0 2024-09-13T02:54:20.567 INFO:tasks.workunit.client.1.smithi131.stdout:8/839: truncate db/d2b/fb5 361480 0 2024-09-13T02:54:20.568 INFO:tasks.workunit.client.1.smithi131.stdout:9/826: write d0/d4d/d55/d76/d96/d118/d14/d17/d107/f112 [3490691,117898] 0 2024-09-13T02:54:20.569 INFO:tasks.workunit.client.1.smithi131.stdout:8/840: mkdir db/d1d/d34/d4e/d7e/dc4/d102 0 2024-09-13T02:54:20.571 INFO:tasks.workunit.client.1.smithi131.stdout:9/827: creat d0/dfb/f11b x:0 0 0 2024-09-13T02:54:20.572 INFO:tasks.workunit.client.1.smithi131.stdout:8/841: creat db/d1d/d34/d4e/dd7/f103 x:0 0 0 2024-09-13T02:54:20.572 INFO:tasks.workunit.client.1.smithi131.stdout:8/842: dread - db/d1d/d34/d4e/dd7/f103 zero size 2024-09-13T02:54:20.573 INFO:tasks.workunit.client.1.smithi131.stdout:8/843: dread - db/d1d/d1f/d66/fa6 zero size 2024-09-13T02:54:20.573 INFO:tasks.workunit.client.1.smithi131.stdout:2/816: sync 2024-09-13T02:54:20.574 INFO:tasks.workunit.client.1.smithi131.stdout:5/637: sync 2024-09-13T02:54:20.575 INFO:tasks.workunit.client.1.smithi131.stdout:5/638: creat d1/d5/dcd/fd9 x:0 0 0 2024-09-13T02:54:20.575 INFO:tasks.workunit.client.1.smithi131.stdout:5/639: write d1/d21/d74/fa7 [772056,104337] 0 2024-09-13T02:54:20.576 INFO:tasks.workunit.client.1.smithi131.stdout:5/640: mknod d1/d1c/d87/db8/cda 0 2024-09-13T02:54:20.576 INFO:tasks.workunit.client.1.smithi131.stdout:5/641: stat d1/d21/d22 0 2024-09-13T02:54:20.577 INFO:tasks.workunit.client.1.smithi131.stdout:7/696: dread d1b/d23/f47 [0,4194304] 0 2024-09-13T02:54:20.584 INFO:tasks.workunit.client.1.smithi131.stdout:3/673: dwrite d2/d4/d7/d1d/d24/d96/fd0 [0,4194304] 0 2024-09-13T02:54:20.585 INFO:tasks.workunit.client.1.smithi131.stdout:3/674: symlink d2/d4/d76/d9f/d41/d6e/le4 0 2024-09-13T02:54:20.587 INFO:tasks.workunit.client.1.smithi131.stdout:3/675: mkdir d2/d4/d76/d9f/db9/de5 0 2024-09-13T02:54:20.587 INFO:tasks.workunit.client.1.smithi131.stdout:8/844: dread db/d2b/d39/d56/f95 [0,4194304] 0 2024-09-13T02:54:20.587 INFO:tasks.workunit.client.1.smithi131.stdout:8/845: creat db/d1d/d1f/d5c/f104 x:0 0 0 2024-09-13T02:54:20.588 INFO:tasks.workunit.client.1.smithi131.stdout:8/846: fsync db/d1d/d34/d4e/d7e/d90/fd2 0 2024-09-13T02:54:20.588 INFO:tasks.workunit.client.1.smithi131.stdout:5/642: getdents d1/d1c/d87/db8 0 2024-09-13T02:54:20.589 INFO:tasks.workunit.client.1.smithi131.stdout:8/847: symlink db/d1d/d34/d4e/d7e/l105 0 2024-09-13T02:54:20.590 INFO:tasks.workunit.client.1.smithi131.stdout:8/848: write db/d1d/d34/d4e/d7e/f100 [289816,98342] 0 2024-09-13T02:54:20.590 INFO:tasks.workunit.client.1.smithi131.stdout:7/697: read fb [1127683,110947] 0 2024-09-13T02:54:20.590 INFO:tasks.workunit.client.1.smithi131.stdout:7/698: chown d1b/d3b/d31/d38/ld6 0 1 2024-09-13T02:54:20.592 INFO:tasks.workunit.client.1.smithi131.stdout:5/643: rename d1/d29/d39/fb5 to d1/d1c/d87/dbd/dca/fdb 0 2024-09-13T02:54:20.592 INFO:tasks.workunit.client.1.smithi131.stdout:5/644: chown d1/d2f/f31 7 1 2024-09-13T02:54:20.592 INFO:tasks.workunit.client.1.smithi131.stdout:3/676: rmdir d2/d4/d7 39 2024-09-13T02:54:20.594 INFO:tasks.workunit.client.1.smithi131.stdout:7/699: rename d1b/d3b/fbc to d1b/d3b/d51/d8b/d99/feb 0 2024-09-13T02:54:20.594 INFO:tasks.workunit.client.1.smithi131.stdout:7/700: write d1b/d3b/d51/d8f/fa4 [2164838,28071] 0 2024-09-13T02:54:20.595 INFO:tasks.workunit.client.1.smithi131.stdout:5/645: creat d1/d1c/d87/db8/fdc x:0 0 0 2024-09-13T02:54:20.597 INFO:tasks.workunit.client.1.smithi131.stdout:3/677: truncate d2/dc/f2a 4512559 0 2024-09-13T02:54:20.599 INFO:tasks.workunit.client.1.smithi131.stdout:3/678: rename d2/d4/d7/d1d/d24/d6f/d7f/le0 to d2/d4/d7/db8/le6 0 2024-09-13T02:54:20.600 INFO:tasks.workunit.client.1.smithi131.stdout:3/679: symlink d2/dc/d39/d61/le7 0 2024-09-13T02:54:20.600 INFO:tasks.workunit.client.1.smithi131.stdout:3/680: fsync d2/dc/d39/fdc 0 2024-09-13T02:54:20.600 INFO:tasks.workunit.client.1.smithi131.stdout:3/681: mkdir d2/d4/d7/d1d/de8 0 2024-09-13T02:54:20.600 INFO:tasks.workunit.client.1.smithi131.stdout:3/682: getdents d2/d4/db7/dda 0 2024-09-13T02:54:20.606 INFO:tasks.workunit.client.1.smithi131.stdout:8/849: dwrite db/f18 [0,4194304] 0 2024-09-13T02:54:20.607 INFO:tasks.workunit.client.1.smithi131.stdout:8/850: truncate db/d2b/d39/fa2 6829790 0 2024-09-13T02:54:20.610 INFO:tasks.workunit.client.1.smithi131.stdout:8/851: rename db/d1d/d1f/d41 to db/d89/d106 0 2024-09-13T02:54:20.610 INFO:tasks.workunit.client.1.smithi131.stdout:8/852: truncate db/d1d/d1f/d66/fbd 536148 0 2024-09-13T02:54:20.610 INFO:tasks.workunit.client.1.smithi131.stdout:7/701: write d1b/d3b/d51/d62/d9e/da2/fb3 [373534,54780] 0 2024-09-13T02:54:20.610 INFO:tasks.workunit.client.1.smithi131.stdout:8/853: mkdir db/d2b/d107 0 2024-09-13T02:54:20.612 INFO:tasks.workunit.client.1.smithi131.stdout:7/702: truncate f10 397097 0 2024-09-13T02:54:20.632 INFO:tasks.workunit.client.1.smithi131.stdout:5/646: dwrite d1/d21/d74/d78/d98/fc8 [0,4194304] 0 2024-09-13T02:54:20.632 INFO:tasks.workunit.client.1.smithi131.stdout:5/647: write d1/d5/f3a [1087347,64467] 0 2024-09-13T02:54:20.632 INFO:tasks.workunit.client.1.smithi131.stdout:3/683: dwrite d2/d4/d7/d1d/d24/fb0 [0,4194304] 0 2024-09-13T02:54:20.632 INFO:tasks.workunit.client.1.smithi131.stdout:3/684: chown d2/d4/d1a/d31/da7 402 1 2024-09-13T02:54:20.632 INFO:tasks.workunit.client.1.smithi131.stdout:3/685: write d2/d4/d7/d1d/d24/d96/fcf [1062913,87466] 0 2024-09-13T02:54:20.635 INFO:tasks.workunit.client.1.smithi131.stdout:3/686: rename d2/d4/d76/d9f/d41/d5c/d71/le3 to d2/d4/d2d/le9 0 2024-09-13T02:54:20.636 INFO:tasks.workunit.client.1.smithi131.stdout:3/687: symlink d2/d4/d1a/d31/lea 0 2024-09-13T02:54:20.636 INFO:tasks.workunit.client.1.smithi131.stdout:3/688: read - d2/d4/d7/d1d/d80/dde/fbc zero size 2024-09-13T02:54:20.637 INFO:tasks.workunit.client.1.smithi131.stdout:5/648: dread d1/d5/fa [0,4194304] 0 2024-09-13T02:54:20.637 INFO:tasks.workunit.client.1.smithi131.stdout:5/649: stat d1/d5 0 2024-09-13T02:54:20.637 INFO:tasks.workunit.client.1.smithi131.stdout:5/650: write d1/d21/f84 [1066747,79454] 0 2024-09-13T02:54:20.640 INFO:tasks.workunit.client.1.smithi131.stdout:7/703: dwrite d1b/d3b/d51/d62/fc2 [0,4194304] 0 2024-09-13T02:54:20.640 INFO:tasks.workunit.client.1.smithi131.stdout:7/704: write d1b/d3b/d51/d62/d9e/da2/fdb [220785,28912] 0 2024-09-13T02:54:20.642 INFO:tasks.workunit.client.1.smithi131.stdout:8/854: dwrite db/d1d/d71/fb9 [0,4194304] 0 2024-09-13T02:54:20.644 INFO:tasks.workunit.client.1.smithi131.stdout:8/855: dread db/d2b/d39/d56/f73 [0,4194304] 0 2024-09-13T02:54:20.645 INFO:tasks.workunit.client.1.smithi131.stdout:8/856: creat db/d1d/d71/f108 x:0 0 0 2024-09-13T02:54:20.650 INFO:tasks.workunit.client.1.smithi131.stdout:5/651: dread d1/d2f/d33/f97 [0,4194304] 0 2024-09-13T02:54:20.651 INFO:tasks.workunit.client.1.smithi131.stdout:8/857: creat db/d1d/d34/d4e/d7e/d90/f109 x:0 0 0 2024-09-13T02:54:20.653 INFO:tasks.workunit.client.1.smithi131.stdout:7/705: dread d1b/d3b/f3e [0,4194304] 0 2024-09-13T02:54:20.658 INFO:tasks.workunit.client.1.smithi131.stdout:7/706: truncate d1b/d3b/d31/d7c/db7/d81/f97 19214 0 2024-09-13T02:54:20.658 INFO:tasks.workunit.client.1.smithi131.stdout:7/707: chown d1b/d23/f2d 480 1 2024-09-13T02:54:20.660 INFO:tasks.workunit.client.1.smithi131.stdout:8/858: getdents db/d1d/d34/d4e/dd7 0 2024-09-13T02:54:20.660 INFO:tasks.workunit.client.1.smithi131.stdout:8/859: dread - db/d1d/d34/d4e/d7e/ff5 zero size 2024-09-13T02:54:20.660 INFO:tasks.workunit.client.1.smithi131.stdout:8/860: fdatasync db/d2b/fe6 0 2024-09-13T02:54:20.661 INFO:tasks.workunit.client.1.smithi131.stdout:7/708: creat d1b/d3b/d46/d4b/d57/d8c/fec x:0 0 0 2024-09-13T02:54:20.662 INFO:tasks.workunit.client.1.smithi131.stdout:7/709: symlink d1b/d3b/d51/led 0 2024-09-13T02:54:20.663 INFO:tasks.workunit.client.1.smithi131.stdout:7/710: mknod d1b/d3b/d46/d4b/d57/d9d/cee 0 2024-09-13T02:54:20.664 INFO:tasks.workunit.client.1.smithi131.stdout:7/711: creat d1b/d3b/d31/d7c/db7/d81/fef x:0 0 0 2024-09-13T02:54:20.664 INFO:tasks.workunit.client.1.smithi131.stdout:7/712: stat d1b/d3b/f55 0 2024-09-13T02:54:20.664 INFO:tasks.workunit.client.1.smithi131.stdout:7/713: write d1b/d3b/d31/d7c/db7/fd0 [444876,106384] 0 2024-09-13T02:54:20.665 INFO:tasks.workunit.client.1.smithi131.stdout:7/714: getdents d1b/d23/d89/db4 0 2024-09-13T02:54:20.667 INFO:tasks.workunit.client.1.smithi131.stdout:7/715: unlink d1b/d3b/d51/d62/f7a 0 2024-09-13T02:54:20.670 INFO:tasks.workunit.client.1.smithi131.stdout:7/716: dread d1b/d3b/d46/f98 [0,4194304] 0 2024-09-13T02:54:20.677 INFO:tasks.workunit.client.1.smithi131.stdout:5/652: dwrite d1/d2f/d33/f92 [0,4194304] 0 2024-09-13T02:54:20.677 INFO:tasks.workunit.client.1.smithi131.stdout:8/861: dwrite db/f18 [0,4194304] 0 2024-09-13T02:54:20.679 INFO:tasks.workunit.client.1.smithi131.stdout:5/653: unlink d1/d2f/d33/l5d 0 2024-09-13T02:54:20.679 INFO:tasks.workunit.client.1.smithi131.stdout:5/654: chown d1/d21/d74/faf 390139443 1 2024-09-13T02:54:20.681 INFO:tasks.workunit.client.1.smithi131.stdout:8/862: unlink db/d2b/fc7 0 2024-09-13T02:54:20.681 INFO:tasks.workunit.client.1.smithi131.stdout:8/863: readlink db/d1d/d1f/lc5 0 2024-09-13T02:54:20.682 INFO:tasks.workunit.client.1.smithi131.stdout:5/655: creat d1/d1c/fdd x:0 0 0 2024-09-13T02:54:20.682 INFO:tasks.workunit.client.1.smithi131.stdout:5/656: fsync d1/d21/d74/fa7 0 2024-09-13T02:54:20.690 INFO:tasks.workunit.client.1.smithi131.stdout:7/717: dwrite d1b/d23/f4c [0,4194304] 0 2024-09-13T02:54:20.691 INFO:tasks.workunit.client.1.smithi131.stdout:7/718: write d1b/d3b/d51/fce [1319789,51033] 0 2024-09-13T02:54:20.691 INFO:tasks.workunit.client.1.smithi131.stdout:7/719: write d1b/d3b/d31/d5f/f9c [1143990,45820] 0 2024-09-13T02:54:20.694 INFO:tasks.workunit.client.1.smithi131.stdout:7/720: rename d1b/d3b/d31/f5c to d1b/d3b/d31/d7c/db7/da7/ff0 0 2024-09-13T02:54:20.701 INFO:tasks.workunit.client.1.smithi131.stdout:5/657: dread d1/d5/f4e [0,4194304] 0 2024-09-13T02:54:20.701 INFO:tasks.workunit.client.1.smithi131.stdout:7/721: dread d1b/d73/f70 [0,4194304] 0 2024-09-13T02:54:20.701 INFO:tasks.workunit.client.1.smithi131.stdout:5/658: chown d1/c6e 1009 1 2024-09-13T02:54:20.701 INFO:tasks.workunit.client.1.smithi131.stdout:5/659: chown d1/d21/d90/fcf 22079185 1 2024-09-13T02:54:20.701 INFO:tasks.workunit.client.1.smithi131.stdout:5/660: chown d1/d2f/d4f/fa1 4286 1 2024-09-13T02:54:20.701 INFO:tasks.workunit.client.1.smithi131.stdout:5/661: write d1/d21/d74/f80 [1171788,104108] 0 2024-09-13T02:54:20.701 INFO:tasks.workunit.client.1.smithi131.stdout:5/662: creat d1/d2f/fde x:0 0 0 2024-09-13T02:54:20.702 INFO:tasks.workunit.client.1.smithi131.stdout:7/722: rmdir d1b/d3b/d31/d7c/db7/da7 39 2024-09-13T02:54:20.703 INFO:tasks.workunit.client.1.smithi131.stdout:5/663: rmdir d1/d1c/d87/db8 39 2024-09-13T02:54:20.703 INFO:tasks.workunit.client.1.smithi131.stdout:5/664: fdatasync d1/d5/dcd/fd9 0 2024-09-13T02:54:20.703 INFO:tasks.workunit.client.1.smithi131.stdout:7/723: creat d1b/d23/d54/ff1 x:0 0 0 2024-09-13T02:54:20.703 INFO:tasks.workunit.client.1.smithi131.stdout:7/724: chown d1b/d3b/d51/d8b/fea 259326696 1 2024-09-13T02:54:20.703 INFO:tasks.workunit.client.1.smithi131.stdout:7/725: read - d1b/d3b/d46/d4b/d57/d8c/fec zero size 2024-09-13T02:54:20.703 INFO:tasks.workunit.client.1.smithi131.stdout:7/726: read - d1b/d3b/d31/fe1 zero size 2024-09-13T02:54:20.717 INFO:tasks.workunit.client.1.smithi131.stdout:8/864: dwrite db/d1d/f25 [0,4194304] 0 2024-09-13T02:54:20.718 INFO:tasks.workunit.client.1.smithi131.stdout:8/865: symlink db/d1d/d34/d8d/l10a 0 2024-09-13T02:54:20.719 INFO:tasks.workunit.client.1.smithi131.stdout:8/866: truncate db/d2e/d3a/f9b 901190 0 2024-09-13T02:54:20.721 INFO:tasks.workunit.client.1.smithi131.stdout:7/727: truncate d1b/d3b/d31/d5f/f9c 3297289 0 2024-09-13T02:54:20.721 INFO:tasks.workunit.client.1.smithi131.stdout:7/728: read - d1b/d3b/d31/fe1 zero size 2024-09-13T02:54:20.721 INFO:tasks.workunit.client.1.smithi131.stdout:7/729: getdents d1b/d3b/d31/d7c/db7 0 2024-09-13T02:54:20.723 INFO:tasks.workunit.client.1.smithi131.stdout:8/867: write db/d89/d106/f55 [728735,79227] 0 2024-09-13T02:54:20.724 INFO:tasks.workunit.client.1.smithi131.stdout:8/868: readlink db/d89/d106/l5b 0 2024-09-13T02:54:20.724 INFO:tasks.workunit.client.1.smithi131.stdout:8/869: write db/d2e/d3a/fe5 [8826061,46155] 0 2024-09-13T02:54:20.724 INFO:tasks.workunit.client.1.smithi131.stdout:8/870: write db/d1d/d34/d4e/dd7/f103 [856420,19863] 0 2024-09-13T02:54:20.725 INFO:tasks.workunit.client.1.smithi131.stdout:8/871: mkdir db/d89/d106/d10b 0 2024-09-13T02:54:20.725 INFO:tasks.workunit.client.1.smithi131.stdout:8/872: creat db/d1d/d34/d8d/f10c x:0 0 0 2024-09-13T02:54:20.727 INFO:tasks.workunit.client.1.smithi131.stdout:8/873: creat db/d89/d106/f10d x:0 0 0 2024-09-13T02:54:20.727 INFO:tasks.workunit.client.1.smithi131.stdout:8/874: creat db/d1d/dc6/f10e x:0 0 0 2024-09-13T02:54:20.729 INFO:tasks.workunit.client.1.smithi131.stdout:8/875: symlink db/d1d/d34/l10f 0 2024-09-13T02:54:20.729 INFO:tasks.workunit.client.1.smithi131.stdout:8/876: readlink db/d89/d106/d50/l58 0 2024-09-13T02:54:20.729 INFO:tasks.workunit.client.1.smithi131.stdout:8/877: fsync db/d89/f98 0 2024-09-13T02:54:20.731 INFO:tasks.workunit.client.1.smithi131.stdout:8/878: rename db/d1d/d1f/d66/l80 to db/d1d/d34/d4e/d7e/dc4/d102/l110 0 2024-09-13T02:54:20.732 INFO:tasks.workunit.client.1.smithi131.stdout:8/879: symlink db/d1d/d1f/l111 0 2024-09-13T02:54:20.732 INFO:tasks.workunit.client.1.smithi131.stdout:8/880: getdents db/d1d/d1f/d5c/da1/df7 0 2024-09-13T02:54:20.732 INFO:tasks.workunit.client.1.smithi131.stdout:8/881: creat db/d1d/d71/f112 x:0 0 0 2024-09-13T02:54:20.732 INFO:tasks.workunit.client.1.smithi131.stdout:8/882: fdatasync db/d89/f98 0 2024-09-13T02:54:20.735 INFO:tasks.workunit.client.1.smithi131.stdout:0/916: sync 2024-09-13T02:54:20.736 INFO:tasks.workunit.client.1.smithi131.stdout:0/917: readlink d0/de/d1f/d22/d31/d39/d67/db5/dc9/l117 0 2024-09-13T02:54:20.736 INFO:tasks.workunit.client.1.smithi131.stdout:0/918: stat d0/d2/fce 0 2024-09-13T02:54:20.747 INFO:tasks.workunit.client.1.smithi131.stdout:5/665: dwrite d1/d2f/d4f/fbc [0,4194304] 0 2024-09-13T02:54:20.751 INFO:tasks.workunit.client.1.smithi131.stdout:5/666: creat d1/d5/d57/d60/fdf x:0 0 0 2024-09-13T02:54:20.754 INFO:tasks.workunit.client.1.smithi131.stdout:5/667: truncate d1/d21/d74/d78/d98/fa8 234106 0 2024-09-13T02:54:20.756 INFO:tasks.workunit.client.1.smithi131.stdout:5/668: rename d1/d1c/c6b to d1/d21/d74/d78/d98/ce0 0 2024-09-13T02:54:20.756 INFO:tasks.workunit.client.1.smithi131.stdout:5/669: fsync d1/d29/d39/f72 0 2024-09-13T02:54:20.756 INFO:tasks.workunit.client.1.smithi131.stdout:5/670: chown d1/d29/d3e/l9d 70829 1 2024-09-13T02:54:20.757 INFO:tasks.workunit.client.1.smithi131.stdout:5/671: symlink d1/d21/d74/d78/d98/le1 0 2024-09-13T02:54:20.758 INFO:tasks.workunit.client.1.smithi131.stdout:5/672: truncate d1/fc6 388217 0 2024-09-13T02:54:20.759 INFO:tasks.workunit.client.1.smithi131.stdout:5/673: symlink d1/d1c/d87/dbd/le2 0 2024-09-13T02:54:20.760 INFO:tasks.workunit.client.1.smithi131.stdout:5/674: read d1/d5/f3a [1443430,10481] 0 2024-09-13T02:54:20.768 INFO:tasks.workunit.client.1.smithi131.stdout:7/730: dwrite d1b/d23/f47 [0,4194304] 0 2024-09-13T02:54:20.769 INFO:tasks.workunit.client.1.smithi131.stdout:8/883: dwrite db/fa9 [0,4194304] 0 2024-09-13T02:54:20.771 INFO:tasks.workunit.client.1.smithi131.stdout:8/884: mkdir db/d1d/d34/d4e/dd7/d113 0 2024-09-13T02:54:20.771 INFO:tasks.workunit.client.1.smithi131.stdout:8/885: dread - db/d1d/d34/d4e/d7e/ff5 zero size 2024-09-13T02:54:20.772 INFO:tasks.workunit.client.1.smithi131.stdout:8/886: unlink db/c45 0 2024-09-13T02:54:20.774 INFO:tasks.workunit.client.1.smithi131.stdout:7/731: dread d1b/d3b/f3e [0,4194304] 0 2024-09-13T02:54:20.781 INFO:tasks.workunit.client.1.smithi131.stdout:0/919: dwrite d0/de/d1f/d22/d3d/d55/f58 [4194304,4194304] 0 2024-09-13T02:54:20.781 INFO:tasks.workunit.client.1.smithi131.stdout:0/920: write d0/d2/d62/fca [808727,17597] 0 2024-09-13T02:54:20.786 INFO:tasks.workunit.client.1.smithi131.stdout:7/732: dread d1b/d3b/d51/fbe [0,4194304] 0 2024-09-13T02:54:20.787 INFO:tasks.workunit.client.1.smithi131.stdout:5/675: dwrite d1/d2f/d4f/fbc [0,4194304] 0 2024-09-13T02:54:20.787 INFO:tasks.workunit.client.1.smithi131.stdout:5/676: write d1/d2f/d33/f75 [2121381,28289] 0 2024-09-13T02:54:20.788 INFO:tasks.workunit.client.1.smithi131.stdout:8/887: dwrite db/f18 [0,4194304] 0 2024-09-13T02:54:20.788 INFO:tasks.workunit.client.1.smithi131.stdout:8/888: write db/d2b/d39/d56/f73 [838517,642] 0 2024-09-13T02:54:20.791 INFO:tasks.workunit.client.1.smithi131.stdout:8/889: symlink db/d1d/d34/l114 0 2024-09-13T02:54:20.800 INFO:tasks.workunit.client.1.smithi131.stdout:5/677: dread d1/d21/d74/d78/d98/fa8 [0,4194304] 0 2024-09-13T02:54:20.802 INFO:tasks.workunit.client.1.smithi131.stdout:5/678: link d1/d21/d74/d78/dbe/l9a d1/d21/d74/d78/d98/le3 0 2024-09-13T02:54:20.802 INFO:tasks.workunit.client.1.smithi131.stdout:5/679: chown d1/d2f/d4f 3 1 2024-09-13T02:54:20.803 INFO:tasks.workunit.client.1.smithi131.stdout:0/921: dwrite d0/de/d1f/d22/d3d/d43/fd8 [4194304,4194304] 0 2024-09-13T02:54:20.803 INFO:tasks.workunit.client.1.smithi131.stdout:0/922: read - d0/de/d1f/d22/d3d/d55/d63/dd2/fe1 zero size 2024-09-13T02:54:20.805 INFO:tasks.workunit.client.1.smithi131.stdout:0/923: getdents d0/d2 0 2024-09-13T02:54:20.805 INFO:tasks.workunit.client.1.smithi131.stdout:0/924: dread - d0/de/d45/dfa/fde zero size 2024-09-13T02:54:20.806 INFO:tasks.workunit.client.1.smithi131.stdout:8/890: write db/d2b/d39/d56/fcf [1009683,90009] 0 2024-09-13T02:54:20.808 INFO:tasks.workunit.client.1.smithi131.stdout:0/925: link d0/de/l61 d0/de/d1f/d22/d3d/d55/d63/d94/da5/l13e 0 2024-09-13T02:54:20.809 INFO:tasks.workunit.client.1.smithi131.stdout:7/733: dwrite d1b/d3b/d51/fce [0,4194304] 0 2024-09-13T02:54:20.833 INFO:tasks.workunit.client.1.smithi131.stdout:5/680: dwrite d1/d5/f3a [0,4194304] 0 2024-09-13T02:54:20.834 INFO:tasks.workunit.client.1.smithi131.stdout:8/891: dwrite db/d1d/d1f/d67/d81/ffd [0,4194304] 0 2024-09-13T02:54:20.835 INFO:tasks.workunit.client.1.smithi131.stdout:7/734: dwrite d1b/d3b/d31/d5f/f7e [0,4194304] 0 2024-09-13T02:54:20.835 INFO:tasks.workunit.client.1.smithi131.stdout:7/735: chown d1b/d3b/d31/c56 651 1 2024-09-13T02:54:20.836 INFO:tasks.workunit.client.1.smithi131.stdout:8/892: symlink db/d2e/l115 0 2024-09-13T02:54:20.838 INFO:tasks.workunit.client.1.smithi131.stdout:7/736: creat d1b/d3b/d31/d38/ff2 x:0 0 0 2024-09-13T02:54:20.838 INFO:tasks.workunit.client.1.smithi131.stdout:7/737: fsync d1b/d3b/d46/d4b/d57/d7b/d92/dbb/fd7 0 2024-09-13T02:54:20.839 INFO:tasks.workunit.client.1.smithi131.stdout:8/893: symlink db/d1d/d1f/d66/dc0/l116 0 2024-09-13T02:54:20.843 INFO:tasks.workunit.client.1.smithi131.stdout:8/894: rename db/d1d/d1f/d5c/da1 to db/d2e/d40/d117 0 2024-09-13T02:54:20.847 INFO:tasks.workunit.client.1.smithi131.stdout:7/738: write d1b/d3b/d31/d7c/db7/f59 [2859600,47644] 0 2024-09-13T02:54:20.847 INFO:tasks.workunit.client.1.smithi131.stdout:7/739: dread - d1b/d3b/d51/d62/d6d/da5/dd8/fe6 zero size 2024-09-13T02:54:20.849 INFO:tasks.workunit.client.1.smithi131.stdout:7/740: link d1b/d3b/d31/d60/l8e d1b/d3b/d51/d62/d6d/da5/dd8/de3/lf3 0 2024-09-13T02:54:20.849 INFO:tasks.workunit.client.1.smithi131.stdout:7/741: symlink d1b/d23/d54/lf4 0 2024-09-13T02:54:20.851 INFO:tasks.workunit.client.1.smithi131.stdout:7/742: creat d1b/d3b/d51/d62/d6d/dac/ff5 x:0 0 0 2024-09-13T02:54:20.852 INFO:tasks.workunit.client.1.smithi131.stdout:7/743: mknod d1b/d3b/d51/d62/d9e/cf6 0 2024-09-13T02:54:20.862 INFO:tasks.workunit.client.1.smithi131.stdout:5/681: dwrite d1/d2f/d33/f81 [0,4194304] 0 2024-09-13T02:54:20.863 INFO:tasks.workunit.client.1.smithi131.stdout:8/895: dwrite db/d1d/d34/d4e/d7e/f100 [0,4194304] 0 2024-09-13T02:54:20.866 INFO:tasks.workunit.client.1.smithi131.stdout:8/896: mknod db/d2b/c118 0 2024-09-13T02:54:20.869 INFO:tasks.workunit.client.1.smithi131.stdout:8/897: dread db/d1d/d34/d4e/f99 [0,4194304] 0 2024-09-13T02:54:20.879 INFO:tasks.workunit.client.1.smithi131.stdout:8/898: write db/d1d/f25 [1221942,74963] 0 2024-09-13T02:54:20.880 INFO:tasks.workunit.client.1.smithi131.stdout:5/682: dwrite d1/d1c/d8e/f52 [0,4194304] 0 2024-09-13T02:54:20.889 INFO:tasks.workunit.client.1.smithi131.stdout:1/858: sync 2024-09-13T02:54:20.889 INFO:tasks.workunit.client.1.smithi131.stdout:6/848: sync 2024-09-13T02:54:20.889 INFO:tasks.workunit.client.1.smithi131.stdout:1/859: dread - dd/ffe zero size 2024-09-13T02:54:20.891 INFO:tasks.workunit.client.1.smithi131.stdout:5/683: dread d1/d29/f2e [0,4194304] 0 2024-09-13T02:54:20.891 INFO:tasks.workunit.client.1.smithi131.stdout:5/684: fdatasync d1/d21/f84 0 2024-09-13T02:54:20.891 INFO:tasks.workunit.client.1.smithi131.stdout:1/860: symlink dd/d33/d42/d47/dd1/d10a/l135 0 2024-09-13T02:54:20.892 INFO:tasks.workunit.client.1.smithi131.stdout:1/861: symlink dd/d33/d42/d47/l136 0 2024-09-13T02:54:20.894 INFO:tasks.workunit.client.1.smithi131.stdout:1/862: rename dd/d26/d44/l41 to dd/d51/l137 0 2024-09-13T02:54:20.894 INFO:tasks.workunit.client.1.smithi131.stdout:1/863: fdatasync dd/d51/db3/ff6 0 2024-09-13T02:54:20.894 INFO:tasks.workunit.client.1.smithi131.stdout:1/864: chown dd/d51/d8a/fcc 170862 1 2024-09-13T02:54:20.895 INFO:tasks.workunit.client.1.smithi131.stdout:1/865: link dd/d51/d8a/d107/l123 dd/d51/l138 0 2024-09-13T02:54:20.904 INFO:tasks.workunit.client.1.smithi131.stdout:8/899: dwrite db/d1d/fed [0,4194304] 0 2024-09-13T02:54:20.905 INFO:tasks.workunit.client.1.smithi131.stdout:5/685: dread d1/d2f/d33/f92 [0,4194304] 0 2024-09-13T02:54:20.905 INFO:tasks.workunit.client.1.smithi131.stdout:5/686: truncate d1/d50/f93 4494322 0 2024-09-13T02:54:20.906 INFO:tasks.workunit.client.1.smithi131.stdout:6/849: dwrite d1/d106/fd2 [8388608,4194304] 0 2024-09-13T02:54:20.906 INFO:tasks.workunit.client.1.smithi131.stdout:8/900: link db/d2b/d39/fa2 db/d2e/d40/d117/df7/f119 0 2024-09-13T02:54:20.909 INFO:tasks.workunit.client.1.smithi131.stdout:1/866: rmdir dd/d26/d44 39 2024-09-13T02:54:20.909 INFO:tasks.workunit.client.1.smithi131.stdout:1/867: fsync dd/d26/d2a/d2c/f34 0 2024-09-13T02:54:20.912 INFO:tasks.workunit.client.1.smithi131.stdout:1/868: rename dd/d26/d2a/d2c/c38 to dd/d33/d42/d47/dd1/d10a/d129/c139 0 2024-09-13T02:54:20.912 INFO:tasks.workunit.client.1.smithi131.stdout:1/869: fsync dd/d26/d2a/fe3 0 2024-09-13T02:54:20.912 INFO:tasks.workunit.client.1.smithi131.stdout:8/901: dread db/d2b/d39/d56/f57 [0,4194304] 0 2024-09-13T02:54:20.912 INFO:tasks.workunit.client.1.smithi131.stdout:8/902: chown db/d89/d106 59 1 2024-09-13T02:54:20.912 INFO:tasks.workunit.client.1.smithi131.stdout:8/903: write db/d2e/d40/d117/fe0 [712809,102744] 0 2024-09-13T02:54:20.913 INFO:tasks.workunit.client.1.smithi131.stdout:8/904: write db/d1d/d34/f70 [338660,107397] 0 2024-09-13T02:54:20.916 INFO:tasks.workunit.client.1.smithi131.stdout:5/687: read d1/d2f/d33/f89 [1092985,10209] 0 2024-09-13T02:54:20.918 INFO:tasks.workunit.client.1.smithi131.stdout:5/688: symlink d1/d50/le4 0 2024-09-13T02:54:20.918 INFO:tasks.workunit.client.1.smithi131.stdout:5/689: fsync d1/d2f/d33/f97 0 2024-09-13T02:54:20.919 INFO:tasks.workunit.client.1.smithi131.stdout:5/690: rename d1/c6e to d1/d1c/d8e/ce5 0 2024-09-13T02:54:20.919 INFO:tasks.workunit.client.1.smithi131.stdout:5/691: creat d1/d5/dcd/fe6 x:0 0 0 2024-09-13T02:54:20.920 INFO:tasks.workunit.client.1.smithi131.stdout:5/692: unlink d1/d29/d3e/fb4 0 2024-09-13T02:54:20.921 INFO:tasks.workunit.client.1.smithi131.stdout:5/693: write d1/d2f/f69 [5210290,93159] 0 2024-09-13T02:54:20.921 INFO:tasks.workunit.client.1.smithi131.stdout:5/694: mknod d1/d1c/d87/dbd/ce7 0 2024-09-13T02:54:20.926 INFO:tasks.workunit.client.1.smithi131.stdout:1/870: write dd/d26/d2a/ff1 [9810416,41584] 0 2024-09-13T02:54:20.926 INFO:tasks.workunit.client.1.smithi131.stdout:1/871: chown dd/d26/d44/d6d/d7c/faf 149585 1 2024-09-13T02:54:20.926 INFO:tasks.workunit.client.1.smithi131.stdout:1/872: dread - dd/d51/dad/f124 zero size 2024-09-13T02:54:20.926 INFO:tasks.workunit.client.1.smithi131.stdout:1/873: readlink dd/d33/d42/l4e 0 2024-09-13T02:54:20.926 INFO:tasks.workunit.client.1.smithi131.stdout:1/874: chown dd/d33/f6a 2548261 1 2024-09-13T02:54:20.936 INFO:tasks.workunit.client.1.smithi131.stdout:8/905: write db/d2e/d3a/fe5 [5432841,58318] 0 2024-09-13T02:54:20.936 INFO:tasks.workunit.client.1.smithi131.stdout:8/906: truncate db/d1d/d1f/d5c/fd1 669297 0 2024-09-13T02:54:20.936 INFO:tasks.workunit.client.1.smithi131.stdout:6/850: dwrite d1/d14/d10b/dc2/d3b/faf [0,4194304] 0 2024-09-13T02:54:20.936 INFO:tasks.workunit.client.1.smithi131.stdout:6/851: truncate d1/d14/d10b/d26/d1c/d4e/f81 4270133 0 2024-09-13T02:54:20.936 INFO:tasks.workunit.client.1.smithi131.stdout:6/852: dread - d1/d14/d10b/dc2/fdb zero size 2024-09-13T02:54:20.938 INFO:tasks.workunit.client.1.smithi131.stdout:8/907: mkdir db/d89/d11a 0 2024-09-13T02:54:20.938 INFO:tasks.workunit.client.1.smithi131.stdout:6/853: mkdir d1/d53/d123 0 2024-09-13T02:54:20.939 INFO:tasks.workunit.client.1.smithi131.stdout:5/695: dwrite d1/d21/d22/f55 [0,4194304] 0 2024-09-13T02:54:20.939 INFO:tasks.workunit.client.1.smithi131.stdout:8/908: mkdir db/d11b 0 2024-09-13T02:54:20.939 INFO:tasks.workunit.client.1.smithi131.stdout:8/909: write db/d1d/d34/f36 [2615346,43141] 0 2024-09-13T02:54:20.939 INFO:tasks.workunit.client.1.smithi131.stdout:8/910: write db/d2e/d3a/fe5 [769355,70400] 0 2024-09-13T02:54:20.943 INFO:tasks.workunit.client.1.smithi131.stdout:5/696: symlink d1/d29/le8 0 2024-09-13T02:54:20.945 INFO:tasks.workunit.client.1.smithi131.stdout:8/911: rename db/d2b/d39/d56/f73 to db/d2e/d40/d117/df7/f11c 0 2024-09-13T02:54:20.945 INFO:tasks.workunit.client.1.smithi131.stdout:8/912: readlink db/d89/d106/l4c 0 2024-09-13T02:54:20.946 INFO:tasks.workunit.client.1.smithi131.stdout:8/913: fsync db/d1d/d34/d4e/d7e/d90/f109 0 2024-09-13T02:54:20.946 INFO:tasks.workunit.client.1.smithi131.stdout:8/914: fdatasync db/d89/d106/f5d 0 2024-09-13T02:54:20.946 INFO:tasks.workunit.client.1.smithi131.stdout:8/915: fdatasync db/d89/d106/f55 0 2024-09-13T02:54:20.946 INFO:tasks.workunit.client.1.smithi131.stdout:8/916: stat db/d1d/d34/d4e/ff0 0 2024-09-13T02:54:20.946 INFO:tasks.workunit.client.1.smithi131.stdout:5/697: truncate d1/d5/fa 1024125 0 2024-09-13T02:54:20.949 INFO:tasks.workunit.client.1.smithi131.stdout:8/917: creat db/d89/f11d x:0 0 0 2024-09-13T02:54:20.949 INFO:tasks.workunit.client.1.smithi131.stdout:8/918: chown db/d1d/d1f/d67/lf1 431388 1 2024-09-13T02:54:20.949 INFO:tasks.workunit.client.1.smithi131.stdout:8/919: chown db/d1d/d34/f70 68 1 2024-09-13T02:54:20.949 INFO:tasks.workunit.client.1.smithi131.stdout:6/854: truncate d1/d14/d10b/dc2/d3b/faf 525001 0 2024-09-13T02:54:20.951 INFO:tasks.workunit.client.1.smithi131.stdout:6/855: dread d1/d8/d9/db/fb2 [0,4194304] 0 2024-09-13T02:54:20.951 INFO:tasks.workunit.client.1.smithi131.stdout:6/856: readlink d1/l75 0 2024-09-13T02:54:20.951 INFO:tasks.workunit.client.1.smithi131.stdout:6/857: write d1/d14/d10b/dc2/d3b/f71 [775575,18832] 0 2024-09-13T02:54:20.951 INFO:tasks.workunit.client.1.smithi131.stdout:5/698: symlink d1/d21/db7/le9 0 2024-09-13T02:54:20.951 INFO:tasks.workunit.client.1.smithi131.stdout:5/699: write d1/d1c/d8e/f43 [8512398,796] 0 2024-09-13T02:54:20.951 INFO:tasks.workunit.client.1.smithi131.stdout:5/700: chown d1/d2f/d71/c73 0 1 2024-09-13T02:54:20.952 INFO:tasks.workunit.client.1.smithi131.stdout:8/920: truncate db/d89/d106/f62 2147105 0 2024-09-13T02:54:20.953 INFO:tasks.workunit.client.1.smithi131.stdout:6/858: symlink d1/d53/l124 0 2024-09-13T02:54:20.954 INFO:tasks.workunit.client.1.smithi131.stdout:5/701: unlink d1/d2f/f69 0 2024-09-13T02:54:20.955 INFO:tasks.workunit.client.1.smithi131.stdout:8/921: creat db/d1d/d34/f11e x:0 0 0 2024-09-13T02:54:20.955 INFO:tasks.workunit.client.1.smithi131.stdout:8/922: chown db/d89/cdf 498294199 1 2024-09-13T02:54:20.955 INFO:tasks.workunit.client.1.smithi131.stdout:6/859: getdents d1/d8/d9/d4b 0 2024-09-13T02:54:20.957 INFO:tasks.workunit.client.1.smithi131.stdout:5/702: symlink d1/d21/d22/lea 0 2024-09-13T02:54:20.967 INFO:tasks.workunit.client.1.smithi131.stdout:6/860: dread d1/f2b [8388608,4194304] 0 2024-09-13T02:54:20.969 INFO:tasks.workunit.client.1.smithi131.stdout:6/861: unlink d1/d14/d10b/d26/d1c/d79/c117 0 2024-09-13T02:54:20.970 INFO:tasks.workunit.client.1.smithi131.stdout:6/862: rename d1/f6e to d1/d14/d10b/d26/d1c/d79/d92/dc6/f125 0 2024-09-13T02:54:20.971 INFO:tasks.workunit.client.1.smithi131.stdout:6/863: mkdir d1/d8/d9/db8/d126 0 2024-09-13T02:54:20.974 INFO:tasks.workunit.client.1.smithi131.stdout:5/703: dwrite d1/d21/f7b [0,4194304] 0 2024-09-13T02:54:20.980 INFO:tasks.workunit.client.1.smithi131.stdout:8/923: dread db/d2e/d3a/fe5 [0,4194304] 0 2024-09-13T02:54:20.995 INFO:tasks.workunit.client.1.smithi131.stdout:6/864: dwrite d1/d14/d10b/dc2/d3b/faf [0,4194304] 0 2024-09-13T02:54:20.995 INFO:tasks.workunit.client.1.smithi131.stdout:6/865: readlink d1/l12 0 2024-09-13T02:54:20.995 INFO:tasks.workunit.client.1.smithi131.stdout:6/866: stat d1/d8/d9/db/d40/l5e 0 2024-09-13T02:54:20.996 INFO:tasks.workunit.client.1.smithi131.stdout:5/704: dwrite d1/d2f/fde [0,4194304] 0 2024-09-13T02:54:20.997 INFO:tasks.workunit.client.1.smithi131.stdout:6/867: link d1/d14/d10b/d26/dbd/ddf/de3/c119 d1/d8/c127 0 2024-09-13T02:54:20.999 INFO:tasks.workunit.client.1.smithi131.stdout:6/868: mkdir d1/d14/d10b/d26/dbd/ddf/d128 0 2024-09-13T02:54:21.000 INFO:tasks.workunit.client.1.smithi131.stdout:6/869: rename d1/d8/d9/d10e to d1/d8/d9/d4b/d129 0 2024-09-13T02:54:21.004 INFO:tasks.workunit.client.1.smithi131.stdout:8/924: dwrite db/d1d/d71/fb9 [0,4194304] 0 2024-09-13T02:54:21.012 INFO:tasks.workunit.client.1.smithi131.stdout:5/705: dwrite d1/d21/d74/f80 [0,4194304] 0 2024-09-13T02:54:21.012 INFO:tasks.workunit.client.1.smithi131.stdout:5/706: fdatasync d1/d1c/fdd 0 2024-09-13T02:54:21.013 INFO:tasks.workunit.client.1.smithi131.stdout:5/707: rename d1/d1c/d8e/laa to d1/d9c/leb 0 2024-09-13T02:54:21.014 INFO:tasks.workunit.client.1.smithi131.stdout:5/708: mknod d1/d21/db7/cec 0 2024-09-13T02:54:21.014 INFO:tasks.workunit.client.1.smithi131.stdout:5/709: fdatasync d1/d2f/fde 0 2024-09-13T02:54:21.014 INFO:tasks.workunit.client.1.smithi131.stdout:8/925: read db/d1d/d1f/fbe [1707480,83735] 0 2024-09-13T02:54:21.014 INFO:tasks.workunit.client.1.smithi131.stdout:8/926: write db/d2b/fd8 [915808,101523] 0 2024-09-13T02:54:21.015 INFO:tasks.workunit.client.1.smithi131.stdout:8/927: read db/d1d/d1f/d5c/fd1 [194569,74149] 0 2024-09-13T02:54:21.016 INFO:tasks.workunit.client.1.smithi131.stdout:8/928: dread db/d2e/d40/d117/fa5 [0,4194304] 0 2024-09-13T02:54:21.017 INFO:tasks.workunit.client.1.smithi131.stdout:8/929: mkdir db/d89/d11a/d11f 0 2024-09-13T02:54:21.024 INFO:tasks.workunit.client.1.smithi131.stdout:8/930: dread db/d1d/d1f/f2d [0,4194304] 0 2024-09-13T02:54:21.025 INFO:tasks.workunit.client.1.smithi131.stdout:8/931: creat db/d1d/d34/d8d/dea/f120 x:0 0 0 2024-09-13T02:54:21.025 INFO:tasks.workunit.client.1.smithi131.stdout:8/932: write db/d2e/d3a/fe5 [9709588,15446] 0 2024-09-13T02:54:21.025 INFO:tasks.workunit.client.1.smithi131.stdout:8/933: fdatasync f2 0 2024-09-13T02:54:21.033 INFO:tasks.workunit.client.1.smithi131.stdout:8/934: read db/d2b/f6d [3197135,45614] 0 2024-09-13T02:54:21.034 INFO:tasks.workunit.client.1.smithi131.stdout:8/935: rmdir db/d1d/d1f 39 2024-09-13T02:54:21.035 INFO:tasks.workunit.client.1.smithi131.stdout:4/863: sync 2024-09-13T02:54:21.035 INFO:tasks.workunit.client.1.smithi131.stdout:4/864: write d1/d18/d43/d97/fa5 [997399,43707] 0 2024-09-13T02:54:21.035 INFO:tasks.workunit.client.1.smithi131.stdout:4/865: truncate d1/d18/d34/f6f 4783274 0 2024-09-13T02:54:21.035 INFO:tasks.workunit.client.1.smithi131.stdout:4/866: write d1/d18/d43/d65/dc7/f107 [915474,52941] 0 2024-09-13T02:54:21.041 INFO:tasks.workunit.client.1.smithi131.stdout:8/936: write db/d2b/d39/fa2 [5050569,49820] 0 2024-09-13T02:54:21.060 INFO:tasks.workunit.client.1.smithi131.stdout:8/937: dwrite db/d89/d106/f5d [0,4194304] 0 2024-09-13T02:54:21.060 INFO:tasks.workunit.client.1.smithi131.stdout:4/867: dwrite d1/d18/d34/d62/da3/da6/fb1 [0,4194304] 0 2024-09-13T02:54:21.060 INFO:tasks.workunit.client.1.smithi131.stdout:4/868: read - d1/d18/d43/d97/dba/d22/d73/ff9 zero size 2024-09-13T02:54:21.061 INFO:tasks.workunit.client.1.smithi131.stdout:8/938: symlink db/d2e/d40/d117/df7/l121 0 2024-09-13T02:54:21.062 INFO:tasks.workunit.client.1.smithi131.stdout:4/869: mknod d1/d18/d43/d65/dbd/dc1/c12a 0 2024-09-13T02:54:21.062 INFO:tasks.workunit.client.1.smithi131.stdout:8/939: truncate db/d2b/f6f 437237 0 2024-09-13T02:54:21.063 INFO:tasks.workunit.client.1.smithi131.stdout:4/870: creat d1/d18/d43/d97/dba/d22/d49/f12b x:0 0 0 2024-09-13T02:54:21.063 INFO:tasks.workunit.client.1.smithi131.stdout:4/871: fdatasync d1/d18/d43/d97/dba/d22/f11f 0 2024-09-13T02:54:21.063 INFO:tasks.workunit.client.1.smithi131.stdout:4/872: truncate d1/d18/d34/d62/d78/fe8 727291 0 2024-09-13T02:54:21.064 INFO:tasks.workunit.client.1.smithi131.stdout:8/940: unlink db/d2e/d40/c87 0 2024-09-13T02:54:21.066 INFO:tasks.workunit.client.1.smithi131.stdout:8/941: rename db/d1d/d34/d4e/dd7 to db/d1d/d1f/d5c/d122 0 2024-09-13T02:54:21.066 INFO:tasks.workunit.client.1.smithi131.stdout:8/942: chown db/d1d/cb0 517087 1 2024-09-13T02:54:21.066 INFO:tasks.workunit.client.1.smithi131.stdout:8/943: creat db/d1d/d71/f123 x:0 0 0 2024-09-13T02:54:21.068 INFO:tasks.workunit.client.1.smithi131.stdout:8/944: rename db/d1d/d1f/d67/dec/lf4 to db/d2e/d40/l124 0 2024-09-13T02:54:21.068 INFO:tasks.workunit.client.1.smithi131.stdout:4/873: dread d1/d18/d43/d97/dba/f3b [0,4194304] 0 2024-09-13T02:54:21.069 INFO:tasks.workunit.client.1.smithi131.stdout:4/874: creat d1/f12c x:0 0 0 2024-09-13T02:54:21.070 INFO:tasks.workunit.client.1.smithi131.stdout:4/875: rename d1/d18/d43/d97/dba/d7a/dd3 to d1/d18/d43/d97/dba/d19/dee/d12d 0 2024-09-13T02:54:21.071 INFO:tasks.workunit.client.1.smithi131.stdout:4/876: symlink d1/d18/d43/d97/dba/d7a/dc5/l12e 0 2024-09-13T02:54:21.071 INFO:tasks.workunit.client.1.smithi131.stdout:4/877: readlink d1/d18/d43/d97/dba/d22/d73/le4 0 2024-09-13T02:54:21.072 INFO:tasks.workunit.client.1.smithi131.stdout:4/878: mkdir d1/d18/d34/d4e/d108/d8d/dc9/d116/d12f 0 2024-09-13T02:54:21.072 INFO:tasks.workunit.client.1.smithi131.stdout:4/879: stat d1/d18/d34/d4e/fb0 0 2024-09-13T02:54:21.081 INFO:tasks.workunit.client.1.smithi131.stdout:4/880: write d1/d18/d43/d65/dbd/dc1/d13/f44 [6482933,15621] 0 2024-09-13T02:54:21.081 INFO:tasks.workunit.client.1.smithi131.stdout:4/881: fdatasync d1/d18/d81/f125 0 2024-09-13T02:54:21.089 INFO:tasks.workunit.client.1.smithi131.stdout:4/882: write d1/d18/d43/d97/dba/d22/d49/f4d [911099,66706] 0 2024-09-13T02:54:21.203 INFO:tasks.workunit.client.1.smithi131.stdout:4/883: dwrite d1/d18/d81/ffd [0,4194304] 0 2024-09-13T02:54:21.203 INFO:tasks.workunit.client.1.smithi131.stdout:4/884: chown d1/d18/d34/d4e/d108/d8d/dc9/d116/f11c 1269261549 1 2024-09-13T02:54:21.203 INFO:tasks.workunit.client.1.smithi131.stdout:8/945: dwrite db/d1d/d34/d8d/ff8 [0,4194304] 0 2024-09-13T02:54:21.204 INFO:tasks.workunit.client.1.smithi131.stdout:4/885: symlink d1/d18/d43/d65/dbd/dc1/l130 0 2024-09-13T02:54:21.209 INFO:tasks.workunit.client.1.smithi131.stdout:8/946: symlink db/d89/d106/d50/l125 0 2024-09-13T02:54:21.209 INFO:tasks.workunit.client.1.smithi131.stdout:8/947: dread db/d1d/d1f/d5c/f64 [0,4194304] 0 2024-09-13T02:54:21.209 INFO:tasks.workunit.client.1.smithi131.stdout:2/817: sync 2024-09-13T02:54:21.209 INFO:tasks.workunit.client.1.smithi131.stdout:9/828: sync 2024-09-13T02:54:21.209 INFO:tasks.workunit.client.1.smithi131.stdout:2/818: fsync d5/d31/d21/fbe 0 2024-09-13T02:54:21.209 INFO:tasks.workunit.client.1.smithi131.stdout:2/819: chown d5/d6e/le1 7 1 2024-09-13T02:54:21.210 INFO:tasks.workunit.client.1.smithi131.stdout:2/820: truncate d5/d34/f65 2402997 0 2024-09-13T02:54:21.210 INFO:tasks.workunit.client.1.smithi131.stdout:2/821: creat d5/d31/d26/d8d/f123 x:0 0 0 2024-09-13T02:54:21.211 INFO:tasks.workunit.client.1.smithi131.stdout:2/822: truncate d5/d31/d21/d57/d90/dc8/fef 2973103 0 2024-09-13T02:54:21.213 INFO:tasks.workunit.client.1.smithi131.stdout:2/823: rename d5/d18/d4b/cdc to d5/d6e/c124 0 2024-09-13T02:54:21.213 INFO:tasks.workunit.client.1.smithi131.stdout:2/824: fsync d5/d31/d21/d57/fcf 0 2024-09-13T02:54:21.213 INFO:tasks.workunit.client.1.smithi131.stdout:2/825: read d5/d31/d1d/f54 [3477737,73663] 0 2024-09-13T02:54:21.213 INFO:tasks.workunit.client.1.smithi131.stdout:2/826: chown d5/d18/d4b/f40 0 1 2024-09-13T02:54:21.215 INFO:tasks.workunit.client.1.smithi131.stdout:2/827: unlink d5/fa 0 2024-09-13T02:54:21.221 INFO:tasks.workunit.client.1.smithi131.stdout:9/829: write d0/d4d/d55/d76/d96/d118/f5b [1956847,96046] 0 2024-09-13T02:54:21.221 INFO:tasks.workunit.client.1.smithi131.stdout:2/828: write d5/d31/d1d/d32/f49 [734096,41261] 0 2024-09-13T02:54:21.223 INFO:tasks.workunit.client.1.smithi131.stdout:9/830: link d0/d4d/d55/d76/d96/d118/d14/d1a/d2a/fa6 d0/d4d/d55/d76/d96/d118/d14/d1a/dc6/de5/f11c 0 2024-09-13T02:54:21.225 INFO:tasks.workunit.client.1.smithi131.stdout:9/831: rename d0/d4d/d55/d76/d96/d118/f5b to d0/d4d/d55/d76/d10f/f11d 0 2024-09-13T02:54:21.226 INFO:tasks.workunit.client.1.smithi131.stdout:9/832: link d0/d4d/d55/d76/d96/d118/d14/d67/dc0/ced d0/d4d/d55/d76/d96/d118/d14/d1a/d2a/d5e/da2/d39/dae/d116/c11e 0 2024-09-13T02:54:21.231 INFO:tasks.workunit.client.1.smithi131.stdout:4/886: dwrite d1/d18/d43/dd9/f100 [0,4194304] 0 2024-09-13T02:54:21.232 INFO:tasks.workunit.client.1.smithi131.stdout:2/829: dread d5/d31/d21/d57/d90/dc8/fef [0,4194304] 0 2024-09-13T02:54:21.232 INFO:tasks.workunit.client.1.smithi131.stdout:2/830: chown d5/d31/d1d/d37/d112/d114/db4/dbc/fcc 1094679986 1 2024-09-13T02:54:21.233 INFO:tasks.workunit.client.1.smithi131.stdout:8/948: dwrite db/d89/f98 [0,4194304] 0 2024-09-13T02:54:21.233 INFO:tasks.workunit.client.1.smithi131.stdout:4/887: symlink d1/d18/d34/d62/da3/ded/l131 0 2024-09-13T02:54:21.234 INFO:tasks.workunit.client.1.smithi131.stdout:2/831: creat d5/d6e/f125 x:0 0 0 2024-09-13T02:54:21.237 INFO:tasks.workunit.client.1.smithi131.stdout:4/888: symlink d1/d18/d43/d97/dba/d7a/dc5/l132 0 2024-09-13T02:54:21.239 INFO:tasks.workunit.client.1.smithi131.stdout:2/832: mknod d5/d31/d1d/d37/d112/d114/db4/dbc/d48/d4c/c126 0 2024-09-13T02:54:21.242 INFO:tasks.workunit.client.1.smithi131.stdout:4/889: unlink d1/fef 0 2024-09-13T02:54:21.242 INFO:tasks.workunit.client.1.smithi131.stdout:8/949: dread db/fa9 [0,4194304] 0 2024-09-13T02:54:21.243 INFO:tasks.workunit.client.1.smithi131.stdout:8/950: fdatasync db/d2e/d40/f53 0 2024-09-13T02:54:21.244 INFO:tasks.workunit.client.1.smithi131.stdout:4/890: symlink d1/d18/d34/d4e/d108/l133 0 2024-09-13T02:54:21.244 INFO:tasks.workunit.client.1.smithi131.stdout:4/891: write d1/d18/d43/d65/dbd/dc1/d13/f44 [6368787,33186] 0 2024-09-13T02:54:21.244 INFO:tasks.workunit.client.1.smithi131.stdout:4/892: fsync d1/d18/d34/d4e/d108/d33/d3a/da8/dff/f106 0 2024-09-13T02:54:21.244 INFO:tasks.workunit.client.1.smithi131.stdout:4/893: read - d1/d18/d34/d4e/d108/d8d/ffe zero size 2024-09-13T02:54:21.244 INFO:tasks.workunit.client.1.smithi131.stdout:4/894: write d1/d18/d43/d97/dba/d22/f11f [896128,51392] 0 2024-09-13T02:54:21.245 INFO:tasks.workunit.client.1.smithi131.stdout:8/951: mkdir db/d1d/d34/d4e/d7e/dc4/d102/d126 0 2024-09-13T02:54:21.249 INFO:tasks.workunit.client.1.smithi131.stdout:8/952: creat db/d1d/d1f/f127 x:0 0 0 2024-09-13T02:54:21.249 INFO:tasks.workunit.client.1.smithi131.stdout:4/895: rmdir d1/d18/d43/d97/dba/d22/d73/de0 39 2024-09-13T02:54:21.250 INFO:tasks.workunit.client.1.smithi131.stdout:8/953: truncate db/d1d/d1f/d67/d81/ffd 2866329 0 2024-09-13T02:54:21.251 INFO:tasks.workunit.client.1.smithi131.stdout:8/954: truncate f6 7065270 0 2024-09-13T02:54:21.252 INFO:tasks.workunit.client.1.smithi131.stdout:8/955: creat db/d1d/d1f/d5c/d122/f128 x:0 0 0 2024-09-13T02:54:21.253 INFO:tasks.workunit.client.1.smithi131.stdout:8/956: mknod db/d1d/d34/d4e/d7e/dc4/d102/c129 0 2024-09-13T02:54:21.254 INFO:tasks.workunit.client.1.smithi131.stdout:8/957: getdents db/d89/d106/d50 0 2024-09-13T02:54:21.257 INFO:tasks.workunit.client.1.smithi131.stdout:2/833: dwrite d5/d18/d4b/df6/f11c [4194304,4194304] 0 2024-09-13T02:54:21.267 INFO:tasks.workunit.client.1.smithi131.stdout:4/896: dwrite d1/d18/d34/d62/d78/ffb [4194304,4194304] 0 2024-09-13T02:54:21.267 INFO:tasks.workunit.client.1.smithi131.stdout:2/834: dread d5/d31/d1d/d37/d112/d114/db4/dbc/d48/d4c/db1/fc5 [0,4194304] 0 2024-09-13T02:54:21.268 INFO:tasks.workunit.client.1.smithi131.stdout:4/897: rename d1/d18/d43/d97/dba/d19/dee/d12d/cea to d1/d18/d43/d97/c134 0 2024-09-13T02:54:21.269 INFO:tasks.workunit.client.1.smithi131.stdout:4/898: mkdir d1/d18/d43/d65/dbd/dc1/d13/d135 0 2024-09-13T02:54:21.270 INFO:tasks.workunit.client.1.smithi131.stdout:4/899: unlink d1/l4 0 2024-09-13T02:54:21.270 INFO:tasks.workunit.client.1.smithi131.stdout:4/900: write d1/d18/d43/d7d/f10d [890951,69346] 0 2024-09-13T02:54:21.275 INFO:tasks.workunit.client.1.smithi131.stdout:8/958: dwrite db/f23 [0,4194304] 0 2024-09-13T02:54:21.276 INFO:tasks.workunit.client.1.smithi131.stdout:8/959: rmdir db/d11b 0 2024-09-13T02:54:21.276 INFO:tasks.workunit.client.1.smithi131.stdout:8/960: chown db/d89/d106 17331 1 2024-09-13T02:54:21.277 INFO:tasks.workunit.client.1.smithi131.stdout:8/961: creat db/d1d/f12a x:0 0 0 2024-09-13T02:54:21.277 INFO:tasks.workunit.client.1.smithi131.stdout:8/962: chown db/d1d/d1f/d5c/d122/f128 4 1 2024-09-13T02:54:21.277 INFO:tasks.workunit.client.1.smithi131.stdout:2/835: dread d5/d31/d4e/f110 [0,4194304] 0 2024-09-13T02:54:21.277 INFO:tasks.workunit.client.1.smithi131.stdout:2/836: write d5/d31/d1d/d32/d7d/fd0 [4505817,80927] 0 2024-09-13T02:54:21.279 INFO:tasks.workunit.client.1.smithi131.stdout:8/963: dread db/d2b/f6f [0,4194304] 0 2024-09-13T02:54:21.282 INFO:tasks.workunit.client.1.smithi131.stdout:2/837: mknod d5/d31/d1d/d50/d121/c127 0 2024-09-13T02:54:21.282 INFO:tasks.workunit.client.1.smithi131.stdout:2/838: truncate d5/d31/d1d/d37/d112/d114/fd8 233539 0 2024-09-13T02:54:21.283 INFO:tasks.workunit.client.1.smithi131.stdout:2/839: chown d5/d31/d1d/d32/d3b/d67/fe6 9489631 1 2024-09-13T02:54:21.283 INFO:tasks.workunit.client.1.smithi131.stdout:8/964: dread db/d89/d106/f62 [0,4194304] 0 2024-09-13T02:54:21.283 INFO:tasks.workunit.client.1.smithi131.stdout:2/840: truncate d5/d34/f7a 2319550 0 2024-09-13T02:54:21.285 INFO:tasks.workunit.client.1.smithi131.stdout:2/841: rename d5/d31/d21/d57/lb8 to d5/d31/d1d/d50/l128 0 2024-09-13T02:54:21.287 INFO:tasks.workunit.client.1.smithi131.stdout:2/842: unlink d5/d31/d1d/c27 0 2024-09-13T02:54:21.289 INFO:tasks.workunit.client.1.smithi131.stdout:2/843: creat d5/d31/d1d/d37/d7c/f129 x:0 0 0 2024-09-13T02:54:21.289 INFO:tasks.workunit.client.1.smithi131.stdout:2/844: write d5/d6e/f125 [965384,72162] 0 2024-09-13T02:54:21.289 INFO:tasks.workunit.client.1.smithi131.stdout:2/845: write d5/d31/d1d/d32/d7d/fa8 [840794,128596] 0 2024-09-13T02:54:21.297 INFO:tasks.workunit.client.1.smithi131.stdout:8/965: dwrite db/d1d/d34/d4e/f99 [0,4194304] 0 2024-09-13T02:54:21.299 INFO:tasks.workunit.client.1.smithi131.stdout:8/966: mkdir db/d1d/d34/d4e/d7e/d12b 0 2024-09-13T02:54:21.299 INFO:tasks.workunit.client.1.smithi131.stdout:8/967: chown db/d89/d106/f62 121 1 2024-09-13T02:54:21.301 INFO:tasks.workunit.client.1.smithi131.stdout:2/846: write d5/d31/d4e/d78/f99 [1459066,28902] 0 2024-09-13T02:54:21.301 INFO:tasks.workunit.client.1.smithi131.stdout:2/847: chown d5/d31/d26/c70 59 1 2024-09-13T02:54:21.303 INFO:tasks.workunit.client.1.smithi131.stdout:2/848: mknod d5/d31/d1d/d37/d112/d114/db4/dbc/ddf/c12a 0 2024-09-13T02:54:21.304 INFO:tasks.workunit.client.1.smithi131.stdout:2/849: mknod d5/d6e/c12b 0 2024-09-13T02:54:21.304 INFO:tasks.workunit.client.1.smithi131.stdout:2/850: truncate d5/d31/d21/d57/fec 359904 0 2024-09-13T02:54:21.317 INFO:tasks.workunit.client.1.smithi131.stdout:8/968: dwrite db/d1d/d1f/f2c [8388608,4194304] 0 2024-09-13T02:54:21.326 INFO:tasks.workunit.client.1.smithi131.stdout:8/969: dread db/d1d/d1f/f52 [0,4194304] 0 2024-09-13T02:54:21.327 INFO:tasks.workunit.client.1.smithi131.stdout:8/970: creat db/d1d/d34/d4e/d7e/dc4/d102/d126/f12c x:0 0 0 2024-09-13T02:54:21.340 INFO:tasks.workunit.client.1.smithi131.stdout:8/971: dwrite db/d1d/d1f/d67/d81/ffd [0,4194304] 0 2024-09-13T02:54:21.348 INFO:tasks.workunit.client.1.smithi131.stdout:8/972: read db/d89/f98 [3064085,76406] 0 2024-09-13T02:54:21.349 INFO:tasks.workunit.client.1.smithi131.stdout:8/973: link db/d1d/d34/f7a db/d1d/f12d 0 2024-09-13T02:54:21.349 INFO:tasks.workunit.client.1.smithi131.stdout:8/974: write db/d1d/d34/d4e/d7e/ff5 [861091,17763] 0 2024-09-13T02:54:21.361 INFO:tasks.workunit.client.1.smithi131.stdout:8/975: dwrite db/d1d/d34/d4e/d7e/dc4/fe7 [0,4194304] 0 2024-09-13T02:54:21.362 INFO:tasks.workunit.client.1.smithi131.stdout:8/976: creat db/d1d/d34/d4e/d7e/dc4/d102/d126/f12e x:0 0 0 2024-09-13T02:54:21.364 INFO:tasks.workunit.client.1.smithi131.stdout:8/977: mknod db/d2b/d39/c12f 0 2024-09-13T02:54:21.367 INFO:tasks.workunit.client.1.smithi131.stdout:8/978: rename db/d1d/d34/d8d to db/d1d/d1f/d66/d130 0 2024-09-13T02:54:21.368 INFO:tasks.workunit.client.1.smithi131.stdout:8/979: stat db/d1d/d1f/d66/lc8 0 2024-09-13T02:54:21.368 INFO:tasks.workunit.client.1.smithi131.stdout:8/980: chown db/d89/cdf 523 1 2024-09-13T02:54:21.369 INFO:tasks.workunit.client.1.smithi131.stdout:8/981: unlink db/d2e/ffa 0 2024-09-13T02:54:21.377 INFO:tasks.workunit.client.1.smithi131.stdout:8/982: write db/f23 [328356,63144] 0 2024-09-13T02:54:21.457 INFO:tasks.workunit.client.1.smithi131.stdout:0/926: sync 2024-09-13T02:54:21.457 INFO:tasks.workunit.client.1.smithi131.stdout:3/689: sync 2024-09-13T02:54:21.459 INFO:tasks.workunit.client.1.smithi131.stdout:0/927: mkdir d0/de/d1f/d22/d31/d39/d67/d13f 0 2024-09-13T02:54:21.460 INFO:tasks.workunit.client.1.smithi131.stdout:0/928: write d0/de/d1f/d22/d31/d39/d67/fec [376375,35887] 0 2024-09-13T02:54:21.460 INFO:tasks.workunit.client.1.smithi131.stdout:3/690: rmdir d2/d4/d76/d9f/d41/d5c/d4f 39 2024-09-13T02:54:21.462 INFO:tasks.workunit.client.1.smithi131.stdout:0/929: link d0/de/d1f/d22/d3d/d43/d4b/fe0 d0/de/d1f/d22/d31/d39/d40/f140 0 2024-09-13T02:54:21.465 INFO:tasks.workunit.client.1.smithi131.stdout:0/930: creat d0/de/d1f/d22/d31/d39/d67/db5/f141 x:0 0 0 2024-09-13T02:54:21.467 INFO:tasks.workunit.client.1.smithi131.stdout:0/931: creat d0/de/d45/dfa/d119/f142 x:0 0 0 2024-09-13T02:54:21.467 INFO:tasks.workunit.client.1.smithi131.stdout:0/932: chown d0/de/d1f/d22/d31/lb3 1133864 1 2024-09-13T02:54:21.469 INFO:tasks.workunit.client.1.smithi131.stdout:0/933: creat d0/de/d1f/d22/d3d/d55/f143 x:0 0 0 2024-09-13T02:54:21.481 INFO:tasks.workunit.client.1.smithi131.stdout:3/691: dwrite d2/d4/f84 [0,4194304] 0 2024-09-13T02:54:21.481 INFO:tasks.workunit.client.1.smithi131.stdout:3/692: write d2/d4/d1a/f6b [1075202,64889] 0 2024-09-13T02:54:21.497 INFO:tasks.workunit.client.1.smithi131.stdout:3/693: dwrite d2/d4/f28 [0,4194304] 0 2024-09-13T02:54:21.497 INFO:tasks.workunit.client.1.smithi131.stdout:3/694: dread - d2/dc/d39/d61/f6c zero size 2024-09-13T02:54:21.500 INFO:tasks.workunit.client.1.smithi131.stdout:3/695: rename d2/d4/d7/d1d/l86 to d2/d4/d1a/leb 0 2024-09-13T02:54:21.500 INFO:tasks.workunit.client.1.smithi131.stdout:3/696: truncate d2/d4/d1a/d31/da7/fd4 650027 0 2024-09-13T02:54:21.500 INFO:tasks.workunit.client.1.smithi131.stdout:3/697: chown d2/d4/d7/d1d/d24/d6f/f7c 163632039 1 2024-09-13T02:54:21.500 INFO:tasks.workunit.client.1.smithi131.stdout:3/698: chown d2/d4/d76/d9f/f6a 12487980 1 2024-09-13T02:54:21.501 INFO:tasks.workunit.client.1.smithi131.stdout:3/699: symlink d2/d4/d7/d1d/d80/lec 0 2024-09-13T02:54:21.503 INFO:tasks.workunit.client.1.smithi131.stdout:3/700: link d2/d4/d7/f4d d2/d4/d76/d9f/d41/d5c/fed 0 2024-09-13T02:54:21.505 INFO:tasks.workunit.client.1.smithi131.stdout:3/701: mkdir d2/d4/d2d/dce/dee 0 2024-09-13T02:54:21.507 INFO:tasks.workunit.client.1.smithi131.stdout:3/702: rename d2/d4/d1a/d31/d48/d69/f8d to d2/dc/db1/dca/fef 0 2024-09-13T02:54:21.507 INFO:tasks.workunit.client.1.smithi131.stdout:3/703: dread - d2/d4/d7/fd3 zero size 2024-09-13T02:54:21.523 INFO:tasks.workunit.client.1.smithi131.stdout:3/704: dread d2/d4/f84 [0,4194304] 0 2024-09-13T02:54:21.534 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:21 smithi089 ceph-mon[27639]: Upgrade: Updating mgr.smithi131.aunbqd 2024-09-13T02:54:21.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:21 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:54:21.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:21 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi131.aunbqd", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T02:54:21.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:21 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T02:54:21.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:21 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:54:21.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:21 smithi089 ceph-mon[27639]: Deploying daemon mgr.smithi131.aunbqd on smithi131 2024-09-13T02:54:21.539 INFO:tasks.workunit.client.1.smithi131.stdout:3/705: dwrite d2/dc/d39/d61/f6c [0,4194304] 0 2024-09-13T02:54:21.600 INFO:tasks.workunit.client.1.smithi131.stdout:1/875: sync 2024-09-13T02:54:21.600 INFO:tasks.workunit.client.1.smithi131.stdout:6/870: sync 2024-09-13T02:54:21.600 INFO:tasks.workunit.client.1.smithi131.stdout:7/744: sync 2024-09-13T02:54:21.600 INFO:tasks.workunit.client.1.smithi131.stdout:5/710: sync 2024-09-13T02:54:21.601 INFO:tasks.workunit.client.1.smithi131.stdout:1/876: creat dd/d51/d5a/f13a x:0 0 0 2024-09-13T02:54:21.602 INFO:tasks.workunit.client.1.smithi131.stdout:1/877: link dd/d33/d42/d47/dd1/d101/f118 dd/d26/d2a/d2c/d4b/f13b 0 2024-09-13T02:54:21.603 INFO:tasks.workunit.client.1.smithi131.stdout:1/878: unlink dd/d26/d44/lf8 0 2024-09-13T02:54:21.604 INFO:tasks.workunit.client.1.smithi131.stdout:1/879: fsync dd/d51/d8a/fcc 0 2024-09-13T02:54:21.604 INFO:tasks.workunit.client.1.smithi131.stdout:1/880: chown dd/d26/d2a/c3f 250891702 1 2024-09-13T02:54:21.604 INFO:tasks.workunit.client.1.smithi131.stdout:5/711: rename d1/d2f/d33 to d1/d21/d74/d78/d98/ded 0 2024-09-13T02:54:21.605 INFO:tasks.workunit.client.1.smithi131.stdout:1/881: mknod dd/c13c 0 2024-09-13T02:54:21.605 INFO:tasks.workunit.client.1.smithi131.stdout:1/882: creat dd/d51/d8a/d95/f13d x:0 0 0 2024-09-13T02:54:21.605 INFO:tasks.workunit.client.1.smithi131.stdout:1/883: readlink dd/d26/d44/d6d/l9c 0 2024-09-13T02:54:21.606 INFO:tasks.workunit.client.1.smithi131.stdout:1/884: mknod dd/d26/d44/d6d/d7c/c13e 0 2024-09-13T02:54:21.607 INFO:tasks.workunit.client.1.smithi131.stdout:1/885: creat dd/d26/d44/d117/f13f x:0 0 0 2024-09-13T02:54:21.607 INFO:tasks.workunit.client.1.smithi131.stdout:1/886: read - dd/d26/d2a/d2c/d4b/d10b/f133 zero size 2024-09-13T02:54:21.607 INFO:tasks.workunit.client.1.smithi131.stdout:1/887: write dd/d26/d2a/d2c/d4b/d10b/f10f [754566,2885] 0 2024-09-13T02:54:21.607 INFO:tasks.workunit.client.1.smithi131.stdout:1/888: read dd/d26/d44/f23 [3272313,16309] 0 2024-09-13T02:54:21.608 INFO:tasks.workunit.client.1.smithi131.stdout:1/889: read - dd/d26/d7d/f11d zero size 2024-09-13T02:54:21.608 INFO:tasks.workunit.client.1.smithi131.stdout:1/890: symlink dd/d51/dad/l140 0 2024-09-13T02:54:21.609 INFO:tasks.workunit.client.1.smithi131.stdout:1/891: truncate dd/d51/db3/f112 421237 0 2024-09-13T02:54:21.609 INFO:tasks.workunit.client.1.smithi131.stdout:1/892: mknod dd/d26/d7d/d11b/c141 0 2024-09-13T02:54:21.609 INFO:tasks.workunit.client.1.smithi131.stdout:1/893: creat dd/d26/d2a/d2c/d4b/d10b/f142 x:0 0 0 2024-09-13T02:54:21.610 INFO:tasks.workunit.client.1.smithi131.stdout:1/894: creat dd/d51/d8a/f143 x:0 0 0 2024-09-13T02:54:21.611 INFO:tasks.workunit.client.1.smithi131.stdout:1/895: truncate dd/d51/d8a/fbe 2459156 0 2024-09-13T02:54:21.613 INFO:tasks.workunit.client.1.smithi131.stdout:1/896: rmdir dd/d51/d8a/d95/d125 0 2024-09-13T02:54:21.615 INFO:tasks.workunit.client.1.smithi131.stdout:1/897: rename dd/d33/d80/fc6 to dd/d33/d42/d47/d12f/f144 0 2024-09-13T02:54:21.622 INFO:tasks.workunit.client.1.smithi131.stdout:1/898: dread dd/d51/d5a/da3/feb [0,4194304] 0 2024-09-13T02:54:21.622 INFO:tasks.workunit.client.1.smithi131.stdout:5/712: dwrite d1/d5/d57/d60/fa2 [0,4194304] 0 2024-09-13T02:54:21.623 INFO:tasks.workunit.client.1.smithi131.stdout:5/713: unlink d1/d2f/d71/ca4 0 2024-09-13T02:54:21.624 INFO:tasks.workunit.client.1.smithi131.stdout:1/899: link dd/d33/d42/ld6 dd/d26/d44/d117/l145 0 2024-09-13T02:54:21.625 INFO:tasks.workunit.client.1.smithi131.stdout:5/714: symlink d1/d21/d74/d78/d98/dc9/lee 0 2024-09-13T02:54:21.626 INFO:tasks.workunit.client.1.smithi131.stdout:1/900: mknod dd/d51/c146 0 2024-09-13T02:54:21.627 INFO:tasks.workunit.client.1.smithi131.stdout:1/901: fdatasync dd/d33/f8f 0 2024-09-13T02:54:21.637 INFO:tasks.workunit.client.1.smithi131.stdout:5/715: write d1/d21/d74/faf [1850233,81218] 0 2024-09-13T02:54:21.638 INFO:tasks.workunit.client.1.smithi131.stdout:5/716: mknod d1/d21/d74/d78/d98/dc9/cef 0 2024-09-13T02:54:21.638 INFO:tasks.workunit.client.1.smithi131.stdout:5/717: symlink d1/d2f/d71/lf0 0 2024-09-13T02:54:21.640 INFO:tasks.workunit.client.1.smithi131.stdout:5/718: rename d1/d50/f7d to d1/d21/d90/ff1 0 2024-09-13T02:54:21.640 INFO:tasks.workunit.client.1.smithi131.stdout:5/719: fsync d1/d21/f51 0 2024-09-13T02:54:21.640 INFO:tasks.workunit.client.1.smithi131.stdout:5/720: chown d1/d2f/d71/c73 1611 1 2024-09-13T02:54:21.646 INFO:tasks.workunit.client.1.smithi131.stdout:1/902: dwrite dd/d26/d2a/fec [0,4194304] 0 2024-09-13T02:54:21.647 INFO:tasks.workunit.client.1.smithi131.stdout:1/903: readlink dd/d51/d5a/da3/lc5 0 2024-09-13T02:54:21.648 INFO:tasks.workunit.client.1.smithi131.stdout:1/904: mknod dd/d26/d2a/d2c/c147 0 2024-09-13T02:54:21.649 INFO:tasks.workunit.client.1.smithi131.stdout:1/905: mkdir dd/d51/d8a/d148 0 2024-09-13T02:54:21.649 INFO:tasks.workunit.client.1.smithi131.stdout:1/906: readlink dd/d26/d2a/d2c/d4b/l76 0 2024-09-13T02:54:21.649 INFO:tasks.workunit.client.1.smithi131.stdout:1/907: creat dd/d51/d8a/d95/f149 x:0 0 0 2024-09-13T02:54:21.655 INFO:tasks.workunit.client.1.smithi131.stdout:5/721: dwrite d1/d21/d90/fcf [0,4194304] 0 2024-09-13T02:54:21.658 INFO:tasks.workunit.client.1.smithi131.stdout:5/722: creat d1/d1c/d87/dbd/dca/ff2 x:0 0 0 2024-09-13T02:54:21.676 INFO:tasks.workunit.client.1.smithi131.stdout:1/908: dwrite dd/d26/d44/f67 [0,4194304] 0 2024-09-13T02:54:21.676 INFO:tasks.workunit.client.1.smithi131.stdout:5/723: dwrite d1/d21/d74/d78/d98/fa8 [0,4194304] 0 2024-09-13T02:54:21.678 INFO:tasks.workunit.client.1.smithi131.stdout:1/909: mkdir dd/d14a 0 2024-09-13T02:54:21.681 INFO:tasks.workunit.client.1.smithi131.stdout:5/724: mkdir d1/d21/d74/d78/d98/df3 0 2024-09-13T02:54:21.682 INFO:tasks.workunit.client.1.smithi131.stdout:1/910: mknod dd/d33/d94/d122/c14b 0 2024-09-13T02:54:21.682 INFO:tasks.workunit.client.1.smithi131.stdout:1/911: dread - dd/d51/d8a/d107/f11f zero size 2024-09-13T02:54:21.683 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:21 smithi131 ceph-mon[34689]: Upgrade: Updating mgr.smithi131.aunbqd 2024-09-13T02:54:21.683 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:21 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:54:21.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:21 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi131.aunbqd", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T02:54:21.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:21 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T02:54:21.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:21 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:54:21.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:21 smithi131 ceph-mon[34689]: Deploying daemon mgr.smithi131.aunbqd on smithi131 2024-09-13T02:54:21.684 INFO:tasks.workunit.client.1.smithi131.stdout:1/912: link dd/d33/ce7 dd/d51/d5a/c14c 0 2024-09-13T02:54:21.686 INFO:tasks.workunit.client.1.smithi131.stdout:1/913: unlink dd/c13c 0 2024-09-13T02:54:21.686 INFO:tasks.workunit.client.1.smithi131.stdout:1/914: stat dd/d33/d42/d47/d12f/f144 0 2024-09-13T02:54:21.686 INFO:tasks.workunit.client.1.smithi131.stdout:1/915: creat dd/d26/f14d x:0 0 0 2024-09-13T02:54:21.686 INFO:tasks.workunit.client.1.smithi131.stdout:1/916: write dd/f7e [324079,52335] 0 2024-09-13T02:54:21.691 INFO:tasks.workunit.client.1.smithi131.stdout:5/725: dread d1/d21/d74/d78/d98/ded/f5b [0,4194304] 0 2024-09-13T02:54:21.692 INFO:tasks.workunit.client.1.smithi131.stdout:5/726: truncate d1/d21/d74/faf 4735484 0 2024-09-13T02:54:21.693 INFO:tasks.workunit.client.1.smithi131.stdout:5/727: write d1/d29/d39/f4a [514018,98010] 0 2024-09-13T02:54:21.694 INFO:tasks.workunit.client.1.smithi131.stdout:5/728: mknod d1/d5/cf4 0 2024-09-13T02:54:21.699 INFO:tasks.workunit.client.1.smithi131.stdout:1/917: dwrite dd/d26/d44/d6d/f105 [0,4194304] 0 2024-09-13T02:54:21.702 INFO:tasks.workunit.client.1.smithi131.stdout:1/918: rename dd/d26/d2a/d69/c78 to dd/d33/d42/d47/dd1/c14e 0 2024-09-13T02:54:21.704 INFO:tasks.workunit.client.1.smithi131.stdout:1/919: rename dd/d33/d94/d106 to dd/d26/d2a/d69/d14f 0 2024-09-13T02:54:21.705 INFO:tasks.workunit.client.1.smithi131.stdout:1/920: unlink dd/l74 0 2024-09-13T02:54:21.705 INFO:tasks.workunit.client.1.smithi131.stdout:1/921: write dd/d26/d2a/ff1 [5943702,34308] 0 2024-09-13T02:54:21.707 INFO:tasks.workunit.client.1.smithi131.stdout:1/922: symlink dd/d33/d42/d47/d12f/l150 0 2024-09-13T02:54:21.707 INFO:tasks.workunit.client.1.smithi131.stdout:1/923: creat dd/d51/dad/f151 x:0 0 0 2024-09-13T02:54:21.708 INFO:tasks.workunit.client.1.smithi131.stdout:1/924: mkdir dd/d51/d8a/d107/d152 0 2024-09-13T02:54:21.708 INFO:tasks.workunit.client.1.smithi131.stdout:1/925: truncate dd/f20 1175867 0 2024-09-13T02:54:21.710 INFO:tasks.workunit.client.1.smithi131.stdout:1/926: write dd/d51/d5a/da3/fde [697447,24915] 0 2024-09-13T02:54:21.710 INFO:tasks.workunit.client.1.smithi131.stdout:1/927: truncate dd/dc2/f79 5034140 0 2024-09-13T02:54:21.711 INFO:tasks.workunit.client.1.smithi131.stdout:1/928: symlink dd/d33/d94/dfb/l153 0 2024-09-13T02:54:21.712 INFO:tasks.workunit.client.1.smithi131.stdout:1/929: creat dd/dc2/f154 x:0 0 0 2024-09-13T02:54:21.713 INFO:tasks.workunit.client.1.smithi131.stdout:1/930: creat dd/d33/d42/d47/d12f/f155 x:0 0 0 2024-09-13T02:54:21.714 INFO:tasks.workunit.client.1.smithi131.stdout:1/931: write dd/d51/d5a/f73 [1942514,115291] 0 2024-09-13T02:54:21.714 INFO:tasks.workunit.client.1.smithi131.stdout:1/932: fsync dd/dc2/f79 0 2024-09-13T02:54:21.714 INFO:tasks.workunit.client.1.smithi131.stdout:5/729: dwrite d1/d5/fa [0,4194304] 0 2024-09-13T02:54:21.716 INFO:tasks.workunit.client.1.smithi131.stdout:1/933: rename dd/d26/fbc to dd/d26/d2a/d69/d14f/f156 0 2024-09-13T02:54:21.716 INFO:tasks.workunit.client.1.smithi131.stdout:1/934: fdatasync dd/d26/d2a/d69/fe6 0 2024-09-13T02:54:21.716 INFO:tasks.workunit.client.1.smithi131.stdout:1/935: chown dd/d26/d2a/d2c/d4b/l76 48760 1 2024-09-13T02:54:21.716 INFO:tasks.workunit.client.1.smithi131.stdout:1/936: write dd/d26/fda [345079,30940] 0 2024-09-13T02:54:21.721 INFO:tasks.workunit.client.1.smithi131.stdout:5/730: link d1/d21/d74/d78/d98/le1 d1/d1c/d87/db8/lf5 0 2024-09-13T02:54:21.722 INFO:tasks.workunit.client.1.smithi131.stdout:1/937: mknod dd/d51/d5a/da3/c157 0 2024-09-13T02:54:21.722 INFO:tasks.workunit.client.1.smithi131.stdout:1/938: chown dd/d26/f50 12057512 1 2024-09-13T02:54:21.723 INFO:tasks.workunit.client.1.smithi131.stdout:5/731: mknod d1/d1c/cf6 0 2024-09-13T02:54:21.724 INFO:tasks.workunit.client.1.smithi131.stdout:1/939: dread dd/f20 [0,4194304] 0 2024-09-13T02:54:21.724 INFO:tasks.workunit.client.1.smithi131.stdout:1/940: stat dd/f3a 0 2024-09-13T02:54:21.724 INFO:tasks.workunit.client.1.smithi131.stdout:1/941: truncate dd/ffe 809529 0 2024-09-13T02:54:21.725 INFO:tasks.workunit.client.1.smithi131.stdout:1/942: rename dd/d33/d42/c10e to dd/d26/d7d/d11b/c158 0 2024-09-13T02:54:21.726 INFO:tasks.workunit.client.1.smithi131.stdout:1/943: chown dd/d26/l2b 29033 1 2024-09-13T02:54:21.726 INFO:tasks.workunit.client.1.smithi131.stdout:5/732: dread d1/d29/f8d [0,4194304] 0 2024-09-13T02:54:21.726 INFO:tasks.workunit.client.1.smithi131.stdout:5/733: dread - d1/d1c/fdd zero size 2024-09-13T02:54:21.727 INFO:tasks.workunit.client.1.smithi131.stdout:5/734: read d1/d1c/d8e/f95 [198755,20273] 0 2024-09-13T02:54:21.737 INFO:tasks.workunit.client.1.smithi131.stdout:5/735: dread d1/d21/d74/f80 [0,4194304] 0 2024-09-13T02:54:21.737 INFO:tasks.workunit.client.1.smithi131.stdout:5/736: write d1/d5/dcd/fd9 [32770,91065] 0 2024-09-13T02:54:21.738 INFO:tasks.workunit.client.1.smithi131.stdout:5/737: creat d1/d21/d74/d78/d98/dc9/ff7 x:0 0 0 2024-09-13T02:54:21.739 INFO:tasks.workunit.client.1.smithi131.stdout:5/738: mkdir d1/d21/d90/df8 0 2024-09-13T02:54:21.740 INFO:tasks.workunit.client.1.smithi131.stdout:1/944: dwrite dd/d26/f50 [0,4194304] 0 2024-09-13T02:54:21.741 INFO:tasks.workunit.client.1.smithi131.stdout:1/945: creat dd/d33/d94/f159 x:0 0 0 2024-09-13T02:54:21.741 INFO:tasks.workunit.client.1.smithi131.stdout:1/946: chown dd/d51/d8a/d148 270861 1 2024-09-13T02:54:21.744 INFO:tasks.workunit.client.1.smithi131.stdout:5/739: write d1/d21/d74/d78/d98/ded/f92 [1675067,38655] 0 2024-09-13T02:54:21.759 INFO:tasks.workunit.client.1.smithi131.stdout:5/740: dread d1/d21/d74/faf [0,4194304] 0 2024-09-13T02:54:21.759 INFO:tasks.workunit.client.1.smithi131.stdout:1/947: dwrite dd/d33/f6a [0,4194304] 0 2024-09-13T02:54:21.760 INFO:tasks.workunit.client.1.smithi131.stdout:1/948: symlink dd/d33/d94/d122/l15a 0 2024-09-13T02:54:21.760 INFO:tasks.workunit.client.1.smithi131.stdout:1/949: truncate dd/d51/d5a/f103 175378 0 2024-09-13T02:54:21.767 INFO:tasks.workunit.client.1.smithi131.stdout:1/950: rmdir dd/d33/d94 39 2024-09-13T02:54:21.767 INFO:tasks.workunit.client.1.smithi131.stdout:1/951: truncate dd/d26/d2a/d69/d14f/f156 762405 0 2024-09-13T02:54:21.767 INFO:tasks.workunit.client.1.smithi131.stdout:1/952: truncate dd/d33/d80/f8b 699070 0 2024-09-13T02:54:21.767 INFO:tasks.workunit.client.1.smithi131.stdout:1/953: creat dd/d26/d2a/d2c/d4b/f15b x:0 0 0 2024-09-13T02:54:21.767 INFO:tasks.workunit.client.1.smithi131.stdout:1/954: write dd/d26/d2a/d2c/d4b/f132 [913263,67854] 0 2024-09-13T02:54:21.767 INFO:tasks.workunit.client.1.smithi131.stdout:1/955: dread - dd/dc2/f154 zero size 2024-09-13T02:54:21.768 INFO:tasks.workunit.client.1.smithi131.stdout:5/741: dread d1/d21/d74/d78/d98/ded/f92 [0,4194304] 0 2024-09-13T02:54:21.771 INFO:tasks.workunit.client.1.smithi131.stdout:5/742: link d1/d5/c8 d1/d2f/cf9 0 2024-09-13T02:54:21.800 INFO:tasks.workunit.client.1.smithi131.stdout:4/901: sync 2024-09-13T02:54:21.800 INFO:tasks.workunit.client.1.smithi131.stdout:9/833: sync 2024-09-13T02:54:21.800 INFO:tasks.workunit.client.1.smithi131.stdout:4/902: chown d1/d18/d43/d65/dc7 175971623 1 2024-09-13T02:54:21.800 INFO:tasks.workunit.client.1.smithi131.stdout:4/903: fdatasync d1/d18/d43/d65/dbd/dc1/d13/f57 0 2024-09-13T02:54:21.801 INFO:tasks.workunit.client.1.smithi131.stdout:4/904: truncate d1/d18/d43/d97/dba/f31 8345123 0 2024-09-13T02:54:21.801 INFO:tasks.workunit.client.1.smithi131.stdout:4/905: stat d1/d18/d43/d97/dba/d22/d73/fcd 0 2024-09-13T02:54:21.801 INFO:tasks.workunit.client.1.smithi131.stdout:4/906: mkdir d1/d18/d43/d65/dbd/dc1/d13/d136 0 2024-09-13T02:54:21.802 INFO:tasks.workunit.client.1.smithi131.stdout:4/907: unlink d1/d18/d43/d65/dbd/dc1/f10e 0 2024-09-13T02:54:21.803 INFO:tasks.workunit.client.1.smithi131.stdout:4/908: rmdir d1/dbe 39 2024-09-13T02:54:21.807 INFO:tasks.workunit.client.1.smithi131.stdout:9/834: read d0/f11 [2858355,86872] 0 2024-09-13T02:54:21.807 INFO:tasks.workunit.client.1.smithi131.stdout:9/835: rmdir d0/d4d/d55/d76/d96/d118/d14/d67 39 2024-09-13T02:54:21.809 INFO:tasks.workunit.client.1.smithi131.stdout:9/836: link d0/l1c d0/d4d/d55/d76/d96/d118/d14/d1a/d2a/d75/l11f 0 2024-09-13T02:54:21.810 INFO:tasks.workunit.client.1.smithi131.stdout:9/837: fsync d0/d4d/f68 0 2024-09-13T02:54:21.810 INFO:tasks.workunit.client.1.smithi131.stdout:9/838: chown d0/d4d/d55/d76/d96/d118/d14/d17/d107 17736499 1 2024-09-13T02:54:21.810 INFO:tasks.workunit.client.1.smithi131.stdout:9/839: chown d0/d4d/d98/dbb/ldb 347017 1 2024-09-13T02:54:21.813 INFO:tasks.workunit.client.1.smithi131.stdout:9/840: link d0/d4d/d55/d76/d96/d118/d14/d1a/d2a/d5e/da2/f99 d0/d4d/d55/d76/d96/d118/d14/d1a/d2a/d5e/da2/d39/dae/db6/f120 0 2024-09-13T02:54:21.816 INFO:tasks.workunit.client.1.smithi131.stdout:9/841: creat d0/d4d/d55/d76/d96/d118/d14/d1a/dc6/d70/f121 x:0 0 0 2024-09-13T02:54:21.818 INFO:tasks.workunit.client.1.smithi131.stdout:4/909: dwrite d1/d18/d34/fbb [0,4194304] 0 2024-09-13T02:54:21.822 INFO:tasks.workunit.client.1.smithi131.stdout:4/910: unlink d1/d18/d43/d65/dbd/dc1/c52 0 2024-09-13T02:54:21.822 INFO:tasks.workunit.client.1.smithi131.stdout:4/911: dread - d1/d18/d43/d97/dba/d22/d73/f7b zero size 2024-09-13T02:54:21.823 INFO:tasks.workunit.client.1.smithi131.stdout:4/912: mknod d1/d18/d43/d97/dba/c137 0 2024-09-13T02:54:21.824 INFO:tasks.workunit.client.1.smithi131.stdout:4/913: chown d1/d18/d43/d65/dbd/dc1/c12a 2527212 1 2024-09-13T02:54:21.826 INFO:tasks.workunit.client.1.smithi131.stdout:9/842: rename d0/d4d/d55/d76/d96/d118/d14/d1a to d0/d4d/d55/d76/d96/d118/d14/dbf/d122 0 2024-09-13T02:54:21.827 INFO:tasks.workunit.client.1.smithi131.stdout:4/914: rename d1/d18/d43/d97/dba/c137 to d1/d18/d34/d4e/d108/d8d/c138 0 2024-09-13T02:54:21.828 INFO:tasks.workunit.client.1.smithi131.stdout:9/843: creat d0/d4d/d55/d76/d96/d118/d14/d17/db0/f123 x:0 0 0 2024-09-13T02:54:21.829 INFO:tasks.workunit.client.1.smithi131.stdout:4/915: mkdir d1/d18/d43/d65/dbd/d139 0 2024-09-13T02:54:21.831 INFO:tasks.workunit.client.1.smithi131.stdout:4/916: rename d1/d18/d43/d97/dba/d22/f69 to d1/d18/d34/d4e/d108/d8d/d115/f13a 0 2024-09-13T02:54:21.837 INFO:tasks.workunit.client.1.smithi131.stdout:9/844: write d0/d4d/d55/d76/d96/d118/d14/dbf/d122/d2a/f4e [2001547,4504] 0 2024-09-13T02:54:21.839 INFO:tasks.workunit.client.1.smithi131.stdout:9/845: unlink d0/d4d/d55/d76/d96/d118/d14/d17/l6b 0 2024-09-13T02:54:21.840 INFO:tasks.workunit.client.1.smithi131.stdout:9/846: truncate d0/d4d/f6d 3480773 0 2024-09-13T02:54:21.842 INFO:tasks.workunit.client.1.smithi131.stdout:9/847: link d0/d4d/d55/d76/d96/d118/d14/dbf/d122/d2a/d5e/fd1 d0/d4d/d55/d76/d96/d118/d14/dbf/d122/d2a/d5e/df7/f124 0 2024-09-13T02:54:21.842 INFO:tasks.workunit.client.1.smithi131.stdout:9/848: fsync d0/d4d/d55/d76/d96/d118/ff9 0 2024-09-13T02:54:21.847 INFO:tasks.workunit.client.1.smithi131.stdout:4/917: dwrite d1/d18/d43/d97/dba/d22/f11f [0,4194304] 0 2024-09-13T02:54:21.851 INFO:tasks.workunit.client.1.smithi131.stdout:4/918: dread d1/d18/d43/d7d/f92 [0,4194304] 0 2024-09-13T02:54:21.853 INFO:tasks.workunit.client.1.smithi131.stdout:4/919: rmdir d1/d18/d43/d97/dba/d22/d49 39 2024-09-13T02:54:21.854 INFO:tasks.workunit.client.1.smithi131.stdout:4/920: mkdir d1/d18/d43/d97/dba/d7a/d13b 0 2024-09-13T02:54:21.854 INFO:tasks.workunit.client.1.smithi131.stdout:4/921: stat d1/d18/d43/d65/dbd/dc1/d13/d136 0 2024-09-13T02:54:21.854 INFO:tasks.workunit.client.1.smithi131.stdout:4/922: mkdir d1/d18/d43/d65/dbd/dc1/d13/d13c 0 2024-09-13T02:54:21.854 INFO:tasks.workunit.client.1.smithi131.stdout:4/923: stat d1/d18/d43/d65/dbd/dc1/d13/f103 0 2024-09-13T02:54:21.857 INFO:tasks.workunit.client.1.smithi131.stdout:9/849: dwrite d0/d4d/de3/fe9 [0,4194304] 0 2024-09-13T02:54:21.864 INFO:tasks.workunit.client.1.smithi131.stdout:9/850: dread d0/d4d/d55/d76/d96/d118/d14/dbf/d122/f23 [0,4194304] 0 2024-09-13T02:54:21.864 INFO:tasks.workunit.client.1.smithi131.stdout:9/851: readlink d0/d4d/d55/d76/d96/d118/d14/l54 0 2024-09-13T02:54:21.866 INFO:tasks.workunit.client.1.smithi131.stdout:9/852: rename d0/d4d/d55/d76/d96/d118/d14/dbf/d122/d2a/d5e/f80 to d0/d4d/d55/d76/d96/d118/d14/d17/d107/f125 0 2024-09-13T02:54:21.867 INFO:tasks.workunit.client.1.smithi131.stdout:9/853: read d0/d4d/d55/d76/d96/d118/d14/dbf/d122/d2a/f4e [4409817,53601] 0 2024-09-13T02:54:21.868 INFO:tasks.workunit.client.1.smithi131.stdout:9/854: unlink d0/d4d/d55/d76/d96/d118/d14/d17/c2f 0 2024-09-13T02:54:21.868 INFO:tasks.workunit.client.1.smithi131.stdout:9/855: chown d0/d4d/d55/d76/d96/d118/d14/dbf/d122/dc6/ce1 25550 1 2024-09-13T02:54:21.868 INFO:tasks.workunit.client.1.smithi131.stdout:9/856: truncate d0/d4d/d55/d76/d96/d118/d14/d17/d107/f125 906428 0 2024-09-13T02:54:21.869 INFO:tasks.workunit.client.1.smithi131.stdout:9/857: truncate d0/d4d/d55/d76/d96/d118/d14/d17/db0/f123 703744 0 2024-09-13T02:54:21.869 INFO:tasks.workunit.client.1.smithi131.stdout:9/858: symlink d0/d4d/d55/d76/d96/d118/d14/dbf/d122/d2a/d5e/da2/d39/dc2/l126 0 2024-09-13T02:54:21.870 INFO:tasks.workunit.client.1.smithi131.stdout:9/859: creat d0/d4d/d55/d76/d96/d118/d14/d67/dc0/f127 x:0 0 0 2024-09-13T02:54:21.870 INFO:tasks.workunit.client.1.smithi131.stdout:9/860: write d0/d4d/d55/d76/d96/d118/d14/f6f [36885,18000] 0 2024-09-13T02:54:21.871 INFO:tasks.workunit.client.1.smithi131.stdout:9/861: mkdir d0/d4d/d55/d76/d96/d118/d14/dbf/d122/d2a/d5e/d128 0 2024-09-13T02:54:21.872 INFO:tasks.workunit.client.1.smithi131.stdout:9/862: symlink d0/d4d/d55/d76/d96/d118/d14/d67/dc0/de7/l129 0 2024-09-13T02:54:21.872 INFO:tasks.workunit.client.1.smithi131.stdout:9/863: stat d0/d4d 0 2024-09-13T02:54:21.873 INFO:tasks.workunit.client.1.smithi131.stdout:9/864: dread - d0/d4d/d55/d76/d96/d118/d14/dbf/d122/d2a/d5e/da2/d39/fd9 zero size 2024-09-13T02:54:21.874 INFO:tasks.workunit.client.1.smithi131.stdout:9/865: symlink d0/d4d/d55/d76/d96/d118/d14/dbf/d122/d2a/d5e/da2/d39/dbe/l12a 0 2024-09-13T02:54:21.875 INFO:tasks.workunit.client.1.smithi131.stdout:9/866: creat d0/d4d/d55/d76/d96/d118/d14/dbf/d122/d2a/d75/f12b x:0 0 0 2024-09-13T02:54:21.894 INFO:tasks.workunit.client.1.smithi131.stdout:9/867: dwrite d0/d4d/d55/d76/d96/d118/d14/dbf/d122/dc6/f93 [4194304,4194304] 0 2024-09-13T02:54:21.894 INFO:tasks.workunit.client.1.smithi131.stdout:9/868: chown d0/d4d/d55/d76/d96/d118/d14/dbf/d122/dc6/d70 77421132 1 2024-09-13T02:54:21.919 INFO:tasks.workunit.client.1.smithi131.stdout:9/869: dwrite d0/fdc [0,4194304] 0 2024-09-13T02:54:21.934 INFO:tasks.workunit.client.1.smithi131.stdout:9/870: dwrite d0/dfb/f11b [0,4194304] 0 2024-09-13T02:54:21.935 INFO:tasks.workunit.client.1.smithi131.stdout:9/871: mkdir d0/d4d/d55/d76/d96/d118/d12c 0 2024-09-13T02:54:21.936 INFO:tasks.workunit.client.1.smithi131.stdout:9/872: mkdir d0/d4d/d55/d76/d96/d118/d14/dbf/d122/d2a/df0/d12d 0 2024-09-13T02:54:21.951 INFO:tasks.workunit.client.1.smithi131.stdout:9/873: dwrite d0/f63 [0,4194304] 0 2024-09-13T02:54:21.953 INFO:tasks.workunit.client.1.smithi131.stdout:9/874: rename d0/d4d/d55/d76/d96/d118/d14/dbf/d122/d2a/d5e/da2/d39/f9e to d0/d4d/d55/d76/d96/d118/d12c/f12e 0 2024-09-13T02:54:21.954 INFO:tasks.workunit.client.1.smithi131.stdout:9/875: rename d0/d4d/d55/d76/d96/d118/d14/l2d to d0/d4d/d55/d76/d96/d118/d14/d17/db0/l12f 0 2024-09-13T02:54:21.954 INFO:tasks.workunit.client.1.smithi131.stdout:9/876: mkdir d0/d4d/d55/d76/d96/d118/d14/d67/dc0/d130 0 2024-09-13T02:54:21.956 INFO:tasks.workunit.client.1.smithi131.stdout:9/877: fdatasync d0/d4d/d55/d76/d96/d118/d14/f6f 0 2024-09-13T02:54:21.957 INFO:tasks.workunit.client.1.smithi131.stdout:9/878: read d0/d4d/d55/d76/d96/d118/d14/dbf/d122/dbc/ff2 [499937,65746] 0 2024-09-13T02:54:21.957 INFO:tasks.workunit.client.1.smithi131.stdout:9/879: write d0/fc5 [867015,55584] 0 2024-09-13T02:54:21.957 INFO:tasks.workunit.client.1.smithi131.stdout:9/880: dread - d0/d4d/d55/d76/d96/d118/d14/dbf/d122/d2a/d5e/df7/f124 zero size 2024-09-13T02:54:21.968 INFO:tasks.workunit.client.1.smithi131.stdout:2/851: sync 2024-09-13T02:54:21.968 INFO:tasks.workunit.client.1.smithi131.stdout:8/983: sync 2024-09-13T02:54:21.968 INFO:tasks.workunit.client.1.smithi131.stdout:0/934: sync 2024-09-13T02:54:21.968 INFO:tasks.workunit.client.1.smithi131.stdout:8/984: dread - db/d1d/d1f/d66/d130/dea/f120 zero size 2024-09-13T02:54:21.968 INFO:tasks.workunit.client.1.smithi131.stdout:8/985: creat db/d1d/d1f/f131 x:0 0 0 2024-09-13T02:54:21.968 INFO:tasks.workunit.client.1.smithi131.stdout:0/935: chown d0/de/f59 12358020 1 2024-09-13T02:54:21.968 INFO:tasks.workunit.client.1.smithi131.stdout:0/936: creat d0/de/d1f/d22/d31/d39/d67/db5/f144 x:0 0 0 2024-09-13T02:54:21.969 INFO:tasks.workunit.client.1.smithi131.stdout:8/986: mknod db/d1d/d34/d4e/d7e/dc4/d102/d126/c132 0 2024-09-13T02:54:21.978 INFO:tasks.workunit.client.1.smithi131.stdout:0/937: write d0/de/d1f/d22/f139 [989913,122660] 0 2024-09-13T02:54:21.978 INFO:tasks.workunit.client.1.smithi131.stdout:2/852: write d5/f9 [1919394,16069] 0 2024-09-13T02:54:21.979 INFO:tasks.workunit.client.1.smithi131.stdout:0/938: getdents d0/de/d1f 0 2024-09-13T02:54:21.979 INFO:tasks.workunit.client.1.smithi131.stdout:0/939: creat d0/de/d1f/d22/d31/d39/da8/d103/f145 x:0 0 0 2024-09-13T02:54:21.980 INFO:tasks.workunit.client.1.smithi131.stdout:2/853: stat d5/d31/d1d/d37/d112/d114/db4/dbc/d48/d4c/ccb 0 2024-09-13T02:54:21.981 INFO:tasks.workunit.client.1.smithi131.stdout:8/987: dread db/d2b/d39/fa2 [0,4194304] 0 2024-09-13T02:54:21.981 INFO:tasks.workunit.client.1.smithi131.stdout:2/854: rmdir d5/d31/d1d/d37/d112/d114/db4/dbc/ddf/d11a 0 2024-09-13T02:54:21.983 INFO:tasks.workunit.client.1.smithi131.stdout:2/855: mknod d5/d31/d1d/d37/d112/d114/db4/dbc/ddf/c12c 0 2024-09-13T02:54:21.984 INFO:tasks.workunit.client.1.smithi131.stdout:2/856: rename d5/d31/d1d/d50/d121 to d5/d31/d1d/d50/d12d 0 2024-09-13T02:54:21.984 INFO:tasks.workunit.client.1.smithi131.stdout:2/857: mknod d5/d31/d4e/d78/c12e 0 2024-09-13T02:54:21.985 INFO:tasks.workunit.client.1.smithi131.stdout:2/858: rmdir d5/d31/d4e/d76 39 2024-09-13T02:54:21.986 INFO:tasks.workunit.client.1.smithi131.stdout:2/859: link d5/d31/d26/f59 d5/d34/f12f 0 2024-09-13T02:54:21.986 INFO:tasks.workunit.client.1.smithi131.stdout:2/860: chown d5/d31/c3f 120258 1 2024-09-13T02:54:21.989 INFO:tasks.workunit.client.1.smithi131.stdout:0/940: dread d0/de/d1f/d22/d3d/d55/d63/dd2/f11d [0,4194304] 0 2024-09-13T02:54:21.992 INFO:tasks.workunit.client.1.smithi131.stdout:8/988: dread db/d1d/d1f/f2c [4194304,4194304] 0 2024-09-13T02:54:21.992 INFO:tasks.workunit.client.1.smithi131.stdout:8/989: fdatasync db/d1d/d1f/d5c/f104 0 2024-09-13T02:54:21.992 INFO:tasks.workunit.client.1.smithi131.stdout:8/990: readlink db/d1d/d34/d4e/lfe 0 2024-09-13T02:54:21.995 INFO:tasks.workunit.client.1.smithi131.stdout:8/991: rename db/d1d/d34/d4e/f92 to db/f133 0 2024-09-13T02:54:21.995 INFO:tasks.workunit.client.1.smithi131.stdout:8/992: readlink db/d89/d106/d50/lba 0 2024-09-13T02:54:21.997 INFO:tasks.workunit.client.1.smithi131.stdout:0/941: getdents d0/de/d1f/d22/d3d/d55/d63/dd2 0 2024-09-13T02:54:21.997 INFO:tasks.workunit.client.1.smithi131.stdout:0/942: getdents d0/de/d1f/d22/d31/d137 0 2024-09-13T02:54:21.998 INFO:tasks.workunit.client.1.smithi131.stdout:8/993: mkdir db/d1d/d1f/d5c/d122/d134 0 2024-09-13T02:54:21.999 INFO:tasks.workunit.client.1.smithi131.stdout:8/994: chown db/d1d/d34/d4e/d7e/dc4/fda 250084 1 2024-09-13T02:54:22.000 INFO:tasks.workunit.client.1.smithi131.stdout:8/995: mknod db/d1d/c135 0 2024-09-13T02:54:22.000 INFO:tasks.workunit.client.1.smithi131.stdout:8/996: truncate db/d1d/d1f/d66/d130/dea/f120 345539 0 2024-09-13T02:54:22.000 INFO:tasks.workunit.client.1.smithi131.stdout:8/997: creat db/d1d/d1f/d67/f136 x:0 0 0 2024-09-13T02:54:22.002 INFO:tasks.workunit.client.1.smithi131.stdout:8/998: rename db/d2b/d39/c12f to db/d1d/d1f/c137 0 2024-09-13T02:54:22.003 INFO:tasks.workunit.client.1.smithi131.stdout:8/999: unlink db/d1d/d34/d4e/d7e/f83 0 2024-09-13T02:54:22.006 INFO:tasks.workunit.client.1.smithi131.stdout:2/861: dwrite d5/d18/d68/de3/d41/f93 [0,4194304] 0 2024-09-13T02:54:22.007 INFO:tasks.workunit.client.1.smithi131.stdout:0/943: write d0/de/d1f/d22/d3d/d43/d4b/f121 [2769407,104022] 0 2024-09-13T02:54:22.008 INFO:tasks.workunit.client.1.smithi131.stdout:2/862: getdents d5/d31/d21/d57 0 2024-09-13T02:54:22.009 INFO:tasks.workunit.client.1.smithi131.stdout:0/944: symlink d0/de/d1f/d22/d3d/d55/d63/dd2/l146 0 2024-09-13T02:54:22.009 INFO:tasks.workunit.client.1.smithi131.stdout:0/945: creat d0/de/d1f/d22/d31/d39/d67/db5/d113/f147 x:0 0 0 2024-09-13T02:54:22.017 INFO:tasks.workunit.client.1.smithi131.stdout:2/863: dread d5/d18/d4b/f40 [0,4194304] 0 2024-09-13T02:54:22.017 INFO:tasks.workunit.client.1.smithi131.stdout:2/864: write d5/d18/f1b [1746402,44998] 0 2024-09-13T02:54:22.018 INFO:tasks.workunit.client.1.smithi131.stdout:2/865: stat d5/d31/d1d/d37/d112/d114/db4/dbc/d48/l119 0 2024-09-13T02:54:22.020 INFO:tasks.workunit.client.1.smithi131.stdout:2/866: rename d5/d18/c43 to d5/c130 0 2024-09-13T02:54:22.021 INFO:tasks.workunit.client.1.smithi131.stdout:2/867: creat d5/d34/d118/f131 x:0 0 0 2024-09-13T02:54:22.021 INFO:tasks.workunit.client.1.smithi131.stdout:0/946: dread d0/de/d1f/d22/d3d/d55/d63/f10c [0,4194304] 0 2024-09-13T02:54:22.022 INFO:tasks.workunit.client.1.smithi131.stdout:0/947: fdatasync d0/d2/d62/f122 0 2024-09-13T02:54:22.022 INFO:tasks.workunit.client.1.smithi131.stdout:2/868: mkdir d5/d18/d68/de3/d41/d132 0 2024-09-13T02:54:22.022 INFO:tasks.workunit.client.1.smithi131.stdout:2/869: readlink d5/d31/d1d/l1f 0 2024-09-13T02:54:22.022 INFO:tasks.workunit.client.1.smithi131.stdout:0/948: creat d0/de/d1f/d22/d31/d39/da8/d107/f148 x:0 0 0 2024-09-13T02:54:22.024 INFO:tasks.workunit.client.1.smithi131.stdout:0/949: dread d0/d2/d62/f8f [0,4194304] 0 2024-09-13T02:54:22.024 INFO:tasks.workunit.client.1.smithi131.stdout:0/950: truncate d0/de/d1f/d22/d31/d39/ff1 701850 0 2024-09-13T02:54:22.024 INFO:tasks.workunit.client.1.smithi131.stdout:0/951: creat d0/de/d1f/d22/d31/d39/da8/f149 x:0 0 0 2024-09-13T02:54:22.029 INFO:tasks.workunit.client.1.smithi131.stdout:0/952: mkdir d0/de/d1f/d22/d3d/d55/dfd/d14a 0 2024-09-13T02:54:22.029 INFO:tasks.workunit.client.1.smithi131.stdout:0/953: mknod d0/de/d45/dfa/d119/d135/c14b 0 2024-09-13T02:54:22.029 INFO:tasks.workunit.client.1.smithi131.stdout:0/954: getdents d0/de 0 2024-09-13T02:54:22.029 INFO:tasks.workunit.client.1.smithi131.stdout:0/955: readlink d0/l27 0 2024-09-13T02:54:22.029 INFO:tasks.workunit.client.1.smithi131.stdout:0/956: creat d0/de/d1f/d22/d3d/d80/f14c x:0 0 0 2024-09-13T02:54:22.029 INFO:tasks.workunit.client.1.smithi131.stdout:0/957: dread - d0/de/d1f/d22/d3d/d80/f14c zero size 2024-09-13T02:54:22.029 INFO:tasks.workunit.client.1.smithi131.stdout:0/958: symlink d0/de/d1f/d22/d3d/d43/dc2/dd3/l14d 0 2024-09-13T02:54:22.031 INFO:tasks.workunit.client.1.smithi131.stdout:0/959: creat d0/de/d1f/d22/d31/d39/f14e x:0 0 0 2024-09-13T02:54:22.032 INFO:tasks.workunit.client.1.smithi131.stdout:0/960: mknod d0/de/d45/d78/c14f 0 2024-09-13T02:54:22.032 INFO:tasks.workunit.client.1.smithi131.stdout:0/961: chown d0/d2/d41/f131 235 1 2024-09-13T02:54:22.032 INFO:tasks.workunit.client.1.smithi131.stdout:0/962: write d0/de/d1f/d22/d3d/d43/dc2/dd3/ffb [215984,23981] 0 2024-09-13T02:54:22.037 INFO:tasks.workunit.client.1.smithi131.stdout:0/963: dread d0/d2/d62/f8e [0,4194304] 0 2024-09-13T02:54:22.037 INFO:tasks.workunit.client.1.smithi131.stdout:0/964: fsync d0/de/d1f/d22/fb2 0 2024-09-13T02:54:22.037 INFO:tasks.workunit.client.1.smithi131.stdout:0/965: link d0/de/d1f/d22/d31/d39/d67/db5/d113/f147 d0/de/d1f/d22/d31/d39/d40/d68/f150 0 2024-09-13T02:54:22.038 INFO:tasks.workunit.client.1.smithi131.stdout:0/966: dread d0/d2/d62/f8f [0,4194304] 0 2024-09-13T02:54:22.039 INFO:tasks.workunit.client.1.smithi131.stdout:0/967: getdents d0/de 0 2024-09-13T02:54:22.039 INFO:tasks.workunit.client.1.smithi131.stdout:2/870: dwrite d5/d31/d26/d8d/f123 [0,4194304] 0 2024-09-13T02:54:22.041 INFO:tasks.workunit.client.1.smithi131.stdout:2/871: rename d5/d31/d1d/d32/d3b/d67/cb7 to d5/d31/d21/d57/d90/dc8/c133 0 2024-09-13T02:54:22.041 INFO:tasks.workunit.client.1.smithi131.stdout:2/872: creat d5/d31/d1d/d32/d3b/d67/f134 x:0 0 0 2024-09-13T02:54:22.043 INFO:tasks.workunit.client.1.smithi131.stdout:2/873: symlink d5/d6e/l135 0 2024-09-13T02:54:22.049 INFO:tasks.workunit.client.1.smithi131.stdout:0/968: write d0/de/d1f/d22/d31/d39/d40/f140 [2193701,46417] 0 2024-09-13T02:54:22.058 INFO:tasks.workunit.client.1.smithi131.stdout:0/969: dread d0/de/d1f/d22/d3d/d43/fd8 [0,4194304] 0 2024-09-13T02:54:22.058 INFO:tasks.workunit.client.1.smithi131.stdout:0/970: chown d0/de/d1f/d22/d31/l13d 1083800 1 2024-09-13T02:54:22.058 INFO:tasks.workunit.client.1.smithi131.stdout:0/971: dread - d0/de/d1f/d22/d31/d39/d40/f13b zero size 2024-09-13T02:54:22.075 INFO:tasks.workunit.client.1.smithi131.stdout:0/972: dwrite d0/d2/d41/f79 [0,4194304] 0 2024-09-13T02:54:22.076 INFO:tasks.workunit.client.1.smithi131.stdout:0/973: creat d0/de/d45/dfa/d119/d135/f151 x:0 0 0 2024-09-13T02:54:22.077 INFO:tasks.workunit.client.1.smithi131.stdout:0/974: mknod d0/de/c152 0 2024-09-13T02:54:22.132 INFO:tasks.workunit.client.1.smithi131.stdout:3/706: sync 2024-09-13T02:54:22.132 INFO:tasks.workunit.client.1.smithi131.stdout:7/745: sync 2024-09-13T02:54:22.134 INFO:tasks.workunit.client.1.smithi131.stdout:7/746: mkdir d1b/d3b/d31/d7c/db7/df7 0 2024-09-13T02:54:22.154 INFO:tasks.workunit.client.1.smithi131.stdout:3/707: dwrite d2/d4/d7/d1d/d24/f58 [0,4194304] 0 2024-09-13T02:54:22.154 INFO:tasks.workunit.client.1.smithi131.stdout:7/747: dwrite d1b/d3b/f55 [0,4194304] 0 2024-09-13T02:54:22.155 INFO:tasks.workunit.client.1.smithi131.stdout:3/708: creat d2/d4/d7/d1d/d24/d6f/d7f/ff0 x:0 0 0 2024-09-13T02:54:22.156 INFO:tasks.workunit.client.1.smithi131.stdout:3/709: rmdir d2/d4/d2d 39 2024-09-13T02:54:22.157 INFO:tasks.workunit.client.1.smithi131.stdout:3/710: write d2/d4/f5d [2579443,37582] 0 2024-09-13T02:54:22.157 INFO:tasks.workunit.client.1.smithi131.stdout:3/711: readlink d2/d4/db7/lba 0 2024-09-13T02:54:22.165 INFO:tasks.workunit.client.1.smithi131.stdout:3/712: dread d2/dc/f1b [0,4194304] 0 2024-09-13T02:54:22.166 INFO:tasks.workunit.client.1.smithi131.stdout:3/713: truncate d2/d4/d7/fd3 53402 0 2024-09-13T02:54:22.166 INFO:tasks.workunit.client.1.smithi131.stdout:3/714: read - d2/d4/d76/d9f/d41/d6e/fc0 zero size 2024-09-13T02:54:22.167 INFO:tasks.workunit.client.1.smithi131.stdout:3/715: mkdir d2/d4/d76/d9f/db9/de5/df1 0 2024-09-13T02:54:22.167 INFO:tasks.workunit.client.1.smithi131.stdout:3/716: write d2/d4/d7/d1d/d24/d6f/f70 [1387385,58872] 0 2024-09-13T02:54:22.168 INFO:tasks.workunit.client.1.smithi131.stdout:3/717: creat d2/d4/d76/dc1/ff2 x:0 0 0 2024-09-13T02:54:22.169 INFO:tasks.workunit.client.1.smithi131.stdout:3/718: symlink d2/d4/d76/d9f/lf3 0 2024-09-13T02:54:22.169 INFO:tasks.workunit.client.1.smithi131.stdout:3/719: chown d2/dc/d39/f72 2782 1 2024-09-13T02:54:22.170 INFO:tasks.workunit.client.1.smithi131.stdout:3/720: creat d2/d4/d76/d9f/d41/d5c/d71/ff4 x:0 0 0 2024-09-13T02:54:22.170 INFO:tasks.workunit.client.1.smithi131.stdout:7/748: dwrite d1b/d3b/d51/d62/d9e/da2/fb3 [0,4194304] 0 2024-09-13T02:54:22.171 INFO:tasks.workunit.client.1.smithi131.stdout:3/721: rename d2/d4/d76/d9f/d41/d6e to d2/d4/d7/d1d/d24/d6f/df5 0 2024-09-13T02:54:22.180 INFO:tasks.workunit.client.1.smithi131.stdout:3/722: dread d2/d4/d1a/d31/d48/fc9 [0,4194304] 0 2024-09-13T02:54:22.181 INFO:tasks.workunit.client.1.smithi131.stdout:3/723: creat d2/d4/d7/d1d/d24/ff6 x:0 0 0 2024-09-13T02:54:22.182 INFO:tasks.workunit.client.1.smithi131.stdout:7/749: write d1b/d3b/f6b [2111627,70542] 0 2024-09-13T02:54:22.183 INFO:tasks.workunit.client.1.smithi131.stdout:3/724: rename d2/dc/db1/lc2 to d2/d4/d7/d1d/de8/lf7 0 2024-09-13T02:54:22.185 INFO:tasks.workunit.client.1.smithi131.stdout:3/725: unlink d2/d4/d76/d9f/d41/d5c/d4f/l7d 0 2024-09-13T02:54:22.185 INFO:tasks.workunit.client.1.smithi131.stdout:3/726: truncate d2/d4/d7/d1d/d80/dde/fbc 106677 0 2024-09-13T02:54:22.187 INFO:tasks.workunit.client.1.smithi131.stdout:3/727: link d2/dc/c46 d2/d4/db7/dda/cf8 0 2024-09-13T02:54:22.187 INFO:tasks.workunit.client.1.smithi131.stdout:3/728: dread - d2/dc/fa8 zero size 2024-09-13T02:54:22.187 INFO:tasks.workunit.client.1.smithi131.stdout:3/729: chown d2/d4/d7/d1d/f2c 1 1 2024-09-13T02:54:22.187 INFO:tasks.workunit.client.1.smithi131.stdout:3/730: chown d2/dc/d39/d61/f6c 12 1 2024-09-13T02:54:22.191 INFO:tasks.workunit.client.1.smithi131.stdout:7/750: dread d1b/d3b/d31/d5f/f7e [0,4194304] 0 2024-09-13T02:54:22.193 INFO:tasks.workunit.client.1.smithi131.stdout:7/751: mknod d1b/d3b/d51/d62/d9e/da2/cf8 0 2024-09-13T02:54:22.193 INFO:tasks.workunit.client.1.smithi131.stdout:7/752: chown d1b/d23/f2d 5 1 2024-09-13T02:54:22.193 INFO:tasks.workunit.client.1.smithi131.stdout:7/753: mkdir d1b/d3b/d31/d7c/df9 0 2024-09-13T02:54:22.194 INFO:tasks.workunit.client.1.smithi131.stdout:7/754: creat d1b/d3b/d51/d8f/ffa x:0 0 0 2024-09-13T02:54:22.204 INFO:tasks.workunit.client.1.smithi131.stdout:7/755: dread d1b/d3b/d31/d5f/f79 [0,4194304] 0 2024-09-13T02:54:22.206 INFO:tasks.workunit.client.1.smithi131.stdout:3/731: dwrite d2/d4/d76/d9f/d41/d5c/d4f/fdd [0,4194304] 0 2024-09-13T02:54:22.206 INFO:tasks.workunit.client.1.smithi131.stdout:7/756: mkdir d1b/d3b/d31/d7c/df9/dfb 0 2024-09-13T02:54:22.206 INFO:tasks.workunit.client.1.smithi131.stdout:7/757: creat d1b/d3b/d51/d62/d6d/dac/ffc x:0 0 0 2024-09-13T02:54:22.207 INFO:tasks.workunit.client.1.smithi131.stdout:3/732: dread d2/d4/d76/d9f/d41/fa9 [0,4194304] 0 2024-09-13T02:54:22.208 INFO:tasks.workunit.client.1.smithi131.stdout:3/733: read d2/d4/d7/f53 [139763,63465] 0 2024-09-13T02:54:22.209 INFO:tasks.workunit.client.1.smithi131.stdout:7/758: getdents d1b/d23/d54 0 2024-09-13T02:54:22.209 INFO:tasks.workunit.client.1.smithi131.stdout:7/759: stat d1b/d3b/d31/d5f/la0 0 2024-09-13T02:54:22.220 INFO:tasks.workunit.client.1.smithi131.stdout:3/734: dread d2/d4/f84 [0,4194304] 0 2024-09-13T02:54:22.222 INFO:tasks.workunit.client.1.smithi131.stdout:3/735: unlink d2/dc/d39/f3d 0 2024-09-13T02:54:22.222 INFO:tasks.workunit.client.1.smithi131.stdout:7/760: read d1b/d23/d54/dc6/fc7 [82576,109874] 0 2024-09-13T02:54:22.222 INFO:tasks.workunit.client.1.smithi131.stdout:3/736: symlink d2/d4/d2d/dce/dc4/lf9 0 2024-09-13T02:54:22.223 INFO:tasks.workunit.client.1.smithi131.stdout:3/737: write d2/dc/faf [996448,98880] 0 2024-09-13T02:54:22.223 INFO:tasks.workunit.client.1.smithi131.stdout:3/738: getdents d2/d4 0 2024-09-13T02:54:22.224 INFO:tasks.workunit.client.1.smithi131.stdout:3/739: truncate d2/d4/d7/f4d 364405 0 2024-09-13T02:54:22.224 INFO:tasks.workunit.client.1.smithi131.stdout:3/740: write d2/dc/faf [1741299,123034] 0 2024-09-13T02:54:22.226 INFO:tasks.workunit.client.1.smithi131.stdout:7/761: write d1b/d3b/d51/fbe [2295079,123647] 0 2024-09-13T02:54:22.229 INFO:tasks.workunit.client.1.smithi131.stdout:3/741: write d2/d4/d1a/f8b [504928,94408] 0 2024-09-13T02:54:22.251 INFO:tasks.workunit.client.1.smithi131.stdout:7/762: dwrite d1b/d3b/d51/d62/d9e/da2/fa6 [0,4194304] 0 2024-09-13T02:54:22.253 INFO:tasks.workunit.client.1.smithi131.stdout:7/763: mknod d1b/d3b/d31/cfd 0 2024-09-13T02:54:22.253 INFO:tasks.workunit.client.1.smithi131.stdout:7/764: chown d1b/d3b/d31/d7c/db7/f59 0 1 2024-09-13T02:54:22.254 INFO:tasks.workunit.client.1.smithi131.stdout:3/742: dwrite d2/d4/d76/d9f/d41/d5c/f35 [0,4194304] 0 2024-09-13T02:54:22.254 INFO:tasks.workunit.client.1.smithi131.stdout:3/743: write d2/d4/d7/d1d/d80/fd7 [902108,126970] 0 2024-09-13T02:54:22.255 INFO:tasks.workunit.client.1.smithi131.stdout:7/765: creat d1b/d3b/d51/d62/d6d/da1/ffe x:0 0 0 2024-09-13T02:54:22.255 INFO:tasks.workunit.client.1.smithi131.stdout:7/766: write d1b/d3b/d46/d4b/d57/d7b/d92/dbb/fd7 [766202,118873] 0 2024-09-13T02:54:22.256 INFO:tasks.workunit.client.1.smithi131.stdout:7/767: dread - d1b/d3b/fb6 zero size 2024-09-13T02:54:22.257 INFO:tasks.workunit.client.1.smithi131.stdout:7/768: creat d1b/d3b/d31/fff x:0 0 0 2024-09-13T02:54:22.257 INFO:tasks.workunit.client.1.smithi131.stdout:7/769: chown d1b/d3b/d31/c58 114906 1 2024-09-13T02:54:22.261 INFO:tasks.workunit.client.1.smithi131.stdout:7/770: write d1b/d3b/d31/d5f/f79 [2455976,53661] 0 2024-09-13T02:54:22.263 INFO:tasks.workunit.client.1.smithi131.stdout:7/771: write d1b/d3b/d51/d62/d6d/fb8 [704635,93405] 0 2024-09-13T02:54:22.265 INFO:tasks.workunit.client.1.smithi131.stdout:7/772: symlink d1b/d3b/d46/d4b/l100 0 2024-09-13T02:54:22.267 INFO:tasks.workunit.client.1.smithi131.stdout:7/773: mknod d1b/d3b/d46/d4b/d57/d7b/d92/c101 0 2024-09-13T02:54:22.267 INFO:tasks.workunit.client.1.smithi131.stdout:7/774: fdatasync f10 0 2024-09-13T02:54:22.273 INFO:tasks.workunit.client.1.smithi131.stdout:3/744: dwrite d2/d4/f84 [4194304,4194304] 0 2024-09-13T02:54:22.275 INFO:tasks.workunit.client.1.smithi131.stdout:3/745: symlink d2/d4/d76/d9f/d41/d5c/d71/lfa 0 2024-09-13T02:54:22.275 INFO:tasks.workunit.client.1.smithi131.stdout:3/746: mkdir d2/dfb 0 2024-09-13T02:54:22.278 INFO:tasks.workunit.client.1.smithi131.stdout:7/775: write f3 [827267,31355] 0 2024-09-13T02:54:22.278 INFO:tasks.workunit.client.1.smithi131.stdout:7/776: write d1b/d3b/d51/fbe [3096138,51234] 0 2024-09-13T02:54:22.278 INFO:tasks.workunit.client.1.smithi131.stdout:7/777: fdatasync d1b/d3b/d31/d5f/f7e 0 2024-09-13T02:54:22.278 INFO:tasks.workunit.client.1.smithi131.stdout:7/778: readlink d1b/d3b/d51/led 0 2024-09-13T02:54:22.281 INFO:tasks.workunit.client.1.smithi131.stdout:7/779: rmdir d1b/d3b/d46/d4b/d57/d7b/d92 39 2024-09-13T02:54:22.290 INFO:tasks.workunit.client.1.smithi131.stdout:3/747: dwrite d2/d4/d7/d1d/d80/fd7 [0,4194304] 0 2024-09-13T02:54:22.297 INFO:tasks.workunit.client.1.smithi131.stdout:3/748: dread d2/d4/f34 [0,4194304] 0 2024-09-13T02:54:22.299 INFO:tasks.workunit.client.1.smithi131.stdout:3/749: creat d2/d4/d1a/d31/ffc x:0 0 0 2024-09-13T02:54:22.299 INFO:tasks.workunit.client.1.smithi131.stdout:3/750: fsync d2/d4/d1a/f66 0 2024-09-13T02:54:22.299 INFO:tasks.workunit.client.1.smithi131.stdout:3/751: truncate d2/d4/d7/fd3 799981 0 2024-09-13T02:54:22.299 INFO:tasks.workunit.client.1.smithi131.stdout:3/752: creat d2/d4/d1a/d31/d48/d69/ffd x:0 0 0 2024-09-13T02:54:22.299 INFO:tasks.workunit.client.1.smithi131.stdout:3/753: truncate d2/d4/d76/d9f/d41/d5c/f4e 864227 0 2024-09-13T02:54:22.300 INFO:tasks.workunit.client.1.smithi131.stdout:3/754: readlink d2/d4/d1a/leb 0 2024-09-13T02:54:22.300 INFO:tasks.workunit.client.1.smithi131.stdout:3/755: creat d2/d4/d7/d1d/db4/dcc/ffe x:0 0 0 2024-09-13T02:54:22.300 INFO:tasks.workunit.client.1.smithi131.stdout:3/756: fdatasync d2/d4/d7/d1d/d24/d6f/f70 0 2024-09-13T02:54:22.301 INFO:tasks.workunit.client.1.smithi131.stdout:3/757: link d2/d4/d76/c99 d2/d4/d2d/dce/dee/cff 0 2024-09-13T02:54:22.302 INFO:tasks.workunit.client.1.smithi131.stdout:3/758: symlink d2/dc/d39/d61/l100 0 2024-09-13T02:54:22.303 INFO:tasks.workunit.client.1.smithi131.stdout:3/759: rename d2/d4/d7/d1d/de8 to d2/d4/d76/d9f/db9/de5/d101 0 2024-09-13T02:54:22.303 INFO:tasks.workunit.client.1.smithi131.stdout:3/760: stat d2/d4/d1a/d31/da7/fd4 0 2024-09-13T02:54:22.304 INFO:tasks.workunit.client.1.smithi131.stdout:3/761: fdatasync d2/dc/d39/fa0 0 2024-09-13T02:54:22.313 INFO:tasks.workunit.client.1.smithi131.stdout:3/762: dread d2/dc/d39/d61/f87 [0,4194304] 0 2024-09-13T02:54:22.313 INFO:tasks.workunit.client.1.smithi131.stdout:7/780: dwrite d1b/d3b/d51/d62/d6d/fb8 [0,4194304] 0 2024-09-13T02:54:22.313 INFO:tasks.workunit.client.1.smithi131.stdout:7/781: stat d1b/d3b/d51/d62/d6d/db5 0 2024-09-13T02:54:22.314 INFO:tasks.workunit.client.1.smithi131.stdout:3/763: write d2/d4/d1a/d31/ffc [389996,72266] 0 2024-09-13T02:54:22.315 INFO:tasks.workunit.client.1.smithi131.stdout:7/782: rename d1b/d3b/d46/d4b/d57/d7b/l82 to d1b/d3b/d31/l102 0 2024-09-13T02:54:22.315 INFO:tasks.workunit.client.1.smithi131.stdout:3/764: creat d2/d4/d2d/f102 x:0 0 0 2024-09-13T02:54:22.316 INFO:tasks.workunit.client.1.smithi131.stdout:7/783: rename d1b/d23/d54/l68 to d1b/d3b/d31/d7c/db7/l103 0 2024-09-13T02:54:22.317 INFO:tasks.workunit.client.1.smithi131.stdout:3/765: mknod d2/d4/db7/dda/c103 0 2024-09-13T02:54:22.317 INFO:tasks.workunit.client.1.smithi131.stdout:3/766: stat d2/d4/d7/d1d/d24/cbb 0 2024-09-13T02:54:22.318 INFO:tasks.workunit.client.1.smithi131.stdout:7/784: symlink d1b/d3b/d51/d8b/l104 0 2024-09-13T02:54:22.319 INFO:tasks.workunit.client.1.smithi131.stdout:7/785: chown d1b/cdc 1612142 1 2024-09-13T02:54:22.319 INFO:tasks.workunit.client.1.smithi131.stdout:7/786: chown d1b/d3b/d31/dcb/cd3 113349784 1 2024-09-13T02:54:22.319 INFO:tasks.workunit.client.1.smithi131.stdout:3/767: creat d2/d4/d76/d9f/d41/f104 x:0 0 0 2024-09-13T02:54:22.319 INFO:tasks.workunit.client.1.smithi131.stdout:3/768: readlink d2/d4/d76/d9f/l2f 0 2024-09-13T02:54:22.321 INFO:tasks.workunit.client.1.smithi131.stdout:3/769: rmdir d2/d4/d7/d1d/d24/d6f/d7f 39 2024-09-13T02:54:22.322 INFO:tasks.workunit.client.1.smithi131.stdout:3/770: symlink d2/d4/d1a/d31/d48/d69/l105 0 2024-09-13T02:54:22.324 INFO:tasks.workunit.client.1.smithi131.stdout:3/771: symlink d2/d4/d7/d1d/l106 0 2024-09-13T02:54:22.325 INFO:tasks.workunit.client.1.smithi131.stdout:3/772: mknod d2/d4/d2d/dce/dee/c107 0 2024-09-13T02:54:22.332 INFO:tasks.workunit.client.1.smithi131.stdout:7/787: dwrite d1b/d3b/d51/d62/d6d/dac/ff5 [0,4194304] 0 2024-09-13T02:54:22.332 INFO:tasks.workunit.client.1.smithi131.stdout:7/788: write d1b/d3b/d51/d62/d6d/dac/ffc [460682,128308] 0 2024-09-13T02:54:22.332 INFO:tasks.workunit.client.1.smithi131.stdout:7/789: write d1b/d3b/d31/d5f/f79 [2538756,111504] 0 2024-09-13T02:54:22.334 INFO:tasks.workunit.client.1.smithi131.stdout:7/790: creat d1b/d23/d89/f105 x:0 0 0 2024-09-13T02:54:22.335 INFO:tasks.workunit.client.1.smithi131.stdout:7/791: write d1b/d3b/d51/fbe [3753536,31053] 0 2024-09-13T02:54:22.351 INFO:tasks.workunit.client.1.smithi131.stdout:3/773: dwrite d2/d4/d7/f53 [0,4194304] 0 2024-09-13T02:54:22.351 INFO:tasks.workunit.client.1.smithi131.stdout:3/774: write d2/d4/d1a/d31/ffc [928104,129458] 0 2024-09-13T02:54:22.351 INFO:tasks.workunit.client.1.smithi131.stdout:3/775: write d2/d4/d7/f94 [1404996,79349] 0 2024-09-13T02:54:22.351 INFO:tasks.workunit.client.1.smithi131.stdout:3/776: readlink d2/d4/d76/d9f/d41/d5c/d71/lc7 0 2024-09-13T02:54:22.351 INFO:tasks.workunit.client.1.smithi131.stdout:7/792: dwrite d1b/d3b/d51/d8f/fa4 [0,4194304] 0 2024-09-13T02:54:22.351 INFO:tasks.workunit.client.1.smithi131.stdout:7/793: dread - d1b/d3b/d51/d62/d6d/da5/dd8/fe6 zero size 2024-09-13T02:54:22.354 INFO:tasks.workunit.client.1.smithi131.stdout:7/794: truncate d1b/d23/f28 1415920 0 2024-09-13T02:54:22.364 INFO:tasks.workunit.client.1.smithi131.stdout:7/795: write d1b/d3b/d51/d62/d9e/da2/fa6 [3446293,35492] 0 2024-09-13T02:54:22.364 INFO:tasks.workunit.client.1.smithi131.stdout:7/796: readlink d1b/d3b/d31/d38/l3d 0 2024-09-13T02:54:22.365 INFO:tasks.workunit.client.1.smithi131.stdout:7/797: write d1b/d3b/d46/d4b/d57/d8c/fec [778790,2798] 0 2024-09-13T02:54:22.365 INFO:tasks.workunit.client.1.smithi131.stdout:7/798: symlink d1b/d3b/d51/d62/d6d/da5/dd8/l106 0 2024-09-13T02:54:22.366 INFO:tasks.workunit.client.1.smithi131.stdout:7/799: stat d1b/d23/c2b 0 2024-09-13T02:54:22.367 INFO:tasks.workunit.client.1.smithi131.stdout:7/800: mkdir d1b/d3b/d46/d4b/d57/d9d/d107 0 2024-09-13T02:54:22.367 INFO:tasks.workunit.client.1.smithi131.stdout:7/801: readlink d1b/d3b/d51/d62/l9b 0 2024-09-13T02:54:22.367 INFO:tasks.workunit.client.1.smithi131.stdout:3/777: dwrite d2/d4/d7/d1d/f2e [0,4194304] 0 2024-09-13T02:54:22.367 INFO:tasks.workunit.client.1.smithi131.stdout:3/778: truncate d2/d4/d7/d1d/d24/d6f/f7c 291444 0 2024-09-13T02:54:22.367 INFO:tasks.workunit.client.1.smithi131.stdout:7/802: read d1b/d3b/d51/d62/d6d/dac/ffc [246274,88136] 0 2024-09-13T02:54:22.367 INFO:tasks.workunit.client.1.smithi131.stdout:7/803: chown d1b/d3b/d46/d4b/d57/d7b/ce8 1019518 1 2024-09-13T02:54:22.367 INFO:tasks.workunit.client.1.smithi131.stdout:3/779: truncate d2/d4/d76/d9f/d41/d5c/f35 3177129 0 2024-09-13T02:54:22.368 INFO:tasks.workunit.client.1.smithi131.stdout:7/804: rename f10 to d1b/d3b/d51/d8b/d99/f108 0 2024-09-13T02:54:22.368 INFO:tasks.workunit.client.1.smithi131.stdout:7/805: readlink d1b/d3b/d31/d5f/ddf/le0 0 2024-09-13T02:54:22.368 INFO:tasks.workunit.client.1.smithi131.stdout:7/806: truncate d1b/d3b/d31/d60/fc3 1189633 0 2024-09-13T02:54:22.369 INFO:tasks.workunit.client.1.smithi131.stdout:3/780: fdatasync d2/d4/d7/f94 0 2024-09-13T02:54:22.370 INFO:tasks.workunit.client.1.smithi131.stdout:7/807: dread d1b/d3b/d51/d8b/d99/f108 [0,4194304] 0 2024-09-13T02:54:22.371 INFO:tasks.workunit.client.1.smithi131.stdout:0/975: sync 2024-09-13T02:54:22.371 INFO:tasks.workunit.client.1.smithi131.stdout:5/743: sync 2024-09-13T02:54:22.371 INFO:tasks.workunit.client.1.smithi131.stdout:2/874: sync 2024-09-13T02:54:22.371 INFO:tasks.workunit.client.1.smithi131.stdout:1/956: sync 2024-09-13T02:54:22.371 INFO:tasks.workunit.client.1.smithi131.stdout:6/871: sync 2024-09-13T02:54:22.371 INFO:tasks.workunit.client.1.smithi131.stdout:9/881: sync 2024-09-13T02:54:22.371 INFO:tasks.workunit.client.1.smithi131.stdout:9/882: readlink d0/d4d/d55/d76/d96/d118/la3 0 2024-09-13T02:54:22.372 INFO:tasks.workunit.client.1.smithi131.stdout:4/924: sync 2024-09-13T02:54:22.372 INFO:tasks.workunit.client.1.smithi131.stdout:4/925: fsync d1/d18/d43/d97/dba/f2e 0 2024-09-13T02:54:22.372 INFO:tasks.workunit.client.1.smithi131.stdout:4/926: chown d1/d18/d43/d97/dba/d7a/dc5/l12e 20736 1 2024-09-13T02:54:22.372 INFO:tasks.workunit.client.1.smithi131.stdout:4/927: creat d1/d18/d43/d97/dba/d7a/dc5/f13d x:0 0 0 2024-09-13T02:54:22.372 INFO:tasks.workunit.client.1.smithi131.stdout:3/781: rename d2/d4/d7/d1d/f2e to d2/d4/d1a/d31/f108 0 2024-09-13T02:54:22.372 INFO:tasks.workunit.client.1.smithi131.stdout:4/928: write d1/d18/d81/fb8 [4475169,112979] 0 2024-09-13T02:54:22.372 INFO:tasks.workunit.client.1.smithi131.stdout:3/782: readlink d2/d4/d2d/dce/l9d 0 2024-09-13T02:54:22.373 INFO:tasks.workunit.client.1.smithi131.stdout:7/808: creat d1b/d3b/d46/d4b/d57/d9d/d107/f109 x:0 0 0 2024-09-13T02:54:22.373 INFO:tasks.workunit.client.1.smithi131.stdout:4/929: write d1/d18/d43/d7d/f92 [563954,125072] 0 2024-09-13T02:54:22.373 INFO:tasks.workunit.client.1.smithi131.stdout:2/875: mknod d5/d31/d4e/c136 0 2024-09-13T02:54:22.374 INFO:tasks.workunit.client.1.smithi131.stdout:5/744: mknod d1/d21/d74/d78/cfa 0 2024-09-13T02:54:22.374 INFO:tasks.workunit.client.1.smithi131.stdout:5/745: chown d1/d1c/d87/db8/fdc 2381577 1 2024-09-13T02:54:22.374 INFO:tasks.workunit.client.1.smithi131.stdout:0/976: mkdir d0/de/d1f/d22/d3d/d55/d63/d94/da5/d153 0 2024-09-13T02:54:22.374 INFO:tasks.workunit.client.1.smithi131.stdout:0/977: fdatasync d0/d2/d41/feb 0 2024-09-13T02:54:22.376 INFO:tasks.workunit.client.1.smithi131.stdout:9/883: creat d0/d4d/d98/dbb/d106/f131 x:0 0 0 2024-09-13T02:54:22.379 INFO:tasks.workunit.client.1.smithi131.stdout:9/884: dread d0/d4d/d55/d76/d96/d118/d14/f6f [0,4194304] 0 2024-09-13T02:54:22.379 INFO:tasks.workunit.client.1.smithi131.stdout:9/885: dread - d0/d4d/d55/d76/d96/d118/d14/dbf/fc7 zero size 2024-09-13T02:54:22.379 INFO:tasks.workunit.client.1.smithi131.stdout:6/872: rename d1/d14/d10b/d26/d1c/d79/ca5 to d1/d14/da2/c12a 0 2024-09-13T02:54:22.381 INFO:tasks.workunit.client.1.smithi131.stdout:1/957: dread dd/d51/d8a/fcc [4194304,4194304] 0 2024-09-13T02:54:22.381 INFO:tasks.workunit.client.1.smithi131.stdout:1/958: fdatasync dd/d51/d8a/d107/f11f 0 2024-09-13T02:54:22.382 INFO:tasks.workunit.client.1.smithi131.stdout:3/783: creat d2/d4/d76/d9f/d41/d5c/f109 x:0 0 0 2024-09-13T02:54:22.384 INFO:tasks.workunit.client.1.smithi131.stdout:3/784: read d2/d4/d7/f94 [395661,93213] 0 2024-09-13T02:54:22.384 INFO:tasks.workunit.client.1.smithi131.stdout:7/809: mkdir d1b/d10a 0 2024-09-13T02:54:22.384 INFO:tasks.workunit.client.1.smithi131.stdout:3/785: write d2/f12 [199287,62785] 0 2024-09-13T02:54:22.384 INFO:tasks.workunit.client.1.smithi131.stdout:7/810: fdatasync d1b/d73/f70 0 2024-09-13T02:54:22.384 INFO:tasks.workunit.client.1.smithi131.stdout:7/811: stat f4 0 2024-09-13T02:54:22.386 INFO:tasks.workunit.client.1.smithi131.stdout:4/930: unlink d1/d18/d43/d97/dba/d19/dee/d12d/fe7 0 2024-09-13T02:54:22.386 INFO:tasks.workunit.client.1.smithi131.stdout:4/931: fdatasync d1/d18/d43/d97/dba/d22/f59 0 2024-09-13T02:54:22.386 INFO:tasks.workunit.client.1.smithi131.stdout:2/876: write d5/f3a [3163478,2802] 0 2024-09-13T02:54:22.386 INFO:tasks.workunit.client.1.smithi131.stdout:4/932: read - d1/d18/d43/d97/dba/d7a/dc5/fce zero size 2024-09-13T02:54:22.386 INFO:tasks.workunit.client.1.smithi131.stdout:2/877: chown d5/d31/d4e/d78/c12e 0 1 2024-09-13T02:54:22.386 INFO:tasks.workunit.client.1.smithi131.stdout:2/878: fdatasync d5/d18/d4b/fdd 0 2024-09-13T02:54:22.387 INFO:tasks.workunit.client.1.smithi131.stdout:9/886: mknod d0/d4d/c132 0 2024-09-13T02:54:22.388 INFO:tasks.workunit.client.1.smithi131.stdout:6/873: dread - d1/d14/d10b/d26/d1c/d4e/f99 zero size 2024-09-13T02:54:22.388 INFO:tasks.workunit.client.1.smithi131.stdout:6/874: write d1/d14/ff3 [280768,102348] 0 2024-09-13T02:54:22.389 INFO:tasks.workunit.client.1.smithi131.stdout:1/959: creat dd/d26/d44/d6d/f15c x:0 0 0 2024-09-13T02:54:22.389 INFO:tasks.workunit.client.1.smithi131.stdout:1/960: read - dd/d51/f11e zero size 2024-09-13T02:54:22.389 INFO:tasks.workunit.client.1.smithi131.stdout:1/961: chown dd/d51/fcb 0 1 2024-09-13T02:54:22.392 INFO:tasks.workunit.client.1.smithi131.stdout:5/746: read d1/d5/f4e [2335681,5711] 0 2024-09-13T02:54:22.393 INFO:tasks.workunit.client.1.smithi131.stdout:3/786: creat d2/d4/d2d/dce/dc4/f10a x:0 0 0 2024-09-13T02:54:22.394 INFO:tasks.workunit.client.1.smithi131.stdout:4/933: mknod d1/dbe/c13e 0 2024-09-13T02:54:22.394 INFO:tasks.workunit.client.1.smithi131.stdout:4/934: truncate d1/d18/d43/d97/dba/d22/d73/f7b 484334 0 2024-09-13T02:54:22.395 INFO:tasks.workunit.client.1.smithi131.stdout:7/812: dread d1b/d3b/d46/d4b/d57/d7b/f53 [0,4194304] 0 2024-09-13T02:54:22.398 INFO:tasks.workunit.client.1.smithi131.stdout:2/879: unlink d5/d31/d1d/d37/d112/d114/db4/dbc/l6d 0 2024-09-13T02:54:22.399 INFO:tasks.workunit.client.1.smithi131.stdout:9/887: symlink d0/d4d/d55/d76/d96/d118/d14/dbf/d122/d2a/d5e/da2/d39/dc2/d109/l133 0 2024-09-13T02:54:22.399 INFO:tasks.workunit.client.1.smithi131.stdout:0/978: dwrite d0/d2/d62/fca [0,4194304] 0 2024-09-13T02:54:22.400 INFO:tasks.workunit.client.1.smithi131.stdout:0/979: stat d0/de/d1f/d22/d31/d39/d40/f140 0 2024-09-13T02:54:22.400 INFO:tasks.workunit.client.1.smithi131.stdout:0/980: write d0/de/d45/d86/de8/f6f [3932033,93036] 0 2024-09-13T02:54:22.400 INFO:tasks.workunit.client.1.smithi131.stdout:0/981: fdatasync d0/de/d45/dfa/fde 0 2024-09-13T02:54:22.400 INFO:tasks.workunit.client.1.smithi131.stdout:0/982: fdatasync d0/de/d1f/d22/d3d/d80/f123 0 2024-09-13T02:54:22.401 INFO:tasks.workunit.client.1.smithi131.stdout:7/813: dread d1b/d3b/d46/d4b/d57/d7b/f53 [0,4194304] 0 2024-09-13T02:54:22.401 INFO:tasks.workunit.client.1.smithi131.stdout:6/875: mkdir d1/d8/d9/db8/d126/d12b 0 2024-09-13T02:54:22.401 INFO:tasks.workunit.client.1.smithi131.stdout:6/876: fdatasync d1/d8/d9/db/fad 0 2024-09-13T02:54:22.401 INFO:tasks.workunit.client.1.smithi131.stdout:6/877: truncate d1/f2b 12886906 0 2024-09-13T02:54:22.401 INFO:tasks.workunit.client.1.smithi131.stdout:0/983: dread d0/d2/d62/f8f [0,4194304] 0 2024-09-13T02:54:22.401 INFO:tasks.workunit.client.1.smithi131.stdout:0/984: chown d0/de/da3/ldd 0 1 2024-09-13T02:54:22.401 INFO:tasks.workunit.client.1.smithi131.stdout:5/747: rmdir d1/d21/d74/d78/d98 39 2024-09-13T02:54:22.403 INFO:tasks.workunit.client.1.smithi131.stdout:3/787: truncate d2/d4/d7/d1d/f21 1101696 0 2024-09-13T02:54:22.403 INFO:tasks.workunit.client.1.smithi131.stdout:3/788: fsync d2/dc/f1b 0 2024-09-13T02:54:22.404 INFO:tasks.workunit.client.1.smithi131.stdout:4/935: getdents d1/d18/d43/d97/dba/d19/dee 0 2024-09-13T02:54:22.407 INFO:tasks.workunit.client.1.smithi131.stdout:5/748: dread d1/d21/d74/d78/d98/ded/f5b [0,4194304] 0 2024-09-13T02:54:22.407 INFO:tasks.workunit.client.1.smithi131.stdout:2/880: creat d5/d31/d1d/d32/d7d/de2/f137 x:0 0 0 2024-09-13T02:54:22.408 INFO:tasks.workunit.client.1.smithi131.stdout:9/888: symlink d0/d4d/d55/d76/l134 0 2024-09-13T02:54:22.414 INFO:tasks.workunit.client.1.smithi131.stdout:7/814: truncate f4 4049974 0 2024-09-13T02:54:22.414 INFO:tasks.workunit.client.1.smithi131.stdout:7/815: chown d1b/d3b/d46/d4b/d57/d8c 3986750 1 2024-09-13T02:54:22.414 INFO:tasks.workunit.client.1.smithi131.stdout:7/816: write d1b/d3b/d46/d4b/d57/d7b/d92/f96 [788467,26906] 0 2024-09-13T02:54:22.414 INFO:tasks.workunit.client.1.smithi131.stdout:6/878: symlink d1/d8/d9/d10d/l12c 0 2024-09-13T02:54:22.415 INFO:tasks.workunit.client.1.smithi131.stdout:0/985: mkdir d0/de/d136/d154 0 2024-09-13T02:54:22.416 INFO:tasks.workunit.client.1.smithi131.stdout:0/986: read d0/de/d1f/d22/d3d/d43/dc2/dd3/fee [641774,115963] 0 2024-09-13T02:54:22.417 INFO:tasks.workunit.client.1.smithi131.stdout:0/987: getdents d0/de/d1f/d22/d3d/d55/dfd/d14a 0 2024-09-13T02:54:22.417 INFO:tasks.workunit.client.1.smithi131.stdout:0/988: chown d0/de/d1f/d22/f4e 22865 1 2024-09-13T02:54:22.417 INFO:tasks.workunit.client.1.smithi131.stdout:3/789: symlink d2/d4/d7/db8/l10b 0 2024-09-13T02:54:22.418 INFO:tasks.workunit.client.1.smithi131.stdout:4/936: truncate d1/d18/d34/f6f 1520382 0 2024-09-13T02:54:22.420 INFO:tasks.workunit.client.1.smithi131.stdout:5/749: creat d1/d1c/d87/ffb x:0 0 0 2024-09-13T02:54:22.420 INFO:tasks.workunit.client.1.smithi131.stdout:9/889: mkdir d0/d4d/d55/d76/d96/d118/d14/dbf/d122/d2a/d5e/da2/d39/dae/d135 0 2024-09-13T02:54:22.423 INFO:tasks.workunit.client.1.smithi131.stdout:7/817: rename d1b/d3b/d31/d7c/db7/d81/fe7 to d1b/d3b/d31/d60/f10b 0 2024-09-13T02:54:22.423 INFO:tasks.workunit.client.1.smithi131.stdout:7/818: chown d1b/d3b/d46/d4b 1354266 1 2024-09-13T02:54:22.423 INFO:tasks.workunit.client.1.smithi131.stdout:3/790: write d2/d4/f34 [1104939,62929] 0 2024-09-13T02:54:22.426 INFO:tasks.workunit.client.1.smithi131.stdout:5/750: rmdir d1/d21/d74/d78/dbe 39 2024-09-13T02:54:22.426 INFO:tasks.workunit.client.1.smithi131.stdout:4/937: creat d1/d122/f13f x:0 0 0 2024-09-13T02:54:22.428 INFO:tasks.workunit.client.1.smithi131.stdout:6/879: rename d1/d14/d10b/dff/f11b to d1/d8/d9/db/d40/dd4/f12d 0 2024-09-13T02:54:22.429 INFO:tasks.workunit.client.1.smithi131.stdout:7/819: mkdir d1b/d3b/d46/d10c 0 2024-09-13T02:54:22.436 INFO:tasks.workunit.client.1.smithi131.stdout:3/791: creat d2/dc/db1/f10c x:0 0 0 2024-09-13T02:54:22.441 INFO:tasks.workunit.client.1.smithi131.stdout:5/751: write d1/d5/fa [3854443,88604] 0 2024-09-13T02:54:22.441 INFO:tasks.workunit.client.1.smithi131.stdout:3/792: link d2/d4/d7/d1d/d24/f51 d2/dc/db1/dca/f10d 0 2024-09-13T02:54:22.441 INFO:tasks.workunit.client.1.smithi131.stdout:3/793: symlink d2/d4/d76/d9f/d41/d5c/d71/l10e 0 2024-09-13T02:54:22.441 INFO:tasks.workunit.client.1.smithi131.stdout:3/794: readlink d2/d4/d76/d9f/d41/lc5 0 2024-09-13T02:54:22.441 INFO:tasks.workunit.client.1.smithi131.stdout:3/795: readlink d2/d4/d76/d9f/d41/d5c/l50 0 2024-09-13T02:54:22.441 INFO:tasks.workunit.client.1.smithi131.stdout:3/796: mknod d2/d4/d2d/dce/dee/c10f 0 2024-09-13T02:54:22.454 INFO:tasks.workunit.client.1.smithi131.stdout:5/752: dread d1/d29/d3e/f42 [4194304,4194304] 0 2024-09-13T02:54:22.468 INFO:tasks.workunit.client.1.smithi131.stdout:5/753: dread d1/d5/f65 [0,4194304] 0 2024-09-13T02:54:22.469 INFO:tasks.workunit.client.1.smithi131.stdout:5/754: truncate d1/d5/d57/d60/fa2 2249304 0 2024-09-13T02:54:22.470 INFO:tasks.workunit.client.1.smithi131.stdout:5/755: mknod d1/d2f/d4f/cfc 0 2024-09-13T02:54:22.480 INFO:tasks.workunit.client.1.smithi131.stdout:2/881: dwrite d5/d4f/ffc [0,4194304] 0 2024-09-13T02:54:22.480 INFO:tasks.workunit.client.1.smithi131.stdout:9/890: dwrite d0/d4d/d55/d76/d10f/f11d [0,4194304] 0 2024-09-13T02:54:22.482 INFO:tasks.workunit.client.1.smithi131.stdout:9/891: read d0/d4d/d55/d76/d96/d118/d14/dbf/d122/dc6/f77 [430999,116533] 0 2024-09-13T02:54:22.483 INFO:tasks.workunit.client.1.smithi131.stdout:6/880: dwrite d1/d14/d10b/dc2/d3b/faf [0,4194304] 0 2024-09-13T02:54:22.485 INFO:tasks.workunit.client.1.smithi131.stdout:3/797: dwrite d2/d4/f28 [0,4194304] 0 2024-09-13T02:54:22.486 INFO:tasks.workunit.client.1.smithi131.stdout:0/989: dwrite d0/de/d1f/d22/d3d/d80/f14c [0,4194304] 0 2024-09-13T02:54:22.486 INFO:tasks.workunit.client.1.smithi131.stdout:4/938: dwrite d1/d18/d43/d97/fa5 [0,4194304] 0 2024-09-13T02:54:22.490 INFO:tasks.workunit.client.1.smithi131.stdout:5/756: dwrite d1/d2f/fc5 [0,4194304] 0 2024-09-13T02:54:22.491 INFO:tasks.workunit.client.1.smithi131.stdout:5/757: chown d1/d2f/l83 16082 1 2024-09-13T02:54:22.491 INFO:tasks.workunit.client.1.smithi131.stdout:3/798: write d2/dc/f1b [2639749,19253] 0 2024-09-13T02:54:22.491 INFO:tasks.workunit.client.1.smithi131.stdout:5/758: write d1/d21/d74/d78/d98/ded/f89 [1929460,53890] 0 2024-09-13T02:54:22.491 INFO:tasks.workunit.client.1.smithi131.stdout:3/799: chown d2/d4/d7/d1d/d24/d6f/d7f/ff0 466561804 1 2024-09-13T02:54:22.491 INFO:tasks.workunit.client.1.smithi131.stdout:3/800: chown d2/d4/d76/d9f/d41/d5c/c3c 6 1 2024-09-13T02:54:22.495 INFO:tasks.workunit.client.1.smithi131.stdout:2/882: dread d5/d31/d1d/d32/f5e [0,4194304] 0 2024-09-13T02:54:22.495 INFO:tasks.workunit.client.1.smithi131.stdout:2/883: truncate d5/d31/d4e/d76/fe8 423240 0 2024-09-13T02:54:22.495 INFO:tasks.workunit.client.1.smithi131.stdout:0/990: dread d0/de/d45/d86/de8/f7f [0,4194304] 0 2024-09-13T02:54:22.497 INFO:tasks.workunit.client.1.smithi131.stdout:5/759: rename d1/d1c/d87/dbd/dca/ff2 to d1/d1c/d87/ffd 0 2024-09-13T02:54:22.498 INFO:tasks.workunit.client.1.smithi131.stdout:3/801: creat d2/dc/d39/f110 x:0 0 0 2024-09-13T02:54:22.498 INFO:tasks.workunit.client.1.smithi131.stdout:3/802: chown d2/d4/d2d/d92 13 1 2024-09-13T02:54:22.499 INFO:tasks.workunit.client.1.smithi131.stdout:4/939: symlink d1/d18/d43/dd9/l140 0 2024-09-13T02:54:22.499 INFO:tasks.workunit.client.1.smithi131.stdout:0/991: getdents d0/de/d136 0 2024-09-13T02:54:22.500 INFO:tasks.workunit.client.1.smithi131.stdout:5/760: creat d1/d21/d90/df8/ffe x:0 0 0 2024-09-13T02:54:22.501 INFO:tasks.workunit.client.1.smithi131.stdout:3/803: creat d2/d4/d76/d9f/db9/f111 x:0 0 0 2024-09-13T02:54:22.504 INFO:tasks.workunit.client.1.smithi131.stdout:0/992: creat d0/de/d1f/d22/d3d/d55/dfd/d14a/f155 x:0 0 0 2024-09-13T02:54:22.504 INFO:tasks.workunit.client.1.smithi131.stdout:0/993: truncate d0/de/d1f/d22/d3d/d43/dc2/f12b 872460 0 2024-09-13T02:54:22.506 INFO:tasks.workunit.client.1.smithi131.stdout:4/940: symlink d1/d18/d34/d62/d78/l141 0 2024-09-13T02:54:22.506 INFO:tasks.workunit.client.1.smithi131.stdout:3/804: rmdir d2/d4/d76/d9f/d41/d5c/d71 39 2024-09-13T02:54:22.506 INFO:tasks.workunit.client.1.smithi131.stdout:3/805: fdatasync d2/dc/f1b 0 2024-09-13T02:54:22.506 INFO:tasks.workunit.client.1.smithi131.stdout:6/881: dwrite d1/d14/d10b/dc2/f88 [0,4194304] 0 2024-09-13T02:54:22.506 INFO:tasks.workunit.client.1.smithi131.stdout:5/761: dread d1/d21/d74/d78/d98/fc8 [0,4194304] 0 2024-09-13T02:54:22.506 INFO:tasks.workunit.client.1.smithi131.stdout:5/762: write d1/d5/d57/d60/fdf [993690,91869] 0 2024-09-13T02:54:22.508 INFO:tasks.workunit.client.1.smithi131.stdout:6/882: creat d1/d14/d10b/dc2/f12e x:0 0 0 2024-09-13T02:54:22.508 INFO:tasks.workunit.client.1.smithi131.stdout:5/763: mknod d1/d29/cff 0 2024-09-13T02:54:22.509 INFO:tasks.workunit.client.1.smithi131.stdout:6/883: rmdir d1/d14/d10b/d26/d1c 39 2024-09-13T02:54:22.509 INFO:tasks.workunit.client.1.smithi131.stdout:6/884: stat d1/d14/d10b/d26/fc5 0 2024-09-13T02:54:22.511 INFO:tasks.workunit.client.1.smithi131.stdout:5/764: rename d1/d29/c99 to d1/d29/c100 0 2024-09-13T02:54:22.511 INFO:tasks.workunit.client.1.smithi131.stdout:5/765: stat d1/d21/d22/l82 0 2024-09-13T02:54:22.514 INFO:tasks.workunit.client.1.smithi131.stdout:6/885: rename d1/d14/d10b/c11e to d1/d14/d10b/d26/d1c/d4e/c12f 0 2024-09-13T02:54:22.517 INFO:tasks.workunit.client.1.smithi131.stdout:6/886: symlink d1/d8/d9/db/l130 0 2024-09-13T02:54:22.520 INFO:tasks.workunit.client.1.smithi131.stdout:5/766: rename d1/d21/d74/d78/d98/lc7 to d1/d1c/d87/dbd/l101 0 2024-09-13T02:54:22.520 INFO:tasks.workunit.client.1.smithi131.stdout:5/767: creat d1/d2f/d4f/f102 x:0 0 0 2024-09-13T02:54:22.521 INFO:tasks.workunit.client.1.smithi131.stdout:6/887: mkdir d1/d106/d131 0 2024-09-13T02:54:22.523 INFO:tasks.workunit.client.1.smithi131.stdout:6/888: unlink d1/d14/c23 0 2024-09-13T02:54:22.525 INFO:tasks.workunit.client.1.smithi131.stdout:3/806: dread d2/f95 [0,4194304] 0 2024-09-13T02:54:22.529 INFO:tasks.workunit.client.1.smithi131.stdout:6/889: dread d1/d8/d9/db/d40/fb4 [0,4194304] 0 2024-09-13T02:54:22.529 INFO:tasks.workunit.client.1.smithi131.stdout:6/890: write d1/d8/d9/db/d40/f47 [8487736,61161] 0 2024-09-13T02:54:22.529 INFO:tasks.workunit.client.1.smithi131.stdout:6/891: fdatasync d1/f84 0 2024-09-13T02:54:22.533 INFO:tasks.workunit.client.1.smithi131.stdout:5/768: dread d1/d5/f3a [0,4194304] 0 2024-09-13T02:54:22.534 INFO:tasks.workunit.client.1.smithi131.stdout:5/769: truncate d1/d21/f7b 3466903 0 2024-09-13T02:54:22.534 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:22 smithi089 ceph-mon[27639]: pgmap v253: 65 pgs: 65 active+clean; 2.8 GiB data, 9.8 GiB used, 527 GiB / 536 GiB avail; 137 MiB/s rd, 167 MiB/s wr, 298 op/s 2024-09-13T02:54:22.535 INFO:tasks.workunit.client.1.smithi131.stdout:5/770: mknod d1/d5/d57/c103 0 2024-09-13T02:54:22.545 INFO:tasks.workunit.client.1.smithi131.stdout:4/941: dwrite d1/d18/d43/d97/dba/d22/d49/f61 [0,4194304] 0 2024-09-13T02:54:22.546 INFO:tasks.workunit.client.1.smithi131.stdout:6/892: dwrite d1/d8/fa7 [0,4194304] 0 2024-09-13T02:54:22.548 INFO:tasks.workunit.client.1.smithi131.stdout:4/942: symlink d1/d18/d43/d97/dba/d22/d73/l142 0 2024-09-13T02:54:22.549 INFO:tasks.workunit.client.1.smithi131.stdout:4/943: readlink d1/d18/d34/d4e/d108/l133 0 2024-09-13T02:54:22.560 INFO:tasks.workunit.client.1.smithi131.stdout:5/771: dwrite d1/d5/f3a [0,4194304] 0 2024-09-13T02:54:22.560 INFO:tasks.workunit.client.1.smithi131.stdout:5/772: chown d1/l19 2504 1 2024-09-13T02:54:22.561 INFO:tasks.workunit.client.1.smithi131.stdout:5/773: creat d1/d1c/d87/f104 x:0 0 0 2024-09-13T02:54:22.562 INFO:tasks.workunit.client.1.smithi131.stdout:5/774: link d1/d1c/d87/db8/cda d1/d5/dcd/c105 0 2024-09-13T02:54:22.562 INFO:tasks.workunit.client.1.smithi131.stdout:5/775: readlink d1/d21/d74/d78/lb3 0 2024-09-13T02:54:22.563 INFO:tasks.workunit.client.1.smithi131.stdout:5/776: creat d1/d9c/dd1/f106 x:0 0 0 2024-09-13T02:54:22.563 INFO:tasks.workunit.client.1.smithi131.stdout:5/777: mkdir d1/d21/d74/d78/d98/d107 0 2024-09-13T02:54:22.568 INFO:tasks.workunit.client.1.smithi131.stdout:5/778: write d1/d29/f2e [5319372,25613] 0 2024-09-13T02:54:22.568 INFO:tasks.workunit.client.1.smithi131.stdout:5/779: chown d1/d29/d39/c70 5 1 2024-09-13T02:54:22.574 INFO:tasks.workunit.client.1.smithi131.stdout:6/893: dwrite d1/d8/f2c [4194304,4194304] 0 2024-09-13T02:54:22.577 INFO:tasks.workunit.client.1.smithi131.stdout:4/944: dwrite d1/d18/d43/d7d/fe6 [0,4194304] 0 2024-09-13T02:54:22.577 INFO:tasks.workunit.client.1.smithi131.stdout:4/945: creat d1/d18/d43/d97/dba/d7a/dc5/f143 x:0 0 0 2024-09-13T02:54:22.583 INFO:tasks.workunit.client.1.smithi131.stdout:4/946: creat d1/d18/d34/d4e/d108/d33/d3a/da8/dff/f144 x:0 0 0 2024-09-13T02:54:22.586 INFO:tasks.workunit.client.1.smithi131.stdout:4/947: rename d1/d18/d81/cac to d1/d18/d34/d62/da3/ded/c145 0 2024-09-13T02:54:22.586 INFO:tasks.workunit.client.1.smithi131.stdout:4/948: fsync d1/d18/d34/d4e/d108/d8d/f117 0 2024-09-13T02:54:22.586 INFO:tasks.workunit.client.1.smithi131.stdout:4/949: chown d1/d18/d34/d4e/d108/d33/d3a 251727 1 2024-09-13T02:54:22.589 INFO:tasks.workunit.client.1.smithi131.stdout:4/950: rename d1/d18/f2d to d1/d18/d34/d4e/f146 0 2024-09-13T02:54:22.589 INFO:tasks.workunit.client.1.smithi131.stdout:4/951: stat d1/d18/d43/d97/dba/d7a/dc5 0 2024-09-13T02:54:22.591 INFO:tasks.workunit.client.1.smithi131.stdout:5/780: dwrite d1/d5/d57/f7c [0,4194304] 0 2024-09-13T02:54:22.593 INFO:tasks.workunit.client.1.smithi131.stdout:5/781: unlink d1/d21/d74/d78/d98/ded/l8f 0 2024-09-13T02:54:22.593 INFO:tasks.workunit.client.1.smithi131.stdout:5/782: fsync d1/d1c/d8e/f48 0 2024-09-13T02:54:22.593 INFO:tasks.workunit.client.1.smithi131.stdout:5/783: write d1/d21/f6d [1562371,117638] 0 2024-09-13T02:54:22.603 INFO:tasks.workunit.client.1.smithi131.stdout:4/952: write d1/d18/d43/d97/dba/d22/d49/f61 [2264564,55029] 0 2024-09-13T02:54:22.603 INFO:tasks.workunit.client.1.smithi131.stdout:6/894: dwrite d1/d14/f20 [0,4194304] 0 2024-09-13T02:54:22.603 INFO:tasks.workunit.client.1.smithi131.stdout:6/895: chown d1/d8/d9/f1d 3 1 2024-09-13T02:54:22.605 INFO:tasks.workunit.client.1.smithi131.stdout:4/953: unlink d1/d18/d43/d97/dba/d22/fb9 0 2024-09-13T02:54:22.605 INFO:tasks.workunit.client.1.smithi131.stdout:4/954: truncate d1/d18/d34/d4e/d108/f9e 917422 0 2024-09-13T02:54:22.606 INFO:tasks.workunit.client.1.smithi131.stdout:6/896: creat d1/d8/d9/d10d/f132 x:0 0 0 2024-09-13T02:54:22.616 INFO:tasks.workunit.client.1.smithi131.stdout:5/784: dwrite d1/d50/fa3 [0,4194304] 0 2024-09-13T02:54:22.620 INFO:tasks.workunit.client.1.smithi131.stdout:4/955: dread d1/d18/d34/d62/d78/ffb [4194304,4194304] 0 2024-09-13T02:54:22.621 INFO:tasks.workunit.client.1.smithi131.stdout:6/897: read d1/d8/d9/db/d40/f9d [3770896,92513] 0 2024-09-13T02:54:22.621 INFO:tasks.workunit.client.1.smithi131.stdout:6/898: chown d1/d14/d10b/d26/dbd/ddf/de3/l100 809032 1 2024-09-13T02:54:22.622 INFO:tasks.workunit.client.1.smithi131.stdout:6/899: unlink d1/d53/la3 0 2024-09-13T02:54:22.623 INFO:tasks.workunit.client.1.smithi131.stdout:4/956: getdents d1/d18/d43/d65/dbd/dc1 0 2024-09-13T02:54:22.623 INFO:tasks.workunit.client.1.smithi131.stdout:4/957: stat d1/d18/ff0 0 2024-09-13T02:54:22.623 INFO:tasks.workunit.client.1.smithi131.stdout:4/958: truncate d1/d18/d43/d97/dba/d22/d49/f12b 353982 0 2024-09-13T02:54:22.624 INFO:tasks.workunit.client.1.smithi131.stdout:6/900: mknod d1/d14/c133 0 2024-09-13T02:54:22.625 INFO:tasks.workunit.client.1.smithi131.stdout:4/959: creat d1/d18/d34/d4e/d108/d33/d3a/da8/f147 x:0 0 0 2024-09-13T02:54:22.627 INFO:tasks.workunit.client.1.smithi131.stdout:6/901: read d1/d14/d10b/dc2/d3b/f71 [465947,4595] 0 2024-09-13T02:54:22.627 INFO:tasks.workunit.client.1.smithi131.stdout:6/902: creat d1/d14/d10b/dff/f134 x:0 0 0 2024-09-13T02:54:22.627 INFO:tasks.workunit.client.1.smithi131.stdout:5/785: write d1/d21/d74/d78/d98/ded/f97 [1511221,112389] 0 2024-09-13T02:54:22.628 INFO:tasks.workunit.client.1.smithi131.stdout:4/960: getdents d1/d18/d34/d4e/d108/d8d/dc9/d116 0 2024-09-13T02:54:22.631 INFO:tasks.workunit.client.1.smithi131.stdout:6/903: rename d1/c8b to d1/d14/d10b/d26/dd1/c135 0 2024-09-13T02:54:22.634 INFO:tasks.workunit.client.1.smithi131.stdout:4/961: symlink d1/d18/d43/d97/l148 0 2024-09-13T02:54:22.634 INFO:tasks.workunit.client.1.smithi131.stdout:4/962: stat d1/d18/d43/d97/dba/d22/d49 0 2024-09-13T02:54:22.634 INFO:tasks.workunit.client.1.smithi131.stdout:4/963: chown d1/d18/d43/d97/dba/l113 15979310 1 2024-09-13T02:54:22.636 INFO:tasks.workunit.client.1.smithi131.stdout:6/904: creat d1/f136 x:0 0 0 2024-09-13T02:54:22.637 INFO:tasks.workunit.client.1.smithi131.stdout:6/905: truncate d1/d14/f7c 3959715 0 2024-09-13T02:54:22.637 INFO:tasks.workunit.client.1.smithi131.stdout:6/906: chown d1/d14/d10b/d26/d1c/d4e/f73 748357 1 2024-09-13T02:54:22.639 INFO:tasks.workunit.client.1.smithi131.stdout:6/907: symlink d1/d14/d10b/dc2/d3b/dd0/l137 0 2024-09-13T02:54:22.640 INFO:tasks.workunit.client.1.smithi131.stdout:6/908: symlink d1/d14/d10b/d26/dd1/l138 0 2024-09-13T02:54:22.640 INFO:tasks.workunit.client.1.smithi131.stdout:6/909: write d1/d8/fa7 [4677947,110533] 0 2024-09-13T02:54:22.641 INFO:tasks.workunit.client.1.smithi131.stdout:6/910: fdatasync d1/d8/d9/d10d/f111 0 2024-09-13T02:54:22.644 INFO:tasks.workunit.client.1.smithi131.stdout:6/911: rename d1/d14/d10b/dc2/d3b/c7b to d1/d14/d10b/dc2/c139 0 2024-09-13T02:54:22.645 INFO:tasks.workunit.client.1.smithi131.stdout:6/912: mkdir d1/d8/d9/db8/d126/d12b/d13a 0 2024-09-13T02:54:22.645 INFO:tasks.workunit.client.1.smithi131.stdout:6/913: chown d1/d53 54 1 2024-09-13T02:54:22.645 INFO:tasks.workunit.client.1.smithi131.stdout:6/914: symlink d1/d8/d9/d4b/l13b 0 2024-09-13T02:54:22.649 INFO:tasks.workunit.client.1.smithi131.stdout:5/786: dwrite d1/d1c/d87/dbd/dca/fdb [0,4194304] 0 2024-09-13T02:54:22.651 INFO:tasks.workunit.client.1.smithi131.stdout:4/964: dwrite d1/d122/f13f [0,4194304] 0 2024-09-13T02:54:22.652 INFO:tasks.workunit.client.1.smithi131.stdout:5/787: creat d1/d21/f108 x:0 0 0 2024-09-13T02:54:22.652 INFO:tasks.workunit.client.1.smithi131.stdout:5/788: read - d1/d2f/d4f/fa1 zero size 2024-09-13T02:54:22.656 INFO:tasks.workunit.client.1.smithi131.stdout:4/965: truncate d1/ff4 399892 0 2024-09-13T02:54:22.657 INFO:tasks.workunit.client.1.smithi131.stdout:5/789: mkdir d1/d2f/d71/d109 0 2024-09-13T02:54:22.657 INFO:tasks.workunit.client.1.smithi131.stdout:4/966: chown d1/d18/d43/d97/dba/d19/dee/c10c 88 1 2024-09-13T02:54:22.657 INFO:tasks.workunit.client.1.smithi131.stdout:4/967: chown d1/d18/d43/d65/dbd/dc1/c90 75 1 2024-09-13T02:54:22.657 INFO:tasks.workunit.client.1.smithi131.stdout:4/968: fdatasync d1/d18/d34/d4e/d108/f4a 0 2024-09-13T02:54:22.658 INFO:tasks.workunit.client.1.smithi131.stdout:5/790: creat d1/d5/d57/d60/f10a x:0 0 0 2024-09-13T02:54:22.659 INFO:tasks.workunit.client.1.smithi131.stdout:4/969: mknod d1/d18/d43/d97/c149 0 2024-09-13T02:54:22.661 INFO:tasks.workunit.client.1.smithi131.stdout:5/791: unlink d1/d21/d74/d78/d98/dc9/cef 0 2024-09-13T02:54:22.663 INFO:tasks.workunit.client.1.smithi131.stdout:4/970: creat d1/d18/d43/d97/dba/d7a/d13b/f14a x:0 0 0 2024-09-13T02:54:22.664 INFO:tasks.workunit.client.1.smithi131.stdout:5/792: truncate d1/d21/d90/fcf 2327868 0 2024-09-13T02:54:22.664 INFO:tasks.workunit.client.1.smithi131.stdout:5/793: write d1/d5/d57/f7c [5036467,21066] 0 2024-09-13T02:54:22.664 INFO:tasks.workunit.client.1.smithi131.stdout:5/794: write d1/d21/d74/d78/fb0 [1047020,65447] 0 2024-09-13T02:54:22.664 INFO:tasks.workunit.client.1.smithi131.stdout:5/795: dread - d1/d21/d74/fcb zero size 2024-09-13T02:54:22.666 INFO:tasks.workunit.client.1.smithi131.stdout:4/971: link d1/f27 d1/dbe/f14b 0 2024-09-13T02:54:22.666 INFO:tasks.workunit.client.1.smithi131.stdout:4/972: write d1/d18/d43/d97/dba/d22/d73/de0/fe1 [4884868,69630] 0 2024-09-13T02:54:22.668 INFO:tasks.workunit.client.1.smithi131.stdout:5/796: unlink d1/d21/d74/d78/cac 0 2024-09-13T02:54:22.669 INFO:tasks.workunit.client.1.smithi131.stdout:5/797: rmdir d1/d1c/d8e 39 2024-09-13T02:54:22.671 INFO:tasks.workunit.client.1.smithi131.stdout:5/798: rename d1/d1c/d8e/c34 to d1/d1c/d8e/c10b 0 2024-09-13T02:54:22.671 INFO:tasks.workunit.client.1.smithi131.stdout:5/799: dread - d1/d29/d39/f9e zero size 2024-09-13T02:54:22.671 INFO:tasks.workunit.client.1.smithi131.stdout:5/800: creat d1/d21/d90/f10c x:0 0 0 2024-09-13T02:54:22.673 INFO:tasks.workunit.client.1.smithi131.stdout:5/801: creat d1/d21/d74/d78/d98/d107/f10d x:0 0 0 2024-09-13T02:54:22.673 INFO:tasks.workunit.client.1.smithi131.stdout:5/802: write d1/d29/d39/f72 [1767060,77454] 0 2024-09-13T02:54:22.673 INFO:tasks.workunit.client.1.smithi131.stdout:5/803: write d1/d1c/d87/ffd [923297,53027] 0 2024-09-13T02:54:22.674 INFO:tasks.workunit.client.1.smithi131.stdout:5/804: chown d1/d21/f25 92805 1 2024-09-13T02:54:22.676 INFO:tasks.workunit.client.1.smithi131.stdout:5/805: unlink d1/d1c/d87/dbd/le2 0 2024-09-13T02:54:22.676 INFO:tasks.workunit.client.1.smithi131.stdout:5/806: write d1/d2f/fd3 [583818,73857] 0 2024-09-13T02:54:22.677 INFO:tasks.workunit.client.1.smithi131.stdout:5/807: symlink d1/d2f/d4f/l10e 0 2024-09-13T02:54:22.679 INFO:tasks.workunit.client.1.smithi131.stdout:4/973: write d1/d18/d43/d97/dba/d22/f11f [200448,37608] 0 2024-09-13T02:54:22.684 INFO:tasks.workunit.client.1.smithi131.stdout:4/974: dread d1/d18/d43/d65/fa4 [0,4194304] 0 2024-09-13T02:54:22.685 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:22 smithi131 ceph-mon[34689]: pgmap v253: 65 pgs: 65 active+clean; 2.8 GiB data, 9.8 GiB used, 527 GiB / 536 GiB avail; 137 MiB/s rd, 167 MiB/s wr, 298 op/s 2024-09-13T02:54:22.687 INFO:tasks.workunit.client.1.smithi131.stdout:6/915: write d1/d14/f7c [1572934,16576] 0 2024-09-13T02:54:22.687 INFO:tasks.workunit.client.1.smithi131.stdout:6/916: stat d1 0 2024-09-13T02:54:22.687 INFO:tasks.workunit.client.1.smithi131.stdout:6/917: write d1/d8/d9/f6f [997556,33531] 0 2024-09-13T02:54:22.690 INFO:tasks.workunit.client.1.smithi131.stdout:6/918: rmdir d1/d53 39 2024-09-13T02:54:22.699 INFO:tasks.workunit.client.1.smithi131.stdout:4/975: dread d1/d18/d43/d97/dba/d22/f11f [0,4194304] 0 2024-09-13T02:54:22.699 INFO:tasks.workunit.client.1.smithi131.stdout:4/976: write d1/d18/d34/d4e/d108/d8d/fe2 [274782,29145] 0 2024-09-13T02:54:22.699 INFO:tasks.workunit.client.1.smithi131.stdout:4/977: read - d1/d18/d43/d65/dbd/dc1/f68 zero size 2024-09-13T02:54:22.702 INFO:tasks.workunit.client.1.smithi131.stdout:6/919: write d1/d14/f20 [1354298,73408] 0 2024-09-13T02:54:22.704 INFO:tasks.workunit.client.1.smithi131.stdout:6/920: creat d1/d8/d9/f13c x:0 0 0 2024-09-13T02:54:22.709 INFO:tasks.workunit.client.1.smithi131.stdout:5/808: dwrite d1/d21/d74/d78/d98/ded/f97 [0,4194304] 0 2024-09-13T02:54:22.710 INFO:tasks.workunit.client.1.smithi131.stdout:5/809: mknod d1/d21/c10f 0 2024-09-13T02:54:22.712 INFO:tasks.workunit.client.1.smithi131.stdout:5/810: write d1/d21/d74/fa7 [642720,21112] 0 2024-09-13T02:54:22.713 INFO:tasks.workunit.client.1.smithi131.stdout:5/811: getdents d1/d50 0 2024-09-13T02:54:22.714 INFO:tasks.workunit.client.1.smithi131.stdout:6/921: dread d1/d8/d9/d4b/fa1 [0,4194304] 0 2024-09-13T02:54:22.714 INFO:tasks.workunit.client.1.smithi131.stdout:5/812: mknod d1/d1c/d87/c110 0 2024-09-13T02:54:22.721 INFO:tasks.workunit.client.1.smithi131.stdout:4/978: dwrite d1/d18/d43/d65/dbd/dc1/fb4 [4194304,4194304] 0 2024-09-13T02:54:22.724 INFO:tasks.workunit.client.1.smithi131.stdout:4/979: rename d1/d18/d43/d97/dba/fae to d1/d18/d34/d4e/d108/d33/d3a/f14c 0 2024-09-13T02:54:22.725 INFO:tasks.workunit.client.1.smithi131.stdout:5/813: dread d1/d2f/fd3 [0,4194304] 0 2024-09-13T02:54:22.725 INFO:tasks.workunit.client.1.smithi131.stdout:4/980: creat d1/d18/d34/d4e/d108/d8d/d115/f14d x:0 0 0 2024-09-13T02:54:22.727 INFO:tasks.workunit.client.1.smithi131.stdout:5/814: creat d1/d21/d74/d78/f111 x:0 0 0 2024-09-13T02:54:22.727 INFO:tasks.workunit.client.1.smithi131.stdout:4/981: mknod d1/d18/d34/d4e/d108/d8d/d115/c14e 0 2024-09-13T02:54:22.728 INFO:tasks.workunit.client.1.smithi131.stdout:4/982: mknod d1/d18/d43/d65/c14f 0 2024-09-13T02:54:22.729 INFO:tasks.workunit.client.1.smithi131.stdout:4/983: write d1/d18/d34/d4e/d108/d8d/d115/f14d [555474,25026] 0 2024-09-13T02:54:22.738 INFO:tasks.workunit.client.1.smithi131.stdout:6/922: dwrite d1/d8/d9/d8d/ff1 [0,4194304] 0 2024-09-13T02:54:22.738 INFO:tasks.workunit.client.1.smithi131.stdout:5/815: read d1/d21/d22/f55 [4012706,29905] 0 2024-09-13T02:54:22.740 INFO:tasks.workunit.client.1.smithi131.stdout:4/984: dread d1/d18/d34/d4e/d108/d33/d3a/f74 [0,4194304] 0 2024-09-13T02:54:22.743 INFO:tasks.workunit.client.1.smithi131.stdout:6/923: symlink d1/d53/l13d 0 2024-09-13T02:54:22.743 INFO:tasks.workunit.client.1.smithi131.stdout:5/816: mkdir d1/d21/db7/d112 0 2024-09-13T02:54:22.747 INFO:tasks.workunit.client.1.smithi131.stdout:5/817: unlink d1/d2f/fde 0 2024-09-13T02:54:22.758 INFO:tasks.workunit.client.1.smithi131.stdout:5/818: dread d1/d1c/d8e/f48 [0,4194304] 0 2024-09-13T02:54:22.759 INFO:tasks.workunit.client.1.smithi131.stdout:5/819: readlink d1/d29/d3e/lbf 0 2024-09-13T02:54:22.759 INFO:tasks.workunit.client.1.smithi131.stdout:5/820: creat d1/d21/d74/d78/d98/dc9/f113 x:0 0 0 2024-09-13T02:54:22.765 INFO:tasks.workunit.client.1.smithi131.stdout:6/924: dwrite d1/d8/d9/db/f64 [0,4194304] 0 2024-09-13T02:54:22.768 INFO:tasks.workunit.client.1.smithi131.stdout:6/925: dread d1/d14/d10b/dc2/f33 [0,4194304] 0 2024-09-13T02:54:22.770 INFO:tasks.workunit.client.1.smithi131.stdout:6/926: creat d1/d8/d9/d4b/f13e x:0 0 0 2024-09-13T02:54:22.770 INFO:tasks.workunit.client.1.smithi131.stdout:6/927: chown d1/d53/ffd 11284137 1 2024-09-13T02:54:22.770 INFO:tasks.workunit.client.1.smithi131.stdout:6/928: readlink d1/d14/d10b/dc2/d3b/dd0/l137 0 2024-09-13T02:54:22.771 INFO:tasks.workunit.client.1.smithi131.stdout:6/929: rename d1/d8/d9/d10d/l11c to d1/d14/d10b/dc2/d3b/dd0/l13f 0 2024-09-13T02:54:22.772 INFO:tasks.workunit.client.1.smithi131.stdout:5/821: write d1/d29/f2e [1467049,129697] 0 2024-09-13T02:54:22.772 INFO:tasks.workunit.client.1.smithi131.stdout:5/822: write d1/d2f/d4f/fbc [5039568,33773] 0 2024-09-13T02:54:22.772 INFO:tasks.workunit.client.1.smithi131.stdout:5/823: creat d1/d21/d74/f114 x:0 0 0 2024-09-13T02:54:22.773 INFO:tasks.workunit.client.1.smithi131.stdout:6/930: rename d1/d8/d9/db/d40/l4a to d1/d8/d9/d8d/l140 0 2024-09-13T02:54:22.773 INFO:tasks.workunit.client.1.smithi131.stdout:6/931: stat d1/d53/d123 0 2024-09-13T02:54:22.774 INFO:tasks.workunit.client.1.smithi131.stdout:6/932: mkdir d1/d14/d10b/d26/dbd/d141 0 2024-09-13T02:54:22.774 INFO:tasks.workunit.client.1.smithi131.stdout:6/933: write d1/d14/d10b/d26/d1c/d79/d92/dc6/f125 [1462990,105560] 0 2024-09-13T02:54:22.775 INFO:tasks.workunit.client.1.smithi131.stdout:6/934: mkdir d1/d14/d10b/d26/dbd/ddf/d142 0 2024-09-13T02:54:22.775 INFO:tasks.workunit.client.1.smithi131.stdout:6/935: chown d1/d14/d10b/d26/d1c/d79/d120 978248 1 2024-09-13T02:54:22.783 INFO:tasks.workunit.client.1.smithi131.stdout:6/936: write d1/d14/d10b/d26/d1c/d4e/f81 [872485,31808] 0 2024-09-13T02:54:22.784 INFO:tasks.workunit.client.1.smithi131.stdout:6/937: link d1/d53/l124 d1/d8/d9/db/d40/dd4/l143 0 2024-09-13T02:54:22.785 INFO:tasks.workunit.client.1.smithi131.stdout:6/938: creat d1/d14/d10b/d26/dbd/d141/f144 x:0 0 0 2024-09-13T02:54:22.786 INFO:tasks.workunit.client.1.smithi131.stdout:5/824: dwrite d1/d5/f16 [0,4194304] 0 2024-09-13T02:54:22.787 INFO:tasks.workunit.client.1.smithi131.stdout:5/825: getdents d1/d29 0 2024-09-13T02:54:22.788 INFO:tasks.workunit.client.1.smithi131.stdout:5/826: mknod d1/d2f/d71/d109/c115 0 2024-09-13T02:54:22.788 INFO:tasks.workunit.client.1.smithi131.stdout:5/827: fsync d1/d21/d74/d78/d98/dc9/ff7 0 2024-09-13T02:54:22.797 INFO:tasks.workunit.client.1.smithi131.stdout:6/939: dread d1/d14/d10b/d26/d1c/d79/fdc [0,4194304] 0 2024-09-13T02:54:22.797 INFO:tasks.workunit.client.1.smithi131.stdout:6/940: truncate d1/d8/d9/db/d40/f63 130639 0 2024-09-13T02:54:22.803 INFO:tasks.workunit.client.1.smithi131.stdout:5/828: dwrite d1/d5/f16 [0,4194304] 0 2024-09-13T02:54:22.817 INFO:tasks.workunit.client.1.smithi131.stdout:5/829: dread d1/d5/f65 [0,4194304] 0 2024-09-13T02:54:22.819 INFO:tasks.workunit.client.1.smithi131.stdout:6/941: dwrite d1/d14/d10b/d26/f3a [0,4194304] 0 2024-09-13T02:54:22.821 INFO:tasks.workunit.client.1.smithi131.stdout:5/830: mkdir d1/d21/d74/d78/dbe/d116 0 2024-09-13T02:54:22.836 INFO:tasks.workunit.client.1.smithi131.stdout:5/831: read d1/d21/f51 [2521068,54872] 0 2024-09-13T02:54:22.836 INFO:tasks.workunit.client.1.smithi131.stdout:5/832: chown d1/d2f/cf9 113656 1 2024-09-13T02:54:22.836 INFO:tasks.workunit.client.1.smithi131.stdout:5/833: write d1/d21/d90/ff1 [2161288,42157] 0 2024-09-13T02:54:22.839 INFO:tasks.workunit.client.1.smithi131.stdout:6/942: dwrite d1/d14/d10b/d26/d1c/d79/d92/dc6/fca [0,4194304] 0 2024-09-13T02:54:22.839 INFO:tasks.workunit.client.1.smithi131.stdout:6/943: write d1/d8/d9/db/f68 [767164,117012] 0 2024-09-13T02:54:22.841 INFO:tasks.workunit.client.1.smithi131.stdout:6/944: symlink d1/d14/d10b/d26/d1c/d79/d92/l145 0 2024-09-13T02:54:22.843 INFO:tasks.workunit.client.1.smithi131.stdout:6/945: rmdir d1/d14/d10b/d26/dbd/d141 39 2024-09-13T02:54:22.845 INFO:tasks.workunit.client.1.smithi131.stdout:6/946: unlink d1/d53/f85 0 2024-09-13T02:54:22.846 INFO:tasks.workunit.client.1.smithi131.stdout:6/947: mknod d1/d8/d9/db/c146 0 2024-09-13T02:54:22.857 INFO:tasks.workunit.client.1.smithi131.stdout:5/834: dwrite d1/d9c/dd1/f106 [0,4194304] 0 2024-09-13T02:54:22.857 INFO:tasks.workunit.client.1.smithi131.stdout:5/835: fdatasync d1/d29/d39/f9e 0 2024-09-13T02:54:22.857 INFO:tasks.workunit.client.1.smithi131.stdout:5/836: creat d1/d1c/d87/dbd/dca/f117 x:0 0 0 2024-09-13T02:54:22.857 INFO:tasks.workunit.client.1.smithi131.stdout:6/948: dread d1/d14/d10b/d26/d1c/d79/d92/dc6/ffc [0,4194304] 0 2024-09-13T02:54:22.860 INFO:tasks.workunit.client.1.smithi131.stdout:5/837: mknod d1/d5/c118 0 2024-09-13T02:54:22.863 INFO:tasks.workunit.client.1.smithi131.stdout:5/838: mkdir d1/d1c/d87/dbd/dca/d119 0 2024-09-13T02:54:22.863 INFO:tasks.workunit.client.1.smithi131.stdout:5/839: chown d1/d29/c30 0 1 2024-09-13T02:54:22.863 INFO:tasks.workunit.client.1.smithi131.stdout:5/840: truncate d1/d21/f84 1188554 0 2024-09-13T02:54:22.863 INFO:tasks.workunit.client.1.smithi131.stdout:5/841: chown d1/d1c/d87/db8/fdc 617652 1 2024-09-13T02:54:22.880 INFO:tasks.workunit.client.1.smithi131.stdout:6/949: dwrite d1/d106/ff0 [0,4194304] 0 2024-09-13T02:54:22.899 INFO:tasks.workunit.client.1.smithi131.stdout:6/950: dwrite d1/d14/d10b/d26/d1c/d79/d92/dc6/f125 [0,4194304] 0 2024-09-13T02:54:22.918 INFO:tasks.workunit.client.1.smithi131.stdout:6/951: dwrite d1/d14/d10b/d26/d1c/d79/d92/dc6/fcb [0,4194304] 0 2024-09-13T02:54:22.925 INFO:tasks.workunit.client.1.smithi131.stdout:6/952: write d1/d14/d10b/d26/d1c/d79/d92/dc6/ffc [1527336,25137] 0 2024-09-13T02:54:22.925 INFO:tasks.workunit.client.1.smithi131.stdout:6/953: write d1/d8/d9/d8d/f103 [243299,9062] 0 2024-09-13T02:54:22.933 INFO:tasks.workunit.client.1.smithi131.stdout:6/954: write d1/d14/f5f [228145,93214] 0 2024-09-13T02:54:22.934 INFO:tasks.workunit.client.1.smithi131.stdout:6/955: rmdir d1/d8/d9/db8/d126/d12b/d13a 0 2024-09-13T02:54:22.953 INFO:tasks.workunit.client.1.smithi131.stdout:6/956: dwrite d1/d8/d9/d8d/ff5 [0,4194304] 0 2024-09-13T02:54:22.956 INFO:tasks.workunit.client.1.smithi131.stdout:6/957: symlink d1/d14/d10b/d26/dbd/ddf/l147 0 2024-09-13T02:54:22.956 INFO:tasks.workunit.client.1.smithi131.stdout:6/958: write d1/d8/d9/db/d40/f9d [3414679,5786] 0 2024-09-13T02:54:22.963 INFO:tasks.workunit.client.1.smithi131.stdout:1/962: sync 2024-09-13T02:54:22.963 INFO:tasks.workunit.client.1.smithi131.stdout:1/963: chown dd/d26/d44/ff5 4797 1 2024-09-13T02:54:22.963 INFO:tasks.workunit.client.1.smithi131.stdout:1/964: creat dd/d51/d8a/d107/f15d x:0 0 0 2024-09-13T02:54:22.965 INFO:tasks.workunit.client.1.smithi131.stdout:1/965: unlink dd/d33/d42/d47/l82 0 2024-09-13T02:54:22.965 INFO:tasks.workunit.client.1.smithi131.stdout:1/966: chown dd/d33/lae 36945604 1 2024-09-13T02:54:22.973 INFO:tasks.workunit.client.1.smithi131.stdout:6/959: dwrite d1/d14/d10b/d26/d1c/d79/d92/dc6/ffc [0,4194304] 0 2024-09-13T02:54:22.973 INFO:tasks.workunit.client.1.smithi131.stdout:1/967: dread dd/d33/d42/d47/ff3 [0,4194304] 0 2024-09-13T02:54:22.974 INFO:tasks.workunit.client.1.smithi131.stdout:1/968: chown dd/d33/d42/d47/c4d 1275053 1 2024-09-13T02:54:22.974 INFO:tasks.workunit.client.1.smithi131.stdout:6/960: rename d1/d8/d9/l46 to d1/d8/d9/db8/d126/l148 0 2024-09-13T02:54:22.975 INFO:tasks.workunit.client.1.smithi131.stdout:1/969: mkdir dd/d33/d94/dfb/d15e 0 2024-09-13T02:54:22.976 INFO:tasks.workunit.client.1.smithi131.stdout:6/961: rename d1/d8/d9/db/c146 to d1/d14/d10b/d26/dd1/c149 0 2024-09-13T02:54:22.977 INFO:tasks.workunit.client.1.smithi131.stdout:1/970: creat dd/f15f x:0 0 0 2024-09-13T02:54:22.978 INFO:tasks.workunit.client.1.smithi131.stdout:1/971: getdents dd/d51/d8a 0 2024-09-13T02:54:22.979 INFO:tasks.workunit.client.1.smithi131.stdout:1/972: creat dd/d51/d5a/d114/f160 x:0 0 0 2024-09-13T02:54:22.980 INFO:tasks.workunit.client.1.smithi131.stdout:1/973: truncate dd/d26/d44/ff5 3237639 0 2024-09-13T02:54:22.980 INFO:tasks.workunit.client.1.smithi131.stdout:1/974: fdatasync dd/d33/d42/d47/fd5 0 2024-09-13T02:54:22.980 INFO:tasks.workunit.client.1.smithi131.stdout:1/975: dread - dd/d51/d5a/d114/f160 zero size 2024-09-13T02:54:22.984 INFO:tasks.workunit.client.1.smithi131.stdout:6/962: read d1/d8/fa7 [2855930,51662] 0 2024-09-13T02:54:22.985 INFO:tasks.workunit.client.1.smithi131.stdout:1/976: write dd/d26/d44/f22 [7793228,116194] 0 2024-09-13T02:54:23.008 INFO:tasks.workunit.client.1.smithi131.stdout:1/977: dwrite dd/d51/f11e [0,4194304] 0 2024-09-13T02:54:23.009 INFO:tasks.workunit.client.1.smithi131.stdout:1/978: readlink dd/d33/d42/d47/dd1/d10a/l135 0 2024-09-13T02:54:23.009 INFO:tasks.workunit.client.1.smithi131.stdout:6/963: dwrite d1/d8/fa7 [0,4194304] 0 2024-09-13T02:54:23.010 INFO:tasks.workunit.client.1.smithi131.stdout:1/979: rename dd/d51/d5a/da3 to dd/d26/d7d/d11b/d161 0 2024-09-13T02:54:23.012 INFO:tasks.workunit.client.1.smithi131.stdout:1/980: unlink dd/d33/d42/d47/dd1/d10a/d129/f111 0 2024-09-13T02:54:23.012 INFO:tasks.workunit.client.1.smithi131.stdout:1/981: chown dd/d51/l12c 13761855 1 2024-09-13T02:54:23.014 INFO:tasks.workunit.client.1.smithi131.stdout:1/982: rename dd/d26/d2a/d2c/d4b/f5b to dd/d51/d8a/d148/f162 0 2024-09-13T02:54:23.032 INFO:tasks.workunit.client.1.smithi131.stdout:6/964: dwrite d1/d106/fd2 [12582912,4194304] 0 2024-09-13T02:54:23.032 INFO:tasks.workunit.client.1.smithi131.stdout:1/983: dwrite dd/d26/d2a/d69/fe6 [0,4194304] 0 2024-09-13T02:54:23.032 INFO:tasks.workunit.client.1.smithi131.stdout:1/984: creat dd/d33/d42/d47/d12f/f163 x:0 0 0 2024-09-13T02:54:23.033 INFO:tasks.workunit.client.1.smithi131.stdout:6/965: mkdir d1/d8/d9/d4b/d129/d14a 0 2024-09-13T02:54:23.034 INFO:tasks.workunit.client.1.smithi131.stdout:6/966: write d1/d14/d10b/dc2/f33 [312894,53318] 0 2024-09-13T02:54:23.034 INFO:tasks.workunit.client.1.smithi131.stdout:1/985: mknod dd/d33/d42/d47/dd1/d10a/d129/c164 0 2024-09-13T02:54:23.035 INFO:tasks.workunit.client.1.smithi131.stdout:6/967: unlink d1/d14/d10b/d26/d1c/c2f 0 2024-09-13T02:54:23.036 INFO:tasks.workunit.client.1.smithi131.stdout:1/986: creat dd/d33/d94/dfb/d15e/f165 x:0 0 0 2024-09-13T02:54:23.037 INFO:tasks.workunit.client.1.smithi131.stdout:1/987: chown dd/d26/d44/d6d/d7c/fab 112 1 2024-09-13T02:54:23.038 INFO:tasks.workunit.client.1.smithi131.stdout:1/988: rename dd/d26/f8d to dd/d33/d42/d47/dd1/f166 0 2024-09-13T02:54:23.045 INFO:tasks.workunit.client.1.smithi131.stdout:6/968: read d1/d14/d10b/d26/f3a [3698797,25184] 0 2024-09-13T02:54:23.045 INFO:tasks.workunit.client.1.smithi131.stdout:6/969: write d1/d14/d10b/d26/d1c/d79/d92/dc6/f125 [5045142,71067] 0 2024-09-13T02:54:23.047 INFO:tasks.workunit.client.1.smithi131.stdout:1/989: dread dd/f15 [0,4194304] 0 2024-09-13T02:54:23.047 INFO:tasks.workunit.client.1.smithi131.stdout:1/990: chown dd/d26/f12b 186849133 1 2024-09-13T02:54:23.049 INFO:tasks.workunit.client.1.smithi131.stdout:1/991: creat dd/d33/d42/d47/dd1/d101/f167 x:0 0 0 2024-09-13T02:54:23.049 INFO:tasks.workunit.client.1.smithi131.stdout:1/992: truncate dd/d26/d2a/d2c/d4b/f12e 793842 0 2024-09-13T02:54:23.049 INFO:tasks.workunit.client.1.smithi131.stdout:1/993: write dd/d26/d2a/d69/fe6 [4582481,69581] 0 2024-09-13T02:54:23.050 INFO:tasks.workunit.client.1.smithi131.stdout:1/994: link dd/d33/d94/dfb/d15e/f165 dd/d33/d94/d122/f168 0 2024-09-13T02:54:23.051 INFO:tasks.workunit.client.1.smithi131.stdout:1/995: creat dd/d33/d42/d47/f169 x:0 0 0 2024-09-13T02:54:23.053 INFO:tasks.workunit.client.1.smithi131.stdout:1/996: dread dd/d51/fdf [0,4194304] 0 2024-09-13T02:54:23.053 INFO:tasks.workunit.client.1.smithi131.stdout:1/997: write dd/d26/d2a/d2c/d4b/f104 [630744,34] 0 2024-09-13T02:54:23.056 INFO:tasks.workunit.client.1.smithi131.stdout:7/820: sync 2024-09-13T02:54:23.056 INFO:tasks.workunit.client.1.smithi131.stdout:7/821: link d1b/d3b/d31/d7c/db7/l103 d1b/d3b/d46/d4b/d57/l10d 0 2024-09-13T02:54:23.059 INFO:tasks.workunit.client.1.smithi131.stdout:7/822: creat d1b/d3b/d51/d62/f10e x:0 0 0 2024-09-13T02:54:23.059 INFO:tasks.workunit.client.1.smithi131.stdout:7/823: getdents d1b/d3b/d46/d10c 0 2024-09-13T02:54:23.064 INFO:tasks.workunit.client.1.smithi131.stdout:7/824: dread d1b/d3b/d51/fbe [0,4194304] 0 2024-09-13T02:54:23.081 INFO:tasks.workunit.client.1.smithi131.stdout:1/998: dwrite dd/d26/d44/d6d/d7c/faf [0,4194304] 0 2024-09-13T02:54:23.081 INFO:tasks.workunit.client.1.smithi131.stdout:6/970: dwrite d1/d14/d10b/d26/d1c/d4e/fcd [0,4194304] 0 2024-09-13T02:54:23.081 INFO:tasks.workunit.client.1.smithi131.stdout:6/971: fsync d1/d14/f7c 0 2024-09-13T02:54:23.082 INFO:tasks.workunit.client.1.smithi131.stdout:6/972: dread - d1/f136 zero size 2024-09-13T02:54:23.082 INFO:tasks.workunit.client.1.smithi131.stdout:7/825: dwrite d1b/d3b/d31/d5f/f79 [4194304,4194304] 0 2024-09-13T02:54:23.082 INFO:tasks.workunit.client.1.smithi131.stdout:7/826: dread - d1b/d3b/d51/d8b/fca zero size 2024-09-13T02:54:23.082 INFO:tasks.workunit.client.1.smithi131.stdout:7/827: chown d1b/d23/d89/dbd 74131452 1 2024-09-13T02:54:23.082 INFO:tasks.workunit.client.1.smithi131.stdout:7/828: readlink d1b/d3b/d31/d38/ld6 0 2024-09-13T02:54:23.083 INFO:tasks.workunit.client.1.smithi131.stdout:1/999: symlink dd/d26/d44/d6d/d7c/l16a 0 2024-09-13T02:54:23.084 INFO:tasks.workunit.client.1.smithi131.stdout:6/973: mkdir d1/d14/d10b/d26/d1c/d79/d120/d14b 0 2024-09-13T02:54:23.085 INFO:tasks.workunit.client.1.smithi131.stdout:6/974: symlink d1/d8/d9/db/d40/dd4/df7/l14c 0 2024-09-13T02:54:23.086 INFO:tasks.workunit.client.1.smithi131.stdout:6/975: link d1/d14/d10b/d26/d1c/d4e/le1 d1/d106/d131/l14d 0 2024-09-13T02:54:23.087 INFO:tasks.workunit.client.1.smithi131.stdout:6/976: mkdir d1/d8/d14e 0 2024-09-13T02:54:23.088 INFO:tasks.workunit.client.1.smithi131.stdout:6/977: dread d1/d14/d10b/d26/f91 [0,4194304] 0 2024-09-13T02:54:23.089 INFO:tasks.workunit.client.1.smithi131.stdout:6/978: dread d1/d8/d9/db/fb2 [0,4194304] 0 2024-09-13T02:54:23.093 INFO:tasks.workunit.client.1.smithi131.stdout:6/979: write d1/d14/d10b/dc2/d3b/fb9 [2866214,93460] 0 2024-09-13T02:54:23.101 INFO:tasks.workunit.client.1.smithi131.stdout:6/980: dread d1/d8/d9/db/d40/fc0 [0,4194304] 0 2024-09-13T02:54:23.116 INFO:tasks.workunit.client.1.smithi131.stdout:6/981: dwrite d1/d106/dd9/ffe [0,4194304] 0 2024-09-13T02:54:23.122 INFO:tasks.workunit.client.1.smithi131.stdout:9/892: sync 2024-09-13T02:54:23.123 INFO:tasks.workunit.client.1.smithi131.stdout:3/807: sync 2024-09-13T02:54:23.123 INFO:tasks.workunit.client.1.smithi131.stdout:5/842: sync 2024-09-13T02:54:23.123 INFO:tasks.workunit.client.1.smithi131.stdout:2/884: sync 2024-09-13T02:54:23.123 INFO:tasks.workunit.client.1.smithi131.stdout:0/994: sync 2024-09-13T02:54:23.123 INFO:tasks.workunit.client.1.smithi131.stdout:4/985: sync 2024-09-13T02:54:23.123 INFO:tasks.workunit.client.1.smithi131.stdout:4/986: chown d1/d18/d43/d65/f112 1176 1 2024-09-13T02:54:23.123 INFO:tasks.workunit.client.1.smithi131.stdout:3/808: creat d2/d4/d1a/d31/f112 x:0 0 0 2024-09-13T02:54:23.123 INFO:tasks.workunit.client.1.smithi131.stdout:4/987: read - d1/d18/d43/d97/dba/d22/d49/f127 zero size 2024-09-13T02:54:23.123 INFO:tasks.workunit.client.1.smithi131.stdout:3/809: stat d2/dc/fa8 0 2024-09-13T02:54:23.123 INFO:tasks.workunit.client.1.smithi131.stdout:4/988: fdatasync d1/d18/d81/fb8 0 2024-09-13T02:54:23.123 INFO:tasks.workunit.client.1.smithi131.stdout:4/989: write d1/d18/d34/d4e/d108/d8d/ffe [134223,59770] 0 2024-09-13T02:54:23.123 INFO:tasks.workunit.client.1.smithi131.stdout:4/990: write d1/d18/d81/f8a [1770450,64812] 0 2024-09-13T02:54:23.124 INFO:tasks.workunit.client.1.smithi131.stdout:2/885: link d5/d31/d1d/d32/d3b/d67/c120 d5/d31/d1d/d37/d112/d114/db4/dbc/ddf/c138 0 2024-09-13T02:54:23.124 INFO:tasks.workunit.client.1.smithi131.stdout:2/886: write d5/d31/d1d/d37/d112/d114/db4/fcd [3498269,43197] 0 2024-09-13T02:54:23.125 INFO:tasks.workunit.client.1.smithi131.stdout:5/843: mknod d1/d21/d74/d78/d98/dc9/c11a 0 2024-09-13T02:54:23.125 INFO:tasks.workunit.client.1.smithi131.stdout:5/844: fdatasync d1/fc6 0 2024-09-13T02:54:23.125 INFO:tasks.workunit.client.1.smithi131.stdout:9/893: creat d0/d4d/d55/d76/d96/f136 x:0 0 0 2024-09-13T02:54:23.127 INFO:tasks.workunit.client.1.smithi131.stdout:3/810: rename d2/d4/d76/d9f/d41/d5c/d49/f4a to d2/dc/db1/dca/f113 0 2024-09-13T02:54:23.127 INFO:tasks.workunit.client.1.smithi131.stdout:3/811: write d2/d4/d7/d1d/d24/d6f/f70 [3527329,127682] 0 2024-09-13T02:54:23.127 INFO:tasks.workunit.client.1.smithi131.stdout:2/887: rmdir d5/d31/d1d/d32 39 2024-09-13T02:54:23.129 INFO:tasks.workunit.client.1.smithi131.stdout:5/845: symlink d1/d21/d90/l11b 0 2024-09-13T02:54:23.129 INFO:tasks.workunit.client.1.smithi131.stdout:9/894: creat d0/d4d/d55/d76/d96/d118/d14/d67/dc0/de7/f137 x:0 0 0 2024-09-13T02:54:23.130 INFO:tasks.workunit.client.1.smithi131.stdout:4/991: symlink d1/d18/d34/d62/d78/db6/l150 0 2024-09-13T02:54:23.131 INFO:tasks.workunit.client.1.smithi131.stdout:9/895: creat d0/d4d/d55/d76/d96/d118/d14/d17/f138 x:0 0 0 2024-09-13T02:54:23.131 INFO:tasks.workunit.client.1.smithi131.stdout:9/896: chown d0/d4d/d55/d76/d96/d118/d14/c97 0 1 2024-09-13T02:54:23.131 INFO:tasks.workunit.client.1.smithi131.stdout:9/897: write d0/d4d/d55/d76/d96/d118/d14/dbf/d122/d2a/fa6 [982398,80704] 0 2024-09-13T02:54:23.131 INFO:tasks.workunit.client.1.smithi131.stdout:4/992: symlink d1/d18/d34/d62/da3/l151 0 2024-09-13T02:54:23.131 INFO:tasks.workunit.client.1.smithi131.stdout:4/993: stat d1/d18/d34/d62/d78/ffb 0 2024-09-13T02:54:23.132 INFO:tasks.workunit.client.1.smithi131.stdout:9/898: rmdir d0/d4d/d55/d76/d96/d118/d14/dbf/d122/dc6/de5 39 2024-09-13T02:54:23.132 INFO:tasks.workunit.client.1.smithi131.stdout:9/899: stat d0/d4d/d55/d76/d96/d118/l86 0 2024-09-13T02:54:23.132 INFO:tasks.workunit.client.1.smithi131.stdout:4/994: truncate d1/d18/d43/d65/dbd/dc1/f2f 1949125 0 2024-09-13T02:54:23.133 INFO:tasks.workunit.client.1.smithi131.stdout:9/900: mkdir d0/d4d/d55/d76/d96/d118/d14/dbf/d122/d2a/d5e/da2/d39/dae/d135/d139 0 2024-09-13T02:54:23.133 INFO:tasks.workunit.client.1.smithi131.stdout:9/901: fdatasync d0/d4d/d55/d76/d96/d118/d14/dbf/d122/d2a/fb2 0 2024-09-13T02:54:23.134 INFO:tasks.workunit.client.1.smithi131.stdout:0/995: dread d0/de/d1f/d22/d31/d39/d67/f69 [0,4194304] 0 2024-09-13T02:54:23.135 INFO:tasks.workunit.client.1.smithi131.stdout:6/982: dwrite d1/d8/d9/d4b/f94 [0,4194304] 0 2024-09-13T02:54:23.135 INFO:tasks.workunit.client.1.smithi131.stdout:5/846: dread d1/d21/d74/d78/d98/ded/f75 [0,4194304] 0 2024-09-13T02:54:23.135 INFO:tasks.workunit.client.1.smithi131.stdout:9/902: mkdir d0/d4d/d13a 0 2024-09-13T02:54:23.135 INFO:tasks.workunit.client.1.smithi131.stdout:4/995: mknod d1/d18/d34/d62/d78/c152 0 2024-09-13T02:54:23.137 INFO:tasks.workunit.client.1.smithi131.stdout:3/812: dread d2/d4/d1a/d31/f108 [0,4194304] 0 2024-09-13T02:54:23.139 INFO:tasks.workunit.client.1.smithi131.stdout:6/983: mkdir d1/d14/d10b/d26/dbd/ddf/d128/d14f 0 2024-09-13T02:54:23.139 INFO:tasks.workunit.client.1.smithi131.stdout:6/984: readlink d1/d14/da2/lb3 0 2024-09-13T02:54:23.139 INFO:tasks.workunit.client.1.smithi131.stdout:6/985: chown d1/d14/d10b/dc2/d3b/dd0/l137 24009 1 2024-09-13T02:54:23.139 INFO:tasks.workunit.client.1.smithi131.stdout:5/847: symlink d1/d21/d74/d78/dbe/d116/l11c 0 2024-09-13T02:54:23.139 INFO:tasks.workunit.client.1.smithi131.stdout:5/848: write d1/d5/d57/d60/fa2 [3178315,79259] 0 2024-09-13T02:54:23.139 INFO:tasks.workunit.client.1.smithi131.stdout:5/849: truncate d1/d21/d74/d78/d98/fa8 4630761 0 2024-09-13T02:54:23.139 INFO:tasks.workunit.client.1.smithi131.stdout:5/850: creat d1/d21/f11d x:0 0 0 2024-09-13T02:54:23.140 INFO:tasks.workunit.client.1.smithi131.stdout:9/903: creat d0/d4d/d55/d76/d10f/f13b x:0 0 0 2024-09-13T02:54:23.140 INFO:tasks.workunit.client.1.smithi131.stdout:4/996: creat d1/d18/d34/d62/da3/ded/f153 x:0 0 0 2024-09-13T02:54:23.144 INFO:tasks.workunit.client.1.smithi131.stdout:5/851: rename d1/d21/d74/d78/d98/dc9/ff7 to d1/d21/d74/d78/d98/ded/f11e 0 2024-09-13T02:54:23.145 INFO:tasks.workunit.client.1.smithi131.stdout:0/996: dread d0/de/d1f/fbd [0,4194304] 0 2024-09-13T02:54:23.145 INFO:tasks.workunit.client.1.smithi131.stdout:0/997: write d0/de/d1f/d22/d31/d39/d67/db5/d113/f147 [348207,101545] 0 2024-09-13T02:54:23.145 INFO:tasks.workunit.client.1.smithi131.stdout:0/998: fdatasync d0/de/d45/dfa/d119/f142 0 2024-09-13T02:54:23.145 INFO:tasks.workunit.client.1.smithi131.stdout:0/999: chown d0/de/d1f/d22/d3d/d55/d63/d94/da5/c12a 50745 1 2024-09-13T02:54:23.146 INFO:tasks.workunit.client.1.smithi131.stdout:9/904: creat d0/d4d/d55/d76/d96/d118/d14/dbf/d122/dc6/d70/f13c x:0 0 0 2024-09-13T02:54:23.147 INFO:tasks.workunit.client.1.smithi131.stdout:4/997: symlink d1/d18/d43/d65/dbd/l154 0 2024-09-13T02:54:23.149 INFO:tasks.workunit.client.1.smithi131.stdout:9/905: mkdir d0/d4d/d55/d76/d96/d118/d14/dbf/d122/d2a/d5e/da2/d13d 0 2024-09-13T02:54:23.151 INFO:tasks.workunit.client.1.smithi131.stdout:4/998: creat d1/d18/d34/d4e/d108/d8d/ddf/f155 x:0 0 0 2024-09-13T02:54:23.151 INFO:tasks.workunit.client.1.smithi131.stdout:4/999: chown d1/d18/d34/d4e/d108 96058441 1 2024-09-13T02:54:23.153 INFO:tasks.workunit.client.1.smithi131.stdout:3/813: read d2/d4/d1a/d31/d48/f77 [2747214,2964] 0 2024-09-13T02:54:23.153 INFO:tasks.workunit.client.1.smithi131.stdout:3/814: read - d2/d4/d76/d9f/d41/d5c/d71/ff4 zero size 2024-09-13T02:54:23.153 INFO:tasks.workunit.client.1.smithi131.stdout:3/815: write d2/d4/d1a/d31/d48/f77 [742347,97387] 0 2024-09-13T02:54:23.154 INFO:tasks.workunit.client.1.smithi131.stdout:2/888: dwrite d5/d31/ff [0,4194304] 0 2024-09-13T02:54:23.155 INFO:tasks.workunit.client.1.smithi131.stdout:3/816: mknod d2/d4/d7/d1d/d80/dde/c114 0 2024-09-13T02:54:23.157 INFO:tasks.workunit.client.1.smithi131.stdout:2/889: mkdir d5/d31/d1d/d32/d3b/d67/d139 0 2024-09-13T02:54:23.157 INFO:tasks.workunit.client.1.smithi131.stdout:6/986: dread d1/d14/d10b/d26/d1c/d79/d92/dc6/f125 [0,4194304] 0 2024-09-13T02:54:23.157 INFO:tasks.workunit.client.1.smithi131.stdout:6/987: fsync d1/d53/ffd 0 2024-09-13T02:54:23.157 INFO:tasks.workunit.client.1.smithi131.stdout:3/817: creat d2/d4/d2d/f115 x:0 0 0 2024-09-13T02:54:23.157 INFO:tasks.workunit.client.1.smithi131.stdout:3/818: write d2/d4/d7/d1d/d24/d6f/d7f/f88 [1520605,99584] 0 2024-09-13T02:54:23.160 INFO:tasks.workunit.client.1.smithi131.stdout:3/819: mknod d2/d4/d7/d1d/d24/d6f/df5/c116 0 2024-09-13T02:54:23.160 INFO:tasks.workunit.client.1.smithi131.stdout:5/852: dread d1/d5/f65 [0,4194304] 0 2024-09-13T02:54:23.161 INFO:tasks.workunit.client.1.smithi131.stdout:6/988: dread d1/d8/d9/db/d40/fc7 [0,4194304] 0 2024-09-13T02:54:23.161 INFO:tasks.workunit.client.1.smithi131.stdout:5/853: link d1/d21/d22/l2d d1/d21/db7/l11f 0 2024-09-13T02:54:23.161 INFO:tasks.workunit.client.1.smithi131.stdout:5/854: creat d1/d21/d74/d78/f120 x:0 0 0 2024-09-13T02:54:23.162 INFO:tasks.workunit.client.1.smithi131.stdout:6/989: rename d1/d106 to d1/d8/d14e/d150 0 2024-09-13T02:54:23.162 INFO:tasks.workunit.client.1.smithi131.stdout:6/990: chown d1/d8/d9/d4b/d129 2018 1 2024-09-13T02:54:23.163 INFO:tasks.workunit.client.1.smithi131.stdout:5/855: truncate d1/d21/f6d 698965 0 2024-09-13T02:54:23.163 INFO:tasks.workunit.client.1.smithi131.stdout:5/856: fdatasync d1/d29/d39/f9e 0 2024-09-13T02:54:23.164 INFO:tasks.workunit.client.1.smithi131.stdout:6/991: mkdir d1/d14/d10b/dc2/d3b/dd0/d151 0 2024-09-13T02:54:23.164 INFO:tasks.workunit.client.1.smithi131.stdout:6/992: fdatasync d1/d8/d9/db/fb2 0 2024-09-13T02:54:23.165 INFO:tasks.workunit.client.1.smithi131.stdout:6/993: mknod d1/d14/d10b/d26/dbd/ddf/d128/c152 0 2024-09-13T02:54:23.166 INFO:tasks.workunit.client.1.smithi131.stdout:6/994: rename d1/d14/d10b/d26/d1c/d79/d120/d14b to d1/d8/d9/db/d40/d153 0 2024-09-13T02:54:23.166 INFO:tasks.workunit.client.1.smithi131.stdout:6/995: symlink d1/d14/d10b/d26/dbd/d141/l154 0 2024-09-13T02:54:23.167 INFO:tasks.workunit.client.1.smithi131.stdout:6/996: rmdir d1/d53/d107 39 2024-09-13T02:54:23.167 INFO:tasks.workunit.client.1.smithi131.stdout:6/997: write d1/d14/d10b/dc2/f6b [1416203,108235] 0 2024-09-13T02:54:23.174 INFO:tasks.workunit.client.1.smithi131.stdout:9/906: dwrite d0/d4d/d55/d76/d96/d118/d14/d17/d107/f125 [0,4194304] 0 2024-09-13T02:54:23.176 INFO:tasks.workunit.client.1.smithi131.stdout:3/820: dread d2/d4/d76/d9f/f6a [0,4194304] 0 2024-09-13T02:54:23.178 INFO:tasks.workunit.client.1.smithi131.stdout:3/821: rmdir d2/d4/d2d/dce/dc4 39 2024-09-13T02:54:23.178 INFO:tasks.workunit.client.1.smithi131.stdout:2/890: dread d5/d31/d26/d8d/fa1 [0,4194304] 0 2024-09-13T02:54:23.180 INFO:tasks.workunit.client.1.smithi131.stdout:3/822: creat d2/dfb/f117 x:0 0 0 2024-09-13T02:54:23.180 INFO:tasks.workunit.client.1.smithi131.stdout:3/823: creat d2/d4/d1a/d31/d48/d69/f118 x:0 0 0 2024-09-13T02:54:23.180 INFO:tasks.workunit.client.1.smithi131.stdout:3/824: chown d2/d4/d7 8377401 1 2024-09-13T02:54:23.181 INFO:tasks.workunit.client.1.smithi131.stdout:3/825: write d2/d4/d1a/d31/d48/f77 [3351264,127156] 0 2024-09-13T02:54:23.196 INFO:tasks.workunit.client.1.smithi131.stdout:5/857: dwrite d1/fc6 [0,4194304] 0 2024-09-13T02:54:23.198 INFO:tasks.workunit.client.1.smithi131.stdout:9/907: dwrite d0/d4d/d55/d76/d96/f136 [0,4194304] 0 2024-09-13T02:54:23.203 INFO:tasks.workunit.client.1.smithi131.stdout:9/908: mknod d0/d4d/d55/d76/d96/d118/d14/d17/db0/dfc/c13e 0 2024-09-13T02:54:23.210 INFO:tasks.workunit.client.1.smithi131.stdout:5/858: dread d1/d21/d74/d78/d98/ded/f81 [0,4194304] 0 2024-09-13T02:54:23.211 INFO:tasks.workunit.client.1.smithi131.stdout:5/859: readlink d1/d2f/d4f/lbb 0 2024-09-13T02:54:23.212 INFO:tasks.workunit.client.1.smithi131.stdout:5/860: getdents d1/d21/d74/d78/d98/ded 0 2024-09-13T02:54:23.213 INFO:tasks.workunit.client.1.smithi131.stdout:5/861: mknod d1/d50/c121 0 2024-09-13T02:54:23.213 INFO:tasks.workunit.client.1.smithi131.stdout:5/862: write d1/d29/d39/fcc [668920,51704] 0 2024-09-13T02:54:23.214 INFO:tasks.workunit.client.1.smithi131.stdout:5/863: creat d1/d5/f122 x:0 0 0 2024-09-13T02:54:23.215 INFO:tasks.workunit.client.1.smithi131.stdout:5/864: symlink d1/d21/d74/d78/d98/l123 0 2024-09-13T02:54:23.215 INFO:tasks.workunit.client.1.smithi131.stdout:5/865: fdatasync d1/d21/f11d 0 2024-09-13T02:54:23.217 INFO:tasks.workunit.client.1.smithi131.stdout:2/891: dwrite d5/d31/d26/f77 [0,4194304] 0 2024-09-13T02:54:23.217 INFO:tasks.workunit.client.1.smithi131.stdout:3/826: dwrite d2/d4/d2d/f102 [0,4194304] 0 2024-09-13T02:54:23.217 INFO:tasks.workunit.client.1.smithi131.stdout:9/909: read d0/d4d/d98/fdf [196538,70952] 0 2024-09-13T02:54:23.218 INFO:tasks.workunit.client.1.smithi131.stdout:2/892: write d5/d31/d1d/d37/d112/d114/db4/dbc/d48/d4c/db1/fc5 [412963,87093] 0 2024-09-13T02:54:23.218 INFO:tasks.workunit.client.1.smithi131.stdout:5/866: rmdir d1/d9c 39 2024-09-13T02:54:23.222 INFO:tasks.workunit.client.1.smithi131.stdout:9/910: rename d0/d4d/d55/d76/d96/d118/d14/dbf/d122/d2a/d5e/da2/f6a to d0/d4d/d55/d76/d96/d118/d14/d17/db0/dfc/f13f 0 2024-09-13T02:54:23.227 INFO:tasks.workunit.client.1.smithi131.stdout:3/827: dread d2/d4/f84 [0,4194304] 0 2024-09-13T02:54:23.229 INFO:tasks.workunit.client.1.smithi131.stdout:3/828: mknod d2/d4/d7/d1d/d24/d6f/df5/c119 0 2024-09-13T02:54:23.229 INFO:tasks.workunit.client.1.smithi131.stdout:3/829: write d2/d4/d7/d1d/f21 [1089607,92196] 0 2024-09-13T02:54:23.232 INFO:tasks.workunit.client.1.smithi131.stdout:3/830: truncate d2/d4/d1a/f37 619550 0 2024-09-13T02:54:23.232 INFO:tasks.workunit.client.1.smithi131.stdout:3/831: chown d2/dc/d39/f110 16180105 1 2024-09-13T02:54:23.244 INFO:tasks.workunit.client.1.smithi131.stdout:2/893: dwrite d5/d18/d68/de3/d66/fe4 [0,4194304] 0 2024-09-13T02:54:23.246 INFO:tasks.workunit.client.1.smithi131.stdout:2/894: mkdir d5/d13a 0 2024-09-13T02:54:23.254 INFO:tasks.workunit.client.1.smithi131.stdout:5/867: dwrite d1/d5/d57/f7c [0,4194304] 0 2024-09-13T02:54:23.254 INFO:tasks.workunit.client.1.smithi131.stdout:3/832: dwrite d2/d4/d2d/dce/dc4/f10a [0,4194304] 0 2024-09-13T02:54:23.254 INFO:tasks.workunit.client.1.smithi131.stdout:3/833: chown d2/d4/d7/d1d 109754 1 2024-09-13T02:54:23.255 INFO:tasks.workunit.client.1.smithi131.stdout:3/834: write d2/d4/d7/d1d/d80/dde/fbc [64677,46457] 0 2024-09-13T02:54:23.256 INFO:tasks.workunit.client.1.smithi131.stdout:3/835: dread - d2/d4/d76/dc1/ff2 zero size 2024-09-13T02:54:23.256 INFO:tasks.workunit.client.1.smithi131.stdout:3/836: write d2/dc/db1/dca/f113 [3030680,17715] 0 2024-09-13T02:54:23.257 INFO:tasks.workunit.client.1.smithi131.stdout:3/837: getdents d2/d4/d7/d1d/d24/d96 0 2024-09-13T02:54:23.266 INFO:tasks.workunit.client.1.smithi131.stdout:2/895: dwrite d5/d18/d4b/fdd [0,4194304] 0 2024-09-13T02:54:23.266 INFO:tasks.workunit.client.1.smithi131.stdout:2/896: stat d5/d34/d42/led 0 2024-09-13T02:54:23.273 INFO:tasks.workunit.client.1.smithi131.stdout:5/868: dwrite d1/d21/d90/df8/ffe [0,4194304] 0 2024-09-13T02:54:23.280 INFO:tasks.workunit.client.1.smithi131.stdout:5/869: dread d1/d21/d74/d78/d98/ded/f5b [0,4194304] 0 2024-09-13T02:54:23.286 INFO:tasks.workunit.client.1.smithi131.stdout:3/838: dwrite d2/d4/d7/d1d/d80/dde/fe1 [4194304,4194304] 0 2024-09-13T02:54:23.286 INFO:tasks.workunit.client.1.smithi131.stdout:3/839: chown d2/d4/db7/lba 1911385 1 2024-09-13T02:54:23.286 INFO:tasks.workunit.client.1.smithi131.stdout:3/840: chown d2/d4/d1a/d31/da7/fd4 45734441 1 2024-09-13T02:54:23.288 INFO:tasks.workunit.client.1.smithi131.stdout:2/897: dwrite d5/d31/d21/d57/fec [0,4194304] 0 2024-09-13T02:54:23.289 INFO:tasks.workunit.client.1.smithi131.stdout:5/870: write d1/d5/d57/d60/fa2 [2535373,5480] 0 2024-09-13T02:54:23.290 INFO:tasks.workunit.client.1.smithi131.stdout:2/898: mknod d5/d53/c13b 0 2024-09-13T02:54:23.291 INFO:tasks.workunit.client.1.smithi131.stdout:2/899: rmdir d5/d18/d68/de3/d66 39 2024-09-13T02:54:23.292 INFO:tasks.workunit.client.1.smithi131.stdout:2/900: truncate d5/d18/d4b/f89 430200 0 2024-09-13T02:54:23.294 INFO:tasks.workunit.client.1.smithi131.stdout:5/871: dread d1/d21/d74/fa7 [0,4194304] 0 2024-09-13T02:54:23.296 INFO:tasks.workunit.client.1.smithi131.stdout:2/901: dread d5/d31/d21/ffa [0,4194304] 0 2024-09-13T02:54:23.298 INFO:tasks.workunit.client.1.smithi131.stdout:2/902: link d5/d31/d1d/d32/d7d/fd0 d5/d31/d21/d57/d90/dc8/f13c 0 2024-09-13T02:54:23.299 INFO:tasks.workunit.client.1.smithi131.stdout:2/903: creat d5/d31/d1d/d37/d112/d114/db4/dbc/d48/f13d x:0 0 0 2024-09-13T02:54:23.299 INFO:tasks.workunit.client.1.smithi131.stdout:2/904: dread - d5/d31/d1d/d50/d10e/ff5 zero size 2024-09-13T02:54:23.305 INFO:tasks.workunit.client.1.smithi131.stdout:2/905: rmdir d5/d31/d21/d57/d90 39 2024-09-13T02:54:23.307 INFO:tasks.workunit.client.1.smithi131.stdout:2/906: symlink d5/d31/d1d/d37/l13e 0 2024-09-13T02:54:23.307 INFO:tasks.workunit.client.1.smithi131.stdout:2/907: chown d5/d18/d68/de3/d41/d132 892131 1 2024-09-13T02:54:23.307 INFO:tasks.workunit.client.1.smithi131.stdout:2/908: creat d5/d34/d42/f13f x:0 0 0 2024-09-13T02:54:23.307 INFO:tasks.workunit.client.1.smithi131.stdout:2/909: stat d5/d18/l15 0 2024-09-13T02:54:23.311 INFO:tasks.workunit.client.1.smithi131.stdout:5/872: dwrite d1/d1c/d87/dbd/dca/f117 [0,4194304] 0 2024-09-13T02:54:23.313 INFO:tasks.workunit.client.1.smithi131.stdout:5/873: mkdir d1/d1c/d87/dbd/dca/d119/d124 0 2024-09-13T02:54:23.313 INFO:tasks.workunit.client.1.smithi131.stdout:5/874: creat d1/d21/d74/f125 x:0 0 0 2024-09-13T02:54:23.314 INFO:tasks.workunit.client.1.smithi131.stdout:5/875: link d1/d1c/d8e/f52 d1/d29/f126 0 2024-09-13T02:54:23.314 INFO:tasks.workunit.client.1.smithi131.stdout:5/876: truncate d1/d21/d90/f10c 700473 0 2024-09-13T02:54:23.329 INFO:tasks.workunit.client.1.smithi131.stdout:5/877: dwrite d1/fc6 [0,4194304] 0 2024-09-13T02:54:23.329 INFO:tasks.workunit.client.1.smithi131.stdout:5/878: readlink d1/d21/d22/l54 0 2024-09-13T02:54:23.329 INFO:tasks.workunit.client.1.smithi131.stdout:5/879: truncate d1/d29/f126 3827983 0 2024-09-13T02:54:23.330 INFO:tasks.workunit.client.1.smithi131.stdout:5/880: mknod d1/d1c/d87/dbd/c127 0 2024-09-13T02:54:23.330 INFO:tasks.workunit.client.1.smithi131.stdout:5/881: write d1/d21/d74/faf [5064523,97582] 0 2024-09-13T02:54:23.331 INFO:tasks.workunit.client.1.smithi131.stdout:5/882: mknod d1/d9c/dd1/c128 0 2024-09-13T02:54:23.347 INFO:tasks.workunit.client.1.smithi131.stdout:5/883: dwrite d1/d5/d57/d60/fa2 [0,4194304] 0 2024-09-13T02:54:23.348 INFO:tasks.workunit.client.1.smithi131.stdout:5/884: truncate d1/d1c/d8e/f48 4020933 0 2024-09-13T02:54:23.372 INFO:tasks.workunit.client.1.smithi131.stdout:5/885: dwrite d1/d1c/d8e/f48 [0,4194304] 0 2024-09-13T02:54:23.372 INFO:tasks.workunit.client.1.smithi131.stdout:5/886: truncate d1/d2f/d4f/fbc 5337531 0 2024-09-13T02:54:23.373 INFO:tasks.workunit.client.1.smithi131.stdout:5/887: symlink d1/d21/d74/d78/d98/ded/l129 0 2024-09-13T02:54:23.385 INFO:tasks.workunit.client.1.smithi131.stdout:5/888: read d1/d2f/fc5 [114846,57758] 0 2024-09-13T02:54:23.386 INFO:tasks.workunit.client.1.smithi131.stdout:5/889: readlink d1/d21/db7/l11f 0 2024-09-13T02:54:23.386 INFO:tasks.workunit.client.1.smithi131.stdout:5/890: write d1/d29/f8d [1307307,2539] 0 2024-09-13T02:54:23.386 INFO:tasks.workunit.client.1.smithi131.stdout:5/891: write d1/d2f/f31 [2036480,88300] 0 2024-09-13T02:54:23.387 INFO:tasks.workunit.client.1.smithi131.stdout:5/892: link d1/d2f/d4f/cba d1/d2f/c12a 0 2024-09-13T02:54:23.387 INFO:tasks.workunit.client.1.smithi131.stdout:5/893: chown d1/d50/c121 290039391 1 2024-09-13T02:54:23.387 INFO:tasks.workunit.client.1.smithi131.stdout:5/894: stat d1/d1c/d8e 0 2024-09-13T02:54:23.387 INFO:tasks.workunit.client.1.smithi131.stdout:5/895: stat d1/d21/f25 0 2024-09-13T02:54:23.388 INFO:tasks.workunit.client.1.smithi131.stdout:5/896: mknod d1/d29/d39/c12b 0 2024-09-13T02:54:23.388 INFO:tasks.workunit.client.1.smithi131.stdout:5/897: creat d1/d1c/d87/dbd/dca/f12c x:0 0 0 2024-09-13T02:54:23.388 INFO:tasks.workunit.client.1.smithi131.stdout:5/898: write d1/d29/f8d [844207,61632] 0 2024-09-13T02:54:23.388 INFO:tasks.workunit.client.1.smithi131.stdout:5/899: link d1/d29/l8a d1/d21/d90/l12d 0 2024-09-13T02:54:23.394 INFO:tasks.workunit.client.1.smithi131.stdout:5/900: rename d1/d29 to d1/d9c/dd1/d12e 0 2024-09-13T02:54:23.394 INFO:tasks.workunit.client.1.smithi131.stdout:5/901: mknod d1/d50/c12f 0 2024-09-13T02:54:23.395 INFO:tasks.workunit.client.1.smithi131.stdout:5/902: mknod d1/d21/d90/df8/c130 0 2024-09-13T02:54:23.395 INFO:tasks.workunit.client.1.smithi131.stdout:5/903: write d1/d21/d74/d78/d98/dc9/f113 [682064,4525] 0 2024-09-13T02:54:23.421 INFO:tasks.workunit.client.1.smithi131.stdout:5/904: dwrite d1/d21/d90/fcf [0,4194304] 0 2024-09-13T02:54:23.421 INFO:tasks.workunit.client.1.smithi131.stdout:5/905: fdatasync d1/d21/d74/d78/d98/d107/f10d 0 2024-09-13T02:54:23.421 INFO:tasks.workunit.client.1.smithi131.stdout:5/906: write d1/d5/dcd/fd9 [126196,65150] 0 2024-09-13T02:54:23.422 INFO:tasks.workunit.client.1.smithi131.stdout:5/907: mknod d1/d1c/d87/dbd/dca/c131 0 2024-09-13T02:54:23.422 INFO:tasks.workunit.client.1.smithi131.stdout:5/908: write d1/d2f/fd3 [1657311,119491] 0 2024-09-13T02:54:23.427 INFO:tasks.workunit.client.1.smithi131.stdout:5/909: truncate d1/d21/d74/d78/d98/dc9/f113 249368 0 2024-09-13T02:54:23.427 INFO:tasks.workunit.client.1.smithi131.stdout:5/910: mkdir d1/d9c/d132 0 2024-09-13T02:54:23.435 INFO:tasks.workunit.client.1.smithi131.stdout:5/911: dread d1/d9c/dd1/d12e/f126 [0,4194304] 0 2024-09-13T02:54:23.435 INFO:tasks.workunit.client.1.smithi131.stdout:5/912: creat d1/f133 x:0 0 0 2024-09-13T02:54:23.437 INFO:tasks.workunit.client.1.smithi131.stdout:5/913: mknod d1/d21/d74/d78/d98/ded/c134 0 2024-09-13T02:54:23.544 INFO:tasks.workunit.client.1.smithi131.stdout:7/829: sync 2024-09-13T02:54:23.544 INFO:tasks.workunit.client.1.smithi131.stdout:7/830: dread - d1b/d3b/d51/d62/f10e zero size 2024-09-13T02:54:23.544 INFO:tasks.workunit.client.1.smithi131.stdout:7/831: readlink d1b/d3b/d31/d38/l49 0 2024-09-13T02:54:23.545 INFO:tasks.workunit.client.1.smithi131.stdout:7/832: symlink d1b/d3b/d46/d4b/d57/d9d/d107/l10f 0 2024-09-13T02:54:23.559 INFO:tasks.workunit.client.1.smithi131.stdout:7/833: write d1b/d3b/d51/d8f/fa4 [2526122,67833] 0 2024-09-13T02:54:23.562 INFO:tasks.workunit.client.1.smithi131.stdout:7/834: rename d1b/cdc to d1b/d23/d54/c110 0 2024-09-13T02:54:23.563 INFO:tasks.workunit.client.1.smithi131.stdout:7/835: creat d1b/d73/f111 x:0 0 0 2024-09-13T02:54:23.565 INFO:tasks.workunit.client.1.smithi131.stdout:7/836: creat d1b/f112 x:0 0 0 2024-09-13T02:54:23.565 INFO:tasks.workunit.client.1.smithi131.stdout:7/837: chown d1b/d23/d89/f105 72573944 1 2024-09-13T02:54:23.565 INFO:tasks.workunit.client.1.smithi131.stdout:7/838: chown d1b/d23/d54/dc6 103555002 1 2024-09-13T02:54:23.566 INFO:tasks.workunit.client.1.smithi131.stdout:7/839: mknod d1b/d3b/d51/d62/d6d/dac/c113 0 2024-09-13T02:54:23.567 INFO:tasks.workunit.client.1.smithi131.stdout:7/840: symlink d1b/d3b/d46/l114 0 2024-09-13T02:54:23.592 INFO:tasks.workunit.client.1.smithi131.stdout:7/841: dwrite d1b/d3b/d31/d7c/db7/fd0 [0,4194304] 0 2024-09-13T02:54:23.592 INFO:tasks.workunit.client.1.smithi131.stdout:7/842: readlink d1b/d3b/d51/d62/d6d/da5/dd8/l106 0 2024-09-13T02:54:23.592 INFO:tasks.workunit.client.1.smithi131.stdout:7/843: dread - d1b/d73/f111 zero size 2024-09-13T02:54:23.594 INFO:tasks.workunit.client.1.smithi131.stdout:7/844: rename d1b/f112 to d1b/d3b/d31/d7c/db7/f115 0 2024-09-13T02:54:23.595 INFO:tasks.workunit.client.1.smithi131.stdout:7/845: creat d1b/d3b/d51/f116 x:0 0 0 2024-09-13T02:54:23.596 INFO:tasks.workunit.client.1.smithi131.stdout:7/846: chown d1b/d3b/d46/d4b/d57/d9d 27049572 1 2024-09-13T02:54:23.596 INFO:tasks.workunit.client.1.smithi131.stdout:7/847: write d1b/d23/f28 [1173973,119139] 0 2024-09-13T02:54:23.596 INFO:tasks.workunit.client.1.smithi131.stdout:7/848: truncate d1b/d3b/d51/d62/d6d/dac/ffc 150861 0 2024-09-13T02:54:23.596 INFO:tasks.workunit.client.1.smithi131.stdout:7/849: write d1b/d73/f111 [634287,80361] 0 2024-09-13T02:54:23.598 INFO:tasks.workunit.client.1.smithi131.stdout:7/850: rename d1b/d23/d89/dbd to d1b/d73/d117 0 2024-09-13T02:54:23.628 INFO:tasks.workunit.client.1.smithi131.stdout:7/851: dwrite d1b/d3b/d31/d60/fc3 [0,4194304] 0 2024-09-13T02:54:23.630 INFO:tasks.workunit.client.1.smithi131.stdout:7/852: mkdir d1b/d3b/d31/dcb/d118 0 2024-09-13T02:54:23.631 INFO:tasks.workunit.client.1.smithi131.stdout:7/853: truncate d1b/d3b/f3e 47758 0 2024-09-13T02:54:23.649 INFO:tasks.workunit.client.1.smithi131.stdout:7/854: dwrite d1b/d3b/d51/d8b/fca [0,4194304] 0 2024-09-13T02:54:23.650 INFO:tasks.workunit.client.1.smithi131.stdout:7/855: write d1b/d3b/d31/d7c/db7/fb9 [857072,22569] 0 2024-09-13T02:54:23.651 INFO:tasks.workunit.client.1.smithi131.stdout:7/856: symlink d1b/d3b/d51/d8b/l119 0 2024-09-13T02:54:23.651 INFO:tasks.workunit.client.1.smithi131.stdout:7/857: creat d1b/f11a x:0 0 0 2024-09-13T02:54:23.651 INFO:tasks.workunit.client.1.smithi131.stdout:7/858: chown d1b/d3b/d31/d7c/db7/fd0 131 1 2024-09-13T02:54:23.660 INFO:tasks.workunit.client.1.smithi131.stdout:7/859: write d1b/d23/f4c [793355,40025] 0 2024-09-13T02:54:23.682 INFO:tasks.workunit.client.1.smithi131.stdout:7/860: dwrite d1b/d3b/d46/f98 [0,4194304] 0 2024-09-13T02:54:23.684 INFO:tasks.workunit.client.1.smithi131.stdout:7/861: unlink d1b/d3b/d51/d62/f10e 0 2024-09-13T02:54:23.685 INFO:tasks.workunit.client.1.smithi131.stdout:7/862: symlink d1b/d3b/d51/d62/d6d/da5/dd8/l11b 0 2024-09-13T02:54:23.686 INFO:tasks.workunit.client.1.smithi131.stdout:7/863: truncate d1b/d3b/d46/d4b/d57/d8c/fec 1012273 0 2024-09-13T02:54:23.687 INFO:tasks.workunit.client.1.smithi131.stdout:7/864: getdents d1b/d3b/d51/d62/d6d/dac 0 2024-09-13T02:54:23.688 INFO:tasks.workunit.client.1.smithi131.stdout:7/865: unlink d1b/d23/d89/db4/cc8 0 2024-09-13T02:54:23.717 INFO:tasks.workunit.client.1.smithi131.stdout:7/866: dwrite d1b/d3b/f55 [0,4194304] 0 2024-09-13T02:54:23.722 INFO:tasks.workunit.client.1.smithi131.stdout:6/998: sync 2024-09-13T02:54:23.723 INFO:tasks.workunit.client.1.smithi131.stdout:6/999: rmdir d1/d14/d10b/dc2 39 2024-09-13T02:54:23.740 INFO:tasks.workunit.client.1.smithi131.stdout:7/867: dwrite d1b/d23/fd9 [0,4194304] 0 2024-09-13T02:54:23.741 INFO:tasks.workunit.client.1.smithi131.stdout:7/868: rename d1b/d3b/d51/d62/d6d/dac/c113 to d1b/d23/d54/c11c 0 2024-09-13T02:54:23.744 INFO:tasks.workunit.client.1.smithi131.stdout:7/869: rename d1b/d23/d89 to d1b/d3b/d31/dcb/d118/d11d 0 2024-09-13T02:54:23.745 INFO:tasks.workunit.client.1.smithi131.stdout:7/870: symlink d1b/d23/d54/l11e 0 2024-09-13T02:54:23.746 INFO:tasks.workunit.client.1.smithi131.stdout:7/871: link d1b/d3b/d31/d5f/l7f d1b/d3b/d46/d4b/d57/d9d/l11f 0 2024-09-13T02:54:23.762 INFO:tasks.workunit.client.1.smithi131.stdout:7/872: dwrite d1b/d3b/d31/d5f/f9c [0,4194304] 0 2024-09-13T02:54:23.772 INFO:tasks.workunit.client.1.smithi131.stdout:3/841: sync 2024-09-13T02:54:23.772 INFO:tasks.workunit.client.1.smithi131.stdout:9/911: sync 2024-09-13T02:54:23.774 INFO:tasks.workunit.client.1.smithi131.stdout:3/842: rename d2/d4/d1a/c55 to d2/d4/d2d/dce/dee/c11a 0 2024-09-13T02:54:23.774 INFO:tasks.workunit.client.1.smithi131.stdout:3/843: readlink d2/d4/d7/d1d/d80/ldf 0 2024-09-13T02:54:23.777 INFO:tasks.workunit.client.1.smithi131.stdout:3/844: rmdir d2/d4/d76/d9f/db9/de5/d101 39 2024-09-13T02:54:23.777 INFO:tasks.workunit.client.1.smithi131.stdout:3/845: chown d2/d4/d7/d1d/d24/d6f/df5/c83 245263031 1 2024-09-13T02:54:23.778 INFO:tasks.workunit.client.1.smithi131.stdout:3/846: truncate d2/d4/d1a/d31/da7/fd4 1299563 0 2024-09-13T02:54:23.778 INFO:tasks.workunit.client.1.smithi131.stdout:3/847: stat d2/d4/d76/dc1 0 2024-09-13T02:54:23.788 INFO:tasks.workunit.client.1.smithi131.stdout:7/873: dwrite d1b/d23/f2d [4194304,4194304] 0 2024-09-13T02:54:23.788 INFO:tasks.workunit.client.1.smithi131.stdout:7/874: write d1b/d3b/d51/d62/d6d/da1/ffe [125943,36625] 0 2024-09-13T02:54:23.789 INFO:tasks.workunit.client.1.smithi131.stdout:7/875: chown d1b/d3b/d51/d62/d6d/fb8 246308284 1 2024-09-13T02:54:23.790 INFO:tasks.workunit.client.1.smithi131.stdout:7/876: truncate d1b/d3b/d31/d5f/f7e 1875566 0 2024-09-13T02:54:23.790 INFO:tasks.workunit.client.1.smithi131.stdout:7/877: dread - d1b/d3b/d51/d8f/ffa zero size 2024-09-13T02:54:23.791 INFO:tasks.workunit.client.1.smithi131.stdout:7/878: write d1b/d3b/d51/d8f/ffa [813361,18424] 0 2024-09-13T02:54:23.791 INFO:tasks.workunit.client.1.smithi131.stdout:7/879: mknod d1b/d3b/d31/c120 0 2024-09-13T02:54:23.791 INFO:tasks.workunit.client.1.smithi131.stdout:7/880: write d1b/d3b/d31/d7c/db7/f115 [210096,17159] 0 2024-09-13T02:54:23.792 INFO:tasks.workunit.client.1.smithi131.stdout:7/881: symlink d1b/d3b/d31/d7c/l121 0 2024-09-13T02:54:23.792 INFO:tasks.workunit.client.1.smithi131.stdout:7/882: write d1b/d3b/d31/d60/f10b [1000789,32743] 0 2024-09-13T02:54:23.792 INFO:tasks.workunit.client.1.smithi131.stdout:7/883: read - d1b/d3b/d31/d38/ff2 zero size 2024-09-13T02:54:23.793 INFO:tasks.workunit.client.1.smithi131.stdout:7/884: write d1b/d3b/d31/d7c/db7/d81/f97 [226262,48466] 0 2024-09-13T02:54:23.793 INFO:tasks.workunit.client.1.smithi131.stdout:7/885: write fb [2191006,100450] 0 2024-09-13T02:54:23.793 INFO:tasks.workunit.client.1.smithi131.stdout:7/886: creat d1b/d3b/d51/d62/d6d/f122 x:0 0 0 2024-09-13T02:54:23.793 INFO:tasks.workunit.client.1.smithi131.stdout:7/887: creat d1b/d3b/d51/d62/f123 x:0 0 0 2024-09-13T02:54:23.794 INFO:tasks.workunit.client.1.smithi131.stdout:7/888: rename d1b/d3b/d51/d62/d9e/da2/fdb to d1b/d3b/d51/d62/d6d/da5/dd8/de3/f124 0 2024-09-13T02:54:23.795 INFO:tasks.workunit.client.1.smithi131.stdout:7/889: chown d1b/d73 432916 1 2024-09-13T02:54:23.795 INFO:tasks.workunit.client.1.smithi131.stdout:7/890: chown d1b/f11a 4 1 2024-09-13T02:54:23.795 INFO:tasks.workunit.client.1.smithi131.stdout:7/891: write d1b/d3b/d51/d62/d6d/da1/ffe [63688,29818] 0 2024-09-13T02:54:23.796 INFO:tasks.workunit.client.1.smithi131.stdout:7/892: mkdir d1b/d3b/d51/d62/d6d/da5/dd8/d125 0 2024-09-13T02:54:23.796 INFO:tasks.workunit.client.1.smithi131.stdout:7/893: symlink d1b/d3b/d31/d7c/db7/d81/l126 0 2024-09-13T02:54:23.797 INFO:tasks.workunit.client.1.smithi131.stdout:3/848: dwrite d2/d4/d7/d1d/f2c [0,4194304] 0 2024-09-13T02:54:23.799 INFO:tasks.workunit.client.1.smithi131.stdout:5/914: sync 2024-09-13T02:54:23.799 INFO:tasks.workunit.client.1.smithi131.stdout:2/910: sync 2024-09-13T02:54:23.799 INFO:tasks.workunit.client.1.smithi131.stdout:2/911: read - d5/d18/d4b/fc2 zero size 2024-09-13T02:54:23.800 INFO:tasks.workunit.client.1.smithi131.stdout:5/915: unlink d1/d9c/dd1/d12e/d39/cd7 0 2024-09-13T02:54:23.800 INFO:tasks.workunit.client.1.smithi131.stdout:5/916: write d1/d1c/d8e/f43 [1220405,53729] 0 2024-09-13T02:54:23.801 INFO:tasks.workunit.client.1.smithi131.stdout:5/917: stat d1/d1c/d87/ffb 0 2024-09-13T02:54:23.801 INFO:tasks.workunit.client.1.smithi131.stdout:5/918: chown d1/d5/cf4 0 1 2024-09-13T02:54:23.801 INFO:tasks.workunit.client.1.smithi131.stdout:2/912: mkdir d5/d18/d4b/df6/d140 0 2024-09-13T02:54:23.801 INFO:tasks.workunit.client.1.smithi131.stdout:2/913: read d5/d31/d26/f39 [2807700,44110] 0 2024-09-13T02:54:23.803 INFO:tasks.workunit.client.1.smithi131.stdout:5/919: link d1/d1c/d87/ffd d1/d21/d74/d78/dbe/f135 0 2024-09-13T02:54:23.805 INFO:tasks.workunit.client.1.smithi131.stdout:2/914: link d5/d31/d26/d8d/fa1 d5/d31/d4e/d76/f141 0 2024-09-13T02:54:23.805 INFO:tasks.workunit.client.1.smithi131.stdout:5/920: mkdir d1/d21/d74/d78/d98/df3/d136 0 2024-09-13T02:54:23.806 INFO:tasks.workunit.client.1.smithi131.stdout:2/915: mknod d5/d31/d26/d8d/c142 0 2024-09-13T02:54:23.807 INFO:tasks.workunit.client.1.smithi131.stdout:7/894: dread d1b/f2c [0,4194304] 0 2024-09-13T02:54:23.807 INFO:tasks.workunit.client.1.smithi131.stdout:7/895: dread - d1b/d23/d54/ff1 zero size 2024-09-13T02:54:23.807 INFO:tasks.workunit.client.1.smithi131.stdout:5/921: creat d1/d2f/d71/d109/f137 x:0 0 0 2024-09-13T02:54:23.808 INFO:tasks.workunit.client.1.smithi131.stdout:5/922: chown d1/d21/d22/l56 2989 1 2024-09-13T02:54:23.808 INFO:tasks.workunit.client.1.smithi131.stdout:2/916: mknod d5/d31/d1d/d50/d10e/c143 0 2024-09-13T02:54:23.808 INFO:tasks.workunit.client.1.smithi131.stdout:2/917: read d5/d31/d1d/d32/f3d [299410,31159] 0 2024-09-13T02:54:23.809 INFO:tasks.workunit.client.1.smithi131.stdout:7/896: symlink d1b/d23/l127 0 2024-09-13T02:54:23.809 INFO:tasks.workunit.client.1.smithi131.stdout:7/897: fsync d1b/d3b/d51/d8b/fca 0 2024-09-13T02:54:23.810 INFO:tasks.workunit.client.1.smithi131.stdout:5/923: mkdir d1/d21/d90/d138 0 2024-09-13T02:54:23.811 INFO:tasks.workunit.client.1.smithi131.stdout:5/924: rmdir d1/d1c/d8e 39 2024-09-13T02:54:23.811 INFO:tasks.workunit.client.1.smithi131.stdout:5/925: chown d1/d5/d57/d60/fdf 61018 1 2024-09-13T02:54:23.812 INFO:tasks.workunit.client.1.smithi131.stdout:3/849: write d2/d4/d1a/d31/d48/d69/f8e [2157212,3274] 0 2024-09-13T02:54:23.812 INFO:tasks.workunit.client.1.smithi131.stdout:5/926: symlink d1/d21/d74/d78/d98/df3/d136/l139 0 2024-09-13T02:54:23.812 INFO:tasks.workunit.client.1.smithi131.stdout:5/927: write d1/d21/f108 [792644,40127] 0 2024-09-13T02:54:23.812 INFO:tasks.workunit.client.1.smithi131.stdout:5/928: stat d1/d1c/d87/dbd/dca 0 2024-09-13T02:54:23.814 INFO:tasks.workunit.client.1.smithi131.stdout:5/929: write d1/d9c/dd1/d12e/f8d [426177,99391] 0 2024-09-13T02:54:23.814 INFO:tasks.workunit.client.1.smithi131.stdout:5/930: readlink d1/d9c/dd1/d12e/l8a 0 2024-09-13T02:54:23.817 INFO:tasks.workunit.client.1.smithi131.stdout:3/850: dread d2/d4/d7/d1d/d24/d6f/f70 [0,4194304] 0 2024-09-13T02:54:23.822 INFO:tasks.workunit.client.1.smithi131.stdout:7/898: read d1b/d73/f85 [1535778,103110] 0 2024-09-13T02:54:23.822 INFO:tasks.workunit.client.1.smithi131.stdout:7/899: truncate d1b/d3b/d31/d7c/db7/fb9 976212 0 2024-09-13T02:54:23.822 INFO:tasks.workunit.client.1.smithi131.stdout:2/918: dread d5/d18/d68/de3/d66/fe4 [0,4194304] 0 2024-09-13T02:54:23.822 INFO:tasks.workunit.client.1.smithi131.stdout:2/919: stat d5/d31/d1d/d50/d10e/c143 0 2024-09-13T02:54:23.824 INFO:tasks.workunit.client.1.smithi131.stdout:7/900: truncate d1b/d3b/d51/d62/fc2 2002735 0 2024-09-13T02:54:23.824 INFO:tasks.workunit.client.1.smithi131.stdout:7/901: write d1b/d3b/fb6 [532786,53059] 0 2024-09-13T02:54:23.824 INFO:tasks.workunit.client.1.smithi131.stdout:7/902: chown d1b/d3b/d51/d62/d6d/dac/ff5 0 1 2024-09-13T02:54:23.824 INFO:tasks.workunit.client.1.smithi131.stdout:7/903: getdents d1b/d3b/d46/d10c 0 2024-09-13T02:54:23.827 INFO:tasks.workunit.client.1.smithi131.stdout:2/920: dread d5/d31/d1d/f52 [0,4194304] 0 2024-09-13T02:54:23.830 INFO:tasks.workunit.client.1.smithi131.stdout:2/921: truncate d5/d31/d26/f59 1078169 0 2024-09-13T02:54:23.832 INFO:tasks.workunit.client.1.smithi131.stdout:2/922: unlink d5/d31/d26/f7f 0 2024-09-13T02:54:23.833 INFO:tasks.workunit.client.1.smithi131.stdout:2/923: dread - d5/d34/d118/f131 zero size 2024-09-13T02:54:23.834 INFO:tasks.workunit.client.1.smithi131.stdout:2/924: rmdir d5/d18/d68/de3/d41/d132 0 2024-09-13T02:54:23.867 INFO:tasks.workunit.client.1.smithi131.stdout:3/851: dwrite d2/d4/d7/d1d/d24/f51 [0,4194304] 0 2024-09-13T02:54:23.867 INFO:tasks.workunit.client.1.smithi131.stdout:7/904: dwrite d1b/d3b/d51/d8f/ffa [0,4194304] 0 2024-09-13T02:54:23.869 INFO:tasks.workunit.client.1.smithi131.stdout:2/925: dwrite d5/d31/d21/ffa [4194304,4194304] 0 2024-09-13T02:54:23.869 INFO:tasks.workunit.client.1.smithi131.stdout:2/926: dread - d5/d31/d1d/d37/d112/d114/db4/dbc/d48/f13d zero size 2024-09-13T02:54:23.870 INFO:tasks.workunit.client.1.smithi131.stdout:7/905: mknod d1b/d3b/d31/dcb/d118/d11d/db4/c128 0 2024-09-13T02:54:23.871 INFO:tasks.workunit.client.1.smithi131.stdout:3/852: getdents d2/d4/d7/d1d/db4/dcc 0 2024-09-13T02:54:23.874 INFO:tasks.workunit.client.1.smithi131.stdout:2/927: mknod d5/d31/d1d/d50/d10e/c144 0 2024-09-13T02:54:23.888 INFO:tasks.workunit.client.1.smithi131.stdout:2/928: write d5/fdb [3769972,129086] 0 2024-09-13T02:54:23.899 INFO:tasks.workunit.client.1.smithi131.stdout:7/906: dwrite d1b/d3b/d51/fce [0,4194304] 0 2024-09-13T02:54:23.900 INFO:tasks.workunit.client.1.smithi131.stdout:7/907: rmdir d1b/d3b/d46/d4b/d57 39 2024-09-13T02:54:23.903 INFO:tasks.workunit.client.1.smithi131.stdout:2/929: write d5/d18/d68/de3/d41/f9f [727834,56200] 0 2024-09-13T02:54:23.904 INFO:tasks.workunit.client.1.smithi131.stdout:2/930: fsync d5/d34/f12f 0 2024-09-13T02:54:23.904 INFO:tasks.workunit.client.1.smithi131.stdout:3/853: dwrite d2/d4/d7/d1d/f21 [0,4194304] 0 2024-09-13T02:54:23.906 INFO:tasks.workunit.client.1.smithi131.stdout:2/931: link d5/d31/d1d/d50/d12d/c127 d5/d31/d1d/d37/c145 0 2024-09-13T02:54:23.906 INFO:tasks.workunit.client.1.smithi131.stdout:2/932: chown d5/d31/d21/d57/f100 499 1 2024-09-13T02:54:23.907 INFO:tasks.workunit.client.1.smithi131.stdout:3/854: creat d2/dc/f11b x:0 0 0 2024-09-13T02:54:23.908 INFO:tasks.workunit.client.1.smithi131.stdout:3/855: rmdir d2/d4/d2d 39 2024-09-13T02:54:23.910 INFO:tasks.workunit.client.1.smithi131.stdout:3/856: link d2/d4/d7/db8/le6 d2/d4/d7/l11c 0 2024-09-13T02:54:23.910 INFO:tasks.workunit.client.1.smithi131.stdout:3/857: fdatasync d2/d4/d2d/d92/f90 0 2024-09-13T02:54:23.911 INFO:tasks.workunit.client.1.smithi131.stdout:3/858: symlink d2/d4/d76/d9f/d41/l11d 0 2024-09-13T02:54:23.911 INFO:tasks.workunit.client.1.smithi131.stdout:3/859: stat d2/d4/d1a/f6b 0 2024-09-13T02:54:23.924 INFO:tasks.workunit.client.1.smithi131.stdout:3/860: dread d2/d4/d1a/f6b [0,4194304] 0 2024-09-13T02:54:23.925 INFO:tasks.workunit.client.1.smithi131.stdout:3/861: symlink d2/d4/l11e 0 2024-09-13T02:54:23.928 INFO:tasks.workunit.client.1.smithi131.stdout:3/862: write d2/d4/d1a/d31/f108 [520370,86652] 0 2024-09-13T02:54:23.929 INFO:tasks.workunit.client.1.smithi131.stdout:3/863: truncate d2/d4/d1a/f1e 1657346 0 2024-09-13T02:54:23.930 INFO:tasks.workunit.client.1.smithi131.stdout:7/908: dwrite d1b/d23/f4c [0,4194304] 0 2024-09-13T02:54:23.931 INFO:tasks.workunit.client.1.smithi131.stdout:2/933: dwrite d5/d31/d1d/d32/d7d/fd0 [4194304,4194304] 0 2024-09-13T02:54:23.931 INFO:tasks.workunit.client.1.smithi131.stdout:7/909: truncate d1b/d73/f85 4102150 0 2024-09-13T02:54:23.935 INFO:tasks.workunit.client.1.smithi131.stdout:7/910: rename d1b/d3b/d51/d62/d6d/da5/dd8/de3 to d1b/d3b/d129 0 2024-09-13T02:54:23.935 INFO:tasks.workunit.client.1.smithi131.stdout:7/911: write d1b/d3b/d51/d62/d6d/da1/ffe [408691,92727] 0 2024-09-13T02:54:23.935 INFO:tasks.workunit.client.1.smithi131.stdout:7/912: creat d1b/d3b/d51/d62/d6d/f12a x:0 0 0 2024-09-13T02:54:23.939 INFO:tasks.workunit.client.1.smithi131.stdout:7/913: rename d1b/d3b/d46/d4b/d57/d7b/d92/f96 to d1b/d3b/d31/d7c/df9/dfb/f12b 0 2024-09-13T02:54:23.942 INFO:tasks.workunit.client.1.smithi131.stdout:7/914: dread d1b/f21 [0,4194304] 0 2024-09-13T02:54:23.951 INFO:tasks.workunit.client.1.smithi131.stdout:7/915: dread d1b/d3b/d31/d5f/f74 [0,4194304] 0 2024-09-13T02:54:23.951 INFO:tasks.workunit.client.1.smithi131.stdout:7/916: chown d1b/d3b/d51 261434 1 2024-09-13T02:54:23.963 INFO:tasks.workunit.client.1.smithi131.stdout:2/934: write d5/f28 [7680761,49852] 0 2024-09-13T02:54:23.964 INFO:tasks.workunit.client.1.smithi131.stdout:2/935: fsync d5/d4f/fe0 0 2024-09-13T02:54:23.964 INFO:tasks.workunit.client.1.smithi131.stdout:2/936: fsync d5/d31/d1d/d37/d112/d114/db4/dbc/ddf/f11d 0 2024-09-13T02:54:23.964 INFO:tasks.workunit.client.1.smithi131.stdout:2/937: creat d5/d31/d21/d57/f146 x:0 0 0 2024-09-13T02:54:23.965 INFO:tasks.workunit.client.1.smithi131.stdout:2/938: rename d5/d6e/f125 to d5/d31/d1d/d50/d12d/f147 0 2024-09-13T02:54:23.971 INFO:tasks.workunit.client.1.smithi131.stdout:7/917: dwrite d1b/d3b/d51/d62/d6d/fb8 [0,4194304] 0 2024-09-13T02:54:23.978 INFO:tasks.workunit.client.1.smithi131.stdout:2/939: dread d5/d31/d21/d57/d90/dc8/f13c [0,4194304] 0 2024-09-13T02:54:23.979 INFO:tasks.workunit.client.1.smithi131.stdout:2/940: rmdir d5/d4f 39 2024-09-13T02:54:23.979 INFO:tasks.workunit.client.1.smithi131.stdout:2/941: dread - d5/d31/d21/d57/f146 zero size 2024-09-13T02:54:23.980 INFO:tasks.workunit.client.1.smithi131.stdout:2/942: getdents d5/d31/d4e 0 2024-09-13T02:54:23.980 INFO:tasks.workunit.client.1.smithi131.stdout:2/943: chown d5/d31/d1d/d37/d112/d114/d10c 80642021 1 2024-09-13T02:54:23.981 INFO:tasks.workunit.client.1.smithi131.stdout:2/944: mkdir d5/d34/d148 0 2024-09-13T02:54:23.981 INFO:tasks.workunit.client.1.smithi131.stdout:2/945: getdents d5/d31/d21/d57/d90 0 2024-09-13T02:54:23.983 INFO:tasks.workunit.client.1.smithi131.stdout:2/946: mkdir d5/d31/d21/d57/d149 0 2024-09-13T02:54:23.984 INFO:tasks.workunit.client.1.smithi131.stdout:2/947: link d5/d31/c13 d5/d31/d21/d57/d90/c14a 0 2024-09-13T02:54:23.984 INFO:tasks.workunit.client.1.smithi131.stdout:2/948: read d5/d31/d21/ffa [3664041,53598] 0 2024-09-13T02:54:23.985 INFO:tasks.workunit.client.1.smithi131.stdout:2/949: truncate d5/d18/d68/de3/d66/f8a 1923322 0 2024-09-13T02:54:23.985 INFO:tasks.workunit.client.1.smithi131.stdout:2/950: write d5/d31/d1d/d37/d112/d114/db4/dbc/fae [283476,33041] 0 2024-09-13T02:54:23.990 INFO:tasks.workunit.client.1.smithi131.stdout:7/918: dwrite f3 [0,4194304] 0 2024-09-13T02:54:23.992 INFO:tasks.workunit.client.1.smithi131.stdout:7/919: mknod d1b/d3b/d31/d7c/df9/dfb/c12c 0 2024-09-13T02:54:23.993 INFO:tasks.workunit.client.1.smithi131.stdout:7/920: dread d1b/d3b/d51/d62/d6d/dac/ffc [0,4194304] 0 2024-09-13T02:54:23.994 INFO:tasks.workunit.client.1.smithi131.stdout:7/921: getdents d1b/d3b/d46/d4b/d57/d7b 0 2024-09-13T02:54:23.995 INFO:tasks.workunit.client.1.smithi131.stdout:7/922: mkdir d1b/d3b/d51/d62/d6d/da5/d12d 0 2024-09-13T02:54:23.995 INFO:tasks.workunit.client.1.smithi131.stdout:7/923: dread - d1b/d3b/d31/d38/ff2 zero size 2024-09-13T02:54:23.996 INFO:tasks.workunit.client.1.smithi131.stdout:7/924: symlink d1b/d3b/d51/d62/d6d/da5/l12e 0 2024-09-13T02:54:23.996 INFO:tasks.workunit.client.1.smithi131.stdout:7/925: symlink d1b/l12f 0 2024-09-13T02:54:23.996 INFO:tasks.workunit.client.1.smithi131.stdout:7/926: fdatasync d1b/d3b/d31/d7c/db7/fd0 0 2024-09-13T02:54:23.997 INFO:tasks.workunit.client.1.smithi131.stdout:7/927: truncate d1b/d3b/f6b 3679651 0 2024-09-13T02:54:23.998 INFO:tasks.workunit.client.1.smithi131.stdout:7/928: mkdir d1b/d3b/d51/d62/d6d/d130 0 2024-09-13T02:54:24.007 INFO:tasks.workunit.client.1.smithi131.stdout:2/951: dwrite d5/d18/d68/de3/d41/f9f [4194304,4194304] 0 2024-09-13T02:54:24.008 INFO:tasks.workunit.client.1.smithi131.stdout:2/952: link d5/d18/d68/f103 d5/d31/d1d/d50/f14b 0 2024-09-13T02:54:24.009 INFO:tasks.workunit.client.1.smithi131.stdout:2/953: rmdir d5/d31/d1d/d37/d112/d114/d10c/d122 0 2024-09-13T02:54:24.012 INFO:tasks.workunit.client.1.smithi131.stdout:7/929: dread fb [0,4194304] 0 2024-09-13T02:54:24.013 INFO:tasks.workunit.client.1.smithi131.stdout:7/930: getdents d1b/d3b/d51/d62 0 2024-09-13T02:54:24.014 INFO:tasks.workunit.client.1.smithi131.stdout:7/931: truncate d1b/d3b/d51/d8b/fca 2111291 0 2024-09-13T02:54:24.016 INFO:tasks.workunit.client.1.smithi131.stdout:7/932: creat d1b/d3b/d51/d62/d9e/f131 x:0 0 0 2024-09-13T02:54:24.016 INFO:tasks.workunit.client.1.smithi131.stdout:7/933: write d1b/d73/f111 [1209646,112083] 0 2024-09-13T02:54:24.025 INFO:tasks.workunit.client.1.smithi131.stdout:7/934: read f4 [3802180,66910] 0 2024-09-13T02:54:24.025 INFO:tasks.workunit.client.1.smithi131.stdout:7/935: write d1b/d3b/d51/f116 [576014,118268] 0 2024-09-13T02:54:24.101 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-13T02:54:24.101 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-13T02:54:24.139 INFO:tasks.workunit.client.1.smithi131.stdout:5/931: sync 2024-09-13T02:54:24.139 INFO:tasks.workunit.client.1.smithi131.stdout:9/912: sync 2024-09-13T02:54:24.139 INFO:tasks.workunit.client.1.smithi131.stdout:9/913: write d0/d4d/d55/d76/d96/d118/d14/f34 [4768822,122721] 0 2024-09-13T02:54:24.140 INFO:tasks.workunit.client.1.smithi131.stdout:9/914: rename d0/d4d/d55/d76/d96/d118/d14/d17/db0/leb to d0/d4d/d55/d76/d96/d118/d14/dbf/d122/d2a/d5e/da2/d39/dae/l140 0 2024-09-13T02:54:24.141 INFO:tasks.workunit.client.1.smithi131.stdout:9/915: rmdir d0/d4d/d55/d76/d96/d118/dac 39 2024-09-13T02:54:24.141 INFO:tasks.workunit.client.1.smithi131.stdout:9/916: chown d0/d4d/d55/d76/d96/d118/d14/dbf/d122/d2a/d75/c9a 656874 1 2024-09-13T02:54:24.141 INFO:tasks.workunit.client.1.smithi131.stdout:9/917: dread - d0/d4d/d55/d76/d96/d118/d14/dbf/d122/d2a/d5e/f101 zero size 2024-09-13T02:54:24.141 INFO:tasks.workunit.client.1.smithi131.stdout:9/918: chown d0/l1c 5 1 2024-09-13T02:54:24.142 INFO:tasks.workunit.client.1.smithi131.stdout:9/919: rmdir d0/d4d/d55/d76/d96/d118/d14/dbf/d122/d2a/d5e/da2/d39/dc2 39 2024-09-13T02:54:24.142 INFO:tasks.workunit.client.1.smithi131.stdout:9/920: read d0/d4d/d55/d76/d96/d118/d14/d17/f9f [162480,79326] 0 2024-09-13T02:54:24.142 INFO:tasks.workunit.client.1.smithi131.stdout:9/921: truncate d0/d4d/d55/d76/d96/d118/d14/d67/dc0/de7/f137 158542 0 2024-09-13T02:54:24.144 INFO:tasks.workunit.client.1.smithi131.stdout:9/922: rename d0/d4d/d55/d76/d96/d118/d14/d17/d107/f112 to d0/d4d/d55/d76/d96/d118/d12c/f141 0 2024-09-13T02:54:24.144 INFO:tasks.workunit.client.1.smithi131.stdout:9/923: fdatasync d0/d4d/d55/d76/d96/d118/d14/dbf/d122/f23 0 2024-09-13T02:54:24.144 INFO:tasks.workunit.client.1.smithi131.stdout:9/924: write d0/dfb/f11b [4225569,117737] 0 2024-09-13T02:54:24.145 INFO:tasks.workunit.client.1.smithi131.stdout:9/925: creat d0/d4d/d55/d76/d96/d118/dac/f142 x:0 0 0 2024-09-13T02:54:24.145 INFO:tasks.workunit.client.1.smithi131.stdout:9/926: write d0/f12 [1289579,7087] 0 2024-09-13T02:54:24.145 INFO:tasks.workunit.client.1.smithi131.stdout:9/927: creat d0/d4d/f143 x:0 0 0 2024-09-13T02:54:24.146 INFO:tasks.workunit.client.1.smithi131.stdout:9/928: creat d0/d4d/d55/d76/d96/d118/d14/dbf/d122/d2a/d5e/da2/d39/dae/d113/f144 x:0 0 0 2024-09-13T02:54:24.147 INFO:tasks.workunit.client.1.smithi131.stdout:9/929: creat d0/d3f/f145 x:0 0 0 2024-09-13T02:54:24.148 INFO:tasks.workunit.client.1.smithi131.stdout:9/930: rename d0/d4d/d55/d76/d96/d118/d14/dbf/d122/d2a/d5e/da2/d39/dbe/ff3 to d0/d4d/d55/d76/d96/d118/d14/d95/f146 0 2024-09-13T02:54:24.149 INFO:tasks.workunit.client.1.smithi131.stdout:9/931: symlink d0/d4d/d55/d76/d96/d118/d14/dbf/d122/d2a/d5e/da2/d39/dae/db6/l147 0 2024-09-13T02:54:24.150 INFO:tasks.workunit.client.1.smithi131.stdout:9/932: rmdir d0/d4d/d55/d76/d96/d118/d14/dbf/d122/d2a/d5e/da2/d39/dbe 39 2024-09-13T02:54:24.159 INFO:tasks.workunit.client.1.smithi131.stdout:9/933: dread d0/f9 [0,4194304] 0 2024-09-13T02:54:24.160 INFO:tasks.workunit.client.1.smithi131.stdout:9/934: mkdir d0/d4d/d55/d76/d96/d118/d14/df4/d148 0 2024-09-13T02:54:24.160 INFO:tasks.workunit.client.1.smithi131.stdout:9/935: truncate d0/d4d/d55/d76/d96/d118/d14/dbf/d122/d2a/d5e/da2/d39/fd9 661602 0 2024-09-13T02:54:24.167 INFO:tasks.workunit.client.1.smithi131.stdout:9/936: write d0/f63 [2457109,117262] 0 2024-09-13T02:54:24.168 INFO:tasks.workunit.client.1.smithi131.stdout:9/937: creat d0/d4d/d55/d76/d96/d118/d14/df4/f149 x:0 0 0 2024-09-13T02:54:24.175 INFO:tasks.workunit.client.1.smithi131.stdout:9/938: dread d0/d4d/d55/d76/d96/d118/d14/d17/f74 [0,4194304] 0 2024-09-13T02:54:24.176 INFO:tasks.workunit.client.1.smithi131.stdout:9/939: dread - d0/d4d/d55/d76/d96/d118/d14/dbf/d122/d2a/f65 zero size 2024-09-13T02:54:24.176 INFO:tasks.workunit.client.1.smithi131.stdout:9/940: chown d0/d4d/d55/d76/d96/d118/d14/dbf/d122/dc6/d8a 802255 1 2024-09-13T02:54:24.176 INFO:tasks.workunit.client.1.smithi131.stdout:9/941: getdents d0/d4d/d55/d76/d96/d118/d14/dbf 0 2024-09-13T02:54:24.193 INFO:tasks.workunit.client.1.smithi131.stdout:9/942: dwrite d0/d4d/d55/d76/d96/d118/d14/dbf/d122/dc6/f77 [0,4194304] 0 2024-09-13T02:54:24.199 INFO:tasks.workunit.client.1.smithi131.stdout:9/943: dread d0/d4d/d55/d76/d96/d118/d14/dbf/d122/dbc/ff2 [0,4194304] 0 2024-09-13T02:54:24.201 INFO:tasks.workunit.client.1.smithi131.stdout:9/944: mkdir d0/d4d/d55/d76/d96/d118/d14/dbf/d122/d2a/d5e/da2/d39/dbe/d14a 0 2024-09-13T02:54:24.215 INFO:tasks.workunit.client.1.smithi131.stdout:9/945: dwrite d0/d4d/d55/d76/d96/d118/d14/d17/db0/dfc/f13f [0,4194304] 0 2024-09-13T02:54:24.217 INFO:tasks.workunit.client.1.smithi131.stdout:9/946: unlink d0/d4d/d55/d76/d96/d118/d14/dbf/d122/d2a/d5e/f101 0 2024-09-13T02:54:24.219 INFO:tasks.workunit.client.1.smithi131.stdout:9/947: unlink d0/d4d/d98/dbb/f115 0 2024-09-13T02:54:24.220 INFO:tasks.workunit.client.1.smithi131.stdout:9/948: mkdir d0/d4d/d55/d76/d96/d118/d14/dbf/d122/dc6/de5/d14b 0 2024-09-13T02:54:24.220 INFO:tasks.workunit.client.1.smithi131.stdout:9/949: stat d0/d4d/d55/d76/d96/d118/d14/d95/fa8 0 2024-09-13T02:54:24.220 INFO:tasks.workunit.client.1.smithi131.stdout:9/950: fsync d0/d4d/d55/d76/d96/d118/d14/dbf/d122/dc6/fc8 0 2024-09-13T02:54:24.220 INFO:tasks.workunit.client.1.smithi131.stdout:9/951: chown d0/d4d/d55/d76/d96/d118/d14/dbf/d122/d2a/d5e/fd1 4 1 2024-09-13T02:54:24.356 INFO:tasks.workunit.client.1.smithi131.stdout:3/864: sync 2024-09-13T02:54:24.357 INFO:tasks.workunit.client.1.smithi131.stdout:2/954: sync 2024-09-13T02:54:24.357 INFO:tasks.workunit.client.1.smithi131.stdout:2/955: readlink d5/d31/d26/d8d/l105 0 2024-09-13T02:54:24.358 INFO:tasks.workunit.client.1.smithi131.stdout:2/956: unlink d5/d31/d1d/d32/d3b/d67/c69 0 2024-09-13T02:54:24.358 INFO:tasks.workunit.client.1.smithi131.stdout:2/957: fdatasync d5/d34/d42/fad 0 2024-09-13T02:54:24.359 INFO:tasks.workunit.client.1.smithi131.stdout:2/958: mknod d5/d18/d4b/c14c 0 2024-09-13T02:54:24.361 INFO:tasks.workunit.client.1.smithi131.stdout:2/959: rename d5/d31/d1d/d37/d112/d114/db4/dbc/d48/d4c/l5f to d5/d31/d1d/d32/d3b/l14d 0 2024-09-13T02:54:24.361 INFO:tasks.workunit.client.1.smithi131.stdout:3/865: dread d2/dc/d39/fa0 [0,4194304] 0 2024-09-13T02:54:24.371 INFO:tasks.workunit.client.1.smithi131.stdout:3/866: read d2/d4/d7/d1d/d24/d6f/d7f/f88 [3052709,127245] 0 2024-09-13T02:54:24.372 INFO:tasks.workunit.client.1.smithi131.stdout:3/867: mkdir d2/d4/d7/dc8/d11f 0 2024-09-13T02:54:24.373 INFO:tasks.workunit.client.1.smithi131.stdout:3/868: truncate d2/d4/d7/d1d/d24/d96/fd0 1642195 0 2024-09-13T02:54:24.373 INFO:tasks.workunit.client.1.smithi131.stdout:3/869: creat d2/d4/d1a/d31/d48/d69/f120 x:0 0 0 2024-09-13T02:54:24.375 INFO:tasks.workunit.client.1.smithi131.stdout:3/870: mkdir d2/d4/d7/d1d/d80/dde/d121 0 2024-09-13T02:54:24.375 INFO:tasks.workunit.client.1.smithi131.stdout:3/871: stat d2/d4/d1a/d31/d48/fc9 0 2024-09-13T02:54:24.375 INFO:tasks.workunit.client.1.smithi131.stdout:3/872: chown d2/dc/db1 549943590 1 2024-09-13T02:54:24.375 INFO:tasks.workunit.client.1.smithi131.stdout:2/960: dwrite d5/d31/d1d/d32/d3b/d67/f134 [0,4194304] 0 2024-09-13T02:54:24.375 INFO:tasks.workunit.client.1.smithi131.stdout:2/961: dread - d5/d31/d21/f106 zero size 2024-09-13T02:54:24.376 INFO:tasks.workunit.client.1.smithi131.stdout:3/873: unlink d2/dc/d39/d61/f6c 0 2024-09-13T02:54:24.376 INFO:tasks.workunit.client.1.smithi131.stdout:3/874: dread - d2/dc/f11b zero size 2024-09-13T02:54:24.376 INFO:tasks.workunit.client.1.smithi131.stdout:3/875: readlink d2/d4/d7/d1d/l106 0 2024-09-13T02:54:24.378 INFO:tasks.workunit.client.1.smithi131.stdout:2/962: unlink d5/d31/d26/d8d/l105 0 2024-09-13T02:54:24.378 INFO:tasks.workunit.client.1.smithi131.stdout:3/876: mknod d2/d4/d76/d9f/c122 0 2024-09-13T02:54:24.380 INFO:tasks.workunit.client.1.smithi131.stdout:2/963: symlink d5/d31/d1d/d37/d112/d114/l14e 0 2024-09-13T02:54:24.380 INFO:tasks.workunit.client.1.smithi131.stdout:2/964: readlink d5/d31/d1d/d32/d3b/d67/lce 0 2024-09-13T02:54:24.382 INFO:tasks.workunit.client.1.smithi131.stdout:3/877: mkdir d2/d4/d1a/d31/d48/d123 0 2024-09-13T02:54:24.382 INFO:tasks.workunit.client.1.smithi131.stdout:3/878: fsync d2/dc/d39/fa0 0 2024-09-13T02:54:24.384 INFO:tasks.workunit.client.1.smithi131.stdout:2/965: link d5/d53/fa9 d5/d31/d26/f14f 0 2024-09-13T02:54:24.386 INFO:tasks.workunit.client.1.smithi131.stdout:2/966: read d5/d18/d68/f103 [540395,5458] 0 2024-09-13T02:54:24.386 INFO:tasks.workunit.client.1.smithi131.stdout:2/967: fsync d5/d6e/fa6 0 2024-09-13T02:54:24.386 INFO:tasks.workunit.client.1.smithi131.stdout:2/968: fdatasync d5/d18/d68/f103 0 2024-09-13T02:54:24.387 INFO:tasks.workunit.client.1.smithi131.stdout:2/969: creat d5/d18/d68/de3/d41/f150 x:0 0 0 2024-09-13T02:54:24.390 INFO:tasks.workunit.client.1.smithi131.stdout:2/970: mknod d5/d18/d68/de3/d41/c151 0 2024-09-13T02:54:24.390 INFO:tasks.workunit.client.1.smithi131.stdout:2/971: readlink d5/d31/d1d/d37/d112/d114/db4/l10a 0 2024-09-13T02:54:24.390 INFO:tasks.workunit.client.1.smithi131.stdout:2/972: stat d5/d31/d1d/d50/l8f 0 2024-09-13T02:54:24.391 INFO:tasks.workunit.client.1.smithi131.stdout:2/973: write d5/d34/f12f [1733495,917] 0 2024-09-13T02:54:24.398 INFO:tasks.workunit.client.1.smithi131.stdout:3/879: dwrite d2/d4/d7/d1d/d24/fb6 [0,4194304] 0 2024-09-13T02:54:24.398 INFO:tasks.workunit.client.1.smithi131.stdout:3/880: write d2/d4/d2d/dce/fc3 [380746,123928] 0 2024-09-13T02:54:24.403 INFO:tasks.workunit.client.1.smithi131.stdout:3/881: rename d2/d4/d7/d1d/d80/dde/d121 to d2/d4/d7/d1d/db4/dcc/d124 0 2024-09-13T02:54:24.405 INFO:tasks.workunit.client.1.smithi131.stdout:3/882: creat d2/d4/d76/d9f/db9/de5/f125 x:0 0 0 2024-09-13T02:54:24.405 INFO:tasks.workunit.client.1.smithi131.stdout:3/883: stat d2/d4/d7/d1d/d24/d6f/df5/c83 0 2024-09-13T02:54:24.407 INFO:tasks.workunit.client.1.smithi131.stdout:2/974: dwrite d5/d18/d68/fee [0,4194304] 0 2024-09-13T02:54:24.408 INFO:tasks.workunit.client.1.smithi131.stdout:3/884: symlink d2/d4/d7/d1d/d24/d6f/d7f/l126 0 2024-09-13T02:54:24.408 INFO:tasks.workunit.client.1.smithi131.stdout:3/885: fdatasync d2/d4/d1a/d31/d48/fc9 0 2024-09-13T02:54:24.425 INFO:tasks.workunit.client.1.smithi131.stdout:7/936: sync 2024-09-13T02:54:24.432 INFO:tasks.workunit.client.1.smithi131.stdout:7/937: dread d1b/d3b/d46/d4b/d57/f8a [0,4194304] 0 2024-09-13T02:54:24.432 INFO:tasks.workunit.client.1.smithi131.stdout:7/938: chown d1b/d3b/d46/d10c 56010 1 2024-09-13T02:54:24.434 INFO:tasks.workunit.client.1.smithi131.stdout:7/939: unlink d1b/d3b/d46/d4b/d57/d7b/ce8 0 2024-09-13T02:54:24.434 INFO:tasks.workunit.client.1.smithi131.stdout:7/940: write d1b/d3b/d46/d4b/d57/d9d/d107/f109 [230019,54683] 0 2024-09-13T02:54:24.434 INFO:tasks.workunit.client.1.smithi131.stdout:7/941: creat d1b/d3b/d51/d8f/f132 x:0 0 0 2024-09-13T02:54:24.435 INFO:tasks.workunit.client.1.smithi131.stdout:7/942: truncate d1b/d3b/d46/f6e 1128202 0 2024-09-13T02:54:24.437 INFO:tasks.workunit.client.1.smithi131.stdout:3/886: dwrite d2/dc/d39/f110 [0,4194304] 0 2024-09-13T02:54:24.437 INFO:tasks.workunit.client.1.smithi131.stdout:2/975: dwrite d5/d53/fba [0,4194304] 0 2024-09-13T02:54:24.437 INFO:tasks.workunit.client.1.smithi131.stdout:2/976: write d5/d31/d1d/d50/d10e/ff5 [320721,78895] 0 2024-09-13T02:54:24.437 INFO:tasks.workunit.client.1.smithi131.stdout:2/977: chown d5/d31/d1d/d32/d3b/ca0 1923122 1 2024-09-13T02:54:24.441 INFO:tasks.workunit.client.1.smithi131.stdout:3/887: write d2/d4/d76/d9f/f6a [728075,18414] 0 2024-09-13T02:54:24.441 INFO:tasks.workunit.client.1.smithi131.stdout:3/888: readlink d2/dc/d39/d61/le7 0 2024-09-13T02:54:24.449 INFO:tasks.workunit.client.1.smithi131.stdout:3/889: creat d2/d4/d76/d9f/d41/d5c/d4f/f127 x:0 0 0 2024-09-13T02:54:24.449 INFO:tasks.workunit.client.1.smithi131.stdout:2/978: write d5/d31/d26/f77 [2708021,49360] 0 2024-09-13T02:54:24.450 INFO:tasks.workunit.client.1.smithi131.stdout:3/890: chown d2/d4/d1a/d31/f112 265158142 1 2024-09-13T02:54:24.450 INFO:tasks.workunit.client.1.smithi131.stdout:3/891: stat d2/d4/d2d/d92/lb3 0 2024-09-13T02:54:24.450 INFO:tasks.workunit.client.1.smithi131.stdout:3/892: chown d2/d4/d7/d1d/d24/d6f/d7f/ldb 0 1 2024-09-13T02:54:24.450 INFO:tasks.workunit.client.1.smithi131.stdout:3/893: truncate d2/d4/d76/d9f/d41/fa9 1019022 0 2024-09-13T02:54:24.451 INFO:tasks.workunit.client.1.smithi131.stdout:2/979: symlink d5/d31/d1d/d32/d3b/d67/d139/l152 0 2024-09-13T02:54:24.451 INFO:tasks.workunit.client.1.smithi131.stdout:9/952: sync 2024-09-13T02:54:24.451 INFO:tasks.workunit.client.1.smithi131.stdout:5/932: sync 2024-09-13T02:54:24.452 INFO:tasks.workunit.client.1.smithi131.stdout:3/894: fdatasync d2/d4/d2d/dce/fc3 0 2024-09-13T02:54:24.452 INFO:tasks.workunit.client.1.smithi131.stdout:7/943: dwrite d1b/d3b/d31/d38/ff2 [0,4194304] 0 2024-09-13T02:54:24.452 INFO:tasks.workunit.client.1.smithi131.stdout:7/944: write d1b/d73/f111 [2367012,12282] 0 2024-09-13T02:54:24.453 INFO:tasks.workunit.client.1.smithi131.stdout:9/953: mkdir d0/d4d/d55/d76/d96/d118/d14/d14c 0 2024-09-13T02:54:24.454 INFO:tasks.workunit.client.1.smithi131.stdout:5/933: dread d1/d21/d74/d78/dbe/f135 [0,4194304] 0 2024-09-13T02:54:24.454 INFO:tasks.workunit.client.1.smithi131.stdout:3/895: creat d2/dc/db1/dca/f128 x:0 0 0 2024-09-13T02:54:24.455 INFO:tasks.workunit.client.1.smithi131.stdout:2/980: dread d5/d31/d1d/d50/d12d/f147 [0,4194304] 0 2024-09-13T02:54:24.456 INFO:tasks.workunit.client.1.smithi131.stdout:7/945: mknod d1b/d3b/d51/d8f/c133 0 2024-09-13T02:54:24.456 INFO:tasks.workunit.client.1.smithi131.stdout:7/946: write d1b/d23/d54/dc6/fc7 [5063581,77080] 0 2024-09-13T02:54:24.457 INFO:tasks.workunit.client.1.smithi131.stdout:9/954: creat d0/f14d x:0 0 0 2024-09-13T02:54:24.458 INFO:tasks.workunit.client.1.smithi131.stdout:7/947: dread d1b/d3b/d31/d7c/db7/da7/ff0 [0,4194304] 0 2024-09-13T02:54:24.463 INFO:tasks.workunit.client.1.smithi131.stdout:2/981: unlink d5/f28 0 2024-09-13T02:54:24.463 INFO:tasks.workunit.client.1.smithi131.stdout:2/982: read d5/d31/d21/d57/d94/f9b [4092439,967] 0 2024-09-13T02:54:24.470 INFO:tasks.workunit.client.1.smithi131.stdout:9/955: mkdir d0/d4d/d55/d76/d96/d118/d14/dbf/d122/d2a/d5e/d14e 0 2024-09-13T02:54:24.472 INFO:tasks.workunit.client.1.smithi131.stdout:5/934: dwrite d1/d1c/d8e/f95 [0,4194304] 0 2024-09-13T02:54:24.472 INFO:tasks.workunit.client.1.smithi131.stdout:3/896: rmdir d2/dc/db1/dca 39 2024-09-13T02:54:24.472 INFO:tasks.workunit.client.1.smithi131.stdout:3/897: chown d2/d4/d76/d9f/d41/d5c/d4f/c52 26230552 1 2024-09-13T02:54:24.473 INFO:tasks.workunit.client.1.smithi131.stdout:3/898: readlink d2/d4/d2d/dce/l9d 0 2024-09-13T02:54:24.474 INFO:tasks.workunit.client.1.smithi131.stdout:2/983: rmdir d5/d4f 39 2024-09-13T02:54:24.474 INFO:tasks.workunit.client.1.smithi131.stdout:9/956: truncate d0/d4d/d55/d76/d96/d118/d14/dbf/d122/f1d 14185 0 2024-09-13T02:54:24.476 INFO:tasks.workunit.client.1.smithi131.stdout:5/935: truncate d1/d9c/dd1/d12e/f126 1283201 0 2024-09-13T02:54:24.476 INFO:tasks.workunit.client.1.smithi131.stdout:5/936: creat d1/d21/f13a x:0 0 0 2024-09-13T02:54:24.476 INFO:tasks.workunit.client.1.smithi131.stdout:5/937: write d1/d1c/d87/f104 [710687,34363] 0 2024-09-13T02:54:24.476 INFO:tasks.workunit.client.1.smithi131.stdout:5/938: chown d1/d9c/dd1 3473 1 2024-09-13T02:54:24.477 INFO:tasks.workunit.client.1.smithi131.stdout:3/899: mkdir d2/d4/d7/dc8/d11f/d129 0 2024-09-13T02:54:24.478 INFO:tasks.workunit.client.1.smithi131.stdout:9/957: creat d0/d4d/d55/d76/d96/d118/d14/d14c/f14f x:0 0 0 2024-09-13T02:54:24.480 INFO:tasks.workunit.client.1.smithi131.stdout:7/948: dwrite d1b/d3b/d46/d4b/d57/d7b/f53 [0,4194304] 0 2024-09-13T02:54:24.480 INFO:tasks.workunit.client.1.smithi131.stdout:7/949: stat d1b/d23/l37 0 2024-09-13T02:54:24.480 INFO:tasks.workunit.client.1.smithi131.stdout:3/900: rmdir d2/d4/db7 39 2024-09-13T02:54:24.481 INFO:tasks.workunit.client.1.smithi131.stdout:9/958: symlink d0/d4d/d13a/l150 0 2024-09-13T02:54:24.483 INFO:tasks.workunit.client.1.smithi131.stdout:2/984: dread d5/d18/d68/de3/d41/f4a [0,4194304] 0 2024-09-13T02:54:24.484 INFO:tasks.workunit.client.1.smithi131.stdout:7/950: rename d1b/d3b/d31/d7c/df9/dfb to d1b/d73/d134 0 2024-09-13T02:54:24.485 INFO:tasks.workunit.client.1.smithi131.stdout:7/951: chown d1b/d3b/d46/c84 59 1 2024-09-13T02:54:24.487 INFO:tasks.workunit.client.1.smithi131.stdout:5/939: rmdir d1/d21/d74/d78/d98/dc9 39 2024-09-13T02:54:24.487 INFO:tasks.workunit.client.1.smithi131.stdout:5/940: dread - d1/d21/d74/d78/d98/d107/f10d zero size 2024-09-13T02:54:24.488 INFO:tasks.workunit.client.1.smithi131.stdout:3/901: truncate d2/d4/d1a/d31/da7/fd4 697633 0 2024-09-13T02:54:24.490 INFO:tasks.workunit.client.1.smithi131.stdout:2/985: link d5/d31/d4e/ffb d5/d34/f153 0 2024-09-13T02:54:24.490 INFO:tasks.workunit.client.1.smithi131.stdout:2/986: fsync d5/f11f 0 2024-09-13T02:54:24.494 INFO:tasks.workunit.client.1.smithi131.stdout:5/941: creat d1/d21/d74/d78/d98/ded/f13b x:0 0 0 2024-09-13T02:54:24.495 INFO:tasks.workunit.client.1.smithi131.stdout:5/942: fsync d1/d1c/d8e/f5c 0 2024-09-13T02:54:24.495 INFO:tasks.workunit.client.1.smithi131.stdout:2/987: mknod d5/d31/d1d/d50/c154 0 2024-09-13T02:54:24.495 INFO:tasks.workunit.client.1.smithi131.stdout:2/988: write d5/d31/d1d/d37/d112/d114/db4/dbc/d48/d4c/f84 [1021001,25777] 0 2024-09-13T02:54:24.499 INFO:tasks.workunit.client.1.smithi131.stdout:2/989: creat d5/d31/d1d/d37/d112/d114/d10c/f155 x:0 0 0 2024-09-13T02:54:24.500 INFO:tasks.workunit.client.1.smithi131.stdout:5/943: unlink d1/d21/d74/ca0 0 2024-09-13T02:54:24.500 INFO:tasks.workunit.client.1.smithi131.stdout:5/944: dread - d1/d2f/d4f/f102 zero size 2024-09-13T02:54:24.500 INFO:tasks.workunit.client.1.smithi131.stdout:5/945: dread - d1/d21/d74/d78/d98/ded/f11e zero size 2024-09-13T02:54:24.502 INFO:tasks.workunit.client.1.smithi131.stdout:2/990: link d5/d31/d1d/d32/d7d/de2/f137 d5/d31/d21/f156 0 2024-09-13T02:54:24.502 INFO:tasks.workunit.client.1.smithi131.stdout:2/991: chown d5/d31 372101 1 2024-09-13T02:54:24.502 INFO:tasks.workunit.client.1.smithi131.stdout:2/992: fsync d5/d18/d68/de3/d41/f9f 0 2024-09-13T02:54:24.502 INFO:tasks.workunit.client.1.smithi131.stdout:9/959: dwrite d0/d4d/d55/d76/d96/d118/d14/dbf/d122/d2a/d5e/df7/f124 [0,4194304] 0 2024-09-13T02:54:24.506 INFO:tasks.workunit.client.1.smithi131.stdout:9/960: link d0/d4d/d55/d76/d96/d118/d12c/f141 d0/d4d/d55/d76/d96/d118/d14/dbf/d122/f151 0 2024-09-13T02:54:24.506 INFO:tasks.workunit.client.1.smithi131.stdout:9/961: read d0/d4d/d55/d76/d96/d118/d12c/f141 [340245,55882] 0 2024-09-13T02:54:24.506 INFO:tasks.workunit.client.1.smithi131.stdout:9/962: rename d0/d4d/d55/d76/d96/d118/d14 to d0/d4d/d55/d76/d96/d118/d14/dbf/d122/dbc/d152 22 2024-09-13T02:54:24.506 INFO:tasks.workunit.client.1.smithi131.stdout:9/963: truncate d0/d4d/d55/d76/d96/d118/d14/f6f 886107 0 2024-09-13T02:54:24.506 INFO:tasks.workunit.client.1.smithi131.stdout:9/964: write d0/f12 [3140976,4565] 0 2024-09-13T02:54:24.506 INFO:tasks.workunit.client.1.smithi131.stdout:9/965: chown d0/d4d/d55/d76/d10f/f11d 403 1 2024-09-13T02:54:24.509 INFO:tasks.workunit.client.1.smithi131.stdout:9/966: creat d0/d4d/d55/d76/d96/d118/d14/dbf/d122/d2a/d5e/da2/d39/dae/f153 x:0 0 0 2024-09-13T02:54:24.509 INFO:tasks.workunit.client.1.smithi131.stdout:9/967: truncate d0/d4d/d55/d76/d96/d118/d14/d95/f146 85048 0 2024-09-13T02:54:24.509 INFO:tasks.workunit.client.1.smithi131.stdout:9/968: read - d0/d4d/d55/d76/d96/d118/d14/d17/f138 zero size 2024-09-13T02:54:24.511 INFO:tasks.workunit.client.1.smithi131.stdout:9/969: rename d0/d4d/d55/d76/d96/d118/d14/d95/c10d to d0/d4d/d55/d76/d96/d118/d14/dbf/d122/dbc/c154 0 2024-09-13T02:54:24.511 INFO:tasks.workunit.client.1.smithi131.stdout:3/902: dwrite d2/d4/d1a/fd2 [0,4194304] 0 2024-09-13T02:54:24.511 INFO:tasks.workunit.client.1.smithi131.stdout:3/903: creat d2/dc/d39/f12a x:0 0 0 2024-09-13T02:54:24.511 INFO:tasks.workunit.client.1.smithi131.stdout:3/904: write d2/d4/d1a/d31/d48/d69/f120 [889667,64881] 0 2024-09-13T02:54:24.511 INFO:tasks.workunit.client.1.smithi131.stdout:3/905: chown d2/d4/d7/d1d/d24/d6f/df5/fc0 0 1 2024-09-13T02:54:24.512 INFO:tasks.workunit.client.1.smithi131.stdout:7/952: dwrite d1b/d3b/d31/d7c/db7/f115 [0,4194304] 0 2024-09-13T02:54:24.516 INFO:tasks.workunit.client.1.smithi131.stdout:9/970: truncate d0/d4d/d55/d76/d96/d118/d14/dbf/d122/d2a/f7d 2452947 0 2024-09-13T02:54:24.524 INFO:tasks.workunit.client.1.smithi131.stdout:7/953: symlink d1b/l135 0 2024-09-13T02:54:24.525 INFO:tasks.workunit.client.1.smithi131.stdout:5/946: dwrite d1/d9c/dd1/d12e/d3e/f42 [4194304,4194304] 0 2024-09-13T02:54:24.528 INFO:tasks.workunit.client.1.smithi131.stdout:9/971: unlink d0/d4d/d55/d76/d96/d118/d14/d67/dc0/c11a 0 2024-09-13T02:54:24.531 INFO:tasks.workunit.client.1.smithi131.stdout:5/947: link d1/d5/d57/d60/f10a d1/d21/d90/df8/f13c 0 2024-09-13T02:54:24.533 INFO:tasks.workunit.client.1.smithi131.stdout:5/948: creat d1/d1c/d87/dbd/dca/d119/d124/f13d x:0 0 0 2024-09-13T02:54:24.533 INFO:tasks.workunit.client.1.smithi131.stdout:3/906: dwrite d2/d4/f84 [0,4194304] 0 2024-09-13T02:54:24.533 INFO:tasks.workunit.client.1.smithi131.stdout:3/907: chown d2/d4/d7/lab 12974 1 2024-09-13T02:54:24.534 INFO:tasks.workunit.client.1.smithi131.stdout:5/949: read d1/d21/f84 [443511,26157] 0 2024-09-13T02:54:24.534 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:24 smithi089 ceph-mon[27639]: pgmap v254: 65 pgs: 65 active+clean; 2.8 GiB data, 9.8 GiB used, 527 GiB / 536 GiB avail; 152 MiB/s rd, 180 MiB/s wr, 359 op/s 2024-09-13T02:54:24.537 INFO:tasks.workunit.client.1.smithi131.stdout:7/954: write d1b/d3b/d31/d7c/db7/f115 [2867746,83653] 0 2024-09-13T02:54:24.537 INFO:tasks.workunit.client.1.smithi131.stdout:7/955: chown d1b/d3b/d31/d38/fbf 419365 1 2024-09-13T02:54:24.538 INFO:tasks.workunit.client.1.smithi131.stdout:2/993: dwrite d5/d34/d118/f131 [0,4194304] 0 2024-09-13T02:54:24.538 INFO:tasks.workunit.client.1.smithi131.stdout:2/994: chown d5/d18/d68/la5 204475 1 2024-09-13T02:54:24.538 INFO:tasks.workunit.client.1.smithi131.stdout:3/908: rename d2/d4/d2d/dce/fc3 to d2/d4/d7/d1d/d24/d6f/f12b 0 2024-09-13T02:54:24.538 INFO:tasks.workunit.client.1.smithi131.stdout:3/909: fdatasync d2/d4/d7/d1d/d24/d6f/df5/fc0 0 2024-09-13T02:54:24.538 INFO:tasks.workunit.client.1.smithi131.stdout:3/910: write d2/d4/d7/f94 [213892,61459] 0 2024-09-13T02:54:24.538 INFO:tasks.workunit.client.1.smithi131.stdout:3/911: write d2/d4/d76/d9f/f6a [1973788,38524] 0 2024-09-13T02:54:24.539 INFO:tasks.workunit.client.1.smithi131.stdout:7/956: dread d1b/d3b/d129/f124 [0,4194304] 0 2024-09-13T02:54:24.539 INFO:tasks.workunit.client.1.smithi131.stdout:7/957: truncate d1b/d3b/d31/d7c/db7/d81/fef 822057 0 2024-09-13T02:54:24.539 INFO:tasks.workunit.client.1.smithi131.stdout:5/950: mkdir d1/d1c/d87/dbd/dca/d13e 0 2024-09-13T02:54:24.539 INFO:tasks.workunit.client.1.smithi131.stdout:5/951: fsync d1/d21/d90/df8/ffe 0 2024-09-13T02:54:24.540 INFO:tasks.workunit.client.1.smithi131.stdout:5/952: chown d1/d21/d74/d78/d98/cc1 3974536 1 2024-09-13T02:54:24.540 INFO:tasks.workunit.client.1.smithi131.stdout:5/953: stat d1/d21/d74/d78/d98/ded/c134 0 2024-09-13T02:54:24.543 INFO:tasks.workunit.client.1.smithi131.stdout:3/912: rmdir d2/d4 39 2024-09-13T02:54:24.543 INFO:tasks.workunit.client.1.smithi131.stdout:3/913: readlink d2/d4/d1a/d31/d48/d69/l105 0 2024-09-13T02:54:24.543 INFO:tasks.workunit.client.1.smithi131.stdout:3/914: write d2/d4/f34 [5036735,92156] 0 2024-09-13T02:54:24.543 INFO:tasks.workunit.client.1.smithi131.stdout:3/915: readlink d2/d4/d7/d1d/d80/dde/lbf 0 2024-09-13T02:54:24.543 INFO:tasks.workunit.client.1.smithi131.stdout:7/958: getdents d1b/d3b/d46/d4b 0 2024-09-13T02:54:24.545 INFO:tasks.workunit.client.1.smithi131.stdout:2/995: mkdir d5/d18/d68/de3/d41/d157 0 2024-09-13T02:54:24.545 INFO:tasks.workunit.client.1.smithi131.stdout:2/996: write d5/d31/d1d/d37/d112/d114/db4/dbc/fcc [470909,97286] 0 2024-09-13T02:54:24.545 INFO:tasks.workunit.client.1.smithi131.stdout:7/959: rmdir d1b/d3b/d46/d4b/d57/d7b/d92/dbb 39 2024-09-13T02:54:24.547 INFO:tasks.workunit.client.1.smithi131.stdout:7/960: mknod d1b/d3b/d51/d62/d9e/c136 0 2024-09-13T02:54:24.549 INFO:tasks.workunit.client.1.smithi131.stdout:5/954: dread d1/d2f/f31 [0,4194304] 0 2024-09-13T02:54:24.549 INFO:tasks.workunit.client.1.smithi131.stdout:5/955: creat d1/d21/d90/df8/f13f x:0 0 0 2024-09-13T02:54:24.550 INFO:tasks.workunit.client.1.smithi131.stdout:7/961: mknod d1b/d3b/d31/d7c/db7/da7/c137 0 2024-09-13T02:54:24.559 INFO:tasks.workunit.client.1.smithi131.stdout:9/972: dwrite d0/d4d/d55/d76/d96/d118/d14/dbf/d122/d2a/d5e/da2/f99 [0,4194304] 0 2024-09-13T02:54:24.559 INFO:tasks.workunit.client.1.smithi131.stdout:9/973: fdatasync d0/d4d/d55/d76/d96/d118/d14/d67/dc0/de7/f137 0 2024-09-13T02:54:24.561 INFO:tasks.workunit.client.1.smithi131.stdout:7/962: creat d1b/d23/f138 x:0 0 0 2024-09-13T02:54:24.568 INFO:tasks.workunit.client.1.smithi131.stdout:9/974: mknod d0/d4d/d55/d76/d96/d118/d14/dbf/d122/dbc/c155 0 2024-09-13T02:54:24.568 INFO:tasks.workunit.client.1.smithi131.stdout:9/975: write d0/d4d/d55/d76/d96/d118/d14/dbf/d122/dc6/d70/f13c [752699,97847] 0 2024-09-13T02:54:24.568 INFO:tasks.workunit.client.1.smithi131.stdout:9/976: write d0/d4d/d55/d76/d96/d118/fa1 [436262,34653] 0 2024-09-13T02:54:24.570 INFO:tasks.workunit.client.1.smithi131.stdout:7/963: mknod d1b/d3b/d51/d62/d6d/db5/c139 0 2024-09-13T02:54:24.570 INFO:tasks.workunit.client.1.smithi131.stdout:3/916: dwrite d2/d4/d1a/fd2 [0,4194304] 0 2024-09-13T02:54:24.573 INFO:tasks.workunit.client.1.smithi131.stdout:5/956: dwrite d1/d9c/dd1/d12e/f8d [0,4194304] 0 2024-09-13T02:54:24.578 INFO:tasks.workunit.client.1.smithi131.stdout:5/957: truncate d1/d21/d90/f10c 234993 0 2024-09-13T02:54:24.579 INFO:tasks.workunit.client.1.smithi131.stdout:9/977: dread d0/d4d/fef [0,4194304] 0 2024-09-13T02:54:24.579 INFO:tasks.workunit.client.1.smithi131.stdout:5/958: write d1/d21/d90/ff1 [238955,97306] 0 2024-09-13T02:54:24.579 INFO:tasks.workunit.client.1.smithi131.stdout:5/959: fsync d1/d1c/d8e/f95 0 2024-09-13T02:54:24.579 INFO:tasks.workunit.client.1.smithi131.stdout:7/964: dread d1b/d3b/d31/d5f/f7e [0,4194304] 0 2024-09-13T02:54:24.579 INFO:tasks.workunit.client.1.smithi131.stdout:7/965: fsync d1b/d3b/d31/d60/fc3 0 2024-09-13T02:54:24.580 INFO:tasks.workunit.client.1.smithi131.stdout:9/978: creat d0/d4d/d55/d76/d96/d118/d14/dbf/d122/d2a/d5e/da2/d39/f156 x:0 0 0 2024-09-13T02:54:24.580 INFO:tasks.workunit.client.1.smithi131.stdout:9/979: stat d0/d4d/d55/d76/d96/d118/d14/dbf/d122/d2a/d5e/d128 0 2024-09-13T02:54:24.580 INFO:tasks.workunit.client.1.smithi131.stdout:7/966: symlink d1b/d3b/d51/d8b/d99/l13a 0 2024-09-13T02:54:24.581 INFO:tasks.workunit.client.1.smithi131.stdout:7/967: chown d1b/f2c 58 1 2024-09-13T02:54:24.581 INFO:tasks.workunit.client.1.smithi131.stdout:3/917: dread d2/d4/d76/d9f/d41/d5c/d49/fa5 [0,4194304] 0 2024-09-13T02:54:24.581 INFO:tasks.workunit.client.1.smithi131.stdout:7/968: mknod d1b/d3b/d31/c13b 0 2024-09-13T02:54:24.583 INFO:tasks.workunit.client.1.smithi131.stdout:3/918: creat d2/d4/db2/f12c x:0 0 0 2024-09-13T02:54:24.583 INFO:tasks.workunit.client.1.smithi131.stdout:3/919: write d2/d4/d1a/d31/f112 [36368,4283] 0 2024-09-13T02:54:24.583 INFO:tasks.workunit.client.1.smithi131.stdout:7/969: symlink d1b/d3b/d31/d7c/l13c 0 2024-09-13T02:54:24.584 INFO:tasks.workunit.client.1.smithi131.stdout:3/920: mknod d2/d4/d7/dc8/c12d 0 2024-09-13T02:54:24.585 INFO:tasks.workunit.client.1.smithi131.stdout:3/921: symlink d2/d4/d76/d9f/l12e 0 2024-09-13T02:54:24.585 INFO:tasks.workunit.client.1.smithi131.stdout:7/970: dread d1b/d3b/d51/d62/d6d/dac/ffc [0,4194304] 0 2024-09-13T02:54:24.586 INFO:tasks.workunit.client.1.smithi131.stdout:3/922: creat d2/d4/d2d/d92/f12f x:0 0 0 2024-09-13T02:54:24.588 INFO:tasks.workunit.client.1.smithi131.stdout:7/971: unlink d1b/d3b/d31/cfd 0 2024-09-13T02:54:24.592 INFO:tasks.workunit.client.1.smithi131.stdout:3/923: rename d2/d4/d76/d9f/ld8 to d2/d4/d1a/d31/d48/d123/l130 0 2024-09-13T02:54:24.592 INFO:tasks.workunit.client.1.smithi131.stdout:3/924: readlink d2/d4/db7/lba 0 2024-09-13T02:54:24.595 INFO:tasks.workunit.client.1.smithi131.stdout:3/925: mknod d2/d4/d7/d1d/d24/d96/c131 0 2024-09-13T02:54:24.597 INFO:tasks.workunit.client.1.smithi131.stdout:3/926: rmdir d2/d4/d7/d1d/d24/d96 39 2024-09-13T02:54:24.600 INFO:tasks.workunit.client.1.smithi131.stdout:3/927: rename d2/dc/d39/d61/f87 to d2/d4/d76/d9f/db9/de5/f132 0 2024-09-13T02:54:24.602 INFO:tasks.workunit.client.1.smithi131.stdout:3/928: unlink d2/d4/d1a/d31/ffc 0 2024-09-13T02:54:24.602 INFO:tasks.workunit.client.1.smithi131.stdout:3/929: chown d2/f95 6935365 1 2024-09-13T02:54:24.603 INFO:tasks.workunit.client.1.smithi131.stdout:3/930: unlink d2/d4/d7/d1d/d80/dde/fe1 0 2024-09-13T02:54:24.604 INFO:tasks.workunit.client.1.smithi131.stdout:3/931: mkdir d2/d4/d7/d1d/db4/dcc/d133 0 2024-09-13T02:54:24.606 INFO:tasks.workunit.client.1.smithi131.stdout:3/932: unlink d2/d4/d7/d1d/d24/d6f/f12b 0 2024-09-13T02:54:24.606 INFO:tasks.workunit.client.1.smithi131.stdout:3/933: fdatasync d2/d4/d1a/d31/f108 0 2024-09-13T02:54:24.607 INFO:tasks.workunit.client.1.smithi131.stdout:5/960: dwrite d1/d9c/dd1/d12e/f2e [4194304,4194304] 0 2024-09-13T02:54:24.607 INFO:tasks.workunit.client.1.smithi131.stdout:3/934: creat d2/d4/db7/dda/f134 x:0 0 0 2024-09-13T02:54:24.607 INFO:tasks.workunit.client.1.smithi131.stdout:3/935: chown d2/d4/d1a/d31/d48/d69/f118 199285013 1 2024-09-13T02:54:24.609 INFO:tasks.workunit.client.1.smithi131.stdout:5/961: mkdir d1/d2f/d140 0 2024-09-13T02:54:24.609 INFO:tasks.workunit.client.1.smithi131.stdout:5/962: stat d1/d9c/dd1/d12e 0 2024-09-13T02:54:24.609 INFO:tasks.workunit.client.1.smithi131.stdout:3/936: mknod d2/d4/d2d/d92/c135 0 2024-09-13T02:54:24.610 INFO:tasks.workunit.client.1.smithi131.stdout:3/937: chown d2/d4/d76/d9f/db9/de5/d101 1046590442 1 2024-09-13T02:54:24.610 INFO:tasks.workunit.client.1.smithi131.stdout:3/938: fdatasync d2/d4/d1a/f1e 0 2024-09-13T02:54:24.611 INFO:tasks.workunit.client.1.smithi131.stdout:9/980: dwrite d0/d4d/d55/d76/d96/d118/d14/d17/f138 [0,4194304] 0 2024-09-13T02:54:24.611 INFO:tasks.workunit.client.1.smithi131.stdout:7/972: dwrite d1b/d3b/d51/d8b/fea [0,4194304] 0 2024-09-13T02:54:24.611 INFO:tasks.workunit.client.1.smithi131.stdout:7/973: write d1b/d3b/d51/d8f/fa4 [282263,117060] 0 2024-09-13T02:54:24.611 INFO:tasks.workunit.client.1.smithi131.stdout:7/974: chown d1b/f88 262341331 1 2024-09-13T02:54:24.611 INFO:tasks.workunit.client.1.smithi131.stdout:7/975: fsync d1b/d3b/d51/d62/d6d/da1/ffe 0 2024-09-13T02:54:24.611 INFO:tasks.workunit.client.1.smithi131.stdout:7/976: chown d1b/d23/f2d 1289249 1 2024-09-13T02:54:24.611 INFO:tasks.workunit.client.1.smithi131.stdout:7/977: chown d1b/d3b/d51/d62/d9e/da2/cc4 509378 1 2024-09-13T02:54:24.616 INFO:tasks.workunit.client.1.smithi131.stdout:7/978: rename d1b/d23/f47 to d1b/d3b/d31/d60/f13d 0 2024-09-13T02:54:24.618 INFO:tasks.workunit.client.1.smithi131.stdout:7/979: link d1b/d3b/d51/led d1b/d3b/d46/d10c/l13e 0 2024-09-13T02:54:24.618 INFO:tasks.workunit.client.1.smithi131.stdout:7/980: truncate d1b/d3b/d51/d62/d6d/f122 734340 0 2024-09-13T02:54:24.619 INFO:tasks.workunit.client.1.smithi131.stdout:9/981: dread d0/d4d/d55/d76/d96/d118/d14/d17/db0/dfc/f105 [0,4194304] 0 2024-09-13T02:54:24.621 INFO:tasks.workunit.client.1.smithi131.stdout:7/981: creat d1b/d3b/d46/d4b/d57/d7b/f13f x:0 0 0 2024-09-13T02:54:24.622 INFO:tasks.workunit.client.1.smithi131.stdout:5/963: dread d1/d5/f12 [0,4194304] 0 2024-09-13T02:54:24.623 INFO:tasks.workunit.client.1.smithi131.stdout:7/982: rename d1b/d3b/d46/d4b/d57/d8c/l93 to d1b/d3b/d31/d38/l140 0 2024-09-13T02:54:24.624 INFO:tasks.workunit.client.1.smithi131.stdout:3/939: write d2/d4/d2d/f102 [3470234,60143] 0 2024-09-13T02:54:24.626 INFO:tasks.workunit.client.1.smithi131.stdout:7/983: creat d1b/d3b/d51/d8b/d99/f141 x:0 0 0 2024-09-13T02:54:24.633 INFO:tasks.workunit.client.1.smithi131.stdout:7/984: symlink d1b/d3b/d31/d7c/db7/da7/l142 0 2024-09-13T02:54:24.636 INFO:tasks.workunit.client.1.smithi131.stdout:7/985: mkdir d1b/d3b/d46/d10c/d143 0 2024-09-13T02:54:24.636 INFO:tasks.workunit.client.1.smithi131.stdout:7/986: write d1b/d3b/d51/d62/d6d/dac/ffc [149793,9835] 0 2024-09-13T02:54:24.643 INFO:tasks.workunit.client.1.smithi131.stdout:7/987: dread d1b/d3b/d31/d5f/f7e [0,4194304] 0 2024-09-13T02:54:24.643 INFO:tasks.workunit.client.1.smithi131.stdout:7/988: write d1b/d3b/d31/d7c/db7/d81/f97 [1091159,23110] 0 2024-09-13T02:54:24.643 INFO:tasks.workunit.client.1.smithi131.stdout:7/989: write d1b/d23/d54/ff1 [1022857,84780] 0 2024-09-13T02:54:24.645 INFO:tasks.workunit.client.1.smithi131.stdout:7/990: link d1b/d3b/d129/lf3 d1b/d3b/d31/d7c/db7/da7/l144 0 2024-09-13T02:54:24.646 INFO:tasks.workunit.client.1.smithi131.stdout:9/982: dwrite d0/d4d/d55/d76/d96/d118/d14/dbf/d122/dc6/de5/ff6 [0,4194304] 0 2024-09-13T02:54:24.646 INFO:tasks.workunit.client.1.smithi131.stdout:9/983: truncate d0/d4d/d55/d76/d96/d118/d14/dbf/d122/dc6/d70/f13c 1044312 0 2024-09-13T02:54:24.646 INFO:tasks.workunit.client.1.smithi131.stdout:5/964: dwrite d1/d21/f84 [0,4194304] 0 2024-09-13T02:54:24.656 INFO:tasks.workunit.client.1.smithi131.stdout:7/991: dread d1b/d3b/d31/d5f/f79 [0,4194304] 0 2024-09-13T02:54:24.656 INFO:tasks.workunit.client.1.smithi131.stdout:9/984: link d0/d4d/d55/d76/d96/d118/d14/dbf/d122/d2a/d5e/da2/d39/dae/db6/f120 d0/d4d/d55/d76/d96/d118/d14/dbf/d122/d2a/d5e/da2/d39/dae/d135/d139/f157 0 2024-09-13T02:54:24.656 INFO:tasks.workunit.client.1.smithi131.stdout:3/940: dwrite d2/d4/d7/d1d/d24/ff6 [0,4194304] 0 2024-09-13T02:54:24.658 INFO:tasks.workunit.client.1.smithi131.stdout:5/965: link d1/d21/d22/l82 d1/d21/d90/d138/l141 0 2024-09-13T02:54:24.659 INFO:tasks.workunit.client.1.smithi131.stdout:7/992: rename d1b/d3b/d51/d8f/ffa to d1b/d73/d117/f145 0 2024-09-13T02:54:24.663 INFO:tasks.workunit.client.1.smithi131.stdout:5/966: truncate d1/d9c/dd1/d12e/d3e/f42 387789 0 2024-09-13T02:54:24.664 INFO:tasks.workunit.client.1.smithi131.stdout:5/967: dread - d1/d21/f11d zero size 2024-09-13T02:54:24.665 INFO:tasks.workunit.client.1.smithi131.stdout:5/968: mkdir d1/d21/d90/d142 0 2024-09-13T02:54:24.666 INFO:tasks.workunit.client.1.smithi131.stdout:5/969: mkdir d1/d21/d90/df8/d143 0 2024-09-13T02:54:24.672 INFO:tasks.workunit.client.1.smithi131.stdout:7/993: dwrite d1b/d3b/d51/f116 [0,4194304] 0 2024-09-13T02:54:24.672 INFO:tasks.workunit.client.1.smithi131.stdout:7/994: write d1b/d3b/d51/d62/d6d/f12a [674236,117907] 0 2024-09-13T02:54:24.672 INFO:tasks.workunit.client.1.smithi131.stdout:7/995: truncate d1b/d3b/d31/d7c/db7/da7/ff0 1289786 0 2024-09-13T02:54:24.674 INFO:tasks.workunit.client.1.smithi131.stdout:9/985: rename d0/d4d/d55/d76/d96/d118/d14/dbf/d122/d2a/d5e/da2/d39/dae/d135 to d0/d4d/d55/d76/d96/d118/d14/dbf/d158 0 2024-09-13T02:54:24.675 INFO:tasks.workunit.client.1.smithi131.stdout:7/996: mknod d1b/d3b/d46/d4b/d57/d7b/c146 0 2024-09-13T02:54:24.675 INFO:tasks.workunit.client.1.smithi131.stdout:7/997: chown d1b/d3b/d31/d7c/db7/da7/c137 176 1 2024-09-13T02:54:24.675 INFO:tasks.workunit.client.1.smithi131.stdout:7/998: fdatasync d1b/d73/f111 0 2024-09-13T02:54:24.675 INFO:tasks.workunit.client.1.smithi131.stdout:7/999: write d1b/d3b/d51/d62/d6d/da1/ffe [1491376,56276] 0 2024-09-13T02:54:24.676 INFO:tasks.workunit.client.1.smithi131.stdout:9/986: dread d0/d4d/d55/d76/d96/d118/d14/dbf/d122/d2a/d5e/da2/d39/fd9 [0,4194304] 0 2024-09-13T02:54:24.683 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:24 smithi131 ceph-mon[34689]: pgmap v254: 65 pgs: 65 active+clean; 2.8 GiB data, 9.8 GiB used, 527 GiB / 536 GiB avail; 152 MiB/s rd, 180 MiB/s wr, 359 op/s 2024-09-13T02:54:24.690 INFO:tasks.workunit.client.1.smithi131.stdout:9/987: dwrite d0/d4d/de3/fe9 [0,4194304] 0 2024-09-13T02:54:24.690 INFO:tasks.workunit.client.1.smithi131.stdout:9/988: rename d0/d4d/d55/d76/d96/d118 to d0/d4d/d55/d76/d96/d118/d14/dbf/d122/d2a/d159 22 2024-09-13T02:54:24.690 INFO:tasks.workunit.client.1.smithi131.stdout:9/989: fsync d0/d4d/d55/d76/d96/d118/d14/d17/db0/dfc/f105 0 2024-09-13T02:54:24.696 INFO:tasks.workunit.client.1.smithi131.stdout:9/990: mkdir d0/d4d/d55/d76/d15a 0 2024-09-13T02:54:24.711 INFO:tasks.workunit.client.1.smithi131.stdout:9/991: dwrite d0/d4d/d55/d76/d96/d118/d14/d17/f21 [0,4194304] 0 2024-09-13T02:54:24.723 INFO:tasks.workunit.client.1.smithi131.stdout:9/992: dread d0/d4d/d55/d76/d96/d118/d14/dbf/d122/d2a/d5e/df7/f124 [0,4194304] 0 2024-09-13T02:54:24.724 INFO:tasks.workunit.client.1.smithi131.stdout:9/993: mknod d0/d4d/d55/d76/d96/d118/d14/dbf/d122/dc6/d70/c15b 0 2024-09-13T02:54:24.724 INFO:tasks.workunit.client.1.smithi131.stdout:9/994: creat d0/d4d/d98/dbb/d106/f15c x:0 0 0 2024-09-13T02:54:24.740 INFO:tasks.workunit.client.1.smithi131.stdout:9/995: dwrite d0/d4d/d55/d76/d96/d118/d14/d17/db0/dfc/f13f [0,4194304] 0 2024-09-13T02:54:24.741 INFO:tasks.workunit.client.1.smithi131.stdout:9/996: readlink d0/d4d/d55/d76/d96/d118/d14/dbf/d122/d2a/l47 0 2024-09-13T02:54:24.755 INFO:tasks.workunit.client.1.smithi131.stdout:9/997: write d0/d4d/d55/d76/d96/d118/d14/dbf/d122/f1d [935977,2459] 0 2024-09-13T02:54:24.755 INFO:tasks.workunit.client.1.smithi131.stdout:9/998: write d0/d4d/d98/dbb/d106/f131 [990093,64853] 0 2024-09-13T02:54:24.757 INFO:tasks.workunit.client.1.smithi131.stdout:9/999: creat d0/d4d/d55/d76/d96/d118/d14/dbf/d122/d2a/d5e/da2/d39/dae/db6/f15d x:0 0 0 2024-09-13T02:54:24.775 INFO:tasks.workunit.client.1.smithi131.stdout:3/941: sync 2024-09-13T02:54:24.775 INFO:tasks.workunit.client.1.smithi131.stdout:2/997: sync 2024-09-13T02:54:24.775 INFO:tasks.workunit.client.1.smithi131.stdout:2/998: dread - d5/d31/d1d/d37/fb5 zero size 2024-09-13T02:54:24.776 INFO:tasks.workunit.client.1.smithi131.stdout:3/942: creat d2/dc/db1/dca/f136 x:0 0 0 2024-09-13T02:54:24.776 INFO:tasks.workunit.client.1.smithi131.stdout:3/943: creat d2/d4/d1a/d31/da7/f137 x:0 0 0 2024-09-13T02:54:24.777 INFO:tasks.workunit.client.1.smithi131.stdout:3/944: symlink d2/d4/d76/d9f/db9/de5/l138 0 2024-09-13T02:54:24.778 INFO:tasks.workunit.client.1.smithi131.stdout:3/945: mkdir d2/d4/d7/dc8/d11f/d139 0 2024-09-13T02:54:24.779 INFO:tasks.workunit.client.1.smithi131.stdout:2/999: dread d5/d31/d4e/ffb [0,4194304] 0 2024-09-13T02:54:24.780 INFO:tasks.workunit.client.1.smithi131.stdout:3/946: rmdir d2/d4/d7/d1d/db4/dcc/d133 0 2024-09-13T02:54:24.781 INFO:tasks.workunit.client.1.smithi131.stdout:3/947: mkdir d2/dfb/d13a 0 2024-09-13T02:54:24.783 INFO:tasks.workunit.client.1.smithi131.stdout:3/948: symlink d2/d4/d7/d1d/db4/dcc/l13b 0 2024-09-13T02:54:24.783 INFO:tasks.workunit.client.1.smithi131.stdout:3/949: write d2/d4/d7/d1d/db4/dcc/ffe [384177,126733] 0 2024-09-13T02:54:24.785 INFO:tasks.workunit.client.1.smithi131.stdout:3/950: dread d2/d4/d2d/d92/f90 [0,4194304] 0 2024-09-13T02:54:24.798 INFO:tasks.workunit.client.1.smithi131.stdout:3/951: dwrite d2/d4/d7/d1d/d24/d96/fcf [0,4194304] 0 2024-09-13T02:54:24.800 INFO:tasks.workunit.client.1.smithi131.stdout:3/952: truncate d2/d4/d1a/f7b 462922 0 2024-09-13T02:54:24.807 INFO:tasks.workunit.client.1.smithi131.stdout:3/953: write d2/d4/d7/d1d/d24/f58 [3332321,81361] 0 2024-09-13T02:54:24.813 INFO:tasks.workunit.client.1.smithi131.stdout:3/954: dread d2/d4/d1a/d31/d48/d69/f8e [0,4194304] 0 2024-09-13T02:54:24.814 INFO:tasks.workunit.client.1.smithi131.stdout:3/955: symlink d2/d4/db7/dda/l13c 0 2024-09-13T02:54:24.871 INFO:tasks.workunit.client.1.smithi131.stdout:5/970: sync 2024-09-13T02:54:24.871 INFO:tasks.workunit.client.1.smithi131.stdout:5/971: dread - d1/d5/d57/d60/f10a zero size 2024-09-13T02:54:24.872 INFO:tasks.workunit.client.1.smithi131.stdout:5/972: truncate d1/d21/d74/d78/d98/ded/f5b 2971253 0 2024-09-13T02:54:24.875 INFO:tasks.workunit.client.1.smithi131.stdout:5/973: getdents d1/d21/d90/df8 0 2024-09-13T02:54:24.876 INFO:tasks.workunit.client.1.smithi131.stdout:5/974: creat d1/d21/d74/d78/d98/f144 x:0 0 0 2024-09-13T02:54:24.877 INFO:tasks.workunit.client.1.smithi131.stdout:5/975: symlink d1/d21/d90/d142/l145 0 2024-09-13T02:54:24.885 INFO:tasks.workunit.client.1.smithi131.stdout:5/976: write d1/d1c/d87/dbd/dca/fdb [3288736,123312] 0 2024-09-13T02:54:24.885 INFO:tasks.workunit.client.1.smithi131.stdout:5/977: chown d1/d1c/d87/dbd/dca/d119 54272 1 2024-09-13T02:54:24.885 INFO:tasks.workunit.client.1.smithi131.stdout:5/978: dread - d1/d2f/d4f/fa1 zero size 2024-09-13T02:54:24.886 INFO:tasks.workunit.client.1.smithi131.stdout:5/979: symlink d1/d1c/l146 0 2024-09-13T02:54:24.888 INFO:tasks.workunit.client.1.smithi131.stdout:5/980: dread d1/d9c/dd1/d12e/d39/f4a [0,4194304] 0 2024-09-13T02:54:24.888 INFO:tasks.workunit.client.1.smithi131.stdout:5/981: write d1/d21/f11d [307283,18286] 0 2024-09-13T02:54:24.894 INFO:tasks.workunit.client.1.smithi131.stdout:5/982: read d1/d5/f16 [3710285,110303] 0 2024-09-13T02:54:24.909 INFO:tasks.workunit.client.1.smithi131.stdout:5/983: dwrite d1/d1c/d8e/f5c [4194304,4194304] 0 2024-09-13T02:54:24.910 INFO:tasks.workunit.client.1.smithi131.stdout:5/984: mknod d1/d2f/d4f/c147 0 2024-09-13T02:54:24.919 INFO:tasks.workunit.client.1.smithi131.stdout:5/985: dread d1/d21/d74/d78/d98/ded/f81 [0,4194304] 0 2024-09-13T02:54:24.936 INFO:tasks.workunit.client.1.smithi131.stdout:5/986: dwrite d1/d21/d74/d78/fb0 [0,4194304] 0 2024-09-13T02:54:24.942 INFO:tasks.workunit.client.1.smithi131.stdout:5/987: mkdir d1/d9c/d132/d148 0 2024-09-13T02:54:24.942 INFO:tasks.workunit.client.1.smithi131.stdout:5/988: stat d1/d5/f12 0 2024-09-13T02:54:24.944 INFO:tasks.workunit.client.1.smithi131.stdout:5/989: truncate d1/d1c/d8e/f43 7476435 0 2024-09-13T02:54:24.945 INFO:tasks.workunit.client.1.smithi131.stdout:5/990: creat d1/d21/d74/f149 x:0 0 0 2024-09-13T02:54:24.950 INFO:tasks.workunit.client.1.smithi131.stdout:5/991: mknod d1/d1c/d8e/c14a 0 2024-09-13T02:54:24.950 INFO:tasks.workunit.client.1.smithi131.stdout:3/956: sync 2024-09-13T02:54:24.950 INFO:tasks.workunit.client.1.smithi131.stdout:5/992: creat d1/d21/d74/d78/d98/f14b x:0 0 0 2024-09-13T02:54:24.957 INFO:tasks.workunit.client.1.smithi131.stdout:5/993: dread d1/d21/f51 [0,4194304] 0 2024-09-13T02:54:24.957 INFO:tasks.workunit.client.1.smithi131.stdout:5/994: fsync d1/d21/d74/d78/d98/ded/f81 0 2024-09-13T02:54:24.959 INFO:tasks.workunit.client.1.smithi131.stdout:3/957: dread d2/d4/d76/d9f/d41/f68 [0,4194304] 0 2024-09-13T02:54:24.964 INFO:tasks.workunit.client.1.smithi131.stdout:5/995: mknod d1/d21/db7/d112/c14c 0 2024-09-13T02:54:24.965 INFO:tasks.workunit.client.1.smithi131.stdout:3/958: mknod d2/d4/d7/d1d/d24/d6f/df5/c13d 0 2024-09-13T02:54:24.966 INFO:tasks.workunit.client.1.smithi131.stdout:5/996: link d1/d21/d74/d78/d98/dc9/f113 d1/d21/d74/d78/d98/d107/f14d 0 2024-09-13T02:54:24.967 INFO:tasks.workunit.client.1.smithi131.stdout:5/997: mkdir d1/d21/d74/d78/d98/df3/d14e 0 2024-09-13T02:54:24.973 INFO:tasks.workunit.client.1.smithi131.stdout:3/959: write d2/d4/d76/d9f/d41/d5c/d71/f93 [674286,89242] 0 2024-09-13T02:54:24.973 INFO:tasks.workunit.client.1.smithi131.stdout:3/960: fdatasync d2/d4/d1a/d31/d48/d69/f8e 0 2024-09-13T02:54:24.974 INFO:tasks.workunit.client.1.smithi131.stdout:3/961: chown d2/d4/d7/fd3 67121720 1 2024-09-13T02:54:24.975 INFO:tasks.workunit.client.1.smithi131.stdout:3/962: rmdir d2/d4/d7/dc8 39 2024-09-13T02:54:24.975 INFO:tasks.workunit.client.1.smithi131.stdout:3/963: chown d2/d4/d1a/d31/da7/f137 575593 1 2024-09-13T02:54:24.975 INFO:tasks.workunit.client.1.smithi131.stdout:3/964: stat d2/d4/d1a/d31/d48/d69 0 2024-09-13T02:54:24.976 INFO:tasks.workunit.client.1.smithi131.stdout:3/965: creat d2/d4/d2d/dce/f13e x:0 0 0 2024-09-13T02:54:24.976 INFO:tasks.workunit.client.1.smithi131.stdout:3/966: truncate d2/d4/d7/d1d/d24/d96/fd0 1662148 0 2024-09-13T02:54:24.977 INFO:tasks.workunit.client.1.smithi131.stdout:5/998: write d1/d21/d74/d78/d98/ded/f97 [3284253,93290] 0 2024-09-13T02:54:24.978 INFO:tasks.workunit.client.1.smithi131.stdout:5/999: mknod d1/c14f 0 2024-09-13T02:54:24.995 INFO:tasks.workunit.client.1.smithi131.stdout:3/967: dwrite d2/d4/d76/d9f/db9/f111 [0,4194304] 0 2024-09-13T02:54:25.012 INFO:tasks.workunit.client.1.smithi131.stdout:3/968: dwrite d2/d4/d76/d9f/d41/f104 [0,4194304] 0 2024-09-13T02:54:25.014 INFO:tasks.workunit.client.1.smithi131.stdout:3/969: mkdir d2/d4/d1a/d31/da7/d13f 0 2024-09-13T02:54:25.018 INFO:tasks.workunit.client.1.smithi131.stdout:3/970: symlink d2/d4/d7/d1d/db4/dcc/l140 0 2024-09-13T02:54:25.019 INFO:tasks.workunit.client.1.smithi131.stdout:3/971: mkdir d2/d4/d7/dc8/d11f/d139/d141 0 2024-09-13T02:54:25.021 INFO:tasks.workunit.client.1.smithi131.stdout:3/972: mknod d2/d4/d7/dc8/c142 0 2024-09-13T02:54:25.021 INFO:tasks.workunit.client.1.smithi131.stdout:3/973: symlink d2/d4/db7/dda/l143 0 2024-09-13T02:54:25.023 INFO:tasks.workunit.client.1.smithi131.stdout:3/974: creat d2/d4/f144 x:0 0 0 2024-09-13T02:54:25.024 INFO:tasks.workunit.client.1.smithi131.stdout:3/975: write d2/f12 [514075,48974] 0 2024-09-13T02:54:25.031 INFO:tasks.workunit.client.1.smithi131.stdout:3/976: write d2/d4/d1a/d31/da7/fd4 [759704,28842] 0 2024-09-13T02:54:25.056 INFO:tasks.workunit.client.1.smithi131.stdout:3/977: dwrite d2/d4/d76/dc1/ff2 [0,4194304] 0 2024-09-13T02:54:25.063 INFO:tasks.workunit.client.1.smithi131.stdout:3/978: dread d2/d4/d7/d1d/f2c [0,4194304] 0 2024-09-13T02:54:25.064 INFO:tasks.workunit.client.1.smithi131.stdout:3/979: symlink d2/d4/d7/dc8/d11f/d129/l145 0 2024-09-13T02:54:25.065 INFO:tasks.workunit.client.1.smithi131.stdout:3/980: symlink d2/d4/d76/d9f/d41/d5c/d71/l146 0 2024-09-13T02:54:25.067 INFO:tasks.workunit.client.1.smithi131.stdout:3/981: mkdir d2/d4/d76/d9f/d41/d5c/d4f/d147 0 2024-09-13T02:54:25.069 INFO:tasks.workunit.client.1.smithi131.stdout:3/982: unlink d2/d4/d76/d9f/d41/d5c/d4f/fdd 0 2024-09-13T02:54:25.069 INFO:tasks.workunit.client.1.smithi131.stdout:3/983: readlink d2/d4/db7/dda/l13c 0 2024-09-13T02:54:25.070 INFO:tasks.workunit.client.1.smithi131.stdout:3/984: mkdir d2/d4/db7/dda/d148 0 2024-09-13T02:54:25.070 INFO:tasks.workunit.client.1.smithi131.stdout:3/985: fsync d2/dc/d39/f79 0 2024-09-13T02:54:25.075 INFO:tasks.workunit.client.1.smithi131.stdout:3/986: read d2/d4/d1a/f7b [219881,20712] 0 2024-09-13T02:54:25.077 INFO:tasks.workunit.client.1.smithi131.stdout:3/987: link d2/d4/l2b d2/dfb/d13a/l149 0 2024-09-13T02:54:25.077 INFO:tasks.workunit.client.1.smithi131.stdout:3/988: fdatasync d2/d4/d1a/f66 0 2024-09-13T02:54:25.079 INFO:tasks.workunit.client.1.smithi131.stdout:3/989: mkdir d2/d4/d76/d9f/d41/d5c/d71/d14a 0 2024-09-13T02:54:25.079 INFO:tasks.workunit.client.1.smithi131.stdout:3/990: dread - d2/dc/db1/dca/f128 zero size 2024-09-13T02:54:25.080 INFO:tasks.workunit.client.1.smithi131.stdout:3/991: getdents d2/d4/d7/d1d/d80 0 2024-09-13T02:54:25.080 INFO:tasks.workunit.client.1.smithi131.stdout:3/992: stat d2/d4/d76/d9f/l12e 0 2024-09-13T02:54:25.082 INFO:tasks.workunit.client.1.smithi131.stdout:3/993: symlink d2/d4/d7/d1d/d24/d6f/l14b 0 2024-09-13T02:54:25.082 INFO:tasks.workunit.client.1.smithi131.stdout:3/994: chown d2/d4/d1a/d31/d48/d123/l130 286 1 2024-09-13T02:54:25.083 INFO:tasks.workunit.client.1.smithi131.stdout:3/995: symlink d2/dfb/d13a/l14c 0 2024-09-13T02:54:25.083 INFO:tasks.workunit.client.1.smithi131.stdout:3/996: stat d2/dc/d39/f12a 0 2024-09-13T02:54:25.083 INFO:tasks.workunit.client.1.smithi131.stdout:3/997: write d2/d4/d7/d1d/d24/d6f/df5/fc0 [216124,61051] 0 2024-09-13T02:54:25.083 INFO:tasks.workunit.client.1.smithi131.stdout:3/998: fdatasync d2/d4/d1a/d31/d48/f77 0 2024-09-13T02:54:25.097 INFO:tasks.workunit.client.1.smithi131.stdout:3/999: dwrite d2/d4/d1a/f37 [0,4194304] 0 2024-09-13T02:54:25.100 INFO:tasks.workunit.client.1.smithi131.stderr:+ rm -rf -- ./tmp.SRfns8LUvZ 2024-09-13T02:54:26.376 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:26 smithi131 ceph-mon[34689]: pgmap v255: 65 pgs: 65 active+clean; 2.5 GiB data, 9.4 GiB used, 527 GiB / 536 GiB avail; 165 MiB/s rd, 204 MiB/s wr, 430 op/s 2024-09-13T02:54:26.536 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:26 smithi089 ceph-mon[27639]: pgmap v255: 65 pgs: 65 active+clean; 2.5 GiB data, 9.4 GiB used, 527 GiB / 536 GiB avail; 165 MiB/s rd, 204 MiB/s wr, 430 op/s 2024-09-13T02:54:28.509 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:28 smithi131 ceph-mon[34689]: pgmap v256: 65 pgs: 65 active+clean; 2.4 GiB data, 9.1 GiB used, 527 GiB / 536 GiB avail; 146 MiB/s rd, 170 MiB/s wr, 359 op/s 2024-09-13T02:54:28.509 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:28 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:54:28.509 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:28 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:54:28.509 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:28 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:54:28.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:28 smithi089 ceph-mon[27639]: pgmap v256: 65 pgs: 65 active+clean; 2.4 GiB data, 9.1 GiB used, 527 GiB / 536 GiB avail; 146 MiB/s rd, 170 MiB/s wr, 359 op/s 2024-09-13T02:54:28.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:28 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:54:28.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:28 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:54:28.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:28 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:54:29.411 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:29 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:54:29.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:29 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:54:30.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:30 smithi089 ceph-mon[27639]: pgmap v257: 65 pgs: 65 active+clean; 2.2 GiB data, 8.3 GiB used, 528 GiB / 536 GiB avail; 142 MiB/s rd, 166 MiB/s wr, 432 op/s 2024-09-13T02:54:30.673 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:30 smithi131 ceph-mon[34689]: pgmap v257: 65 pgs: 65 active+clean; 2.2 GiB data, 8.3 GiB used, 528 GiB / 536 GiB avail; 142 MiB/s rd, 166 MiB/s wr, 432 op/s 2024-09-13T02:54:32.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:32 smithi131 ceph-mon[34689]: pgmap v258: 65 pgs: 65 active+clean; 2.1 GiB data, 8.1 GiB used, 528 GiB / 536 GiB avail; 103 MiB/s rd, 120 MiB/s wr, 329 op/s 2024-09-13T02:54:32.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:32 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:54:32.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:32 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:54:32.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:32 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:54:32.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:32 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:54:32.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:32 smithi089 ceph-mon[27639]: pgmap v258: 65 pgs: 65 active+clean; 2.1 GiB data, 8.1 GiB used, 528 GiB / 536 GiB avail; 103 MiB/s rd, 120 MiB/s wr, 329 op/s 2024-09-13T02:54:32.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:32 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:54:32.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:32 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:54:32.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:32 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:54:32.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:32 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:54:34.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:34 smithi131 ceph-mon[34689]: pgmap v259: 65 pgs: 65 active+clean; 1.8 GiB data, 7.4 GiB used, 529 GiB / 536 GiB avail; 91 MiB/s rd, 105 MiB/s wr, 341 op/s 2024-09-13T02:54:34.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:34 smithi089 ceph-mon[27639]: pgmap v259: 65 pgs: 65 active+clean; 1.8 GiB data, 7.4 GiB used, 529 GiB / 536 GiB avail; 91 MiB/s rd, 105 MiB/s wr, 341 op/s 2024-09-13T02:54:35.349 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:35 smithi131 ceph-mon[34689]: Standby manager daemon smithi131.aunbqd restarted 2024-09-13T02:54:35.349 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:35 smithi131 ceph-mon[34689]: Standby manager daemon smithi131.aunbqd started 2024-09-13T02:54:35.349 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:35 smithi131 ceph-mon[34689]: from='mgr.? 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi131.aunbqd/crt"}]: dispatch 2024-09-13T02:54:35.349 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:35 smithi131 ceph-mon[34689]: from='mgr.? 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T02:54:35.349 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:35 smithi131 ceph-mon[34689]: from='mgr.? 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi131.aunbqd/key"}]: dispatch 2024-09-13T02:54:35.349 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:35 smithi131 ceph-mon[34689]: from='mgr.? 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T02:54:35.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:35 smithi089 ceph-mon[27639]: Standby manager daemon smithi131.aunbqd restarted 2024-09-13T02:54:35.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:35 smithi089 ceph-mon[27639]: Standby manager daemon smithi131.aunbqd started 2024-09-13T02:54:35.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:35 smithi089 ceph-mon[27639]: from='mgr.? 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi131.aunbqd/crt"}]: dispatch 2024-09-13T02:54:35.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:35 smithi089 ceph-mon[27639]: from='mgr.? 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T02:54:35.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:35 smithi089 ceph-mon[27639]: from='mgr.? 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi131.aunbqd/key"}]: dispatch 2024-09-13T02:54:35.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:35 smithi089 ceph-mon[27639]: from='mgr.? 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T02:54:36.385 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:36 smithi089 ceph-mon[27639]: pgmap v260: 65 pgs: 65 active+clean; 1.4 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail; 66 MiB/s rd, 83 MiB/s wr, 347 op/s 2024-09-13T02:54:36.386 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:36 smithi089 ceph-mon[27639]: mgrmap e20: smithi089.guohvs(active, since 7m), standbys: smithi131.aunbqd 2024-09-13T02:54:36.386 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:36 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:54:36.386 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:36 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:54:36.386 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:36 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:54:36.386 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:36 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:54:36.386 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:36 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:54:36.386 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:36 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:54:36.386 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:36 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mgr fail", "who": "smithi089.guohvs"}]: dispatch 2024-09-13T02:54:36.386 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:36 smithi089 ceph-mon[27639]: Activating manager daemon smithi131.aunbqd 2024-09-13T02:54:36.386 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:36 smithi089 ceph-mon[27639]: osdmap e45: 6 total, 6 up, 6 in 2024-09-13T02:54:36.386 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:36 smithi089 ceph-mon[27639]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd='[{"prefix": "mgr fail", "who": "smithi089.guohvs"}]': finished 2024-09-13T02:54:36.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:36 smithi089 ceph-mon[27639]: mgrmap e21: smithi131.aunbqd(active, starting, since 0.0128539s) 2024-09-13T02:54:36.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:36 smithi089 ceph-mon[27639]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "mon metadata", "id": "smithi089"}]: dispatch 2024-09-13T02:54:36.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:36 smithi089 ceph-mon[27639]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "mon metadata", "id": "smithi131"}]: dispatch 2024-09-13T02:54:36.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:36 smithi089 ceph-mon[27639]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi089.rarddb"}]: dispatch 2024-09-13T02:54:36.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:36 smithi089 ceph-mon[27639]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi089.qjoitb"}]: dispatch 2024-09-13T02:54:36.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:36 smithi089 ceph-mon[27639]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi131.uasrkg"}]: dispatch 2024-09-13T02:54:36.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:36 smithi089 ceph-mon[27639]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi131.rbovzc"}]: dispatch 2024-09-13T02:54:36.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:36 smithi089 ceph-mon[27639]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "mgr metadata", "who": "smithi131.aunbqd", "id": "smithi131.aunbqd"}]: dispatch 2024-09-13T02:54:36.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:36 smithi089 ceph-mon[27639]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T02:54:36.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:36 smithi089 ceph-mon[27639]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T02:54:36.387 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:36 smithi089 ceph-mon[27639]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T02:54:36.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:36 smithi089 ceph-mon[27639]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T02:54:36.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:36 smithi089 ceph-mon[27639]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T02:54:36.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:36 smithi089 ceph-mon[27639]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T02:54:36.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:36 smithi089 ceph-mon[27639]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T02:54:36.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:36 smithi089 ceph-mon[27639]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T02:54:36.388 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:36 smithi089 ceph-mon[27639]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T02:54:36.510 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:36 smithi131 ceph-mon[34689]: pgmap v260: 65 pgs: 65 active+clean; 1.4 GiB data, 6.1 GiB used, 530 GiB / 536 GiB avail; 66 MiB/s rd, 83 MiB/s wr, 347 op/s 2024-09-13T02:54:36.511 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:36 smithi131 ceph-mon[34689]: mgrmap e20: smithi089.guohvs(active, since 7m), standbys: smithi131.aunbqd 2024-09-13T02:54:36.511 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:36 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:54:36.511 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:36 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:54:36.511 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:36 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:54:36.511 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:36 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:54:36.511 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:36 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' 2024-09-13T02:54:36.511 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:36 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:54:36.511 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:36 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mgr fail", "who": "smithi089.guohvs"}]: dispatch 2024-09-13T02:54:36.511 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:36 smithi131 ceph-mon[34689]: Activating manager daemon smithi131.aunbqd 2024-09-13T02:54:36.511 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:36 smithi131 ceph-mon[34689]: osdmap e45: 6 total, 6 up, 6 in 2024-09-13T02:54:36.511 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:36 smithi131 ceph-mon[34689]: from='mgr.14204 172.21.15.89:0/897116199' entity='mgr.smithi089.guohvs' cmd='[{"prefix": "mgr fail", "who": "smithi089.guohvs"}]': finished 2024-09-13T02:54:36.511 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:36 smithi131 ceph-mon[34689]: mgrmap e21: smithi131.aunbqd(active, starting, since 0.0128539s) 2024-09-13T02:54:36.511 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:36 smithi131 ceph-mon[34689]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "mon metadata", "id": "smithi089"}]: dispatch 2024-09-13T02:54:36.512 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:36 smithi131 ceph-mon[34689]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "mon metadata", "id": "smithi131"}]: dispatch 2024-09-13T02:54:36.512 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:36 smithi131 ceph-mon[34689]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi089.rarddb"}]: dispatch 2024-09-13T02:54:36.512 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:36 smithi131 ceph-mon[34689]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi089.qjoitb"}]: dispatch 2024-09-13T02:54:36.512 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:36 smithi131 ceph-mon[34689]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi131.uasrkg"}]: dispatch 2024-09-13T02:54:36.512 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:36 smithi131 ceph-mon[34689]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi131.rbovzc"}]: dispatch 2024-09-13T02:54:36.512 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:36 smithi131 ceph-mon[34689]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "mgr metadata", "who": "smithi131.aunbqd", "id": "smithi131.aunbqd"}]: dispatch 2024-09-13T02:54:36.512 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:36 smithi131 ceph-mon[34689]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T02:54:36.512 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:36 smithi131 ceph-mon[34689]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T02:54:36.512 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:36 smithi131 ceph-mon[34689]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T02:54:36.512 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:36 smithi131 ceph-mon[34689]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T02:54:36.512 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:36 smithi131 ceph-mon[34689]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T02:54:36.512 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:36 smithi131 ceph-mon[34689]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T02:54:36.512 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:36 smithi131 ceph-mon[34689]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T02:54:36.513 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:36 smithi131 ceph-mon[34689]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T02:54:36.513 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:36 smithi131 ceph-mon[34689]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T02:54:37.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:37 smithi089 ceph-mon[27639]: Manager daemon smithi131.aunbqd is now available 2024-09-13T02:54:37.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:37 smithi089 ceph-mon[27639]: Checking for cert/key for grafana.smithi089 2024-09-13T02:54:37.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:37 smithi089 ceph-mon[27639]: Migrating grafana.smithi089 cert to cert store 2024-09-13T02:54:37.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:37 smithi089 ceph-mon[27639]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' 2024-09-13T02:54:37.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:37 smithi089 ceph-mon[27639]: Migrating grafana.smithi089 key to cert store 2024-09-13T02:54:37.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:37 smithi089 ceph-mon[27639]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' 2024-09-13T02:54:37.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:37 smithi089 ceph-mon[27639]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' 2024-09-13T02:54:37.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:37 smithi089 ceph-mon[27639]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:54:37.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:37 smithi089 ceph-mon[27639]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:54:37.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:37 smithi089 ceph-mon[27639]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi131.aunbqd/mirror_snapshot_schedule"}]: dispatch 2024-09-13T02:54:37.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:37 smithi089 ceph-mon[27639]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi131.aunbqd/trash_purge_schedule"}]: dispatch 2024-09-13T02:54:37.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:37 smithi131 ceph-mon[34689]: Manager daemon smithi131.aunbqd is now available 2024-09-13T02:54:37.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:37 smithi131 ceph-mon[34689]: Checking for cert/key for grafana.smithi089 2024-09-13T02:54:37.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:37 smithi131 ceph-mon[34689]: Migrating grafana.smithi089 cert to cert store 2024-09-13T02:54:37.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:37 smithi131 ceph-mon[34689]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' 2024-09-13T02:54:37.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:37 smithi131 ceph-mon[34689]: Migrating grafana.smithi089 key to cert store 2024-09-13T02:54:37.685 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:37 smithi131 ceph-mon[34689]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' 2024-09-13T02:54:37.685 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:37 smithi131 ceph-mon[34689]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' 2024-09-13T02:54:37.685 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:37 smithi131 ceph-mon[34689]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:54:37.685 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:37 smithi131 ceph-mon[34689]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:54:37.685 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:37 smithi131 ceph-mon[34689]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi131.aunbqd/mirror_snapshot_schedule"}]: dispatch 2024-09-13T02:54:37.685 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:37 smithi131 ceph-mon[34689]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi131.aunbqd/trash_purge_schedule"}]: dispatch 2024-09-13T02:54:38.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:38 smithi089 ceph-mon[27639]: Deploying cephadm binary to smithi131 2024-09-13T02:54:38.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:38 smithi089 ceph-mon[27639]: Deploying cephadm binary to smithi089 2024-09-13T02:54:38.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:38 smithi089 ceph-mon[27639]: mgrmap e22: smithi131.aunbqd(active, since 1.1359s) 2024-09-13T02:54:38.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:38 smithi089 ceph-mon[27639]: pgmap v3: 65 pgs: 65 active+clean; 510 MiB data, 3.5 GiB used, 533 GiB / 536 GiB avail 2024-09-13T02:54:38.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:38 smithi089 ceph-mon[27639]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' 2024-09-13T02:54:38.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:38 smithi089 ceph-mon[27639]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' 2024-09-13T02:54:38.683 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:38 smithi131 ceph-mon[34689]: Deploying cephadm binary to smithi131 2024-09-13T02:54:38.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:38 smithi131 ceph-mon[34689]: Deploying cephadm binary to smithi089 2024-09-13T02:54:38.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:38 smithi131 ceph-mon[34689]: mgrmap e22: smithi131.aunbqd(active, since 1.1359s) 2024-09-13T02:54:38.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:38 smithi131 ceph-mon[34689]: pgmap v3: 65 pgs: 65 active+clean; 510 MiB data, 3.5 GiB used, 533 GiB / 536 GiB avail 2024-09-13T02:54:38.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:38 smithi131 ceph-mon[34689]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' 2024-09-13T02:54:38.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:38 smithi131 ceph-mon[34689]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' 2024-09-13T02:54:38.943 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-13T02:54:38.943 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2024-09-13T02:54:39.433 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:39 smithi089 ceph-mon[27639]: pgmap v4: 65 pgs: 65 active+clean; 510 MiB data, 3.5 GiB used, 533 GiB / 536 GiB avail 2024-09-13T02:54:39.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:39 smithi131 ceph-mon[34689]: pgmap v4: 65 pgs: 65 active+clean; 510 MiB data, 3.5 GiB used, 533 GiB / 536 GiB avail 2024-09-13T02:54:40.368 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:40 smithi089 ceph-mon[27639]: mgrmap e23: smithi131.aunbqd(active, since 3s) 2024-09-13T02:54:40.368 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:40 smithi089 ceph-mon[27639]: [13/Sep/2024:02:54:39] ENGINE Bus STARTING 2024-09-13T02:54:40.368 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:40 smithi089 ceph-mon[27639]: [13/Sep/2024:02:54:39] ENGINE Serving on http://172.21.15.131:8765 2024-09-13T02:54:40.368 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:40 smithi089 ceph-mon[27639]: [13/Sep/2024:02:54:39] ENGINE Serving on https://172.21.15.131:7150 2024-09-13T02:54:40.368 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:40 smithi089 ceph-mon[27639]: [13/Sep/2024:02:54:39] ENGINE Bus STARTED 2024-09-13T02:54:40.368 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:40 smithi089 ceph-mon[27639]: [13/Sep/2024:02:54:39] ENGINE Error in HTTPServer.serve 2024-09-13T02:54:40.368 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Traceback (most recent call last): 2024-09-13T02:54:40.368 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T02:54:40.368 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: self._connections.run(self.expiration_interval) 2024-09-13T02:54:40.369 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T02:54:40.369 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: self._run(expiration_interval) 2024-09-13T02:54:40.369 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T02:54:40.369 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T02:54:40.369 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T02:54:40.369 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T02:54:40.369 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T02:54:40.369 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: s = self.context.wrap_socket( 2024-09-13T02:54:40.369 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T02:54:40.369 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: return self.sslsocket_class._create( 2024-09-13T02:54:40.369 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T02:54:40.369 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: self.do_handshake() 2024-09-13T02:54:40.370 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T02:54:40.370 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: self._sslobj.do_handshake() 2024-09-13T02:54:40.370 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T02:54:40.401 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:40 smithi131 ceph-mon[34689]: mgrmap e23: smithi131.aunbqd(active, since 3s) 2024-09-13T02:54:40.401 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:40 smithi131 ceph-mon[34689]: [13/Sep/2024:02:54:39] ENGINE Bus STARTING 2024-09-13T02:54:40.401 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:40 smithi131 ceph-mon[34689]: [13/Sep/2024:02:54:39] ENGINE Serving on http://172.21.15.131:8765 2024-09-13T02:54:40.401 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:40 smithi131 ceph-mon[34689]: [13/Sep/2024:02:54:39] ENGINE Serving on https://172.21.15.131:7150 2024-09-13T02:54:40.402 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:40 smithi131 ceph-mon[34689]: [13/Sep/2024:02:54:39] ENGINE Bus STARTED 2024-09-13T02:54:40.402 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:40 smithi131 ceph-mon[34689]: [13/Sep/2024:02:54:39] ENGINE Error in HTTPServer.serve 2024-09-13T02:54:40.402 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: Traceback (most recent call last): 2024-09-13T02:54:40.402 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T02:54:40.402 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: self._connections.run(self.expiration_interval) 2024-09-13T02:54:40.402 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T02:54:40.402 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: self._run(expiration_interval) 2024-09-13T02:54:40.402 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T02:54:40.402 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T02:54:40.402 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T02:54:40.402 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T02:54:40.402 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T02:54:40.402 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: s = self.context.wrap_socket( 2024-09-13T02:54:40.402 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T02:54:40.403 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: return self.sslsocket_class._create( 2024-09-13T02:54:40.403 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T02:54:40.403 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: self.do_handshake() 2024-09-13T02:54:40.403 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T02:54:40.403 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: self._sslobj.do_handshake() 2024-09-13T02:54:40.403 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T02:54:41.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:41 smithi131 ceph-mon[34689]: pgmap v5: 65 pgs: 65 active+clean; 510 MiB data, 3.5 GiB used, 533 GiB / 536 GiB avail 2024-09-13T02:54:41.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:41 smithi089 ceph-mon[27639]: pgmap v5: 65 pgs: 65 active+clean; 510 MiB data, 3.5 GiB used, 533 GiB / 536 GiB avail 2024-09-13T02:54:42.492 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:42 smithi131 ceph-mon[34689]: mgrmap e24: smithi131.aunbqd(active, since 5s) 2024-09-13T02:54:42.492 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:42 smithi131 ceph-mon[34689]: Standby manager daemon smithi089.guohvs started 2024-09-13T02:54:42.492 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:42 smithi131 ceph-mon[34689]: from='mgr.? 172.21.15.89:0/2999596261' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi089.guohvs/crt"}]: dispatch 2024-09-13T02:54:42.492 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:42 smithi131 ceph-mon[34689]: from='mgr.? 172.21.15.89:0/2999596261' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T02:54:42.492 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:42 smithi131 ceph-mon[34689]: from='mgr.? 172.21.15.89:0/2999596261' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi089.guohvs/key"}]: dispatch 2024-09-13T02:54:42.493 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:42 smithi131 ceph-mon[34689]: from='mgr.? 172.21.15.89:0/2999596261' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T02:54:42.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:42 smithi089 ceph-mon[27639]: mgrmap e24: smithi131.aunbqd(active, since 5s) 2024-09-13T02:54:42.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:42 smithi089 ceph-mon[27639]: Standby manager daemon smithi089.guohvs started 2024-09-13T02:54:42.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:42 smithi089 ceph-mon[27639]: from='mgr.? 172.21.15.89:0/2999596261' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi089.guohvs/crt"}]: dispatch 2024-09-13T02:54:42.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:42 smithi089 ceph-mon[27639]: from='mgr.? 172.21.15.89:0/2999596261' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T02:54:42.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:42 smithi089 ceph-mon[27639]: from='mgr.? 172.21.15.89:0/2999596261' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi089.guohvs/key"}]: dispatch 2024-09-13T02:54:42.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:42 smithi089 ceph-mon[27639]: from='mgr.? 172.21.15.89:0/2999596261' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T02:54:43.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:43 smithi089 ceph-mon[27639]: pgmap v6: 65 pgs: 65 active+clean; 510 MiB data, 3.5 GiB used, 533 GiB / 536 GiB avail 2024-09-13T02:54:43.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:43 smithi089 ceph-mon[27639]: mgrmap e25: smithi131.aunbqd(active, since 6s), standbys: smithi089.guohvs 2024-09-13T02:54:43.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:43 smithi089 ceph-mon[27639]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "mgr metadata", "who": "smithi089.guohvs", "id": "smithi089.guohvs"}]: dispatch 2024-09-13T02:54:43.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:43 smithi131 ceph-mon[34689]: pgmap v6: 65 pgs: 65 active+clean; 510 MiB data, 3.5 GiB used, 533 GiB / 536 GiB avail 2024-09-13T02:54:43.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:43 smithi131 ceph-mon[34689]: mgrmap e25: smithi131.aunbqd(active, since 6s), standbys: smithi089.guohvs 2024-09-13T02:54:43.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:43 smithi131 ceph-mon[34689]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "mgr metadata", "who": "smithi089.guohvs", "id": "smithi089.guohvs"}]: dispatch 2024-09-13T02:54:44.679 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:44.677+0000 7fd6fd4c2640 1 -- 172.21.15.89:0/4182153992 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6f80ff730 msgr2=0x7fd6f8101b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:44.679 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:44.677+0000 7fd6fd4c2640 1 --2- 172.21.15.89:0/4182153992 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6f80ff730 0x7fd6f8101b10 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fd6e00048d0 tx=0x7fd6e0009da0 comp rx=0 tx=0).stop 2024-09-13T02:54:44.679 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:44.677+0000 7fd6fd4c2640 1 -- 172.21.15.89:0/4182153992 shutdown_connections 2024-09-13T02:54:44.679 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:44.677+0000 7fd6fd4c2640 1 --2- 172.21.15.89:0/4182153992 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6f80ff730 0x7fd6f8101b10 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:44.679 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:44.677+0000 7fd6fd4c2640 1 --2- 172.21.15.89:0/4182153992 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd6f8066410 0x7fd6f80ff1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:44.679 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:44.677+0000 7fd6fd4c2640 1 -- 172.21.15.89:0/4182153992 >> 172.21.15.89:0/4182153992 conn(0x7fd6f80f6c00 msgr2=0x7fd6f80f9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:54:44.679 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:44.677+0000 7fd6fd4c2640 1 -- 172.21.15.89:0/4182153992 shutdown_connections 2024-09-13T02:54:44.680 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:44.677+0000 7fd6fd4c2640 1 -- 172.21.15.89:0/4182153992 wait complete. 2024-09-13T02:54:44.680 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:44 smithi089 ceph-mon[27639]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' 2024-09-13T02:54:44.680 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:44 smithi089 ceph-mon[27639]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' 2024-09-13T02:54:44.680 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:44 smithi089 ceph-mon[27639]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' 2024-09-13T02:54:44.680 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:44 smithi089 ceph-mon[27639]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' 2024-09-13T02:54:44.681 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:44.678+0000 7fd6fd4c2640 1 Processor -- start 2024-09-13T02:54:44.682 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:44.678+0000 7fd6fd4c2640 1 -- start start 2024-09-13T02:54:44.682 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:44.678+0000 7fd6fd4c2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6f8066410 0x7fd6f810d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:54:44.682 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:44.678+0000 7fd6fd4c2640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd6f80ff730 0x7fd6f810d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:54:44.682 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:44.678+0000 7fd6fd4c2640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f810dc30 con 0x7fd6f8066410 2024-09-13T02:54:44.682 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:44.678+0000 7fd6fd4c2640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6f810e400 con 0x7fd6f80ff730 2024-09-13T02:54:44.682 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:44.678+0000 7fd6f6ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6f8066410 0x7fd6f810d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:54:44.682 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:44.678+0000 7fd6f6ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6f8066410 0x7fd6f810d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:52302/0 (socket says 172.21.15.89:52302) 2024-09-13T02:54:44.682 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:44.678+0000 7fd6f6ffd640 1 -- 172.21.15.89:0/677193111 learned_addr learned my addr 172.21.15.89:0/677193111 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:54:44.682 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:44.678+0000 7fd6effff640 1 --2- 172.21.15.89:0/677193111 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd6f80ff730 0x7fd6f810d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:54:44.682 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:44.679+0000 7fd6f6ffd640 1 -- 172.21.15.89:0/677193111 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd6f80ff730 msgr2=0x7fd6f810d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:44.682 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:44.679+0000 7fd6f6ffd640 1 --2- 172.21.15.89:0/677193111 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd6f80ff730 0x7fd6f810d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:44.682 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:44.679+0000 7fd6f6ffd640 1 -- 172.21.15.89:0/677193111 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6e0005040 con 0x7fd6f8066410 2024-09-13T02:54:44.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:44.679+0000 7fd6f6ffd640 1 --2- 172.21.15.89:0/677193111 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6f8066410 0x7fd6f810d0a0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fd6e800eb70 tx=0x7fd6e800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:54:44.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:44.679+0000 7fd6ef7fe640 1 -- 172.21.15.89:0/677193111 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6e8007c30 con 0x7fd6f8066410 2024-09-13T02:54:44.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:44.679+0000 7fd6ef7fe640 1 -- 172.21.15.89:0/677193111 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd6e800f040 con 0x7fd6f8066410 2024-09-13T02:54:44.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:44.679+0000 7fd6ef7fe640 1 -- 172.21.15.89:0/677193111 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd6e800cb80 con 0x7fd6f8066410 2024-09-13T02:54:44.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:44.679+0000 7fd6fd4c2640 1 -- 172.21.15.89:0/677193111 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6f810e6e0 con 0x7fd6f8066410 2024-09-13T02:54:44.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:44.679+0000 7fd6fd4c2640 1 -- 172.21.15.89:0/677193111 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6f810ebb0 con 0x7fd6f8066410 2024-09-13T02:54:44.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:44.680+0000 7fd6fd4c2640 1 -- 172.21.15.89:0/677193111 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6d8005240 con 0x7fd6f8066410 2024-09-13T02:54:44.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:44 smithi131 ceph-mon[34689]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' 2024-09-13T02:54:44.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:44 smithi131 ceph-mon[34689]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' 2024-09-13T02:54:44.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:44 smithi131 ceph-mon[34689]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' 2024-09-13T02:54:44.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:44 smithi131 ceph-mon[34689]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' 2024-09-13T02:54:44.684 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:44.681+0000 7fd6ef7fe640 1 -- 172.21.15.89:0/677193111 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7fd6e8009740 con 0x7fd6f8066410 2024-09-13T02:54:44.685 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:44.682+0000 7fd6ef7fe640 1 --2- 172.21.15.89:0/677193111 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7fd6e406e6e0 0x7fd6e4070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:54:44.685 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:44.682+0000 7fd6ef7fe640 1 -- 172.21.15.89:0/677193111 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fd6e808e550 con 0x7fd6f8066410 2024-09-13T02:54:44.685 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:44.682+0000 7fd6effff640 1 --2- 172.21.15.89:0/677193111 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7fd6e406e6e0 0x7fd6e4070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:54:44.685 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:44.683+0000 7fd6effff640 1 --2- 172.21.15.89:0/677193111 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7fd6e406e6e0 0x7fd6e4070b90 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd6e0007ac0 tx=0x7fd6e0035040 comp rx=0 tx=0).ready entity=mgr.24393 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:54:44.688 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:44.686+0000 7fd6ef7fe640 1 -- 172.21.15.89:0/677193111 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fd6e8058030 con 0x7fd6f8066410 2024-09-13T02:54:44.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:44.882+0000 7fd6fd4c2640 1 -- 172.21.15.89:0/677193111 --> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd6d8000bf0 con 0x7fd6e406e6e0 2024-09-13T02:54:44.885 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:44.884+0000 7fd6ef7fe640 1 -- 172.21.15.89:0/677193111 <== mgr.24393 v2:172.21.15.131:6828/2180703853 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7fd6d8000bf0 con 0x7fd6e406e6e0 2024-09-13T02:54:44.889 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:44.887+0000 7fd6fd4c2640 1 -- 172.21.15.89:0/677193111 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7fd6e406e6e0 msgr2=0x7fd6e4070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:44.889 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:44.887+0000 7fd6fd4c2640 1 --2- 172.21.15.89:0/677193111 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7fd6e406e6e0 0x7fd6e4070b90 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fd6e0007ac0 tx=0x7fd6e0035040 comp rx=0 tx=0).stop 2024-09-13T02:54:44.889 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:44.887+0000 7fd6fd4c2640 1 -- 172.21.15.89:0/677193111 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6f8066410 msgr2=0x7fd6f810d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:44.889 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:44.887+0000 7fd6fd4c2640 1 --2- 172.21.15.89:0/677193111 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6f8066410 0x7fd6f810d0a0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fd6e800eb70 tx=0x7fd6e800b040 comp rx=0 tx=0).stop 2024-09-13T02:54:44.889 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:44.887+0000 7fd6fd4c2640 1 -- 172.21.15.89:0/677193111 shutdown_connections 2024-09-13T02:54:44.889 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:44.888+0000 7fd6fd4c2640 1 --2- 172.21.15.89:0/677193111 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7fd6e406e6e0 0x7fd6e4070b90 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:44.889 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:44.888+0000 7fd6fd4c2640 1 --2- 172.21.15.89:0/677193111 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd6f80ff730 0x7fd6f810d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:44.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:44.888+0000 7fd6fd4c2640 1 --2- 172.21.15.89:0/677193111 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd6f8066410 0x7fd6f810d0a0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:44.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:44.888+0000 7fd6fd4c2640 1 -- 172.21.15.89:0/677193111 >> 172.21.15.89:0/677193111 conn(0x7fd6f80f6c00 msgr2=0x7fd6f80f6fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:54:44.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:44.888+0000 7fd6fd4c2640 1 -- 172.21.15.89:0/677193111 shutdown_connections 2024-09-13T02:54:44.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:44.888+0000 7fd6fd4c2640 1 -- 172.21.15.89:0/677193111 wait complete. 2024-09-13T02:54:44.900 INFO:teuthology.orchestra.run.smithi089.stdout:true 2024-09-13T02:54:45.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.008+0000 7fbc8acc0640 1 -- 172.21.15.89:0/493403738 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbc84102b60 msgr2=0x7fbc84102f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:45.010 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.008+0000 7fbc8acc0640 1 --2- 172.21.15.89:0/493403738 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbc84102b60 0x7fbc84102f70 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fbc740048d0 tx=0x7fbc74009da0 comp rx=0 tx=0).stop 2024-09-13T02:54:45.010 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.008+0000 7fbc8acc0640 1 -- 172.21.15.89:0/493403738 shutdown_connections 2024-09-13T02:54:45.010 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.008+0000 7fbc8acc0640 1 --2- 172.21.15.89:0/493403738 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbc84103e30 0x7fbc841042a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:45.010 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.008+0000 7fbc8acc0640 1 --2- 172.21.15.89:0/493403738 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbc84102b60 0x7fbc84102f70 secure :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fbc740048d0 tx=0x7fbc74009da0 comp rx=0 tx=0).stop 2024-09-13T02:54:45.010 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.008+0000 7fbc8acc0640 1 -- 172.21.15.89:0/493403738 >> 172.21.15.89:0/493403738 conn(0x7fbc84071dc0 msgr2=0x7fbc840741f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:54:45.010 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.008+0000 7fbc8acc0640 1 -- 172.21.15.89:0/493403738 shutdown_connections 2024-09-13T02:54:45.010 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.009+0000 7fbc8acc0640 1 -- 172.21.15.89:0/493403738 wait complete. 2024-09-13T02:54:45.011 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.009+0000 7fbc8acc0640 1 Processor -- start 2024-09-13T02:54:45.011 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.009+0000 7fbc8acc0640 1 -- start start 2024-09-13T02:54:45.011 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.010+0000 7fbc8acc0640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbc84103e30 0x7fbc841137c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:54:45.011 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.010+0000 7fbc8acc0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbc84113d00 0x7fbc84114b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:54:45.011 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.010+0000 7fbc8acc0640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc841141c0 con 0x7fbc84113d00 2024-09-13T02:54:45.011 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.010+0000 7fbc8acc0640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc84114300 con 0x7fbc84103e30 2024-09-13T02:54:45.012 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.010+0000 7fbc83fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbc84113d00 0x7fbc84114b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:54:45.012 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.010+0000 7fbc83fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbc84113d00 0x7fbc84114b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:52316/0 (socket says 172.21.15.89:52316) 2024-09-13T02:54:45.012 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.010+0000 7fbc83fff640 1 -- 172.21.15.89:0/1959606994 learned_addr learned my addr 172.21.15.89:0/1959606994 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:54:45.012 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.011+0000 7fbc83fff640 1 -- 172.21.15.89:0/1959606994 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbc84103e30 msgr2=0x7fbc841137c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:45.013 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.011+0000 7fbc83fff640 1 --2- 172.21.15.89:0/1959606994 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbc84103e30 0x7fbc841137c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:45.013 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.011+0000 7fbc83fff640 1 -- 172.21.15.89:0/1959606994 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc74005040 con 0x7fbc84113d00 2024-09-13T02:54:45.013 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.011+0000 7fbc83fff640 1 --2- 172.21.15.89:0/1959606994 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbc84113d00 0x7fbc84114b70 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c00cae0 tx=0x7fbc7c007e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:54:45.013 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.011+0000 7fbc817fa640 1 -- 172.21.15.89:0/1959606994 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc7c00ab00 con 0x7fbc84113d00 2024-09-13T02:54:45.013 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.011+0000 7fbc8acc0640 1 -- 172.21.15.89:0/1959606994 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc84115170 con 0x7fbc84113d00 2024-09-13T02:54:45.013 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.011+0000 7fbc817fa640 1 -- 172.21.15.89:0/1959606994 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fbc7c00ac60 con 0x7fbc84113d00 2024-09-13T02:54:45.015 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.012+0000 7fbc817fa640 1 -- 172.21.15.89:0/1959606994 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc7c0115e0 con 0x7fbc84113d00 2024-09-13T02:54:45.015 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.012+0000 7fbc8acc0640 1 -- 172.21.15.89:0/1959606994 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc84115710 con 0x7fbc84113d00 2024-09-13T02:54:45.015 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.014+0000 7fbc817fa640 1 -- 172.21.15.89:0/1959606994 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7fbc7c0129e0 con 0x7fbc84113d00 2024-09-13T02:54:45.015 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.014+0000 7fbc8acc0640 1 -- 172.21.15.89:0/1959606994 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc8410bd70 con 0x7fbc84113d00 2024-09-13T02:54:45.016 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.014+0000 7fbc817fa640 1 --2- 172.21.15.89:0/1959606994 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7fbc6c06e6e0 0x7fbc6c070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:54:45.016 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.014+0000 7fbc817fa640 1 -- 172.21.15.89:0/1959606994 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fbc7c08e680 con 0x7fbc84113d00 2024-09-13T02:54:45.016 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.015+0000 7fbc88a5c640 1 --2- 172.21.15.89:0/1959606994 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7fbc6c06e6e0 0x7fbc6c070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:54:45.017 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.015+0000 7fbc88a5c640 1 --2- 172.21.15.89:0/1959606994 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7fbc6c06e6e0 0x7fbc6c070b90 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fbc74000c00 tx=0x7fbc74009da0 comp rx=0 tx=0).ready entity=mgr.24393 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:54:45.024 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.023+0000 7fbc817fa640 1 -- 172.21.15.89:0/1959606994 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fbc7c058150 con 0x7fbc84113d00 2024-09-13T02:54:45.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.300+0000 7fbc8acc0640 1 -- 172.21.15.89:0/1959606994 --> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbc8410b6e0 con 0x7fbc6c06e6e0 2024-09-13T02:54:45.302 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.301+0000 7fbc817fa640 1 -- 172.21.15.89:0/1959606994 <== mgr.24393 v2:172.21.15.131:6828/2180703853 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7fbc8410b6e0 con 0x7fbc6c06e6e0 2024-09-13T02:54:45.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.304+0000 7fbc8acc0640 1 -- 172.21.15.89:0/1959606994 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7fbc6c06e6e0 msgr2=0x7fbc6c070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:45.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.304+0000 7fbc8acc0640 1 --2- 172.21.15.89:0/1959606994 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7fbc6c06e6e0 0x7fbc6c070b90 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fbc74000c00 tx=0x7fbc74009da0 comp rx=0 tx=0).stop 2024-09-13T02:54:45.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.304+0000 7fbc8acc0640 1 -- 172.21.15.89:0/1959606994 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbc84113d00 msgr2=0x7fbc84114b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:45.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.304+0000 7fbc8acc0640 1 --2- 172.21.15.89:0/1959606994 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbc84113d00 0x7fbc84114b70 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fbc7c00cae0 tx=0x7fbc7c007e50 comp rx=0 tx=0).stop 2024-09-13T02:54:45.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.304+0000 7fbc8acc0640 1 -- 172.21.15.89:0/1959606994 shutdown_connections 2024-09-13T02:54:45.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.304+0000 7fbc8acc0640 1 --2- 172.21.15.89:0/1959606994 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7fbc6c06e6e0 0x7fbc6c070b90 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:45.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.304+0000 7fbc8acc0640 1 --2- 172.21.15.89:0/1959606994 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbc84113d00 0x7fbc84114b70 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:45.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.304+0000 7fbc8acc0640 1 --2- 172.21.15.89:0/1959606994 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbc84103e30 0x7fbc841137c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:45.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.304+0000 7fbc8acc0640 1 -- 172.21.15.89:0/1959606994 >> 172.21.15.89:0/1959606994 conn(0x7fbc84071dc0 msgr2=0x7fbc84073610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:54:45.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.304+0000 7fbc8acc0640 1 -- 172.21.15.89:0/1959606994 shutdown_connections 2024-09-13T02:54:45.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.304+0000 7fbc8acc0640 1 -- 172.21.15.89:0/1959606994 wait complete. 2024-09-13T02:54:45.393 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.392+0000 7fdd3dd22640 1 -- 172.21.15.89:0/2359100331 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdd380fb430 msgr2=0x7fdd380fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:45.394 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.392+0000 7fdd3dd22640 1 --2- 172.21.15.89:0/2359100331 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdd380fb430 0x7fdd380fb840 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fdd280048d0 tx=0x7fdd28009da0 comp rx=0 tx=0).stop 2024-09-13T02:54:45.394 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.392+0000 7fdd3dd22640 1 -- 172.21.15.89:0/2359100331 shutdown_connections 2024-09-13T02:54:45.394 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.392+0000 7fdd3dd22640 1 --2- 172.21.15.89:0/2359100331 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdd380fc700 0x7fdd380fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:45.394 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.392+0000 7fdd3dd22640 1 --2- 172.21.15.89:0/2359100331 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdd380fb430 0x7fdd380fb840 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:45.394 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.392+0000 7fdd3dd22640 1 -- 172.21.15.89:0/2359100331 >> 172.21.15.89:0/2359100331 conn(0x7fdd380f6c10 msgr2=0x7fdd380f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:54:45.394 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.392+0000 7fdd3dd22640 1 -- 172.21.15.89:0/2359100331 shutdown_connections 2024-09-13T02:54:45.394 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.392+0000 7fdd3dd22640 1 -- 172.21.15.89:0/2359100331 wait complete. 2024-09-13T02:54:45.396 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.393+0000 7fdd3dd22640 1 Processor -- start 2024-09-13T02:54:45.396 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.393+0000 7fdd3dd22640 1 -- start start 2024-09-13T02:54:45.396 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.393+0000 7fdd3dd22640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdd380fb430 0x7fdd3810fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:54:45.396 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.393+0000 7fdd3dd22640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdd380fc700 0x7fdd38112310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:54:45.396 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.393+0000 7fdd3dd22640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd38065c60 con 0x7fdd380fc700 2024-09-13T02:54:45.396 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.393+0000 7fdd3dd22640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd38065dd0 con 0x7fdd380fb430 2024-09-13T02:54:45.396 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.393+0000 7fdd36ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdd380fc700 0x7fdd38112310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:54:45.396 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.393+0000 7fdd36ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdd380fc700 0x7fdd38112310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:52326/0 (socket says 172.21.15.89:52326) 2024-09-13T02:54:45.396 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.393+0000 7fdd36ffd640 1 -- 172.21.15.89:0/920945297 learned_addr learned my addr 172.21.15.89:0/920945297 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:54:45.396 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.393+0000 7fdd377fe640 1 --2- 172.21.15.89:0/920945297 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdd380fb430 0x7fdd3810fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:54:45.396 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.394+0000 7fdd36ffd640 1 -- 172.21.15.89:0/920945297 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdd380fb430 msgr2=0x7fdd3810fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:45.397 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.394+0000 7fdd36ffd640 1 --2- 172.21.15.89:0/920945297 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdd380fb430 0x7fdd3810fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:45.397 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.394+0000 7fdd36ffd640 1 -- 172.21.15.89:0/920945297 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd28005040 con 0x7fdd380fc700 2024-09-13T02:54:45.397 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.394+0000 7fdd36ffd640 1 --2- 172.21.15.89:0/920945297 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdd380fc700 0x7fdd38112310 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fdd2c00eb70 tx=0x7fdd2c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:54:45.397 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.394+0000 7fdd1ffff640 1 -- 172.21.15.89:0/920945297 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd2c007c30 con 0x7fdd380fc700 2024-09-13T02:54:45.397 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.394+0000 7fdd1ffff640 1 -- 172.21.15.89:0/920945297 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fdd2c00f040 con 0x7fdd380fc700 2024-09-13T02:54:45.397 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.394+0000 7fdd3dd22640 1 -- 172.21.15.89:0/920945297 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd38112850 con 0x7fdd380fc700 2024-09-13T02:54:45.397 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.394+0000 7fdd3dd22640 1 -- 172.21.15.89:0/920945297 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd38112d00 con 0x7fdd380fc700 2024-09-13T02:54:45.397 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.394+0000 7fdd1ffff640 1 -- 172.21.15.89:0/920945297 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd2c00ca60 con 0x7fdd380fc700 2024-09-13T02:54:45.398 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.395+0000 7fdd3dd22640 1 -- 172.21.15.89:0/920945297 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd24005240 con 0x7fdd380fc700 2024-09-13T02:54:45.398 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.396+0000 7fdd1ffff640 1 -- 172.21.15.89:0/920945297 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7fdd2c00cbc0 con 0x7fdd380fc700 2024-09-13T02:54:45.398 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.396+0000 7fdd1ffff640 1 --2- 172.21.15.89:0/920945297 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7fdd2006e6e0 0x7fdd20070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:54:45.398 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.397+0000 7fdd1ffff640 1 -- 172.21.15.89:0/920945297 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fdd2c08d950 con 0x7fdd380fc700 2024-09-13T02:54:45.398 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.397+0000 7fdd377fe640 1 --2- 172.21.15.89:0/920945297 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7fdd2006e6e0 0x7fdd20070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:54:45.399 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.397+0000 7fdd377fe640 1 --2- 172.21.15.89:0/920945297 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7fdd2006e6e0 0x7fdd20070b90 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fdd28000c00 tx=0x7fdd28035040 comp rx=0 tx=0).ready entity=mgr.24393 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:54:45.402 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.401+0000 7fdd1ffff640 1 -- 172.21.15.89:0/920945297 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fdd2c057300 con 0x7fdd380fc700 2024-09-13T02:54:45.578 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:45 smithi089 ceph-mon[27639]: pgmap v7: 65 pgs: 65 active+clean; 329 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 403 op/s 2024-09-13T02:54:45.673 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.672+0000 7fdd3dd22640 1 -- 172.21.15.89:0/920945297 --> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fdd24000bf0 con 0x7fdd2006e6e0 2024-09-13T02:54:45.683 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:45 smithi131 ceph-mon[34689]: pgmap v7: 65 pgs: 65 active+clean; 329 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.7 MiB/s wr, 403 op/s 2024-09-13T02:54:45.690 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.689+0000 7fdd1ffff640 1 -- 172.21.15.89:0/920945297 <== mgr.24393 v2:172.21.15.131:6828/2180703853 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fdd24000bf0 con 0x7fdd2006e6e0 2024-09-13T02:54:45.690 INFO:teuthology.orchestra.run.smithi089.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T02:54:45.690 INFO:teuthology.orchestra.run.smithi089.stdout:alertmanager.smithi089 smithi089 *:9093,9094 running (7m) 2m ago 8m 24.9M - 0.25.0 c8568f914cd2 e0d15812dfa4 2024-09-13T02:54:45.690 INFO:teuthology.orchestra.run.smithi089.stdout:crash.smithi089 smithi089 running (8m) 2m ago 8m 6895k - 17.2.7-1627-gbbdadfa3 a994b00deb3a e8994cd5600e 2024-09-13T02:54:45.690 INFO:teuthology.orchestra.run.smithi089.stdout:crash.smithi131 smithi131 running (7m) 2s ago 7m 6895k - 17.2.7-1627-gbbdadfa3 a994b00deb3a dcbb0a9d5261 2024-09-13T02:54:45.690 INFO:teuthology.orchestra.run.smithi089.stdout:grafana.smithi089 smithi089 *:3000 running (6m) 2m ago 8m 83.4M - 9.4.7 954c08fa6188 bb04115ceb76 2024-09-13T02:54:45.690 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi089.qjoitb smithi089 running (2m) 2m ago 2m 11.9M - 17.2.7-1627-gbbdadfa3 a994b00deb3a ff9b59ec5107 2024-09-13T02:54:45.691 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi089.rarddb smithi089 running (2m) 2m ago 2m 15.2M - 17.2.7-1627-gbbdadfa3 a994b00deb3a db2dc502c1ba 2024-09-13T02:54:45.691 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi131.rbovzc smithi131 running (2m) 2s ago 2m 82.3M - 17.2.7-1627-gbbdadfa3 a994b00deb3a d071b6d99537 2024-09-13T02:54:45.691 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi131.uasrkg smithi131 running (2m) 2s ago 2m 165M - 17.2.7-1627-gbbdadfa3 a994b00deb3a 0b3d4ffa6ce5 2024-09-13T02:54:45.691 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.smithi089.guohvs smithi089 *:9283,8765,8443 running (9m) 2m ago 9m 449M - 17.2.7-1627-gbbdadfa3 a994b00deb3a 32ceefe7e647 2024-09-13T02:54:45.691 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.smithi131.aunbqd smithi131 *:8443,9283 running (18s) 2s ago 7m 482M - 19.1.1-322-g7741f7f9 19dc8d659727 fbb86845e934 2024-09-13T02:54:45.691 INFO:teuthology.orchestra.run.smithi089.stdout:mon.smithi089 smithi089 running (9m) 2m ago 9m 47.2M 2048M 17.2.7-1627-gbbdadfa3 a994b00deb3a d2f18141b2af 2024-09-13T02:54:45.691 INFO:teuthology.orchestra.run.smithi089.stdout:mon.smithi131 smithi131 running (7m) 2s ago 7m 41.7M 2048M 17.2.7-1627-gbbdadfa3 a994b00deb3a 1191e59dc7a0 2024-09-13T02:54:45.691 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.smithi089 smithi089 *:9100 running (8m) 2m ago 8m 16.2M - 1.5.0 0da6a335fe13 c5dbf820b035 2024-09-13T02:54:45.691 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.smithi131 smithi131 *:9100 running (7m) 2s ago 7m 16.3M - 1.5.0 0da6a335fe13 c3309019f407 2024-09-13T02:54:45.691 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0 smithi089 running (6m) 2m ago 6m 48.0M 4287M 17.2.7-1627-gbbdadfa3 a994b00deb3a b9404e2bc82c 2024-09-13T02:54:45.691 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1 smithi089 running (6m) 2m ago 6m 45.8M 4287M 17.2.7-1627-gbbdadfa3 a994b00deb3a af6538730e42 2024-09-13T02:54:45.691 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2 smithi089 running (5m) 2m ago 5m 46.4M 4287M 17.2.7-1627-gbbdadfa3 a994b00deb3a 447cf103114b 2024-09-13T02:54:45.691 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3 smithi131 running (5m) 2s ago 5m 240M 5312M 17.2.7-1627-gbbdadfa3 a994b00deb3a 0b80a4dea862 2024-09-13T02:54:45.692 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4 smithi131 running (4m) 2s ago 4m 215M 5312M 17.2.7-1627-gbbdadfa3 a994b00deb3a 06ec44680b00 2024-09-13T02:54:45.692 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5 smithi131 running (4m) 2s ago 4m 218M 5312M 17.2.7-1627-gbbdadfa3 a994b00deb3a ace4b45e5873 2024-09-13T02:54:45.692 INFO:teuthology.orchestra.run.smithi089.stdout:prometheus.smithi089 smithi089 *:9095 running (6m) 2m ago 7m 52.8M - 2.43.0 a07b618ecd1d 003f13763491 2024-09-13T02:54:45.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.691+0000 7fdd3dd22640 1 -- 172.21.15.89:0/920945297 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7fdd2006e6e0 msgr2=0x7fdd20070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:45.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.691+0000 7fdd3dd22640 1 --2- 172.21.15.89:0/920945297 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7fdd2006e6e0 0x7fdd20070b90 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fdd28000c00 tx=0x7fdd28035040 comp rx=0 tx=0).stop 2024-09-13T02:54:45.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.691+0000 7fdd3dd22640 1 -- 172.21.15.89:0/920945297 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdd380fc700 msgr2=0x7fdd38112310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:45.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.691+0000 7fdd3dd22640 1 --2- 172.21.15.89:0/920945297 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdd380fc700 0x7fdd38112310 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fdd2c00eb70 tx=0x7fdd2c00b040 comp rx=0 tx=0).stop 2024-09-13T02:54:45.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.691+0000 7fdd3dd22640 1 -- 172.21.15.89:0/920945297 shutdown_connections 2024-09-13T02:54:45.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.691+0000 7fdd3dd22640 1 --2- 172.21.15.89:0/920945297 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7fdd2006e6e0 0x7fdd20070b90 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:45.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.691+0000 7fdd3dd22640 1 --2- 172.21.15.89:0/920945297 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdd380fc700 0x7fdd38112310 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:45.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.691+0000 7fdd3dd22640 1 --2- 172.21.15.89:0/920945297 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdd380fb430 0x7fdd3810fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:45.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.691+0000 7fdd3dd22640 1 -- 172.21.15.89:0/920945297 >> 172.21.15.89:0/920945297 conn(0x7fdd380f6c10 msgr2=0x7fdd380f83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:54:45.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.691+0000 7fdd3dd22640 1 -- 172.21.15.89:0/920945297 shutdown_connections 2024-09-13T02:54:45.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.691+0000 7fdd3dd22640 1 -- 172.21.15.89:0/920945297 wait complete. 2024-09-13T02:54:45.789 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.788+0000 7f5cd2e80640 1 -- 172.21.15.89:0/872713929 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ccc0fc6f0 msgr2=0x7f5ccc0fcb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:45.790 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.788+0000 7f5cd2e80640 1 --2- 172.21.15.89:0/872713929 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ccc0fc6f0 0x7f5ccc0fcb60 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f5cb80048d0 tx=0x7f5cb8009da0 comp rx=0 tx=0).stop 2024-09-13T02:54:45.790 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.788+0000 7f5cd2e80640 1 -- 172.21.15.89:0/872713929 shutdown_connections 2024-09-13T02:54:45.790 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.788+0000 7f5cd2e80640 1 --2- 172.21.15.89:0/872713929 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ccc0fc6f0 0x7f5ccc0fcb60 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:45.790 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.788+0000 7f5cd2e80640 1 --2- 172.21.15.89:0/872713929 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ccc0fb420 0x7f5ccc0fb830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:45.790 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.788+0000 7f5cd2e80640 1 -- 172.21.15.89:0/872713929 >> 172.21.15.89:0/872713929 conn(0x7f5ccc0f6c00 msgr2=0x7f5ccc0f9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:54:45.790 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.788+0000 7f5cd2e80640 1 -- 172.21.15.89:0/872713929 shutdown_connections 2024-09-13T02:54:45.790 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.788+0000 7f5cd2e80640 1 -- 172.21.15.89:0/872713929 wait complete. 2024-09-13T02:54:45.790 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.788+0000 7f5cd2e80640 1 Processor -- start 2024-09-13T02:54:45.790 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.788+0000 7f5cd2e80640 1 -- start start 2024-09-13T02:54:45.792 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.789+0000 7f5cd2e80640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ccc0fb420 0x7f5ccc10d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:54:45.792 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.789+0000 7f5cd2e80640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ccc0fc6f0 0x7f5ccc10d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:54:45.792 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.789+0000 7f5cd2e80640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ccc10dc70 con 0x7f5ccc0fc6f0 2024-09-13T02:54:45.792 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.789+0000 7f5cd2e80640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ccc10e440 con 0x7f5ccc0fb420 2024-09-13T02:54:45.792 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.789+0000 7f5ccbfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ccc0fc6f0 0x7f5ccc10d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:54:45.792 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.789+0000 7f5ccbfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ccc0fc6f0 0x7f5ccc10d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:52334/0 (socket says 172.21.15.89:52334) 2024-09-13T02:54:45.792 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.789+0000 7f5ccbfff640 1 -- 172.21.15.89:0/4284074636 learned_addr learned my addr 172.21.15.89:0/4284074636 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:54:45.792 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.789+0000 7f5cd0c1c640 1 --2- 172.21.15.89:0/4284074636 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ccc0fb420 0x7f5ccc10d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:54:45.793 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.789+0000 7f5ccbfff640 1 -- 172.21.15.89:0/4284074636 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ccc0fb420 msgr2=0x7f5ccc10d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:45.793 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.789+0000 7f5ccbfff640 1 --2- 172.21.15.89:0/4284074636 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ccc0fb420 0x7f5ccc10d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:45.793 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.789+0000 7f5ccbfff640 1 -- 172.21.15.89:0/4284074636 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cb8005040 con 0x7f5ccc0fc6f0 2024-09-13T02:54:45.793 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.790+0000 7f5ccbfff640 1 --2- 172.21.15.89:0/4284074636 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ccc0fc6f0 0x7f5ccc10d620 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f5cb80043d0 tx=0x7f5cb8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:54:45.793 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.790+0000 7f5cc97fa640 1 -- 172.21.15.89:0/4284074636 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5cb8038070 con 0x7f5ccc0fc6f0 2024-09-13T02:54:45.793 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.790+0000 7f5cd2e80640 1 -- 172.21.15.89:0/4284074636 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ccc10e670 con 0x7f5ccc0fc6f0 2024-09-13T02:54:45.793 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.790+0000 7f5cd2e80640 1 -- 172.21.15.89:0/4284074636 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ccc10eb90 con 0x7f5ccc0fc6f0 2024-09-13T02:54:45.793 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.790+0000 7f5cc97fa640 1 -- 172.21.15.89:0/4284074636 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f5cb802ae90 con 0x7f5ccc0fc6f0 2024-09-13T02:54:45.793 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.790+0000 7f5cc97fa640 1 -- 172.21.15.89:0/4284074636 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5cb803e670 con 0x7f5ccc0fc6f0 2024-09-13T02:54:45.793 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.791+0000 7f5cd2e80640 1 -- 172.21.15.89:0/4284074636 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ccc0fa880 con 0x7f5ccc0fc6f0 2024-09-13T02:54:45.794 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.791+0000 7f5cc97fa640 1 -- 172.21.15.89:0/4284074636 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7f5cb8030020 con 0x7f5ccc0fc6f0 2024-09-13T02:54:45.794 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.792+0000 7f5cc97fa640 1 --2- 172.21.15.89:0/4284074636 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7f5cbc06e6e0 0x7f5cbc070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:54:45.794 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.792+0000 7f5cc97fa640 1 -- 172.21.15.89:0/4284074636 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f5cb80adff0 con 0x7f5ccc0fc6f0 2024-09-13T02:54:45.794 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.792+0000 7f5cd0c1c640 1 --2- 172.21.15.89:0/4284074636 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7f5cbc06e6e0 0x7f5cbc070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:54:45.794 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.793+0000 7f5cd0c1c640 1 --2- 172.21.15.89:0/4284074636 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7f5cbc06e6e0 0x7f5cbc070b90 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f5cc0009fd0 tx=0x7f5cc0013040 comp rx=0 tx=0).ready entity=mgr.24393 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:54:45.800 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:45.799+0000 7f5cc97fa640 1 -- 172.21.15.89:0/4284074636 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f5cb8077ab0 con 0x7f5ccc0fc6f0 2024-09-13T02:54:46.100 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.098+0000 7f5cd2e80640 1 -- 172.21.15.89:0/4284074636 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f5ccc103e20 con 0x7f5ccc0fc6f0 2024-09-13T02:54:46.100 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.099+0000 7f5cc97fa640 1 -- 172.21.15.89:0/4284074636 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+855 (secure 0 0 0) 0x7f5cb807b170 con 0x7f5ccc0fc6f0 2024-09-13T02:54:46.100 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-13T02:54:46.101 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": { 2024-09-13T02:54:46.101 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 2 2024-09-13T02:54:46.101 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T02:54:46.101 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": { 2024-09-13T02:54:46.101 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 1, 2024-09-13T02:54:46.101 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 1 2024-09-13T02:54:46.101 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T02:54:46.101 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": { 2024-09-13T02:54:46.101 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 6 2024-09-13T02:54:46.101 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T02:54:46.101 INFO:teuthology.orchestra.run.smithi089.stdout: "mds": { 2024-09-13T02:54:46.102 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 4 2024-09-13T02:54:46.102 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T02:54:46.102 INFO:teuthology.orchestra.run.smithi089.stdout: "overall": { 2024-09-13T02:54:46.102 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 13, 2024-09-13T02:54:46.102 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 1 2024-09-13T02:54:46.102 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-13T02:54:46.102 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-13T02:54:46.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.101+0000 7f5cd2e80640 1 -- 172.21.15.89:0/4284074636 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7f5cbc06e6e0 msgr2=0x7f5cbc070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:46.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.101+0000 7f5cd2e80640 1 --2- 172.21.15.89:0/4284074636 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7f5cbc06e6e0 0x7f5cbc070b90 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f5cc0009fd0 tx=0x7f5cc0013040 comp rx=0 tx=0).stop 2024-09-13T02:54:46.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.102+0000 7f5cd2e80640 1 -- 172.21.15.89:0/4284074636 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ccc0fc6f0 msgr2=0x7f5ccc10d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:46.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.102+0000 7f5cd2e80640 1 --2- 172.21.15.89:0/4284074636 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ccc0fc6f0 0x7f5ccc10d620 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f5cb80043d0 tx=0x7f5cb8009da0 comp rx=0 tx=0).stop 2024-09-13T02:54:46.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.102+0000 7f5cd2e80640 1 -- 172.21.15.89:0/4284074636 shutdown_connections 2024-09-13T02:54:46.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.102+0000 7f5cd2e80640 1 --2- 172.21.15.89:0/4284074636 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7f5cbc06e6e0 0x7f5cbc070b90 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:46.103 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.102+0000 7f5cd2e80640 1 --2- 172.21.15.89:0/4284074636 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5ccc0fc6f0 0x7f5ccc10d620 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:46.104 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.102+0000 7f5cd2e80640 1 --2- 172.21.15.89:0/4284074636 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5ccc0fb420 0x7f5ccc10d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:46.104 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.102+0000 7f5cd2e80640 1 -- 172.21.15.89:0/4284074636 >> 172.21.15.89:0/4284074636 conn(0x7f5ccc0f6c00 msgr2=0x7f5ccc065f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:54:46.104 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.102+0000 7f5cd2e80640 1 -- 172.21.15.89:0/4284074636 shutdown_connections 2024-09-13T02:54:46.104 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.102+0000 7f5cd2e80640 1 -- 172.21.15.89:0/4284074636 wait complete. 2024-09-13T02:54:46.210 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.209+0000 7eff07540640 1 -- 172.21.15.89:0/1762447069 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff000fb430 msgr2=0x7eff000fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:46.211 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.209+0000 7eff07540640 1 --2- 172.21.15.89:0/1762447069 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff000fb430 0x7eff000fb840 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7efefc0048d0 tx=0x7efefc009da0 comp rx=0 tx=0).stop 2024-09-13T02:54:46.211 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.209+0000 7eff07540640 1 -- 172.21.15.89:0/1762447069 shutdown_connections 2024-09-13T02:54:46.211 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.209+0000 7eff07540640 1 --2- 172.21.15.89:0/1762447069 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7eff000fc700 0x7eff000fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:46.211 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.209+0000 7eff07540640 1 --2- 172.21.15.89:0/1762447069 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff000fb430 0x7eff000fb840 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:46.211 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.209+0000 7eff07540640 1 -- 172.21.15.89:0/1762447069 >> 172.21.15.89:0/1762447069 conn(0x7eff000f6c10 msgr2=0x7eff000f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:54:46.211 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.209+0000 7eff07540640 1 -- 172.21.15.89:0/1762447069 shutdown_connections 2024-09-13T02:54:46.211 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.209+0000 7eff07540640 1 -- 172.21.15.89:0/1762447069 wait complete. 2024-09-13T02:54:46.212 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.210+0000 7eff07540640 1 Processor -- start 2024-09-13T02:54:46.212 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.211+0000 7eff07540640 1 -- start start 2024-09-13T02:54:46.213 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.211+0000 7eff07540640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff000fb430 0x7eff0010bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:54:46.213 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.211+0000 7eff07540640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7eff000fc700 0x7eff0010c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:54:46.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.211+0000 7eff07540640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff0010cb10 con 0x7eff000fb430 2024-09-13T02:54:46.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.211+0000 7eff07540640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff0010d330 con 0x7eff000fc700 2024-09-13T02:54:46.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.211+0000 7eff052dc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff000fb430 0x7eff0010bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:54:46.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.211+0000 7eff04adb640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7eff000fc700 0x7eff0010c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:54:46.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.211+0000 7eff04adb640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7eff000fc700 0x7eff0010c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.89:53942/0 (socket says 172.21.15.89:53942) 2024-09-13T02:54:46.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.211+0000 7eff052dc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff000fb430 0x7eff0010bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:52350/0 (socket says 172.21.15.89:52350) 2024-09-13T02:54:46.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.211+0000 7eff04adb640 1 -- 172.21.15.89:0/4106474752 learned_addr learned my addr 172.21.15.89:0/4106474752 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:54:46.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.212+0000 7eff052dc640 1 -- 172.21.15.89:0/4106474752 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7eff000fc700 msgr2=0x7eff0010c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:46.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.212+0000 7eff052dc640 1 --2- 172.21.15.89:0/4106474752 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7eff000fc700 0x7eff0010c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:46.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.212+0000 7eff052dc640 1 -- 172.21.15.89:0/4106474752 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efefc005040 con 0x7eff000fb430 2024-09-13T02:54:46.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.212+0000 7eff04adb640 1 --2- 172.21.15.89:0/4106474752 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7eff000fc700 0x7eff0010c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T02:54:46.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.212+0000 7eff052dc640 1 --2- 172.21.15.89:0/4106474752 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff000fb430 0x7eff0010bf80 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7efefc02a530 tx=0x7efefc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:54:46.215 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.212+0000 7efef5ffb640 1 -- 172.21.15.89:0/4106474752 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efefc038070 con 0x7eff000fb430 2024-09-13T02:54:46.215 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.212+0000 7eff07540640 1 -- 172.21.15.89:0/4106474752 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff0010d560 con 0x7eff000fb430 2024-09-13T02:54:46.215 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.212+0000 7efef5ffb640 1 -- 172.21.15.89:0/4106474752 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7efefc02ae90 con 0x7eff000fb430 2024-09-13T02:54:46.215 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.212+0000 7efef5ffb640 1 -- 172.21.15.89:0/4106474752 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efefc03e670 con 0x7eff000fb430 2024-09-13T02:54:46.215 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.213+0000 7eff07540640 1 -- 172.21.15.89:0/4106474752 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff0010db00 con 0x7eff000fb430 2024-09-13T02:54:46.215 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.214+0000 7eff07540640 1 -- 172.21.15.89:0/4106474752 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff000fa890 con 0x7eff000fb430 2024-09-13T02:54:46.216 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.215+0000 7efef5ffb640 1 -- 172.21.15.89:0/4106474752 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7efefc030020 con 0x7eff000fb430 2024-09-13T02:54:46.217 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.216+0000 7efef5ffb640 1 --2- 172.21.15.89:0/4106474752 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7efeec06e6e0 0x7efeec070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:54:46.217 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.216+0000 7efef5ffb640 1 -- 172.21.15.89:0/4106474752 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7efefc0ade80 con 0x7eff000fb430 2024-09-13T02:54:46.217 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.216+0000 7eff04adb640 1 --2- 172.21.15.89:0/4106474752 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7efeec06e6e0 0x7efeec070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:54:46.217 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.216+0000 7eff04adb640 1 --2- 172.21.15.89:0/4106474752 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7efeec06e6e0 0x7efeec070b90 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7eff0010bd30 tx=0x7efef0014040 comp rx=0 tx=0).ready entity=mgr.24393 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:54:46.220 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.219+0000 7efef5ffb640 1 -- 172.21.15.89:0/4106474752 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7efefc077a00 con 0x7eff000fb430 2024-09-13T02:54:46.553 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.552+0000 7eff07540640 1 -- 172.21.15.89:0/4106474752 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7eff0010dde0 con 0x7eff000fb430 2024-09-13T02:54:46.554 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.553+0000 7efef5ffb640 1 -- 172.21.15.89:0/4106474752 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1864 (secure 0 0 0) 0x7efefc07b0c0 con 0x7eff000fb430 2024-09-13T02:54:46.554 INFO:teuthology.orchestra.run.smithi089.stdout:e21 2024-09-13T02:54:46.554 INFO:teuthology.orchestra.run.smithi089.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T02:54:46.554 INFO:teuthology.orchestra.run.smithi089.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:54:46.554 INFO:teuthology.orchestra.run.smithi089.stdout:legacy client fscid: 1 2024-09-13T02:54:46.555 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:54:46.555 INFO:teuthology.orchestra.run.smithi089.stdout:Filesystem 'cephfs' (1) 2024-09-13T02:54:46.555 INFO:teuthology.orchestra.run.smithi089.stdout:fs_name cephfs 2024-09-13T02:54:46.555 INFO:teuthology.orchestra.run.smithi089.stdout:epoch 21 2024-09-13T02:54:46.555 INFO:teuthology.orchestra.run.smithi089.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T02:54:46.555 INFO:teuthology.orchestra.run.smithi089.stdout:created 2024-09-13T02:51:40.657817+0000 2024-09-13T02:54:46.555 INFO:teuthology.orchestra.run.smithi089.stdout:modified 2024-09-13T02:54:05.118633+0000 2024-09-13T02:54:46.555 INFO:teuthology.orchestra.run.smithi089.stdout:tableserver 0 2024-09-13T02:54:46.555 INFO:teuthology.orchestra.run.smithi089.stdout:root 0 2024-09-13T02:54:46.555 INFO:teuthology.orchestra.run.smithi089.stdout:session_timeout 60 2024-09-13T02:54:46.555 INFO:teuthology.orchestra.run.smithi089.stdout:session_autoclose 300 2024-09-13T02:54:46.555 INFO:teuthology.orchestra.run.smithi089.stdout:max_file_size 1099511627776 2024-09-13T02:54:46.555 INFO:teuthology.orchestra.run.smithi089.stdout:required_client_features {} 2024-09-13T02:54:46.555 INFO:teuthology.orchestra.run.smithi089.stdout:last_failure 0 2024-09-13T02:54:46.556 INFO:teuthology.orchestra.run.smithi089.stdout:last_failure_osd_epoch 44 2024-09-13T02:54:46.556 INFO:teuthology.orchestra.run.smithi089.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:54:46.556 INFO:teuthology.orchestra.run.smithi089.stdout:max_mds 2 2024-09-13T02:54:46.556 INFO:teuthology.orchestra.run.smithi089.stdout:in 0,1 2024-09-13T02:54:46.556 INFO:teuthology.orchestra.run.smithi089.stdout:up {0=14480,1=24257} 2024-09-13T02:54:46.556 INFO:teuthology.orchestra.run.smithi089.stdout:failed 2024-09-13T02:54:46.556 INFO:teuthology.orchestra.run.smithi089.stdout:damaged 2024-09-13T02:54:46.556 INFO:teuthology.orchestra.run.smithi089.stdout:stopped 2024-09-13T02:54:46.556 INFO:teuthology.orchestra.run.smithi089.stdout:data_pools [3] 2024-09-13T02:54:46.556 INFO:teuthology.orchestra.run.smithi089.stdout:metadata_pool 2 2024-09-13T02:54:46.556 INFO:teuthology.orchestra.run.smithi089.stdout:inline_data disabled 2024-09-13T02:54:46.556 INFO:teuthology.orchestra.run.smithi089.stdout:balancer 2024-09-13T02:54:46.556 INFO:teuthology.orchestra.run.smithi089.stdout:standby_count_wanted 1 2024-09-13T02:54:46.556 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi089.rarddb{0:14480} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.89:6828/1561365213,v1:172.21.15.89:6829/1561365213] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:54:46.557 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi089.qjoitb{0:14488} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.89:6826/1464393547,v1:172.21.15.89:6827/1464393547] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:54:46.557 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi131.uasrkg{1:24257} state up:active seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.131:6824/260493836,v1:172.21.15.131:6825/260493836] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:54:46.557 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi131.rbovzc{1:24265} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.131:6826/665579373,v1:172.21.15.131:6827/665579373] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:54:46.557 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:54:46.557 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:54:46.558 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 21 2024-09-13T02:54:46.558 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.556+0000 7eff07540640 1 -- 172.21.15.89:0/4106474752 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7efeec06e6e0 msgr2=0x7efeec070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:46.558 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.556+0000 7eff07540640 1 --2- 172.21.15.89:0/4106474752 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7efeec06e6e0 0x7efeec070b90 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7eff0010bd30 tx=0x7efef0014040 comp rx=0 tx=0).stop 2024-09-13T02:54:46.558 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.556+0000 7eff07540640 1 -- 172.21.15.89:0/4106474752 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff000fb430 msgr2=0x7eff0010bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:46.558 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.556+0000 7eff07540640 1 --2- 172.21.15.89:0/4106474752 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff000fb430 0x7eff0010bf80 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7efefc02a530 tx=0x7efefc009da0 comp rx=0 tx=0).stop 2024-09-13T02:54:46.558 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.556+0000 7eff07540640 1 -- 172.21.15.89:0/4106474752 shutdown_connections 2024-09-13T02:54:46.558 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.556+0000 7eff07540640 1 --2- 172.21.15.89:0/4106474752 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7efeec06e6e0 0x7efeec070b90 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:46.558 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.556+0000 7eff07540640 1 --2- 172.21.15.89:0/4106474752 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7eff000fc700 0x7eff0010c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:46.558 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.556+0000 7eff07540640 1 --2- 172.21.15.89:0/4106474752 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7eff000fb430 0x7eff0010bf80 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:46.559 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.557+0000 7eff07540640 1 -- 172.21.15.89:0/4106474752 >> 172.21.15.89:0/4106474752 conn(0x7eff000f6c10 msgr2=0x7eff000f83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:54:46.559 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.557+0000 7eff07540640 1 -- 172.21.15.89:0/4106474752 shutdown_connections 2024-09-13T02:54:46.559 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.557+0000 7eff07540640 1 -- 172.21.15.89:0/4106474752 wait complete. 2024-09-13T02:54:46.678 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.677+0000 7f38e367c640 1 -- 172.21.15.89:0/2601388964 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38dc0fc700 msgr2=0x7f38dc0fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:46.679 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.677+0000 7f38e367c640 1 --2- 172.21.15.89:0/2601388964 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38dc0fc700 0x7f38dc0fcb70 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f38cc0048d0 tx=0x7f38cc009da0 comp rx=0 tx=0).stop 2024-09-13T02:54:46.679 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:46 smithi089 ceph-mon[27639]: from='client.14678 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:54:46.679 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:46 smithi089 ceph-mon[27639]: from='client.14682 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:54:46.679 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:46 smithi089 ceph-mon[27639]: from='client.14686 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:54:46.679 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:46 smithi089 ceph-mon[27639]: from='client.? 172.21.15.89:0/4284074636' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:54:46.680 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.677+0000 7f38e367c640 1 -- 172.21.15.89:0/2601388964 shutdown_connections 2024-09-13T02:54:46.680 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.677+0000 7f38e367c640 1 --2- 172.21.15.89:0/2601388964 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38dc0fc700 0x7f38dc0fcb70 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:46.680 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.677+0000 7f38e367c640 1 --2- 172.21.15.89:0/2601388964 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f38dc0fb430 0x7f38dc0fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:46.680 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.677+0000 7f38e367c640 1 -- 172.21.15.89:0/2601388964 >> 172.21.15.89:0/2601388964 conn(0x7f38dc0f6c10 msgr2=0x7f38dc0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:54:46.680 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.677+0000 7f38e367c640 1 -- 172.21.15.89:0/2601388964 shutdown_connections 2024-09-13T02:54:46.681 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.678+0000 7f38e367c640 1 -- 172.21.15.89:0/2601388964 wait complete. 2024-09-13T02:54:46.681 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.679+0000 7f38e367c640 1 Processor -- start 2024-09-13T02:54:46.681 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.679+0000 7f38e367c640 1 -- start start 2024-09-13T02:54:46.682 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.679+0000 7f38e367c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f38dc0fb430 0x7f38dc10aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:54:46.682 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.680+0000 7f38e367c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38dc0fc700 0x7f38dc10b410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:54:46.682 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.680+0000 7f38e1418640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f38dc0fb430 0x7f38dc10aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:54:46.682 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.680+0000 7f38e1418640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f38dc0fb430 0x7f38dc10aed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.89:53974/0 (socket says 172.21.15.89:53974) 2024-09-13T02:54:46.682 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.680+0000 7f38e1418640 1 -- 172.21.15.89:0/2642607118 learned_addr learned my addr 172.21.15.89:0/2642607118 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:54:46.682 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.680+0000 7f38e367c640 1 -- 172.21.15.89:0/2642607118 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38dc10c140 con 0x7f38dc0fc700 2024-09-13T02:54:46.682 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.680+0000 7f38e367c640 1 -- 172.21.15.89:0/2642607118 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38dc10c2b0 con 0x7f38dc0fb430 2024-09-13T02:54:46.682 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.680+0000 7f38e0c17640 1 --2- 172.21.15.89:0/2642607118 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38dc0fc700 0x7f38dc10b410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:54:46.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.681+0000 7f38e0c17640 1 -- 172.21.15.89:0/2642607118 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f38dc0fb430 msgr2=0x7f38dc10aed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:46.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.681+0000 7f38e0c17640 1 --2- 172.21.15.89:0/2642607118 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f38dc0fb430 0x7f38dc10aed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:46.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.681+0000 7f38e0c17640 1 -- 172.21.15.89:0/2642607118 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38cc005040 con 0x7f38dc0fc700 2024-09-13T02:54:46.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.681+0000 7f38e1418640 1 --2- 172.21.15.89:0/2642607118 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f38dc0fb430 0x7f38dc10aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T02:54:46.684 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.682+0000 7f38e0c17640 1 --2- 172.21.15.89:0/2642607118 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38dc0fc700 0x7f38dc10b410 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f38cc02a530 tx=0x7f38cc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:54:46.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:46 smithi131 ceph-mon[34689]: from='client.14678 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:54:46.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:46 smithi131 ceph-mon[34689]: from='client.14682 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:54:46.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:46 smithi131 ceph-mon[34689]: from='client.14686 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:54:46.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:46 smithi131 ceph-mon[34689]: from='client.? 172.21.15.89:0/4284074636' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:54:46.685 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.683+0000 7f38d1ffb640 1 -- 172.21.15.89:0/2642607118 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f38cc038070 con 0x7f38dc0fc700 2024-09-13T02:54:46.685 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.683+0000 7f38d1ffb640 1 -- 172.21.15.89:0/2642607118 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f38cc02ae90 con 0x7f38dc0fc700 2024-09-13T02:54:46.685 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.684+0000 7f38d1ffb640 1 -- 172.21.15.89:0/2642607118 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f38cc03e670 con 0x7f38dc0fc700 2024-09-13T02:54:46.685 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.684+0000 7f38e367c640 1 -- 172.21.15.89:0/2642607118 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38dc10c530 con 0x7f38dc0fc700 2024-09-13T02:54:46.685 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.684+0000 7f38e367c640 1 -- 172.21.15.89:0/2642607118 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38dc10caa0 con 0x7f38dc0fc700 2024-09-13T02:54:46.687 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.686+0000 7f38e367c640 1 -- 172.21.15.89:0/2642607118 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f38dc0fa890 con 0x7f38dc0fc700 2024-09-13T02:54:46.689 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.687+0000 7f38d1ffb640 1 -- 172.21.15.89:0/2642607118 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7f38cc030020 con 0x7f38dc0fc700 2024-09-13T02:54:46.689 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.687+0000 7f38d1ffb640 1 --2- 172.21.15.89:0/2642607118 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7f38c8070770 0x7f38c8072c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:54:46.689 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.687+0000 7f38d1ffb640 1 -- 172.21.15.89:0/2642607118 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f38cc0ad520 con 0x7f38dc0fc700 2024-09-13T02:54:46.689 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.688+0000 7f38e1418640 1 --2- 172.21.15.89:0/2642607118 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7f38c8070770 0x7f38c8072c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:54:46.691 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.690+0000 7f38e1418640 1 --2- 172.21.15.89:0/2642607118 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7f38c8070770 0x7f38c8072c20 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f38d8004ad0 tx=0x7f38d800b040 comp rx=0 tx=0).ready entity=mgr.24393 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:54:46.694 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.693+0000 7f38d1ffb640 1 -- 172.21.15.89:0/2642607118 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f38cc076f30 con 0x7f38dc0fc700 2024-09-13T02:54:46.950 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.948+0000 7f38e367c640 1 -- 172.21.15.89:0/2642607118 --> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f38dc10ccc0 con 0x7f38c8070770 2024-09-13T02:54:46.951 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.950+0000 7f38d1ffb640 1 -- 172.21.15.89:0/2642607118 <== mgr.24393 v2:172.21.15.131:6828/2180703853 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f38dc10ccc0 con 0x7f38c8070770 2024-09-13T02:54:46.951 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-13T02:54:46.951 INFO:teuthology.orchestra.run.smithi089.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d", 2024-09-13T02:54:46.951 INFO:teuthology.orchestra.run.smithi089.stdout: "in_progress": true, 2024-09-13T02:54:46.951 INFO:teuthology.orchestra.run.smithi089.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T02:54:46.951 INFO:teuthology.orchestra.run.smithi089.stdout: "services_complete": [], 2024-09-13T02:54:46.952 INFO:teuthology.orchestra.run.smithi089.stdout: "progress": "1/21 daemons upgraded", 2024-09-13T02:54:46.952 INFO:teuthology.orchestra.run.smithi089.stdout: "message": "", 2024-09-13T02:54:46.952 INFO:teuthology.orchestra.run.smithi089.stdout: "is_paused": false 2024-09-13T02:54:46.952 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-13T02:54:46.954 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.953+0000 7f38e367c640 1 -- 172.21.15.89:0/2642607118 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7f38c8070770 msgr2=0x7f38c8072c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:46.954 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.953+0000 7f38e367c640 1 --2- 172.21.15.89:0/2642607118 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7f38c8070770 0x7f38c8072c20 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f38d8004ad0 tx=0x7f38d800b040 comp rx=0 tx=0).stop 2024-09-13T02:54:46.954 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.953+0000 7f38e367c640 1 -- 172.21.15.89:0/2642607118 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38dc0fc700 msgr2=0x7f38dc10b410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:46.954 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.953+0000 7f38e367c640 1 --2- 172.21.15.89:0/2642607118 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38dc0fc700 0x7f38dc10b410 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f38cc02a530 tx=0x7f38cc009da0 comp rx=0 tx=0).stop 2024-09-13T02:54:46.954 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.953+0000 7f38e367c640 1 -- 172.21.15.89:0/2642607118 shutdown_connections 2024-09-13T02:54:46.954 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.953+0000 7f38e367c640 1 --2- 172.21.15.89:0/2642607118 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7f38c8070770 0x7f38c8072c20 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:46.955 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.953+0000 7f38e367c640 1 --2- 172.21.15.89:0/2642607118 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f38dc0fc700 0x7f38dc10b410 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:46.955 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.953+0000 7f38e367c640 1 --2- 172.21.15.89:0/2642607118 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f38dc0fb430 0x7f38dc10aed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:46.955 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.953+0000 7f38e367c640 1 -- 172.21.15.89:0/2642607118 >> 172.21.15.89:0/2642607118 conn(0x7f38dc0f6c10 msgr2=0x7f38dc0f83f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:54:46.955 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.953+0000 7f38e367c640 1 -- 172.21.15.89:0/2642607118 shutdown_connections 2024-09-13T02:54:46.955 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:46.953+0000 7f38e367c640 1 -- 172.21.15.89:0/2642607118 wait complete. 2024-09-13T02:54:47.072 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:47.070+0000 7fa0376cd640 1 -- 172.21.15.89:0/2194517450 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0300fd460 msgr2=0x7fa0300ff8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:47.072 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:47.070+0000 7fa0376cd640 1 --2- 172.21.15.89:0/2194517450 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0300fd460 0x7fa0300ff8e0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fa0200048d0 tx=0x7fa020009da0 comp rx=0 tx=0).stop 2024-09-13T02:54:47.072 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:47.071+0000 7fa0376cd640 1 -- 172.21.15.89:0/2194517450 shutdown_connections 2024-09-13T02:54:47.072 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:47.071+0000 7fa0376cd640 1 --2- 172.21.15.89:0/2194517450 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0300fd460 0x7fa0300ff8e0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:47.072 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:47.071+0000 7fa0376cd640 1 --2- 172.21.15.89:0/2194517450 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa0300664d0 0x7fa0300fcf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:47.073 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:47.071+0000 7fa0376cd640 1 -- 172.21.15.89:0/2194517450 >> 172.21.15.89:0/2194517450 conn(0x7fa0300f6c00 msgr2=0x7fa0300f9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:54:47.074 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:47.071+0000 7fa0376cd640 1 -- 172.21.15.89:0/2194517450 shutdown_connections 2024-09-13T02:54:47.074 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:47.071+0000 7fa0376cd640 1 -- 172.21.15.89:0/2194517450 wait complete. 2024-09-13T02:54:47.074 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:47.072+0000 7fa0376cd640 1 Processor -- start 2024-09-13T02:54:47.074 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:47.072+0000 7fa0376cd640 1 -- start start 2024-09-13T02:54:47.074 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:47.072+0000 7fa0376cd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0300664d0 0x7fa030108010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:54:47.074 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:47.072+0000 7fa0376cd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa0300fd460 0x7fa030108550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:54:47.075 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:47.072+0000 7fa0376cd640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa030109be0 con 0x7fa0300664d0 2024-09-13T02:54:47.075 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:47.072+0000 7fa035469640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0300664d0 0x7fa030108010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:54:47.075 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:47.072+0000 7fa0376cd640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa030108ac0 con 0x7fa0300fd460 2024-09-13T02:54:47.075 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:47.072+0000 7fa035469640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0300664d0 0x7fa030108010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:52388/0 (socket says 172.21.15.89:52388) 2024-09-13T02:54:47.075 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:47.072+0000 7fa035469640 1 -- 172.21.15.89:0/1150606469 learned_addr learned my addr 172.21.15.89:0/1150606469 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:54:47.075 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:47.073+0000 7fa034c68640 1 --2- 172.21.15.89:0/1150606469 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa0300fd460 0x7fa030108550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:54:47.075 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:47.073+0000 7fa035469640 1 -- 172.21.15.89:0/1150606469 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa0300fd460 msgr2=0x7fa030108550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:47.075 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:47.073+0000 7fa035469640 1 --2- 172.21.15.89:0/1150606469 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa0300fd460 0x7fa030108550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:47.075 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:47.073+0000 7fa035469640 1 -- 172.21.15.89:0/1150606469 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa020005040 con 0x7fa0300664d0 2024-09-13T02:54:47.075 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:47.073+0000 7fa034c68640 1 --2- 172.21.15.89:0/1150606469 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa0300fd460 0x7fa030108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T02:54:47.075 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:47.073+0000 7fa035469640 1 --2- 172.21.15.89:0/1150606469 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0300664d0 0x7fa030108010 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fa02c00eb70 tx=0x7fa02c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:54:47.076 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:47.073+0000 7fa025ffb640 1 -- 172.21.15.89:0/1150606469 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa02c007c30 con 0x7fa0300664d0 2024-09-13T02:54:47.076 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:47.073+0000 7fa025ffb640 1 -- 172.21.15.89:0/1150606469 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa02c00f040 con 0x7fa0300664d0 2024-09-13T02:54:47.076 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:47.073+0000 7fa0376cd640 1 -- 172.21.15.89:0/1150606469 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa030108da0 con 0x7fa0300664d0 2024-09-13T02:54:47.076 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:47.074+0000 7fa025ffb640 1 -- 172.21.15.89:0/1150606469 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa02c009610 con 0x7fa0300664d0 2024-09-13T02:54:47.076 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:47.074+0000 7fa0376cd640 1 -- 172.21.15.89:0/1150606469 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa030121be0 con 0x7fa0300664d0 2024-09-13T02:54:47.077 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:47.075+0000 7fa0376cd640 1 -- 172.21.15.89:0/1150606469 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0300fa880 con 0x7fa0300664d0 2024-09-13T02:54:47.077 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:47.076+0000 7fa025ffb640 1 -- 172.21.15.89:0/1150606469 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7fa02c009770 con 0x7fa0300664d0 2024-09-13T02:54:47.078 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:47.077+0000 7fa025ffb640 1 --2- 172.21.15.89:0/1150606469 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7fa01c06e7b0 0x7fa01c070c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:54:47.078 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:47.077+0000 7fa025ffb640 1 -- 172.21.15.89:0/1150606469 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fa02c08e0b0 con 0x7fa0300664d0 2024-09-13T02:54:47.078 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:47.077+0000 7fa034c68640 1 --2- 172.21.15.89:0/1150606469 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7fa01c06e7b0 0x7fa01c070c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:54:47.079 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:47.078+0000 7fa034c68640 1 --2- 172.21.15.89:0/1150606469 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7fa01c06e7b0 0x7fa01c070c60 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa02000b020 tx=0x7fa020009da0 comp rx=0 tx=0).ready entity=mgr.24393 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:54:47.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:47.084+0000 7fa025ffb640 1 -- 172.21.15.89:0/1150606469 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fa02c057a50 con 0x7fa0300664d0 2024-09-13T02:54:47.454 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:47.452+0000 7fa0376cd640 1 -- 172.21.15.89:0/1150606469 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fa03004b720 con 0x7fa0300664d0 2024-09-13T02:54:47.454 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:47.452+0000 7fa025ffb640 1 -- 172.21.15.89:0/1150606469 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fa02c05b110 con 0x7fa0300664d0 2024-09-13T02:54:47.454 INFO:teuthology.orchestra.run.smithi089.stdout:HEALTH_OK 2024-09-13T02:54:47.456 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:47.455+0000 7fa0376cd640 1 -- 172.21.15.89:0/1150606469 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7fa01c06e7b0 msgr2=0x7fa01c070c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:47.456 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:47.455+0000 7fa0376cd640 1 --2- 172.21.15.89:0/1150606469 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7fa01c06e7b0 0x7fa01c070c60 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fa02000b020 tx=0x7fa020009da0 comp rx=0 tx=0).stop 2024-09-13T02:54:47.456 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:47.455+0000 7fa0376cd640 1 -- 172.21.15.89:0/1150606469 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0300664d0 msgr2=0x7fa030108010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:54:47.456 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:47.455+0000 7fa0376cd640 1 --2- 172.21.15.89:0/1150606469 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0300664d0 0x7fa030108010 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fa02c00eb70 tx=0x7fa02c00b040 comp rx=0 tx=0).stop 2024-09-13T02:54:47.456 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:47.455+0000 7fa0376cd640 1 -- 172.21.15.89:0/1150606469 shutdown_connections 2024-09-13T02:54:47.457 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:47.455+0000 7fa0376cd640 1 --2- 172.21.15.89:0/1150606469 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7fa01c06e7b0 0x7fa01c070c60 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:47.457 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:47.455+0000 7fa0376cd640 1 --2- 172.21.15.89:0/1150606469 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa0300fd460 0x7fa030108550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:47.457 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:47.455+0000 7fa0376cd640 1 --2- 172.21.15.89:0/1150606469 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa0300664d0 0x7fa030108010 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:54:47.457 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:47.455+0000 7fa0376cd640 1 -- 172.21.15.89:0/1150606469 >> 172.21.15.89:0/1150606469 conn(0x7fa0300f6c00 msgr2=0x7fa0300f6fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:54:47.457 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:47.455+0000 7fa0376cd640 1 -- 172.21.15.89:0/1150606469 shutdown_connections 2024-09-13T02:54:47.457 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:54:47.455+0000 7fa0376cd640 1 -- 172.21.15.89:0/1150606469 wait complete. 2024-09-13T02:54:47.683 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:47 smithi131 ceph-mon[34689]: pgmap v8: 65 pgs: 65 active+clean; 329 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 1.0 MiB/s rd, 1.3 MiB/s wr, 312 op/s 2024-09-13T02:54:47.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:47 smithi131 ceph-mon[34689]: from='client.? 172.21.15.89:0/4106474752' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T02:54:47.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:47 smithi089 ceph-mon[27639]: pgmap v8: 65 pgs: 65 active+clean; 329 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 1.0 MiB/s rd, 1.3 MiB/s wr, 312 op/s 2024-09-13T02:54:47.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:47 smithi089 ceph-mon[27639]: from='client.? 172.21.15.89:0/4106474752' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T02:54:48.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:48 smithi131 ceph-mon[34689]: from='client.14698 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:54:48.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:48 smithi131 ceph-mon[34689]: from='client.? 172.21.15.89:0/1150606469' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T02:54:48.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:48 smithi131 ceph-mon[34689]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' 2024-09-13T02:54:48.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:48 smithi131 ceph-mon[34689]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' 2024-09-13T02:54:48.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:48 smithi089 ceph-mon[27639]: from='client.14698 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:54:48.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:48 smithi089 ceph-mon[27639]: from='client.? 172.21.15.89:0/1150606469' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T02:54:48.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:48 smithi089 ceph-mon[27639]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' 2024-09-13T02:54:48.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:48 smithi089 ceph-mon[27639]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' 2024-09-13T02:54:50.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:49 smithi089 ceph-mon[27639]: pgmap v9: 65 pgs: 65 active+clean; 306 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 611 op/s 2024-09-13T02:54:50.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:49 smithi089 ceph-mon[27639]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' 2024-09-13T02:54:50.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:49 smithi089 ceph-mon[27639]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' 2024-09-13T02:54:50.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:49 smithi089 ceph-mon[27639]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:54:50.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:49 smithi089 ceph-mon[27639]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:54:50.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:49 smithi089 ceph-mon[27639]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:54:50.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:49 smithi089 ceph-mon[27639]: Adjusting osd_memory_target on smithi089 to 1557M 2024-09-13T02:54:50.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:49 smithi089 ceph-mon[27639]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' 2024-09-13T02:54:50.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:49 smithi131 ceph-mon[34689]: pgmap v9: 65 pgs: 65 active+clean; 306 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.3 MiB/s rd, 2.4 MiB/s wr, 611 op/s 2024-09-13T02:54:50.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:49 smithi131 ceph-mon[34689]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' 2024-09-13T02:54:50.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:49 smithi131 ceph-mon[34689]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' 2024-09-13T02:54:50.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:49 smithi131 ceph-mon[34689]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:54:50.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:49 smithi131 ceph-mon[34689]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:54:50.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:49 smithi131 ceph-mon[34689]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:54:50.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:49 smithi131 ceph-mon[34689]: Adjusting osd_memory_target on smithi089 to 1557M 2024-09-13T02:54:50.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:49 smithi131 ceph-mon[34689]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' 2024-09-13T02:54:51.933 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:51 smithi131 ceph-mon[34689]: pgmap v10: 65 pgs: 65 active+clean; 306 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 553 op/s 2024-09-13T02:54:51.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:51 smithi131 ceph-mon[34689]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:54:52.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:51 smithi089 ceph-mon[27639]: pgmap v10: 65 pgs: 65 active+clean; 306 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 553 op/s 2024-09-13T02:54:52.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:51 smithi089 ceph-mon[27639]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:54:53.936 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:53 smithi131 ceph-mon[34689]: pgmap v11: 65 pgs: 65 active+clean; 306 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 553 op/s 2024-09-13T02:54:54.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:53 smithi089 ceph-mon[27639]: pgmap v11: 65 pgs: 65 active+clean; 306 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.1 MiB/s rd, 2.2 MiB/s wr, 553 op/s 2024-09-13T02:54:56.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:55 smithi089 ceph-mon[27639]: pgmap v12: 65 pgs: 65 active+clean; 322 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 3.7 MiB/s rd, 3.9 MiB/s wr, 732 op/s 2024-09-13T02:54:56.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:55 smithi131 ceph-mon[34689]: pgmap v12: 65 pgs: 65 active+clean; 322 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 3.7 MiB/s rd, 3.9 MiB/s wr, 732 op/s 2024-09-13T02:54:58.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:57 smithi089 ceph-mon[27639]: pgmap v13: 65 pgs: 65 active+clean; 322 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 2.9 MiB/s rd, 3.0 MiB/s wr, 501 op/s 2024-09-13T02:54:58.037 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:57 smithi131 ceph-mon[34689]: pgmap v13: 65 pgs: 65 active+clean; 322 MiB data, 2.8 GiB used, 534 GiB / 536 GiB avail; 2.9 MiB/s rd, 3.0 MiB/s wr, 501 op/s 2024-09-13T02:55:00.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:54:59 smithi089 ceph-mon[27639]: pgmap v14: 65 pgs: 65 active+clean; 319 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 4.3 MiB/s rd, 4.3 MiB/s wr, 815 op/s 2024-09-13T02:55:00.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:54:59 smithi131 ceph-mon[34689]: pgmap v14: 65 pgs: 65 active+clean; 319 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 4.3 MiB/s rd, 4.3 MiB/s wr, 815 op/s 2024-09-13T02:55:02.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:01 smithi089 ceph-mon[27639]: pgmap v15: 65 pgs: 65 active+clean; 319 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 3.0 MiB/s rd, 3.0 MiB/s wr, 492 op/s 2024-09-13T02:55:02.183 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:01 smithi131 ceph-mon[34689]: pgmap v15: 65 pgs: 65 active+clean; 319 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 3.0 MiB/s rd, 3.0 MiB/s wr, 492 op/s 2024-09-13T02:55:03.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:03 smithi131 ceph-mon[34689]: pgmap v16: 65 pgs: 65 active+clean; 319 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 3.0 MiB/s rd, 3.0 MiB/s wr, 492 op/s 2024-09-13T02:55:03.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:03 smithi131 ceph-mon[34689]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' 2024-09-13T02:55:03.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:03 smithi131 ceph-mon[34689]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' 2024-09-13T02:55:03.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:03 smithi131 ceph-mon[34689]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:55:03.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:03 smithi131 ceph-mon[34689]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:55:03.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:03 smithi131 ceph-mon[34689]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:55:03.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:03 smithi131 ceph-mon[34689]: Adjusting osd_memory_target on smithi131 to 2581M 2024-09-13T02:55:03.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:03 smithi131 ceph-mon[34689]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' 2024-09-13T02:55:03.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:03 smithi131 ceph-mon[34689]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:55:03.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:03 smithi131 ceph-mon[34689]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:55:03.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:03 smithi131 ceph-mon[34689]: Updating smithi089:/etc/ceph/ceph.conf 2024-09-13T02:55:03.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:03 smithi131 ceph-mon[34689]: Updating smithi131:/etc/ceph/ceph.conf 2024-09-13T02:55:04.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:03 smithi089 ceph-mon[27639]: pgmap v16: 65 pgs: 65 active+clean; 319 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 3.0 MiB/s rd, 3.0 MiB/s wr, 492 op/s 2024-09-13T02:55:04.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:03 smithi089 ceph-mon[27639]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' 2024-09-13T02:55:04.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:03 smithi089 ceph-mon[27639]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' 2024-09-13T02:55:04.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:03 smithi089 ceph-mon[27639]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:55:04.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:03 smithi089 ceph-mon[27639]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:55:04.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:03 smithi089 ceph-mon[27639]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-13T02:55:04.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:03 smithi089 ceph-mon[27639]: Adjusting osd_memory_target on smithi131 to 2581M 2024-09-13T02:55:04.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:03 smithi089 ceph-mon[27639]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' 2024-09-13T02:55:04.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:03 smithi089 ceph-mon[27639]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:55:04.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:03 smithi089 ceph-mon[27639]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:55:04.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:03 smithi089 ceph-mon[27639]: Updating smithi089:/etc/ceph/ceph.conf 2024-09-13T02:55:04.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:03 smithi089 ceph-mon[27639]: Updating smithi131:/etc/ceph/ceph.conf 2024-09-13T02:55:05.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:04 smithi089 ceph-mon[27639]: Updating smithi089:/var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T02:55:05.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:04 smithi089 ceph-mon[27639]: Updating smithi131:/var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T02:55:05.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:04 smithi089 ceph-mon[27639]: Updating smithi089:/etc/ceph/ceph.client.admin.keyring 2024-09-13T02:55:05.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:04 smithi089 ceph-mon[27639]: Updating smithi131:/etc/ceph/ceph.client.admin.keyring 2024-09-13T02:55:05.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:04 smithi089 ceph-mon[27639]: Updating smithi089:/var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T02:55:05.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:04 smithi089 ceph-mon[27639]: Updating smithi131:/var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T02:55:05.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:04 smithi089 ceph-mon[27639]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' 2024-09-13T02:55:05.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:04 smithi089 ceph-mon[27639]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' 2024-09-13T02:55:05.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:04 smithi089 ceph-mon[27639]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' 2024-09-13T02:55:05.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:04 smithi089 ceph-mon[27639]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' 2024-09-13T02:55:05.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:04 smithi089 ceph-mon[27639]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' 2024-09-13T02:55:05.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:04 smithi089 ceph-mon[27639]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' 2024-09-13T02:55:05.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:04 smithi089 ceph-mon[27639]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' 2024-09-13T02:55:05.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:04 smithi089 ceph-mon[27639]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' 2024-09-13T02:55:05.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:04 smithi089 ceph-mon[27639]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' 2024-09-13T02:55:05.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:04 smithi131 ceph-mon[34689]: Updating smithi089:/var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T02:55:05.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:04 smithi131 ceph-mon[34689]: Updating smithi131:/var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T02:55:05.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:04 smithi131 ceph-mon[34689]: Updating smithi089:/etc/ceph/ceph.client.admin.keyring 2024-09-13T02:55:05.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:04 smithi131 ceph-mon[34689]: Updating smithi131:/etc/ceph/ceph.client.admin.keyring 2024-09-13T02:55:05.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:04 smithi131 ceph-mon[34689]: Updating smithi089:/var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T02:55:05.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:04 smithi131 ceph-mon[34689]: Updating smithi131:/var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T02:55:05.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:04 smithi131 ceph-mon[34689]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' 2024-09-13T02:55:05.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:04 smithi131 ceph-mon[34689]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' 2024-09-13T02:55:05.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:04 smithi131 ceph-mon[34689]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' 2024-09-13T02:55:05.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:04 smithi131 ceph-mon[34689]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' 2024-09-13T02:55:05.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:04 smithi131 ceph-mon[34689]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' 2024-09-13T02:55:05.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:04 smithi131 ceph-mon[34689]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' 2024-09-13T02:55:05.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:04 smithi131 ceph-mon[34689]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' 2024-09-13T02:55:05.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:04 smithi131 ceph-mon[34689]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' 2024-09-13T02:55:05.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:04 smithi131 ceph-mon[34689]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' 2024-09-13T02:55:05.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:05 smithi089 ceph-mon[27639]: Reconfiguring node-exporter.smithi089 (dependencies changed)... 2024-09-13T02:55:05.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:05 smithi089 ceph-mon[27639]: Deploying daemon node-exporter.smithi089 on smithi089 2024-09-13T02:55:05.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:05 smithi089 ceph-mon[27639]: pgmap v17: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 4.2 MiB/s rd, 4.2 MiB/s wr, 774 op/s 2024-09-13T02:55:06.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:05 smithi131 ceph-mon[34689]: Reconfiguring node-exporter.smithi089 (dependencies changed)... 2024-09-13T02:55:06.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:05 smithi131 ceph-mon[34689]: Deploying daemon node-exporter.smithi089 on smithi089 2024-09-13T02:55:06.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:05 smithi131 ceph-mon[34689]: pgmap v17: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 4.2 MiB/s rd, 4.2 MiB/s wr, 774 op/s 2024-09-13T02:55:06.915 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-09-13T02:55:06.915 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-13T02:55:07.034 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:06 smithi089 ceph-mon[27639]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:55:07.183 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:06 smithi131 ceph-mon[34689]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:55:07.366 DEBUG:teuthology.parallel:result is None 2024-09-13T02:55:08.183 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:07 smithi131 ceph-mon[34689]: pgmap v18: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.6 MiB/s rd, 2.5 MiB/s wr, 595 op/s 2024-09-13T02:55:08.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:07 smithi089 ceph-mon[27639]: pgmap v18: 65 pgs: 65 active+clean; 314 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.6 MiB/s rd, 2.5 MiB/s wr, 595 op/s 2024-09-13T02:55:10.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:09 smithi131 ceph-mon[34689]: pgmap v19: 65 pgs: 65 active+clean; 313 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 3.6 MiB/s rd, 3.5 MiB/s wr, 848 op/s 2024-09-13T02:55:10.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:09 smithi089 ceph-mon[27639]: pgmap v19: 65 pgs: 65 active+clean; 313 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 3.6 MiB/s rd, 3.5 MiB/s wr, 848 op/s 2024-09-13T02:55:12.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:11 smithi131 ceph-mon[34689]: pgmap v20: 65 pgs: 65 active+clean; 313 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 534 op/s 2024-09-13T02:55:12.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:11 smithi089 ceph-mon[27639]: pgmap v20: 65 pgs: 65 active+clean; 313 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 534 op/s 2024-09-13T02:55:14.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:13 smithi131 ceph-mon[34689]: pgmap v21: 65 pgs: 65 active+clean; 313 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 534 op/s 2024-09-13T02:55:14.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:13 smithi089 ceph-mon[27639]: pgmap v21: 65 pgs: 65 active+clean; 313 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.2 MiB/s rd, 2.2 MiB/s wr, 534 op/s 2024-09-13T02:55:16.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:15 smithi089 ceph-mon[27639]: pgmap v22: 65 pgs: 65 active+clean; 312 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 3.0 MiB/s rd, 2.9 MiB/s wr, 712 op/s 2024-09-13T02:55:16.183 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:15 smithi131 ceph-mon[34689]: pgmap v22: 65 pgs: 65 active+clean; 312 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 3.0 MiB/s rd, 2.9 MiB/s wr, 712 op/s 2024-09-13T02:55:17.557 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:17.551+0000 7f7ffd313640 1 -- 172.21.15.89:0/3552022504 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7ff80fc700 msgr2=0x7f7ff80fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:17.557 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:17.551+0000 7f7ffd313640 1 --2- 172.21.15.89:0/3552022504 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7ff80fc700 0x7f7ff80fcb70 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f7fe00048d0 tx=0x7f7fe0009da0 comp rx=0 tx=0).stop 2024-09-13T02:55:17.558 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:17.552+0000 7f7ffd313640 1 -- 172.21.15.89:0/3552022504 shutdown_connections 2024-09-13T02:55:17.558 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:17.552+0000 7f7ffd313640 1 --2- 172.21.15.89:0/3552022504 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7ff80fc700 0x7f7ff80fcb70 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:17.558 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:17.552+0000 7f7ffd313640 1 --2- 172.21.15.89:0/3552022504 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7ff80fb430 0x7f7ff80fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:17.558 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:17.552+0000 7f7ffd313640 1 -- 172.21.15.89:0/3552022504 >> 172.21.15.89:0/3552022504 conn(0x7f7ff80f6c10 msgr2=0x7f7ff80f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:55:17.558 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:17.552+0000 7f7ffd313640 1 -- 172.21.15.89:0/3552022504 shutdown_connections 2024-09-13T02:55:17.559 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:17.552+0000 7f7ffd313640 1 -- 172.21.15.89:0/3552022504 wait complete. 2024-09-13T02:55:17.559 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:17.552+0000 7f7ffd313640 1 Processor -- start 2024-09-13T02:55:17.559 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:17.552+0000 7f7ffd313640 1 -- start start 2024-09-13T02:55:17.559 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:17.553+0000 7f7ffd313640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7ff80fb430 0x7f7ff810fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:17.560 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:17.553+0000 7f7ffd313640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7ff80fc700 0x7f7ff8112310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:17.560 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:17.553+0000 7f7ffd313640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff8065c60 con 0x7f7ff80fb430 2024-09-13T02:55:17.560 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:17.553+0000 7f7ffd313640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff8065dd0 con 0x7f7ff80fc700 2024-09-13T02:55:17.560 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:17.553+0000 7f7ff6ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7ff80fb430 0x7f7ff810fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:17.561 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:17.553+0000 7f7ff6ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7ff80fb430 0x7f7ff810fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:47016/0 (socket says 172.21.15.89:47016) 2024-09-13T02:55:17.561 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:17.553+0000 7f7ff6ffd640 1 -- 172.21.15.89:0/3198126175 learned_addr learned my addr 172.21.15.89:0/3198126175 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:55:17.561 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:17.553+0000 7f7fee7fc640 1 --2- 172.21.15.89:0/3198126175 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7ff80fc700 0x7f7ff8112310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:17.561 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:17.553+0000 7f7ff6ffd640 1 -- 172.21.15.89:0/3198126175 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7ff80fc700 msgr2=0x7f7ff8112310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:17.561 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:17.553+0000 7f7ff6ffd640 1 --2- 172.21.15.89:0/3198126175 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7ff80fc700 0x7f7ff8112310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:17.562 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:17.553+0000 7f7ff6ffd640 1 -- 172.21.15.89:0/3198126175 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fe0005040 con 0x7f7ff80fb430 2024-09-13T02:55:17.562 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:17.553+0000 7f7ff6ffd640 1 --2- 172.21.15.89:0/3198126175 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7ff80fb430 0x7f7ff810fdc0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f7fe8002a50 tx=0x7f7fe8004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:55:17.562 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:17.553+0000 7f7feffff640 1 -- 172.21.15.89:0/3198126175 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7fe8007c30 con 0x7f7ff80fb430 2024-09-13T02:55:17.562 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:17.553+0000 7f7ffd313640 1 -- 172.21.15.89:0/3198126175 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ff81128b0 con 0x7f7ff80fb430 2024-09-13T02:55:17.563 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:17.554+0000 7f7feffff640 1 -- 172.21.15.89:0/3198126175 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f7fe800f040 con 0x7f7ff80fb430 2024-09-13T02:55:17.563 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:17.554+0000 7f7ffd313640 1 -- 172.21.15.89:0/3198126175 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ff8112e20 con 0x7f7ff80fb430 2024-09-13T02:55:17.563 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:17.554+0000 7f7feffff640 1 -- 172.21.15.89:0/3198126175 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7fe800da90 con 0x7f7ff80fb430 2024-09-13T02:55:17.563 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:17.555+0000 7f7ffd313640 1 -- 172.21.15.89:0/3198126175 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fd8005240 con 0x7f7ff80fb430 2024-09-13T02:55:17.563 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:17.555+0000 7f7feffff640 1 -- 172.21.15.89:0/3198126175 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7f7fe800dcd0 con 0x7f7ff80fb430 2024-09-13T02:55:17.564 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:17.556+0000 7f7feffff640 1 --2- 172.21.15.89:0/3198126175 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7f7fe406e6e0 0x7f7fe4070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:17.564 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:17.556+0000 7f7feffff640 1 -- 172.21.15.89:0/3198126175 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f7fe808d720 con 0x7f7ff80fb430 2024-09-13T02:55:17.564 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:17.556+0000 7f7fee7fc640 1 --2- 172.21.15.89:0/3198126175 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7f7fe406e6e0 0x7f7fe4070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:17.565 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:17.556+0000 7f7fee7fc640 1 --2- 172.21.15.89:0/3198126175 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7f7fe406e6e0 0x7f7fe4070b90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7fe0007ac0 tx=0x7f7fe0035040 comp rx=0 tx=0).ready entity=mgr.24393 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:55:17.565 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:17.563+0000 7f7feffff640 1 -- 172.21.15.89:0/3198126175 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f7fe804f670 con 0x7f7ff80fb430 2024-09-13T02:55:17.807 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:17.806+0000 7f7ffd313640 1 -- 172.21.15.89:0/3198126175 --> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7fd8000bf0 con 0x7f7fe406e6e0 2024-09-13T02:55:17.808 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:17.807+0000 7f7feffff640 1 -- 172.21.15.89:0/3198126175 <== mgr.24393 v2:172.21.15.131:6828/2180703853 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f7fd8000bf0 con 0x7f7fe406e6e0 2024-09-13T02:55:17.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:17.810+0000 7f7ffd313640 1 -- 172.21.15.89:0/3198126175 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7f7fe406e6e0 msgr2=0x7f7fe4070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:17.811 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:17.810+0000 7f7ffd313640 1 --2- 172.21.15.89:0/3198126175 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7f7fe406e6e0 0x7f7fe4070b90 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7fe0007ac0 tx=0x7f7fe0035040 comp rx=0 tx=0).stop 2024-09-13T02:55:17.812 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:17.810+0000 7f7ffd313640 1 -- 172.21.15.89:0/3198126175 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7ff80fb430 msgr2=0x7f7ff810fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:17.812 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:17.810+0000 7f7ffd313640 1 --2- 172.21.15.89:0/3198126175 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7ff80fb430 0x7f7ff810fdc0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f7fe8002a50 tx=0x7f7fe8004600 comp rx=0 tx=0).stop 2024-09-13T02:55:17.812 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:17.810+0000 7f7ffd313640 1 -- 172.21.15.89:0/3198126175 shutdown_connections 2024-09-13T02:55:17.812 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:17.810+0000 7f7ffd313640 1 --2- 172.21.15.89:0/3198126175 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7f7fe406e6e0 0x7f7fe4070b90 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:17.812 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:17.810+0000 7f7ffd313640 1 --2- 172.21.15.89:0/3198126175 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7ff80fc700 0x7f7ff8112310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:17.812 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:17.810+0000 7f7ffd313640 1 --2- 172.21.15.89:0/3198126175 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7ff80fb430 0x7f7ff810fdc0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:17.813 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:17.810+0000 7f7ffd313640 1 -- 172.21.15.89:0/3198126175 >> 172.21.15.89:0/3198126175 conn(0x7f7ff80f6c10 msgr2=0x7f7ff80f83f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:55:17.813 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:17.811+0000 7f7ffd313640 1 -- 172.21.15.89:0/3198126175 shutdown_connections 2024-09-13T02:55:17.814 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:17.811+0000 7f7ffd313640 1 -- 172.21.15.89:0/3198126175 wait complete. 2024-09-13T02:55:17.824 INFO:teuthology.orchestra.run.smithi089.stdout:true 2024-09-13T02:55:17.932 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:17.928+0000 7f1590415640 1 -- 172.21.15.89:0/4250484100 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15880ff680 msgr2=0x7f1588101a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:17.933 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:17.928+0000 7f1590415640 1 --2- 172.21.15.89:0/4250484100 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15880ff680 0x7f1588101a60 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f15780048d0 tx=0x7f1578009da0 comp rx=0 tx=0).stop 2024-09-13T02:55:17.933 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:17.928+0000 7f1590415640 1 -- 172.21.15.89:0/4250484100 shutdown_connections 2024-09-13T02:55:17.933 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:17.928+0000 7f1590415640 1 --2- 172.21.15.89:0/4250484100 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15880ff680 0x7f1588101a60 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:17.933 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:17.928+0000 7f1590415640 1 --2- 172.21.15.89:0/4250484100 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1588065c40 0x7f15880ff140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:17.933 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:17.928+0000 7f1590415640 1 -- 172.21.15.89:0/4250484100 >> 172.21.15.89:0/4250484100 conn(0x7f15880f6c10 msgr2=0x7f15880f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:55:17.933 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:17.928+0000 7f1590415640 1 -- 172.21.15.89:0/4250484100 shutdown_connections 2024-09-13T02:55:17.933 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:17.928+0000 7f1590415640 1 -- 172.21.15.89:0/4250484100 wait complete. 2024-09-13T02:55:17.933 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:17.929+0000 7f1590415640 1 Processor -- start 2024-09-13T02:55:17.933 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:17.929+0000 7f1590415640 1 -- start start 2024-09-13T02:55:17.933 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:17.929+0000 7f1590415640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1588065c40 0x7f158810d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:17.934 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:17.929+0000 7f1590415640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15880ff680 0x7f158810d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:17.934 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:17.929+0000 7f1590415640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f158810dc00 con 0x7f15880ff680 2024-09-13T02:55:17.934 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:17.929+0000 7f1590415640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f158810e420 con 0x7f1588065c40 2024-09-13T02:55:17.934 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:17.929+0000 7f158d9b0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15880ff680 0x7f158810d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:17.934 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:17.929+0000 7f158d9b0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15880ff680 0x7f158810d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:47036/0 (socket says 172.21.15.89:47036) 2024-09-13T02:55:17.934 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:17.929+0000 7f158d9b0640 1 -- 172.21.15.89:0/1665761574 learned_addr learned my addr 172.21.15.89:0/1665761574 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:55:17.934 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:17.929+0000 7f158e1b1640 1 --2- 172.21.15.89:0/1665761574 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1588065c40 0x7f158810d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:17.934 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:17.930+0000 7f158d9b0640 1 -- 172.21.15.89:0/1665761574 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1588065c40 msgr2=0x7f158810d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:17.934 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:17.930+0000 7f158d9b0640 1 --2- 172.21.15.89:0/1665761574 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1588065c40 0x7f158810d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:17.934 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:17.930+0000 7f158d9b0640 1 -- 172.21.15.89:0/1665761574 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1578005040 con 0x7f15880ff680 2024-09-13T02:55:17.934 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:17.930+0000 7f158e1b1640 1 --2- 172.21.15.89:0/1665761574 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1588065c40 0x7f158810d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T02:55:17.934 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:17.930+0000 7f158d9b0640 1 --2- 172.21.15.89:0/1665761574 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15880ff680 0x7f158810d5b0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f15780048a0 tx=0x7f1578009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:55:17.934 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:17.930+0000 7f157effd640 1 -- 172.21.15.89:0/1665761574 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1578038070 con 0x7f15880ff680 2024-09-13T02:55:17.934 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:17.930+0000 7f157effd640 1 -- 172.21.15.89:0/1665761574 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f1578004290 con 0x7f15880ff680 2024-09-13T02:55:17.934 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:17.930+0000 7f1590415640 1 -- 172.21.15.89:0/1665761574 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f158810e650 con 0x7f15880ff680 2024-09-13T02:55:17.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:17.930+0000 7f157effd640 1 -- 172.21.15.89:0/1665761574 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1578033660 con 0x7f15880ff680 2024-09-13T02:55:17.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:17.930+0000 7f1590415640 1 -- 172.21.15.89:0/1665761574 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f158810ebf0 con 0x7f15880ff680 2024-09-13T02:55:17.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:17.931+0000 7f1590415640 1 -- 172.21.15.89:0/1665761574 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15880fa890 con 0x7f15880ff680 2024-09-13T02:55:17.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:17.932+0000 7f157effd640 1 -- 172.21.15.89:0/1665761574 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7f1578030020 con 0x7f15880ff680 2024-09-13T02:55:17.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:17.932+0000 7f157effd640 1 --2- 172.21.15.89:0/1665761574 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7f157406e6e0 0x7f1574070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:17.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:17.932+0000 7f157effd640 1 -- 172.21.15.89:0/1665761574 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f15780adf40 con 0x7f15880ff680 2024-09-13T02:55:17.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:17.932+0000 7f158e1b1640 1 --2- 172.21.15.89:0/1665761574 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7f157406e6e0 0x7f1574070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:17.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:17.933+0000 7f158e1b1640 1 --2- 172.21.15.89:0/1665761574 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7f157406e6e0 0x7f1574070b90 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f15880659a0 tx=0x7f158400b040 comp rx=0 tx=0).ready entity=mgr.24393 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:55:17.941 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:17.940+0000 7f157effd640 1 -- 172.21.15.89:0/1665761574 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f1578077950 con 0x7f15880ff680 2024-09-13T02:55:18.135 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.134+0000 7f1590415640 1 -- 172.21.15.89:0/1665761574 --> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f158810ef40 con 0x7f157406e6e0 2024-09-13T02:55:18.135 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:17 smithi089 ceph-mon[27639]: pgmap v23: 65 pgs: 65 active+clean; 312 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 430 op/s 2024-09-13T02:55:18.136 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.135+0000 7f157effd640 1 -- 172.21.15.89:0/1665761574 <== mgr.24393 v2:172.21.15.131:6828/2180703853 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f158810ef40 con 0x7f157406e6e0 2024-09-13T02:55:18.139 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.138+0000 7f1590415640 1 -- 172.21.15.89:0/1665761574 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7f157406e6e0 msgr2=0x7f1574070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:18.140 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.138+0000 7f1590415640 1 --2- 172.21.15.89:0/1665761574 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7f157406e6e0 0x7f1574070b90 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f15880659a0 tx=0x7f158400b040 comp rx=0 tx=0).stop 2024-09-13T02:55:18.140 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.138+0000 7f1590415640 1 -- 172.21.15.89:0/1665761574 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15880ff680 msgr2=0x7f158810d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:18.140 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.138+0000 7f1590415640 1 --2- 172.21.15.89:0/1665761574 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15880ff680 0x7f158810d5b0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f15780048a0 tx=0x7f1578009da0 comp rx=0 tx=0).stop 2024-09-13T02:55:18.140 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.138+0000 7f1590415640 1 -- 172.21.15.89:0/1665761574 shutdown_connections 2024-09-13T02:55:18.140 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.138+0000 7f1590415640 1 --2- 172.21.15.89:0/1665761574 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7f157406e6e0 0x7f1574070b90 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:18.140 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.138+0000 7f1590415640 1 --2- 172.21.15.89:0/1665761574 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f15880ff680 0x7f158810d5b0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:18.140 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.138+0000 7f1590415640 1 --2- 172.21.15.89:0/1665761574 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1588065c40 0x7f158810d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:18.140 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.138+0000 7f1590415640 1 -- 172.21.15.89:0/1665761574 >> 172.21.15.89:0/1665761574 conn(0x7f15880f6c10 msgr2=0x7f15880f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:55:18.140 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.138+0000 7f1590415640 1 -- 172.21.15.89:0/1665761574 shutdown_connections 2024-09-13T02:55:18.140 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.138+0000 7f1590415640 1 -- 172.21.15.89:0/1665761574 wait complete. 2024-09-13T02:55:18.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:17 smithi131 ceph-mon[34689]: pgmap v23: 65 pgs: 65 active+clean; 312 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.8 MiB/s rd, 1.7 MiB/s wr, 430 op/s 2024-09-13T02:55:18.226 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.224+0000 7f4d9a6f1640 1 -- 172.21.15.89:0/1228742342 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4d940fc700 msgr2=0x7f4d940fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:18.226 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.224+0000 7f4d9a6f1640 1 --2- 172.21.15.89:0/1228742342 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4d940fc700 0x7f4d940fcb70 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f4d880048d0 tx=0x7f4d88009da0 comp rx=0 tx=0).stop 2024-09-13T02:55:18.226 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.224+0000 7f4d9a6f1640 1 -- 172.21.15.89:0/1228742342 shutdown_connections 2024-09-13T02:55:18.226 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.224+0000 7f4d9a6f1640 1 --2- 172.21.15.89:0/1228742342 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4d940fc700 0x7f4d940fcb70 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:18.226 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.224+0000 7f4d9a6f1640 1 --2- 172.21.15.89:0/1228742342 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4d940fb430 0x7f4d940fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:18.226 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.224+0000 7f4d9a6f1640 1 -- 172.21.15.89:0/1228742342 >> 172.21.15.89:0/1228742342 conn(0x7f4d940f6c10 msgr2=0x7f4d940f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:55:18.226 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.224+0000 7f4d9a6f1640 1 -- 172.21.15.89:0/1228742342 shutdown_connections 2024-09-13T02:55:18.227 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.225+0000 7f4d9a6f1640 1 -- 172.21.15.89:0/1228742342 wait complete. 2024-09-13T02:55:18.228 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.225+0000 7f4d9a6f1640 1 Processor -- start 2024-09-13T02:55:18.228 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.225+0000 7f4d9a6f1640 1 -- start start 2024-09-13T02:55:18.228 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.226+0000 7f4d9a6f1640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4d940fb430 0x7f4d9410bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:18.228 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.226+0000 7f4d9a6f1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4d940fc700 0x7f4d9410c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:18.228 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.226+0000 7f4d9a6f1640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d9410cb10 con 0x7f4d940fc700 2024-09-13T02:55:18.228 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.226+0000 7f4d9a6f1640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d9410d330 con 0x7f4d940fb430 2024-09-13T02:55:18.228 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.226+0000 7f4d937fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4d940fc700 0x7f4d9410c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:18.228 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.226+0000 7f4d93fff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4d940fb430 0x7f4d9410bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:18.229 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.226+0000 7f4d937fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4d940fc700 0x7f4d9410c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:47052/0 (socket says 172.21.15.89:47052) 2024-09-13T02:55:18.229 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.226+0000 7f4d937fe640 1 -- 172.21.15.89:0/2050361012 learned_addr learned my addr 172.21.15.89:0/2050361012 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:55:18.229 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.226+0000 7f4d93fff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4d940fb430 0x7f4d9410bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.89:45936/0 (socket says 172.21.15.89:45936) 2024-09-13T02:55:18.229 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.226+0000 7f4d93fff640 1 -- 172.21.15.89:0/2050361012 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4d940fc700 msgr2=0x7f4d9410c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:18.229 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.226+0000 7f4d93fff640 1 --2- 172.21.15.89:0/2050361012 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4d940fc700 0x7f4d9410c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:18.229 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.226+0000 7f4d93fff640 1 -- 172.21.15.89:0/2050361012 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d88005040 con 0x7f4d940fb430 2024-09-13T02:55:18.229 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.226+0000 7f4d93fff640 1 --2- 172.21.15.89:0/2050361012 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4d940fb430 0x7f4d9410bf80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4d8400eb40 tx=0x7f4d8400b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:55:18.229 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.226+0000 7f4d90ff9640 1 -- 172.21.15.89:0/2050361012 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4d84007c30 con 0x7f4d940fb430 2024-09-13T02:55:18.229 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.227+0000 7f4d9a6f1640 1 -- 172.21.15.89:0/2050361012 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d9410d560 con 0x7f4d940fb430 2024-09-13T02:55:18.229 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.227+0000 7f4d90ff9640 1 -- 172.21.15.89:0/2050361012 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4d8400f040 con 0x7f4d940fb430 2024-09-13T02:55:18.229 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.227+0000 7f4d90ff9640 1 -- 172.21.15.89:0/2050361012 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4d8400cac0 con 0x7f4d940fb430 2024-09-13T02:55:18.229 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.227+0000 7f4d9a6f1640 1 -- 172.21.15.89:0/2050361012 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d9410db00 con 0x7f4d940fb430 2024-09-13T02:55:18.230 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.228+0000 7f4d9a6f1640 1 -- 172.21.15.89:0/2050361012 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d940fa890 con 0x7f4d940fb430 2024-09-13T02:55:18.230 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.228+0000 7f4d90ff9640 1 -- 172.21.15.89:0/2050361012 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7f4d84009700 con 0x7f4d940fb430 2024-09-13T02:55:18.230 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.229+0000 7f4d90ff9640 1 --2- 172.21.15.89:0/2050361012 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7f4d7c06e6e0 0x7f4d7c070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:18.230 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.229+0000 7f4d90ff9640 1 -- 172.21.15.89:0/2050361012 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f4d8408db90 con 0x7f4d940fb430 2024-09-13T02:55:18.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.229+0000 7f4d937fe640 1 --2- 172.21.15.89:0/2050361012 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7f4d7c06e6e0 0x7f4d7c070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:18.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.230+0000 7f4d937fe640 1 --2- 172.21.15.89:0/2050361012 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7f4d7c06e6e0 0x7f4d7c070b90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4d9410bd30 tx=0x7f4d88037040 comp rx=0 tx=0).ready entity=mgr.24393 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:55:18.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.234+0000 7f4d90ff9640 1 -- 172.21.15.89:0/2050361012 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f4d840574c0 con 0x7f4d940fb430 2024-09-13T02:55:18.472 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.471+0000 7f4d9a6f1640 1 -- 172.21.15.89:0/2050361012 --> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f4d9410de80 con 0x7f4d7c06e6e0 2024-09-13T02:55:18.482 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.481+0000 7f4d90ff9640 1 -- 172.21.15.89:0/2050361012 <== mgr.24393 v2:172.21.15.131:6828/2180703853 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f4d9410de80 con 0x7f4d7c06e6e0 2024-09-13T02:55:18.482 INFO:teuthology.orchestra.run.smithi089.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T02:55:18.482 INFO:teuthology.orchestra.run.smithi089.stdout:alertmanager.smithi089 smithi089 *:9093,9094 running (7m) 30s ago 8m 25.0M - 0.25.0 c8568f914cd2 e0d15812dfa4 2024-09-13T02:55:18.482 INFO:teuthology.orchestra.run.smithi089.stdout:crash.smithi089 smithi089 running (9m) 30s ago 9m 6895k - 17.2.7-1627-gbbdadfa3 a994b00deb3a e8994cd5600e 2024-09-13T02:55:18.482 INFO:teuthology.orchestra.run.smithi089.stdout:crash.smithi131 smithi131 running (8m) 35s ago 8m 6895k - 17.2.7-1627-gbbdadfa3 a994b00deb3a dcbb0a9d5261 2024-09-13T02:55:18.482 INFO:teuthology.orchestra.run.smithi089.stdout:grafana.smithi089 smithi089 *:3000 running (7m) 30s ago 8m 83.9M - 9.4.7 954c08fa6188 bb04115ceb76 2024-09-13T02:55:18.482 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi089.qjoitb smithi089 running (3m) 30s ago 3m 98.3M - 17.2.7-1627-gbbdadfa3 a994b00deb3a ff9b59ec5107 2024-09-13T02:55:18.482 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi089.rarddb smithi089 running (3m) 30s ago 3m 176M - 17.2.7-1627-gbbdadfa3 a994b00deb3a db2dc502c1ba 2024-09-13T02:55:18.483 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi131.rbovzc smithi131 running (3m) 35s ago 3m 82.3M - 17.2.7-1627-gbbdadfa3 a994b00deb3a d071b6d99537 2024-09-13T02:55:18.483 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi131.uasrkg smithi131 running (3m) 35s ago 3m 165M - 17.2.7-1627-gbbdadfa3 a994b00deb3a 0b3d4ffa6ce5 2024-09-13T02:55:18.483 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.smithi089.guohvs smithi089 *:9283,8765,8443 running (10m) 30s ago 10m 304M - 17.2.7-1627-gbbdadfa3 a994b00deb3a 32ceefe7e647 2024-09-13T02:55:18.483 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.smithi131.aunbqd smithi131 *:8443,9283 running (51s) 35s ago 8m 482M - 19.1.1-322-g7741f7f9 19dc8d659727 fbb86845e934 2024-09-13T02:55:18.483 INFO:teuthology.orchestra.run.smithi089.stdout:mon.smithi089 smithi089 running (10m) 30s ago 10m 51.0M 2048M 17.2.7-1627-gbbdadfa3 a994b00deb3a d2f18141b2af 2024-09-13T02:55:18.483 INFO:teuthology.orchestra.run.smithi089.stdout:mon.smithi131 smithi131 running (7m) 35s ago 7m 41.7M 2048M 17.2.7-1627-gbbdadfa3 a994b00deb3a 1191e59dc7a0 2024-09-13T02:55:18.483 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.smithi089 smithi089 *:9100 running (8m) 30s ago 8m 16.5M - 1.5.0 0da6a335fe13 c5dbf820b035 2024-09-13T02:55:18.483 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.smithi131 smithi131 *:9100 running (8m) 35s ago 8m 16.3M - 1.5.0 0da6a335fe13 c3309019f407 2024-09-13T02:55:18.483 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0 smithi089 running (7m) 30s ago 7m 206M 1557M 17.2.7-1627-gbbdadfa3 a994b00deb3a b9404e2bc82c 2024-09-13T02:55:18.483 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1 smithi089 running (6m) 30s ago 6m 216M 1557M 17.2.7-1627-gbbdadfa3 a994b00deb3a af6538730e42 2024-09-13T02:55:18.483 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2 smithi089 running (6m) 30s ago 6m 179M 1557M 17.2.7-1627-gbbdadfa3 a994b00deb3a 447cf103114b 2024-09-13T02:55:18.484 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3 smithi131 running (5m) 35s ago 5m 240M 2581M 17.2.7-1627-gbbdadfa3 a994b00deb3a 0b80a4dea862 2024-09-13T02:55:18.484 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4 smithi131 running (5m) 35s ago 5m 215M 2581M 17.2.7-1627-gbbdadfa3 a994b00deb3a 06ec44680b00 2024-09-13T02:55:18.484 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5 smithi131 running (5m) 35s ago 5m 218M 2581M 17.2.7-1627-gbbdadfa3 a994b00deb3a ace4b45e5873 2024-09-13T02:55:18.484 INFO:teuthology.orchestra.run.smithi089.stdout:prometheus.smithi089 smithi089 *:9095 running (7m) 30s ago 8m 57.1M - 2.43.0 a07b618ecd1d 003f13763491 2024-09-13T02:55:18.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.483+0000 7f4d9a6f1640 1 -- 172.21.15.89:0/2050361012 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7f4d7c06e6e0 msgr2=0x7f4d7c070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:18.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.483+0000 7f4d9a6f1640 1 --2- 172.21.15.89:0/2050361012 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7f4d7c06e6e0 0x7f4d7c070b90 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4d9410bd30 tx=0x7f4d88037040 comp rx=0 tx=0).stop 2024-09-13T02:55:18.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.483+0000 7f4d9a6f1640 1 -- 172.21.15.89:0/2050361012 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4d940fb430 msgr2=0x7f4d9410bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:18.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.483+0000 7f4d9a6f1640 1 --2- 172.21.15.89:0/2050361012 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4d940fb430 0x7f4d9410bf80 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4d8400eb40 tx=0x7f4d8400b040 comp rx=0 tx=0).stop 2024-09-13T02:55:18.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.483+0000 7f4d9a6f1640 1 -- 172.21.15.89:0/2050361012 shutdown_connections 2024-09-13T02:55:18.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.483+0000 7f4d9a6f1640 1 --2- 172.21.15.89:0/2050361012 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7f4d7c06e6e0 0x7f4d7c070b90 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:18.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.483+0000 7f4d9a6f1640 1 --2- 172.21.15.89:0/2050361012 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4d940fc700 0x7f4d9410c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:18.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.483+0000 7f4d9a6f1640 1 --2- 172.21.15.89:0/2050361012 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4d940fb430 0x7f4d9410bf80 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:18.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.483+0000 7f4d9a6f1640 1 -- 172.21.15.89:0/2050361012 >> 172.21.15.89:0/2050361012 conn(0x7f4d940f6c10 msgr2=0x7f4d940f83f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:55:18.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.483+0000 7f4d9a6f1640 1 -- 172.21.15.89:0/2050361012 shutdown_connections 2024-09-13T02:55:18.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.483+0000 7f4d9a6f1640 1 -- 172.21.15.89:0/2050361012 wait complete. 2024-09-13T02:55:18.600 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.598+0000 7fd21f623640 1 -- 172.21.15.89:0/2568039875 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2180fc6f0 msgr2=0x7fd2180fcb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:18.601 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.598+0000 7fd21f623640 1 --2- 172.21.15.89:0/2568039875 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2180fc6f0 0x7fd2180fcb60 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fd2140048d0 tx=0x7fd214009da0 comp rx=0 tx=0).stop 2024-09-13T02:55:18.601 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.599+0000 7fd21f623640 1 -- 172.21.15.89:0/2568039875 shutdown_connections 2024-09-13T02:55:18.601 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.599+0000 7fd21f623640 1 --2- 172.21.15.89:0/2568039875 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2180fc6f0 0x7fd2180fcb60 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:18.601 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.599+0000 7fd21f623640 1 --2- 172.21.15.89:0/2568039875 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd2180fb420 0x7fd2180fb830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:18.601 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.599+0000 7fd21f623640 1 -- 172.21.15.89:0/2568039875 >> 172.21.15.89:0/2568039875 conn(0x7fd2180f6c00 msgr2=0x7fd2180f9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:55:18.602 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.600+0000 7fd21f623640 1 -- 172.21.15.89:0/2568039875 shutdown_connections 2024-09-13T02:55:18.602 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.600+0000 7fd21f623640 1 -- 172.21.15.89:0/2568039875 wait complete. 2024-09-13T02:55:18.602 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.600+0000 7fd21f623640 1 Processor -- start 2024-09-13T02:55:18.603 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.600+0000 7fd21f623640 1 -- start start 2024-09-13T02:55:18.603 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.601+0000 7fd21f623640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2180fb420 0x7fd21810aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:18.603 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.601+0000 7fd21f623640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd2180fc6f0 0x7fd21810b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:18.603 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.601+0000 7fd21f623640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd21810ba80 con 0x7fd2180fb420 2024-09-13T02:55:18.603 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.601+0000 7fd21f623640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd21810c2b0 con 0x7fd2180fc6f0 2024-09-13T02:55:18.603 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.601+0000 7fd21d3bf640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2180fb420 0x7fd21810aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:18.603 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.601+0000 7fd21d3bf640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2180fb420 0x7fd21810aeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:47062/0 (socket says 172.21.15.89:47062) 2024-09-13T02:55:18.603 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.601+0000 7fd21d3bf640 1 -- 172.21.15.89:0/1227155803 learned_addr learned my addr 172.21.15.89:0/1227155803 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:55:18.603 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.601+0000 7fd21cbbe640 1 --2- 172.21.15.89:0/1227155803 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd2180fc6f0 0x7fd21810b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:18.604 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.601+0000 7fd21d3bf640 1 -- 172.21.15.89:0/1227155803 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd2180fc6f0 msgr2=0x7fd21810b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:18.604 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.601+0000 7fd21d3bf640 1 --2- 172.21.15.89:0/1227155803 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd2180fc6f0 0x7fd21810b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:18.604 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.601+0000 7fd21d3bf640 1 -- 172.21.15.89:0/1227155803 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd214005040 con 0x7fd2180fb420 2024-09-13T02:55:18.604 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.601+0000 7fd21d3bf640 1 --2- 172.21.15.89:0/1227155803 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2180fb420 0x7fd21810aeb0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fd21000bb30 tx=0x7fd210009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:55:18.604 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.602+0000 7fd20dffb640 1 -- 172.21.15.89:0/1227155803 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd2100092e0 con 0x7fd2180fb420 2024-09-13T02:55:18.604 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.602+0000 7fd20dffb640 1 -- 172.21.15.89:0/1227155803 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd21000cdd0 con 0x7fd2180fb420 2024-09-13T02:55:18.605 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.602+0000 7fd20dffb640 1 -- 172.21.15.89:0/1227155803 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd210015ea0 con 0x7fd2180fb420 2024-09-13T02:55:18.605 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.602+0000 7fd21f623640 1 -- 172.21.15.89:0/1227155803 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd21810c530 con 0x7fd2180fb420 2024-09-13T02:55:18.605 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.603+0000 7fd21f623640 1 -- 172.21.15.89:0/1227155803 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd21810cad0 con 0x7fd2180fb420 2024-09-13T02:55:18.606 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.604+0000 7fd21f623640 1 -- 172.21.15.89:0/1227155803 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2180fa880 con 0x7fd2180fb420 2024-09-13T02:55:18.606 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.605+0000 7fd20dffb640 1 -- 172.21.15.89:0/1227155803 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7fd210012070 con 0x7fd2180fb420 2024-09-13T02:55:18.607 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.606+0000 7fd20dffb640 1 --2- 172.21.15.89:0/1227155803 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7fd20406e880 0x7fd204070d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:18.607 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.606+0000 7fd20dffb640 1 -- 172.21.15.89:0/1227155803 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fd21008e1d0 con 0x7fd2180fb420 2024-09-13T02:55:18.609 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.607+0000 7fd21cbbe640 1 --2- 172.21.15.89:0/1227155803 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7fd20406e880 0x7fd204070d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:18.609 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.608+0000 7fd21cbbe640 1 --2- 172.21.15.89:0/1227155803 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7fd20406e880 0x7fd204070d30 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd2140048a0 tx=0x7fd214035040 comp rx=0 tx=0).ready entity=mgr.24393 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:55:18.615 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.613+0000 7fd20dffb640 1 -- 172.21.15.89:0/1227155803 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fd210057be0 con 0x7fd2180fb420 2024-09-13T02:55:18.689 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.1... 2024-09-13T02:55:18.689 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2024-09-13T02:55:18.928 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.927+0000 7fd21f623640 1 -- 172.21.15.89:0/1227155803 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd218105230 con 0x7fd2180fb420 2024-09-13T02:55:18.929 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.927+0000 7fd20dffb640 1 -- 172.21.15.89:0/1227155803 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+855 (secure 0 0 0) 0x7fd21005b2a0 con 0x7fd2180fb420 2024-09-13T02:55:18.929 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-13T02:55:18.929 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": { 2024-09-13T02:55:18.929 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 2 2024-09-13T02:55:18.929 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T02:55:18.929 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": { 2024-09-13T02:55:18.929 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 1, 2024-09-13T02:55:18.929 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 1 2024-09-13T02:55:18.929 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T02:55:18.929 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": { 2024-09-13T02:55:18.930 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 6 2024-09-13T02:55:18.930 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T02:55:18.930 INFO:teuthology.orchestra.run.smithi089.stdout: "mds": { 2024-09-13T02:55:18.930 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 4 2024-09-13T02:55:18.930 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T02:55:18.930 INFO:teuthology.orchestra.run.smithi089.stdout: "overall": { 2024-09-13T02:55:18.930 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 13, 2024-09-13T02:55:18.930 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 1 2024-09-13T02:55:18.930 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-13T02:55:18.930 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-13T02:55:18.931 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.929+0000 7fd21f623640 1 -- 172.21.15.89:0/1227155803 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7fd20406e880 msgr2=0x7fd204070d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:18.931 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.929+0000 7fd21f623640 1 --2- 172.21.15.89:0/1227155803 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7fd20406e880 0x7fd204070d30 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fd2140048a0 tx=0x7fd214035040 comp rx=0 tx=0).stop 2024-09-13T02:55:18.931 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.929+0000 7fd21f623640 1 -- 172.21.15.89:0/1227155803 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2180fb420 msgr2=0x7fd21810aeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:18.931 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.929+0000 7fd21f623640 1 --2- 172.21.15.89:0/1227155803 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2180fb420 0x7fd21810aeb0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fd21000bb30 tx=0x7fd210009840 comp rx=0 tx=0).stop 2024-09-13T02:55:18.931 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.929+0000 7fd21f623640 1 -- 172.21.15.89:0/1227155803 shutdown_connections 2024-09-13T02:55:18.931 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.929+0000 7fd21f623640 1 --2- 172.21.15.89:0/1227155803 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7fd20406e880 0x7fd204070d30 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:18.931 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.929+0000 7fd21f623640 1 --2- 172.21.15.89:0/1227155803 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd2180fc6f0 0x7fd21810b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:18.931 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.929+0000 7fd21f623640 1 --2- 172.21.15.89:0/1227155803 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd2180fb420 0x7fd21810aeb0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:18.931 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.929+0000 7fd21f623640 1 -- 172.21.15.89:0/1227155803 >> 172.21.15.89:0/1227155803 conn(0x7fd2180f6c00 msgr2=0x7fd2180f8300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:55:18.932 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.930+0000 7fd21f623640 1 -- 172.21.15.89:0/1227155803 shutdown_connections 2024-09-13T02:55:18.932 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:18.930+0000 7fd21f623640 1 -- 172.21.15.89:0/1227155803 wait complete. 2024-09-13T02:55:19.011 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.009+0000 7f7c585f8640 1 -- 172.21.15.89:0/235482043 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c5006ffe0 msgr2=0x7f7c50070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:19.012 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.009+0000 7f7c585f8640 1 --2- 172.21.15.89:0/235482043 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c5006ffe0 0x7f7c50070450 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f7c400048d0 tx=0x7f7c40009da0 comp rx=0 tx=0).stop 2024-09-13T02:55:19.012 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.009+0000 7f7c585f8640 1 -- 172.21.15.89:0/235482043 shutdown_connections 2024-09-13T02:55:19.012 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.009+0000 7f7c585f8640 1 --2- 172.21.15.89:0/235482043 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c5006ffe0 0x7f7c50070450 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:19.012 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.009+0000 7f7c585f8640 1 --2- 172.21.15.89:0/235482043 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7c50071570 0x7f7c5006faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:19.012 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.009+0000 7f7c585f8640 1 -- 172.21.15.89:0/235482043 >> 172.21.15.89:0/235482043 conn(0x7f7c500f7ce0 msgr2=0x7f7c500fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:55:19.012 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.009+0000 7f7c585f8640 1 -- 172.21.15.89:0/235482043 shutdown_connections 2024-09-13T02:55:19.012 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.009+0000 7f7c585f8640 1 -- 172.21.15.89:0/235482043 wait complete. 2024-09-13T02:55:19.012 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.009+0000 7f7c585f8640 1 Processor -- start 2024-09-13T02:55:19.012 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.009+0000 7f7c585f8640 1 -- start start 2024-09-13T02:55:19.012 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.009+0000 7f7c585f8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c5006ffe0 0x7f7c5010f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:19.012 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.010+0000 7f7c585f8640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7c50071570 0x7f7c5010f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:19.013 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.010+0000 7f7c585f8640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c5010fe10 con 0x7f7c5006ffe0 2024-09-13T02:55:19.013 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.010+0000 7f7c585f8640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c50110630 con 0x7f7c50071570 2024-09-13T02:55:19.013 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.010+0000 7f7c56394640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c5006ffe0 0x7f7c5010f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:19.013 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.010+0000 7f7c56394640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c5006ffe0 0x7f7c5010f280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:47080/0 (socket says 172.21.15.89:47080) 2024-09-13T02:55:19.013 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.010+0000 7f7c56394640 1 -- 172.21.15.89:0/3681599818 learned_addr learned my addr 172.21.15.89:0/3681599818 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:55:19.013 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.010+0000 7f7c55b93640 1 --2- 172.21.15.89:0/3681599818 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7c50071570 0x7f7c5010f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:19.013 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.010+0000 7f7c56394640 1 -- 172.21.15.89:0/3681599818 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7c50071570 msgr2=0x7f7c5010f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:19.013 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.010+0000 7f7c56394640 1 --2- 172.21.15.89:0/3681599818 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7c50071570 0x7f7c5010f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:19.013 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.010+0000 7f7c56394640 1 -- 172.21.15.89:0/3681599818 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c40005040 con 0x7f7c5006ffe0 2024-09-13T02:55:19.013 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.010+0000 7f7c56394640 1 --2- 172.21.15.89:0/3681599818 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c5006ffe0 0x7f7c5010f280 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c002840 tx=0x7f7c4c004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:55:19.013 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.010+0000 7f7c46ffd640 1 -- 172.21.15.89:0/3681599818 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c4c007c30 con 0x7f7c5006ffe0 2024-09-13T02:55:19.013 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.010+0000 7f7c46ffd640 1 -- 172.21.15.89:0/3681599818 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f7c4c00f040 con 0x7f7c5006ffe0 2024-09-13T02:55:19.013 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.010+0000 7f7c585f8640 1 -- 172.21.15.89:0/3681599818 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c501108c0 con 0x7f7c5006ffe0 2024-09-13T02:55:19.014 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.010+0000 7f7c46ffd640 1 -- 172.21.15.89:0/3681599818 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c4c00d990 con 0x7f7c5006ffe0 2024-09-13T02:55:19.014 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.010+0000 7f7c585f8640 1 -- 172.21.15.89:0/3681599818 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c50110e60 con 0x7f7c5006ffe0 2024-09-13T02:55:19.014 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.011+0000 7f7c585f8640 1 -- 172.21.15.89:0/3681599818 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c500fb980 con 0x7f7c5006ffe0 2024-09-13T02:55:19.015 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.012+0000 7f7c46ffd640 1 -- 172.21.15.89:0/3681599818 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7f7c4c009600 con 0x7f7c5006ffe0 2024-09-13T02:55:19.015 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.012+0000 7f7c46ffd640 1 --2- 172.21.15.89:0/3681599818 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7f7c3c06e6e0 0x7f7c3c070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:19.015 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.012+0000 7f7c46ffd640 1 -- 172.21.15.89:0/3681599818 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f7c4c08dd60 con 0x7f7c5006ffe0 2024-09-13T02:55:19.015 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.012+0000 7f7c55b93640 1 --2- 172.21.15.89:0/3681599818 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7f7c3c06e6e0 0x7f7c3c070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:19.015 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.013+0000 7f7c55b93640 1 --2- 172.21.15.89:0/3681599818 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7f7c3c06e6e0 0x7f7c3c070b90 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7c5010f030 tx=0x7f7c40035040 comp rx=0 tx=0).ready entity=mgr.24393 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:55:19.017 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.016+0000 7f7c46ffd640 1 -- 172.21.15.89:0/3681599818 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f7c4c0575e0 con 0x7f7c5006ffe0 2024-09-13T02:55:19.018 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:18 smithi131 ceph-mon[34689]: from='client.14706 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:55:19.019 DEBUG:teuthology.parallel:result is None 2024-09-13T02:55:19.020 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-13T02:55:19.054 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:18 smithi089 ceph-mon[27639]: from='client.14706 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:55:19.055 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-13T02:55:19.055 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2024-09-13T02:55:19.086 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2024-09-13T02:55:19.086 DEBUG:teuthology.parallel:result is None 2024-09-13T02:55:19.230 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.228+0000 7f7c585f8640 1 -- 172.21.15.89:0/3681599818 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f7c5004b720 con 0x7f7c5006ffe0 2024-09-13T02:55:19.230 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.228+0000 7f7c46ffd640 1 -- 172.21.15.89:0/3681599818 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1864 (secure 0 0 0) 0x7f7c4c05aca0 con 0x7f7c5006ffe0 2024-09-13T02:55:19.230 INFO:teuthology.orchestra.run.smithi089.stdout:e21 2024-09-13T02:55:19.230 INFO:teuthology.orchestra.run.smithi089.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T02:55:19.230 INFO:teuthology.orchestra.run.smithi089.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:55:19.231 INFO:teuthology.orchestra.run.smithi089.stdout:legacy client fscid: 1 2024-09-13T02:55:19.231 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:55:19.231 INFO:teuthology.orchestra.run.smithi089.stdout:Filesystem 'cephfs' (1) 2024-09-13T02:55:19.231 INFO:teuthology.orchestra.run.smithi089.stdout:fs_name cephfs 2024-09-13T02:55:19.231 INFO:teuthology.orchestra.run.smithi089.stdout:epoch 21 2024-09-13T02:55:19.231 INFO:teuthology.orchestra.run.smithi089.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T02:55:19.231 INFO:teuthology.orchestra.run.smithi089.stdout:created 2024-09-13T02:51:40.657817+0000 2024-09-13T02:55:19.231 INFO:teuthology.orchestra.run.smithi089.stdout:modified 2024-09-13T02:54:05.118633+0000 2024-09-13T02:55:19.231 INFO:teuthology.orchestra.run.smithi089.stdout:tableserver 0 2024-09-13T02:55:19.231 INFO:teuthology.orchestra.run.smithi089.stdout:root 0 2024-09-13T02:55:19.231 INFO:teuthology.orchestra.run.smithi089.stdout:session_timeout 60 2024-09-13T02:55:19.231 INFO:teuthology.orchestra.run.smithi089.stdout:session_autoclose 300 2024-09-13T02:55:19.232 INFO:teuthology.orchestra.run.smithi089.stdout:max_file_size 1099511627776 2024-09-13T02:55:19.232 INFO:teuthology.orchestra.run.smithi089.stdout:required_client_features {} 2024-09-13T02:55:19.232 INFO:teuthology.orchestra.run.smithi089.stdout:last_failure 0 2024-09-13T02:55:19.232 INFO:teuthology.orchestra.run.smithi089.stdout:last_failure_osd_epoch 44 2024-09-13T02:55:19.232 INFO:teuthology.orchestra.run.smithi089.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:55:19.232 INFO:teuthology.orchestra.run.smithi089.stdout:max_mds 2 2024-09-13T02:55:19.232 INFO:teuthology.orchestra.run.smithi089.stdout:in 0,1 2024-09-13T02:55:19.232 INFO:teuthology.orchestra.run.smithi089.stdout:up {0=14480,1=24257} 2024-09-13T02:55:19.232 INFO:teuthology.orchestra.run.smithi089.stdout:failed 2024-09-13T02:55:19.232 INFO:teuthology.orchestra.run.smithi089.stdout:damaged 2024-09-13T02:55:19.232 INFO:teuthology.orchestra.run.smithi089.stdout:stopped 2024-09-13T02:55:19.232 INFO:teuthology.orchestra.run.smithi089.stdout:data_pools [3] 2024-09-13T02:55:19.232 INFO:teuthology.orchestra.run.smithi089.stdout:metadata_pool 2 2024-09-13T02:55:19.232 INFO:teuthology.orchestra.run.smithi089.stdout:inline_data disabled 2024-09-13T02:55:19.233 INFO:teuthology.orchestra.run.smithi089.stdout:balancer 2024-09-13T02:55:19.233 INFO:teuthology.orchestra.run.smithi089.stdout:standby_count_wanted 1 2024-09-13T02:55:19.233 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi089.rarddb{0:14480} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.89:6828/1561365213,v1:172.21.15.89:6829/1561365213] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:55:19.233 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi089.qjoitb{0:14488} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.89:6826/1464393547,v1:172.21.15.89:6827/1464393547] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:55:19.233 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi131.uasrkg{1:24257} state up:active seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.131:6824/260493836,v1:172.21.15.131:6825/260493836] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:55:19.233 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi131.rbovzc{1:24265} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.131:6826/665579373,v1:172.21.15.131:6827/665579373] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:55:19.233 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:55:19.233 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:55:19.234 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 21 2024-09-13T02:55:19.234 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.231+0000 7f7c585f8640 1 -- 172.21.15.89:0/3681599818 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7f7c3c06e6e0 msgr2=0x7f7c3c070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:19.234 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.231+0000 7f7c585f8640 1 --2- 172.21.15.89:0/3681599818 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7f7c3c06e6e0 0x7f7c3c070b90 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7c5010f030 tx=0x7f7c40035040 comp rx=0 tx=0).stop 2024-09-13T02:55:19.234 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.231+0000 7f7c585f8640 1 -- 172.21.15.89:0/3681599818 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c5006ffe0 msgr2=0x7f7c5010f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:19.234 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.231+0000 7f7c585f8640 1 --2- 172.21.15.89:0/3681599818 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c5006ffe0 0x7f7c5010f280 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f7c4c002840 tx=0x7f7c4c004570 comp rx=0 tx=0).stop 2024-09-13T02:55:19.234 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.231+0000 7f7c585f8640 1 -- 172.21.15.89:0/3681599818 shutdown_connections 2024-09-13T02:55:19.234 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.231+0000 7f7c585f8640 1 --2- 172.21.15.89:0/3681599818 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7f7c3c06e6e0 0x7f7c3c070b90 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:19.234 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.231+0000 7f7c585f8640 1 --2- 172.21.15.89:0/3681599818 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7c50071570 0x7f7c5010f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:19.234 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.231+0000 7f7c585f8640 1 --2- 172.21.15.89:0/3681599818 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7c5006ffe0 0x7f7c5010f280 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:19.234 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.231+0000 7f7c585f8640 1 -- 172.21.15.89:0/3681599818 >> 172.21.15.89:0/3681599818 conn(0x7f7c500f7ce0 msgr2=0x7f7c500f94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:55:19.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.231+0000 7f7c585f8640 1 -- 172.21.15.89:0/3681599818 shutdown_connections 2024-09-13T02:55:19.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.231+0000 7f7c585f8640 1 -- 172.21.15.89:0/3681599818 wait complete. 2024-09-13T02:55:19.315 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.313+0000 7f3cff9cb640 1 -- 172.21.15.89:0/1589227876 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3cf80fc700 msgr2=0x7f3cf80fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:19.315 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.313+0000 7f3cff9cb640 1 --2- 172.21.15.89:0/1589227876 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3cf80fc700 0x7f3cf80fcb70 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f3ce80048d0 tx=0x7f3ce8009da0 comp rx=0 tx=0).stop 2024-09-13T02:55:19.315 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.313+0000 7f3cff9cb640 1 -- 172.21.15.89:0/1589227876 shutdown_connections 2024-09-13T02:55:19.315 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.313+0000 7f3cff9cb640 1 --2- 172.21.15.89:0/1589227876 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3cf80fc700 0x7f3cf80fcb70 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:19.315 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.313+0000 7f3cff9cb640 1 --2- 172.21.15.89:0/1589227876 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3cf80fb430 0x7f3cf80fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:19.315 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.313+0000 7f3cff9cb640 1 -- 172.21.15.89:0/1589227876 >> 172.21.15.89:0/1589227876 conn(0x7f3cf80f6c10 msgr2=0x7f3cf80f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:55:19.316 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.313+0000 7f3cff9cb640 1 -- 172.21.15.89:0/1589227876 shutdown_connections 2024-09-13T02:55:19.316 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.313+0000 7f3cff9cb640 1 -- 172.21.15.89:0/1589227876 wait complete. 2024-09-13T02:55:19.316 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.313+0000 7f3cff9cb640 1 Processor -- start 2024-09-13T02:55:19.316 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.313+0000 7f3cff9cb640 1 -- start start 2024-09-13T02:55:19.316 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.314+0000 7f3cff9cb640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3cf80fb430 0x7f3cf810bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:19.316 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.314+0000 7f3cff9cb640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3cf80fc700 0x7f3cf810c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:19.316 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.314+0000 7f3cff9cb640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf810cb10 con 0x7f3cf80fc700 2024-09-13T02:55:19.316 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.314+0000 7f3cff9cb640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cf810d330 con 0x7f3cf80fb430 2024-09-13T02:55:19.316 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.314+0000 7f3cfcf66640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3cf80fc700 0x7f3cf810c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:19.316 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.314+0000 7f3cfd767640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3cf80fb430 0x7f3cf810bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:19.316 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.314+0000 7f3cfcf66640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3cf80fc700 0x7f3cf810c4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:47088/0 (socket says 172.21.15.89:47088) 2024-09-13T02:55:19.316 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.314+0000 7f3cfd767640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3cf80fb430 0x7f3cf810bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.89:45992/0 (socket says 172.21.15.89:45992) 2024-09-13T02:55:19.316 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.314+0000 7f3cfcf66640 1 -- 172.21.15.89:0/1520061522 learned_addr learned my addr 172.21.15.89:0/1520061522 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:55:19.317 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.314+0000 7f3cfcf66640 1 -- 172.21.15.89:0/1520061522 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3cf80fb430 msgr2=0x7f3cf810bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:19.317 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.314+0000 7f3cfcf66640 1 --2- 172.21.15.89:0/1520061522 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3cf80fb430 0x7f3cf810bf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:19.317 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.314+0000 7f3cfcf66640 1 -- 172.21.15.89:0/1520061522 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ce8005040 con 0x7f3cf80fc700 2024-09-13T02:55:19.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.314+0000 7f3cfcf66640 1 --2- 172.21.15.89:0/1520061522 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3cf80fc700 0x7f3cf810c4c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f3ce80043d0 tx=0x7f3ce8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:55:19.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.314+0000 7f3cedffb640 1 -- 172.21.15.89:0/1520061522 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ce8038070 con 0x7f3cf80fc700 2024-09-13T02:55:19.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.314+0000 7f3cedffb640 1 -- 172.21.15.89:0/1520061522 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3ce8009800 con 0x7f3cf80fc700 2024-09-13T02:55:19.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.314+0000 7f3cff9cb640 1 -- 172.21.15.89:0/1520061522 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cf810d560 con 0x7f3cf80fc700 2024-09-13T02:55:19.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.314+0000 7f3cedffb640 1 -- 172.21.15.89:0/1520061522 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ce803e670 con 0x7f3cf80fc700 2024-09-13T02:55:19.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.315+0000 7f3cff9cb640 1 -- 172.21.15.89:0/1520061522 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cf810db00 con 0x7f3cf80fc700 2024-09-13T02:55:19.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.316+0000 7f3cff9cb640 1 -- 172.21.15.89:0/1520061522 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cf80fa890 con 0x7f3cf80fc700 2024-09-13T02:55:19.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.316+0000 7f3cedffb640 1 -- 172.21.15.89:0/1520061522 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7f3ce8030020 con 0x7f3cf80fc700 2024-09-13T02:55:19.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.316+0000 7f3cedffb640 1 --2- 172.21.15.89:0/1520061522 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7f3ce406e6e0 0x7f3ce4070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:19.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.317+0000 7f3cedffb640 1 -- 172.21.15.89:0/1520061522 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f3ce80adf60 con 0x7f3cf80fc700 2024-09-13T02:55:19.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.317+0000 7f3cfd767640 1 --2- 172.21.15.89:0/1520061522 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7f3ce406e6e0 0x7f3ce4070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:19.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.317+0000 7f3cfd767640 1 --2- 172.21.15.89:0/1520061522 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7f3ce406e6e0 0x7f3ce4070b90 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3cf4004ed0 tx=0x7f3cf400b040 comp rx=0 tx=0).ready entity=mgr.24393 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:55:19.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.321+0000 7f3cedffb640 1 -- 172.21.15.89:0/1520061522 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f3ce80e2670 con 0x7f3cf80fc700 2024-09-13T02:55:19.539 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.537+0000 7f3cff9cb640 1 -- 172.21.15.89:0/1520061522 --> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3cf810de80 con 0x7f3ce406e6e0 2024-09-13T02:55:19.540 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.539+0000 7f3cedffb640 1 -- 172.21.15.89:0/1520061522 <== mgr.24393 v2:172.21.15.131:6828/2180703853 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+318 (secure 0 0 0) 0x7f3cf810de80 con 0x7f3ce406e6e0 2024-09-13T02:55:19.540 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-13T02:55:19.540 INFO:teuthology.orchestra.run.smithi089.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d", 2024-09-13T02:55:19.540 INFO:teuthology.orchestra.run.smithi089.stdout: "in_progress": true, 2024-09-13T02:55:19.540 INFO:teuthology.orchestra.run.smithi089.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T02:55:19.540 INFO:teuthology.orchestra.run.smithi089.stdout: "services_complete": [], 2024-09-13T02:55:19.541 INFO:teuthology.orchestra.run.smithi089.stdout: "progress": "1/21 daemons upgraded", 2024-09-13T02:55:19.541 INFO:teuthology.orchestra.run.smithi089.stdout: "message": "", 2024-09-13T02:55:19.541 INFO:teuthology.orchestra.run.smithi089.stdout: "is_paused": false 2024-09-13T02:55:19.541 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-13T02:55:19.542 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.541+0000 7f3cff9cb640 1 -- 172.21.15.89:0/1520061522 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7f3ce406e6e0 msgr2=0x7f3ce4070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:19.542 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.541+0000 7f3cff9cb640 1 --2- 172.21.15.89:0/1520061522 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7f3ce406e6e0 0x7f3ce4070b90 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3cf4004ed0 tx=0x7f3cf400b040 comp rx=0 tx=0).stop 2024-09-13T02:55:19.542 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.541+0000 7f3cff9cb640 1 -- 172.21.15.89:0/1520061522 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3cf80fc700 msgr2=0x7f3cf810c4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:19.542 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.541+0000 7f3cff9cb640 1 --2- 172.21.15.89:0/1520061522 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3cf80fc700 0x7f3cf810c4c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f3ce80043d0 tx=0x7f3ce8009da0 comp rx=0 tx=0).stop 2024-09-13T02:55:19.542 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.541+0000 7f3cff9cb640 1 -- 172.21.15.89:0/1520061522 shutdown_connections 2024-09-13T02:55:19.543 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.541+0000 7f3cff9cb640 1 --2- 172.21.15.89:0/1520061522 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7f3ce406e6e0 0x7f3ce4070b90 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:19.543 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.541+0000 7f3cff9cb640 1 --2- 172.21.15.89:0/1520061522 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3cf80fc700 0x7f3cf810c4c0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:19.543 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.541+0000 7f3cff9cb640 1 --2- 172.21.15.89:0/1520061522 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3cf80fb430 0x7f3cf810bf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:19.543 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.541+0000 7f3cff9cb640 1 -- 172.21.15.89:0/1520061522 >> 172.21.15.89:0/1520061522 conn(0x7f3cf80f6c10 msgr2=0x7f3cf80f83f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:55:19.543 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.541+0000 7f3cff9cb640 1 -- 172.21.15.89:0/1520061522 shutdown_connections 2024-09-13T02:55:19.543 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.541+0000 7f3cff9cb640 1 -- 172.21.15.89:0/1520061522 wait complete. 2024-09-13T02:55:19.624 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.621+0000 7fd976f1e640 1 -- 172.21.15.89:0/217372356 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9700ff720 msgr2=0x7fd970101b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:19.624 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.621+0000 7fd976f1e640 1 --2- 172.21.15.89:0/217372356 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9700ff720 0x7fd970101b00 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fd95c0048d0 tx=0x7fd95c009da0 comp rx=0 tx=0).stop 2024-09-13T02:55:19.624 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.621+0000 7fd976f1e640 1 -- 172.21.15.89:0/217372356 shutdown_connections 2024-09-13T02:55:19.624 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.621+0000 7fd976f1e640 1 --2- 172.21.15.89:0/217372356 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9700ff720 0x7fd970101b00 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:19.625 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.621+0000 7fd976f1e640 1 --2- 172.21.15.89:0/217372356 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd970066690 0x7fd9700ff1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:19.625 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.622+0000 7fd976f1e640 1 -- 172.21.15.89:0/217372356 >> 172.21.15.89:0/217372356 conn(0x7fd9700f6c10 msgr2=0x7fd9700f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:55:19.625 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.622+0000 7fd976f1e640 1 -- 172.21.15.89:0/217372356 shutdown_connections 2024-09-13T02:55:19.625 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.622+0000 7fd976f1e640 1 -- 172.21.15.89:0/217372356 wait complete. 2024-09-13T02:55:19.625 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.622+0000 7fd976f1e640 1 Processor -- start 2024-09-13T02:55:19.625 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.622+0000 7fd976f1e640 1 -- start start 2024-09-13T02:55:19.625 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.622+0000 7fd976f1e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd970066690 0x7fd97010d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:19.625 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.623+0000 7fd976f1e640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd9700ff720 0x7fd97010d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:19.625 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.623+0000 7fd976f1e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd97010dd10 con 0x7fd970066690 2024-09-13T02:55:19.625 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.623+0000 7fd976f1e640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd97010e4e0 con 0x7fd9700ff720 2024-09-13T02:55:19.625 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.623+0000 7fd974cba640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd970066690 0x7fd97010d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:19.625 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.623+0000 7fd974cba640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd970066690 0x7fd97010d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:47096/0 (socket says 172.21.15.89:47096) 2024-09-13T02:55:19.625 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.623+0000 7fd974cba640 1 -- 172.21.15.89:0/1198385064 learned_addr learned my addr 172.21.15.89:0/1198385064 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:55:19.626 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.623+0000 7fd96ffff640 1 --2- 172.21.15.89:0/1198385064 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd9700ff720 0x7fd97010d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:19.626 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.623+0000 7fd974cba640 1 -- 172.21.15.89:0/1198385064 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd9700ff720 msgr2=0x7fd97010d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:19.626 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.623+0000 7fd974cba640 1 --2- 172.21.15.89:0/1198385064 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd9700ff720 0x7fd97010d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:19.626 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.623+0000 7fd974cba640 1 -- 172.21.15.89:0/1198385064 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd95c005040 con 0x7fd970066690 2024-09-13T02:55:19.627 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.623+0000 7fd974cba640 1 --2- 172.21.15.89:0/1198385064 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd970066690 0x7fd97010d180 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fd964002840 tx=0x7fd964004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:55:19.627 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.623+0000 7fd96d7fa640 1 -- 172.21.15.89:0/1198385064 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd964007c30 con 0x7fd970066690 2024-09-13T02:55:19.627 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.623+0000 7fd96d7fa640 1 -- 172.21.15.89:0/1198385064 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd96400f040 con 0x7fd970066690 2024-09-13T02:55:19.627 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.623+0000 7fd976f1e640 1 -- 172.21.15.89:0/1198385064 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd97010e770 con 0x7fd970066690 2024-09-13T02:55:19.627 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.624+0000 7fd96d7fa640 1 -- 172.21.15.89:0/1198385064 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd96400d990 con 0x7fd970066690 2024-09-13T02:55:19.627 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.624+0000 7fd976f1e640 1 -- 172.21.15.89:0/1198385064 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd97010ece0 con 0x7fd970066690 2024-09-13T02:55:19.627 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.625+0000 7fd976f1e640 1 -- 172.21.15.89:0/1198385064 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd970105790 con 0x7fd970066690 2024-09-13T02:55:19.628 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.626+0000 7fd96d7fa640 1 -- 172.21.15.89:0/1198385064 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7fd96400dbc0 con 0x7fd970066690 2024-09-13T02:55:19.628 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.626+0000 7fd96d7fa640 1 --2- 172.21.15.89:0/1198385064 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7fd96006e6e0 0x7fd960070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:19.628 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.626+0000 7fd96d7fa640 1 -- 172.21.15.89:0/1198385064 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fd96408dd70 con 0x7fd970066690 2024-09-13T02:55:19.628 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.626+0000 7fd96ffff640 1 --2- 172.21.15.89:0/1198385064 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7fd96006e6e0 0x7fd960070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:19.628 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.627+0000 7fd96ffff640 1 --2- 172.21.15.89:0/1198385064 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7fd96006e6e0 0x7fd960070b90 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd95c000c00 tx=0x7fd95c035040 comp rx=0 tx=0).ready entity=mgr.24393 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:55:19.632 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.631+0000 7fd96d7fa640 1 -- 172.21.15.89:0/1198385064 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fd9640575f0 con 0x7fd970066690 2024-09-13T02:55:19.873 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.871+0000 7fd976f1e640 1 -- 172.21.15.89:0/1198385064 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fd9700fa8b0 con 0x7fd970066690 2024-09-13T02:55:19.873 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.872+0000 7fd96d7fa640 1 -- 172.21.15.89:0/1198385064 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fd96405acb0 con 0x7fd970066690 2024-09-13T02:55:19.873 INFO:teuthology.orchestra.run.smithi089.stdout:HEALTH_OK 2024-09-13T02:55:19.875 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.873+0000 7fd976f1e640 1 -- 172.21.15.89:0/1198385064 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7fd96006e6e0 msgr2=0x7fd960070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:19.875 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.873+0000 7fd976f1e640 1 --2- 172.21.15.89:0/1198385064 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7fd96006e6e0 0x7fd960070b90 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd95c000c00 tx=0x7fd95c035040 comp rx=0 tx=0).stop 2024-09-13T02:55:19.875 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.873+0000 7fd976f1e640 1 -- 172.21.15.89:0/1198385064 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd970066690 msgr2=0x7fd97010d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:19.875 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.873+0000 7fd976f1e640 1 --2- 172.21.15.89:0/1198385064 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd970066690 0x7fd97010d180 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fd964002840 tx=0x7fd964004570 comp rx=0 tx=0).stop 2024-09-13T02:55:19.875 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.874+0000 7fd976f1e640 1 -- 172.21.15.89:0/1198385064 shutdown_connections 2024-09-13T02:55:19.875 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.874+0000 7fd976f1e640 1 --2- 172.21.15.89:0/1198385064 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7fd96006e6e0 0x7fd960070b90 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:19.875 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.874+0000 7fd976f1e640 1 --2- 172.21.15.89:0/1198385064 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd9700ff720 0x7fd97010d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:19.875 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.874+0000 7fd976f1e640 1 --2- 172.21.15.89:0/1198385064 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd970066690 0x7fd97010d180 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:19.876 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:19 smithi089 ceph-mon[27639]: pgmap v24: 65 pgs: 65 active+clean; 310 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 591 op/s 2024-09-13T02:55:19.876 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:19 smithi089 ceph-mon[27639]: from='client.14710 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:55:19.876 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:19 smithi089 ceph-mon[27639]: from='client.24451 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:55:19.876 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:19 smithi089 ceph-mon[27639]: from='client.? 172.21.15.89:0/1227155803' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:55:19.876 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:19 smithi089 ceph-mon[27639]: from='client.? 172.21.15.89:0/3681599818' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T02:55:19.876 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.874+0000 7fd976f1e640 1 -- 172.21.15.89:0/1198385064 >> 172.21.15.89:0/1198385064 conn(0x7fd9700f6c10 msgr2=0x7fd9700f7030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:55:19.877 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.874+0000 7fd976f1e640 1 -- 172.21.15.89:0/1198385064 shutdown_connections 2024-09-13T02:55:19.877 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:19.874+0000 7fd976f1e640 1 -- 172.21.15.89:0/1198385064 wait complete. 2024-09-13T02:55:20.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:19 smithi131 ceph-mon[34689]: pgmap v24: 65 pgs: 65 active+clean; 310 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 2.3 MiB/s rd, 2.3 MiB/s wr, 591 op/s 2024-09-13T02:55:20.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:19 smithi131 ceph-mon[34689]: from='client.14710 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:55:20.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:19 smithi131 ceph-mon[34689]: from='client.24451 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:55:20.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:19 smithi131 ceph-mon[34689]: from='client.? 172.21.15.89:0/1227155803' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:55:20.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:19 smithi131 ceph-mon[34689]: from='client.? 172.21.15.89:0/3681599818' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T02:55:21.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:20 smithi131 ceph-mon[34689]: from='client.14726 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:55:21.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:20 smithi131 ceph-mon[34689]: from='client.? 172.21.15.89:0/1198385064' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T02:55:21.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:20 smithi131 ceph-mon[34689]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' 2024-09-13T02:55:21.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:20 smithi131 ceph-mon[34689]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' 2024-09-13T02:55:21.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:20 smithi089 ceph-mon[27639]: from='client.14726 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:55:21.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:20 smithi089 ceph-mon[27639]: from='client.? 172.21.15.89:0/1198385064' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T02:55:21.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:20 smithi089 ceph-mon[27639]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' 2024-09-13T02:55:21.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:20 smithi089 ceph-mon[27639]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' 2024-09-13T02:55:22.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:21 smithi131 ceph-mon[34689]: Reconfiguring alertmanager.smithi089 (dependencies changed)... 2024-09-13T02:55:22.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:21 smithi131 ceph-mon[34689]: Deploying daemon alertmanager.smithi089 on smithi089 2024-09-13T02:55:22.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:21 smithi131 ceph-mon[34689]: pgmap v25: 65 pgs: 65 active+clean; 310 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 338 op/s 2024-09-13T02:55:22.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:21 smithi131 ceph-mon[34689]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:55:22.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:21 smithi089 ceph-mon[27639]: Reconfiguring alertmanager.smithi089 (dependencies changed)... 2024-09-13T02:55:22.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:21 smithi089 ceph-mon[27639]: Deploying daemon alertmanager.smithi089 on smithi089 2024-09-13T02:55:22.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:21 smithi089 ceph-mon[27639]: pgmap v25: 65 pgs: 65 active+clean; 310 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 338 op/s 2024-09-13T02:55:22.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:21 smithi089 ceph-mon[27639]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:55:24.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:23 smithi089 ceph-mon[27639]: pgmap v26: 65 pgs: 65 active+clean; 310 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 338 op/s 2024-09-13T02:55:24.183 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:23 smithi131 ceph-mon[34689]: pgmap v26: 65 pgs: 65 active+clean; 310 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 1.3 MiB/s rd, 1.3 MiB/s wr, 338 op/s 2024-09-13T02:55:26.055 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:25 smithi089 ceph-mon[27639]: pgmap v27: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 409 op/s 2024-09-13T02:55:26.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:25 smithi131 ceph-mon[34689]: pgmap v27: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 409 op/s 2024-09-13T02:55:28.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:27 smithi089 ceph-mon[27639]: pgmap v28: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 853 KiB/s rd, 866 KiB/s wr, 230 op/s 2024-09-13T02:55:28.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:27 smithi131 ceph-mon[34689]: pgmap v28: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 853 KiB/s rd, 866 KiB/s wr, 230 op/s 2024-09-13T02:55:30.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:29 smithi089 ceph-mon[27639]: pgmap v29: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 859 KiB/s rd, 872 KiB/s wr, 234 op/s 2024-09-13T02:55:30.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:29 smithi089 ceph-mon[27639]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' 2024-09-13T02:55:30.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:29 smithi089 ceph-mon[27639]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' 2024-09-13T02:55:30.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:29 smithi089 ceph-mon[27639]: Reconfiguring grafana.smithi089 (dependencies changed)... 2024-09-13T02:55:30.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:29 smithi089 ceph-mon[27639]: Reconfiguring daemon grafana.smithi089 on smithi089 2024-09-13T02:55:30.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:29 smithi131 ceph-mon[34689]: pgmap v29: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 859 KiB/s rd, 872 KiB/s wr, 234 op/s 2024-09-13T02:55:30.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:29 smithi131 ceph-mon[34689]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' 2024-09-13T02:55:30.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:29 smithi131 ceph-mon[34689]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' 2024-09-13T02:55:30.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:29 smithi131 ceph-mon[34689]: Reconfiguring grafana.smithi089 (dependencies changed)... 2024-09-13T02:55:30.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:29 smithi131 ceph-mon[34689]: Reconfiguring daemon grafana.smithi089 on smithi089 2024-09-13T02:55:32.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:31 smithi089 ceph-mon[27639]: pgmap v30: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 303 KiB/s rd, 232 KiB/s wr, 74 op/s 2024-09-13T02:55:32.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:31 smithi131 ceph-mon[34689]: pgmap v30: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 303 KiB/s rd, 232 KiB/s wr, 74 op/s 2024-09-13T02:55:34.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:33 smithi089 ceph-mon[27639]: pgmap v31: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 303 KiB/s rd, 232 KiB/s wr, 74 op/s 2024-09-13T02:55:34.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:33 smithi089 ceph-mon[27639]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' 2024-09-13T02:55:34.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:33 smithi089 ceph-mon[27639]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' 2024-09-13T02:55:34.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:33 smithi131 ceph-mon[34689]: pgmap v31: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 303 KiB/s rd, 232 KiB/s wr, 74 op/s 2024-09-13T02:55:34.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:33 smithi131 ceph-mon[34689]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' 2024-09-13T02:55:34.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:33 smithi131 ceph-mon[34689]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' 2024-09-13T02:55:35.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:34 smithi089 ceph-mon[27639]: Reconfiguring prometheus.smithi089 (dependencies changed)... 2024-09-13T02:55:35.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:34 smithi089 ceph-mon[27639]: Deploying daemon prometheus.smithi089 on smithi089 2024-09-13T02:55:35.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:34 smithi131 ceph-mon[34689]: Reconfiguring prometheus.smithi089 (dependencies changed)... 2024-09-13T02:55:35.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:34 smithi131 ceph-mon[34689]: Deploying daemon prometheus.smithi089 on smithi089 2024-09-13T02:55:36.020 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:35 smithi089 ceph-mon[27639]: pgmap v32: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 304 KiB/s rd, 232 KiB/s wr, 76 op/s 2024-09-13T02:55:36.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:35 smithi131 ceph-mon[34689]: pgmap v32: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 304 KiB/s rd, 232 KiB/s wr, 76 op/s 2024-09-13T02:55:36.971 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:36 smithi089 ceph-mon[27639]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:55:37.183 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:36 smithi131 ceph-mon[34689]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:55:37.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:37 smithi089 ceph-mon[27639]: pgmap v33: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 7.5 KiB/s rd, 6.3 KiB/s wr, 5 op/s 2024-09-13T02:55:38.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:37 smithi131 ceph-mon[34689]: pgmap v33: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 7.5 KiB/s rd, 6.3 KiB/s wr, 5 op/s 2024-09-13T02:55:40.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:39 smithi089 ceph-mon[27639]: pgmap v34: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 8.3 KiB/s rd, 6.3 KiB/s wr, 7 op/s 2024-09-13T02:55:40.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:39 smithi089 ceph-mon[27639]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' 2024-09-13T02:55:40.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:39 smithi089 ceph-mon[27639]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' 2024-09-13T02:55:40.115 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:39 smithi131 ceph-mon[34689]: pgmap v34: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 8.3 KiB/s rd, 6.3 KiB/s wr, 7 op/s 2024-09-13T02:55:40.115 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:39 smithi131 ceph-mon[34689]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' 2024-09-13T02:55:40.115 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:39 smithi131 ceph-mon[34689]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' 2024-09-13T02:55:40.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:40 smithi131 ceph-mon[34689]: Reconfiguring node-exporter.smithi131 (dependencies changed)... 2024-09-13T02:55:40.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:40 smithi131 ceph-mon[34689]: Deploying daemon node-exporter.smithi131 on smithi131 2024-09-13T02:55:41.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:40 smithi089 ceph-mon[27639]: Reconfiguring node-exporter.smithi131 (dependencies changed)... 2024-09-13T02:55:41.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:40 smithi089 ceph-mon[27639]: Deploying daemon node-exporter.smithi131 on smithi131 2024-09-13T02:55:42.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:41 smithi089 ceph-mon[27639]: pgmap v35: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.8 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-13T02:55:42.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:41 smithi089 ceph-mon[27639]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' 2024-09-13T02:55:42.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:41 smithi089 ceph-mon[27639]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' 2024-09-13T02:55:42.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:41 smithi089 ceph-mon[27639]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-13T02:55:42.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:41 smithi089 ceph-mon[27639]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-13T02:55:42.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:41 smithi089 ceph-mon[27639]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T02:55:42.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:41 smithi089 ceph-mon[27639]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:55:42.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:41 smithi131 ceph-mon[34689]: pgmap v35: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.8 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-13T02:55:42.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:41 smithi131 ceph-mon[34689]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' 2024-09-13T02:55:42.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:41 smithi131 ceph-mon[34689]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' 2024-09-13T02:55:42.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:41 smithi131 ceph-mon[34689]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-13T02:55:42.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:41 smithi131 ceph-mon[34689]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-13T02:55:42.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:41 smithi131 ceph-mon[34689]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T02:55:42.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:41 smithi131 ceph-mon[34689]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:55:42.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:42 smithi131 ceph-mon[34689]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-13T02:55:42.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:42 smithi131 ceph-mon[34689]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-13T02:55:42.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:42 smithi131 ceph-mon[34689]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T02:55:42.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:42 smithi131 ceph-mon[34689]: Upgrade: Need to upgrade myself (mgr.smithi131.aunbqd) 2024-09-13T02:55:42.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:42 smithi131 ceph-mon[34689]: Upgrade: Need to upgrade myself (mgr.smithi131.aunbqd) 2024-09-13T02:55:43.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:42 smithi089 ceph-mon[27639]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-09-13T02:55:43.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:42 smithi089 ceph-mon[27639]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-13T02:55:43.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:42 smithi089 ceph-mon[27639]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T02:55:43.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:42 smithi089 ceph-mon[27639]: Upgrade: Need to upgrade myself (mgr.smithi131.aunbqd) 2024-09-13T02:55:43.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:42 smithi089 ceph-mon[27639]: Upgrade: Need to upgrade myself (mgr.smithi131.aunbqd) 2024-09-13T02:55:44.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:43 smithi089 ceph-mon[27639]: pgmap v36: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.8 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-13T02:55:44.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:43 smithi089 ceph-mon[27639]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' 2024-09-13T02:55:44.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:43 smithi089 ceph-mon[27639]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi089.guohvs", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T02:55:44.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:43 smithi089 ceph-mon[27639]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T02:55:44.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:43 smithi089 ceph-mon[27639]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:55:44.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:43 smithi131 ceph-mon[34689]: pgmap v36: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.8 KiB/s rd, 255 B/s wr, 3 op/s 2024-09-13T02:55:44.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:43 smithi131 ceph-mon[34689]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' 2024-09-13T02:55:44.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:43 smithi131 ceph-mon[34689]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi089.guohvs", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T02:55:44.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:43 smithi131 ceph-mon[34689]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T02:55:44.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:43 smithi131 ceph-mon[34689]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:55:44.947 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:44 smithi089 ceph-mon[27639]: Upgrade: Updating mgr.smithi089.guohvs 2024-09-13T02:55:44.948 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:44 smithi089 ceph-mon[27639]: Deploying daemon mgr.smithi089.guohvs on smithi089 2024-09-13T02:55:45.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:44 smithi131 ceph-mon[34689]: Upgrade: Updating mgr.smithi089.guohvs 2024-09-13T02:55:45.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:44 smithi131 ceph-mon[34689]: Deploying daemon mgr.smithi089.guohvs on smithi089 2024-09-13T02:55:46.177 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:45 smithi089 ceph-mon[27639]: pgmap v37: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-13T02:55:46.183 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:45 smithi131 ceph-mon[34689]: pgmap v37: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.7 KiB/s rd, 426 B/s wr, 5 op/s 2024-09-13T02:55:47.987 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:47 smithi089 ceph-mon[27639]: pgmap v38: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-13T02:55:47.987 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:47 smithi089 ceph-mon[27639]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' 2024-09-13T02:55:47.987 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:47 smithi089 ceph-mon[27639]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' 2024-09-13T02:55:47.987 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:47 smithi089 ceph-mon[27639]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:55:47.987 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:47 smithi089 ceph-mon[27639]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' 2024-09-13T02:55:47.987 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:47 smithi089 ceph-mon[27639]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' 2024-09-13T02:55:48.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:47 smithi131 ceph-mon[34689]: pgmap v38: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 170 B/s wr, 3 op/s 2024-09-13T02:55:48.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:47 smithi131 ceph-mon[34689]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' 2024-09-13T02:55:48.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:47 smithi131 ceph-mon[34689]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' 2024-09-13T02:55:48.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:47 smithi131 ceph-mon[34689]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:55:48.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:47 smithi131 ceph-mon[34689]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' 2024-09-13T02:55:48.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:47 smithi131 ceph-mon[34689]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' 2024-09-13T02:55:49.960 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:49.956+0000 7fc326c8e640 1 -- 172.21.15.89:0/2885052451 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc3200fc700 msgr2=0x7fc3200fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:49.960 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:49.956+0000 7fc326c8e640 1 --2- 172.21.15.89:0/2885052451 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc3200fc700 0x7fc3200fcb70 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fc30c0048d0 tx=0x7fc30c009da0 comp rx=0 tx=0).stop 2024-09-13T02:55:49.960 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:49.956+0000 7fc326c8e640 1 -- 172.21.15.89:0/2885052451 shutdown_connections 2024-09-13T02:55:49.960 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:49.956+0000 7fc326c8e640 1 --2- 172.21.15.89:0/2885052451 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc3200fc700 0x7fc3200fcb70 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:49.960 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:49.956+0000 7fc326c8e640 1 --2- 172.21.15.89:0/2885052451 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc3200fb430 0x7fc3200fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:49.960 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:49.956+0000 7fc326c8e640 1 -- 172.21.15.89:0/2885052451 >> 172.21.15.89:0/2885052451 conn(0x7fc3200f6c10 msgr2=0x7fc3200f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:55:49.960 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:49.956+0000 7fc326c8e640 1 -- 172.21.15.89:0/2885052451 shutdown_connections 2024-09-13T02:55:49.960 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:49.956+0000 7fc326c8e640 1 -- 172.21.15.89:0/2885052451 wait complete. 2024-09-13T02:55:49.960 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:49.956+0000 7fc326c8e640 1 Processor -- start 2024-09-13T02:55:49.960 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:49.957+0000 7fc326c8e640 1 -- start start 2024-09-13T02:55:49.961 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:49.957+0000 7fc326c8e640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc3200fb430 0x7fc32010d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:49.961 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:49.957+0000 7fc326c8e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc3200fc700 0x7fc32010d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:49.961 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:49.957+0000 7fc326c8e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc32010dc10 con 0x7fc3200fc700 2024-09-13T02:55:49.961 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:49.957+0000 7fc326c8e640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc32010e430 con 0x7fc3200fb430 2024-09-13T02:55:49.961 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:49.957+0000 7fc31ffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc3200fc700 0x7fc32010d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:49.961 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:49.957+0000 7fc31ffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc3200fc700 0x7fc32010d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:54404/0 (socket says 172.21.15.89:54404) 2024-09-13T02:55:49.961 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:49.957+0000 7fc31ffff640 1 -- 172.21.15.89:0/496867790 learned_addr learned my addr 172.21.15.89:0/496867790 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:55:49.961 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:49.957+0000 7fc324a2a640 1 --2- 172.21.15.89:0/496867790 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc3200fb430 0x7fc32010d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:49.961 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:49.957+0000 7fc31ffff640 1 -- 172.21.15.89:0/496867790 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc3200fb430 msgr2=0x7fc32010d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:49.961 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:49.957+0000 7fc31ffff640 1 --2- 172.21.15.89:0/496867790 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc3200fb430 0x7fc32010d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:49.961 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:49.957+0000 7fc31ffff640 1 -- 172.21.15.89:0/496867790 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc30c005040 con 0x7fc3200fc700 2024-09-13T02:55:49.961 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:49.958+0000 7fc31ffff640 1 --2- 172.21.15.89:0/496867790 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc3200fc700 0x7fc32010d5c0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fc30c0048a0 tx=0x7fc30c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:55:49.963 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:49.958+0000 7fc31d7fa640 1 -- 172.21.15.89:0/496867790 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc30c038070 con 0x7fc3200fc700 2024-09-13T02:55:49.963 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:49.958+0000 7fc31d7fa640 1 -- 172.21.15.89:0/496867790 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc30c004290 con 0x7fc3200fc700 2024-09-13T02:55:49.963 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:49.958+0000 7fc326c8e640 1 -- 172.21.15.89:0/496867790 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc32010e660 con 0x7fc3200fc700 2024-09-13T02:55:49.963 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:49.958+0000 7fc326c8e640 1 -- 172.21.15.89:0/496867790 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc32010ec00 con 0x7fc3200fc700 2024-09-13T02:55:49.963 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:49.958+0000 7fc31d7fa640 1 -- 172.21.15.89:0/496867790 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc30c033660 con 0x7fc3200fc700 2024-09-13T02:55:49.963 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:49.959+0000 7fc326c8e640 1 -- 172.21.15.89:0/496867790 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3200fa890 con 0x7fc3200fc700 2024-09-13T02:55:49.963 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:49.959+0000 7fc31d7fa640 1 -- 172.21.15.89:0/496867790 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7fc30c030020 con 0x7fc3200fc700 2024-09-13T02:55:49.963 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:49.960+0000 7fc31d7fa640 1 --2- 172.21.15.89:0/496867790 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7fc31006e6e0 0x7fc310070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:49.963 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:49.960+0000 7fc31d7fa640 1 -- 172.21.15.89:0/496867790 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fc30c0adf60 con 0x7fc3200fc700 2024-09-13T02:55:49.963 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:49.960+0000 7fc324a2a640 1 --2- 172.21.15.89:0/496867790 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7fc31006e6e0 0x7fc310070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:49.963 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:49.961+0000 7fc324a2a640 1 --2- 172.21.15.89:0/496867790 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7fc31006e6e0 0x7fc310070b90 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc314009af0 tx=0x7fc31400b040 comp rx=0 tx=0).ready entity=mgr.24393 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:55:49.966 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:49.964+0000 7fc31d7fa640 1 -- 172.21.15.89:0/496867790 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fc30c0e2670 con 0x7fc3200fc700 2024-09-13T02:55:50.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:49 smithi089 ceph-mon[27639]: pgmap v39: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-09-13T02:55:50.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:49 smithi089 ceph-mon[27639]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' 2024-09-13T02:55:50.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:49 smithi089 ceph-mon[27639]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' 2024-09-13T02:55:50.170 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.168+0000 7fc326c8e640 1 -- 172.21.15.89:0/496867790 --> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc320103f60 con 0x7fc31006e6e0 2024-09-13T02:55:50.171 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.169+0000 7fc31d7fa640 1 -- 172.21.15.89:0/496867790 <== mgr.24393 v2:172.21.15.131:6828/2180703853 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+328 (secure 0 0 0) 0x7fc320103f60 con 0x7fc31006e6e0 2024-09-13T02:55:50.174 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.171+0000 7fc326c8e640 1 -- 172.21.15.89:0/496867790 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7fc31006e6e0 msgr2=0x7fc310070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:50.174 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.171+0000 7fc326c8e640 1 --2- 172.21.15.89:0/496867790 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7fc31006e6e0 0x7fc310070b90 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fc314009af0 tx=0x7fc31400b040 comp rx=0 tx=0).stop 2024-09-13T02:55:50.174 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.171+0000 7fc326c8e640 1 -- 172.21.15.89:0/496867790 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc3200fc700 msgr2=0x7fc32010d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:50.174 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.171+0000 7fc326c8e640 1 --2- 172.21.15.89:0/496867790 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc3200fc700 0x7fc32010d5c0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fc30c0048a0 tx=0x7fc30c009da0 comp rx=0 tx=0).stop 2024-09-13T02:55:50.174 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.172+0000 7fc326c8e640 1 -- 172.21.15.89:0/496867790 shutdown_connections 2024-09-13T02:55:50.174 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.172+0000 7fc326c8e640 1 --2- 172.21.15.89:0/496867790 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7fc31006e6e0 0x7fc310070b90 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:50.174 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.172+0000 7fc326c8e640 1 --2- 172.21.15.89:0/496867790 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc3200fc700 0x7fc32010d5c0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:50.174 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.172+0000 7fc326c8e640 1 --2- 172.21.15.89:0/496867790 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc3200fb430 0x7fc32010d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:50.175 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.172+0000 7fc326c8e640 1 -- 172.21.15.89:0/496867790 >> 172.21.15.89:0/496867790 conn(0x7fc3200f6c10 msgr2=0x7fc320065600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:55:50.175 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.172+0000 7fc326c8e640 1 -- 172.21.15.89:0/496867790 shutdown_connections 2024-09-13T02:55:50.175 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.172+0000 7fc326c8e640 1 -- 172.21.15.89:0/496867790 wait complete. 2024-09-13T02:55:50.183 INFO:teuthology.orchestra.run.smithi089.stdout:true 2024-09-13T02:55:50.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:49 smithi131 ceph-mon[34689]: pgmap v39: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-09-13T02:55:50.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:49 smithi131 ceph-mon[34689]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' 2024-09-13T02:55:50.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:49 smithi131 ceph-mon[34689]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' 2024-09-13T02:55:50.257 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.253+0000 7fa6887ca640 1 -- 172.21.15.89:0/1685362772 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6800fd7f0 msgr2=0x7fa6800fdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:50.257 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.253+0000 7fa6887ca640 1 --2- 172.21.15.89:0/1685362772 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6800fd7f0 0x7fa6800fdc60 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fa67c0048d0 tx=0x7fa67c009da0 comp rx=0 tx=0).stop 2024-09-13T02:55:50.257 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.254+0000 7fa6887ca640 1 -- 172.21.15.89:0/1685362772 shutdown_connections 2024-09-13T02:55:50.257 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.254+0000 7fa6887ca640 1 --2- 172.21.15.89:0/1685362772 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6800fd7f0 0x7fa6800fdc60 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:50.257 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.254+0000 7fa6887ca640 1 --2- 172.21.15.89:0/1685362772 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6800fc520 0x7fa6800fc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:50.257 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.254+0000 7fa6887ca640 1 -- 172.21.15.89:0/1685362772 >> 172.21.15.89:0/1685362772 conn(0x7fa6800f7ce0 msgr2=0x7fa6800fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:55:50.257 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.254+0000 7fa6887ca640 1 -- 172.21.15.89:0/1685362772 shutdown_connections 2024-09-13T02:55:50.257 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.254+0000 7fa6887ca640 1 -- 172.21.15.89:0/1685362772 wait complete. 2024-09-13T02:55:50.257 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.254+0000 7fa6887ca640 1 Processor -- start 2024-09-13T02:55:50.257 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.254+0000 7fa6887ca640 1 -- start start 2024-09-13T02:55:50.258 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.255+0000 7fa6887ca640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6800fc520 0x7fa68010d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:50.259 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.255+0000 7fa6887ca640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6800fd7f0 0x7fa68010d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:50.259 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.255+0000 7fa6887ca640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa68010dbf0 con 0x7fa6800fd7f0 2024-09-13T02:55:50.259 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.255+0000 7fa6887ca640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa68010e410 con 0x7fa6800fc520 2024-09-13T02:55:50.259 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.255+0000 7fa685d65640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6800fd7f0 0x7fa68010d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:50.259 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.255+0000 7fa686566640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6800fc520 0x7fa68010d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:50.259 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.255+0000 7fa686566640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6800fc520 0x7fa68010d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.89:53152/0 (socket says 172.21.15.89:53152) 2024-09-13T02:55:50.259 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.255+0000 7fa685d65640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6800fd7f0 0x7fa68010d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:54414/0 (socket says 172.21.15.89:54414) 2024-09-13T02:55:50.259 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.255+0000 7fa686566640 1 -- 172.21.15.89:0/39716624 learned_addr learned my addr 172.21.15.89:0/39716624 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:55:50.259 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.255+0000 7fa686566640 1 -- 172.21.15.89:0/39716624 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6800fd7f0 msgr2=0x7fa68010d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:50.259 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.255+0000 7fa686566640 1 --2- 172.21.15.89:0/39716624 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6800fd7f0 0x7fa68010d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:50.259 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.255+0000 7fa686566640 1 -- 172.21.15.89:0/39716624 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa67c005040 con 0x7fa6800fc520 2024-09-13T02:55:50.259 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.256+0000 7fa686566640 1 --2- 172.21.15.89:0/39716624 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6800fc520 0x7fa68010d060 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa67000c810 tx=0x7fa6700043c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:55:50.260 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.256+0000 7fa676ffd640 1 -- 172.21.15.89:0/39716624 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa67000a7a0 con 0x7fa6800fc520 2024-09-13T02:55:50.260 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.256+0000 7fa676ffd640 1 -- 172.21.15.89:0/39716624 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa67000ada0 con 0x7fa6800fc520 2024-09-13T02:55:50.260 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.256+0000 7fa6887ca640 1 -- 172.21.15.89:0/39716624 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa68010e6a0 con 0x7fa6800fc520 2024-09-13T02:55:50.260 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.256+0000 7fa6887ca640 1 -- 172.21.15.89:0/39716624 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa68010ec40 con 0x7fa6800fc520 2024-09-13T02:55:50.260 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.256+0000 7fa676ffd640 1 -- 172.21.15.89:0/39716624 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa670011380 con 0x7fa6800fc520 2024-09-13T02:55:50.261 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.257+0000 7fa6887ca640 1 -- 172.21.15.89:0/39716624 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6800fb980 con 0x7fa6800fc520 2024-09-13T02:55:50.261 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.258+0000 7fa676ffd640 1 -- 172.21.15.89:0/39716624 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7fa6700115f0 con 0x7fa6800fc520 2024-09-13T02:55:50.261 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.258+0000 7fa676ffd640 1 --2- 172.21.15.89:0/39716624 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7fa66c06e6e0 0x7fa66c070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:50.261 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.258+0000 7fa676ffd640 1 -- 172.21.15.89:0/39716624 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fa67008e380 con 0x7fa6800fc520 2024-09-13T02:55:50.261 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.258+0000 7fa685d65640 1 --2- 172.21.15.89:0/39716624 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7fa66c06e6e0 0x7fa66c070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:50.261 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.259+0000 7fa685d65640 1 --2- 172.21.15.89:0/39716624 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7fa66c06e6e0 0x7fa66c070b90 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fa68010ce10 tx=0x7fa67c035040 comp rx=0 tx=0).ready entity=mgr.24393 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:55:50.265 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.263+0000 7fa676ffd640 1 -- 172.21.15.89:0/39716624 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fa670057c90 con 0x7fa6800fc520 2024-09-13T02:55:50.456 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.453+0000 7fa6887ca640 1 -- 172.21.15.89:0/39716624 --> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa68010f020 con 0x7fa66c06e6e0 2024-09-13T02:55:50.457 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.455+0000 7fa676ffd640 1 -- 172.21.15.89:0/39716624 <== mgr.24393 v2:172.21.15.131:6828/2180703853 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+328 (secure 0 0 0) 0x7fa68010f020 con 0x7fa66c06e6e0 2024-09-13T02:55:50.459 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.457+0000 7fa6887ca640 1 -- 172.21.15.89:0/39716624 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7fa66c06e6e0 msgr2=0x7fa66c070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:50.459 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.457+0000 7fa6887ca640 1 --2- 172.21.15.89:0/39716624 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7fa66c06e6e0 0x7fa66c070b90 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fa68010ce10 tx=0x7fa67c035040 comp rx=0 tx=0).stop 2024-09-13T02:55:50.459 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.457+0000 7fa6887ca640 1 -- 172.21.15.89:0/39716624 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6800fc520 msgr2=0x7fa68010d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:50.459 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.457+0000 7fa6887ca640 1 --2- 172.21.15.89:0/39716624 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6800fc520 0x7fa68010d060 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa67000c810 tx=0x7fa6700043c0 comp rx=0 tx=0).stop 2024-09-13T02:55:50.459 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.457+0000 7fa6887ca640 1 -- 172.21.15.89:0/39716624 shutdown_connections 2024-09-13T02:55:50.459 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.457+0000 7fa6887ca640 1 --2- 172.21.15.89:0/39716624 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7fa66c06e6e0 0x7fa66c070b90 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:50.460 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.457+0000 7fa6887ca640 1 --2- 172.21.15.89:0/39716624 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6800fd7f0 0x7fa68010d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:50.460 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.457+0000 7fa6887ca640 1 --2- 172.21.15.89:0/39716624 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6800fc520 0x7fa68010d060 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:50.460 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.457+0000 7fa6887ca640 1 -- 172.21.15.89:0/39716624 >> 172.21.15.89:0/39716624 conn(0x7fa6800f7ce0 msgr2=0x7fa6800f94b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:55:50.460 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.457+0000 7fa6887ca640 1 -- 172.21.15.89:0/39716624 shutdown_connections 2024-09-13T02:55:50.460 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.457+0000 7fa6887ca640 1 -- 172.21.15.89:0/39716624 wait complete. 2024-09-13T02:55:50.544 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.541+0000 7f647cb21640 1 -- 172.21.15.89:0/3151648979 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f64780fb420 msgr2=0x7f64780fb830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:50.544 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.541+0000 7f647cb21640 1 --2- 172.21.15.89:0/3151648979 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f64780fb420 0x7f64780fb830 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f64680048d0 tx=0x7f6468009da0 comp rx=0 tx=0).stop 2024-09-13T02:55:50.544 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.541+0000 7f647cb21640 1 -- 172.21.15.89:0/3151648979 shutdown_connections 2024-09-13T02:55:50.544 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.541+0000 7f647cb21640 1 --2- 172.21.15.89:0/3151648979 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f64780fc6f0 0x7f64780fcb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:50.544 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.541+0000 7f647cb21640 1 --2- 172.21.15.89:0/3151648979 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f64780fb420 0x7f64780fb830 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:50.544 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.541+0000 7f647cb21640 1 -- 172.21.15.89:0/3151648979 >> 172.21.15.89:0/3151648979 conn(0x7f64780f6c00 msgr2=0x7f64780f9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:55:50.545 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.541+0000 7f647cb21640 1 -- 172.21.15.89:0/3151648979 shutdown_connections 2024-09-13T02:55:50.545 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.541+0000 7f647cb21640 1 -- 172.21.15.89:0/3151648979 wait complete. 2024-09-13T02:55:50.545 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.541+0000 7f647cb21640 1 Processor -- start 2024-09-13T02:55:50.545 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.541+0000 7f647cb21640 1 -- start start 2024-09-13T02:55:50.545 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.542+0000 7f647cb21640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f64780fb420 0x7f647810fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:50.545 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.542+0000 7f647cb21640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f64780fc6f0 0x7f6478112300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:50.545 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.542+0000 7f647cb21640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64780664f0 con 0x7f64780fc6f0 2024-09-13T02:55:50.545 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.542+0000 7f647cb21640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6478066660 con 0x7f64780fb420 2024-09-13T02:55:50.545 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.542+0000 7f6475d9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f64780fc6f0 0x7f6478112300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:50.545 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.542+0000 7f6475d9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f64780fc6f0 0x7f6478112300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:54432/0 (socket says 172.21.15.89:54432) 2024-09-13T02:55:50.545 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.542+0000 7f6475d9b640 1 -- 172.21.15.89:0/2954878236 learned_addr learned my addr 172.21.15.89:0/2954878236 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:55:50.545 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.542+0000 7f647659c640 1 --2- 172.21.15.89:0/2954878236 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f64780fb420 0x7f647810fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:50.546 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.542+0000 7f6475d9b640 1 -- 172.21.15.89:0/2954878236 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f64780fb420 msgr2=0x7f647810fdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:50.547 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.542+0000 7f6475d9b640 1 --2- 172.21.15.89:0/2954878236 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f64780fb420 0x7f647810fdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:50.547 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.542+0000 7f6475d9b640 1 -- 172.21.15.89:0/2954878236 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6468005040 con 0x7f64780fc6f0 2024-09-13T02:55:50.547 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.542+0000 7f6475d9b640 1 --2- 172.21.15.89:0/2954878236 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f64780fc6f0 0x7f6478112300 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f646c002a50 tx=0x7f646c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:55:50.547 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.542+0000 7f6466ffd640 1 -- 172.21.15.89:0/2954878236 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f646c007c30 con 0x7f64780fc6f0 2024-09-13T02:55:50.547 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.543+0000 7f6466ffd640 1 -- 172.21.15.89:0/2954878236 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f646c00f040 con 0x7f64780fc6f0 2024-09-13T02:55:50.547 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.543+0000 7f647cb21640 1 -- 172.21.15.89:0/2954878236 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64781128a0 con 0x7f64780fc6f0 2024-09-13T02:55:50.547 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.543+0000 7f6466ffd640 1 -- 172.21.15.89:0/2954878236 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f646c00da10 con 0x7f64780fc6f0 2024-09-13T02:55:50.547 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.543+0000 7f647cb21640 1 -- 172.21.15.89:0/2954878236 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6478112e10 con 0x7f64780fc6f0 2024-09-13T02:55:50.547 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.544+0000 7f647cb21640 1 -- 172.21.15.89:0/2954878236 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64780fa880 con 0x7f64780fc6f0 2024-09-13T02:55:50.547 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.544+0000 7f6466ffd640 1 -- 172.21.15.89:0/2954878236 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7f646c00dc80 con 0x7f64780fc6f0 2024-09-13T02:55:50.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.545+0000 7f6466ffd640 1 --2- 172.21.15.89:0/2954878236 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7f646006e6e0 0x7f6460070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:50.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.545+0000 7f6466ffd640 1 -- 172.21.15.89:0/2954878236 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f646c08d6c0 con 0x7f64780fc6f0 2024-09-13T02:55:50.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.545+0000 7f647659c640 1 --2- 172.21.15.89:0/2954878236 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7f646006e6e0 0x7f6460070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:50.548 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.546+0000 7f647659c640 1 --2- 172.21.15.89:0/2954878236 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7f646006e6e0 0x7f6460070b90 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6468000c00 tx=0x7f6468035040 comp rx=0 tx=0).ready entity=mgr.24393 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:55:50.555 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.552+0000 7f6466ffd640 1 -- 172.21.15.89:0/2954878236 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f646c04f670 con 0x7f64780fc6f0 2024-09-13T02:55:50.738 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.736+0000 7f647cb21640 1 -- 172.21.15.89:0/2954878236 --> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f6478100b00 con 0x7f646006e6e0 2024-09-13T02:55:50.746 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.744+0000 7f6466ffd640 1 -- 172.21.15.89:0/2954878236 <== mgr.24393 v2:172.21.15.131:6828/2180703853 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f6478100b00 con 0x7f646006e6e0 2024-09-13T02:55:50.747 INFO:teuthology.orchestra.run.smithi089.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T02:55:50.747 INFO:teuthology.orchestra.run.smithi089.stdout:alertmanager.smithi089 smithi089 *:9093,9094 starting - - - - 2024-09-13T02:55:50.747 INFO:teuthology.orchestra.run.smithi089.stdout:crash.smithi089 smithi089 running (9m) 62s ago 9m 6895k - 17.2.7-1627-gbbdadfa3 a994b00deb3a e8994cd5600e 2024-09-13T02:55:50.747 INFO:teuthology.orchestra.run.smithi089.stdout:crash.smithi131 smithi131 running (8m) 1s ago 8m 6895k - 17.2.7-1627-gbbdadfa3 a994b00deb3a dcbb0a9d5261 2024-09-13T02:55:50.747 INFO:teuthology.orchestra.run.smithi089.stdout:grafana.smithi089 smithi089 *:3000 starting - - - - 2024-09-13T02:55:50.747 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi089.qjoitb smithi089 running (4m) 62s ago 4m 98.3M - 17.2.7-1627-gbbdadfa3 a994b00deb3a ff9b59ec5107 2024-09-13T02:55:50.747 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi089.rarddb smithi089 running (3m) 62s ago 3m 176M - 17.2.7-1627-gbbdadfa3 a994b00deb3a db2dc502c1ba 2024-09-13T02:55:50.747 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi131.rbovzc smithi131 running (3m) 1s ago 3m 59.9M - 17.2.7-1627-gbbdadfa3 a994b00deb3a d071b6d99537 2024-09-13T02:55:50.747 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi131.uasrkg smithi131 running (4m) 1s ago 4m 112M - 17.2.7-1627-gbbdadfa3 a994b00deb3a 0b3d4ffa6ce5 2024-09-13T02:55:50.747 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.smithi089.guohvs smithi089 *:8443,9283,8765 starting - - - - 2024-09-13T02:55:50.747 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.smithi131.aunbqd smithi131 *:8443,9283 running (83s) 1s ago 8m 503M - 19.1.1-322-g7741f7f9 19dc8d659727 fbb86845e934 2024-09-13T02:55:50.748 INFO:teuthology.orchestra.run.smithi089.stdout:mon.smithi089 smithi089 running (10m) 62s ago 10m 51.0M 2048M 17.2.7-1627-gbbdadfa3 a994b00deb3a d2f18141b2af 2024-09-13T02:55:50.748 INFO:teuthology.orchestra.run.smithi089.stdout:mon.smithi131 smithi131 running (8m) 1s ago 8m 39.4M 2048M 17.2.7-1627-gbbdadfa3 a994b00deb3a 1191e59dc7a0 2024-09-13T02:55:50.748 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.smithi089 smithi089 *:9100 starting - - - - 2024-09-13T02:55:50.748 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.smithi131 smithi131 *:9100 running (9s) 1s ago 8m 3657k - 1.5.0 0da6a335fe13 bcfde5d1a508 2024-09-13T02:55:50.748 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0 smithi089 running (7m) 62s ago 7m 206M 1557M 17.2.7-1627-gbbdadfa3 a994b00deb3a b9404e2bc82c 2024-09-13T02:55:50.748 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1 smithi089 running (7m) 62s ago 7m 216M 1557M 17.2.7-1627-gbbdadfa3 a994b00deb3a af6538730e42 2024-09-13T02:55:50.748 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2 smithi089 running (6m) 62s ago 6m 179M 1557M 17.2.7-1627-gbbdadfa3 a994b00deb3a 447cf103114b 2024-09-13T02:55:50.748 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3 smithi131 running (6m) 1s ago 6m 264M 2581M 17.2.7-1627-gbbdadfa3 a994b00deb3a 0b80a4dea862 2024-09-13T02:55:50.748 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4 smithi131 running (5m) 1s ago 5m 234M 2581M 17.2.7-1627-gbbdadfa3 a994b00deb3a 06ec44680b00 2024-09-13T02:55:50.748 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5 smithi131 running (5m) 1s ago 5m 230M 2581M 17.2.7-1627-gbbdadfa3 a994b00deb3a ace4b45e5873 2024-09-13T02:55:50.748 INFO:teuthology.orchestra.run.smithi089.stdout:prometheus.smithi089 smithi089 *:9095 starting - - - - 2024-09-13T02:55:50.749 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.746+0000 7f647cb21640 1 -- 172.21.15.89:0/2954878236 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7f646006e6e0 msgr2=0x7f6460070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:50.749 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.746+0000 7f647cb21640 1 --2- 172.21.15.89:0/2954878236 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7f646006e6e0 0x7f6460070b90 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f6468000c00 tx=0x7f6468035040 comp rx=0 tx=0).stop 2024-09-13T02:55:50.749 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.746+0000 7f647cb21640 1 -- 172.21.15.89:0/2954878236 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f64780fc6f0 msgr2=0x7f6478112300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:50.749 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.746+0000 7f647cb21640 1 --2- 172.21.15.89:0/2954878236 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f64780fc6f0 0x7f6478112300 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f646c002a50 tx=0x7f646c004600 comp rx=0 tx=0).stop 2024-09-13T02:55:50.749 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.746+0000 7f647cb21640 1 -- 172.21.15.89:0/2954878236 shutdown_connections 2024-09-13T02:55:50.749 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.746+0000 7f647cb21640 1 --2- 172.21.15.89:0/2954878236 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7f646006e6e0 0x7f6460070b90 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:50.749 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.746+0000 7f647cb21640 1 --2- 172.21.15.89:0/2954878236 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f64780fc6f0 0x7f6478112300 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:50.749 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.746+0000 7f647cb21640 1 --2- 172.21.15.89:0/2954878236 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f64780fb420 0x7f647810fdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:50.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.746+0000 7f647cb21640 1 -- 172.21.15.89:0/2954878236 >> 172.21.15.89:0/2954878236 conn(0x7f64780f6c00 msgr2=0x7f64780f83a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:55:50.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.747+0000 7f647cb21640 1 -- 172.21.15.89:0/2954878236 shutdown_connections 2024-09-13T02:55:50.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.747+0000 7f647cb21640 1 -- 172.21.15.89:0/2954878236 wait complete. 2024-09-13T02:55:50.832 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.829+0000 7f871fc34640 1 -- 172.21.15.89:0/146589611 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f87180ff720 msgr2=0x7f8718101b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:50.832 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.829+0000 7f871fc34640 1 --2- 172.21.15.89:0/146589611 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f87180ff720 0x7f8718101b00 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f87080048d0 tx=0x7f8708009da0 comp rx=0 tx=0).stop 2024-09-13T02:55:50.832 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.829+0000 7f871fc34640 1 -- 172.21.15.89:0/146589611 shutdown_connections 2024-09-13T02:55:50.832 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.829+0000 7f871fc34640 1 --2- 172.21.15.89:0/146589611 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f87180ff720 0x7f8718101b00 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:50.832 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.829+0000 7f871fc34640 1 --2- 172.21.15.89:0/146589611 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8718065ba0 0x7f87180ff1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:50.832 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.829+0000 7f871fc34640 1 -- 172.21.15.89:0/146589611 >> 172.21.15.89:0/146589611 conn(0x7f87180f6c10 msgr2=0x7f87180f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:55:50.832 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.829+0000 7f871fc34640 1 -- 172.21.15.89:0/146589611 shutdown_connections 2024-09-13T02:55:50.832 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.829+0000 7f871fc34640 1 -- 172.21.15.89:0/146589611 wait complete. 2024-09-13T02:55:50.834 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.830+0000 7f871fc34640 1 Processor -- start 2024-09-13T02:55:50.834 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.830+0000 7f871fc34640 1 -- start start 2024-09-13T02:55:50.834 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.830+0000 7f871fc34640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8718065ba0 0x7f87180fcbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:50.834 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.830+0000 7f871fc34640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f87180ff720 0x7f87180fb0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:50.834 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.830+0000 7f871fc34640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87180fb670 con 0x7f8718065ba0 2024-09-13T02:55:50.834 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.830+0000 7f871fc34640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87180fb7b0 con 0x7f87180ff720 2024-09-13T02:55:50.834 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.830+0000 7f871d9d0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8718065ba0 0x7f87180fcbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:50.834 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.830+0000 7f871d1cf640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f87180ff720 0x7f87180fb0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:50.834 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.830+0000 7f871d9d0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8718065ba0 0x7f87180fcbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:54448/0 (socket says 172.21.15.89:54448) 2024-09-13T02:55:50.835 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.830+0000 7f871d9d0640 1 -- 172.21.15.89:0/1490453230 learned_addr learned my addr 172.21.15.89:0/1490453230 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:55:50.835 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.831+0000 7f871d9d0640 1 -- 172.21.15.89:0/1490453230 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f87180ff720 msgr2=0x7f87180fb0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:50.835 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.831+0000 7f871d9d0640 1 --2- 172.21.15.89:0/1490453230 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f87180ff720 0x7f87180fb0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:50.835 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.831+0000 7f871d9d0640 1 -- 172.21.15.89:0/1490453230 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8708005040 con 0x7f8718065ba0 2024-09-13T02:55:50.835 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.831+0000 7f871d9d0640 1 --2- 172.21.15.89:0/1490453230 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8718065ba0 0x7f87180fcbf0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f8714002840 tx=0x7f8714004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:55:50.835 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.831+0000 7f870e7fc640 1 -- 172.21.15.89:0/1490453230 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8714007c30 con 0x7f8718065ba0 2024-09-13T02:55:50.835 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.831+0000 7f870e7fc640 1 -- 172.21.15.89:0/1490453230 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f871400f040 con 0x7f8718065ba0 2024-09-13T02:55:50.835 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.831+0000 7f871fc34640 1 -- 172.21.15.89:0/1490453230 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87180fba90 con 0x7f8718065ba0 2024-09-13T02:55:50.835 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.831+0000 7f870e7fc640 1 -- 172.21.15.89:0/1490453230 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f871400d990 con 0x7f8718065ba0 2024-09-13T02:55:50.835 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.832+0000 7f871fc34640 1 -- 172.21.15.89:0/1490453230 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87181150f0 con 0x7f8718065ba0 2024-09-13T02:55:50.836 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.833+0000 7f871fc34640 1 -- 172.21.15.89:0/1490453230 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f871804b720 con 0x7f8718065ba0 2024-09-13T02:55:50.836 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.834+0000 7f870e7fc640 1 -- 172.21.15.89:0/1490453230 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7f8714009600 con 0x7f8718065ba0 2024-09-13T02:55:50.836 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.834+0000 7f870e7fc640 1 --2- 172.21.15.89:0/1490453230 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7f870406e6e0 0x7f8704070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:50.837 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.834+0000 7f870e7fc640 1 -- 172.21.15.89:0/1490453230 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f871408dd30 con 0x7f8718065ba0 2024-09-13T02:55:50.837 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.835+0000 7f871d1cf640 1 --2- 172.21.15.89:0/1490453230 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7f870406e6e0 0x7f8704070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:50.838 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.836+0000 7f871d1cf640 1 --2- 172.21.15.89:0/1490453230 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7f870406e6e0 0x7f8704070b90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8708000c00 tx=0x7f8708035040 comp rx=0 tx=0).ready entity=mgr.24393 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:55:50.845 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:50.843+0000 7f870e7fc640 1 -- 172.21.15.89:0/1490453230 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f87140575b0 con 0x7f8718065ba0 2024-09-13T02:55:51.093 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.090+0000 7f871fc34640 1 -- 172.21.15.89:0/1490453230 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8718115380 con 0x7f8718065ba0 2024-09-13T02:55:51.093 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.091+0000 7f870e7fc640 1 -- 172.21.15.89:0/1490453230 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+855 (secure 0 0 0) 0x7f871405ac70 con 0x7f8718065ba0 2024-09-13T02:55:51.093 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-13T02:55:51.094 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": { 2024-09-13T02:55:51.094 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 2 2024-09-13T02:55:51.094 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T02:55:51.094 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": { 2024-09-13T02:55:51.094 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 1, 2024-09-13T02:55:51.094 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 1 2024-09-13T02:55:51.094 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T02:55:51.094 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": { 2024-09-13T02:55:51.094 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 6 2024-09-13T02:55:51.094 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T02:55:51.094 INFO:teuthology.orchestra.run.smithi089.stdout: "mds": { 2024-09-13T02:55:51.094 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 4 2024-09-13T02:55:51.094 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T02:55:51.095 INFO:teuthology.orchestra.run.smithi089.stdout: "overall": { 2024-09-13T02:55:51.095 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 13, 2024-09-13T02:55:51.095 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 1 2024-09-13T02:55:51.095 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-13T02:55:51.095 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-13T02:55:51.095 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.093+0000 7f871fc34640 1 -- 172.21.15.89:0/1490453230 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7f870406e6e0 msgr2=0x7f8704070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:51.096 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.093+0000 7f871fc34640 1 --2- 172.21.15.89:0/1490453230 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7f870406e6e0 0x7f8704070b90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f8708000c00 tx=0x7f8708035040 comp rx=0 tx=0).stop 2024-09-13T02:55:51.096 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.093+0000 7f871fc34640 1 -- 172.21.15.89:0/1490453230 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8718065ba0 msgr2=0x7f87180fcbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:51.096 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.093+0000 7f871fc34640 1 --2- 172.21.15.89:0/1490453230 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8718065ba0 0x7f87180fcbf0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f8714002840 tx=0x7f8714004570 comp rx=0 tx=0).stop 2024-09-13T02:55:51.096 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.093+0000 7f871fc34640 1 -- 172.21.15.89:0/1490453230 shutdown_connections 2024-09-13T02:55:51.096 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.093+0000 7f871fc34640 1 --2- 172.21.15.89:0/1490453230 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7f870406e6e0 0x7f8704070b90 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:51.096 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.093+0000 7f871fc34640 1 --2- 172.21.15.89:0/1490453230 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f87180ff720 0x7f87180fb0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:51.096 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.093+0000 7f871fc34640 1 --2- 172.21.15.89:0/1490453230 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8718065ba0 0x7f87180fcbf0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:51.096 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.093+0000 7f871fc34640 1 -- 172.21.15.89:0/1490453230 >> 172.21.15.89:0/1490453230 conn(0x7f87180f6c10 msgr2=0x7f87180f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:55:51.096 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.093+0000 7f871fc34640 1 -- 172.21.15.89:0/1490453230 shutdown_connections 2024-09-13T02:55:51.096 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.093+0000 7f871fc34640 1 -- 172.21.15.89:0/1490453230 wait complete. 2024-09-13T02:55:51.176 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.173+0000 7f8f34720640 1 -- 172.21.15.89:0/1610909513 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f2c0fe4c0 msgr2=0x7f8f2c0fa620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:51.176 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.173+0000 7f8f34720640 1 --2- 172.21.15.89:0/1610909513 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f2c0fe4c0 0x7f8f2c0fa620 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f8f280048d0 tx=0x7f8f28009da0 comp rx=0 tx=0).stop 2024-09-13T02:55:51.176 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.174+0000 7f8f34720640 1 -- 172.21.15.89:0/1610909513 shutdown_connections 2024-09-13T02:55:51.176 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.174+0000 7f8f34720640 1 --2- 172.21.15.89:0/1610909513 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f2c0fe4c0 0x7f8f2c0fa620 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:51.176 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.174+0000 7f8f34720640 1 --2- 172.21.15.89:0/1610909513 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8f2c0fdb70 0x7f8f2c0fdf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:51.177 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.174+0000 7f8f34720640 1 -- 172.21.15.89:0/1610909513 >> 172.21.15.89:0/1610909513 conn(0x7f8f2c0f6390 msgr2=0x7f8f2c0f87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:55:51.177 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.174+0000 7f8f34720640 1 -- 172.21.15.89:0/1610909513 shutdown_connections 2024-09-13T02:55:51.177 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.174+0000 7f8f34720640 1 -- 172.21.15.89:0/1610909513 wait complete. 2024-09-13T02:55:51.178 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.174+0000 7f8f34720640 1 Processor -- start 2024-09-13T02:55:51.178 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.174+0000 7f8f34720640 1 -- start start 2024-09-13T02:55:51.178 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.174+0000 7f8f34720640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8f2c0fdb70 0x7f8f2c10d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:51.178 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.174+0000 7f8f34720640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f2c0fe4c0 0x7f8f2c10d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:51.178 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.174+0000 7f8f34720640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f2c10dc30 con 0x7f8f2c0fe4c0 2024-09-13T02:55:51.179 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.174+0000 7f8f34720640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f2c10e450 con 0x7f8f2c0fdb70 2024-09-13T02:55:51.179 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.175+0000 7f8f31cbb640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f2c0fe4c0 0x7f8f2c10d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:51.179 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.175+0000 7f8f31cbb640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f2c0fe4c0 0x7f8f2c10d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:54468/0 (socket says 172.21.15.89:54468) 2024-09-13T02:55:51.179 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.175+0000 7f8f31cbb640 1 -- 172.21.15.89:0/2236294650 learned_addr learned my addr 172.21.15.89:0/2236294650 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:55:51.179 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.175+0000 7f8f324bc640 1 --2- 172.21.15.89:0/2236294650 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8f2c0fdb70 0x7f8f2c10d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:51.179 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.175+0000 7f8f31cbb640 1 -- 172.21.15.89:0/2236294650 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8f2c0fdb70 msgr2=0x7f8f2c10d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:51.179 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.175+0000 7f8f31cbb640 1 --2- 172.21.15.89:0/2236294650 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8f2c0fdb70 0x7f8f2c10d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:51.179 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.175+0000 7f8f31cbb640 1 -- 172.21.15.89:0/2236294650 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f28005040 con 0x7f8f2c0fe4c0 2024-09-13T02:55:51.179 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.175+0000 7f8f31cbb640 1 --2- 172.21.15.89:0/2236294650 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f2c0fe4c0 0x7f8f2c10d5e0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f8f280043d0 tx=0x7f8f28009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:55:51.179 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.175+0000 7f8f22ffd640 1 -- 172.21.15.89:0/2236294650 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f28038070 con 0x7f8f2c0fe4c0 2024-09-13T02:55:51.179 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.175+0000 7f8f34720640 1 -- 172.21.15.89:0/2236294650 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f2c10e680 con 0x7f8f2c0fe4c0 2024-09-13T02:55:51.179 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.175+0000 7f8f22ffd640 1 -- 172.21.15.89:0/2236294650 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f8f2802ae90 con 0x7f8f2c0fe4c0 2024-09-13T02:55:51.179 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.175+0000 7f8f22ffd640 1 -- 172.21.15.89:0/2236294650 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f2803e670 con 0x7f8f2c0fe4c0 2024-09-13T02:55:51.179 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.175+0000 7f8f34720640 1 -- 172.21.15.89:0/2236294650 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f2c10ec20 con 0x7f8f2c0fe4c0 2024-09-13T02:55:51.180 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.176+0000 7f8f34720640 1 -- 172.21.15.89:0/2236294650 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f2c0fa010 con 0x7f8f2c0fe4c0 2024-09-13T02:55:51.180 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.177+0000 7f8f22ffd640 1 -- 172.21.15.89:0/2236294650 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7f8f28030020 con 0x7f8f2c0fe4c0 2024-09-13T02:55:51.180 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.177+0000 7f8f22ffd640 1 --2- 172.21.15.89:0/2236294650 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7f8f1806e6e0 0x7f8f18070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:51.180 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.178+0000 7f8f22ffd640 1 -- 172.21.15.89:0/2236294650 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f8f280ae070 con 0x7f8f2c0fe4c0 2024-09-13T02:55:51.181 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.178+0000 7f8f324bc640 1 --2- 172.21.15.89:0/2236294650 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7f8f1806e6e0 0x7f8f18070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:51.181 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.178+0000 7f8f324bc640 1 --2- 172.21.15.89:0/2236294650 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7f8f1806e6e0 0x7f8f18070b90 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c007fd0 tx=0x7f8f1c009e90 comp rx=0 tx=0).ready entity=mgr.24393 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:55:51.184 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.182+0000 7f8f22ffd640 1 -- 172.21.15.89:0/2236294650 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f8f28077a00 con 0x7f8f2c0fe4c0 2024-09-13T02:55:51.396 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.393+0000 7f8f34720640 1 -- 172.21.15.89:0/2236294650 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f8f2c104f70 con 0x7f8f2c0fe4c0 2024-09-13T02:55:51.396 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.394+0000 7f8f22ffd640 1 -- 172.21.15.89:0/2236294650 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1864 (secure 0 0 0) 0x7f8f2807b0c0 con 0x7f8f2c0fe4c0 2024-09-13T02:55:51.396 INFO:teuthology.orchestra.run.smithi089.stdout:e21 2024-09-13T02:55:51.397 INFO:teuthology.orchestra.run.smithi089.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T02:55:51.397 INFO:teuthology.orchestra.run.smithi089.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:55:51.397 INFO:teuthology.orchestra.run.smithi089.stdout:legacy client fscid: 1 2024-09-13T02:55:51.397 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:55:51.397 INFO:teuthology.orchestra.run.smithi089.stdout:Filesystem 'cephfs' (1) 2024-09-13T02:55:51.397 INFO:teuthology.orchestra.run.smithi089.stdout:fs_name cephfs 2024-09-13T02:55:51.397 INFO:teuthology.orchestra.run.smithi089.stdout:epoch 21 2024-09-13T02:55:51.397 INFO:teuthology.orchestra.run.smithi089.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T02:55:51.397 INFO:teuthology.orchestra.run.smithi089.stdout:created 2024-09-13T02:51:40.657817+0000 2024-09-13T02:55:51.397 INFO:teuthology.orchestra.run.smithi089.stdout:modified 2024-09-13T02:54:05.118633+0000 2024-09-13T02:55:51.397 INFO:teuthology.orchestra.run.smithi089.stdout:tableserver 0 2024-09-13T02:55:51.397 INFO:teuthology.orchestra.run.smithi089.stdout:root 0 2024-09-13T02:55:51.397 INFO:teuthology.orchestra.run.smithi089.stdout:session_timeout 60 2024-09-13T02:55:51.398 INFO:teuthology.orchestra.run.smithi089.stdout:session_autoclose 300 2024-09-13T02:55:51.398 INFO:teuthology.orchestra.run.smithi089.stdout:max_file_size 1099511627776 2024-09-13T02:55:51.398 INFO:teuthology.orchestra.run.smithi089.stdout:required_client_features {} 2024-09-13T02:55:51.398 INFO:teuthology.orchestra.run.smithi089.stdout:last_failure 0 2024-09-13T02:55:51.398 INFO:teuthology.orchestra.run.smithi089.stdout:last_failure_osd_epoch 44 2024-09-13T02:55:51.398 INFO:teuthology.orchestra.run.smithi089.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:55:51.398 INFO:teuthology.orchestra.run.smithi089.stdout:max_mds 2 2024-09-13T02:55:51.398 INFO:teuthology.orchestra.run.smithi089.stdout:in 0,1 2024-09-13T02:55:51.398 INFO:teuthology.orchestra.run.smithi089.stdout:up {0=14480,1=24257} 2024-09-13T02:55:51.398 INFO:teuthology.orchestra.run.smithi089.stdout:failed 2024-09-13T02:55:51.398 INFO:teuthology.orchestra.run.smithi089.stdout:damaged 2024-09-13T02:55:51.398 INFO:teuthology.orchestra.run.smithi089.stdout:stopped 2024-09-13T02:55:51.398 INFO:teuthology.orchestra.run.smithi089.stdout:data_pools [3] 2024-09-13T02:55:51.398 INFO:teuthology.orchestra.run.smithi089.stdout:metadata_pool 2 2024-09-13T02:55:51.399 INFO:teuthology.orchestra.run.smithi089.stdout:inline_data disabled 2024-09-13T02:55:51.399 INFO:teuthology.orchestra.run.smithi089.stdout:balancer 2024-09-13T02:55:51.399 INFO:teuthology.orchestra.run.smithi089.stdout:standby_count_wanted 1 2024-09-13T02:55:51.399 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi089.rarddb{0:14480} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.89:6828/1561365213,v1:172.21.15.89:6829/1561365213] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:55:51.399 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi089.qjoitb{0:14488} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.89:6826/1464393547,v1:172.21.15.89:6827/1464393547] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:55:51.399 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi131.uasrkg{1:24257} state up:active seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.131:6824/260493836,v1:172.21.15.131:6825/260493836] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:55:51.399 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi131.rbovzc{1:24265} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.131:6826/665579373,v1:172.21.15.131:6827/665579373] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:55:51.399 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:55:51.399 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:55:51.400 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 21 2024-09-13T02:55:51.400 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.396+0000 7f8f34720640 1 -- 172.21.15.89:0/2236294650 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7f8f1806e6e0 msgr2=0x7f8f18070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:51.400 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.396+0000 7f8f34720640 1 --2- 172.21.15.89:0/2236294650 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7f8f1806e6e0 0x7f8f18070b90 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c007fd0 tx=0x7f8f1c009e90 comp rx=0 tx=0).stop 2024-09-13T02:55:51.400 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.396+0000 7f8f34720640 1 -- 172.21.15.89:0/2236294650 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f2c0fe4c0 msgr2=0x7f8f2c10d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:51.400 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.396+0000 7f8f34720640 1 --2- 172.21.15.89:0/2236294650 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f2c0fe4c0 0x7f8f2c10d5e0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f8f280043d0 tx=0x7f8f28009da0 comp rx=0 tx=0).stop 2024-09-13T02:55:51.400 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.396+0000 7f8f34720640 1 -- 172.21.15.89:0/2236294650 shutdown_connections 2024-09-13T02:55:51.401 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.396+0000 7f8f34720640 1 --2- 172.21.15.89:0/2236294650 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7f8f1806e6e0 0x7f8f18070b90 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:51.401 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.396+0000 7f8f34720640 1 --2- 172.21.15.89:0/2236294650 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f2c0fe4c0 0x7f8f2c10d5e0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:51.401 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.396+0000 7f8f34720640 1 --2- 172.21.15.89:0/2236294650 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8f2c0fdb70 0x7f8f2c10d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:51.401 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.396+0000 7f8f34720640 1 -- 172.21.15.89:0/2236294650 >> 172.21.15.89:0/2236294650 conn(0x7f8f2c0f6390 msgr2=0x7f8f2c0f7b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:55:51.401 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.396+0000 7f8f34720640 1 -- 172.21.15.89:0/2236294650 shutdown_connections 2024-09-13T02:55:51.401 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.396+0000 7f8f34720640 1 -- 172.21.15.89:0/2236294650 wait complete. 2024-09-13T02:55:51.482 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.479+0000 7f8121044640 1 -- 172.21.15.89:0/3538646530 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f811c065c40 msgr2=0x7f811c0ff140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:51.482 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.479+0000 7f8121044640 1 --2- 172.21.15.89:0/3538646530 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f811c065c40 0x7f811c0ff140 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f810c0048d0 tx=0x7f810c009da0 comp rx=0 tx=0).stop 2024-09-13T02:55:51.482 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.479+0000 7f8121044640 1 -- 172.21.15.89:0/3538646530 shutdown_connections 2024-09-13T02:55:51.482 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.479+0000 7f8121044640 1 --2- 172.21.15.89:0/3538646530 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f811c0ff680 0x7f811c101a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:51.482 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.479+0000 7f8121044640 1 --2- 172.21.15.89:0/3538646530 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f811c065c40 0x7f811c0ff140 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:51.482 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.479+0000 7f8121044640 1 -- 172.21.15.89:0/3538646530 >> 172.21.15.89:0/3538646530 conn(0x7f811c0f6c10 msgr2=0x7f811c0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:55:51.482 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.479+0000 7f8121044640 1 -- 172.21.15.89:0/3538646530 shutdown_connections 2024-09-13T02:55:51.482 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.479+0000 7f8121044640 1 -- 172.21.15.89:0/3538646530 wait complete. 2024-09-13T02:55:51.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.480+0000 7f8121044640 1 Processor -- start 2024-09-13T02:55:51.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.480+0000 7f8121044640 1 -- start start 2024-09-13T02:55:51.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.480+0000 7f8121044640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f811c065c40 0x7f811c10d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:51.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.480+0000 7f8121044640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f811c0ff680 0x7f811c10d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:51.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.480+0000 7f8121044640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f811c10dca0 con 0x7f811c065c40 2024-09-13T02:55:51.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.480+0000 7f8121044640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f811c10e400 con 0x7f811c0ff680 2024-09-13T02:55:51.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.480+0000 7f811ad9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f811c065c40 0x7f811c10d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:51.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.480+0000 7f811ad9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f811c065c40 0x7f811c10d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:33450/0 (socket says 172.21.15.89:33450) 2024-09-13T02:55:51.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.480+0000 7f811ad9d640 1 -- 172.21.15.89:0/264844380 learned_addr learned my addr 172.21.15.89:0/264844380 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:55:51.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.481+0000 7f811a59c640 1 --2- 172.21.15.89:0/264844380 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f811c0ff680 0x7f811c10d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:51.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.481+0000 7f811ad9d640 1 -- 172.21.15.89:0/264844380 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f811c0ff680 msgr2=0x7f811c10d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:51.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.481+0000 7f811ad9d640 1 --2- 172.21.15.89:0/264844380 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f811c0ff680 0x7f811c10d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:51.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.481+0000 7f811ad9d640 1 -- 172.21.15.89:0/264844380 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f810c005040 con 0x7f811c065c40 2024-09-13T02:55:51.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.481+0000 7f811ad9d640 1 --2- 172.21.15.89:0/264844380 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f811c065c40 0x7f811c10d110 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f810c0043d0 tx=0x7f810c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:55:51.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.481+0000 7f81037fe640 1 -- 172.21.15.89:0/264844380 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f810c038070 con 0x7f811c065c40 2024-09-13T02:55:51.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.481+0000 7f81037fe640 1 -- 172.21.15.89:0/264844380 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f810c02ae90 con 0x7f811c065c40 2024-09-13T02:55:51.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.481+0000 7f8121044640 1 -- 172.21.15.89:0/264844380 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f811c10e630 con 0x7f811c065c40 2024-09-13T02:55:51.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.481+0000 7f81037fe640 1 -- 172.21.15.89:0/264844380 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f810c03e670 con 0x7f811c065c40 2024-09-13T02:55:51.485 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.481+0000 7f8121044640 1 -- 172.21.15.89:0/264844380 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f811c10ebd0 con 0x7f811c065c40 2024-09-13T02:55:51.486 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.482+0000 7f8121044640 1 -- 172.21.15.89:0/264844380 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f811c0fa890 con 0x7f811c065c40 2024-09-13T02:55:51.486 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.483+0000 7f81037fe640 1 -- 172.21.15.89:0/264844380 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7f810c030020 con 0x7f811c065c40 2024-09-13T02:55:51.486 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.483+0000 7f81037fe640 1 --2- 172.21.15.89:0/264844380 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7f810406e6e0 0x7f8104070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:51.486 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.483+0000 7f81037fe640 1 -- 172.21.15.89:0/264844380 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7f810c0adf10 con 0x7f811c065c40 2024-09-13T02:55:51.486 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.484+0000 7f811a59c640 1 --2- 172.21.15.89:0/264844380 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7f810406e6e0 0x7f8104070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:51.487 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.484+0000 7f811a59c640 1 --2- 172.21.15.89:0/264844380 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7f810406e6e0 0x7f8104070b90 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f811c10cec0 tx=0x7f811000b040 comp rx=0 tx=0).ready entity=mgr.24393 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:55:51.489 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.487+0000 7f81037fe640 1 -- 172.21.15.89:0/264844380 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f810c077a90 con 0x7f811c065c40 2024-09-13T02:55:51.680 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.678+0000 7f8121044640 1 -- 172.21.15.89:0/264844380 --> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f811c10eff0 con 0x7f810406e6e0 2024-09-13T02:55:51.682 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.679+0000 7f81037fe640 1 -- 172.21.15.89:0/264844380 <== mgr.24393 v2:172.21.15.131:6828/2180703853 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+328 (secure 0 0 0) 0x7f811c10eff0 con 0x7f810406e6e0 2024-09-13T02:55:51.682 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-13T02:55:51.682 INFO:teuthology.orchestra.run.smithi089.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d", 2024-09-13T02:55:51.682 INFO:teuthology.orchestra.run.smithi089.stdout: "in_progress": true, 2024-09-13T02:55:51.682 INFO:teuthology.orchestra.run.smithi089.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T02:55:51.683 INFO:teuthology.orchestra.run.smithi089.stdout: "services_complete": [], 2024-09-13T02:55:51.683 INFO:teuthology.orchestra.run.smithi089.stdout: "progress": "", 2024-09-13T02:55:51.683 INFO:teuthology.orchestra.run.smithi089.stdout: "message": "Currently upgrading mgr daemons", 2024-09-13T02:55:51.683 INFO:teuthology.orchestra.run.smithi089.stdout: "is_paused": false 2024-09-13T02:55:51.683 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-13T02:55:51.685 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.682+0000 7f8121044640 1 -- 172.21.15.89:0/264844380 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7f810406e6e0 msgr2=0x7f8104070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:51.685 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.682+0000 7f8121044640 1 --2- 172.21.15.89:0/264844380 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7f810406e6e0 0x7f8104070b90 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f811c10cec0 tx=0x7f811000b040 comp rx=0 tx=0).stop 2024-09-13T02:55:51.685 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.682+0000 7f8121044640 1 -- 172.21.15.89:0/264844380 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f811c065c40 msgr2=0x7f811c10d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:51.685 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.682+0000 7f8121044640 1 --2- 172.21.15.89:0/264844380 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f811c065c40 0x7f811c10d110 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f810c0043d0 tx=0x7f810c009da0 comp rx=0 tx=0).stop 2024-09-13T02:55:51.685 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.682+0000 7f8121044640 1 -- 172.21.15.89:0/264844380 shutdown_connections 2024-09-13T02:55:51.685 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.682+0000 7f8121044640 1 --2- 172.21.15.89:0/264844380 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7f810406e6e0 0x7f8104070b90 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:51.685 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.682+0000 7f8121044640 1 --2- 172.21.15.89:0/264844380 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f811c0ff680 0x7f811c10d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:51.685 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.682+0000 7f8121044640 1 --2- 172.21.15.89:0/264844380 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f811c065c40 0x7f811c10d110 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:51.685 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.682+0000 7f8121044640 1 -- 172.21.15.89:0/264844380 >> 172.21.15.89:0/264844380 conn(0x7f811c0f6c10 msgr2=0x7f811c0f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:55:51.685 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.682+0000 7f8121044640 1 -- 172.21.15.89:0/264844380 shutdown_connections 2024-09-13T02:55:51.685 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.682+0000 7f8121044640 1 -- 172.21.15.89:0/264844380 wait complete. 2024-09-13T02:55:51.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.766+0000 7fb817b70640 1 -- 172.21.15.89:0/3749947320 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8100fd840 msgr2=0x7fb8100fdcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:51.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.766+0000 7fb817b70640 1 --2- 172.21.15.89:0/3749947320 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8100fd840 0x7fb8100fdcb0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fb8000048d0 tx=0x7fb800009da0 comp rx=0 tx=0).stop 2024-09-13T02:55:51.769 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.766+0000 7fb817b70640 1 -- 172.21.15.89:0/3749947320 shutdown_connections 2024-09-13T02:55:51.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.766+0000 7fb817b70640 1 --2- 172.21.15.89:0/3749947320 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8100fd840 0x7fb8100fdcb0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:51.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.766+0000 7fb817b70640 1 --2- 172.21.15.89:0/3749947320 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb8100fc570 0x7fb8100fc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:51.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.766+0000 7fb817b70640 1 -- 172.21.15.89:0/3749947320 >> 172.21.15.89:0/3749947320 conn(0x7fb8100f7d30 msgr2=0x7fb8100fa160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:55:51.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.766+0000 7fb817b70640 1 -- 172.21.15.89:0/3749947320 shutdown_connections 2024-09-13T02:55:51.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.766+0000 7fb817b70640 1 -- 172.21.15.89:0/3749947320 wait complete. 2024-09-13T02:55:51.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.767+0000 7fb817b70640 1 Processor -- start 2024-09-13T02:55:51.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.767+0000 7fb817b70640 1 -- start start 2024-09-13T02:55:51.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.767+0000 7fb817b70640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8100fc570 0x7fb810071570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:51.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.767+0000 7fb817b70640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb8100fd840 0x7fb81006fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:51.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.767+0000 7fb817b70640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb81006fff0 con 0x7fb8100fc570 2024-09-13T02:55:51.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.767+0000 7fb817b70640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb810070130 con 0x7fb8100fd840 2024-09-13T02:55:51.771 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.767+0000 7fb81590c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8100fc570 0x7fb810071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:51.771 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.767+0000 7fb81590c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8100fc570 0x7fb810071570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:33472/0 (socket says 172.21.15.89:33472) 2024-09-13T02:55:51.771 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.767+0000 7fb81590c640 1 -- 172.21.15.89:0/1274084675 learned_addr learned my addr 172.21.15.89:0/1274084675 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:55:51.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.768+0000 7fb81510b640 1 --2- 172.21.15.89:0/1274084675 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb8100fd840 0x7fb81006fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:51.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.768+0000 7fb81590c640 1 -- 172.21.15.89:0/1274084675 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb8100fd840 msgr2=0x7fb81006fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:51.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.768+0000 7fb81590c640 1 --2- 172.21.15.89:0/1274084675 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb8100fd840 0x7fb81006fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:51.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.768+0000 7fb81590c640 1 -- 172.21.15.89:0/1274084675 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb800005040 con 0x7fb8100fc570 2024-09-13T02:55:51.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.768+0000 7fb81590c640 1 --2- 172.21.15.89:0/1274084675 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8100fc570 0x7fb810071570 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fb80c00c790 tx=0x7fb80c0043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:55:51.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.768+0000 7fb8067fc640 1 -- 172.21.15.89:0/1274084675 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb80c00a740 con 0x7fb8100fc570 2024-09-13T02:55:51.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.768+0000 7fb817b70640 1 -- 172.21.15.89:0/1274084675 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb810070410 con 0x7fb8100fc570 2024-09-13T02:55:51.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.768+0000 7fb8067fc640 1 -- 172.21.15.89:0/1274084675 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb80c00ad40 con 0x7fb8100fc570 2024-09-13T02:55:51.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.768+0000 7fb8067fc640 1 -- 172.21.15.89:0/1274084675 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb80c012ea0 con 0x7fb8100fc570 2024-09-13T02:55:51.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.768+0000 7fb817b70640 1 -- 172.21.15.89:0/1274084675 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8101150b0 con 0x7fb8100fc570 2024-09-13T02:55:51.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.769+0000 7fb817b70640 1 -- 172.21.15.89:0/1274084675 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8100fb9d0 con 0x7fb8100fc570 2024-09-13T02:55:51.773 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.770+0000 7fb8067fc640 1 -- 172.21.15.89:0/1274084675 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 25) v1 ==== 91662+0+0 (secure 0 0 0) 0x7fb80c00a8a0 con 0x7fb8100fc570 2024-09-13T02:55:51.773 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.770+0000 7fb8067fc640 1 --2- 172.21.15.89:0/1274084675 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7fb7fc06e6e0 0x7fb7fc070b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:55:51.773 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.770+0000 7fb8067fc640 1 -- 172.21.15.89:0/1274084675 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5808+0+0 (secure 0 0 0) 0x7fb80c08e3f0 con 0x7fb8100fc570 2024-09-13T02:55:51.773 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.771+0000 7fb81510b640 1 --2- 172.21.15.89:0/1274084675 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7fb7fc06e6e0 0x7fb7fc070b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:55:51.773 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.771+0000 7fb81510b640 1 --2- 172.21.15.89:0/1274084675 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7fb7fc06e6e0 0x7fb7fc070b90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb800000c00 tx=0x7fb800035040 comp rx=0 tx=0).ready entity=mgr.24393 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:55:51.777 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:51.775+0000 7fb8067fc640 1 -- 172.21.15.89:0/1274084675 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fb80c057d80 con 0x7fb8100fc570 2024-09-13T02:55:52.019 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:52.017+0000 7fb817b70640 1 -- 172.21.15.89:0/1274084675 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fb810115340 con 0x7fb8100fc570 2024-09-13T02:55:52.020 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:51 smithi089 ceph-mon[27639]: pgmap v40: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-09-13T02:55:52.020 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:51 smithi089 ceph-mon[27639]: from='client.14738 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:55:52.020 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:51 smithi089 ceph-mon[27639]: from='client.24473 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:55:52.020 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:51 smithi089 ceph-mon[27639]: from='client.14746 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:55:52.020 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:51 smithi089 ceph-mon[27639]: from='client.? 172.21.15.89:0/1490453230' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:55:52.020 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:51 smithi089 ceph-mon[27639]: from='client.? 172.21.15.89:0/2236294650' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T02:55:52.020 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:51 smithi089 ceph-mon[27639]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:55:52.020 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:52.017+0000 7fb8067fc640 1 -- 172.21.15.89:0/1274084675 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fb80c05b440 con 0x7fb8100fc570 2024-09-13T02:55:52.021 INFO:teuthology.orchestra.run.smithi089.stdout:HEALTH_OK 2024-09-13T02:55:52.022 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:52.019+0000 7fb817b70640 1 -- 172.21.15.89:0/1274084675 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7fb7fc06e6e0 msgr2=0x7fb7fc070b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:52.022 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:52.019+0000 7fb817b70640 1 --2- 172.21.15.89:0/1274084675 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7fb7fc06e6e0 0x7fb7fc070b90 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb800000c00 tx=0x7fb800035040 comp rx=0 tx=0).stop 2024-09-13T02:55:52.022 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:52.019+0000 7fb817b70640 1 -- 172.21.15.89:0/1274084675 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8100fc570 msgr2=0x7fb810071570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:55:52.022 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:52.019+0000 7fb817b70640 1 --2- 172.21.15.89:0/1274084675 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8100fc570 0x7fb810071570 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fb80c00c790 tx=0x7fb80c0043b0 comp rx=0 tx=0).stop 2024-09-13T02:55:52.022 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:52.019+0000 7fb817b70640 1 -- 172.21.15.89:0/1274084675 shutdown_connections 2024-09-13T02:55:52.022 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:52.019+0000 7fb817b70640 1 --2- 172.21.15.89:0/1274084675 >> [v2:172.21.15.131:6828/2180703853,v1:172.21.15.131:6829/2180703853] conn(0x7fb7fc06e6e0 0x7fb7fc070b90 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:52.022 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:52.019+0000 7fb817b70640 1 --2- 172.21.15.89:0/1274084675 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb8100fd840 0x7fb81006fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:52.022 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:52.019+0000 7fb817b70640 1 --2- 172.21.15.89:0/1274084675 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb8100fc570 0x7fb810071570 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:55:52.022 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:52.019+0000 7fb817b70640 1 -- 172.21.15.89:0/1274084675 >> 172.21.15.89:0/1274084675 conn(0x7fb8100f7d30 msgr2=0x7fb8100f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:55:52.022 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:52.019+0000 7fb817b70640 1 -- 172.21.15.89:0/1274084675 shutdown_connections 2024-09-13T02:55:52.022 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:55:52.019+0000 7fb817b70640 1 -- 172.21.15.89:0/1274084675 wait complete. 2024-09-13T02:55:52.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:51 smithi131 ceph-mon[34689]: pgmap v40: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-09-13T02:55:52.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:51 smithi131 ceph-mon[34689]: from='client.14738 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:55:52.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:51 smithi131 ceph-mon[34689]: from='client.24473 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:55:52.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:51 smithi131 ceph-mon[34689]: from='client.14746 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:55:52.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:51 smithi131 ceph-mon[34689]: from='client.? 172.21.15.89:0/1490453230' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:55:52.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:51 smithi131 ceph-mon[34689]: from='client.? 172.21.15.89:0/2236294650' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T02:55:52.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:51 smithi131 ceph-mon[34689]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:55:53.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:52 smithi131 ceph-mon[34689]: from='client.14758 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:55:53.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:52 smithi131 ceph-mon[34689]: Standby manager daemon smithi089.guohvs restarted 2024-09-13T02:55:53.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:52 smithi131 ceph-mon[34689]: Standby manager daemon smithi089.guohvs started 2024-09-13T02:55:53.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:52 smithi131 ceph-mon[34689]: from='mgr.? 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi089.guohvs/crt"}]: dispatch 2024-09-13T02:55:53.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:52 smithi131 ceph-mon[34689]: from='mgr.? 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T02:55:53.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:52 smithi131 ceph-mon[34689]: from='mgr.? 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi089.guohvs/key"}]: dispatch 2024-09-13T02:55:53.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:52 smithi131 ceph-mon[34689]: from='mgr.? 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T02:55:53.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:52 smithi131 ceph-mon[34689]: from='client.? 172.21.15.89:0/1274084675' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T02:55:53.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:52 smithi131 ceph-mon[34689]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' 2024-09-13T02:55:53.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:52 smithi131 ceph-mon[34689]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' 2024-09-13T02:55:53.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:52 smithi089 ceph-mon[27639]: from='client.14758 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:55:53.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:52 smithi089 ceph-mon[27639]: Standby manager daemon smithi089.guohvs restarted 2024-09-13T02:55:53.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:52 smithi089 ceph-mon[27639]: Standby manager daemon smithi089.guohvs started 2024-09-13T02:55:53.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:52 smithi089 ceph-mon[27639]: from='mgr.? 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi089.guohvs/crt"}]: dispatch 2024-09-13T02:55:53.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:52 smithi089 ceph-mon[27639]: from='mgr.? 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T02:55:53.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:52 smithi089 ceph-mon[27639]: from='mgr.? 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi089.guohvs/key"}]: dispatch 2024-09-13T02:55:53.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:52 smithi089 ceph-mon[27639]: from='mgr.? 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T02:55:53.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:52 smithi089 ceph-mon[27639]: from='client.? 172.21.15.89:0/1274084675' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T02:55:53.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:52 smithi089 ceph-mon[27639]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' 2024-09-13T02:55:53.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:52 smithi089 ceph-mon[27639]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' 2024-09-13T02:55:54.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:53 smithi089 ceph-mon[27639]: pgmap v41: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-09-13T02:55:54.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:53 smithi089 ceph-mon[27639]: mgrmap e26: smithi131.aunbqd(active, since 76s), standbys: smithi089.guohvs 2024-09-13T02:55:54.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:53 smithi089 ceph-mon[27639]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' 2024-09-13T02:55:54.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:53 smithi089 ceph-mon[27639]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' 2024-09-13T02:55:54.183 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:53 smithi131 ceph-mon[34689]: pgmap v41: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.8 KiB/s rd, 341 B/s wr, 3 op/s 2024-09-13T02:55:54.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:53 smithi131 ceph-mon[34689]: mgrmap e26: smithi131.aunbqd(active, since 76s), standbys: smithi089.guohvs 2024-09-13T02:55:54.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:53 smithi131 ceph-mon[34689]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' 2024-09-13T02:55:54.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:53 smithi131 ceph-mon[34689]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' 2024-09-13T02:55:56.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:55 smithi089 ceph-mon[27639]: pgmap v42: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-09-13T02:55:56.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:55 smithi131 ceph-mon[34689]: pgmap v42: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.7 KiB/s rd, 341 B/s wr, 5 op/s 2024-09-13T02:55:57.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:57 smithi089 ceph-mon[27639]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' 2024-09-13T02:55:57.536 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:57 smithi089 ceph-mon[27639]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' 2024-09-13T02:55:57.536 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:57 smithi089 ceph-mon[27639]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:55:57.536 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:57 smithi089 ceph-mon[27639]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:55:57.536 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:57 smithi089 ceph-mon[27639]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' 2024-09-13T02:55:57.536 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:57 smithi089 ceph-mon[27639]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:55:57.536 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:57 smithi089 ceph-mon[27639]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "mgr fail", "who": "smithi131.aunbqd"}]: dispatch 2024-09-13T02:55:57.536 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:57 smithi089 ceph-mon[27639]: Activating manager daemon smithi089.guohvs 2024-09-13T02:55:57.536 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:57 smithi089 ceph-mon[27639]: osdmap e46: 6 total, 6 up, 6 in 2024-09-13T02:55:57.536 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:57 smithi089 ceph-mon[27639]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' cmd='[{"prefix": "mgr fail", "who": "smithi131.aunbqd"}]': finished 2024-09-13T02:55:57.536 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:57 smithi089 ceph-mon[27639]: mgrmap e27: smithi089.guohvs(active, starting, since 0.0068141s) 2024-09-13T02:55:57.536 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:57 smithi089 ceph-mon[27639]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mon metadata", "id": "smithi089"}]: dispatch 2024-09-13T02:55:57.536 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:57 smithi089 ceph-mon[27639]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mon metadata", "id": "smithi131"}]: dispatch 2024-09-13T02:55:57.537 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:57 smithi089 ceph-mon[27639]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi089.rarddb"}]: dispatch 2024-09-13T02:55:57.537 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:57 smithi089 ceph-mon[27639]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi089.qjoitb"}]: dispatch 2024-09-13T02:55:57.537 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:57 smithi089 ceph-mon[27639]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi131.uasrkg"}]: dispatch 2024-09-13T02:55:57.537 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:57 smithi089 ceph-mon[27639]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi131.rbovzc"}]: dispatch 2024-09-13T02:55:57.537 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:57 smithi089 ceph-mon[27639]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mgr metadata", "who": "smithi089.guohvs", "id": "smithi089.guohvs"}]: dispatch 2024-09-13T02:55:57.537 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:57 smithi089 ceph-mon[27639]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T02:55:57.537 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:57 smithi089 ceph-mon[27639]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T02:55:57.537 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:57 smithi089 ceph-mon[27639]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T02:55:57.537 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:57 smithi089 ceph-mon[27639]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T02:55:57.537 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:57 smithi089 ceph-mon[27639]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T02:55:57.537 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:57 smithi089 ceph-mon[27639]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T02:55:57.537 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:57 smithi089 ceph-mon[27639]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T02:55:57.537 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:57 smithi089 ceph-mon[27639]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T02:55:57.538 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:57 smithi089 ceph-mon[27639]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T02:55:57.538 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:57 smithi089 ceph-mon[27639]: Manager daemon smithi089.guohvs is now available 2024-09-13T02:55:57.538 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:57 smithi089 ceph-mon[27639]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:55:57.538 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:57 smithi089 ceph-mon[27639]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:55:57.538 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:57 smithi089 ceph-mon[27639]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi089.guohvs/mirror_snapshot_schedule"}]: dispatch 2024-09-13T02:55:57.538 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:57 smithi089 ceph-mon[27639]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi089.guohvs/trash_purge_schedule"}]: dispatch 2024-09-13T02:55:57.651 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:57 smithi131 ceph-mon[34689]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' 2024-09-13T02:55:57.651 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:57 smithi131 ceph-mon[34689]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' 2024-09-13T02:55:57.651 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:57 smithi131 ceph-mon[34689]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:55:57.651 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:57 smithi131 ceph-mon[34689]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:55:57.651 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:57 smithi131 ceph-mon[34689]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' 2024-09-13T02:55:57.651 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:57 smithi131 ceph-mon[34689]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:55:57.651 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:57 smithi131 ceph-mon[34689]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "mgr fail", "who": "smithi131.aunbqd"}]: dispatch 2024-09-13T02:55:57.651 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:57 smithi131 ceph-mon[34689]: Activating manager daemon smithi089.guohvs 2024-09-13T02:55:57.652 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:57 smithi131 ceph-mon[34689]: osdmap e46: 6 total, 6 up, 6 in 2024-09-13T02:55:57.652 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:57 smithi131 ceph-mon[34689]: from='mgr.24393 172.21.15.131:0/3348465231' entity='mgr.smithi131.aunbqd' cmd='[{"prefix": "mgr fail", "who": "smithi131.aunbqd"}]': finished 2024-09-13T02:55:57.652 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:57 smithi131 ceph-mon[34689]: mgrmap e27: smithi089.guohvs(active, starting, since 0.0068141s) 2024-09-13T02:55:57.652 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:57 smithi131 ceph-mon[34689]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mon metadata", "id": "smithi089"}]: dispatch 2024-09-13T02:55:57.652 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:57 smithi131 ceph-mon[34689]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mon metadata", "id": "smithi131"}]: dispatch 2024-09-13T02:55:57.652 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:57 smithi131 ceph-mon[34689]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi089.rarddb"}]: dispatch 2024-09-13T02:55:57.652 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:57 smithi131 ceph-mon[34689]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi089.qjoitb"}]: dispatch 2024-09-13T02:55:57.652 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:57 smithi131 ceph-mon[34689]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi131.uasrkg"}]: dispatch 2024-09-13T02:55:57.652 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:57 smithi131 ceph-mon[34689]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi131.rbovzc"}]: dispatch 2024-09-13T02:55:57.652 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:57 smithi131 ceph-mon[34689]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mgr metadata", "who": "smithi089.guohvs", "id": "smithi089.guohvs"}]: dispatch 2024-09-13T02:55:57.652 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:57 smithi131 ceph-mon[34689]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T02:55:57.652 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:57 smithi131 ceph-mon[34689]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T02:55:57.652 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:57 smithi131 ceph-mon[34689]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T02:55:57.653 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:57 smithi131 ceph-mon[34689]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T02:55:57.653 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:57 smithi131 ceph-mon[34689]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T02:55:57.653 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:57 smithi131 ceph-mon[34689]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T02:55:57.653 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:57 smithi131 ceph-mon[34689]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T02:55:57.653 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:57 smithi131 ceph-mon[34689]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T02:55:57.653 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:57 smithi131 ceph-mon[34689]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T02:55:57.653 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:57 smithi131 ceph-mon[34689]: Manager daemon smithi089.guohvs is now available 2024-09-13T02:55:57.653 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:57 smithi131 ceph-mon[34689]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:55:57.653 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:57 smithi131 ceph-mon[34689]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:55:57.653 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:57 smithi131 ceph-mon[34689]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi089.guohvs/mirror_snapshot_schedule"}]: dispatch 2024-09-13T02:55:57.653 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:57 smithi131 ceph-mon[34689]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi089.guohvs/trash_purge_schedule"}]: dispatch 2024-09-13T02:55:59.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:58 smithi131 ceph-mon[34689]: mgrmap e28: smithi089.guohvs(active, since 1.20297s) 2024-09-13T02:55:59.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:58 smithi131 ceph-mon[34689]: [13/Sep/2024:02:55:58] ENGINE Bus STARTING 2024-09-13T02:55:59.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:58 smithi131 ceph-mon[34689]: [13/Sep/2024:02:55:58] ENGINE Serving on http://172.21.15.89:8765 2024-09-13T02:55:59.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:58 smithi131 ceph-mon[34689]: [13/Sep/2024:02:55:58] ENGINE Serving on https://172.21.15.89:7150 2024-09-13T02:55:59.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:58 smithi131 ceph-mon[34689]: [13/Sep/2024:02:55:58] ENGINE Bus STARTED 2024-09-13T02:55:59.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:58 smithi131 ceph-mon[34689]: [13/Sep/2024:02:55:58] ENGINE Error in HTTPServer.serve 2024-09-13T02:55:59.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: Traceback (most recent call last): 2024-09-13T02:55:59.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T02:55:59.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: self._connections.run(self.expiration_interval) 2024-09-13T02:55:59.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T02:55:59.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: self._run(expiration_interval) 2024-09-13T02:55:59.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T02:55:59.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T02:55:59.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T02:55:59.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T02:55:59.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T02:55:59.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: s = self.context.wrap_socket( 2024-09-13T02:55:59.186 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T02:55:59.186 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: return self.sslsocket_class._create( 2024-09-13T02:55:59.186 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T02:55:59.186 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: self.do_handshake() 2024-09-13T02:55:59.186 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T02:55:59.186 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: self._sslobj.do_handshake() 2024-09-13T02:55:59.186 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T02:55:59.186 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:58 smithi131 ceph-mon[34689]: pgmap v4: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:55:59.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:58 smithi089 ceph-mon[27639]: mgrmap e28: smithi089.guohvs(active, since 1.20297s) 2024-09-13T02:55:59.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:58 smithi089 ceph-mon[27639]: [13/Sep/2024:02:55:58] ENGINE Bus STARTING 2024-09-13T02:55:59.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:58 smithi089 ceph-mon[27639]: [13/Sep/2024:02:55:58] ENGINE Serving on http://172.21.15.89:8765 2024-09-13T02:55:59.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:58 smithi089 ceph-mon[27639]: [13/Sep/2024:02:55:58] ENGINE Serving on https://172.21.15.89:7150 2024-09-13T02:55:59.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:58 smithi089 ceph-mon[27639]: [13/Sep/2024:02:55:58] ENGINE Bus STARTED 2024-09-13T02:55:59.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:58 smithi089 ceph-mon[27639]: [13/Sep/2024:02:55:58] ENGINE Error in HTTPServer.serve 2024-09-13T02:55:59.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Traceback (most recent call last): 2024-09-13T02:55:59.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T02:55:59.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: self._connections.run(self.expiration_interval) 2024-09-13T02:55:59.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T02:55:59.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: self._run(expiration_interval) 2024-09-13T02:55:59.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T02:55:59.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T02:55:59.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T02:55:59.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T02:55:59.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T02:55:59.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: s = self.context.wrap_socket( 2024-09-13T02:55:59.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T02:55:59.287 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: return self.sslsocket_class._create( 2024-09-13T02:55:59.287 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T02:55:59.287 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: self.do_handshake() 2024-09-13T02:55:59.287 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T02:55:59.287 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: self._sslobj.do_handshake() 2024-09-13T02:55:59.287 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T02:55:59.287 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:58 smithi089 ceph-mon[27639]: pgmap v4: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:56:00.074 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:55:59 smithi089 ceph-mon[27639]: mgrmap e29: smithi089.guohvs(active, since 2s) 2024-09-13T02:56:00.159 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:55:59 smithi131 ceph-mon[34689]: mgrmap e29: smithi089.guohvs(active, since 2s) 2024-09-13T02:56:01.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:01 smithi089 ceph-mon[27639]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:01.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:01 smithi089 ceph-mon[27639]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:01.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:01 smithi089 ceph-mon[27639]: pgmap v5: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:56:01.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:01 smithi089 ceph-mon[27639]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:01.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:01 smithi089 ceph-mon[27639]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:01.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:01 smithi089 ceph-mon[27639]: mgrmap e30: smithi089.guohvs(active, since 4s) 2024-09-13T02:56:01.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:01 smithi131 ceph-mon[34689]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:01.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:01 smithi131 ceph-mon[34689]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:01.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:01 smithi131 ceph-mon[34689]: pgmap v5: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:56:01.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:01 smithi131 ceph-mon[34689]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:01.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:01 smithi131 ceph-mon[34689]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:01.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:01 smithi131 ceph-mon[34689]: mgrmap e30: smithi089.guohvs(active, since 4s) 2024-09-13T02:56:02.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:02 smithi131 ceph-mon[34689]: Standby manager daemon smithi131.aunbqd started 2024-09-13T02:56:02.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:02 smithi131 ceph-mon[34689]: from='mgr.? 172.21.15.131:0/1142353739' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi131.aunbqd/crt"}]: dispatch 2024-09-13T02:56:02.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:02 smithi131 ceph-mon[34689]: from='mgr.? 172.21.15.131:0/1142353739' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T02:56:02.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:02 smithi131 ceph-mon[34689]: from='mgr.? 172.21.15.131:0/1142353739' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi131.aunbqd/key"}]: dispatch 2024-09-13T02:56:02.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:02 smithi131 ceph-mon[34689]: from='mgr.? 172.21.15.131:0/1142353739' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T02:56:02.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:02 smithi089 ceph-mon[27639]: Standby manager daemon smithi131.aunbqd started 2024-09-13T02:56:02.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:02 smithi089 ceph-mon[27639]: from='mgr.? 172.21.15.131:0/1142353739' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi131.aunbqd/crt"}]: dispatch 2024-09-13T02:56:02.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:02 smithi089 ceph-mon[27639]: from='mgr.? 172.21.15.131:0/1142353739' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T02:56:02.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:02 smithi089 ceph-mon[27639]: from='mgr.? 172.21.15.131:0/1142353739' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi131.aunbqd/key"}]: dispatch 2024-09-13T02:56:02.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:02 smithi089 ceph-mon[27639]: from='mgr.? 172.21.15.131:0/1142353739' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T02:56:03.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:03 smithi131 ceph-mon[34689]: mgrmap e31: smithi089.guohvs(active, since 5s), standbys: smithi131.aunbqd 2024-09-13T02:56:03.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:03 smithi131 ceph-mon[34689]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mgr metadata", "who": "smithi131.aunbqd", "id": "smithi131.aunbqd"}]: dispatch 2024-09-13T02:56:03.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:03 smithi131 ceph-mon[34689]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:03.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:03 smithi131 ceph-mon[34689]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:03.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:03 smithi131 ceph-mon[34689]: pgmap v6: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:56:03.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:03 smithi131 ceph-mon[34689]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:03.435 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:03 smithi131 ceph-mon[34689]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:03.446 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:03 smithi089 ceph-mon[27639]: mgrmap e31: smithi089.guohvs(active, since 5s), standbys: smithi131.aunbqd 2024-09-13T02:56:03.446 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:03 smithi089 ceph-mon[27639]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mgr metadata", "who": "smithi131.aunbqd", "id": "smithi131.aunbqd"}]: dispatch 2024-09-13T02:56:03.447 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:03 smithi089 ceph-mon[27639]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:03.447 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:03 smithi089 ceph-mon[27639]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:03.447 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:03 smithi089 ceph-mon[27639]: pgmap v6: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:56:03.447 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:03 smithi089 ceph-mon[27639]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:03.447 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:03 smithi089 ceph-mon[27639]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:05.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:05 smithi131 ceph-mon[34689]: pgmap v7: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 32 KiB/s rd, 0 B/s wr, 20 op/s 2024-09-13T02:56:05.968 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:05 smithi089 ceph-mon[27639]: pgmap v7: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 32 KiB/s rd, 0 B/s wr, 20 op/s 2024-09-13T02:56:07.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:07 smithi089 ceph-mon[27639]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:07.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:07 smithi089 ceph-mon[27639]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:07.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:07 smithi089 ceph-mon[27639]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:56:07.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:07 smithi089 ceph-mon[27639]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:56:07.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:07 smithi089 ceph-mon[27639]: Updating smithi089:/etc/ceph/ceph.conf 2024-09-13T02:56:07.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:07 smithi089 ceph-mon[27639]: Updating smithi131:/etc/ceph/ceph.conf 2024-09-13T02:56:07.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:07 smithi089 ceph-mon[27639]: Updating smithi089:/var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T02:56:07.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:07 smithi089 ceph-mon[27639]: Updating smithi131:/var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T02:56:07.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:07 smithi089 ceph-mon[27639]: Updating smithi089:/etc/ceph/ceph.client.admin.keyring 2024-09-13T02:56:07.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:07 smithi089 ceph-mon[27639]: Updating smithi131:/etc/ceph/ceph.client.admin.keyring 2024-09-13T02:56:07.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:07 smithi089 ceph-mon[27639]: pgmap v8: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 25 KiB/s rd, 0 B/s wr, 15 op/s 2024-09-13T02:56:07.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:07 smithi089 ceph-mon[27639]: Updating smithi089:/var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T02:56:07.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:07 smithi089 ceph-mon[27639]: Updating smithi131:/var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T02:56:07.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:07 smithi089 ceph-mon[27639]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:07.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:07 smithi089 ceph-mon[27639]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:07.287 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:07 smithi089 ceph-mon[27639]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:07.287 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:07 smithi089 ceph-mon[27639]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:07.287 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:07 smithi089 ceph-mon[27639]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:07.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:07 smithi131 ceph-mon[34689]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:07.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:07 smithi131 ceph-mon[34689]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:07.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:07 smithi131 ceph-mon[34689]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:56:07.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:07 smithi131 ceph-mon[34689]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:56:07.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:07 smithi131 ceph-mon[34689]: Updating smithi089:/etc/ceph/ceph.conf 2024-09-13T02:56:07.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:07 smithi131 ceph-mon[34689]: Updating smithi131:/etc/ceph/ceph.conf 2024-09-13T02:56:07.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:07 smithi131 ceph-mon[34689]: Updating smithi089:/var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T02:56:07.435 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:07 smithi131 ceph-mon[34689]: Updating smithi131:/var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T02:56:07.435 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:07 smithi131 ceph-mon[34689]: Updating smithi089:/etc/ceph/ceph.client.admin.keyring 2024-09-13T02:56:07.435 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:07 smithi131 ceph-mon[34689]: Updating smithi131:/etc/ceph/ceph.client.admin.keyring 2024-09-13T02:56:07.435 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:07 smithi131 ceph-mon[34689]: pgmap v8: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 25 KiB/s rd, 0 B/s wr, 15 op/s 2024-09-13T02:56:07.435 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:07 smithi131 ceph-mon[34689]: Updating smithi089:/var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T02:56:07.435 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:07 smithi131 ceph-mon[34689]: Updating smithi131:/var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T02:56:07.435 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:07 smithi131 ceph-mon[34689]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:07.435 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:07 smithi131 ceph-mon[34689]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:07.435 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:07 smithi131 ceph-mon[34689]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:07.435 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:07 smithi131 ceph-mon[34689]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:07.435 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:07 smithi131 ceph-mon[34689]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:08.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:08 smithi089 ceph-mon[27639]: Reconfiguring prometheus.smithi089 (dependencies changed)... 2024-09-13T02:56:08.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:08 smithi089 ceph-mon[27639]: Reconfiguring daemon prometheus.smithi089 on smithi089 2024-09-13T02:56:08.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:08 smithi131 ceph-mon[34689]: Reconfiguring prometheus.smithi089 (dependencies changed)... 2024-09-13T02:56:08.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:08 smithi131 ceph-mon[34689]: Reconfiguring daemon prometheus.smithi089 on smithi089 2024-09-13T02:56:09.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:09 smithi089 ceph-mon[27639]: pgmap v9: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 21 KiB/s rd, 0 B/s wr, 14 op/s 2024-09-13T02:56:09.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:09 smithi131 ceph-mon[34689]: pgmap v9: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 21 KiB/s rd, 0 B/s wr, 14 op/s 2024-09-13T02:56:11.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:11 smithi089 ceph-mon[27639]: pgmap v10: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 13 op/s 2024-09-13T02:56:11.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:11 smithi131 ceph-mon[34689]: pgmap v10: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 13 op/s 2024-09-13T02:56:12.784 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:12 smithi131 ceph-mon[34689]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:56:12.784 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:12 smithi131 ceph-mon[34689]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:12.784 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:12 smithi131 ceph-mon[34689]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:12.784 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:12 smithi131 ceph-mon[34689]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T02:56:12.784 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:12 smithi131 ceph-mon[34689]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:56:13.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:12 smithi089 ceph-mon[27639]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:56:13.037 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:12 smithi089 ceph-mon[27639]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:13.037 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:12 smithi089 ceph-mon[27639]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:13.037 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:12 smithi089 ceph-mon[27639]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T02:56:13.037 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:12 smithi089 ceph-mon[27639]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:56:13.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:13 smithi089 ceph-mon[27639]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T02:56:13.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:13 smithi089 ceph-mon[27639]: pgmap v11: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 13 op/s 2024-09-13T02:56:13.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:13 smithi089 ceph-mon[27639]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi131.aunbqd", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T02:56:13.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:13 smithi089 ceph-mon[27639]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T02:56:13.786 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:13 smithi089 ceph-mon[27639]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:56:13.888 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:13 smithi131 ceph-mon[34689]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-09-13T02:56:13.888 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:13 smithi131 ceph-mon[34689]: pgmap v11: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 13 op/s 2024-09-13T02:56:13.888 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:13 smithi131 ceph-mon[34689]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi131.aunbqd", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T02:56:13.888 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:13 smithi131 ceph-mon[34689]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T02:56:13.889 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:13 smithi131 ceph-mon[34689]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:56:14.902 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:14 smithi131 ceph-mon[34689]: Upgrade: Updating mgr.smithi131.aunbqd 2024-09-13T02:56:14.902 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:14 smithi131 ceph-mon[34689]: Deploying daemon mgr.smithi131.aunbqd on smithi131 2024-09-13T02:56:15.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:14 smithi089 ceph-mon[27639]: Upgrade: Updating mgr.smithi131.aunbqd 2024-09-13T02:56:15.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:14 smithi089 ceph-mon[27639]: Deploying daemon mgr.smithi131.aunbqd on smithi131 2024-09-13T02:56:15.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:15 smithi131 ceph-mon[34689]: pgmap v12: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 20 KiB/s rd, 0 B/s wr, 14 op/s 2024-09-13T02:56:16.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:15 smithi089 ceph-mon[27639]: pgmap v12: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 20 KiB/s rd, 0 B/s wr, 14 op/s 2024-09-13T02:56:17.801 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:17 smithi131 ceph-mon[34689]: pgmap v13: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T02:56:17.801 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:17 smithi131 ceph-mon[34689]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:17.801 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:17 smithi131 ceph-mon[34689]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:17.801 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:17 smithi131 ceph-mon[34689]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:56:18.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:17 smithi089 ceph-mon[27639]: pgmap v13: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T02:56:18.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:17 smithi089 ceph-mon[27639]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:18.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:17 smithi089 ceph-mon[27639]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:18.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:17 smithi089 ceph-mon[27639]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:56:19.999 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:19 smithi089 ceph-mon[27639]: pgmap v14: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T02:56:20.065 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:19 smithi131 ceph-mon[34689]: pgmap v14: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T02:56:21.017 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:20 smithi131 ceph-mon[34689]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:21.017 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:20 smithi131 ceph-mon[34689]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:21.018 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:20 smithi131 ceph-mon[34689]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:21.018 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:20 smithi131 ceph-mon[34689]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:21.018 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:20 smithi131 ceph-mon[34689]: pgmap v15: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T02:56:21.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:20 smithi089 ceph-mon[27639]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:21.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:20 smithi089 ceph-mon[27639]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:21.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:20 smithi089 ceph-mon[27639]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:21.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:20 smithi089 ceph-mon[27639]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:21.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:20 smithi089 ceph-mon[27639]: pgmap v15: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T02:56:22.105 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.101+0000 7f674c954640 1 -- 172.21.15.89:0/1792435679 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67480fb450 msgr2=0x7f67480fb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:22.105 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.101+0000 7f674c954640 1 --2- 172.21.15.89:0/1792435679 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67480fb450 0x7f67480fb860 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f67380048d0 tx=0x7f6738009da0 comp rx=0 tx=0).stop 2024-09-13T02:56:22.106 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.101+0000 7f674c954640 1 -- 172.21.15.89:0/1792435679 shutdown_connections 2024-09-13T02:56:22.106 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.101+0000 7f674c954640 1 --2- 172.21.15.89:0/1792435679 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f67480fc720 0x7f67480fcb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:22.106 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.101+0000 7f674c954640 1 --2- 172.21.15.89:0/1792435679 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67480fb450 0x7f67480fb860 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:22.106 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.101+0000 7f674c954640 1 -- 172.21.15.89:0/1792435679 >> 172.21.15.89:0/1792435679 conn(0x7f67480f6c10 msgr2=0x7f67480f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:56:22.106 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.102+0000 7f674c954640 1 -- 172.21.15.89:0/1792435679 shutdown_connections 2024-09-13T02:56:22.106 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.102+0000 7f674c954640 1 -- 172.21.15.89:0/1792435679 wait complete. 2024-09-13T02:56:22.106 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.102+0000 7f674c954640 1 Processor -- start 2024-09-13T02:56:22.106 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.102+0000 7f674c954640 1 -- start start 2024-09-13T02:56:22.106 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.102+0000 7f674c954640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f67480fb450 0x7f674810fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:22.106 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.102+0000 7f674c954640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67480fc720 0x7f6748112360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:22.106 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.102+0000 7f674c954640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6748066730 con 0x7f67480fc720 2024-09-13T02:56:22.107 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.102+0000 7f674c954640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67480668a0 con 0x7f67480fb450 2024-09-13T02:56:22.107 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.102+0000 7f6745d9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67480fc720 0x7f6748112360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:22.107 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.102+0000 7f6745d9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67480fc720 0x7f6748112360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:53184/0 (socket says 172.21.15.89:53184) 2024-09-13T02:56:22.107 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.102+0000 7f6745d9b640 1 -- 172.21.15.89:0/3180626046 learned_addr learned my addr 172.21.15.89:0/3180626046 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:56:22.107 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.103+0000 7f674659c640 1 --2- 172.21.15.89:0/3180626046 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f67480fb450 0x7f674810fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:22.107 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.103+0000 7f6745d9b640 1 -- 172.21.15.89:0/3180626046 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f67480fb450 msgr2=0x7f674810fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:22.107 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.103+0000 7f6745d9b640 1 --2- 172.21.15.89:0/3180626046 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f67480fb450 0x7f674810fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:22.107 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.103+0000 7f6745d9b640 1 -- 172.21.15.89:0/3180626046 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6738005040 con 0x7f67480fc720 2024-09-13T02:56:22.107 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.103+0000 7f6745d9b640 1 --2- 172.21.15.89:0/3180626046 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67480fc720 0x7f6748112360 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f673c002a50 tx=0x7f673c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:56:22.107 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.103+0000 7f6736ffd640 1 -- 172.21.15.89:0/3180626046 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f673c007c30 con 0x7f67480fc720 2024-09-13T02:56:22.107 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.103+0000 7f6736ffd640 1 -- 172.21.15.89:0/3180626046 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f673c00f040 con 0x7f67480fc720 2024-09-13T02:56:22.107 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.103+0000 7f674c954640 1 -- 172.21.15.89:0/3180626046 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6748112900 con 0x7f67480fc720 2024-09-13T02:56:22.107 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.103+0000 7f6736ffd640 1 -- 172.21.15.89:0/3180626046 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f673c00dad0 con 0x7f67480fc720 2024-09-13T02:56:22.108 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.103+0000 7f674c954640 1 -- 172.21.15.89:0/3180626046 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6748112e70 con 0x7f67480fc720 2024-09-13T02:56:22.108 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.104+0000 7f674c954640 1 -- 172.21.15.89:0/3180626046 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67480fa8b0 con 0x7f67480fc720 2024-09-13T02:56:22.108 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.105+0000 7f6736ffd640 1 -- 172.21.15.89:0/3180626046 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 31) v1 ==== 92375+0+0 (secure 0 0 0) 0x7f673c00dc30 con 0x7f67480fc720 2024-09-13T02:56:22.109 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.105+0000 7f6736ffd640 1 --2- 172.21.15.89:0/3180626046 >> [v2:172.21.15.89:6800/4290496884,v1:172.21.15.89:6801/4290496884] conn(0x7f673006df60 0x7f6730070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:22.109 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.105+0000 7f6736ffd640 1 -- 172.21.15.89:0/3180626046 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f673c08d980 con 0x7f67480fc720 2024-09-13T02:56:22.109 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.105+0000 7f674659c640 1 --2- 172.21.15.89:0/3180626046 >> [v2:172.21.15.89:6800/4290496884,v1:172.21.15.89:6801/4290496884] conn(0x7f673006df60 0x7f6730070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:22.109 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.106+0000 7f674659c640 1 --2- 172.21.15.89:0/3180626046 >> [v2:172.21.15.89:6800/4290496884,v1:172.21.15.89:6801/4290496884] conn(0x7f673006df60 0x7f6730070410 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f6738000c00 tx=0x7f6738035040 comp rx=0 tx=0).ready entity=mgr.14734 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:56:22.111 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.109+0000 7f6736ffd640 1 -- 172.21.15.89:0/3180626046 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f673c057000 con 0x7f67480fc720 2024-09-13T02:56:22.290 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.289+0000 7f674c954640 1 -- 172.21.15.89:0/3180626046 --> [v2:172.21.15.89:6800/4290496884,v1:172.21.15.89:6801/4290496884] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6748100bd0 con 0x7f673006df60 2024-09-13T02:56:22.291 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.290+0000 7f6736ffd640 1 -- 172.21.15.89:0/3180626046 <== mgr.14734 v2:172.21.15.89:6800/4290496884 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f6748100bd0 con 0x7f673006df60 2024-09-13T02:56:22.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.292+0000 7f674c954640 1 -- 172.21.15.89:0/3180626046 >> [v2:172.21.15.89:6800/4290496884,v1:172.21.15.89:6801/4290496884] conn(0x7f673006df60 msgr2=0x7f6730070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:22.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.292+0000 7f674c954640 1 --2- 172.21.15.89:0/3180626046 >> [v2:172.21.15.89:6800/4290496884,v1:172.21.15.89:6801/4290496884] conn(0x7f673006df60 0x7f6730070410 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f6738000c00 tx=0x7f6738035040 comp rx=0 tx=0).stop 2024-09-13T02:56:22.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.292+0000 7f674c954640 1 -- 172.21.15.89:0/3180626046 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67480fc720 msgr2=0x7f6748112360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:22.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.292+0000 7f674c954640 1 --2- 172.21.15.89:0/3180626046 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67480fc720 0x7f6748112360 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f673c002a50 tx=0x7f673c004600 comp rx=0 tx=0).stop 2024-09-13T02:56:22.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.292+0000 7f674c954640 1 -- 172.21.15.89:0/3180626046 shutdown_connections 2024-09-13T02:56:22.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.292+0000 7f674c954640 1 --2- 172.21.15.89:0/3180626046 >> [v2:172.21.15.89:6800/4290496884,v1:172.21.15.89:6801/4290496884] conn(0x7f673006df60 0x7f6730070410 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:22.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.292+0000 7f674c954640 1 --2- 172.21.15.89:0/3180626046 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f67480fc720 0x7f6748112360 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:22.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.292+0000 7f674c954640 1 --2- 172.21.15.89:0/3180626046 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f67480fb450 0x7f674810fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:22.295 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.292+0000 7f674c954640 1 -- 172.21.15.89:0/3180626046 >> 172.21.15.89:0/3180626046 conn(0x7f67480f6c10 msgr2=0x7f67480f8450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:56:22.295 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.292+0000 7f674c954640 1 -- 172.21.15.89:0/3180626046 shutdown_connections 2024-09-13T02:56:22.295 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.292+0000 7f674c954640 1 -- 172.21.15.89:0/3180626046 wait complete. 2024-09-13T02:56:22.303 INFO:teuthology.orchestra.run.smithi089.stdout:true 2024-09-13T02:56:22.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.371+0000 7f1c3d794640 1 -- 172.21.15.89:0/2839219282 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1c38066730 msgr2=0x7f1c380ff160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:22.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.371+0000 7f1c3d794640 1 --2- 172.21.15.89:0/2839219282 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1c38066730 0x7f1c380ff160 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f1c280048d0 tx=0x7f1c28009da0 comp rx=0 tx=0).stop 2024-09-13T02:56:22.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.371+0000 7f1c3d794640 1 -- 172.21.15.89:0/2839219282 shutdown_connections 2024-09-13T02:56:22.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.371+0000 7f1c3d794640 1 --2- 172.21.15.89:0/2839219282 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1c380ff6a0 0x7f1c38101a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:22.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.371+0000 7f1c3d794640 1 --2- 172.21.15.89:0/2839219282 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1c38066730 0x7f1c380ff160 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:22.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.371+0000 7f1c3d794640 1 -- 172.21.15.89:0/2839219282 >> 172.21.15.89:0/2839219282 conn(0x7f1c380f6c10 msgr2=0x7f1c380f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:56:22.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.371+0000 7f1c3d794640 1 -- 172.21.15.89:0/2839219282 shutdown_connections 2024-09-13T02:56:22.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.371+0000 7f1c3d794640 1 -- 172.21.15.89:0/2839219282 wait complete. 2024-09-13T02:56:22.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.372+0000 7f1c3d794640 1 Processor -- start 2024-09-13T02:56:22.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.372+0000 7f1c3d794640 1 -- start start 2024-09-13T02:56:22.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.372+0000 7f1c3d794640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1c38066730 0x7f1c3810d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:22.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.372+0000 7f1c3d794640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1c380ff6a0 0x7f1c3810d710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:22.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.372+0000 7f1c3d794640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c3810e4e0 con 0x7f1c38066730 2024-09-13T02:56:22.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.372+0000 7f1c3d794640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c3810e650 con 0x7f1c380ff6a0 2024-09-13T02:56:22.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.372+0000 7f1c36ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1c38066730 0x7f1c3810d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:22.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.372+0000 7f1c36ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1c38066730 0x7f1c3810d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:53204/0 (socket says 172.21.15.89:53204) 2024-09-13T02:56:22.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.372+0000 7f1c36ffd640 1 -- 172.21.15.89:0/576117788 learned_addr learned my addr 172.21.15.89:0/576117788 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:56:22.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.372+0000 7f1c367fc640 1 --2- 172.21.15.89:0/576117788 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1c380ff6a0 0x7f1c3810d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:22.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.372+0000 7f1c36ffd640 1 -- 172.21.15.89:0/576117788 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1c380ff6a0 msgr2=0x7f1c3810d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:22.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.372+0000 7f1c36ffd640 1 --2- 172.21.15.89:0/576117788 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1c380ff6a0 0x7f1c3810d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:22.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.372+0000 7f1c36ffd640 1 -- 172.21.15.89:0/576117788 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c28005040 con 0x7f1c38066730 2024-09-13T02:56:22.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.372+0000 7f1c367fc640 1 --2- 172.21.15.89:0/576117788 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1c380ff6a0 0x7f1c3810d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T02:56:22.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.372+0000 7f1c36ffd640 1 --2- 172.21.15.89:0/576117788 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1c38066730 0x7f1c3810d1d0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f1c280048a0 tx=0x7f1c28009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:56:22.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.373+0000 7f1c1f7fe640 1 -- 172.21.15.89:0/576117788 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c28038070 con 0x7f1c38066730 2024-09-13T02:56:22.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.373+0000 7f1c1f7fe640 1 -- 172.21.15.89:0/576117788 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f1c2802ae90 con 0x7f1c38066730 2024-09-13T02:56:22.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.373+0000 7f1c3d794640 1 -- 172.21.15.89:0/576117788 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c3810e8d0 con 0x7f1c38066730 2024-09-13T02:56:22.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.373+0000 7f1c1f7fe640 1 -- 172.21.15.89:0/576117788 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c2802c8b0 con 0x7f1c38066730 2024-09-13T02:56:22.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.373+0000 7f1c3d794640 1 -- 172.21.15.89:0/576117788 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c3810ed90 con 0x7f1c38066730 2024-09-13T02:56:22.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.374+0000 7f1c3d794640 1 -- 172.21.15.89:0/576117788 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c381057e0 con 0x7f1c38066730 2024-09-13T02:56:22.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.374+0000 7f1c1f7fe640 1 -- 172.21.15.89:0/576117788 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 31) v1 ==== 92375+0+0 (secure 0 0 0) 0x7f1c28030020 con 0x7f1c38066730 2024-09-13T02:56:22.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.375+0000 7f1c1f7fe640 1 --2- 172.21.15.89:0/576117788 >> [v2:172.21.15.89:6800/4290496884,v1:172.21.15.89:6801/4290496884] conn(0x7f1c2006df60 0x7f1c20070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:22.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.375+0000 7f1c1f7fe640 1 -- 172.21.15.89:0/576117788 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f1c280adfd0 con 0x7f1c38066730 2024-09-13T02:56:22.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.375+0000 7f1c367fc640 1 --2- 172.21.15.89:0/576117788 >> [v2:172.21.15.89:6800/4290496884,v1:172.21.15.89:6801/4290496884] conn(0x7f1c2006df60 0x7f1c20070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:22.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.376+0000 7f1c367fc640 1 --2- 172.21.15.89:0/576117788 >> [v2:172.21.15.89:6800/4290496884,v1:172.21.15.89:6801/4290496884] conn(0x7f1c2006df60 0x7f1c20070410 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f1c2c006fd0 tx=0x7f1c2c008040 comp rx=0 tx=0).ready entity=mgr.14734 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:56:22.381 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.380+0000 7f1c1f7fe640 1 -- 172.21.15.89:0/576117788 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f1c28077880 con 0x7f1c38066730 2024-09-13T02:56:22.563 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.562+0000 7f1c3d794640 1 -- 172.21.15.89:0/576117788 --> [v2:172.21.15.89:6800/4290496884,v1:172.21.15.89:6801/4290496884] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1c3810f000 con 0x7f1c2006df60 2024-09-13T02:56:22.564 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.563+0000 7f1c1f7fe640 1 -- 172.21.15.89:0/576117788 <== mgr.14734 v2:172.21.15.89:6800/4290496884 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f1c3810f000 con 0x7f1c2006df60 2024-09-13T02:56:22.567 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.565+0000 7f1c3d794640 1 -- 172.21.15.89:0/576117788 >> [v2:172.21.15.89:6800/4290496884,v1:172.21.15.89:6801/4290496884] conn(0x7f1c2006df60 msgr2=0x7f1c20070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:22.567 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.565+0000 7f1c3d794640 1 --2- 172.21.15.89:0/576117788 >> [v2:172.21.15.89:6800/4290496884,v1:172.21.15.89:6801/4290496884] conn(0x7f1c2006df60 0x7f1c20070410 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f1c2c006fd0 tx=0x7f1c2c008040 comp rx=0 tx=0).stop 2024-09-13T02:56:22.567 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.565+0000 7f1c3d794640 1 -- 172.21.15.89:0/576117788 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1c38066730 msgr2=0x7f1c3810d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:22.567 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.565+0000 7f1c3d794640 1 --2- 172.21.15.89:0/576117788 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1c38066730 0x7f1c3810d1d0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f1c280048a0 tx=0x7f1c28009da0 comp rx=0 tx=0).stop 2024-09-13T02:56:22.568 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.565+0000 7f1c3d794640 1 -- 172.21.15.89:0/576117788 shutdown_connections 2024-09-13T02:56:22.568 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.565+0000 7f1c3d794640 1 --2- 172.21.15.89:0/576117788 >> [v2:172.21.15.89:6800/4290496884,v1:172.21.15.89:6801/4290496884] conn(0x7f1c2006df60 0x7f1c20070410 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:22.568 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.565+0000 7f1c3d794640 1 --2- 172.21.15.89:0/576117788 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1c380ff6a0 0x7f1c3810d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:22.568 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.565+0000 7f1c3d794640 1 --2- 172.21.15.89:0/576117788 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1c38066730 0x7f1c3810d1d0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:22.568 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.565+0000 7f1c3d794640 1 -- 172.21.15.89:0/576117788 >> 172.21.15.89:0/576117788 conn(0x7f1c380f6c10 msgr2=0x7f1c380f7030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:56:22.568 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.565+0000 7f1c3d794640 1 -- 172.21.15.89:0/576117788 shutdown_connections 2024-09-13T02:56:22.568 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.565+0000 7f1c3d794640 1 -- 172.21.15.89:0/576117788 wait complete. 2024-09-13T02:56:22.650 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.648+0000 7fc40b906640 1 -- 172.21.15.89:0/2021958008 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4040fc220 msgr2=0x7fc4040fa650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:22.650 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.648+0000 7fc40b906640 1 --2- 172.21.15.89:0/2021958008 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4040fc220 0x7fc4040fa650 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fc3f40048d0 tx=0x7fc3f4009da0 comp rx=0 tx=0).stop 2024-09-13T02:56:22.650 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.648+0000 7fc40b906640 1 -- 172.21.15.89:0/2021958008 shutdown_connections 2024-09-13T02:56:22.650 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.648+0000 7fc40b906640 1 --2- 172.21.15.89:0/2021958008 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4040fc220 0x7fc4040fa650 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:22.650 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.648+0000 7fc40b906640 1 --2- 172.21.15.89:0/2021958008 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc4040fb8d0 0x7fc4040fbce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:22.650 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.648+0000 7fc40b906640 1 -- 172.21.15.89:0/2021958008 >> 172.21.15.89:0/2021958008 conn(0x7fc4040f63a0 msgr2=0x7fc4040f87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:56:22.650 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:22 smithi089 ceph-mon[27639]: Standby manager daemon smithi131.aunbqd restarted 2024-09-13T02:56:22.651 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:22 smithi089 ceph-mon[27639]: Standby manager daemon smithi131.aunbqd started 2024-09-13T02:56:22.651 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:22 smithi089 ceph-mon[27639]: from='mgr.? 172.21.15.131:0/2433777374' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi131.aunbqd/crt"}]: dispatch 2024-09-13T02:56:22.651 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:22 smithi089 ceph-mon[27639]: from='mgr.? 172.21.15.131:0/2433777374' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T02:56:22.651 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:22 smithi089 ceph-mon[27639]: from='mgr.? 172.21.15.131:0/2433777374' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi131.aunbqd/key"}]: dispatch 2024-09-13T02:56:22.651 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:22 smithi089 ceph-mon[27639]: from='mgr.? 172.21.15.131:0/2433777374' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T02:56:22.651 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:22 smithi089 ceph-mon[27639]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:22.651 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:22 smithi089 ceph-mon[27639]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:22.653 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.649+0000 7fc40b906640 1 -- 172.21.15.89:0/2021958008 shutdown_connections 2024-09-13T02:56:22.653 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.649+0000 7fc40b906640 1 -- 172.21.15.89:0/2021958008 wait complete. 2024-09-13T02:56:22.653 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.649+0000 7fc40b906640 1 Processor -- start 2024-09-13T02:56:22.653 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.649+0000 7fc40b906640 1 -- start start 2024-09-13T02:56:22.653 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.649+0000 7fc40b906640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc4040fb8d0 0x7fc4041136b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:22.653 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.649+0000 7fc40b906640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4040fc220 0x7fc404113bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:22.653 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.649+0000 7fc40b906640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc404114240 con 0x7fc4040fc220 2024-09-13T02:56:22.653 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.649+0000 7fc40b906640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc404114a10 con 0x7fc4040fb8d0 2024-09-13T02:56:22.653 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.649+0000 7fc408ea1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4040fc220 0x7fc404113bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:22.653 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.649+0000 7fc408ea1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4040fc220 0x7fc404113bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:53220/0 (socket says 172.21.15.89:53220) 2024-09-13T02:56:22.654 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.649+0000 7fc408ea1640 1 -- 172.21.15.89:0/1263701634 learned_addr learned my addr 172.21.15.89:0/1263701634 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:56:22.654 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.650+0000 7fc4096a2640 1 --2- 172.21.15.89:0/1263701634 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc4040fb8d0 0x7fc4041136b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:22.654 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.650+0000 7fc408ea1640 1 -- 172.21.15.89:0/1263701634 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc4040fb8d0 msgr2=0x7fc4041136b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:22.654 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.650+0000 7fc408ea1640 1 --2- 172.21.15.89:0/1263701634 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc4040fb8d0 0x7fc4041136b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:22.654 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.650+0000 7fc408ea1640 1 -- 172.21.15.89:0/1263701634 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3f4005040 con 0x7fc4040fc220 2024-09-13T02:56:22.654 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.650+0000 7fc408ea1640 1 --2- 172.21.15.89:0/1263701634 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4040fc220 0x7fc404113bf0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fc3f40043d0 tx=0x7fc3f4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:56:22.654 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.650+0000 7fc3f9ffb640 1 -- 172.21.15.89:0/1263701634 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3f4038070 con 0x7fc4040fc220 2024-09-13T02:56:22.654 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.650+0000 7fc3f9ffb640 1 -- 172.21.15.89:0/1263701634 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc3f402ae90 con 0x7fc4040fc220 2024-09-13T02:56:22.654 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.650+0000 7fc40b906640 1 -- 172.21.15.89:0/1263701634 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc404114c40 con 0x7fc4040fc220 2024-09-13T02:56:22.654 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.650+0000 7fc3f9ffb640 1 -- 172.21.15.89:0/1263701634 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc3f403e670 con 0x7fc4040fc220 2024-09-13T02:56:22.654 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.650+0000 7fc40b906640 1 -- 172.21.15.89:0/1263701634 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4041151e0 con 0x7fc4040fc220 2024-09-13T02:56:22.654 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.652+0000 7fc40b906640 1 -- 172.21.15.89:0/1263701634 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4040fa040 con 0x7fc4040fc220 2024-09-13T02:56:22.655 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.652+0000 7fc3f9ffb640 1 -- 172.21.15.89:0/1263701634 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 32) v1 ==== 92375+0+0 (secure 0 0 0) 0x7fc3f4030020 con 0x7fc4040fc220 2024-09-13T02:56:22.655 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.652+0000 7fc3f9ffb640 1 --2- 172.21.15.89:0/1263701634 >> [v2:172.21.15.89:6800/4290496884,v1:172.21.15.89:6801/4290496884] conn(0x7fc3f006df60 0x7fc3f0070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:22.655 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.653+0000 7fc3f9ffb640 1 -- 172.21.15.89:0/1263701634 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6152+0+0 (secure 0 0 0) 0x7fc3f40adb00 con 0x7fc4040fc220 2024-09-13T02:56:22.655 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.653+0000 7fc4096a2640 1 --2- 172.21.15.89:0/1263701634 >> [v2:172.21.15.89:6800/4290496884,v1:172.21.15.89:6801/4290496884] conn(0x7fc3f006df60 0x7fc3f0070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:22.655 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.653+0000 7fc4096a2640 1 --2- 172.21.15.89:0/1263701634 >> [v2:172.21.15.89:6800/4290496884,v1:172.21.15.89:6801/4290496884] conn(0x7fc3f006df60 0x7fc3f0070410 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc400004ed0 tx=0x7fc40000b040 comp rx=0 tx=0).ready entity=mgr.14734 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:56:22.658 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.657+0000 7fc3f9ffb640 1 -- 172.21.15.89:0/1263701634 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fc3f4077460 con 0x7fc4040fc220 2024-09-13T02:56:22.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:22 smithi131 ceph-mon[34689]: Standby manager daemon smithi131.aunbqd restarted 2024-09-13T02:56:22.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:22 smithi131 ceph-mon[34689]: Standby manager daemon smithi131.aunbqd started 2024-09-13T02:56:22.685 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:22 smithi131 ceph-mon[34689]: from='mgr.? 172.21.15.131:0/2433777374' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi131.aunbqd/crt"}]: dispatch 2024-09-13T02:56:22.685 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:22 smithi131 ceph-mon[34689]: from='mgr.? 172.21.15.131:0/2433777374' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T02:56:22.685 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:22 smithi131 ceph-mon[34689]: from='mgr.? 172.21.15.131:0/2433777374' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi131.aunbqd/key"}]: dispatch 2024-09-13T02:56:22.685 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:22 smithi131 ceph-mon[34689]: from='mgr.? 172.21.15.131:0/2433777374' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T02:56:22.685 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:22 smithi131 ceph-mon[34689]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:22.685 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:22 smithi131 ceph-mon[34689]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:22.831 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.830+0000 7fc40b906640 1 -- 172.21.15.89:0/1263701634 --> [v2:172.21.15.89:6800/4290496884,v1:172.21.15.89:6801/4290496884] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc404115560 con 0x7fc3f006df60 2024-09-13T02:56:22.840 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.839+0000 7fc3f9ffb640 1 -- 172.21.15.89:0/1263701634 <== mgr.14734 v2:172.21.15.89:6800/4290496884 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fc404115560 con 0x7fc3f006df60 2024-09-13T02:56:22.840 INFO:teuthology.orchestra.run.smithi089.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T02:56:22.840 INFO:teuthology.orchestra.run.smithi089.stdout:alertmanager.smithi089 smithi089 *:9093,9094 running (54s) 0s ago 9m 15.0M - 0.25.0 c8568f914cd2 1d2432f5479e 2024-09-13T02:56:22.840 INFO:teuthology.orchestra.run.smithi089.stdout:crash.smithi089 smithi089 running (10m) 0s ago 10m 6895k - 17.2.7-1627-gbbdadfa3 a994b00deb3a e8994cd5600e 2024-09-13T02:56:22.840 INFO:teuthology.orchestra.run.smithi089.stdout:crash.smithi131 smithi131 running (9m) 2s ago 9m 6895k - 17.2.7-1627-gbbdadfa3 a994b00deb3a dcbb0a9d5261 2024-09-13T02:56:22.841 INFO:teuthology.orchestra.run.smithi089.stdout:grafana.smithi089 smithi089 *:3000 running (49s) 0s ago 9m 80.6M - 9.4.7 954c08fa6188 dee914ded1af 2024-09-13T02:56:22.841 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi089.qjoitb smithi089 running (4m) 0s ago 4m 70.2M - 17.2.7-1627-gbbdadfa3 a994b00deb3a ff9b59ec5107 2024-09-13T02:56:22.841 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi089.rarddb smithi089 running (4m) 0s ago 4m 136M - 17.2.7-1627-gbbdadfa3 a994b00deb3a db2dc502c1ba 2024-09-13T02:56:22.841 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi131.rbovzc smithi131 running (4m) 2s ago 4m 60.2M - 17.2.7-1627-gbbdadfa3 a994b00deb3a d071b6d99537 2024-09-13T02:56:22.841 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi131.uasrkg smithi131 running (4m) 2s ago 4m 112M - 17.2.7-1627-gbbdadfa3 a994b00deb3a 0b3d4ffa6ce5 2024-09-13T02:56:22.841 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.smithi089.guohvs smithi089 *:8443,9283,8765 running (36s) 0s ago 11m 488M - 19.1.1-322-g7741f7f9 19dc8d659727 1e887446f1b0 2024-09-13T02:56:22.841 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.smithi131.aunbqd smithi131 *:8443,9283,8765 running (6s) 2s ago 9m 70.7M - 19.1.1-322-g7741f7f9 19dc8d659727 358d7478f2ba 2024-09-13T02:56:22.841 INFO:teuthology.orchestra.run.smithi089.stdout:mon.smithi089 smithi089 running (11m) 0s ago 11m 55.3M 2048M 17.2.7-1627-gbbdadfa3 a994b00deb3a d2f18141b2af 2024-09-13T02:56:22.841 INFO:teuthology.orchestra.run.smithi089.stdout:mon.smithi131 smithi131 running (8m) 2s ago 8m 43.8M 2048M 17.2.7-1627-gbbdadfa3 a994b00deb3a 1191e59dc7a0 2024-09-13T02:56:22.841 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.smithi089 smithi089 *:9100 running (67s) 0s ago 10m 8274k - 1.5.0 0da6a335fe13 5a9927b583e6 2024-09-13T02:56:22.841 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.smithi131 smithi131 *:9100 running (41s) 2s ago 9m 8422k - 1.5.0 0da6a335fe13 bcfde5d1a508 2024-09-13T02:56:22.841 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0 smithi089 running (8m) 0s ago 8m 222M 1557M 17.2.7-1627-gbbdadfa3 a994b00deb3a b9404e2bc82c 2024-09-13T02:56:22.842 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1 smithi089 running (7m) 0s ago 7m 231M 1557M 17.2.7-1627-gbbdadfa3 a994b00deb3a af6538730e42 2024-09-13T02:56:22.842 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2 smithi089 running (7m) 0s ago 7m 195M 1557M 17.2.7-1627-gbbdadfa3 a994b00deb3a 447cf103114b 2024-09-13T02:56:22.842 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3 smithi131 running (6m) 2s ago 6m 263M 2581M 17.2.7-1627-gbbdadfa3 a994b00deb3a 0b80a4dea862 2024-09-13T02:56:22.842 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4 smithi131 running (6m) 2s ago 6m 234M 2581M 17.2.7-1627-gbbdadfa3 a994b00deb3a 06ec44680b00 2024-09-13T02:56:22.842 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5 smithi131 running (6m) 2s ago 6m 230M 2581M 17.2.7-1627-gbbdadfa3 a994b00deb3a ace4b45e5873 2024-09-13T02:56:22.842 INFO:teuthology.orchestra.run.smithi089.stdout:prometheus.smithi089 smithi089 *:9095 running (11s) 0s ago 9m 41.2M - 2.43.0 a07b618ecd1d 9d336370c187 2024-09-13T02:56:22.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.841+0000 7fc40b906640 1 -- 172.21.15.89:0/1263701634 >> [v2:172.21.15.89:6800/4290496884,v1:172.21.15.89:6801/4290496884] conn(0x7fc3f006df60 msgr2=0x7fc3f0070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:22.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.841+0000 7fc40b906640 1 --2- 172.21.15.89:0/1263701634 >> [v2:172.21.15.89:6800/4290496884,v1:172.21.15.89:6801/4290496884] conn(0x7fc3f006df60 0x7fc3f0070410 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc400004ed0 tx=0x7fc40000b040 comp rx=0 tx=0).stop 2024-09-13T02:56:22.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.841+0000 7fc40b906640 1 -- 172.21.15.89:0/1263701634 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4040fc220 msgr2=0x7fc404113bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:22.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.841+0000 7fc40b906640 1 --2- 172.21.15.89:0/1263701634 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4040fc220 0x7fc404113bf0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fc3f40043d0 tx=0x7fc3f4009da0 comp rx=0 tx=0).stop 2024-09-13T02:56:22.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.841+0000 7fc40b906640 1 -- 172.21.15.89:0/1263701634 shutdown_connections 2024-09-13T02:56:22.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.841+0000 7fc40b906640 1 --2- 172.21.15.89:0/1263701634 >> [v2:172.21.15.89:6800/4290496884,v1:172.21.15.89:6801/4290496884] conn(0x7fc3f006df60 0x7fc3f0070410 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:22.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.841+0000 7fc40b906640 1 --2- 172.21.15.89:0/1263701634 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc4040fc220 0x7fc404113bf0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:22.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.841+0000 7fc40b906640 1 --2- 172.21.15.89:0/1263701634 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc4040fb8d0 0x7fc4041136b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:22.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.841+0000 7fc40b906640 1 -- 172.21.15.89:0/1263701634 >> 172.21.15.89:0/1263701634 conn(0x7fc4040f63a0 msgr2=0x7fc4040f7b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:56:22.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.841+0000 7fc40b906640 1 -- 172.21.15.89:0/1263701634 shutdown_connections 2024-09-13T02:56:22.843 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.841+0000 7fc40b906640 1 -- 172.21.15.89:0/1263701634 wait complete. 2024-09-13T02:56:22.922 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.919+0000 7f3e6c7df640 1 -- 172.21.15.89:0/3881865485 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3e640fb450 msgr2=0x7f3e640fb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:22.922 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.919+0000 7f3e6c7df640 1 --2- 172.21.15.89:0/3881865485 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3e640fb450 0x7f3e640fb860 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f3e600048d0 tx=0x7f3e60009da0 comp rx=0 tx=0).stop 2024-09-13T02:56:22.922 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.919+0000 7f3e6c7df640 1 -- 172.21.15.89:0/3881865485 shutdown_connections 2024-09-13T02:56:22.922 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.919+0000 7f3e6c7df640 1 --2- 172.21.15.89:0/3881865485 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3e640fc720 0x7f3e640fcb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:22.922 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.919+0000 7f3e6c7df640 1 --2- 172.21.15.89:0/3881865485 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3e640fb450 0x7f3e640fb860 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:22.922 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.919+0000 7f3e6c7df640 1 -- 172.21.15.89:0/3881865485 >> 172.21.15.89:0/3881865485 conn(0x7f3e640f6c10 msgr2=0x7f3e640f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:56:22.922 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.919+0000 7f3e6c7df640 1 -- 172.21.15.89:0/3881865485 shutdown_connections 2024-09-13T02:56:22.923 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.919+0000 7f3e6c7df640 1 -- 172.21.15.89:0/3881865485 wait complete. 2024-09-13T02:56:22.923 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.920+0000 7f3e6c7df640 1 Processor -- start 2024-09-13T02:56:22.923 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.920+0000 7f3e6c7df640 1 -- start start 2024-09-13T02:56:22.923 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.920+0000 7f3e6c7df640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3e640fb450 0x7f3e6410fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:22.923 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.920+0000 7f3e6c7df640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3e640fc720 0x7f3e64112380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:22.923 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.920+0000 7f3e6c7df640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e64066730 con 0x7f3e640fc720 2024-09-13T02:56:22.923 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.920+0000 7f3e6c7df640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e640668a0 con 0x7f3e640fb450 2024-09-13T02:56:22.923 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.920+0000 7f3e69d7a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3e640fc720 0x7f3e64112380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:22.923 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.920+0000 7f3e69d7a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3e640fc720 0x7f3e64112380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:53238/0 (socket says 172.21.15.89:53238) 2024-09-13T02:56:22.923 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.920+0000 7f3e69d7a640 1 -- 172.21.15.89:0/2624153440 learned_addr learned my addr 172.21.15.89:0/2624153440 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:56:22.923 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.920+0000 7f3e6a57b640 1 --2- 172.21.15.89:0/2624153440 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3e640fb450 0x7f3e6410fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:22.923 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.920+0000 7f3e69d7a640 1 -- 172.21.15.89:0/2624153440 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3e640fb450 msgr2=0x7f3e6410fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:22.924 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.920+0000 7f3e69d7a640 1 --2- 172.21.15.89:0/2624153440 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3e640fb450 0x7f3e6410fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:22.924 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.920+0000 7f3e69d7a640 1 -- 172.21.15.89:0/2624153440 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e60005040 con 0x7f3e640fc720 2024-09-13T02:56:22.924 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.921+0000 7f3e69d7a640 1 --2- 172.21.15.89:0/2624153440 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3e640fc720 0x7f3e64112380 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f3e5400eb70 tx=0x7f3e5400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:56:22.924 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.921+0000 7f3e5affd640 1 -- 172.21.15.89:0/2624153440 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3e54007c30 con 0x7f3e640fc720 2024-09-13T02:56:22.924 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.921+0000 7f3e5affd640 1 -- 172.21.15.89:0/2624153440 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3e5400f040 con 0x7f3e640fc720 2024-09-13T02:56:22.924 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.921+0000 7f3e6c7df640 1 -- 172.21.15.89:0/2624153440 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e641128c0 con 0x7f3e640fc720 2024-09-13T02:56:22.925 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.921+0000 7f3e5affd640 1 -- 172.21.15.89:0/2624153440 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3e5400ca60 con 0x7f3e640fc720 2024-09-13T02:56:22.925 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.921+0000 7f3e6c7df640 1 -- 172.21.15.89:0/2624153440 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e64112e30 con 0x7f3e640fc720 2024-09-13T02:56:22.925 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.922+0000 7f3e6c7df640 1 -- 172.21.15.89:0/2624153440 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e640fa8b0 con 0x7f3e640fc720 2024-09-13T02:56:22.925 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.922+0000 7f3e5affd640 1 -- 172.21.15.89:0/2624153440 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 32) v1 ==== 92375+0+0 (secure 0 0 0) 0x7f3e5400cbc0 con 0x7f3e640fc720 2024-09-13T02:56:22.925 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.923+0000 7f3e5affd640 1 --2- 172.21.15.89:0/2624153440 >> [v2:172.21.15.89:6800/4290496884,v1:172.21.15.89:6801/4290496884] conn(0x7f3e5006dd50 0x7f3e50070200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:22.925 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.923+0000 7f3e5affd640 1 -- 172.21.15.89:0/2624153440 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f3e5408d460 con 0x7f3e640fc720 2024-09-13T02:56:22.925 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.923+0000 7f3e6a57b640 1 --2- 172.21.15.89:0/2624153440 >> [v2:172.21.15.89:6800/4290496884,v1:172.21.15.89:6801/4290496884] conn(0x7f3e5006dd50 0x7f3e50070200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:22.925 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.924+0000 7f3e6a57b640 1 --2- 172.21.15.89:0/2624153440 >> [v2:172.21.15.89:6800/4290496884,v1:172.21.15.89:6801/4290496884] conn(0x7f3e5006dd50 0x7f3e50070200 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3e60009ac0 tx=0x7f3e60035040 comp rx=0 tx=0).ready entity=mgr.14734 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:56:22.928 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:22.927+0000 7f3e5affd640 1 -- 172.21.15.89:0/2624153440 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f3e54056cb0 con 0x7f3e640fc720 2024-09-13T02:56:23.156 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.154+0000 7f3e6c7df640 1 -- 172.21.15.89:0/2624153440 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3e6404b720 con 0x7f3e640fc720 2024-09-13T02:56:23.156 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.155+0000 7f3e5affd640 1 -- 172.21.15.89:0/2624153440 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+747 (secure 0 0 0) 0x7f3e5405a370 con 0x7f3e640fc720 2024-09-13T02:56:23.156 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-13T02:56:23.156 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": { 2024-09-13T02:56:23.156 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 2 2024-09-13T02:56:23.157 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T02:56:23.157 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": { 2024-09-13T02:56:23.157 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 2 2024-09-13T02:56:23.157 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T02:56:23.157 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": { 2024-09-13T02:56:23.157 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 6 2024-09-13T02:56:23.157 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T02:56:23.157 INFO:teuthology.orchestra.run.smithi089.stdout: "mds": { 2024-09-13T02:56:23.157 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 4 2024-09-13T02:56:23.157 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T02:56:23.157 INFO:teuthology.orchestra.run.smithi089.stdout: "overall": { 2024-09-13T02:56:23.157 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 12, 2024-09-13T02:56:23.157 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 2 2024-09-13T02:56:23.158 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-13T02:56:23.158 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-13T02:56:23.158 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.156+0000 7f3e6c7df640 1 -- 172.21.15.89:0/2624153440 >> [v2:172.21.15.89:6800/4290496884,v1:172.21.15.89:6801/4290496884] conn(0x7f3e5006dd50 msgr2=0x7f3e50070200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:23.158 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.156+0000 7f3e6c7df640 1 --2- 172.21.15.89:0/2624153440 >> [v2:172.21.15.89:6800/4290496884,v1:172.21.15.89:6801/4290496884] conn(0x7f3e5006dd50 0x7f3e50070200 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f3e60009ac0 tx=0x7f3e60035040 comp rx=0 tx=0).stop 2024-09-13T02:56:23.158 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.157+0000 7f3e6c7df640 1 -- 172.21.15.89:0/2624153440 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3e640fc720 msgr2=0x7f3e64112380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:23.159 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.157+0000 7f3e6c7df640 1 --2- 172.21.15.89:0/2624153440 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3e640fc720 0x7f3e64112380 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f3e5400eb70 tx=0x7f3e5400b040 comp rx=0 tx=0).stop 2024-09-13T02:56:23.159 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.157+0000 7f3e6c7df640 1 -- 172.21.15.89:0/2624153440 shutdown_connections 2024-09-13T02:56:23.159 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.157+0000 7f3e6c7df640 1 --2- 172.21.15.89:0/2624153440 >> [v2:172.21.15.89:6800/4290496884,v1:172.21.15.89:6801/4290496884] conn(0x7f3e5006dd50 0x7f3e50070200 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:23.159 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.157+0000 7f3e6c7df640 1 --2- 172.21.15.89:0/2624153440 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3e640fc720 0x7f3e64112380 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:23.159 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.157+0000 7f3e6c7df640 1 --2- 172.21.15.89:0/2624153440 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3e640fb450 0x7f3e6410fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:23.159 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.157+0000 7f3e6c7df640 1 -- 172.21.15.89:0/2624153440 >> 172.21.15.89:0/2624153440 conn(0x7f3e640f6c10 msgr2=0x7f3e640f8450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:56:23.159 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.157+0000 7f3e6c7df640 1 -- 172.21.15.89:0/2624153440 shutdown_connections 2024-09-13T02:56:23.159 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.157+0000 7f3e6c7df640 1 -- 172.21.15.89:0/2624153440 wait complete. 2024-09-13T02:56:23.237 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.234+0000 7fe207d22640 1 -- 172.21.15.89:0/633919116 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe2000fe4f0 msgr2=0x7fe2000fa650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:23.237 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.234+0000 7fe207d22640 1 --2- 172.21.15.89:0/633919116 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe2000fe4f0 0x7fe2000fa650 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fe1f00048d0 tx=0x7fe1f0009da0 comp rx=0 tx=0).stop 2024-09-13T02:56:23.237 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.234+0000 7fe207d22640 1 -- 172.21.15.89:0/633919116 shutdown_connections 2024-09-13T02:56:23.237 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.234+0000 7fe207d22640 1 --2- 172.21.15.89:0/633919116 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe2000fe4f0 0x7fe2000fa650 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:23.237 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.234+0000 7fe207d22640 1 --2- 172.21.15.89:0/633919116 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe2000fdba0 0x7fe2000fdfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:23.238 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.234+0000 7fe207d22640 1 -- 172.21.15.89:0/633919116 >> 172.21.15.89:0/633919116 conn(0x7fe2000f63a0 msgr2=0x7fe2000f87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:56:23.238 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.234+0000 7fe207d22640 1 -- 172.21.15.89:0/633919116 shutdown_connections 2024-09-13T02:56:23.238 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.234+0000 7fe207d22640 1 -- 172.21.15.89:0/633919116 wait complete. 2024-09-13T02:56:23.238 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.235+0000 7fe207d22640 1 Processor -- start 2024-09-13T02:56:23.238 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.235+0000 7fe207d22640 1 -- start start 2024-09-13T02:56:23.238 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.235+0000 7fe207d22640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe2000fdba0 0x7fe20010d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:23.238 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.235+0000 7fe207d22640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe2000fe4f0 0x7fe20010d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:23.238 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.235+0000 7fe207d22640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe20010dc50 con 0x7fe2000fdba0 2024-09-13T02:56:23.238 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.235+0000 7fe207d22640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe20010e420 con 0x7fe2000fe4f0 2024-09-13T02:56:23.238 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.235+0000 7fe205abe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe2000fdba0 0x7fe20010d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:23.238 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.235+0000 7fe205abe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe2000fdba0 0x7fe20010d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:53262/0 (socket says 172.21.15.89:53262) 2024-09-13T02:56:23.238 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.235+0000 7fe205abe640 1 -- 172.21.15.89:0/670650842 learned_addr learned my addr 172.21.15.89:0/670650842 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:56:23.238 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.235+0000 7fe2052bd640 1 --2- 172.21.15.89:0/670650842 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe2000fe4f0 0x7fe20010d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:23.238 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.235+0000 7fe205abe640 1 -- 172.21.15.89:0/670650842 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe2000fe4f0 msgr2=0x7fe20010d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:23.239 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.235+0000 7fe205abe640 1 --2- 172.21.15.89:0/670650842 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe2000fe4f0 0x7fe20010d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:23.239 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.235+0000 7fe205abe640 1 -- 172.21.15.89:0/670650842 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1f0005040 con 0x7fe2000fdba0 2024-09-13T02:56:23.239 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.236+0000 7fe205abe640 1 --2- 172.21.15.89:0/670650842 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe2000fdba0 0x7fe20010d0c0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc002a50 tx=0x7fe1fc004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:56:23.239 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.236+0000 7fe1f67fc640 1 -- 172.21.15.89:0/670650842 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe1fc007c30 con 0x7fe2000fdba0 2024-09-13T02:56:23.239 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.236+0000 7fe1f67fc640 1 -- 172.21.15.89:0/670650842 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe1fc00f040 con 0x7fe2000fdba0 2024-09-13T02:56:23.239 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.236+0000 7fe1f67fc640 1 -- 172.21.15.89:0/670650842 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe1fc00dad0 con 0x7fe2000fdba0 2024-09-13T02:56:23.239 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.236+0000 7fe207d22640 1 -- 172.21.15.89:0/670650842 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe20010e6b0 con 0x7fe2000fdba0 2024-09-13T02:56:23.239 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.236+0000 7fe207d22640 1 -- 172.21.15.89:0/670650842 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe20010ec20 con 0x7fe2000fdba0 2024-09-13T02:56:23.240 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.237+0000 7fe207d22640 1 -- 172.21.15.89:0/670650842 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe200105790 con 0x7fe2000fdba0 2024-09-13T02:56:23.240 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.237+0000 7fe1f67fc640 1 -- 172.21.15.89:0/670650842 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 32) v1 ==== 92375+0+0 (secure 0 0 0) 0x7fe1fc00dc30 con 0x7fe2000fdba0 2024-09-13T02:56:23.240 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.238+0000 7fe1f67fc640 1 --2- 172.21.15.89:0/670650842 >> [v2:172.21.15.89:6800/4290496884,v1:172.21.15.89:6801/4290496884] conn(0x7fe1ec06df60 0x7fe1ec070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:23.240 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.238+0000 7fe1f67fc640 1 -- 172.21.15.89:0/670650842 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6152+0+0 (secure 0 0 0) 0x7fe1fc08d880 con 0x7fe2000fdba0 2024-09-13T02:56:23.240 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.238+0000 7fe2052bd640 1 --2- 172.21.15.89:0/670650842 >> [v2:172.21.15.89:6800/4290496884,v1:172.21.15.89:6801/4290496884] conn(0x7fe1ec06df60 0x7fe1ec070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:23.241 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.238+0000 7fe2052bd640 1 --2- 172.21.15.89:0/670650842 >> [v2:172.21.15.89:6800/4290496884,v1:172.21.15.89:6801/4290496884] conn(0x7fe1ec06df60 0x7fe1ec070410 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fe1f0000c00 tx=0x7fe1f0035040 comp rx=0 tx=0).ready entity=mgr.14734 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:56:23.243 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.242+0000 7fe1f67fc640 1 -- 172.21.15.89:0/670650842 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7fe1fc057020 con 0x7fe2000fdba0 2024-09-13T02:56:23.440 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.438+0000 7fe207d22640 1 -- 172.21.15.89:0/670650842 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe20004b7a0 con 0x7fe2000fdba0 2024-09-13T02:56:23.440 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.439+0000 7fe1f67fc640 1 -- 172.21.15.89:0/670650842 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1864 (secure 0 0 0) 0x7fe20004b7a0 con 0x7fe2000fdba0 2024-09-13T02:56:23.440 INFO:teuthology.orchestra.run.smithi089.stdout:e21 2024-09-13T02:56:23.440 INFO:teuthology.orchestra.run.smithi089.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T02:56:23.441 INFO:teuthology.orchestra.run.smithi089.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:56:23.441 INFO:teuthology.orchestra.run.smithi089.stdout:legacy client fscid: 1 2024-09-13T02:56:23.441 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:56:23.441 INFO:teuthology.orchestra.run.smithi089.stdout:Filesystem 'cephfs' (1) 2024-09-13T02:56:23.441 INFO:teuthology.orchestra.run.smithi089.stdout:fs_name cephfs 2024-09-13T02:56:23.441 INFO:teuthology.orchestra.run.smithi089.stdout:epoch 21 2024-09-13T02:56:23.441 INFO:teuthology.orchestra.run.smithi089.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T02:56:23.441 INFO:teuthology.orchestra.run.smithi089.stdout:created 2024-09-13T02:51:40.657817+0000 2024-09-13T02:56:23.441 INFO:teuthology.orchestra.run.smithi089.stdout:modified 2024-09-13T02:54:05.118633+0000 2024-09-13T02:56:23.441 INFO:teuthology.orchestra.run.smithi089.stdout:tableserver 0 2024-09-13T02:56:23.441 INFO:teuthology.orchestra.run.smithi089.stdout:root 0 2024-09-13T02:56:23.441 INFO:teuthology.orchestra.run.smithi089.stdout:session_timeout 60 2024-09-13T02:56:23.441 INFO:teuthology.orchestra.run.smithi089.stdout:session_autoclose 300 2024-09-13T02:56:23.442 INFO:teuthology.orchestra.run.smithi089.stdout:max_file_size 1099511627776 2024-09-13T02:56:23.442 INFO:teuthology.orchestra.run.smithi089.stdout:required_client_features {} 2024-09-13T02:56:23.442 INFO:teuthology.orchestra.run.smithi089.stdout:last_failure 0 2024-09-13T02:56:23.442 INFO:teuthology.orchestra.run.smithi089.stdout:last_failure_osd_epoch 44 2024-09-13T02:56:23.442 INFO:teuthology.orchestra.run.smithi089.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:56:23.442 INFO:teuthology.orchestra.run.smithi089.stdout:max_mds 2 2024-09-13T02:56:23.442 INFO:teuthology.orchestra.run.smithi089.stdout:in 0,1 2024-09-13T02:56:23.442 INFO:teuthology.orchestra.run.smithi089.stdout:up {0=14480,1=24257} 2024-09-13T02:56:23.442 INFO:teuthology.orchestra.run.smithi089.stdout:failed 2024-09-13T02:56:23.442 INFO:teuthology.orchestra.run.smithi089.stdout:damaged 2024-09-13T02:56:23.442 INFO:teuthology.orchestra.run.smithi089.stdout:stopped 2024-09-13T02:56:23.442 INFO:teuthology.orchestra.run.smithi089.stdout:data_pools [3] 2024-09-13T02:56:23.443 INFO:teuthology.orchestra.run.smithi089.stdout:metadata_pool 2 2024-09-13T02:56:23.443 INFO:teuthology.orchestra.run.smithi089.stdout:inline_data disabled 2024-09-13T02:56:23.443 INFO:teuthology.orchestra.run.smithi089.stdout:balancer 2024-09-13T02:56:23.443 INFO:teuthology.orchestra.run.smithi089.stdout:standby_count_wanted 1 2024-09-13T02:56:23.443 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi089.rarddb{0:14480} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.89:6828/1561365213,v1:172.21.15.89:6829/1561365213] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:56:23.443 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi089.qjoitb{0:14488} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.89:6826/1464393547,v1:172.21.15.89:6827/1464393547] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:56:23.443 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi131.uasrkg{1:24257} state up:active seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.131:6824/260493836,v1:172.21.15.131:6825/260493836] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:56:23.443 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi131.rbovzc{1:24265} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.131:6826/665579373,v1:172.21.15.131:6827/665579373] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:56:23.443 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:56:23.443 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:56:23.444 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 21 2024-09-13T02:56:23.444 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.441+0000 7fe207d22640 1 -- 172.21.15.89:0/670650842 >> [v2:172.21.15.89:6800/4290496884,v1:172.21.15.89:6801/4290496884] conn(0x7fe1ec06df60 msgr2=0x7fe1ec070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:23.444 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.441+0000 7fe207d22640 1 --2- 172.21.15.89:0/670650842 >> [v2:172.21.15.89:6800/4290496884,v1:172.21.15.89:6801/4290496884] conn(0x7fe1ec06df60 0x7fe1ec070410 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fe1f0000c00 tx=0x7fe1f0035040 comp rx=0 tx=0).stop 2024-09-13T02:56:23.444 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.441+0000 7fe207d22640 1 -- 172.21.15.89:0/670650842 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe2000fdba0 msgr2=0x7fe20010d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:23.444 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.441+0000 7fe207d22640 1 --2- 172.21.15.89:0/670650842 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe2000fdba0 0x7fe20010d0c0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fe1fc002a50 tx=0x7fe1fc004600 comp rx=0 tx=0).stop 2024-09-13T02:56:23.444 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.441+0000 7fe207d22640 1 -- 172.21.15.89:0/670650842 shutdown_connections 2024-09-13T02:56:23.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.441+0000 7fe207d22640 1 --2- 172.21.15.89:0/670650842 >> [v2:172.21.15.89:6800/4290496884,v1:172.21.15.89:6801/4290496884] conn(0x7fe1ec06df60 0x7fe1ec070410 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:23.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.441+0000 7fe207d22640 1 --2- 172.21.15.89:0/670650842 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe2000fe4f0 0x7fe20010d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:23.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.441+0000 7fe207d22640 1 --2- 172.21.15.89:0/670650842 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe2000fdba0 0x7fe20010d0c0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:23.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.441+0000 7fe207d22640 1 -- 172.21.15.89:0/670650842 >> 172.21.15.89:0/670650842 conn(0x7fe2000f63a0 msgr2=0x7fe2000f7b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:56:23.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.441+0000 7fe207d22640 1 -- 172.21.15.89:0/670650842 shutdown_connections 2024-09-13T02:56:23.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.441+0000 7fe207d22640 1 -- 172.21.15.89:0/670650842 wait complete. 2024-09-13T02:56:23.523 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.520+0000 7ffab2da1640 1 -- 172.21.15.89:0/3403942827 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffaac0fc720 msgr2=0x7ffaac0fcb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:23.523 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.520+0000 7ffab2da1640 1 --2- 172.21.15.89:0/3403942827 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffaac0fc720 0x7ffaac0fcb90 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7ffa980048d0 tx=0x7ffa98009da0 comp rx=0 tx=0).stop 2024-09-13T02:56:23.523 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.520+0000 7ffab2da1640 1 -- 172.21.15.89:0/3403942827 shutdown_connections 2024-09-13T02:56:23.523 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.520+0000 7ffab2da1640 1 --2- 172.21.15.89:0/3403942827 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffaac0fc720 0x7ffaac0fcb90 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:23.523 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.520+0000 7ffab2da1640 1 --2- 172.21.15.89:0/3403942827 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffaac0fb450 0x7ffaac0fb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:23.523 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.520+0000 7ffab2da1640 1 -- 172.21.15.89:0/3403942827 >> 172.21.15.89:0/3403942827 conn(0x7ffaac0f6c10 msgr2=0x7ffaac0f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:56:23.524 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.520+0000 7ffab2da1640 1 -- 172.21.15.89:0/3403942827 shutdown_connections 2024-09-13T02:56:23.524 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.520+0000 7ffab2da1640 1 -- 172.21.15.89:0/3403942827 wait complete. 2024-09-13T02:56:23.524 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.520+0000 7ffab2da1640 1 Processor -- start 2024-09-13T02:56:23.524 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.520+0000 7ffab2da1640 1 -- start start 2024-09-13T02:56:23.524 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.521+0000 7ffab2da1640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffaac0fb450 0x7ffaac10fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:23.524 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.521+0000 7ffab2da1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffaac0fc720 0x7ffaac1122c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:23.524 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.521+0000 7ffab2da1640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaac066770 con 0x7ffaac0fc720 2024-09-13T02:56:23.524 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.521+0000 7ffab2da1640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffaac0668e0 con 0x7ffaac0fb450 2024-09-13T02:56:23.524 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.521+0000 7ffaabfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffaac0fc720 0x7ffaac1122c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:23.524 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.521+0000 7ffaabfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffaac0fc720 0x7ffaac1122c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:53286/0 (socket says 172.21.15.89:53286) 2024-09-13T02:56:23.524 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.521+0000 7ffaabfff640 1 -- 172.21.15.89:0/943007525 learned_addr learned my addr 172.21.15.89:0/943007525 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:56:23.525 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.521+0000 7ffab0b3d640 1 --2- 172.21.15.89:0/943007525 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffaac0fb450 0x7ffaac10fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:23.525 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.521+0000 7ffaabfff640 1 -- 172.21.15.89:0/943007525 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffaac0fb450 msgr2=0x7ffaac10fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:23.525 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.521+0000 7ffaabfff640 1 --2- 172.21.15.89:0/943007525 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffaac0fb450 0x7ffaac10fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:23.525 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.521+0000 7ffaabfff640 1 -- 172.21.15.89:0/943007525 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa98005040 con 0x7ffaac0fc720 2024-09-13T02:56:23.525 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.521+0000 7ffaabfff640 1 --2- 172.21.15.89:0/943007525 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffaac0fc720 0x7ffaac1122c0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7ffa98003080 tx=0x7ffa98009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:56:23.525 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.521+0000 7ffaa97fa640 1 -- 172.21.15.89:0/943007525 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa98038070 con 0x7ffaac0fc720 2024-09-13T02:56:23.525 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.521+0000 7ffaa97fa640 1 -- 172.21.15.89:0/943007525 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ffa9802abd0 con 0x7ffaac0fc720 2024-09-13T02:56:23.525 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.521+0000 7ffab2da1640 1 -- 172.21.15.89:0/943007525 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffaac112800 con 0x7ffaac0fc720 2024-09-13T02:56:23.525 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.521+0000 7ffaa97fa640 1 -- 172.21.15.89:0/943007525 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa9803e670 con 0x7ffaac0fc720 2024-09-13T02:56:23.525 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.521+0000 7ffab2da1640 1 -- 172.21.15.89:0/943007525 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffaac112da0 con 0x7ffaac0fc720 2024-09-13T02:56:23.526 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.523+0000 7ffab2da1640 1 -- 172.21.15.89:0/943007525 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffaac0fa8b0 con 0x7ffaac0fc720 2024-09-13T02:56:23.526 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.523+0000 7ffaa97fa640 1 -- 172.21.15.89:0/943007525 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 32) v1 ==== 92375+0+0 (secure 0 0 0) 0x7ffa98030020 con 0x7ffaac0fc720 2024-09-13T02:56:23.526 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.523+0000 7ffaa97fa640 1 --2- 172.21.15.89:0/943007525 >> [v2:172.21.15.89:6800/4290496884,v1:172.21.15.89:6801/4290496884] conn(0x7ffa9c06df60 0x7ffa9c070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:23.526 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.524+0000 7ffaa97fa640 1 -- 172.21.15.89:0/943007525 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6152+0+0 (secure 0 0 0) 0x7ffa980addc0 con 0x7ffaac0fc720 2024-09-13T02:56:23.526 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.524+0000 7ffab0b3d640 1 --2- 172.21.15.89:0/943007525 >> [v2:172.21.15.89:6800/4290496884,v1:172.21.15.89:6801/4290496884] conn(0x7ffa9c06df60 0x7ffa9c070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:23.526 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.524+0000 7ffab0b3d640 1 --2- 172.21.15.89:0/943007525 >> [v2:172.21.15.89:6800/4290496884,v1:172.21.15.89:6801/4290496884] conn(0x7ffa9c06df60 0x7ffa9c070410 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ffaa00041d0 tx=0x7ffaa0009040 comp rx=0 tx=0).ready entity=mgr.14734 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:56:23.529 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.528+0000 7ffaa97fa640 1 -- 172.21.15.89:0/943007525 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7ffa980775f0 con 0x7ffaac0fc720 2024-09-13T02:56:23.674 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:23 smithi131 ceph-mon[34689]: from='client.14792 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:56:23.675 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:23 smithi131 ceph-mon[34689]: from='client.14796 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:56:23.675 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:23 smithi131 ceph-mon[34689]: mgrmap e32: smithi089.guohvs(active, since 25s), standbys: smithi131.aunbqd 2024-09-13T02:56:23.675 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:23 smithi131 ceph-mon[34689]: pgmap v16: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T02:56:23.675 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:23 smithi131 ceph-mon[34689]: from='client.? 172.21.15.89:0/2624153440' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:56:23.675 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:23 smithi131 ceph-mon[34689]: from='client.? 172.21.15.89:0/670650842' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T02:56:23.713 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.712+0000 7ffab2da1640 1 -- 172.21.15.89:0/943007525 --> [v2:172.21.15.89:6800/4290496884,v1:172.21.15.89:6801/4290496884] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ffaac100b20 con 0x7ffa9c06df60 2024-09-13T02:56:23.714 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.713+0000 7ffaa97fa640 1 -- 172.21.15.89:0/943007525 <== mgr.14734 v2:172.21.15.89:6800/4290496884 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7ffaac100b20 con 0x7ffa9c06df60 2024-09-13T02:56:23.715 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-13T02:56:23.715 INFO:teuthology.orchestra.run.smithi089.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d", 2024-09-13T02:56:23.715 INFO:teuthology.orchestra.run.smithi089.stdout: "in_progress": true, 2024-09-13T02:56:23.715 INFO:teuthology.orchestra.run.smithi089.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T02:56:23.715 INFO:teuthology.orchestra.run.smithi089.stdout: "services_complete": [ 2024-09-13T02:56:23.715 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr" 2024-09-13T02:56:23.715 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-13T02:56:23.715 INFO:teuthology.orchestra.run.smithi089.stdout: "progress": "2/21 daemons upgraded", 2024-09-13T02:56:23.715 INFO:teuthology.orchestra.run.smithi089.stdout: "message": "Currently upgrading mgr daemons", 2024-09-13T02:56:23.715 INFO:teuthology.orchestra.run.smithi089.stdout: "is_paused": false 2024-09-13T02:56:23.715 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-13T02:56:23.717 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.716+0000 7ffab2da1640 1 -- 172.21.15.89:0/943007525 >> [v2:172.21.15.89:6800/4290496884,v1:172.21.15.89:6801/4290496884] conn(0x7ffa9c06df60 msgr2=0x7ffa9c070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:23.717 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.716+0000 7ffab2da1640 1 --2- 172.21.15.89:0/943007525 >> [v2:172.21.15.89:6800/4290496884,v1:172.21.15.89:6801/4290496884] conn(0x7ffa9c06df60 0x7ffa9c070410 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7ffaa00041d0 tx=0x7ffaa0009040 comp rx=0 tx=0).stop 2024-09-13T02:56:23.717 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.716+0000 7ffab2da1640 1 -- 172.21.15.89:0/943007525 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffaac0fc720 msgr2=0x7ffaac1122c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:23.718 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.716+0000 7ffab2da1640 1 --2- 172.21.15.89:0/943007525 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffaac0fc720 0x7ffaac1122c0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7ffa98003080 tx=0x7ffa98009da0 comp rx=0 tx=0).stop 2024-09-13T02:56:23.718 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.716+0000 7ffab2da1640 1 -- 172.21.15.89:0/943007525 shutdown_connections 2024-09-13T02:56:23.718 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.716+0000 7ffab2da1640 1 --2- 172.21.15.89:0/943007525 >> [v2:172.21.15.89:6800/4290496884,v1:172.21.15.89:6801/4290496884] conn(0x7ffa9c06df60 0x7ffa9c070410 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:23.718 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.716+0000 7ffab2da1640 1 --2- 172.21.15.89:0/943007525 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ffaac0fc720 0x7ffaac1122c0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:23.718 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.716+0000 7ffab2da1640 1 --2- 172.21.15.89:0/943007525 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ffaac0fb450 0x7ffaac10fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:23.718 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.716+0000 7ffab2da1640 1 -- 172.21.15.89:0/943007525 >> 172.21.15.89:0/943007525 conn(0x7ffaac0f6c10 msgr2=0x7ffaac0f8370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:56:23.718 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.716+0000 7ffab2da1640 1 -- 172.21.15.89:0/943007525 shutdown_connections 2024-09-13T02:56:23.718 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.716+0000 7ffab2da1640 1 -- 172.21.15.89:0/943007525 wait complete. 2024-09-13T02:56:23.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:23 smithi089 ceph-mon[27639]: from='client.14792 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:56:23.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:23 smithi089 ceph-mon[27639]: from='client.14796 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:56:23.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:23 smithi089 ceph-mon[27639]: mgrmap e32: smithi089.guohvs(active, since 25s), standbys: smithi131.aunbqd 2024-09-13T02:56:23.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:23 smithi089 ceph-mon[27639]: pgmap v16: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T02:56:23.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:23 smithi089 ceph-mon[27639]: from='client.? 172.21.15.89:0/2624153440' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:56:23.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:23 smithi089 ceph-mon[27639]: from='client.? 172.21.15.89:0/670650842' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T02:56:23.799 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.797+0000 7f149239d640 1 -- 172.21.15.89:0/1273014186 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f148c0fd680 msgr2=0x7f148c0fdaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:23.799 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.797+0000 7f149239d640 1 --2- 172.21.15.89:0/1273014186 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f148c0fd680 0x7f148c0fdaf0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f14880048d0 tx=0x7f1488009da0 comp rx=0 tx=0).stop 2024-09-13T02:56:23.799 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.797+0000 7f149239d640 1 -- 172.21.15.89:0/1273014186 shutdown_connections 2024-09-13T02:56:23.799 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.797+0000 7f149239d640 1 --2- 172.21.15.89:0/1273014186 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f148c0fd680 0x7f148c0fdaf0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:23.799 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.797+0000 7f149239d640 1 --2- 172.21.15.89:0/1273014186 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f148c0fc3b0 0x7f148c0fc7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:23.799 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.797+0000 7f149239d640 1 -- 172.21.15.89:0/1273014186 >> 172.21.15.89:0/1273014186 conn(0x7f148c0f7b70 msgr2=0x7f148c0f9fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:56:23.800 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.798+0000 7f149239d640 1 -- 172.21.15.89:0/1273014186 shutdown_connections 2024-09-13T02:56:23.800 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.798+0000 7f149239d640 1 -- 172.21.15.89:0/1273014186 wait complete. 2024-09-13T02:56:23.801 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.798+0000 7f149239d640 1 Processor -- start 2024-09-13T02:56:23.801 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.798+0000 7f149239d640 1 -- start start 2024-09-13T02:56:23.801 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.798+0000 7f149239d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f148c0fc3b0 0x7f148c10f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:23.801 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.799+0000 7f149239d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f148c0fd680 0x7f148c10f600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:23.801 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.799+0000 7f149239d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f148c10fc50 con 0x7f148c0fc3b0 2024-09-13T02:56:23.801 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.799+0000 7f149239d640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f148c110470 con 0x7f148c0fd680 2024-09-13T02:56:23.802 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.799+0000 7f149139b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f148c0fc3b0 0x7f148c10f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:23.802 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.799+0000 7f149139b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f148c0fc3b0 0x7f148c10f0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:53298/0 (socket says 172.21.15.89:53298) 2024-09-13T02:56:23.802 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.799+0000 7f149139b640 1 -- 172.21.15.89:0/748416887 learned_addr learned my addr 172.21.15.89:0/748416887 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:56:23.802 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.799+0000 7f1490b9a640 1 --2- 172.21.15.89:0/748416887 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f148c0fd680 0x7f148c10f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:23.802 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.799+0000 7f149139b640 1 -- 172.21.15.89:0/748416887 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f148c0fd680 msgr2=0x7f148c10f600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:23.802 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.799+0000 7f149139b640 1 --2- 172.21.15.89:0/748416887 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f148c0fd680 0x7f148c10f600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:23.802 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.799+0000 7f149139b640 1 -- 172.21.15.89:0/748416887 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1488005040 con 0x7f148c0fc3b0 2024-09-13T02:56:23.802 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.799+0000 7f149139b640 1 --2- 172.21.15.89:0/748416887 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f148c0fc3b0 0x7f148c10f0c0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f147c002a50 tx=0x7f147c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:56:23.802 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.799+0000 7f1481ffb640 1 -- 172.21.15.89:0/748416887 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f147c007c30 con 0x7f148c0fc3b0 2024-09-13T02:56:23.802 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.799+0000 7f1481ffb640 1 -- 172.21.15.89:0/748416887 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f147c00f040 con 0x7f148c0fc3b0 2024-09-13T02:56:23.802 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.799+0000 7f1481ffb640 1 -- 172.21.15.89:0/748416887 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f147c00da10 con 0x7f148c0fc3b0 2024-09-13T02:56:23.802 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.799+0000 7f149239d640 1 -- 172.21.15.89:0/748416887 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f148c110700 con 0x7f148c0fc3b0 2024-09-13T02:56:23.802 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.800+0000 7f149239d640 1 -- 172.21.15.89:0/748416887 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f148c110ca0 con 0x7f148c0fc3b0 2024-09-13T02:56:23.803 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.800+0000 7f149239d640 1 -- 172.21.15.89:0/748416887 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f148c1055e0 con 0x7f148c0fc3b0 2024-09-13T02:56:23.803 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.802+0000 7f1481ffb640 1 -- 172.21.15.89:0/748416887 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 32) v1 ==== 92375+0+0 (secure 0 0 0) 0x7f147c00db70 con 0x7f148c0fc3b0 2024-09-13T02:56:23.804 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.802+0000 7f1481ffb640 1 --2- 172.21.15.89:0/748416887 >> [v2:172.21.15.89:6800/4290496884,v1:172.21.15.89:6801/4290496884] conn(0x7f147806df60 0x7f1478070410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:23.804 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.802+0000 7f1481ffb640 1 -- 172.21.15.89:0/748416887 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 6152+0+0 (secure 0 0 0) 0x7f147c08d7c0 con 0x7f148c0fc3b0 2024-09-13T02:56:23.804 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.802+0000 7f1490b9a640 1 --2- 172.21.15.89:0/748416887 >> [v2:172.21.15.89:6800/4290496884,v1:172.21.15.89:6801/4290496884] conn(0x7f147806df60 0x7f1478070410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:23.804 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.803+0000 7f1490b9a640 1 --2- 172.21.15.89:0/748416887 >> [v2:172.21.15.89:6800/4290496884,v1:172.21.15.89:6801/4290496884] conn(0x7f147806df60 0x7f1478070410 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f148c10ee70 tx=0x7f1488035040 comp rx=0 tx=0).ready entity=mgr.14734 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:56:23.807 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:23.806+0000 7f1481ffb640 1 -- 172.21.15.89:0/748416887 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+185942 (secure 0 0 0) 0x7f147c056f60 con 0x7f148c0fc3b0 2024-09-13T02:56:24.044 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:24.042+0000 7f149239d640 1 -- 172.21.15.89:0/748416887 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f148c0fb810 con 0x7f148c0fc3b0 2024-09-13T02:56:24.044 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:24.043+0000 7f1481ffb640 1 -- 172.21.15.89:0/748416887 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f147c05a620 con 0x7f148c0fc3b0 2024-09-13T02:56:24.044 INFO:teuthology.orchestra.run.smithi089.stdout:HEALTH_OK 2024-09-13T02:56:24.046 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:24.045+0000 7f149239d640 1 -- 172.21.15.89:0/748416887 >> [v2:172.21.15.89:6800/4290496884,v1:172.21.15.89:6801/4290496884] conn(0x7f147806df60 msgr2=0x7f1478070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:24.047 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:24.045+0000 7f149239d640 1 --2- 172.21.15.89:0/748416887 >> [v2:172.21.15.89:6800/4290496884,v1:172.21.15.89:6801/4290496884] conn(0x7f147806df60 0x7f1478070410 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f148c10ee70 tx=0x7f1488035040 comp rx=0 tx=0).stop 2024-09-13T02:56:24.047 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:24.045+0000 7f149239d640 1 -- 172.21.15.89:0/748416887 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f148c0fc3b0 msgr2=0x7f148c10f0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:24.047 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:24.045+0000 7f149239d640 1 --2- 172.21.15.89:0/748416887 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f148c0fc3b0 0x7f148c10f0c0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f147c002a50 tx=0x7f147c004600 comp rx=0 tx=0).stop 2024-09-13T02:56:24.047 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:24.045+0000 7f149239d640 1 -- 172.21.15.89:0/748416887 shutdown_connections 2024-09-13T02:56:24.047 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:24.045+0000 7f149239d640 1 --2- 172.21.15.89:0/748416887 >> [v2:172.21.15.89:6800/4290496884,v1:172.21.15.89:6801/4290496884] conn(0x7f147806df60 0x7f1478070410 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:24.047 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:24.045+0000 7f149239d640 1 --2- 172.21.15.89:0/748416887 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f148c0fd680 0x7f148c10f600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:24.047 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:24.045+0000 7f149239d640 1 --2- 172.21.15.89:0/748416887 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f148c0fc3b0 0x7f148c10f0c0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:24.047 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:24.045+0000 7f149239d640 1 -- 172.21.15.89:0/748416887 >> 172.21.15.89:0/748416887 conn(0x7f148c0f7b70 msgr2=0x7f148c0f92e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:56:24.047 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:24.045+0000 7f149239d640 1 -- 172.21.15.89:0/748416887 shutdown_connections 2024-09-13T02:56:24.047 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:24.045+0000 7f149239d640 1 -- 172.21.15.89:0/748416887 wait complete. 2024-09-13T02:56:24.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:24 smithi089 ceph-mon[27639]: from='client.14800 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:56:24.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:24 smithi089 ceph-mon[27639]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:24.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:24 smithi089 ceph-mon[27639]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:24.786 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:24 smithi089 ceph-mon[27639]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:56:24.786 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:24 smithi089 ceph-mon[27639]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:56:24.786 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:24 smithi089 ceph-mon[27639]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:24.786 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:24 smithi089 ceph-mon[27639]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:56:24.786 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:24 smithi089 ceph-mon[27639]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:56:24.786 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:24 smithi089 ceph-mon[27639]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:24.786 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:24 smithi089 ceph-mon[27639]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi089.guohvs"}]: dispatch 2024-09-13T02:56:24.786 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:24 smithi089 ceph-mon[27639]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi089.guohvs"}]': finished 2024-09-13T02:56:24.786 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:24 smithi089 ceph-mon[27639]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi131.aunbqd"}]: dispatch 2024-09-13T02:56:24.786 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:24 smithi089 ceph-mon[27639]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi131.aunbqd"}]': finished 2024-09-13T02:56:24.786 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:24 smithi089 ceph-mon[27639]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-13T02:56:24.786 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:24 smithi089 ceph-mon[27639]: from='client.? 172.21.15.89:0/748416887' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T02:56:24.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:24 smithi131 ceph-mon[34689]: from='client.14800 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:56:24.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:24 smithi131 ceph-mon[34689]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:24.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:24 smithi131 ceph-mon[34689]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:24.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:24 smithi131 ceph-mon[34689]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:56:24.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:24 smithi131 ceph-mon[34689]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:56:24.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:24 smithi131 ceph-mon[34689]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:24.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:24 smithi131 ceph-mon[34689]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:56:24.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:24 smithi131 ceph-mon[34689]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:56:24.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:24 smithi131 ceph-mon[34689]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:24.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:24 smithi131 ceph-mon[34689]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi089.guohvs"}]: dispatch 2024-09-13T02:56:24.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:24 smithi131 ceph-mon[34689]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi089.guohvs"}]': finished 2024-09-13T02:56:24.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:24 smithi131 ceph-mon[34689]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi131.aunbqd"}]: dispatch 2024-09-13T02:56:24.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:24 smithi131 ceph-mon[34689]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi131.aunbqd"}]': finished 2024-09-13T02:56:24.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:24 smithi131 ceph-mon[34689]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-13T02:56:24.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:24 smithi131 ceph-mon[34689]: from='client.? 172.21.15.89:0/748416887' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T02:56:25.864 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:25 smithi089 ceph-mon[27639]: from='client.14812 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:56:25.865 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:25 smithi089 ceph-mon[27639]: Upgrade: Setting container_image for all mgr 2024-09-13T02:56:25.865 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:25 smithi089 ceph-mon[27639]: pgmap v17: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T02:56:25.865 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:25 smithi089 ceph-mon[27639]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:25.865 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:25 smithi089 ceph-mon[27639]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T02:56:25.865 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:25 smithi089 ceph-mon[27639]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T02:56:25.865 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:25 smithi089 ceph-mon[27639]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:56:25.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:25 smithi131 ceph-mon[34689]: from='client.14812 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:56:25.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:25 smithi131 ceph-mon[34689]: Upgrade: Setting container_image for all mgr 2024-09-13T02:56:25.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:25 smithi131 ceph-mon[34689]: pgmap v17: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T02:56:25.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:25 smithi131 ceph-mon[34689]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:25.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:25 smithi131 ceph-mon[34689]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T02:56:25.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:25 smithi131 ceph-mon[34689]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T02:56:25.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:25 smithi131 ceph-mon[34689]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:56:26.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:26 smithi089 ceph-mon[27639]: Upgrade: Updating mon.smithi089 2024-09-13T02:56:26.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:26 smithi089 ceph-mon[27639]: Deploying daemon mon.smithi089 on smithi089 2024-09-13T02:56:26.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:26 smithi131 ceph-mon[34689]: Upgrade: Updating mon.smithi089 2024-09-13T02:56:26.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:26 smithi131 ceph-mon[34689]: Deploying daemon mon.smithi089 on smithi089 2024-09-13T02:56:27.411 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:27 smithi089 systemd[1]: Stopping Ceph mon.smithi089 for 12cdb164-717a-11ef-bceb-c7b262605968... 2024-09-13T02:56:27.672 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:27 smithi089 ceph-12cdb164-717a-11ef-bceb-c7b262605968-mon-smithi089[27635]: 2024-09-13T02:56:27.409+0000 7ff2cc299640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi089 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T02:56:27.672 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:27 smithi089 ceph-12cdb164-717a-11ef-bceb-c7b262605968-mon-smithi089[27635]: 2024-09-13T02:56:27.409+0000 7ff2cc299640 -1 mon.smithi089@0(leader) e2 *** Got Signal Terminated *** 2024-09-13T02:56:27.969 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:27 smithi089 podman[91381]: 2024-09-13 02:56:27.67140691 +0000 UTC m=+0.377022773 container died d2f18141b2afcc73363d47d6b8def4b06204e0940ce706e27df611b6cc808e22 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-mon-smithi089, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=quincy-bbdadfa, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-13T02:56:28.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:28 smithi089 podman[91381]: 2024-09-13 02:56:28.152687691 +0000 UTC m=+0.858303557 container cleanup d2f18141b2afcc73363d47d6b8def4b06204e0940ce706e27df611b6cc808e22 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-mon-smithi089, GIT_CLEAN=True, RELEASE=quincy-bbdadfa, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-13T02:56:28.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:28 smithi089 bash[91381]: ceph-12cdb164-717a-11ef-bceb-c7b262605968-mon-smithi089 2024-09-13T02:56:28.659 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:28 smithi089 podman[91393]: 2024-09-13 02:56:28.396120356 +0000 UTC m=+0.727283375 container remove d2f18141b2afcc73363d47d6b8def4b06204e0940ce706e27df611b6cc808e22 (image=quay.ceph.io/ceph-ci/ceph:quincy, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-mon-smithi089, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=quincy-bbdadfa, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-13T02:56:28.660 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:28 smithi089 systemd[1]: ceph-12cdb164-717a-11ef-bceb-c7b262605968@mon.smithi089.service: Deactivated successfully. 2024-09-13T02:56:28.660 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:28 smithi089 systemd[1]: Stopped Ceph mon.smithi089 for 12cdb164-717a-11ef-bceb-c7b262605968. 2024-09-13T02:56:28.660 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:28 smithi089 systemd[1]: ceph-12cdb164-717a-11ef-bceb-c7b262605968@mon.smithi089.service: Consumed 10.302s CPU time. 2024-09-13T02:56:28.956 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:28 smithi089 systemd[1]: Starting Ceph mon.smithi089 for 12cdb164-717a-11ef-bceb-c7b262605968... 2024-09-13T02:56:29.259 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:28 smithi089 podman[91533]: 2024-09-13 02:56:28.858335623 +0000 UTC m=+0.015925917 image pull 19dc8d6597273a47b0b4862f1d0e037b0157b908a02acd63baceec3ee94fbd6c quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d 2024-09-13T02:56:29.259 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 podman[91533]: 2024-09-13 02:56:29.005658793 +0000 UTC m=+0.163249088 container create 8a29fb65028ffa278e3b6a3671fa8e0db870691b89be174d6ed87e62cc0c273b (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-mon-smithi089, RELEASE=squid-7741f7f, ceph=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=) 2024-09-13T02:56:29.259 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 podman[91533]: 2024-09-13 02:56:29.25853546 +0000 UTC m=+0.416125762 container init 8a29fb65028ffa278e3b6a3671fa8e0db870691b89be174d6ed87e62cc0c273b (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-mon-smithi089, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-7741f7f, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T02:56:29.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 podman[91533]: 2024-09-13 02:56:29.26221958 +0000 UTC m=+0.419809875 container start 8a29fb65028ffa278e3b6a3671fa8e0db870691b89be174d6ed87e62cc0c273b (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-mon-smithi089, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-7741f7f) 2024-09-13T02:56:29.536 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: set uid:gid to 167:167 (ceph:ceph) 2024-09-13T02:56:29.536 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable), process ceph-mon, pid 2 2024-09-13T02:56:29.536 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: pidfile_write: ignore empty --pid-file 2024-09-13T02:56:29.536 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: load: jerasure load: lrc 2024-09-13T02:56:29.536 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: RocksDB version: 7.9.2 2024-09-13T02:56:29.536 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Git sha 0 2024-09-13T02:56:29.536 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Compile date 2024-09-12 19:43:04 2024-09-13T02:56:29.536 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: DB SUMMARY 2024-09-13T02:56:29.536 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: DB Session ID: X1YSV1A2FQL9YY79YMWK 2024-09-13T02:56:29.536 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: CURRENT file: CURRENT 2024-09-13T02:56:29.536 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: IDENTITY file: IDENTITY 2024-09-13T02:56:29.537 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: MANIFEST file: MANIFEST-000015 size: 979 Bytes 2024-09-13T02:56:29.537 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi089/store.db dir, Total Num: 1, files: 000030.sst 2024-09-13T02:56:29.537 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi089/store.db: 000028.log size: 2351210 ; 2024-09-13T02:56:29.537 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.error_if_exists: 0 2024-09-13T02:56:29.537 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.create_if_missing: 0 2024-09-13T02:56:29.537 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.paranoid_checks: 1 2024-09-13T02:56:29.537 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-13T02:56:29.537 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-13T02:56:29.537 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-13T02:56:29.537 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.env: 0x5634a9bce940 2024-09-13T02:56:29.537 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.fs: PosixFileSystem 2024-09-13T02:56:29.537 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.info_log: 0x5634aabaf8c0 2024-09-13T02:56:29.538 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.max_file_opening_threads: 16 2024-09-13T02:56:29.538 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.statistics: (nil) 2024-09-13T02:56:29.538 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.use_fsync: 0 2024-09-13T02:56:29.538 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.max_log_file_size: 0 2024-09-13T02:56:29.538 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-13T02:56:29.538 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-13T02:56:29.538 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.keep_log_file_num: 1000 2024-09-13T02:56:29.538 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.recycle_log_file_num: 0 2024-09-13T02:56:29.538 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.allow_fallocate: 1 2024-09-13T02:56:29.538 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.allow_mmap_reads: 0 2024-09-13T02:56:29.538 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.allow_mmap_writes: 0 2024-09-13T02:56:29.538 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.use_direct_reads: 0 2024-09-13T02:56:29.538 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-13T02:56:29.539 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.create_missing_column_families: 0 2024-09-13T02:56:29.539 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.db_log_dir: 2024-09-13T02:56:29.539 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.wal_dir: 2024-09-13T02:56:29.539 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-13T02:56:29.539 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-13T02:56:29.539 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-13T02:56:29.539 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-13T02:56:29.539 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-13T02:56:29.539 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-13T02:56:29.539 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.advise_random_on_open: 1 2024-09-13T02:56:29.539 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.db_write_buffer_size: 0 2024-09-13T02:56:29.539 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.write_buffer_manager: 0x5634aabbedc0 2024-09-13T02:56:29.539 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-13T02:56:29.539 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-13T02:56:29.540 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-13T02:56:29.540 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.rate_limiter: (nil) 2024-09-13T02:56:29.540 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-13T02:56:29.540 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.wal_recovery_mode: 2 2024-09-13T02:56:29.540 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.enable_thread_tracking: 0 2024-09-13T02:56:29.540 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.enable_pipelined_write: 0 2024-09-13T02:56:29.540 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.unordered_write: 0 2024-09-13T02:56:29.540 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-13T02:56:29.540 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-13T02:56:29.540 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-13T02:56:29.540 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-13T02:56:29.540 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.row_cache: None 2024-09-13T02:56:29.540 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.wal_filter: None 2024-09-13T02:56:29.540 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-13T02:56:29.541 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.allow_ingest_behind: 0 2024-09-13T02:56:29.541 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.two_write_queues: 0 2024-09-13T02:56:29.541 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.manual_wal_flush: 0 2024-09-13T02:56:29.541 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.wal_compression: 0 2024-09-13T02:56:29.541 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.atomic_flush: 0 2024-09-13T02:56:29.541 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-13T02:56:29.541 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-13T02:56:29.541 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-13T02:56:29.542 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.log_readahead_size: 0 2024-09-13T02:56:29.543 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-13T02:56:29.543 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.best_efforts_recovery: 0 2024-09-13T02:56:29.543 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-13T02:56:29.543 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-13T02:56:29.543 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.allow_data_in_errors: 0 2024-09-13T02:56:29.543 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.db_host_id: __hostname__ 2024-09-13T02:56:29.543 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-13T02:56:29.543 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.max_background_jobs: 2 2024-09-13T02:56:29.543 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.max_background_compactions: -1 2024-09-13T02:56:29.543 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.max_subcompactions: 1 2024-09-13T02:56:29.543 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-13T02:56:29.543 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-13T02:56:29.544 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-13T02:56:29.544 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.max_total_wal_size: 0 2024-09-13T02:56:29.544 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-13T02:56:29.544 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-13T02:56:29.544 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-13T02:56:29.544 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-13T02:56:29.544 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.max_open_files: -1 2024-09-13T02:56:29.544 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.bytes_per_sync: 0 2024-09-13T02:56:29.544 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-13T02:56:29.544 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-13T02:56:29.544 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.compaction_readahead_size: 0 2024-09-13T02:56:29.544 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.max_background_flushes: -1 2024-09-13T02:56:29.544 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Compression algorithms supported: 2024-09-13T02:56:29.544 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: kZSTD supported: 0 2024-09-13T02:56:29.545 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: kXpressCompression supported: 0 2024-09-13T02:56:29.545 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: kBZip2Compression supported: 0 2024-09-13T02:56:29.545 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-13T02:56:29.545 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: kLZ4Compression supported: 1 2024-09-13T02:56:29.545 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: kZlibCompression supported: 1 2024-09-13T02:56:29.545 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: kLZ4HCCompression supported: 1 2024-09-13T02:56:29.545 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: kSnappyCompression supported: 1 2024-09-13T02:56:29.545 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-13T02:56:29.545 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-13T02:56:29.545 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi089/store.db/MANIFEST-000015 2024-09-13T02:56:29.546 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-13T02:56:29.546 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-13T02:56:29.546 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.merge_operator: 2024-09-13T02:56:29.546 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.compaction_filter: None 2024-09-13T02:56:29.546 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.compaction_filter_factory: None 2024-09-13T02:56:29.546 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.sst_partitioner_factory: None 2024-09-13T02:56:29.546 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-13T02:56:29.546 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-13T02:56:29.546 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5634aabaf520) 2024-09-13T02:56:29.546 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: cache_index_and_filter_blocks: 1 2024-09-13T02:56:29.547 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-13T02:56:29.547 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-13T02:56:29.547 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: pin_top_level_index_and_filter: 1 2024-09-13T02:56:29.547 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: index_type: 0 2024-09-13T02:56:29.547 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: data_block_index_type: 0 2024-09-13T02:56:29.547 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: index_shortening: 1 2024-09-13T02:56:29.547 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-13T02:56:29.547 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: checksum: 4 2024-09-13T02:56:29.547 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: no_block_cache: 0 2024-09-13T02:56:29.547 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: block_cache: 0x5634aaba31f0 2024-09-13T02:56:29.547 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: block_cache_name: BinnedLRUCache 2024-09-13T02:56:29.547 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: block_cache_options: 2024-09-13T02:56:29.548 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: capacity : 536870912 2024-09-13T02:56:29.548 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: num_shard_bits : 4 2024-09-13T02:56:29.548 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: strict_capacity_limit : 0 2024-09-13T02:56:29.548 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: high_pri_pool_ratio: 0.000 2024-09-13T02:56:29.548 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: block_cache_compressed: (nil) 2024-09-13T02:56:29.548 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: persistent_cache: (nil) 2024-09-13T02:56:29.548 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: block_size: 4096 2024-09-13T02:56:29.548 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: block_size_deviation: 10 2024-09-13T02:56:29.548 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: block_restart_interval: 16 2024-09-13T02:56:29.548 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: index_block_restart_interval: 1 2024-09-13T02:56:29.548 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: metadata_block_size: 4096 2024-09-13T02:56:29.548 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: partition_filters: 0 2024-09-13T02:56:29.548 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: use_delta_encoding: 1 2024-09-13T02:56:29.549 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: filter_policy: bloomfilter 2024-09-13T02:56:29.549 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: whole_key_filtering: 1 2024-09-13T02:56:29.549 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: verify_compression: 0 2024-09-13T02:56:29.549 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: read_amp_bytes_per_bit: 0 2024-09-13T02:56:29.549 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: format_version: 5 2024-09-13T02:56:29.549 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: enable_index_compression: 1 2024-09-13T02:56:29.549 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: block_align: 0 2024-09-13T02:56:29.549 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: max_auto_readahead_size: 262144 2024-09-13T02:56:29.549 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: prepopulate_block_cache: 0 2024-09-13T02:56:29.549 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: initial_auto_readahead_size: 8192 2024-09-13T02:56:29.549 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: num_file_reads_for_auto_readahead: 2 2024-09-13T02:56:29.549 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.write_buffer_size: 33554432 2024-09-13T02:56:29.549 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.max_write_buffer_number: 2 2024-09-13T02:56:29.550 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.compression: NoCompression 2024-09-13T02:56:29.550 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.bottommost_compression: Disabled 2024-09-13T02:56:29.550 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.prefix_extractor: nullptr 2024-09-13T02:56:29.550 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-13T02:56:29.550 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.num_levels: 7 2024-09-13T02:56:29.550 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-13T02:56:29.550 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-13T02:56:29.550 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-13T02:56:29.550 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-13T02:56:29.550 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-13T02:56:29.550 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-13T02:56:29.550 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-13T02:56:29.550 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-13T02:56:29.550 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-13T02:56:29.551 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-13T02:56:29.551 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-13T02:56:29.551 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-13T02:56:29.551 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-13T02:56:29.551 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.compression_opts.level: 32767 2024-09-13T02:56:29.551 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.compression_opts.strategy: 0 2024-09-13T02:56:29.551 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-13T02:56:29.551 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-13T02:56:29.551 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-13T02:56:29.551 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-13T02:56:29.551 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.compression_opts.enabled: false 2024-09-13T02:56:29.551 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-13T02:56:29.552 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-13T02:56:29.552 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-13T02:56:29.552 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-13T02:56:29.552 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.target_file_size_base: 67108864 2024-09-13T02:56:29.552 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-13T02:56:29.552 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-13T02:56:29.552 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-13T02:56:29.552 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-13T02:56:29.552 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-13T02:56:29.552 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-13T02:56:29.552 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-13T02:56:29.552 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-13T02:56:29.553 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-13T02:56:29.553 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-13T02:56:29.553 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-13T02:56:29.553 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-13T02:56:29.553 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-13T02:56:29.553 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-13T02:56:29.553 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.arena_block_size: 1048576 2024-09-13T02:56:29.553 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-13T02:56:29.553 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-13T02:56:29.553 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.disable_auto_compactions: 0 2024-09-13T02:56:29.553 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-13T02:56:29.553 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-13T02:56:29.553 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-13T02:56:29.553 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-13T02:56:29.554 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-13T02:56:29.554 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-13T02:56:29.554 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-13T02:56:29.554 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-13T02:56:29.554 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-13T02:56:29.554 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-13T02:56:29.554 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-13T02:56:29.554 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.inplace_update_support: 0 2024-09-13T02:56:29.554 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-13T02:56:29.554 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-13T02:56:29.554 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-13T02:56:29.554 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-13T02:56:29.554 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.bloom_locality: 0 2024-09-13T02:56:29.555 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.max_successive_merges: 0 2024-09-13T02:56:29.555 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-13T02:56:29.555 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.paranoid_file_checks: 0 2024-09-13T02:56:29.555 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.force_consistency_checks: 1 2024-09-13T02:56:29.555 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.report_bg_io_stats: 0 2024-09-13T02:56:29.555 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.ttl: 2592000 2024-09-13T02:56:29.555 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-13T02:56:29.555 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-13T02:56:29.555 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-13T02:56:29.555 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.enable_blob_files: false 2024-09-13T02:56:29.555 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.min_blob_size: 0 2024-09-13T02:56:29.555 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.blob_file_size: 268435456 2024-09-13T02:56:29.555 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-13T02:56:29.556 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-13T02:56:29.556 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-13T02:56:29.556 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-13T02:56:29.556 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-13T02:56:29.556 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.blob_file_starting_level: 0 2024-09-13T02:56:29.556 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-13T02:56:29.556 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 30.sst 2024-09-13T02:56:29.556 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-13T02:56:29.556 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi089/store.db/MANIFEST-000015 succeeded,manifest_file_number is 15, next_file_number is 32, last_sequence is 10412, log_number is 28,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-13T02:56:29.556 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 28 2024-09-13T02:56:29.557 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: e7d314da-89cb-41fd-bf5c-5bb1cc0e184b 2024-09-13T02:56:29.557 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726196189288414, "job": 1, "event": "recovery_started", "wal_files": [28]} 2024-09-13T02:56:29.557 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #28 mode 2 2024-09-13T02:56:29.557 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726196189294993, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 33, "file_size": 2157394, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 10413, "largest_seqno": 11213, "table_properties": {"data_size": 2152821, "index_size": 2569, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 965, "raw_key_size": 9121, "raw_average_key_size": 23, "raw_value_size": 2144466, "raw_average_value_size": 5584, "num_data_blocks": 117, "num_entries": 384, "num_filter_entries": 384, "num_deletions": 2, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726196189, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "e7d314da-89cb-41fd-bf5c-5bb1cc0e184b", "db_session_id": "X1YSV1A2FQL9YY79YMWK", "orig_file_number": 33, "seqno_to_time_mapping": "N/A"}} 2024-09-13T02:56:29.557 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726196189295111, "job": 1, "event": "recovery_finished"} 2024-09-13T02:56:29.557 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: [db/version_set.cc:5047] Creating manifest 35 2024-09-13T02:56:29.557 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-13T02:56:29.557 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi089/store.db/000028.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-13T02:56:29.557 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5634aabd0e00 2024-09-13T02:56:29.557 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: DB pointer 0x5634aaccc000 2024-09-13T02:56:29.557 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-13T02:56:29.557 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-13T02:56:29.558 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: ** DB Stats ** 2024-09-13T02:56:29.558 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-13T02:56:29.558 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-13T02:56:29.558 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-13T02:56:29.558 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-13T02:56:29.558 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-13T02:56:29.558 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-13T02:56:29.558 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-13T02:56:29.558 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: 2024-09-13T02:56:29.559 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: ** Compaction Stats [default] ** 2024-09-13T02:56:29.559 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-13T02:56:29.559 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-13T02:56:29.559 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: L0 1/0 2.06 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 617.7 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-09-13T02:56:29.559 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: L6 1/0 5.27 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-13T02:56:29.559 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Sum 2/0 7.33 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 617.7 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-09-13T02:56:29.559 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 617.7 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-09-13T02:56:29.559 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: 2024-09-13T02:56:29.559 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: ** Compaction Stats [default] ** 2024-09-13T02:56:29.559 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-13T02:56:29.559 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-13T02:56:29.559 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 617.7 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-09-13T02:56:29.559 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: 2024-09-13T02:56:29.560 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-13T02:56:29.560 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: 2024-09-13T02:56:29.560 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-13T02:56:29.560 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Flush(GB): cumulative 0.002, interval 0.002 2024-09-13T02:56:29.560 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-13T02:56:29.560 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-13T02:56:29.560 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-13T02:56:29.560 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-13T02:56:29.560 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Cumulative compaction: 0.00 GB write, 185.98 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T02:56:29.560 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Interval compaction: 0.00 GB write, 185.98 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T02:56:29.560 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-13T02:56:29.560 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Block cache BinnedLRUCache@0x5634aaba31f0#2 capacity: 512.00 MB usage: 3.86 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-09-13T02:56:29.560 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,1.03 KB,0.000196695%) IndexBlock(1,2.83 KB,0.000539422%) Misc(1,0.00 KB,0%) 2024-09-13T02:56:29.561 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: 2024-09-13T02:56:29.561 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-13T02:56:29.561 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: starting mon.smithi089 rank 0 at public addrs [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] at bind addrs [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi089 fsid 12cdb164-717a-11ef-bceb-c7b262605968 2024-09-13T02:56:29.561 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: mon.smithi089@-1(???) e2 preinit fsid 12cdb164-717a-11ef-bceb-c7b262605968 2024-09-13T02:56:29.561 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: mon.smithi089@-1(???).mds e21 new map 2024-09-13T02:56:29.561 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: mon.smithi089@-1(???).mds e21 print_map 2024-09-13T02:56:29.561 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: e21 2024-09-13T02:56:29.561 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: btime 1970-01-01T00:00:00:000000+0000 2024-09-13T02:56:29.561 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T02:56:29.561 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:56:29.561 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: legacy client fscid: 1 2024-09-13T02:56:29.561 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: 2024-09-13T02:56:29.562 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Filesystem 'cephfs' (1) 2024-09-13T02:56:29.562 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: fs_name cephfs 2024-09-13T02:56:29.562 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: epoch 21 2024-09-13T02:56:29.562 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T02:56:29.562 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: created 2024-09-13T02:51:40.657817+0000 2024-09-13T02:56:29.562 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: modified 2024-09-13T02:54:05.118633+0000 2024-09-13T02:56:29.562 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: tableserver 0 2024-09-13T02:56:29.562 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: root 0 2024-09-13T02:56:29.562 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: session_timeout 60 2024-09-13T02:56:29.562 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: session_autoclose 300 2024-09-13T02:56:29.562 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: max_file_size 1099511627776 2024-09-13T02:56:29.562 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: max_xattr_size 65536 2024-09-13T02:56:29.562 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: required_client_features {} 2024-09-13T02:56:29.563 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: last_failure 0 2024-09-13T02:56:29.563 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: last_failure_osd_epoch 44 2024-09-13T02:56:29.563 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:56:29.563 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: max_mds 2 2024-09-13T02:56:29.563 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: in 0,1 2024-09-13T02:56:29.563 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: up {0=14480,1=24257} 2024-09-13T02:56:29.564 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: failed 2024-09-13T02:56:29.564 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: damaged 2024-09-13T02:56:29.564 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: stopped 2024-09-13T02:56:29.564 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: data_pools [3] 2024-09-13T02:56:29.564 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: metadata_pool 2 2024-09-13T02:56:29.565 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: inline_data disabled 2024-09-13T02:56:29.565 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: balancer 2024-09-13T02:56:29.565 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: bal_rank_mask -1 2024-09-13T02:56:29.565 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: standby_count_wanted 1 2024-09-13T02:56:29.565 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: qdb_cluster leader: 0 members: 2024-09-13T02:56:29.566 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: [mds.cephfs.smithi089.rarddb{0:14480} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.89:6828/1561365213,v1:172.21.15.89:6829/1561365213] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:56:29.566 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: [mds.cephfs.smithi089.qjoitb{0:14488} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.89:6826/1464393547,v1:172.21.15.89:6827/1464393547] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:56:29.566 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: [mds.cephfs.smithi131.uasrkg{1:24257} state up:active seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.131:6824/260493836,v1:172.21.15.131:6825/260493836] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:56:29.566 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: [mds.cephfs.smithi131.rbovzc{1:24265} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.131:6826/665579373,v1:172.21.15.131:6827/665579373] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:56:29.566 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: 2024-09-13T02:56:29.566 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: 2024-09-13T02:56:29.566 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: mon.smithi089@-1(???).osd e46 crush map has features 3314933000852226048, adjusting msgr requires 2024-09-13T02:56:29.566 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: mon.smithi089@-1(???).osd e46 crush map has features 288514051259236352, adjusting msgr requires 2024-09-13T02:56:29.566 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: mon.smithi089@-1(???).osd e46 crush map has features 288514051259236352, adjusting msgr requires 2024-09-13T02:56:29.566 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: mon.smithi089@-1(???).osd e46 crush map has features 288514051259236352, adjusting msgr requires 2024-09-13T02:56:29.566 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 ceph-mon[91553]: mon.smithi089@-1(???).paxosservice(auth 1..20) refresh upgraded, format 0 -> 3 2024-09-13T02:56:29.566 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 bash[91533]: 8a29fb65028ffa278e3b6a3671fa8e0db870691b89be174d6ed87e62cc0c273b 2024-09-13T02:56:29.566 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:29 smithi089 systemd[1]: Started Ceph mon.smithi089 for 12cdb164-717a-11ef-bceb-c7b262605968. 2024-09-13T02:56:31.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:30 smithi089 ceph-mon[91553]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mon metadata", "id": "smithi089"}]: dispatch 2024-09-13T02:56:31.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:30 smithi089 ceph-mon[91553]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mon metadata", "id": "smithi131"}]: dispatch 2024-09-13T02:56:31.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:30 smithi089 ceph-mon[91553]: pgmap v19: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T02:56:31.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:30 smithi089 ceph-mon[91553]: pgmap v20: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T02:56:31.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:30 smithi089 ceph-mon[91553]: mon.smithi089 calling monitor election 2024-09-13T02:56:31.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:30 smithi089 ceph-mon[91553]: mon.smithi089 is new leader, mons smithi089,smithi131 in quorum (ranks 0,1) 2024-09-13T02:56:31.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:30 smithi089 ceph-mon[91553]: monmap epoch 2 2024-09-13T02:56:31.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:30 smithi089 ceph-mon[91553]: fsid 12cdb164-717a-11ef-bceb-c7b262605968 2024-09-13T02:56:31.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:30 smithi089 ceph-mon[91553]: last_changed 2024-09-13T02:47:24.164531+0000 2024-09-13T02:56:31.037 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:30 smithi089 ceph-mon[91553]: created 2024-09-13T02:45:02.514381+0000 2024-09-13T02:56:31.037 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:30 smithi089 ceph-mon[91553]: min_mon_release 17 (quincy) 2024-09-13T02:56:31.037 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:30 smithi089 ceph-mon[91553]: election_strategy: 1 2024-09-13T02:56:31.037 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:30 smithi089 ceph-mon[91553]: 0: [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] mon.smithi089 2024-09-13T02:56:31.037 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:30 smithi089 ceph-mon[91553]: 1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.smithi131 2024-09-13T02:56:31.037 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:30 smithi089 ceph-mon[91553]: fsmap cephfs:2 {0=cephfs.smithi089.rarddb=up:active,1=cephfs.smithi131.uasrkg=up:active} 2 up:standby-replay 2024-09-13T02:56:31.037 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:30 smithi089 ceph-mon[91553]: osdmap e46: 6 total, 6 up, 6 in 2024-09-13T02:56:31.037 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:30 smithi089 ceph-mon[91553]: mgrmap e32: smithi089.guohvs(active, since 34s), standbys: smithi131.aunbqd 2024-09-13T02:56:31.038 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:30 smithi089 ceph-mon[91553]: overall HEALTH_OK 2024-09-13T02:56:31.038 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:30 smithi089 ceph-mon[91553]: from='mgr.14734 ' entity='' 2024-09-13T02:56:31.038 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:30 smithi089 ceph-mon[91553]: mgrmap e33: smithi089.guohvs(active, since 34s), standbys: smithi131.aunbqd 2024-09-13T02:56:31.084 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:30 smithi131 ceph-mon[34689]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mon metadata", "id": "smithi089"}]: dispatch 2024-09-13T02:56:31.084 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:30 smithi131 ceph-mon[34689]: from='mgr.14734 172.21.15.89:0/1014691722' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mon metadata", "id": "smithi131"}]: dispatch 2024-09-13T02:56:31.084 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:30 smithi131 ceph-mon[34689]: pgmap v19: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T02:56:31.084 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:30 smithi131 ceph-mon[34689]: pgmap v20: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T02:56:31.084 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:30 smithi131 ceph-mon[34689]: mon.smithi089 calling monitor election 2024-09-13T02:56:31.084 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:30 smithi131 ceph-mon[34689]: mon.smithi089 is new leader, mons smithi089,smithi131 in quorum (ranks 0,1) 2024-09-13T02:56:31.084 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:30 smithi131 ceph-mon[34689]: monmap epoch 2 2024-09-13T02:56:31.084 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:30 smithi131 ceph-mon[34689]: fsid 12cdb164-717a-11ef-bceb-c7b262605968 2024-09-13T02:56:31.084 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:30 smithi131 ceph-mon[34689]: last_changed 2024-09-13T02:47:24.164531+0000 2024-09-13T02:56:31.084 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:30 smithi131 ceph-mon[34689]: created 2024-09-13T02:45:02.514381+0000 2024-09-13T02:56:31.084 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:30 smithi131 ceph-mon[34689]: min_mon_release 17 (quincy) 2024-09-13T02:56:31.085 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:30 smithi131 ceph-mon[34689]: election_strategy: 1 2024-09-13T02:56:31.085 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:30 smithi131 ceph-mon[34689]: 0: [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] mon.smithi089 2024-09-13T02:56:31.085 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:30 smithi131 ceph-mon[34689]: 1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.smithi131 2024-09-13T02:56:31.085 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:30 smithi131 ceph-mon[34689]: fsmap cephfs:2 {0=cephfs.smithi089.rarddb=up:active,1=cephfs.smithi131.uasrkg=up:active} 2 up:standby-replay 2024-09-13T02:56:31.085 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:30 smithi131 ceph-mon[34689]: osdmap e46: 6 total, 6 up, 6 in 2024-09-13T02:56:31.085 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:30 smithi131 ceph-mon[34689]: mgrmap e32: smithi089.guohvs(active, since 34s), standbys: smithi131.aunbqd 2024-09-13T02:56:31.085 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:30 smithi131 ceph-mon[34689]: overall HEALTH_OK 2024-09-13T02:56:31.085 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:30 smithi131 ceph-mon[34689]: from='mgr.14734 ' entity='' 2024-09-13T02:56:31.085 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:30 smithi131 ceph-mon[34689]: mgrmap e33: smithi089.guohvs(active, since 34s), standbys: smithi131.aunbqd 2024-09-13T02:56:35.772 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:35 smithi089 ceph-mon[91553]: Standby manager daemon smithi131.aunbqd restarted 2024-09-13T02:56:35.772 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:35 smithi089 ceph-mon[91553]: Standby manager daemon smithi131.aunbqd started 2024-09-13T02:56:35.772 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:35 smithi089 ceph-mon[91553]: from='mgr.? 172.21.15.131:0/30657218' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi131.aunbqd/crt"}]: dispatch 2024-09-13T02:56:35.773 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:35 smithi089 ceph-mon[91553]: from='mgr.? 172.21.15.131:0/30657218' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T02:56:35.773 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:35 smithi089 ceph-mon[91553]: from='mgr.? 172.21.15.131:0/30657218' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi131.aunbqd/key"}]: dispatch 2024-09-13T02:56:35.773 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:35 smithi089 ceph-mon[91553]: from='mgr.? 172.21.15.131:0/30657218' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T02:56:35.773 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:35 smithi089 ceph-mon[91553]: Active manager daemon smithi089.guohvs restarted 2024-09-13T02:56:35.773 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:35 smithi089 ceph-mon[91553]: Activating manager daemon smithi089.guohvs 2024-09-13T02:56:35.773 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:35 smithi089 ceph-mon[91553]: osdmap e47: 6 total, 6 up, 6 in 2024-09-13T02:56:35.773 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:35 smithi089 ceph-mon[91553]: mgrmap e34: smithi089.guohvs(active, starting, since 0.00582416s), standbys: smithi131.aunbqd 2024-09-13T02:56:35.773 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:35 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mon metadata", "id": "smithi089"}]: dispatch 2024-09-13T02:56:35.773 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:35 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mon metadata", "id": "smithi131"}]: dispatch 2024-09-13T02:56:35.773 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:35 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi089.rarddb"}]: dispatch 2024-09-13T02:56:35.773 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:35 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi089.qjoitb"}]: dispatch 2024-09-13T02:56:35.773 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:35 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi131.uasrkg"}]: dispatch 2024-09-13T02:56:35.774 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:35 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi131.rbovzc"}]: dispatch 2024-09-13T02:56:35.774 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:35 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mgr metadata", "who": "smithi089.guohvs", "id": "smithi089.guohvs"}]: dispatch 2024-09-13T02:56:35.774 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:35 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mgr metadata", "who": "smithi131.aunbqd", "id": "smithi131.aunbqd"}]: dispatch 2024-09-13T02:56:35.774 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:35 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T02:56:35.774 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:35 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T02:56:35.774 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:35 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T02:56:35.774 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:35 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T02:56:35.774 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:35 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T02:56:35.774 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:35 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T02:56:35.774 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:35 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T02:56:35.774 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:35 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T02:56:35.774 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:35 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T02:56:35.774 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:35 smithi089 ceph-mon[91553]: Manager daemon smithi089.guohvs is now available 2024-09-13T02:56:35.826 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:35 smithi131 ceph-mon[34689]: Standby manager daemon smithi131.aunbqd restarted 2024-09-13T02:56:35.826 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:35 smithi131 ceph-mon[34689]: Standby manager daemon smithi131.aunbqd started 2024-09-13T02:56:35.826 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:35 smithi131 ceph-mon[34689]: from='mgr.? 172.21.15.131:0/30657218' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi131.aunbqd/crt"}]: dispatch 2024-09-13T02:56:35.826 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:35 smithi131 ceph-mon[34689]: from='mgr.? 172.21.15.131:0/30657218' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-13T02:56:35.826 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:35 smithi131 ceph-mon[34689]: from='mgr.? 172.21.15.131:0/30657218' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi131.aunbqd/key"}]: dispatch 2024-09-13T02:56:35.826 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:35 smithi131 ceph-mon[34689]: from='mgr.? 172.21.15.131:0/30657218' entity='mgr.smithi131.aunbqd' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-13T02:56:35.826 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:35 smithi131 ceph-mon[34689]: Active manager daemon smithi089.guohvs restarted 2024-09-13T02:56:35.826 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:35 smithi131 ceph-mon[34689]: Activating manager daemon smithi089.guohvs 2024-09-13T02:56:35.826 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:35 smithi131 ceph-mon[34689]: osdmap e47: 6 total, 6 up, 6 in 2024-09-13T02:56:35.826 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:35 smithi131 ceph-mon[34689]: mgrmap e34: smithi089.guohvs(active, starting, since 0.00582416s), standbys: smithi131.aunbqd 2024-09-13T02:56:35.826 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:35 smithi131 ceph-mon[34689]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mon metadata", "id": "smithi089"}]: dispatch 2024-09-13T02:56:35.827 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:35 smithi131 ceph-mon[34689]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mon metadata", "id": "smithi131"}]: dispatch 2024-09-13T02:56:35.827 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:35 smithi131 ceph-mon[34689]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi089.rarddb"}]: dispatch 2024-09-13T02:56:35.827 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:35 smithi131 ceph-mon[34689]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi089.qjoitb"}]: dispatch 2024-09-13T02:56:35.827 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:35 smithi131 ceph-mon[34689]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi131.uasrkg"}]: dispatch 2024-09-13T02:56:35.827 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:35 smithi131 ceph-mon[34689]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi131.rbovzc"}]: dispatch 2024-09-13T02:56:35.827 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:35 smithi131 ceph-mon[34689]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mgr metadata", "who": "smithi089.guohvs", "id": "smithi089.guohvs"}]: dispatch 2024-09-13T02:56:35.827 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:35 smithi131 ceph-mon[34689]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mgr metadata", "who": "smithi131.aunbqd", "id": "smithi131.aunbqd"}]: dispatch 2024-09-13T02:56:35.827 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:35 smithi131 ceph-mon[34689]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T02:56:35.827 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:35 smithi131 ceph-mon[34689]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T02:56:35.827 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:35 smithi131 ceph-mon[34689]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T02:56:35.827 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:35 smithi131 ceph-mon[34689]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T02:56:35.827 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:35 smithi131 ceph-mon[34689]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T02:56:35.827 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:35 smithi131 ceph-mon[34689]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T02:56:35.827 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:35 smithi131 ceph-mon[34689]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-13T02:56:35.828 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:35 smithi131 ceph-mon[34689]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-13T02:56:35.828 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:35 smithi131 ceph-mon[34689]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-13T02:56:35.828 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:35 smithi131 ceph-mon[34689]: Manager daemon smithi089.guohvs is now available 2024-09-13T02:56:36.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:36 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:56:36.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:36 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:56:36.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:36 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi089.guohvs/mirror_snapshot_schedule"}]: dispatch 2024-09-13T02:56:36.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:36 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi089.guohvs/trash_purge_schedule"}]: dispatch 2024-09-13T02:56:36.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:36 smithi089 ceph-mon[91553]: mgrmap e35: smithi089.guohvs(active, since 1.00942s), standbys: smithi131.aunbqd 2024-09-13T02:56:36.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:36 smithi131 ceph-mon[34689]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:56:36.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:36 smithi131 ceph-mon[34689]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:56:36.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:36 smithi131 ceph-mon[34689]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi089.guohvs/mirror_snapshot_schedule"}]: dispatch 2024-09-13T02:56:36.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:36 smithi131 ceph-mon[34689]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi089.guohvs/trash_purge_schedule"}]: dispatch 2024-09-13T02:56:36.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:36 smithi131 ceph-mon[34689]: mgrmap e35: smithi089.guohvs(active, since 1.00942s), standbys: smithi131.aunbqd 2024-09-13T02:56:37.887 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:37 smithi089 ceph-mon[91553]: [13/Sep/2024:02:56:36] ENGINE Bus STARTING 2024-09-13T02:56:37.933 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:37 smithi131 ceph-mon[34689]: [13/Sep/2024:02:56:36] ENGINE Bus STARTING 2024-09-13T02:56:38.877 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:38 smithi089 ceph-mon[91553]: [13/Sep/2024:02:56:36] ENGINE Serving on http://172.21.15.89:8765 2024-09-13T02:56:38.877 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:38 smithi089 ceph-mon[91553]: [13/Sep/2024:02:56:36] ENGINE Serving on https://172.21.15.89:7150 2024-09-13T02:56:38.877 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:38 smithi089 ceph-mon[91553]: [13/Sep/2024:02:56:36] ENGINE Bus STARTED 2024-09-13T02:56:38.877 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:38 smithi089 ceph-mon[91553]: [13/Sep/2024:02:56:36] ENGINE Error in HTTPServer.serve 2024-09-13T02:56:38.877 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: Traceback (most recent call last): 2024-09-13T02:56:38.877 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T02:56:38.877 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: self._connections.run(self.expiration_interval) 2024-09-13T02:56:38.877 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T02:56:38.877 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: self._run(expiration_interval) 2024-09-13T02:56:38.877 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T02:56:38.878 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T02:56:38.878 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T02:56:38.878 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T02:56:38.878 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T02:56:38.878 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: s = self.context.wrap_socket( 2024-09-13T02:56:38.878 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T02:56:38.878 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: return self.sslsocket_class._create( 2024-09-13T02:56:38.878 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T02:56:38.878 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: self.do_handshake() 2024-09-13T02:56:38.878 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T02:56:38.878 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: self._sslobj.do_handshake() 2024-09-13T02:56:38.878 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T02:56:38.878 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:38 smithi089 ceph-mon[91553]: pgmap v4: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:56:38.879 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:38 smithi089 ceph-mon[91553]: mgrmap e36: smithi089.guohvs(active, since 2s), standbys: smithi131.aunbqd 2024-09-13T02:56:38.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:38 smithi131 ceph-mon[34689]: [13/Sep/2024:02:56:36] ENGINE Serving on http://172.21.15.89:8765 2024-09-13T02:56:38.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:38 smithi131 ceph-mon[34689]: [13/Sep/2024:02:56:36] ENGINE Serving on https://172.21.15.89:7150 2024-09-13T02:56:38.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:38 smithi131 ceph-mon[34689]: [13/Sep/2024:02:56:36] ENGINE Bus STARTED 2024-09-13T02:56:38.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:38 smithi131 ceph-mon[34689]: [13/Sep/2024:02:56:36] ENGINE Error in HTTPServer.serve 2024-09-13T02:56:38.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: Traceback (most recent call last): 2024-09-13T02:56:38.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-13T02:56:38.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: self._connections.run(self.expiration_interval) 2024-09-13T02:56:38.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-13T02:56:38.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: self._run(expiration_interval) 2024-09-13T02:56:38.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-13T02:56:38.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-13T02:56:38.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-13T02:56:38.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-13T02:56:38.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-13T02:56:38.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: s = self.context.wrap_socket( 2024-09-13T02:56:38.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-13T02:56:38.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: return self.sslsocket_class._create( 2024-09-13T02:56:38.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-13T02:56:38.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: self.do_handshake() 2024-09-13T02:56:38.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-13T02:56:38.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: self._sslobj.do_handshake() 2024-09-13T02:56:38.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-13T02:56:38.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:38 smithi131 ceph-mon[34689]: pgmap v4: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:56:38.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:38 smithi131 ceph-mon[34689]: mgrmap e36: smithi089.guohvs(active, since 2s), standbys: smithi131.aunbqd 2024-09-13T02:56:39.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:39 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:39.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:39 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:39.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:39 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:39.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:39 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:39.852 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:39 smithi131 ceph-mon[34689]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:39.852 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:39 smithi131 ceph-mon[34689]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:39.852 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:39 smithi131 ceph-mon[34689]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:39.852 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:39 smithi131 ceph-mon[34689]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:40.753 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:40 smithi131 ceph-mon[34689]: pgmap v5: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:56:40.753 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:40 smithi131 ceph-mon[34689]: mgrmap e37: smithi089.guohvs(active, since 4s), standbys: smithi131.aunbqd 2024-09-13T02:56:41.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:40 smithi089 ceph-mon[91553]: pgmap v5: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-09-13T02:56:41.039 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:40 smithi089 ceph-mon[91553]: mgrmap e37: smithi089.guohvs(active, since 4s), standbys: smithi131.aunbqd 2024-09-13T02:56:42.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:41 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:42.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:41 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:42.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:41 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:42.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:41 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:42.063 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:41 smithi131 ceph-mon[34689]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:42.063 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:41 smithi131 ceph-mon[34689]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:42.063 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:41 smithi131 ceph-mon[34689]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:42.063 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:41 smithi131 ceph-mon[34689]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:43.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:42 smithi089 ceph-mon[91553]: pgmap v6: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 42 KiB/s rd, 0 B/s wr, 25 op/s 2024-09-13T02:56:43.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:42 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:43.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:42 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:43.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:42 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:56:43.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:42 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:56:43.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:42 smithi131 ceph-mon[34689]: pgmap v6: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 42 KiB/s rd, 0 B/s wr, 25 op/s 2024-09-13T02:56:43.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:42 smithi131 ceph-mon[34689]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:43.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:42 smithi131 ceph-mon[34689]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:43.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:42 smithi131 ceph-mon[34689]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:56:43.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:42 smithi131 ceph-mon[34689]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:56:43.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:43 smithi089 ceph-mon[91553]: Updating smithi089:/etc/ceph/ceph.conf 2024-09-13T02:56:43.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:43 smithi089 ceph-mon[91553]: Updating smithi131:/etc/ceph/ceph.conf 2024-09-13T02:56:43.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:43 smithi089 ceph-mon[91553]: Updating smithi089:/var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T02:56:43.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:43 smithi089 ceph-mon[91553]: Updating smithi131:/var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T02:56:43.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:43 smithi089 ceph-mon[91553]: Updating smithi089:/etc/ceph/ceph.client.admin.keyring 2024-09-13T02:56:43.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:43 smithi089 ceph-mon[91553]: Updating smithi131:/etc/ceph/ceph.client.admin.keyring 2024-09-13T02:56:43.786 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:43 smithi089 ceph-mon[91553]: Updating smithi089:/var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T02:56:43.786 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:43 smithi089 ceph-mon[91553]: Updating smithi131:/var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T02:56:43.786 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:43 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:43.786 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:43 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:43.786 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:43 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:43.786 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:43 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:43.786 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:43 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:43.786 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:43 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:56:43.786 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:43 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:56:43.786 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:43 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-13T02:56:44.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:43 smithi131 ceph-mon[34689]: Updating smithi089:/etc/ceph/ceph.conf 2024-09-13T02:56:44.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:43 smithi131 ceph-mon[34689]: Updating smithi131:/etc/ceph/ceph.conf 2024-09-13T02:56:44.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:43 smithi131 ceph-mon[34689]: Updating smithi089:/var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T02:56:44.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:43 smithi131 ceph-mon[34689]: Updating smithi131:/var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-13T02:56:44.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:43 smithi131 ceph-mon[34689]: Updating smithi089:/etc/ceph/ceph.client.admin.keyring 2024-09-13T02:56:44.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:43 smithi131 ceph-mon[34689]: Updating smithi131:/etc/ceph/ceph.client.admin.keyring 2024-09-13T02:56:44.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:43 smithi131 ceph-mon[34689]: Updating smithi089:/var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T02:56:44.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:43 smithi131 ceph-mon[34689]: Updating smithi131:/var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-13T02:56:44.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:43 smithi131 ceph-mon[34689]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:44.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:43 smithi131 ceph-mon[34689]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:44.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:43 smithi131 ceph-mon[34689]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:44.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:43 smithi131 ceph-mon[34689]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:44.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:43 smithi131 ceph-mon[34689]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:44.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:43 smithi131 ceph-mon[34689]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:56:44.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:43 smithi131 ceph-mon[34689]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:56:44.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:43 smithi131 ceph-mon[34689]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-09-13T02:56:44.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:44 smithi131 ceph-mon[34689]: pgmap v7: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 31 KiB/s rd, 0 B/s wr, 19 op/s 2024-09-13T02:56:45.000 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:44 smithi131 ceph-mon[34689]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:45.000 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:44 smithi131 ceph-mon[34689]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T02:56:45.000 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:44 smithi131 ceph-mon[34689]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T02:56:45.000 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:44 smithi131 ceph-mon[34689]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:56:45.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:44 smithi089 ceph-mon[91553]: pgmap v7: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 31 KiB/s rd, 0 B/s wr, 19 op/s 2024-09-13T02:56:45.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:44 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:45.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:44 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T02:56:45.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:44 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T02:56:45.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:44 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:56:45.793 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:45 smithi131 ceph-mon[34689]: Upgrade: Updating mon.smithi131 2024-09-13T02:56:45.793 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:45 smithi131 ceph-mon[34689]: Deploying daemon mon.smithi131 on smithi131 2024-09-13T02:56:46.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:45 smithi089 ceph-mon[91553]: Upgrade: Updating mon.smithi131 2024-09-13T02:56:46.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:45 smithi089 ceph-mon[91553]: Deploying daemon mon.smithi131 on smithi131 2024-09-13T02:56:46.365 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:46 smithi131 systemd[1]: Stopping Ceph mon.smithi131 for 12cdb164-717a-11ef-bceb-c7b262605968... 2024-09-13T02:56:46.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:46 smithi131 ceph-12cdb164-717a-11ef-bceb-c7b262605968-mon-smithi131[34682]: 2024-09-13T02:56:46.362+0000 7f9352e21640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi131 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T02:56:46.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:46 smithi131 ceph-12cdb164-717a-11ef-bceb-c7b262605968-mon-smithi131[34682]: 2024-09-13T02:56:46.362+0000 7f9352e21640 -1 mon.smithi131@1(peon) e2 *** Got Signal Terminated *** 2024-09-13T02:56:46.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:46 smithi131 podman[78677]: 2024-09-13 02:56:46.455873501 +0000 UTC m=+0.231280979 container died 1191e59dc7a0fe16e6e1dbad0a9a713065d35efd57f8a5ab8c88082e891424e8 (image=quay.ceph.io/ceph-ci/ceph@sha256:20745bd452f31fe48c67c092910f9b2c550f9dc62d239ff3e2953415a85590be, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-mon-smithi131, RELEASE=quincy-bbdadfa, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T02:56:47.117 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:46 smithi131 podman[78677]: 2024-09-13 02:56:46.815012606 +0000 UTC m=+0.590420078 container cleanup 1191e59dc7a0fe16e6e1dbad0a9a713065d35efd57f8a5ab8c88082e891424e8 (image=quay.ceph.io/ceph-ci/ceph@sha256:20745bd452f31fe48c67c092910f9b2c550f9dc62d239ff3e2953415a85590be, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-mon-smithi131, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=quincy-bbdadfa, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD) 2024-09-13T02:56:47.117 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:46 smithi131 bash[78677]: ceph-12cdb164-717a-11ef-bceb-c7b262605968-mon-smithi131 2024-09-13T02:56:47.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 podman[78689]: 2024-09-13 02:56:47.116588601 +0000 UTC m=+0.652054862 container remove 1191e59dc7a0fe16e6e1dbad0a9a713065d35efd57f8a5ab8c88082e891424e8 (image=quay.ceph.io/ceph-ci/ceph@sha256:20745bd452f31fe48c67c092910f9b2c550f9dc62d239ff3e2953415a85590be, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-mon-smithi131, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=quincy-bbdadfa, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-13T02:56:47.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 systemd[1]: ceph-12cdb164-717a-11ef-bceb-c7b262605968@mon.smithi131.service: Deactivated successfully. 2024-09-13T02:56:47.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 systemd[1]: Stopped Ceph mon.smithi131 for 12cdb164-717a-11ef-bceb-c7b262605968. 2024-09-13T02:56:47.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 systemd[1]: ceph-12cdb164-717a-11ef-bceb-c7b262605968@mon.smithi131.service: Consumed 5.567s CPU time. 2024-09-13T02:56:47.825 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 systemd[1]: Starting Ceph mon.smithi131 for 12cdb164-717a-11ef-bceb-c7b262605968... 2024-09-13T02:56:47.828 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 podman[78819]: 2024-09-13 02:56:47.603318294 +0000 UTC m=+0.015742519 image pull 19dc8d6597273a47b0b4862f1d0e037b0157b908a02acd63baceec3ee94fbd6c quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d 2024-09-13T02:56:47.828 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 podman[78819]: 2024-09-13 02:56:47.717462688 +0000 UTC m=+0.129886912 container create 506310ad86204c45c4619d6903672a4bfe0a284455a3c7e55361345d837d7042 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-mon-smithi131, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=squid-7741f7f, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-13T02:56:48.123 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 podman[78819]: 2024-09-13 02:56:47.919998346 +0000 UTC m=+0.332422580 container init 506310ad86204c45c4619d6903672a4bfe0a284455a3c7e55361345d837d7042 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-mon-smithi131, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-7741f7f, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T02:56:48.123 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 podman[78819]: 2024-09-13 02:56:47.923297752 +0000 UTC m=+0.335721982 container start 506310ad86204c45c4619d6903672a4bfe0a284455a3c7e55361345d837d7042 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-mon-smithi131, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-7741f7f, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0) 2024-09-13T02:56:48.123 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: set uid:gid to 167:167 (ceph:ceph) 2024-09-13T02:56:48.123 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable), process ceph-mon, pid 2 2024-09-13T02:56:48.123 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: pidfile_write: ignore empty --pid-file 2024-09-13T02:56:48.123 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: load: jerasure load: lrc 2024-09-13T02:56:48.123 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: RocksDB version: 7.9.2 2024-09-13T02:56:48.123 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Git sha 0 2024-09-13T02:56:48.123 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Compile date 2024-09-12 19:43:04 2024-09-13T02:56:48.124 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: DB SUMMARY 2024-09-13T02:56:48.124 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: DB Session ID: N69RKEMUW2HBYYLBAML2 2024-09-13T02:56:48.124 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: CURRENT file: CURRENT 2024-09-13T02:56:48.124 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: IDENTITY file: IDENTITY 2024-09-13T02:56:48.124 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: MANIFEST file: MANIFEST-000009 size: 903 Bytes 2024-09-13T02:56:48.124 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi131/store.db dir, Total Num: 1, files: 000024.sst 2024-09-13T02:56:48.124 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi131/store.db: 000022.log size: 6061516 ; 2024-09-13T02:56:48.124 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.error_if_exists: 0 2024-09-13T02:56:48.124 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.create_if_missing: 0 2024-09-13T02:56:48.124 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.paranoid_checks: 1 2024-09-13T02:56:48.124 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-13T02:56:48.125 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-13T02:56:48.125 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-13T02:56:48.125 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.env: 0x5601a7d1e940 2024-09-13T02:56:48.125 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.fs: PosixFileSystem 2024-09-13T02:56:48.125 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.info_log: 0x5601a95f38c0 2024-09-13T02:56:48.125 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.max_file_opening_threads: 16 2024-09-13T02:56:48.126 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.statistics: (nil) 2024-09-13T02:56:48.127 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.use_fsync: 0 2024-09-13T02:56:48.127 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.max_log_file_size: 0 2024-09-13T02:56:48.127 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-13T02:56:48.127 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-13T02:56:48.127 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.keep_log_file_num: 1000 2024-09-13T02:56:48.127 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.recycle_log_file_num: 0 2024-09-13T02:56:48.127 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.allow_fallocate: 1 2024-09-13T02:56:48.127 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.allow_mmap_reads: 0 2024-09-13T02:56:48.127 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.allow_mmap_writes: 0 2024-09-13T02:56:48.127 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.use_direct_reads: 0 2024-09-13T02:56:48.127 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-13T02:56:48.127 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.create_missing_column_families: 0 2024-09-13T02:56:48.127 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.db_log_dir: 2024-09-13T02:56:48.128 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.wal_dir: 2024-09-13T02:56:48.128 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-13T02:56:48.128 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-13T02:56:48.128 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-13T02:56:48.128 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-13T02:56:48.128 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-13T02:56:48.128 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-13T02:56:48.128 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.advise_random_on_open: 1 2024-09-13T02:56:48.128 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.db_write_buffer_size: 0 2024-09-13T02:56:48.128 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.write_buffer_manager: 0x5601a9602dc0 2024-09-13T02:56:48.128 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-13T02:56:48.128 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-13T02:56:48.128 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-13T02:56:48.129 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.rate_limiter: (nil) 2024-09-13T02:56:48.129 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-13T02:56:48.129 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.wal_recovery_mode: 2 2024-09-13T02:56:48.129 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.enable_thread_tracking: 0 2024-09-13T02:56:48.129 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.enable_pipelined_write: 0 2024-09-13T02:56:48.129 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.unordered_write: 0 2024-09-13T02:56:48.129 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-13T02:56:48.129 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-13T02:56:48.129 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-13T02:56:48.129 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-13T02:56:48.129 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.row_cache: None 2024-09-13T02:56:48.129 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.wal_filter: None 2024-09-13T02:56:48.129 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-13T02:56:48.129 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.allow_ingest_behind: 0 2024-09-13T02:56:48.130 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.two_write_queues: 0 2024-09-13T02:56:48.130 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.manual_wal_flush: 0 2024-09-13T02:56:48.130 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.wal_compression: 0 2024-09-13T02:56:48.130 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.atomic_flush: 0 2024-09-13T02:56:48.130 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-13T02:56:48.130 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-13T02:56:48.130 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-13T02:56:48.130 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.log_readahead_size: 0 2024-09-13T02:56:48.130 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-13T02:56:48.130 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.best_efforts_recovery: 0 2024-09-13T02:56:48.130 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-13T02:56:48.130 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-13T02:56:48.130 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.allow_data_in_errors: 0 2024-09-13T02:56:48.130 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.db_host_id: __hostname__ 2024-09-13T02:56:48.131 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-13T02:56:48.131 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.max_background_jobs: 2 2024-09-13T02:56:48.131 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.max_background_compactions: -1 2024-09-13T02:56:48.131 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.max_subcompactions: 1 2024-09-13T02:56:48.131 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-13T02:56:48.131 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-13T02:56:48.131 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-13T02:56:48.131 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.max_total_wal_size: 0 2024-09-13T02:56:48.131 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-13T02:56:48.131 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-13T02:56:48.131 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-13T02:56:48.131 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-13T02:56:48.131 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.max_open_files: -1 2024-09-13T02:56:48.131 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.bytes_per_sync: 0 2024-09-13T02:56:48.132 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-13T02:56:48.132 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-13T02:56:48.132 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.compaction_readahead_size: 0 2024-09-13T02:56:48.132 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.max_background_flushes: -1 2024-09-13T02:56:48.132 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Compression algorithms supported: 2024-09-13T02:56:48.132 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: kZSTD supported: 0 2024-09-13T02:56:48.132 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: kXpressCompression supported: 0 2024-09-13T02:56:48.132 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: kBZip2Compression supported: 0 2024-09-13T02:56:48.132 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-13T02:56:48.132 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: kLZ4Compression supported: 1 2024-09-13T02:56:48.132 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: kZlibCompression supported: 1 2024-09-13T02:56:48.132 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: kLZ4HCCompression supported: 1 2024-09-13T02:56:48.132 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: kSnappyCompression supported: 1 2024-09-13T02:56:48.133 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-13T02:56:48.133 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-13T02:56:48.133 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi131/store.db/MANIFEST-000009 2024-09-13T02:56:48.133 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-13T02:56:48.133 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-13T02:56:48.133 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.merge_operator: 2024-09-13T02:56:48.133 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.compaction_filter: None 2024-09-13T02:56:48.133 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.compaction_filter_factory: None 2024-09-13T02:56:48.133 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.sst_partitioner_factory: None 2024-09-13T02:56:48.133 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-13T02:56:48.133 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-13T02:56:48.133 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5601a95f3520) 2024-09-13T02:56:48.133 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: cache_index_and_filter_blocks: 1 2024-09-13T02:56:48.134 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-13T02:56:48.134 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-13T02:56:48.134 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: pin_top_level_index_and_filter: 1 2024-09-13T02:56:48.134 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: index_type: 0 2024-09-13T02:56:48.134 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: data_block_index_type: 0 2024-09-13T02:56:48.134 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: index_shortening: 1 2024-09-13T02:56:48.134 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-13T02:56:48.134 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: checksum: 4 2024-09-13T02:56:48.134 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: no_block_cache: 0 2024-09-13T02:56:48.134 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: block_cache: 0x5601a95e71f0 2024-09-13T02:56:48.134 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: block_cache_name: BinnedLRUCache 2024-09-13T02:56:48.134 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: block_cache_options: 2024-09-13T02:56:48.134 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: capacity : 536870912 2024-09-13T02:56:48.134 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: num_shard_bits : 4 2024-09-13T02:56:48.135 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: strict_capacity_limit : 0 2024-09-13T02:56:48.135 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: high_pri_pool_ratio: 0.000 2024-09-13T02:56:48.135 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: block_cache_compressed: (nil) 2024-09-13T02:56:48.135 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: persistent_cache: (nil) 2024-09-13T02:56:48.135 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: block_size: 4096 2024-09-13T02:56:48.135 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: block_size_deviation: 10 2024-09-13T02:56:48.135 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: block_restart_interval: 16 2024-09-13T02:56:48.135 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: index_block_restart_interval: 1 2024-09-13T02:56:48.135 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: metadata_block_size: 4096 2024-09-13T02:56:48.135 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: partition_filters: 0 2024-09-13T02:56:48.135 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: use_delta_encoding: 1 2024-09-13T02:56:48.135 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: filter_policy: bloomfilter 2024-09-13T02:56:48.135 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: whole_key_filtering: 1 2024-09-13T02:56:48.135 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: verify_compression: 0 2024-09-13T02:56:48.136 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: read_amp_bytes_per_bit: 0 2024-09-13T02:56:48.136 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: format_version: 5 2024-09-13T02:56:48.136 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: enable_index_compression: 1 2024-09-13T02:56:48.136 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: block_align: 0 2024-09-13T02:56:48.136 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: max_auto_readahead_size: 262144 2024-09-13T02:56:48.136 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: prepopulate_block_cache: 0 2024-09-13T02:56:48.136 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: initial_auto_readahead_size: 8192 2024-09-13T02:56:48.136 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: num_file_reads_for_auto_readahead: 2 2024-09-13T02:56:48.136 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.write_buffer_size: 33554432 2024-09-13T02:56:48.136 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.max_write_buffer_number: 2 2024-09-13T02:56:48.136 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.compression: NoCompression 2024-09-13T02:56:48.136 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.bottommost_compression: Disabled 2024-09-13T02:56:48.136 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.prefix_extractor: nullptr 2024-09-13T02:56:48.137 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-13T02:56:48.137 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.num_levels: 7 2024-09-13T02:56:48.137 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-13T02:56:48.137 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-13T02:56:48.137 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-13T02:56:48.137 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-13T02:56:48.137 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-13T02:56:48.137 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-13T02:56:48.137 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-13T02:56:48.137 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-13T02:56:48.137 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-13T02:56:48.137 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-13T02:56:48.137 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-13T02:56:48.138 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-13T02:56:48.138 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-13T02:56:48.138 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.compression_opts.level: 32767 2024-09-13T02:56:48.138 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.compression_opts.strategy: 0 2024-09-13T02:56:48.138 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-13T02:56:48.138 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-13T02:56:48.138 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-13T02:56:48.138 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-13T02:56:48.138 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.compression_opts.enabled: false 2024-09-13T02:56:48.138 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-13T02:56:48.138 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-13T02:56:48.138 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-13T02:56:48.138 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-13T02:56:48.138 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.target_file_size_base: 67108864 2024-09-13T02:56:48.138 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-13T02:56:48.139 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-13T02:56:48.139 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-13T02:56:48.139 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-13T02:56:48.139 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-13T02:56:48.139 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-13T02:56:48.139 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-13T02:56:48.139 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-13T02:56:48.139 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-13T02:56:48.139 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-13T02:56:48.139 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-13T02:56:48.139 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-13T02:56:48.139 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-13T02:56:48.139 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-13T02:56:48.139 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.arena_block_size: 1048576 2024-09-13T02:56:48.140 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-13T02:56:48.140 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-13T02:56:48.140 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.disable_auto_compactions: 0 2024-09-13T02:56:48.140 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-13T02:56:48.140 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-13T02:56:48.140 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-13T02:56:48.140 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-13T02:56:48.140 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-13T02:56:48.140 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-13T02:56:48.141 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-13T02:56:48.141 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-13T02:56:48.141 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-13T02:56:48.141 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-13T02:56:48.141 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-13T02:56:48.141 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.inplace_update_support: 0 2024-09-13T02:56:48.141 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-13T02:56:48.141 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-13T02:56:48.141 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-13T02:56:48.141 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-13T02:56:48.141 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.bloom_locality: 0 2024-09-13T02:56:48.142 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.max_successive_merges: 0 2024-09-13T02:56:48.142 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-13T02:56:48.142 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.paranoid_file_checks: 0 2024-09-13T02:56:48.142 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.force_consistency_checks: 1 2024-09-13T02:56:48.142 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.report_bg_io_stats: 0 2024-09-13T02:56:48.142 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.ttl: 2592000 2024-09-13T02:56:48.142 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-13T02:56:48.142 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-13T02:56:48.142 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-13T02:56:48.142 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.enable_blob_files: false 2024-09-13T02:56:48.142 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.min_blob_size: 0 2024-09-13T02:56:48.142 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.blob_file_size: 268435456 2024-09-13T02:56:48.142 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-13T02:56:48.142 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-13T02:56:48.143 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-13T02:56:48.143 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-13T02:56:48.143 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-13T02:56:48.143 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.blob_file_starting_level: 0 2024-09-13T02:56:48.143 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-13T02:56:48.143 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 24.sst 2024-09-13T02:56:48.143 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-13T02:56:48.143 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi131/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 26, last_sequence is 10542, log_number is 22,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-13T02:56:48.143 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 22 2024-09-13T02:56:48.143 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: bfba9d6b-672c-4bb3-97fe-b14ff4d8d85a 2024-09-13T02:56:48.143 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726196207949948, "job": 1, "event": "recovery_started", "wal_files": [22]} 2024-09-13T02:56:48.143 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #22 mode 2 2024-09-13T02:56:48.143 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726196207964212, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 27, "file_size": 3648622, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 10547, "largest_seqno": 11875, "table_properties": {"data_size": 3642237, "index_size": 3868, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 1477, "raw_key_size": 13618, "raw_average_key_size": 23, "raw_value_size": 3629843, "raw_average_value_size": 6301, "num_data_blocks": 176, "num_entries": 576, "num_filter_entries": 576, "num_deletions": 2, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726196207, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "bfba9d6b-672c-4bb3-97fe-b14ff4d8d85a", "db_session_id": "N69RKEMUW2HBYYLBAML2", "orig_file_number": 27, "seqno_to_time_mapping": "N/A"}} 2024-09-13T02:56:48.144 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726196207964353, "job": 1, "event": "recovery_finished"} 2024-09-13T02:56:48.144 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: [db/version_set.cc:5047] Creating manifest 29 2024-09-13T02:56:48.144 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-09-13T02:56:48.144 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi131/store.db/000022.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-13T02:56:48.144 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5601a9614e00 2024-09-13T02:56:48.144 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: DB pointer 0x5601a9710000 2024-09-13T02:56:48.144 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-13T02:56:48.144 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-13T02:56:48.144 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: ** DB Stats ** 2024-09-13T02:56:48.144 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-13T02:56:48.144 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-13T02:56:48.144 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-13T02:56:48.144 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-13T02:56:48.145 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-13T02:56:48.145 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-13T02:56:48.145 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-13T02:56:48.145 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: 2024-09-13T02:56:48.145 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: ** Compaction Stats [default] ** 2024-09-13T02:56:48.145 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-13T02:56:48.145 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-13T02:56:48.145 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: L0 1/0 3.48 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 509.5 0.01 0.00 1 0.007 0 0 0.0 0.0 2024-09-13T02:56:48.145 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: L6 1/0 5.27 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-09-13T02:56:48.145 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: Sum 2/0 8.75 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 509.5 0.01 0.00 1 0.007 0 0 0.0 0.0 2024-09-13T02:56:48.145 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 509.5 0.01 0.00 1 0.007 0 0 0.0 0.0 2024-09-13T02:56:48.145 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: 2024-09-13T02:56:48.145 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: ** Compaction Stats [default] ** 2024-09-13T02:56:48.145 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-13T02:56:48.146 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-13T02:56:48.146 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 509.5 0.01 0.00 1 0.007 0 0 0.0 0.0 2024-09-13T02:56:48.146 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: 2024-09-13T02:56:48.146 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-13T02:56:48.146 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: 2024-09-13T02:56:48.146 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-13T02:56:48.146 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: Flush(GB): cumulative 0.003, interval 0.003 2024-09-13T02:56:48.146 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-13T02:56:48.146 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-13T02:56:48.146 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-13T02:56:48.146 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-13T02:56:48.146 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: Cumulative compaction: 0.00 GB write, 193.70 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T02:56:48.146 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: Interval compaction: 0.00 GB write, 193.70 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-13T02:56:48.146 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-13T02:56:48.147 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: Block cache BinnedLRUCache@0x5601a95e71f0#2 capacity: 512.00 MB usage: 5.61 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1.1e-05 secs_since: 0 2024-09-13T02:56:48.147 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,1.53 KB,0.000292063%) IndexBlock(1,4.08 KB,0.000777841%) Misc(1,0.00 KB,0%) 2024-09-13T02:56:48.147 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: 2024-09-13T02:56:48.147 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-13T02:56:48.147 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: starting mon.smithi131 rank 1 at public addrs [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] at bind addrs [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi131 fsid 12cdb164-717a-11ef-bceb-c7b262605968 2024-09-13T02:56:48.147 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: mon.smithi131@-1(???) e2 preinit fsid 12cdb164-717a-11ef-bceb-c7b262605968 2024-09-13T02:56:48.147 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: mon.smithi131@-1(???).mds e21 new map 2024-09-13T02:56:48.147 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: mon.smithi131@-1(???).mds e21 print_map 2024-09-13T02:56:48.147 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: e21 2024-09-13T02:56:48.147 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: btime 1970-01-01T00:00:00:000000+0000 2024-09-13T02:56:48.147 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T02:56:48.147 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:56:48.147 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: legacy client fscid: 1 2024-09-13T02:56:48.148 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: 2024-09-13T02:56:48.148 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: Filesystem 'cephfs' (1) 2024-09-13T02:56:48.148 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: fs_name cephfs 2024-09-13T02:56:48.148 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: epoch 21 2024-09-13T02:56:48.148 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T02:56:48.148 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: created 2024-09-13T02:51:40.657817+0000 2024-09-13T02:56:48.148 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: modified 2024-09-13T02:54:05.118633+0000 2024-09-13T02:56:48.148 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: tableserver 0 2024-09-13T02:56:48.148 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: root 0 2024-09-13T02:56:48.148 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: session_timeout 60 2024-09-13T02:56:48.148 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: session_autoclose 300 2024-09-13T02:56:48.148 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: max_file_size 1099511627776 2024-09-13T02:56:48.148 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: max_xattr_size 65536 2024-09-13T02:56:48.148 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: required_client_features {} 2024-09-13T02:56:48.149 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: last_failure 0 2024-09-13T02:56:48.149 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: last_failure_osd_epoch 44 2024-09-13T02:56:48.149 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:56:48.149 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: max_mds 2 2024-09-13T02:56:48.149 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: in 0,1 2024-09-13T02:56:48.149 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: up {0=14480,1=24257} 2024-09-13T02:56:48.149 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: failed 2024-09-13T02:56:48.149 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: damaged 2024-09-13T02:56:48.149 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: stopped 2024-09-13T02:56:48.149 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: data_pools [3] 2024-09-13T02:56:48.149 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: metadata_pool 2 2024-09-13T02:56:48.149 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: inline_data disabled 2024-09-13T02:56:48.149 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: balancer 2024-09-13T02:56:48.149 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: bal_rank_mask -1 2024-09-13T02:56:48.150 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: standby_count_wanted 1 2024-09-13T02:56:48.150 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: qdb_cluster leader: 0 members: 2024-09-13T02:56:48.150 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: [mds.cephfs.smithi089.rarddb{0:14480} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.89:6828/1561365213,v1:172.21.15.89:6829/1561365213] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:56:48.150 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: [mds.cephfs.smithi089.qjoitb{0:14488} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.89:6826/1464393547,v1:172.21.15.89:6827/1464393547] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:56:48.150 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: [mds.cephfs.smithi131.uasrkg{1:24257} state up:active seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.131:6824/260493836,v1:172.21.15.131:6825/260493836] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:56:48.150 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: [mds.cephfs.smithi131.rbovzc{1:24265} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.131:6826/665579373,v1:172.21.15.131:6827/665579373] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:56:48.150 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: 2024-09-13T02:56:48.150 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout: 2024-09-13T02:56:48.150 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: mon.smithi131@-1(???).osd e47 crush map has features 3314933000852226048, adjusting msgr requires 2024-09-13T02:56:48.150 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: mon.smithi131@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2024-09-13T02:56:48.150 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: mon.smithi131@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2024-09-13T02:56:48.150 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: mon.smithi131@-1(???).osd e47 crush map has features 288514051259236352, adjusting msgr requires 2024-09-13T02:56:48.150 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 ceph-mon[78839]: mon.smithi131@-1(???).paxosservice(auth 1..21) refresh upgraded, format 0 -> 3 2024-09-13T02:56:48.150 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 bash[78819]: 506310ad86204c45c4619d6903672a4bfe0a284455a3c7e55361345d837d7042 2024-09-13T02:56:48.150 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:47 smithi131 systemd[1]: Started Ceph mon.smithi131 for 12cdb164-717a-11ef-bceb-c7b262605968. 2024-09-13T02:56:48.151 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:48 smithi131 ceph-mon[78839]: pgmap v8: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 24 KiB/s rd, 0 B/s wr, 15 op/s 2024-09-13T02:56:48.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:48 smithi089 ceph-mon[91553]: pgmap v8: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 24 KiB/s rd, 0 B/s wr, 15 op/s 2024-09-13T02:56:49.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:49 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mon metadata", "id": "smithi089"}]: dispatch 2024-09-13T02:56:49.435 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:49 smithi131 ceph-mon[78839]: mon.smithi131 calling monitor election 2024-09-13T02:56:49.435 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:49 smithi131 ceph-mon[78839]: mon.smithi089 calling monitor election 2024-09-13T02:56:49.435 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:49 smithi131 ceph-mon[78839]: mon.smithi089 is new leader, mons smithi089,smithi131 in quorum (ranks 0,1) 2024-09-13T02:56:49.435 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:49 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mon metadata", "id": "smithi131"}]: dispatch 2024-09-13T02:56:49.435 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:49 smithi131 ceph-mon[78839]: monmap epoch 3 2024-09-13T02:56:49.435 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:49 smithi131 ceph-mon[78839]: fsid 12cdb164-717a-11ef-bceb-c7b262605968 2024-09-13T02:56:49.435 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:49 smithi131 ceph-mon[78839]: last_changed 2024-09-13T02:56:48.124685+0000 2024-09-13T02:56:49.436 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:49 smithi131 ceph-mon[78839]: created 2024-09-13T02:45:02.514381+0000 2024-09-13T02:56:49.436 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:49 smithi131 ceph-mon[78839]: min_mon_release 19 (squid) 2024-09-13T02:56:49.436 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:49 smithi131 ceph-mon[78839]: election_strategy: 1 2024-09-13T02:56:49.436 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:49 smithi131 ceph-mon[78839]: 0: [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] mon.smithi089 2024-09-13T02:56:49.436 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:49 smithi131 ceph-mon[78839]: 1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.smithi131 2024-09-13T02:56:49.436 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:49 smithi131 ceph-mon[78839]: fsmap cephfs:2 {0=cephfs.smithi089.rarddb=up:active,1=cephfs.smithi131.uasrkg=up:active} 2 up:standby-replay 2024-09-13T02:56:49.436 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:49 smithi131 ceph-mon[78839]: osdmap e47: 6 total, 6 up, 6 in 2024-09-13T02:56:49.436 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:49 smithi131 ceph-mon[78839]: mgrmap e37: smithi089.guohvs(active, since 12s), standbys: smithi131.aunbqd 2024-09-13T02:56:49.437 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:49 smithi131 ceph-mon[78839]: overall HEALTH_OK 2024-09-13T02:56:49.437 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:49 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:49.437 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:49 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:49.437 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:49 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:56:49.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:49 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mon metadata", "id": "smithi089"}]: dispatch 2024-09-13T02:56:49.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:49 smithi089 ceph-mon[91553]: mon.smithi131 calling monitor election 2024-09-13T02:56:49.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:49 smithi089 ceph-mon[91553]: mon.smithi089 calling monitor election 2024-09-13T02:56:49.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:49 smithi089 ceph-mon[91553]: mon.smithi089 is new leader, mons smithi089,smithi131 in quorum (ranks 0,1) 2024-09-13T02:56:49.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:49 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mon metadata", "id": "smithi131"}]: dispatch 2024-09-13T02:56:49.536 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:49 smithi089 ceph-mon[91553]: monmap epoch 3 2024-09-13T02:56:49.536 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:49 smithi089 ceph-mon[91553]: fsid 12cdb164-717a-11ef-bceb-c7b262605968 2024-09-13T02:56:49.536 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:49 smithi089 ceph-mon[91553]: last_changed 2024-09-13T02:56:48.124685+0000 2024-09-13T02:56:49.536 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:49 smithi089 ceph-mon[91553]: created 2024-09-13T02:45:02.514381+0000 2024-09-13T02:56:49.536 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:49 smithi089 ceph-mon[91553]: min_mon_release 19 (squid) 2024-09-13T02:56:49.536 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:49 smithi089 ceph-mon[91553]: election_strategy: 1 2024-09-13T02:56:49.536 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:49 smithi089 ceph-mon[91553]: 0: [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] mon.smithi089 2024-09-13T02:56:49.536 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:49 smithi089 ceph-mon[91553]: 1: [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] mon.smithi131 2024-09-13T02:56:49.536 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:49 smithi089 ceph-mon[91553]: fsmap cephfs:2 {0=cephfs.smithi089.rarddb=up:active,1=cephfs.smithi131.uasrkg=up:active} 2 up:standby-replay 2024-09-13T02:56:49.536 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:49 smithi089 ceph-mon[91553]: osdmap e47: 6 total, 6 up, 6 in 2024-09-13T02:56:49.536 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:49 smithi089 ceph-mon[91553]: mgrmap e37: smithi089.guohvs(active, since 12s), standbys: smithi131.aunbqd 2024-09-13T02:56:49.536 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:49 smithi089 ceph-mon[91553]: overall HEALTH_OK 2024-09-13T02:56:49.537 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:49 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:49.537 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:49 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:49.537 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:49 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:56:50.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:50 smithi131 ceph-mon[78839]: pgmap v10: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 12 op/s 2024-09-13T02:56:50.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:50 smithi089 ceph-mon[91553]: pgmap v10: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 12 op/s 2024-09-13T02:56:51.433 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:51 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:56:51.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:51 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:51.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:51 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:51.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:51 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:56:51.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:51 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:51.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:51 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:52.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:52 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:52.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:52 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:52.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:52 smithi131 ceph-mon[78839]: pgmap v11: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 13 op/s 2024-09-13T02:56:52.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:52 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:52.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:52 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:52.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:52 smithi089 ceph-mon[91553]: pgmap v11: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 13 op/s 2024-09-13T02:56:54.084 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:53 smithi131 ceph-mon[78839]: pgmap v12: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T02:56:54.140 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.137+0000 7fc9f173c640 1 -- 172.21.15.89:0/3632766861 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9ec0fc530 msgr2=0x7fc9ec0fc940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:54.140 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.137+0000 7fc9f173c640 1 --2- 172.21.15.89:0/3632766861 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9ec0fc530 0x7fc9ec0fc940 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc0048d0 tx=0x7fc9dc009da0 comp rx=0 tx=0).stop 2024-09-13T02:56:54.140 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.137+0000 7fc9f173c640 1 -- 172.21.15.89:0/3632766861 shutdown_connections 2024-09-13T02:56:54.140 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.137+0000 7fc9f173c640 1 --2- 172.21.15.89:0/3632766861 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9ec0fd800 0x7fc9ec0fdc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:54.140 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.137+0000 7fc9f173c640 1 --2- 172.21.15.89:0/3632766861 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9ec0fc530 0x7fc9ec0fc940 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:54.140 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.137+0000 7fc9f173c640 1 -- 172.21.15.89:0/3632766861 >> 172.21.15.89:0/3632766861 conn(0x7fc9ec0f7d10 msgr2=0x7fc9ec0fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:56:54.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.137+0000 7fc9f173c640 1 -- 172.21.15.89:0/3632766861 shutdown_connections 2024-09-13T02:56:54.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.137+0000 7fc9f173c640 1 -- 172.21.15.89:0/3632766861 wait complete. 2024-09-13T02:56:54.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.137+0000 7fc9f173c640 1 Processor -- start 2024-09-13T02:56:54.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.137+0000 7fc9f173c640 1 -- start start 2024-09-13T02:56:54.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.137+0000 7fc9f173c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9ec0fc530 0x7fc9ec071570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:54.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.137+0000 7fc9f173c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9ec0fd800 0x7fc9ec06fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:54.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.137+0000 7fc9f173c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9ec06fff0 con 0x7fc9ec0fc530 2024-09-13T02:56:54.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.137+0000 7fc9f173c640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9ec070130 con 0x7fc9ec0fd800 2024-09-13T02:56:54.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.138+0000 7fc9eaffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9ec0fc530 0x7fc9ec071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:54.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.138+0000 7fc9eaffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9ec0fc530 0x7fc9ec071570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:57726/0 (socket says 172.21.15.89:57726) 2024-09-13T02:56:54.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.138+0000 7fc9eaffd640 1 -- 172.21.15.89:0/2573820403 learned_addr learned my addr 172.21.15.89:0/2573820403 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:56:54.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.138+0000 7fc9e3fff640 1 --2- 172.21.15.89:0/2573820403 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9ec0fd800 0x7fc9ec06fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:54.142 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.138+0000 7fc9eaffd640 1 -- 172.21.15.89:0/2573820403 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9ec0fd800 msgr2=0x7fc9ec06fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:54.142 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.138+0000 7fc9eaffd640 1 --2- 172.21.15.89:0/2573820403 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9ec0fd800 0x7fc9ec06fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:54.142 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.138+0000 7fc9eaffd640 1 -- 172.21.15.89:0/2573820403 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9dc005040 con 0x7fc9ec0fc530 2024-09-13T02:56:54.142 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.138+0000 7fc9eaffd640 1 --2- 172.21.15.89:0/2573820403 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9ec0fc530 0x7fc9ec071570 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc0043d0 tx=0x7fc9dc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:56:54.142 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.138+0000 7fc9e37fe640 1 -- 172.21.15.89:0/2573820403 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc9dc038070 con 0x7fc9ec0fc530 2024-09-13T02:56:54.142 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.138+0000 7fc9e37fe640 1 -- 172.21.15.89:0/2573820403 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc9dc009800 con 0x7fc9ec0fc530 2024-09-13T02:56:54.142 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.138+0000 7fc9f173c640 1 -- 172.21.15.89:0/2573820403 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9ec0703b0 con 0x7fc9ec0fc530 2024-09-13T02:56:54.142 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.138+0000 7fc9e37fe640 1 -- 172.21.15.89:0/2573820403 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc9dc03e670 con 0x7fc9ec0fc530 2024-09-13T02:56:54.142 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.138+0000 7fc9f173c640 1 -- 172.21.15.89:0/2573820403 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9ec0708d0 con 0x7fc9ec0fc530 2024-09-13T02:56:54.143 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.140+0000 7fc9f173c640 1 -- 172.21.15.89:0/2573820403 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9ec0fb990 con 0x7fc9ec0fc530 2024-09-13T02:56:54.143 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.140+0000 7fc9e37fe640 1 -- 172.21.15.89:0/2573820403 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 37) v1 ==== 92653+0+0 (secure 0 0 0) 0x7fc9dc030020 con 0x7fc9ec0fc530 2024-09-13T02:56:54.143 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.141+0000 7fc9e37fe640 1 --2- 172.21.15.89:0/2573820403 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fc9d806e660 0x7fc9d8070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:54.143 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.141+0000 7fc9e3fff640 1 --2- 172.21.15.89:0/2573820403 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fc9d806e660 0x7fc9d8070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:54.143 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.141+0000 7fc9e37fe640 1 -- 172.21.15.89:0/2573820403 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fc9dc0ae240 con 0x7fc9ec0fc530 2024-09-13T02:56:54.143 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.141+0000 7fc9e3fff640 1 --2- 172.21.15.89:0/2573820403 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fc9d806e660 0x7fc9d8070b10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc9d4009fd0 tx=0x7fc9d400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:56:54.147 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.146+0000 7fc9e37fe640 1 -- 172.21.15.89:0/2573820403 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fc9dc077350 con 0x7fc9ec0fc530 2024-09-13T02:56:54.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:53 smithi089 ceph-mon[91553]: pgmap v12: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T02:56:54.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.330+0000 7fc9f173c640 1 -- 172.21.15.89:0/2573820403 --> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc9ec0708d0 con 0x7fc9d806e660 2024-09-13T02:56:54.333 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.331+0000 7fc9e37fe640 1 -- 172.21.15.89:0/2573820403 <== mgr.34104 v2:172.21.15.89:6800/1881577856 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7fc9ec0708d0 con 0x7fc9d806e660 2024-09-13T02:56:54.335 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.333+0000 7fc9f173c640 1 -- 172.21.15.89:0/2573820403 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fc9d806e660 msgr2=0x7fc9d8070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:54.335 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.333+0000 7fc9f173c640 1 --2- 172.21.15.89:0/2573820403 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fc9d806e660 0x7fc9d8070b10 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fc9d4009fd0 tx=0x7fc9d400b040 comp rx=0 tx=0).stop 2024-09-13T02:56:54.335 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.333+0000 7fc9f173c640 1 -- 172.21.15.89:0/2573820403 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9ec0fc530 msgr2=0x7fc9ec071570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:54.335 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.333+0000 7fc9f173c640 1 --2- 172.21.15.89:0/2573820403 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9ec0fc530 0x7fc9ec071570 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc9dc0043d0 tx=0x7fc9dc009da0 comp rx=0 tx=0).stop 2024-09-13T02:56:54.335 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.334+0000 7fc9f173c640 1 -- 172.21.15.89:0/2573820403 shutdown_connections 2024-09-13T02:56:54.335 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.334+0000 7fc9f173c640 1 --2- 172.21.15.89:0/2573820403 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fc9d806e660 0x7fc9d8070b10 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:54.335 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.334+0000 7fc9f173c640 1 --2- 172.21.15.89:0/2573820403 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9ec0fd800 0x7fc9ec06fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:54.336 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.334+0000 7fc9f173c640 1 --2- 172.21.15.89:0/2573820403 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9ec0fc530 0x7fc9ec071570 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:54.336 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.334+0000 7fc9f173c640 1 -- 172.21.15.89:0/2573820403 >> 172.21.15.89:0/2573820403 conn(0x7fc9ec0f7d10 msgr2=0x7fc9ec0f94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:56:54.336 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.334+0000 7fc9f173c640 1 -- 172.21.15.89:0/2573820403 shutdown_connections 2024-09-13T02:56:54.336 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.334+0000 7fc9f173c640 1 -- 172.21.15.89:0/2573820403 wait complete. 2024-09-13T02:56:54.344 INFO:teuthology.orchestra.run.smithi089.stdout:true 2024-09-13T02:56:54.416 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.413+0000 7f47af4a0640 1 -- 172.21.15.89:0/1601549340 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47a80fd820 msgr2=0x7f47a80fdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:54.416 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.413+0000 7f47af4a0640 1 --2- 172.21.15.89:0/1601549340 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47a80fd820 0x7f47a80fdc90 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f479c009c50 tx=0x7f479c004d10 comp rx=0 tx=0).stop 2024-09-13T02:56:54.416 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.413+0000 7f47af4a0640 1 -- 172.21.15.89:0/1601549340 shutdown_connections 2024-09-13T02:56:54.416 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.413+0000 7f47af4a0640 1 --2- 172.21.15.89:0/1601549340 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47a80fd820 0x7f47a80fdc90 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:54.416 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.413+0000 7f47af4a0640 1 --2- 172.21.15.89:0/1601549340 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f47a80fc550 0x7f47a80fc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:54.416 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.413+0000 7f47af4a0640 1 -- 172.21.15.89:0/1601549340 >> 172.21.15.89:0/1601549340 conn(0x7f47a80f7d30 msgr2=0x7f47a80fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:56:54.416 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.413+0000 7f47af4a0640 1 -- 172.21.15.89:0/1601549340 shutdown_connections 2024-09-13T02:56:54.416 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.413+0000 7f47af4a0640 1 -- 172.21.15.89:0/1601549340 wait complete. 2024-09-13T02:56:54.416 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.413+0000 7f47af4a0640 1 Processor -- start 2024-09-13T02:56:54.417 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.413+0000 7f47af4a0640 1 -- start start 2024-09-13T02:56:54.417 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.414+0000 7f47af4a0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47a80fc550 0x7f47a810d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:54.417 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.414+0000 7f47af4a0640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f47a80fd820 0x7f47a810d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:54.417 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.414+0000 7f47af4a0640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a810dc40 con 0x7f47a80fc550 2024-09-13T02:56:54.417 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.414+0000 7f47af4a0640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a810e460 con 0x7f47a80fd820 2024-09-13T02:56:54.417 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.414+0000 7f47ad23c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47a80fc550 0x7f47a810d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:54.417 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.414+0000 7f47ad23c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47a80fc550 0x7f47a810d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:57742/0 (socket says 172.21.15.89:57742) 2024-09-13T02:56:54.417 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.414+0000 7f47ad23c640 1 -- 172.21.15.89:0/3710557508 learned_addr learned my addr 172.21.15.89:0/3710557508 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:56:54.417 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.414+0000 7f47aca3b640 1 --2- 172.21.15.89:0/3710557508 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f47a80fd820 0x7f47a810d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:54.417 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.414+0000 7f47ad23c640 1 -- 172.21.15.89:0/3710557508 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f47a80fd820 msgr2=0x7f47a810d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:54.417 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.414+0000 7f47ad23c640 1 --2- 172.21.15.89:0/3710557508 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f47a80fd820 0x7f47a810d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:54.417 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.414+0000 7f47ad23c640 1 -- 172.21.15.89:0/3710557508 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f479c0098b0 con 0x7f47a80fc550 2024-09-13T02:56:54.417 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.414+0000 7f47ad23c640 1 --2- 172.21.15.89:0/3710557508 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47a80fc550 0x7f47a810d0b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f47a000eb70 tx=0x7f47a000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:56:54.417 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.414+0000 7f47a5ffb640 1 -- 172.21.15.89:0/3710557508 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f47a0007c30 con 0x7f47a80fc550 2024-09-13T02:56:54.418 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.414+0000 7f47a5ffb640 1 -- 172.21.15.89:0/3710557508 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f47a000f040 con 0x7f47a80fc550 2024-09-13T02:56:54.418 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.414+0000 7f47af4a0640 1 -- 172.21.15.89:0/3710557508 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47a810e690 con 0x7f47a80fc550 2024-09-13T02:56:54.418 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.414+0000 7f47a5ffb640 1 -- 172.21.15.89:0/3710557508 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f47a00094e0 con 0x7f47a80fc550 2024-09-13T02:56:54.418 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.415+0000 7f47af4a0640 1 -- 172.21.15.89:0/3710557508 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47a810ec30 con 0x7f47a80fc550 2024-09-13T02:56:54.419 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.416+0000 7f47af4a0640 1 -- 172.21.15.89:0/3710557508 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47a80fb9b0 con 0x7f47a80fc550 2024-09-13T02:56:54.419 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.416+0000 7f47a5ffb640 1 -- 172.21.15.89:0/3710557508 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 37) v1 ==== 92653+0+0 (secure 0 0 0) 0x7f47a0009660 con 0x7f47a80fc550 2024-09-13T02:56:54.419 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.416+0000 7f47a5ffb640 1 --2- 172.21.15.89:0/3710557508 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f479006e660 0x7f4790070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:54.419 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.417+0000 7f47a5ffb640 1 -- 172.21.15.89:0/3710557508 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f47a008e180 con 0x7f47a80fc550 2024-09-13T02:56:54.419 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.417+0000 7f47aca3b640 1 --2- 172.21.15.89:0/3710557508 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f479006e660 0x7f4790070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:54.419 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.417+0000 7f47aca3b640 1 --2- 172.21.15.89:0/3710557508 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f479006e660 0x7f4790070b10 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f479c004a30 tx=0x7f479c004d10 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:56:54.422 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.421+0000 7f47a5ffb640 1 -- 172.21.15.89:0/3710557508 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f47a0057050 con 0x7f47a80fc550 2024-09-13T02:56:54.610 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.608+0000 7f47af4a0640 1 -- 172.21.15.89:0/3710557508 --> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f47a810ef60 con 0x7f479006e660 2024-09-13T02:56:54.610 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.609+0000 7f47a5ffb640 1 -- 172.21.15.89:0/3710557508 <== mgr.34104 v2:172.21.15.89:6800/1881577856 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f47a810ef60 con 0x7f479006e660 2024-09-13T02:56:54.614 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.611+0000 7f47af4a0640 1 -- 172.21.15.89:0/3710557508 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f479006e660 msgr2=0x7f4790070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:54.614 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.611+0000 7f47af4a0640 1 --2- 172.21.15.89:0/3710557508 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f479006e660 0x7f4790070b10 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f479c004a30 tx=0x7f479c004d10 comp rx=0 tx=0).stop 2024-09-13T02:56:54.614 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.611+0000 7f47af4a0640 1 -- 172.21.15.89:0/3710557508 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47a80fc550 msgr2=0x7f47a810d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:54.614 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.611+0000 7f47af4a0640 1 --2- 172.21.15.89:0/3710557508 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47a80fc550 0x7f47a810d0b0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f47a000eb70 tx=0x7f47a000b040 comp rx=0 tx=0).stop 2024-09-13T02:56:54.614 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.612+0000 7f47af4a0640 1 -- 172.21.15.89:0/3710557508 shutdown_connections 2024-09-13T02:56:54.614 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.612+0000 7f47af4a0640 1 --2- 172.21.15.89:0/3710557508 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f479006e660 0x7f4790070b10 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:54.614 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.612+0000 7f47af4a0640 1 --2- 172.21.15.89:0/3710557508 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f47a80fd820 0x7f47a810d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:54.614 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.612+0000 7f47af4a0640 1 --2- 172.21.15.89:0/3710557508 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f47a80fc550 0x7f47a810d0b0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:54.614 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.612+0000 7f47af4a0640 1 -- 172.21.15.89:0/3710557508 >> 172.21.15.89:0/3710557508 conn(0x7f47a80f7d30 msgr2=0x7f47a80f94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:56:54.614 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.612+0000 7f47af4a0640 1 -- 172.21.15.89:0/3710557508 shutdown_connections 2024-09-13T02:56:54.614 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.612+0000 7f47af4a0640 1 -- 172.21.15.89:0/3710557508 wait complete. 2024-09-13T02:56:54.704 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.701+0000 7f59036e2640 1 -- 172.21.15.89:0/304404662 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58fc0ff680 msgr2=0x7f58fc101a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:54.704 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.701+0000 7f59036e2640 1 --2- 172.21.15.89:0/304404662 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58fc0ff680 0x7f58fc101a60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f58ec0048d0 tx=0x7f58ec009da0 comp rx=0 tx=0).stop 2024-09-13T02:56:54.704 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.701+0000 7f59036e2640 1 -- 172.21.15.89:0/304404662 shutdown_connections 2024-09-13T02:56:54.704 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.701+0000 7f59036e2640 1 --2- 172.21.15.89:0/304404662 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58fc0ff680 0x7f58fc101a60 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:54.704 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.701+0000 7f59036e2640 1 --2- 172.21.15.89:0/304404662 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f58fc065c40 0x7f58fc0ff140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:54.704 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.701+0000 7f59036e2640 1 -- 172.21.15.89:0/304404662 >> 172.21.15.89:0/304404662 conn(0x7f58fc0f6c10 msgr2=0x7f58fc0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:56:54.704 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.701+0000 7f59036e2640 1 -- 172.21.15.89:0/304404662 shutdown_connections 2024-09-13T02:56:54.705 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.701+0000 7f59036e2640 1 -- 172.21.15.89:0/304404662 wait complete. 2024-09-13T02:56:54.705 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.702+0000 7f59036e2640 1 Processor -- start 2024-09-13T02:56:54.705 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.702+0000 7f59036e2640 1 -- start start 2024-09-13T02:56:54.705 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.702+0000 7f59036e2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58fc065c40 0x7f58fc10f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:54.705 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.702+0000 7f59036e2640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f58fc0ff680 0x7f58fc10f830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:54.705 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.702+0000 7f59036e2640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58fc1106a0 con 0x7f58fc065c40 2024-09-13T02:56:54.705 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.702+0000 7f59036e2640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58fc110810 con 0x7f58fc0ff680 2024-09-13T02:56:54.705 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.702+0000 7f590147e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58fc065c40 0x7f58fc10f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:54.706 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.702+0000 7f590147e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58fc065c40 0x7f58fc10f2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:57750/0 (socket says 172.21.15.89:57750) 2024-09-13T02:56:54.706 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.702+0000 7f590147e640 1 -- 172.21.15.89:0/326690173 learned_addr learned my addr 172.21.15.89:0/326690173 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:56:54.706 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.703+0000 7f5900c7d640 1 --2- 172.21.15.89:0/326690173 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f58fc0ff680 0x7f58fc10f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:54.706 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.703+0000 7f590147e640 1 -- 172.21.15.89:0/326690173 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f58fc0ff680 msgr2=0x7f58fc10f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:54.706 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.703+0000 7f590147e640 1 --2- 172.21.15.89:0/326690173 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f58fc0ff680 0x7f58fc10f830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:54.706 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.703+0000 7f590147e640 1 -- 172.21.15.89:0/326690173 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58ec005040 con 0x7f58fc065c40 2024-09-13T02:56:54.706 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.703+0000 7f5900c7d640 1 --2- 172.21.15.89:0/326690173 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f58fc0ff680 0x7f58fc10f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T02:56:54.706 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.703+0000 7f590147e640 1 --2- 172.21.15.89:0/326690173 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58fc065c40 0x7f58fc10f2f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f58f800b580 tx=0x7f58f80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:56:54.708 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.703+0000 7f58f1ffb640 1 -- 172.21.15.89:0/326690173 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f58f800f570 con 0x7f58fc065c40 2024-09-13T02:56:54.708 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.703+0000 7f58f1ffb640 1 -- 172.21.15.89:0/326690173 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f58f800fb70 con 0x7f58fc065c40 2024-09-13T02:56:54.708 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.703+0000 7f59036e2640 1 -- 172.21.15.89:0/326690173 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58fc110af0 con 0x7f58fc065c40 2024-09-13T02:56:54.708 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.703+0000 7f58f1ffb640 1 -- 172.21.15.89:0/326690173 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f58f8010d40 con 0x7f58fc065c40 2024-09-13T02:56:54.708 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.703+0000 7f59036e2640 1 -- 172.21.15.89:0/326690173 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58fc111010 con 0x7f58fc065c40 2024-09-13T02:56:54.709 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.704+0000 7f59036e2640 1 -- 172.21.15.89:0/326690173 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58fc1057e0 con 0x7f58fc065c40 2024-09-13T02:56:54.709 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.705+0000 7f58f1ffb640 1 -- 172.21.15.89:0/326690173 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 37) v1 ==== 92653+0+0 (secure 0 0 0) 0x7f58f801a460 con 0x7f58fc065c40 2024-09-13T02:56:54.709 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.705+0000 7f58f1ffb640 1 --2- 172.21.15.89:0/326690173 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f58e806e660 0x7f58e8070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:54.709 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.705+0000 7f58f1ffb640 1 -- 172.21.15.89:0/326690173 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f58f808e0b0 con 0x7f58fc065c40 2024-09-13T02:56:54.709 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.705+0000 7f5900c7d640 1 --2- 172.21.15.89:0/326690173 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f58e806e660 0x7f58e8070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:54.709 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.706+0000 7f5900c7d640 1 --2- 172.21.15.89:0/326690173 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f58e806e660 0x7f58e8070b10 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f58ec00b020 tx=0x7f58ec009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:56:54.711 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.710+0000 7f58f1ffb640 1 -- 172.21.15.89:0/326690173 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f58f80571d0 con 0x7f58fc065c40 2024-09-13T02:56:54.923 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.922+0000 7f59036e2640 1 -- 172.21.15.89:0/326690173 --> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f58fc105020 con 0x7f58e806e660 2024-09-13T02:56:54.933 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.932+0000 7f58f1ffb640 1 -- 172.21.15.89:0/326690173 <== mgr.34104 v2:172.21.15.89:6800/1881577856 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f58fc105020 con 0x7f58e806e660 2024-09-13T02:56:54.933 INFO:teuthology.orchestra.run.smithi089.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T02:56:54.933 INFO:teuthology.orchestra.run.smithi089.stdout:alertmanager.smithi089 smithi089 *:9093,9094 running (87s) 14s ago 10m 15.0M - 0.25.0 c8568f914cd2 1d2432f5479e 2024-09-13T02:56:54.933 INFO:teuthology.orchestra.run.smithi089.stdout:crash.smithi089 smithi089 running (10m) 14s ago 10m 6895k - 17.2.7-1627-gbbdadfa3 a994b00deb3a e8994cd5600e 2024-09-13T02:56:54.933 INFO:teuthology.orchestra.run.smithi089.stdout:crash.smithi131 smithi131 running (9m) 4s ago 9m 6895k - 17.2.7-1627-gbbdadfa3 a994b00deb3a dcbb0a9d5261 2024-09-13T02:56:54.934 INFO:teuthology.orchestra.run.smithi089.stdout:grafana.smithi089 smithi089 *:3000 running (81s) 14s ago 10m 77.8M - 9.4.7 954c08fa6188 dee914ded1af 2024-09-13T02:56:54.934 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi089.qjoitb smithi089 running (5m) 14s ago 5m 70.4M - 17.2.7-1627-gbbdadfa3 a994b00deb3a ff9b59ec5107 2024-09-13T02:56:54.934 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi089.rarddb smithi089 running (5m) 14s ago 5m 136M - 17.2.7-1627-gbbdadfa3 a994b00deb3a db2dc502c1ba 2024-09-13T02:56:54.934 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi131.rbovzc smithi131 running (4m) 4s ago 4m 60.5M - 17.2.7-1627-gbbdadfa3 a994b00deb3a d071b6d99537 2024-09-13T02:56:54.934 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi131.uasrkg smithi131 running (5m) 4s ago 5m 112M - 17.2.7-1627-gbbdadfa3 a994b00deb3a 0b3d4ffa6ce5 2024-09-13T02:56:54.934 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.smithi089.guohvs smithi089 *:8443,9283,8765 running (68s) 14s ago 11m 472M - 19.1.1-322-g7741f7f9 19dc8d659727 1e887446f1b0 2024-09-13T02:56:54.934 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.smithi131.aunbqd smithi131 *:8443,9283,8765 running (38s) 4s ago 9m 438M - 19.1.1-322-g7741f7f9 19dc8d659727 358d7478f2ba 2024-09-13T02:56:54.934 INFO:teuthology.orchestra.run.smithi089.stdout:mon.smithi089 smithi089 running (26s) 14s ago 11m 28.0M 2048M 19.1.1-322-g7741f7f9 19dc8d659727 8a29fb65028f 2024-09-13T02:56:54.934 INFO:teuthology.orchestra.run.smithi089.stdout:mon.smithi131 smithi131 running (7s) 4s ago 9m 25.6M 2048M 19.1.1-322-g7741f7f9 19dc8d659727 506310ad8620 2024-09-13T02:56:54.934 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.smithi089 smithi089 *:9100 running (99s) 14s ago 10m 8384k - 1.5.0 0da6a335fe13 5a9927b583e6 2024-09-13T02:56:54.934 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.smithi131 smithi131 *:9100 running (73s) 4s ago 9m 15.9M - 1.5.0 0da6a335fe13 bcfde5d1a508 2024-09-13T02:56:54.934 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0 smithi089 running (8m) 14s ago 8m 223M 1557M 17.2.7-1627-gbbdadfa3 a994b00deb3a b9404e2bc82c 2024-09-13T02:56:54.934 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1 smithi089 running (8m) 14s ago 8m 232M 1557M 17.2.7-1627-gbbdadfa3 a994b00deb3a af6538730e42 2024-09-13T02:56:54.935 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2 smithi089 running (7m) 14s ago 7m 195M 1557M 17.2.7-1627-gbbdadfa3 a994b00deb3a 447cf103114b 2024-09-13T02:56:54.935 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3 smithi131 running (7m) 4s ago 7m 264M 2581M 17.2.7-1627-gbbdadfa3 a994b00deb3a 0b80a4dea862 2024-09-13T02:56:54.935 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4 smithi131 running (7m) 4s ago 7m 235M 2581M 17.2.7-1627-gbbdadfa3 a994b00deb3a 06ec44680b00 2024-09-13T02:56:54.935 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5 smithi131 running (6m) 4s ago 6m 231M 2581M 17.2.7-1627-gbbdadfa3 a994b00deb3a ace4b45e5873 2024-09-13T02:56:54.935 INFO:teuthology.orchestra.run.smithi089.stdout:prometheus.smithi089 smithi089 *:9095 running (43s) 14s ago 10m 48.9M - 2.43.0 a07b618ecd1d 9d336370c187 2024-09-13T02:56:54.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.934+0000 7f59036e2640 1 -- 172.21.15.89:0/326690173 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f58e806e660 msgr2=0x7f58e8070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:54.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.934+0000 7f59036e2640 1 --2- 172.21.15.89:0/326690173 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f58e806e660 0x7f58e8070b10 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f58ec00b020 tx=0x7f58ec009da0 comp rx=0 tx=0).stop 2024-09-13T02:56:54.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.934+0000 7f59036e2640 1 -- 172.21.15.89:0/326690173 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58fc065c40 msgr2=0x7f58fc10f2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:54.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.934+0000 7f59036e2640 1 --2- 172.21.15.89:0/326690173 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58fc065c40 0x7f58fc10f2f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f58f800b580 tx=0x7f58f80091a0 comp rx=0 tx=0).stop 2024-09-13T02:56:54.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.934+0000 7f59036e2640 1 -- 172.21.15.89:0/326690173 shutdown_connections 2024-09-13T02:56:54.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.934+0000 7f59036e2640 1 --2- 172.21.15.89:0/326690173 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f58e806e660 0x7f58e8070b10 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:54.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.934+0000 7f59036e2640 1 --2- 172.21.15.89:0/326690173 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f58fc0ff680 0x7f58fc10f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:54.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.934+0000 7f59036e2640 1 --2- 172.21.15.89:0/326690173 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f58fc065c40 0x7f58fc10f2f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:54.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.934+0000 7f59036e2640 1 -- 172.21.15.89:0/326690173 >> 172.21.15.89:0/326690173 conn(0x7f58fc0f6c10 msgr2=0x7f58fc0fb2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:56:54.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.934+0000 7f59036e2640 1 -- 172.21.15.89:0/326690173 shutdown_connections 2024-09-13T02:56:54.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:54.934+0000 7f59036e2640 1 -- 172.21.15.89:0/326690173 wait complete. 2024-09-13T02:56:55.015 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.011+0000 7f78ef8ad640 1 -- 172.21.15.89:0/4251778600 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78e80fc520 msgr2=0x7f78e80fc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:55.015 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.011+0000 7f78ef8ad640 1 --2- 172.21.15.89:0/4251778600 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78e80fc520 0x7f78e80fc930 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f78e40048d0 tx=0x7f78e4009da0 comp rx=0 tx=0).stop 2024-09-13T02:56:55.015 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.011+0000 7f78ef8ad640 1 -- 172.21.15.89:0/4251778600 shutdown_connections 2024-09-13T02:56:55.015 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.011+0000 7f78ef8ad640 1 --2- 172.21.15.89:0/4251778600 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f78e80fd7f0 0x7f78e80fdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:55.015 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.011+0000 7f78ef8ad640 1 --2- 172.21.15.89:0/4251778600 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78e80fc520 0x7f78e80fc930 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:55.016 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.011+0000 7f78ef8ad640 1 -- 172.21.15.89:0/4251778600 >> 172.21.15.89:0/4251778600 conn(0x7f78e80f7ce0 msgr2=0x7f78e80fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:56:55.016 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.011+0000 7f78ef8ad640 1 -- 172.21.15.89:0/4251778600 shutdown_connections 2024-09-13T02:56:55.016 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.011+0000 7f78ef8ad640 1 -- 172.21.15.89:0/4251778600 wait complete. 2024-09-13T02:56:55.016 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.012+0000 7f78ef8ad640 1 Processor -- start 2024-09-13T02:56:55.016 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.012+0000 7f78ef8ad640 1 -- start start 2024-09-13T02:56:55.016 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.012+0000 7f78ef8ad640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78e80fc520 0x7f78e8071570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:55.016 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.012+0000 7f78ef8ad640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f78e80fd7f0 0x7f78e806fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:55.016 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.012+0000 7f78ef8ad640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78e806fff0 con 0x7f78e80fc520 2024-09-13T02:56:55.016 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.012+0000 7f78ef8ad640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78e8070130 con 0x7f78e80fd7f0 2024-09-13T02:56:55.016 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.012+0000 7f78ed649640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78e80fc520 0x7f78e8071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:55.016 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.012+0000 7f78ed649640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78e80fc520 0x7f78e8071570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:57764/0 (socket says 172.21.15.89:57764) 2024-09-13T02:56:55.016 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.012+0000 7f78ed649640 1 -- 172.21.15.89:0/1333302742 learned_addr learned my addr 172.21.15.89:0/1333302742 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:56:55.017 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.012+0000 7f78ece48640 1 --2- 172.21.15.89:0/1333302742 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f78e80fd7f0 0x7f78e806fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:55.017 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.013+0000 7f78ed649640 1 -- 172.21.15.89:0/1333302742 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f78e80fd7f0 msgr2=0x7f78e806fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:55.017 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.013+0000 7f78ed649640 1 --2- 172.21.15.89:0/1333302742 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f78e80fd7f0 0x7f78e806fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:55.017 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.013+0000 7f78ed649640 1 -- 172.21.15.89:0/1333302742 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78e4005040 con 0x7f78e80fc520 2024-09-13T02:56:55.017 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.013+0000 7f78ed649640 1 --2- 172.21.15.89:0/1333302742 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78e80fc520 0x7f78e8071570 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f78e4003080 tx=0x7f78e4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:56:55.017 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.013+0000 7f78ddffb640 1 -- 172.21.15.89:0/1333302742 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f78e4038070 con 0x7f78e80fc520 2024-09-13T02:56:55.017 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.013+0000 7f78ddffb640 1 -- 172.21.15.89:0/1333302742 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f78e4009800 con 0x7f78e80fc520 2024-09-13T02:56:55.017 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.013+0000 7f78ddffb640 1 -- 172.21.15.89:0/1333302742 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f78e4033660 con 0x7f78e80fc520 2024-09-13T02:56:55.017 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.013+0000 7f78ef8ad640 1 -- 172.21.15.89:0/1333302742 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78e80703b0 con 0x7f78e80fc520 2024-09-13T02:56:55.017 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.013+0000 7f78ef8ad640 1 -- 172.21.15.89:0/1333302742 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78e8115100 con 0x7f78e80fc520 2024-09-13T02:56:55.018 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.014+0000 7f78ef8ad640 1 -- 172.21.15.89:0/1333302742 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78e80fb980 con 0x7f78e80fc520 2024-09-13T02:56:55.018 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.015+0000 7f78ddffb640 1 -- 172.21.15.89:0/1333302742 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 37) v1 ==== 92653+0+0 (secure 0 0 0) 0x7f78e4030020 con 0x7f78e80fc520 2024-09-13T02:56:55.018 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.015+0000 7f78ddffb640 1 --2- 172.21.15.89:0/1333302742 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f78d406e660 0x7f78d4070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:55.018 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.015+0000 7f78ddffb640 1 -- 172.21.15.89:0/1333302742 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f78e40ae2c0 con 0x7f78e80fc520 2024-09-13T02:56:55.018 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.015+0000 7f78ece48640 1 --2- 172.21.15.89:0/1333302742 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f78d406e660 0x7f78d4070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:55.019 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.016+0000 7f78ece48640 1 --2- 172.21.15.89:0/1333302742 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f78d406e660 0x7f78d4070b10 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f78d80041d0 tx=0x7f78d8004330 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:56:55.020 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.019+0000 7f78ddffb640 1 -- 172.21.15.89:0/1333302742 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f78e40773d0 con 0x7f78e80fc520 2024-09-13T02:56:55.269 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.267+0000 7f78ef8ad640 1 -- 172.21.15.89:0/1333302742 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f78e8104f50 con 0x7f78e80fc520 2024-09-13T02:56:55.270 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.268+0000 7f78ddffb640 1 -- 172.21.15.89:0/1333302742 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+745 (secure 0 0 0) 0x7f78e407aa90 con 0x7f78e80fc520 2024-09-13T02:56:55.270 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-13T02:56:55.270 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": { 2024-09-13T02:56:55.270 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 2 2024-09-13T02:56:55.270 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T02:56:55.270 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": { 2024-09-13T02:56:55.270 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 2 2024-09-13T02:56:55.271 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T02:56:55.271 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": { 2024-09-13T02:56:55.271 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 6 2024-09-13T02:56:55.271 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T02:56:55.271 INFO:teuthology.orchestra.run.smithi089.stdout: "mds": { 2024-09-13T02:56:55.271 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 4 2024-09-13T02:56:55.271 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T02:56:55.271 INFO:teuthology.orchestra.run.smithi089.stdout: "overall": { 2024-09-13T02:56:55.271 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 10, 2024-09-13T02:56:55.271 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 4 2024-09-13T02:56:55.271 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-13T02:56:55.271 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-13T02:56:55.272 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.270+0000 7f78ef8ad640 1 -- 172.21.15.89:0/1333302742 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f78d406e660 msgr2=0x7f78d4070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:55.272 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.270+0000 7f78ef8ad640 1 --2- 172.21.15.89:0/1333302742 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f78d406e660 0x7f78d4070b10 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f78d80041d0 tx=0x7f78d8004330 comp rx=0 tx=0).stop 2024-09-13T02:56:55.272 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.270+0000 7f78ef8ad640 1 -- 172.21.15.89:0/1333302742 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78e80fc520 msgr2=0x7f78e8071570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:55.272 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.270+0000 7f78ef8ad640 1 --2- 172.21.15.89:0/1333302742 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78e80fc520 0x7f78e8071570 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f78e4003080 tx=0x7f78e4009da0 comp rx=0 tx=0).stop 2024-09-13T02:56:55.272 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.270+0000 7f78ef8ad640 1 -- 172.21.15.89:0/1333302742 shutdown_connections 2024-09-13T02:56:55.272 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.271+0000 7f78ef8ad640 1 --2- 172.21.15.89:0/1333302742 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f78d406e660 0x7f78d4070b10 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:55.273 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.271+0000 7f78ef8ad640 1 --2- 172.21.15.89:0/1333302742 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f78e80fd7f0 0x7f78e806fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:55.273 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.271+0000 7f78ef8ad640 1 --2- 172.21.15.89:0/1333302742 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f78e80fc520 0x7f78e8071570 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:55.273 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.271+0000 7f78ef8ad640 1 -- 172.21.15.89:0/1333302742 >> 172.21.15.89:0/1333302742 conn(0x7f78e80f7ce0 msgr2=0x7f78e80f9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:56:55.273 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.271+0000 7f78ef8ad640 1 -- 172.21.15.89:0/1333302742 shutdown_connections 2024-09-13T02:56:55.273 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.271+0000 7f78ef8ad640 1 -- 172.21.15.89:0/1333302742 wait complete. 2024-09-13T02:56:55.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.353+0000 7fc1e5360640 1 -- 172.21.15.89:0/887826241 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc1e0066410 msgr2=0x7fc1e00ff1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:55.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.353+0000 7fc1e5360640 1 --2- 172.21.15.89:0/887826241 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc1e0066410 0x7fc1e00ff1f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fc1d00048d0 tx=0x7fc1d0009da0 comp rx=0 tx=0).stop 2024-09-13T02:56:55.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.353+0000 7fc1e5360640 1 -- 172.21.15.89:0/887826241 shutdown_connections 2024-09-13T02:56:55.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.353+0000 7fc1e5360640 1 --2- 172.21.15.89:0/887826241 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc1e00ff730 0x7fc1e0101b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:55.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.353+0000 7fc1e5360640 1 --2- 172.21.15.89:0/887826241 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc1e0066410 0x7fc1e00ff1f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:55.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.353+0000 7fc1e5360640 1 -- 172.21.15.89:0/887826241 >> 172.21.15.89:0/887826241 conn(0x7fc1e00f6c00 msgr2=0x7fc1e00f9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:56:55.356 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.353+0000 7fc1e5360640 1 -- 172.21.15.89:0/887826241 shutdown_connections 2024-09-13T02:56:55.356 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.353+0000 7fc1e5360640 1 -- 172.21.15.89:0/887826241 wait complete. 2024-09-13T02:56:55.357 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.354+0000 7fc1e5360640 1 Processor -- start 2024-09-13T02:56:55.357 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.354+0000 7fc1e5360640 1 -- start start 2024-09-13T02:56:55.358 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.354+0000 7fc1e5360640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc1e0066410 0x7fc1e010d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:55.358 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.354+0000 7fc1e5360640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc1e00ff730 0x7fc1e010d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:55.358 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.354+0000 7fc1e5360640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e010dc10 con 0x7fc1e00ff730 2024-09-13T02:56:55.358 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.354+0000 7fc1e5360640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1e010e430 con 0x7fc1e0066410 2024-09-13T02:56:55.358 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.355+0000 7fc1de7fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc1e00ff730 0x7fc1e010d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:55.358 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.355+0000 7fc1de7fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc1e00ff730 0x7fc1e010d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:57786/0 (socket says 172.21.15.89:57786) 2024-09-13T02:56:55.358 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.355+0000 7fc1de7fc640 1 -- 172.21.15.89:0/704282298 learned_addr learned my addr 172.21.15.89:0/704282298 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:56:55.358 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.355+0000 7fc1deffd640 1 --2- 172.21.15.89:0/704282298 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc1e0066410 0x7fc1e010d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:55.358 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.355+0000 7fc1de7fc640 1 -- 172.21.15.89:0/704282298 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc1e0066410 msgr2=0x7fc1e010d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:55.359 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.355+0000 7fc1de7fc640 1 --2- 172.21.15.89:0/704282298 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc1e0066410 0x7fc1e010d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:55.359 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.355+0000 7fc1de7fc640 1 -- 172.21.15.89:0/704282298 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1d0005040 con 0x7fc1e00ff730 2024-09-13T02:56:55.359 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.355+0000 7fc1deffd640 1 --2- 172.21.15.89:0/704282298 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc1e0066410 0x7fc1e010d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T02:56:55.359 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.355+0000 7fc1de7fc640 1 --2- 172.21.15.89:0/704282298 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc1e00ff730 0x7fc1e010d5c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc1d400eb70 tx=0x7fc1d400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:56:55.359 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.355+0000 7fc1c77fe640 1 -- 172.21.15.89:0/704282298 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc1d4007c30 con 0x7fc1e00ff730 2024-09-13T02:56:55.359 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.355+0000 7fc1e5360640 1 -- 172.21.15.89:0/704282298 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1e010e660 con 0x7fc1e00ff730 2024-09-13T02:56:55.359 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.355+0000 7fc1e5360640 1 -- 172.21.15.89:0/704282298 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1e010ec00 con 0x7fc1e00ff730 2024-09-13T02:56:55.359 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.355+0000 7fc1c77fe640 1 -- 172.21.15.89:0/704282298 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc1d400f040 con 0x7fc1e00ff730 2024-09-13T02:56:55.359 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.355+0000 7fc1c77fe640 1 -- 172.21.15.89:0/704282298 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc1d4009550 con 0x7fc1e00ff730 2024-09-13T02:56:55.360 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.356+0000 7fc1e5360640 1 -- 172.21.15.89:0/704282298 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1e00fa880 con 0x7fc1e00ff730 2024-09-13T02:56:55.360 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.357+0000 7fc1c77fe640 1 -- 172.21.15.89:0/704282298 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 37) v1 ==== 92653+0+0 (secure 0 0 0) 0x7fc1d400cca0 con 0x7fc1e00ff730 2024-09-13T02:56:55.360 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.357+0000 7fc1c77fe640 1 --2- 172.21.15.89:0/704282298 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fc1c806e660 0x7fc1c8070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:55.360 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.357+0000 7fc1c77fe640 1 -- 172.21.15.89:0/704282298 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fc1d408dfb0 con 0x7fc1e00ff730 2024-09-13T02:56:55.360 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.357+0000 7fc1deffd640 1 --2- 172.21.15.89:0/704282298 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fc1c806e660 0x7fc1c8070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:55.361 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.358+0000 7fc1deffd640 1 --2- 172.21.15.89:0/704282298 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fc1c806e660 0x7fc1c8070b10 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc1d0007ac0 tx=0x7fc1d0035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:56:55.367 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.366+0000 7fc1c77fe640 1 -- 172.21.15.89:0/704282298 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fc1d40c31b0 con 0x7fc1e00ff730 2024-09-13T02:56:55.581 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.580+0000 7fc1e5360640 1 -- 172.21.15.89:0/704282298 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc1e0104f20 con 0x7fc1e00ff730 2024-09-13T02:56:55.582 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.580+0000 7fc1c77fe640 1 -- 172.21.15.89:0/704282298 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1972 (secure 0 0 0) 0x7fc1d40197d0 con 0x7fc1e00ff730 2024-09-13T02:56:55.582 INFO:teuthology.orchestra.run.smithi089.stdout:e21 2024-09-13T02:56:55.582 INFO:teuthology.orchestra.run.smithi089.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-13T02:56:55.582 INFO:teuthology.orchestra.run.smithi089.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T02:56:55.582 INFO:teuthology.orchestra.run.smithi089.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:56:55.582 INFO:teuthology.orchestra.run.smithi089.stdout:legacy client fscid: 1 2024-09-13T02:56:55.582 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:56:55.582 INFO:teuthology.orchestra.run.smithi089.stdout:Filesystem 'cephfs' (1) 2024-09-13T02:56:55.583 INFO:teuthology.orchestra.run.smithi089.stdout:fs_name cephfs 2024-09-13T02:56:55.583 INFO:teuthology.orchestra.run.smithi089.stdout:epoch 21 2024-09-13T02:56:55.583 INFO:teuthology.orchestra.run.smithi089.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T02:56:55.583 INFO:teuthology.orchestra.run.smithi089.stdout:created 2024-09-13T02:51:40.657817+0000 2024-09-13T02:56:55.583 INFO:teuthology.orchestra.run.smithi089.stdout:modified 2024-09-13T02:54:05.118633+0000 2024-09-13T02:56:55.583 INFO:teuthology.orchestra.run.smithi089.stdout:tableserver 0 2024-09-13T02:56:55.583 INFO:teuthology.orchestra.run.smithi089.stdout:root 0 2024-09-13T02:56:55.583 INFO:teuthology.orchestra.run.smithi089.stdout:session_timeout 60 2024-09-13T02:56:55.583 INFO:teuthology.orchestra.run.smithi089.stdout:session_autoclose 300 2024-09-13T02:56:55.583 INFO:teuthology.orchestra.run.smithi089.stdout:max_file_size 1099511627776 2024-09-13T02:56:55.583 INFO:teuthology.orchestra.run.smithi089.stdout:max_xattr_size 65536 2024-09-13T02:56:55.583 INFO:teuthology.orchestra.run.smithi089.stdout:required_client_features {} 2024-09-13T02:56:55.583 INFO:teuthology.orchestra.run.smithi089.stdout:last_failure 0 2024-09-13T02:56:55.583 INFO:teuthology.orchestra.run.smithi089.stdout:last_failure_osd_epoch 44 2024-09-13T02:56:55.584 INFO:teuthology.orchestra.run.smithi089.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:56:55.584 INFO:teuthology.orchestra.run.smithi089.stdout:max_mds 2 2024-09-13T02:56:55.584 INFO:teuthology.orchestra.run.smithi089.stdout:in 0,1 2024-09-13T02:56:55.584 INFO:teuthology.orchestra.run.smithi089.stdout:up {0=14480,1=24257} 2024-09-13T02:56:55.584 INFO:teuthology.orchestra.run.smithi089.stdout:failed 2024-09-13T02:56:55.584 INFO:teuthology.orchestra.run.smithi089.stdout:damaged 2024-09-13T02:56:55.584 INFO:teuthology.orchestra.run.smithi089.stdout:stopped 2024-09-13T02:56:55.584 INFO:teuthology.orchestra.run.smithi089.stdout:data_pools [3] 2024-09-13T02:56:55.584 INFO:teuthology.orchestra.run.smithi089.stdout:metadata_pool 2 2024-09-13T02:56:55.584 INFO:teuthology.orchestra.run.smithi089.stdout:inline_data disabled 2024-09-13T02:56:55.584 INFO:teuthology.orchestra.run.smithi089.stdout:balancer 2024-09-13T02:56:55.584 INFO:teuthology.orchestra.run.smithi089.stdout:bal_rank_mask -1 2024-09-13T02:56:55.584 INFO:teuthology.orchestra.run.smithi089.stdout:standby_count_wanted 1 2024-09-13T02:56:55.584 INFO:teuthology.orchestra.run.smithi089.stdout:qdb_cluster leader: 0 members: 2024-09-13T02:56:55.585 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi089.rarddb{0:14480} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.89:6828/1561365213,v1:172.21.15.89:6829/1561365213] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:56:55.585 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi089.qjoitb{0:14488} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.89:6826/1464393547,v1:172.21.15.89:6827/1464393547] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:56:55.585 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi131.uasrkg{1:24257} state up:active seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.131:6824/260493836,v1:172.21.15.131:6825/260493836] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:56:55.585 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi131.rbovzc{1:24265} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.131:6826/665579373,v1:172.21.15.131:6827/665579373] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:56:55.585 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:56:55.585 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:56:55.586 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 21 2024-09-13T02:56:55.586 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.582+0000 7fc1e5360640 1 -- 172.21.15.89:0/704282298 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fc1c806e660 msgr2=0x7fc1c8070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:55.586 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.582+0000 7fc1e5360640 1 --2- 172.21.15.89:0/704282298 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fc1c806e660 0x7fc1c8070b10 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fc1d0007ac0 tx=0x7fc1d0035040 comp rx=0 tx=0).stop 2024-09-13T02:56:55.586 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.582+0000 7fc1e5360640 1 -- 172.21.15.89:0/704282298 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc1e00ff730 msgr2=0x7fc1e010d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:55.586 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.582+0000 7fc1e5360640 1 --2- 172.21.15.89:0/704282298 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc1e00ff730 0x7fc1e010d5c0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fc1d400eb70 tx=0x7fc1d400b040 comp rx=0 tx=0).stop 2024-09-13T02:56:55.586 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.583+0000 7fc1e5360640 1 -- 172.21.15.89:0/704282298 shutdown_connections 2024-09-13T02:56:55.586 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.583+0000 7fc1e5360640 1 --2- 172.21.15.89:0/704282298 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fc1c806e660 0x7fc1c8070b10 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:55.586 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.583+0000 7fc1e5360640 1 --2- 172.21.15.89:0/704282298 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc1e00ff730 0x7fc1e010d5c0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:55.586 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.583+0000 7fc1e5360640 1 --2- 172.21.15.89:0/704282298 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc1e0066410 0x7fc1e010d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:55.586 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.583+0000 7fc1e5360640 1 -- 172.21.15.89:0/704282298 >> 172.21.15.89:0/704282298 conn(0x7fc1e00f6c00 msgr2=0x7fc1e00f6fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:56:55.586 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.583+0000 7fc1e5360640 1 -- 172.21.15.89:0/704282298 shutdown_connections 2024-09-13T02:56:55.586 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.583+0000 7fc1e5360640 1 -- 172.21.15.89:0/704282298 wait complete. 2024-09-13T02:56:55.677 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.673+0000 7f231696d640 1 -- 172.21.15.89:0/2074253725 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23100ff6c0 msgr2=0x7f2310101aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:55.677 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.673+0000 7f231696d640 1 --2- 172.21.15.89:0/2074253725 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23100ff6c0 0x7f2310101aa0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f23040048d0 tx=0x7f2304009da0 comp rx=0 tx=0).stop 2024-09-13T02:56:55.677 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.673+0000 7f231696d640 1 -- 172.21.15.89:0/2074253725 shutdown_connections 2024-09-13T02:56:55.677 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.673+0000 7f231696d640 1 --2- 172.21.15.89:0/2074253725 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23100ff6c0 0x7f2310101aa0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:55.677 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.673+0000 7f231696d640 1 --2- 172.21.15.89:0/2074253725 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2310066730 0x7f23100ff180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:55.677 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.673+0000 7f231696d640 1 -- 172.21.15.89:0/2074253725 >> 172.21.15.89:0/2074253725 conn(0x7f23100f6c30 msgr2=0x7f23100f9060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:56:55.677 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.673+0000 7f231696d640 1 -- 172.21.15.89:0/2074253725 shutdown_connections 2024-09-13T02:56:55.677 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.673+0000 7f231696d640 1 -- 172.21.15.89:0/2074253725 wait complete. 2024-09-13T02:56:55.677 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.674+0000 7f231696d640 1 Processor -- start 2024-09-13T02:56:55.678 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.674+0000 7f231696d640 1 -- start start 2024-09-13T02:56:55.678 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.674+0000 7f231696d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2310066730 0x7f231010d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:55.678 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.674+0000 7f231696d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f23100ff6c0 0x7f231010d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:55.678 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.674+0000 7f231696d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f231010dc20 con 0x7f2310066730 2024-09-13T02:56:55.678 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.674+0000 7f231696d640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f231010e440 con 0x7f23100ff6c0 2024-09-13T02:56:55.678 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.674+0000 7f230ffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2310066730 0x7f231010d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:55.678 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.674+0000 7f230ffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2310066730 0x7f231010d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:57796/0 (socket says 172.21.15.89:57796) 2024-09-13T02:56:55.678 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.675+0000 7f230ffff640 1 -- 172.21.15.89:0/4039876970 learned_addr learned my addr 172.21.15.89:0/4039876970 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:56:55.678 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.675+0000 7f230f7fe640 1 --2- 172.21.15.89:0/4039876970 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f23100ff6c0 0x7f231010d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:55.678 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.675+0000 7f230ffff640 1 -- 172.21.15.89:0/4039876970 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f23100ff6c0 msgr2=0x7f231010d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:55.678 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.675+0000 7f230ffff640 1 --2- 172.21.15.89:0/4039876970 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f23100ff6c0 0x7f231010d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:55.678 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.675+0000 7f230ffff640 1 -- 172.21.15.89:0/4039876970 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2304005040 con 0x7f2310066730 2024-09-13T02:56:55.678 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.675+0000 7f230ffff640 1 --2- 172.21.15.89:0/4039876970 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2310066730 0x7f231010d090 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2300002840 tx=0x7f2300004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:56:55.679 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.675+0000 7f230cff9640 1 -- 172.21.15.89:0/4039876970 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2300007c30 con 0x7f2310066730 2024-09-13T02:56:55.679 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.675+0000 7f231696d640 1 -- 172.21.15.89:0/4039876970 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f231010e6d0 con 0x7f2310066730 2024-09-13T02:56:55.679 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.675+0000 7f230cff9640 1 -- 172.21.15.89:0/4039876970 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f230000f040 con 0x7f2310066730 2024-09-13T02:56:55.679 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.675+0000 7f230cff9640 1 -- 172.21.15.89:0/4039876970 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f230000d990 con 0x7f2310066730 2024-09-13T02:56:55.679 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.675+0000 7f231696d640 1 -- 172.21.15.89:0/4039876970 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f231010ec70 con 0x7f2310066730 2024-09-13T02:56:55.680 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.677+0000 7f231696d640 1 -- 172.21.15.89:0/4039876970 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23100fa8d0 con 0x7f2310066730 2024-09-13T02:56:55.680 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.677+0000 7f230cff9640 1 -- 172.21.15.89:0/4039876970 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 37) v1 ==== 92653+0+0 (secure 0 0 0) 0x7f2300009600 con 0x7f2310066730 2024-09-13T02:56:55.680 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.678+0000 7f230cff9640 1 --2- 172.21.15.89:0/4039876970 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f22f806e660 0x7f22f8070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:55.680 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.678+0000 7f230cff9640 1 -- 172.21.15.89:0/4039876970 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f230008e1e0 con 0x7f2310066730 2024-09-13T02:56:55.680 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.678+0000 7f230f7fe640 1 --2- 172.21.15.89:0/4039876970 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f22f806e660 0x7f22f8070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:55.680 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.678+0000 7f230f7fe640 1 --2- 172.21.15.89:0/4039876970 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f22f806e660 0x7f22f8070b10 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f231010ce40 tx=0x7f2304035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:56:55.683 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.682+0000 7f230cff9640 1 -- 172.21.15.89:0/4039876970 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f2300057130 con 0x7f2310066730 2024-09-13T02:56:55.786 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:55 smithi089 ceph-mon[91553]: from='client.34132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:56:55.786 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:55 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:55.786 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:55 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:55.786 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:55 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:56:55.787 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:55 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:56:55.787 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:55 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:55.787 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:55 smithi089 ceph-mon[91553]: from='client.34136 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:56:55.787 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:55 smithi089 ceph-mon[91553]: Reconfiguring mon.smithi089 (monmap changed)... 2024-09-13T02:56:55.787 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:55 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T02:56:55.787 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:55 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T02:56:55.787 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:55 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:56:55.787 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:55 smithi089 ceph-mon[91553]: Reconfiguring daemon mon.smithi089 on smithi089 2024-09-13T02:56:55.787 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:55 smithi089 ceph-mon[91553]: from='client.? 172.21.15.89:0/1333302742' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:56:55.879 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.877+0000 7f231696d640 1 -- 172.21.15.89:0/4039876970 --> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f231010f010 con 0x7f22f806e660 2024-09-13T02:56:55.880 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.879+0000 7f230cff9640 1 -- 172.21.15.89:0/4039876970 <== mgr.34104 v2:172.21.15.89:6800/1881577856 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7f231010f010 con 0x7f22f806e660 2024-09-13T02:56:55.880 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-13T02:56:55.880 INFO:teuthology.orchestra.run.smithi089.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d", 2024-09-13T02:56:55.880 INFO:teuthology.orchestra.run.smithi089.stdout: "in_progress": true, 2024-09-13T02:56:55.880 INFO:teuthology.orchestra.run.smithi089.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T02:56:55.880 INFO:teuthology.orchestra.run.smithi089.stdout: "services_complete": [ 2024-09-13T02:56:55.880 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr", 2024-09-13T02:56:55.881 INFO:teuthology.orchestra.run.smithi089.stdout: "mon" 2024-09-13T02:56:55.881 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-13T02:56:55.881 INFO:teuthology.orchestra.run.smithi089.stdout: "progress": "4/21 daemons upgraded", 2024-09-13T02:56:55.881 INFO:teuthology.orchestra.run.smithi089.stdout: "message": "Currently upgrading mon daemons", 2024-09-13T02:56:55.881 INFO:teuthology.orchestra.run.smithi089.stdout: "is_paused": false 2024-09-13T02:56:55.881 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-13T02:56:55.882 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.881+0000 7f231696d640 1 -- 172.21.15.89:0/4039876970 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f22f806e660 msgr2=0x7f22f8070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:55.882 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.881+0000 7f231696d640 1 --2- 172.21.15.89:0/4039876970 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f22f806e660 0x7f22f8070b10 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f231010ce40 tx=0x7f2304035040 comp rx=0 tx=0).stop 2024-09-13T02:56:55.882 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.881+0000 7f231696d640 1 -- 172.21.15.89:0/4039876970 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2310066730 msgr2=0x7f231010d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:55.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.881+0000 7f231696d640 1 --2- 172.21.15.89:0/4039876970 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2310066730 0x7f231010d090 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2300002840 tx=0x7f2300004570 comp rx=0 tx=0).stop 2024-09-13T02:56:55.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.881+0000 7f231696d640 1 -- 172.21.15.89:0/4039876970 shutdown_connections 2024-09-13T02:56:55.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.881+0000 7f231696d640 1 --2- 172.21.15.89:0/4039876970 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f22f806e660 0x7f22f8070b10 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:55.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.881+0000 7f231696d640 1 --2- 172.21.15.89:0/4039876970 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f23100ff6c0 0x7f231010d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:55.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.881+0000 7f231696d640 1 --2- 172.21.15.89:0/4039876970 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2310066730 0x7f231010d090 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:55.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.881+0000 7f231696d640 1 -- 172.21.15.89:0/4039876970 >> 172.21.15.89:0/4039876970 conn(0x7f23100f6c30 msgr2=0x7f23100f7050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:56:55.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.881+0000 7f231696d640 1 -- 172.21.15.89:0/4039876970 shutdown_connections 2024-09-13T02:56:55.883 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.881+0000 7f231696d640 1 -- 172.21.15.89:0/4039876970 wait complete. 2024-09-13T02:56:55.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:55 smithi131 ceph-mon[78839]: from='client.34132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:56:55.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:55 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:55.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:55 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:55.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:55 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:56:55.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:55 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:56:55.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:55 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:55.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:55 smithi131 ceph-mon[78839]: from='client.34136 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:56:55.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:55 smithi131 ceph-mon[78839]: Reconfiguring mon.smithi089 (monmap changed)... 2024-09-13T02:56:55.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:55 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T02:56:55.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:55 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T02:56:55.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:55 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:56:55.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:55 smithi131 ceph-mon[78839]: Reconfiguring daemon mon.smithi089 on smithi089 2024-09-13T02:56:55.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:55 smithi131 ceph-mon[78839]: from='client.? 172.21.15.89:0/1333302742' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:56:55.963 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.961+0000 7f7be596b640 1 -- 172.21.15.89:0/991988047 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7be00fb3e0 msgr2=0x7f7be00fb7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:55.963 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.961+0000 7f7be596b640 1 --2- 172.21.15.89:0/991988047 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7be00fb3e0 0x7f7be00fb7f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7bd00048d0 tx=0x7f7bd0009da0 comp rx=0 tx=0).stop 2024-09-13T02:56:55.963 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.961+0000 7f7be596b640 1 -- 172.21.15.89:0/991988047 shutdown_connections 2024-09-13T02:56:55.964 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.961+0000 7f7be596b640 1 --2- 172.21.15.89:0/991988047 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7be00fc6b0 0x7f7be00fcb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:55.964 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.961+0000 7f7be596b640 1 --2- 172.21.15.89:0/991988047 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7be00fb3e0 0x7f7be00fb7f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:55.964 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.961+0000 7f7be596b640 1 -- 172.21.15.89:0/991988047 >> 172.21.15.89:0/991988047 conn(0x7f7be00f6b80 msgr2=0x7f7be00f8fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:56:55.964 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.961+0000 7f7be596b640 1 -- 172.21.15.89:0/991988047 shutdown_connections 2024-09-13T02:56:55.964 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.961+0000 7f7be596b640 1 -- 172.21.15.89:0/991988047 wait complete. 2024-09-13T02:56:55.964 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.962+0000 7f7be596b640 1 Processor -- start 2024-09-13T02:56:55.964 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.962+0000 7f7be596b640 1 -- start start 2024-09-13T02:56:55.965 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.962+0000 7f7be596b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7be00fb3e0 0x7f7be00ff4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:55.965 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.962+0000 7f7be596b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7be00fc6b0 0x7f7be00fd9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:55.966 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.962+0000 7f7be596b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7be00fdf30 con 0x7f7be00fb3e0 2024-09-13T02:56:55.966 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.962+0000 7f7be596b640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7be00fe070 con 0x7f7be00fc6b0 2024-09-13T02:56:55.966 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.962+0000 7f7bdeffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7be00fb3e0 0x7f7be00ff4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:55.966 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.962+0000 7f7bdeffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7be00fb3e0 0x7f7be00ff4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:57820/0 (socket says 172.21.15.89:57820) 2024-09-13T02:56:55.966 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.962+0000 7f7bdeffd640 1 -- 172.21.15.89:0/1289007304 learned_addr learned my addr 172.21.15.89:0/1289007304 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:56:55.966 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.963+0000 7f7bde7fc640 1 --2- 172.21.15.89:0/1289007304 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7be00fc6b0 0x7f7be00fd9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:55.966 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.963+0000 7f7bdeffd640 1 -- 172.21.15.89:0/1289007304 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7be00fc6b0 msgr2=0x7f7be00fd9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:55.966 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.963+0000 7f7bdeffd640 1 --2- 172.21.15.89:0/1289007304 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7be00fc6b0 0x7f7be00fd9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:55.966 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.963+0000 7f7bdeffd640 1 -- 172.21.15.89:0/1289007304 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bd0005040 con 0x7f7be00fb3e0 2024-09-13T02:56:55.966 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.963+0000 7f7bdeffd640 1 --2- 172.21.15.89:0/1289007304 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7be00fb3e0 0x7f7be00ff4b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7bd0003080 tx=0x7f7bd0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:56:55.966 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.963+0000 7f7bc77fe640 1 -- 172.21.15.89:0/1289007304 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7bd0038070 con 0x7f7be00fb3e0 2024-09-13T02:56:55.966 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.963+0000 7f7bc77fe640 1 -- 172.21.15.89:0/1289007304 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f7bd002abd0 con 0x7f7be00fb3e0 2024-09-13T02:56:55.966 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.963+0000 7f7be596b640 1 -- 172.21.15.89:0/1289007304 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7be00fe2f0 con 0x7f7be00fb3e0 2024-09-13T02:56:55.967 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.963+0000 7f7bc77fe640 1 -- 172.21.15.89:0/1289007304 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7bd003e670 con 0x7f7be00fb3e0 2024-09-13T02:56:55.967 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.963+0000 7f7be596b640 1 -- 172.21.15.89:0/1289007304 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7be01150c0 con 0x7f7be00fb3e0 2024-09-13T02:56:55.967 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.964+0000 7f7be596b640 1 -- 172.21.15.89:0/1289007304 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7be005ed70 con 0x7f7be00fb3e0 2024-09-13T02:56:55.967 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.965+0000 7f7bc77fe640 1 -- 172.21.15.89:0/1289007304 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 37) v1 ==== 92653+0+0 (secure 0 0 0) 0x7f7bd0030020 con 0x7f7be00fb3e0 2024-09-13T02:56:55.967 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.965+0000 7f7bc77fe640 1 --2- 172.21.15.89:0/1289007304 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f7bc806e660 0x7f7bc8070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:56:55.968 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.966+0000 7f7bc77fe640 1 -- 172.21.15.89:0/1289007304 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f7bd00ae720 con 0x7f7be00fb3e0 2024-09-13T02:56:55.968 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.966+0000 7f7bde7fc640 1 --2- 172.21.15.89:0/1289007304 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f7bc806e660 0x7f7bc8070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:56:55.968 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.966+0000 7f7bde7fc640 1 --2- 172.21.15.89:0/1289007304 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f7bc806e660 0x7f7bc8070b10 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7bd4004c20 tx=0x7f7bd4009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:56:55.971 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:55.970+0000 7f7bc77fe640 1 -- 172.21.15.89:0/1289007304 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f7bd0077700 con 0x7f7be00fb3e0 2024-09-13T02:56:56.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:56.229+0000 7f7be596b640 1 -- 172.21.15.89:0/1289007304 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f7be0103de0 con 0x7f7be00fb3e0 2024-09-13T02:56:56.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:56.229+0000 7f7bc77fe640 1 -- 172.21.15.89:0/1289007304 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f7bd007adc0 con 0x7f7be00fb3e0 2024-09-13T02:56:56.231 INFO:teuthology.orchestra.run.smithi089.stdout:HEALTH_OK 2024-09-13T02:56:56.234 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:56.232+0000 7f7be596b640 1 -- 172.21.15.89:0/1289007304 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f7bc806e660 msgr2=0x7f7bc8070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:56.234 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:56.232+0000 7f7be596b640 1 --2- 172.21.15.89:0/1289007304 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f7bc806e660 0x7f7bc8070b10 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f7bd4004c20 tx=0x7f7bd4009040 comp rx=0 tx=0).stop 2024-09-13T02:56:56.234 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:56.232+0000 7f7be596b640 1 -- 172.21.15.89:0/1289007304 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7be00fb3e0 msgr2=0x7f7be00ff4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:56:56.234 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:56.232+0000 7f7be596b640 1 --2- 172.21.15.89:0/1289007304 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7be00fb3e0 0x7f7be00ff4b0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f7bd0003080 tx=0x7f7bd0009da0 comp rx=0 tx=0).stop 2024-09-13T02:56:56.234 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:56.232+0000 7f7be596b640 1 -- 172.21.15.89:0/1289007304 shutdown_connections 2024-09-13T02:56:56.234 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:56.232+0000 7f7be596b640 1 --2- 172.21.15.89:0/1289007304 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f7bc806e660 0x7f7bc8070b10 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:56.234 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:56.232+0000 7f7be596b640 1 --2- 172.21.15.89:0/1289007304 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7be00fc6b0 0x7f7be00fd9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:56.234 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:56.232+0000 7f7be596b640 1 --2- 172.21.15.89:0/1289007304 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7be00fb3e0 0x7f7be00ff4b0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:56:56.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:56.232+0000 7f7be596b640 1 -- 172.21.15.89:0/1289007304 >> 172.21.15.89:0/1289007304 conn(0x7f7be00f6b80 msgr2=0x7f7be00655f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:56:56.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:56.232+0000 7f7be596b640 1 -- 172.21.15.89:0/1289007304 shutdown_connections 2024-09-13T02:56:56.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:56:56.232+0000 7f7be596b640 1 -- 172.21.15.89:0/1289007304 wait complete. 2024-09-13T02:56:56.776 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:56 smithi089 ceph-mon[91553]: from='client.34140 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:56:56.776 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:56 smithi089 ceph-mon[91553]: pgmap v13: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T02:56:56.776 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:56 smithi089 ceph-mon[91553]: from='client.? 172.21.15.89:0/704282298' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T02:56:56.776 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:56 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:56.777 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:56 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:56.777 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:56 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi089.guohvs", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T02:56:56.777 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:56 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T02:56:56.777 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:56 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:56:56.777 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:56 smithi089 ceph-mon[91553]: from='client.? 172.21.15.89:0/1289007304' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T02:56:56.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:56 smithi131 ceph-mon[78839]: from='client.34140 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:56:56.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:56 smithi131 ceph-mon[78839]: pgmap v13: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T02:56:56.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:56 smithi131 ceph-mon[78839]: from='client.? 172.21.15.89:0/704282298' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T02:56:56.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:56 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:56.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:56 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:56.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:56 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi089.guohvs", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T02:56:56.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:56 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T02:56:56.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:56 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:56:56.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:56 smithi131 ceph-mon[78839]: from='client.? 172.21.15.89:0/1289007304' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T02:56:57.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:57 smithi131 ceph-mon[78839]: from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:56:57.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:57 smithi131 ceph-mon[78839]: Reconfiguring mgr.smithi089.guohvs (monmap changed)... 2024-09-13T02:56:57.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:57 smithi131 ceph-mon[78839]: Reconfiguring daemon mgr.smithi089.guohvs on smithi089 2024-09-13T02:56:58.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:57 smithi089 ceph-mon[91553]: from='client.34152 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:56:58.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:57 smithi089 ceph-mon[91553]: Reconfiguring mgr.smithi089.guohvs (monmap changed)... 2024-09-13T02:56:58.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:57 smithi089 ceph-mon[91553]: Reconfiguring daemon mgr.smithi089.guohvs on smithi089 2024-09-13T02:56:58.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:58 smithi131 ceph-mon[78839]: pgmap v14: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T02:56:58.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:58 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:58.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:58 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:58.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:58 smithi131 ceph-mon[78839]: Reconfiguring crash.smithi089 (monmap changed)... 2024-09-13T02:56:58.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:58 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi089", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T02:56:58.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:58 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:56:58.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:56:58 smithi131 ceph-mon[78839]: Reconfiguring daemon crash.smithi089 on smithi089 2024-09-13T02:56:59.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:58 smithi089 ceph-mon[91553]: pgmap v14: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T02:56:59.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:58 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:59.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:58 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:56:59.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:58 smithi089 ceph-mon[91553]: Reconfiguring crash.smithi089 (monmap changed)... 2024-09-13T02:56:59.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:58 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi089", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T02:56:59.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:58 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:56:59.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:56:58 smithi089 ceph-mon[91553]: Reconfiguring daemon crash.smithi089 on smithi089 2024-09-13T02:57:00.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:00 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:00.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:00 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:00.435 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:00 smithi131 ceph-mon[78839]: Reconfiguring osd.0 (monmap changed)... 2024-09-13T02:57:00.435 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:00 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-13T02:57:00.435 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:00 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:57:00.435 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:00 smithi131 ceph-mon[78839]: Reconfiguring daemon osd.0 on smithi089 2024-09-13T02:57:00.435 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:00 smithi131 ceph-mon[78839]: pgmap v15: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T02:57:00.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:00 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:00.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:00 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:00.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:00 smithi089 ceph-mon[91553]: Reconfiguring osd.0 (monmap changed)... 2024-09-13T02:57:00.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:00 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-13T02:57:00.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:00 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:57:00.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:00 smithi089 ceph-mon[91553]: Reconfiguring daemon osd.0 on smithi089 2024-09-13T02:57:00.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:00 smithi089 ceph-mon[91553]: pgmap v15: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T02:57:02.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:01 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:02.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:01 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:02.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:01 smithi089 ceph-mon[91553]: Reconfiguring osd.1 (monmap changed)... 2024-09-13T02:57:02.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:01 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-13T02:57:02.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:01 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:57:02.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:01 smithi089 ceph-mon[91553]: Reconfiguring daemon osd.1 on smithi089 2024-09-13T02:57:02.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:01 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:02.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:01 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:02.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:01 smithi131 ceph-mon[78839]: Reconfiguring osd.1 (monmap changed)... 2024-09-13T02:57:02.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:01 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-13T02:57:02.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:01 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:57:02.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:01 smithi131 ceph-mon[78839]: Reconfiguring daemon osd.1 on smithi089 2024-09-13T02:57:02.822 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:02 smithi089 ceph-mon[91553]: pgmap v16: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T02:57:02.822 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:02 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:02.822 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:02 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:02.822 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:02 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-13T02:57:02.822 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:02 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:57:03.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:02 smithi131 ceph-mon[78839]: pgmap v16: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T02:57:03.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:02 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:03.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:02 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:03.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:02 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-13T02:57:03.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:02 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:57:04.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:03 smithi089 ceph-mon[91553]: Reconfiguring osd.2 (monmap changed)... 2024-09-13T02:57:04.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:03 smithi089 ceph-mon[91553]: Reconfiguring daemon osd.2 on smithi089 2024-09-13T02:57:04.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:03 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:04.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:03 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:04.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:03 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi089.qjoitb", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T02:57:04.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:03 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:57:04.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:03 smithi131 ceph-mon[78839]: Reconfiguring osd.2 (monmap changed)... 2024-09-13T02:57:04.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:03 smithi131 ceph-mon[78839]: Reconfiguring daemon osd.2 on smithi089 2024-09-13T02:57:04.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:03 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:04.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:03 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:04.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:03 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi089.qjoitb", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T02:57:04.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:03 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:57:05.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:04 smithi089 ceph-mon[91553]: pgmap v17: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T02:57:05.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:04 smithi089 ceph-mon[91553]: Reconfiguring mds.cephfs.smithi089.qjoitb (monmap changed)... 2024-09-13T02:57:05.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:04 smithi089 ceph-mon[91553]: Reconfiguring daemon mds.cephfs.smithi089.qjoitb on smithi089 2024-09-13T02:57:05.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:04 smithi131 ceph-mon[78839]: pgmap v17: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T02:57:05.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:04 smithi131 ceph-mon[78839]: Reconfiguring mds.cephfs.smithi089.qjoitb (monmap changed)... 2024-09-13T02:57:05.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:04 smithi131 ceph-mon[78839]: Reconfiguring daemon mds.cephfs.smithi089.qjoitb on smithi089 2024-09-13T02:57:06.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:06 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:06.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:06 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:06.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:06 smithi131 ceph-mon[78839]: Reconfiguring mds.cephfs.smithi089.rarddb (monmap changed)... 2024-09-13T02:57:06.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:06 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi089.rarddb", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T02:57:06.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:06 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:57:06.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:06 smithi131 ceph-mon[78839]: Reconfiguring daemon mds.cephfs.smithi089.rarddb on smithi089 2024-09-13T02:57:06.435 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:06 smithi131 ceph-mon[78839]: pgmap v18: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T02:57:06.435 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:06 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:57:06.524 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:06 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:06.524 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:06 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:06.524 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:06 smithi089 ceph-mon[91553]: Reconfiguring mds.cephfs.smithi089.rarddb (monmap changed)... 2024-09-13T02:57:06.524 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:06 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi089.rarddb", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T02:57:06.525 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:06 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:57:06.525 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:06 smithi089 ceph-mon[91553]: Reconfiguring daemon mds.cephfs.smithi089.rarddb on smithi089 2024-09-13T02:57:06.525 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:06 smithi089 ceph-mon[91553]: pgmap v18: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T02:57:06.525 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:06 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:57:08.000 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:07 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:08.000 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:07 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:08.000 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:07 smithi131 ceph-mon[78839]: Reconfiguring crash.smithi131 (monmap changed)... 2024-09-13T02:57:08.000 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:07 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi131", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T02:57:08.000 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:07 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:57:08.000 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:07 smithi131 ceph-mon[78839]: Reconfiguring daemon crash.smithi131 on smithi131 2024-09-13T02:57:08.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:07 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:08.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:07 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:08.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:07 smithi089 ceph-mon[91553]: Reconfiguring crash.smithi131 (monmap changed)... 2024-09-13T02:57:08.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:07 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi131", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T02:57:08.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:07 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:57:08.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:07 smithi089 ceph-mon[91553]: Reconfiguring daemon crash.smithi131 on smithi131 2024-09-13T02:57:09.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:08 smithi089 ceph-mon[91553]: pgmap v19: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T02:57:09.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:08 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:09.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:08 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:09.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:08 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi131.aunbqd", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T02:57:09.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:08 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T02:57:09.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:08 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:57:09.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:08 smithi131 ceph-mon[78839]: pgmap v19: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T02:57:09.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:08 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:09.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:08 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:09.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:08 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi131.aunbqd", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-13T02:57:09.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:08 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-13T02:57:09.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:08 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:57:10.003 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:09 smithi131 ceph-mon[78839]: Reconfiguring mgr.smithi131.aunbqd (monmap changed)... 2024-09-13T02:57:10.004 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:09 smithi131 ceph-mon[78839]: Reconfiguring daemon mgr.smithi131.aunbqd on smithi131 2024-09-13T02:57:10.004 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:09 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:10.004 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:09 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:10.004 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:09 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T02:57:10.004 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:09 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T02:57:10.004 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:09 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:57:10.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:09 smithi089 ceph-mon[91553]: Reconfiguring mgr.smithi131.aunbqd (monmap changed)... 2024-09-13T02:57:10.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:09 smithi089 ceph-mon[91553]: Reconfiguring daemon mgr.smithi131.aunbqd on smithi131 2024-09-13T02:57:10.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:09 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:10.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:09 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:10.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:09 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-13T02:57:10.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:09 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-13T02:57:10.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:09 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:57:11.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:10 smithi089 ceph-mon[91553]: Reconfiguring mon.smithi131 (monmap changed)... 2024-09-13T02:57:11.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:10 smithi089 ceph-mon[91553]: Reconfiguring daemon mon.smithi131 on smithi131 2024-09-13T02:57:11.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:10 smithi089 ceph-mon[91553]: pgmap v20: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T02:57:11.163 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:10 smithi131 ceph-mon[78839]: Reconfiguring mon.smithi131 (monmap changed)... 2024-09-13T02:57:11.164 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:10 smithi131 ceph-mon[78839]: Reconfiguring daemon mon.smithi131 on smithi131 2024-09-13T02:57:11.164 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:10 smithi131 ceph-mon[78839]: pgmap v20: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T02:57:12.117 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:11 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:12.225 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:11 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:12.225 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:11 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-13T02:57:12.225 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:11 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:57:12.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:11 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:12.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:11 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:12.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:11 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-13T02:57:12.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:11 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:57:13.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:12 smithi131 ceph-mon[78839]: Reconfiguring osd.3 (monmap changed)... 2024-09-13T02:57:13.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:12 smithi131 ceph-mon[78839]: Reconfiguring daemon osd.3 on smithi131 2024-09-13T02:57:13.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:12 smithi131 ceph-mon[78839]: pgmap v21: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T02:57:13.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:12 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:13.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:12 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:13.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:12 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-13T02:57:13.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:12 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:57:13.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:12 smithi089 ceph-mon[91553]: Reconfiguring osd.3 (monmap changed)... 2024-09-13T02:57:13.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:12 smithi089 ceph-mon[91553]: Reconfiguring daemon osd.3 on smithi131 2024-09-13T02:57:13.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:12 smithi089 ceph-mon[91553]: pgmap v21: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T02:57:13.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:12 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:13.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:12 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:13.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:12 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-13T02:57:13.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:12 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:57:14.111 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:13 smithi131 ceph-mon[78839]: Reconfiguring osd.4 (monmap changed)... 2024-09-13T02:57:14.111 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:13 smithi131 ceph-mon[78839]: Reconfiguring daemon osd.4 on smithi131 2024-09-13T02:57:14.111 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:13 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:14.111 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:13 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:14.111 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:13 smithi131 ceph-mon[78839]: Reconfiguring osd.5 (monmap changed)... 2024-09-13T02:57:14.111 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:13 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-13T02:57:14.111 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:13 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:57:14.112 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:13 smithi131 ceph-mon[78839]: Reconfiguring daemon osd.5 on smithi131 2024-09-13T02:57:14.112 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:13 smithi131 ceph-mon[78839]: pgmap v22: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T02:57:14.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:13 smithi089 ceph-mon[91553]: Reconfiguring osd.4 (monmap changed)... 2024-09-13T02:57:14.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:13 smithi089 ceph-mon[91553]: Reconfiguring daemon osd.4 on smithi131 2024-09-13T02:57:14.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:13 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:14.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:13 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:14.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:13 smithi089 ceph-mon[91553]: Reconfiguring osd.5 (monmap changed)... 2024-09-13T02:57:14.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:13 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-13T02:57:14.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:13 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:57:14.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:13 smithi089 ceph-mon[91553]: Reconfiguring daemon osd.5 on smithi131 2024-09-13T02:57:14.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:13 smithi089 ceph-mon[91553]: pgmap v22: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T02:57:16.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:15 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:16.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:15 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:16.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:15 smithi131 ceph-mon[78839]: Reconfiguring mds.cephfs.smithi131.uasrkg (monmap changed)... 2024-09-13T02:57:16.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:15 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi131.uasrkg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T02:57:16.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:15 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:57:16.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:15 smithi131 ceph-mon[78839]: Reconfiguring daemon mds.cephfs.smithi131.uasrkg on smithi131 2024-09-13T02:57:16.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:15 smithi131 ceph-mon[78839]: pgmap v23: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T02:57:16.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:15 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:16.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:15 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:16.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:15 smithi089 ceph-mon[91553]: Reconfiguring mds.cephfs.smithi131.uasrkg (monmap changed)... 2024-09-13T02:57:16.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:15 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi131.uasrkg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T02:57:16.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:15 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:57:16.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:15 smithi089 ceph-mon[91553]: Reconfiguring daemon mds.cephfs.smithi131.uasrkg on smithi131 2024-09-13T02:57:16.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:15 smithi089 ceph-mon[91553]: pgmap v23: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T02:57:17.597 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:17 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:17.598 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:17 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:17.598 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:17 smithi131 ceph-mon[78839]: Reconfiguring mds.cephfs.smithi131.rbovzc (monmap changed)... 2024-09-13T02:57:17.598 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:17 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi131.rbovzc", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T02:57:17.598 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:17 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:57:17.598 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:17 smithi131 ceph-mon[78839]: Reconfiguring daemon mds.cephfs.smithi131.rbovzc on smithi131 2024-09-13T02:57:17.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:17 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:17.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:17 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:17.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:17 smithi089 ceph-mon[91553]: Reconfiguring mds.cephfs.smithi131.rbovzc (monmap changed)... 2024-09-13T02:57:17.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:17 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi131.rbovzc", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T02:57:17.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:17 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:57:17.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:17 smithi089 ceph-mon[91553]: Reconfiguring daemon mds.cephfs.smithi131.rbovzc on smithi131 2024-09-13T02:57:18.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:18 smithi131 ceph-mon[78839]: pgmap v24: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T02:57:18.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:18 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:18.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:18 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:18.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:18 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:57:18.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:18 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:57:18.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:18 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:57:18.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:18 smithi131 ceph-mon[78839]: Upgrade: Setting container_image for all mon 2024-09-13T02:57:18.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:18 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:18.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:18 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi089"}]: dispatch 2024-09-13T02:57:18.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:18 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi089"}]': finished 2024-09-13T02:57:18.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:18 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi131"}]: dispatch 2024-09-13T02:57:18.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:18 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi131"}]': finished 2024-09-13T02:57:19.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:18 smithi089 ceph-mon[91553]: pgmap v24: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T02:57:19.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:18 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:19.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:18 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:19.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:18 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:57:19.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:18 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:57:19.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:18 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:57:19.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:18 smithi089 ceph-mon[91553]: Upgrade: Setting container_image for all mon 2024-09-13T02:57:19.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:18 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:19.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:18 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi089"}]: dispatch 2024-09-13T02:57:19.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:18 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi089"}]': finished 2024-09-13T02:57:19.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:18 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi131"}]: dispatch 2024-09-13T02:57:19.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:18 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi131"}]': finished 2024-09-13T02:57:20.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:20 smithi131 ceph-mon[78839]: Upgrade: Updating crash.smithi089 (1/2) 2024-09-13T02:57:20.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:20 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:20.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:20 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi089", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T02:57:20.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:20 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:57:20.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:20 smithi131 ceph-mon[78839]: Deploying daemon crash.smithi089 on smithi089 2024-09-13T02:57:20.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:20 smithi131 ceph-mon[78839]: pgmap v25: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T02:57:20.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:20 smithi089 ceph-mon[91553]: Upgrade: Updating crash.smithi089 (1/2) 2024-09-13T02:57:20.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:20 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:20.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:20 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi089", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T02:57:20.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:20 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:57:20.536 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:20 smithi089 ceph-mon[91553]: Deploying daemon crash.smithi089 on smithi089 2024-09-13T02:57:20.536 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:20 smithi089 ceph-mon[91553]: pgmap v25: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T02:57:21.377 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:21 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:57:21.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:21 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:57:22.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:22 smithi089 ceph-mon[91553]: pgmap v26: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T02:57:22.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:22 smithi131 ceph-mon[78839]: pgmap v26: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T02:57:24.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:23 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:24.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:23 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:24.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:23 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:24.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:23 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:25.052 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:24 smithi089 ceph-mon[91553]: pgmap v27: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T02:57:25.052 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:24 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:25.052 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:24 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi131", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T02:57:25.052 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:24 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:57:25.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:24 smithi131 ceph-mon[78839]: pgmap v27: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T02:57:25.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:24 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:25.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:24 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi131", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-09-13T02:57:25.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:24 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:57:25.899 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:25 smithi131 ceph-mon[78839]: Upgrade: Updating crash.smithi131 (2/2) 2024-09-13T02:57:25.899 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:25 smithi131 ceph-mon[78839]: Deploying daemon crash.smithi131 on smithi131 2024-09-13T02:57:26.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:25 smithi089 ceph-mon[91553]: Upgrade: Updating crash.smithi131 (2/2) 2024-09-13T02:57:26.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:25 smithi089 ceph-mon[91553]: Deploying daemon crash.smithi131 on smithi131 2024-09-13T02:57:26.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.315+0000 7fb113bbf640 1 -- 172.21.15.89:0/2733234752 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb10c066790 msgr2=0x7fb10c0ff160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:26.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.315+0000 7fb113bbf640 1 --2- 172.21.15.89:0/2733234752 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb10c066790 0x7fb10c0ff160 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb1080048d0 tx=0x7fb108009da0 comp rx=0 tx=0).stop 2024-09-13T02:57:26.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.315+0000 7fb113bbf640 1 -- 172.21.15.89:0/2733234752 shutdown_connections 2024-09-13T02:57:26.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.315+0000 7fb113bbf640 1 --2- 172.21.15.89:0/2733234752 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb10c0ff6a0 0x7fb10c101a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:26.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.315+0000 7fb113bbf640 1 --2- 172.21.15.89:0/2733234752 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb10c066790 0x7fb10c0ff160 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:26.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.315+0000 7fb113bbf640 1 -- 172.21.15.89:0/2733234752 >> 172.21.15.89:0/2733234752 conn(0x7fb10c0f6c10 msgr2=0x7fb10c0f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:57:26.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.315+0000 7fb113bbf640 1 -- 172.21.15.89:0/2733234752 shutdown_connections 2024-09-13T02:57:26.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.315+0000 7fb113bbf640 1 -- 172.21.15.89:0/2733234752 wait complete. 2024-09-13T02:57:26.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.316+0000 7fb113bbf640 1 Processor -- start 2024-09-13T02:57:26.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.316+0000 7fb113bbf640 1 -- start start 2024-09-13T02:57:26.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.316+0000 7fb113bbf640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb10c066790 0x7fb10c10d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:26.320 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.316+0000 7fb113bbf640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb10c0ff6a0 0x7fb10c10d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:26.320 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.316+0000 7fb113bbf640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb10c10dcb0 con 0x7fb10c066790 2024-09-13T02:57:26.320 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.316+0000 7fb113bbf640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb10c10e480 con 0x7fb10c0ff6a0 2024-09-13T02:57:26.320 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.316+0000 7fb11195b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb10c066790 0x7fb10c10d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:26.320 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.316+0000 7fb11195b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb10c066790 0x7fb10c10d120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:38340/0 (socket says 172.21.15.89:38340) 2024-09-13T02:57:26.320 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.316+0000 7fb11195b640 1 -- 172.21.15.89:0/65427172 learned_addr learned my addr 172.21.15.89:0/65427172 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:57:26.320 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.316+0000 7fb11115a640 1 --2- 172.21.15.89:0/65427172 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb10c0ff6a0 0x7fb10c10d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:26.320 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.316+0000 7fb11195b640 1 -- 172.21.15.89:0/65427172 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb10c0ff6a0 msgr2=0x7fb10c10d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:26.320 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.316+0000 7fb11195b640 1 --2- 172.21.15.89:0/65427172 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb10c0ff6a0 0x7fb10c10d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:26.320 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.316+0000 7fb11195b640 1 -- 172.21.15.89:0/65427172 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb108005040 con 0x7fb10c066790 2024-09-13T02:57:26.320 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.317+0000 7fb11195b640 1 --2- 172.21.15.89:0/65427172 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb10c066790 0x7fb10c10d120 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb1080043d0 tx=0x7fb108009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:57:26.320 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.317+0000 7fb1027fc640 1 -- 172.21.15.89:0/65427172 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb108038070 con 0x7fb10c066790 2024-09-13T02:57:26.321 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.317+0000 7fb1027fc640 1 -- 172.21.15.89:0/65427172 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb108009800 con 0x7fb10c066790 2024-09-13T02:57:26.321 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.317+0000 7fb1027fc640 1 -- 172.21.15.89:0/65427172 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb10803e630 con 0x7fb10c066790 2024-09-13T02:57:26.321 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.317+0000 7fb113bbf640 1 -- 172.21.15.89:0/65427172 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb10c10e6b0 con 0x7fb10c066790 2024-09-13T02:57:26.321 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.317+0000 7fb113bbf640 1 -- 172.21.15.89:0/65427172 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb10c10ec50 con 0x7fb10c066790 2024-09-13T02:57:26.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.318+0000 7fb113bbf640 1 -- 172.21.15.89:0/65427172 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb10c0fa8b0 con 0x7fb10c066790 2024-09-13T02:57:26.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.318+0000 7fb1027fc640 1 -- 172.21.15.89:0/65427172 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 37) v1 ==== 92653+0+0 (secure 0 0 0) 0x7fb108030020 con 0x7fb10c066790 2024-09-13T02:57:26.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.319+0000 7fb1027fc640 1 --2- 172.21.15.89:0/65427172 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fb0f806e660 0x7fb0f8070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:26.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.319+0000 7fb1027fc640 1 -- 172.21.15.89:0/65427172 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fb1080ae4e0 con 0x7fb10c066790 2024-09-13T02:57:26.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.319+0000 7fb11115a640 1 --2- 172.21.15.89:0/65427172 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fb0f806e660 0x7fb0f8070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:26.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.319+0000 7fb11115a640 1 --2- 172.21.15.89:0/65427172 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fb0f806e660 0x7fb0f8070b10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb10c10ced0 tx=0x7fb0fc00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:57:26.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.323+0000 7fb1027fc640 1 -- 172.21.15.89:0/65427172 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fb1080775f0 con 0x7fb10c066790 2024-09-13T02:57:26.506 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.505+0000 7fb113bbf640 1 -- 172.21.15.89:0/65427172 --> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb10c10efd0 con 0x7fb0f806e660 2024-09-13T02:57:26.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.506+0000 7fb1027fc640 1 -- 172.21.15.89:0/65427172 <== mgr.34104 v2:172.21.15.89:6800/1881577856 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7fb10c10efd0 con 0x7fb0f806e660 2024-09-13T02:57:26.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.509+0000 7fb113bbf640 1 -- 172.21.15.89:0/65427172 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fb0f806e660 msgr2=0x7fb0f8070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:26.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.509+0000 7fb113bbf640 1 --2- 172.21.15.89:0/65427172 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fb0f806e660 0x7fb0f8070b10 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb10c10ced0 tx=0x7fb0fc00b040 comp rx=0 tx=0).stop 2024-09-13T02:57:26.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.509+0000 7fb113bbf640 1 -- 172.21.15.89:0/65427172 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb10c066790 msgr2=0x7fb10c10d120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:26.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.509+0000 7fb113bbf640 1 --2- 172.21.15.89:0/65427172 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb10c066790 0x7fb10c10d120 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb1080043d0 tx=0x7fb108009da0 comp rx=0 tx=0).stop 2024-09-13T02:57:26.511 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.509+0000 7fb113bbf640 1 -- 172.21.15.89:0/65427172 shutdown_connections 2024-09-13T02:57:26.511 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.509+0000 7fb113bbf640 1 --2- 172.21.15.89:0/65427172 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fb0f806e660 0x7fb0f8070b10 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:26.511 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.509+0000 7fb113bbf640 1 --2- 172.21.15.89:0/65427172 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb10c0ff6a0 0x7fb10c10d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:26.511 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.509+0000 7fb113bbf640 1 --2- 172.21.15.89:0/65427172 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb10c066790 0x7fb10c10d120 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:26.511 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.509+0000 7fb113bbf640 1 -- 172.21.15.89:0/65427172 >> 172.21.15.89:0/65427172 conn(0x7fb10c0f6c10 msgr2=0x7fb10c0f7030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:57:26.511 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.509+0000 7fb113bbf640 1 -- 172.21.15.89:0/65427172 shutdown_connections 2024-09-13T02:57:26.511 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.509+0000 7fb113bbf640 1 -- 172.21.15.89:0/65427172 wait complete. 2024-09-13T02:57:26.518 INFO:teuthology.orchestra.run.smithi089.stdout:true 2024-09-13T02:57:26.591 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.588+0000 7f8f19b59640 1 -- 172.21.15.89:0/2914891874 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f140ff740 msgr2=0x7f8f14101b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:26.591 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.588+0000 7f8f19b59640 1 --2- 172.21.15.89:0/2914891874 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f140ff740 0x7f8f14101b20 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f8efc0048d0 tx=0x7f8efc009da0 comp rx=0 tx=0).stop 2024-09-13T02:57:26.591 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.588+0000 7f8f19b59640 1 -- 172.21.15.89:0/2914891874 shutdown_connections 2024-09-13T02:57:26.591 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.588+0000 7f8f19b59640 1 --2- 172.21.15.89:0/2914891874 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f140ff740 0x7f8f14101b20 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:26.591 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.588+0000 7f8f19b59640 1 --2- 172.21.15.89:0/2914891874 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8f14066690 0x7f8f140ff200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:26.591 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.588+0000 7f8f19b59640 1 -- 172.21.15.89:0/2914891874 >> 172.21.15.89:0/2914891874 conn(0x7f8f140f6c10 msgr2=0x7f8f140f9060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:57:26.591 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.588+0000 7f8f19b59640 1 -- 172.21.15.89:0/2914891874 shutdown_connections 2024-09-13T02:57:26.592 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.588+0000 7f8f19b59640 1 -- 172.21.15.89:0/2914891874 wait complete. 2024-09-13T02:57:26.592 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.588+0000 7f8f19b59640 1 Processor -- start 2024-09-13T02:57:26.592 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.588+0000 7f8f19b59640 1 -- start start 2024-09-13T02:57:26.592 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.589+0000 7f8f19b59640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8f14066690 0x7f8f1410d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:26.592 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.589+0000 7f8f19b59640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f140ff740 0x7f8f1410d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:26.592 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.589+0000 7f8f19b59640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f1410dc40 con 0x7f8f140ff740 2024-09-13T02:57:26.592 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.589+0000 7f8f19b59640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f1410e460 con 0x7f8f14066690 2024-09-13T02:57:26.592 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.589+0000 7f8f0bfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f140ff740 0x7f8f1410d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:26.592 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.589+0000 7f8f0bfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f140ff740 0x7f8f1410d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:38356/0 (socket says 172.21.15.89:38356) 2024-09-13T02:57:26.592 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.589+0000 7f8f0bfff640 1 -- 172.21.15.89:0/2756025464 learned_addr learned my addr 172.21.15.89:0/2756025464 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:57:26.592 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.589+0000 7f8f137fe640 1 --2- 172.21.15.89:0/2756025464 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8f14066690 0x7f8f1410d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:26.592 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.589+0000 7f8f0bfff640 1 -- 172.21.15.89:0/2756025464 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8f14066690 msgr2=0x7f8f1410d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:26.592 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.589+0000 7f8f0bfff640 1 --2- 172.21.15.89:0/2756025464 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8f14066690 0x7f8f1410d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:26.593 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.589+0000 7f8f0bfff640 1 -- 172.21.15.89:0/2756025464 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8efc005040 con 0x7f8f140ff740 2024-09-13T02:57:26.593 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.589+0000 7f8f0bfff640 1 --2- 172.21.15.89:0/2756025464 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f140ff740 0x7f8f1410d5f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8efc0043d0 tx=0x7f8efc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:57:26.593 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.589+0000 7f8f10ff9640 1 -- 172.21.15.89:0/2756025464 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8efc038070 con 0x7f8f140ff740 2024-09-13T02:57:26.593 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.590+0000 7f8f19b59640 1 -- 172.21.15.89:0/2756025464 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f1410e690 con 0x7f8f140ff740 2024-09-13T02:57:26.593 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.590+0000 7f8f10ff9640 1 -- 172.21.15.89:0/2756025464 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f8efc02ae90 con 0x7f8f140ff740 2024-09-13T02:57:26.593 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.590+0000 7f8f10ff9640 1 -- 172.21.15.89:0/2756025464 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8efc03e670 con 0x7f8f140ff740 2024-09-13T02:57:26.593 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.590+0000 7f8f19b59640 1 -- 172.21.15.89:0/2756025464 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f1410ec30 con 0x7f8f140ff740 2024-09-13T02:57:26.594 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.591+0000 7f8f19b59640 1 -- 172.21.15.89:0/2756025464 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f140fa8d0 con 0x7f8f140ff740 2024-09-13T02:57:26.594 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.591+0000 7f8f10ff9640 1 -- 172.21.15.89:0/2756025464 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 37) v1 ==== 92653+0+0 (secure 0 0 0) 0x7f8efc030020 con 0x7f8f140ff740 2024-09-13T02:57:26.594 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.592+0000 7f8f10ff9640 1 --2- 172.21.15.89:0/2756025464 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f8f0006e660 0x7f8f00070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:26.594 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.592+0000 7f8f10ff9640 1 -- 172.21.15.89:0/2756025464 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f8efc0ae460 con 0x7f8f140ff740 2024-09-13T02:57:26.594 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.592+0000 7f8f137fe640 1 --2- 172.21.15.89:0/2756025464 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f8f0006e660 0x7f8f00070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:26.594 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.592+0000 7f8f137fe640 1 --2- 172.21.15.89:0/2756025464 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f8f0006e660 0x7f8f00070b10 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f8f140663f0 tx=0x7f8f0400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:57:26.597 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.596+0000 7f8f10ff9640 1 -- 172.21.15.89:0/2756025464 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f8efc0774f0 con 0x7f8f140ff740 2024-09-13T02:57:26.781 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.780+0000 7f8f19b59640 1 -- 172.21.15.89:0/2756025464 --> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8f1410ef80 con 0x7f8f0006e660 2024-09-13T02:57:26.782 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.781+0000 7f8f10ff9640 1 -- 172.21.15.89:0/2756025464 <== mgr.34104 v2:172.21.15.89:6800/1881577856 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7f8f1410ef80 con 0x7f8f0006e660 2024-09-13T02:57:26.784 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.783+0000 7f8f19b59640 1 -- 172.21.15.89:0/2756025464 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f8f0006e660 msgr2=0x7f8f00070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:26.784 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.783+0000 7f8f19b59640 1 --2- 172.21.15.89:0/2756025464 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f8f0006e660 0x7f8f00070b10 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f8f140663f0 tx=0x7f8f0400b040 comp rx=0 tx=0).stop 2024-09-13T02:57:26.784 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.783+0000 7f8f19b59640 1 -- 172.21.15.89:0/2756025464 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f140ff740 msgr2=0x7f8f1410d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:26.785 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.783+0000 7f8f19b59640 1 --2- 172.21.15.89:0/2756025464 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f140ff740 0x7f8f1410d5f0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f8efc0043d0 tx=0x7f8efc009da0 comp rx=0 tx=0).stop 2024-09-13T02:57:26.785 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.783+0000 7f8f19b59640 1 -- 172.21.15.89:0/2756025464 shutdown_connections 2024-09-13T02:57:26.785 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.783+0000 7f8f19b59640 1 --2- 172.21.15.89:0/2756025464 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f8f0006e660 0x7f8f00070b10 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:26.785 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.783+0000 7f8f19b59640 1 --2- 172.21.15.89:0/2756025464 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8f140ff740 0x7f8f1410d5f0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:26.785 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.783+0000 7f8f19b59640 1 --2- 172.21.15.89:0/2756025464 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8f14066690 0x7f8f1410d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:26.785 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.783+0000 7f8f19b59640 1 -- 172.21.15.89:0/2756025464 >> 172.21.15.89:0/2756025464 conn(0x7f8f140f6c10 msgr2=0x7f8f140f7050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:57:26.785 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.783+0000 7f8f19b59640 1 -- 172.21.15.89:0/2756025464 shutdown_connections 2024-09-13T02:57:26.785 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.783+0000 7f8f19b59640 1 -- 172.21.15.89:0/2756025464 wait complete. 2024-09-13T02:57:26.864 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.862+0000 7f0ac64ff640 1 -- 172.21.15.89:0/879452791 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ac00fe500 msgr2=0x7f0ac00fa660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:26.864 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.862+0000 7f0ac64ff640 1 --2- 172.21.15.89:0/879452791 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ac00fe500 0x7f0ac00fa660 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f0aa80048d0 tx=0x7f0aa8009da0 comp rx=0 tx=0).stop 2024-09-13T02:57:26.864 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.863+0000 7f0ac64ff640 1 -- 172.21.15.89:0/879452791 shutdown_connections 2024-09-13T02:57:26.864 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.863+0000 7f0ac64ff640 1 --2- 172.21.15.89:0/879452791 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ac00fe500 0x7f0ac00fa660 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:26.864 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.863+0000 7f0ac64ff640 1 --2- 172.21.15.89:0/879452791 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0ac00fdbb0 0x7f0ac00fdfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:26.865 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.863+0000 7f0ac64ff640 1 -- 172.21.15.89:0/879452791 >> 172.21.15.89:0/879452791 conn(0x7f0ac00f63b0 msgr2=0x7f0ac00f87e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:57:26.865 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:26 smithi089 ceph-mon[91553]: pgmap v28: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T02:57:26.866 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.863+0000 7f0ac64ff640 1 -- 172.21.15.89:0/879452791 shutdown_connections 2024-09-13T02:57:26.866 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.863+0000 7f0ac64ff640 1 -- 172.21.15.89:0/879452791 wait complete. 2024-09-13T02:57:26.867 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.863+0000 7f0ac64ff640 1 Processor -- start 2024-09-13T02:57:26.867 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.864+0000 7f0ac64ff640 1 -- start start 2024-09-13T02:57:26.867 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.864+0000 7f0ac64ff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0ac00fdbb0 0x7f0ac00fd3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:26.867 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.864+0000 7f0ac64ff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ac00fe500 0x7f0ac00fb890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:26.867 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.864+0000 7f0ac64ff640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac00fbe20 con 0x7f0ac00fe500 2024-09-13T02:57:26.867 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.864+0000 7f0ac64ff640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ac00fbf60 con 0x7f0ac00fdbb0 2024-09-13T02:57:26.867 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.864+0000 7f0abffff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0ac00fdbb0 0x7f0ac00fd3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:26.867 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.864+0000 7f0abffff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0ac00fdbb0 0x7f0ac00fd3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.89:59704/0 (socket says 172.21.15.89:59704) 2024-09-13T02:57:26.867 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.864+0000 7f0abffff640 1 -- 172.21.15.89:0/800429544 learned_addr learned my addr 172.21.15.89:0/800429544 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:57:26.867 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.864+0000 7f0ab7fff640 1 --2- 172.21.15.89:0/800429544 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ac00fe500 0x7f0ac00fb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:26.867 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.864+0000 7f0abffff640 1 -- 172.21.15.89:0/800429544 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ac00fe500 msgr2=0x7f0ac00fb890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:26.867 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.864+0000 7f0abffff640 1 --2- 172.21.15.89:0/800429544 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ac00fe500 0x7f0ac00fb890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:26.868 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.864+0000 7f0abffff640 1 -- 172.21.15.89:0/800429544 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aa8005040 con 0x7f0ac00fdbb0 2024-09-13T02:57:26.868 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.865+0000 7f0abffff640 1 --2- 172.21.15.89:0/800429544 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0ac00fdbb0 0x7f0ac00fd3a0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f0ab0002a80 tx=0x7f0ab0004600 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:57:26.868 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.865+0000 7f0abd7fa640 1 -- 172.21.15.89:0/800429544 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ab0007c30 con 0x7f0ac00fdbb0 2024-09-13T02:57:26.868 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.865+0000 7f0ac64ff640 1 -- 172.21.15.89:0/800429544 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ac00fc240 con 0x7f0ac00fdbb0 2024-09-13T02:57:26.868 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.865+0000 7f0abd7fa640 1 -- 172.21.15.89:0/800429544 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0ab000f040 con 0x7f0ac00fdbb0 2024-09-13T02:57:26.868 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.865+0000 7f0abd7fa640 1 -- 172.21.15.89:0/800429544 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ab000dab0 con 0x7f0ac00fdbb0 2024-09-13T02:57:26.868 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.865+0000 7f0ac64ff640 1 -- 172.21.15.89:0/800429544 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ac01150c0 con 0x7f0ac00fdbb0 2024-09-13T02:57:26.869 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.866+0000 7f0ac64ff640 1 -- 172.21.15.89:0/800429544 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ac00fa050 con 0x7f0ac00fdbb0 2024-09-13T02:57:26.869 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.867+0000 7f0abd7fa640 1 -- 172.21.15.89:0/800429544 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 37) v1 ==== 92653+0+0 (secure 0 0 0) 0x7f0ab000dc10 con 0x7f0ac00fdbb0 2024-09-13T02:57:26.872 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.867+0000 7f0abd7fa640 1 --2- 172.21.15.89:0/800429544 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f0aac06e660 0x7f0aac070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:26.873 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.867+0000 7f0abd7fa640 1 -- 172.21.15.89:0/800429544 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f0ab008e0f0 con 0x7f0ac00fdbb0 2024-09-13T02:57:26.873 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.867+0000 7f0ab7fff640 1 --2- 172.21.15.89:0/800429544 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f0aac06e660 0x7f0aac070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:26.873 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.868+0000 7f0ab7fff640 1 --2- 172.21.15.89:0/800429544 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f0aac06e660 0x7f0aac070b10 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f0aa8000c00 tx=0x7f0aa8035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:57:26.873 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:26.871+0000 7f0abd7fa640 1 -- 172.21.15.89:0/800429544 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f0ab0057070 con 0x7f0ac00fdbb0 2024-09-13T02:57:26.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:26 smithi131 ceph-mon[78839]: pgmap v28: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T02:57:27.046 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.044+0000 7f0ac64ff640 1 -- 172.21.15.89:0/800429544 --> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f0ac0101d40 con 0x7f0aac06e660 2024-09-13T02:57:27.054 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.053+0000 7f0abd7fa640 1 -- 172.21.15.89:0/800429544 <== mgr.34104 v2:172.21.15.89:6800/1881577856 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f0ac0101d40 con 0x7f0aac06e660 2024-09-13T02:57:27.055 INFO:teuthology.orchestra.run.smithi089.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T02:57:27.055 INFO:teuthology.orchestra.run.smithi089.stdout:alertmanager.smithi089 smithi089 *:9093,9094 running (119s) 46s ago 10m 15.0M - 0.25.0 c8568f914cd2 1d2432f5479e 2024-09-13T02:57:27.055 INFO:teuthology.orchestra.run.smithi089.stdout:crash.smithi089 smithi089 starting - - - - 2024-09-13T02:57:27.055 INFO:teuthology.orchestra.run.smithi089.stdout:crash.smithi131 smithi131 running (10m) 36s ago 10m 6895k - 17.2.7-1627-gbbdadfa3 a994b00deb3a dcbb0a9d5261 2024-09-13T02:57:27.055 INFO:teuthology.orchestra.run.smithi089.stdout:grafana.smithi089 smithi089 *:3000 running (114s) 46s ago 10m 77.8M - 9.4.7 954c08fa6188 dee914ded1af 2024-09-13T02:57:27.055 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi089.qjoitb smithi089 running (5m) 46s ago 5m 70.4M - 17.2.7-1627-gbbdadfa3 a994b00deb3a ff9b59ec5107 2024-09-13T02:57:27.055 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi089.rarddb smithi089 running (5m) 46s ago 5m 136M - 17.2.7-1627-gbbdadfa3 a994b00deb3a db2dc502c1ba 2024-09-13T02:57:27.055 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi131.rbovzc smithi131 running (5m) 36s ago 5m 60.5M - 17.2.7-1627-gbbdadfa3 a994b00deb3a d071b6d99537 2024-09-13T02:57:27.055 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi131.uasrkg smithi131 running (5m) 36s ago 5m 112M - 17.2.7-1627-gbbdadfa3 a994b00deb3a 0b3d4ffa6ce5 2024-09-13T02:57:27.055 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.smithi089.guohvs smithi089 *:8443,9283,8765 running (100s) 46s ago 12m 472M - 19.1.1-322-g7741f7f9 19dc8d659727 1e887446f1b0 2024-09-13T02:57:27.056 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.smithi131.aunbqd smithi131 *:8443,9283,8765 running (70s) 36s ago 10m 438M - 19.1.1-322-g7741f7f9 19dc8d659727 358d7478f2ba 2024-09-13T02:57:27.056 INFO:teuthology.orchestra.run.smithi089.stdout:mon.smithi089 smithi089 running (58s) 46s ago 12m 28.0M 2048M 19.1.1-322-g7741f7f9 19dc8d659727 8a29fb65028f 2024-09-13T02:57:27.056 INFO:teuthology.orchestra.run.smithi089.stdout:mon.smithi131 smithi131 running (39s) 36s ago 10m 25.6M 2048M 19.1.1-322-g7741f7f9 19dc8d659727 506310ad8620 2024-09-13T02:57:27.056 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.smithi089 smithi089 *:9100 running (2m) 46s ago 11m 8384k - 1.5.0 0da6a335fe13 5a9927b583e6 2024-09-13T02:57:27.056 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.smithi131 smithi131 *:9100 running (105s) 36s ago 10m 15.9M - 1.5.0 0da6a335fe13 bcfde5d1a508 2024-09-13T02:57:27.056 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0 smithi089 running (9m) 46s ago 9m 223M 1557M 17.2.7-1627-gbbdadfa3 a994b00deb3a b9404e2bc82c 2024-09-13T02:57:27.056 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1 smithi089 running (8m) 46s ago 8m 232M 1557M 17.2.7-1627-gbbdadfa3 a994b00deb3a af6538730e42 2024-09-13T02:57:27.056 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2 smithi089 running (8m) 46s ago 8m 195M 1557M 17.2.7-1627-gbbdadfa3 a994b00deb3a 447cf103114b 2024-09-13T02:57:27.056 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3 smithi131 running (8m) 36s ago 7m 264M 2581M 17.2.7-1627-gbbdadfa3 a994b00deb3a 0b80a4dea862 2024-09-13T02:57:27.056 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4 smithi131 running (7m) 36s ago 7m 235M 2581M 17.2.7-1627-gbbdadfa3 a994b00deb3a 06ec44680b00 2024-09-13T02:57:27.056 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5 smithi131 running (7m) 36s ago 7m 231M 2581M 17.2.7-1627-gbbdadfa3 a994b00deb3a ace4b45e5873 2024-09-13T02:57:27.056 INFO:teuthology.orchestra.run.smithi089.stdout:prometheus.smithi089 smithi089 *:9095 running (75s) 46s ago 10m 48.9M - 2.43.0 a07b618ecd1d 9d336370c187 2024-09-13T02:57:27.057 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.055+0000 7f0ac64ff640 1 -- 172.21.15.89:0/800429544 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f0aac06e660 msgr2=0x7f0aac070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:27.057 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.055+0000 7f0ac64ff640 1 --2- 172.21.15.89:0/800429544 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f0aac06e660 0x7f0aac070b10 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f0aa8000c00 tx=0x7f0aa8035040 comp rx=0 tx=0).stop 2024-09-13T02:57:27.057 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.055+0000 7f0ac64ff640 1 -- 172.21.15.89:0/800429544 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0ac00fdbb0 msgr2=0x7f0ac00fd3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:27.057 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.055+0000 7f0ac64ff640 1 --2- 172.21.15.89:0/800429544 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0ac00fdbb0 0x7f0ac00fd3a0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f0ab0002a80 tx=0x7f0ab0004600 comp rx=0 tx=0).stop 2024-09-13T02:57:27.057 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.055+0000 7f0ac64ff640 1 -- 172.21.15.89:0/800429544 shutdown_connections 2024-09-13T02:57:27.057 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.055+0000 7f0ac64ff640 1 --2- 172.21.15.89:0/800429544 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f0aac06e660 0x7f0aac070b10 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:27.058 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.055+0000 7f0ac64ff640 1 --2- 172.21.15.89:0/800429544 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0ac00fe500 0x7f0ac00fb890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:27.058 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.055+0000 7f0ac64ff640 1 --2- 172.21.15.89:0/800429544 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0ac00fdbb0 0x7f0ac00fd3a0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:27.058 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.055+0000 7f0ac64ff640 1 -- 172.21.15.89:0/800429544 >> 172.21.15.89:0/800429544 conn(0x7f0ac00f63b0 msgr2=0x7f0ac00f7b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:57:27.058 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.056+0000 7f0ac64ff640 1 -- 172.21.15.89:0/800429544 shutdown_connections 2024-09-13T02:57:27.058 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.056+0000 7f0ac64ff640 1 -- 172.21.15.89:0/800429544 wait complete. 2024-09-13T02:57:27.136 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.133+0000 7ff57dfb2640 1 -- 172.21.15.89:0/1785444236 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff5780fb420 msgr2=0x7ff5780fb830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:27.136 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.133+0000 7ff57dfb2640 1 --2- 172.21.15.89:0/1785444236 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff5780fb420 0x7ff5780fb830 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff5680048d0 tx=0x7ff568009da0 comp rx=0 tx=0).stop 2024-09-13T02:57:27.136 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.133+0000 7ff57dfb2640 1 -- 172.21.15.89:0/1785444236 shutdown_connections 2024-09-13T02:57:27.136 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.133+0000 7ff57dfb2640 1 --2- 172.21.15.89:0/1785444236 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5780fc6f0 0x7ff5780fcb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:27.136 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.133+0000 7ff57dfb2640 1 --2- 172.21.15.89:0/1785444236 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff5780fb420 0x7ff5780fb830 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:27.136 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.133+0000 7ff57dfb2640 1 -- 172.21.15.89:0/1785444236 >> 172.21.15.89:0/1785444236 conn(0x7ff5780f6c00 msgr2=0x7ff5780f9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:57:27.136 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.133+0000 7ff57dfb2640 1 -- 172.21.15.89:0/1785444236 shutdown_connections 2024-09-13T02:57:27.136 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.133+0000 7ff57dfb2640 1 -- 172.21.15.89:0/1785444236 wait complete. 2024-09-13T02:57:27.136 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.133+0000 7ff57dfb2640 1 Processor -- start 2024-09-13T02:57:27.136 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.133+0000 7ff57dfb2640 1 -- start start 2024-09-13T02:57:27.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.133+0000 7ff57dfb2640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5780fb420 0x7ff57810d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:27.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.133+0000 7ff57dfb2640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff5780fc6f0 0x7ff57810d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:27.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.133+0000 7ff57dfb2640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff57810e4b0 con 0x7ff5780fc6f0 2024-09-13T02:57:27.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.133+0000 7ff57dfb2640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff57810e620 con 0x7ff5780fb420 2024-09-13T02:57:27.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.134+0000 7ff56ffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff5780fc6f0 0x7ff57810d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:27.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.134+0000 7ff56ffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff5780fc6f0 0x7ff57810d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:38408/0 (socket says 172.21.15.89:38408) 2024-09-13T02:57:27.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.134+0000 7ff56ffff640 1 -- 172.21.15.89:0/4015719509 learned_addr learned my addr 172.21.15.89:0/4015719509 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:57:27.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.134+0000 7ff5777fe640 1 --2- 172.21.15.89:0/4015719509 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5780fb420 0x7ff57810d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:27.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.134+0000 7ff56ffff640 1 -- 172.21.15.89:0/4015719509 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5780fb420 msgr2=0x7ff57810d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:27.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.134+0000 7ff56ffff640 1 --2- 172.21.15.89:0/4015719509 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5780fb420 0x7ff57810d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:27.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.134+0000 7ff56ffff640 1 -- 172.21.15.89:0/4015719509 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff568005040 con 0x7ff5780fc6f0 2024-09-13T02:57:27.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.134+0000 7ff56ffff640 1 --2- 172.21.15.89:0/4015719509 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff5780fc6f0 0x7ff57810d640 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff56000b790 tx=0x7ff5600091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:57:27.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.134+0000 7ff574ff9640 1 -- 172.21.15.89:0/4015719509 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff56000c700 con 0x7ff5780fc6f0 2024-09-13T02:57:27.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.134+0000 7ff574ff9640 1 -- 172.21.15.89:0/4015719509 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff56000cd00 con 0x7ff5780fc6f0 2024-09-13T02:57:27.138 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.134+0000 7ff57dfb2640 1 -- 172.21.15.89:0/4015719509 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff57810e900 con 0x7ff5780fc6f0 2024-09-13T02:57:27.138 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.134+0000 7ff574ff9640 1 -- 172.21.15.89:0/4015719509 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff560015e80 con 0x7ff5780fc6f0 2024-09-13T02:57:27.138 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.134+0000 7ff57dfb2640 1 -- 172.21.15.89:0/4015719509 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff57810ee20 con 0x7ff5780fc6f0 2024-09-13T02:57:27.139 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.135+0000 7ff57dfb2640 1 -- 172.21.15.89:0/4015719509 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5780fa880 con 0x7ff5780fc6f0 2024-09-13T02:57:27.139 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.136+0000 7ff574ff9640 1 -- 172.21.15.89:0/4015719509 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 37) v1 ==== 92653+0+0 (secure 0 0 0) 0x7ff560012070 con 0x7ff5780fc6f0 2024-09-13T02:57:27.139 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.137+0000 7ff574ff9640 1 --2- 172.21.15.89:0/4015719509 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7ff56406e660 0x7ff564070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:27.139 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.137+0000 7ff574ff9640 1 -- 172.21.15.89:0/4015719509 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6496+0+0 (secure 0 0 0) 0x7ff56008daf0 con 0x7ff5780fc6f0 2024-09-13T02:57:27.139 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.137+0000 7ff5777fe640 1 --2- 172.21.15.89:0/4015719509 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7ff56406e660 0x7ff564070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:27.140 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.137+0000 7ff5777fe640 1 --2- 172.21.15.89:0/4015719509 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7ff56406e660 0x7ff564070b10 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff568000c00 tx=0x7ff568035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:57:27.142 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.141+0000 7ff574ff9640 1 -- 172.21.15.89:0/4015719509 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7ff560056b50 con 0x7ff5780fc6f0 2024-09-13T02:57:27.369 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.368+0000 7ff57dfb2640 1 -- 172.21.15.89:0/4015719509 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff578103ea0 con 0x7ff5780fc6f0 2024-09-13T02:57:27.370 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.368+0000 7ff574ff9640 1 -- 172.21.15.89:0/4015719509 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+745 (secure 0 0 0) 0x7ff56005a210 con 0x7ff5780fc6f0 2024-09-13T02:57:27.370 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-13T02:57:27.370 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": { 2024-09-13T02:57:27.370 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 2 2024-09-13T02:57:27.370 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T02:57:27.370 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": { 2024-09-13T02:57:27.371 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 2 2024-09-13T02:57:27.371 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T02:57:27.371 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": { 2024-09-13T02:57:27.371 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 6 2024-09-13T02:57:27.371 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T02:57:27.371 INFO:teuthology.orchestra.run.smithi089.stdout: "mds": { 2024-09-13T02:57:27.371 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 4 2024-09-13T02:57:27.371 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T02:57:27.371 INFO:teuthology.orchestra.run.smithi089.stdout: "overall": { 2024-09-13T02:57:27.371 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 10, 2024-09-13T02:57:27.371 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 4 2024-09-13T02:57:27.371 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-13T02:57:27.371 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-13T02:57:27.372 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.370+0000 7ff57dfb2640 1 -- 172.21.15.89:0/4015719509 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7ff56406e660 msgr2=0x7ff564070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:27.372 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.370+0000 7ff57dfb2640 1 --2- 172.21.15.89:0/4015719509 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7ff56406e660 0x7ff564070b10 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7ff568000c00 tx=0x7ff568035040 comp rx=0 tx=0).stop 2024-09-13T02:57:27.373 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.370+0000 7ff57dfb2640 1 -- 172.21.15.89:0/4015719509 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff5780fc6f0 msgr2=0x7ff57810d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:27.373 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.370+0000 7ff57dfb2640 1 --2- 172.21.15.89:0/4015719509 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff5780fc6f0 0x7ff57810d640 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff56000b790 tx=0x7ff5600091d0 comp rx=0 tx=0).stop 2024-09-13T02:57:27.373 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.370+0000 7ff57dfb2640 1 -- 172.21.15.89:0/4015719509 shutdown_connections 2024-09-13T02:57:27.373 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.371+0000 7ff57dfb2640 1 --2- 172.21.15.89:0/4015719509 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7ff56406e660 0x7ff564070b10 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:27.373 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.371+0000 7ff57dfb2640 1 --2- 172.21.15.89:0/4015719509 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff5780fc6f0 0x7ff57810d640 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:27.373 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.371+0000 7ff57dfb2640 1 --2- 172.21.15.89:0/4015719509 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5780fb420 0x7ff57810d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:27.373 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.371+0000 7ff57dfb2640 1 -- 172.21.15.89:0/4015719509 >> 172.21.15.89:0/4015719509 conn(0x7ff5780f6c00 msgr2=0x7ff578065ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:57:27.373 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.371+0000 7ff57dfb2640 1 -- 172.21.15.89:0/4015719509 shutdown_connections 2024-09-13T02:57:27.373 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.371+0000 7ff57dfb2640 1 -- 172.21.15.89:0/4015719509 wait complete. 2024-09-13T02:57:27.450 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.449+0000 7fd412c10640 1 -- 172.21.15.89:0/3559359085 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd40c0fc720 msgr2=0x7fd40c0fcb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:27.451 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.449+0000 7fd412c10640 1 --2- 172.21.15.89:0/3559359085 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd40c0fc720 0x7fd40c0fcb90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd3f80048d0 tx=0x7fd3f8009da0 comp rx=0 tx=0).stop 2024-09-13T02:57:27.451 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.449+0000 7fd412c10640 1 -- 172.21.15.89:0/3559359085 shutdown_connections 2024-09-13T02:57:27.451 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.449+0000 7fd412c10640 1 --2- 172.21.15.89:0/3559359085 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd40c0fc720 0x7fd40c0fcb90 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:27.451 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.449+0000 7fd412c10640 1 --2- 172.21.15.89:0/3559359085 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd40c0fb450 0x7fd40c0fb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:27.451 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.449+0000 7fd412c10640 1 -- 172.21.15.89:0/3559359085 >> 172.21.15.89:0/3559359085 conn(0x7fd40c0f6c10 msgr2=0x7fd40c0f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:57:27.451 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.449+0000 7fd412c10640 1 -- 172.21.15.89:0/3559359085 shutdown_connections 2024-09-13T02:57:27.451 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.449+0000 7fd412c10640 1 -- 172.21.15.89:0/3559359085 wait complete. 2024-09-13T02:57:27.453 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.450+0000 7fd412c10640 1 Processor -- start 2024-09-13T02:57:27.453 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.450+0000 7fd412c10640 1 -- start start 2024-09-13T02:57:27.453 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.450+0000 7fd412c10640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd40c0fb450 0x7fd40c10d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:27.453 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.450+0000 7fd412c10640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd40c0fc720 0x7fd40c10d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:27.453 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.450+0000 7fd412c10640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd40c10dc70 con 0x7fd40c0fc720 2024-09-13T02:57:27.453 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.450+0000 7fd412c10640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd40c10e490 con 0x7fd40c0fb450 2024-09-13T02:57:27.453 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.450+0000 7fd40bfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd40c0fc720 0x7fd40c10d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:27.453 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.450+0000 7fd40bfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd40c0fc720 0x7fd40c10d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:38422/0 (socket says 172.21.15.89:38422) 2024-09-13T02:57:27.453 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.450+0000 7fd40bfff640 1 -- 172.21.15.89:0/4117982688 learned_addr learned my addr 172.21.15.89:0/4117982688 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:57:27.453 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.451+0000 7fd4109ac640 1 --2- 172.21.15.89:0/4117982688 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd40c0fb450 0x7fd40c10d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:27.453 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.451+0000 7fd40bfff640 1 -- 172.21.15.89:0/4117982688 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd40c0fb450 msgr2=0x7fd40c10d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:27.454 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.451+0000 7fd40bfff640 1 --2- 172.21.15.89:0/4117982688 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd40c0fb450 0x7fd40c10d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:27.454 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.451+0000 7fd40bfff640 1 -- 172.21.15.89:0/4117982688 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3f8005040 con 0x7fd40c0fc720 2024-09-13T02:57:27.454 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.451+0000 7fd40bfff640 1 --2- 172.21.15.89:0/4117982688 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd40c0fc720 0x7fd40c10d620 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd3f80043d0 tx=0x7fd3f8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:57:27.454 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.451+0000 7fd4097fa640 1 -- 172.21.15.89:0/4117982688 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3f8038070 con 0x7fd40c0fc720 2024-09-13T02:57:27.454 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.451+0000 7fd4097fa640 1 -- 172.21.15.89:0/4117982688 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd3f802ae90 con 0x7fd40c0fc720 2024-09-13T02:57:27.454 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.451+0000 7fd4097fa640 1 -- 172.21.15.89:0/4117982688 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3f803e670 con 0x7fd40c0fc720 2024-09-13T02:57:27.454 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.451+0000 7fd412c10640 1 -- 172.21.15.89:0/4117982688 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd40c10e6c0 con 0x7fd40c0fc720 2024-09-13T02:57:27.454 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.451+0000 7fd412c10640 1 -- 172.21.15.89:0/4117982688 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd40c10ec60 con 0x7fd40c0fc720 2024-09-13T02:57:27.454 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.452+0000 7fd412c10640 1 -- 172.21.15.89:0/4117982688 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd40c0fa8b0 con 0x7fd40c0fc720 2024-09-13T02:57:27.456 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.455+0000 7fd4097fa640 1 -- 172.21.15.89:0/4117982688 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 37) v1 ==== 92653+0+0 (secure 0 0 0) 0x7fd3f8030020 con 0x7fd40c0fc720 2024-09-13T02:57:27.457 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.456+0000 7fd4097fa640 1 --2- 172.21.15.89:0/4117982688 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fd3fc06e660 0x7fd3fc070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:27.457 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.456+0000 7fd4109ac640 1 --2- 172.21.15.89:0/4117982688 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fd3fc06e660 0x7fd3fc070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:27.457 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.456+0000 7fd4097fa640 1 -- 172.21.15.89:0/4117982688 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fd3f80ae4d0 con 0x7fd40c0fc720 2024-09-13T02:57:27.457 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.456+0000 7fd4109ac640 1 --2- 172.21.15.89:0/4117982688 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fd3fc06e660 0x7fd3fc070b10 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd400009fd0 tx=0x7fd400009e50 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:57:27.460 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.459+0000 7fd4097fa640 1 -- 172.21.15.89:0/4117982688 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fd3f80776a0 con 0x7fd40c0fc720 2024-09-13T02:57:27.671 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.669+0000 7fd412c10640 1 -- 172.21.15.89:0/4117982688 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd40c04b720 con 0x7fd40c0fc720 2024-09-13T02:57:27.671 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.669+0000 7fd4097fa640 1 -- 172.21.15.89:0/4117982688 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 21 v21) v1 ==== 76+0+1972 (secure 0 0 0) 0x7fd3f807ad60 con 0x7fd40c0fc720 2024-09-13T02:57:27.671 INFO:teuthology.orchestra.run.smithi089.stdout:e21 2024-09-13T02:57:27.671 INFO:teuthology.orchestra.run.smithi089.stdout:btime 1970-01-01T00:00:00:000000+0000 2024-09-13T02:57:27.671 INFO:teuthology.orchestra.run.smithi089.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T02:57:27.672 INFO:teuthology.orchestra.run.smithi089.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:57:27.672 INFO:teuthology.orchestra.run.smithi089.stdout:legacy client fscid: 1 2024-09-13T02:57:27.672 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:57:27.672 INFO:teuthology.orchestra.run.smithi089.stdout:Filesystem 'cephfs' (1) 2024-09-13T02:57:27.672 INFO:teuthology.orchestra.run.smithi089.stdout:fs_name cephfs 2024-09-13T02:57:27.672 INFO:teuthology.orchestra.run.smithi089.stdout:epoch 21 2024-09-13T02:57:27.672 INFO:teuthology.orchestra.run.smithi089.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T02:57:27.672 INFO:teuthology.orchestra.run.smithi089.stdout:created 2024-09-13T02:51:40.657817+0000 2024-09-13T02:57:27.672 INFO:teuthology.orchestra.run.smithi089.stdout:modified 2024-09-13T02:54:05.118633+0000 2024-09-13T02:57:27.672 INFO:teuthology.orchestra.run.smithi089.stdout:tableserver 0 2024-09-13T02:57:27.672 INFO:teuthology.orchestra.run.smithi089.stdout:root 0 2024-09-13T02:57:27.672 INFO:teuthology.orchestra.run.smithi089.stdout:session_timeout 60 2024-09-13T02:57:27.672 INFO:teuthology.orchestra.run.smithi089.stdout:session_autoclose 300 2024-09-13T02:57:27.672 INFO:teuthology.orchestra.run.smithi089.stdout:max_file_size 1099511627776 2024-09-13T02:57:27.673 INFO:teuthology.orchestra.run.smithi089.stdout:max_xattr_size 65536 2024-09-13T02:57:27.673 INFO:teuthology.orchestra.run.smithi089.stdout:required_client_features {} 2024-09-13T02:57:27.673 INFO:teuthology.orchestra.run.smithi089.stdout:last_failure 0 2024-09-13T02:57:27.673 INFO:teuthology.orchestra.run.smithi089.stdout:last_failure_osd_epoch 44 2024-09-13T02:57:27.673 INFO:teuthology.orchestra.run.smithi089.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:57:27.673 INFO:teuthology.orchestra.run.smithi089.stdout:max_mds 2 2024-09-13T02:57:27.673 INFO:teuthology.orchestra.run.smithi089.stdout:in 0,1 2024-09-13T02:57:27.673 INFO:teuthology.orchestra.run.smithi089.stdout:up {0=14480,1=24257} 2024-09-13T02:57:27.673 INFO:teuthology.orchestra.run.smithi089.stdout:failed 2024-09-13T02:57:27.673 INFO:teuthology.orchestra.run.smithi089.stdout:damaged 2024-09-13T02:57:27.673 INFO:teuthology.orchestra.run.smithi089.stdout:stopped 2024-09-13T02:57:27.673 INFO:teuthology.orchestra.run.smithi089.stdout:data_pools [3] 2024-09-13T02:57:27.673 INFO:teuthology.orchestra.run.smithi089.stdout:metadata_pool 2 2024-09-13T02:57:27.674 INFO:teuthology.orchestra.run.smithi089.stdout:inline_data disabled 2024-09-13T02:57:27.674 INFO:teuthology.orchestra.run.smithi089.stdout:balancer 2024-09-13T02:57:27.674 INFO:teuthology.orchestra.run.smithi089.stdout:bal_rank_mask -1 2024-09-13T02:57:27.674 INFO:teuthology.orchestra.run.smithi089.stdout:standby_count_wanted 1 2024-09-13T02:57:27.674 INFO:teuthology.orchestra.run.smithi089.stdout:qdb_cluster leader: 0 members: 2024-09-13T02:57:27.674 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi089.rarddb{0:14480} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.89:6828/1561365213,v1:172.21.15.89:6829/1561365213] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:57:27.674 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi089.qjoitb{0:14488} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.89:6826/1464393547,v1:172.21.15.89:6827/1464393547] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:57:27.674 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi131.uasrkg{1:24257} state up:active seq 4 export targets 0 join_fscid=1 addr [v2:172.21.15.131:6824/260493836,v1:172.21.15.131:6825/260493836] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:57:27.674 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi131.rbovzc{1:24265} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.131:6826/665579373,v1:172.21.15.131:6827/665579373] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:57:27.674 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:57:27.674 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:57:27.675 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 21 2024-09-13T02:57:27.675 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.671+0000 7fd412c10640 1 -- 172.21.15.89:0/4117982688 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fd3fc06e660 msgr2=0x7fd3fc070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:27.675 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.671+0000 7fd412c10640 1 --2- 172.21.15.89:0/4117982688 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fd3fc06e660 0x7fd3fc070b10 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fd400009fd0 tx=0x7fd400009e50 comp rx=0 tx=0).stop 2024-09-13T02:57:27.675 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.671+0000 7fd412c10640 1 -- 172.21.15.89:0/4117982688 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd40c0fc720 msgr2=0x7fd40c10d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:27.675 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.671+0000 7fd412c10640 1 --2- 172.21.15.89:0/4117982688 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd40c0fc720 0x7fd40c10d620 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fd3f80043d0 tx=0x7fd3f8009da0 comp rx=0 tx=0).stop 2024-09-13T02:57:27.675 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.671+0000 7fd412c10640 1 -- 172.21.15.89:0/4117982688 shutdown_connections 2024-09-13T02:57:27.675 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.671+0000 7fd412c10640 1 --2- 172.21.15.89:0/4117982688 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fd3fc06e660 0x7fd3fc070b10 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:27.675 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.671+0000 7fd412c10640 1 --2- 172.21.15.89:0/4117982688 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd40c0fc720 0x7fd40c10d620 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:27.675 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.671+0000 7fd412c10640 1 --2- 172.21.15.89:0/4117982688 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd40c0fb450 0x7fd40c10d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:27.676 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.671+0000 7fd412c10640 1 -- 172.21.15.89:0/4117982688 >> 172.21.15.89:0/4117982688 conn(0x7fd40c0f6c10 msgr2=0x7fd40c0660c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:57:27.676 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.672+0000 7fd412c10640 1 -- 172.21.15.89:0/4117982688 shutdown_connections 2024-09-13T02:57:27.676 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.672+0000 7fd412c10640 1 -- 172.21.15.89:0/4117982688 wait complete. 2024-09-13T02:57:27.771 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.769+0000 7f3f1f33c640 1 -- 172.21.15.89:0/1110707926 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f180fe4f0 msgr2=0x7f3f180fa650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:27.771 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.769+0000 7f3f1f33c640 1 --2- 172.21.15.89:0/1110707926 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f180fe4f0 0x7f3f180fa650 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f3f080048d0 tx=0x7f3f08009da0 comp rx=0 tx=0).stop 2024-09-13T02:57:27.771 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.769+0000 7f3f1f33c640 1 -- 172.21.15.89:0/1110707926 shutdown_connections 2024-09-13T02:57:27.771 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.769+0000 7f3f1f33c640 1 --2- 172.21.15.89:0/1110707926 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f180fe4f0 0x7f3f180fa650 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:27.771 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.769+0000 7f3f1f33c640 1 --2- 172.21.15.89:0/1110707926 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3f180fdba0 0x7f3f180fdfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:27.771 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.769+0000 7f3f1f33c640 1 -- 172.21.15.89:0/1110707926 >> 172.21.15.89:0/1110707926 conn(0x7f3f180f63a0 msgr2=0x7f3f180f87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:57:27.771 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.769+0000 7f3f1f33c640 1 -- 172.21.15.89:0/1110707926 shutdown_connections 2024-09-13T02:57:27.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.769+0000 7f3f1f33c640 1 -- 172.21.15.89:0/1110707926 wait complete. 2024-09-13T02:57:27.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.770+0000 7f3f1f33c640 1 Processor -- start 2024-09-13T02:57:27.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.770+0000 7f3f1f33c640 1 -- start start 2024-09-13T02:57:27.773 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.770+0000 7f3f1f33c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3f180fdba0 0x7f3f180fd390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:27.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.770+0000 7f3f1f33c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f180fe4f0 0x7f3f180fb880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:27.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.770+0000 7f3f1f33c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f180fbe10 con 0x7f3f180fe4f0 2024-09-13T02:57:27.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.770+0000 7f3f1f33c640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f180fbf50 con 0x7f3f180fdba0 2024-09-13T02:57:27.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.770+0000 7f3f1c8d7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f180fe4f0 0x7f3f180fb880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:27.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.770+0000 7f3f1c8d7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f180fe4f0 0x7f3f180fb880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:38434/0 (socket says 172.21.15.89:38434) 2024-09-13T02:57:27.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.770+0000 7f3f1c8d7640 1 -- 172.21.15.89:0/1672023209 learned_addr learned my addr 172.21.15.89:0/1672023209 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:57:27.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.770+0000 7f3f1d0d8640 1 --2- 172.21.15.89:0/1672023209 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3f180fdba0 0x7f3f180fd390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:27.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.771+0000 7f3f1c8d7640 1 -- 172.21.15.89:0/1672023209 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3f180fdba0 msgr2=0x7f3f180fd390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:27.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.771+0000 7f3f1c8d7640 1 --2- 172.21.15.89:0/1672023209 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3f180fdba0 0x7f3f180fd390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:27.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.771+0000 7f3f1c8d7640 1 -- 172.21.15.89:0/1672023209 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f08005040 con 0x7f3f180fe4f0 2024-09-13T02:57:27.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.771+0000 7f3f1d0d8640 1 --2- 172.21.15.89:0/1672023209 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3f180fdba0 0x7f3f180fd390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T02:57:27.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.771+0000 7f3f1c8d7640 1 --2- 172.21.15.89:0/1672023209 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f180fe4f0 0x7f3f180fb880 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3f080043d0 tx=0x7f3f08009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:57:27.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.771+0000 7f3f0dffb640 1 -- 172.21.15.89:0/1672023209 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f08038070 con 0x7f3f180fe4f0 2024-09-13T02:57:27.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.771+0000 7f3f1f33c640 1 -- 172.21.15.89:0/1672023209 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f180fc1d0 con 0x7f3f180fe4f0 2024-09-13T02:57:27.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.771+0000 7f3f0dffb640 1 -- 172.21.15.89:0/1672023209 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f3f0802ae90 con 0x7f3f180fe4f0 2024-09-13T02:57:27.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.772+0000 7f3f0dffb640 1 -- 172.21.15.89:0/1672023209 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f0803e670 con 0x7f3f180fe4f0 2024-09-13T02:57:27.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.772+0000 7f3f1f33c640 1 -- 172.21.15.89:0/1672023209 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f180fc6f0 con 0x7f3f180fe4f0 2024-09-13T02:57:27.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.773+0000 7f3f1f33c640 1 -- 172.21.15.89:0/1672023209 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f180fa040 con 0x7f3f180fe4f0 2024-09-13T02:57:27.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.773+0000 7f3f0dffb640 1 -- 172.21.15.89:0/1672023209 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 37) v1 ==== 92653+0+0 (secure 0 0 0) 0x7f3f08030020 con 0x7f3f180fe4f0 2024-09-13T02:57:27.776 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.774+0000 7f3f0dffb640 1 --2- 172.21.15.89:0/1672023209 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f3f0406e660 0x7f3f04070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:27.776 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.774+0000 7f3f0dffb640 1 -- 172.21.15.89:0/1672023209 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f3f080ae2f0 con 0x7f3f180fe4f0 2024-09-13T02:57:27.776 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.774+0000 7f3f1d0d8640 1 --2- 172.21.15.89:0/1672023209 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f3f0406e660 0x7f3f04070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:27.776 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.775+0000 7f3f1d0d8640 1 --2- 172.21.15.89:0/1672023209 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f3f0406e660 0x7f3f04070b10 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3f180fd140 tx=0x7f3f1400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:57:27.780 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.779+0000 7f3f0dffb640 1 -- 172.21.15.89:0/1672023209 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f3f08077340 con 0x7f3f180fe4f0 2024-09-13T02:57:27.988 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.987+0000 7f3f1f33c640 1 -- 172.21.15.89:0/1672023209 --> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3f180fc6f0 con 0x7f3f0406e660 2024-09-13T02:57:27.989 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.988+0000 7f3f0dffb640 1 -- 172.21.15.89:0/1672023209 <== mgr.34104 v2:172.21.15.89:6800/1881577856 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7f3f180fc6f0 con 0x7f3f0406e660 2024-09-13T02:57:27.989 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-13T02:57:27.989 INFO:teuthology.orchestra.run.smithi089.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d", 2024-09-13T02:57:27.989 INFO:teuthology.orchestra.run.smithi089.stdout: "in_progress": true, 2024-09-13T02:57:27.989 INFO:teuthology.orchestra.run.smithi089.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T02:57:27.990 INFO:teuthology.orchestra.run.smithi089.stdout: "services_complete": [ 2024-09-13T02:57:27.990 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr", 2024-09-13T02:57:27.990 INFO:teuthology.orchestra.run.smithi089.stdout: "mon" 2024-09-13T02:57:27.990 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-13T02:57:27.990 INFO:teuthology.orchestra.run.smithi089.stdout: "progress": "4/21 daemons upgraded", 2024-09-13T02:57:27.990 INFO:teuthology.orchestra.run.smithi089.stdout: "message": "Currently upgrading crash daemons", 2024-09-13T02:57:27.990 INFO:teuthology.orchestra.run.smithi089.stdout: "is_paused": false 2024-09-13T02:57:27.990 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-13T02:57:27.991 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.990+0000 7f3f1f33c640 1 -- 172.21.15.89:0/1672023209 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f3f0406e660 msgr2=0x7f3f04070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:27.992 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.990+0000 7f3f1f33c640 1 --2- 172.21.15.89:0/1672023209 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f3f0406e660 0x7f3f04070b10 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3f180fd140 tx=0x7f3f1400b040 comp rx=0 tx=0).stop 2024-09-13T02:57:27.992 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.990+0000 7f3f1f33c640 1 -- 172.21.15.89:0/1672023209 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f180fe4f0 msgr2=0x7f3f180fb880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:27.992 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.990+0000 7f3f1f33c640 1 --2- 172.21.15.89:0/1672023209 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f180fe4f0 0x7f3f180fb880 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f3f080043d0 tx=0x7f3f08009da0 comp rx=0 tx=0).stop 2024-09-13T02:57:27.992 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.990+0000 7f3f1f33c640 1 -- 172.21.15.89:0/1672023209 shutdown_connections 2024-09-13T02:57:27.992 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.990+0000 7f3f1f33c640 1 --2- 172.21.15.89:0/1672023209 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f3f0406e660 0x7f3f04070b10 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:27.992 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.990+0000 7f3f1f33c640 1 --2- 172.21.15.89:0/1672023209 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f3f180fe4f0 0x7f3f180fb880 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:27.992 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.990+0000 7f3f1f33c640 1 --2- 172.21.15.89:0/1672023209 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f3f180fdba0 0x7f3f180fd390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:27.992 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.990+0000 7f3f1f33c640 1 -- 172.21.15.89:0/1672023209 >> 172.21.15.89:0/1672023209 conn(0x7f3f180f63a0 msgr2=0x7f3f180f7b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:57:27.992 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.990+0000 7f3f1f33c640 1 -- 172.21.15.89:0/1672023209 shutdown_connections 2024-09-13T02:57:27.992 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:27.990+0000 7f3f1f33c640 1 -- 172.21.15.89:0/1672023209 wait complete. 2024-09-13T02:57:28.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:27 smithi089 ceph-mon[91553]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:57:28.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:27 smithi089 ceph-mon[91553]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:57:28.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:27 smithi089 ceph-mon[91553]: from='client.? 172.21.15.89:0/4015719509' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:57:28.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:27 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:28.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:27 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:28.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:27 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:57:28.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:27 smithi089 ceph-mon[91553]: from='client.? 172.21.15.89:0/4117982688' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T02:57:28.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:27 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:28.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:27 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:28.070 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:28.068+0000 7ff7e16bf640 1 -- 172.21.15.89:0/3713690 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff7dc0fd820 msgr2=0x7ff7dc0fdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:28.070 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:28.068+0000 7ff7e16bf640 1 --2- 172.21.15.89:0/3713690 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff7dc0fd820 0x7ff7dc0fdc90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7ff7d00048d0 tx=0x7ff7d0009da0 comp rx=0 tx=0).stop 2024-09-13T02:57:28.070 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:28.068+0000 7ff7e16bf640 1 -- 172.21.15.89:0/3713690 shutdown_connections 2024-09-13T02:57:28.070 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:28.068+0000 7ff7e16bf640 1 --2- 172.21.15.89:0/3713690 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff7dc0fd820 0x7ff7dc0fdc90 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:28.070 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:28.068+0000 7ff7e16bf640 1 --2- 172.21.15.89:0/3713690 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff7dc0fc550 0x7ff7dc0fc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:28.070 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:28.068+0000 7ff7e16bf640 1 -- 172.21.15.89:0/3713690 >> 172.21.15.89:0/3713690 conn(0x7ff7dc0f7d30 msgr2=0x7ff7dc0fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:57:28.070 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:28.068+0000 7ff7e16bf640 1 -- 172.21.15.89:0/3713690 shutdown_connections 2024-09-13T02:57:28.070 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:28.068+0000 7ff7e16bf640 1 -- 172.21.15.89:0/3713690 wait complete. 2024-09-13T02:57:28.072 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:28.069+0000 7ff7e16bf640 1 Processor -- start 2024-09-13T02:57:28.072 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:28.069+0000 7ff7e16bf640 1 -- start start 2024-09-13T02:57:28.072 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:28.069+0000 7ff7e16bf640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff7dc0fc550 0x7ff7dc10d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:28.072 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:28.069+0000 7ff7e16bf640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff7dc0fd820 0x7ff7dc10d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:28.072 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:28.069+0000 7ff7e16bf640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7dc10dc20 con 0x7ff7dc0fc550 2024-09-13T02:57:28.072 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:28.069+0000 7ff7e16bf640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7dc10e440 con 0x7ff7dc0fd820 2024-09-13T02:57:28.073 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:28.069+0000 7ff7daffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff7dc0fc550 0x7ff7dc10d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:28.073 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:28.069+0000 7ff7daffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff7dc0fc550 0x7ff7dc10d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:38454/0 (socket says 172.21.15.89:38454) 2024-09-13T02:57:28.073 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:28.069+0000 7ff7daffd640 1 -- 172.21.15.89:0/276025903 learned_addr learned my addr 172.21.15.89:0/276025903 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:57:28.073 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:28.069+0000 7ff7da7fc640 1 --2- 172.21.15.89:0/276025903 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff7dc0fd820 0x7ff7dc10d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:28.073 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:28.070+0000 7ff7daffd640 1 -- 172.21.15.89:0/276025903 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff7dc0fd820 msgr2=0x7ff7dc10d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:28.073 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:28.070+0000 7ff7daffd640 1 --2- 172.21.15.89:0/276025903 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff7dc0fd820 0x7ff7dc10d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:28.073 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:28.070+0000 7ff7daffd640 1 -- 172.21.15.89:0/276025903 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7d0005040 con 0x7ff7dc0fc550 2024-09-13T02:57:28.073 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:28.070+0000 7ff7daffd640 1 --2- 172.21.15.89:0/276025903 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff7dc0fc550 0x7ff7dc10d090 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc002a80 tx=0x7ff7cc004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:57:28.073 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:28.070+0000 7ff7c37fe640 1 -- 172.21.15.89:0/276025903 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff7cc007c30 con 0x7ff7dc0fc550 2024-09-13T02:57:28.073 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:28.070+0000 7ff7c37fe640 1 -- 172.21.15.89:0/276025903 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff7cc00f040 con 0x7ff7dc0fc550 2024-09-13T02:57:28.073 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:28.070+0000 7ff7e16bf640 1 -- 172.21.15.89:0/276025903 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7dc10e6d0 con 0x7ff7dc0fc550 2024-09-13T02:57:28.073 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:28.070+0000 7ff7c37fe640 1 -- 172.21.15.89:0/276025903 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff7cc00dab0 con 0x7ff7dc0fc550 2024-09-13T02:57:28.073 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:28.070+0000 7ff7e16bf640 1 -- 172.21.15.89:0/276025903 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7dc10ebf0 con 0x7ff7dc0fc550 2024-09-13T02:57:28.074 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:28.071+0000 7ff7e16bf640 1 -- 172.21.15.89:0/276025903 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7dc0fb9b0 con 0x7ff7dc0fc550 2024-09-13T02:57:28.074 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:28.072+0000 7ff7c37fe640 1 -- 172.21.15.89:0/276025903 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 37) v1 ==== 92653+0+0 (secure 0 0 0) 0x7ff7cc00dc10 con 0x7ff7dc0fc550 2024-09-13T02:57:28.074 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:28.072+0000 7ff7c37fe640 1 --2- 172.21.15.89:0/276025903 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7ff7c406e660 0x7ff7c4070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:28.074 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:28.072+0000 7ff7da7fc640 1 --2- 172.21.15.89:0/276025903 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7ff7c406e660 0x7ff7c4070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:28.075 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:28.072+0000 7ff7c37fe640 1 -- 172.21.15.89:0/276025903 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 6496+0+0 (secure 0 0 0) 0x7ff7cc08dc70 con 0x7ff7dc0fc550 2024-09-13T02:57:28.075 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:28.073+0000 7ff7da7fc640 1 --2- 172.21.15.89:0/276025903 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7ff7c406e660 0x7ff7c4070b10 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc10ce40 tx=0x7ff7d0035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:57:28.080 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:28.079+0000 7ff7c37fe640 1 -- 172.21.15.89:0/276025903 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7ff7cc056bf0 con 0x7ff7dc0fc550 2024-09-13T02:57:28.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:27 smithi131 ceph-mon[78839]: from='client.34160 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:57:28.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:27 smithi131 ceph-mon[78839]: from='client.34164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:57:28.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:27 smithi131 ceph-mon[78839]: from='client.? 172.21.15.89:0/4015719509' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:57:28.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:27 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:28.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:27 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:28.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:27 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:57:28.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:27 smithi131 ceph-mon[78839]: from='client.? 172.21.15.89:0/4117982688' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T02:57:28.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:27 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:28.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:27 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:28.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:28.324+0000 7ff7e16bf640 1 -- 172.21.15.89:0/276025903 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7ff7dc04b720 con 0x7ff7dc0fc550 2024-09-13T02:57:28.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:28.325+0000 7ff7c37fe640 1 -- 172.21.15.89:0/276025903 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7ff7cc05a2b0 con 0x7ff7dc0fc550 2024-09-13T02:57:28.327 INFO:teuthology.orchestra.run.smithi089.stdout:HEALTH_OK 2024-09-13T02:57:28.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:28.327+0000 7ff7e16bf640 1 -- 172.21.15.89:0/276025903 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7ff7c406e660 msgr2=0x7ff7c4070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:28.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:28.327+0000 7ff7e16bf640 1 --2- 172.21.15.89:0/276025903 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7ff7c406e660 0x7ff7c4070b10 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7ff7dc10ce40 tx=0x7ff7d0035040 comp rx=0 tx=0).stop 2024-09-13T02:57:28.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:28.327+0000 7ff7e16bf640 1 -- 172.21.15.89:0/276025903 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff7dc0fc550 msgr2=0x7ff7dc10d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:28.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:28.327+0000 7ff7e16bf640 1 --2- 172.21.15.89:0/276025903 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff7dc0fc550 0x7ff7dc10d090 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7ff7cc002a80 tx=0x7ff7cc004600 comp rx=0 tx=0).stop 2024-09-13T02:57:28.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:28.327+0000 7ff7e16bf640 1 -- 172.21.15.89:0/276025903 shutdown_connections 2024-09-13T02:57:28.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:28.327+0000 7ff7e16bf640 1 --2- 172.21.15.89:0/276025903 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7ff7c406e660 0x7ff7c4070b10 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:28.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:28.327+0000 7ff7e16bf640 1 --2- 172.21.15.89:0/276025903 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff7dc0fd820 0x7ff7dc10d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:28.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:28.327+0000 7ff7e16bf640 1 --2- 172.21.15.89:0/276025903 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff7dc0fc550 0x7ff7dc10d090 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:28.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:28.327+0000 7ff7e16bf640 1 -- 172.21.15.89:0/276025903 >> 172.21.15.89:0/276025903 conn(0x7ff7dc0f7d30 msgr2=0x7ff7dc0f9490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:57:28.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:28.327+0000 7ff7e16bf640 1 -- 172.21.15.89:0/276025903 shutdown_connections 2024-09-13T02:57:28.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:28.327+0000 7ff7e16bf640 1 -- 172.21.15.89:0/276025903 wait complete. 2024-09-13T02:57:29.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:28 smithi089 ceph-mon[91553]: from='client.44129 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:57:29.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:28 smithi089 ceph-mon[91553]: pgmap v29: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T02:57:29.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:28 smithi089 ceph-mon[91553]: from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:57:29.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:28 smithi089 ceph-mon[91553]: from='client.? 172.21.15.89:0/276025903' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T02:57:29.074 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:28 smithi131 ceph-mon[78839]: from='client.44129 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:57:29.074 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:28 smithi131 ceph-mon[78839]: pgmap v29: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T02:57:29.074 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:28 smithi131 ceph-mon[78839]: from='client.34180 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:57:29.074 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:28 smithi131 ceph-mon[78839]: from='client.? 172.21.15.89:0/276025903' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T02:57:30.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:29 smithi089 ceph-mon[91553]: pgmap v30: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T02:57:30.071 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:29 smithi131 ceph-mon[78839]: pgmap v30: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T02:57:31.658 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:31 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:31.658 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:31 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:31.658 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:31 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:31.658 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:31 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:31.770 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:31 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:31.770 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:31 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:31.771 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:31 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:31.771 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:31 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:32.506 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:32 smithi131 ceph-mon[78839]: pgmap v31: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T02:57:32.506 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:32 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:32.506 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:32 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:32.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:32 smithi089 ceph-mon[91553]: pgmap v31: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T02:57:32.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:32 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:32.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:32 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:34.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:33 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:34.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:33 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:34.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:33 smithi131 ceph-mon[78839]: pgmap v32: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T02:57:34.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:33 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:34.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:33 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:34.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:33 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:34.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:33 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:34.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:33 smithi089 ceph-mon[91553]: pgmap v32: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T02:57:34.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:33 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:34.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:33 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:35.765 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:35 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:57:35.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:35 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:57:36.893 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:36 smithi089 ceph-mon[91553]: pgmap v33: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T02:57:36.893 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:36 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:36.894 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:36 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:36.894 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:36 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:57:36.894 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:36 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:57:36.894 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:36 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:36.894 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:36 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:57:36.894 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:36 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:57:36.894 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:36 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:57:36.894 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:36 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:57:36.894 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:36 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:36.894 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:36 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi089"}]: dispatch 2024-09-13T02:57:36.894 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:36 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi089"}]': finished 2024-09-13T02:57:36.894 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:36 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi131"}]: dispatch 2024-09-13T02:57:36.895 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:36 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi131"}]': finished 2024-09-13T02:57:36.895 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:36 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-13T02:57:36.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:36 smithi131 ceph-mon[78839]: pgmap v33: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T02:57:36.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:36 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:36.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:36 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:36.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:36 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:57:36.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:36 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:57:36.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:36 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:36.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:36 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:57:36.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:36 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:57:36.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:36 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:57:36.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:36 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:57:36.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:36 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:36.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:36 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi089"}]: dispatch 2024-09-13T02:57:36.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:36 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi089"}]': finished 2024-09-13T02:57:36.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:36 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi131"}]: dispatch 2024-09-13T02:57:36.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:36 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi131"}]': finished 2024-09-13T02:57:36.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:36 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-13T02:57:37.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:37 smithi131 ceph-mon[78839]: Upgrade: Setting container_image for all crash 2024-09-13T02:57:37.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:37 smithi131 ceph-mon[78839]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-13T02:57:37.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:37 smithi131 ceph-mon[78839]: Upgrade: osd.0 is safe to restart 2024-09-13T02:57:37.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:37 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:37.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:37 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-13T02:57:37.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:37 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:57:37.982 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:37 smithi089 ceph-mon[91553]: Upgrade: Setting container_image for all crash 2024-09-13T02:57:37.983 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:37 smithi089 ceph-mon[91553]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-09-13T02:57:37.983 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:37 smithi089 ceph-mon[91553]: Upgrade: osd.0 is safe to restart 2024-09-13T02:57:37.983 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:37 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:37.983 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:37 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-13T02:57:37.983 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:37 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:57:38.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:38 smithi131 ceph-mon[78839]: pgmap v34: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T02:57:38.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:38 smithi131 ceph-mon[78839]: Upgrade: Updating osd.0 2024-09-13T02:57:38.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:38 smithi131 ceph-mon[78839]: Deploying daemon osd.0 on smithi089 2024-09-13T02:57:39.005 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:38 smithi089 ceph-mon[91553]: pgmap v34: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T02:57:39.005 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:38 smithi089 ceph-mon[91553]: Upgrade: Updating osd.0 2024-09-13T02:57:39.005 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:38 smithi089 ceph-mon[91553]: Deploying daemon osd.0 on smithi089 2024-09-13T02:57:40.878 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:40 smithi089 ceph-mon[91553]: pgmap v35: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T02:57:40.878 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:40 smithi089 ceph-mon[91553]: fsmap cephfs:2 {0=cephfs.smithi089.rarddb=up:active,1=cephfs.smithi131.uasrkg=up:active} 2 up:standby-replay 2024-09-13T02:57:40.878 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 02:57:40 smithi089 systemd[1]: Stopping Ceph osd.0 for 12cdb164-717a-11ef-bceb-c7b262605968... 2024-09-13T02:57:40.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:40 smithi131 ceph-mon[78839]: pgmap v35: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T02:57:40.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:40 smithi131 ceph-mon[78839]: fsmap cephfs:2 {0=cephfs.smithi089.rarddb=up:active,1=cephfs.smithi131.uasrkg=up:active} 2 up:standby-replay 2024-09-13T02:57:41.285 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 02:57:40 smithi089 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-0[46234]: 2024-09-13T02:57:40.875+0000 7fdc71b8e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T02:57:41.285 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 02:57:40 smithi089 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-0[46234]: 2024-09-13T02:57:40.875+0000 7fdc71b8e640 -1 osd.0 47 *** Got signal Terminated *** 2024-09-13T02:57:41.285 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 02:57:40 smithi089 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-0[46234]: 2024-09-13T02:57:40.875+0000 7fdc71b8e640 -1 osd.0 47 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T02:57:41.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:41 smithi131 ceph-mon[78839]: osd.0 marked itself down and dead 2024-09-13T02:57:42.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:41 smithi089 ceph-mon[91553]: osd.0 marked itself down and dead 2024-09-13T02:57:42.411 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 02:57:42 smithi089 podman[99345]: 2024-09-13 02:57:42.153409568 +0000 UTC m=+1.414480688 container died b9404e2bc82c1642d04e1af9be9fcf96503a1c952bb3c0b63033396c429f3694 (image=quay.ceph.io/ceph-ci/ceph@sha256:20745bd452f31fe48c67c092910f9b2c550f9dc62d239ff3e2953415a85590be, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-0, RELEASE=quincy-bbdadfa, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T02:57:42.793 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:42 smithi089 ceph-mon[91553]: pgmap v36: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T02:57:42.793 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:42 smithi089 ceph-mon[91553]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T02:57:42.793 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:42 smithi089 ceph-mon[91553]: osdmap e48: 6 total, 5 up, 6 in 2024-09-13T02:57:42.793 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 02:57:42 smithi089 podman[99345]: 2024-09-13 02:57:42.508936205 +0000 UTC m=+1.770007311 container cleanup b9404e2bc82c1642d04e1af9be9fcf96503a1c952bb3c0b63033396c429f3694 (image=quay.ceph.io/ceph-ci/ceph@sha256:20745bd452f31fe48c67c092910f9b2c550f9dc62d239ff3e2953415a85590be, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-0, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=quincy-bbdadfa, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-13T02:57:42.793 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 02:57:42 smithi089 bash[99345]: ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-0 2024-09-13T02:57:42.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:42 smithi131 ceph-mon[78839]: pgmap v36: 65 pgs: 65 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T02:57:42.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:42 smithi131 ceph-mon[78839]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T02:57:42.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:42 smithi131 ceph-mon[78839]: osdmap e48: 6 total, 5 up, 6 in 2024-09-13T02:57:43.178 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 02:57:42 smithi089 podman[99360]: 2024-09-13 02:57:42.869344943 +0000 UTC m=+0.711058015 container remove b9404e2bc82c1642d04e1af9be9fcf96503a1c952bb3c0b63033396c429f3694 (image=quay.ceph.io/ceph-ci/ceph@sha256:20745bd452f31fe48c67c092910f9b2c550f9dc62d239ff3e2953415a85590be, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, ceph=True, RELEASE=quincy-bbdadfa) 2024-09-13T02:57:43.465 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 02:57:43 smithi089 podman[99444]: 2024-09-13 02:57:43.080845086 +0000 UTC m=+0.015730191 image pull 19dc8d6597273a47b0b4862f1d0e037b0157b908a02acd63baceec3ee94fbd6c quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d 2024-09-13T02:57:43.465 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 02:57:43 smithi089 podman[99444]: 2024-09-13 02:57:43.220436103 +0000 UTC m=+0.155321198 container create 7bff2d3762e893b503811b5b5b8039a1366ce4f35a850237028c73c0ddea39a2 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, RELEASE=squid-7741f7f, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T02:57:43.465 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 02:57:43 smithi089 podman[99444]: 2024-09-13 02:57:43.46472296 +0000 UTC m=+0.399608056 container init 7bff2d3762e893b503811b5b5b8039a1366ce4f35a850237028c73c0ddea39a2 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=squid-7741f7f, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T02:57:43.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:43 smithi089 ceph-mon[91553]: osdmap e49: 6 total, 5 up, 6 in 2024-09-13T02:57:43.785 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 02:57:43 smithi089 podman[99444]: 2024-09-13 02:57:43.46802891 +0000 UTC m=+0.402914010 container start 7bff2d3762e893b503811b5b5b8039a1366ce4f35a850237028c73c0ddea39a2 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, RELEASE=squid-7741f7f, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-13T02:57:43.785 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 02:57:43 smithi089 podman[99444]: 2024-09-13 02:57:43.564750115 +0000 UTC m=+0.499635232 container attach 7bff2d3762e893b503811b5b5b8039a1366ce4f35a850237028c73c0ddea39a2 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-7741f7f, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-13T02:57:43.785 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 02:57:43 smithi089 podman[99444]: 2024-09-13 02:57:43.662331586 +0000 UTC m=+0.597216691 container died 7bff2d3762e893b503811b5b5b8039a1366ce4f35a850237028c73c0ddea39a2 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-0-deactivate, RELEASE=squid-7741f7f, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS) 2024-09-13T02:57:43.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:43 smithi131 ceph-mon[78839]: osdmap e49: 6 total, 5 up, 6 in 2024-09-13T02:57:44.659 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 02:57:44 smithi089 podman[99467]: 2024-09-13 02:57:44.360030913 +0000 UTC m=+0.692117930 container remove 7bff2d3762e893b503811b5b5b8039a1366ce4f35a850237028c73c0ddea39a2 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=squid-7741f7f, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-13T02:57:44.659 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 02:57:44 smithi089 systemd[1]: ceph-12cdb164-717a-11ef-bceb-c7b262605968@osd.0.service: Deactivated successfully. 2024-09-13T02:57:44.659 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 02:57:44 smithi089 systemd[1]: Stopped Ceph osd.0 for 12cdb164-717a-11ef-bceb-c7b262605968. 2024-09-13T02:57:44.659 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 02:57:44 smithi089 systemd[1]: ceph-12cdb164-717a-11ef-bceb-c7b262605968@osd.0.service: Consumed 52.031s CPU time. 2024-09-13T02:57:44.659 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 02:57:44 smithi089 systemd[1]: Starting Ceph osd.0 for 12cdb164-717a-11ef-bceb-c7b262605968... 2024-09-13T02:57:44.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:44 smithi131 ceph-mon[78839]: pgmap v39: 65 pgs: 9 stale+active+clean, 56 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T02:57:44.953 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:44 smithi089 ceph-mon[91553]: pgmap v39: 65 pgs: 9 stale+active+clean, 56 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T02:57:44.953 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 02:57:44 smithi089 podman[99564]: 2024-09-13 02:57:44.709200908 +0000 UTC m=+0.016239839 image pull 19dc8d6597273a47b0b4862f1d0e037b0157b908a02acd63baceec3ee94fbd6c quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d 2024-09-13T02:57:44.954 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 02:57:44 smithi089 podman[99564]: 2024-09-13 02:57:44.845145036 +0000 UTC m=+0.152184010 container create 70ef21d9193988bcdbfc391305b04f5d45404cff76c9ee2dfdca7e13532f8500 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-0-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=squid-7741f7f, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True) 2024-09-13T02:57:45.221 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 02:57:45 smithi089 podman[99564]: 2024-09-13 02:57:45.0893493 +0000 UTC m=+0.396388229 container init 70ef21d9193988bcdbfc391305b04f5d45404cff76c9ee2dfdca7e13532f8500 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-0-activate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, RELEASE=squid-7741f7f) 2024-09-13T02:57:45.221 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 02:57:45 smithi089 podman[99564]: 2024-09-13 02:57:45.092737346 +0000 UTC m=+0.399776275 container start 70ef21d9193988bcdbfc391305b04f5d45404cff76c9ee2dfdca7e13532f8500 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-0-activate, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, RELEASE=squid-7741f7f) 2024-09-13T02:57:45.221 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 02:57:45 smithi089 podman[99564]: 2024-09-13 02:57:45.155978116 +0000 UTC m=+0.463017045 container attach 70ef21d9193988bcdbfc391305b04f5d45404cff76c9ee2dfdca7e13532f8500 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-0-activate, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-7741f7f, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T02:57:45.535 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 02:57:45 smithi089 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-0-activate[99579]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T02:57:45.535 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 02:57:45 smithi089 bash[99564]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T02:57:45.535 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 02:57:45 smithi089 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-0-activate[99579]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T02:57:45.535 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 02:57:45 smithi089 bash[99564]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T02:57:46.239 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 02:57:45 smithi089 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-0-activate[99579]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-13T02:57:46.240 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 02:57:45 smithi089 bash[99564]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-13T02:57:46.240 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 02:57:45 smithi089 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-0-activate[99579]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-13T02:57:46.240 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 02:57:45 smithi089 bash[99564]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-13T02:57:46.535 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 02:57:46 smithi089 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-0-activate[99579]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-13T02:57:46.535 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 02:57:46 smithi089 bash[99564]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-13T02:57:46.535 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 02:57:46 smithi089 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-0-activate[99579]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-13T02:57:46.535 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 02:57:46 smithi089 bash[99564]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-13T02:57:46.535 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 02:57:46 smithi089 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-0-activate[99579]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-09-13T02:57:46.535 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 02:57:46 smithi089 bash[99564]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-09-13T02:57:46.536 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 02:57:46 smithi089 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-0-activate[99579]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-13T02:57:46.536 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 02:57:46 smithi089 bash[99564]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-13T02:57:46.536 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 02:57:46 smithi089 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-0-activate[99579]: --> ceph-volume raw activate successful for osd ID: 0 2024-09-13T02:57:46.536 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 02:57:46 smithi089 bash[99564]: --> ceph-volume raw activate successful for osd ID: 0 2024-09-13T02:57:46.536 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 02:57:46 smithi089 podman[99564]: 2024-09-13 02:57:46.266467166 +0000 UTC m=+1.573506095 container died 70ef21d9193988bcdbfc391305b04f5d45404cff76c9ee2dfdca7e13532f8500 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-0-activate, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, RELEASE=squid-7741f7f, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T02:57:46.927 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:46 smithi089 ceph-mon[91553]: pgmap v40: 65 pgs: 9 stale+active+clean, 56 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T02:57:46.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:46 smithi131 ceph-mon[78839]: pgmap v40: 65 pgs: 9 stale+active+clean, 56 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T02:57:47.283 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 02:57:46 smithi089 podman[99712]: 2024-09-13 02:57:46.927155862 +0000 UTC m=+0.655183318 container remove 70ef21d9193988bcdbfc391305b04f5d45404cff76c9ee2dfdca7e13532f8500 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-0-activate, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-7741f7f, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2) 2024-09-13T02:57:47.283 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 02:57:47 smithi089 podman[99771]: 2024-09-13 02:57:47.033485993 +0000 UTC m=+0.015875354 image pull 19dc8d6597273a47b0b4862f1d0e037b0157b908a02acd63baceec3ee94fbd6c quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d 2024-09-13T02:57:47.284 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 02:57:47 smithi089 podman[99771]: 2024-09-13 02:57:47.169831444 +0000 UTC m=+0.152220846 container create e8038f6d52b6a1b1ec33a5b4abe9fff27c7333012e3d4fd6f522e1ef0f185a87 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-0, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, RELEASE=squid-7741f7f, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-13T02:57:47.785 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 02:57:47 smithi089 podman[99771]: 2024-09-13 02:57:47.405757502 +0000 UTC m=+0.388146866 container init e8038f6d52b6a1b1ec33a5b4abe9fff27c7333012e3d4fd6f522e1ef0f185a87 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-7741f7f, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-13T02:57:47.785 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 02:57:47 smithi089 podman[99771]: 2024-09-13 02:57:47.409190794 +0000 UTC m=+0.391580162 container start e8038f6d52b6a1b1ec33a5b4abe9fff27c7333012e3d4fd6f522e1ef0f185a87 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-0, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, RELEASE=squid-7741f7f, io.buildah.version=1.37.2) 2024-09-13T02:57:47.785 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 02:57:47 smithi089 ceph-osd[99790]: -- 172.21.15.89:0/4183597173 <== mon.0 v2:172.21.15.89:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5561fade01e0 con 0x5561fad76000 2024-09-13T02:57:47.785 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 02:57:47 smithi089 bash[99771]: e8038f6d52b6a1b1ec33a5b4abe9fff27c7333012e3d4fd6f522e1ef0f185a87 2024-09-13T02:57:47.785 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 02:57:47 smithi089 systemd[1]: Started Ceph osd.0 for 12cdb164-717a-11ef-bceb-c7b262605968. 2024-09-13T02:57:48.922 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:48 smithi089 ceph-mon[91553]: pgmap v41: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 70/357 objects degraded (19.608%) 2024-09-13T02:57:48.923 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:48 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:48.923 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:48 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:48.923 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:48 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:57:48.933 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:48 smithi131 ceph-mon[78839]: pgmap v41: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 70/357 objects degraded (19.608%) 2024-09-13T02:57:48.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:48 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:48.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:48 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:48.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:48 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:57:49.535 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 02:57:49 smithi089 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-0[99786]: 2024-09-13T02:57:49.283+0000 7f7c9dc56640 -1 Falling back to public interface 2024-09-13T02:57:49.859 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:49 smithi089 ceph-mon[91553]: Health check failed: Degraded data redundancy: 70/357 objects degraded (19.608%), 20 pgs degraded (PG_DEGRADED) 2024-09-13T02:57:49.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:49 smithi131 ceph-mon[78839]: Health check failed: Degraded data redundancy: 70/357 objects degraded (19.608%), 20 pgs degraded (PG_DEGRADED) 2024-09-13T02:57:50.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:50 smithi089 ceph-mon[91553]: pgmap v42: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 70/357 objects degraded (19.608%) 2024-09-13T02:57:50.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:50 smithi131 ceph-mon[78839]: pgmap v42: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 70/357 objects degraded (19.608%) 2024-09-13T02:57:51.893 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:51 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:51.894 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:51 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:57:51.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:51 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:51.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:51 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:57:52.856 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:52 smithi089 ceph-mon[91553]: pgmap v43: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 70/357 objects degraded (19.608%) 2024-09-13T02:57:52.856 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:52 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:52.856 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:52 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:52.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:52 smithi131 ceph-mon[78839]: pgmap v43: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 70/357 objects degraded (19.608%) 2024-09-13T02:57:52.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:52 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:52.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:52 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:53.933 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:53 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:53.933 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:53 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:53.933 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:53 smithi089 ceph-mon[91553]: pgmap v44: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 70/357 objects degraded (19.608%) 2024-09-13T02:57:54.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:53 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:54.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:53 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:54.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:53 smithi131 ceph-mon[78839]: pgmap v44: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 306 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 70/357 objects degraded (19.608%) 2024-09-13T02:57:55.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:54 smithi089 ceph-mon[91553]: from='osd.0 [v2:172.21.15.89:6802/953764875,v1:172.21.15.89:6803/953764875]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-13T02:57:55.285 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 02:57:54 smithi089 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-0[99786]: 2024-09-13T02:57:54.927+0000 7f7c9dc56640 -1 osd.0 47 log_to_monitors true 2024-09-13T02:57:55.285 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 02:57:54 smithi089 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-0[99786]: 2024-09-13T02:57:54.966+0000 7f7c959f0640 -1 osd.0 47 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T02:57:55.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:54 smithi131 ceph-mon[78839]: from='osd.0 [v2:172.21.15.89:6802/953764875,v1:172.21.15.89:6803/953764875]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-13T02:57:56.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:55 smithi089 ceph-mon[91553]: from='osd.0 [v2:172.21.15.89:6802/953764875,v1:172.21.15.89:6803/953764875]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-13T02:57:56.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:55 smithi089 ceph-mon[91553]: osdmap e50: 6 total, 5 up, 6 in 2024-09-13T02:57:56.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:55 smithi089 ceph-mon[91553]: from='osd.0 [v2:172.21.15.89:6802/953764875,v1:172.21.15.89:6803/953764875]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-09-13T02:57:56.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:55 smithi089 ceph-mon[91553]: pgmap v46: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 306 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 70/357 objects degraded (19.608%) 2024-09-13T02:57:56.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:55 smithi131 ceph-mon[78839]: from='osd.0 [v2:172.21.15.89:6802/953764875,v1:172.21.15.89:6803/953764875]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-13T02:57:56.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:55 smithi131 ceph-mon[78839]: osdmap e50: 6 total, 5 up, 6 in 2024-09-13T02:57:56.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:55 smithi131 ceph-mon[78839]: from='osd.0 [v2:172.21.15.89:6802/953764875,v1:172.21.15.89:6803/953764875]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-09-13T02:57:56.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:55 smithi131 ceph-mon[78839]: pgmap v46: 65 pgs: 14 active+undersized, 20 active+undersized+degraded, 31 active+clean; 306 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 70/357 objects degraded (19.608%) 2024-09-13T02:57:57.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:56 smithi089 ceph-mon[91553]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T02:57:57.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:56 smithi089 ceph-mon[91553]: osd.0 [v2:172.21.15.89:6802/953764875,v1:172.21.15.89:6803/953764875] boot 2024-09-13T02:57:57.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:56 smithi089 ceph-mon[91553]: osdmap e51: 6 total, 6 up, 6 in 2024-09-13T02:57:57.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:56 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T02:57:57.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:56 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:57.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:56 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:57.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:56 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:57:57.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:56 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:57:57.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:56 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:57.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:56 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:57:57.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:56 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:57:57.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:56 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:57:57.287 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:56 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:57:57.287 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:56 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-13T02:57:57.287 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:56 smithi089 ceph-mon[91553]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-13T02:57:57.287 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:56 smithi089 ceph-mon[91553]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-09-13T02:57:57.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:56 smithi131 ceph-mon[78839]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T02:57:57.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:56 smithi131 ceph-mon[78839]: osd.0 [v2:172.21.15.89:6802/953764875,v1:172.21.15.89:6803/953764875] boot 2024-09-13T02:57:57.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:56 smithi131 ceph-mon[78839]: osdmap e51: 6 total, 6 up, 6 in 2024-09-13T02:57:57.435 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:56 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-13T02:57:57.435 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:56 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:57.435 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:56 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:57.435 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:56 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:57:57.435 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:56 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:57:57.435 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:56 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:57:57.435 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:56 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:57:57.435 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:56 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:57:57.435 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:56 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:57:57.435 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:56 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:57:57.435 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:56 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-13T02:57:57.436 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:56 smithi131 ceph-mon[78839]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-13T02:57:57.436 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:56 smithi131 ceph-mon[78839]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-09-13T02:57:58.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:57 smithi089 ceph-mon[91553]: osdmap e52: 6 total, 6 up, 6 in 2024-09-13T02:57:58.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:57 smithi089 ceph-mon[91553]: pgmap v49: 65 pgs: 25 peering, 6 active+undersized, 3 active+undersized+degraded, 31 active+clean; 306 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 12/357 objects degraded (3.361%) 2024-09-13T02:57:58.422 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.418+0000 7f6844d5a640 1 -- 172.21.15.89:0/864843269 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f68400fdbb0 msgr2=0x7f68400fdfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:58.422 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.418+0000 7f6844d5a640 1 --2- 172.21.15.89:0/864843269 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f68400fdbb0 0x7f68400fdfc0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f68300048d0 tx=0x7f6830009da0 comp rx=0 tx=0).stop 2024-09-13T02:57:58.422 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.419+0000 7f6844d5a640 1 -- 172.21.15.89:0/864843269 shutdown_connections 2024-09-13T02:57:58.422 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.419+0000 7f6844d5a640 1 --2- 172.21.15.89:0/864843269 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f68400fe500 0x7f68400fa660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:58.422 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.419+0000 7f6844d5a640 1 --2- 172.21.15.89:0/864843269 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f68400fdbb0 0x7f68400fdfc0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:58.422 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.419+0000 7f6844d5a640 1 -- 172.21.15.89:0/864843269 >> 172.21.15.89:0/864843269 conn(0x7f68400f63b0 msgr2=0x7f68400f87e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:57:58.422 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.419+0000 7f6844d5a640 1 -- 172.21.15.89:0/864843269 shutdown_connections 2024-09-13T02:57:58.422 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.419+0000 7f6844d5a640 1 -- 172.21.15.89:0/864843269 wait complete. 2024-09-13T02:57:58.422 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.419+0000 7f6844d5a640 1 Processor -- start 2024-09-13T02:57:58.422 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.419+0000 7f6844d5a640 1 -- start start 2024-09-13T02:57:58.423 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.419+0000 7f6844d5a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f68400fdbb0 0x7f68400fd3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:58.423 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.419+0000 7f6844d5a640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f68400fe500 0x7f68400fb890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:58.423 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.419+0000 7f6844d5a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68400fbe20 con 0x7f68400fdbb0 2024-09-13T02:57:58.423 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.419+0000 7f6844d5a640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68400fbf60 con 0x7f68400fe500 2024-09-13T02:57:58.423 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.419+0000 7f683e59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f68400fdbb0 0x7f68400fd3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:58.423 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.420+0000 7f683e59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f68400fdbb0 0x7f68400fd3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:42258/0 (socket says 172.21.15.89:42258) 2024-09-13T02:57:58.423 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.420+0000 7f683e59c640 1 -- 172.21.15.89:0/735462216 learned_addr learned my addr 172.21.15.89:0/735462216 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:57:58.423 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.420+0000 7f683dd9b640 1 --2- 172.21.15.89:0/735462216 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f68400fe500 0x7f68400fb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:58.423 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.420+0000 7f683e59c640 1 -- 172.21.15.89:0/735462216 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f68400fe500 msgr2=0x7f68400fb890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:58.423 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.420+0000 7f683e59c640 1 --2- 172.21.15.89:0/735462216 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f68400fe500 0x7f68400fb890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:58.423 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.420+0000 7f683e59c640 1 -- 172.21.15.89:0/735462216 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6830005040 con 0x7f68400fdbb0 2024-09-13T02:57:58.423 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.420+0000 7f683e59c640 1 --2- 172.21.15.89:0/735462216 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f68400fdbb0 0x7f68400fd3a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f68300043d0 tx=0x7f6830009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:57:58.423 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.420+0000 7f6836ffd640 1 -- 172.21.15.89:0/735462216 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6830038070 con 0x7f68400fdbb0 2024-09-13T02:57:58.424 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.420+0000 7f6836ffd640 1 -- 172.21.15.89:0/735462216 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f683002ae90 con 0x7f68400fdbb0 2024-09-13T02:57:58.424 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.420+0000 7f6844d5a640 1 -- 172.21.15.89:0/735462216 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68400fc1e0 con 0x7f68400fdbb0 2024-09-13T02:57:58.424 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.420+0000 7f6836ffd640 1 -- 172.21.15.89:0/735462216 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f683003e670 con 0x7f68400fdbb0 2024-09-13T02:57:58.424 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.420+0000 7f6844d5a640 1 -- 172.21.15.89:0/735462216 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68401150f0 con 0x7f68400fdbb0 2024-09-13T02:57:58.425 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.421+0000 7f6844d5a640 1 -- 172.21.15.89:0/735462216 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68400fa050 con 0x7f68400fdbb0 2024-09-13T02:57:58.425 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.422+0000 7f6836ffd640 1 -- 172.21.15.89:0/735462216 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 37) v1 ==== 92653+0+0 (secure 0 0 0) 0x7f6830030020 con 0x7f68400fdbb0 2024-09-13T02:57:58.425 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.422+0000 7f6836ffd640 1 --2- 172.21.15.89:0/735462216 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f682c06e660 0x7f682c070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:58.425 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.422+0000 7f6836ffd640 1 -- 172.21.15.89:0/735462216 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f68300ae590 con 0x7f68400fdbb0 2024-09-13T02:57:58.425 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.422+0000 7f683dd9b640 1 --2- 172.21.15.89:0/735462216 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f682c06e660 0x7f682c070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:58.425 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.423+0000 7f683dd9b640 1 --2- 172.21.15.89:0/735462216 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f682c06e660 0x7f682c070b10 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6828007fd0 tx=0x7f6828009e90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:57:58.428 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.427+0000 7f6836ffd640 1 -- 172.21.15.89:0/735462216 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f6830077570 con 0x7f68400fdbb0 2024-09-13T02:57:58.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:57 smithi131 ceph-mon[78839]: osdmap e52: 6 total, 6 up, 6 in 2024-09-13T02:57:58.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:57 smithi131 ceph-mon[78839]: pgmap v49: 65 pgs: 25 peering, 6 active+undersized, 3 active+undersized+degraded, 31 active+clean; 306 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 12/357 objects degraded (3.361%) 2024-09-13T02:57:58.613 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.608+0000 7f6844d5a640 1 -- 172.21.15.89:0/735462216 --> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6840101d90 con 0x7f682c06e660 2024-09-13T02:57:58.613 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.610+0000 7f6836ffd640 1 -- 172.21.15.89:0/735462216 <== mgr.34104 v2:172.21.15.89:6800/1881577856 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f6840101d90 con 0x7f682c06e660 2024-09-13T02:57:58.614 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.612+0000 7f6844d5a640 1 -- 172.21.15.89:0/735462216 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f682c06e660 msgr2=0x7f682c070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:58.614 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.612+0000 7f6844d5a640 1 --2- 172.21.15.89:0/735462216 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f682c06e660 0x7f682c070b10 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f6828007fd0 tx=0x7f6828009e90 comp rx=0 tx=0).stop 2024-09-13T02:57:58.614 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.612+0000 7f6844d5a640 1 -- 172.21.15.89:0/735462216 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f68400fdbb0 msgr2=0x7f68400fd3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:58.614 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.612+0000 7f6844d5a640 1 --2- 172.21.15.89:0/735462216 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f68400fdbb0 0x7f68400fd3a0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f68300043d0 tx=0x7f6830009da0 comp rx=0 tx=0).stop 2024-09-13T02:57:58.614 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.612+0000 7f6844d5a640 1 -- 172.21.15.89:0/735462216 shutdown_connections 2024-09-13T02:57:58.614 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.612+0000 7f6844d5a640 1 --2- 172.21.15.89:0/735462216 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f682c06e660 0x7f682c070b10 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:58.614 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.612+0000 7f6844d5a640 1 --2- 172.21.15.89:0/735462216 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f68400fe500 0x7f68400fb890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:58.614 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.612+0000 7f6844d5a640 1 --2- 172.21.15.89:0/735462216 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f68400fdbb0 0x7f68400fd3a0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:58.614 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.612+0000 7f6844d5a640 1 -- 172.21.15.89:0/735462216 >> 172.21.15.89:0/735462216 conn(0x7f68400f63b0 msgr2=0x7f68400f7b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:57:58.614 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.612+0000 7f6844d5a640 1 -- 172.21.15.89:0/735462216 shutdown_connections 2024-09-13T02:57:58.614 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.612+0000 7f6844d5a640 1 -- 172.21.15.89:0/735462216 wait complete. 2024-09-13T02:57:58.624 INFO:teuthology.orchestra.run.smithi089.stdout:true 2024-09-13T02:57:58.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.696+0000 7fe7c4ec3640 1 -- 172.21.15.89:0/4174023178 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7c00fd840 msgr2=0x7fe7c00fdcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:58.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.696+0000 7fe7c4ec3640 1 --2- 172.21.15.89:0/4174023178 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7c00fd840 0x7fe7c00fdcb0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fe7b40048d0 tx=0x7fe7b4009da0 comp rx=0 tx=0).stop 2024-09-13T02:57:58.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.696+0000 7fe7c4ec3640 1 -- 172.21.15.89:0/4174023178 shutdown_connections 2024-09-13T02:57:58.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.696+0000 7fe7c4ec3640 1 --2- 172.21.15.89:0/4174023178 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7c00fd840 0x7fe7c00fdcb0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:58.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.696+0000 7fe7c4ec3640 1 --2- 172.21.15.89:0/4174023178 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe7c00fc570 0x7fe7c00fc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:58.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.696+0000 7fe7c4ec3640 1 -- 172.21.15.89:0/4174023178 >> 172.21.15.89:0/4174023178 conn(0x7fe7c00f7d30 msgr2=0x7fe7c00fa160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:57:58.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.696+0000 7fe7c4ec3640 1 -- 172.21.15.89:0/4174023178 shutdown_connections 2024-09-13T02:57:58.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.696+0000 7fe7c4ec3640 1 -- 172.21.15.89:0/4174023178 wait complete. 2024-09-13T02:57:58.700 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.697+0000 7fe7c4ec3640 1 Processor -- start 2024-09-13T02:57:58.700 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.697+0000 7fe7c4ec3640 1 -- start start 2024-09-13T02:57:58.700 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.697+0000 7fe7c4ec3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7c00fc570 0x7fe7c010d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:58.700 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.697+0000 7fe7c4ec3640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe7c00fd840 0x7fe7c010d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:58.700 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.697+0000 7fe7c4ec3640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c010dbf0 con 0x7fe7c00fc570 2024-09-13T02:57:58.700 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.697+0000 7fe7c4ec3640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c010e410 con 0x7fe7c00fd840 2024-09-13T02:57:58.700 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.697+0000 7fe7be59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7c00fc570 0x7fe7c010d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:58.700 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.697+0000 7fe7be59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7c00fc570 0x7fe7c010d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:42274/0 (socket says 172.21.15.89:42274) 2024-09-13T02:57:58.700 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.697+0000 7fe7be59c640 1 -- 172.21.15.89:0/1520530968 learned_addr learned my addr 172.21.15.89:0/1520530968 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:57:58.700 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.697+0000 7fe7be59c640 1 -- 172.21.15.89:0/1520530968 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe7c00fd840 msgr2=0x7fe7c010d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:58.700 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.697+0000 7fe7be59c640 1 --2- 172.21.15.89:0/1520530968 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe7c00fd840 0x7fe7c010d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:58.700 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.697+0000 7fe7be59c640 1 -- 172.21.15.89:0/1520530968 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7b4005040 con 0x7fe7c00fc570 2024-09-13T02:57:58.701 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.698+0000 7fe7be59c640 1 --2- 172.21.15.89:0/1520530968 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7c00fc570 0x7fe7c010d060 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe7b000c810 tx=0x7fe7b00043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:57:58.701 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.698+0000 7fe7aeffd640 1 -- 172.21.15.89:0/1520530968 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe7b000a820 con 0x7fe7c00fc570 2024-09-13T02:57:58.701 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.698+0000 7fe7aeffd640 1 -- 172.21.15.89:0/1520530968 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe7b000ae20 con 0x7fe7c00fc570 2024-09-13T02:57:58.701 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.698+0000 7fe7c4ec3640 1 -- 172.21.15.89:0/1520530968 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7c010e6a0 con 0x7fe7c00fc570 2024-09-13T02:57:58.701 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.698+0000 7fe7aeffd640 1 -- 172.21.15.89:0/1520530968 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe7b00115c0 con 0x7fe7c00fc570 2024-09-13T02:57:58.701 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.698+0000 7fe7c4ec3640 1 -- 172.21.15.89:0/1520530968 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7c010ec40 con 0x7fe7c00fc570 2024-09-13T02:57:58.702 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.699+0000 7fe7c4ec3640 1 -- 172.21.15.89:0/1520530968 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7c00fb9d0 con 0x7fe7c00fc570 2024-09-13T02:57:58.702 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.699+0000 7fe7aeffd640 1 -- 172.21.15.89:0/1520530968 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 37) v1 ==== 92653+0+0 (secure 0 0 0) 0x7fe7b0012840 con 0x7fe7c00fc570 2024-09-13T02:57:58.702 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.700+0000 7fe7aeffd640 1 --2- 172.21.15.89:0/1520530968 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fe7a806e660 0x7fe7a8070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:58.702 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.700+0000 7fe7aeffd640 1 -- 172.21.15.89:0/1520530968 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fe7b008e8b0 con 0x7fe7c00fc570 2024-09-13T02:57:58.702 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.700+0000 7fe7bdd9b640 1 --2- 172.21.15.89:0/1520530968 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fe7a806e660 0x7fe7a8070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:58.702 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.701+0000 7fe7bdd9b640 1 --2- 172.21.15.89:0/1520530968 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fe7a806e660 0x7fe7a8070b10 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe7b402a530 tx=0x7fe7b4009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:57:58.706 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.704+0000 7fe7aeffd640 1 -- 172.21.15.89:0/1520530968 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fe7b0057890 con 0x7fe7c00fc570 2024-09-13T02:57:58.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.889+0000 7fe7c4ec3640 1 -- 172.21.15.89:0/1520530968 --> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe7c010f030 con 0x7fe7a806e660 2024-09-13T02:57:58.891 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.890+0000 7fe7aeffd640 1 -- 172.21.15.89:0/1520530968 <== mgr.34104 v2:172.21.15.89:6800/1881577856 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fe7c010f030 con 0x7fe7a806e660 2024-09-13T02:57:58.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.892+0000 7fe7c4ec3640 1 -- 172.21.15.89:0/1520530968 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fe7a806e660 msgr2=0x7fe7a8070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:58.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.892+0000 7fe7c4ec3640 1 --2- 172.21.15.89:0/1520530968 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fe7a806e660 0x7fe7a8070b10 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe7b402a530 tx=0x7fe7b4009da0 comp rx=0 tx=0).stop 2024-09-13T02:57:58.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.892+0000 7fe7c4ec3640 1 -- 172.21.15.89:0/1520530968 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7c00fc570 msgr2=0x7fe7c010d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:58.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.892+0000 7fe7c4ec3640 1 --2- 172.21.15.89:0/1520530968 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7c00fc570 0x7fe7c010d060 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fe7b000c810 tx=0x7fe7b00043c0 comp rx=0 tx=0).stop 2024-09-13T02:57:58.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.892+0000 7fe7c4ec3640 1 -- 172.21.15.89:0/1520530968 shutdown_connections 2024-09-13T02:57:58.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.892+0000 7fe7c4ec3640 1 --2- 172.21.15.89:0/1520530968 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fe7a806e660 0x7fe7a8070b10 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:58.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.892+0000 7fe7c4ec3640 1 --2- 172.21.15.89:0/1520530968 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe7c00fd840 0x7fe7c010d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:58.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.892+0000 7fe7c4ec3640 1 --2- 172.21.15.89:0/1520530968 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe7c00fc570 0x7fe7c010d060 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:58.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.892+0000 7fe7c4ec3640 1 -- 172.21.15.89:0/1520530968 >> 172.21.15.89:0/1520530968 conn(0x7fe7c00f7d30 msgr2=0x7fe7c00f94b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:57:58.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.892+0000 7fe7c4ec3640 1 -- 172.21.15.89:0/1520530968 shutdown_connections 2024-09-13T02:57:58.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.892+0000 7fe7c4ec3640 1 -- 172.21.15.89:0/1520530968 wait complete. 2024-09-13T02:57:58.975 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.971+0000 7f1f8a22c640 1 -- 172.21.15.89:0/2199403367 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1f840fc570 msgr2=0x7f1f840fc980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:58.975 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.971+0000 7f1f8a22c640 1 --2- 172.21.15.89:0/2199403367 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1f840fc570 0x7f1f840fc980 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f1f740048d0 tx=0x7f1f74009da0 comp rx=0 tx=0).stop 2024-09-13T02:57:58.975 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.972+0000 7f1f8a22c640 1 -- 172.21.15.89:0/2199403367 shutdown_connections 2024-09-13T02:57:58.975 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.972+0000 7f1f8a22c640 1 --2- 172.21.15.89:0/2199403367 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1f840fd840 0x7f1f840fdcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:58.975 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.972+0000 7f1f8a22c640 1 --2- 172.21.15.89:0/2199403367 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1f840fc570 0x7f1f840fc980 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:58.975 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.972+0000 7f1f8a22c640 1 -- 172.21.15.89:0/2199403367 >> 172.21.15.89:0/2199403367 conn(0x7f1f840f7d30 msgr2=0x7f1f840fa160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:57:58.975 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.972+0000 7f1f8a22c640 1 -- 172.21.15.89:0/2199403367 shutdown_connections 2024-09-13T02:57:58.975 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.972+0000 7f1f8a22c640 1 -- 172.21.15.89:0/2199403367 wait complete. 2024-09-13T02:57:58.975 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.972+0000 7f1f8a22c640 1 Processor -- start 2024-09-13T02:57:58.975 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.972+0000 7f1f8a22c640 1 -- start start 2024-09-13T02:57:58.975 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.972+0000 7f1f8a22c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1f840fc570 0x7f1f8410d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:58.975 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.972+0000 7f1f8a22c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1f840fd840 0x7f1f8410d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:58.976 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.972+0000 7f1f8a22c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f8410dc00 con 0x7f1f840fc570 2024-09-13T02:57:58.976 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.972+0000 7f1f8a22c640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f8410e420 con 0x7f1f840fd840 2024-09-13T02:57:58.976 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.972+0000 7f1f837fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1f840fc570 0x7f1f8410d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:58.976 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.972+0000 7f1f837fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1f840fc570 0x7f1f8410d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:42290/0 (socket says 172.21.15.89:42290) 2024-09-13T02:57:58.976 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.972+0000 7f1f837fe640 1 -- 172.21.15.89:0/1008541346 learned_addr learned my addr 172.21.15.89:0/1008541346 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:57:58.976 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.973+0000 7f1f7bfff640 1 --2- 172.21.15.89:0/1008541346 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1f840fd840 0x7f1f8410d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:58.976 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.973+0000 7f1f837fe640 1 -- 172.21.15.89:0/1008541346 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1f840fd840 msgr2=0x7f1f8410d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:58.976 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.973+0000 7f1f837fe640 1 --2- 172.21.15.89:0/1008541346 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1f840fd840 0x7f1f8410d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:58.976 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.973+0000 7f1f837fe640 1 -- 172.21.15.89:0/1008541346 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f74005040 con 0x7f1f840fc570 2024-09-13T02:57:58.976 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.973+0000 7f1f837fe640 1 --2- 172.21.15.89:0/1008541346 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1f840fc570 0x7f1f8410d070 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1f740043d0 tx=0x7f1f74009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:57:58.976 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.973+0000 7f1f80ff9640 1 -- 172.21.15.89:0/1008541346 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f74038070 con 0x7f1f840fc570 2024-09-13T02:57:58.976 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.973+0000 7f1f8a22c640 1 -- 172.21.15.89:0/1008541346 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f8410e650 con 0x7f1f840fc570 2024-09-13T02:57:58.976 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.973+0000 7f1f80ff9640 1 -- 172.21.15.89:0/1008541346 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f1f7402ae90 con 0x7f1f840fc570 2024-09-13T02:57:58.977 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.973+0000 7f1f80ff9640 1 -- 172.21.15.89:0/1008541346 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f7403e670 con 0x7f1f840fc570 2024-09-13T02:57:58.977 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.973+0000 7f1f8a22c640 1 -- 172.21.15.89:0/1008541346 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f8410ebf0 con 0x7f1f840fc570 2024-09-13T02:57:58.977 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.974+0000 7f1f8a22c640 1 -- 172.21.15.89:0/1008541346 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f840fb9d0 con 0x7f1f840fc570 2024-09-13T02:57:58.978 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.975+0000 7f1f80ff9640 1 -- 172.21.15.89:0/1008541346 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 37) v1 ==== 92653+0+0 (secure 0 0 0) 0x7f1f74030020 con 0x7f1f840fc570 2024-09-13T02:57:58.978 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.975+0000 7f1f80ff9640 1 --2- 172.21.15.89:0/1008541346 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f1f7006e660 0x7f1f70070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:58.978 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.975+0000 7f1f80ff9640 1 -- 172.21.15.89:0/1008541346 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f1f740ae590 con 0x7f1f840fc570 2024-09-13T02:57:58.978 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.975+0000 7f1f7bfff640 1 --2- 172.21.15.89:0/1008541346 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f1f7006e660 0x7f1f70070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:58.978 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.976+0000 7f1f7bfff640 1 --2- 172.21.15.89:0/1008541346 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f1f7006e660 0x7f1f70070b10 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c009fd0 tx=0x7f1f6c009e50 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:57:58.981 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:58.980+0000 7f1f80ff9640 1 -- 172.21.15.89:0/1008541346 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f1f74077570 con 0x7f1f840fc570 2024-09-13T02:57:59.155 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.154+0000 7f1f8a22c640 1 -- 172.21.15.89:0/1008541346 --> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f1f8410ef20 con 0x7f1f7006e660 2024-09-13T02:57:59.164 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.163+0000 7f1f80ff9640 1 -- 172.21.15.89:0/1008541346 <== mgr.34104 v2:172.21.15.89:6800/1881577856 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f1f8410ef20 con 0x7f1f7006e660 2024-09-13T02:57:59.164 INFO:teuthology.orchestra.run.smithi089.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T02:57:59.164 INFO:teuthology.orchestra.run.smithi089.stdout:alertmanager.smithi089 smithi089 *:9093,9094 running (2m) 6s ago 11m 15.2M - 0.25.0 c8568f914cd2 1d2432f5479e 2024-09-13T02:57:59.164 INFO:teuthology.orchestra.run.smithi089.stdout:crash.smithi089 smithi089 running (36s) 6s ago 11m 6891k - 19.1.1-322-g7741f7f9 19dc8d659727 0ef15ca3e7f9 2024-09-13T02:57:59.165 INFO:teuthology.orchestra.run.smithi089.stdout:crash.smithi131 smithi131 running (32s) 28s ago 10m 6895k - 19.1.1-322-g7741f7f9 19dc8d659727 21e4d6fc04f7 2024-09-13T02:57:59.165 INFO:teuthology.orchestra.run.smithi089.stdout:grafana.smithi089 smithi089 *:3000 running (2m) 6s ago 11m 79.6M - 9.4.7 954c08fa6188 dee914ded1af 2024-09-13T02:57:59.165 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi089.qjoitb smithi089 running (6m) 6s ago 6m 70.6M - 17.2.7-1627-gbbdadfa3 a994b00deb3a ff9b59ec5107 2024-09-13T02:57:59.165 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi089.rarddb smithi089 running (6m) 6s ago 6m 136M - 17.2.7-1627-gbbdadfa3 a994b00deb3a db2dc502c1ba 2024-09-13T02:57:59.165 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi131.rbovzc smithi131 running (6m) 28s ago 6m 60.5M - 17.2.7-1627-gbbdadfa3 a994b00deb3a d071b6d99537 2024-09-13T02:57:59.165 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi131.uasrkg smithi131 running (6m) 28s ago 6m 112M - 17.2.7-1627-gbbdadfa3 a994b00deb3a 0b3d4ffa6ce5 2024-09-13T02:57:59.165 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.smithi089.guohvs smithi089 *:8443,9283,8765 running (2m) 6s ago 12m 494M - 19.1.1-322-g7741f7f9 19dc8d659727 1e887446f1b0 2024-09-13T02:57:59.165 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.smithi131.aunbqd smithi131 *:8443,9283,8765 running (102s) 28s ago 10m 439M - 19.1.1-322-g7741f7f9 19dc8d659727 358d7478f2ba 2024-09-13T02:57:59.165 INFO:teuthology.orchestra.run.smithi089.stdout:mon.smithi089 smithi089 running (90s) 6s ago 12m 41.6M 2048M 19.1.1-322-g7741f7f9 19dc8d659727 8a29fb65028f 2024-09-13T02:57:59.165 INFO:teuthology.orchestra.run.smithi089.stdout:mon.smithi131 smithi131 running (71s) 28s ago 10m 37.6M 2048M 19.1.1-322-g7741f7f9 19dc8d659727 506310ad8620 2024-09-13T02:57:59.165 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.smithi089 smithi089 *:9100 running (2m) 6s ago 11m 15.1M - 1.5.0 0da6a335fe13 5a9927b583e6 2024-09-13T02:57:59.165 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.smithi131 smithi131 *:9100 running (2m) 28s ago 10m 15.3M - 1.5.0 0da6a335fe13 bcfde5d1a508 2024-09-13T02:57:59.165 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0 smithi089 running (12s) 6s ago 9m 14.2M 1557M 19.1.1-322-g7741f7f9 19dc8d659727 e8038f6d52b6 2024-09-13T02:57:59.165 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1 smithi089 running (9m) 6s ago 9m 232M 1557M 17.2.7-1627-gbbdadfa3 a994b00deb3a af6538730e42 2024-09-13T02:57:59.166 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2 smithi089 running (8m) 6s ago 8m 195M 1557M 17.2.7-1627-gbbdadfa3 a994b00deb3a 447cf103114b 2024-09-13T02:57:59.166 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3 smithi131 running (8m) 28s ago 8m 264M 2581M 17.2.7-1627-gbbdadfa3 a994b00deb3a 0b80a4dea862 2024-09-13T02:57:59.166 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4 smithi131 running (8m) 28s ago 8m 236M 2581M 17.2.7-1627-gbbdadfa3 a994b00deb3a 06ec44680b00 2024-09-13T02:57:59.166 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5 smithi131 running (7m) 28s ago 7m 231M 2581M 17.2.7-1627-gbbdadfa3 a994b00deb3a ace4b45e5873 2024-09-13T02:57:59.166 INFO:teuthology.orchestra.run.smithi089.stdout:prometheus.smithi089 smithi089 *:9095 running (107s) 6s ago 11m 51.7M - 2.43.0 a07b618ecd1d 9d336370c187 2024-09-13T02:57:59.166 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.165+0000 7f1f8a22c640 1 -- 172.21.15.89:0/1008541346 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f1f7006e660 msgr2=0x7f1f70070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:59.167 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.165+0000 7f1f8a22c640 1 --2- 172.21.15.89:0/1008541346 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f1f7006e660 0x7f1f70070b10 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f1f6c009fd0 tx=0x7f1f6c009e50 comp rx=0 tx=0).stop 2024-09-13T02:57:59.167 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.165+0000 7f1f8a22c640 1 -- 172.21.15.89:0/1008541346 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1f840fc570 msgr2=0x7f1f8410d070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:59.167 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.165+0000 7f1f8a22c640 1 --2- 172.21.15.89:0/1008541346 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1f840fc570 0x7f1f8410d070 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1f740043d0 tx=0x7f1f74009da0 comp rx=0 tx=0).stop 2024-09-13T02:57:59.167 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.165+0000 7f1f8a22c640 1 -- 172.21.15.89:0/1008541346 shutdown_connections 2024-09-13T02:57:59.167 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.165+0000 7f1f8a22c640 1 --2- 172.21.15.89:0/1008541346 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f1f7006e660 0x7f1f70070b10 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:59.167 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.165+0000 7f1f8a22c640 1 --2- 172.21.15.89:0/1008541346 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1f840fd840 0x7f1f8410d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:59.167 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.165+0000 7f1f8a22c640 1 --2- 172.21.15.89:0/1008541346 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1f840fc570 0x7f1f8410d070 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:59.167 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.165+0000 7f1f8a22c640 1 -- 172.21.15.89:0/1008541346 >> 172.21.15.89:0/1008541346 conn(0x7f1f840f7d30 msgr2=0x7f1f840f94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:57:59.167 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.165+0000 7f1f8a22c640 1 -- 172.21.15.89:0/1008541346 shutdown_connections 2024-09-13T02:57:59.167 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.165+0000 7f1f8a22c640 1 -- 172.21.15.89:0/1008541346 wait complete. 2024-09-13T02:57:59.243 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.241+0000 7fc991ed0640 1 -- 172.21.15.89:0/354596691 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc98c0fc6f0 msgr2=0x7fc98c0fcb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:59.243 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.241+0000 7fc991ed0640 1 --2- 172.21.15.89:0/354596691 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc98c0fc6f0 0x7fc98c0fcb60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc9800048d0 tx=0x7fc980009da0 comp rx=0 tx=0).stop 2024-09-13T02:57:59.243 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.241+0000 7fc991ed0640 1 -- 172.21.15.89:0/354596691 shutdown_connections 2024-09-13T02:57:59.243 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.241+0000 7fc991ed0640 1 --2- 172.21.15.89:0/354596691 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc98c0fc6f0 0x7fc98c0fcb60 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:59.243 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.241+0000 7fc991ed0640 1 --2- 172.21.15.89:0/354596691 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc98c0fb420 0x7fc98c0fb830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:59.243 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.241+0000 7fc991ed0640 1 -- 172.21.15.89:0/354596691 >> 172.21.15.89:0/354596691 conn(0x7fc98c0f6c00 msgr2=0x7fc98c0f9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:57:59.244 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:58 smithi089 ceph-mon[91553]: Health check update: Degraded data redundancy: 12/357 objects degraded (3.361%), 3 pgs degraded (PG_DEGRADED) 2024-09-13T02:57:59.244 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:58 smithi089 ceph-mon[91553]: from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:57:59.246 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.242+0000 7fc991ed0640 1 -- 172.21.15.89:0/354596691 shutdown_connections 2024-09-13T02:57:59.246 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.242+0000 7fc991ed0640 1 -- 172.21.15.89:0/354596691 wait complete. 2024-09-13T02:57:59.246 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.242+0000 7fc991ed0640 1 Processor -- start 2024-09-13T02:57:59.246 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.242+0000 7fc991ed0640 1 -- start start 2024-09-13T02:57:59.246 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.243+0000 7fc991ed0640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc98c0fb420 0x7fc98c10fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:59.246 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.243+0000 7fc991ed0640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc98c0fc6f0 0x7fc98c1122e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:59.246 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.243+0000 7fc991ed0640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc98c0664f0 con 0x7fc98c0fb420 2024-09-13T02:57:59.246 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.243+0000 7fc991ed0640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc98c066660 con 0x7fc98c0fc6f0 2024-09-13T02:57:59.246 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.243+0000 7fc98b7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc98c0fb420 0x7fc98c10fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:59.246 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.243+0000 7fc98b7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc98c0fb420 0x7fc98c10fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:42296/0 (socket says 172.21.15.89:42296) 2024-09-13T02:57:59.246 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.243+0000 7fc98b7fe640 1 -- 172.21.15.89:0/422500914 learned_addr learned my addr 172.21.15.89:0/422500914 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:57:59.247 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.243+0000 7fc98affd640 1 --2- 172.21.15.89:0/422500914 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc98c0fc6f0 0x7fc98c1122e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:59.247 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.243+0000 7fc98b7fe640 1 -- 172.21.15.89:0/422500914 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc98c0fc6f0 msgr2=0x7fc98c1122e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:59.247 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.243+0000 7fc98b7fe640 1 --2- 172.21.15.89:0/422500914 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc98c0fc6f0 0x7fc98c1122e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:59.247 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.243+0000 7fc98b7fe640 1 -- 172.21.15.89:0/422500914 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc980005040 con 0x7fc98c0fb420 2024-09-13T02:57:59.247 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.243+0000 7fc98b7fe640 1 --2- 172.21.15.89:0/422500914 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc98c0fb420 0x7fc98c10fd90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc97c00eb70 tx=0x7fc97c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:57:59.247 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.244+0000 7fc973fff640 1 -- 172.21.15.89:0/422500914 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc97c007c30 con 0x7fc98c0fb420 2024-09-13T02:57:59.247 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.244+0000 7fc973fff640 1 -- 172.21.15.89:0/422500914 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc97c00f040 con 0x7fc98c0fb420 2024-09-13T02:57:59.247 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.244+0000 7fc991ed0640 1 -- 172.21.15.89:0/422500914 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc98c112820 con 0x7fc98c0fb420 2024-09-13T02:57:59.247 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.244+0000 7fc973fff640 1 -- 172.21.15.89:0/422500914 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc97c009550 con 0x7fc98c0fb420 2024-09-13T02:57:59.247 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.244+0000 7fc991ed0640 1 -- 172.21.15.89:0/422500914 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc98c112d90 con 0x7fc98c0fb420 2024-09-13T02:57:59.247 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.245+0000 7fc991ed0640 1 -- 172.21.15.89:0/422500914 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc98c0fa880 con 0x7fc98c0fb420 2024-09-13T02:57:59.248 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.245+0000 7fc973fff640 1 -- 172.21.15.89:0/422500914 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 37) v1 ==== 92653+0+0 (secure 0 0 0) 0x7fc97c00cca0 con 0x7fc98c0fb420 2024-09-13T02:57:59.248 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.246+0000 7fc973fff640 1 --2- 172.21.15.89:0/422500914 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fc97406e660 0x7fc974070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:59.248 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.246+0000 7fc973fff640 1 -- 172.21.15.89:0/422500914 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fc97c08dff0 con 0x7fc98c0fb420 2024-09-13T02:57:59.248 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.246+0000 7fc98affd640 1 --2- 172.21.15.89:0/422500914 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fc97406e660 0x7fc974070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:59.248 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.246+0000 7fc98affd640 1 --2- 172.21.15.89:0/422500914 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fc97406e660 0x7fc974070b10 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc980007ac0 tx=0x7fc980035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:57:59.252 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.251+0000 7fc973fff640 1 -- 172.21.15.89:0/422500914 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fc97c056ff0 con 0x7fc98c0fb420 2024-09-13T02:57:59.436 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:58 smithi131 ceph-mon[78839]: Health check update: Degraded data redundancy: 12/357 objects degraded (3.361%), 3 pgs degraded (PG_DEGRADED) 2024-09-13T02:57:59.436 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:58 smithi131 ceph-mon[78839]: from='client.34192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:57:59.486 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.485+0000 7fc991ed0640 1 -- 172.21.15.89:0/422500914 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc98c113060 con 0x7fc98c0fb420 2024-09-13T02:57:59.486 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.485+0000 7fc973fff640 1 -- 172.21.15.89:0/422500914 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+850 (secure 0 0 0) 0x7fc97c05a6b0 con 0x7fc98c0fb420 2024-09-13T02:57:59.487 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-13T02:57:59.487 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": { 2024-09-13T02:57:59.487 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 2 2024-09-13T02:57:59.487 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T02:57:59.487 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": { 2024-09-13T02:57:59.487 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 2 2024-09-13T02:57:59.487 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T02:57:59.487 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": { 2024-09-13T02:57:59.487 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 5, 2024-09-13T02:57:59.487 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 1 2024-09-13T02:57:59.488 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T02:57:59.488 INFO:teuthology.orchestra.run.smithi089.stdout: "mds": { 2024-09-13T02:57:59.488 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 4 2024-09-13T02:57:59.488 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T02:57:59.488 INFO:teuthology.orchestra.run.smithi089.stdout: "overall": { 2024-09-13T02:57:59.488 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 9, 2024-09-13T02:57:59.488 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 5 2024-09-13T02:57:59.488 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-13T02:57:59.488 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-13T02:57:59.489 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.487+0000 7fc991ed0640 1 -- 172.21.15.89:0/422500914 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fc97406e660 msgr2=0x7fc974070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:59.489 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.487+0000 7fc991ed0640 1 --2- 172.21.15.89:0/422500914 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fc97406e660 0x7fc974070b10 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc980007ac0 tx=0x7fc980035040 comp rx=0 tx=0).stop 2024-09-13T02:57:59.489 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.487+0000 7fc991ed0640 1 -- 172.21.15.89:0/422500914 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc98c0fb420 msgr2=0x7fc98c10fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:59.489 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.487+0000 7fc991ed0640 1 --2- 172.21.15.89:0/422500914 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc98c0fb420 0x7fc98c10fd90 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc97c00eb70 tx=0x7fc97c00b040 comp rx=0 tx=0).stop 2024-09-13T02:57:59.489 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.487+0000 7fc991ed0640 1 -- 172.21.15.89:0/422500914 shutdown_connections 2024-09-13T02:57:59.489 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.487+0000 7fc991ed0640 1 --2- 172.21.15.89:0/422500914 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fc97406e660 0x7fc974070b10 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:59.489 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.487+0000 7fc991ed0640 1 --2- 172.21.15.89:0/422500914 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc98c0fc6f0 0x7fc98c1122e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:59.489 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.487+0000 7fc991ed0640 1 --2- 172.21.15.89:0/422500914 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc98c0fb420 0x7fc98c10fd90 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:59.489 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.487+0000 7fc991ed0640 1 -- 172.21.15.89:0/422500914 >> 172.21.15.89:0/422500914 conn(0x7fc98c0f6c00 msgr2=0x7fc98c0f83b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:57:59.490 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.488+0000 7fc991ed0640 1 -- 172.21.15.89:0/422500914 shutdown_connections 2024-09-13T02:57:59.490 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.488+0000 7fc991ed0640 1 -- 172.21.15.89:0/422500914 wait complete. 2024-09-13T02:57:59.569 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.565+0000 7f4b3f4c4640 1 -- 172.21.15.89:0/3474611115 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b380ff720 msgr2=0x7f4b38101b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:59.569 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.566+0000 7f4b3f4c4640 1 --2- 172.21.15.89:0/3474611115 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b380ff720 0x7f4b38101b00 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f4b340048d0 tx=0x7f4b34009da0 comp rx=0 tx=0).stop 2024-09-13T02:57:59.569 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.566+0000 7f4b3f4c4640 1 -- 172.21.15.89:0/3474611115 shutdown_connections 2024-09-13T02:57:59.569 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.566+0000 7f4b3f4c4640 1 --2- 172.21.15.89:0/3474611115 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b380ff720 0x7f4b38101b00 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:59.569 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.566+0000 7f4b3f4c4640 1 --2- 172.21.15.89:0/3474611115 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4b38066690 0x7f4b380ff1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:59.569 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.566+0000 7f4b3f4c4640 1 -- 172.21.15.89:0/3474611115 >> 172.21.15.89:0/3474611115 conn(0x7f4b380f6c10 msgr2=0x7f4b380f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:57:59.569 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.566+0000 7f4b3f4c4640 1 -- 172.21.15.89:0/3474611115 shutdown_connections 2024-09-13T02:57:59.569 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.566+0000 7f4b3f4c4640 1 -- 172.21.15.89:0/3474611115 wait complete. 2024-09-13T02:57:59.569 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.566+0000 7f4b3f4c4640 1 Processor -- start 2024-09-13T02:57:59.569 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.566+0000 7f4b3f4c4640 1 -- start start 2024-09-13T02:57:59.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.567+0000 7f4b3f4c4640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4b38066690 0x7f4b3810d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:59.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.567+0000 7f4b3f4c4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b380ff720 0x7f4b3810d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:59.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.567+0000 7f4b3f4c4640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b3810dcf0 con 0x7f4b380ff720 2024-09-13T02:57:59.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.567+0000 7f4b3f4c4640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b3810e510 con 0x7f4b38066690 2024-09-13T02:57:59.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.567+0000 7f4b3ca5f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b380ff720 0x7f4b3810d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:59.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.567+0000 7f4b3ca5f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b380ff720 0x7f4b3810d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:42314/0 (socket says 172.21.15.89:42314) 2024-09-13T02:57:59.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.567+0000 7f4b3ca5f640 1 -- 172.21.15.89:0/15410501 learned_addr learned my addr 172.21.15.89:0/15410501 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:57:59.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.567+0000 7f4b3d260640 1 --2- 172.21.15.89:0/15410501 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4b38066690 0x7f4b3810d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:59.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.567+0000 7f4b3ca5f640 1 -- 172.21.15.89:0/15410501 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4b38066690 msgr2=0x7f4b3810d160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:59.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.567+0000 7f4b3ca5f640 1 --2- 172.21.15.89:0/15410501 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4b38066690 0x7f4b3810d160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:59.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.567+0000 7f4b3ca5f640 1 -- 172.21.15.89:0/15410501 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b34005040 con 0x7f4b380ff720 2024-09-13T02:57:59.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.567+0000 7f4b3d260640 1 --2- 172.21.15.89:0/15410501 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4b38066690 0x7f4b3810d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T02:57:59.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.567+0000 7f4b3ca5f640 1 --2- 172.21.15.89:0/15410501 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b380ff720 0x7f4b3810d6a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4b340094f0 tx=0x7f4b34009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:57:59.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.567+0000 7f4b29ffb640 1 -- 172.21.15.89:0/15410501 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b34038070 con 0x7f4b380ff720 2024-09-13T02:57:59.571 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.567+0000 7f4b3f4c4640 1 -- 172.21.15.89:0/15410501 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b3810e740 con 0x7f4b380ff720 2024-09-13T02:57:59.571 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.567+0000 7f4b29ffb640 1 -- 172.21.15.89:0/15410501 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4b3402abd0 con 0x7f4b380ff720 2024-09-13T02:57:59.571 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.567+0000 7f4b29ffb640 1 -- 172.21.15.89:0/15410501 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4b3403e670 con 0x7f4b380ff720 2024-09-13T02:57:59.571 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.568+0000 7f4b3f4c4640 1 -- 172.21.15.89:0/15410501 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b3810ece0 con 0x7f4b380ff720 2024-09-13T02:57:59.572 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.569+0000 7f4b3f4c4640 1 -- 172.21.15.89:0/15410501 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b380fa8b0 con 0x7f4b380ff720 2024-09-13T02:57:59.572 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.569+0000 7f4b29ffb640 1 -- 172.21.15.89:0/15410501 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 37) v1 ==== 92653+0+0 (secure 0 0 0) 0x7f4b34030020 con 0x7f4b380ff720 2024-09-13T02:57:59.572 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.570+0000 7f4b29ffb640 1 --2- 172.21.15.89:0/15410501 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f4b2406e660 0x7f4b24070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:59.572 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.570+0000 7f4b29ffb640 1 -- 172.21.15.89:0/15410501 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f4b340ae5a0 con 0x7f4b380ff720 2024-09-13T02:57:59.572 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.570+0000 7f4b3d260640 1 --2- 172.21.15.89:0/15410501 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f4b2406e660 0x7f4b24070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:59.572 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.570+0000 7f4b3d260640 1 --2- 172.21.15.89:0/15410501 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f4b2406e660 0x7f4b24070b10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4b380663f0 tx=0x7f4b2c009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:57:59.575 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.574+0000 7f4b29ffb640 1 -- 172.21.15.89:0/15410501 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f4b34077580 con 0x7f4b380ff720 2024-09-13T02:57:59.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.773+0000 7f4b3f4c4640 1 -- 172.21.15.89:0/15410501 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f4b3804b720 con 0x7f4b380ff720 2024-09-13T02:57:59.775 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.774+0000 7f4b29ffb640 1 -- 172.21.15.89:0/15410501 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 22 v22) v1 ==== 76+0+1970 (secure 0 0 0) 0x7f4b3407ac40 con 0x7f4b380ff720 2024-09-13T02:57:59.776 INFO:teuthology.orchestra.run.smithi089.stdout:e22 2024-09-13T02:57:59.776 INFO:teuthology.orchestra.run.smithi089.stdout:btime 2024-09-13T02:57:39:637363+0000 2024-09-13T02:57:59.776 INFO:teuthology.orchestra.run.smithi089.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T02:57:59.776 INFO:teuthology.orchestra.run.smithi089.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:57:59.776 INFO:teuthology.orchestra.run.smithi089.stdout:legacy client fscid: 1 2024-09-13T02:57:59.776 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:57:59.776 INFO:teuthology.orchestra.run.smithi089.stdout:Filesystem 'cephfs' (1) 2024-09-13T02:57:59.776 INFO:teuthology.orchestra.run.smithi089.stdout:fs_name cephfs 2024-09-13T02:57:59.777 INFO:teuthology.orchestra.run.smithi089.stdout:epoch 22 2024-09-13T02:57:59.777 INFO:teuthology.orchestra.run.smithi089.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T02:57:59.777 INFO:teuthology.orchestra.run.smithi089.stdout:created 2024-09-13T02:51:40.657817+0000 2024-09-13T02:57:59.777 INFO:teuthology.orchestra.run.smithi089.stdout:modified 2024-09-13T02:57:39.637360+0000 2024-09-13T02:57:59.777 INFO:teuthology.orchestra.run.smithi089.stdout:tableserver 0 2024-09-13T02:57:59.777 INFO:teuthology.orchestra.run.smithi089.stdout:root 0 2024-09-13T02:57:59.777 INFO:teuthology.orchestra.run.smithi089.stdout:session_timeout 60 2024-09-13T02:57:59.777 INFO:teuthology.orchestra.run.smithi089.stdout:session_autoclose 300 2024-09-13T02:57:59.777 INFO:teuthology.orchestra.run.smithi089.stdout:max_file_size 1099511627776 2024-09-13T02:57:59.777 INFO:teuthology.orchestra.run.smithi089.stdout:max_xattr_size 65536 2024-09-13T02:57:59.777 INFO:teuthology.orchestra.run.smithi089.stdout:required_client_features {} 2024-09-13T02:57:59.778 INFO:teuthology.orchestra.run.smithi089.stdout:last_failure 0 2024-09-13T02:57:59.778 INFO:teuthology.orchestra.run.smithi089.stdout:last_failure_osd_epoch 44 2024-09-13T02:57:59.778 INFO:teuthology.orchestra.run.smithi089.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:57:59.778 INFO:teuthology.orchestra.run.smithi089.stdout:max_mds 2 2024-09-13T02:57:59.778 INFO:teuthology.orchestra.run.smithi089.stdout:in 0,1 2024-09-13T02:57:59.778 INFO:teuthology.orchestra.run.smithi089.stdout:up {0=14480,1=24257} 2024-09-13T02:57:59.778 INFO:teuthology.orchestra.run.smithi089.stdout:failed 2024-09-13T02:57:59.778 INFO:teuthology.orchestra.run.smithi089.stdout:damaged 2024-09-13T02:57:59.778 INFO:teuthology.orchestra.run.smithi089.stdout:stopped 2024-09-13T02:57:59.778 INFO:teuthology.orchestra.run.smithi089.stdout:data_pools [3] 2024-09-13T02:57:59.778 INFO:teuthology.orchestra.run.smithi089.stdout:metadata_pool 2 2024-09-13T02:57:59.778 INFO:teuthology.orchestra.run.smithi089.stdout:inline_data disabled 2024-09-13T02:57:59.778 INFO:teuthology.orchestra.run.smithi089.stdout:balancer 2024-09-13T02:57:59.779 INFO:teuthology.orchestra.run.smithi089.stdout:bal_rank_mask -1 2024-09-13T02:57:59.779 INFO:teuthology.orchestra.run.smithi089.stdout:standby_count_wanted 1 2024-09-13T02:57:59.779 INFO:teuthology.orchestra.run.smithi089.stdout:qdb_cluster leader: 14480 members: 14480,24257 2024-09-13T02:57:59.779 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi089.rarddb{0:14480} state up:active seq 6 export targets 1 join_fscid=1 addr [v2:172.21.15.89:6828/1561365213,v1:172.21.15.89:6829/1561365213] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:57:59.779 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi089.qjoitb{0:14488} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.89:6826/1464393547,v1:172.21.15.89:6827/1464393547] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:57:59.779 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi131.uasrkg{1:24257} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.131:6824/260493836,v1:172.21.15.131:6825/260493836] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:57:59.779 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi131.rbovzc{1:24265} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.131:6826/665579373,v1:172.21.15.131:6827/665579373] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:57:59.779 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:57:59.779 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:57:59.780 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 22 2024-09-13T02:57:59.780 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.776+0000 7f4b3f4c4640 1 -- 172.21.15.89:0/15410501 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f4b2406e660 msgr2=0x7f4b24070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:59.780 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.776+0000 7f4b3f4c4640 1 --2- 172.21.15.89:0/15410501 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f4b2406e660 0x7f4b24070b10 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f4b380663f0 tx=0x7f4b2c009040 comp rx=0 tx=0).stop 2024-09-13T02:57:59.780 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.776+0000 7f4b3f4c4640 1 -- 172.21.15.89:0/15410501 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b380ff720 msgr2=0x7f4b3810d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:59.781 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.776+0000 7f4b3f4c4640 1 --2- 172.21.15.89:0/15410501 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b380ff720 0x7f4b3810d6a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4b340094f0 tx=0x7f4b34009da0 comp rx=0 tx=0).stop 2024-09-13T02:57:59.781 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.776+0000 7f4b3f4c4640 1 -- 172.21.15.89:0/15410501 shutdown_connections 2024-09-13T02:57:59.781 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.776+0000 7f4b3f4c4640 1 --2- 172.21.15.89:0/15410501 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f4b2406e660 0x7f4b24070b10 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:59.781 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.776+0000 7f4b3f4c4640 1 --2- 172.21.15.89:0/15410501 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4b380ff720 0x7f4b3810d6a0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:59.781 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.776+0000 7f4b3f4c4640 1 --2- 172.21.15.89:0/15410501 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4b38066690 0x7f4b3810d160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:59.781 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.776+0000 7f4b3f4c4640 1 -- 172.21.15.89:0/15410501 >> 172.21.15.89:0/15410501 conn(0x7f4b380f6c10 msgr2=0x7f4b380f7030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:57:59.781 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.776+0000 7f4b3f4c4640 1 -- 172.21.15.89:0/15410501 shutdown_connections 2024-09-13T02:57:59.781 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.776+0000 7f4b3f4c4640 1 -- 172.21.15.89:0/15410501 wait complete. 2024-09-13T02:57:59.858 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.855+0000 7f1409457640 1 -- 172.21.15.89:0/4091011149 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f14040fd820 msgr2=0x7f14040fdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:59.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.855+0000 7f1409457640 1 --2- 172.21.15.89:0/4091011149 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f14040fd820 0x7f14040fdc90 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f13f80048d0 tx=0x7f13f8009da0 comp rx=0 tx=0).stop 2024-09-13T02:57:59.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.855+0000 7f1409457640 1 -- 172.21.15.89:0/4091011149 shutdown_connections 2024-09-13T02:57:59.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.855+0000 7f1409457640 1 --2- 172.21.15.89:0/4091011149 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f14040fd820 0x7f14040fdc90 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:59.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.855+0000 7f1409457640 1 --2- 172.21.15.89:0/4091011149 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f14040fc550 0x7f14040fc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:59.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.855+0000 7f1409457640 1 -- 172.21.15.89:0/4091011149 >> 172.21.15.89:0/4091011149 conn(0x7f14040f7d30 msgr2=0x7f14040fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:57:59.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.855+0000 7f1409457640 1 -- 172.21.15.89:0/4091011149 shutdown_connections 2024-09-13T02:57:59.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.855+0000 7f1409457640 1 -- 172.21.15.89:0/4091011149 wait complete. 2024-09-13T02:57:59.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.856+0000 7f1409457640 1 Processor -- start 2024-09-13T02:57:59.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.856+0000 7f1409457640 1 -- start start 2024-09-13T02:57:59.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.856+0000 7f1409457640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f14040fc550 0x7f140410f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:59.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.856+0000 7f1409457640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f14040fd820 0x7f140410f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:59.860 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.856+0000 7f1409457640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f140410fe70 con 0x7f14040fc550 2024-09-13T02:57:59.860 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.856+0000 7f1409457640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1404110690 con 0x7f14040fd820 2024-09-13T02:57:59.860 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.856+0000 7f1402ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f14040fc550 0x7f140410f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:59.860 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.857+0000 7f1402ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f14040fc550 0x7f140410f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:42332/0 (socket says 172.21.15.89:42332) 2024-09-13T02:57:59.860 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.857+0000 7f1402ffd640 1 -- 172.21.15.89:0/1464384873 learned_addr learned my addr 172.21.15.89:0/1464384873 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:57:59.860 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.857+0000 7f14027fc640 1 --2- 172.21.15.89:0/1464384873 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f14040fd820 0x7f140410f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:59.860 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.857+0000 7f1402ffd640 1 -- 172.21.15.89:0/1464384873 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f14040fd820 msgr2=0x7f140410f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:57:59.860 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.857+0000 7f1402ffd640 1 --2- 172.21.15.89:0/1464384873 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f14040fd820 0x7f140410f820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:57:59.860 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.857+0000 7f1402ffd640 1 -- 172.21.15.89:0/1464384873 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13f8005040 con 0x7f14040fc550 2024-09-13T02:57:59.860 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.857+0000 7f14027fc640 1 --2- 172.21.15.89:0/1464384873 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f14040fd820 0x7f140410f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T02:57:59.860 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.857+0000 7f1402ffd640 1 --2- 172.21.15.89:0/1464384873 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f14040fc550 0x7f140410f2e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f13f400c830 tx=0x7f13f4004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:57:59.860 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.857+0000 7f13eb7fe640 1 -- 172.21.15.89:0/1464384873 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f13f400a850 con 0x7f14040fc550 2024-09-13T02:57:59.861 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.857+0000 7f13eb7fe640 1 -- 172.21.15.89:0/1464384873 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f13f400ae50 con 0x7f14040fc550 2024-09-13T02:57:59.861 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.857+0000 7f1409457640 1 -- 172.21.15.89:0/1464384873 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1404110920 con 0x7f14040fc550 2024-09-13T02:57:59.861 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.857+0000 7f13eb7fe640 1 -- 172.21.15.89:0/1464384873 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f13f40113a0 con 0x7f14040fc550 2024-09-13T02:57:59.861 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.857+0000 7f1409457640 1 -- 172.21.15.89:0/1464384873 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1404110ec0 con 0x7f14040fc550 2024-09-13T02:57:59.862 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.858+0000 7f1409457640 1 -- 172.21.15.89:0/1464384873 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14040fb9b0 con 0x7f14040fc550 2024-09-13T02:57:59.862 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.859+0000 7f13eb7fe640 1 -- 172.21.15.89:0/1464384873 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 37) v1 ==== 92653+0+0 (secure 0 0 0) 0x7f13f4012400 con 0x7f14040fc550 2024-09-13T02:57:59.862 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.859+0000 7f13eb7fe640 1 --2- 172.21.15.89:0/1464384873 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f13ec06e660 0x7f13ec070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:57:59.862 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.859+0000 7f13eb7fe640 1 -- 172.21.15.89:0/1464384873 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f13f408e530 con 0x7f14040fc550 2024-09-13T02:57:59.862 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.859+0000 7f14027fc640 1 --2- 172.21.15.89:0/1464384873 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f13ec06e660 0x7f13ec070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:57:59.862 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.860+0000 7f14027fc640 1 --2- 172.21.15.89:0/1464384873 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f13ec06e660 0x7f13ec070b10 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f13f8007ac0 tx=0x7f13f8035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:57:59.865 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:57:59.864+0000 7f13eb7fe640 1 -- 172.21.15.89:0/1464384873 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f13f4057590 con 0x7f14040fc550 2024-09-13T02:58:00.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:00.050+0000 7f1409457640 1 -- 172.21.15.89:0/1464384873 --> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f14041111f0 con 0x7f13ec06e660 2024-09-13T02:58:00.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:00.051+0000 7f13eb7fe640 1 -- 172.21.15.89:0/1464384873 <== mgr.34104 v2:172.21.15.89:6800/1881577856 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f14041111f0 con 0x7f13ec06e660 2024-09-13T02:58:00.054 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-13T02:58:00.054 INFO:teuthology.orchestra.run.smithi089.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d", 2024-09-13T02:58:00.054 INFO:teuthology.orchestra.run.smithi089.stdout: "in_progress": true, 2024-09-13T02:58:00.054 INFO:teuthology.orchestra.run.smithi089.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T02:58:00.055 INFO:teuthology.orchestra.run.smithi089.stdout: "services_complete": [ 2024-09-13T02:58:00.055 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr", 2024-09-13T02:58:00.055 INFO:teuthology.orchestra.run.smithi089.stdout: "crash", 2024-09-13T02:58:00.055 INFO:teuthology.orchestra.run.smithi089.stdout: "mon" 2024-09-13T02:58:00.055 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-13T02:58:00.055 INFO:teuthology.orchestra.run.smithi089.stdout: "progress": "7/21 daemons upgraded", 2024-09-13T02:58:00.055 INFO:teuthology.orchestra.run.smithi089.stdout: "message": "Currently upgrading osd daemons", 2024-09-13T02:58:00.056 INFO:teuthology.orchestra.run.smithi089.stdout: "is_paused": false 2024-09-13T02:58:00.056 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-13T02:58:00.057 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:00.054+0000 7f1409457640 1 -- 172.21.15.89:0/1464384873 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f13ec06e660 msgr2=0x7f13ec070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:00.057 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:00.054+0000 7f1409457640 1 --2- 172.21.15.89:0/1464384873 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f13ec06e660 0x7f13ec070b10 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f13f8007ac0 tx=0x7f13f8035040 comp rx=0 tx=0).stop 2024-09-13T02:58:00.057 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:00.054+0000 7f1409457640 1 -- 172.21.15.89:0/1464384873 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f14040fc550 msgr2=0x7f140410f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:00.057 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:00.054+0000 7f1409457640 1 --2- 172.21.15.89:0/1464384873 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f14040fc550 0x7f140410f2e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f13f400c830 tx=0x7f13f4004430 comp rx=0 tx=0).stop 2024-09-13T02:58:00.058 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:00.054+0000 7f1409457640 1 -- 172.21.15.89:0/1464384873 shutdown_connections 2024-09-13T02:58:00.058 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:00.054+0000 7f1409457640 1 --2- 172.21.15.89:0/1464384873 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f13ec06e660 0x7f13ec070b10 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:00.058 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:00.054+0000 7f1409457640 1 --2- 172.21.15.89:0/1464384873 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f14040fd820 0x7f140410f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:00.058 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:00.054+0000 7f1409457640 1 --2- 172.21.15.89:0/1464384873 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f14040fc550 0x7f140410f2e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:00.058 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:00.054+0000 7f1409457640 1 -- 172.21.15.89:0/1464384873 >> 172.21.15.89:0/1464384873 conn(0x7f14040f7d30 msgr2=0x7f14040f9450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:58:00.058 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:00.054+0000 7f1409457640 1 -- 172.21.15.89:0/1464384873 shutdown_connections 2024-09-13T02:58:00.058 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:00.054+0000 7f1409457640 1 -- 172.21.15.89:0/1464384873 wait complete. 2024-09-13T02:58:00.133 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:00.131+0000 7fcf3bfb5640 1 -- 172.21.15.89:0/567174486 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf340fb480 msgr2=0x7fcf340fb890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:00.133 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:00.131+0000 7fcf3bfb5640 1 --2- 172.21.15.89:0/567174486 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf340fb480 0x7fcf340fb890 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fcf240048d0 tx=0x7fcf24009da0 comp rx=0 tx=0).stop 2024-09-13T02:58:00.133 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:00.131+0000 7fcf3bfb5640 1 -- 172.21.15.89:0/567174486 shutdown_connections 2024-09-13T02:58:00.133 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:00.131+0000 7fcf3bfb5640 1 --2- 172.21.15.89:0/567174486 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcf340fc750 0x7fcf340fcbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:00.134 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:00.131+0000 7fcf3bfb5640 1 --2- 172.21.15.89:0/567174486 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf340fb480 0x7fcf340fb890 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:00.134 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:00.132+0000 7fcf3bfb5640 1 -- 172.21.15.89:0/567174486 >> 172.21.15.89:0/567174486 conn(0x7fcf340f6c40 msgr2=0x7fcf340f9070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:58:00.134 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:00.132+0000 7fcf3bfb5640 1 -- 172.21.15.89:0/567174486 shutdown_connections 2024-09-13T02:58:00.134 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:00.132+0000 7fcf3bfb5640 1 -- 172.21.15.89:0/567174486 wait complete. 2024-09-13T02:58:00.134 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:59 smithi089 ceph-mon[91553]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:58:00.134 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:59 smithi089 ceph-mon[91553]: from='client.34200 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:58:00.134 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:59 smithi089 ceph-mon[91553]: from='client.? 172.21.15.89:0/422500914' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:00.134 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:59 smithi089 ceph-mon[91553]: pgmap v50: 65 pgs: 25 peering, 6 active+undersized, 3 active+undersized+degraded, 31 active+clean; 306 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 12/357 objects degraded (3.361%) 2024-09-13T02:58:00.134 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:57:59 smithi089 ceph-mon[91553]: from='client.? 172.21.15.89:0/15410501' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T02:58:00.136 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:00.132+0000 7fcf3bfb5640 1 Processor -- start 2024-09-13T02:58:00.136 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:00.132+0000 7fcf3bfb5640 1 -- start start 2024-09-13T02:58:00.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:00.132+0000 7fcf3bfb5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf340fb480 0x7fcf3410fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:00.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:00.132+0000 7fcf3bfb5640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcf340fc750 0x7fcf341123d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:00.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:00.132+0000 7fcf3bfb5640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf340667c0 con 0x7fcf340fb480 2024-09-13T02:58:00.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:00.132+0000 7fcf3bfb5640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf34066930 con 0x7fcf340fc750 2024-09-13T02:58:00.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:00.132+0000 7fcf39d51640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf340fb480 0x7fcf3410fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:58:00.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:00.132+0000 7fcf39d51640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf340fb480 0x7fcf3410fe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:42342/0 (socket says 172.21.15.89:42342) 2024-09-13T02:58:00.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:00.133+0000 7fcf39d51640 1 -- 172.21.15.89:0/4238002764 learned_addr learned my addr 172.21.15.89:0/4238002764 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:58:00.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:00.133+0000 7fcf39550640 1 --2- 172.21.15.89:0/4238002764 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcf340fc750 0x7fcf341123d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:58:00.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:00.133+0000 7fcf39d51640 1 -- 172.21.15.89:0/4238002764 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcf340fc750 msgr2=0x7fcf341123d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:00.138 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:00.133+0000 7fcf39d51640 1 --2- 172.21.15.89:0/4238002764 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcf340fc750 0x7fcf341123d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:00.138 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:00.133+0000 7fcf39d51640 1 -- 172.21.15.89:0/4238002764 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf24005040 con 0x7fcf340fb480 2024-09-13T02:58:00.138 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:00.133+0000 7fcf39550640 1 --2- 172.21.15.89:0/4238002764 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcf340fc750 0x7fcf341123d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T02:58:00.138 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:00.133+0000 7fcf39d51640 1 --2- 172.21.15.89:0/4238002764 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf340fb480 0x7fcf3410fe80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fcf24000c00 tx=0x7fcf24009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:58:00.138 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:00.133+0000 7fcf2a7fc640 1 -- 172.21.15.89:0/4238002764 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf24038070 con 0x7fcf340fb480 2024-09-13T02:58:00.138 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:00.133+0000 7fcf2a7fc640 1 -- 172.21.15.89:0/4238002764 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fcf2402ae90 con 0x7fcf340fb480 2024-09-13T02:58:00.138 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:00.133+0000 7fcf2a7fc640 1 -- 172.21.15.89:0/4238002764 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcf2403d440 con 0x7fcf340fb480 2024-09-13T02:58:00.138 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:00.133+0000 7fcf3bfb5640 1 -- 172.21.15.89:0/4238002764 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf34112970 con 0x7fcf340fb480 2024-09-13T02:58:00.138 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:00.133+0000 7fcf3bfb5640 1 -- 172.21.15.89:0/4238002764 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf34112e90 con 0x7fcf340fb480 2024-09-13T02:58:00.138 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:00.134+0000 7fcf3bfb5640 1 -- 172.21.15.89:0/4238002764 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf340fa8e0 con 0x7fcf340fb480 2024-09-13T02:58:00.138 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:00.135+0000 7fcf2a7fc640 1 -- 172.21.15.89:0/4238002764 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 37) v1 ==== 92653+0+0 (secure 0 0 0) 0x7fcf24030020 con 0x7fcf340fb480 2024-09-13T02:58:00.139 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:00.136+0000 7fcf2a7fc640 1 --2- 172.21.15.89:0/4238002764 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fcf2006e660 0x7fcf20070b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:00.139 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:00.136+0000 7fcf2a7fc640 1 -- 172.21.15.89:0/4238002764 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fcf240ae910 con 0x7fcf340fb480 2024-09-13T02:58:00.139 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:00.136+0000 7fcf39550640 1 --2- 172.21.15.89:0/4238002764 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fcf2006e660 0x7fcf20070b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:58:00.139 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:00.136+0000 7fcf39550640 1 --2- 172.21.15.89:0/4238002764 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fcf2006e660 0x7fcf20070b10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fcf30006fd0 tx=0x7fcf30008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:58:00.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:00.140+0000 7fcf2a7fc640 1 -- 172.21.15.89:0/4238002764 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fcf24077970 con 0x7fcf340fb480 2024-09-13T02:58:00.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:00.373+0000 7fcf3bfb5640 1 -- 172.21.15.89:0/4238002764 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fcf3404b720 con 0x7fcf340fb480 2024-09-13T02:58:00.376 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:00.374+0000 7fcf2a7fc640 1 -- 172.21.15.89:0/4238002764 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+349 (secure 0 0 0) 0x7fcf2407b030 con 0x7fcf340fb480 2024-09-13T02:58:00.376 INFO:teuthology.orchestra.run.smithi089.stdout:HEALTH_WARN Degraded data redundancy: 12/357 objects degraded (3.361%), 3 pgs degraded 2024-09-13T02:58:00.376 INFO:teuthology.orchestra.run.smithi089.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 12/357 objects degraded (3.361%), 3 pgs degraded 2024-09-13T02:58:00.376 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.13 is active+undersized+degraded, acting [4,2] 2024-09-13T02:58:00.376 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.19 is active+undersized+degraded, acting [4,2] 2024-09-13T02:58:00.376 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.1f is active+undersized+degraded, acting [3,4] 2024-09-13T02:58:00.377 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:00.376+0000 7fcf3bfb5640 1 -- 172.21.15.89:0/4238002764 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fcf2006e660 msgr2=0x7fcf20070b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:00.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:00.376+0000 7fcf3bfb5640 1 --2- 172.21.15.89:0/4238002764 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fcf2006e660 0x7fcf20070b10 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fcf30006fd0 tx=0x7fcf30008040 comp rx=0 tx=0).stop 2024-09-13T02:58:00.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:00.376+0000 7fcf3bfb5640 1 -- 172.21.15.89:0/4238002764 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf340fb480 msgr2=0x7fcf3410fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:00.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:00.376+0000 7fcf3bfb5640 1 --2- 172.21.15.89:0/4238002764 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf340fb480 0x7fcf3410fe80 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fcf24000c00 tx=0x7fcf24009da0 comp rx=0 tx=0).stop 2024-09-13T02:58:00.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:00.376+0000 7fcf3bfb5640 1 -- 172.21.15.89:0/4238002764 shutdown_connections 2024-09-13T02:58:00.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:00.376+0000 7fcf3bfb5640 1 --2- 172.21.15.89:0/4238002764 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fcf2006e660 0x7fcf20070b10 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:00.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:00.376+0000 7fcf3bfb5640 1 --2- 172.21.15.89:0/4238002764 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fcf340fc750 0x7fcf341123d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:00.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:00.376+0000 7fcf3bfb5640 1 --2- 172.21.15.89:0/4238002764 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fcf340fb480 0x7fcf3410fe80 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:00.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:00.376+0000 7fcf3bfb5640 1 -- 172.21.15.89:0/4238002764 >> 172.21.15.89:0/4238002764 conn(0x7fcf340f6c40 msgr2=0x7fcf340f8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:58:00.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:00.376+0000 7fcf3bfb5640 1 -- 172.21.15.89:0/4238002764 shutdown_connections 2024-09-13T02:58:00.378 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:00.376+0000 7fcf3bfb5640 1 -- 172.21.15.89:0/4238002764 wait complete. 2024-09-13T02:58:00.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:59 smithi131 ceph-mon[78839]: from='client.34196 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:58:00.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:59 smithi131 ceph-mon[78839]: from='client.34200 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:58:00.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:59 smithi131 ceph-mon[78839]: from='client.? 172.21.15.89:0/422500914' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:00.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:59 smithi131 ceph-mon[78839]: pgmap v50: 65 pgs: 25 peering, 6 active+undersized, 3 active+undersized+degraded, 31 active+clean; 306 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 12/357 objects degraded (3.361%) 2024-09-13T02:58:00.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:57:59 smithi131 ceph-mon[78839]: from='client.? 172.21.15.89:0/15410501' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T02:58:01.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:00 smithi089 ceph-mon[91553]: from='client.34212 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:58:01.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:00 smithi089 ceph-mon[91553]: from='client.? 172.21.15.89:0/4238002764' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T02:58:01.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:00 smithi131 ceph-mon[78839]: from='client.34212 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:58:01.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:00 smithi131 ceph-mon[78839]: from='client.? 172.21.15.89:0/4238002764' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T02:58:02.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:01 smithi089 ceph-mon[91553]: pgmap v51: 65 pgs: 65 active+clean; 306 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-13T02:58:02.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:01 smithi131 ceph-mon[78839]: pgmap v51: 65 pgs: 65 active+clean; 306 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-13T02:58:03.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:02 smithi089 ceph-mon[91553]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 12/357 objects degraded (3.361%), 3 pgs degraded) 2024-09-13T02:58:03.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:02 smithi089 ceph-mon[91553]: Cluster is now healthy 2024-09-13T02:58:03.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:02 smithi131 ceph-mon[78839]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 12/357 objects degraded (3.361%), 3 pgs degraded) 2024-09-13T02:58:03.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:02 smithi131 ceph-mon[78839]: Cluster is now healthy 2024-09-13T02:58:04.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:03 smithi089 ceph-mon[91553]: pgmap v52: 65 pgs: 65 active+clean; 306 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T02:58:04.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:03 smithi131 ceph-mon[78839]: pgmap v52: 65 pgs: 65 active+clean; 306 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T02:58:06.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:05 smithi089 ceph-mon[91553]: fsmap cephfs:2 {0=cephfs.smithi089.rarddb=up:active,1=cephfs.smithi131.uasrkg=up:active} 2 up:standby-replay 2024-09-13T02:58:06.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:05 smithi089 ceph-mon[91553]: pgmap v53: 65 pgs: 65 active+clean; 306 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T02:58:06.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:05 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:58:06.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:05 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:58:06.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:05 smithi131 ceph-mon[78839]: fsmap cephfs:2 {0=cephfs.smithi089.rarddb=up:active,1=cephfs.smithi131.uasrkg=up:active} 2 up:standby-replay 2024-09-13T02:58:06.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:05 smithi131 ceph-mon[78839]: pgmap v53: 65 pgs: 65 active+clean; 306 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T02:58:06.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:05 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:58:06.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:05 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:58:08.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:08 smithi131 ceph-mon[78839]: pgmap v54: 65 pgs: 65 active+clean; 306 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 2.1 KiB/s rd, 579 B/s wr, 4 op/s 2024-09-13T02:58:08.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:08 smithi131 ceph-mon[78839]: mgrmap e38: smithi089.guohvs(active, since 92s), standbys: smithi131.aunbqd 2024-09-13T02:58:09.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:08 smithi089 ceph-mon[91553]: pgmap v54: 65 pgs: 65 active+clean; 306 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 2.1 KiB/s rd, 579 B/s wr, 4 op/s 2024-09-13T02:58:09.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:08 smithi089 ceph-mon[91553]: mgrmap e38: smithi089.guohvs(active, since 92s), standbys: smithi131.aunbqd 2024-09-13T02:58:10.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:10 smithi131 ceph-mon[78839]: pgmap v55: 65 pgs: 65 active+clean; 306 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.8 KiB/s rd, 511 B/s wr, 3 op/s 2024-09-13T02:58:10.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:10 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:58:11.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:10 smithi089 ceph-mon[91553]: pgmap v55: 65 pgs: 65 active+clean; 306 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.8 KiB/s rd, 511 B/s wr, 3 op/s 2024-09-13T02:58:11.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:10 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:58:11.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:11 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-13T02:58:11.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:11 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-13T02:58:12.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:12 smithi131 ceph-mon[78839]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-13T02:58:12.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:12 smithi131 ceph-mon[78839]: Upgrade: osd.1 is safe to restart 2024-09-13T02:58:12.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:12 smithi131 ceph-mon[78839]: pgmap v56: 65 pgs: 65 active+clean; 306 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 2.7 KiB/s rd, 511 B/s wr, 5 op/s 2024-09-13T02:58:13.010 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:12 smithi089 ceph-mon[91553]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-09-13T02:58:13.010 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:12 smithi089 ceph-mon[91553]: Upgrade: osd.1 is safe to restart 2024-09-13T02:58:13.010 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:12 smithi089 ceph-mon[91553]: pgmap v56: 65 pgs: 65 active+clean; 306 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 2.7 KiB/s rd, 511 B/s wr, 5 op/s 2024-09-13T02:58:13.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:13 smithi131 ceph-mon[78839]: Upgrade: Updating osd.1 2024-09-13T02:58:13.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:13 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:58:13.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:13 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-13T02:58:13.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:13 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:58:13.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:13 smithi131 ceph-mon[78839]: Deploying daemon osd.1 on smithi089 2024-09-13T02:58:13.986 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:13 smithi089 ceph-mon[91553]: Upgrade: Updating osd.1 2024-09-13T02:58:13.986 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:13 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:58:13.986 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:13 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-13T02:58:13.987 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:13 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:58:13.987 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:13 smithi089 ceph-mon[91553]: Deploying daemon osd.1 on smithi089 2024-09-13T02:58:14.929 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:14 smithi089 ceph-mon[91553]: pgmap v57: 65 pgs: 65 active+clean; 306 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.8 KiB/s rd, 511 B/s wr, 3 op/s 2024-09-13T02:58:14.933 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:14 smithi131 ceph-mon[78839]: pgmap v57: 65 pgs: 65 active+clean; 306 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.8 KiB/s rd, 511 B/s wr, 3 op/s 2024-09-13T02:58:15.809 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 02:58:15 smithi089 systemd[1]: Stopping Ceph osd.1 for 12cdb164-717a-11ef-bceb-c7b262605968... 2024-09-13T02:58:16.285 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 02:58:15 smithi089 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-1[53258]: 2024-09-13T02:58:15.807+0000 7f30706e6640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T02:58:16.285 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 02:58:15 smithi089 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-1[53258]: 2024-09-13T02:58:15.807+0000 7f30706e6640 -1 osd.1 52 *** Got signal Terminated *** 2024-09-13T02:58:16.285 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 02:58:15 smithi089 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-1[53258]: 2024-09-13T02:58:15.807+0000 7f30706e6640 -1 osd.1 52 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T02:58:16.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:16 smithi131 ceph-mon[78839]: pgmap v58: 65 pgs: 65 active+clean; 306 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.8 KiB/s rd, 511 B/s wr, 3 op/s 2024-09-13T02:58:16.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:16 smithi131 ceph-mon[78839]: osd.1 marked itself down and dead 2024-09-13T02:58:17.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:16 smithi089 ceph-mon[91553]: pgmap v58: 65 pgs: 65 active+clean; 306 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.8 KiB/s rd, 511 B/s wr, 3 op/s 2024-09-13T02:58:17.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:16 smithi089 ceph-mon[91553]: osd.1 marked itself down and dead 2024-09-13T02:58:17.326 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 02:58:17 smithi089 podman[104667]: 2024-09-13 02:58:17.046103764 +0000 UTC m=+1.363597383 container died af6538730e422df919da5dc2e8f992e35b2eb856f8239c8c1427428d780ff28f (image=quay.ceph.io/ceph-ci/ceph@sha256:20745bd452f31fe48c67c092910f9b2c550f9dc62d239ff3e2953415a85590be, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-1, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, RELEASE=quincy-bbdadfa, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-13T02:58:17.653 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 02:58:17 smithi089 podman[104667]: 2024-09-13 02:58:17.407780815 +0000 UTC m=+1.725274475 container cleanup af6538730e422df919da5dc2e8f992e35b2eb856f8239c8c1427428d780ff28f (image=quay.ceph.io/ceph-ci/ceph@sha256:20745bd452f31fe48c67c092910f9b2c550f9dc62d239ff3e2953415a85590be, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-1, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=quincy-bbdadfa, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-13T02:58:17.653 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 02:58:17 smithi089 bash[104667]: ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-1 2024-09-13T02:58:17.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:17 smithi131 ceph-mon[78839]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T02:58:17.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:17 smithi131 ceph-mon[78839]: osdmap e53: 6 total, 5 up, 6 in 2024-09-13T02:58:18.002 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:17 smithi089 ceph-mon[91553]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T02:58:18.003 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:17 smithi089 ceph-mon[91553]: osdmap e53: 6 total, 5 up, 6 in 2024-09-13T02:58:18.003 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 02:58:17 smithi089 podman[104685]: 2024-09-13 02:58:17.701283011 +0000 UTC m=+0.652146102 container remove af6538730e422df919da5dc2e8f992e35b2eb856f8239c8c1427428d780ff28f (image=quay.ceph.io/ceph-ci/ceph@sha256:20745bd452f31fe48c67c092910f9b2c550f9dc62d239ff3e2953415a85590be, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-1, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=quincy-bbdadfa, GIT_BRANCH=HEAD) 2024-09-13T02:58:18.285 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 02:58:18 smithi089 podman[104772]: 2024-09-13 02:58:18.002150332 +0000 UTC m=+0.094555894 container create 5d05b13e8e2233d904130f5d457fddcfcb80bab9f0ee4b560a72750952a41aa0 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-1-deactivate, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-7741f7f, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS) 2024-09-13T02:58:18.285 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 02:58:18 smithi089 podman[104772]: 2024-09-13 02:58:17.9232977 +0000 UTC m=+0.015703275 image pull 19dc8d6597273a47b0b4862f1d0e037b0157b908a02acd63baceec3ee94fbd6c quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d 2024-09-13T02:58:18.285 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 02:58:18 smithi089 podman[104772]: 2024-09-13 02:58:18.238073813 +0000 UTC m=+0.330479376 container init 5d05b13e8e2233d904130f5d457fddcfcb80bab9f0ee4b560a72750952a41aa0 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-7741f7f, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-13T02:58:18.285 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 02:58:18 smithi089 podman[104772]: 2024-09-13 02:58:18.241428938 +0000 UTC m=+0.333834506 container start 5d05b13e8e2233d904130f5d457fddcfcb80bab9f0ee4b560a72750952a41aa0 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-1-deactivate, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-7741f7f, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD) 2024-09-13T02:58:18.660 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 02:58:18 smithi089 podman[104772]: 2024-09-13 02:58:18.312954713 +0000 UTC m=+0.405360276 container attach 5d05b13e8e2233d904130f5d457fddcfcb80bab9f0ee4b560a72750952a41aa0 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-1-deactivate, RELEASE=squid-7741f7f, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-13T02:58:18.660 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 02:58:18 smithi089 podman[104772]: 2024-09-13 02:58:18.433802634 +0000 UTC m=+0.526208215 container died 5d05b13e8e2233d904130f5d457fddcfcb80bab9f0ee4b560a72750952a41aa0 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-7741f7f, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T02:58:18.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:18 smithi131 ceph-mon[78839]: pgmap v60: 65 pgs: 12 stale+active+clean, 53 active+clean; 306 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-13T02:58:18.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:18 smithi131 ceph-mon[78839]: osdmap e54: 6 total, 5 up, 6 in 2024-09-13T02:58:19.017 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:18 smithi089 ceph-mon[91553]: pgmap v60: 65 pgs: 12 stale+active+clean, 53 active+clean; 306 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-13T02:58:19.017 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:18 smithi089 ceph-mon[91553]: osdmap e54: 6 total, 5 up, 6 in 2024-09-13T02:58:19.285 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 02:58:19 smithi089 podman[104795]: 2024-09-13 02:58:19.016709648 +0000 UTC m=+0.576218506 container remove 5d05b13e8e2233d904130f5d457fddcfcb80bab9f0ee4b560a72750952a41aa0 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-7741f7f, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-13T02:58:19.286 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 02:58:19 smithi089 systemd[1]: ceph-12cdb164-717a-11ef-bceb-c7b262605968@osd.1.service: Deactivated successfully. 2024-09-13T02:58:19.286 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 02:58:19 smithi089 systemd[1]: Stopped Ceph osd.1 for 12cdb164-717a-11ef-bceb-c7b262605968. 2024-09-13T02:58:19.286 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 02:58:19 smithi089 systemd[1]: ceph-12cdb164-717a-11ef-bceb-c7b262605968@osd.1.service: Consumed 57.835s CPU time. 2024-09-13T02:58:19.286 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 02:58:19 smithi089 systemd[1]: Starting Ceph osd.1 for 12cdb164-717a-11ef-bceb-c7b262605968... 2024-09-13T02:58:19.746 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 02:58:19 smithi089 podman[104893]: 2024-09-13 02:58:19.357390753 +0000 UTC m=+0.015768531 image pull 19dc8d6597273a47b0b4862f1d0e037b0157b908a02acd63baceec3ee94fbd6c quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d 2024-09-13T02:58:19.746 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 02:58:19 smithi089 podman[104893]: 2024-09-13 02:58:19.459569527 +0000 UTC m=+0.117947294 container create c2c349ed643f24b01b1f5b178c9a2415aae84e2916c2afaffe8b6ee378c86b8f (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-1-activate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-7741f7f, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-13T02:58:19.746 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 02:58:19 smithi089 podman[104893]: 2024-09-13 02:58:19.670435435 +0000 UTC m=+0.328813208 container init c2c349ed643f24b01b1f5b178c9a2415aae84e2916c2afaffe8b6ee378c86b8f (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-1-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=squid-7741f7f, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-09-13T02:58:19.746 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 02:58:19 smithi089 podman[104893]: 2024-09-13 02:58:19.67389307 +0000 UTC m=+0.332270841 container start c2c349ed643f24b01b1f5b178c9a2415aae84e2916c2afaffe8b6ee378c86b8f (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-1-activate, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-7741f7f, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T02:58:19.746 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 02:58:19 smithi089 podman[104893]: 2024-09-13 02:58:19.745212538 +0000 UTC m=+0.403590319 container attach c2c349ed643f24b01b1f5b178c9a2415aae84e2916c2afaffe8b6ee378c86b8f (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-1-activate, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-7741f7f, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-13T02:58:20.035 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 02:58:19 smithi089 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-1-activate[104909]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T02:58:20.035 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 02:58:19 smithi089 bash[104893]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T02:58:20.035 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 02:58:19 smithi089 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-1-activate[104909]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T02:58:20.035 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 02:58:19 smithi089 bash[104893]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T02:58:20.824 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:20 smithi089 ceph-mon[91553]: pgmap v62: 65 pgs: 12 stale+active+clean, 53 active+clean; 306 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T02:58:20.824 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:20 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:58:20.824 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:20 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:58:20.824 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 02:58:20 smithi089 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-1-activate[104909]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-13T02:58:20.824 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 02:58:20 smithi089 bash[104893]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-13T02:58:20.825 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 02:58:20 smithi089 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-1-activate[104909]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-13T02:58:20.825 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 02:58:20 smithi089 bash[104893]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-13T02:58:20.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:20 smithi131 ceph-mon[78839]: pgmap v62: 65 pgs: 12 stale+active+clean, 53 active+clean; 306 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T02:58:20.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:20 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:58:20.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:20 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:58:21.233 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 02:58:20 smithi089 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-1-activate[104909]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-13T02:58:21.233 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 02:58:20 smithi089 bash[104893]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-13T02:58:21.233 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 02:58:20 smithi089 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-1-activate[104909]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-13T02:58:21.233 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 02:58:20 smithi089 bash[104893]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-13T02:58:21.233 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 02:58:20 smithi089 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-1-activate[104909]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-09-13T02:58:21.233 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 02:58:20 smithi089 bash[104893]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-09-13T02:58:21.233 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 02:58:20 smithi089 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-1-activate[104909]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-13T02:58:21.233 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 02:58:20 smithi089 bash[104893]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-13T02:58:21.233 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 02:58:20 smithi089 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-1-activate[104909]: --> ceph-volume raw activate successful for osd ID: 1 2024-09-13T02:58:21.234 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 02:58:20 smithi089 bash[104893]: --> ceph-volume raw activate successful for osd ID: 1 2024-09-13T02:58:21.234 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 02:58:20 smithi089 podman[104893]: 2024-09-13 02:58:20.851707085 +0000 UTC m=+1.510084854 container died c2c349ed643f24b01b1f5b178c9a2415aae84e2916c2afaffe8b6ee378c86b8f (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-1-activate, RELEASE=squid-7741f7f, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T02:58:21.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:21 smithi089 ceph-mon[91553]: Health check failed: Degraded data redundancy: 55/357 objects degraded (15.406%), 16 pgs degraded (PG_DEGRADED) 2024-09-13T02:58:21.785 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 02:58:21 smithi089 podman[105058]: 2024-09-13 02:58:21.524202692 +0000 UTC m=+0.666701975 container remove c2c349ed643f24b01b1f5b178c9a2415aae84e2916c2afaffe8b6ee378c86b8f (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-1-activate, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-7741f7f, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS) 2024-09-13T02:58:21.785 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 02:58:21 smithi089 podman[105118]: 2024-09-13 02:58:21.635610113 +0000 UTC m=+0.015943094 image pull 19dc8d6597273a47b0b4862f1d0e037b0157b908a02acd63baceec3ee94fbd6c quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d 2024-09-13T02:58:21.785 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 02:58:21 smithi089 podman[105118]: 2024-09-13 02:58:21.759910361 +0000 UTC m=+0.140243327 container create e174144d9633cbada52f87617925c09773941c4bedf8e297fee80a37c48021a7 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-1, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-7741f7f, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True) 2024-09-13T02:58:22.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:21 smithi131 ceph-mon[78839]: Health check failed: Degraded data redundancy: 55/357 objects degraded (15.406%), 16 pgs degraded (PG_DEGRADED) 2024-09-13T02:58:22.285 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 02:58:21 smithi089 podman[105118]: 2024-09-13 02:58:21.95315059 +0000 UTC m=+0.333483573 container init e174144d9633cbada52f87617925c09773941c4bedf8e297fee80a37c48021a7 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-1, CEPH_POINT_RELEASE=, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-7741f7f, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T02:58:22.285 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 02:58:21 smithi089 podman[105118]: 2024-09-13 02:58:21.956721709 +0000 UTC m=+0.337054676 container start e174144d9633cbada52f87617925c09773941c4bedf8e297fee80a37c48021a7 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-1, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=squid-7741f7f, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T02:58:22.285 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 02:58:21 smithi089 ceph-osd[105137]: -- 172.21.15.89:0/2223838198 <== mon.0 v2:172.21.15.89:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5611545dc1e0 con 0x561154572000 2024-09-13T02:58:22.285 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 02:58:22 smithi089 bash[105118]: e174144d9633cbada52f87617925c09773941c4bedf8e297fee80a37c48021a7 2024-09-13T02:58:22.286 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 02:58:22 smithi089 systemd[1]: Started Ceph osd.1 for 12cdb164-717a-11ef-bceb-c7b262605968. 2024-09-13T02:58:22.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:22 smithi131 ceph-mon[78839]: pgmap v63: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 306 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 55/357 objects degraded (15.406%) 2024-09-13T02:58:22.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:22 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:58:22.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:22 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:58:22.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:22 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:58:23.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:22 smithi089 ceph-mon[91553]: pgmap v63: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 306 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 55/357 objects degraded (15.406%) 2024-09-13T02:58:23.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:22 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:58:23.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:22 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:58:23.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:22 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:58:24.113 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 02:58:23 smithi089 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-1[105133]: 2024-09-13T02:58:23.843+0000 7f3fc0ece640 -1 Falling back to public interface 2024-09-13T02:58:24.981 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:24 smithi089 ceph-mon[91553]: pgmap v64: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 306 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 55/357 objects degraded (15.406%) 2024-09-13T02:58:25.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:24 smithi131 ceph-mon[78839]: pgmap v64: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 306 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 55/357 objects degraded (15.406%) 2024-09-13T02:58:27.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:26 smithi089 ceph-mon[91553]: pgmap v65: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 306 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 55/357 objects degraded (15.406%) 2024-09-13T02:58:27.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:26 smithi131 ceph-mon[78839]: pgmap v65: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 306 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 55/357 objects degraded (15.406%) 2024-09-13T02:58:28.117 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:27 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:58:28.117 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:27 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:58:28.118 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:27 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:58:28.118 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:27 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:58:28.118 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:27 smithi089 ceph-mon[91553]: pgmap v66: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 306 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 55/357 objects degraded (15.406%) 2024-09-13T02:58:28.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:27 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:58:28.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:27 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:58:28.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:27 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:58:28.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:27 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:58:28.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:27 smithi131 ceph-mon[78839]: pgmap v66: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 306 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 55/357 objects degraded (15.406%) 2024-09-13T02:58:30.182 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 02:58:29 smithi089 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-1[105133]: 2024-09-13T02:58:29.926+0000 7f3fc0ece640 -1 osd.1 52 log_to_monitors true 2024-09-13T02:58:30.462 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:30.459+0000 7f975fae1640 1 -- 172.21.15.89:0/239181667 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97580fe4f0 msgr2=0x7f97580fa650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:30.462 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:30.459+0000 7f975fae1640 1 --2- 172.21.15.89:0/239181667 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97580fe4f0 0x7f97580fa650 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f97480048d0 tx=0x7f9748009da0 comp rx=0 tx=0).stop 2024-09-13T02:58:30.462 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:30.459+0000 7f975fae1640 1 -- 172.21.15.89:0/239181667 shutdown_connections 2024-09-13T02:58:30.463 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:30.459+0000 7f975fae1640 1 --2- 172.21.15.89:0/239181667 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97580fe4f0 0x7f97580fa650 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:30.463 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:30.459+0000 7f975fae1640 1 --2- 172.21.15.89:0/239181667 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f97580fdba0 0x7f97580fdfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:30.463 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:30.459+0000 7f975fae1640 1 -- 172.21.15.89:0/239181667 >> 172.21.15.89:0/239181667 conn(0x7f97580f63a0 msgr2=0x7f97580f87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:58:30.463 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:30.459+0000 7f975fae1640 1 -- 172.21.15.89:0/239181667 shutdown_connections 2024-09-13T02:58:30.463 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:30.459+0000 7f975fae1640 1 -- 172.21.15.89:0/239181667 wait complete. 2024-09-13T02:58:30.463 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:30.460+0000 7f975fae1640 1 Processor -- start 2024-09-13T02:58:30.463 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:30.460+0000 7f975fae1640 1 -- start start 2024-09-13T02:58:30.463 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:30.460+0000 7f975fae1640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f97580fdba0 0x7f975810d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:30.463 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:30.460+0000 7f975fae1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97580fe4f0 0x7f975810d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:30.463 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:30.460+0000 7f975fae1640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f975810dc70 con 0x7f97580fe4f0 2024-09-13T02:58:30.463 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:30.460+0000 7f975fae1640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f975810e440 con 0x7f97580fdba0 2024-09-13T02:58:30.463 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:30.460+0000 7f975d07c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97580fe4f0 0x7f975810d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:58:30.463 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:30.460+0000 7f975d07c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97580fe4f0 0x7f975810d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:51086/0 (socket says 172.21.15.89:51086) 2024-09-13T02:58:30.463 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:30.460+0000 7f975d07c640 1 -- 172.21.15.89:0/2198780114 learned_addr learned my addr 172.21.15.89:0/2198780114 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:58:30.464 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:30.460+0000 7f975d07c640 1 -- 172.21.15.89:0/2198780114 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f97580fdba0 msgr2=0x7f975810d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:30.464 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:30.460+0000 7f975d07c640 1 --2- 172.21.15.89:0/2198780114 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f97580fdba0 0x7f975810d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:30.464 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:30.460+0000 7f975d07c640 1 -- 172.21.15.89:0/2198780114 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9748005040 con 0x7f97580fe4f0 2024-09-13T02:58:30.464 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:30.460+0000 7f975d07c640 1 --2- 172.21.15.89:0/2198780114 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97580fe4f0 0x7f975810d620 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f97480048a0 tx=0x7f9748009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:58:30.464 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:30.461+0000 7f974e7fc640 1 -- 172.21.15.89:0/2198780114 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9748038070 con 0x7f97580fe4f0 2024-09-13T02:58:30.464 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:30.461+0000 7f975fae1640 1 -- 172.21.15.89:0/2198780114 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f975810e670 con 0x7f97580fe4f0 2024-09-13T02:58:30.464 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:30.461+0000 7f974e7fc640 1 -- 172.21.15.89:0/2198780114 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f974802abd0 con 0x7f97580fe4f0 2024-09-13T02:58:30.464 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:30.461+0000 7f975fae1640 1 -- 172.21.15.89:0/2198780114 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f975810ec10 con 0x7f97580fe4f0 2024-09-13T02:58:30.464 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:30.461+0000 7f974e7fc640 1 -- 172.21.15.89:0/2198780114 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9748033640 con 0x7f97580fe4f0 2024-09-13T02:58:30.465 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:30.462+0000 7f975fae1640 1 -- 172.21.15.89:0/2198780114 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97580fa040 con 0x7f97580fe4f0 2024-09-13T02:58:30.465 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:30.462+0000 7f974e7fc640 1 -- 172.21.15.89:0/2198780114 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f9748030020 con 0x7f97580fe4f0 2024-09-13T02:58:30.465 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:30.463+0000 7f974e7fc640 1 --2- 172.21.15.89:0/2198780114 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f974406e530 0x7f97440709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:30.465 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:30.463+0000 7f974e7fc640 1 -- 172.21.15.89:0/2198780114 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f97480ae520 con 0x7f97580fe4f0 2024-09-13T02:58:30.465 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:30.463+0000 7f975d87d640 1 --2- 172.21.15.89:0/2198780114 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f974406e530 0x7f97440709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:58:30.465 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:30.463+0000 7f975d87d640 1 --2- 172.21.15.89:0/2198780114 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f974406e530 0x7f97440709e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9754004a50 tx=0x7f9754007cb0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:58:30.468 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:30.467+0000 7f974e7fc640 1 -- 172.21.15.89:0/2198780114 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f9748077610 con 0x7f97580fe4f0 2024-09-13T02:58:30.660 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:30.659+0000 7f975fae1640 1 -- 172.21.15.89:0/2198780114 --> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f975810eef0 con 0x7f974406e530 2024-09-13T02:58:30.661 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:30.660+0000 7f974e7fc640 1 -- 172.21.15.89:0/2198780114 <== mgr.34104 v2:172.21.15.89:6800/1881577856 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f975810eef0 con 0x7f974406e530 2024-09-13T02:58:30.663 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:30.662+0000 7f975fae1640 1 -- 172.21.15.89:0/2198780114 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f974406e530 msgr2=0x7f97440709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:30.663 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:30.662+0000 7f975fae1640 1 --2- 172.21.15.89:0/2198780114 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f974406e530 0x7f97440709e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9754004a50 tx=0x7f9754007cb0 comp rx=0 tx=0).stop 2024-09-13T02:58:30.663 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:30.662+0000 7f975fae1640 1 -- 172.21.15.89:0/2198780114 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97580fe4f0 msgr2=0x7f975810d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:30.664 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:30.662+0000 7f975fae1640 1 --2- 172.21.15.89:0/2198780114 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97580fe4f0 0x7f975810d620 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f97480048a0 tx=0x7f9748009da0 comp rx=0 tx=0).stop 2024-09-13T02:58:30.664 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:30.662+0000 7f975fae1640 1 -- 172.21.15.89:0/2198780114 shutdown_connections 2024-09-13T02:58:30.664 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:30.662+0000 7f975fae1640 1 --2- 172.21.15.89:0/2198780114 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f974406e530 0x7f97440709e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:30.664 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:30.662+0000 7f975fae1640 1 --2- 172.21.15.89:0/2198780114 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f97580fe4f0 0x7f975810d620 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:30.664 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:30.662+0000 7f975fae1640 1 --2- 172.21.15.89:0/2198780114 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f97580fdba0 0x7f975810d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:30.664 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:30.662+0000 7f975fae1640 1 -- 172.21.15.89:0/2198780114 >> 172.21.15.89:0/2198780114 conn(0x7f97580f63a0 msgr2=0x7f97580f7b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:58:30.664 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:30.662+0000 7f975fae1640 1 -- 172.21.15.89:0/2198780114 shutdown_connections 2024-09-13T02:58:30.664 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:30.662+0000 7f975fae1640 1 -- 172.21.15.89:0/2198780114 wait complete. 2024-09-13T02:58:30.672 INFO:teuthology.orchestra.run.smithi089.stdout:true 2024-09-13T02:58:30.744 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:30.743+0000 7faec259f640 1 -- 172.21.15.89:0/1715621352 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faebc0fb440 msgr2=0x7faebc0fb850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:30.744 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:30.743+0000 7faec259f640 1 --2- 172.21.15.89:0/1715621352 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faebc0fb440 0x7faebc0fb850 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7faeac0048d0 tx=0x7faeac009da0 comp rx=0 tx=0).stop 2024-09-13T02:58:30.744 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:30.743+0000 7faec259f640 1 -- 172.21.15.89:0/1715621352 shutdown_connections 2024-09-13T02:58:30.745 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:30.743+0000 7faec259f640 1 --2- 172.21.15.89:0/1715621352 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faebc0fc710 0x7faebc0fcb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:30.745 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:30.743+0000 7faec259f640 1 --2- 172.21.15.89:0/1715621352 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faebc0fb440 0x7faebc0fb850 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:30.745 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:30.743+0000 7faec259f640 1 -- 172.21.15.89:0/1715621352 >> 172.21.15.89:0/1715621352 conn(0x7faebc0f6c00 msgr2=0x7faebc0f9030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:58:30.745 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 02:58:30 smithi089 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-1[105133]: 2024-09-13T02:58:30.628+0000 7f3fb8c68640 -1 osd.1 52 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T02:58:30.745 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:30 smithi089 ceph-mon[91553]: pgmap v67: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 306 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 55/357 objects degraded (15.406%) 2024-09-13T02:58:30.746 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:30 smithi089 ceph-mon[91553]: from='osd.1 [v2:172.21.15.89:6810/3812497008,v1:172.21.15.89:6811/3812497008]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-13T02:58:30.747 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:30.743+0000 7faec259f640 1 -- 172.21.15.89:0/1715621352 shutdown_connections 2024-09-13T02:58:30.747 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:30.743+0000 7faec259f640 1 -- 172.21.15.89:0/1715621352 wait complete. 2024-09-13T02:58:30.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:30.744+0000 7faec259f640 1 Processor -- start 2024-09-13T02:58:30.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:30.744+0000 7faec259f640 1 -- start start 2024-09-13T02:58:30.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:30.744+0000 7faec259f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faebc0fb440 0x7faebc10d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:30.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:30.744+0000 7faec259f640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faebc0fc710 0x7faebc10d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:30.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:30.744+0000 7faec259f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faebc10dbf0 con 0x7faebc0fb440 2024-09-13T02:58:30.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:30.744+0000 7faec259f640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faebc10e410 con 0x7faebc0fc710 2024-09-13T02:58:30.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:30.744+0000 7faebbfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faebc0fb440 0x7faebc10d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:58:30.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:30.744+0000 7faebbfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faebc0fb440 0x7faebc10d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:51112/0 (socket says 172.21.15.89:51112) 2024-09-13T02:58:30.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:30.744+0000 7faebbfff640 1 -- 172.21.15.89:0/1903927425 learned_addr learned my addr 172.21.15.89:0/1903927425 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:58:30.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:30.744+0000 7faeb3fff640 1 --2- 172.21.15.89:0/1903927425 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faebc0fc710 0x7faebc10d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:58:30.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:30.744+0000 7faebbfff640 1 -- 172.21.15.89:0/1903927425 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faebc0fc710 msgr2=0x7faebc10d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:30.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:30.744+0000 7faebbfff640 1 --2- 172.21.15.89:0/1903927425 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faebc0fc710 0x7faebc10d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:30.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:30.744+0000 7faebbfff640 1 -- 172.21.15.89:0/1903927425 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeac005040 con 0x7faebc0fb440 2024-09-13T02:58:30.749 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:30.744+0000 7faeb3fff640 1 --2- 172.21.15.89:0/1903927425 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faebc0fc710 0x7faebc10d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T02:58:30.749 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:30.744+0000 7faebbfff640 1 --2- 172.21.15.89:0/1903927425 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faebc0fb440 0x7faebc10d060 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7faeac0043d0 tx=0x7faeac009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:58:30.749 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:30.745+0000 7faeb97fa640 1 -- 172.21.15.89:0/1903927425 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faeac038070 con 0x7faebc0fb440 2024-09-13T02:58:30.749 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:30.745+0000 7faeb97fa640 1 -- 172.21.15.89:0/1903927425 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7faeac02ae90 con 0x7faebc0fb440 2024-09-13T02:58:30.749 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:30.745+0000 7faec259f640 1 -- 172.21.15.89:0/1903927425 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faebc10e640 con 0x7faebc0fb440 2024-09-13T02:58:30.749 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:30.745+0000 7faeb97fa640 1 -- 172.21.15.89:0/1903927425 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faeac03e670 con 0x7faebc0fb440 2024-09-13T02:58:30.749 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:30.745+0000 7faec259f640 1 -- 172.21.15.89:0/1903927425 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faebc10ebe0 con 0x7faebc0fb440 2024-09-13T02:58:30.749 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:30.746+0000 7faec259f640 1 -- 172.21.15.89:0/1903927425 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faebc0fa8a0 con 0x7faebc0fb440 2024-09-13T02:58:30.749 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:30.746+0000 7faeb97fa640 1 -- 172.21.15.89:0/1903927425 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7faeac030020 con 0x7faebc0fb440 2024-09-13T02:58:30.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:30.747+0000 7faeb97fa640 1 --2- 172.21.15.89:0/1903927425 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7faea806e530 0x7faea80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:30.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:30.747+0000 7faeb97fa640 1 -- 172.21.15.89:0/1903927425 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6496+0+0 (secure 0 0 0) 0x7faeac0ae330 con 0x7faebc0fb440 2024-09-13T02:58:30.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:30.747+0000 7faeb3fff640 1 --2- 172.21.15.89:0/1903927425 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7faea806e530 0x7faea80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:58:30.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:30.747+0000 7faeb3fff640 1 --2- 172.21.15.89:0/1903927425 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7faea806e530 0x7faea80709e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7faebc10ce10 tx=0x7faea400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:58:30.752 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:30.751+0000 7faeb97fa640 1 -- 172.21.15.89:0/1903927425 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7faeac0774a0 con 0x7faebc0fb440 2024-09-13T02:58:30.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:30 smithi131 ceph-mon[78839]: pgmap v67: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 306 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 55/357 objects degraded (15.406%) 2024-09-13T02:58:30.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:30 smithi131 ceph-mon[78839]: from='osd.1 [v2:172.21.15.89:6810/3812497008,v1:172.21.15.89:6811/3812497008]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-13T02:58:30.944 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:30.942+0000 7faec259f640 1 -- 172.21.15.89:0/1903927425 --> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7faebc103fc0 con 0x7faea806e530 2024-09-13T02:58:30.944 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:30.943+0000 7faeb97fa640 1 -- 172.21.15.89:0/1903927425 <== mgr.34104 v2:172.21.15.89:6800/1881577856 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7faebc103fc0 con 0x7faea806e530 2024-09-13T02:58:30.947 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:30.945+0000 7faec259f640 1 -- 172.21.15.89:0/1903927425 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7faea806e530 msgr2=0x7faea80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:30.947 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:30.945+0000 7faec259f640 1 --2- 172.21.15.89:0/1903927425 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7faea806e530 0x7faea80709e0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7faebc10ce10 tx=0x7faea400b040 comp rx=0 tx=0).stop 2024-09-13T02:58:30.947 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:30.945+0000 7faec259f640 1 -- 172.21.15.89:0/1903927425 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faebc0fb440 msgr2=0x7faebc10d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:30.947 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:30.945+0000 7faec259f640 1 --2- 172.21.15.89:0/1903927425 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faebc0fb440 0x7faebc10d060 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7faeac0043d0 tx=0x7faeac009da0 comp rx=0 tx=0).stop 2024-09-13T02:58:30.947 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:30.945+0000 7faec259f640 1 -- 172.21.15.89:0/1903927425 shutdown_connections 2024-09-13T02:58:30.947 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:30.945+0000 7faec259f640 1 --2- 172.21.15.89:0/1903927425 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7faea806e530 0x7faea80709e0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:30.947 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:30.945+0000 7faec259f640 1 --2- 172.21.15.89:0/1903927425 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7faebc0fc710 0x7faebc10d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:30.947 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:30.945+0000 7faec259f640 1 --2- 172.21.15.89:0/1903927425 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7faebc0fb440 0x7faebc10d060 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:30.947 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:30.945+0000 7faec259f640 1 -- 172.21.15.89:0/1903927425 >> 172.21.15.89:0/1903927425 conn(0x7faebc0f6c00 msgr2=0x7faebc0660e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:58:30.947 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:30.945+0000 7faec259f640 1 -- 172.21.15.89:0/1903927425 shutdown_connections 2024-09-13T02:58:30.947 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:30.945+0000 7faec259f640 1 -- 172.21.15.89:0/1903927425 wait complete. 2024-09-13T02:58:31.030 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.027+0000 7fac0bc80640 1 -- 172.21.15.89:0/3808534373 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac040fb420 msgr2=0x7fac040fb830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:31.030 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.027+0000 7fac0bc80640 1 --2- 172.21.15.89:0/3808534373 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac040fb420 0x7fac040fb830 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fac000048d0 tx=0x7fac00009da0 comp rx=0 tx=0).stop 2024-09-13T02:58:31.030 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.027+0000 7fac0bc80640 1 -- 172.21.15.89:0/3808534373 shutdown_connections 2024-09-13T02:58:31.030 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.027+0000 7fac0bc80640 1 --2- 172.21.15.89:0/3808534373 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fac040fc6f0 0x7fac040fcb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:31.031 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.027+0000 7fac0bc80640 1 --2- 172.21.15.89:0/3808534373 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac040fb420 0x7fac040fb830 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:31.031 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.027+0000 7fac0bc80640 1 -- 172.21.15.89:0/3808534373 >> 172.21.15.89:0/3808534373 conn(0x7fac040f6c00 msgr2=0x7fac040f9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:58:31.031 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.027+0000 7fac0bc80640 1 -- 172.21.15.89:0/3808534373 shutdown_connections 2024-09-13T02:58:31.031 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.027+0000 7fac0bc80640 1 -- 172.21.15.89:0/3808534373 wait complete. 2024-09-13T02:58:31.031 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.027+0000 7fac0bc80640 1 Processor -- start 2024-09-13T02:58:31.031 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.028+0000 7fac0bc80640 1 -- start start 2024-09-13T02:58:31.031 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.028+0000 7fac0bc80640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac040fb420 0x7fac0410d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:31.031 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.028+0000 7fac0bc80640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fac040fc6f0 0x7fac0410d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:31.031 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.028+0000 7fac0bc80640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac0410dc10 con 0x7fac040fb420 2024-09-13T02:58:31.031 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.028+0000 7fac0bc80640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac0410e430 con 0x7fac040fc6f0 2024-09-13T02:58:31.031 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.028+0000 7fac09a1c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac040fb420 0x7fac0410d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:58:31.031 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.028+0000 7fac09a1c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac040fb420 0x7fac0410d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:51126/0 (socket says 172.21.15.89:51126) 2024-09-13T02:58:31.031 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.028+0000 7fac09a1c640 1 -- 172.21.15.89:0/4153791706 learned_addr learned my addr 172.21.15.89:0/4153791706 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:58:31.032 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.028+0000 7fac0921b640 1 --2- 172.21.15.89:0/4153791706 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fac040fc6f0 0x7fac0410d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:58:31.032 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.028+0000 7fac09a1c640 1 -- 172.21.15.89:0/4153791706 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fac040fc6f0 msgr2=0x7fac0410d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:31.032 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.028+0000 7fac09a1c640 1 --2- 172.21.15.89:0/4153791706 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fac040fc6f0 0x7fac0410d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:31.032 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.028+0000 7fac09a1c640 1 -- 172.21.15.89:0/4153791706 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac00005040 con 0x7fac040fb420 2024-09-13T02:58:31.032 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.028+0000 7fac09a1c640 1 --2- 172.21.15.89:0/4153791706 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac040fb420 0x7fac0410d080 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fac000043d0 tx=0x7fac00009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:58:31.032 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.028+0000 7fabfa7fc640 1 -- 172.21.15.89:0/4153791706 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fac00038070 con 0x7fac040fb420 2024-09-13T02:58:31.032 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.028+0000 7fabfa7fc640 1 -- 172.21.15.89:0/4153791706 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fac0002ae90 con 0x7fac040fb420 2024-09-13T02:58:31.032 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.028+0000 7fac0bc80640 1 -- 172.21.15.89:0/4153791706 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac0410e660 con 0x7fac040fb420 2024-09-13T02:58:31.032 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.029+0000 7fabfa7fc640 1 -- 172.21.15.89:0/4153791706 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fac0003e670 con 0x7fac040fb420 2024-09-13T02:58:31.032 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.029+0000 7fac0bc80640 1 -- 172.21.15.89:0/4153791706 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac0410ec00 con 0x7fac040fb420 2024-09-13T02:58:31.033 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.030+0000 7fac0bc80640 1 -- 172.21.15.89:0/4153791706 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac040fa880 con 0x7fac040fb420 2024-09-13T02:58:31.033 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.030+0000 7fabfa7fc640 1 -- 172.21.15.89:0/4153791706 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fac00030020 con 0x7fac040fb420 2024-09-13T02:58:31.033 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.030+0000 7fabfa7fc640 1 --2- 172.21.15.89:0/4153791706 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fabf006e530 0x7fabf00709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:31.033 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.031+0000 7fabfa7fc640 1 -- 172.21.15.89:0/4153791706 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fac000ae280 con 0x7fac040fb420 2024-09-13T02:58:31.033 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.031+0000 7fac0921b640 1 --2- 172.21.15.89:0/4153791706 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fabf006e530 0x7fabf00709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:58:31.033 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.031+0000 7fac0921b640 1 --2- 172.21.15.89:0/4153791706 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fabf006e530 0x7fabf00709e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fac0410ce30 tx=0x7fabf400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:58:31.036 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.035+0000 7fabfa7fc640 1 -- 172.21.15.89:0/4153791706 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fac000774a0 con 0x7fac040fb420 2024-09-13T02:58:31.208 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.207+0000 7fac0bc80640 1 -- 172.21.15.89:0/4153791706 --> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fac04103f50 con 0x7fabf006e530 2024-09-13T02:58:31.217 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.215+0000 7fabfa7fc640 1 -- 172.21.15.89:0/4153791706 <== mgr.34104 v2:172.21.15.89:6800/1881577856 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fac04103f50 con 0x7fabf006e530 2024-09-13T02:58:31.217 INFO:teuthology.orchestra.run.smithi089.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T02:58:31.217 INFO:teuthology.orchestra.run.smithi089.stdout:alertmanager.smithi089 smithi089 *:9093,9094 running (3m) 4s ago 11m 23.7M - 0.25.0 c8568f914cd2 1d2432f5479e 2024-09-13T02:58:31.217 INFO:teuthology.orchestra.run.smithi089.stdout:crash.smithi089 smithi089 running (68s) 4s ago 12m 6891k - 19.1.1-322-g7741f7f9 19dc8d659727 0ef15ca3e7f9 2024-09-13T02:58:31.217 INFO:teuthology.orchestra.run.smithi089.stdout:crash.smithi131 smithi131 running (64s) 60s ago 11m 6895k - 19.1.1-322-g7741f7f9 19dc8d659727 21e4d6fc04f7 2024-09-13T02:58:31.217 INFO:teuthology.orchestra.run.smithi089.stdout:grafana.smithi089 smithi089 *:3000 running (2m) 4s ago 11m 77.5M - 9.4.7 954c08fa6188 dee914ded1af 2024-09-13T02:58:31.217 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi089.qjoitb smithi089 running (6m) 4s ago 6m 70.3M - 17.2.7-1627-gbbdadfa3 a994b00deb3a ff9b59ec5107 2024-09-13T02:58:31.217 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi089.rarddb smithi089 running (6m) 4s ago 6m 136M - 17.2.7-1627-gbbdadfa3 a994b00deb3a db2dc502c1ba 2024-09-13T02:58:31.217 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi131.rbovzc smithi131 running (6m) 60s ago 6m 60.5M - 17.2.7-1627-gbbdadfa3 a994b00deb3a d071b6d99537 2024-09-13T02:58:31.218 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi131.uasrkg smithi131 running (6m) 60s ago 6m 112M - 17.2.7-1627-gbbdadfa3 a994b00deb3a 0b3d4ffa6ce5 2024-09-13T02:58:31.218 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.smithi089.guohvs smithi089 *:8443,9283,8765 running (2m) 4s ago 13m 496M - 19.1.1-322-g7741f7f9 19dc8d659727 1e887446f1b0 2024-09-13T02:58:31.218 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.smithi131.aunbqd smithi131 *:8443,9283,8765 running (2m) 60s ago 11m 439M - 19.1.1-322-g7741f7f9 19dc8d659727 358d7478f2ba 2024-09-13T02:58:31.218 INFO:teuthology.orchestra.run.smithi089.stdout:mon.smithi089 smithi089 running (2m) 4s ago 13m 44.8M 2048M 19.1.1-322-g7741f7f9 19dc8d659727 8a29fb65028f 2024-09-13T02:58:31.218 INFO:teuthology.orchestra.run.smithi089.stdout:mon.smithi131 smithi131 running (103s) 60s ago 11m 37.6M 2048M 19.1.1-322-g7741f7f9 19dc8d659727 506310ad8620 2024-09-13T02:58:31.218 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.smithi089 smithi089 *:9100 running (3m) 4s ago 12m 16.9M - 1.5.0 0da6a335fe13 5a9927b583e6 2024-09-13T02:58:31.218 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.smithi131 smithi131 *:9100 running (2m) 60s ago 11m 15.3M - 1.5.0 0da6a335fe13 bcfde5d1a508 2024-09-13T02:58:31.218 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0 smithi089 running (44s) 4s ago 10m 93.0M 1557M 19.1.1-322-g7741f7f9 19dc8d659727 e8038f6d52b6 2024-09-13T02:58:31.218 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1 smithi089 running (9s) 4s ago 9m 12.1M 1557M 19.1.1-322-g7741f7f9 19dc8d659727 e174144d9633 2024-09-13T02:58:31.218 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2 smithi089 running (9m) 4s ago 9m 196M 1557M 17.2.7-1627-gbbdadfa3 a994b00deb3a 447cf103114b 2024-09-13T02:58:31.218 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3 smithi131 running (9m) 60s ago 9m 264M 2581M 17.2.7-1627-gbbdadfa3 a994b00deb3a 0b80a4dea862 2024-09-13T02:58:31.218 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4 smithi131 running (8m) 60s ago 8m 236M 2581M 17.2.7-1627-gbbdadfa3 a994b00deb3a 06ec44680b00 2024-09-13T02:58:31.218 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5 smithi131 running (8m) 60s ago 8m 231M 2581M 17.2.7-1627-gbbdadfa3 a994b00deb3a ace4b45e5873 2024-09-13T02:58:31.218 INFO:teuthology.orchestra.run.smithi089.stdout:prometheus.smithi089 smithi089 *:9095 running (2m) 4s ago 11m 56.3M - 2.43.0 a07b618ecd1d 9d336370c187 2024-09-13T02:58:31.219 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.217+0000 7fac0bc80640 1 -- 172.21.15.89:0/4153791706 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fabf006e530 msgr2=0x7fabf00709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:31.219 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.217+0000 7fac0bc80640 1 --2- 172.21.15.89:0/4153791706 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fabf006e530 0x7fabf00709e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fac0410ce30 tx=0x7fabf400b040 comp rx=0 tx=0).stop 2024-09-13T02:58:31.220 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.217+0000 7fac0bc80640 1 -- 172.21.15.89:0/4153791706 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac040fb420 msgr2=0x7fac0410d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:31.220 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.217+0000 7fac0bc80640 1 --2- 172.21.15.89:0/4153791706 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac040fb420 0x7fac0410d080 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fac000043d0 tx=0x7fac00009da0 comp rx=0 tx=0).stop 2024-09-13T02:58:31.220 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.217+0000 7fac0bc80640 1 -- 172.21.15.89:0/4153791706 shutdown_connections 2024-09-13T02:58:31.220 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.217+0000 7fac0bc80640 1 --2- 172.21.15.89:0/4153791706 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fabf006e530 0x7fabf00709e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:31.220 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.217+0000 7fac0bc80640 1 --2- 172.21.15.89:0/4153791706 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fac040fc6f0 0x7fac0410d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:31.220 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.217+0000 7fac0bc80640 1 --2- 172.21.15.89:0/4153791706 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fac040fb420 0x7fac0410d080 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:31.220 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.217+0000 7fac0bc80640 1 -- 172.21.15.89:0/4153791706 >> 172.21.15.89:0/4153791706 conn(0x7fac040f6c00 msgr2=0x7fac04065e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:58:31.220 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.218+0000 7fac0bc80640 1 -- 172.21.15.89:0/4153791706 shutdown_connections 2024-09-13T02:58:31.220 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.218+0000 7fac0bc80640 1 -- 172.21.15.89:0/4153791706 wait complete. 2024-09-13T02:58:31.297 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.295+0000 7f1a82dfa640 1 -- 172.21.15.89:0/4281200049 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1a7c0fd7f0 msgr2=0x7f1a7c0fdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:31.297 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.295+0000 7f1a82dfa640 1 --2- 172.21.15.89:0/4281200049 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1a7c0fd7f0 0x7f1a7c0fdc60 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c009c50 tx=0x7f1a6c004d10 comp rx=0 tx=0).stop 2024-09-13T02:58:31.297 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.295+0000 7f1a82dfa640 1 -- 172.21.15.89:0/4281200049 shutdown_connections 2024-09-13T02:58:31.297 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.295+0000 7f1a82dfa640 1 --2- 172.21.15.89:0/4281200049 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1a7c0fd7f0 0x7f1a7c0fdc60 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:31.297 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.295+0000 7f1a82dfa640 1 --2- 172.21.15.89:0/4281200049 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1a7c0fc520 0x7f1a7c0fc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:31.298 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.295+0000 7f1a82dfa640 1 -- 172.21.15.89:0/4281200049 >> 172.21.15.89:0/4281200049 conn(0x7f1a7c0f7ce0 msgr2=0x7f1a7c0fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:58:31.298 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.295+0000 7f1a82dfa640 1 -- 172.21.15.89:0/4281200049 shutdown_connections 2024-09-13T02:58:31.298 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.295+0000 7f1a82dfa640 1 -- 172.21.15.89:0/4281200049 wait complete. 2024-09-13T02:58:31.298 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.296+0000 7f1a82dfa640 1 Processor -- start 2024-09-13T02:58:31.298 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.296+0000 7f1a82dfa640 1 -- start start 2024-09-13T02:58:31.299 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.296+0000 7f1a82dfa640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1a7c0fc520 0x7f1a7c10d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:31.299 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.296+0000 7f1a82dfa640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1a7c0fd7f0 0x7f1a7c10d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:31.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.296+0000 7f1a82dfa640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a7c10e490 con 0x7f1a7c0fd7f0 2024-09-13T02:58:31.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.296+0000 7f1a82dfa640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a7c10e600 con 0x7f1a7c0fc520 2024-09-13T02:58:31.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.296+0000 7f1a7bfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1a7c0fd7f0 0x7f1a7c10d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:58:31.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.296+0000 7f1a7bfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1a7c0fd7f0 0x7f1a7c10d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:43524/0 (socket says 172.21.15.89:43524) 2024-09-13T02:58:31.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.297+0000 7f1a7bfff640 1 -- 172.21.15.89:0/2971292202 learned_addr learned my addr 172.21.15.89:0/2971292202 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:58:31.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.297+0000 7f1a80b96640 1 --2- 172.21.15.89:0/2971292202 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1a7c0fc520 0x7f1a7c10d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:58:31.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.297+0000 7f1a7bfff640 1 -- 172.21.15.89:0/2971292202 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1a7c0fc520 msgr2=0x7f1a7c10d0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:31.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.297+0000 7f1a7bfff640 1 --2- 172.21.15.89:0/2971292202 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1a7c0fc520 0x7f1a7c10d0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:31.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.297+0000 7f1a7bfff640 1 -- 172.21.15.89:0/2971292202 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a6c0098b0 con 0x7f1a7c0fd7f0 2024-09-13T02:58:31.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.297+0000 7f1a7bfff640 1 --2- 172.21.15.89:0/2971292202 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1a7c0fd7f0 0x7f1a7c10d620 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c004a30 tx=0x7f1a6c004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:58:31.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.297+0000 7f1a797fa640 1 -- 172.21.15.89:0/2971292202 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a6c032850 con 0x7f1a7c0fd7f0 2024-09-13T02:58:31.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.297+0000 7f1a797fa640 1 -- 172.21.15.89:0/2971292202 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f1a6c009710 con 0x7f1a7c0fd7f0 2024-09-13T02:58:31.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.297+0000 7f1a82dfa640 1 -- 172.21.15.89:0/2971292202 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a7c10e880 con 0x7f1a7c0fd7f0 2024-09-13T02:58:31.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.297+0000 7f1a797fa640 1 -- 172.21.15.89:0/2971292202 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a6c03dc20 con 0x7f1a7c0fd7f0 2024-09-13T02:58:31.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.297+0000 7f1a82dfa640 1 -- 172.21.15.89:0/2971292202 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a7c10eda0 con 0x7f1a7c0fd7f0 2024-09-13T02:58:31.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.298+0000 7f1a82dfa640 1 -- 172.21.15.89:0/2971292202 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a7c0fb980 con 0x7f1a7c0fd7f0 2024-09-13T02:58:31.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.299+0000 7f1a797fa640 1 -- 172.21.15.89:0/2971292202 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f1a6c02f030 con 0x7f1a7c0fd7f0 2024-09-13T02:58:31.302 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.299+0000 7f1a797fa640 1 --2- 172.21.15.89:0/2971292202 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f1a6806e530 0x7f1a680709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:31.302 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.299+0000 7f1a797fa640 1 -- 172.21.15.89:0/2971292202 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f1a6c0af820 con 0x7f1a7c0fd7f0 2024-09-13T02:58:31.302 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.299+0000 7f1a80b96640 1 --2- 172.21.15.89:0/2971292202 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f1a6806e530 0x7f1a680709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:58:31.302 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.299+0000 7f1a80b96640 1 --2- 172.21.15.89:0/2971292202 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f1a6806e530 0x7f1a680709e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1a74009b50 tx=0x7f1a74009120 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:58:31.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.303+0000 7f1a797fa640 1 -- 172.21.15.89:0/2971292202 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f1a6c078910 con 0x7f1a7c0fd7f0 2024-09-13T02:58:31.535 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.533+0000 7f1a82dfa640 1 -- 172.21.15.89:0/2971292202 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1a7c04b720 con 0x7f1a7c0fd7f0 2024-09-13T02:58:31.535 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.533+0000 7f1a797fa640 1 -- 172.21.15.89:0/2971292202 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+850 (secure 0 0 0) 0x7f1a6c07bfd0 con 0x7f1a7c0fd7f0 2024-09-13T02:58:31.535 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-13T02:58:31.535 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": { 2024-09-13T02:58:31.535 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 2 2024-09-13T02:58:31.535 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T02:58:31.536 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": { 2024-09-13T02:58:31.536 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 2 2024-09-13T02:58:31.536 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T02:58:31.536 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": { 2024-09-13T02:58:31.536 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 4, 2024-09-13T02:58:31.536 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 1 2024-09-13T02:58:31.536 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T02:58:31.536 INFO:teuthology.orchestra.run.smithi089.stdout: "mds": { 2024-09-13T02:58:31.536 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 4 2024-09-13T02:58:31.536 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T02:58:31.536 INFO:teuthology.orchestra.run.smithi089.stdout: "overall": { 2024-09-13T02:58:31.536 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 8, 2024-09-13T02:58:31.536 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 5 2024-09-13T02:58:31.536 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-13T02:58:31.537 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-13T02:58:31.537 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.536+0000 7f1a82dfa640 1 -- 172.21.15.89:0/2971292202 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f1a6806e530 msgr2=0x7f1a680709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:31.537 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.536+0000 7f1a82dfa640 1 --2- 172.21.15.89:0/2971292202 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f1a6806e530 0x7f1a680709e0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1a74009b50 tx=0x7f1a74009120 comp rx=0 tx=0).stop 2024-09-13T02:58:31.537 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.536+0000 7f1a82dfa640 1 -- 172.21.15.89:0/2971292202 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1a7c0fd7f0 msgr2=0x7f1a7c10d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:31.538 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.536+0000 7f1a82dfa640 1 --2- 172.21.15.89:0/2971292202 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1a7c0fd7f0 0x7f1a7c10d620 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1a6c004a30 tx=0x7f1a6c004d10 comp rx=0 tx=0).stop 2024-09-13T02:58:31.538 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.536+0000 7f1a82dfa640 1 -- 172.21.15.89:0/2971292202 shutdown_connections 2024-09-13T02:58:31.538 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.536+0000 7f1a82dfa640 1 --2- 172.21.15.89:0/2971292202 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f1a6806e530 0x7f1a680709e0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:31.538 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.536+0000 7f1a82dfa640 1 --2- 172.21.15.89:0/2971292202 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1a7c0fd7f0 0x7f1a7c10d620 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:31.538 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.536+0000 7f1a82dfa640 1 --2- 172.21.15.89:0/2971292202 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1a7c0fc520 0x7f1a7c10d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:31.538 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.536+0000 7f1a82dfa640 1 -- 172.21.15.89:0/2971292202 >> 172.21.15.89:0/2971292202 conn(0x7f1a7c0f7ce0 msgr2=0x7f1a7c0f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:58:31.538 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.536+0000 7f1a82dfa640 1 -- 172.21.15.89:0/2971292202 shutdown_connections 2024-09-13T02:58:31.538 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.536+0000 7f1a82dfa640 1 -- 172.21.15.89:0/2971292202 wait complete. 2024-09-13T02:58:31.622 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.619+0000 7f573a1e8640 1 -- 172.21.15.89:0/134164403 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57340fc520 msgr2=0x7f57340fc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:31.622 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.619+0000 7f573a1e8640 1 --2- 172.21.15.89:0/134164403 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57340fc520 0x7f57340fc930 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f57240048d0 tx=0x7f5724009da0 comp rx=0 tx=0).stop 2024-09-13T02:58:31.625 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.623+0000 7f573a1e8640 1 -- 172.21.15.89:0/134164403 shutdown_connections 2024-09-13T02:58:31.625 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.624+0000 7f573a1e8640 1 --2- 172.21.15.89:0/134164403 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f57340fd7f0 0x7f57340fdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:31.625 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.624+0000 7f573a1e8640 1 --2- 172.21.15.89:0/134164403 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57340fc520 0x7f57340fc930 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:31.625 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.624+0000 7f573a1e8640 1 -- 172.21.15.89:0/134164403 >> 172.21.15.89:0/134164403 conn(0x7f57340f7ce0 msgr2=0x7f57340fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:58:31.625 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.624+0000 7f573a1e8640 1 -- 172.21.15.89:0/134164403 shutdown_connections 2024-09-13T02:58:31.629 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.624+0000 7f573a1e8640 1 -- 172.21.15.89:0/134164403 wait complete. 2024-09-13T02:58:31.629 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.625+0000 7f573a1e8640 1 Processor -- start 2024-09-13T02:58:31.629 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.625+0000 7f573a1e8640 1 -- start start 2024-09-13T02:58:31.629 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.626+0000 7f573a1e8640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f57340fc520 0x7f573410ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:31.629 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.626+0000 7f573a1e8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57340fd7f0 0x7f573410b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:31.629 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.626+0000 7f573a1e8640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f573410b9d0 con 0x7f57340fd7f0 2024-09-13T02:58:31.630 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.626+0000 7f573a1e8640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f573410c280 con 0x7f57340fc520 2024-09-13T02:58:31.630 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.629+0000 7f5732ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57340fd7f0 0x7f573410b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:58:31.630 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.629+0000 7f5732ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57340fd7f0 0x7f573410b380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:43550/0 (socket says 172.21.15.89:43550) 2024-09-13T02:58:31.630 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.629+0000 7f5732ffd640 1 -- 172.21.15.89:0/906855191 learned_addr learned my addr 172.21.15.89:0/906855191 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:58:31.632 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.630+0000 7f5732ffd640 1 -- 172.21.15.89:0/906855191 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f57340fc520 msgr2=0x7f573410ae40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-13T02:58:31.632 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.630+0000 7f5732ffd640 1 --2- 172.21.15.89:0/906855191 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f57340fc520 0x7f573410ae40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:31.632 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.630+0000 7f5732ffd640 1 -- 172.21.15.89:0/906855191 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5724005040 con 0x7f57340fd7f0 2024-09-13T02:58:31.633 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.632+0000 7f5732ffd640 1 --2- 172.21.15.89:0/906855191 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57340fd7f0 0x7f573410b380 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5728002a50 tx=0x7f5728004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:58:31.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.633+0000 7f571bfff640 1 -- 172.21.15.89:0/906855191 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5728007c30 con 0x7f57340fd7f0 2024-09-13T02:58:31.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.633+0000 7f573a1e8640 1 -- 172.21.15.89:0/906855191 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f573410c560 con 0x7f57340fd7f0 2024-09-13T02:58:31.635 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.633+0000 7f573a1e8640 1 -- 172.21.15.89:0/906855191 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f573410cb00 con 0x7f57340fd7f0 2024-09-13T02:58:31.637 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.634+0000 7f571bfff640 1 -- 172.21.15.89:0/906855191 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f572800f040 con 0x7f57340fd7f0 2024-09-13T02:58:31.637 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.635+0000 7f571bfff640 1 -- 172.21.15.89:0/906855191 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f572800daa0 con 0x7f57340fd7f0 2024-09-13T02:58:31.637 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.635+0000 7f573a1e8640 1 -- 172.21.15.89:0/906855191 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57340fb980 con 0x7f57340fd7f0 2024-09-13T02:58:31.637 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.636+0000 7f571bfff640 1 -- 172.21.15.89:0/906855191 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f572800dcc0 con 0x7f57340fd7f0 2024-09-13T02:58:31.638 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.637+0000 7f571bfff640 1 --2- 172.21.15.89:0/906855191 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f571c06e430 0x7f571c0708e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:31.638 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.637+0000 7f571bfff640 1 -- 172.21.15.89:0/906855191 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f572808d9e0 con 0x7f57340fd7f0 2024-09-13T02:58:31.640 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.639+0000 7f57337fe640 1 --2- 172.21.15.89:0/906855191 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f571c06e430 0x7f571c0708e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:58:31.641 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.639+0000 7f57337fe640 1 --2- 172.21.15.89:0/906855191 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f571c06e430 0x7f571c0708e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f57240043d0 tx=0x7f5724009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:58:31.647 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.645+0000 7f571bfff640 1 -- 172.21.15.89:0/906855191 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f5728056c30 con 0x7f57340fd7f0 2024-09-13T02:58:31.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.846+0000 7f573a1e8640 1 -- 172.21.15.89:0/906855191 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f5734104f50 con 0x7f57340fd7f0 2024-09-13T02:58:31.848 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.846+0000 7f571bfff640 1 -- 172.21.15.89:0/906855191 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 23 v23) v1 ==== 76+0+1953 (secure 0 0 0) 0x7f572805a2f0 con 0x7f57340fd7f0 2024-09-13T02:58:31.848 INFO:teuthology.orchestra.run.smithi089.stdout:e23 2024-09-13T02:58:31.848 INFO:teuthology.orchestra.run.smithi089.stdout:btime 2024-09-13T02:58:04:980780+0000 2024-09-13T02:58:31.849 INFO:teuthology.orchestra.run.smithi089.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T02:58:31.849 INFO:teuthology.orchestra.run.smithi089.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:58:31.849 INFO:teuthology.orchestra.run.smithi089.stdout:legacy client fscid: 1 2024-09-13T02:58:31.849 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:58:31.849 INFO:teuthology.orchestra.run.smithi089.stdout:Filesystem 'cephfs' (1) 2024-09-13T02:58:31.849 INFO:teuthology.orchestra.run.smithi089.stdout:fs_name cephfs 2024-09-13T02:58:31.849 INFO:teuthology.orchestra.run.smithi089.stdout:epoch 23 2024-09-13T02:58:31.849 INFO:teuthology.orchestra.run.smithi089.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T02:58:31.849 INFO:teuthology.orchestra.run.smithi089.stdout:created 2024-09-13T02:51:40.657817+0000 2024-09-13T02:58:31.849 INFO:teuthology.orchestra.run.smithi089.stdout:modified 2024-09-13T02:58:04.067950+0000 2024-09-13T02:58:31.849 INFO:teuthology.orchestra.run.smithi089.stdout:tableserver 0 2024-09-13T02:58:31.849 INFO:teuthology.orchestra.run.smithi089.stdout:root 0 2024-09-13T02:58:31.849 INFO:teuthology.orchestra.run.smithi089.stdout:session_timeout 60 2024-09-13T02:58:31.850 INFO:teuthology.orchestra.run.smithi089.stdout:session_autoclose 300 2024-09-13T02:58:31.850 INFO:teuthology.orchestra.run.smithi089.stdout:max_file_size 1099511627776 2024-09-13T02:58:31.850 INFO:teuthology.orchestra.run.smithi089.stdout:max_xattr_size 65536 2024-09-13T02:58:31.850 INFO:teuthology.orchestra.run.smithi089.stdout:required_client_features {} 2024-09-13T02:58:31.850 INFO:teuthology.orchestra.run.smithi089.stdout:last_failure 0 2024-09-13T02:58:31.850 INFO:teuthology.orchestra.run.smithi089.stdout:last_failure_osd_epoch 44 2024-09-13T02:58:31.850 INFO:teuthology.orchestra.run.smithi089.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:58:31.850 INFO:teuthology.orchestra.run.smithi089.stdout:max_mds 2 2024-09-13T02:58:31.850 INFO:teuthology.orchestra.run.smithi089.stdout:in 0,1 2024-09-13T02:58:31.850 INFO:teuthology.orchestra.run.smithi089.stdout:up {0=14480,1=24257} 2024-09-13T02:58:31.850 INFO:teuthology.orchestra.run.smithi089.stdout:failed 2024-09-13T02:58:31.850 INFO:teuthology.orchestra.run.smithi089.stdout:damaged 2024-09-13T02:58:31.851 INFO:teuthology.orchestra.run.smithi089.stdout:stopped 2024-09-13T02:58:31.851 INFO:teuthology.orchestra.run.smithi089.stdout:data_pools [3] 2024-09-13T02:58:31.851 INFO:teuthology.orchestra.run.smithi089.stdout:metadata_pool 2 2024-09-13T02:58:31.851 INFO:teuthology.orchestra.run.smithi089.stdout:inline_data disabled 2024-09-13T02:58:31.851 INFO:teuthology.orchestra.run.smithi089.stdout:balancer 2024-09-13T02:58:31.851 INFO:teuthology.orchestra.run.smithi089.stdout:bal_rank_mask -1 2024-09-13T02:58:31.851 INFO:teuthology.orchestra.run.smithi089.stdout:standby_count_wanted 1 2024-09-13T02:58:31.851 INFO:teuthology.orchestra.run.smithi089.stdout:qdb_cluster leader: 14480 members: 24257,14480 2024-09-13T02:58:31.851 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi089.rarddb{0:14480} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.89:6828/1561365213,v1:172.21.15.89:6829/1561365213] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:58:31.851 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi089.qjoitb{0:14488} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.89:6826/1464393547,v1:172.21.15.89:6827/1464393547] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:58:31.851 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi131.uasrkg{1:24257} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.131:6824/260493836,v1:172.21.15.131:6825/260493836] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:58:31.851 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi131.rbovzc{1:24265} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.131:6826/665579373,v1:172.21.15.131:6827/665579373] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:58:31.851 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:58:31.851 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:58:31.852 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 23 2024-09-13T02:58:31.852 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.849+0000 7f573a1e8640 1 -- 172.21.15.89:0/906855191 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f571c06e430 msgr2=0x7f571c0708e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:31.853 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.849+0000 7f573a1e8640 1 --2- 172.21.15.89:0/906855191 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f571c06e430 0x7f571c0708e0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f57240043d0 tx=0x7f5724009da0 comp rx=0 tx=0).stop 2024-09-13T02:58:31.853 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.849+0000 7f573a1e8640 1 -- 172.21.15.89:0/906855191 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57340fd7f0 msgr2=0x7f573410b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:31.853 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.849+0000 7f573a1e8640 1 --2- 172.21.15.89:0/906855191 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57340fd7f0 0x7f573410b380 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5728002a50 tx=0x7f5728004600 comp rx=0 tx=0).stop 2024-09-13T02:58:31.853 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.849+0000 7f573a1e8640 1 -- 172.21.15.89:0/906855191 shutdown_connections 2024-09-13T02:58:31.853 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.849+0000 7f573a1e8640 1 --2- 172.21.15.89:0/906855191 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f571c06e430 0x7f571c0708e0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:31.853 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.849+0000 7f573a1e8640 1 --2- 172.21.15.89:0/906855191 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f57340fd7f0 0x7f573410b380 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:31.853 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.849+0000 7f573a1e8640 1 --2- 172.21.15.89:0/906855191 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f57340fc520 0x7f573410ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:31.853 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.849+0000 7f573a1e8640 1 -- 172.21.15.89:0/906855191 >> 172.21.15.89:0/906855191 conn(0x7f57340f7ce0 msgr2=0x7f57340f93a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:58:31.853 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.849+0000 7f573a1e8640 1 -- 172.21.15.89:0/906855191 shutdown_connections 2024-09-13T02:58:31.853 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.849+0000 7f573a1e8640 1 -- 172.21.15.89:0/906855191 wait complete. 2024-09-13T02:58:31.930 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.928+0000 7ff01602c640 1 -- 172.21.15.89:0/1206427213 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0100fb440 msgr2=0x7ff0100fb850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:31.930 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.928+0000 7ff01602c640 1 --2- 172.21.15.89:0/1206427213 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0100fb440 0x7ff0100fb850 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff0000048d0 tx=0x7ff000009da0 comp rx=0 tx=0).stop 2024-09-13T02:58:31.930 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.928+0000 7ff01602c640 1 -- 172.21.15.89:0/1206427213 shutdown_connections 2024-09-13T02:58:31.930 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.928+0000 7ff01602c640 1 --2- 172.21.15.89:0/1206427213 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff0100fc710 0x7ff0100fcb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:31.930 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.928+0000 7ff01602c640 1 --2- 172.21.15.89:0/1206427213 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0100fb440 0x7ff0100fb850 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:31.930 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.928+0000 7ff01602c640 1 -- 172.21.15.89:0/1206427213 >> 172.21.15.89:0/1206427213 conn(0x7ff0100f6c20 msgr2=0x7ff0100f9030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:58:31.931 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.929+0000 7ff01602c640 1 -- 172.21.15.89:0/1206427213 shutdown_connections 2024-09-13T02:58:31.931 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:31 smithi089 ceph-mon[91553]: from='osd.1 [v2:172.21.15.89:6810/3812497008,v1:172.21.15.89:6811/3812497008]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-13T02:58:31.931 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:31 smithi089 ceph-mon[91553]: osdmap e55: 6 total, 5 up, 6 in 2024-09-13T02:58:31.931 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:31 smithi089 ceph-mon[91553]: from='osd.1 [v2:172.21.15.89:6810/3812497008,v1:172.21.15.89:6811/3812497008]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-09-13T02:58:31.931 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:31 smithi089 ceph-mon[91553]: from='client.34224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:58:31.931 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:31 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:58:31.931 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:31 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:58:31.931 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:31 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:58:31.931 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:31 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:58:31.932 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:31 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:58:31.932 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:31 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:58:31.932 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:31 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:31.932 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:31 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:31.932 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:31 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:31.932 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:31 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-13T02:58:31.932 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:31 smithi089 ceph-mon[91553]: from='client.? 172.21.15.89:0/2971292202' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:31.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.929+0000 7ff01602c640 1 -- 172.21.15.89:0/1206427213 wait complete. 2024-09-13T02:58:31.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.929+0000 7ff01602c640 1 Processor -- start 2024-09-13T02:58:31.935 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.930+0000 7ff01602c640 1 -- start start 2024-09-13T02:58:31.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.930+0000 7ff01602c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff0100fb440 0x7ff01010fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:31.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.930+0000 7ff01602c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0100fc710 0x7ff010112330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:31.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.930+0000 7ff01602c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0100666d0 con 0x7ff0100fc710 2024-09-13T02:58:31.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.930+0000 7ff01602c640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff010066840 con 0x7ff0100fb440 2024-09-13T02:58:31.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.930+0000 7ff00effd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0100fc710 0x7ff010112330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:58:31.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.930+0000 7ff00f7fe640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff0100fb440 0x7ff01010fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:58:31.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.930+0000 7ff00effd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0100fc710 0x7ff010112330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:43564/0 (socket says 172.21.15.89:43564) 2024-09-13T02:58:31.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.930+0000 7ff00f7fe640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff0100fb440 0x7ff01010fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.89:43800/0 (socket says 172.21.15.89:43800) 2024-09-13T02:58:31.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.930+0000 7ff00effd640 1 -- 172.21.15.89:0/1491392441 learned_addr learned my addr 172.21.15.89:0/1491392441 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:58:31.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.930+0000 7ff00effd640 1 -- 172.21.15.89:0/1491392441 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff0100fb440 msgr2=0x7ff01010fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:31.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.930+0000 7ff00effd640 1 --2- 172.21.15.89:0/1491392441 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff0100fb440 0x7ff01010fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:31.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.930+0000 7ff00effd640 1 -- 172.21.15.89:0/1491392441 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff000005040 con 0x7ff0100fc710 2024-09-13T02:58:31.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.931+0000 7ff00effd640 1 --2- 172.21.15.89:0/1491392441 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0100fc710 0x7ff010112330 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7feff8002a50 tx=0x7feff8004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:58:31.937 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.931+0000 7ff007fff640 1 -- 172.21.15.89:0/1491392441 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feff8007c30 con 0x7ff0100fc710 2024-09-13T02:58:31.937 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.931+0000 7ff007fff640 1 -- 172.21.15.89:0/1491392441 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7feff800f040 con 0x7ff0100fc710 2024-09-13T02:58:31.937 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.931+0000 7ff01602c640 1 -- 172.21.15.89:0/1491392441 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0101128d0 con 0x7ff0100fc710 2024-09-13T02:58:31.937 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.931+0000 7ff007fff640 1 -- 172.21.15.89:0/1491392441 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feff800dad0 con 0x7ff0100fc710 2024-09-13T02:58:31.937 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.931+0000 7ff01602c640 1 -- 172.21.15.89:0/1491392441 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff010112e40 con 0x7ff0100fc710 2024-09-13T02:58:31.937 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.932+0000 7ff01602c640 1 -- 172.21.15.89:0/1491392441 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0100fa8a0 con 0x7ff0100fc710 2024-09-13T02:58:31.937 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.933+0000 7ff007fff640 1 -- 172.21.15.89:0/1491392441 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7feff800dc30 con 0x7ff0100fc710 2024-09-13T02:58:31.937 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.933+0000 7ff007fff640 1 --2- 172.21.15.89:0/1491392441 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7feffc06e530 0x7feffc0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:31.937 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.933+0000 7ff007fff640 1 -- 172.21.15.89:0/1491392441 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6496+0+0 (secure 0 0 0) 0x7feff808dfc0 con 0x7ff0100fc710 2024-09-13T02:58:31.937 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.933+0000 7ff00f7fe640 1 --2- 172.21.15.89:0/1491392441 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7feffc06e530 0x7feffc0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:58:31.937 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.934+0000 7ff00f7fe640 1 --2- 172.21.15.89:0/1491392441 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7feffc06e530 0x7feffc0709e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff000000c00 tx=0x7ff000035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:58:31.937 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:31 smithi131 ceph-mon[78839]: from='osd.1 [v2:172.21.15.89:6810/3812497008,v1:172.21.15.89:6811/3812497008]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-13T02:58:31.938 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:31 smithi131 ceph-mon[78839]: osdmap e55: 6 total, 5 up, 6 in 2024-09-13T02:58:31.938 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:31 smithi131 ceph-mon[78839]: from='osd.1 [v2:172.21.15.89:6810/3812497008,v1:172.21.15.89:6811/3812497008]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-09-13T02:58:31.938 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:31 smithi131 ceph-mon[78839]: from='client.34224 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:58:31.938 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:31 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:58:31.938 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:31 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:58:31.938 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:31 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:58:31.938 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:31 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:58:31.938 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:31 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:58:31.938 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:31 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:58:31.938 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:31 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:31.938 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:31 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:31.938 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:31 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:31.938 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:31 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-13T02:58:31.939 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:31 smithi131 ceph-mon[78839]: from='client.? 172.21.15.89:0/2971292202' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:58:31.939 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:31.937+0000 7ff007fff640 1 -- 172.21.15.89:0/1491392441 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7feff80570b0 con 0x7ff0100fc710 2024-09-13T02:58:32.119 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:32.118+0000 7ff01602c640 1 -- 172.21.15.89:0/1491392441 --> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff010100b30 con 0x7feffc06e530 2024-09-13T02:58:32.121 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:32.119+0000 7ff007fff640 1 -- 172.21.15.89:0/1491392441 <== mgr.34104 v2:172.21.15.89:6800/1881577856 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7ff010100b30 con 0x7feffc06e530 2024-09-13T02:58:32.121 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-13T02:58:32.121 INFO:teuthology.orchestra.run.smithi089.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d", 2024-09-13T02:58:32.121 INFO:teuthology.orchestra.run.smithi089.stdout: "in_progress": true, 2024-09-13T02:58:32.121 INFO:teuthology.orchestra.run.smithi089.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T02:58:32.121 INFO:teuthology.orchestra.run.smithi089.stdout: "services_complete": [ 2024-09-13T02:58:32.121 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr", 2024-09-13T02:58:32.121 INFO:teuthology.orchestra.run.smithi089.stdout: "crash", 2024-09-13T02:58:32.121 INFO:teuthology.orchestra.run.smithi089.stdout: "mon" 2024-09-13T02:58:32.121 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-13T02:58:32.122 INFO:teuthology.orchestra.run.smithi089.stdout: "progress": "8/21 daemons upgraded", 2024-09-13T02:58:32.122 INFO:teuthology.orchestra.run.smithi089.stdout: "message": "Currently upgrading osd daemons", 2024-09-13T02:58:32.122 INFO:teuthology.orchestra.run.smithi089.stdout: "is_paused": false 2024-09-13T02:58:32.122 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-13T02:58:32.123 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:32.122+0000 7ff01602c640 1 -- 172.21.15.89:0/1491392441 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7feffc06e530 msgr2=0x7feffc0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:32.123 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:32.122+0000 7ff01602c640 1 --2- 172.21.15.89:0/1491392441 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7feffc06e530 0x7feffc0709e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff000000c00 tx=0x7ff000035040 comp rx=0 tx=0).stop 2024-09-13T02:58:32.123 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:32.122+0000 7ff01602c640 1 -- 172.21.15.89:0/1491392441 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0100fc710 msgr2=0x7ff010112330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:32.123 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:32.122+0000 7ff01602c640 1 --2- 172.21.15.89:0/1491392441 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0100fc710 0x7ff010112330 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7feff8002a50 tx=0x7feff8004600 comp rx=0 tx=0).stop 2024-09-13T02:58:32.124 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:32.122+0000 7ff01602c640 1 -- 172.21.15.89:0/1491392441 shutdown_connections 2024-09-13T02:58:32.124 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:32.122+0000 7ff01602c640 1 --2- 172.21.15.89:0/1491392441 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7feffc06e530 0x7feffc0709e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:32.124 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:32.122+0000 7ff01602c640 1 --2- 172.21.15.89:0/1491392441 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff0100fc710 0x7ff010112330 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:32.124 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:32.122+0000 7ff01602c640 1 --2- 172.21.15.89:0/1491392441 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff0100fb440 0x7ff01010fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:32.124 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:32.122+0000 7ff01602c640 1 -- 172.21.15.89:0/1491392441 >> 172.21.15.89:0/1491392441 conn(0x7ff0100f6c20 msgr2=0x7ff0100f8450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:58:32.124 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:32.122+0000 7ff01602c640 1 -- 172.21.15.89:0/1491392441 shutdown_connections 2024-09-13T02:58:32.124 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:32.122+0000 7ff01602c640 1 -- 172.21.15.89:0/1491392441 wait complete. 2024-09-13T02:58:32.201 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:32.200+0000 7ff9aee85640 1 -- 172.21.15.89:0/2758055446 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9a80666b0 msgr2=0x7ff9a80ff1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:32.201 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:32.200+0000 7ff9aee85640 1 --2- 172.21.15.89:0/2758055446 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9a80666b0 0x7ff9a80ff1c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7ff99c0048d0 tx=0x7ff99c009da0 comp rx=0 tx=0).stop 2024-09-13T02:58:32.201 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:32.200+0000 7ff9aee85640 1 -- 172.21.15.89:0/2758055446 shutdown_connections 2024-09-13T02:58:32.201 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:32.200+0000 7ff9aee85640 1 --2- 172.21.15.89:0/2758055446 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff9a80ff700 0x7ff9a8101ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:32.201 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:32.200+0000 7ff9aee85640 1 --2- 172.21.15.89:0/2758055446 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9a80666b0 0x7ff9a80ff1c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:32.202 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:32.200+0000 7ff9aee85640 1 -- 172.21.15.89:0/2758055446 >> 172.21.15.89:0/2758055446 conn(0x7ff9a80f6c10 msgr2=0x7ff9a80f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:58:32.202 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:32.200+0000 7ff9aee85640 1 -- 172.21.15.89:0/2758055446 shutdown_connections 2024-09-13T02:58:32.202 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:32.200+0000 7ff9aee85640 1 -- 172.21.15.89:0/2758055446 wait complete. 2024-09-13T02:58:32.203 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:32.200+0000 7ff9aee85640 1 Processor -- start 2024-09-13T02:58:32.203 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:32.200+0000 7ff9aee85640 1 -- start start 2024-09-13T02:58:32.203 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:32.201+0000 7ff9aee85640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff9a80666b0 0x7ff9a810d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:32.204 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:32.201+0000 7ff9aee85640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9a80ff700 0x7ff9a810d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:32.204 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:32.201+0000 7ff9aee85640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a810dd10 con 0x7ff9a80ff700 2024-09-13T02:58:32.204 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:32.201+0000 7ff9aee85640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9a810e4e0 con 0x7ff9a80666b0 2024-09-13T02:58:32.204 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:32.201+0000 7ff9a7fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9a80ff700 0x7ff9a810d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:58:32.204 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:32.201+0000 7ff9a7fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9a80ff700 0x7ff9a810d6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:43570/0 (socket says 172.21.15.89:43570) 2024-09-13T02:58:32.204 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:32.201+0000 7ff9a7fff640 1 -- 172.21.15.89:0/1229469251 learned_addr learned my addr 172.21.15.89:0/1229469251 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:58:32.204 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:32.201+0000 7ff9acc21640 1 --2- 172.21.15.89:0/1229469251 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff9a80666b0 0x7ff9a810d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:58:32.204 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:32.201+0000 7ff9a7fff640 1 -- 172.21.15.89:0/1229469251 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff9a80666b0 msgr2=0x7ff9a810d180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:32.204 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:32.201+0000 7ff9a7fff640 1 --2- 172.21.15.89:0/1229469251 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff9a80666b0 0x7ff9a810d180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:32.204 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:32.201+0000 7ff9a7fff640 1 -- 172.21.15.89:0/1229469251 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff99c005040 con 0x7ff9a80ff700 2024-09-13T02:58:32.204 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:32.201+0000 7ff9acc21640 1 --2- 172.21.15.89:0/1229469251 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff9a80666b0 0x7ff9a810d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T02:58:32.204 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:32.202+0000 7ff9a7fff640 1 --2- 172.21.15.89:0/1229469251 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9a80ff700 0x7ff9a810d6c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff99400c830 tx=0x7ff994004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:58:32.204 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:32.202+0000 7ff9a57fa640 1 -- 172.21.15.89:0/1229469251 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff99400a850 con 0x7ff9a80ff700 2024-09-13T02:58:32.204 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:32.202+0000 7ff9a57fa640 1 -- 172.21.15.89:0/1229469251 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff99400ae50 con 0x7ff9a80ff700 2024-09-13T02:58:32.205 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:32.202+0000 7ff9aee85640 1 -- 172.21.15.89:0/1229469251 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9a810e770 con 0x7ff9a80ff700 2024-09-13T02:58:32.205 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:32.202+0000 7ff9aee85640 1 -- 172.21.15.89:0/1229469251 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9a810ed10 con 0x7ff9a80ff700 2024-09-13T02:58:32.205 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:32.202+0000 7ff9a57fa640 1 -- 172.21.15.89:0/1229469251 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff9940113a0 con 0x7ff9a80ff700 2024-09-13T02:58:32.205 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:32.203+0000 7ff9aee85640 1 -- 172.21.15.89:0/1229469251 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9a80fa8b0 con 0x7ff9a80ff700 2024-09-13T02:58:32.206 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:32.204+0000 7ff9a57fa640 1 -- 172.21.15.89:0/1229469251 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7ff994012400 con 0x7ff9a80ff700 2024-09-13T02:58:32.206 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:32.204+0000 7ff9a57fa640 1 --2- 172.21.15.89:0/1229469251 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7ff99806e530 0x7ff9980709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:58:32.206 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:32.204+0000 7ff9a57fa640 1 -- 172.21.15.89:0/1229469251 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6496+0+0 (secure 0 0 0) 0x7ff99408e3c0 con 0x7ff9a80ff700 2024-09-13T02:58:32.206 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:32.204+0000 7ff9acc21640 1 --2- 172.21.15.89:0/1229469251 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7ff99806e530 0x7ff9980709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:58:32.206 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:32.205+0000 7ff9acc21640 1 --2- 172.21.15.89:0/1229469251 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7ff99806e530 0x7ff9980709e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff99c0048a0 tx=0x7ff99c009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:58:32.210 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:32.208+0000 7ff9a57fa640 1 -- 172.21.15.89:0/1229469251 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7ff994057530 con 0x7ff9a80ff700 2024-09-13T02:58:32.440 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:32.438+0000 7ff9aee85640 1 -- 172.21.15.89:0/1229469251 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7ff9a810f0a0 con 0x7ff9a80ff700 2024-09-13T02:58:32.440 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:32.438+0000 7ff9a57fa640 1 -- 172.21.15.89:0/1229469251 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1071 (secure 0 0 0) 0x7ff99405abf0 con 0x7ff9a80ff700 2024-09-13T02:58:32.440 INFO:teuthology.orchestra.run.smithi089.stdout:HEALTH_WARN Degraded data redundancy: 55/357 objects degraded (15.406%), 16 pgs degraded 2024-09-13T02:58:32.440 INFO:teuthology.orchestra.run.smithi089.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 55/357 objects degraded (15.406%), 16 pgs degraded 2024-09-13T02:58:32.440 INFO:teuthology.orchestra.run.smithi089.stdout: pg 1.0 is active+undersized+degraded, acting [3,0] 2024-09-13T02:58:32.440 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.0 is active+undersized+degraded, acting [3,0] 2024-09-13T02:58:32.440 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.1 is active+undersized+degraded, acting [2,0] 2024-09-13T02:58:32.440 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.2 is active+undersized+degraded, acting [5,0] 2024-09-13T02:58:32.440 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.3 is active+undersized+degraded, acting [5,2] 2024-09-13T02:58:32.440 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.4 is active+undersized+degraded, acting [0,4] 2024-09-13T02:58:32.441 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.6 is active+undersized+degraded, acting [3,4] 2024-09-13T02:58:32.441 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.9 is active+undersized+degraded, acting [4,0] 2024-09-13T02:58:32.441 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.a is active+undersized+degraded, acting [4,3] 2024-09-13T02:58:32.441 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.d is active+undersized+degraded, acting [3,2] 2024-09-13T02:58:32.441 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.10 is active+undersized+degraded, acting [2,0] 2024-09-13T02:58:32.441 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.11 is active+undersized+degraded, acting [4,3] 2024-09-13T02:58:32.441 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.12 is active+undersized+degraded, acting [3,0] 2024-09-13T02:58:32.441 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.15 is active+undersized+degraded, acting [3,0] 2024-09-13T02:58:32.441 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.17 is active+undersized+degraded, acting [5,2] 2024-09-13T02:58:32.441 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.1b is active+undersized+degraded, acting [0,5] 2024-09-13T02:58:32.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:32.440+0000 7ff9aee85640 1 -- 172.21.15.89:0/1229469251 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7ff99806e530 msgr2=0x7ff9980709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:32.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:32.440+0000 7ff9aee85640 1 --2- 172.21.15.89:0/1229469251 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7ff99806e530 0x7ff9980709e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7ff99c0048a0 tx=0x7ff99c009da0 comp rx=0 tx=0).stop 2024-09-13T02:58:32.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:32.440+0000 7ff9aee85640 1 -- 172.21.15.89:0/1229469251 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9a80ff700 msgr2=0x7ff9a810d6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:58:32.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:32.440+0000 7ff9aee85640 1 --2- 172.21.15.89:0/1229469251 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9a80ff700 0x7ff9a810d6c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7ff99400c830 tx=0x7ff994004430 comp rx=0 tx=0).stop 2024-09-13T02:58:32.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:32.441+0000 7ff9aee85640 1 -- 172.21.15.89:0/1229469251 shutdown_connections 2024-09-13T02:58:32.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:32.441+0000 7ff9aee85640 1 --2- 172.21.15.89:0/1229469251 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7ff99806e530 0x7ff9980709e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:32.442 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:32.441+0000 7ff9aee85640 1 --2- 172.21.15.89:0/1229469251 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff9a80ff700 0x7ff9a810d6c0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:32.443 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:32.441+0000 7ff9aee85640 1 --2- 172.21.15.89:0/1229469251 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff9a80666b0 0x7ff9a810d180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:58:32.443 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:32.441+0000 7ff9aee85640 1 -- 172.21.15.89:0/1229469251 >> 172.21.15.89:0/1229469251 conn(0x7ff9a80f6c10 msgr2=0x7ff9a80f7030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:58:32.443 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:32.441+0000 7ff9aee85640 1 -- 172.21.15.89:0/1229469251 shutdown_connections 2024-09-13T02:58:32.443 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:58:32.441+0000 7ff9aee85640 1 -- 172.21.15.89:0/1229469251 wait complete. 2024-09-13T02:58:32.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:32 smithi131 ceph-mon[78839]: from='client.34228 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:58:32.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:32 smithi131 ceph-mon[78839]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-13T02:58:32.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:32 smithi131 ceph-mon[78839]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-09-13T02:58:32.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:32 smithi131 ceph-mon[78839]: from='client.34232 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:58:32.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:32 smithi131 ceph-mon[78839]: pgmap v69: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 306 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s; 55/357 objects degraded (15.406%) 2024-09-13T02:58:32.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:32 smithi131 ceph-mon[78839]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T02:58:32.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:32 smithi131 ceph-mon[78839]: osd.1 [v2:172.21.15.89:6810/3812497008,v1:172.21.15.89:6811/3812497008] boot 2024-09-13T02:58:32.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:32 smithi131 ceph-mon[78839]: osdmap e56: 6 total, 6 up, 6 in 2024-09-13T02:58:32.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:32 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T02:58:32.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:32 smithi131 ceph-mon[78839]: from='client.? 172.21.15.89:0/906855191' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T02:58:32.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:32 smithi131 ceph-mon[78839]: from='client.? 172.21.15.89:0/1229469251' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T02:58:32.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:32 smithi131 ceph-mon[78839]: osdmap e57: 6 total, 6 up, 6 in 2024-09-13T02:58:33.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:32 smithi089 ceph-mon[91553]: from='client.34228 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:58:33.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:32 smithi089 ceph-mon[91553]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-13T02:58:33.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:32 smithi089 ceph-mon[91553]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-09-13T02:58:33.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:32 smithi089 ceph-mon[91553]: from='client.34232 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:58:33.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:32 smithi089 ceph-mon[91553]: pgmap v69: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 306 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s; 55/357 objects degraded (15.406%) 2024-09-13T02:58:33.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:32 smithi089 ceph-mon[91553]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T02:58:33.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:32 smithi089 ceph-mon[91553]: osd.1 [v2:172.21.15.89:6810/3812497008,v1:172.21.15.89:6811/3812497008] boot 2024-09-13T02:58:33.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:32 smithi089 ceph-mon[91553]: osdmap e56: 6 total, 6 up, 6 in 2024-09-13T02:58:33.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:32 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-13T02:58:33.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:32 smithi089 ceph-mon[91553]: from='client.? 172.21.15.89:0/906855191' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T02:58:33.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:32 smithi089 ceph-mon[91553]: from='client.? 172.21.15.89:0/1229469251' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T02:58:33.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:32 smithi089 ceph-mon[91553]: osdmap e57: 6 total, 6 up, 6 in 2024-09-13T02:58:33.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:33 smithi089 ceph-mon[91553]: from='client.34244 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:58:33.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:33 smithi131 ceph-mon[78839]: from='client.34244 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:58:34.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:34 smithi089 ceph-mon[91553]: pgmap v72: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 306 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 55/357 objects degraded (15.406%) 2024-09-13T02:58:34.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:34 smithi131 ceph-mon[78839]: pgmap v72: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 306 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 55/357 objects degraded (15.406%) 2024-09-13T02:58:36.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:36 smithi131 ceph-mon[78839]: pgmap v73: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 306 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 55/357 objects degraded (15.406%) 2024-09-13T02:58:36.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:36 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:58:36.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:36 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:58:37.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:36 smithi089 ceph-mon[91553]: pgmap v73: 65 pgs: 16 active+undersized, 16 active+undersized+degraded, 33 active+clean; 306 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 55/357 objects degraded (15.406%) 2024-09-13T02:58:37.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:36 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:58:37.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:36 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:58:37.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:37 smithi131 ceph-mon[78839]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 55/357 objects degraded (15.406%), 16 pgs degraded) 2024-09-13T02:58:37.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:37 smithi131 ceph-mon[78839]: Cluster is now healthy 2024-09-13T02:58:38.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:37 smithi089 ceph-mon[91553]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 55/357 objects degraded (15.406%), 16 pgs degraded) 2024-09-13T02:58:38.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:37 smithi089 ceph-mon[91553]: Cluster is now healthy 2024-09-13T02:58:38.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:38 smithi131 ceph-mon[78839]: pgmap v74: 65 pgs: 65 active+clean; 306 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 2.6 KiB/s rd, 5 op/s 2024-09-13T02:58:39.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:38 smithi089 ceph-mon[91553]: pgmap v74: 65 pgs: 65 active+clean; 306 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 2.6 KiB/s rd, 5 op/s 2024-09-13T02:58:40.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:40 smithi131 ceph-mon[78839]: pgmap v75: 65 pgs: 65 active+clean; 306 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 1023 B/s rd, 2 op/s 2024-09-13T02:58:41.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:40 smithi089 ceph-mon[91553]: pgmap v75: 65 pgs: 65 active+clean; 306 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 1023 B/s rd, 2 op/s 2024-09-13T02:58:42.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:42 smithi131 ceph-mon[78839]: pgmap v76: 65 pgs: 65 active+clean; 306 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s 2024-09-13T02:58:43.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:42 smithi089 ceph-mon[91553]: pgmap v76: 65 pgs: 65 active+clean; 306 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 1.8 KiB/s rd, 3 op/s 2024-09-13T02:58:44.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:44 smithi089 ceph-mon[91553]: pgmap v77: 65 pgs: 65 active+clean; 306 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-09-13T02:58:44.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:44 smithi131 ceph-mon[78839]: pgmap v77: 65 pgs: 65 active+clean; 306 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-09-13T02:58:46.653 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:46 smithi089 ceph-mon[91553]: pgmap v78: 65 pgs: 65 active+clean; 306 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 1.5 KiB/s rd, 3 op/s 2024-09-13T02:58:46.653 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:46 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:58:46.653 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:46 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-13T02:58:46.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:46 smithi131 ceph-mon[78839]: pgmap v78: 65 pgs: 65 active+clean; 306 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 1.5 KiB/s rd, 3 op/s 2024-09-13T02:58:46.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:46 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:58:46.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:46 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-13T02:58:47.875 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:47 smithi089 ceph-mon[91553]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-13T02:58:47.875 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:47 smithi089 ceph-mon[91553]: Upgrade: osd.2 is safe to restart 2024-09-13T02:58:47.876 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:47 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:58:47.876 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:47 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-13T02:58:47.876 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:47 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:58:47.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:47 smithi131 ceph-mon[78839]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-09-13T02:58:47.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:47 smithi131 ceph-mon[78839]: Upgrade: osd.2 is safe to restart 2024-09-13T02:58:47.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:47 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:58:47.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:47 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-13T02:58:47.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:47 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:58:48.763 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:48 smithi089 ceph-mon[91553]: Upgrade: Updating osd.2 2024-09-13T02:58:48.763 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:48 smithi089 ceph-mon[91553]: Deploying daemon osd.2 on smithi089 2024-09-13T02:58:48.763 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:48 smithi089 ceph-mon[91553]: pgmap v79: 65 pgs: 65 active+clean; 306 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 2.3 KiB/s rd, 4 op/s 2024-09-13T02:58:48.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:48 smithi131 ceph-mon[78839]: Upgrade: Updating osd.2 2024-09-13T02:58:48.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:48 smithi131 ceph-mon[78839]: Deploying daemon osd.2 on smithi089 2024-09-13T02:58:48.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:48 smithi131 ceph-mon[78839]: pgmap v79: 65 pgs: 65 active+clean; 306 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 2.3 KiB/s rd, 4 op/s 2024-09-13T02:58:50.685 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:50 smithi089 ceph-mon[91553]: pgmap v80: 65 pgs: 65 active+clean; 306 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T02:58:50.685 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:50 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:58:50.685 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:50 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:58:50.686 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 02:58:50 smithi089 systemd[1]: Stopping Ceph osd.2 for 12cdb164-717a-11ef-bceb-c7b262605968... 2024-09-13T02:58:50.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:50 smithi131 ceph-mon[78839]: pgmap v80: 65 pgs: 65 active+clean; 306 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T02:58:50.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:50 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:58:50.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:50 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:58:51.035 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 02:58:50 smithi089 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-2[60601]: 2024-09-13T02:58:50.682+0000 7fb78805c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T02:58:51.035 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 02:58:50 smithi089 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-2[60601]: 2024-09-13T02:58:50.682+0000 7fb78805c640 -1 osd.2 57 *** Got signal Terminated *** 2024-09-13T02:58:51.035 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 02:58:50 smithi089 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-2[60601]: 2024-09-13T02:58:50.682+0000 7fb78805c640 -1 osd.2 57 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T02:58:51.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:51 smithi131 ceph-mon[78839]: osd.2 marked itself down and dead 2024-09-13T02:58:52.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:51 smithi089 ceph-mon[91553]: osd.2 marked itself down and dead 2024-09-13T02:58:52.452 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 02:58:52 smithi089 podman[110310]: 2024-09-13 02:58:52.175974769 +0000 UTC m=+1.612881995 container died 447cf103114b0d3830dddc4b13a4c883546bd99b9a938af3e871b2b209152828 (image=quay.ceph.io/ceph-ci/ceph@sha256:20745bd452f31fe48c67c092910f9b2c550f9dc62d239ff3e2953415a85590be, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=quincy-bbdadfa, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2) 2024-09-13T02:58:52.785 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 02:58:52 smithi089 podman[110310]: 2024-09-13 02:58:52.550089718 +0000 UTC m=+1.986996932 container cleanup 447cf103114b0d3830dddc4b13a4c883546bd99b9a938af3e871b2b209152828 (image=quay.ceph.io/ceph-ci/ceph@sha256:20745bd452f31fe48c67c092910f9b2c550f9dc62d239ff3e2953415a85590be, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=quincy-bbdadfa) 2024-09-13T02:58:52.785 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 02:58:52 smithi089 bash[110310]: ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-2 2024-09-13T02:58:52.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:52 smithi089 ceph-mon[91553]: pgmap v81: 65 pgs: 65 active+clean; 306 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T02:58:52.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:52 smithi089 ceph-mon[91553]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T02:58:52.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:52 smithi089 ceph-mon[91553]: osdmap e58: 6 total, 5 up, 6 in 2024-09-13T02:58:52.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:52 smithi131 ceph-mon[78839]: pgmap v81: 65 pgs: 65 active+clean; 306 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T02:58:52.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:52 smithi131 ceph-mon[78839]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T02:58:52.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:52 smithi131 ceph-mon[78839]: osdmap e58: 6 total, 5 up, 6 in 2024-09-13T02:58:53.189 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 02:58:52 smithi089 podman[110325]: 2024-09-13 02:58:52.859767116 +0000 UTC m=+0.680996639 container remove 447cf103114b0d3830dddc4b13a4c883546bd99b9a938af3e871b2b209152828 (image=quay.ceph.io/ceph-ci/ceph@sha256:20745bd452f31fe48c67c092910f9b2c550f9dc62d239ff3e2953415a85590be, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, CEPH_POINT_RELEASE=, RELEASE=quincy-bbdadfa, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-09-13T02:58:53.448 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 02:58:53 smithi089 podman[110415]: 2024-09-13 02:58:53.09106082 +0000 UTC m=+0.016059263 image pull 19dc8d6597273a47b0b4862f1d0e037b0157b908a02acd63baceec3ee94fbd6c quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d 2024-09-13T02:58:53.448 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 02:58:53 smithi089 podman[110415]: 2024-09-13 02:58:53.21118084 +0000 UTC m=+0.136179269 container create 680e6ed3ff5a78c3efcea5758eb79beceee5a22a3d0308060ec9695b76e2f9f4 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-2-deactivate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-7741f7f, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-13T02:58:53.448 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 02:58:53 smithi089 podman[110415]: 2024-09-13 02:58:53.446810202 +0000 UTC m=+0.371808634 container init 680e6ed3ff5a78c3efcea5758eb79beceee5a22a3d0308060ec9695b76e2f9f4 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-2-deactivate, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=squid-7741f7f, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T02:58:53.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:53 smithi089 ceph-mon[91553]: osdmap e59: 6 total, 5 up, 6 in 2024-09-13T02:58:53.785 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 02:58:53 smithi089 podman[110415]: 2024-09-13 02:58:53.450270857 +0000 UTC m=+0.375269294 container start 680e6ed3ff5a78c3efcea5758eb79beceee5a22a3d0308060ec9695b76e2f9f4 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-2-deactivate, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-7741f7f, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T02:58:53.785 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 02:58:53 smithi089 podman[110415]: 2024-09-13 02:58:53.521572078 +0000 UTC m=+0.446570522 container attach 680e6ed3ff5a78c3efcea5758eb79beceee5a22a3d0308060ec9695b76e2f9f4 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-2-deactivate, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-7741f7f, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-13T02:58:53.785 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 02:58:53 smithi089 podman[110415]: 2024-09-13 02:58:53.640723742 +0000 UTC m=+0.565722184 container died 680e6ed3ff5a78c3efcea5758eb79beceee5a22a3d0308060ec9695b76e2f9f4 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-2-deactivate, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=squid-7741f7f, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-13T02:58:53.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:53 smithi131 ceph-mon[78839]: osdmap e59: 6 total, 5 up, 6 in 2024-09-13T02:58:54.535 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 02:58:54 smithi089 podman[110438]: 2024-09-13 02:58:54.275594127 +0000 UTC m=+0.629039711 container remove 680e6ed3ff5a78c3efcea5758eb79beceee5a22a3d0308060ec9695b76e2f9f4 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-7741f7f, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2) 2024-09-13T02:58:54.535 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 02:58:54 smithi089 systemd[1]: ceph-12cdb164-717a-11ef-bceb-c7b262605968@osd.2.service: Deactivated successfully. 2024-09-13T02:58:54.535 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 02:58:54 smithi089 systemd[1]: Stopped Ceph osd.2 for 12cdb164-717a-11ef-bceb-c7b262605968. 2024-09-13T02:58:54.536 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 02:58:54 smithi089 systemd[1]: ceph-12cdb164-717a-11ef-bceb-c7b262605968@osd.2.service: Consumed 47.202s CPU time. 2024-09-13T02:58:54.536 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 02:58:54 smithi089 systemd[1]: Starting Ceph osd.2 for 12cdb164-717a-11ef-bceb-c7b262605968... 2024-09-13T02:58:54.884 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:54 smithi089 ceph-mon[91553]: pgmap v84: 65 pgs: 9 stale+active+clean, 56 active+clean; 306 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T02:58:54.885 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 02:58:54 smithi089 podman[110536]: 2024-09-13 02:58:54.622998331 +0000 UTC m=+0.016359837 image pull 19dc8d6597273a47b0b4862f1d0e037b0157b908a02acd63baceec3ee94fbd6c quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d 2024-09-13T02:58:54.885 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 02:58:54 smithi089 podman[110536]: 2024-09-13 02:58:54.759948428 +0000 UTC m=+0.153309927 container create b8622d76d5dfb3cc059a20674f698e8c3c54684864b8d54b918c5e8bcdbaec84 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-2-activate, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-7741f7f, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=) 2024-09-13T02:58:54.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:54 smithi131 ceph-mon[78839]: pgmap v84: 65 pgs: 9 stale+active+clean, 56 active+clean; 306 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T02:58:55.144 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 02:58:55 smithi089 podman[110536]: 2024-09-13 02:58:55.012401838 +0000 UTC m=+0.405763329 container init b8622d76d5dfb3cc059a20674f698e8c3c54684864b8d54b918c5e8bcdbaec84 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-2-activate, RELEASE=squid-7741f7f, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2) 2024-09-13T02:58:55.144 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 02:58:55 smithi089 podman[110536]: 2024-09-13 02:58:55.015762354 +0000 UTC m=+0.409123858 container start b8622d76d5dfb3cc059a20674f698e8c3c54684864b8d54b918c5e8bcdbaec84 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-2-activate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=squid-7741f7f, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T02:58:55.144 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 02:58:55 smithi089 podman[110536]: 2024-09-13 02:58:55.079076002 +0000 UTC m=+0.472437516 container attach b8622d76d5dfb3cc059a20674f698e8c3c54684864b8d54b918c5e8bcdbaec84 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-2-activate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-7741f7f, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-13T02:58:55.535 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 02:58:55 smithi089 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-2-activate[110551]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T02:58:55.535 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 02:58:55 smithi089 bash[110536]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T02:58:55.535 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 02:58:55 smithi089 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-2-activate[110551]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T02:58:55.535 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 02:58:55 smithi089 bash[110536]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T02:58:55.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:55 smithi131 ceph-mon[78839]: Health check failed: Degraded data redundancy: 13/357 objects degraded (3.641%), 4 pgs degraded (PG_DEGRADED) 2024-09-13T02:58:56.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:55 smithi089 ceph-mon[91553]: Health check failed: Degraded data redundancy: 13/357 objects degraded (3.641%), 4 pgs degraded (PG_DEGRADED) 2024-09-13T02:58:56.035 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 02:58:55 smithi089 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-2-activate[110551]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-13T02:58:56.035 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 02:58:55 smithi089 bash[110536]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-13T02:58:56.036 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 02:58:55 smithi089 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-2-activate[110551]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-13T02:58:56.036 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 02:58:55 smithi089 bash[110536]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-13T02:58:56.518 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 02:58:56 smithi089 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-2-activate[110551]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-13T02:58:56.518 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 02:58:56 smithi089 bash[110536]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-13T02:58:56.518 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 02:58:56 smithi089 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-2-activate[110551]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-13T02:58:56.518 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 02:58:56 smithi089 bash[110536]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-13T02:58:56.518 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 02:58:56 smithi089 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-2-activate[110551]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-09-13T02:58:56.518 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 02:58:56 smithi089 bash[110536]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-09-13T02:58:56.518 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 02:58:56 smithi089 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-2-activate[110551]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-13T02:58:56.518 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 02:58:56 smithi089 bash[110536]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-13T02:58:56.518 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 02:58:56 smithi089 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-2-activate[110551]: --> ceph-volume raw activate successful for osd ID: 2 2024-09-13T02:58:56.519 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 02:58:56 smithi089 bash[110536]: --> ceph-volume raw activate successful for osd ID: 2 2024-09-13T02:58:56.519 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 02:58:56 smithi089 podman[110536]: 2024-09-13 02:58:56.204941199 +0000 UTC m=+1.598302698 container died b8622d76d5dfb3cc059a20674f698e8c3c54684864b8d54b918c5e8bcdbaec84 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-2-activate, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-7741f7f, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-13T02:58:56.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:56 smithi089 ceph-mon[91553]: pgmap v85: 65 pgs: 4 active+undersized, 6 stale+active+clean, 4 active+undersized+degraded, 51 active+clean; 306 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 13/357 objects degraded (3.641%) 2024-09-13T02:58:56.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:56 smithi131 ceph-mon[78839]: pgmap v85: 65 pgs: 4 active+undersized, 6 stale+active+clean, 4 active+undersized+degraded, 51 active+clean; 306 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 13/357 objects degraded (3.641%) 2024-09-13T02:58:57.150 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 02:58:56 smithi089 podman[110691]: 2024-09-13 02:58:56.816574607 +0000 UTC m=+0.605627018 container remove b8622d76d5dfb3cc059a20674f698e8c3c54684864b8d54b918c5e8bcdbaec84 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-2-activate, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-7741f7f, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T02:58:57.150 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 02:58:57 smithi089 podman[110762]: 2024-09-13 02:58:56.925487438 +0000 UTC m=+0.016004054 image pull 19dc8d6597273a47b0b4862f1d0e037b0157b908a02acd63baceec3ee94fbd6c quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d 2024-09-13T02:58:57.151 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 02:58:57 smithi089 podman[110762]: 2024-09-13 02:58:57.042507175 +0000 UTC m=+0.133023785 container create 2d8cab08c2b3f3d62b780c9307168b9e877136751fa454307ace42a2affdf478 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=squid-7741f7f, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-13T02:58:57.535 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 02:58:57 smithi089 podman[110762]: 2024-09-13 02:58:57.286640276 +0000 UTC m=+0.377156895 container init 2d8cab08c2b3f3d62b780c9307168b9e877136751fa454307ace42a2affdf478 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-7741f7f, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-13T02:58:57.535 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 02:58:57 smithi089 podman[110762]: 2024-09-13 02:58:57.290043067 +0000 UTC m=+0.380559675 container start 2d8cab08c2b3f3d62b780c9307168b9e877136751fa454307ace42a2affdf478 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-2, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-7741f7f, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True) 2024-09-13T02:58:57.535 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 02:58:57 smithi089 ceph-osd[110781]: -- 172.21.15.89:0/3282988533 <== mon.0 v2:172.21.15.89:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56358b3181e0 con 0x56358a4c5c00 2024-09-13T02:58:57.535 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 02:58:57 smithi089 bash[110762]: 2d8cab08c2b3f3d62b780c9307168b9e877136751fa454307ace42a2affdf478 2024-09-13T02:58:57.535 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 02:58:57 smithi089 systemd[1]: Started Ceph osd.2 for 12cdb164-717a-11ef-bceb-c7b262605968. 2024-09-13T02:58:58.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:58 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:58:58.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:58 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:58:58.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:58 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:58:58.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:58:58 smithi089 ceph-mon[91553]: pgmap v86: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 306 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 43/357 objects degraded (12.045%) 2024-09-13T02:58:58.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:58 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:58:58.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:58 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:58:58.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:58 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:58:58.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:58:58 smithi131 ceph-mon[78839]: pgmap v86: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 306 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 43/357 objects degraded (12.045%) 2024-09-13T02:58:59.053 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 02:58:58 smithi089 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-2[110777]: 2024-09-13T02:58:58.917+0000 7f9475030640 -1 Falling back to public interface 2024-09-13T02:59:00.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:00 smithi131 ceph-mon[78839]: pgmap v87: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 306 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 43/357 objects degraded (12.045%) 2024-09-13T02:59:01.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:00 smithi089 ceph-mon[91553]: pgmap v87: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 306 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 43/357 objects degraded (12.045%) 2024-09-13T02:59:02.527 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:02.525+0000 7f55dd528640 1 -- 172.21.15.89:0/3039893568 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55d8101ae0 msgr2=0x7f55d8103ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:02.527 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:02.525+0000 7f55dd528640 1 --2- 172.21.15.89:0/3039893568 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55d8101ae0 0x7f55d8103ec0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f55cc0048d0 tx=0x7f55cc009da0 comp rx=0 tx=0).stop 2024-09-13T02:59:02.527 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:02.525+0000 7f55dd528640 1 -- 172.21.15.89:0/3039893568 shutdown_connections 2024-09-13T02:59:02.527 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:02.525+0000 7f55dd528640 1 --2- 172.21.15.89:0/3039893568 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55d8101ae0 0x7f55d8103ec0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:02.527 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:02.525+0000 7f55dd528640 1 --2- 172.21.15.89:0/3039893568 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f55d8065be0 0x7f55d81015a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:02.527 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:02.525+0000 7f55dd528640 1 -- 172.21.15.89:0/3039893568 >> 172.21.15.89:0/3039893568 conn(0x7f55d80f6c10 msgr2=0x7f55d80f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:59:02.527 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:02.525+0000 7f55dd528640 1 -- 172.21.15.89:0/3039893568 shutdown_connections 2024-09-13T02:59:02.528 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:02.525+0000 7f55dd528640 1 -- 172.21.15.89:0/3039893568 wait complete. 2024-09-13T02:59:02.528 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:02.526+0000 7f55dd528640 1 Processor -- start 2024-09-13T02:59:02.528 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:02.526+0000 7f55dd528640 1 -- start start 2024-09-13T02:59:02.529 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:02.526+0000 7f55dd528640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55d8065be0 0x7f55d810f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:59:02.529 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:02.526+0000 7f55dd528640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f55d8101ae0 0x7f55d810f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:59:02.529 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:02.526+0000 7f55dd528640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55d810fdd0 con 0x7f55d8065be0 2024-09-13T02:59:02.529 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:02.526+0000 7f55dd528640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55d81105f0 con 0x7f55d8101ae0 2024-09-13T02:59:02.529 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:02.526+0000 7f55d6ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55d8065be0 0x7f55d810f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:59:02.530 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:02.526+0000 7f55d6ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55d8065be0 0x7f55d810f240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:56042/0 (socket says 172.21.15.89:56042) 2024-09-13T02:59:02.530 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:02.526+0000 7f55d6ffd640 1 -- 172.21.15.89:0/711237838 learned_addr learned my addr 172.21.15.89:0/711237838 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:59:02.530 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:02.526+0000 7f55d67fc640 1 --2- 172.21.15.89:0/711237838 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f55d8101ae0 0x7f55d810f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:59:02.530 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:02.527+0000 7f55d6ffd640 1 -- 172.21.15.89:0/711237838 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f55d8101ae0 msgr2=0x7f55d810f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:02.530 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:02.527+0000 7f55d6ffd640 1 --2- 172.21.15.89:0/711237838 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f55d8101ae0 0x7f55d810f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:02.530 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:02.527+0000 7f55d6ffd640 1 -- 172.21.15.89:0/711237838 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55cc005040 con 0x7f55d8065be0 2024-09-13T02:59:02.530 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:02.527+0000 7f55d6ffd640 1 --2- 172.21.15.89:0/711237838 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55d8065be0 0x7f55d810f240 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f55c800c810 tx=0x7f55c80043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:59:02.530 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:02.527+0000 7f55bf7fe640 1 -- 172.21.15.89:0/711237838 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f55c800a7a0 con 0x7f55d8065be0 2024-09-13T02:59:02.530 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:02.527+0000 7f55dd528640 1 -- 172.21.15.89:0/711237838 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55d8110880 con 0x7f55d8065be0 2024-09-13T02:59:02.530 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:02.527+0000 7f55bf7fe640 1 -- 172.21.15.89:0/711237838 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f55c800ada0 con 0x7f55d8065be0 2024-09-13T02:59:02.530 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:02.527+0000 7f55bf7fe640 1 -- 172.21.15.89:0/711237838 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f55c8011380 con 0x7f55d8065be0 2024-09-13T02:59:02.530 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:02.527+0000 7f55dd528640 1 -- 172.21.15.89:0/711237838 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55d8110df0 con 0x7f55d8065be0 2024-09-13T02:59:02.531 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:02.529+0000 7f55dd528640 1 -- 172.21.15.89:0/711237838 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55d8107950 con 0x7f55d8065be0 2024-09-13T02:59:02.531 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:02.529+0000 7f55bf7fe640 1 -- 172.21.15.89:0/711237838 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f55c8012420 con 0x7f55d8065be0 2024-09-13T02:59:02.531 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:02.529+0000 7f55bf7fe640 1 --2- 172.21.15.89:0/711237838 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f55c006e530 0x7f55c00709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:59:02.532 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:02.530+0000 7f55bf7fe640 1 -- 172.21.15.89:0/711237838 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f55c808e560 con 0x7f55d8065be0 2024-09-13T02:59:02.532 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:02.530+0000 7f55d67fc640 1 --2- 172.21.15.89:0/711237838 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f55c006e530 0x7f55c00709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:59:02.532 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:02.530+0000 7f55d67fc640 1 --2- 172.21.15.89:0/711237838 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f55c006e530 0x7f55c00709e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f55cc000c00 tx=0x7f55cc035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:59:02.535 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:02.534+0000 7f55bf7fe640 1 -- 172.21.15.89:0/711237838 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f55c8057650 con 0x7f55d8065be0 2024-09-13T02:59:02.760 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:02.759+0000 7f55dd528640 1 -- 172.21.15.89:0/711237838 --> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f55d8111150 con 0x7f55c006e530 2024-09-13T02:59:02.761 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:02.760+0000 7f55bf7fe640 1 -- 172.21.15.89:0/711237838 <== mgr.34104 v2:172.21.15.89:6800/1881577856 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f55d8111150 con 0x7f55c006e530 2024-09-13T02:59:02.764 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:02.762+0000 7f55dd528640 1 -- 172.21.15.89:0/711237838 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f55c006e530 msgr2=0x7f55c00709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:02.764 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:02.762+0000 7f55dd528640 1 --2- 172.21.15.89:0/711237838 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f55c006e530 0x7f55c00709e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f55cc000c00 tx=0x7f55cc035040 comp rx=0 tx=0).stop 2024-09-13T02:59:02.764 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:02.762+0000 7f55dd528640 1 -- 172.21.15.89:0/711237838 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55d8065be0 msgr2=0x7f55d810f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:02.764 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:02.762+0000 7f55dd528640 1 --2- 172.21.15.89:0/711237838 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55d8065be0 0x7f55d810f240 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f55c800c810 tx=0x7f55c80043c0 comp rx=0 tx=0).stop 2024-09-13T02:59:02.764 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:02.762+0000 7f55dd528640 1 -- 172.21.15.89:0/711237838 shutdown_connections 2024-09-13T02:59:02.764 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:02.762+0000 7f55dd528640 1 --2- 172.21.15.89:0/711237838 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f55c006e530 0x7f55c00709e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:02.764 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:02.762+0000 7f55dd528640 1 --2- 172.21.15.89:0/711237838 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f55d8101ae0 0x7f55d810f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:02.764 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:02.762+0000 7f55dd528640 1 --2- 172.21.15.89:0/711237838 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55d8065be0 0x7f55d810f240 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:02.764 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:02.762+0000 7f55dd528640 1 -- 172.21.15.89:0/711237838 >> 172.21.15.89:0/711237838 conn(0x7f55d80f6c10 msgr2=0x7f55d80f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:59:02.764 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:02.762+0000 7f55dd528640 1 -- 172.21.15.89:0/711237838 shutdown_connections 2024-09-13T02:59:02.764 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:02.762+0000 7f55dd528640 1 -- 172.21.15.89:0/711237838 wait complete. 2024-09-13T02:59:02.773 INFO:teuthology.orchestra.run.smithi089.stdout:true 2024-09-13T02:59:02.846 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:02.845+0000 7f53d008a640 1 -- 172.21.15.89:0/3873085064 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53c80fc700 msgr2=0x7f53c80fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:02.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:02.845+0000 7f53d008a640 1 --2- 172.21.15.89:0/3873085064 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53c80fc700 0x7f53c80fcb70 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f53b80048d0 tx=0x7f53b8009da0 comp rx=0 tx=0).stop 2024-09-13T02:59:02.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:02.845+0000 7f53d008a640 1 -- 172.21.15.89:0/3873085064 shutdown_connections 2024-09-13T02:59:02.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:02.845+0000 7f53d008a640 1 --2- 172.21.15.89:0/3873085064 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53c80fc700 0x7f53c80fcb70 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:02.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:02.845+0000 7f53d008a640 1 --2- 172.21.15.89:0/3873085064 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f53c80fb430 0x7f53c80fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:02.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:02.845+0000 7f53d008a640 1 -- 172.21.15.89:0/3873085064 >> 172.21.15.89:0/3873085064 conn(0x7f53c80f6c10 msgr2=0x7f53c80f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:59:02.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:02.845+0000 7f53d008a640 1 -- 172.21.15.89:0/3873085064 shutdown_connections 2024-09-13T02:59:02.847 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:02.845+0000 7f53d008a640 1 -- 172.21.15.89:0/3873085064 wait complete. 2024-09-13T02:59:02.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:02.846+0000 7f53d008a640 1 Processor -- start 2024-09-13T02:59:02.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:02.846+0000 7f53d008a640 1 -- start start 2024-09-13T02:59:02.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:02.846+0000 7f53d008a640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f53c80fb430 0x7f53c80ff550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:59:02.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:02.846+0000 7f53d008a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53c80fc700 0x7f53c80fda40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:59:02.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:02.846+0000 7f53d008a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53c80fdfd0 con 0x7f53c80fc700 2024-09-13T02:59:02.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:02.846+0000 7f53d008a640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53c80fe110 con 0x7f53c80fb430 2024-09-13T02:59:02.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:02.846+0000 7f53cd625640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53c80fc700 0x7f53c80fda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:59:02.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:02.846+0000 7f53cd625640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53c80fc700 0x7f53c80fda40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:56064/0 (socket says 172.21.15.89:56064) 2024-09-13T02:59:02.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:02.846+0000 7f53cd625640 1 -- 172.21.15.89:0/3543497494 learned_addr learned my addr 172.21.15.89:0/3543497494 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:59:02.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:02.846+0000 7f53cde26640 1 --2- 172.21.15.89:0/3543497494 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f53c80fb430 0x7f53c80ff550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:59:02.849 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:02.846+0000 7f53cd625640 1 -- 172.21.15.89:0/3543497494 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f53c80fb430 msgr2=0x7f53c80ff550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:02.850 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:02.846+0000 7f53cd625640 1 --2- 172.21.15.89:0/3543497494 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f53c80fb430 0x7f53c80ff550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:02.850 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:02.846+0000 7f53cd625640 1 -- 172.21.15.89:0/3543497494 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53b8005040 con 0x7f53c80fc700 2024-09-13T02:59:02.850 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:02.846+0000 7f53cd625640 1 --2- 172.21.15.89:0/3543497494 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53c80fc700 0x7f53c80fda40 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f53b80048a0 tx=0x7f53b8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:59:02.850 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:02.847+0000 7f53be7fc640 1 -- 172.21.15.89:0/3543497494 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f53b8038070 con 0x7f53c80fc700 2024-09-13T02:59:02.850 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:02.847+0000 7f53be7fc640 1 -- 172.21.15.89:0/3543497494 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f53b8004290 con 0x7f53c80fc700 2024-09-13T02:59:02.850 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:02.847+0000 7f53d008a640 1 -- 172.21.15.89:0/3543497494 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53c80fe390 con 0x7f53c80fc700 2024-09-13T02:59:02.850 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:02.847+0000 7f53be7fc640 1 -- 172.21.15.89:0/3543497494 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f53b8033660 con 0x7f53c80fc700 2024-09-13T02:59:02.850 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:02.847+0000 7f53d008a640 1 -- 172.21.15.89:0/3543497494 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53c81150b0 con 0x7f53c80fc700 2024-09-13T02:59:02.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:02.848+0000 7f53d008a640 1 -- 172.21.15.89:0/3543497494 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53c80fa890 con 0x7f53c80fc700 2024-09-13T02:59:02.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:02.848+0000 7f53be7fc640 1 -- 172.21.15.89:0/3543497494 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f53b8030020 con 0x7f53c80fc700 2024-09-13T02:59:02.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:02.849+0000 7f53be7fc640 1 --2- 172.21.15.89:0/3543497494 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f53b406e530 0x7f53b40709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:59:02.851 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:02.849+0000 7f53be7fc640 1 -- 172.21.15.89:0/3543497494 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f53b80ae2b0 con 0x7f53c80fc700 2024-09-13T02:59:02.852 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:02.849+0000 7f53cde26640 1 --2- 172.21.15.89:0/3543497494 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f53b406e530 0x7f53b40709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:59:02.852 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:02.849+0000 7f53cde26640 1 --2- 172.21.15.89:0/3543497494 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f53b406e530 0x7f53b40709e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f53c80ff300 tx=0x7f53c000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:59:02.855 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:02.853+0000 7f53be7fc640 1 -- 172.21.15.89:0/3543497494 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f53b8077450 con 0x7f53c80fc700 2024-09-13T02:59:02.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:02 smithi131 ceph-mon[78839]: pgmap v88: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 306 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 43/357 objects degraded (12.045%) 2024-09-13T02:59:02.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:02 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:59:02.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:02 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:59:03.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:02 smithi089 ceph-mon[91553]: pgmap v88: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 306 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 43/357 objects degraded (12.045%) 2024-09-13T02:59:03.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:02 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:59:03.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:02 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:59:03.068 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.067+0000 7f53d008a640 1 -- 172.21.15.89:0/3543497494 --> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f53c8103f60 con 0x7f53b406e530 2024-09-13T02:59:03.074 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.068+0000 7f53be7fc640 1 -- 172.21.15.89:0/3543497494 <== mgr.34104 v2:172.21.15.89:6800/1881577856 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f53c8103f60 con 0x7f53b406e530 2024-09-13T02:59:03.074 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.070+0000 7f53d008a640 1 -- 172.21.15.89:0/3543497494 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f53b406e530 msgr2=0x7f53b40709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:03.074 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.070+0000 7f53d008a640 1 --2- 172.21.15.89:0/3543497494 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f53b406e530 0x7f53b40709e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f53c80ff300 tx=0x7f53c000b040 comp rx=0 tx=0).stop 2024-09-13T02:59:03.074 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.070+0000 7f53d008a640 1 -- 172.21.15.89:0/3543497494 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53c80fc700 msgr2=0x7f53c80fda40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:03.074 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.070+0000 7f53d008a640 1 --2- 172.21.15.89:0/3543497494 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53c80fc700 0x7f53c80fda40 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f53b80048a0 tx=0x7f53b8009da0 comp rx=0 tx=0).stop 2024-09-13T02:59:03.074 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.070+0000 7f53d008a640 1 -- 172.21.15.89:0/3543497494 shutdown_connections 2024-09-13T02:59:03.074 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.070+0000 7f53d008a640 1 --2- 172.21.15.89:0/3543497494 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f53b406e530 0x7f53b40709e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:03.074 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.070+0000 7f53d008a640 1 --2- 172.21.15.89:0/3543497494 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f53c80fc700 0x7f53c80fda40 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:03.074 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.070+0000 7f53d008a640 1 --2- 172.21.15.89:0/3543497494 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f53c80fb430 0x7f53c80ff550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:03.074 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.070+0000 7f53d008a640 1 -- 172.21.15.89:0/3543497494 >> 172.21.15.89:0/3543497494 conn(0x7f53c80f6c10 msgr2=0x7f53c8065610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:59:03.074 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.070+0000 7f53d008a640 1 -- 172.21.15.89:0/3543497494 shutdown_connections 2024-09-13T02:59:03.075 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.070+0000 7f53d008a640 1 -- 172.21.15.89:0/3543497494 wait complete. 2024-09-13T02:59:03.156 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.153+0000 7f0e33218640 1 -- 172.21.15.89:0/446973553 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e2c0fb430 msgr2=0x7f0e2c0fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:03.156 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.153+0000 7f0e33218640 1 --2- 172.21.15.89:0/446973553 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e2c0fb430 0x7f0e2c0fb840 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f0e200048d0 tx=0x7f0e20009da0 comp rx=0 tx=0).stop 2024-09-13T02:59:03.157 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.153+0000 7f0e33218640 1 -- 172.21.15.89:0/446973553 shutdown_connections 2024-09-13T02:59:03.157 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.153+0000 7f0e33218640 1 --2- 172.21.15.89:0/446973553 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0e2c0fc700 0x7f0e2c0fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:03.157 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.153+0000 7f0e33218640 1 --2- 172.21.15.89:0/446973553 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e2c0fb430 0x7f0e2c0fb840 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:03.157 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.153+0000 7f0e33218640 1 -- 172.21.15.89:0/446973553 >> 172.21.15.89:0/446973553 conn(0x7f0e2c0f6c10 msgr2=0x7f0e2c0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:59:03.157 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.153+0000 7f0e33218640 1 -- 172.21.15.89:0/446973553 shutdown_connections 2024-09-13T02:59:03.157 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.153+0000 7f0e33218640 1 -- 172.21.15.89:0/446973553 wait complete. 2024-09-13T02:59:03.157 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.154+0000 7f0e33218640 1 Processor -- start 2024-09-13T02:59:03.157 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.154+0000 7f0e33218640 1 -- start start 2024-09-13T02:59:03.157 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.154+0000 7f0e33218640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e2c0fb430 0x7f0e2c10f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:59:03.157 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.154+0000 7f0e33218640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0e2c0fc700 0x7f0e2c10f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:59:03.157 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.154+0000 7f0e33218640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e2c10fe20 con 0x7f0e2c0fb430 2024-09-13T02:59:03.157 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.154+0000 7f0e33218640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e2c110640 con 0x7f0e2c0fc700 2024-09-13T02:59:03.157 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.154+0000 7f0e30fb4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e2c0fb430 0x7f0e2c10f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:59:03.158 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.154+0000 7f0e30fb4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e2c0fb430 0x7f0e2c10f290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:56082/0 (socket says 172.21.15.89:56082) 2024-09-13T02:59:03.158 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.154+0000 7f0e30fb4640 1 -- 172.21.15.89:0/34387919 learned_addr learned my addr 172.21.15.89:0/34387919 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:59:03.158 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.154+0000 7f0e2bfff640 1 --2- 172.21.15.89:0/34387919 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0e2c0fc700 0x7f0e2c10f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:59:03.158 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.154+0000 7f0e30fb4640 1 -- 172.21.15.89:0/34387919 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0e2c0fc700 msgr2=0x7f0e2c10f7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:03.158 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.154+0000 7f0e30fb4640 1 --2- 172.21.15.89:0/34387919 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0e2c0fc700 0x7f0e2c10f7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:03.158 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.154+0000 7f0e30fb4640 1 -- 172.21.15.89:0/34387919 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e20005040 con 0x7f0e2c0fb430 2024-09-13T02:59:03.158 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.155+0000 7f0e30fb4640 1 --2- 172.21.15.89:0/34387919 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e2c0fb430 0x7f0e2c10f290 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0e200043d0 tx=0x7f0e20009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:59:03.158 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.155+0000 7f0e297fa640 1 -- 172.21.15.89:0/34387919 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e20038070 con 0x7f0e2c0fb430 2024-09-13T02:59:03.158 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.155+0000 7f0e297fa640 1 -- 172.21.15.89:0/34387919 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0e2002ae90 con 0x7f0e2c0fb430 2024-09-13T02:59:03.158 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.155+0000 7f0e33218640 1 -- 172.21.15.89:0/34387919 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e2c110870 con 0x7f0e2c0fb430 2024-09-13T02:59:03.158 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.155+0000 7f0e297fa640 1 -- 172.21.15.89:0/34387919 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0e2003e670 con 0x7f0e2c0fb430 2024-09-13T02:59:03.158 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.155+0000 7f0e33218640 1 -- 172.21.15.89:0/34387919 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e2c110e10 con 0x7f0e2c0fb430 2024-09-13T02:59:03.159 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.156+0000 7f0e33218640 1 -- 172.21.15.89:0/34387919 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e2c0fa890 con 0x7f0e2c0fb430 2024-09-13T02:59:03.159 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.156+0000 7f0e297fa640 1 -- 172.21.15.89:0/34387919 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f0e20030020 con 0x7f0e2c0fb430 2024-09-13T02:59:03.159 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.157+0000 7f0e297fa640 1 --2- 172.21.15.89:0/34387919 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f0e1c06e530 0x7f0e1c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:59:03.159 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.157+0000 7f0e297fa640 1 -- 172.21.15.89:0/34387919 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f0e200ae3a0 con 0x7f0e2c0fb430 2024-09-13T02:59:03.159 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.157+0000 7f0e2bfff640 1 --2- 172.21.15.89:0/34387919 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f0e1c06e530 0x7f0e1c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:59:03.160 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.157+0000 7f0e2bfff640 1 --2- 172.21.15.89:0/34387919 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f0e1c06e530 0x7f0e1c0709e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0e18007fd0 tx=0x7f0e18009e90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:59:03.162 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.161+0000 7f0e297fa640 1 -- 172.21.15.89:0/34387919 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f0e20077510 con 0x7f0e2c0fb430 2024-09-13T02:59:03.351 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.349+0000 7f0e33218640 1 -- 172.21.15.89:0/34387919 --> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f0e2c111080 con 0x7f0e1c06e530 2024-09-13T02:59:03.359 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.358+0000 7f0e297fa640 1 -- 172.21.15.89:0/34387919 <== mgr.34104 v2:172.21.15.89:6800/1881577856 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f0e2c111080 con 0x7f0e1c06e530 2024-09-13T02:59:03.359 INFO:teuthology.orchestra.run.smithi089.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T02:59:03.359 INFO:teuthology.orchestra.run.smithi089.stdout:alertmanager.smithi089 smithi089 *:9093,9094 running (3m) 1s ago 12m 25.7M - 0.25.0 c8568f914cd2 1d2432f5479e 2024-09-13T02:59:03.360 INFO:teuthology.orchestra.run.smithi089.stdout:crash.smithi089 smithi089 running (101s) 1s ago 12m 6891k - 19.1.1-322-g7741f7f9 19dc8d659727 0ef15ca3e7f9 2024-09-13T02:59:03.360 INFO:teuthology.orchestra.run.smithi089.stdout:crash.smithi131 smithi131 running (96s) 92s ago 11m 6895k - 19.1.1-322-g7741f7f9 19dc8d659727 21e4d6fc04f7 2024-09-13T02:59:03.360 INFO:teuthology.orchestra.run.smithi089.stdout:grafana.smithi089 smithi089 *:3000 running (3m) 1s ago 12m 79.0M - 9.4.7 954c08fa6188 dee914ded1af 2024-09-13T02:59:03.360 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi089.qjoitb smithi089 running (7m) 1s ago 7m 70.3M - 17.2.7-1627-gbbdadfa3 a994b00deb3a ff9b59ec5107 2024-09-13T02:59:03.360 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi089.rarddb smithi089 running (7m) 1s ago 7m 135M - 17.2.7-1627-gbbdadfa3 a994b00deb3a db2dc502c1ba 2024-09-13T02:59:03.360 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi131.rbovzc smithi131 running (7m) 92s ago 7m 60.5M - 17.2.7-1627-gbbdadfa3 a994b00deb3a d071b6d99537 2024-09-13T02:59:03.360 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi131.uasrkg smithi131 running (7m) 92s ago 7m 112M - 17.2.7-1627-gbbdadfa3 a994b00deb3a 0b3d4ffa6ce5 2024-09-13T02:59:03.360 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.smithi089.guohvs smithi089 *:8443,9283,8765 running (3m) 1s ago 13m 498M - 19.1.1-322-g7741f7f9 19dc8d659727 1e887446f1b0 2024-09-13T02:59:03.360 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.smithi131.aunbqd smithi131 *:8443,9283,8765 running (2m) 92s ago 11m 439M - 19.1.1-322-g7741f7f9 19dc8d659727 358d7478f2ba 2024-09-13T02:59:03.360 INFO:teuthology.orchestra.run.smithi089.stdout:mon.smithi089 smithi089 running (2m) 1s ago 13m 46.4M 2048M 19.1.1-322-g7741f7f9 19dc8d659727 8a29fb65028f 2024-09-13T02:59:03.360 INFO:teuthology.orchestra.run.smithi089.stdout:mon.smithi131 smithi131 running (2m) 92s ago 11m 37.6M 2048M 19.1.1-322-g7741f7f9 19dc8d659727 506310ad8620 2024-09-13T02:59:03.360 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.smithi089 smithi089 *:9100 running (3m) 1s ago 12m 16.9M - 1.5.0 0da6a335fe13 5a9927b583e6 2024-09-13T02:59:03.360 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.smithi131 smithi131 *:9100 running (3m) 92s ago 11m 15.3M - 1.5.0 0da6a335fe13 bcfde5d1a508 2024-09-13T02:59:03.361 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0 smithi089 running (76s) 1s ago 10m 93.7M 1557M 19.1.1-322-g7741f7f9 19dc8d659727 e8038f6d52b6 2024-09-13T02:59:03.361 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1 smithi089 running (41s) 1s ago 10m 94.5M 1557M 19.1.1-322-g7741f7f9 19dc8d659727 e174144d9633 2024-09-13T02:59:03.361 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2 smithi089 running (6s) 1s ago 9m 11.2M 1557M 19.1.1-322-g7741f7f9 19dc8d659727 2d8cab08c2b3 2024-09-13T02:59:03.361 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3 smithi131 running (9m) 92s ago 9m 264M 2581M 17.2.7-1627-gbbdadfa3 a994b00deb3a 0b80a4dea862 2024-09-13T02:59:03.361 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4 smithi131 running (9m) 92s ago 9m 236M 2581M 17.2.7-1627-gbbdadfa3 a994b00deb3a 06ec44680b00 2024-09-13T02:59:03.361 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5 smithi131 running (8m) 92s ago 8m 231M 2581M 17.2.7-1627-gbbdadfa3 a994b00deb3a ace4b45e5873 2024-09-13T02:59:03.361 INFO:teuthology.orchestra.run.smithi089.stdout:prometheus.smithi089 smithi089 *:9095 running (2m) 1s ago 12m 56.4M - 2.43.0 a07b618ecd1d 9d336370c187 2024-09-13T02:59:03.361 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.360+0000 7f0e33218640 1 -- 172.21.15.89:0/34387919 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f0e1c06e530 msgr2=0x7f0e1c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:03.362 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.360+0000 7f0e33218640 1 --2- 172.21.15.89:0/34387919 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f0e1c06e530 0x7f0e1c0709e0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f0e18007fd0 tx=0x7f0e18009e90 comp rx=0 tx=0).stop 2024-09-13T02:59:03.363 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.360+0000 7f0e33218640 1 -- 172.21.15.89:0/34387919 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e2c0fb430 msgr2=0x7f0e2c10f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:03.363 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.360+0000 7f0e33218640 1 --2- 172.21.15.89:0/34387919 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e2c0fb430 0x7f0e2c10f290 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0e200043d0 tx=0x7f0e20009da0 comp rx=0 tx=0).stop 2024-09-13T02:59:03.363 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.360+0000 7f0e33218640 1 -- 172.21.15.89:0/34387919 shutdown_connections 2024-09-13T02:59:03.363 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.360+0000 7f0e33218640 1 --2- 172.21.15.89:0/34387919 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f0e1c06e530 0x7f0e1c0709e0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:03.363 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.360+0000 7f0e33218640 1 --2- 172.21.15.89:0/34387919 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0e2c0fc700 0x7f0e2c10f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:03.363 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.360+0000 7f0e33218640 1 --2- 172.21.15.89:0/34387919 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0e2c0fb430 0x7f0e2c10f290 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:03.363 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.360+0000 7f0e33218640 1 -- 172.21.15.89:0/34387919 >> 172.21.15.89:0/34387919 conn(0x7f0e2c0f6c10 msgr2=0x7f0e2c065620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:59:03.363 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.361+0000 7f0e33218640 1 -- 172.21.15.89:0/34387919 shutdown_connections 2024-09-13T02:59:03.363 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.361+0000 7f0e33218640 1 -- 172.21.15.89:0/34387919 wait complete. 2024-09-13T02:59:03.443 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.441+0000 7f1d85ddf640 1 -- 172.21.15.89:0/2930082613 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1d80065b80 msgr2=0x7f1d800ff200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:03.443 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.441+0000 7f1d85ddf640 1 --2- 172.21.15.89:0/2930082613 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1d80065b80 0x7f1d800ff200 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1d78009c50 tx=0x7f1d78004d10 comp rx=0 tx=0).stop 2024-09-13T02:59:03.443 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.441+0000 7f1d85ddf640 1 -- 172.21.15.89:0/2930082613 shutdown_connections 2024-09-13T02:59:03.443 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.441+0000 7f1d85ddf640 1 --2- 172.21.15.89:0/2930082613 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d800ff740 0x7f1d80101b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:03.443 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.441+0000 7f1d85ddf640 1 --2- 172.21.15.89:0/2930082613 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1d80065b80 0x7f1d800ff200 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:03.444 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.441+0000 7f1d85ddf640 1 -- 172.21.15.89:0/2930082613 >> 172.21.15.89:0/2930082613 conn(0x7f1d800f6c10 msgr2=0x7f1d800f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:59:03.444 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.442+0000 7f1d85ddf640 1 -- 172.21.15.89:0/2930082613 shutdown_connections 2024-09-13T02:59:03.444 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.442+0000 7f1d85ddf640 1 -- 172.21.15.89:0/2930082613 wait complete. 2024-09-13T02:59:03.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.442+0000 7f1d85ddf640 1 Processor -- start 2024-09-13T02:59:03.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.442+0000 7f1d85ddf640 1 -- start start 2024-09-13T02:59:03.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.443+0000 7f1d85ddf640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1d80065b80 0x7f1d8010d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:59:03.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.443+0000 7f1d85ddf640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d800ff740 0x7f1d8010d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:59:03.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.443+0000 7f1d85ddf640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d8010e4c0 con 0x7f1d80065b80 2024-09-13T02:59:03.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.443+0000 7f1d85ddf640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d8010e630 con 0x7f1d800ff740 2024-09-13T02:59:03.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.443+0000 7f1d7f7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1d80065b80 0x7f1d8010d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:59:03.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.443+0000 7f1d7f7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1d80065b80 0x7f1d8010d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:56094/0 (socket says 172.21.15.89:56094) 2024-09-13T02:59:03.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.443+0000 7f1d7f7fe640 1 -- 172.21.15.89:0/3408301135 learned_addr learned my addr 172.21.15.89:0/3408301135 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:59:03.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.443+0000 7f1d7effd640 1 --2- 172.21.15.89:0/3408301135 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d800ff740 0x7f1d8010d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:59:03.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.443+0000 7f1d7f7fe640 1 -- 172.21.15.89:0/3408301135 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d800ff740 msgr2=0x7f1d8010d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:03.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.443+0000 7f1d7f7fe640 1 --2- 172.21.15.89:0/3408301135 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d800ff740 0x7f1d8010d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:03.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.443+0000 7f1d7f7fe640 1 -- 172.21.15.89:0/3408301135 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d780098b0 con 0x7f1d80065b80 2024-09-13T02:59:03.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.443+0000 7f1d7f7fe640 1 --2- 172.21.15.89:0/3408301135 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1d80065b80 0x7f1d8010d110 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1d78000f80 tx=0x7f1d78004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:59:03.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.444+0000 7f1d77fff640 1 -- 172.21.15.89:0/3408301135 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1d78032850 con 0x7f1d80065b80 2024-09-13T02:59:03.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.444+0000 7f1d77fff640 1 -- 172.21.15.89:0/3408301135 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f1d78009710 con 0x7f1d80065b80 2024-09-13T02:59:03.447 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.444+0000 7f1d77fff640 1 -- 172.21.15.89:0/3408301135 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1d7803db20 con 0x7f1d80065b80 2024-09-13T02:59:03.447 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.444+0000 7f1d85ddf640 1 -- 172.21.15.89:0/3408301135 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d8010e8b0 con 0x7f1d80065b80 2024-09-13T02:59:03.447 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.444+0000 7f1d85ddf640 1 -- 172.21.15.89:0/3408301135 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d8010ed80 con 0x7f1d80065b80 2024-09-13T02:59:03.448 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.445+0000 7f1d85ddf640 1 -- 172.21.15.89:0/3408301135 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d801057c0 con 0x7f1d80065b80 2024-09-13T02:59:03.448 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.445+0000 7f1d77fff640 1 -- 172.21.15.89:0/3408301135 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f1d7802f030 con 0x7f1d80065b80 2024-09-13T02:59:03.448 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.446+0000 7f1d77fff640 1 --2- 172.21.15.89:0/3408301135 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f1d6c06e530 0x7f1d6c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:59:03.448 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.446+0000 7f1d77fff640 1 -- 172.21.15.89:0/3408301135 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f1d780af430 con 0x7f1d80065b80 2024-09-13T02:59:03.448 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.446+0000 7f1d7effd640 1 --2- 172.21.15.89:0/3408301135 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f1d6c06e530 0x7f1d6c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:59:03.448 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.446+0000 7f1d7effd640 1 --2- 172.21.15.89:0/3408301135 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f1d6c06e530 0x7f1d6c0709e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1d8010cec0 tx=0x7f1d68009120 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:59:03.452 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.450+0000 7f1d77fff640 1 -- 172.21.15.89:0/3408301135 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f1d78078520 con 0x7f1d80065b80 2024-09-13T02:59:03.726 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.724+0000 7f1d85ddf640 1 -- 172.21.15.89:0/3408301135 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1d800fa890 con 0x7f1d80065b80 2024-09-13T02:59:03.726 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.724+0000 7f1d77fff640 1 -- 172.21.15.89:0/3408301135 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+850 (secure 0 0 0) 0x7f1d7807bbe0 con 0x7f1d80065b80 2024-09-13T02:59:03.727 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-13T02:59:03.727 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": { 2024-09-13T02:59:03.727 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 2 2024-09-13T02:59:03.727 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T02:59:03.727 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": { 2024-09-13T02:59:03.727 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 2 2024-09-13T02:59:03.727 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T02:59:03.727 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": { 2024-09-13T02:59:03.727 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 3, 2024-09-13T02:59:03.727 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 2 2024-09-13T02:59:03.727 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T02:59:03.727 INFO:teuthology.orchestra.run.smithi089.stdout: "mds": { 2024-09-13T02:59:03.727 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 4 2024-09-13T02:59:03.728 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T02:59:03.728 INFO:teuthology.orchestra.run.smithi089.stdout: "overall": { 2024-09-13T02:59:03.728 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 7, 2024-09-13T02:59:03.728 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 6 2024-09-13T02:59:03.728 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-13T02:59:03.728 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-13T02:59:03.728 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.727+0000 7f1d85ddf640 1 -- 172.21.15.89:0/3408301135 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f1d6c06e530 msgr2=0x7f1d6c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:03.728 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.727+0000 7f1d85ddf640 1 --2- 172.21.15.89:0/3408301135 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f1d6c06e530 0x7f1d6c0709e0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1d8010cec0 tx=0x7f1d68009120 comp rx=0 tx=0).stop 2024-09-13T02:59:03.728 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.727+0000 7f1d85ddf640 1 -- 172.21.15.89:0/3408301135 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1d80065b80 msgr2=0x7f1d8010d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:03.729 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.727+0000 7f1d85ddf640 1 --2- 172.21.15.89:0/3408301135 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1d80065b80 0x7f1d8010d110 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1d78000f80 tx=0x7f1d78004d10 comp rx=0 tx=0).stop 2024-09-13T02:59:03.729 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.727+0000 7f1d85ddf640 1 -- 172.21.15.89:0/3408301135 shutdown_connections 2024-09-13T02:59:03.729 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.727+0000 7f1d85ddf640 1 --2- 172.21.15.89:0/3408301135 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f1d6c06e530 0x7f1d6c0709e0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:03.729 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.727+0000 7f1d85ddf640 1 --2- 172.21.15.89:0/3408301135 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1d800ff740 0x7f1d8010d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:03.729 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.727+0000 7f1d85ddf640 1 --2- 172.21.15.89:0/3408301135 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1d80065b80 0x7f1d8010d110 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:03.729 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.727+0000 7f1d85ddf640 1 -- 172.21.15.89:0/3408301135 >> 172.21.15.89:0/3408301135 conn(0x7f1d800f6c10 msgr2=0x7f1d800f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:59:03.729 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.728+0000 7f1d85ddf640 1 -- 172.21.15.89:0/3408301135 shutdown_connections 2024-09-13T02:59:03.730 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.728+0000 7f1d85ddf640 1 -- 172.21.15.89:0/3408301135 wait complete. 2024-09-13T02:59:03.814 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.810+0000 7fb38d75c640 1 -- 172.21.15.89:0/3598836181 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3880fba20 msgr2=0x7fb3880fbe30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:03.814 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.810+0000 7fb38d75c640 1 --2- 172.21.15.89:0/3598836181 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3880fba20 0x7fb3880fbe30 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fb3700048d0 tx=0x7fb370009da0 comp rx=0 tx=0).stop 2024-09-13T02:59:03.814 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.811+0000 7fb38d75c640 1 -- 172.21.15.89:0/3598836181 shutdown_connections 2024-09-13T02:59:03.814 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.811+0000 7fb38d75c640 1 --2- 172.21.15.89:0/3598836181 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb3880fc370 0x7fb3880fc7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:03.814 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.811+0000 7fb38d75c640 1 --2- 172.21.15.89:0/3598836181 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3880fba20 0x7fb3880fbe30 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:03.814 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.811+0000 7fb38d75c640 1 -- 172.21.15.89:0/3598836181 >> 172.21.15.89:0/3598836181 conn(0x7fb3880f6390 msgr2=0x7fb3880f87a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:59:03.815 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.811+0000 7fb38d75c640 1 -- 172.21.15.89:0/3598836181 shutdown_connections 2024-09-13T02:59:03.815 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.811+0000 7fb38d75c640 1 -- 172.21.15.89:0/3598836181 wait complete. 2024-09-13T02:59:03.815 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.811+0000 7fb38d75c640 1 Processor -- start 2024-09-13T02:59:03.815 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.811+0000 7fb38d75c640 1 -- start start 2024-09-13T02:59:03.815 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.811+0000 7fb38d75c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb3880fba20 0x7fb3880ff600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:59:03.815 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.811+0000 7fb38d75c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3880fc370 0x7fb3880fdb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:59:03.815 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.811+0000 7fb38d75c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3880fe080 con 0x7fb3880fc370 2024-09-13T02:59:03.815 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.811+0000 7fb38d75c640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3880fe1c0 con 0x7fb3880fba20 2024-09-13T02:59:03.815 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.812+0000 7fb3867fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3880fc370 0x7fb3880fdb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:59:03.815 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.812+0000 7fb3867fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3880fc370 0x7fb3880fdb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:56108/0 (socket says 172.21.15.89:56108) 2024-09-13T02:59:03.815 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.812+0000 7fb3867fc640 1 -- 172.21.15.89:0/1203529883 learned_addr learned my addr 172.21.15.89:0/1203529883 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:59:03.815 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.812+0000 7fb386ffd640 1 --2- 172.21.15.89:0/1203529883 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb3880fba20 0x7fb3880ff600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:59:03.815 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.812+0000 7fb3867fc640 1 -- 172.21.15.89:0/1203529883 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb3880fba20 msgr2=0x7fb3880ff600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:03.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.812+0000 7fb3867fc640 1 --2- 172.21.15.89:0/1203529883 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb3880fba20 0x7fb3880ff600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:03.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.812+0000 7fb3867fc640 1 -- 172.21.15.89:0/1203529883 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb370005040 con 0x7fb3880fc370 2024-09-13T02:59:03.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.812+0000 7fb3867fc640 1 --2- 172.21.15.89:0/1203529883 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3880fc370 0x7fb3880fdb40 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb37800c830 tx=0x7fb378004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:59:03.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.812+0000 7fb37f7fe640 1 -- 172.21.15.89:0/1203529883 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb37800a7d0 con 0x7fb3880fc370 2024-09-13T02:59:03.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.813+0000 7fb38d75c640 1 -- 172.21.15.89:0/1203529883 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3880fe4a0 con 0x7fb3880fc370 2024-09-13T02:59:03.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.813+0000 7fb37f7fe640 1 -- 172.21.15.89:0/1203529883 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb37800add0 con 0x7fb3880fc370 2024-09-13T02:59:03.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.813+0000 7fb37f7fe640 1 -- 172.21.15.89:0/1203529883 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb3780113a0 con 0x7fb3880fc370 2024-09-13T02:59:03.816 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.813+0000 7fb38d75c640 1 -- 172.21.15.89:0/1203529883 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3881151b0 con 0x7fb3880fc370 2024-09-13T02:59:03.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.814+0000 7fb38d75c640 1 -- 172.21.15.89:0/1203529883 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3880fa010 con 0x7fb3880fc370 2024-09-13T02:59:03.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.814+0000 7fb37f7fe640 1 -- 172.21.15.89:0/1203529883 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fb37800a930 con 0x7fb3880fc370 2024-09-13T02:59:03.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.815+0000 7fb37f7fe640 1 --2- 172.21.15.89:0/1203529883 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fb37406e530 0x7fb3740709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:59:03.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.815+0000 7fb37f7fe640 1 -- 172.21.15.89:0/1203529883 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fb37808e270 con 0x7fb3880fc370 2024-09-13T02:59:03.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.815+0000 7fb386ffd640 1 --2- 172.21.15.89:0/1203529883 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fb37406e530 0x7fb3740709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:59:03.817 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.815+0000 7fb386ffd640 1 --2- 172.21.15.89:0/1203529883 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fb37406e530 0x7fb3740709e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb3880ff3b0 tx=0x7fb370035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:59:03.820 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:03.819+0000 7fb37f7fe640 1 -- 172.21.15.89:0/1203529883 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fb3780573e0 con 0x7fb3880fc370 2024-09-13T02:59:03.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:03 smithi131 ceph-mon[78839]: from='client.34254 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:59:03.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:03 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:59:03.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:03 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:59:04.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:03 smithi089 ceph-mon[91553]: from='client.34254 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:59:04.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:03 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:59:04.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:03 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:59:04.051 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.050+0000 7fb38d75c640 1 -- 172.21.15.89:0/1203529883 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb388103fa0 con 0x7fb3880fc370 2024-09-13T02:59:04.052 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.050+0000 7fb37f7fe640 1 -- 172.21.15.89:0/1203529883 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 23 v23) v1 ==== 76+0+1953 (secure 0 0 0) 0x7fb37805aaa0 con 0x7fb3880fc370 2024-09-13T02:59:04.052 INFO:teuthology.orchestra.run.smithi089.stdout:e23 2024-09-13T02:59:04.052 INFO:teuthology.orchestra.run.smithi089.stdout:btime 2024-09-13T02:58:04:980780+0000 2024-09-13T02:59:04.053 INFO:teuthology.orchestra.run.smithi089.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T02:59:04.053 INFO:teuthology.orchestra.run.smithi089.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:59:04.053 INFO:teuthology.orchestra.run.smithi089.stdout:legacy client fscid: 1 2024-09-13T02:59:04.053 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:59:04.053 INFO:teuthology.orchestra.run.smithi089.stdout:Filesystem 'cephfs' (1) 2024-09-13T02:59:04.053 INFO:teuthology.orchestra.run.smithi089.stdout:fs_name cephfs 2024-09-13T02:59:04.054 INFO:teuthology.orchestra.run.smithi089.stdout:epoch 23 2024-09-13T02:59:04.054 INFO:teuthology.orchestra.run.smithi089.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T02:59:04.054 INFO:teuthology.orchestra.run.smithi089.stdout:created 2024-09-13T02:51:40.657817+0000 2024-09-13T02:59:04.054 INFO:teuthology.orchestra.run.smithi089.stdout:modified 2024-09-13T02:58:04.067950+0000 2024-09-13T02:59:04.054 INFO:teuthology.orchestra.run.smithi089.stdout:tableserver 0 2024-09-13T02:59:04.055 INFO:teuthology.orchestra.run.smithi089.stdout:root 0 2024-09-13T02:59:04.055 INFO:teuthology.orchestra.run.smithi089.stdout:session_timeout 60 2024-09-13T02:59:04.055 INFO:teuthology.orchestra.run.smithi089.stdout:session_autoclose 300 2024-09-13T02:59:04.055 INFO:teuthology.orchestra.run.smithi089.stdout:max_file_size 1099511627776 2024-09-13T02:59:04.056 INFO:teuthology.orchestra.run.smithi089.stdout:max_xattr_size 65536 2024-09-13T02:59:04.056 INFO:teuthology.orchestra.run.smithi089.stdout:required_client_features {} 2024-09-13T02:59:04.056 INFO:teuthology.orchestra.run.smithi089.stdout:last_failure 0 2024-09-13T02:59:04.056 INFO:teuthology.orchestra.run.smithi089.stdout:last_failure_osd_epoch 44 2024-09-13T02:59:04.056 INFO:teuthology.orchestra.run.smithi089.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:59:04.057 INFO:teuthology.orchestra.run.smithi089.stdout:max_mds 2 2024-09-13T02:59:04.057 INFO:teuthology.orchestra.run.smithi089.stdout:in 0,1 2024-09-13T02:59:04.057 INFO:teuthology.orchestra.run.smithi089.stdout:up {0=14480,1=24257} 2024-09-13T02:59:04.057 INFO:teuthology.orchestra.run.smithi089.stdout:failed 2024-09-13T02:59:04.057 INFO:teuthology.orchestra.run.smithi089.stdout:damaged 2024-09-13T02:59:04.057 INFO:teuthology.orchestra.run.smithi089.stdout:stopped 2024-09-13T02:59:04.058 INFO:teuthology.orchestra.run.smithi089.stdout:data_pools [3] 2024-09-13T02:59:04.058 INFO:teuthology.orchestra.run.smithi089.stdout:metadata_pool 2 2024-09-13T02:59:04.058 INFO:teuthology.orchestra.run.smithi089.stdout:inline_data disabled 2024-09-13T02:59:04.058 INFO:teuthology.orchestra.run.smithi089.stdout:balancer 2024-09-13T02:59:04.058 INFO:teuthology.orchestra.run.smithi089.stdout:bal_rank_mask -1 2024-09-13T02:59:04.058 INFO:teuthology.orchestra.run.smithi089.stdout:standby_count_wanted 1 2024-09-13T02:59:04.059 INFO:teuthology.orchestra.run.smithi089.stdout:qdb_cluster leader: 14480 members: 24257,14480 2024-09-13T02:59:04.059 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi089.rarddb{0:14480} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.89:6828/1561365213,v1:172.21.15.89:6829/1561365213] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:59:04.059 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi089.qjoitb{0:14488} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.89:6826/1464393547,v1:172.21.15.89:6827/1464393547] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:59:04.059 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi131.uasrkg{1:24257} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.131:6824/260493836,v1:172.21.15.131:6825/260493836] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:59:04.059 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi131.rbovzc{1:24265} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.131:6826/665579373,v1:172.21.15.131:6827/665579373] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:59:04.059 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:59:04.059 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:59:04.061 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 23 2024-09-13T02:59:04.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.053+0000 7fb38d75c640 1 -- 172.21.15.89:0/1203529883 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fb37406e530 msgr2=0x7fb3740709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:04.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.053+0000 7fb38d75c640 1 --2- 172.21.15.89:0/1203529883 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fb37406e530 0x7fb3740709e0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb3880ff3b0 tx=0x7fb370035040 comp rx=0 tx=0).stop 2024-09-13T02:59:04.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.053+0000 7fb38d75c640 1 -- 172.21.15.89:0/1203529883 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3880fc370 msgr2=0x7fb3880fdb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:04.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.053+0000 7fb38d75c640 1 --2- 172.21.15.89:0/1203529883 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3880fc370 0x7fb3880fdb40 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb37800c830 tx=0x7fb378004430 comp rx=0 tx=0).stop 2024-09-13T02:59:04.062 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.053+0000 7fb38d75c640 1 -- 172.21.15.89:0/1203529883 shutdown_connections 2024-09-13T02:59:04.062 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.053+0000 7fb38d75c640 1 --2- 172.21.15.89:0/1203529883 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fb37406e530 0x7fb3740709e0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:04.062 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.053+0000 7fb38d75c640 1 --2- 172.21.15.89:0/1203529883 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb3880fc370 0x7fb3880fdb40 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:04.062 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.053+0000 7fb38d75c640 1 --2- 172.21.15.89:0/1203529883 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb3880fba20 0x7fb3880ff600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:04.062 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.053+0000 7fb38d75c640 1 -- 172.21.15.89:0/1203529883 >> 172.21.15.89:0/1203529883 conn(0x7fb3880f6390 msgr2=0x7fb3880fae70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:59:04.062 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.053+0000 7fb38d75c640 1 -- 172.21.15.89:0/1203529883 shutdown_connections 2024-09-13T02:59:04.063 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.053+0000 7fb38d75c640 1 -- 172.21.15.89:0/1203529883 wait complete. 2024-09-13T02:59:04.139 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.137+0000 7fddab670640 1 -- 172.21.15.89:0/4268901352 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdda40fb440 msgr2=0x7fdda40fb850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:04.140 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.137+0000 7fddab670640 1 --2- 172.21.15.89:0/4268901352 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdda40fb440 0x7fdda40fb850 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fdda00048d0 tx=0x7fdda0009da0 comp rx=0 tx=0).stop 2024-09-13T02:59:04.140 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.137+0000 7fddab670640 1 -- 172.21.15.89:0/4268901352 shutdown_connections 2024-09-13T02:59:04.140 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.137+0000 7fddab670640 1 --2- 172.21.15.89:0/4268901352 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdda40fc710 0x7fdda40fcb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:04.140 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.137+0000 7fddab670640 1 --2- 172.21.15.89:0/4268901352 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdda40fb440 0x7fdda40fb850 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:04.140 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.137+0000 7fddab670640 1 -- 172.21.15.89:0/4268901352 >> 172.21.15.89:0/4268901352 conn(0x7fdda40f6c20 msgr2=0x7fdda40f9030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:59:04.140 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.138+0000 7fddab670640 1 -- 172.21.15.89:0/4268901352 shutdown_connections 2024-09-13T02:59:04.140 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.138+0000 7fddab670640 1 -- 172.21.15.89:0/4268901352 wait complete. 2024-09-13T02:59:04.140 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.138+0000 7fddab670640 1 Processor -- start 2024-09-13T02:59:04.140 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.138+0000 7fddab670640 1 -- start start 2024-09-13T02:59:04.142 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.139+0000 7fddab670640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdda40fb440 0x7fdda410d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:59:04.142 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.139+0000 7fddab670640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdda40fc710 0x7fdda410d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:59:04.142 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.139+0000 7fddab670640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdda410dc90 con 0x7fdda40fc710 2024-09-13T02:59:04.142 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.139+0000 7fddab670640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdda410e460 con 0x7fdda40fb440 2024-09-13T02:59:04.142 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.139+0000 7fdda8c0b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdda40fc710 0x7fdda410d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:59:04.142 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.139+0000 7fdda8c0b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdda40fc710 0x7fdda410d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:56134/0 (socket says 172.21.15.89:56134) 2024-09-13T02:59:04.142 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.139+0000 7fdda8c0b640 1 -- 172.21.15.89:0/2641312513 learned_addr learned my addr 172.21.15.89:0/2641312513 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:59:04.142 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.139+0000 7fdda940c640 1 --2- 172.21.15.89:0/2641312513 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdda40fb440 0x7fdda410d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:59:04.142 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.139+0000 7fdda8c0b640 1 -- 172.21.15.89:0/2641312513 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdda40fb440 msgr2=0x7fdda410d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:04.142 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.139+0000 7fdda8c0b640 1 --2- 172.21.15.89:0/2641312513 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdda40fb440 0x7fdda410d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:04.142 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.139+0000 7fdda8c0b640 1 -- 172.21.15.89:0/2641312513 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdda0005040 con 0x7fdda40fc710 2024-09-13T02:59:04.142 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.139+0000 7fdda8c0b640 1 --2- 172.21.15.89:0/2641312513 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdda40fc710 0x7fdda410d640 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fdd94002a50 tx=0x7fdd94004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:59:04.143 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.140+0000 7fdd99ffb640 1 -- 172.21.15.89:0/2641312513 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd94007c30 con 0x7fdda40fc710 2024-09-13T02:59:04.143 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.140+0000 7fdd99ffb640 1 -- 172.21.15.89:0/2641312513 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fdd9400f040 con 0x7fdda40fc710 2024-09-13T02:59:04.143 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.140+0000 7fdd99ffb640 1 -- 172.21.15.89:0/2641312513 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdd9400da10 con 0x7fdda40fc710 2024-09-13T02:59:04.143 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.140+0000 7fddab670640 1 -- 172.21.15.89:0/2641312513 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdda410e6f0 con 0x7fdda40fc710 2024-09-13T02:59:04.143 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.140+0000 7fddab670640 1 -- 172.21.15.89:0/2641312513 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdda410ec90 con 0x7fdda40fc710 2024-09-13T02:59:04.144 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.141+0000 7fddab670640 1 -- 172.21.15.89:0/2641312513 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdda40fa8a0 con 0x7fdda40fc710 2024-09-13T02:59:04.144 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.141+0000 7fdd99ffb640 1 -- 172.21.15.89:0/2641312513 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fdd9400dbb0 con 0x7fdda40fc710 2024-09-13T02:59:04.144 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.142+0000 7fdd99ffb640 1 --2- 172.21.15.89:0/2641312513 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fdd9006e530 0x7fdd900709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:59:04.144 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.142+0000 7fdd99ffb640 1 -- 172.21.15.89:0/2641312513 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fdd9408d8c0 con 0x7fdda40fc710 2024-09-13T02:59:04.144 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.142+0000 7fdda940c640 1 --2- 172.21.15.89:0/2641312513 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fdd9006e530 0x7fdd900709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:59:04.144 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.143+0000 7fdda940c640 1 --2- 172.21.15.89:0/2641312513 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fdd9006e530 0x7fdd900709e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fdda0007ac0 tx=0x7fdda0035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:59:04.148 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.146+0000 7fdd99ffb640 1 -- 172.21.15.89:0/2641312513 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fdd94056ae0 con 0x7fdda40fc710 2024-09-13T02:59:04.344 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.342+0000 7fddab670640 1 -- 172.21.15.89:0/2641312513 --> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdda4104010 con 0x7fdd9006e530 2024-09-13T02:59:04.344 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 02:59:04 smithi089 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-2[110777]: 2024-09-13T02:59:04.238+0000 7f9475030640 -1 osd.2 57 log_to_monitors true 2024-09-13T02:59:04.344 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.343+0000 7fdd99ffb640 1 -- 172.21.15.89:0/2641312513 <== mgr.34104 v2:172.21.15.89:6800/1881577856 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fdda0039040 con 0x7fdd9006e530 2024-09-13T02:59:04.345 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-13T02:59:04.345 INFO:teuthology.orchestra.run.smithi089.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d", 2024-09-13T02:59:04.345 INFO:teuthology.orchestra.run.smithi089.stdout: "in_progress": true, 2024-09-13T02:59:04.345 INFO:teuthology.orchestra.run.smithi089.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T02:59:04.345 INFO:teuthology.orchestra.run.smithi089.stdout: "services_complete": [ 2024-09-13T02:59:04.345 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr", 2024-09-13T02:59:04.345 INFO:teuthology.orchestra.run.smithi089.stdout: "crash", 2024-09-13T02:59:04.345 INFO:teuthology.orchestra.run.smithi089.stdout: "mon" 2024-09-13T02:59:04.345 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-13T02:59:04.345 INFO:teuthology.orchestra.run.smithi089.stdout: "progress": "9/21 daemons upgraded", 2024-09-13T02:59:04.345 INFO:teuthology.orchestra.run.smithi089.stdout: "message": "Currently upgrading osd daemons", 2024-09-13T02:59:04.345 INFO:teuthology.orchestra.run.smithi089.stdout: "is_paused": false 2024-09-13T02:59:04.345 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-13T02:59:04.347 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.346+0000 7fddab670640 1 -- 172.21.15.89:0/2641312513 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fdd9006e530 msgr2=0x7fdd900709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:04.347 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.346+0000 7fddab670640 1 --2- 172.21.15.89:0/2641312513 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fdd9006e530 0x7fdd900709e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fdda0007ac0 tx=0x7fdda0035040 comp rx=0 tx=0).stop 2024-09-13T02:59:04.347 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.346+0000 7fddab670640 1 -- 172.21.15.89:0/2641312513 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdda40fc710 msgr2=0x7fdda410d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:04.348 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.346+0000 7fddab670640 1 --2- 172.21.15.89:0/2641312513 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdda40fc710 0x7fdda410d640 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fdd94002a50 tx=0x7fdd94004600 comp rx=0 tx=0).stop 2024-09-13T02:59:04.348 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.346+0000 7fddab670640 1 -- 172.21.15.89:0/2641312513 shutdown_connections 2024-09-13T02:59:04.348 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.346+0000 7fddab670640 1 --2- 172.21.15.89:0/2641312513 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fdd9006e530 0x7fdd900709e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:04.348 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.346+0000 7fddab670640 1 --2- 172.21.15.89:0/2641312513 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdda40fc710 0x7fdda410d640 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:04.348 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.346+0000 7fddab670640 1 --2- 172.21.15.89:0/2641312513 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdda40fb440 0x7fdda410d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:04.348 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.346+0000 7fddab670640 1 -- 172.21.15.89:0/2641312513 >> 172.21.15.89:0/2641312513 conn(0x7fdda40f6c20 msgr2=0x7fdda4066080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:59:04.348 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.346+0000 7fddab670640 1 -- 172.21.15.89:0/2641312513 shutdown_connections 2024-09-13T02:59:04.348 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.346+0000 7fddab670640 1 -- 172.21.15.89:0/2641312513 wait complete. 2024-09-13T02:59:04.429 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.425+0000 7f7f74732640 1 -- 172.21.15.89:0/3870099087 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f6c101ad0 msgr2=0x7f7f6c103eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:04.429 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.425+0000 7f7f74732640 1 --2- 172.21.15.89:0/3870099087 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f6c101ad0 0x7f7f6c103eb0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c0048d0 tx=0x7f7f5c009da0 comp rx=0 tx=0).stop 2024-09-13T02:59:04.429 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.425+0000 7f7f74732640 1 -- 172.21.15.89:0/3870099087 shutdown_connections 2024-09-13T02:59:04.429 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.425+0000 7f7f74732640 1 --2- 172.21.15.89:0/3870099087 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f6c101ad0 0x7f7f6c103eb0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:04.429 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.425+0000 7f7f74732640 1 --2- 172.21.15.89:0/3870099087 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7f6c066470 0x7f7f6c101590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:04.429 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.425+0000 7f7f74732640 1 -- 172.21.15.89:0/3870099087 >> 172.21.15.89:0/3870099087 conn(0x7f7f6c0f6c00 msgr2=0x7f7f6c0f9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:59:04.429 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.426+0000 7f7f74732640 1 -- 172.21.15.89:0/3870099087 shutdown_connections 2024-09-13T02:59:04.429 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.426+0000 7f7f74732640 1 -- 172.21.15.89:0/3870099087 wait complete. 2024-09-13T02:59:04.429 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.426+0000 7f7f74732640 1 Processor -- start 2024-09-13T02:59:04.429 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.426+0000 7f7f74732640 1 -- start start 2024-09-13T02:59:04.430 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.426+0000 7f7f74732640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7f6c066470 0x7f7f6c10f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:59:04.430 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.426+0000 7f7f74732640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f6c101ad0 0x7f7f6c10f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:59:04.430 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.426+0000 7f7f74732640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f6c10fde0 con 0x7f7f6c101ad0 2024-09-13T02:59:04.430 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.426+0000 7f7f74732640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f6c110600 con 0x7f7f6c066470 2024-09-13T02:59:04.430 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.427+0000 7f7f71ccd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f6c101ad0 0x7f7f6c10f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:59:04.430 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.427+0000 7f7f71ccd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f6c101ad0 0x7f7f6c10f790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:56156/0 (socket says 172.21.15.89:56156) 2024-09-13T02:59:04.430 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.427+0000 7f7f71ccd640 1 -- 172.21.15.89:0/7056011 learned_addr learned my addr 172.21.15.89:0/7056011 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:59:04.430 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.427+0000 7f7f724ce640 1 --2- 172.21.15.89:0/7056011 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7f6c066470 0x7f7f6c10f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:59:04.430 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.427+0000 7f7f71ccd640 1 -- 172.21.15.89:0/7056011 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7f6c066470 msgr2=0x7f7f6c10f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:04.430 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.427+0000 7f7f71ccd640 1 --2- 172.21.15.89:0/7056011 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7f6c066470 0x7f7f6c10f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:04.430 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.427+0000 7f7f71ccd640 1 -- 172.21.15.89:0/7056011 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f5c005040 con 0x7f7f6c101ad0 2024-09-13T02:59:04.430 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.427+0000 7f7f724ce640 1 --2- 172.21.15.89:0/7056011 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7f6c066470 0x7f7f6c10f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T02:59:04.430 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.427+0000 7f7f71ccd640 1 --2- 172.21.15.89:0/7056011 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f6c101ad0 0x7f7f6c10f790 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c0048a0 tx=0x7f7f5c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:59:04.431 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.427+0000 7f7f62ffd640 1 -- 172.21.15.89:0/7056011 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f5c038070 con 0x7f7f6c101ad0 2024-09-13T02:59:04.431 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.427+0000 7f7f62ffd640 1 -- 172.21.15.89:0/7056011 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f7f5c032d30 con 0x7f7f6c101ad0 2024-09-13T02:59:04.431 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.427+0000 7f7f74732640 1 -- 172.21.15.89:0/7056011 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f6c110830 con 0x7f7f6c101ad0 2024-09-13T02:59:04.431 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.427+0000 7f7f62ffd640 1 -- 172.21.15.89:0/7056011 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f5c033ac0 con 0x7f7f6c101ad0 2024-09-13T02:59:04.431 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.427+0000 7f7f74732640 1 -- 172.21.15.89:0/7056011 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f6c110dd0 con 0x7f7f6c101ad0 2024-09-13T02:59:04.432 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.428+0000 7f7f74732640 1 -- 172.21.15.89:0/7056011 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f6c0fa880 con 0x7f7f6c101ad0 2024-09-13T02:59:04.432 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.429+0000 7f7f62ffd640 1 -- 172.21.15.89:0/7056011 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f7f5c030020 con 0x7f7f6c101ad0 2024-09-13T02:59:04.432 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.429+0000 7f7f62ffd640 1 --2- 172.21.15.89:0/7056011 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f7f5806e530 0x7f7f580709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:59:04.432 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.429+0000 7f7f724ce640 1 --2- 172.21.15.89:0/7056011 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f7f5806e530 0x7f7f580709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:59:04.432 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.429+0000 7f7f62ffd640 1 -- 172.21.15.89:0/7056011 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f7f5c0ae6e0 con 0x7f7f6c101ad0 2024-09-13T02:59:04.432 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.430+0000 7f7f724ce640 1 --2- 172.21.15.89:0/7056011 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f7f5806e530 0x7f7f580709e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c0661d0 tx=0x7f7f6800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:59:04.435 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.434+0000 7f7f62ffd640 1 -- 172.21.15.89:0/7056011 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f7f5c077850 con 0x7f7f6c101ad0 2024-09-13T02:59:04.685 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.683+0000 7f7f74732640 1 -- 172.21.15.89:0/7056011 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f7f6c04b720 con 0x7f7f6c101ad0 2024-09-13T02:59:04.685 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.683+0000 7f7f62ffd640 1 -- 172.21.15.89:0/7056011 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+996 (secure 0 0 0) 0x7f7f5c07af10 con 0x7f7f6c101ad0 2024-09-13T02:59:04.685 INFO:teuthology.orchestra.run.smithi089.stdout:HEALTH_WARN 1 osds down; Degraded data redundancy: 43/357 objects degraded (12.045%), 13 pgs degraded 2024-09-13T02:59:04.685 INFO:teuthology.orchestra.run.smithi089.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-13T02:59:04.685 INFO:teuthology.orchestra.run.smithi089.stdout: osd.2 (root=default,host=smithi089) is down 2024-09-13T02:59:04.685 INFO:teuthology.orchestra.run.smithi089.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 43/357 objects degraded (12.045%), 13 pgs degraded 2024-09-13T02:59:04.685 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.1 is active+undersized+degraded, acting [1,0] 2024-09-13T02:59:04.685 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.3 is active+undersized+degraded, acting [5,1] 2024-09-13T02:59:04.685 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.7 is active+undersized+degraded, acting [3,4] 2024-09-13T02:59:04.686 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.c is active+undersized+degraded, acting [3,0] 2024-09-13T02:59:04.686 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.d is active+undersized+degraded, acting [1,3] 2024-09-13T02:59:04.686 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.e is active+undersized+degraded, acting [0,3] 2024-09-13T02:59:04.686 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.10 is active+undersized+degraded, acting [1,0] 2024-09-13T02:59:04.686 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.13 is active+undersized+degraded, acting [0,4] 2024-09-13T02:59:04.686 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.16 is active+undersized+degraded, acting [5,3] 2024-09-13T02:59:04.686 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.17 is active+undersized+degraded, acting [5,1] 2024-09-13T02:59:04.686 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.19 is active+undersized+degraded, acting [0,4] 2024-09-13T02:59:04.686 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.1c is active+undersized+degraded, acting [4,5] 2024-09-13T02:59:04.686 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.1e is active+undersized+degraded, acting [0,5] 2024-09-13T02:59:04.687 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.685+0000 7f7f74732640 1 -- 172.21.15.89:0/7056011 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f7f5806e530 msgr2=0x7f7f580709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:04.687 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.685+0000 7f7f74732640 1 --2- 172.21.15.89:0/7056011 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f7f5806e530 0x7f7f580709e0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f7f6c0661d0 tx=0x7f7f6800b040 comp rx=0 tx=0).stop 2024-09-13T02:59:04.687 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.685+0000 7f7f74732640 1 -- 172.21.15.89:0/7056011 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f6c101ad0 msgr2=0x7f7f6c10f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:04.687 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.685+0000 7f7f74732640 1 --2- 172.21.15.89:0/7056011 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f6c101ad0 0x7f7f6c10f790 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7f5c0048a0 tx=0x7f7f5c009da0 comp rx=0 tx=0).stop 2024-09-13T02:59:04.687 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.685+0000 7f7f74732640 1 -- 172.21.15.89:0/7056011 shutdown_connections 2024-09-13T02:59:04.687 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.685+0000 7f7f74732640 1 --2- 172.21.15.89:0/7056011 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f7f5806e530 0x7f7f580709e0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:04.687 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.685+0000 7f7f74732640 1 --2- 172.21.15.89:0/7056011 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7f6c101ad0 0x7f7f6c10f790 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:04.688 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.685+0000 7f7f74732640 1 --2- 172.21.15.89:0/7056011 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7f6c066470 0x7f7f6c10f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:04.688 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.685+0000 7f7f74732640 1 -- 172.21.15.89:0/7056011 >> 172.21.15.89:0/7056011 conn(0x7f7f6c0f6c00 msgr2=0x7f7f6c0f6fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:59:04.688 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.685+0000 7f7f74732640 1 -- 172.21.15.89:0/7056011 shutdown_connections 2024-09-13T02:59:04.688 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:04.685+0000 7f7f74732640 1 -- 172.21.15.89:0/7056011 wait complete. 2024-09-13T02:59:04.877 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:04 smithi089 ceph-mon[91553]: from='client.34258 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:59:04.877 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:04 smithi089 ceph-mon[91553]: from='client.34262 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:59:04.877 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:04 smithi089 ceph-mon[91553]: pgmap v89: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 306 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 43/357 objects degraded (12.045%) 2024-09-13T02:59:04.877 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:04 smithi089 ceph-mon[91553]: from='client.? 172.21.15.89:0/3408301135' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:59:04.877 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:04 smithi089 ceph-mon[91553]: from='client.? 172.21.15.89:0/1203529883' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T02:59:04.877 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:04 smithi089 ceph-mon[91553]: from='osd.2 [v2:172.21.15.89:6818/4141220207,v1:172.21.15.89:6819/4141220207]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-13T02:59:04.877 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:04 smithi089 ceph-mon[91553]: Health check update: Degraded data redundancy: 43/357 objects degraded (12.045%), 13 pgs degraded (PG_DEGRADED) 2024-09-13T02:59:04.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:04 smithi131 ceph-mon[78839]: from='client.34258 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:59:04.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:04 smithi131 ceph-mon[78839]: from='client.34262 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:59:04.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:04 smithi131 ceph-mon[78839]: pgmap v89: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 306 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 43/357 objects degraded (12.045%) 2024-09-13T02:59:04.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:04 smithi131 ceph-mon[78839]: from='client.? 172.21.15.89:0/3408301135' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:59:04.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:04 smithi131 ceph-mon[78839]: from='client.? 172.21.15.89:0/1203529883' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T02:59:04.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:04 smithi131 ceph-mon[78839]: from='osd.2 [v2:172.21.15.89:6818/4141220207,v1:172.21.15.89:6819/4141220207]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-13T02:59:04.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:04 smithi131 ceph-mon[78839]: Health check update: Degraded data redundancy: 43/357 objects degraded (12.045%), 13 pgs degraded (PG_DEGRADED) 2024-09-13T02:59:05.876 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:05 smithi089 ceph-mon[91553]: from='client.34274 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:59:05.877 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:05 smithi089 ceph-mon[91553]: from='client.? 172.21.15.89:0/7056011' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T02:59:05.877 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:05 smithi089 ceph-mon[91553]: from='osd.2 [v2:172.21.15.89:6818/4141220207,v1:172.21.15.89:6819/4141220207]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-13T02:59:05.877 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:05 smithi089 ceph-mon[91553]: osdmap e60: 6 total, 5 up, 6 in 2024-09-13T02:59:05.877 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:05 smithi089 ceph-mon[91553]: from='osd.2 [v2:172.21.15.89:6818/4141220207,v1:172.21.15.89:6819/4141220207]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-09-13T02:59:05.877 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:05 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:59:05.877 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:05 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:59:05.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:05 smithi131 ceph-mon[78839]: from='client.34274 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:59:05.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:05 smithi131 ceph-mon[78839]: from='client.? 172.21.15.89:0/7056011' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T02:59:05.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:05 smithi131 ceph-mon[78839]: from='osd.2 [v2:172.21.15.89:6818/4141220207,v1:172.21.15.89:6819/4141220207]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-13T02:59:05.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:05 smithi131 ceph-mon[78839]: osdmap e60: 6 total, 5 up, 6 in 2024-09-13T02:59:05.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:05 smithi131 ceph-mon[78839]: from='osd.2 [v2:172.21.15.89:6818/4141220207,v1:172.21.15.89:6819/4141220207]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi089", "root=default"]}]: dispatch 2024-09-13T02:59:05.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:05 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:59:05.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:05 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:59:06.176 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 02:59:05 smithi089 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-2[110777]: 2024-09-13T02:59:05.874+0000 7f9468dc2640 -1 osd.2 57 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T02:59:06.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:06 smithi089 ceph-mon[91553]: pgmap v91: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 306 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 43/357 objects degraded (12.045%) 2024-09-13T02:59:06.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:06 smithi089 ceph-mon[91553]: from='osd.2 [v2:172.21.15.89:6818/4141220207,v1:172.21.15.89:6819/4141220207]' entity='osd.2' 2024-09-13T02:59:06.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:06 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:59:06.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:06 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:59:06.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:06 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:59:06.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:06 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:59:06.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:06 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:59:06.786 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:06 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:59:06.786 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:06 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:59:06.786 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:06 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:59:06.786 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:06 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:59:06.786 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:06 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-13T02:59:06.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:06 smithi131 ceph-mon[78839]: pgmap v91: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 306 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 43/357 objects degraded (12.045%) 2024-09-13T02:59:06.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:06 smithi131 ceph-mon[78839]: from='osd.2 [v2:172.21.15.89:6818/4141220207,v1:172.21.15.89:6819/4141220207]' entity='osd.2' 2024-09-13T02:59:06.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:06 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:59:06.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:06 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:59:06.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:06 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:59:06.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:06 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:59:06.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:06 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:59:06.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:06 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:59:06.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:06 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:59:06.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:06 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:59:06.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:06 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:59:06.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:06 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-13T02:59:07.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:07 smithi131 ceph-mon[78839]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-13T02:59:07.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:07 smithi131 ceph-mon[78839]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-13T02:59:07.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:07 smithi131 ceph-mon[78839]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T02:59:07.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:07 smithi131 ceph-mon[78839]: osd.2 [v2:172.21.15.89:6818/4141220207,v1:172.21.15.89:6819/4141220207] boot 2024-09-13T02:59:07.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:07 smithi131 ceph-mon[78839]: osdmap e61: 6 total, 6 up, 6 in 2024-09-13T02:59:07.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:07 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T02:59:08.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:07 smithi089 ceph-mon[91553]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-13T02:59:08.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:07 smithi089 ceph-mon[91553]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-13T02:59:08.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:07 smithi089 ceph-mon[91553]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T02:59:08.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:07 smithi089 ceph-mon[91553]: osd.2 [v2:172.21.15.89:6818/4141220207,v1:172.21.15.89:6819/4141220207] boot 2024-09-13T02:59:08.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:07 smithi089 ceph-mon[91553]: osdmap e61: 6 total, 6 up, 6 in 2024-09-13T02:59:08.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:07 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-13T02:59:08.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:08 smithi131 ceph-mon[78839]: pgmap v93: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 306 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s; 43/357 objects degraded (12.045%) 2024-09-13T02:59:08.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:08 smithi131 ceph-mon[78839]: osdmap e62: 6 total, 6 up, 6 in 2024-09-13T02:59:09.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:08 smithi089 ceph-mon[91553]: pgmap v93: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 306 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s; 43/357 objects degraded (12.045%) 2024-09-13T02:59:09.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:08 smithi089 ceph-mon[91553]: osdmap e62: 6 total, 6 up, 6 in 2024-09-13T02:59:10.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:10 smithi131 ceph-mon[78839]: pgmap v95: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 306 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 43/357 objects degraded (12.045%) 2024-09-13T02:59:11.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:10 smithi089 ceph-mon[91553]: pgmap v95: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 306 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 43/357 objects degraded (12.045%) 2024-09-13T02:59:12.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:11 smithi089 ceph-mon[91553]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 43/357 objects degraded (12.045%), 13 pgs degraded) 2024-09-13T02:59:12.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:11 smithi089 ceph-mon[91553]: Cluster is now healthy 2024-09-13T02:59:12.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:11 smithi131 ceph-mon[78839]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 43/357 objects degraded (12.045%), 13 pgs degraded) 2024-09-13T02:59:12.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:11 smithi131 ceph-mon[78839]: Cluster is now healthy 2024-09-13T02:59:13.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:12 smithi089 ceph-mon[91553]: pgmap v96: 65 pgs: 65 active+clean; 306 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 3 op/s 2024-09-13T02:59:13.085 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:12 smithi131 ceph-mon[78839]: pgmap v96: 65 pgs: 65 active+clean; 306 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 2.7 KiB/s rd, 3 op/s 2024-09-13T02:59:14.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:14 smithi089 ceph-mon[91553]: pgmap v97: 65 pgs: 65 active+clean; 306 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-09-13T02:59:15.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:14 smithi131 ceph-mon[78839]: pgmap v97: 65 pgs: 65 active+clean; 306 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 2 op/s 2024-09-13T02:59:17.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:16 smithi089 ceph-mon[91553]: pgmap v98: 65 pgs: 65 active+clean; 306 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 942 B/s rd, 0 op/s 2024-09-13T02:59:17.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:16 smithi131 ceph-mon[78839]: pgmap v98: 65 pgs: 65 active+clean; 306 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 942 B/s rd, 0 op/s 2024-09-13T02:59:19.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:18 smithi089 ceph-mon[91553]: pgmap v99: 65 pgs: 65 active+clean; 306 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 2 op/s 2024-09-13T02:59:19.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:18 smithi131 ceph-mon[78839]: pgmap v99: 65 pgs: 65 active+clean; 306 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.8 KiB/s rd, 2 op/s 2024-09-13T02:59:21.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:20 smithi089 ceph-mon[91553]: pgmap v100: 65 pgs: 65 active+clean; 306 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-13T02:59:21.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:20 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:59:21.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:20 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:59:21.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:20 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:59:21.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:20 smithi131 ceph-mon[78839]: pgmap v100: 65 pgs: 65 active+clean; 306 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-09-13T02:59:21.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:20 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:59:21.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:20 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:59:21.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:20 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:59:21.999 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:21 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-13T02:59:22.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:21 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-13T02:59:23.025 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:22 smithi131 ceph-mon[78839]: pgmap v101: 65 pgs: 65 active+clean; 306 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 2.3 KiB/s rd, 3 op/s 2024-09-13T02:59:23.025 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:22 smithi131 ceph-mon[78839]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-13T02:59:23.025 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:22 smithi131 ceph-mon[78839]: Upgrade: osd.3 is safe to restart 2024-09-13T02:59:23.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:22 smithi089 ceph-mon[91553]: pgmap v101: 65 pgs: 65 active+clean; 306 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 2.3 KiB/s rd, 3 op/s 2024-09-13T02:59:23.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:22 smithi089 ceph-mon[91553]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-09-13T02:59:23.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:22 smithi089 ceph-mon[91553]: Upgrade: osd.3 is safe to restart 2024-09-13T02:59:24.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:23 smithi131 ceph-mon[78839]: Upgrade: Updating osd.3 2024-09-13T02:59:24.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:23 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:59:24.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:23 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-13T02:59:24.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:23 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:59:24.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:23 smithi131 ceph-mon[78839]: Deploying daemon osd.3 on smithi131 2024-09-13T02:59:24.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:23 smithi131 ceph-mon[78839]: pgmap v102: 65 pgs: 65 active+clean; 306 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T02:59:24.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:23 smithi089 ceph-mon[91553]: Upgrade: Updating osd.3 2024-09-13T02:59:24.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:23 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:59:24.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:23 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-13T02:59:24.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:23 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:59:24.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:23 smithi089 ceph-mon[91553]: Deploying daemon osd.3 on smithi131 2024-09-13T02:59:24.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:23 smithi089 ceph-mon[91553]: pgmap v102: 65 pgs: 65 active+clean; 306 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T02:59:26.184 INFO:journalctl@ceph.osd.3.smithi131.stdout:Sep 13 02:59:25 smithi131 systemd[1]: Stopping Ceph osd.3 for 12cdb164-717a-11ef-bceb-c7b262605968... 2024-09-13T02:59:26.185 INFO:journalctl@ceph.osd.3.smithi131.stdout:Sep 13 02:59:26 smithi131 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-3[40147]: 2024-09-13T02:59:26.169+0000 7efc2918f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T02:59:26.185 INFO:journalctl@ceph.osd.3.smithi131.stdout:Sep 13 02:59:26 smithi131 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-3[40147]: 2024-09-13T02:59:26.169+0000 7efc2918f640 -1 osd.3 62 *** Got signal Terminated *** 2024-09-13T02:59:26.185 INFO:journalctl@ceph.osd.3.smithi131.stdout:Sep 13 02:59:26 smithi131 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-3[40147]: 2024-09-13T02:59:26.169+0000 7efc2918f640 -1 osd.3 62 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T02:59:26.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:26 smithi131 ceph-mon[78839]: pgmap v103: 65 pgs: 65 active+clean; 306 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T02:59:26.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:26 smithi131 ceph-mon[78839]: osd.3 marked itself down and dead 2024-09-13T02:59:27.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:26 smithi089 ceph-mon[91553]: pgmap v103: 65 pgs: 65 active+clean; 306 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T02:59:27.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:26 smithi089 ceph-mon[91553]: osd.3 marked itself down and dead 2024-09-13T02:59:27.422 INFO:journalctl@ceph.osd.3.smithi131.stdout:Sep 13 02:59:27 smithi131 podman[87750]: 2024-09-13 02:59:27.1311603 +0000 UTC m=+1.065885982 container died 0b80a4dea862686fab94567a7834d415dd9d24e333da61cd57e58bf1d252e257 (image=quay.ceph.io/ceph-ci/ceph@sha256:20745bd452f31fe48c67c092910f9b2c550f9dc62d239ff3e2953415a85590be, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-3, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=quincy-bbdadfa, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T02:59:27.684 INFO:journalctl@ceph.osd.3.smithi131.stdout:Sep 13 02:59:27 smithi131 podman[87750]: 2024-09-13 02:59:27.619570075 +0000 UTC m=+1.554295748 container cleanup 0b80a4dea862686fab94567a7834d415dd9d24e333da61cd57e58bf1d252e257 (image=quay.ceph.io/ceph-ci/ceph@sha256:20745bd452f31fe48c67c092910f9b2c550f9dc62d239ff3e2953415a85590be, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-3, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=quincy-bbdadfa, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, ceph=True) 2024-09-13T02:59:27.684 INFO:journalctl@ceph.osd.3.smithi131.stdout:Sep 13 02:59:27 smithi131 bash[87750]: ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-3 2024-09-13T02:59:27.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:27 smithi131 ceph-mon[78839]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T02:59:27.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:27 smithi131 ceph-mon[78839]: osdmap e63: 6 total, 5 up, 6 in 2024-09-13T02:59:27.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:27 smithi131 ceph-mon[78839]: osdmap e64: 6 total, 5 up, 6 in 2024-09-13T02:59:28.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:27 smithi089 ceph-mon[91553]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T02:59:28.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:27 smithi089 ceph-mon[91553]: osdmap e63: 6 total, 5 up, 6 in 2024-09-13T02:59:28.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:27 smithi089 ceph-mon[91553]: osdmap e64: 6 total, 5 up, 6 in 2024-09-13T02:59:28.184 INFO:journalctl@ceph.osd.3.smithi131.stdout:Sep 13 02:59:27 smithi131 podman[87767]: 2024-09-13 02:59:27.879822555 +0000 UTC m=+0.739630615 container remove 0b80a4dea862686fab94567a7834d415dd9d24e333da61cd57e58bf1d252e257 (image=quay.ceph.io/ceph-ci/ceph@sha256:20745bd452f31fe48c67c092910f9b2c550f9dc62d239ff3e2953415a85590be, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-3, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=quincy-bbdadfa, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-13T02:59:28.534 INFO:journalctl@ceph.osd.3.smithi131.stdout:Sep 13 02:59:28 smithi131 podman[87855]: 2024-09-13 02:59:28.132365105 +0000 UTC m=+0.015936655 image pull 19dc8d6597273a47b0b4862f1d0e037b0157b908a02acd63baceec3ee94fbd6c quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d 2024-09-13T02:59:28.534 INFO:journalctl@ceph.osd.3.smithi131.stdout:Sep 13 02:59:28 smithi131 podman[87855]: 2024-09-13 02:59:28.247437046 +0000 UTC m=+0.131008595 container create 7864a38c335f44ef3f0ed134bf427058d84d583e12ae1af0ad0e3ff70fa3b11f (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-7741f7f, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T02:59:28.534 INFO:journalctl@ceph.osd.3.smithi131.stdout:Sep 13 02:59:28 smithi131 podman[87855]: 2024-09-13 02:59:28.449571093 +0000 UTC m=+0.333142642 container init 7864a38c335f44ef3f0ed134bf427058d84d583e12ae1af0ad0e3ff70fa3b11f (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-3-deactivate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-7741f7f, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-13T02:59:28.534 INFO:journalctl@ceph.osd.3.smithi131.stdout:Sep 13 02:59:28 smithi131 podman[87855]: 2024-09-13 02:59:28.452863195 +0000 UTC m=+0.336434747 container start 7864a38c335f44ef3f0ed134bf427058d84d583e12ae1af0ad0e3ff70fa3b11f (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, RELEASE=squid-7741f7f) 2024-09-13T02:59:28.534 INFO:journalctl@ceph.osd.3.smithi131.stdout:Sep 13 02:59:28 smithi131 podman[87855]: 2024-09-13 02:59:28.532892758 +0000 UTC m=+0.416464315 container attach 7864a38c335f44ef3f0ed134bf427058d84d583e12ae1af0ad0e3ff70fa3b11f (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-3-deactivate, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=squid-7741f7f, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=) 2024-09-13T02:59:28.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:28 smithi131 ceph-mon[78839]: pgmap v105: 65 pgs: 16 stale+active+clean, 49 active+clean; 306 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-13T02:59:28.935 INFO:journalctl@ceph.osd.3.smithi131.stdout:Sep 13 02:59:28 smithi131 podman[87855]: 2024-09-13 02:59:28.643804244 +0000 UTC m=+0.527375802 container died 7864a38c335f44ef3f0ed134bf427058d84d583e12ae1af0ad0e3ff70fa3b11f (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-3-deactivate, RELEASE=squid-7741f7f, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-13T02:59:29.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:28 smithi089 ceph-mon[91553]: pgmap v105: 65 pgs: 16 stale+active+clean, 49 active+clean; 306 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-13T02:59:29.684 INFO:journalctl@ceph.osd.3.smithi131.stdout:Sep 13 02:59:29 smithi131 podman[87878]: 2024-09-13 02:59:29.269667435 +0000 UTC m=+0.619825900 container remove 7864a38c335f44ef3f0ed134bf427058d84d583e12ae1af0ad0e3ff70fa3b11f (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-3-deactivate, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-7741f7f, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T02:59:29.684 INFO:journalctl@ceph.osd.3.smithi131.stdout:Sep 13 02:59:29 smithi131 systemd[1]: ceph-12cdb164-717a-11ef-bceb-c7b262605968@osd.3.service: Deactivated successfully. 2024-09-13T02:59:29.684 INFO:journalctl@ceph.osd.3.smithi131.stdout:Sep 13 02:59:29 smithi131 systemd[1]: Stopped Ceph osd.3 for 12cdb164-717a-11ef-bceb-c7b262605968. 2024-09-13T02:59:29.685 INFO:journalctl@ceph.osd.3.smithi131.stdout:Sep 13 02:59:29 smithi131 systemd[1]: ceph-12cdb164-717a-11ef-bceb-c7b262605968@osd.3.service: Consumed 1min 6.013s CPU time. 2024-09-13T02:59:29.685 INFO:journalctl@ceph.osd.3.smithi131.stdout:Sep 13 02:59:29 smithi131 systemd[1]: Starting Ceph osd.3 for 12cdb164-717a-11ef-bceb-c7b262605968... 2024-09-13T02:59:29.974 INFO:journalctl@ceph.osd.3.smithi131.stdout:Sep 13 02:59:29 smithi131 podman[87979]: 2024-09-13 02:59:29.607703725 +0000 UTC m=+0.015931426 image pull 19dc8d6597273a47b0b4862f1d0e037b0157b908a02acd63baceec3ee94fbd6c quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d 2024-09-13T02:59:29.974 INFO:journalctl@ceph.osd.3.smithi131.stdout:Sep 13 02:59:29 smithi131 podman[87979]: 2024-09-13 02:59:29.746000606 +0000 UTC m=+0.154228303 container create 4f764619cc7a1c9d24b63a6ee0ccd26d7920b731db1f71084ec85af832deb723 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-3-activate, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-7741f7f, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-09-13T02:59:29.974 INFO:journalctl@ceph.osd.3.smithi131.stdout:Sep 13 02:59:29 smithi131 podman[87979]: 2024-09-13 02:59:29.973619743 +0000 UTC m=+0.381847445 container init 4f764619cc7a1c9d24b63a6ee0ccd26d7920b731db1f71084ec85af832deb723 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-3-activate, GIT_BRANCH=HEAD, RELEASE=squid-7741f7f, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T02:59:30.434 INFO:journalctl@ceph.osd.3.smithi131.stdout:Sep 13 02:59:29 smithi131 podman[87979]: 2024-09-13 02:59:29.976964503 +0000 UTC m=+0.385192201 container start 4f764619cc7a1c9d24b63a6ee0ccd26d7920b731db1f71084ec85af832deb723 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-3-activate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-7741f7f, ceph=True) 2024-09-13T02:59:30.434 INFO:journalctl@ceph.osd.3.smithi131.stdout:Sep 13 02:59:30 smithi131 podman[87979]: 2024-09-13 02:59:30.073417018 +0000 UTC m=+0.481644727 container attach 4f764619cc7a1c9d24b63a6ee0ccd26d7920b731db1f71084ec85af832deb723 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-3-activate, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=squid-7741f7f, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T02:59:30.435 INFO:journalctl@ceph.osd.3.smithi131.stdout:Sep 13 02:59:30 smithi131 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-3-activate[87994]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T02:59:30.435 INFO:journalctl@ceph.osd.3.smithi131.stdout:Sep 13 02:59:30 smithi131 bash[87979]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T02:59:30.435 INFO:journalctl@ceph.osd.3.smithi131.stdout:Sep 13 02:59:30 smithi131 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-3-activate[87994]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T02:59:30.435 INFO:journalctl@ceph.osd.3.smithi131.stdout:Sep 13 02:59:30 smithi131 bash[87979]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T02:59:30.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:30 smithi131 ceph-mon[78839]: pgmap v107: 65 pgs: 16 stale+active+clean, 49 active+clean; 306 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T02:59:30.934 INFO:journalctl@ceph.osd.3.smithi131.stdout:Sep 13 02:59:30 smithi131 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-3-activate[87994]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-13T02:59:30.934 INFO:journalctl@ceph.osd.3.smithi131.stdout:Sep 13 02:59:30 smithi131 bash[87979]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-13T02:59:30.934 INFO:journalctl@ceph.osd.3.smithi131.stdout:Sep 13 02:59:30 smithi131 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-3-activate[87994]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-13T02:59:30.934 INFO:journalctl@ceph.osd.3.smithi131.stdout:Sep 13 02:59:30 smithi131 bash[87979]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-09-13T02:59:31.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:30 smithi089 ceph-mon[91553]: pgmap v107: 65 pgs: 16 stale+active+clean, 49 active+clean; 306 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 1.2 KiB/s rd, 2 op/s 2024-09-13T02:59:31.434 INFO:journalctl@ceph.osd.3.smithi131.stdout:Sep 13 02:59:31 smithi131 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-3-activate[87994]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-13T02:59:31.434 INFO:journalctl@ceph.osd.3.smithi131.stdout:Sep 13 02:59:31 smithi131 bash[87979]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-09-13T02:59:31.434 INFO:journalctl@ceph.osd.3.smithi131.stdout:Sep 13 02:59:31 smithi131 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-3-activate[87994]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-13T02:59:31.434 INFO:journalctl@ceph.osd.3.smithi131.stdout:Sep 13 02:59:31 smithi131 bash[87979]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-09-13T02:59:31.434 INFO:journalctl@ceph.osd.3.smithi131.stdout:Sep 13 02:59:31 smithi131 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-3-activate[87994]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-09-13T02:59:31.434 INFO:journalctl@ceph.osd.3.smithi131.stdout:Sep 13 02:59:31 smithi131 bash[87979]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-09-13T02:59:31.434 INFO:journalctl@ceph.osd.3.smithi131.stdout:Sep 13 02:59:31 smithi131 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-3-activate[87994]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-13T02:59:31.435 INFO:journalctl@ceph.osd.3.smithi131.stdout:Sep 13 02:59:31 smithi131 bash[87979]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-13T02:59:31.435 INFO:journalctl@ceph.osd.3.smithi131.stdout:Sep 13 02:59:31 smithi131 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-3-activate[87994]: --> ceph-volume raw activate successful for osd ID: 3 2024-09-13T02:59:31.435 INFO:journalctl@ceph.osd.3.smithi131.stdout:Sep 13 02:59:31 smithi131 bash[87979]: --> ceph-volume raw activate successful for osd ID: 3 2024-09-13T02:59:31.435 INFO:journalctl@ceph.osd.3.smithi131.stdout:Sep 13 02:59:31 smithi131 podman[87979]: 2024-09-13 02:59:31.150581431 +0000 UTC m=+1.558809132 container died 4f764619cc7a1c9d24b63a6ee0ccd26d7920b731db1f71084ec85af832deb723 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-3-activate, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-7741f7f, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2) 2024-09-13T02:59:31.903 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:31 smithi131 ceph-mon[78839]: Health check failed: Degraded data redundancy: 75/357 objects degraded (21.008%), 20 pgs degraded (PG_DEGRADED) 2024-09-13T02:59:31.903 INFO:journalctl@ceph.osd.3.smithi131.stdout:Sep 13 02:59:31 smithi131 podman[88139]: 2024-09-13 02:59:31.593383231 +0000 UTC m=+0.436723843 container remove 4f764619cc7a1c9d24b63a6ee0ccd26d7920b731db1f71084ec85af832deb723 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-3-activate, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-7741f7f, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-13T02:59:31.903 INFO:journalctl@ceph.osd.3.smithi131.stdout:Sep 13 02:59:31 smithi131 podman[88197]: 2024-09-13 02:59:31.706101451 +0000 UTC m=+0.016599000 image pull 19dc8d6597273a47b0b4862f1d0e037b0157b908a02acd63baceec3ee94fbd6c quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d 2024-09-13T02:59:31.903 INFO:journalctl@ceph.osd.3.smithi131.stdout:Sep 13 02:59:31 smithi131 podman[88197]: 2024-09-13 02:59:31.902519341 +0000 UTC m=+0.213016881 container create e77cff6248696cd631f551696c190b3b5ad28a5a22e37c666bc7654902e05995 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-3, RELEASE=squid-7741f7f, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2) 2024-09-13T02:59:32.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:31 smithi089 ceph-mon[91553]: Health check failed: Degraded data redundancy: 75/357 objects degraded (21.008%), 20 pgs degraded (PG_DEGRADED) 2024-09-13T02:59:32.154 INFO:journalctl@ceph.osd.3.smithi131.stdout:Sep 13 02:59:32 smithi131 podman[88197]: 2024-09-13 02:59:32.12979283 +0000 UTC m=+0.440290381 container init e77cff6248696cd631f551696c190b3b5ad28a5a22e37c666bc7654902e05995 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-3, GIT_CLEAN=True, RELEASE=squid-7741f7f, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, ceph=True) 2024-09-13T02:59:32.155 INFO:journalctl@ceph.osd.3.smithi131.stdout:Sep 13 02:59:32 smithi131 podman[88197]: 2024-09-13 02:59:32.132965043 +0000 UTC m=+0.443462586 container start e77cff6248696cd631f551696c190b3b5ad28a5a22e37c666bc7654902e05995 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-3, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, RELEASE=squid-7741f7f, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-13T02:59:32.434 INFO:journalctl@ceph.osd.3.smithi131.stdout:Sep 13 02:59:32 smithi131 ceph-osd[88216]: -- 172.21.15.131:0/3659035649 <== mon.1 v2:172.21.15.131:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5634035f41e0 con 0x56340358a000 2024-09-13T02:59:32.434 INFO:journalctl@ceph.osd.3.smithi131.stdout:Sep 13 02:59:32 smithi131 bash[88197]: e77cff6248696cd631f551696c190b3b5ad28a5a22e37c666bc7654902e05995 2024-09-13T02:59:32.434 INFO:journalctl@ceph.osd.3.smithi131.stdout:Sep 13 02:59:32 smithi131 systemd[1]: Started Ceph osd.3 for 12cdb164-717a-11ef-bceb-c7b262605968. 2024-09-13T02:59:33.029 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:32 smithi131 ceph-mon[78839]: pgmap v108: 65 pgs: 18 active+undersized, 20 active+undersized+degraded, 27 active+clean; 306 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 75/357 objects degraded (21.008%) 2024-09-13T02:59:33.029 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:32 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:59:33.029 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:32 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:59:33.029 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:32 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:59:33.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:32 smithi089 ceph-mon[91553]: pgmap v108: 65 pgs: 18 active+undersized, 20 active+undersized+degraded, 27 active+clean; 306 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 75/357 objects degraded (21.008%) 2024-09-13T02:59:33.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:32 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:59:33.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:32 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:59:33.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:32 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:59:34.314 INFO:journalctl@ceph.osd.3.smithi131.stdout:Sep 13 02:59:34 smithi131 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-3[88212]: 2024-09-13T02:59:34.030+0000 7f3dc5be5640 -1 Falling back to public interface 2024-09-13T02:59:34.780 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:34 smithi089 ceph-mon[91553]: pgmap v109: 65 pgs: 18 active+undersized, 20 active+undersized+degraded, 27 active+clean; 306 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 75/357 objects degraded (21.008%) 2024-09-13T02:59:34.782 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:34.776+0000 7f39d84e4640 1 -- 172.21.15.89:0/1203607949 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39d00fc720 msgr2=0x7f39d00fcb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:34.782 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:34.776+0000 7f39d84e4640 1 --2- 172.21.15.89:0/1203607949 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39d00fc720 0x7f39d00fcb90 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f39c00048d0 tx=0x7f39c0009da0 comp rx=0 tx=0).stop 2024-09-13T02:59:34.783 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:34.777+0000 7f39d84e4640 1 -- 172.21.15.89:0/1203607949 shutdown_connections 2024-09-13T02:59:34.783 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:34.777+0000 7f39d84e4640 1 --2- 172.21.15.89:0/1203607949 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39d00fc720 0x7f39d00fcb90 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:34.783 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:34.777+0000 7f39d84e4640 1 --2- 172.21.15.89:0/1203607949 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f39d00fb450 0x7f39d00fb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:34.783 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:34.777+0000 7f39d84e4640 1 -- 172.21.15.89:0/1203607949 >> 172.21.15.89:0/1203607949 conn(0x7f39d00f6c10 msgr2=0x7f39d00f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:59:34.783 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:34.777+0000 7f39d84e4640 1 -- 172.21.15.89:0/1203607949 shutdown_connections 2024-09-13T02:59:34.783 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:34.777+0000 7f39d84e4640 1 -- 172.21.15.89:0/1203607949 wait complete. 2024-09-13T02:59:34.783 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:34.777+0000 7f39d84e4640 1 Processor -- start 2024-09-13T02:59:34.783 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:34.777+0000 7f39d84e4640 1 -- start start 2024-09-13T02:59:34.783 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:34.777+0000 7f39d84e4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39d00fb450 0x7f39d010fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:59:34.783 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:34.777+0000 7f39d84e4640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f39d00fc720 0x7f39d0112350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:59:34.783 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:34.777+0000 7f39d84e4640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39d0066730 con 0x7f39d00fb450 2024-09-13T02:59:34.783 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:34.777+0000 7f39d84e4640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39d00668a0 con 0x7f39d00fc720 2024-09-13T02:59:34.784 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:34.778+0000 7f39d6280640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39d00fb450 0x7f39d010fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:59:34.784 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:34.778+0000 7f39d5a7f640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f39d00fc720 0x7f39d0112350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:59:34.784 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:34.778+0000 7f39d6280640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39d00fb450 0x7f39d010fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:52914/0 (socket says 172.21.15.89:52914) 2024-09-13T02:59:34.784 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:34.778+0000 7f39d6280640 1 -- 172.21.15.89:0/3841825875 learned_addr learned my addr 172.21.15.89:0/3841825875 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:59:34.784 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:34.778+0000 7f39d6280640 1 -- 172.21.15.89:0/3841825875 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f39d00fc720 msgr2=0x7f39d0112350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:34.784 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:34.778+0000 7f39d6280640 1 --2- 172.21.15.89:0/3841825875 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f39d00fc720 0x7f39d0112350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:34.784 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:34.778+0000 7f39d6280640 1 -- 172.21.15.89:0/3841825875 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39c0005040 con 0x7f39d00fb450 2024-09-13T02:59:34.784 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:34.778+0000 7f39d5a7f640 1 --2- 172.21.15.89:0/3841825875 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f39d00fc720 0x7f39d0112350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T02:59:34.784 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:34.778+0000 7f39d6280640 1 --2- 172.21.15.89:0/3841825875 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39d00fb450 0x7f39d010fe00 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f39cc00eb70 tx=0x7f39cc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:59:34.784 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:34.778+0000 7f39c6ffd640 1 -- 172.21.15.89:0/3841825875 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f39cc007c30 con 0x7f39d00fb450 2024-09-13T02:59:34.784 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:34.778+0000 7f39c6ffd640 1 -- 172.21.15.89:0/3841825875 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f39cc00f040 con 0x7f39d00fb450 2024-09-13T02:59:34.784 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:34.778+0000 7f39d84e4640 1 -- 172.21.15.89:0/3841825875 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39d0112890 con 0x7f39d00fb450 2024-09-13T02:59:34.784 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:34.778+0000 7f39c6ffd640 1 -- 172.21.15.89:0/3841825875 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f39cc0094e0 con 0x7f39d00fb450 2024-09-13T02:59:34.784 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:34.779+0000 7f39d84e4640 1 -- 172.21.15.89:0/3841825875 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39d0112e00 con 0x7f39d00fb450 2024-09-13T02:59:34.785 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:34.780+0000 7f39d84e4640 1 -- 172.21.15.89:0/3841825875 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39d00fa8b0 con 0x7f39d00fb450 2024-09-13T02:59:34.785 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:34.780+0000 7f39c6ffd640 1 -- 172.21.15.89:0/3841825875 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f39cc0097b0 con 0x7f39d00fb450 2024-09-13T02:59:34.785 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:34.781+0000 7f39c6ffd640 1 --2- 172.21.15.89:0/3841825875 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f39bc06e530 0x7f39bc0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:59:34.785 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:34.781+0000 7f39c6ffd640 1 -- 172.21.15.89:0/3841825875 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f39cc08de00 con 0x7f39d00fb450 2024-09-13T02:59:34.786 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:34.781+0000 7f39d5a7f640 1 --2- 172.21.15.89:0/3841825875 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f39bc06e530 0x7f39bc0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:59:34.786 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:34.781+0000 7f39d5a7f640 1 --2- 172.21.15.89:0/3841825875 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f39bc06e530 0x7f39bc0709e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f39c0003080 tx=0x7f39c0035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:59:34.787 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:34.785+0000 7f39c6ffd640 1 -- 172.21.15.89:0/3841825875 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f39cc056fa0 con 0x7f39d00fb450 2024-09-13T02:59:34.993 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:34.991+0000 7f39d84e4640 1 -- 172.21.15.89:0/3841825875 --> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f39d0100b70 con 0x7f39bc06e530 2024-09-13T02:59:34.994 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:34.992+0000 7f39c6ffd640 1 -- 172.21.15.89:0/3841825875 <== mgr.34104 v2:172.21.15.89:6800/1881577856 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f39d0100b70 con 0x7f39bc06e530 2024-09-13T02:59:34.997 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:34.994+0000 7f39d84e4640 1 -- 172.21.15.89:0/3841825875 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f39bc06e530 msgr2=0x7f39bc0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:34.997 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:34.994+0000 7f39d84e4640 1 --2- 172.21.15.89:0/3841825875 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f39bc06e530 0x7f39bc0709e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f39c0003080 tx=0x7f39c0035040 comp rx=0 tx=0).stop 2024-09-13T02:59:34.997 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:34.994+0000 7f39d84e4640 1 -- 172.21.15.89:0/3841825875 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39d00fb450 msgr2=0x7f39d010fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:34.997 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:34.994+0000 7f39d84e4640 1 --2- 172.21.15.89:0/3841825875 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39d00fb450 0x7f39d010fe00 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f39cc00eb70 tx=0x7f39cc00b040 comp rx=0 tx=0).stop 2024-09-13T02:59:34.997 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:34.994+0000 7f39d84e4640 1 -- 172.21.15.89:0/3841825875 shutdown_connections 2024-09-13T02:59:34.997 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:34.994+0000 7f39d84e4640 1 --2- 172.21.15.89:0/3841825875 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f39bc06e530 0x7f39bc0709e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:34.997 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:34.994+0000 7f39d84e4640 1 --2- 172.21.15.89:0/3841825875 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f39d00fc720 0x7f39d0112350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:34.997 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:34.994+0000 7f39d84e4640 1 --2- 172.21.15.89:0/3841825875 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f39d00fb450 0x7f39d010fe00 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:34.997 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:34.994+0000 7f39d84e4640 1 -- 172.21.15.89:0/3841825875 >> 172.21.15.89:0/3841825875 conn(0x7f39d00f6c10 msgr2=0x7f39d00f8410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:59:34.997 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:34.994+0000 7f39d84e4640 1 -- 172.21.15.89:0/3841825875 shutdown_connections 2024-09-13T02:59:34.997 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:34.994+0000 7f39d84e4640 1 -- 172.21.15.89:0/3841825875 wait complete. 2024-09-13T02:59:35.005 INFO:teuthology.orchestra.run.smithi089.stdout:true 2024-09-13T02:59:35.078 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.075+0000 7ff409ed6640 1 -- 172.21.15.89:0/374254181 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff40406ffe0 msgr2=0x7ff404070450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:35.078 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.075+0000 7ff409ed6640 1 --2- 172.21.15.89:0/374254181 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff40406ffe0 0x7ff404070450 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff3f80048d0 tx=0x7ff3f8009da0 comp rx=0 tx=0).stop 2024-09-13T02:59:35.078 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.075+0000 7ff409ed6640 1 -- 172.21.15.89:0/374254181 shutdown_connections 2024-09-13T02:59:35.078 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.075+0000 7ff409ed6640 1 --2- 172.21.15.89:0/374254181 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff40406ffe0 0x7ff404070450 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:35.078 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.075+0000 7ff409ed6640 1 --2- 172.21.15.89:0/374254181 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff404071570 0x7ff40406faa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:35.079 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.075+0000 7ff409ed6640 1 -- 172.21.15.89:0/374254181 >> 172.21.15.89:0/374254181 conn(0x7ff4040f7d30 msgr2=0x7ff4040fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:59:35.079 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.075+0000 7ff409ed6640 1 -- 172.21.15.89:0/374254181 shutdown_connections 2024-09-13T02:59:35.079 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.075+0000 7ff409ed6640 1 -- 172.21.15.89:0/374254181 wait complete. 2024-09-13T02:59:35.079 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.076+0000 7ff409ed6640 1 Processor -- start 2024-09-13T02:59:35.079 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.076+0000 7ff409ed6640 1 -- start start 2024-09-13T02:59:35.080 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.076+0000 7ff409ed6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff40406ffe0 0x7ff40410f260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:59:35.080 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.076+0000 7ff409ed6640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff404071570 0x7ff40410f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:59:35.080 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.076+0000 7ff409ed6640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff40410fdf0 con 0x7ff40406ffe0 2024-09-13T02:59:35.080 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.076+0000 7ff409ed6640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff404110610 con 0x7ff404071570 2024-09-13T02:59:35.080 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.076+0000 7ff4037fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff40406ffe0 0x7ff40410f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:59:35.080 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.076+0000 7ff4037fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff40406ffe0 0x7ff40410f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:52922/0 (socket says 172.21.15.89:52922) 2024-09-13T02:59:35.080 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.076+0000 7ff4037fe640 1 -- 172.21.15.89:0/3186245876 learned_addr learned my addr 172.21.15.89:0/3186245876 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:59:35.081 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.076+0000 7ff402ffd640 1 --2- 172.21.15.89:0/3186245876 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff404071570 0x7ff40410f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:59:35.081 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.077+0000 7ff4037fe640 1 -- 172.21.15.89:0/3186245876 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff404071570 msgr2=0x7ff40410f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:35.081 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.077+0000 7ff4037fe640 1 --2- 172.21.15.89:0/3186245876 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff404071570 0x7ff40410f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:35.081 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.077+0000 7ff4037fe640 1 -- 172.21.15.89:0/3186245876 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3f8005040 con 0x7ff40406ffe0 2024-09-13T02:59:35.081 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.077+0000 7ff4037fe640 1 --2- 172.21.15.89:0/3186245876 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff40406ffe0 0x7ff40410f260 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff3f4002a80 tx=0x7ff3f4004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:59:35.081 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.077+0000 7ff3ebfff640 1 -- 172.21.15.89:0/3186245876 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff3f4007c30 con 0x7ff40406ffe0 2024-09-13T02:59:35.081 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.077+0000 7ff3ebfff640 1 -- 172.21.15.89:0/3186245876 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff3f400f040 con 0x7ff40406ffe0 2024-09-13T02:59:35.081 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.077+0000 7ff409ed6640 1 -- 172.21.15.89:0/3186245876 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4041108a0 con 0x7ff40406ffe0 2024-09-13T02:59:35.081 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.077+0000 7ff3ebfff640 1 -- 172.21.15.89:0/3186245876 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff3f400dad0 con 0x7ff40406ffe0 2024-09-13T02:59:35.081 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.077+0000 7ff409ed6640 1 -- 172.21.15.89:0/3186245876 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff404110e40 con 0x7ff40406ffe0 2024-09-13T02:59:35.081 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.078+0000 7ff409ed6640 1 -- 172.21.15.89:0/3186245876 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4040fb9b0 con 0x7ff40406ffe0 2024-09-13T02:59:35.082 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.078+0000 7ff3ebfff640 1 -- 172.21.15.89:0/3186245876 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7ff3f400dc30 con 0x7ff40406ffe0 2024-09-13T02:59:35.082 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.079+0000 7ff3ebfff640 1 --2- 172.21.15.89:0/3186245876 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7ff3ec06e530 0x7ff3ec0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:59:35.082 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.079+0000 7ff3ebfff640 1 -- 172.21.15.89:0/3186245876 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6496+0+0 (secure 0 0 0) 0x7ff3f408df30 con 0x7ff40406ffe0 2024-09-13T02:59:35.082 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.079+0000 7ff402ffd640 1 --2- 172.21.15.89:0/3186245876 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7ff3ec06e530 0x7ff3ec0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:59:35.082 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.079+0000 7ff402ffd640 1 --2- 172.21.15.89:0/3186245876 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7ff3ec06e530 0x7ff3ec0709e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff40410f010 tx=0x7ff3f8035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:59:35.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.083+0000 7ff3ebfff640 1 -- 172.21.15.89:0/3186245876 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7ff3f40570a0 con 0x7ff40406ffe0 2024-09-13T02:59:35.183 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:34 smithi131 ceph-mon[78839]: pgmap v109: 65 pgs: 18 active+undersized, 20 active+undersized+degraded, 27 active+clean; 306 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 75/357 objects degraded (21.008%) 2024-09-13T02:59:35.269 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.267+0000 7ff409ed6640 1 -- 172.21.15.89:0/3186245876 --> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff404111220 con 0x7ff3ec06e530 2024-09-13T02:59:35.270 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.268+0000 7ff3ebfff640 1 -- 172.21.15.89:0/3186245876 <== mgr.34104 v2:172.21.15.89:6800/1881577856 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7ff404111220 con 0x7ff3ec06e530 2024-09-13T02:59:35.273 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.270+0000 7ff409ed6640 1 -- 172.21.15.89:0/3186245876 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7ff3ec06e530 msgr2=0x7ff3ec0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:35.273 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.270+0000 7ff409ed6640 1 --2- 172.21.15.89:0/3186245876 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7ff3ec06e530 0x7ff3ec0709e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ff40410f010 tx=0x7ff3f8035040 comp rx=0 tx=0).stop 2024-09-13T02:59:35.273 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.270+0000 7ff409ed6640 1 -- 172.21.15.89:0/3186245876 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff40406ffe0 msgr2=0x7ff40410f260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:35.273 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.270+0000 7ff409ed6640 1 --2- 172.21.15.89:0/3186245876 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff40406ffe0 0x7ff40410f260 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff3f4002a80 tx=0x7ff3f4004570 comp rx=0 tx=0).stop 2024-09-13T02:59:35.273 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.270+0000 7ff409ed6640 1 -- 172.21.15.89:0/3186245876 shutdown_connections 2024-09-13T02:59:35.273 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.270+0000 7ff409ed6640 1 --2- 172.21.15.89:0/3186245876 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7ff3ec06e530 0x7ff3ec0709e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:35.273 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.270+0000 7ff409ed6640 1 --2- 172.21.15.89:0/3186245876 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff404071570 0x7ff40410f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:35.273 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.270+0000 7ff409ed6640 1 --2- 172.21.15.89:0/3186245876 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff40406ffe0 0x7ff40410f260 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:35.273 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.270+0000 7ff409ed6640 1 -- 172.21.15.89:0/3186245876 >> 172.21.15.89:0/3186245876 conn(0x7ff4040f7d30 msgr2=0x7ff4040f94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:59:35.273 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.270+0000 7ff409ed6640 1 -- 172.21.15.89:0/3186245876 shutdown_connections 2024-09-13T02:59:35.273 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.270+0000 7ff409ed6640 1 -- 172.21.15.89:0/3186245876 wait complete. 2024-09-13T02:59:35.353 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.349+0000 7f6e6c81e640 1 -- 172.21.15.89:0/1324815453 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e68065bc0 msgr2=0x7f6e680ff1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:35.353 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.349+0000 7f6e6c81e640 1 --2- 172.21.15.89:0/1324815453 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e68065bc0 0x7f6e680ff1c0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f6e60009c50 tx=0x7f6e60004d10 comp rx=0 tx=0).stop 2024-09-13T02:59:35.353 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.350+0000 7f6e6c81e640 1 -- 172.21.15.89:0/1324815453 shutdown_connections 2024-09-13T02:59:35.353 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.350+0000 7f6e6c81e640 1 --2- 172.21.15.89:0/1324815453 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e680ff700 0x7f6e68101ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:35.353 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.350+0000 7f6e6c81e640 1 --2- 172.21.15.89:0/1324815453 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e68065bc0 0x7f6e680ff1c0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:35.353 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.350+0000 7f6e6c81e640 1 -- 172.21.15.89:0/1324815453 >> 172.21.15.89:0/1324815453 conn(0x7f6e680f6c10 msgr2=0x7f6e680f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:59:35.353 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.350+0000 7f6e6c81e640 1 -- 172.21.15.89:0/1324815453 shutdown_connections 2024-09-13T02:59:35.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.350+0000 7f6e6c81e640 1 -- 172.21.15.89:0/1324815453 wait complete. 2024-09-13T02:59:35.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.350+0000 7f6e6c81e640 1 Processor -- start 2024-09-13T02:59:35.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.350+0000 7f6e6c81e640 1 -- start start 2024-09-13T02:59:35.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.350+0000 7f6e6c81e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e68065bc0 0x7f6e680fcb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:59:35.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.350+0000 7f6e6c81e640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e680ff700 0x7f6e680fb0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:59:35.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.350+0000 7f6e6c81e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e680fb600 con 0x7f6e68065bc0 2024-09-13T02:59:35.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.350+0000 7f6e6c81e640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e680fb740 con 0x7f6e680ff700 2024-09-13T02:59:35.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.350+0000 7f6e6659c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e68065bc0 0x7f6e680fcb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:59:35.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.350+0000 7f6e6659c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e68065bc0 0x7f6e680fcb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:52932/0 (socket says 172.21.15.89:52932) 2024-09-13T02:59:35.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.350+0000 7f6e6659c640 1 -- 172.21.15.89:0/1362684438 learned_addr learned my addr 172.21.15.89:0/1362684438 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:59:35.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.351+0000 7f6e65d9b640 1 --2- 172.21.15.89:0/1362684438 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e680ff700 0x7f6e680fb0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:59:35.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.352+0000 7f6e6659c640 1 -- 172.21.15.89:0/1362684438 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e680ff700 msgr2=0x7f6e680fb0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:35.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.352+0000 7f6e6659c640 1 --2- 172.21.15.89:0/1362684438 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e680ff700 0x7f6e680fb0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:35.354 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.352+0000 7f6e6659c640 1 -- 172.21.15.89:0/1362684438 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e600098b0 con 0x7f6e68065bc0 2024-09-13T02:59:35.355 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.352+0000 7f6e6659c640 1 --2- 172.21.15.89:0/1362684438 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e68065bc0 0x7f6e680fcb80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6e60000f80 tx=0x7f6e60004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:59:35.356 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.352+0000 7f6e5effd640 1 -- 172.21.15.89:0/1362684438 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e60009710 con 0x7f6e68065bc0 2024-09-13T02:59:35.356 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.352+0000 7f6e5effd640 1 -- 172.21.15.89:0/1362684438 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f6e60032b10 con 0x7f6e68065bc0 2024-09-13T02:59:35.356 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.352+0000 7f6e6c81e640 1 -- 172.21.15.89:0/1362684438 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e680fb9c0 con 0x7f6e68065bc0 2024-09-13T02:59:35.356 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.352+0000 7f6e5effd640 1 -- 172.21.15.89:0/1362684438 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e6003db30 con 0x7f6e68065bc0 2024-09-13T02:59:35.356 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.352+0000 7f6e6c81e640 1 -- 172.21.15.89:0/1362684438 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e68115150 con 0x7f6e68065bc0 2024-09-13T02:59:35.356 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.352+0000 7f6e6c81e640 1 -- 172.21.15.89:0/1362684438 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e680fa890 con 0x7f6e68065bc0 2024-09-13T02:59:35.356 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.353+0000 7f6e5effd640 1 -- 172.21.15.89:0/1362684438 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f6e6002f030 con 0x7f6e68065bc0 2024-09-13T02:59:35.357 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.354+0000 7f6e5effd640 1 --2- 172.21.15.89:0/1362684438 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f6e5406e530 0x7f6e540709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:59:35.357 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.354+0000 7f6e5effd640 1 -- 172.21.15.89:0/1362684438 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f6e600af180 con 0x7f6e68065bc0 2024-09-13T02:59:35.357 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.354+0000 7f6e65d9b640 1 --2- 172.21.15.89:0/1362684438 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f6e5406e530 0x7f6e540709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:59:35.357 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.354+0000 7f6e65d9b640 1 --2- 172.21.15.89:0/1362684438 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f6e5406e530 0x7f6e540709e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6e68066060 tx=0x7f6e5000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:59:35.360 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.358+0000 7f6e5effd640 1 -- 172.21.15.89:0/1362684438 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f6e600782f0 con 0x7f6e68065bc0 2024-09-13T02:59:35.535 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.532+0000 7f6e6c81e640 1 -- 172.21.15.89:0/1362684438 --> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f6e680f8700 con 0x7f6e5406e530 2024-09-13T02:59:35.545 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.542+0000 7f6e5effd640 1 -- 172.21.15.89:0/1362684438 <== mgr.34104 v2:172.21.15.89:6800/1881577856 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f6e680f8700 con 0x7f6e5406e530 2024-09-13T02:59:35.545 INFO:teuthology.orchestra.run.smithi089.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T02:59:35.545 INFO:teuthology.orchestra.run.smithi089.stdout:alertmanager.smithi089 smithi089 *:9093,9094 running (4m) 33s ago 13m 25.7M - 0.25.0 c8568f914cd2 1d2432f5479e 2024-09-13T02:59:35.545 INFO:teuthology.orchestra.run.smithi089.stdout:crash.smithi089 smithi089 running (2m) 33s ago 13m 6891k - 19.1.1-322-g7741f7f9 19dc8d659727 0ef15ca3e7f9 2024-09-13T02:59:35.545 INFO:teuthology.orchestra.run.smithi089.stdout:crash.smithi131 smithi131 running (2m) 0s ago 12m 6895k - 19.1.1-322-g7741f7f9 19dc8d659727 21e4d6fc04f7 2024-09-13T02:59:35.545 INFO:teuthology.orchestra.run.smithi089.stdout:grafana.smithi089 smithi089 *:3000 running (4m) 33s ago 12m 79.0M - 9.4.7 954c08fa6188 dee914ded1af 2024-09-13T02:59:35.545 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi089.qjoitb smithi089 running (7m) 33s ago 7m 70.3M - 17.2.7-1627-gbbdadfa3 a994b00deb3a ff9b59ec5107 2024-09-13T02:59:35.545 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi089.rarddb smithi089 running (7m) 33s ago 7m 135M - 17.2.7-1627-gbbdadfa3 a994b00deb3a db2dc502c1ba 2024-09-13T02:59:35.545 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi131.rbovzc smithi131 running (7m) 0s ago 7m 60.3M - 17.2.7-1627-gbbdadfa3 a994b00deb3a d071b6d99537 2024-09-13T02:59:35.546 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi131.uasrkg smithi131 running (7m) 0s ago 7m 112M - 17.2.7-1627-gbbdadfa3 a994b00deb3a 0b3d4ffa6ce5 2024-09-13T02:59:35.546 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.smithi089.guohvs smithi089 *:8443,9283,8765 running (3m) 33s ago 14m 498M - 19.1.1-322-g7741f7f9 19dc8d659727 1e887446f1b0 2024-09-13T02:59:35.546 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.smithi131.aunbqd smithi131 *:8443,9283,8765 running (3m) 0s ago 12m 440M - 19.1.1-322-g7741f7f9 19dc8d659727 358d7478f2ba 2024-09-13T02:59:35.546 INFO:teuthology.orchestra.run.smithi089.stdout:mon.smithi089 smithi089 running (3m) 33s ago 14m 46.4M 2048M 19.1.1-322-g7741f7f9 19dc8d659727 8a29fb65028f 2024-09-13T02:59:35.546 INFO:teuthology.orchestra.run.smithi089.stdout:mon.smithi131 smithi131 running (2m) 0s ago 12m 41.5M 2048M 19.1.1-322-g7741f7f9 19dc8d659727 506310ad8620 2024-09-13T02:59:35.546 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.smithi089 smithi089 *:9100 running (4m) 33s ago 13m 16.9M - 1.5.0 0da6a335fe13 5a9927b583e6 2024-09-13T02:59:35.546 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.smithi131 smithi131 *:9100 running (3m) 0s ago 12m 15.7M - 1.5.0 0da6a335fe13 bcfde5d1a508 2024-09-13T02:59:35.546 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0 smithi089 running (108s) 33s ago 11m 93.7M 1557M 19.1.1-322-g7741f7f9 19dc8d659727 e8038f6d52b6 2024-09-13T02:59:35.546 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1 smithi089 running (73s) 33s ago 11m 94.5M 1557M 19.1.1-322-g7741f7f9 19dc8d659727 e174144d9633 2024-09-13T02:59:35.546 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2 smithi089 running (38s) 33s ago 10m 11.2M 1557M 19.1.1-322-g7741f7f9 19dc8d659727 2d8cab08c2b3 2024-09-13T02:59:35.546 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3 smithi131 running (3s) 0s ago 10m 12.1M 2581M 19.1.1-322-g7741f7f9 19dc8d659727 e77cff624869 2024-09-13T02:59:35.546 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4 smithi131 running (9m) 0s ago 9m 236M 2581M 17.2.7-1627-gbbdadfa3 a994b00deb3a 06ec44680b00 2024-09-13T02:59:35.546 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5 smithi131 running (9m) 0s ago 9m 229M 2581M 17.2.7-1627-gbbdadfa3 a994b00deb3a ace4b45e5873 2024-09-13T02:59:35.547 INFO:teuthology.orchestra.run.smithi089.stdout:prometheus.smithi089 smithi089 *:9095 running (3m) 33s ago 12m 56.4M - 2.43.0 a07b618ecd1d 9d336370c187 2024-09-13T02:59:35.549 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.544+0000 7f6e6c81e640 1 -- 172.21.15.89:0/1362684438 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f6e5406e530 msgr2=0x7f6e540709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:35.550 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.544+0000 7f6e6c81e640 1 --2- 172.21.15.89:0/1362684438 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f6e5406e530 0x7f6e540709e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6e68066060 tx=0x7f6e5000b040 comp rx=0 tx=0).stop 2024-09-13T02:59:35.550 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.544+0000 7f6e6c81e640 1 -- 172.21.15.89:0/1362684438 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e68065bc0 msgr2=0x7f6e680fcb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:35.550 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.544+0000 7f6e6c81e640 1 --2- 172.21.15.89:0/1362684438 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e68065bc0 0x7f6e680fcb80 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6e60000f80 tx=0x7f6e60004d10 comp rx=0 tx=0).stop 2024-09-13T02:59:35.550 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.544+0000 7f6e6c81e640 1 -- 172.21.15.89:0/1362684438 shutdown_connections 2024-09-13T02:59:35.550 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.544+0000 7f6e6c81e640 1 --2- 172.21.15.89:0/1362684438 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f6e5406e530 0x7f6e540709e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:35.550 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.544+0000 7f6e6c81e640 1 --2- 172.21.15.89:0/1362684438 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e680ff700 0x7f6e680fb0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:35.550 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.544+0000 7f6e6c81e640 1 --2- 172.21.15.89:0/1362684438 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e68065bc0 0x7f6e680fcb80 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:35.550 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.544+0000 7f6e6c81e640 1 -- 172.21.15.89:0/1362684438 >> 172.21.15.89:0/1362684438 conn(0x7f6e680f6c10 msgr2=0x7f6e680f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:59:35.550 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.544+0000 7f6e6c81e640 1 -- 172.21.15.89:0/1362684438 shutdown_connections 2024-09-13T02:59:35.550 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.544+0000 7f6e6c81e640 1 -- 172.21.15.89:0/1362684438 wait complete. 2024-09-13T02:59:35.628 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.625+0000 7fa868107640 1 -- 172.21.15.89:0/451035614 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa8600fdbc0 msgr2=0x7fa8600fdfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:35.629 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.625+0000 7fa868107640 1 --2- 172.21.15.89:0/451035614 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa8600fdbc0 0x7fa8600fdfd0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa85c0048d0 tx=0x7fa85c009da0 comp rx=0 tx=0).stop 2024-09-13T02:59:35.629 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.625+0000 7fa868107640 1 -- 172.21.15.89:0/451035614 shutdown_connections 2024-09-13T02:59:35.629 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.625+0000 7fa868107640 1 --2- 172.21.15.89:0/451035614 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa8600fe510 0x7fa8600fa670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:35.629 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.625+0000 7fa868107640 1 --2- 172.21.15.89:0/451035614 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa8600fdbc0 0x7fa8600fdfd0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:35.629 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.625+0000 7fa868107640 1 -- 172.21.15.89:0/451035614 >> 172.21.15.89:0/451035614 conn(0x7fa8600f63c0 msgr2=0x7fa8600f87f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:59:35.629 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.625+0000 7fa868107640 1 -- 172.21.15.89:0/451035614 shutdown_connections 2024-09-13T02:59:35.629 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.625+0000 7fa868107640 1 -- 172.21.15.89:0/451035614 wait complete. 2024-09-13T02:59:35.629 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.626+0000 7fa868107640 1 Processor -- start 2024-09-13T02:59:35.629 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.626+0000 7fa868107640 1 -- start start 2024-09-13T02:59:35.630 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.626+0000 7fa868107640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa8600fdbc0 0x7fa86010f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:59:35.631 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.626+0000 7fa868107640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa8600fe510 0x7fa86010f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:59:35.631 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.626+0000 7fa868107640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa86010fec0 con 0x7fa8600fdbc0 2024-09-13T02:59:35.631 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.626+0000 7fa868107640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8601106e0 con 0x7fa8600fe510 2024-09-13T02:59:35.631 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.626+0000 7fa865ea3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa8600fdbc0 0x7fa86010f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:59:35.631 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.626+0000 7fa865ea3640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa8600fdbc0 0x7fa86010f330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:52942/0 (socket says 172.21.15.89:52942) 2024-09-13T02:59:35.631 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.626+0000 7fa865ea3640 1 -- 172.21.15.89:0/3612710288 learned_addr learned my addr 172.21.15.89:0/3612710288 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:59:35.631 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.626+0000 7fa8656a2640 1 --2- 172.21.15.89:0/3612710288 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa8600fe510 0x7fa86010f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:59:35.631 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.626+0000 7fa865ea3640 1 -- 172.21.15.89:0/3612710288 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa8600fe510 msgr2=0x7fa86010f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:35.631 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.626+0000 7fa865ea3640 1 --2- 172.21.15.89:0/3612710288 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa8600fe510 0x7fa86010f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:35.631 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.626+0000 7fa865ea3640 1 -- 172.21.15.89:0/3612710288 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa85c005040 con 0x7fa8600fdbc0 2024-09-13T02:59:35.631 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.627+0000 7fa865ea3640 1 --2- 172.21.15.89:0/3612710288 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa8600fdbc0 0x7fa86010f330 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa85c0043d0 tx=0x7fa85c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:59:35.631 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.627+0000 7fa8567fc640 1 -- 172.21.15.89:0/3612710288 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa85c038070 con 0x7fa8600fdbc0 2024-09-13T02:59:35.632 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.627+0000 7fa868107640 1 -- 172.21.15.89:0/3612710288 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa860110910 con 0x7fa8600fdbc0 2024-09-13T02:59:35.632 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.627+0000 7fa8567fc640 1 -- 172.21.15.89:0/3612710288 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa85c02ae90 con 0x7fa8600fdbc0 2024-09-13T02:59:35.632 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.627+0000 7fa8567fc640 1 -- 172.21.15.89:0/3612710288 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa85c03e670 con 0x7fa8600fdbc0 2024-09-13T02:59:35.632 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.627+0000 7fa868107640 1 -- 172.21.15.89:0/3612710288 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa860110eb0 con 0x7fa8600fdbc0 2024-09-13T02:59:35.632 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.628+0000 7fa868107640 1 -- 172.21.15.89:0/3612710288 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8600fa060 con 0x7fa8600fdbc0 2024-09-13T02:59:35.633 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.628+0000 7fa8567fc640 1 -- 172.21.15.89:0/3612710288 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fa85c030020 con 0x7fa8600fdbc0 2024-09-13T02:59:35.633 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.629+0000 7fa8567fc640 1 --2- 172.21.15.89:0/3612710288 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fa84c06e530 0x7fa84c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:59:35.633 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.629+0000 7fa8567fc640 1 -- 172.21.15.89:0/3612710288 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fa85c0ae310 con 0x7fa8600fdbc0 2024-09-13T02:59:35.633 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.629+0000 7fa8656a2640 1 --2- 172.21.15.89:0/3612710288 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fa84c06e530 0x7fa84c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:59:35.633 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.629+0000 7fa8656a2640 1 --2- 172.21.15.89:0/3612710288 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fa84c06e530 0x7fa84c0709e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa86010f0e0 tx=0x7fa85000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:59:35.637 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.634+0000 7fa8567fc640 1 -- 172.21.15.89:0/3612710288 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fa85c0774b0 con 0x7fa8600fdbc0 2024-09-13T02:59:35.870 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.868+0000 7fa868107640 1 -- 172.21.15.89:0/3612710288 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa860104fb0 con 0x7fa8600fdbc0 2024-09-13T02:59:35.871 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.868+0000 7fa8567fc640 1 -- 172.21.15.89:0/3612710288 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+850 (secure 0 0 0) 0x7fa85c07ab70 con 0x7fa8600fdbc0 2024-09-13T02:59:35.871 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-13T02:59:35.871 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": { 2024-09-13T02:59:35.871 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 2 2024-09-13T02:59:35.871 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T02:59:35.871 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": { 2024-09-13T02:59:35.871 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 2 2024-09-13T02:59:35.871 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T02:59:35.871 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": { 2024-09-13T02:59:35.871 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 2, 2024-09-13T02:59:35.871 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 3 2024-09-13T02:59:35.872 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T02:59:35.872 INFO:teuthology.orchestra.run.smithi089.stdout: "mds": { 2024-09-13T02:59:35.872 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 4 2024-09-13T02:59:35.872 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T02:59:35.872 INFO:teuthology.orchestra.run.smithi089.stdout: "overall": { 2024-09-13T02:59:35.872 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 6, 2024-09-13T02:59:35.872 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 7 2024-09-13T02:59:35.872 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-13T02:59:35.872 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-13T02:59:35.873 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.870+0000 7fa868107640 1 -- 172.21.15.89:0/3612710288 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fa84c06e530 msgr2=0x7fa84c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:35.873 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.870+0000 7fa868107640 1 --2- 172.21.15.89:0/3612710288 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fa84c06e530 0x7fa84c0709e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa86010f0e0 tx=0x7fa85000b040 comp rx=0 tx=0).stop 2024-09-13T02:59:35.873 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.870+0000 7fa868107640 1 -- 172.21.15.89:0/3612710288 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa8600fdbc0 msgr2=0x7fa86010f330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:35.873 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.870+0000 7fa868107640 1 --2- 172.21.15.89:0/3612710288 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa8600fdbc0 0x7fa86010f330 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa85c0043d0 tx=0x7fa85c009da0 comp rx=0 tx=0).stop 2024-09-13T02:59:35.873 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.870+0000 7fa868107640 1 -- 172.21.15.89:0/3612710288 shutdown_connections 2024-09-13T02:59:35.873 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.870+0000 7fa868107640 1 --2- 172.21.15.89:0/3612710288 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fa84c06e530 0x7fa84c0709e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:35.873 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.870+0000 7fa868107640 1 --2- 172.21.15.89:0/3612710288 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa8600fe510 0x7fa86010f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:35.873 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.870+0000 7fa868107640 1 --2- 172.21.15.89:0/3612710288 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa8600fdbc0 0x7fa86010f330 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:35.873 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.870+0000 7fa868107640 1 -- 172.21.15.89:0/3612710288 >> 172.21.15.89:0/3612710288 conn(0x7fa8600f63c0 msgr2=0x7fa8600f7bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:59:35.874 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.870+0000 7fa868107640 1 -- 172.21.15.89:0/3612710288 shutdown_connections 2024-09-13T02:59:35.874 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.870+0000 7fa868107640 1 -- 172.21.15.89:0/3612710288 wait complete. 2024-09-13T02:59:35.952 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.949+0000 7f5bc5ed5640 1 -- 172.21.15.89:0/3296434148 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5bc00fb430 msgr2=0x7f5bc00fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:35.953 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.949+0000 7f5bc5ed5640 1 --2- 172.21.15.89:0/3296434148 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5bc00fb430 0x7f5bc00fb840 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f5ba80048d0 tx=0x7f5ba8009da0 comp rx=0 tx=0).stop 2024-09-13T02:59:35.953 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.950+0000 7f5bc5ed5640 1 -- 172.21.15.89:0/3296434148 shutdown_connections 2024-09-13T02:59:35.953 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.950+0000 7f5bc5ed5640 1 --2- 172.21.15.89:0/3296434148 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5bc00fc700 0x7f5bc00fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:35.953 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.950+0000 7f5bc5ed5640 1 --2- 172.21.15.89:0/3296434148 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5bc00fb430 0x7f5bc00fb840 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:35.953 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.950+0000 7f5bc5ed5640 1 -- 172.21.15.89:0/3296434148 >> 172.21.15.89:0/3296434148 conn(0x7f5bc00f6c10 msgr2=0x7f5bc00f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:59:35.953 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.950+0000 7f5bc5ed5640 1 -- 172.21.15.89:0/3296434148 shutdown_connections 2024-09-13T02:59:35.953 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.950+0000 7f5bc5ed5640 1 -- 172.21.15.89:0/3296434148 wait complete. 2024-09-13T02:59:35.953 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.950+0000 7f5bc5ed5640 1 Processor -- start 2024-09-13T02:59:35.953 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.950+0000 7f5bc5ed5640 1 -- start start 2024-09-13T02:59:35.955 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.950+0000 7f5bc5ed5640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5bc00fb430 0x7f5bc010fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:59:35.955 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.950+0000 7f5bc5ed5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5bc00fc700 0x7f5bc0112310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:59:35.955 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.950+0000 7f5bc5ed5640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc0065c60 con 0x7f5bc00fc700 2024-09-13T02:59:35.955 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.950+0000 7f5bc5ed5640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bc0065dd0 con 0x7f5bc00fb430 2024-09-13T02:59:35.955 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.951+0000 7f5bbeffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5bc00fc700 0x7f5bc0112310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:59:35.955 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.951+0000 7f5bbeffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5bc00fc700 0x7f5bc0112310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:52952/0 (socket says 172.21.15.89:52952) 2024-09-13T02:59:35.955 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.951+0000 7f5bbeffd640 1 -- 172.21.15.89:0/2587744840 learned_addr learned my addr 172.21.15.89:0/2587744840 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:59:35.955 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.951+0000 7f5bbf7fe640 1 --2- 172.21.15.89:0/2587744840 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5bc00fb430 0x7f5bc010fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:59:35.956 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.951+0000 7f5bbeffd640 1 -- 172.21.15.89:0/2587744840 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5bc00fb430 msgr2=0x7f5bc010fdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:35.956 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.951+0000 7f5bbeffd640 1 --2- 172.21.15.89:0/2587744840 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5bc00fb430 0x7f5bc010fdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:35.956 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.951+0000 7f5bbeffd640 1 -- 172.21.15.89:0/2587744840 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ba8005040 con 0x7f5bc00fc700 2024-09-13T02:59:35.956 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.951+0000 7f5bbeffd640 1 --2- 172.21.15.89:0/2587744840 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5bc00fc700 0x7f5bc0112310 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5bb000eb70 tx=0x7f5bb000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:59:35.956 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.951+0000 7f5bb7fff640 1 -- 172.21.15.89:0/2587744840 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5bb0007c30 con 0x7f5bc00fc700 2024-09-13T02:59:35.956 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.951+0000 7f5bb7fff640 1 -- 172.21.15.89:0/2587744840 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f5bb000f040 con 0x7f5bc00fc700 2024-09-13T02:59:35.956 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.951+0000 7f5bc5ed5640 1 -- 172.21.15.89:0/2587744840 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bc0112850 con 0x7f5bc00fc700 2024-09-13T02:59:35.956 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.951+0000 7f5bb7fff640 1 -- 172.21.15.89:0/2587744840 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5bb00094e0 con 0x7f5bc00fc700 2024-09-13T02:59:35.956 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.951+0000 7f5bc5ed5640 1 -- 172.21.15.89:0/2587744840 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bc0112dc0 con 0x7f5bc00fc700 2024-09-13T02:59:35.956 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.952+0000 7f5bc5ed5640 1 -- 172.21.15.89:0/2587744840 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bc00fa890 con 0x7f5bc00fc700 2024-09-13T02:59:35.956 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.953+0000 7f5bb7fff640 1 -- 172.21.15.89:0/2587744840 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f5bb0009640 con 0x7f5bc00fc700 2024-09-13T02:59:35.957 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.953+0000 7f5bb7fff640 1 --2- 172.21.15.89:0/2587744840 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f5bac06e530 0x7f5bac0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:59:35.957 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.953+0000 7f5bb7fff640 1 -- 172.21.15.89:0/2587744840 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f5bb008de50 con 0x7f5bc00fc700 2024-09-13T02:59:35.957 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.953+0000 7f5bbf7fe640 1 --2- 172.21.15.89:0/2587744840 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f5bac06e530 0x7f5bac0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:59:35.957 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.954+0000 7f5bbf7fe640 1 --2- 172.21.15.89:0/2587744840 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f5bac06e530 0x7f5bac0709e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5ba8007ac0 tx=0x7f5ba8035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:59:35.960 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:35.957+0000 7f5bb7fff640 1 -- 172.21.15.89:0/2587744840 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f5bb0056fc0 con 0x7f5bc00fc700 2024-09-13T02:59:36.143 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:35 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:59:36.144 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:35 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:59:36.144 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:35 smithi131 ceph-mon[78839]: from='client.34284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:59:36.144 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:35 smithi131 ceph-mon[78839]: from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:59:36.144 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:35 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:59:36.144 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:35 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:59:36.144 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:35 smithi131 ceph-mon[78839]: from='client.34292 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:59:36.144 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:35 smithi131 ceph-mon[78839]: pgmap v110: 65 pgs: 18 active+undersized, 20 active+undersized+degraded, 27 active+clean; 306 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 75/357 objects degraded (21.008%) 2024-09-13T02:59:36.144 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:35 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:59:36.144 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:35 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:59:36.144 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:35 smithi131 ceph-mon[78839]: from='client.? 172.21.15.89:0/3612710288' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:59:36.161 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.158+0000 7f5bc5ed5640 1 -- 172.21.15.89:0/2587744840 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f5bc004b720 con 0x7f5bc00fc700 2024-09-13T02:59:36.161 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:35 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:59:36.161 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:35 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:59:36.161 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:35 smithi089 ceph-mon[91553]: from='client.34284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:59:36.161 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:35 smithi089 ceph-mon[91553]: from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:59:36.161 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:35 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:59:36.161 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:35 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:59:36.162 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:35 smithi089 ceph-mon[91553]: from='client.34292 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:59:36.162 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:35 smithi089 ceph-mon[91553]: pgmap v110: 65 pgs: 18 active+undersized, 20 active+undersized+degraded, 27 active+clean; 306 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 75/357 objects degraded (21.008%) 2024-09-13T02:59:36.162 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:35 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:59:36.162 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:35 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:59:36.162 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:35 smithi089 ceph-mon[91553]: from='client.? 172.21.15.89:0/3612710288' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:59:36.162 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.159+0000 7f5bb7fff640 1 -- 172.21.15.89:0/2587744840 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 23 v23) v1 ==== 76+0+1953 (secure 0 0 0) 0x7f5bb005a680 con 0x7f5bc00fc700 2024-09-13T02:59:36.163 INFO:teuthology.orchestra.run.smithi089.stdout:e23 2024-09-13T02:59:36.163 INFO:teuthology.orchestra.run.smithi089.stdout:btime 2024-09-13T02:58:04:980780+0000 2024-09-13T02:59:36.163 INFO:teuthology.orchestra.run.smithi089.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T02:59:36.163 INFO:teuthology.orchestra.run.smithi089.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:59:36.163 INFO:teuthology.orchestra.run.smithi089.stdout:legacy client fscid: 1 2024-09-13T02:59:36.163 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:59:36.163 INFO:teuthology.orchestra.run.smithi089.stdout:Filesystem 'cephfs' (1) 2024-09-13T02:59:36.163 INFO:teuthology.orchestra.run.smithi089.stdout:fs_name cephfs 2024-09-13T02:59:36.163 INFO:teuthology.orchestra.run.smithi089.stdout:epoch 23 2024-09-13T02:59:36.163 INFO:teuthology.orchestra.run.smithi089.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T02:59:36.163 INFO:teuthology.orchestra.run.smithi089.stdout:created 2024-09-13T02:51:40.657817+0000 2024-09-13T02:59:36.163 INFO:teuthology.orchestra.run.smithi089.stdout:modified 2024-09-13T02:58:04.067950+0000 2024-09-13T02:59:36.164 INFO:teuthology.orchestra.run.smithi089.stdout:tableserver 0 2024-09-13T02:59:36.164 INFO:teuthology.orchestra.run.smithi089.stdout:root 0 2024-09-13T02:59:36.164 INFO:teuthology.orchestra.run.smithi089.stdout:session_timeout 60 2024-09-13T02:59:36.164 INFO:teuthology.orchestra.run.smithi089.stdout:session_autoclose 300 2024-09-13T02:59:36.164 INFO:teuthology.orchestra.run.smithi089.stdout:max_file_size 1099511627776 2024-09-13T02:59:36.164 INFO:teuthology.orchestra.run.smithi089.stdout:max_xattr_size 65536 2024-09-13T02:59:36.164 INFO:teuthology.orchestra.run.smithi089.stdout:required_client_features {} 2024-09-13T02:59:36.164 INFO:teuthology.orchestra.run.smithi089.stdout:last_failure 0 2024-09-13T02:59:36.164 INFO:teuthology.orchestra.run.smithi089.stdout:last_failure_osd_epoch 44 2024-09-13T02:59:36.164 INFO:teuthology.orchestra.run.smithi089.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T02:59:36.164 INFO:teuthology.orchestra.run.smithi089.stdout:max_mds 2 2024-09-13T02:59:36.164 INFO:teuthology.orchestra.run.smithi089.stdout:in 0,1 2024-09-13T02:59:36.164 INFO:teuthology.orchestra.run.smithi089.stdout:up {0=14480,1=24257} 2024-09-13T02:59:36.164 INFO:teuthology.orchestra.run.smithi089.stdout:failed 2024-09-13T02:59:36.165 INFO:teuthology.orchestra.run.smithi089.stdout:damaged 2024-09-13T02:59:36.165 INFO:teuthology.orchestra.run.smithi089.stdout:stopped 2024-09-13T02:59:36.165 INFO:teuthology.orchestra.run.smithi089.stdout:data_pools [3] 2024-09-13T02:59:36.165 INFO:teuthology.orchestra.run.smithi089.stdout:metadata_pool 2 2024-09-13T02:59:36.165 INFO:teuthology.orchestra.run.smithi089.stdout:inline_data disabled 2024-09-13T02:59:36.165 INFO:teuthology.orchestra.run.smithi089.stdout:balancer 2024-09-13T02:59:36.165 INFO:teuthology.orchestra.run.smithi089.stdout:bal_rank_mask -1 2024-09-13T02:59:36.165 INFO:teuthology.orchestra.run.smithi089.stdout:standby_count_wanted 1 2024-09-13T02:59:36.165 INFO:teuthology.orchestra.run.smithi089.stdout:qdb_cluster leader: 14480 members: 24257,14480 2024-09-13T02:59:36.165 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi089.rarddb{0:14480} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.89:6828/1561365213,v1:172.21.15.89:6829/1561365213] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:59:36.165 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi089.qjoitb{0:14488} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.89:6826/1464393547,v1:172.21.15.89:6827/1464393547] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:59:36.165 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi131.uasrkg{1:24257} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.131:6824/260493836,v1:172.21.15.131:6825/260493836] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:59:36.165 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi131.rbovzc{1:24265} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.131:6826/665579373,v1:172.21.15.131:6827/665579373] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T02:59:36.165 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:59:36.166 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T02:59:36.166 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 23 2024-09-13T02:59:36.166 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.161+0000 7f5bc5ed5640 1 -- 172.21.15.89:0/2587744840 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f5bac06e530 msgr2=0x7f5bac0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:36.167 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.161+0000 7f5bc5ed5640 1 --2- 172.21.15.89:0/2587744840 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f5bac06e530 0x7f5bac0709e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5ba8007ac0 tx=0x7f5ba8035040 comp rx=0 tx=0).stop 2024-09-13T02:59:36.167 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.161+0000 7f5bc5ed5640 1 -- 172.21.15.89:0/2587744840 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5bc00fc700 msgr2=0x7f5bc0112310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:36.167 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.161+0000 7f5bc5ed5640 1 --2- 172.21.15.89:0/2587744840 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5bc00fc700 0x7f5bc0112310 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5bb000eb70 tx=0x7f5bb000b040 comp rx=0 tx=0).stop 2024-09-13T02:59:36.167 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.161+0000 7f5bc5ed5640 1 -- 172.21.15.89:0/2587744840 shutdown_connections 2024-09-13T02:59:36.167 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.161+0000 7f5bc5ed5640 1 --2- 172.21.15.89:0/2587744840 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f5bac06e530 0x7f5bac0709e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:36.167 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.161+0000 7f5bc5ed5640 1 --2- 172.21.15.89:0/2587744840 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5bc00fc700 0x7f5bc0112310 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:36.167 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.161+0000 7f5bc5ed5640 1 --2- 172.21.15.89:0/2587744840 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5bc00fb430 0x7f5bc010fdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:36.167 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.161+0000 7f5bc5ed5640 1 -- 172.21.15.89:0/2587744840 >> 172.21.15.89:0/2587744840 conn(0x7f5bc00f6c10 msgr2=0x7f5bc00f83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:59:36.167 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.161+0000 7f5bc5ed5640 1 -- 172.21.15.89:0/2587744840 shutdown_connections 2024-09-13T02:59:36.167 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.161+0000 7f5bc5ed5640 1 -- 172.21.15.89:0/2587744840 wait complete. 2024-09-13T02:59:36.242 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.240+0000 7fe242ac9640 1 -- 172.21.15.89:0/167320842 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe23c0fdba0 msgr2=0x7fe23c0fdfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:36.243 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.240+0000 7fe242ac9640 1 --2- 172.21.15.89:0/167320842 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe23c0fdba0 0x7fe23c0fdfb0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe2300048d0 tx=0x7fe230009da0 comp rx=0 tx=0).stop 2024-09-13T02:59:36.243 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.240+0000 7fe242ac9640 1 -- 172.21.15.89:0/167320842 shutdown_connections 2024-09-13T02:59:36.243 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.240+0000 7fe242ac9640 1 --2- 172.21.15.89:0/167320842 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe23c0fe4f0 0x7fe23c0fa650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:36.243 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.240+0000 7fe242ac9640 1 --2- 172.21.15.89:0/167320842 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe23c0fdba0 0x7fe23c0fdfb0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:36.243 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.240+0000 7fe242ac9640 1 -- 172.21.15.89:0/167320842 >> 172.21.15.89:0/167320842 conn(0x7fe23c0f63a0 msgr2=0x7fe23c0f87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:59:36.243 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.240+0000 7fe242ac9640 1 -- 172.21.15.89:0/167320842 shutdown_connections 2024-09-13T02:59:36.243 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.240+0000 7fe242ac9640 1 -- 172.21.15.89:0/167320842 wait complete. 2024-09-13T02:59:36.243 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.240+0000 7fe242ac9640 1 Processor -- start 2024-09-13T02:59:36.243 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.240+0000 7fe242ac9640 1 -- start start 2024-09-13T02:59:36.245 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.241+0000 7fe242ac9640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe23c0fdba0 0x7fe23c10d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:59:36.245 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.241+0000 7fe242ac9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe23c0fe4f0 0x7fe23c10d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:59:36.245 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.241+0000 7fe242ac9640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe23c10dc20 con 0x7fe23c0fe4f0 2024-09-13T02:59:36.245 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.241+0000 7fe242ac9640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe23c10e440 con 0x7fe23c0fdba0 2024-09-13T02:59:36.245 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.241+0000 7fe23bfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe23c0fe4f0 0x7fe23c10d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:59:36.245 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.241+0000 7fe23bfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe23c0fe4f0 0x7fe23c10d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:52974/0 (socket says 172.21.15.89:52974) 2024-09-13T02:59:36.245 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.241+0000 7fe23bfff640 1 -- 172.21.15.89:0/324011781 learned_addr learned my addr 172.21.15.89:0/324011781 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:59:36.246 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.241+0000 7fe240865640 1 --2- 172.21.15.89:0/324011781 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe23c0fdba0 0x7fe23c10d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:59:36.246 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.241+0000 7fe23bfff640 1 -- 172.21.15.89:0/324011781 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe23c0fdba0 msgr2=0x7fe23c10d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:36.246 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.241+0000 7fe23bfff640 1 --2- 172.21.15.89:0/324011781 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe23c0fdba0 0x7fe23c10d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:36.246 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.241+0000 7fe23bfff640 1 -- 172.21.15.89:0/324011781 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe230005040 con 0x7fe23c0fe4f0 2024-09-13T02:59:36.246 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.241+0000 7fe240865640 1 --2- 172.21.15.89:0/324011781 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe23c0fdba0 0x7fe23c10d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T02:59:36.246 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.241+0000 7fe23bfff640 1 --2- 172.21.15.89:0/324011781 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe23c0fe4f0 0x7fe23c10d5d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe228002f40 tx=0x7fe22800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:59:36.246 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.241+0000 7fe2397fa640 1 -- 172.21.15.89:0/324011781 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe228007c30 con 0x7fe23c0fe4f0 2024-09-13T02:59:36.246 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.241+0000 7fe242ac9640 1 -- 172.21.15.89:0/324011781 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe23c10e670 con 0x7fe23c0fe4f0 2024-09-13T02:59:36.246 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.241+0000 7fe2397fa640 1 -- 172.21.15.89:0/324011781 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe22800f040 con 0x7fe23c0fe4f0 2024-09-13T02:59:36.246 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.241+0000 7fe2397fa640 1 -- 172.21.15.89:0/324011781 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe22800cbe0 con 0x7fe23c0fe4f0 2024-09-13T02:59:36.246 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.242+0000 7fe242ac9640 1 -- 172.21.15.89:0/324011781 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe23c10ec10 con 0x7fe23c0fe4f0 2024-09-13T02:59:36.246 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.242+0000 7fe242ac9640 1 -- 172.21.15.89:0/324011781 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe23c0fa040 con 0x7fe23c0fe4f0 2024-09-13T02:59:36.246 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.243+0000 7fe2397fa640 1 -- 172.21.15.89:0/324011781 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fe22800cd40 con 0x7fe23c0fe4f0 2024-09-13T02:59:36.247 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.243+0000 7fe2397fa640 1 --2- 172.21.15.89:0/324011781 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fe22c06e530 0x7fe22c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:59:36.247 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.243+0000 7fe2397fa640 1 -- 172.21.15.89:0/324011781 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fe22808dea0 con 0x7fe23c0fe4f0 2024-09-13T02:59:36.247 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.243+0000 7fe240865640 1 --2- 172.21.15.89:0/324011781 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fe22c06e530 0x7fe22c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:59:36.247 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.244+0000 7fe240865640 1 --2- 172.21.15.89:0/324011781 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fe22c06e530 0x7fe22c0709e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe230007ac0 tx=0x7fe230035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:59:36.250 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.249+0000 7fe2397fa640 1 -- 172.21.15.89:0/324011781 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fe228056f90 con 0x7fe23c0fe4f0 2024-09-13T02:59:36.432 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.429+0000 7fe242ac9640 1 -- 172.21.15.89:0/324011781 --> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe23c10ef40 con 0x7fe22c06e530 2024-09-13T02:59:36.433 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.431+0000 7fe2397fa640 1 -- 172.21.15.89:0/324011781 <== mgr.34104 v2:172.21.15.89:6800/1881577856 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fe23c10ef40 con 0x7fe22c06e530 2024-09-13T02:59:36.433 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-13T02:59:36.433 INFO:teuthology.orchestra.run.smithi089.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d", 2024-09-13T02:59:36.433 INFO:teuthology.orchestra.run.smithi089.stdout: "in_progress": true, 2024-09-13T02:59:36.433 INFO:teuthology.orchestra.run.smithi089.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T02:59:36.434 INFO:teuthology.orchestra.run.smithi089.stdout: "services_complete": [ 2024-09-13T02:59:36.434 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr", 2024-09-13T02:59:36.434 INFO:teuthology.orchestra.run.smithi089.stdout: "crash", 2024-09-13T02:59:36.434 INFO:teuthology.orchestra.run.smithi089.stdout: "mon" 2024-09-13T02:59:36.434 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-13T02:59:36.434 INFO:teuthology.orchestra.run.smithi089.stdout: "progress": "10/21 daemons upgraded", 2024-09-13T02:59:36.434 INFO:teuthology.orchestra.run.smithi089.stdout: "message": "Currently upgrading osd daemons", 2024-09-13T02:59:36.434 INFO:teuthology.orchestra.run.smithi089.stdout: "is_paused": false 2024-09-13T02:59:36.434 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-13T02:59:36.436 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.433+0000 7fe242ac9640 1 -- 172.21.15.89:0/324011781 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fe22c06e530 msgr2=0x7fe22c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:36.436 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.433+0000 7fe242ac9640 1 --2- 172.21.15.89:0/324011781 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fe22c06e530 0x7fe22c0709e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe230007ac0 tx=0x7fe230035040 comp rx=0 tx=0).stop 2024-09-13T02:59:36.436 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.433+0000 7fe242ac9640 1 -- 172.21.15.89:0/324011781 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe23c0fe4f0 msgr2=0x7fe23c10d5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:36.436 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.433+0000 7fe242ac9640 1 --2- 172.21.15.89:0/324011781 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe23c0fe4f0 0x7fe23c10d5d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fe228002f40 tx=0x7fe22800b040 comp rx=0 tx=0).stop 2024-09-13T02:59:36.436 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.433+0000 7fe242ac9640 1 -- 172.21.15.89:0/324011781 shutdown_connections 2024-09-13T02:59:36.436 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.433+0000 7fe242ac9640 1 --2- 172.21.15.89:0/324011781 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fe22c06e530 0x7fe22c0709e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:36.436 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.433+0000 7fe242ac9640 1 --2- 172.21.15.89:0/324011781 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe23c0fe4f0 0x7fe23c10d5d0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:36.436 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.433+0000 7fe242ac9640 1 --2- 172.21.15.89:0/324011781 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe23c0fdba0 0x7fe23c10d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:36.436 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.433+0000 7fe242ac9640 1 -- 172.21.15.89:0/324011781 >> 172.21.15.89:0/324011781 conn(0x7fe23c0f63a0 msgr2=0x7fe23c0f7b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:59:36.436 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.433+0000 7fe242ac9640 1 -- 172.21.15.89:0/324011781 shutdown_connections 2024-09-13T02:59:36.436 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.433+0000 7fe242ac9640 1 -- 172.21.15.89:0/324011781 wait complete. 2024-09-13T02:59:36.515 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.511+0000 7f82d63a6640 1 -- 172.21.15.89:0/3912735362 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82d00fc530 msgr2=0x7f82d00fc940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:36.515 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.511+0000 7f82d63a6640 1 --2- 172.21.15.89:0/3912735362 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82d00fc530 0x7f82d00fc940 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f82b80048d0 tx=0x7f82b8009da0 comp rx=0 tx=0).stop 2024-09-13T02:59:36.515 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.511+0000 7f82d63a6640 1 -- 172.21.15.89:0/3912735362 shutdown_connections 2024-09-13T02:59:36.515 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.511+0000 7f82d63a6640 1 --2- 172.21.15.89:0/3912735362 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f82d00fd800 0x7f82d00fdc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:36.515 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.511+0000 7f82d63a6640 1 --2- 172.21.15.89:0/3912735362 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82d00fc530 0x7f82d00fc940 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:36.515 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.511+0000 7f82d63a6640 1 -- 172.21.15.89:0/3912735362 >> 172.21.15.89:0/3912735362 conn(0x7f82d00f7d10 msgr2=0x7f82d00fa120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:59:36.515 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.511+0000 7f82d63a6640 1 -- 172.21.15.89:0/3912735362 shutdown_connections 2024-09-13T02:59:36.515 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.511+0000 7f82d63a6640 1 -- 172.21.15.89:0/3912735362 wait complete. 2024-09-13T02:59:36.516 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.511+0000 7f82d63a6640 1 Processor -- start 2024-09-13T02:59:36.516 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.511+0000 7f82d63a6640 1 -- start start 2024-09-13T02:59:36.516 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.512+0000 7f82d63a6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82d00fc530 0x7f82d010d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:59:36.516 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.512+0000 7f82d63a6640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f82d00fd800 0x7f82d010d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:59:36.516 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.512+0000 7f82d63a6640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82d010dc20 con 0x7f82d00fc530 2024-09-13T02:59:36.516 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.512+0000 7f82d63a6640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82d010e440 con 0x7f82d00fd800 2024-09-13T02:59:36.516 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.512+0000 7f82cffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82d00fc530 0x7f82d010d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:59:36.516 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.512+0000 7f82cffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82d00fc530 0x7f82d010d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:52980/0 (socket says 172.21.15.89:52980) 2024-09-13T02:59:36.516 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.512+0000 7f82cffff640 1 -- 172.21.15.89:0/2718628359 learned_addr learned my addr 172.21.15.89:0/2718628359 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T02:59:36.516 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.512+0000 7f82cf7fe640 1 --2- 172.21.15.89:0/2718628359 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f82d00fd800 0x7f82d010d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:59:36.516 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.512+0000 7f82cffff640 1 -- 172.21.15.89:0/2718628359 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f82d00fd800 msgr2=0x7f82d010d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:36.516 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.512+0000 7f82cffff640 1 --2- 172.21.15.89:0/2718628359 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f82d00fd800 0x7f82d010d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:36.516 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.512+0000 7f82cffff640 1 -- 172.21.15.89:0/2718628359 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82b8005040 con 0x7f82d00fc530 2024-09-13T02:59:36.517 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.512+0000 7f82cf7fe640 1 --2- 172.21.15.89:0/2718628359 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f82d00fd800 0x7f82d010d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T02:59:36.517 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.512+0000 7f82cffff640 1 --2- 172.21.15.89:0/2718628359 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82d00fc530 0x7f82d010d090 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f82b8003080 tx=0x7f82b8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:59:36.517 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.512+0000 7f82ccff9640 1 -- 172.21.15.89:0/2718628359 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f82b8038070 con 0x7f82d00fc530 2024-09-13T02:59:36.517 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.512+0000 7f82d63a6640 1 -- 172.21.15.89:0/2718628359 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82d010e670 con 0x7f82d00fc530 2024-09-13T02:59:36.517 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.512+0000 7f82ccff9640 1 -- 172.21.15.89:0/2718628359 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f82b802abd0 con 0x7f82d00fc530 2024-09-13T02:59:36.517 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.512+0000 7f82ccff9640 1 -- 172.21.15.89:0/2718628359 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f82b803e670 con 0x7f82d00fc530 2024-09-13T02:59:36.517 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.512+0000 7f82d63a6640 1 -- 172.21.15.89:0/2718628359 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82d010ec10 con 0x7f82d00fc530 2024-09-13T02:59:36.518 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.513+0000 7f82d63a6640 1 -- 172.21.15.89:0/2718628359 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82d00fb990 con 0x7f82d00fc530 2024-09-13T02:59:36.518 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.514+0000 7f82ccff9640 1 -- 172.21.15.89:0/2718628359 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f82b8030020 con 0x7f82d00fc530 2024-09-13T02:59:36.518 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.514+0000 7f82ccff9640 1 --2- 172.21.15.89:0/2718628359 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f82bc06e530 0x7f82bc0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T02:59:36.518 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.514+0000 7f82ccff9640 1 -- 172.21.15.89:0/2718628359 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f82b80ae4b0 con 0x7f82d00fc530 2024-09-13T02:59:36.518 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.514+0000 7f82cf7fe640 1 --2- 172.21.15.89:0/2718628359 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f82bc06e530 0x7f82bc0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T02:59:36.518 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.515+0000 7f82cf7fe640 1 --2- 172.21.15.89:0/2718628359 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f82bc06e530 0x7f82bc0709e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f82d010ce40 tx=0x7f82c0009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T02:59:36.521 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.519+0000 7f82ccff9640 1 -- 172.21.15.89:0/2718628359 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f82b8077620 con 0x7f82d00fc530 2024-09-13T02:59:36.757 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.755+0000 7f82d63a6640 1 -- 172.21.15.89:0/2718628359 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f82d004b720 con 0x7f82d00fc530 2024-09-13T02:59:36.757 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.756+0000 7f82ccff9640 1 -- 172.21.15.89:0/2718628359 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1383 (secure 0 0 0) 0x7f82b807ace0 con 0x7f82d00fc530 2024-09-13T02:59:36.757 INFO:teuthology.orchestra.run.smithi089.stdout:HEALTH_WARN 1 osds down; Degraded data redundancy: 75/357 objects degraded (21.008%), 20 pgs degraded 2024-09-13T02:59:36.757 INFO:teuthology.orchestra.run.smithi089.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-13T02:59:36.757 INFO:teuthology.orchestra.run.smithi089.stdout: osd.3 (root=default,host=smithi131) is down 2024-09-13T02:59:36.758 INFO:teuthology.orchestra.run.smithi089.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 75/357 objects degraded (21.008%), 20 pgs degraded 2024-09-13T02:59:36.758 INFO:teuthology.orchestra.run.smithi089.stdout: pg 1.0 is active+undersized+degraded, acting [0,1] 2024-09-13T02:59:36.758 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.0 is active+undersized+degraded, acting [1,0] 2024-09-13T02:59:36.758 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.5 is active+undersized+degraded, acting [0,4] 2024-09-13T02:59:36.758 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.6 is active+undersized+degraded, acting [1,4] 2024-09-13T02:59:36.758 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.7 is active+undersized+degraded, acting [4,2] 2024-09-13T02:59:36.758 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.8 is active+undersized+degraded, acting [5,0] 2024-09-13T02:59:36.758 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.a is active+undersized+degraded, acting [1,4] 2024-09-13T02:59:36.758 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.b is active+undersized+degraded, acting [4,5] 2024-09-13T02:59:36.758 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.c is active+undersized+degraded, acting [2,0] 2024-09-13T02:59:36.758 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.d is active+undersized+degraded, acting [1,2] 2024-09-13T02:59:36.758 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.e is active+undersized+degraded, acting [2,0] 2024-09-13T02:59:36.758 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.11 is active+undersized+degraded, acting [4,1] 2024-09-13T02:59:36.759 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.12 is active+undersized+degraded, acting [1,0] 2024-09-13T02:59:36.759 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.14 is active+undersized+degraded, acting [4,5] 2024-09-13T02:59:36.759 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.15 is active+undersized+degraded, acting [1,0] 2024-09-13T02:59:36.759 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.16 is active+undersized+degraded, acting [5,2] 2024-09-13T02:59:36.759 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.18 is active+undersized+degraded, acting [5,4] 2024-09-13T02:59:36.759 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.1a is active+undersized+degraded, acting [4,5] 2024-09-13T02:59:36.759 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.1d is active+undersized+degraded, acting [5,0] 2024-09-13T02:59:36.759 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.1f is active+undersized+degraded, acting [0,4] 2024-09-13T02:59:36.760 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.759+0000 7f82d63a6640 1 -- 172.21.15.89:0/2718628359 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f82bc06e530 msgr2=0x7f82bc0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:36.760 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.759+0000 7f82d63a6640 1 --2- 172.21.15.89:0/2718628359 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f82bc06e530 0x7f82bc0709e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f82d010ce40 tx=0x7f82c0009040 comp rx=0 tx=0).stop 2024-09-13T02:59:36.760 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.759+0000 7f82d63a6640 1 -- 172.21.15.89:0/2718628359 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82d00fc530 msgr2=0x7f82d010d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T02:59:36.760 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.759+0000 7f82d63a6640 1 --2- 172.21.15.89:0/2718628359 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82d00fc530 0x7f82d010d090 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f82b8003080 tx=0x7f82b8009da0 comp rx=0 tx=0).stop 2024-09-13T02:59:36.760 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.759+0000 7f82d63a6640 1 -- 172.21.15.89:0/2718628359 shutdown_connections 2024-09-13T02:59:36.761 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.759+0000 7f82d63a6640 1 --2- 172.21.15.89:0/2718628359 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f82bc06e530 0x7f82bc0709e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:36.761 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.759+0000 7f82d63a6640 1 --2- 172.21.15.89:0/2718628359 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f82d00fd800 0x7f82d010d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:36.761 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.759+0000 7f82d63a6640 1 --2- 172.21.15.89:0/2718628359 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f82d00fc530 0x7f82d010d090 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T02:59:36.761 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.759+0000 7f82d63a6640 1 -- 172.21.15.89:0/2718628359 >> 172.21.15.89:0/2718628359 conn(0x7f82d00f7d10 msgr2=0x7f82d00f94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T02:59:36.761 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.759+0000 7f82d63a6640 1 -- 172.21.15.89:0/2718628359 shutdown_connections 2024-09-13T02:59:36.761 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T02:59:36.759+0000 7f82d63a6640 1 -- 172.21.15.89:0/2718628359 wait complete. 2024-09-13T02:59:37.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:36 smithi089 ceph-mon[91553]: from='client.? 172.21.15.89:0/2587744840' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T02:59:37.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:36 smithi089 ceph-mon[91553]: from='client.34304 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:59:37.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:36 smithi089 ceph-mon[91553]: from='client.? 172.21.15.89:0/2718628359' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T02:59:37.148 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:36 smithi131 ceph-mon[78839]: from='client.? 172.21.15.89:0/2587744840' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T02:59:37.148 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:36 smithi131 ceph-mon[78839]: from='client.34304 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T02:59:37.148 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:36 smithi131 ceph-mon[78839]: from='client.? 172.21.15.89:0/2718628359' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T02:59:38.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:37 smithi131 ceph-mon[78839]: pgmap v111: 65 pgs: 18 active+undersized, 20 active+undersized+degraded, 27 active+clean; 306 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 75/357 objects degraded (21.008%) 2024-09-13T02:59:38.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:37 smithi089 ceph-mon[91553]: pgmap v111: 65 pgs: 18 active+undersized, 20 active+undersized+degraded, 27 active+clean; 306 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 75/357 objects degraded (21.008%) 2024-09-13T02:59:40.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:39 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:59:40.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:39 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:59:40.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:39 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:59:40.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:39 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:59:40.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:39 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:59:40.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:39 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:59:40.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:39 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:59:40.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:39 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:59:40.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:39 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:59:40.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:39 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-13T02:59:40.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:39 smithi131 ceph-mon[78839]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-13T02:59:40.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:39 smithi131 ceph-mon[78839]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-09-13T02:59:40.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:39 smithi131 ceph-mon[78839]: pgmap v112: 65 pgs: 18 active+undersized, 20 active+undersized+degraded, 27 active+clean; 306 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 75/357 objects degraded (21.008%) 2024-09-13T02:59:40.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:39 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:59:40.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:39 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:59:40.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:39 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:59:40.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:39 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T02:59:40.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:39 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:59:40.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:39 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T02:59:40.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:39 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:59:40.287 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:39 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:59:40.287 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:39 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T02:59:40.287 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:39 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-13T02:59:40.287 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:39 smithi089 ceph-mon[91553]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-13T02:59:40.287 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:39 smithi089 ceph-mon[91553]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-09-13T02:59:40.287 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:39 smithi089 ceph-mon[91553]: pgmap v112: 65 pgs: 18 active+undersized, 20 active+undersized+degraded, 27 active+clean; 306 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 75/357 objects degraded (21.008%) 2024-09-13T02:59:40.684 INFO:journalctl@ceph.osd.3.smithi131.stdout:Sep 13 02:59:40 smithi131 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-3[88212]: 2024-09-13T02:59:40.379+0000 7f3dc5be5640 -1 osd.3 62 log_to_monitors true 2024-09-13T02:59:41.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:40 smithi131 ceph-mon[78839]: from='osd.3 [v2:172.21.15.131:6800/946857611,v1:172.21.15.131:6801/946857611]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-13T02:59:41.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:40 smithi131 ceph-mon[78839]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-13T02:59:41.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:40 smithi089 ceph-mon[91553]: from='osd.3 [v2:172.21.15.131:6800/946857611,v1:172.21.15.131:6801/946857611]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-13T02:59:41.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:40 smithi089 ceph-mon[91553]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-13T02:59:41.934 INFO:journalctl@ceph.osd.3.smithi131.stdout:Sep 13 02:59:41 smithi131 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-3[88212]: 2024-09-13T02:59:41.646+0000 7f3db9977640 -1 osd.3 62 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T02:59:41.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:41 smithi131 ceph-mon[78839]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-13T02:59:41.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:41 smithi131 ceph-mon[78839]: from='osd.3 [v2:172.21.15.131:6800/946857611,v1:172.21.15.131:6801/946857611]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]: dispatch 2024-09-13T02:59:41.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:41 smithi131 ceph-mon[78839]: osdmap e65: 6 total, 5 up, 6 in 2024-09-13T02:59:41.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:41 smithi131 ceph-mon[78839]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]: dispatch 2024-09-13T02:59:41.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:41 smithi131 ceph-mon[78839]: pgmap v114: 65 pgs: 18 active+undersized, 20 active+undersized+degraded, 27 active+clean; 306 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s; 75/357 objects degraded (21.008%) 2024-09-13T02:59:41.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:41 smithi131 ceph-mon[78839]: from='osd.3 ' entity='osd.3' 2024-09-13T02:59:42.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:41 smithi089 ceph-mon[91553]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-13T02:59:42.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:41 smithi089 ceph-mon[91553]: from='osd.3 [v2:172.21.15.131:6800/946857611,v1:172.21.15.131:6801/946857611]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]: dispatch 2024-09-13T02:59:42.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:41 smithi089 ceph-mon[91553]: osdmap e65: 6 total, 5 up, 6 in 2024-09-13T02:59:42.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:41 smithi089 ceph-mon[91553]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]: dispatch 2024-09-13T02:59:42.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:41 smithi089 ceph-mon[91553]: pgmap v114: 65 pgs: 18 active+undersized, 20 active+undersized+degraded, 27 active+clean; 306 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s; 75/357 objects degraded (21.008%) 2024-09-13T02:59:42.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:41 smithi089 ceph-mon[91553]: from='osd.3 ' entity='osd.3' 2024-09-13T02:59:43.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:42 smithi131 ceph-mon[78839]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T02:59:43.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:42 smithi131 ceph-mon[78839]: osd.3 [v2:172.21.15.131:6800/946857611,v1:172.21.15.131:6801/946857611] boot 2024-09-13T02:59:43.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:42 smithi131 ceph-mon[78839]: osdmap e66: 6 total, 6 up, 6 in 2024-09-13T02:59:43.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:42 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T02:59:43.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:42 smithi089 ceph-mon[91553]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T02:59:43.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:42 smithi089 ceph-mon[91553]: osd.3 [v2:172.21.15.131:6800/946857611,v1:172.21.15.131:6801/946857611] boot 2024-09-13T02:59:43.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:42 smithi089 ceph-mon[91553]: osdmap e66: 6 total, 6 up, 6 in 2024-09-13T02:59:43.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:42 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-13T02:59:44.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:44 smithi131 ceph-mon[78839]: pgmap v116: 65 pgs: 18 active+undersized, 20 active+undersized+degraded, 27 active+clean; 306 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s; 75/357 objects degraded (21.008%) 2024-09-13T02:59:44.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:44 smithi131 ceph-mon[78839]: osdmap e67: 6 total, 6 up, 6 in 2024-09-13T02:59:44.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:44 smithi089 ceph-mon[91553]: pgmap v116: 65 pgs: 18 active+undersized, 20 active+undersized+degraded, 27 active+clean; 306 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s; 75/357 objects degraded (21.008%) 2024-09-13T02:59:44.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:44 smithi089 ceph-mon[91553]: osdmap e67: 6 total, 6 up, 6 in 2024-09-13T02:59:46.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:45 smithi089 ceph-mon[91553]: Health check update: Degraded data redundancy: 67/357 objects degraded (18.768%), 17 pgs degraded (PG_DEGRADED) 2024-09-13T02:59:46.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:45 smithi131 ceph-mon[78839]: Health check update: Degraded data redundancy: 67/357 objects degraded (18.768%), 17 pgs degraded (PG_DEGRADED) 2024-09-13T02:59:47.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:46 smithi089 ceph-mon[91553]: pgmap v118: 65 pgs: 14 active+undersized, 17 active+undersized+degraded, 34 active+clean; 306 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 67/357 objects degraded (18.768%) 2024-09-13T02:59:47.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:46 smithi131 ceph-mon[78839]: pgmap v118: 65 pgs: 14 active+undersized, 17 active+undersized+degraded, 34 active+clean; 306 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s; 67/357 objects degraded (18.768%) 2024-09-13T02:59:48.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:47 smithi089 ceph-mon[91553]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 67/357 objects degraded (18.768%), 17 pgs degraded) 2024-09-13T02:59:48.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:47 smithi089 ceph-mon[91553]: Cluster is now healthy 2024-09-13T02:59:48.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:47 smithi131 ceph-mon[78839]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 67/357 objects degraded (18.768%), 17 pgs degraded) 2024-09-13T02:59:48.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:47 smithi131 ceph-mon[78839]: Cluster is now healthy 2024-09-13T02:59:49.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:48 smithi089 ceph-mon[91553]: pgmap v119: 65 pgs: 65 active+clean; 306 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T02:59:49.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:48 smithi131 ceph-mon[78839]: pgmap v119: 65 pgs: 65 active+clean; 306 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-13T02:59:51.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:50 smithi089 ceph-mon[91553]: pgmap v120: 65 pgs: 65 active+clean; 306 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 895 B/s rd, 1 op/s 2024-09-13T02:59:51.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:50 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:59:51.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:50 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:59:51.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:50 smithi131 ceph-mon[78839]: pgmap v120: 65 pgs: 65 active+clean; 306 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 895 B/s rd, 1 op/s 2024-09-13T02:59:51.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:50 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:59:51.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:50 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T02:59:53.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:52 smithi089 ceph-mon[91553]: pgmap v121: 65 pgs: 65 active+clean; 306 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s 2024-09-13T02:59:53.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:52 smithi131 ceph-mon[78839]: pgmap v121: 65 pgs: 65 active+clean; 306 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s 2024-09-13T02:59:54.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:54 smithi131 ceph-mon[78839]: pgmap v122: 65 pgs: 65 active+clean; 306 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T02:59:54.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:54 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-13T02:59:55.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:54 smithi089 ceph-mon[91553]: pgmap v122: 65 pgs: 65 active+clean; 306 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T02:59:55.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:54 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-13T02:59:56.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:55 smithi089 ceph-mon[91553]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-13T02:59:56.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:55 smithi089 ceph-mon[91553]: Upgrade: osd.4 is safe to restart 2024-09-13T02:59:56.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:55 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:59:56.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:55 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-13T02:59:56.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:55 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:59:56.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:55 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:59:56.091 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:55 smithi131 ceph-mon[78839]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-09-13T02:59:56.091 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:55 smithi131 ceph-mon[78839]: Upgrade: osd.4 is safe to restart 2024-09-13T02:59:56.091 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:55 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:59:56.091 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:55 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-13T02:59:56.091 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:55 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T02:59:56.091 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:55 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T02:59:57.027 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:56 smithi131 ceph-mon[78839]: Upgrade: Updating osd.4 2024-09-13T02:59:57.027 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:56 smithi131 ceph-mon[78839]: Deploying daemon osd.4 on smithi131 2024-09-13T02:59:57.028 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:56 smithi131 ceph-mon[78839]: pgmap v123: 65 pgs: 65 active+clean; 306 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 3 op/s 2024-09-13T02:59:57.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:56 smithi089 ceph-mon[91553]: Upgrade: Updating osd.4 2024-09-13T02:59:57.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:56 smithi089 ceph-mon[91553]: Deploying daemon osd.4 on smithi131 2024-09-13T02:59:57.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:56 smithi089 ceph-mon[91553]: pgmap v123: 65 pgs: 65 active+clean; 306 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.4 KiB/s rd, 3 op/s 2024-09-13T02:59:58.640 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 13 02:59:58 smithi131 systemd[1]: Stopping Ceph osd.4 for 12cdb164-717a-11ef-bceb-c7b262605968... 2024-09-13T02:59:58.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:58 smithi131 ceph-mon[78839]: pgmap v124: 65 pgs: 65 active+clean; 306 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 4 op/s 2024-09-13T02:59:58.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:58 smithi131 ceph-mon[78839]: osd.4 marked itself down and dead 2024-09-13T02:59:58.934 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 13 02:59:58 smithi131 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-4[46513]: 2024-09-13T02:59:58.661+0000 7fe71d71c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T02:59:58.934 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 13 02:59:58 smithi131 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-4[46513]: 2024-09-13T02:59:58.661+0000 7fe71d71c640 -1 osd.4 67 *** Got signal Terminated *** 2024-09-13T02:59:58.934 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 13 02:59:58 smithi131 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-4[46513]: 2024-09-13T02:59:58.661+0000 7fe71d71c640 -1 osd.4 67 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T02:59:59.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:58 smithi089 ceph-mon[91553]: pgmap v124: 65 pgs: 65 active+clean; 306 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 4 op/s 2024-09-13T02:59:59.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:58 smithi089 ceph-mon[91553]: osd.4 marked itself down and dead 2024-09-13T02:59:59.434 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 13 02:59:59 smithi131 podman[93059]: 2024-09-13 02:59:59.181066125 +0000 UTC m=+0.641578733 container died 06ec44680b00661e1358a5100737407b1e96bbde4bcb37329bb51cfee8da26c9 (image=quay.ceph.io/ceph-ci/ceph@sha256:20745bd452f31fe48c67c092910f9b2c550f9dc62d239ff3e2953415a85590be, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-4, org.label-schema.build-date=20240731, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=quincy-bbdadfa, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T02:59:59.817 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:59 smithi131 ceph-mon[78839]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T02:59:59.817 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 02:59:59 smithi131 ceph-mon[78839]: osdmap e68: 6 total, 5 up, 6 in 2024-09-13T02:59:59.817 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 13 02:59:59 smithi131 podman[93059]: 2024-09-13 02:59:59.529869834 +0000 UTC m=+0.990382442 container cleanup 06ec44680b00661e1358a5100737407b1e96bbde4bcb37329bb51cfee8da26c9 (image=quay.ceph.io/ceph-ci/ceph@sha256:20745bd452f31fe48c67c092910f9b2c550f9dc62d239ff3e2953415a85590be, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=quincy-bbdadfa, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-13T02:59:59.817 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 13 02:59:59 smithi131 bash[93059]: ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-4 2024-09-13T03:00:00.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:59 smithi089 ceph-mon[91553]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T03:00:00.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 02:59:59 smithi089 ceph-mon[91553]: osdmap e68: 6 total, 5 up, 6 in 2024-09-13T03:00:00.156 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 13 02:59:59 smithi131 podman[93084]: 2024-09-13 02:59:59.814777467 +0000 UTC m=+0.632238625 container remove 06ec44680b00661e1358a5100737407b1e96bbde4bcb37329bb51cfee8da26c9 (image=quay.ceph.io/ceph-ci/ceph@sha256:20745bd452f31fe48c67c092910f9b2c550f9dc62d239ff3e2953415a85590be, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-4, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=quincy-bbdadfa, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-13T03:00:00.434 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 13 03:00:00 smithi131 podman[93173]: 2024-09-13 03:00:00.058267561 +0000 UTC m=+0.015812909 image pull 19dc8d6597273a47b0b4862f1d0e037b0157b908a02acd63baceec3ee94fbd6c quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d 2024-09-13T03:00:00.434 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 13 03:00:00 smithi131 podman[93173]: 2024-09-13 03:00:00.165527622 +0000 UTC m=+0.123072960 container create d5f092b980f81143cc2df141c8af507bbbb99c229cb4926bee157f2775f38748 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-7741f7f) 2024-09-13T03:00:00.434 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 13 03:00:00 smithi131 podman[93173]: 2024-09-13 03:00:00.384873159 +0000 UTC m=+0.342418497 container init d5f092b980f81143cc2df141c8af507bbbb99c229cb4926bee157f2775f38748 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, RELEASE=squid-7741f7f, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T03:00:00.434 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 13 03:00:00 smithi131 podman[93173]: 2024-09-13 03:00:00.388254767 +0000 UTC m=+0.345800107 container start d5f092b980f81143cc2df141c8af507bbbb99c229cb4926bee157f2775f38748 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=squid-7741f7f, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T03:00:00.789 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 13 03:00:00 smithi131 podman[93173]: 2024-09-13 03:00:00.476363127 +0000 UTC m=+0.433908466 container attach d5f092b980f81143cc2df141c8af507bbbb99c229cb4926bee157f2775f38748 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-7741f7f, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T03:00:00.790 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 13 03:00:00 smithi131 podman[93173]: 2024-09-13 03:00:00.579445162 +0000 UTC m=+0.536990503 container died d5f092b980f81143cc2df141c8af507bbbb99c229cb4926bee157f2775f38748 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-7741f7f, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True) 2024-09-13T03:00:01.122 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:00 smithi131 ceph-mon[78839]: pgmap v126: 65 pgs: 6 stale+active+clean, 59 active+clean; 306 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-13T03:00:01.123 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:00 smithi131 ceph-mon[78839]: osdmap e69: 6 total, 5 up, 6 in 2024-09-13T03:00:01.123 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:00 smithi131 ceph-mon[78839]: Health detail: HEALTH_WARN 1 osds down 2024-09-13T03:00:01.123 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:00 smithi131 ceph-mon[78839]: [WRN] OSD_DOWN: 1 osds down 2024-09-13T03:00:01.123 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:00 smithi131 ceph-mon[78839]: osd.4 (root=default,host=smithi131) is down 2024-09-13T03:00:01.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:00 smithi089 ceph-mon[91553]: pgmap v126: 65 pgs: 6 stale+active+clean, 59 active+clean; 306 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s 2024-09-13T03:00:01.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:00 smithi089 ceph-mon[91553]: osdmap e69: 6 total, 5 up, 6 in 2024-09-13T03:00:01.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:00 smithi089 ceph-mon[91553]: Health detail: HEALTH_WARN 1 osds down 2024-09-13T03:00:01.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:00 smithi089 ceph-mon[91553]: [WRN] OSD_DOWN: 1 osds down 2024-09-13T03:00:01.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:00 smithi089 ceph-mon[91553]: osd.4 (root=default,host=smithi131) is down 2024-09-13T03:00:01.434 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 13 03:00:01 smithi131 podman[93196]: 2024-09-13 03:00:01.121869481 +0000 UTC m=+0.536615700 container remove d5f092b980f81143cc2df141c8af507bbbb99c229cb4926bee157f2775f38748 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-7741f7f, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-13T03:00:01.434 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 13 03:00:01 smithi131 systemd[1]: ceph-12cdb164-717a-11ef-bceb-c7b262605968@osd.4.service: Deactivated successfully. 2024-09-13T03:00:01.434 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 13 03:00:01 smithi131 systemd[1]: Stopped Ceph osd.4 for 12cdb164-717a-11ef-bceb-c7b262605968. 2024-09-13T03:00:01.434 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 13 03:00:01 smithi131 systemd[1]: ceph-12cdb164-717a-11ef-bceb-c7b262605968@osd.4.service: Consumed 54.416s CPU time. 2024-09-13T03:00:01.434 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 13 03:00:01 smithi131 systemd[1]: Starting Ceph osd.4 for 12cdb164-717a-11ef-bceb-c7b262605968... 2024-09-13T03:00:01.805 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 13 03:00:01 smithi131 podman[93295]: 2024-09-13 03:00:01.456821822 +0000 UTC m=+0.016515615 image pull 19dc8d6597273a47b0b4862f1d0e037b0157b908a02acd63baceec3ee94fbd6c quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d 2024-09-13T03:00:01.805 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 13 03:00:01 smithi131 podman[93295]: 2024-09-13 03:00:01.564626882 +0000 UTC m=+0.124320674 container create 759b1aa465edb4414753348a8630907c13afc72cf8ef81f0563c2d8e7a0e9a09 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-4-activate, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=squid-7741f7f, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-13T03:00:01.806 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 13 03:00:01 smithi131 podman[93295]: 2024-09-13 03:00:01.801429573 +0000 UTC m=+0.361123373 container init 759b1aa465edb4414753348a8630907c13afc72cf8ef81f0563c2d8e7a0e9a09 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-4-activate, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=squid-7741f7f, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-13T03:00:02.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:01 smithi131 ceph-mon[78839]: pgmap v128: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 306 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 60/357 objects degraded (16.807%) 2024-09-13T03:00:02.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:01 smithi131 ceph-mon[78839]: Health check failed: Degraded data redundancy: 60/357 objects degraded (16.807%), 16 pgs degraded (PG_DEGRADED) 2024-09-13T03:00:02.185 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 13 03:00:01 smithi131 podman[93295]: 2024-09-13 03:00:01.804815975 +0000 UTC m=+0.364509767 container start 759b1aa465edb4414753348a8630907c13afc72cf8ef81f0563c2d8e7a0e9a09 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-4-activate, ceph=True, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-7741f7f, org.label-schema.build-date=20240731) 2024-09-13T03:00:02.185 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 13 03:00:01 smithi131 podman[93295]: 2024-09-13 03:00:01.919672806 +0000 UTC m=+0.479366606 container attach 759b1aa465edb4414753348a8630907c13afc72cf8ef81f0563c2d8e7a0e9a09 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-4-activate, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, RELEASE=squid-7741f7f, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-13T03:00:02.185 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 13 03:00:01 smithi131 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-4-activate[93311]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T03:00:02.185 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 13 03:00:01 smithi131 bash[93295]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T03:00:02.185 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 13 03:00:01 smithi131 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-4-activate[93311]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T03:00:02.185 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 13 03:00:01 smithi131 bash[93295]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T03:00:02.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:01 smithi089 ceph-mon[91553]: pgmap v128: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 306 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 60/357 objects degraded (16.807%) 2024-09-13T03:00:02.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:01 smithi089 ceph-mon[91553]: Health check failed: Degraded data redundancy: 60/357 objects degraded (16.807%), 16 pgs degraded (PG_DEGRADED) 2024-09-13T03:00:02.934 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 13 03:00:02 smithi131 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-4-activate[93311]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-13T03:00:02.934 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 13 03:00:02 smithi131 bash[93295]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-13T03:00:02.934 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 13 03:00:02 smithi131 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-4-activate[93311]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-13T03:00:02.934 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 13 03:00:02 smithi131 bash[93295]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-09-13T03:00:03.258 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 13 03:00:02 smithi131 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-4-activate[93311]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-13T03:00:03.258 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 13 03:00:02 smithi131 bash[93295]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-09-13T03:00:03.258 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 13 03:00:02 smithi131 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-4-activate[93311]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-13T03:00:03.259 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 13 03:00:02 smithi131 bash[93295]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-09-13T03:00:03.259 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 13 03:00:02 smithi131 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-4-activate[93311]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-09-13T03:00:03.259 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 13 03:00:02 smithi131 bash[93295]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-09-13T03:00:03.259 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 13 03:00:02 smithi131 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-4-activate[93311]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-13T03:00:03.259 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 13 03:00:02 smithi131 bash[93295]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-13T03:00:03.259 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 13 03:00:02 smithi131 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-4-activate[93311]: --> ceph-volume raw activate successful for osd ID: 4 2024-09-13T03:00:03.259 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 13 03:00:02 smithi131 bash[93295]: --> ceph-volume raw activate successful for osd ID: 4 2024-09-13T03:00:03.259 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 13 03:00:02 smithi131 podman[93295]: 2024-09-13 03:00:02.978662315 +0000 UTC m=+1.538356109 container died 759b1aa465edb4414753348a8630907c13afc72cf8ef81f0563c2d8e7a0e9a09 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-4-activate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=squid-7741f7f, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-09-13T03:00:03.863 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 13 03:00:03 smithi131 podman[93440]: 2024-09-13 03:00:03.535243268 +0000 UTC m=+0.550393347 container remove 759b1aa465edb4414753348a8630907c13afc72cf8ef81f0563c2d8e7a0e9a09 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-4-activate, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-7741f7f, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=) 2024-09-13T03:00:03.863 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 13 03:00:03 smithi131 podman[93499]: 2024-09-13 03:00:03.643633351 +0000 UTC m=+0.017084062 image pull 19dc8d6597273a47b0b4862f1d0e037b0157b908a02acd63baceec3ee94fbd6c quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d 2024-09-13T03:00:03.863 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 13 03:00:03 smithi131 podman[93499]: 2024-09-13 03:00:03.744411254 +0000 UTC m=+0.117861956 container create 0317e6a4a04c9e7adc3f2b7f1ba69c3b34d4248213783c2db5cab6d3d708e377 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-4, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-7741f7f, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-13T03:00:04.434 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 13 03:00:03 smithi131 podman[93499]: 2024-09-13 03:00:03.990981562 +0000 UTC m=+0.364432266 container init 0317e6a4a04c9e7adc3f2b7f1ba69c3b34d4248213783c2db5cab6d3d708e377 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-7741f7f, org.label-schema.build-date=20240731) 2024-09-13T03:00:04.434 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 13 03:00:03 smithi131 podman[93499]: 2024-09-13 03:00:03.994067077 +0000 UTC m=+0.367517779 container start 0317e6a4a04c9e7adc3f2b7f1ba69c3b34d4248213783c2db5cab6d3d708e377 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-4, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-7741f7f, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T03:00:04.434 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 13 03:00:04 smithi131 ceph-osd[93518]: -- 172.21.15.131:0/618148456 <== mon.1 v2:172.21.15.131:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56377f1b61e0 con 0x56377f14c000 2024-09-13T03:00:04.434 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 13 03:00:04 smithi131 bash[93499]: 0317e6a4a04c9e7adc3f2b7f1ba69c3b34d4248213783c2db5cab6d3d708e377 2024-09-13T03:00:04.434 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 13 03:00:04 smithi131 systemd[1]: Started Ceph osd.4 for 12cdb164-717a-11ef-bceb-c7b262605968. 2024-09-13T03:00:04.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:04 smithi089 ceph-mon[91553]: pgmap v129: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 306 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 60/357 objects degraded (16.807%) 2024-09-13T03:00:04.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:04 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:00:04.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:04 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:00:04.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:04 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:00:04.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:04 smithi131 ceph-mon[78839]: pgmap v129: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 306 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 60/357 objects degraded (16.807%) 2024-09-13T03:00:04.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:04 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:00:04.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:04 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:00:04.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:04 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:00:06.184 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 13 03:00:05 smithi131 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-4[93514]: 2024-09-13T03:00:05.879+0000 7efeb1e81640 -1 Falling back to public interface 2024-09-13T03:00:06.852 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:06 smithi089 ceph-mon[91553]: pgmap v130: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 306 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 60/357 objects degraded (16.807%) 2024-09-13T03:00:06.852 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:06 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:00:06.853 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:06 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:00:06.854 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:06.850+0000 7f55014a7640 1 -- 172.21.15.89:0/4129445309 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54fc0fb430 msgr2=0x7f54fc0fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:06.854 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:06.850+0000 7f55014a7640 1 --2- 172.21.15.89:0/4129445309 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54fc0fb430 0x7f54fc0fb840 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f54ec0048d0 tx=0x7f54ec009da0 comp rx=0 tx=0).stop 2024-09-13T03:00:06.854 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:06.850+0000 7f55014a7640 1 -- 172.21.15.89:0/4129445309 shutdown_connections 2024-09-13T03:00:06.855 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:06.850+0000 7f55014a7640 1 --2- 172.21.15.89:0/4129445309 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f54fc0fc700 0x7f54fc0fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:06.855 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:06.850+0000 7f55014a7640 1 --2- 172.21.15.89:0/4129445309 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54fc0fb430 0x7f54fc0fb840 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:06.855 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:06.850+0000 7f55014a7640 1 -- 172.21.15.89:0/4129445309 >> 172.21.15.89:0/4129445309 conn(0x7f54fc0f6c10 msgr2=0x7f54fc0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:00:06.855 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:06.850+0000 7f55014a7640 1 -- 172.21.15.89:0/4129445309 shutdown_connections 2024-09-13T03:00:06.855 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:06.850+0000 7f55014a7640 1 -- 172.21.15.89:0/4129445309 wait complete. 2024-09-13T03:00:06.855 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:06.851+0000 7f55014a7640 1 Processor -- start 2024-09-13T03:00:06.855 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:06.851+0000 7f55014a7640 1 -- start start 2024-09-13T03:00:06.855 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:06.851+0000 7f55014a7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54fc0fb430 0x7f54fc10d0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:06.855 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:06.851+0000 7f55014a7640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f54fc0fc700 0x7f54fc10d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:06.855 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:06.851+0000 7f55014a7640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54fc10dc50 con 0x7f54fc0fb430 2024-09-13T03:00:06.855 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:06.851+0000 7f55014a7640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54fc10e470 con 0x7f54fc0fc700 2024-09-13T03:00:06.855 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:06.852+0000 7f54faffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54fc0fb430 0x7f54fc10d0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:00:06.855 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:06.852+0000 7f54faffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54fc0fb430 0x7f54fc10d0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:44588/0 (socket says 172.21.15.89:44588) 2024-09-13T03:00:06.855 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:06.852+0000 7f54faffd640 1 -- 172.21.15.89:0/2467181613 learned_addr learned my addr 172.21.15.89:0/2467181613 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T03:00:06.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:06.852+0000 7f54fa7fc640 1 --2- 172.21.15.89:0/2467181613 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f54fc0fc700 0x7f54fc10d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:00:06.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:06.852+0000 7f54faffd640 1 -- 172.21.15.89:0/2467181613 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f54fc0fc700 msgr2=0x7f54fc10d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:06.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:06.852+0000 7f54faffd640 1 --2- 172.21.15.89:0/2467181613 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f54fc0fc700 0x7f54fc10d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:06.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:06.852+0000 7f54faffd640 1 -- 172.21.15.89:0/2467181613 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54ec005040 con 0x7f54fc0fb430 2024-09-13T03:00:06.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:06.852+0000 7f54fa7fc640 1 --2- 172.21.15.89:0/2467181613 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f54fc0fc700 0x7f54fc10d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T03:00:06.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:06.852+0000 7f54faffd640 1 --2- 172.21.15.89:0/2467181613 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54fc0fb430 0x7f54fc10d0c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f54ec0048a0 tx=0x7f54ec009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:00:06.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:06.852+0000 7f54e37fe640 1 -- 172.21.15.89:0/2467181613 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f54ec038070 con 0x7f54fc0fb430 2024-09-13T03:00:06.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:06.852+0000 7f55014a7640 1 -- 172.21.15.89:0/2467181613 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54fc10e6a0 con 0x7f54fc0fb430 2024-09-13T03:00:06.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:06.852+0000 7f54e37fe640 1 -- 172.21.15.89:0/2467181613 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f54ec004290 con 0x7f54fc0fb430 2024-09-13T03:00:06.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:06.852+0000 7f54e37fe640 1 -- 172.21.15.89:0/2467181613 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f54ec033660 con 0x7f54fc0fb430 2024-09-13T03:00:06.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:06.852+0000 7f55014a7640 1 -- 172.21.15.89:0/2467181613 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54fc10ec40 con 0x7f54fc0fb430 2024-09-13T03:00:06.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:06.853+0000 7f55014a7640 1 -- 172.21.15.89:0/2467181613 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54fc0fa890 con 0x7f54fc0fb430 2024-09-13T03:00:06.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:06.854+0000 7f54e37fe640 1 -- 172.21.15.89:0/2467181613 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f54ec030020 con 0x7f54fc0fb430 2024-09-13T03:00:06.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:06.854+0000 7f54e37fe640 1 --2- 172.21.15.89:0/2467181613 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f54e406e530 0x7f54e40709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:06.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:06.855+0000 7f54e37fe640 1 -- 172.21.15.89:0/2467181613 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f54ec0ae2b0 con 0x7f54fc0fb430 2024-09-13T03:00:06.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:06.855+0000 7f54fa7fc640 1 --2- 172.21.15.89:0/2467181613 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f54e406e530 0x7f54e40709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:00:06.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:06.855+0000 7f54fa7fc640 1 --2- 172.21.15.89:0/2467181613 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f54e406e530 0x7f54e40709e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f54f0004fd0 tx=0x7f54f000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:00:06.860 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:06.859+0000 7f54e37fe640 1 -- 172.21.15.89:0/2467181613 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f54ec077450 con 0x7f54fc0fb430 2024-09-13T03:00:06.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:06 smithi131 ceph-mon[78839]: pgmap v130: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 306 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 60/357 objects degraded (16.807%) 2024-09-13T03:00:06.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:06 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:00:06.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:06 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:00:07.042 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.040+0000 7f55014a7640 1 -- 172.21.15.89:0/2467181613 --> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f54fc10ee60 con 0x7f54e406e530 2024-09-13T03:00:07.043 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.041+0000 7f54e37fe640 1 -- 172.21.15.89:0/2467181613 <== mgr.34104 v2:172.21.15.89:6800/1881577856 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f54fc10ee60 con 0x7f54e406e530 2024-09-13T03:00:07.045 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.044+0000 7f55014a7640 1 -- 172.21.15.89:0/2467181613 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f54e406e530 msgr2=0x7f54e40709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:07.045 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.044+0000 7f55014a7640 1 --2- 172.21.15.89:0/2467181613 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f54e406e530 0x7f54e40709e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f54f0004fd0 tx=0x7f54f000b040 comp rx=0 tx=0).stop 2024-09-13T03:00:07.045 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.044+0000 7f55014a7640 1 -- 172.21.15.89:0/2467181613 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54fc0fb430 msgr2=0x7f54fc10d0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:07.046 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.044+0000 7f55014a7640 1 --2- 172.21.15.89:0/2467181613 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54fc0fb430 0x7f54fc10d0c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f54ec0048a0 tx=0x7f54ec009da0 comp rx=0 tx=0).stop 2024-09-13T03:00:07.046 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.044+0000 7f55014a7640 1 -- 172.21.15.89:0/2467181613 shutdown_connections 2024-09-13T03:00:07.046 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.044+0000 7f55014a7640 1 --2- 172.21.15.89:0/2467181613 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f54e406e530 0x7f54e40709e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:07.046 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.044+0000 7f55014a7640 1 --2- 172.21.15.89:0/2467181613 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f54fc0fc700 0x7f54fc10d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:07.046 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.044+0000 7f55014a7640 1 --2- 172.21.15.89:0/2467181613 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f54fc0fb430 0x7f54fc10d0c0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:07.046 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.044+0000 7f55014a7640 1 -- 172.21.15.89:0/2467181613 >> 172.21.15.89:0/2467181613 conn(0x7f54fc0f6c10 msgr2=0x7f54fc065670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:00:07.046 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.044+0000 7f55014a7640 1 -- 172.21.15.89:0/2467181613 shutdown_connections 2024-09-13T03:00:07.046 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.044+0000 7f55014a7640 1 -- 172.21.15.89:0/2467181613 wait complete. 2024-09-13T03:00:07.054 INFO:teuthology.orchestra.run.smithi089.stdout:true 2024-09-13T03:00:07.127 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.125+0000 7f4761ec6640 1 -- 172.21.15.89:0/1133107781 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f475c0fd820 msgr2=0x7f475c0fdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:07.127 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.125+0000 7f4761ec6640 1 --2- 172.21.15.89:0/1133107781 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f475c0fd820 0x7f475c0fdc90 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f47500048d0 tx=0x7f4750009da0 comp rx=0 tx=0).stop 2024-09-13T03:00:07.127 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.125+0000 7f4761ec6640 1 -- 172.21.15.89:0/1133107781 shutdown_connections 2024-09-13T03:00:07.127 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.125+0000 7f4761ec6640 1 --2- 172.21.15.89:0/1133107781 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f475c0fd820 0x7f475c0fdc90 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:07.127 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.125+0000 7f4761ec6640 1 --2- 172.21.15.89:0/1133107781 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f475c0fc550 0x7f475c0fc960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:07.127 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.125+0000 7f4761ec6640 1 -- 172.21.15.89:0/1133107781 >> 172.21.15.89:0/1133107781 conn(0x7f475c0f7d30 msgr2=0x7f475c0fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:00:07.127 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.125+0000 7f4761ec6640 1 -- 172.21.15.89:0/1133107781 shutdown_connections 2024-09-13T03:00:07.127 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.125+0000 7f4761ec6640 1 -- 172.21.15.89:0/1133107781 wait complete. 2024-09-13T03:00:07.127 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.125+0000 7f4761ec6640 1 Processor -- start 2024-09-13T03:00:07.127 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.126+0000 7f4761ec6640 1 -- start start 2024-09-13T03:00:07.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.126+0000 7f4761ec6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f475c0fc550 0x7f475c071570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:07.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.126+0000 7f4761ec6640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f475c0fd820 0x7f475c06fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:07.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.126+0000 7f4761ec6640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f475c06fff0 con 0x7f475c0fc550 2024-09-13T03:00:07.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.126+0000 7f4761ec6640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f475c070130 con 0x7f475c0fd820 2024-09-13T03:00:07.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.126+0000 7f475b7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f475c0fc550 0x7f475c071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:00:07.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.126+0000 7f475b7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f475c0fc550 0x7f475c071570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:44616/0 (socket says 172.21.15.89:44616) 2024-09-13T03:00:07.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.126+0000 7f475b7fe640 1 -- 172.21.15.89:0/3029180773 learned_addr learned my addr 172.21.15.89:0/3029180773 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T03:00:07.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.126+0000 7f475affd640 1 --2- 172.21.15.89:0/3029180773 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f475c0fd820 0x7f475c06fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:00:07.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.126+0000 7f475b7fe640 1 -- 172.21.15.89:0/3029180773 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f475c0fd820 msgr2=0x7f475c06fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:07.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.126+0000 7f475b7fe640 1 --2- 172.21.15.89:0/3029180773 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f475c0fd820 0x7f475c06fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:07.129 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.126+0000 7f475b7fe640 1 -- 172.21.15.89:0/3029180773 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4750005040 con 0x7f475c0fc550 2024-09-13T03:00:07.130 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.126+0000 7f475b7fe640 1 --2- 172.21.15.89:0/3029180773 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f475c0fc550 0x7f475c071570 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f474c002a50 tx=0x7f474c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:00:07.130 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.127+0000 7f4743fff640 1 -- 172.21.15.89:0/3029180773 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f474c007c30 con 0x7f475c0fc550 2024-09-13T03:00:07.130 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.127+0000 7f4743fff640 1 -- 172.21.15.89:0/3029180773 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f474c00f040 con 0x7f475c0fc550 2024-09-13T03:00:07.130 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.127+0000 7f4761ec6640 1 -- 172.21.15.89:0/3029180773 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f475c070410 con 0x7f475c0fc550 2024-09-13T03:00:07.130 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.127+0000 7f4743fff640 1 -- 172.21.15.89:0/3029180773 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f474c00da10 con 0x7f475c0fc550 2024-09-13T03:00:07.130 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.127+0000 7f4761ec6640 1 -- 172.21.15.89:0/3029180773 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f475c115100 con 0x7f475c0fc550 2024-09-13T03:00:07.131 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.128+0000 7f4761ec6640 1 -- 172.21.15.89:0/3029180773 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f475c0fb9b0 con 0x7f475c0fc550 2024-09-13T03:00:07.131 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.128+0000 7f4743fff640 1 -- 172.21.15.89:0/3029180773 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f474c00dc50 con 0x7f475c0fc550 2024-09-13T03:00:07.131 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.129+0000 7f4743fff640 1 --2- 172.21.15.89:0/3029180773 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f474406e530 0x7f47440709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:07.131 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.129+0000 7f4743fff640 1 -- 172.21.15.89:0/3029180773 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f474c08d8b0 con 0x7f475c0fc550 2024-09-13T03:00:07.131 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.129+0000 7f475affd640 1 --2- 172.21.15.89:0/3029180773 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f474406e530 0x7f47440709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:00:07.131 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.129+0000 7f475affd640 1 --2- 172.21.15.89:0/3029180773 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f474406e530 0x7f47440709e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f475000b020 tx=0x7f4750035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:00:07.135 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.134+0000 7f4743fff640 1 -- 172.21.15.89:0/3029180773 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f474c056ad0 con 0x7f475c0fc550 2024-09-13T03:00:07.318 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.317+0000 7f4761ec6640 1 -- 172.21.15.89:0/3029180773 --> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f475c101c40 con 0x7f474406e530 2024-09-13T03:00:07.319 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.318+0000 7f4743fff640 1 -- 172.21.15.89:0/3029180773 <== mgr.34104 v2:172.21.15.89:6800/1881577856 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f475c101c40 con 0x7f474406e530 2024-09-13T03:00:07.321 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.320+0000 7f4761ec6640 1 -- 172.21.15.89:0/3029180773 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f474406e530 msgr2=0x7f47440709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:07.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.320+0000 7f4761ec6640 1 --2- 172.21.15.89:0/3029180773 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f474406e530 0x7f47440709e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f475000b020 tx=0x7f4750035040 comp rx=0 tx=0).stop 2024-09-13T03:00:07.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.320+0000 7f4761ec6640 1 -- 172.21.15.89:0/3029180773 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f475c0fc550 msgr2=0x7f475c071570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:07.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.320+0000 7f4761ec6640 1 --2- 172.21.15.89:0/3029180773 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f475c0fc550 0x7f475c071570 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f474c002a50 tx=0x7f474c004600 comp rx=0 tx=0).stop 2024-09-13T03:00:07.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.320+0000 7f4761ec6640 1 -- 172.21.15.89:0/3029180773 shutdown_connections 2024-09-13T03:00:07.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.320+0000 7f4761ec6640 1 --2- 172.21.15.89:0/3029180773 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f474406e530 0x7f47440709e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:07.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.320+0000 7f4761ec6640 1 --2- 172.21.15.89:0/3029180773 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f475c0fd820 0x7f475c06fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:07.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.320+0000 7f4761ec6640 1 --2- 172.21.15.89:0/3029180773 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f475c0fc550 0x7f475c071570 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:07.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.320+0000 7f4761ec6640 1 -- 172.21.15.89:0/3029180773 >> 172.21.15.89:0/3029180773 conn(0x7f475c0f7d30 msgr2=0x7f475c0f94a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:00:07.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.320+0000 7f4761ec6640 1 -- 172.21.15.89:0/3029180773 shutdown_connections 2024-09-13T03:00:07.322 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.320+0000 7f4761ec6640 1 -- 172.21.15.89:0/3029180773 wait complete. 2024-09-13T03:00:07.402 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.400+0000 7f7e1a79c640 1 -- 172.21.15.89:0/671595936 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e140ff680 msgr2=0x7f7e14101a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:07.402 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.400+0000 7f7e1a79c640 1 --2- 172.21.15.89:0/671595936 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e140ff680 0x7f7e14101a60 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7e080048d0 tx=0x7f7e08009da0 comp rx=0 tx=0).stop 2024-09-13T03:00:07.402 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.400+0000 7f7e1a79c640 1 -- 172.21.15.89:0/671595936 shutdown_connections 2024-09-13T03:00:07.402 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.400+0000 7f7e1a79c640 1 --2- 172.21.15.89:0/671595936 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e140ff680 0x7f7e14101a60 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:07.402 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.400+0000 7f7e1a79c640 1 --2- 172.21.15.89:0/671595936 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7e14065c40 0x7f7e140ff140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:07.402 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.400+0000 7f7e1a79c640 1 -- 172.21.15.89:0/671595936 >> 172.21.15.89:0/671595936 conn(0x7f7e140f6c10 msgr2=0x7f7e140f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:00:07.402 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.400+0000 7f7e1a79c640 1 -- 172.21.15.89:0/671595936 shutdown_connections 2024-09-13T03:00:07.402 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.400+0000 7f7e1a79c640 1 -- 172.21.15.89:0/671595936 wait complete. 2024-09-13T03:00:07.402 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.400+0000 7f7e1a79c640 1 Processor -- start 2024-09-13T03:00:07.404 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.401+0000 7f7e1a79c640 1 -- start start 2024-09-13T03:00:07.404 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.401+0000 7f7e1a79c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e14065c40 0x7f7e140fcab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:07.404 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.401+0000 7f7e1a79c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7e140ff680 0x7f7e140fb040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:07.404 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.401+0000 7f7e1a79c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e140fb580 con 0x7f7e14065c40 2024-09-13T03:00:07.404 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.401+0000 7f7e1a79c640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e140fb6f0 con 0x7f7e140ff680 2024-09-13T03:00:07.404 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.401+0000 7f7e13fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e14065c40 0x7f7e140fcab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:00:07.404 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.401+0000 7f7e13fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e14065c40 0x7f7e140fcab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:44638/0 (socket says 172.21.15.89:44638) 2024-09-13T03:00:07.404 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.401+0000 7f7e13fff640 1 -- 172.21.15.89:0/2034080982 learned_addr learned my addr 172.21.15.89:0/2034080982 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T03:00:07.405 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.401+0000 7f7e137fe640 1 --2- 172.21.15.89:0/2034080982 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7e140ff680 0x7f7e140fb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:00:07.405 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.401+0000 7f7e13fff640 1 -- 172.21.15.89:0/2034080982 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7e140ff680 msgr2=0x7f7e140fb040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:07.405 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.401+0000 7f7e13fff640 1 --2- 172.21.15.89:0/2034080982 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7e140ff680 0x7f7e140fb040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:07.405 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.401+0000 7f7e13fff640 1 -- 172.21.15.89:0/2034080982 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e08005040 con 0x7f7e14065c40 2024-09-13T03:00:07.405 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.402+0000 7f7e13fff640 1 --2- 172.21.15.89:0/2034080982 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e14065c40 0x7f7e140fcab0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7e04002a80 tx=0x7f7e04004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:00:07.405 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.402+0000 7f7e10ff9640 1 -- 172.21.15.89:0/2034080982 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e04007c30 con 0x7f7e14065c40 2024-09-13T03:00:07.405 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.402+0000 7f7e10ff9640 1 -- 172.21.15.89:0/2034080982 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f7e0400f040 con 0x7f7e14065c40 2024-09-13T03:00:07.405 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.402+0000 7f7e1a79c640 1 -- 172.21.15.89:0/2034080982 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e140fb9d0 con 0x7f7e14065c40 2024-09-13T03:00:07.405 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.402+0000 7f7e10ff9640 1 -- 172.21.15.89:0/2034080982 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e0400db10 con 0x7f7e14065c40 2024-09-13T03:00:07.405 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.402+0000 7f7e1a79c640 1 -- 172.21.15.89:0/2034080982 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e14115140 con 0x7f7e14065c40 2024-09-13T03:00:07.406 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.403+0000 7f7e1a79c640 1 -- 172.21.15.89:0/2034080982 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e140fa890 con 0x7f7e14065c40 2024-09-13T03:00:07.406 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.403+0000 7f7e10ff9640 1 -- 172.21.15.89:0/2034080982 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f7e0400dc70 con 0x7f7e14065c40 2024-09-13T03:00:07.406 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.404+0000 7f7e10ff9640 1 --2- 172.21.15.89:0/2034080982 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f7dfc06e530 0x7f7dfc0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:07.406 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.404+0000 7f7e10ff9640 1 -- 172.21.15.89:0/2034080982 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f7e0408dd70 con 0x7f7e14065c40 2024-09-13T03:00:07.406 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.404+0000 7f7e137fe640 1 --2- 172.21.15.89:0/2034080982 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f7dfc06e530 0x7f7dfc0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:00:07.406 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.404+0000 7f7e137fe640 1 --2- 172.21.15.89:0/2034080982 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f7dfc06e530 0x7f7dfc0709e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7e0800b020 tx=0x7f7e08035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:00:07.409 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.408+0000 7f7e10ff9640 1 -- 172.21.15.89:0/2034080982 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f7e04056ee0 con 0x7f7e14065c40 2024-09-13T03:00:07.583 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.582+0000 7f7e1a79c640 1 -- 172.21.15.89:0/2034080982 --> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7e140f8700 con 0x7f7dfc06e530 2024-09-13T03:00:07.592 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.590+0000 7f7e10ff9640 1 -- 172.21.15.89:0/2034080982 <== mgr.34104 v2:172.21.15.89:6800/1881577856 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f7e140f8700 con 0x7f7dfc06e530 2024-09-13T03:00:07.592 INFO:teuthology.orchestra.run.smithi089.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T03:00:07.592 INFO:teuthology.orchestra.run.smithi089.stdout:alertmanager.smithi089 smithi089 *:9093,9094 running (4m) 65s ago 13m 25.7M - 0.25.0 c8568f914cd2 1d2432f5479e 2024-09-13T03:00:07.592 INFO:teuthology.orchestra.run.smithi089.stdout:crash.smithi089 smithi089 running (2m) 65s ago 13m 6891k - 19.1.1-322-g7741f7f9 19dc8d659727 0ef15ca3e7f9 2024-09-13T03:00:07.592 INFO:teuthology.orchestra.run.smithi089.stdout:crash.smithi131 smithi131 running (2m) 0s ago 12m 6895k - 19.1.1-322-g7741f7f9 19dc8d659727 21e4d6fc04f7 2024-09-13T03:00:07.592 INFO:teuthology.orchestra.run.smithi089.stdout:grafana.smithi089 smithi089 *:3000 running (4m) 65s ago 13m 79.0M - 9.4.7 954c08fa6188 dee914ded1af 2024-09-13T03:00:07.592 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi089.qjoitb smithi089 running (8m) 65s ago 8m 70.3M - 17.2.7-1627-gbbdadfa3 a994b00deb3a ff9b59ec5107 2024-09-13T03:00:07.592 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi089.rarddb smithi089 running (8m) 65s ago 8m 135M - 17.2.7-1627-gbbdadfa3 a994b00deb3a db2dc502c1ba 2024-09-13T03:00:07.593 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi131.rbovzc smithi131 running (8m) 0s ago 8m 60.3M - 17.2.7-1627-gbbdadfa3 a994b00deb3a d071b6d99537 2024-09-13T03:00:07.593 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi131.uasrkg smithi131 running (8m) 0s ago 8m 112M - 17.2.7-1627-gbbdadfa3 a994b00deb3a 0b3d4ffa6ce5 2024-09-13T03:00:07.593 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.smithi089.guohvs smithi089 *:8443,9283,8765 running (4m) 65s ago 14m 498M - 19.1.1-322-g7741f7f9 19dc8d659727 1e887446f1b0 2024-09-13T03:00:07.593 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.smithi131.aunbqd smithi131 *:8443,9283,8765 running (3m) 0s ago 12m 440M - 19.1.1-322-g7741f7f9 19dc8d659727 358d7478f2ba 2024-09-13T03:00:07.593 INFO:teuthology.orchestra.run.smithi089.stdout:mon.smithi089 smithi089 running (3m) 65s ago 15m 46.4M 2048M 19.1.1-322-g7741f7f9 19dc8d659727 8a29fb65028f 2024-09-13T03:00:07.593 INFO:teuthology.orchestra.run.smithi089.stdout:mon.smithi131 smithi131 running (3m) 0s ago 12m 42.5M 2048M 19.1.1-322-g7741f7f9 19dc8d659727 506310ad8620 2024-09-13T03:00:07.593 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.smithi089 smithi089 *:9100 running (4m) 65s ago 13m 16.9M - 1.5.0 0da6a335fe13 5a9927b583e6 2024-09-13T03:00:07.593 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.smithi131 smithi131 *:9100 running (4m) 0s ago 12m 16.0M - 1.5.0 0da6a335fe13 bcfde5d1a508 2024-09-13T03:00:07.593 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0 smithi089 running (2m) 65s ago 11m 93.7M 1557M 19.1.1-322-g7741f7f9 19dc8d659727 e8038f6d52b6 2024-09-13T03:00:07.593 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1 smithi089 running (105s) 65s ago 11m 94.5M 1557M 19.1.1-322-g7741f7f9 19dc8d659727 e174144d9633 2024-09-13T03:00:07.593 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2 smithi089 running (70s) 65s ago 11m 11.2M 1557M 19.1.1-322-g7741f7f9 19dc8d659727 2d8cab08c2b3 2024-09-13T03:00:07.593 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3 smithi131 running (35s) 0s ago 10m 104M 2581M 19.1.1-322-g7741f7f9 19dc8d659727 e77cff624869 2024-09-13T03:00:07.593 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4 smithi131 running (3s) 0s ago 10m 12.1M 2581M 19.1.1-322-g7741f7f9 19dc8d659727 0317e6a4a04c 2024-09-13T03:00:07.593 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5 smithi131 running (9m) 0s ago 9m 229M 2581M 17.2.7-1627-gbbdadfa3 a994b00deb3a ace4b45e5873 2024-09-13T03:00:07.593 INFO:teuthology.orchestra.run.smithi089.stdout:prometheus.smithi089 smithi089 *:9095 running (3m) 65s ago 13m 56.4M - 2.43.0 a07b618ecd1d 9d336370c187 2024-09-13T03:00:07.594 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.592+0000 7f7e1a79c640 1 -- 172.21.15.89:0/2034080982 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f7dfc06e530 msgr2=0x7f7dfc0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:07.594 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.592+0000 7f7e1a79c640 1 --2- 172.21.15.89:0/2034080982 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f7dfc06e530 0x7f7dfc0709e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7e0800b020 tx=0x7f7e08035040 comp rx=0 tx=0).stop 2024-09-13T03:00:07.594 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.592+0000 7f7e1a79c640 1 -- 172.21.15.89:0/2034080982 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e14065c40 msgr2=0x7f7e140fcab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:07.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.592+0000 7f7e1a79c640 1 --2- 172.21.15.89:0/2034080982 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e14065c40 0x7f7e140fcab0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f7e04002a80 tx=0x7f7e04004600 comp rx=0 tx=0).stop 2024-09-13T03:00:07.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.592+0000 7f7e1a79c640 1 -- 172.21.15.89:0/2034080982 shutdown_connections 2024-09-13T03:00:07.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.592+0000 7f7e1a79c640 1 --2- 172.21.15.89:0/2034080982 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f7dfc06e530 0x7f7dfc0709e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:07.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.592+0000 7f7e1a79c640 1 --2- 172.21.15.89:0/2034080982 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7e140ff680 0x7f7e140fb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:07.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.592+0000 7f7e1a79c640 1 --2- 172.21.15.89:0/2034080982 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7e14065c40 0x7f7e140fcab0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:07.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.592+0000 7f7e1a79c640 1 -- 172.21.15.89:0/2034080982 >> 172.21.15.89:0/2034080982 conn(0x7f7e140f6c10 msgr2=0x7f7e140f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:00:07.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.593+0000 7f7e1a79c640 1 -- 172.21.15.89:0/2034080982 shutdown_connections 2024-09-13T03:00:07.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.593+0000 7f7e1a79c640 1 -- 172.21.15.89:0/2034080982 wait complete. 2024-09-13T03:00:07.673 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.672+0000 7f1bb1747640 1 -- 172.21.15.89:0/4291024002 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1bac0fe4f0 msgr2=0x7f1bac0fa650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:07.674 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.672+0000 7f1bb1747640 1 --2- 172.21.15.89:0/4291024002 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1bac0fe4f0 0x7f1bac0fa650 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1b940048d0 tx=0x7f1b94009da0 comp rx=0 tx=0).stop 2024-09-13T03:00:07.674 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.672+0000 7f1bb1747640 1 -- 172.21.15.89:0/4291024002 shutdown_connections 2024-09-13T03:00:07.674 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.672+0000 7f1bb1747640 1 --2- 172.21.15.89:0/4291024002 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1bac0fe4f0 0x7f1bac0fa650 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:07.674 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.672+0000 7f1bb1747640 1 --2- 172.21.15.89:0/4291024002 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1bac0fdba0 0x7f1bac0fdfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:07.674 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.672+0000 7f1bb1747640 1 -- 172.21.15.89:0/4291024002 >> 172.21.15.89:0/4291024002 conn(0x7f1bac0f63a0 msgr2=0x7f1bac0f87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:00:07.674 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.672+0000 7f1bb1747640 1 -- 172.21.15.89:0/4291024002 shutdown_connections 2024-09-13T03:00:07.674 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.672+0000 7f1bb1747640 1 -- 172.21.15.89:0/4291024002 wait complete. 2024-09-13T03:00:07.676 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.673+0000 7f1bb1747640 1 Processor -- start 2024-09-13T03:00:07.676 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.673+0000 7f1bb1747640 1 -- start start 2024-09-13T03:00:07.676 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.673+0000 7f1bb1747640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1bac0fdba0 0x7f1bac10d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:07.676 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.673+0000 7f1bb1747640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1bac0fe4f0 0x7f1bac10d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:07.676 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.673+0000 7f1bb1747640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bac10dbf0 con 0x7f1bac0fdba0 2024-09-13T03:00:07.676 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.673+0000 7f1bb1747640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bac10e410 con 0x7f1bac0fe4f0 2024-09-13T03:00:07.676 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.673+0000 7f1baaffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1bac0fdba0 0x7f1bac10d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:00:07.676 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.673+0000 7f1baaffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1bac0fdba0 0x7f1bac10d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:44656/0 (socket says 172.21.15.89:44656) 2024-09-13T03:00:07.677 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.673+0000 7f1baaffd640 1 -- 172.21.15.89:0/667899492 learned_addr learned my addr 172.21.15.89:0/667899492 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T03:00:07.677 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.673+0000 7f1baa7fc640 1 --2- 172.21.15.89:0/667899492 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1bac0fe4f0 0x7f1bac10d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:00:07.677 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.673+0000 7f1baaffd640 1 -- 172.21.15.89:0/667899492 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1bac0fe4f0 msgr2=0x7f1bac10d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:07.677 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.673+0000 7f1baaffd640 1 --2- 172.21.15.89:0/667899492 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1bac0fe4f0 0x7f1bac10d5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:07.677 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.673+0000 7f1baaffd640 1 -- 172.21.15.89:0/667899492 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b94005040 con 0x7f1bac0fdba0 2024-09-13T03:00:07.677 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.674+0000 7f1baaffd640 1 --2- 172.21.15.89:0/667899492 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1bac0fdba0 0x7f1bac10d060 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1b9c002a80 tx=0x7f1b9c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:00:07.677 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.674+0000 7f1ba37fe640 1 -- 172.21.15.89:0/667899492 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1b9c007c30 con 0x7f1bac0fdba0 2024-09-13T03:00:07.677 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.674+0000 7f1bb1747640 1 -- 172.21.15.89:0/667899492 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bac10e6a0 con 0x7f1bac0fdba0 2024-09-13T03:00:07.677 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.674+0000 7f1ba37fe640 1 -- 172.21.15.89:0/667899492 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f1b9c00f040 con 0x7f1bac0fdba0 2024-09-13T03:00:07.677 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.674+0000 7f1bb1747640 1 -- 172.21.15.89:0/667899492 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bac10eb90 con 0x7f1bac0fdba0 2024-09-13T03:00:07.677 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.674+0000 7f1ba37fe640 1 -- 172.21.15.89:0/667899492 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1b9c00dab0 con 0x7f1bac0fdba0 2024-09-13T03:00:07.678 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.675+0000 7f1bb1747640 1 -- 172.21.15.89:0/667899492 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b8c005240 con 0x7f1bac0fdba0 2024-09-13T03:00:07.678 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.676+0000 7f1ba37fe640 1 -- 172.21.15.89:0/667899492 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f1b9c00dc10 con 0x7f1bac0fdba0 2024-09-13T03:00:07.678 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.676+0000 7f1ba37fe640 1 --2- 172.21.15.89:0/667899492 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f1b9806e530 0x7f1b980709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:07.678 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.676+0000 7f1ba37fe640 1 -- 172.21.15.89:0/667899492 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f1b9c08d910 con 0x7f1bac0fdba0 2024-09-13T03:00:07.678 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.676+0000 7f1baa7fc640 1 --2- 172.21.15.89:0/667899492 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f1b9806e530 0x7f1b980709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:00:07.678 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.677+0000 7f1baa7fc640 1 --2- 172.21.15.89:0/667899492 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f1b9806e530 0x7f1b980709e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1b94000c00 tx=0x7f1b94035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:00:07.682 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.681+0000 7f1ba37fe640 1 -- 172.21.15.89:0/667899492 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f1b9c056c10 con 0x7f1bac0fdba0 2024-09-13T03:00:07.921 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.920+0000 7f1bb1747640 1 -- 172.21.15.89:0/667899492 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f1b8c005d00 con 0x7f1bac0fdba0 2024-09-13T03:00:07.922 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.920+0000 7f1ba37fe640 1 -- 172.21.15.89:0/667899492 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+850 (secure 0 0 0) 0x7f1b9c05a2d0 con 0x7f1bac0fdba0 2024-09-13T03:00:07.922 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-13T03:00:07.922 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": { 2024-09-13T03:00:07.922 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 2 2024-09-13T03:00:07.922 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T03:00:07.922 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": { 2024-09-13T03:00:07.922 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 2 2024-09-13T03:00:07.922 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T03:00:07.923 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": { 2024-09-13T03:00:07.923 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 1, 2024-09-13T03:00:07.923 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 4 2024-09-13T03:00:07.923 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T03:00:07.923 INFO:teuthology.orchestra.run.smithi089.stdout: "mds": { 2024-09-13T03:00:07.923 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 4 2024-09-13T03:00:07.923 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T03:00:07.923 INFO:teuthology.orchestra.run.smithi089.stdout: "overall": { 2024-09-13T03:00:07.923 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 5, 2024-09-13T03:00:07.923 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 8 2024-09-13T03:00:07.923 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-13T03:00:07.923 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-13T03:00:07.924 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.923+0000 7f1bb1747640 1 -- 172.21.15.89:0/667899492 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f1b9806e530 msgr2=0x7f1b980709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:07.924 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.923+0000 7f1bb1747640 1 --2- 172.21.15.89:0/667899492 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f1b9806e530 0x7f1b980709e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f1b94000c00 tx=0x7f1b94035040 comp rx=0 tx=0).stop 2024-09-13T03:00:07.924 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.923+0000 7f1bb1747640 1 -- 172.21.15.89:0/667899492 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1bac0fdba0 msgr2=0x7f1bac10d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:07.924 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.923+0000 7f1bb1747640 1 --2- 172.21.15.89:0/667899492 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1bac0fdba0 0x7f1bac10d060 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f1b9c002a80 tx=0x7f1b9c004600 comp rx=0 tx=0).stop 2024-09-13T03:00:07.925 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:07 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:00:07.925 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:07 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:00:07.925 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:07 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:00:07.925 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:07 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:00:07.925 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.923+0000 7f1bb1747640 1 -- 172.21.15.89:0/667899492 shutdown_connections 2024-09-13T03:00:07.926 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.923+0000 7f1bb1747640 1 --2- 172.21.15.89:0/667899492 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f1b9806e530 0x7f1b980709e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:07.926 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.923+0000 7f1bb1747640 1 --2- 172.21.15.89:0/667899492 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1bac0fe4f0 0x7f1bac10d5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:07.926 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.923+0000 7f1bb1747640 1 --2- 172.21.15.89:0/667899492 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1bac0fdba0 0x7f1bac10d060 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:07.926 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.923+0000 7f1bb1747640 1 -- 172.21.15.89:0/667899492 >> 172.21.15.89:0/667899492 conn(0x7f1bac0f63a0 msgr2=0x7f1bac0f7b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:00:07.926 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.923+0000 7f1bb1747640 1 -- 172.21.15.89:0/667899492 shutdown_connections 2024-09-13T03:00:07.926 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:07.923+0000 7f1bb1747640 1 -- 172.21.15.89:0/667899492 wait complete. 2024-09-13T03:00:07.981 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:07 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:00:07.982 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:07 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:00:07.982 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:07 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:00:07.982 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:07 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:00:08.004 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.001+0000 7f52c05ce640 1 -- 172.21.15.89:0/1736989394 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f52b80fc700 msgr2=0x7f52b80fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:08.005 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.001+0000 7f52c05ce640 1 --2- 172.21.15.89:0/1736989394 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f52b80fc700 0x7f52b80fcb70 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f52b40048d0 tx=0x7f52b4009da0 comp rx=0 tx=0).stop 2024-09-13T03:00:08.005 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.001+0000 7f52c05ce640 1 -- 172.21.15.89:0/1736989394 shutdown_connections 2024-09-13T03:00:08.005 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.001+0000 7f52c05ce640 1 --2- 172.21.15.89:0/1736989394 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f52b80fc700 0x7f52b80fcb70 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:08.005 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.002+0000 7f52c05ce640 1 --2- 172.21.15.89:0/1736989394 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f52b80fb430 0x7f52b80fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:08.005 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.002+0000 7f52c05ce640 1 -- 172.21.15.89:0/1736989394 >> 172.21.15.89:0/1736989394 conn(0x7f52b80f6c10 msgr2=0x7f52b80f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:00:08.005 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.002+0000 7f52c05ce640 1 -- 172.21.15.89:0/1736989394 shutdown_connections 2024-09-13T03:00:08.005 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.002+0000 7f52c05ce640 1 -- 172.21.15.89:0/1736989394 wait complete. 2024-09-13T03:00:08.005 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.002+0000 7f52c05ce640 1 Processor -- start 2024-09-13T03:00:08.005 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.002+0000 7f52c05ce640 1 -- start start 2024-09-13T03:00:08.005 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.002+0000 7f52c05ce640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f52b80fb430 0x7f52b810d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:08.006 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.002+0000 7f52c05ce640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f52b80fc700 0x7f52b810d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:08.006 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.002+0000 7f52c05ce640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52b810dc10 con 0x7f52b80fb430 2024-09-13T03:00:08.006 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.002+0000 7f52c05ce640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52b810e430 con 0x7f52b80fc700 2024-09-13T03:00:08.006 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.002+0000 7f52be36a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f52b80fb430 0x7f52b810d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:00:08.006 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.002+0000 7f52be36a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f52b80fb430 0x7f52b810d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:44672/0 (socket says 172.21.15.89:44672) 2024-09-13T03:00:08.006 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.002+0000 7f52be36a640 1 -- 172.21.15.89:0/1889477075 learned_addr learned my addr 172.21.15.89:0/1889477075 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T03:00:08.006 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.002+0000 7f52bdb69640 1 --2- 172.21.15.89:0/1889477075 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f52b80fc700 0x7f52b810d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:00:08.006 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.003+0000 7f52be36a640 1 -- 172.21.15.89:0/1889477075 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f52b80fc700 msgr2=0x7f52b810d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:08.006 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.003+0000 7f52be36a640 1 --2- 172.21.15.89:0/1889477075 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f52b80fc700 0x7f52b810d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:08.006 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.003+0000 7f52be36a640 1 -- 172.21.15.89:0/1889477075 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52b4005040 con 0x7f52b80fb430 2024-09-13T03:00:08.006 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.003+0000 7f52be36a640 1 --2- 172.21.15.89:0/1889477075 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f52b80fb430 0x7f52b810d080 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f52ac002a50 tx=0x7f52ac004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:00:08.006 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.003+0000 7f52aaffd640 1 -- 172.21.15.89:0/1889477075 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f52ac007c30 con 0x7f52b80fb430 2024-09-13T03:00:08.006 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.003+0000 7f52aaffd640 1 -- 172.21.15.89:0/1889477075 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f52ac00f040 con 0x7f52b80fb430 2024-09-13T03:00:08.007 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.003+0000 7f52aaffd640 1 -- 172.21.15.89:0/1889477075 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f52ac00da10 con 0x7f52b80fb430 2024-09-13T03:00:08.007 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.003+0000 7f52c05ce640 1 -- 172.21.15.89:0/1889477075 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52b810e6c0 con 0x7f52b80fb430 2024-09-13T03:00:08.007 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.003+0000 7f52c05ce640 1 -- 172.21.15.89:0/1889477075 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52b810ec60 con 0x7f52b80fb430 2024-09-13T03:00:08.007 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.004+0000 7f52c05ce640 1 -- 172.21.15.89:0/1889477075 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52b80fa890 con 0x7f52b80fb430 2024-09-13T03:00:08.008 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.005+0000 7f52aaffd640 1 -- 172.21.15.89:0/1889477075 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f52ac00dbb0 con 0x7f52b80fb430 2024-09-13T03:00:08.008 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.005+0000 7f52aaffd640 1 --2- 172.21.15.89:0/1889477075 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f52a406e530 0x7f52a40709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:08.008 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.005+0000 7f52aaffd640 1 -- 172.21.15.89:0/1889477075 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f52ac08d8c0 con 0x7f52b80fb430 2024-09-13T03:00:08.008 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.005+0000 7f52bdb69640 1 --2- 172.21.15.89:0/1889477075 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f52a406e530 0x7f52a40709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:00:08.008 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.006+0000 7f52bdb69640 1 --2- 172.21.15.89:0/1889477075 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f52a406e530 0x7f52a40709e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f52b810ce30 tx=0x7f52b4035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:00:08.011 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.009+0000 7f52aaffd640 1 -- 172.21.15.89:0/1889477075 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f52ac056ae0 con 0x7f52b80fb430 2024-09-13T03:00:08.209 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.207+0000 7f52c05ce640 1 -- 172.21.15.89:0/1889477075 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f52b802aa40 con 0x7f52b80fb430 2024-09-13T03:00:08.209 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.207+0000 7f52aaffd640 1 -- 172.21.15.89:0/1889477075 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 23 v23) v1 ==== 76+0+1953 (secure 0 0 0) 0x7f52ac00de60 con 0x7f52b80fb430 2024-09-13T03:00:08.209 INFO:teuthology.orchestra.run.smithi089.stdout:e23 2024-09-13T03:00:08.209 INFO:teuthology.orchestra.run.smithi089.stdout:btime 2024-09-13T02:58:04:980780+0000 2024-09-13T03:00:08.209 INFO:teuthology.orchestra.run.smithi089.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T03:00:08.209 INFO:teuthology.orchestra.run.smithi089.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T03:00:08.209 INFO:teuthology.orchestra.run.smithi089.stdout:legacy client fscid: 1 2024-09-13T03:00:08.210 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T03:00:08.210 INFO:teuthology.orchestra.run.smithi089.stdout:Filesystem 'cephfs' (1) 2024-09-13T03:00:08.210 INFO:teuthology.orchestra.run.smithi089.stdout:fs_name cephfs 2024-09-13T03:00:08.210 INFO:teuthology.orchestra.run.smithi089.stdout:epoch 23 2024-09-13T03:00:08.210 INFO:teuthology.orchestra.run.smithi089.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T03:00:08.210 INFO:teuthology.orchestra.run.smithi089.stdout:created 2024-09-13T02:51:40.657817+0000 2024-09-13T03:00:08.210 INFO:teuthology.orchestra.run.smithi089.stdout:modified 2024-09-13T02:58:04.067950+0000 2024-09-13T03:00:08.210 INFO:teuthology.orchestra.run.smithi089.stdout:tableserver 0 2024-09-13T03:00:08.210 INFO:teuthology.orchestra.run.smithi089.stdout:root 0 2024-09-13T03:00:08.210 INFO:teuthology.orchestra.run.smithi089.stdout:session_timeout 60 2024-09-13T03:00:08.210 INFO:teuthology.orchestra.run.smithi089.stdout:session_autoclose 300 2024-09-13T03:00:08.210 INFO:teuthology.orchestra.run.smithi089.stdout:max_file_size 1099511627776 2024-09-13T03:00:08.210 INFO:teuthology.orchestra.run.smithi089.stdout:max_xattr_size 65536 2024-09-13T03:00:08.210 INFO:teuthology.orchestra.run.smithi089.stdout:required_client_features {} 2024-09-13T03:00:08.211 INFO:teuthology.orchestra.run.smithi089.stdout:last_failure 0 2024-09-13T03:00:08.211 INFO:teuthology.orchestra.run.smithi089.stdout:last_failure_osd_epoch 44 2024-09-13T03:00:08.211 INFO:teuthology.orchestra.run.smithi089.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T03:00:08.211 INFO:teuthology.orchestra.run.smithi089.stdout:max_mds 2 2024-09-13T03:00:08.211 INFO:teuthology.orchestra.run.smithi089.stdout:in 0,1 2024-09-13T03:00:08.211 INFO:teuthology.orchestra.run.smithi089.stdout:up {0=14480,1=24257} 2024-09-13T03:00:08.211 INFO:teuthology.orchestra.run.smithi089.stdout:failed 2024-09-13T03:00:08.211 INFO:teuthology.orchestra.run.smithi089.stdout:damaged 2024-09-13T03:00:08.211 INFO:teuthology.orchestra.run.smithi089.stdout:stopped 2024-09-13T03:00:08.211 INFO:teuthology.orchestra.run.smithi089.stdout:data_pools [3] 2024-09-13T03:00:08.211 INFO:teuthology.orchestra.run.smithi089.stdout:metadata_pool 2 2024-09-13T03:00:08.212 INFO:teuthology.orchestra.run.smithi089.stdout:inline_data disabled 2024-09-13T03:00:08.212 INFO:teuthology.orchestra.run.smithi089.stdout:balancer 2024-09-13T03:00:08.212 INFO:teuthology.orchestra.run.smithi089.stdout:bal_rank_mask -1 2024-09-13T03:00:08.212 INFO:teuthology.orchestra.run.smithi089.stdout:standby_count_wanted 1 2024-09-13T03:00:08.212 INFO:teuthology.orchestra.run.smithi089.stdout:qdb_cluster leader: 14480 members: 24257,14480 2024-09-13T03:00:08.212 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi089.rarddb{0:14480} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.89:6828/1561365213,v1:172.21.15.89:6829/1561365213] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T03:00:08.212 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi089.qjoitb{0:14488} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.89:6826/1464393547,v1:172.21.15.89:6827/1464393547] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T03:00:08.212 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi131.uasrkg{1:24257} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.131:6824/260493836,v1:172.21.15.131:6825/260493836] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T03:00:08.212 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi131.rbovzc{1:24265} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.131:6826/665579373,v1:172.21.15.131:6827/665579373] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T03:00:08.212 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T03:00:08.212 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T03:00:08.213 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 23 2024-09-13T03:00:08.213 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.210+0000 7f52c05ce640 1 -- 172.21.15.89:0/1889477075 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f52a406e530 msgr2=0x7f52a40709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:08.213 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.210+0000 7f52c05ce640 1 --2- 172.21.15.89:0/1889477075 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f52a406e530 0x7f52a40709e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f52b810ce30 tx=0x7f52b4035040 comp rx=0 tx=0).stop 2024-09-13T03:00:08.213 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.210+0000 7f52c05ce640 1 -- 172.21.15.89:0/1889477075 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f52b80fb430 msgr2=0x7f52b810d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:08.213 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.210+0000 7f52c05ce640 1 --2- 172.21.15.89:0/1889477075 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f52b80fb430 0x7f52b810d080 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f52ac002a50 tx=0x7f52ac004600 comp rx=0 tx=0).stop 2024-09-13T03:00:08.213 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.210+0000 7f52c05ce640 1 -- 172.21.15.89:0/1889477075 shutdown_connections 2024-09-13T03:00:08.213 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.210+0000 7f52c05ce640 1 --2- 172.21.15.89:0/1889477075 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f52a406e530 0x7f52a40709e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:08.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.210+0000 7f52c05ce640 1 --2- 172.21.15.89:0/1889477075 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f52b80fc700 0x7f52b810d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:08.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.210+0000 7f52c05ce640 1 --2- 172.21.15.89:0/1889477075 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f52b80fb430 0x7f52b810d080 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:08.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.210+0000 7f52c05ce640 1 -- 172.21.15.89:0/1889477075 >> 172.21.15.89:0/1889477075 conn(0x7f52b80f6c10 msgr2=0x7f52b8065550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:00:08.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.211+0000 7f52c05ce640 1 -- 172.21.15.89:0/1889477075 shutdown_connections 2024-09-13T03:00:08.214 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.211+0000 7f52c05ce640 1 -- 172.21.15.89:0/1889477075 wait complete. 2024-09-13T03:00:08.290 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.289+0000 7fef4ef66640 1 -- 172.21.15.89:0/3289117601 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef480fc550 msgr2=0x7fef480fc960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:08.291 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.289+0000 7fef4ef66640 1 --2- 172.21.15.89:0/3289117601 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef480fc550 0x7fef480fc960 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fef3c0048d0 tx=0x7fef3c009da0 comp rx=0 tx=0).stop 2024-09-13T03:00:08.291 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.289+0000 7fef4ef66640 1 -- 172.21.15.89:0/3289117601 shutdown_connections 2024-09-13T03:00:08.291 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.289+0000 7fef4ef66640 1 --2- 172.21.15.89:0/3289117601 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fef480fd820 0x7fef480fdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:08.291 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.289+0000 7fef4ef66640 1 --2- 172.21.15.89:0/3289117601 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef480fc550 0x7fef480fc960 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:08.291 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.289+0000 7fef4ef66640 1 -- 172.21.15.89:0/3289117601 >> 172.21.15.89:0/3289117601 conn(0x7fef480f7d30 msgr2=0x7fef480fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:00:08.291 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.289+0000 7fef4ef66640 1 -- 172.21.15.89:0/3289117601 shutdown_connections 2024-09-13T03:00:08.291 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.289+0000 7fef4ef66640 1 -- 172.21.15.89:0/3289117601 wait complete. 2024-09-13T03:00:08.291 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.289+0000 7fef4ef66640 1 Processor -- start 2024-09-13T03:00:08.291 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.289+0000 7fef4ef66640 1 -- start start 2024-09-13T03:00:08.293 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.290+0000 7fef4ef66640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef480fc550 0x7fef4810d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:08.293 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.290+0000 7fef4ef66640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fef480fd820 0x7fef4810d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:08.293 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.290+0000 7fef4ef66640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef4810dc10 con 0x7fef480fc550 2024-09-13T03:00:08.293 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.290+0000 7fef4ef66640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef4810e430 con 0x7fef480fd820 2024-09-13T03:00:08.293 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.290+0000 7fef4cd02640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef480fc550 0x7fef4810d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:00:08.293 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.290+0000 7fef4cd02640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef480fc550 0x7fef4810d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:44694/0 (socket says 172.21.15.89:44694) 2024-09-13T03:00:08.293 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.290+0000 7fef4cd02640 1 -- 172.21.15.89:0/2281669670 learned_addr learned my addr 172.21.15.89:0/2281669670 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T03:00:08.293 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.290+0000 7fef47fff640 1 --2- 172.21.15.89:0/2281669670 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fef480fd820 0x7fef4810d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:00:08.293 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.290+0000 7fef4cd02640 1 -- 172.21.15.89:0/2281669670 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fef480fd820 msgr2=0x7fef4810d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:08.293 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.290+0000 7fef4cd02640 1 --2- 172.21.15.89:0/2281669670 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fef480fd820 0x7fef4810d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:08.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.290+0000 7fef4cd02640 1 -- 172.21.15.89:0/2281669670 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef3c005040 con 0x7fef480fc550 2024-09-13T03:00:08.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.290+0000 7fef4cd02640 1 --2- 172.21.15.89:0/2281669670 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef480fc550 0x7fef4810d080 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fef3c003080 tx=0x7fef3c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:00:08.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.291+0000 7fef457fa640 1 -- 172.21.15.89:0/2281669670 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef3c038070 con 0x7fef480fc550 2024-09-13T03:00:08.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.291+0000 7fef4ef66640 1 -- 172.21.15.89:0/2281669670 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef4810e660 con 0x7fef480fc550 2024-09-13T03:00:08.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.291+0000 7fef457fa640 1 -- 172.21.15.89:0/2281669670 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fef3c009800 con 0x7fef480fc550 2024-09-13T03:00:08.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.291+0000 7fef457fa640 1 -- 172.21.15.89:0/2281669670 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef3c033660 con 0x7fef480fc550 2024-09-13T03:00:08.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.291+0000 7fef4ef66640 1 -- 172.21.15.89:0/2281669670 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef4810eba0 con 0x7fef480fc550 2024-09-13T03:00:08.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.292+0000 7fef4ef66640 1 -- 172.21.15.89:0/2281669670 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef480fb9b0 con 0x7fef480fc550 2024-09-13T03:00:08.295 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.292+0000 7fef457fa640 1 -- 172.21.15.89:0/2281669670 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fef3c030020 con 0x7fef480fc550 2024-09-13T03:00:08.295 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.293+0000 7fef457fa640 1 --2- 172.21.15.89:0/2281669670 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fef3806e530 0x7fef380709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:08.295 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.293+0000 7fef457fa640 1 -- 172.21.15.89:0/2281669670 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fef3c0ae240 con 0x7fef480fc550 2024-09-13T03:00:08.295 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.293+0000 7fef47fff640 1 --2- 172.21.15.89:0/2281669670 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fef3806e530 0x7fef380709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:00:08.295 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.293+0000 7fef47fff640 1 --2- 172.21.15.89:0/2281669670 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fef3806e530 0x7fef380709e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fef4810ce30 tx=0x7fef34009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:00:08.298 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.297+0000 7fef457fa640 1 -- 172.21.15.89:0/2281669670 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fef3c0773e0 con 0x7fef480fc550 2024-09-13T03:00:08.479 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.478+0000 7fef4ef66640 1 -- 172.21.15.89:0/2281669670 --> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fef4810eed0 con 0x7fef3806e530 2024-09-13T03:00:08.480 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.479+0000 7fef457fa640 1 -- 172.21.15.89:0/2281669670 <== mgr.34104 v2:172.21.15.89:6800/1881577856 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fef4810eed0 con 0x7fef3806e530 2024-09-13T03:00:08.481 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-13T03:00:08.481 INFO:teuthology.orchestra.run.smithi089.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d", 2024-09-13T03:00:08.481 INFO:teuthology.orchestra.run.smithi089.stdout: "in_progress": true, 2024-09-13T03:00:08.481 INFO:teuthology.orchestra.run.smithi089.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T03:00:08.481 INFO:teuthology.orchestra.run.smithi089.stdout: "services_complete": [ 2024-09-13T03:00:08.481 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr", 2024-09-13T03:00:08.481 INFO:teuthology.orchestra.run.smithi089.stdout: "crash", 2024-09-13T03:00:08.481 INFO:teuthology.orchestra.run.smithi089.stdout: "mon" 2024-09-13T03:00:08.481 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-13T03:00:08.481 INFO:teuthology.orchestra.run.smithi089.stdout: "progress": "11/21 daemons upgraded", 2024-09-13T03:00:08.481 INFO:teuthology.orchestra.run.smithi089.stdout: "message": "Currently upgrading osd daemons", 2024-09-13T03:00:08.482 INFO:teuthology.orchestra.run.smithi089.stdout: "is_paused": false 2024-09-13T03:00:08.482 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-13T03:00:08.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.481+0000 7fef4ef66640 1 -- 172.21.15.89:0/2281669670 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fef3806e530 msgr2=0x7fef380709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:08.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.481+0000 7fef4ef66640 1 --2- 172.21.15.89:0/2281669670 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fef3806e530 0x7fef380709e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fef4810ce30 tx=0x7fef34009040 comp rx=0 tx=0).stop 2024-09-13T03:00:08.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.481+0000 7fef4ef66640 1 -- 172.21.15.89:0/2281669670 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef480fc550 msgr2=0x7fef4810d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:08.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.481+0000 7fef4ef66640 1 --2- 172.21.15.89:0/2281669670 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef480fc550 0x7fef4810d080 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fef3c003080 tx=0x7fef3c009da0 comp rx=0 tx=0).stop 2024-09-13T03:00:08.483 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.482+0000 7fef4ef66640 1 -- 172.21.15.89:0/2281669670 shutdown_connections 2024-09-13T03:00:08.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.482+0000 7fef4ef66640 1 --2- 172.21.15.89:0/2281669670 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fef3806e530 0x7fef380709e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:08.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.482+0000 7fef4ef66640 1 --2- 172.21.15.89:0/2281669670 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fef480fd820 0x7fef4810d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:08.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.482+0000 7fef4ef66640 1 --2- 172.21.15.89:0/2281669670 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fef480fc550 0x7fef4810d080 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:08.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.482+0000 7fef4ef66640 1 -- 172.21.15.89:0/2281669670 >> 172.21.15.89:0/2281669670 conn(0x7fef480f7d30 msgr2=0x7fef480f9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:00:08.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.482+0000 7fef4ef66640 1 -- 172.21.15.89:0/2281669670 shutdown_connections 2024-09-13T03:00:08.484 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.482+0000 7fef4ef66640 1 -- 172.21.15.89:0/2281669670 wait complete. 2024-09-13T03:00:08.563 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.559+0000 7f90e640c640 1 -- 172.21.15.89:0/1578376555 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f90e00fc550 msgr2=0x7f90e00fc960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:08.563 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.559+0000 7f90e640c640 1 --2- 172.21.15.89:0/1578376555 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f90e00fc550 0x7f90e00fc960 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f90d00048d0 tx=0x7f90d0009da0 comp rx=0 tx=0).stop 2024-09-13T03:00:08.563 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.559+0000 7f90e640c640 1 -- 172.21.15.89:0/1578376555 shutdown_connections 2024-09-13T03:00:08.563 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.559+0000 7f90e640c640 1 --2- 172.21.15.89:0/1578376555 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f90e00fd820 0x7f90e00fdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:08.563 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.559+0000 7f90e640c640 1 --2- 172.21.15.89:0/1578376555 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f90e00fc550 0x7f90e00fc960 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:08.563 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.559+0000 7f90e640c640 1 -- 172.21.15.89:0/1578376555 >> 172.21.15.89:0/1578376555 conn(0x7f90e00f7d30 msgr2=0x7f90e00fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:00:08.563 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.559+0000 7f90e640c640 1 -- 172.21.15.89:0/1578376555 shutdown_connections 2024-09-13T03:00:08.563 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.559+0000 7f90e640c640 1 -- 172.21.15.89:0/1578376555 wait complete. 2024-09-13T03:00:08.563 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.560+0000 7f90e640c640 1 Processor -- start 2024-09-13T03:00:08.564 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.560+0000 7f90e640c640 1 -- start start 2024-09-13T03:00:08.564 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.560+0000 7f90e640c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f90e00fc550 0x7f90e010d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:08.564 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.560+0000 7f90e640c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f90e00fd820 0x7f90e010d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:08.564 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.560+0000 7f90e640c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90e010dc10 con 0x7f90e00fd820 2024-09-13T03:00:08.564 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.560+0000 7f90e640c640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90e010e430 con 0x7f90e00fc550 2024-09-13T03:00:08.564 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.560+0000 7f90df7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f90e00fd820 0x7f90e010d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:00:08.564 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.560+0000 7f90df7fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f90e00fd820 0x7f90e010d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:44706/0 (socket says 172.21.15.89:44706) 2024-09-13T03:00:08.564 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.560+0000 7f90df7fe640 1 -- 172.21.15.89:0/207499174 learned_addr learned my addr 172.21.15.89:0/207499174 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T03:00:08.564 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.560+0000 7f90dffff640 1 --2- 172.21.15.89:0/207499174 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f90e00fc550 0x7f90e010d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:00:08.564 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.561+0000 7f90df7fe640 1 -- 172.21.15.89:0/207499174 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f90e00fc550 msgr2=0x7f90e010d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:08.564 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.561+0000 7f90df7fe640 1 --2- 172.21.15.89:0/207499174 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f90e00fc550 0x7f90e010d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:08.564 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.561+0000 7f90df7fe640 1 -- 172.21.15.89:0/207499174 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90d0005040 con 0x7f90e00fd820 2024-09-13T03:00:08.565 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.561+0000 7f90df7fe640 1 --2- 172.21.15.89:0/207499174 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f90e00fd820 0x7f90e010d5c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f90d4002a80 tx=0x7f90d4004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:00:08.565 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.561+0000 7f90dcff9640 1 -- 172.21.15.89:0/207499174 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f90d4007c30 con 0x7f90e00fd820 2024-09-13T03:00:08.565 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.561+0000 7f90e640c640 1 -- 172.21.15.89:0/207499174 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90e010e6c0 con 0x7f90e00fd820 2024-09-13T03:00:08.565 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.561+0000 7f90dcff9640 1 -- 172.21.15.89:0/207499174 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f90d400f040 con 0x7f90e00fd820 2024-09-13T03:00:08.565 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.561+0000 7f90dcff9640 1 -- 172.21.15.89:0/207499174 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f90d400dab0 con 0x7f90e00fd820 2024-09-13T03:00:08.565 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.561+0000 7f90e640c640 1 -- 172.21.15.89:0/207499174 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90e010ebe0 con 0x7f90e00fd820 2024-09-13T03:00:08.566 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.562+0000 7f90e640c640 1 -- 172.21.15.89:0/207499174 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90e00fb9b0 con 0x7f90e00fd820 2024-09-13T03:00:08.566 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.562+0000 7f90dcff9640 1 -- 172.21.15.89:0/207499174 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f90d400dc10 con 0x7f90e00fd820 2024-09-13T03:00:08.566 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.563+0000 7f90dcff9640 1 --2- 172.21.15.89:0/207499174 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f90c806e530 0x7f90c80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:08.566 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.563+0000 7f90dffff640 1 --2- 172.21.15.89:0/207499174 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f90c806e530 0x7f90c80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:00:08.566 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.563+0000 7f90dcff9640 1 -- 172.21.15.89:0/207499174 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f90d408d9f0 con 0x7f90e00fd820 2024-09-13T03:00:08.566 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.564+0000 7f90dffff640 1 --2- 172.21.15.89:0/207499174 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f90c806e530 0x7f90c80709e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f90d000b020 tx=0x7f90d0035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:00:08.569 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.567+0000 7f90dcff9640 1 -- 172.21.15.89:0/207499174 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f90d4056b90 con 0x7f90e00fd820 2024-09-13T03:00:08.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:08 smithi089 ceph-mon[91553]: from='client.34316 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T03:00:08.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:08 smithi089 ceph-mon[91553]: from='client.34320 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T03:00:08.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:08 smithi089 ceph-mon[91553]: pgmap v131: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 306 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 60/357 objects degraded (16.807%) 2024-09-13T03:00:08.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:08 smithi089 ceph-mon[91553]: from='client.34324 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T03:00:08.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:08 smithi089 ceph-mon[91553]: from='client.? 172.21.15.89:0/667899492' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:00:08.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:08 smithi089 ceph-mon[91553]: from='client.? 172.21.15.89:0/1889477075' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T03:00:08.800 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.799+0000 7f90e640c640 1 -- 172.21.15.89:0/207499174 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f90e010ef00 con 0x7f90e00fd820 2024-09-13T03:00:08.800 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.799+0000 7f90dcff9640 1 -- 172.21.15.89:0/207499174 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1162 (secure 0 0 0) 0x7f90d405a250 con 0x7f90e00fd820 2024-09-13T03:00:08.801 INFO:teuthology.orchestra.run.smithi089.stdout:HEALTH_WARN 1 osds down; Degraded data redundancy: 60/357 objects degraded (16.807%), 16 pgs degraded 2024-09-13T03:00:08.801 INFO:teuthology.orchestra.run.smithi089.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-13T03:00:08.801 INFO:teuthology.orchestra.run.smithi089.stdout: osd.4 (root=default,host=smithi131) is down 2024-09-13T03:00:08.801 INFO:teuthology.orchestra.run.smithi089.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 60/357 objects degraded (16.807%), 16 pgs degraded 2024-09-13T03:00:08.801 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.4 is active+undersized+degraded, acting [1,0] 2024-09-13T03:00:08.801 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.5 is active+undersized+degraded, acting [3,0] 2024-09-13T03:00:08.801 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.6 is active+undersized+degraded, acting [1,3] 2024-09-13T03:00:08.801 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.7 is active+undersized+degraded, acting [3,2] 2024-09-13T03:00:08.801 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.9 is active+undersized+degraded, acting [1,0] 2024-09-13T03:00:08.801 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.a is active+undersized+degraded, acting [1,3] 2024-09-13T03:00:08.801 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.b is active+undersized+degraded, acting [3,5] 2024-09-13T03:00:08.801 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.f is active+undersized+degraded, acting [0,5] 2024-09-13T03:00:08.802 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.11 is active+undersized+degraded, acting [3,1] 2024-09-13T03:00:08.802 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.13 is active+undersized+degraded, acting [0,2] 2024-09-13T03:00:08.802 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.14 is active+undersized+degraded, acting [3,5] 2024-09-13T03:00:08.802 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.18 is active+undersized+degraded, acting [5,3] 2024-09-13T03:00:08.802 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.19 is active+undersized+degraded, acting [0,2] 2024-09-13T03:00:08.802 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.1a is active+undersized+degraded, acting [3,5] 2024-09-13T03:00:08.802 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.1c is active+undersized+degraded, acting [5,2] 2024-09-13T03:00:08.802 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.1f is active+undersized+degraded, acting [0,3] 2024-09-13T03:00:08.803 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.801+0000 7f90e640c640 1 -- 172.21.15.89:0/207499174 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f90c806e530 msgr2=0x7f90c80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:08.803 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.801+0000 7f90e640c640 1 --2- 172.21.15.89:0/207499174 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f90c806e530 0x7f90c80709e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f90d000b020 tx=0x7f90d0035040 comp rx=0 tx=0).stop 2024-09-13T03:00:08.803 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.801+0000 7f90e640c640 1 -- 172.21.15.89:0/207499174 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f90e00fd820 msgr2=0x7f90e010d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:08.803 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.801+0000 7f90e640c640 1 --2- 172.21.15.89:0/207499174 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f90e00fd820 0x7f90e010d5c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f90d4002a80 tx=0x7f90d4004600 comp rx=0 tx=0).stop 2024-09-13T03:00:08.803 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.801+0000 7f90e640c640 1 -- 172.21.15.89:0/207499174 shutdown_connections 2024-09-13T03:00:08.803 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.801+0000 7f90e640c640 1 --2- 172.21.15.89:0/207499174 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f90c806e530 0x7f90c80709e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:08.803 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.801+0000 7f90e640c640 1 --2- 172.21.15.89:0/207499174 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f90e00fd820 0x7f90e010d5c0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:08.803 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.801+0000 7f90e640c640 1 --2- 172.21.15.89:0/207499174 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f90e00fc550 0x7f90e010d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:08.803 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.801+0000 7f90e640c640 1 -- 172.21.15.89:0/207499174 >> 172.21.15.89:0/207499174 conn(0x7f90e00f7d30 msgr2=0x7f90e00f9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:00:08.804 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.801+0000 7f90e640c640 1 -- 172.21.15.89:0/207499174 shutdown_connections 2024-09-13T03:00:08.804 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:08.801+0000 7f90e640c640 1 -- 172.21.15.89:0/207499174 wait complete. 2024-09-13T03:00:09.099 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:08 smithi131 ceph-mon[78839]: from='client.34316 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T03:00:09.100 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:08 smithi131 ceph-mon[78839]: from='client.34320 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T03:00:09.100 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:08 smithi131 ceph-mon[78839]: pgmap v131: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 306 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 60/357 objects degraded (16.807%) 2024-09-13T03:00:09.100 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:08 smithi131 ceph-mon[78839]: from='client.34324 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T03:00:09.100 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:08 smithi131 ceph-mon[78839]: from='client.? 172.21.15.89:0/667899492' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:00:09.100 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:08 smithi131 ceph-mon[78839]: from='client.? 172.21.15.89:0/1889477075' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T03:00:10.001 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:09 smithi131 ceph-mon[78839]: from='client.34336 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T03:00:10.002 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:09 smithi131 ceph-mon[78839]: from='client.? 172.21.15.89:0/207499174' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T03:00:10.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:09 smithi089 ceph-mon[91553]: from='client.34336 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T03:00:10.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:09 smithi089 ceph-mon[91553]: from='client.? 172.21.15.89:0/207499174' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T03:00:10.811 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:10 smithi131 ceph-mon[78839]: pgmap v132: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 306 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 60/357 objects degraded (16.807%) 2024-09-13T03:00:10.977 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:10 smithi089 ceph-mon[91553]: pgmap v132: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 306 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 60/357 objects degraded (16.807%) 2024-09-13T03:00:12.184 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 13 03:00:12 smithi131 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-4[93514]: 2024-09-13T03:00:12.003+0000 7efeb1e81640 -1 osd.4 67 log_to_monitors true 2024-09-13T03:00:12.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:11 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:00:12.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:11 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:00:12.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:11 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T03:00:12.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:11 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T03:00:12.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:11 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:00:12.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:11 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:00:12.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:11 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:00:12.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:11 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:00:12.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:11 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:00:12.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:11 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-13T03:00:12.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:11 smithi131 ceph-mon[78839]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-13T03:00:12.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:11 smithi131 ceph-mon[78839]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-13T03:00:12.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:11 smithi131 ceph-mon[78839]: pgmap v133: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 306 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 60/357 objects degraded (16.807%) 2024-09-13T03:00:12.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:11 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:00:12.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:11 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:00:12.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:11 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T03:00:12.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:11 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T03:00:12.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:11 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:00:12.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:11 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:00:12.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:11 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:00:12.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:11 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:00:12.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:11 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:00:12.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:11 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-13T03:00:12.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:11 smithi089 ceph-mon[91553]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-13T03:00:12.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:11 smithi089 ceph-mon[91553]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-09-13T03:00:12.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:11 smithi089 ceph-mon[91553]: pgmap v133: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 306 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s; 60/357 objects degraded (16.807%) 2024-09-13T03:00:13.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:12 smithi131 ceph-mon[78839]: from='osd.4 [v2:172.21.15.131:6808/2184236575,v1:172.21.15.131:6809/2184236575]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T03:00:13.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:12 smithi131 ceph-mon[78839]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T03:00:13.184 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 13 03:00:12 smithi131 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-4[93514]: 2024-09-13T03:00:12.887+0000 7efea9c1b640 -1 osd.4 67 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T03:00:13.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:12 smithi089 ceph-mon[91553]: from='osd.4 [v2:172.21.15.131:6808/2184236575,v1:172.21.15.131:6809/2184236575]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T03:00:13.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:12 smithi089 ceph-mon[91553]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-13T03:00:14.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:13 smithi131 ceph-mon[78839]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-13T03:00:14.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:13 smithi131 ceph-mon[78839]: osdmap e70: 6 total, 5 up, 6 in 2024-09-13T03:00:14.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:13 smithi131 ceph-mon[78839]: from='osd.4 [v2:172.21.15.131:6808/2184236575,v1:172.21.15.131:6809/2184236575]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]: dispatch 2024-09-13T03:00:14.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:13 smithi131 ceph-mon[78839]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]: dispatch 2024-09-13T03:00:14.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:13 smithi131 ceph-mon[78839]: pgmap v135: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 306 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s; 60/357 objects degraded (16.807%) 2024-09-13T03:00:14.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:13 smithi089 ceph-mon[91553]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-13T03:00:14.288 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:13 smithi089 ceph-mon[91553]: osdmap e70: 6 total, 5 up, 6 in 2024-09-13T03:00:14.288 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:13 smithi089 ceph-mon[91553]: from='osd.4 [v2:172.21.15.131:6808/2184236575,v1:172.21.15.131:6809/2184236575]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]: dispatch 2024-09-13T03:00:14.288 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:13 smithi089 ceph-mon[91553]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]: dispatch 2024-09-13T03:00:14.288 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:13 smithi089 ceph-mon[91553]: pgmap v135: 65 pgs: 18 active+undersized, 16 active+undersized+degraded, 31 active+clean; 306 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.0 KiB/s rd, 3 op/s; 60/357 objects degraded (16.807%) 2024-09-13T03:00:15.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:14 smithi131 ceph-mon[78839]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T03:00:15.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:14 smithi131 ceph-mon[78839]: osd.4 [v2:172.21.15.131:6808/2184236575,v1:172.21.15.131:6809/2184236575] boot 2024-09-13T03:00:15.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:14 smithi131 ceph-mon[78839]: osdmap e71: 6 total, 6 up, 6 in 2024-09-13T03:00:15.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:14 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T03:00:15.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:14 smithi131 ceph-mon[78839]: osdmap e72: 6 total, 6 up, 6 in 2024-09-13T03:00:15.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:14 smithi089 ceph-mon[91553]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T03:00:15.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:14 smithi089 ceph-mon[91553]: osd.4 [v2:172.21.15.131:6808/2184236575,v1:172.21.15.131:6809/2184236575] boot 2024-09-13T03:00:15.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:14 smithi089 ceph-mon[91553]: osdmap e71: 6 total, 6 up, 6 in 2024-09-13T03:00:15.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:14 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-13T03:00:15.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:14 smithi089 ceph-mon[91553]: osdmap e72: 6 total, 6 up, 6 in 2024-09-13T03:00:16.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:15 smithi131 ceph-mon[78839]: pgmap v138: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 306 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s; 48/357 objects degraded (13.445%) 2024-09-13T03:00:16.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:15 smithi089 ceph-mon[91553]: pgmap v138: 65 pgs: 14 active+undersized, 13 active+undersized+degraded, 38 active+clean; 306 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 4 op/s; 48/357 objects degraded (13.445%) 2024-09-13T03:00:17.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:16 smithi131 ceph-mon[78839]: Health check update: Degraded data redundancy: 48/357 objects degraded (13.445%), 13 pgs degraded (PG_DEGRADED) 2024-09-13T03:00:17.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:16 smithi089 ceph-mon[91553]: Health check update: Degraded data redundancy: 48/357 objects degraded (13.445%), 13 pgs degraded (PG_DEGRADED) 2024-09-13T03:00:18.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:17 smithi131 ceph-mon[78839]: pgmap v139: 65 pgs: 3 active+undersized, 3 active+undersized+degraded, 59 active+clean; 306 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 2 op/s; 7/357 objects degraded (1.961%) 2024-09-13T03:00:18.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:17 smithi089 ceph-mon[91553]: pgmap v139: 65 pgs: 3 active+undersized, 3 active+undersized+degraded, 59 active+clean; 306 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.5 KiB/s rd, 2 op/s; 7/357 objects degraded (1.961%) 2024-09-13T03:00:20.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:19 smithi089 ceph-mon[91553]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 7/357 objects degraded (1.961%), 3 pgs degraded) 2024-09-13T03:00:20.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:19 smithi089 ceph-mon[91553]: Cluster is now healthy 2024-09-13T03:00:20.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:19 smithi131 ceph-mon[78839]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 7/357 objects degraded (1.961%), 3 pgs degraded) 2024-09-13T03:00:20.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:19 smithi131 ceph-mon[78839]: Cluster is now healthy 2024-09-13T03:00:21.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:20 smithi089 ceph-mon[91553]: pgmap v140: 65 pgs: 65 active+clean; 306 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s 2024-09-13T03:00:21.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:20 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:00:21.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:20 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:00:21.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:20 smithi131 ceph-mon[78839]: pgmap v140: 65 pgs: 65 active+clean; 306 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.3 KiB/s rd, 2 op/s 2024-09-13T03:00:21.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:20 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:00:21.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:20 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:00:23.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:22 smithi089 ceph-mon[91553]: pgmap v141: 65 pgs: 65 active+clean; 306 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 4 op/s 2024-09-13T03:00:23.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:22 smithi131 ceph-mon[78839]: pgmap v141: 65 pgs: 65 active+clean; 306 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 4 op/s 2024-09-13T03:00:24.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:24 smithi089 ceph-mon[91553]: pgmap v142: 65 pgs: 65 active+clean; 306 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s 2024-09-13T03:00:25.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:24 smithi131 ceph-mon[78839]: pgmap v142: 65 pgs: 65 active+clean; 306 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s 2024-09-13T03:00:26.918 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:26 smithi131 ceph-mon[78839]: pgmap v143: 65 pgs: 65 active+clean; 306 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T03:00:26.918 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:26 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:00:26.918 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:26 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-13T03:00:27.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:26 smithi089 ceph-mon[91553]: pgmap v143: 65 pgs: 65 active+clean; 306 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T03:00:27.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:26 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:00:27.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:26 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-13T03:00:27.860 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:27 smithi131 ceph-mon[78839]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-13T03:00:27.860 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:27 smithi131 ceph-mon[78839]: Upgrade: osd.5 is safe to restart 2024-09-13T03:00:27.860 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:27 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:00:27.860 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:27 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-13T03:00:27.860 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:27 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T03:00:28.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:27 smithi089 ceph-mon[91553]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-09-13T03:00:28.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:27 smithi089 ceph-mon[91553]: Upgrade: osd.5 is safe to restart 2024-09-13T03:00:28.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:27 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:00:28.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:27 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-13T03:00:28.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:27 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T03:00:28.920 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:28 smithi131 ceph-mon[78839]: Upgrade: Updating osd.5 2024-09-13T03:00:28.921 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:28 smithi131 ceph-mon[78839]: Deploying daemon osd.5 on smithi131 2024-09-13T03:00:28.921 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:28 smithi131 ceph-mon[78839]: pgmap v144: 65 pgs: 65 active+clean; 306 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.3 KiB/s rd, 4 op/s 2024-09-13T03:00:28.935 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:28 smithi089 ceph-mon[91553]: Upgrade: Updating osd.5 2024-09-13T03:00:28.936 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:28 smithi089 ceph-mon[91553]: Deploying daemon osd.5 on smithi131 2024-09-13T03:00:28.936 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:28 smithi089 ceph-mon[91553]: pgmap v144: 65 pgs: 65 active+clean; 306 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 2.3 KiB/s rd, 4 op/s 2024-09-13T03:00:30.428 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 03:00:30 smithi131 systemd[1]: Stopping Ceph osd.5 for 12cdb164-717a-11ef-bceb-c7b262605968... 2024-09-13T03:00:30.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:30 smithi131 ceph-mon[78839]: pgmap v145: 65 pgs: 65 active+clean; 306 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-09-13T03:00:30.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:30 smithi131 ceph-mon[78839]: osd.5 marked itself down and dead 2024-09-13T03:00:30.684 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 03:00:30 smithi131 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-5[53065]: 2024-09-13T03:00:30.434+0000 7f90cb4f3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T03:00:30.684 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 03:00:30 smithi131 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-5[53065]: 2024-09-13T03:00:30.434+0000 7f90cb4f3640 -1 osd.5 72 *** Got signal Terminated *** 2024-09-13T03:00:30.684 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 03:00:30 smithi131 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-5[53065]: 2024-09-13T03:00:30.434+0000 7f90cb4f3640 -1 osd.5 72 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T03:00:31.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:30 smithi089 ceph-mon[91553]: pgmap v145: 65 pgs: 65 active+clean; 306 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 1.6 KiB/s rd, 3 op/s 2024-09-13T03:00:31.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:30 smithi089 ceph-mon[91553]: osd.5 marked itself down and dead 2024-09-13T03:00:31.494 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 03:00:31 smithi131 podman[98191]: 2024-09-13 03:00:31.190951416 +0000 UTC m=+0.879306944 container died ace4b45e5873e914e938d45e7198c485bfe6a4b180abbeb5c2496360082b3daa (image=quay.ceph.io/ceph-ci/ceph@sha256:20745bd452f31fe48c67c092910f9b2c550f9dc62d239ff3e2953415a85590be, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-5, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=quincy-bbdadfa, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T03:00:31.494 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 03:00:31 smithi131 podman[98191]: 2024-09-13 03:00:31.493651814 +0000 UTC m=+1.182007387 container cleanup ace4b45e5873e914e938d45e7198c485bfe6a4b180abbeb5c2496360082b3daa (image=quay.ceph.io/ceph-ci/ceph@sha256:20745bd452f31fe48c67c092910f9b2c550f9dc62d239ff3e2953415a85590be, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-5, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=quincy-bbdadfa, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-13T03:00:31.838 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 03:00:31 smithi131 bash[98191]: ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-5 2024-09-13T03:00:31.838 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:31 smithi131 ceph-mon[78839]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T03:00:31.838 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:31 smithi131 ceph-mon[78839]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-09-13T03:00:31.838 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:31 smithi131 ceph-mon[78839]: osdmap e73: 6 total, 5 up, 6 in 2024-09-13T03:00:32.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:31 smithi089 ceph-mon[91553]: Health check failed: 1 osds down (OSD_DOWN) 2024-09-13T03:00:32.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:31 smithi089 ceph-mon[91553]: Health check failed: all OSDs are running squid or later but require_osd_release < squid (OSD_UPGRADE_FINISHED) 2024-09-13T03:00:32.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:31 smithi089 ceph-mon[91553]: osdmap e73: 6 total, 5 up, 6 in 2024-09-13T03:00:32.184 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 03:00:31 smithi131 podman[98207]: 2024-09-13 03:00:31.837428854 +0000 UTC m=+0.643069736 container remove ace4b45e5873e914e938d45e7198c485bfe6a4b180abbeb5c2496360082b3daa (image=quay.ceph.io/ceph-ci/ceph@sha256:20745bd452f31fe48c67c092910f9b2c550f9dc62d239ff3e2953415a85590be, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-5, org.label-schema.vendor=CentOS, RELEASE=quincy-bbdadfa, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T03:00:32.567 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 03:00:32 smithi131 podman[98297]: 2024-09-13 03:00:32.153636003 +0000 UTC m=+0.015912983 image pull 19dc8d6597273a47b0b4862f1d0e037b0157b908a02acd63baceec3ee94fbd6c quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d 2024-09-13T03:00:32.567 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 03:00:32 smithi131 podman[98297]: 2024-09-13 03:00:32.28020083 +0000 UTC m=+0.142477797 container create b5412b42662c0158c0d939c5934486a6f26f3d1999dbad23c2f3b0b914c158e9 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-7741f7f, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T03:00:32.567 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 03:00:32 smithi131 podman[98297]: 2024-09-13 03:00:32.490970003 +0000 UTC m=+0.353246970 container init b5412b42662c0158c0d939c5934486a6f26f3d1999dbad23c2f3b0b914c158e9 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-5-deactivate, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-7741f7f, ceph=True, org.label-schema.license=GPLv2) 2024-09-13T03:00:32.567 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 03:00:32 smithi131 podman[98297]: 2024-09-13 03:00:32.494359757 +0000 UTC m=+0.356636727 container start b5412b42662c0158c0d939c5934486a6f26f3d1999dbad23c2f3b0b914c158e9 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-5-deactivate, RELEASE=squid-7741f7f, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-13T03:00:32.567 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 03:00:32 smithi131 podman[98297]: 2024-09-13 03:00:32.566130672 +0000 UTC m=+0.428407653 container attach b5412b42662c0158c0d939c5934486a6f26f3d1999dbad23c2f3b0b914c158e9 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-7741f7f) 2024-09-13T03:00:32.937 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:32 smithi131 ceph-mon[78839]: pgmap v147: 65 pgs: 10 peering, 10 stale+active+clean, 45 active+clean; 306 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s 2024-09-13T03:00:32.938 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:32 smithi131 ceph-mon[78839]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2024-09-13T03:00:32.938 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:32 smithi131 ceph-mon[78839]: osdmap e74: 6 total, 5 up, 6 in 2024-09-13T03:00:32.938 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 03:00:32 smithi131 podman[98297]: 2024-09-13 03:00:32.678668297 +0000 UTC m=+0.540945277 container died b5412b42662c0158c0d939c5934486a6f26f3d1999dbad23c2f3b0b914c158e9 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-5-deactivate, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, RELEASE=squid-7741f7f, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2) 2024-09-13T03:00:33.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:32 smithi089 ceph-mon[91553]: pgmap v147: 65 pgs: 10 peering, 10 stale+active+clean, 45 active+clean; 306 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1 op/s 2024-09-13T03:00:33.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:32 smithi089 ceph-mon[91553]: Health check failed: Reduced data availability: 3 pgs peering (PG_AVAILABILITY) 2024-09-13T03:00:33.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:32 smithi089 ceph-mon[91553]: osdmap e74: 6 total, 5 up, 6 in 2024-09-13T03:00:33.650 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 03:00:33 smithi131 podman[98321]: 2024-09-13 03:00:33.220636862 +0000 UTC m=+0.536665775 container remove b5412b42662c0158c0d939c5934486a6f26f3d1999dbad23c2f3b0b914c158e9 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-5-deactivate, RELEASE=squid-7741f7f, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-13T03:00:33.650 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 03:00:33 smithi131 systemd[1]: ceph-12cdb164-717a-11ef-bceb-c7b262605968@osd.5.service: Deactivated successfully. 2024-09-13T03:00:33.650 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 03:00:33 smithi131 systemd[1]: Stopped Ceph osd.5 for 12cdb164-717a-11ef-bceb-c7b262605968. 2024-09-13T03:00:33.650 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 03:00:33 smithi131 systemd[1]: ceph-12cdb164-717a-11ef-bceb-c7b262605968@osd.5.service: Consumed 59.299s CPU time. 2024-09-13T03:00:33.650 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 03:00:33 smithi131 systemd[1]: Starting Ceph osd.5 for 12cdb164-717a-11ef-bceb-c7b262605968... 2024-09-13T03:00:33.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:33 smithi089 ceph-mon[91553]: Health check failed: Degraded data redundancy: 8/357 objects degraded (2.241%), 3 pgs degraded (PG_DEGRADED) 2024-09-13T03:00:33.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:33 smithi131 ceph-mon[78839]: Health check failed: Degraded data redundancy: 8/357 objects degraded (2.241%), 3 pgs degraded (PG_DEGRADED) 2024-09-13T03:00:33.934 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 03:00:33 smithi131 podman[98422]: 2024-09-13 03:00:33.551543081 +0000 UTC m=+0.015973184 image pull 19dc8d6597273a47b0b4862f1d0e037b0157b908a02acd63baceec3ee94fbd6c quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d 2024-09-13T03:00:33.934 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 03:00:33 smithi131 podman[98422]: 2024-09-13 03:00:33.697696244 +0000 UTC m=+0.162126333 container create a6298daefdfa56cd10ed0feaa8e3e15ddaf0f3919a570608943f6d65567cd962 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-5-activate, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-7741f7f, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True) 2024-09-13T03:00:33.934 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 03:00:33 smithi131 podman[98422]: 2024-09-13 03:00:33.892006717 +0000 UTC m=+0.356436818 container init a6298daefdfa56cd10ed0feaa8e3e15ddaf0f3919a570608943f6d65567cd962 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-5-activate, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-7741f7f, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-13T03:00:33.934 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 03:00:33 smithi131 podman[98422]: 2024-09-13 03:00:33.895355188 +0000 UTC m=+0.359785278 container start a6298daefdfa56cd10ed0feaa8e3e15ddaf0f3919a570608943f6d65567cd962 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-5-activate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-7741f7f, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-13T03:00:34.434 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 03:00:33 smithi131 podman[98422]: 2024-09-13 03:00:33.975534595 +0000 UTC m=+0.439964693 container attach a6298daefdfa56cd10ed0feaa8e3e15ddaf0f3919a570608943f6d65567cd962 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-5-activate, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, RELEASE=squid-7741f7f, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-13T03:00:34.434 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 03:00:34 smithi131 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-5-activate[98437]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T03:00:34.434 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 03:00:34 smithi131 bash[98422]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T03:00:34.434 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 03:00:34 smithi131 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-5-activate[98437]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T03:00:34.434 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 03:00:34 smithi131 bash[98422]: Running command: /usr/bin/ceph-authtool --gen-print-key 2024-09-13T03:00:35.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:34 smithi089 ceph-mon[91553]: pgmap v149: 65 pgs: 4 active+undersized, 10 peering, 6 stale+active+clean, 3 active+undersized+degraded, 42 active+clean; 306 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 8/357 objects degraded (2.241%) 2024-09-13T03:00:35.045 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:34 smithi131 ceph-mon[78839]: pgmap v149: 65 pgs: 4 active+undersized, 10 peering, 6 stale+active+clean, 3 active+undersized+degraded, 42 active+clean; 306 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 8/357 objects degraded (2.241%) 2024-09-13T03:00:35.046 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 03:00:34 smithi131 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-5-activate[98437]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-13T03:00:35.046 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 03:00:34 smithi131 bash[98422]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-13T03:00:35.046 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 03:00:34 smithi131 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-5-activate[98437]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-13T03:00:35.046 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 03:00:34 smithi131 bash[98422]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-09-13T03:00:35.338 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 03:00:35 smithi131 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-5-activate[98437]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-13T03:00:35.338 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 03:00:35 smithi131 bash[98422]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-09-13T03:00:35.338 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 03:00:35 smithi131 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-5-activate[98437]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-13T03:00:35.338 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 03:00:35 smithi131 bash[98422]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-09-13T03:00:35.339 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 03:00:35 smithi131 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-5-activate[98437]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-09-13T03:00:35.339 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 03:00:35 smithi131 bash[98422]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-09-13T03:00:35.339 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 03:00:35 smithi131 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-5-activate[98437]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-13T03:00:35.339 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 03:00:35 smithi131 bash[98422]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-13T03:00:35.339 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 03:00:35 smithi131 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-5-activate[98437]: --> ceph-volume raw activate successful for osd ID: 5 2024-09-13T03:00:35.339 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 03:00:35 smithi131 bash[98422]: --> ceph-volume raw activate successful for osd ID: 5 2024-09-13T03:00:35.339 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 03:00:35 smithi131 podman[98422]: 2024-09-13 03:00:35.074003287 +0000 UTC m=+1.538433394 container died a6298daefdfa56cd10ed0feaa8e3e15ddaf0f3919a570608943f6d65567cd962 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-5-activate, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-7741f7f, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-13T03:00:35.934 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 03:00:35 smithi131 podman[98582]: 2024-09-13 03:00:35.621719994 +0000 UTC m=+0.541913844 container remove a6298daefdfa56cd10ed0feaa8e3e15ddaf0f3919a570608943f6d65567cd962 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-5-activate, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-7741f7f, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T03:00:35.934 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 03:00:35 smithi131 podman[98640]: 2024-09-13 03:00:35.731885425 +0000 UTC m=+0.015985704 image pull 19dc8d6597273a47b0b4862f1d0e037b0157b908a02acd63baceec3ee94fbd6c quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d 2024-09-13T03:00:35.934 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 03:00:35 smithi131 podman[98640]: 2024-09-13 03:00:35.84763822 +0000 UTC m=+0.131738494 container create e7d2a780f4e044a5db36d9d2ecd26729578bed4b7ff4e2c0573d9f65fb3c48bb (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-5, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, ceph=True, RELEASE=squid-7741f7f, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-13T03:00:36.434 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 03:00:36 smithi131 podman[98640]: 2024-09-13 03:00:36.033546981 +0000 UTC m=+0.317647249 container init e7d2a780f4e044a5db36d9d2ecd26729578bed4b7ff4e2c0573d9f65fb3c48bb (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-5, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=squid-7741f7f, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T03:00:36.434 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 03:00:36 smithi131 podman[98640]: 2024-09-13 03:00:36.036680409 +0000 UTC m=+0.320780678 container start e7d2a780f4e044a5db36d9d2ecd26729578bed4b7ff4e2c0573d9f65fb3c48bb (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-5, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, RELEASE=squid-7741f7f, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-13T03:00:36.434 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 03:00:36 smithi131 ceph-osd[98660]: -- 172.21.15.131:0/1922773102 <== mon.1 v2:172.21.15.131:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e18ecf21e0 con 0x55e18ec88000 2024-09-13T03:00:36.434 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 03:00:36 smithi131 bash[98640]: e7d2a780f4e044a5db36d9d2ecd26729578bed4b7ff4e2c0573d9f65fb3c48bb 2024-09-13T03:00:36.434 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 03:00:36 smithi131 systemd[1]: Started Ceph osd.5 for 12cdb164-717a-11ef-bceb-c7b262605968. 2024-09-13T03:00:36.876 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:36 smithi131 ceph-mon[78839]: pgmap v150: 65 pgs: 9 active+undersized, 10 peering, 1 stale+active+clean, 6 active+undersized+degraded, 39 active+clean; 306 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 16/357 objects degraded (4.482%) 2024-09-13T03:00:36.877 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:36 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:00:36.877 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:36 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:00:36.877 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:36 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:00:36.877 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:36 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:00:36.877 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:36 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:00:37.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:36 smithi089 ceph-mon[91553]: pgmap v150: 65 pgs: 9 active+undersized, 10 peering, 1 stale+active+clean, 6 active+undersized+degraded, 39 active+clean; 306 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 16/357 objects degraded (4.482%) 2024-09-13T03:00:37.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:36 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:00:37.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:36 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:00:37.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:36 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:00:37.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:36 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:00:37.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:36 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:00:37.758 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:37 smithi131 ceph-mon[78839]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2024-09-13T03:00:38.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:37 smithi089 ceph-mon[91553]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2024-09-13T03:00:38.184 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 03:00:37 smithi131 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-5[98656]: 2024-09-13T03:00:37.903+0000 7f05f55f8640 -1 Falling back to public interface 2024-09-13T03:00:38.670 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:38 smithi131 ceph-mon[78839]: pgmap v151: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 306 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 54/357 objects degraded (15.126%) 2024-09-13T03:00:38.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:38.892+0000 7f270b784640 1 -- 172.21.15.89:0/1393900489 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27040fc700 msgr2=0x7f27040fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:38.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:38.892+0000 7f270b784640 1 --2- 172.21.15.89:0/1393900489 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27040fc700 0x7f27040fcb70 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f26f40048d0 tx=0x7f26f4009da0 comp rx=0 tx=0).stop 2024-09-13T03:00:38.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:38.892+0000 7f270b784640 1 -- 172.21.15.89:0/1393900489 shutdown_connections 2024-09-13T03:00:38.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:38.892+0000 7f270b784640 1 --2- 172.21.15.89:0/1393900489 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27040fc700 0x7f27040fcb70 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:38.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:38.892+0000 7f270b784640 1 --2- 172.21.15.89:0/1393900489 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f27040fb430 0x7f27040fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:38.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:38.892+0000 7f270b784640 1 -- 172.21.15.89:0/1393900489 >> 172.21.15.89:0/1393900489 conn(0x7f27040f6c10 msgr2=0x7f27040f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:00:38.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:38.892+0000 7f270b784640 1 -- 172.21.15.89:0/1393900489 shutdown_connections 2024-09-13T03:00:38.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:38.892+0000 7f270b784640 1 -- 172.21.15.89:0/1393900489 wait complete. 2024-09-13T03:00:38.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:38.892+0000 7f270b784640 1 Processor -- start 2024-09-13T03:00:38.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:38.893+0000 7f270b784640 1 -- start start 2024-09-13T03:00:38.895 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:38 smithi089 ceph-mon[91553]: pgmap v151: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 306 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 54/357 objects degraded (15.126%) 2024-09-13T03:00:38.896 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:38.893+0000 7f270b784640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f27040fb430 0x7f27040ff550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:38.896 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:38.893+0000 7f270b784640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27040fc700 0x7f27040fda40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:38.896 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:38.893+0000 7f270b784640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27040fdfd0 con 0x7f27040fc700 2024-09-13T03:00:38.896 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:38.893+0000 7f270b784640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27040fe110 con 0x7f27040fb430 2024-09-13T03:00:38.896 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:38.893+0000 7f2708d1f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27040fc700 0x7f27040fda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:00:38.896 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:38.893+0000 7f2708d1f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27040fc700 0x7f27040fda40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:37760/0 (socket says 172.21.15.89:37760) 2024-09-13T03:00:38.896 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:38.893+0000 7f2708d1f640 1 -- 172.21.15.89:0/1117088478 learned_addr learned my addr 172.21.15.89:0/1117088478 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T03:00:38.897 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:38.893+0000 7f2709520640 1 --2- 172.21.15.89:0/1117088478 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f27040fb430 0x7f27040ff550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:00:38.897 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:38.893+0000 7f2708d1f640 1 -- 172.21.15.89:0/1117088478 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f27040fb430 msgr2=0x7f27040ff550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:38.897 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:38.893+0000 7f2708d1f640 1 --2- 172.21.15.89:0/1117088478 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f27040fb430 0x7f27040ff550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:38.897 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:38.893+0000 7f2708d1f640 1 -- 172.21.15.89:0/1117088478 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26f4005040 con 0x7f27040fc700 2024-09-13T03:00:38.897 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:38.894+0000 7f2708d1f640 1 --2- 172.21.15.89:0/1117088478 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27040fc700 0x7f27040fda40 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f26f40048a0 tx=0x7f26f4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:00:38.897 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:38.894+0000 7f26f9ffb640 1 -- 172.21.15.89:0/1117088478 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f26f4038070 con 0x7f27040fc700 2024-09-13T03:00:38.897 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:38.894+0000 7f26f9ffb640 1 -- 172.21.15.89:0/1117088478 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f26f4004290 con 0x7f27040fc700 2024-09-13T03:00:38.897 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:38.894+0000 7f270b784640 1 -- 172.21.15.89:0/1117088478 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27040fe390 con 0x7f27040fc700 2024-09-13T03:00:38.897 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:38.894+0000 7f26f9ffb640 1 -- 172.21.15.89:0/1117088478 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f26f4033660 con 0x7f27040fc700 2024-09-13T03:00:38.897 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:38.894+0000 7f270b784640 1 -- 172.21.15.89:0/1117088478 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27041150d0 con 0x7f27040fc700 2024-09-13T03:00:38.898 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:38.895+0000 7f270b784640 1 -- 172.21.15.89:0/1117088478 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27040fa890 con 0x7f27040fc700 2024-09-13T03:00:38.898 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:38.896+0000 7f26f9ffb640 1 -- 172.21.15.89:0/1117088478 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f26f4030020 con 0x7f27040fc700 2024-09-13T03:00:38.898 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:38.896+0000 7f26f9ffb640 1 --2- 172.21.15.89:0/1117088478 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f26f006e530 0x7f26f00709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:38.898 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:38.896+0000 7f26f9ffb640 1 -- 172.21.15.89:0/1117088478 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f26f40ae2b0 con 0x7f27040fc700 2024-09-13T03:00:38.898 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:38.897+0000 7f2709520640 1 --2- 172.21.15.89:0/1117088478 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f26f006e530 0x7f26f00709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:00:38.898 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:38.897+0000 7f2709520640 1 --2- 172.21.15.89:0/1117088478 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f26f006e530 0x7f26f00709e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f27040ff300 tx=0x7f270000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:00:38.902 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:38.901+0000 7f26f9ffb640 1 -- 172.21.15.89:0/1117088478 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f26f4077450 con 0x7f27040fc700 2024-09-13T03:00:39.091 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.089+0000 7f270b784640 1 -- 172.21.15.89:0/1117088478 --> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2704103f60 con 0x7f26f006e530 2024-09-13T03:00:39.092 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.091+0000 7f26f9ffb640 1 -- 172.21.15.89:0/1117088478 <== mgr.34104 v2:172.21.15.89:6800/1881577856 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f2704103f60 con 0x7f26f006e530 2024-09-13T03:00:39.094 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.093+0000 7f270b784640 1 -- 172.21.15.89:0/1117088478 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f26f006e530 msgr2=0x7f26f00709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:39.094 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.093+0000 7f270b784640 1 --2- 172.21.15.89:0/1117088478 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f26f006e530 0x7f26f00709e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f27040ff300 tx=0x7f270000b040 comp rx=0 tx=0).stop 2024-09-13T03:00:39.094 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.093+0000 7f270b784640 1 -- 172.21.15.89:0/1117088478 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27040fc700 msgr2=0x7f27040fda40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:39.094 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.093+0000 7f270b784640 1 --2- 172.21.15.89:0/1117088478 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27040fc700 0x7f27040fda40 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f26f40048a0 tx=0x7f26f4009da0 comp rx=0 tx=0).stop 2024-09-13T03:00:39.095 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.093+0000 7f270b784640 1 -- 172.21.15.89:0/1117088478 shutdown_connections 2024-09-13T03:00:39.095 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.093+0000 7f270b784640 1 --2- 172.21.15.89:0/1117088478 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f26f006e530 0x7f26f00709e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:39.095 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.093+0000 7f270b784640 1 --2- 172.21.15.89:0/1117088478 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f27040fc700 0x7f27040fda40 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:39.095 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.093+0000 7f270b784640 1 --2- 172.21.15.89:0/1117088478 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f27040fb430 0x7f27040ff550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:39.095 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.093+0000 7f270b784640 1 -- 172.21.15.89:0/1117088478 >> 172.21.15.89:0/1117088478 conn(0x7f27040f6c10 msgr2=0x7f2704065560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:00:39.095 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.093+0000 7f270b784640 1 -- 172.21.15.89:0/1117088478 shutdown_connections 2024-09-13T03:00:39.095 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.093+0000 7f270b784640 1 -- 172.21.15.89:0/1117088478 wait complete. 2024-09-13T03:00:39.103 INFO:teuthology.orchestra.run.smithi089.stdout:true 2024-09-13T03:00:39.175 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.173+0000 7ff5048df640 1 -- 172.21.15.89:0/1090949101 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff5000fc550 msgr2=0x7ff5000fc960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:39.175 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.173+0000 7ff5048df640 1 --2- 172.21.15.89:0/1090949101 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff5000fc550 0x7ff5000fc960 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff4f8009c50 tx=0x7ff4f8004d10 comp rx=0 tx=0).stop 2024-09-13T03:00:39.175 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.173+0000 7ff5048df640 1 -- 172.21.15.89:0/1090949101 shutdown_connections 2024-09-13T03:00:39.175 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.173+0000 7ff5048df640 1 --2- 172.21.15.89:0/1090949101 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5000fd820 0x7ff5000fdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:39.175 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.173+0000 7ff5048df640 1 --2- 172.21.15.89:0/1090949101 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff5000fc550 0x7ff5000fc960 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:39.176 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.173+0000 7ff5048df640 1 -- 172.21.15.89:0/1090949101 >> 172.21.15.89:0/1090949101 conn(0x7ff5000f7d30 msgr2=0x7ff5000fa140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:00:39.176 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.173+0000 7ff5048df640 1 -- 172.21.15.89:0/1090949101 shutdown_connections 2024-09-13T03:00:39.176 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.173+0000 7ff5048df640 1 -- 172.21.15.89:0/1090949101 wait complete. 2024-09-13T03:00:39.176 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.173+0000 7ff5048df640 1 Processor -- start 2024-09-13T03:00:39.176 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.173+0000 7ff5048df640 1 -- start start 2024-09-13T03:00:39.176 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.174+0000 7ff5048df640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff5000fc550 0x7ff50010d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:39.176 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.174+0000 7ff5048df640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5000fd820 0x7ff50010d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:39.176 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.174+0000 7ff5048df640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff50010dc10 con 0x7ff5000fc550 2024-09-13T03:00:39.176 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.174+0000 7ff5048df640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff50010e430 con 0x7ff5000fd820 2024-09-13T03:00:39.176 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.174+0000 7ff4fe59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff5000fc550 0x7ff50010d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:00:39.176 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.174+0000 7ff4fdd9b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5000fd820 0x7ff50010d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:00:39.176 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.174+0000 7ff4fe59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff5000fc550 0x7ff50010d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:37780/0 (socket says 172.21.15.89:37780) 2024-09-13T03:00:39.176 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.174+0000 7ff4fe59c640 1 -- 172.21.15.89:0/1343051339 learned_addr learned my addr 172.21.15.89:0/1343051339 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T03:00:39.176 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.174+0000 7ff4fdd9b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5000fd820 0x7ff50010d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.89:51038/0 (socket says 172.21.15.89:51038) 2024-09-13T03:00:39.178 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.174+0000 7ff4fe59c640 1 -- 172.21.15.89:0/1343051339 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5000fd820 msgr2=0x7ff50010d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:39.178 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.174+0000 7ff4fe59c640 1 --2- 172.21.15.89:0/1343051339 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5000fd820 0x7ff50010d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:39.178 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.174+0000 7ff4fe59c640 1 -- 172.21.15.89:0/1343051339 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4f80098b0 con 0x7ff5000fc550 2024-09-13T03:00:39.178 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.174+0000 7ff4fdd9b640 1 --2- 172.21.15.89:0/1343051339 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5000fd820 0x7ff50010d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T03:00:39.178 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.174+0000 7ff4fe59c640 1 --2- 172.21.15.89:0/1343051339 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff5000fc550 0x7ff50010d080 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff4f8004a30 tx=0x7ff4f8004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:00:39.178 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.174+0000 7ff4f6ffd640 1 -- 172.21.15.89:0/1343051339 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff4f8009710 con 0x7ff5000fc550 2024-09-13T03:00:39.178 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.175+0000 7ff4f6ffd640 1 -- 172.21.15.89:0/1343051339 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff4f8032b10 con 0x7ff5000fc550 2024-09-13T03:00:39.179 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.175+0000 7ff5048df640 1 -- 172.21.15.89:0/1343051339 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff50010e660 con 0x7ff5000fc550 2024-09-13T03:00:39.179 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.175+0000 7ff4f6ffd640 1 -- 172.21.15.89:0/1343051339 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff4f803db10 con 0x7ff5000fc550 2024-09-13T03:00:39.179 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.175+0000 7ff5048df640 1 -- 172.21.15.89:0/1343051339 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff50010ec00 con 0x7ff5000fc550 2024-09-13T03:00:39.179 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.176+0000 7ff5048df640 1 -- 172.21.15.89:0/1343051339 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5000fb9b0 con 0x7ff5000fc550 2024-09-13T03:00:39.179 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.176+0000 7ff4f6ffd640 1 -- 172.21.15.89:0/1343051339 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7ff4f802f030 con 0x7ff5000fc550 2024-09-13T03:00:39.179 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.177+0000 7ff4f6ffd640 1 --2- 172.21.15.89:0/1343051339 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7ff4ec06e530 0x7ff4ec0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:39.179 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.177+0000 7ff4f6ffd640 1 -- 172.21.15.89:0/1343051339 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6496+0+0 (secure 0 0 0) 0x7ff4f80af780 con 0x7ff5000fc550 2024-09-13T03:00:39.179 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.177+0000 7ff4fdd9b640 1 --2- 172.21.15.89:0/1343051339 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7ff4ec06e530 0x7ff4ec0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:00:39.179 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.177+0000 7ff4fdd9b640 1 --2- 172.21.15.89:0/1343051339 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7ff4ec06e530 0x7ff4ec0709e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff4e8004fd0 tx=0x7ff4e800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:00:39.182 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.181+0000 7ff4f6ffd640 1 -- 172.21.15.89:0/1343051339 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7ff4f80788f0 con 0x7ff5000fc550 2024-09-13T03:00:39.368 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.366+0000 7ff5048df640 1 -- 172.21.15.89:0/1343051339 --> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff50010efa0 con 0x7ff4ec06e530 2024-09-13T03:00:39.369 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.367+0000 7ff4f6ffd640 1 -- 172.21.15.89:0/1343051339 <== mgr.34104 v2:172.21.15.89:6800/1881577856 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7ff50010efa0 con 0x7ff4ec06e530 2024-09-13T03:00:39.371 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.369+0000 7ff5048df640 1 -- 172.21.15.89:0/1343051339 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7ff4ec06e530 msgr2=0x7ff4ec0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:39.371 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.369+0000 7ff5048df640 1 --2- 172.21.15.89:0/1343051339 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7ff4ec06e530 0x7ff4ec0709e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff4e8004fd0 tx=0x7ff4e800b040 comp rx=0 tx=0).stop 2024-09-13T03:00:39.371 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.369+0000 7ff5048df640 1 -- 172.21.15.89:0/1343051339 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff5000fc550 msgr2=0x7ff50010d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:39.371 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.369+0000 7ff5048df640 1 --2- 172.21.15.89:0/1343051339 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff5000fc550 0x7ff50010d080 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7ff4f8004a30 tx=0x7ff4f8004d10 comp rx=0 tx=0).stop 2024-09-13T03:00:39.371 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.369+0000 7ff5048df640 1 -- 172.21.15.89:0/1343051339 shutdown_connections 2024-09-13T03:00:39.371 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.369+0000 7ff5048df640 1 --2- 172.21.15.89:0/1343051339 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7ff4ec06e530 0x7ff4ec0709e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:39.371 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.369+0000 7ff5048df640 1 --2- 172.21.15.89:0/1343051339 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5000fd820 0x7ff50010d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:39.371 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.369+0000 7ff5048df640 1 --2- 172.21.15.89:0/1343051339 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff5000fc550 0x7ff50010d080 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:39.371 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.369+0000 7ff5048df640 1 -- 172.21.15.89:0/1343051339 >> 172.21.15.89:0/1343051339 conn(0x7ff5000f7d30 msgr2=0x7ff5000f94c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:00:39.371 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.369+0000 7ff5048df640 1 -- 172.21.15.89:0/1343051339 shutdown_connections 2024-09-13T03:00:39.372 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.370+0000 7ff5048df640 1 -- 172.21.15.89:0/1343051339 wait complete. 2024-09-13T03:00:39.450 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.448+0000 7fa60db27640 1 -- 172.21.15.89:0/4168820395 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6080fc720 msgr2=0x7fa6080fcb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:39.451 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.448+0000 7fa60db27640 1 --2- 172.21.15.89:0/4168820395 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6080fc720 0x7fa6080fcb90 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa5f00048d0 tx=0x7fa5f0009da0 comp rx=0 tx=0).stop 2024-09-13T03:00:39.451 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.448+0000 7fa60db27640 1 -- 172.21.15.89:0/4168820395 shutdown_connections 2024-09-13T03:00:39.451 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.448+0000 7fa60db27640 1 --2- 172.21.15.89:0/4168820395 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6080fc720 0x7fa6080fcb90 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:39.451 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.448+0000 7fa60db27640 1 --2- 172.21.15.89:0/4168820395 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6080fb450 0x7fa6080fb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:39.451 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.448+0000 7fa60db27640 1 -- 172.21.15.89:0/4168820395 >> 172.21.15.89:0/4168820395 conn(0x7fa6080f6c10 msgr2=0x7fa6080f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:00:39.451 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.448+0000 7fa60db27640 1 -- 172.21.15.89:0/4168820395 shutdown_connections 2024-09-13T03:00:39.451 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.448+0000 7fa60db27640 1 -- 172.21.15.89:0/4168820395 wait complete. 2024-09-13T03:00:39.451 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.449+0000 7fa60db27640 1 Processor -- start 2024-09-13T03:00:39.451 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.449+0000 7fa60db27640 1 -- start start 2024-09-13T03:00:39.451 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.449+0000 7fa60db27640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6080fb450 0x7fa60810f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:39.451 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.449+0000 7fa60db27640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6080fc720 0x7fa60810f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:39.451 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.449+0000 7fa60db27640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa60810fe40 con 0x7fa6080fc720 2024-09-13T03:00:39.451 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.449+0000 7fa60db27640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa608110660 con 0x7fa6080fb450 2024-09-13T03:00:39.452 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.449+0000 7fa5fffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6080fc720 0x7fa60810f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:00:39.452 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.449+0000 7fa6077fe640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6080fb450 0x7fa60810f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:00:39.452 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.449+0000 7fa5fffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6080fc720 0x7fa60810f7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:37792/0 (socket says 172.21.15.89:37792) 2024-09-13T03:00:39.452 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.449+0000 7fa5fffff640 1 -- 172.21.15.89:0/1486827717 learned_addr learned my addr 172.21.15.89:0/1486827717 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T03:00:39.452 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.449+0000 7fa6077fe640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6080fb450 0x7fa60810f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.131:3300/0 says I am v2:172.21.15.89:51068/0 (socket says 172.21.15.89:51068) 2024-09-13T03:00:39.452 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.449+0000 7fa6077fe640 1 -- 172.21.15.89:0/1486827717 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6080fc720 msgr2=0x7fa60810f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:39.452 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.449+0000 7fa6077fe640 1 --2- 172.21.15.89:0/1486827717 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6080fc720 0x7fa60810f7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:39.452 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.449+0000 7fa6077fe640 1 -- 172.21.15.89:0/1486827717 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5f0005040 con 0x7fa6080fb450 2024-09-13T03:00:39.452 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.449+0000 7fa5fffff640 1 --2- 172.21.15.89:0/1486827717 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6080fc720 0x7fa60810f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-13T03:00:39.453 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.450+0000 7fa6077fe640 1 --2- 172.21.15.89:0/1486827717 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6080fb450 0x7fa60810f2b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa5f8002820 tx=0x7fa5f8004570 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:00:39.453 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.450+0000 7fa604ff9640 1 -- 172.21.15.89:0/1486827717 <== mon.1 v2:172.21.15.131:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa5f8002db0 con 0x7fa6080fb450 2024-09-13T03:00:39.453 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.450+0000 7fa60db27640 1 -- 172.21.15.89:0/1486827717 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6081108f0 con 0x7fa6080fb450 2024-09-13T03:00:39.454 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.450+0000 7fa604ff9640 1 -- 172.21.15.89:0/1486827717 <== mon.1 v2:172.21.15.131:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa5f800f040 con 0x7fa6080fb450 2024-09-13T03:00:39.454 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.450+0000 7fa604ff9640 1 -- 172.21.15.89:0/1486827717 <== mon.1 v2:172.21.15.131:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa5f80095f0 con 0x7fa6080fb450 2024-09-13T03:00:39.454 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.450+0000 7fa60db27640 1 -- 172.21.15.89:0/1486827717 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa608110e10 con 0x7fa6080fb450 2024-09-13T03:00:39.454 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.451+0000 7fa60db27640 1 -- 172.21.15.89:0/1486827717 --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6080fa8b0 con 0x7fa6080fb450 2024-09-13T03:00:39.454 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.451+0000 7fa604ff9640 1 -- 172.21.15.89:0/1486827717 <== mon.1 v2:172.21.15.131:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fa5f8009750 con 0x7fa6080fb450 2024-09-13T03:00:39.454 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.452+0000 7fa604ff9640 1 --2- 172.21.15.89:0/1486827717 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fa5f406e530 0x7fa5f40709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:39.454 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.452+0000 7fa604ff9640 1 -- 172.21.15.89:0/1486827717 <== mon.1 v2:172.21.15.131:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fa5f808d7f0 con 0x7fa6080fb450 2024-09-13T03:00:39.454 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.452+0000 7fa5fffff640 1 --2- 172.21.15.89:0/1486827717 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fa5f406e530 0x7fa5f40709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:00:39.454 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.452+0000 7fa5fffff640 1 --2- 172.21.15.89:0/1486827717 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fa5f406e530 0x7fa5f40709e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa60810f060 tx=0x7fa5f0035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:00:39.458 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.456+0000 7fa604ff9640 1 -- 172.21.15.89:0/1486827717 <== mon.1 v2:172.21.15.131:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fa5f8056a10 con 0x7fa6080fb450 2024-09-13T03:00:39.637 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.635+0000 7fa60db27640 1 -- 172.21.15.89:0/1486827717 --> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa608111080 con 0x7fa5f406e530 2024-09-13T03:00:39.645 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.644+0000 7fa604ff9640 1 -- 172.21.15.89:0/1486827717 <== mgr.34104 v2:172.21.15.89:6800/1881577856 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fa608111080 con 0x7fa5f406e530 2024-09-13T03:00:39.646 INFO:teuthology.orchestra.run.smithi089.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T03:00:39.646 INFO:teuthology.orchestra.run.smithi089.stdout:alertmanager.smithi089 smithi089 *:9093,9094 running (5m) 97s ago 14m 25.7M - 0.25.0 c8568f914cd2 1d2432f5479e 2024-09-13T03:00:39.646 INFO:teuthology.orchestra.run.smithi089.stdout:crash.smithi089 smithi089 running (3m) 97s ago 14m 6891k - 19.1.1-322-g7741f7f9 19dc8d659727 0ef15ca3e7f9 2024-09-13T03:00:39.646 INFO:teuthology.orchestra.run.smithi089.stdout:crash.smithi131 smithi131 running (3m) 0s ago 13m 6895k - 19.1.1-322-g7741f7f9 19dc8d659727 21e4d6fc04f7 2024-09-13T03:00:39.646 INFO:teuthology.orchestra.run.smithi089.stdout:grafana.smithi089 smithi089 *:3000 running (5m) 97s ago 13m 79.0M - 9.4.7 954c08fa6188 dee914ded1af 2024-09-13T03:00:39.646 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi089.qjoitb smithi089 running (8m) 97s ago 8m 70.3M - 17.2.7-1627-gbbdadfa3 a994b00deb3a ff9b59ec5107 2024-09-13T03:00:39.646 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi089.rarddb smithi089 running (8m) 97s ago 8m 135M - 17.2.7-1627-gbbdadfa3 a994b00deb3a db2dc502c1ba 2024-09-13T03:00:39.646 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi131.rbovzc smithi131 running (8m) 0s ago 8m 60.3M - 17.2.7-1627-gbbdadfa3 a994b00deb3a d071b6d99537 2024-09-13T03:00:39.646 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi131.uasrkg smithi131 running (8m) 0s ago 8m 112M - 17.2.7-1627-gbbdadfa3 a994b00deb3a 0b3d4ffa6ce5 2024-09-13T03:00:39.646 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.smithi089.guohvs smithi089 *:8443,9283,8765 running (4m) 97s ago 15m 498M - 19.1.1-322-g7741f7f9 19dc8d659727 1e887446f1b0 2024-09-13T03:00:39.646 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.smithi131.aunbqd smithi131 *:8443,9283,8765 running (4m) 0s ago 13m 441M - 19.1.1-322-g7741f7f9 19dc8d659727 358d7478f2ba 2024-09-13T03:00:39.647 INFO:teuthology.orchestra.run.smithi089.stdout:mon.smithi089 smithi089 running (4m) 97s ago 15m 46.4M 2048M 19.1.1-322-g7741f7f9 19dc8d659727 8a29fb65028f 2024-09-13T03:00:39.647 INFO:teuthology.orchestra.run.smithi089.stdout:mon.smithi131 smithi131 running (3m) 0s ago 13m 43.5M 2048M 19.1.1-322-g7741f7f9 19dc8d659727 506310ad8620 2024-09-13T03:00:39.647 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.smithi089 smithi089 *:9100 running (5m) 97s ago 14m 16.9M - 1.5.0 0da6a335fe13 5a9927b583e6 2024-09-13T03:00:39.647 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.smithi131 smithi131 *:9100 running (4m) 0s ago 13m 15.8M - 1.5.0 0da6a335fe13 bcfde5d1a508 2024-09-13T03:00:39.647 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0 smithi089 running (2m) 97s ago 12m 93.7M 1557M 19.1.1-322-g7741f7f9 19dc8d659727 e8038f6d52b6 2024-09-13T03:00:39.647 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1 smithi089 running (2m) 97s ago 12m 94.5M 1557M 19.1.1-322-g7741f7f9 19dc8d659727 e174144d9633 2024-09-13T03:00:39.647 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2 smithi089 running (102s) 97s ago 11m 11.2M 1557M 19.1.1-322-g7741f7f9 19dc8d659727 2d8cab08c2b3 2024-09-13T03:00:39.647 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3 smithi131 running (67s) 0s ago 11m 106M 2581M 19.1.1-322-g7741f7f9 19dc8d659727 e77cff624869 2024-09-13T03:00:39.647 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4 smithi131 running (35s) 0s ago 10m 97.6M 2581M 19.1.1-322-g7741f7f9 19dc8d659727 0317e6a4a04c 2024-09-13T03:00:39.647 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5 smithi131 running (3s) 0s ago 10m 11.4M 2581M 19.1.1-322-g7741f7f9 19dc8d659727 e7d2a780f4e0 2024-09-13T03:00:39.647 INFO:teuthology.orchestra.run.smithi089.stdout:prometheus.smithi089 smithi089 *:9095 running (4m) 97s ago 13m 56.4M - 2.43.0 a07b618ecd1d 9d336370c187 2024-09-13T03:00:39.648 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.646+0000 7fa60db27640 1 -- 172.21.15.89:0/1486827717 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fa5f406e530 msgr2=0x7fa5f40709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:39.648 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.646+0000 7fa60db27640 1 --2- 172.21.15.89:0/1486827717 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fa5f406e530 0x7fa5f40709e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa60810f060 tx=0x7fa5f0035040 comp rx=0 tx=0).stop 2024-09-13T03:00:39.648 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.646+0000 7fa60db27640 1 -- 172.21.15.89:0/1486827717 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6080fb450 msgr2=0x7fa60810f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:39.648 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.646+0000 7fa60db27640 1 --2- 172.21.15.89:0/1486827717 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6080fb450 0x7fa60810f2b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa5f8002820 tx=0x7fa5f8004570 comp rx=0 tx=0).stop 2024-09-13T03:00:39.648 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.646+0000 7fa60db27640 1 -- 172.21.15.89:0/1486827717 shutdown_connections 2024-09-13T03:00:39.648 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.646+0000 7fa60db27640 1 --2- 172.21.15.89:0/1486827717 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fa5f406e530 0x7fa5f40709e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:39.648 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.646+0000 7fa60db27640 1 --2- 172.21.15.89:0/1486827717 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6080fc720 0x7fa60810f7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:39.649 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.646+0000 7fa60db27640 1 --2- 172.21.15.89:0/1486827717 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6080fb450 0x7fa60810f2b0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:39.649 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.646+0000 7fa60db27640 1 -- 172.21.15.89:0/1486827717 >> 172.21.15.89:0/1486827717 conn(0x7fa6080f6c10 msgr2=0x7fa608066180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:00:39.649 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.646+0000 7fa60db27640 1 -- 172.21.15.89:0/1486827717 shutdown_connections 2024-09-13T03:00:39.649 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.646+0000 7fa60db27640 1 -- 172.21.15.89:0/1486827717 wait complete. 2024-09-13T03:00:39.729 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.725+0000 7f293493e640 1 -- 172.21.15.89:0/483798324 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29300fdbb0 msgr2=0x7f29300fdfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:39.729 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.725+0000 7f293493e640 1 --2- 172.21.15.89:0/483798324 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29300fdbb0 0x7f29300fdfc0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f29200048d0 tx=0x7f2920009da0 comp rx=0 tx=0).stop 2024-09-13T03:00:39.729 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.725+0000 7f293493e640 1 -- 172.21.15.89:0/483798324 shutdown_connections 2024-09-13T03:00:39.729 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.725+0000 7f293493e640 1 --2- 172.21.15.89:0/483798324 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f29300fe500 0x7f29300fa660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:39.729 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.725+0000 7f293493e640 1 --2- 172.21.15.89:0/483798324 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29300fdbb0 0x7f29300fdfc0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:39.729 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.725+0000 7f293493e640 1 -- 172.21.15.89:0/483798324 >> 172.21.15.89:0/483798324 conn(0x7f29300f63b0 msgr2=0x7f29300f87e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:00:39.729 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.725+0000 7f293493e640 1 -- 172.21.15.89:0/483798324 shutdown_connections 2024-09-13T03:00:39.729 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.725+0000 7f293493e640 1 -- 172.21.15.89:0/483798324 wait complete. 2024-09-13T03:00:39.729 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.726+0000 7f293493e640 1 Processor -- start 2024-09-13T03:00:39.729 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.726+0000 7f293493e640 1 -- start start 2024-09-13T03:00:39.729 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.726+0000 7f293493e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29300fdbb0 0x7f293010d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:39.730 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.726+0000 7f293493e640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f29300fe500 0x7f293010d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:39.730 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.726+0000 7f293493e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f293010dc30 con 0x7f29300fdbb0 2024-09-13T03:00:39.730 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.726+0000 7f293493e640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f293010e450 con 0x7f29300fe500 2024-09-13T03:00:39.730 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.726+0000 7f292e59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29300fdbb0 0x7f293010d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:00:39.730 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.726+0000 7f292e59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29300fdbb0 0x7f293010d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:37812/0 (socket says 172.21.15.89:37812) 2024-09-13T03:00:39.730 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.726+0000 7f292e59c640 1 -- 172.21.15.89:0/1991541664 learned_addr learned my addr 172.21.15.89:0/1991541664 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T03:00:39.730 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.726+0000 7f292dd9b640 1 --2- 172.21.15.89:0/1991541664 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f29300fe500 0x7f293010d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:00:39.730 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.726+0000 7f292e59c640 1 -- 172.21.15.89:0/1991541664 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f29300fe500 msgr2=0x7f293010d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:39.730 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.726+0000 7f292e59c640 1 --2- 172.21.15.89:0/1991541664 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f29300fe500 0x7f293010d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:39.730 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.726+0000 7f292e59c640 1 -- 172.21.15.89:0/1991541664 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2920005040 con 0x7f29300fdbb0 2024-09-13T03:00:39.730 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.727+0000 7f292e59c640 1 --2- 172.21.15.89:0/1991541664 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29300fdbb0 0x7f293010d0a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f29200043d0 tx=0x7f2920009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:00:39.730 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.727+0000 7f291effd640 1 -- 172.21.15.89:0/1991541664 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2920038070 con 0x7f29300fdbb0 2024-09-13T03:00:39.731 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.727+0000 7f291effd640 1 -- 172.21.15.89:0/1991541664 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f292002ae90 con 0x7f29300fdbb0 2024-09-13T03:00:39.731 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.727+0000 7f293493e640 1 -- 172.21.15.89:0/1991541664 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f293010e680 con 0x7f29300fdbb0 2024-09-13T03:00:39.731 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.727+0000 7f291effd640 1 -- 172.21.15.89:0/1991541664 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f292003e670 con 0x7f29300fdbb0 2024-09-13T03:00:39.731 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.727+0000 7f293493e640 1 -- 172.21.15.89:0/1991541664 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f293010ec20 con 0x7f29300fdbb0 2024-09-13T03:00:39.732 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.728+0000 7f293493e640 1 -- 172.21.15.89:0/1991541664 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29300fa050 con 0x7f29300fdbb0 2024-09-13T03:00:39.732 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.729+0000 7f291effd640 1 -- 172.21.15.89:0/1991541664 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f2920030020 con 0x7f29300fdbb0 2024-09-13T03:00:39.732 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.729+0000 7f291effd640 1 --2- 172.21.15.89:0/1991541664 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f291806e530 0x7f29180709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:39.732 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.729+0000 7f291effd640 1 -- 172.21.15.89:0/1991541664 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f29200ae2f0 con 0x7f29300fdbb0 2024-09-13T03:00:39.732 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.729+0000 7f292dd9b640 1 --2- 172.21.15.89:0/1991541664 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f291806e530 0x7f29180709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:00:39.732 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.730+0000 7f292dd9b640 1 --2- 172.21.15.89:0/1991541664 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f291806e530 0x7f29180709e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f293010ce50 tx=0x7f292400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:00:39.736 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.734+0000 7f291effd640 1 -- 172.21.15.89:0/1991541664 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f2920077510 con 0x7f29300fdbb0 2024-09-13T03:00:39.969 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.968+0000 7f293493e640 1 -- 172.21.15.89:0/1991541664 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f2930104fc0 con 0x7f29300fdbb0 2024-09-13T03:00:39.970 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.968+0000 7f291effd640 1 -- 172.21.15.89:0/1991541664 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+742 (secure 0 0 0) 0x7f292007abd0 con 0x7f29300fdbb0 2024-09-13T03:00:39.970 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-13T03:00:39.970 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": { 2024-09-13T03:00:39.970 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 2 2024-09-13T03:00:39.970 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T03:00:39.970 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": { 2024-09-13T03:00:39.970 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 2 2024-09-13T03:00:39.970 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T03:00:39.970 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": { 2024-09-13T03:00:39.970 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 5 2024-09-13T03:00:39.971 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T03:00:39.971 INFO:teuthology.orchestra.run.smithi089.stdout: "mds": { 2024-09-13T03:00:39.971 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 4 2024-09-13T03:00:39.971 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T03:00:39.971 INFO:teuthology.orchestra.run.smithi089.stdout: "overall": { 2024-09-13T03:00:39.971 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 4, 2024-09-13T03:00:39.971 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 9 2024-09-13T03:00:39.971 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-13T03:00:39.971 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-13T03:00:39.972 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.970+0000 7f293493e640 1 -- 172.21.15.89:0/1991541664 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f291806e530 msgr2=0x7f29180709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:39.972 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.970+0000 7f293493e640 1 --2- 172.21.15.89:0/1991541664 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f291806e530 0x7f29180709e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f293010ce50 tx=0x7f292400b040 comp rx=0 tx=0).stop 2024-09-13T03:00:39.972 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.970+0000 7f293493e640 1 -- 172.21.15.89:0/1991541664 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29300fdbb0 msgr2=0x7f293010d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:39.972 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.970+0000 7f293493e640 1 --2- 172.21.15.89:0/1991541664 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29300fdbb0 0x7f293010d0a0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f29200043d0 tx=0x7f2920009da0 comp rx=0 tx=0).stop 2024-09-13T03:00:39.972 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.970+0000 7f293493e640 1 -- 172.21.15.89:0/1991541664 shutdown_connections 2024-09-13T03:00:39.972 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.970+0000 7f293493e640 1 --2- 172.21.15.89:0/1991541664 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f291806e530 0x7f29180709e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:39.972 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.970+0000 7f293493e640 1 --2- 172.21.15.89:0/1991541664 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f29300fe500 0x7f293010d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:39.973 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.970+0000 7f293493e640 1 --2- 172.21.15.89:0/1991541664 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f29300fdbb0 0x7f293010d0a0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:39.973 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.970+0000 7f293493e640 1 -- 172.21.15.89:0/1991541664 >> 172.21.15.89:0/1991541664 conn(0x7f29300f63b0 msgr2=0x7f29300f7b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:00:39.973 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.970+0000 7f293493e640 1 -- 172.21.15.89:0/1991541664 shutdown_connections 2024-09-13T03:00:39.973 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:39.970+0000 7f293493e640 1 -- 172.21.15.89:0/1991541664 wait complete. 2024-09-13T03:00:40.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:39 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:00:40.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:39 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:00:40.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:39 smithi089 ceph-mon[91553]: from='client.34348 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T03:00:40.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:39 smithi089 ceph-mon[91553]: Health check update: Degraded data redundancy: 54/357 objects degraded (15.126%), 14 pgs degraded (PG_DEGRADED) 2024-09-13T03:00:40.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:39 smithi089 ceph-mon[91553]: from='client.34352 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T03:00:40.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:39 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:00:40.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:39 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:00:40.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:39 smithi089 ceph-mon[91553]: pgmap v152: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 306 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 54/357 objects degraded (15.126%) 2024-09-13T03:00:40.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:39 smithi089 ceph-mon[91553]: from='client.44271 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T03:00:40.052 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.049+0000 7f2fb0a7c640 1 -- 172.21.15.89:0/3794414397 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fac0fe510 msgr2=0x7f2fac0fa670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:40.052 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.049+0000 7f2fb0a7c640 1 --2- 172.21.15.89:0/3794414397 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fac0fe510 0x7f2fac0fa670 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f2fa00048d0 tx=0x7f2fa0009da0 comp rx=0 tx=0).stop 2024-09-13T03:00:40.052 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.049+0000 7f2fb0a7c640 1 -- 172.21.15.89:0/3794414397 shutdown_connections 2024-09-13T03:00:40.052 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.049+0000 7f2fb0a7c640 1 --2- 172.21.15.89:0/3794414397 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fac0fe510 0x7f2fac0fa670 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:40.052 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.049+0000 7f2fb0a7c640 1 --2- 172.21.15.89:0/3794414397 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2fac0fdbc0 0x7f2fac0fdfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:40.052 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.049+0000 7f2fb0a7c640 1 -- 172.21.15.89:0/3794414397 >> 172.21.15.89:0/3794414397 conn(0x7f2fac0f63c0 msgr2=0x7f2fac0f87f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:00:40.052 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.049+0000 7f2fb0a7c640 1 -- 172.21.15.89:0/3794414397 shutdown_connections 2024-09-13T03:00:40.052 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.049+0000 7f2fb0a7c640 1 -- 172.21.15.89:0/3794414397 wait complete. 2024-09-13T03:00:40.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.049+0000 7f2fb0a7c640 1 Processor -- start 2024-09-13T03:00:40.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.049+0000 7f2fb0a7c640 1 -- start start 2024-09-13T03:00:40.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.049+0000 7f2fb0a7c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fac0fdbc0 0x7f2fac10d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:40.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.049+0000 7f2fb0a7c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2fac0fe510 0x7f2fac10d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:40.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.049+0000 7f2fb0a7c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fac10dc90 con 0x7f2fac0fdbc0 2024-09-13T03:00:40.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.049+0000 7f2fb0a7c640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fac10e4b0 con 0x7f2fac0fe510 2024-09-13T03:00:40.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.050+0000 7f2faa59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fac0fdbc0 0x7f2fac10d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:00:40.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.050+0000 7f2faa59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fac0fdbc0 0x7f2fac10d100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:37822/0 (socket says 172.21.15.89:37822) 2024-09-13T03:00:40.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.050+0000 7f2faa59c640 1 -- 172.21.15.89:0/3693332050 learned_addr learned my addr 172.21.15.89:0/3693332050 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T03:00:40.053 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.050+0000 7f2fa9d9b640 1 --2- 172.21.15.89:0/3693332050 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2fac0fe510 0x7f2fac10d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:00:40.054 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.050+0000 7f2faa59c640 1 -- 172.21.15.89:0/3693332050 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2fac0fe510 msgr2=0x7f2fac10d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:40.054 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.050+0000 7f2faa59c640 1 --2- 172.21.15.89:0/3693332050 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2fac0fe510 0x7f2fac10d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:40.054 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.050+0000 7f2faa59c640 1 -- 172.21.15.89:0/3693332050 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fa0005040 con 0x7f2fac0fdbc0 2024-09-13T03:00:40.054 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.050+0000 7f2faa59c640 1 --2- 172.21.15.89:0/3693332050 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fac0fdbc0 0x7f2fac10d100 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c002a50 tx=0x7f2f9c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:00:40.054 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.050+0000 7f2f9affd640 1 -- 172.21.15.89:0/3693332050 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f9c007c30 con 0x7f2fac0fdbc0 2024-09-13T03:00:40.054 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.050+0000 7f2f9affd640 1 -- 172.21.15.89:0/3693332050 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f2f9c00f040 con 0x7f2fac0fdbc0 2024-09-13T03:00:40.054 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.050+0000 7f2fb0a7c640 1 -- 172.21.15.89:0/3693332050 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fac10e740 con 0x7f2fac0fdbc0 2024-09-13T03:00:40.054 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.050+0000 7f2f9affd640 1 -- 172.21.15.89:0/3693332050 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f9c00dad0 con 0x7f2fac0fdbc0 2024-09-13T03:00:40.054 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.050+0000 7f2fb0a7c640 1 -- 172.21.15.89:0/3693332050 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fac10ecb0 con 0x7f2fac0fdbc0 2024-09-13T03:00:40.055 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.051+0000 7f2fb0a7c640 1 -- 172.21.15.89:0/3693332050 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fac1057b0 con 0x7f2fac0fdbc0 2024-09-13T03:00:40.055 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.052+0000 7f2f9affd640 1 -- 172.21.15.89:0/3693332050 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f2f9c00dc30 con 0x7f2fac0fdbc0 2024-09-13T03:00:40.055 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.052+0000 7f2f9affd640 1 --2- 172.21.15.89:0/3693332050 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f2f9406e530 0x7f2f940709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:40.055 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.052+0000 7f2f9affd640 1 -- 172.21.15.89:0/3693332050 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f2f9c08e040 con 0x7f2fac0fdbc0 2024-09-13T03:00:40.055 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.052+0000 7f2fa9d9b640 1 --2- 172.21.15.89:0/3693332050 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f2f9406e530 0x7f2f940709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:00:40.055 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.053+0000 7f2fa9d9b640 1 --2- 172.21.15.89:0/3693332050 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f2f9406e530 0x7f2f940709e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2fa0000c00 tx=0x7f2fa0035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:00:40.058 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.056+0000 7f2f9affd640 1 -- 172.21.15.89:0/3693332050 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f2f9c057130 con 0x7f2fac0fdbc0 2024-09-13T03:00:40.167 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:39 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:00:40.168 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:39 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:00:40.168 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:39 smithi131 ceph-mon[78839]: from='client.34348 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T03:00:40.168 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:39 smithi131 ceph-mon[78839]: Health check update: Degraded data redundancy: 54/357 objects degraded (15.126%), 14 pgs degraded (PG_DEGRADED) 2024-09-13T03:00:40.168 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:39 smithi131 ceph-mon[78839]: from='client.34352 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T03:00:40.168 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:39 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:00:40.168 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:39 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:00:40.168 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:39 smithi131 ceph-mon[78839]: pgmap v152: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 306 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 54/357 objects degraded (15.126%) 2024-09-13T03:00:40.168 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:39 smithi131 ceph-mon[78839]: from='client.44271 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T03:00:40.259 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.258+0000 7f2fb0a7c640 1 -- 172.21.15.89:0/3693332050 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f2fac04b7a0 con 0x7f2fac0fdbc0 2024-09-13T03:00:40.260 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.258+0000 7f2f9affd640 1 -- 172.21.15.89:0/3693332050 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 23 v23) v1 ==== 76+0+1953 (secure 0 0 0) 0x7f2fac04b7a0 con 0x7f2fac0fdbc0 2024-09-13T03:00:40.260 INFO:teuthology.orchestra.run.smithi089.stdout:e23 2024-09-13T03:00:40.260 INFO:teuthology.orchestra.run.smithi089.stdout:btime 2024-09-13T02:58:04:980780+0000 2024-09-13T03:00:40.260 INFO:teuthology.orchestra.run.smithi089.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T03:00:40.260 INFO:teuthology.orchestra.run.smithi089.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T03:00:40.260 INFO:teuthology.orchestra.run.smithi089.stdout:legacy client fscid: 1 2024-09-13T03:00:40.261 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T03:00:40.261 INFO:teuthology.orchestra.run.smithi089.stdout:Filesystem 'cephfs' (1) 2024-09-13T03:00:40.261 INFO:teuthology.orchestra.run.smithi089.stdout:fs_name cephfs 2024-09-13T03:00:40.261 INFO:teuthology.orchestra.run.smithi089.stdout:epoch 23 2024-09-13T03:00:40.261 INFO:teuthology.orchestra.run.smithi089.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T03:00:40.261 INFO:teuthology.orchestra.run.smithi089.stdout:created 2024-09-13T02:51:40.657817+0000 2024-09-13T03:00:40.261 INFO:teuthology.orchestra.run.smithi089.stdout:modified 2024-09-13T02:58:04.067950+0000 2024-09-13T03:00:40.261 INFO:teuthology.orchestra.run.smithi089.stdout:tableserver 0 2024-09-13T03:00:40.261 INFO:teuthology.orchestra.run.smithi089.stdout:root 0 2024-09-13T03:00:40.261 INFO:teuthology.orchestra.run.smithi089.stdout:session_timeout 60 2024-09-13T03:00:40.261 INFO:teuthology.orchestra.run.smithi089.stdout:session_autoclose 300 2024-09-13T03:00:40.261 INFO:teuthology.orchestra.run.smithi089.stdout:max_file_size 1099511627776 2024-09-13T03:00:40.261 INFO:teuthology.orchestra.run.smithi089.stdout:max_xattr_size 65536 2024-09-13T03:00:40.261 INFO:teuthology.orchestra.run.smithi089.stdout:required_client_features {} 2024-09-13T03:00:40.262 INFO:teuthology.orchestra.run.smithi089.stdout:last_failure 0 2024-09-13T03:00:40.262 INFO:teuthology.orchestra.run.smithi089.stdout:last_failure_osd_epoch 44 2024-09-13T03:00:40.262 INFO:teuthology.orchestra.run.smithi089.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T03:00:40.262 INFO:teuthology.orchestra.run.smithi089.stdout:max_mds 2 2024-09-13T03:00:40.262 INFO:teuthology.orchestra.run.smithi089.stdout:in 0,1 2024-09-13T03:00:40.262 INFO:teuthology.orchestra.run.smithi089.stdout:up {0=14480,1=24257} 2024-09-13T03:00:40.262 INFO:teuthology.orchestra.run.smithi089.stdout:failed 2024-09-13T03:00:40.262 INFO:teuthology.orchestra.run.smithi089.stdout:damaged 2024-09-13T03:00:40.262 INFO:teuthology.orchestra.run.smithi089.stdout:stopped 2024-09-13T03:00:40.262 INFO:teuthology.orchestra.run.smithi089.stdout:data_pools [3] 2024-09-13T03:00:40.262 INFO:teuthology.orchestra.run.smithi089.stdout:metadata_pool 2 2024-09-13T03:00:40.262 INFO:teuthology.orchestra.run.smithi089.stdout:inline_data disabled 2024-09-13T03:00:40.262 INFO:teuthology.orchestra.run.smithi089.stdout:balancer 2024-09-13T03:00:40.262 INFO:teuthology.orchestra.run.smithi089.stdout:bal_rank_mask -1 2024-09-13T03:00:40.263 INFO:teuthology.orchestra.run.smithi089.stdout:standby_count_wanted 1 2024-09-13T03:00:40.263 INFO:teuthology.orchestra.run.smithi089.stdout:qdb_cluster leader: 14480 members: 24257,14480 2024-09-13T03:00:40.263 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi089.rarddb{0:14480} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.89:6828/1561365213,v1:172.21.15.89:6829/1561365213] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T03:00:40.263 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi089.qjoitb{0:14488} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.89:6826/1464393547,v1:172.21.15.89:6827/1464393547] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T03:00:40.263 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi131.uasrkg{1:24257} state up:active seq 4 join_fscid=1 addr [v2:172.21.15.131:6824/260493836,v1:172.21.15.131:6825/260493836] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T03:00:40.263 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi131.rbovzc{1:24265} state up:standby-replay seq 2 join_fscid=1 addr [v2:172.21.15.131:6826/665579373,v1:172.21.15.131:6827/665579373] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T03:00:40.263 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T03:00:40.263 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T03:00:40.264 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 23 2024-09-13T03:00:40.264 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.261+0000 7f2fb0a7c640 1 -- 172.21.15.89:0/3693332050 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f2f9406e530 msgr2=0x7f2f940709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:40.264 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.261+0000 7f2fb0a7c640 1 --2- 172.21.15.89:0/3693332050 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f2f9406e530 0x7f2f940709e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2fa0000c00 tx=0x7f2fa0035040 comp rx=0 tx=0).stop 2024-09-13T03:00:40.264 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.261+0000 7f2fb0a7c640 1 -- 172.21.15.89:0/3693332050 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fac0fdbc0 msgr2=0x7f2fac10d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:40.264 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.261+0000 7f2fb0a7c640 1 --2- 172.21.15.89:0/3693332050 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fac0fdbc0 0x7f2fac10d100 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c002a50 tx=0x7f2f9c004600 comp rx=0 tx=0).stop 2024-09-13T03:00:40.264 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.261+0000 7f2fb0a7c640 1 -- 172.21.15.89:0/3693332050 shutdown_connections 2024-09-13T03:00:40.264 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.261+0000 7f2fb0a7c640 1 --2- 172.21.15.89:0/3693332050 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f2f9406e530 0x7f2f940709e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:40.264 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.261+0000 7f2fb0a7c640 1 --2- 172.21.15.89:0/3693332050 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2fac0fe510 0x7f2fac10d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:40.264 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.261+0000 7f2fb0a7c640 1 --2- 172.21.15.89:0/3693332050 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2fac0fdbc0 0x7f2fac10d100 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:40.264 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.261+0000 7f2fb0a7c640 1 -- 172.21.15.89:0/3693332050 >> 172.21.15.89:0/3693332050 conn(0x7f2fac0f63c0 msgr2=0x7f2fac0f7bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:00:40.264 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.261+0000 7f2fb0a7c640 1 -- 172.21.15.89:0/3693332050 shutdown_connections 2024-09-13T03:00:40.264 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.261+0000 7f2fb0a7c640 1 -- 172.21.15.89:0/3693332050 wait complete. 2024-09-13T03:00:40.342 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.340+0000 7f2a4c695640 1 -- 172.21.15.89:0/935810953 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a440ff720 msgr2=0x7f2a44101b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:40.343 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.340+0000 7f2a4c695640 1 --2- 172.21.15.89:0/935810953 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a440ff720 0x7f2a44101b00 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f2a400048d0 tx=0x7f2a40009da0 comp rx=0 tx=0).stop 2024-09-13T03:00:40.343 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.340+0000 7f2a4c695640 1 -- 172.21.15.89:0/935810953 shutdown_connections 2024-09-13T03:00:40.343 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.340+0000 7f2a4c695640 1 --2- 172.21.15.89:0/935810953 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a440ff720 0x7f2a44101b00 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:40.343 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.340+0000 7f2a4c695640 1 --2- 172.21.15.89:0/935810953 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2a440666b0 0x7f2a440ff1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:40.343 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.340+0000 7f2a4c695640 1 -- 172.21.15.89:0/935810953 >> 172.21.15.89:0/935810953 conn(0x7f2a440f6c10 msgr2=0x7f2a440f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:00:40.343 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.340+0000 7f2a4c695640 1 -- 172.21.15.89:0/935810953 shutdown_connections 2024-09-13T03:00:40.343 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.340+0000 7f2a4c695640 1 -- 172.21.15.89:0/935810953 wait complete. 2024-09-13T03:00:40.343 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.340+0000 7f2a4c695640 1 Processor -- start 2024-09-13T03:00:40.343 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.340+0000 7f2a4c695640 1 -- start start 2024-09-13T03:00:40.343 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.341+0000 7f2a4c695640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a440666b0 0x7f2a4410d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:40.343 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.341+0000 7f2a4c695640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2a440ff720 0x7f2a4410d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:40.343 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.341+0000 7f2a4c695640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a4410dc70 con 0x7f2a440666b0 2024-09-13T03:00:40.344 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.341+0000 7f2a4c695640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a4410e490 con 0x7f2a440ff720 2024-09-13T03:00:40.344 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.341+0000 7f2a4a431640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a440666b0 0x7f2a4410d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:00:40.344 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.341+0000 7f2a4a431640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a440666b0 0x7f2a4410d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:37836/0 (socket says 172.21.15.89:37836) 2024-09-13T03:00:40.344 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.341+0000 7f2a4a431640 1 -- 172.21.15.89:0/3934913548 learned_addr learned my addr 172.21.15.89:0/3934913548 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T03:00:40.344 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.341+0000 7f2a49c30640 1 --2- 172.21.15.89:0/3934913548 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2a440ff720 0x7f2a4410d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:00:40.344 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.341+0000 7f2a4a431640 1 -- 172.21.15.89:0/3934913548 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2a440ff720 msgr2=0x7f2a4410d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:40.344 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.341+0000 7f2a4a431640 1 --2- 172.21.15.89:0/3934913548 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2a440ff720 0x7f2a4410d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:40.344 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.341+0000 7f2a4a431640 1 -- 172.21.15.89:0/3934913548 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a40005040 con 0x7f2a440666b0 2024-09-13T03:00:40.344 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.341+0000 7f2a4a431640 1 --2- 172.21.15.89:0/3934913548 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a440666b0 0x7f2a4410d0e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f2a38002a80 tx=0x7f2a38004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:00:40.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.342+0000 7f2a36ffd640 1 -- 172.21.15.89:0/3934913548 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2a38007c30 con 0x7f2a440666b0 2024-09-13T03:00:40.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.342+0000 7f2a36ffd640 1 -- 172.21.15.89:0/3934913548 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f2a3800f040 con 0x7f2a440666b0 2024-09-13T03:00:40.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.342+0000 7f2a4c695640 1 -- 172.21.15.89:0/3934913548 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a4410e720 con 0x7f2a440666b0 2024-09-13T03:00:40.345 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.342+0000 7f2a36ffd640 1 -- 172.21.15.89:0/3934913548 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2a3800dad0 con 0x7f2a440666b0 2024-09-13T03:00:40.346 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.342+0000 7f2a4c695640 1 -- 172.21.15.89:0/3934913548 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a4410ec90 con 0x7f2a440666b0 2024-09-13T03:00:40.346 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.343+0000 7f2a34ff9640 1 -- 172.21.15.89:0/3934913548 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a2c005210 con 0x7f2a440666b0 2024-09-13T03:00:40.346 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.343+0000 7f2a36ffd640 1 -- 172.21.15.89:0/3934913548 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f2a3800dc30 con 0x7f2a440666b0 2024-09-13T03:00:40.346 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.344+0000 7f2a36ffd640 1 --2- 172.21.15.89:0/3934913548 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f2a3006e530 0x7f2a300709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:40.346 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.344+0000 7f2a36ffd640 1 -- 172.21.15.89:0/3934913548 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f2a3808dff0 con 0x7f2a440666b0 2024-09-13T03:00:40.346 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.344+0000 7f2a49c30640 1 --2- 172.21.15.89:0/3934913548 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f2a3006e530 0x7f2a300709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:00:40.346 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.344+0000 7f2a49c30640 1 --2- 172.21.15.89:0/3934913548 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f2a3006e530 0x7f2a300709e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2a40000c00 tx=0x7f2a40035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:00:40.349 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.348+0000 7f2a36ffd640 1 -- 172.21.15.89:0/3934913548 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f2a380570e0 con 0x7f2a440666b0 2024-09-13T03:00:40.530 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.529+0000 7f2a34ff9640 1 -- 172.21.15.89:0/3934913548 --> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2a2c000bc0 con 0x7f2a3006e530 2024-09-13T03:00:40.531 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.530+0000 7f2a36ffd640 1 -- 172.21.15.89:0/3934913548 <== mgr.34104 v2:172.21.15.89:6800/1881577856 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f2a2c000bc0 con 0x7f2a3006e530 2024-09-13T03:00:40.532 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-13T03:00:40.532 INFO:teuthology.orchestra.run.smithi089.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d", 2024-09-13T03:00:40.532 INFO:teuthology.orchestra.run.smithi089.stdout: "in_progress": true, 2024-09-13T03:00:40.532 INFO:teuthology.orchestra.run.smithi089.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T03:00:40.532 INFO:teuthology.orchestra.run.smithi089.stdout: "services_complete": [ 2024-09-13T03:00:40.532 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr", 2024-09-13T03:00:40.532 INFO:teuthology.orchestra.run.smithi089.stdout: "osd", 2024-09-13T03:00:40.532 INFO:teuthology.orchestra.run.smithi089.stdout: "crash", 2024-09-13T03:00:40.532 INFO:teuthology.orchestra.run.smithi089.stdout: "mon" 2024-09-13T03:00:40.533 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-13T03:00:40.533 INFO:teuthology.orchestra.run.smithi089.stdout: "progress": "12/21 daemons upgraded", 2024-09-13T03:00:40.533 INFO:teuthology.orchestra.run.smithi089.stdout: "message": "Currently upgrading osd daemons", 2024-09-13T03:00:40.533 INFO:teuthology.orchestra.run.smithi089.stdout: "is_paused": false 2024-09-13T03:00:40.533 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-13T03:00:40.534 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.532+0000 7f2a34ff9640 1 -- 172.21.15.89:0/3934913548 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f2a3006e530 msgr2=0x7f2a300709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:40.534 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.532+0000 7f2a34ff9640 1 --2- 172.21.15.89:0/3934913548 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f2a3006e530 0x7f2a300709e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2a40000c00 tx=0x7f2a40035040 comp rx=0 tx=0).stop 2024-09-13T03:00:40.534 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.532+0000 7f2a34ff9640 1 -- 172.21.15.89:0/3934913548 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a440666b0 msgr2=0x7f2a4410d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:40.534 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.532+0000 7f2a34ff9640 1 --2- 172.21.15.89:0/3934913548 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a440666b0 0x7f2a4410d0e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f2a38002a80 tx=0x7f2a38004570 comp rx=0 tx=0).stop 2024-09-13T03:00:40.534 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.532+0000 7f2a34ff9640 1 -- 172.21.15.89:0/3934913548 shutdown_connections 2024-09-13T03:00:40.535 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.532+0000 7f2a34ff9640 1 --2- 172.21.15.89:0/3934913548 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f2a3006e530 0x7f2a300709e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:40.535 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.532+0000 7f2a34ff9640 1 --2- 172.21.15.89:0/3934913548 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2a440ff720 0x7f2a4410d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:40.535 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.532+0000 7f2a34ff9640 1 --2- 172.21.15.89:0/3934913548 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2a440666b0 0x7f2a4410d0e0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:40.535 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.532+0000 7f2a34ff9640 1 -- 172.21.15.89:0/3934913548 >> 172.21.15.89:0/3934913548 conn(0x7f2a440f6c10 msgr2=0x7f2a440f7030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:00:40.535 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.533+0000 7f2a34ff9640 1 -- 172.21.15.89:0/3934913548 shutdown_connections 2024-09-13T03:00:40.535 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.533+0000 7f2a34ff9640 1 -- 172.21.15.89:0/3934913548 wait complete. 2024-09-13T03:00:40.614 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.612+0000 7f2f917ee640 1 -- 172.21.15.89:0/181394914 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f8c0fb450 msgr2=0x7f2f8c0fb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:40.614 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.612+0000 7f2f917ee640 1 --2- 172.21.15.89:0/181394914 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f8c0fb450 0x7f2f8c0fb860 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c0048d0 tx=0x7f2f7c009da0 comp rx=0 tx=0).stop 2024-09-13T03:00:40.614 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.612+0000 7f2f917ee640 1 -- 172.21.15.89:0/181394914 shutdown_connections 2024-09-13T03:00:40.614 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.612+0000 7f2f917ee640 1 --2- 172.21.15.89:0/181394914 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2f8c0fc720 0x7f2f8c0fcb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:40.614 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.612+0000 7f2f917ee640 1 --2- 172.21.15.89:0/181394914 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f8c0fb450 0x7f2f8c0fb860 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:40.614 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.612+0000 7f2f917ee640 1 -- 172.21.15.89:0/181394914 >> 172.21.15.89:0/181394914 conn(0x7f2f8c0f6c10 msgr2=0x7f2f8c0f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:00:40.614 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.612+0000 7f2f917ee640 1 -- 172.21.15.89:0/181394914 shutdown_connections 2024-09-13T03:00:40.614 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.612+0000 7f2f917ee640 1 -- 172.21.15.89:0/181394914 wait complete. 2024-09-13T03:00:40.616 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.613+0000 7f2f917ee640 1 Processor -- start 2024-09-13T03:00:40.616 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.613+0000 7f2f917ee640 1 -- start start 2024-09-13T03:00:40.616 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.613+0000 7f2f917ee640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f8c0fb450 0x7f2f8c10d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:40.616 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.613+0000 7f2f917ee640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2f8c0fc720 0x7f2f8c10d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:40.616 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.613+0000 7f2f917ee640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8c10dc30 con 0x7f2f8c0fb450 2024-09-13T03:00:40.616 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.613+0000 7f2f917ee640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8c10e450 con 0x7f2f8c0fc720 2024-09-13T03:00:40.617 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.613+0000 7f2f8affd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f8c0fb450 0x7f2f8c10d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:00:40.617 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.613+0000 7f2f8affd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f8c0fb450 0x7f2f8c10d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:37860/0 (socket says 172.21.15.89:37860) 2024-09-13T03:00:40.617 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.613+0000 7f2f8affd640 1 -- 172.21.15.89:0/2762574367 learned_addr learned my addr 172.21.15.89:0/2762574367 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T03:00:40.617 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.613+0000 7f2f8a7fc640 1 --2- 172.21.15.89:0/2762574367 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2f8c0fc720 0x7f2f8c10d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:00:40.617 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.613+0000 7f2f8affd640 1 -- 172.21.15.89:0/2762574367 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2f8c0fc720 msgr2=0x7f2f8c10d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:40.617 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.614+0000 7f2f8affd640 1 --2- 172.21.15.89:0/2762574367 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2f8c0fc720 0x7f2f8c10d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:40.617 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.614+0000 7f2f8affd640 1 -- 172.21.15.89:0/2762574367 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f7c005040 con 0x7f2f8c0fb450 2024-09-13T03:00:40.617 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.614+0000 7f2f8affd640 1 --2- 172.21.15.89:0/2762574367 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f8c0fb450 0x7f2f8c10d0a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c0048a0 tx=0x7f2f7c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:00:40.617 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.614+0000 7f2f737fe640 1 -- 172.21.15.89:0/2762574367 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f7c038070 con 0x7f2f8c0fb450 2024-09-13T03:00:40.617 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.614+0000 7f2f917ee640 1 -- 172.21.15.89:0/2762574367 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f8c10e680 con 0x7f2f8c0fb450 2024-09-13T03:00:40.617 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.614+0000 7f2f917ee640 1 -- 172.21.15.89:0/2762574367 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f8c10ec20 con 0x7f2f8c0fb450 2024-09-13T03:00:40.617 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.614+0000 7f2f737fe640 1 -- 172.21.15.89:0/2762574367 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f2f7c004290 con 0x7f2f8c0fb450 2024-09-13T03:00:40.618 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.614+0000 7f2f737fe640 1 -- 172.21.15.89:0/2762574367 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f7c033660 con 0x7f2f8c0fb450 2024-09-13T03:00:40.618 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.615+0000 7f2f917ee640 1 -- 172.21.15.89:0/2762574367 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f8c0fa8b0 con 0x7f2f8c0fb450 2024-09-13T03:00:40.619 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.616+0000 7f2f737fe640 1 -- 172.21.15.89:0/2762574367 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f2f7c030020 con 0x7f2f8c0fb450 2024-09-13T03:00:40.619 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.616+0000 7f2f737fe640 1 --2- 172.21.15.89:0/2762574367 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f2f7406e530 0x7f2f740709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:00:40.619 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.617+0000 7f2f737fe640 1 -- 172.21.15.89:0/2762574367 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f2f7c0ae2b0 con 0x7f2f8c0fb450 2024-09-13T03:00:40.619 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.617+0000 7f2f8a7fc640 1 --2- 172.21.15.89:0/2762574367 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f2f7406e530 0x7f2f740709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:00:40.619 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.617+0000 7f2f8a7fc640 1 --2- 172.21.15.89:0/2762574367 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f2f7406e530 0x7f2f740709e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2f8c10ce50 tx=0x7f2f8000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:00:40.622 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.621+0000 7f2f737fe640 1 -- 172.21.15.89:0/2762574367 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f2f7c077420 con 0x7f2f8c0fb450 2024-09-13T03:00:40.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.853+0000 7f2f917ee640 1 -- 172.21.15.89:0/2762574367 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f2f8c04b720 con 0x7f2f8c0fb450 2024-09-13T03:00:40.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.853+0000 7f2f737fe640 1 -- 172.21.15.89:0/2762574367 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1290 (secure 0 0 0) 0x7f2f7c02c870 con 0x7f2f8c0fb450 2024-09-13T03:00:40.856 INFO:teuthology.orchestra.run.smithi089.stdout:HEALTH_WARN 1 osds down; all OSDs are running squid or later but require_osd_release < squid; Degraded data redundancy: 54/357 objects degraded (15.126%), 14 pgs degraded 2024-09-13T03:00:40.857 INFO:teuthology.orchestra.run.smithi089.stdout:[WRN] OSD_DOWN: 1 osds down 2024-09-13T03:00:40.857 INFO:teuthology.orchestra.run.smithi089.stdout: osd.5 (root=default,host=smithi131) is down 2024-09-13T03:00:40.857 INFO:teuthology.orchestra.run.smithi089.stdout:[WRN] OSD_UPGRADE_FINISHED: all OSDs are running squid or later but require_osd_release < squid 2024-09-13T03:00:40.857 INFO:teuthology.orchestra.run.smithi089.stdout: all OSDs are running squid or later but require_osd_release < squid 2024-09-13T03:00:40.857 INFO:teuthology.orchestra.run.smithi089.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 54/357 objects degraded (15.126%), 14 pgs degraded 2024-09-13T03:00:40.857 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.2 is active+undersized+degraded, acting [1,0] 2024-09-13T03:00:40.857 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.3 is active+undersized+degraded, acting [2,1] 2024-09-13T03:00:40.857 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.8 is active+undersized+degraded, acting [3,0] 2024-09-13T03:00:40.857 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.b is active+undersized+degraded, acting [3,4] 2024-09-13T03:00:40.857 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.f is active+undersized+degraded, acting [4,0] 2024-09-13T03:00:40.857 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.14 is active+undersized+degraded, acting [3,4] 2024-09-13T03:00:40.857 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.16 is active+undersized+degraded, acting [3,2] 2024-09-13T03:00:40.857 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.17 is active+undersized+degraded, acting [2,1] 2024-09-13T03:00:40.858 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.18 is active+undersized+degraded, acting [4,3] 2024-09-13T03:00:40.858 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.1a is active+undersized+degraded, acting [3,4] 2024-09-13T03:00:40.858 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.1b is active+undersized+degraded, acting [1,0] 2024-09-13T03:00:40.858 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.1c is active+undersized+degraded, acting [4,2] 2024-09-13T03:00:40.858 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.1d is active+undersized+degraded, acting [3,0] 2024-09-13T03:00:40.858 INFO:teuthology.orchestra.run.smithi089.stdout: pg 2.1e is active+undersized+degraded, acting [2,0] 2024-09-13T03:00:40.858 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.855+0000 7f2f917ee640 1 -- 172.21.15.89:0/2762574367 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f2f7406e530 msgr2=0x7f2f740709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:40.858 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.855+0000 7f2f917ee640 1 --2- 172.21.15.89:0/2762574367 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f2f7406e530 0x7f2f740709e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f2f8c10ce50 tx=0x7f2f8000b040 comp rx=0 tx=0).stop 2024-09-13T03:00:40.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.855+0000 7f2f917ee640 1 -- 172.21.15.89:0/2762574367 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f8c0fb450 msgr2=0x7f2f8c10d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:00:40.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.855+0000 7f2f917ee640 1 --2- 172.21.15.89:0/2762574367 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f8c0fb450 0x7f2f8c10d0a0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c0048a0 tx=0x7f2f7c009da0 comp rx=0 tx=0).stop 2024-09-13T03:00:40.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.855+0000 7f2f917ee640 1 -- 172.21.15.89:0/2762574367 shutdown_connections 2024-09-13T03:00:40.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.855+0000 7f2f917ee640 1 --2- 172.21.15.89:0/2762574367 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f2f7406e530 0x7f2f740709e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:40.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.855+0000 7f2f917ee640 1 --2- 172.21.15.89:0/2762574367 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f2f8c0fc720 0x7f2f8c10d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:40.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.855+0000 7f2f917ee640 1 --2- 172.21.15.89:0/2762574367 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f2f8c0fb450 0x7f2f8c10d0a0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:00:40.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.855+0000 7f2f917ee640 1 -- 172.21.15.89:0/2762574367 >> 172.21.15.89:0/2762574367 conn(0x7f2f8c0f6c10 msgr2=0x7f2f8c066140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:00:40.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.855+0000 7f2f917ee640 1 -- 172.21.15.89:0/2762574367 shutdown_connections 2024-09-13T03:00:40.859 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:00:40.855+0000 7f2f917ee640 1 -- 172.21.15.89:0/2762574367 wait complete. 2024-09-13T03:00:41.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:40 smithi131 ceph-mon[78839]: from='client.? 172.21.15.89:0/1991541664' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:00:41.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:40 smithi131 ceph-mon[78839]: from='client.? 172.21.15.89:0/3693332050' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T03:00:41.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:40 smithi131 ceph-mon[78839]: from='client.34368 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T03:00:41.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:40 smithi131 ceph-mon[78839]: from='client.? 172.21.15.89:0/2762574367' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T03:00:41.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:40 smithi089 ceph-mon[91553]: from='client.? 172.21.15.89:0/1991541664' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:00:41.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:40 smithi089 ceph-mon[91553]: from='client.? 172.21.15.89:0/3693332050' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T03:00:41.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:40 smithi089 ceph-mon[91553]: from='client.34368 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T03:00:41.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:40 smithi089 ceph-mon[91553]: from='client.? 172.21.15.89:0/2762574367' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T03:00:42.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:41 smithi089 ceph-mon[91553]: pgmap v153: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 306 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 54/357 objects degraded (15.126%) 2024-09-13T03:00:42.355 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:41 smithi131 ceph-mon[78839]: pgmap v153: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 306 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 54/357 objects degraded (15.126%) 2024-09-13T03:00:43.684 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 03:00:43 smithi131 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-5[98656]: 2024-09-13T03:00:43.300+0000 7f05f55f8640 -1 osd.5 72 log_to_monitors true 2024-09-13T03:00:44.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:43 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:00:44.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:43 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:00:44.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:43 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T03:00:44.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:43 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T03:00:44.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:43 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:00:44.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:43 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:00:44.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:43 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:00:44.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:43 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:00:44.037 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:43 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:00:44.037 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:43 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:00:44.037 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:43 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:00:44.037 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:43 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-09-13T03:00:44.037 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:43 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-09-13T03:00:44.037 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:43 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-09-13T03:00:44.037 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:43 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-09-13T03:00:44.037 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:43 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-09-13T03:00:44.037 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:43 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-09-13T03:00:44.037 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:43 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-09-13T03:00:44.037 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:43 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-09-13T03:00:44.037 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:43 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-09-13T03:00:44.037 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:43 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-09-13T03:00:44.037 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:43 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-09-13T03:00:44.038 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:43 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-09-13T03:00:44.038 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:43 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-09-13T03:00:44.038 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:43 smithi089 ceph-mon[91553]: from='osd.5 [v2:172.21.15.131:6816/3578092108,v1:172.21.15.131:6817/3578092108]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T03:00:44.038 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:43 smithi089 ceph-mon[91553]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T03:00:44.184 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 03:00:43 smithi131 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-5[98656]: 2024-09-13T03:00:43.883+0000 7f05ed392640 -1 osd.5 72 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-13T03:00:44.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:43 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:00:44.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:43 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:00:44.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:43 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T03:00:44.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:43 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T03:00:44.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:43 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:00:44.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:43 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:00:44.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:43 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:00:44.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:43 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:00:44.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:43 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:00:44.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:43 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:00:44.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:43 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:00:44.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:43 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-09-13T03:00:44.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:43 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-09-13T03:00:44.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:43 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-09-13T03:00:44.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:43 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-09-13T03:00:44.186 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:43 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-09-13T03:00:44.186 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:43 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-09-13T03:00:44.186 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:43 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-09-13T03:00:44.186 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:43 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-09-13T03:00:44.186 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:43 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-09-13T03:00:44.186 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:43 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-09-13T03:00:44.186 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:43 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-09-13T03:00:44.186 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:43 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-09-13T03:00:44.186 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:43 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd require-osd-release", "release": "squid"}]: dispatch 2024-09-13T03:00:44.186 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:43 smithi131 ceph-mon[78839]: from='osd.5 [v2:172.21.15.131:6816/3578092108,v1:172.21.15.131:6817/3578092108]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T03:00:44.186 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:43 smithi131 ceph-mon[78839]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-13T03:00:44.953 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:44 smithi131 ceph-mon[78839]: Upgrade: Setting container_image for all osd 2024-09-13T03:00:44.953 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:44 smithi131 ceph-mon[78839]: Upgrade: Setting require_osd_release to 19 squid 2024-09-13T03:00:44.954 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:44 smithi131 ceph-mon[78839]: pgmap v154: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 306 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 54/357 objects degraded (15.126%) 2024-09-13T03:00:44.954 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:44 smithi131 ceph-mon[78839]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-09-13T03:00:44.954 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:44 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-09-13T03:00:44.954 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:44 smithi131 ceph-mon[78839]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-13T03:00:44.954 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:44 smithi131 ceph-mon[78839]: from='osd.5 [v2:172.21.15.131:6816/3578092108,v1:172.21.15.131:6817/3578092108]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]: dispatch 2024-09-13T03:00:44.954 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:44 smithi131 ceph-mon[78839]: osdmap e75: 6 total, 5 up, 6 in 2024-09-13T03:00:44.954 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:44 smithi131 ceph-mon[78839]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]: dispatch 2024-09-13T03:00:44.954 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:44 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:00:44.954 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:44 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]: dispatch 2024-09-13T03:00:45.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:44 smithi089 ceph-mon[91553]: Upgrade: Setting container_image for all osd 2024-09-13T03:00:45.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:44 smithi089 ceph-mon[91553]: Upgrade: Setting require_osd_release to 19 squid 2024-09-13T03:00:45.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:44 smithi089 ceph-mon[91553]: pgmap v154: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 306 MiB data, 1.4 GiB used, 535 GiB / 536 GiB avail; 54/357 objects degraded (15.126%) 2024-09-13T03:00:45.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:44 smithi089 ceph-mon[91553]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running squid or later but require_osd_release < squid) 2024-09-13T03:00:45.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:44 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd='[{"prefix": "osd require-osd-release", "release": "squid"}]': finished 2024-09-13T03:00:45.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:44 smithi089 ceph-mon[91553]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-13T03:00:45.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:44 smithi089 ceph-mon[91553]: from='osd.5 [v2:172.21.15.131:6816/3578092108,v1:172.21.15.131:6817/3578092108]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]: dispatch 2024-09-13T03:00:45.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:44 smithi089 ceph-mon[91553]: osdmap e75: 6 total, 5 up, 6 in 2024-09-13T03:00:45.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:44 smithi089 ceph-mon[91553]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi131", "root=default"]}]: dispatch 2024-09-13T03:00:45.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:44 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:00:45.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:44 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]: dispatch 2024-09-13T03:00:46.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:45 smithi089 ceph-mon[91553]: Upgrade: Disabling standby-replay for filesystem cephfs 2024-09-13T03:00:46.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:45 smithi089 ceph-mon[91553]: osdmap e76: 6 total, 5 up, 6 in 2024-09-13T03:00:46.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:45 smithi089 ceph-mon[91553]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-09-13T03:00:46.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:45 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]': finished 2024-09-13T03:00:46.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:45 smithi089 ceph-mon[91553]: fsmap cephfs:2 {0=cephfs.smithi089.rarddb=up:active,1=cephfs.smithi131.uasrkg=up:active} 2024-09-13T03:00:46.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:45 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:00:46.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:45 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T03:00:46.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:45 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T03:00:46.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:45 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:00:46.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:45 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:00:46.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:45 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:00:46.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:45 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:00:46.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:45 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:00:46.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:45 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:00:46.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:45 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:00:46.037 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:45 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-09-13T03:00:46.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:45 smithi131 ceph-mon[78839]: Upgrade: Disabling standby-replay for filesystem cephfs 2024-09-13T03:00:46.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:45 smithi131 ceph-mon[78839]: osdmap e76: 6 total, 5 up, 6 in 2024-09-13T03:00:46.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:45 smithi131 ceph-mon[78839]: Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-09-13T03:00:46.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:45 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "0"}]': finished 2024-09-13T03:00:46.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:45 smithi131 ceph-mon[78839]: fsmap cephfs:2 {0=cephfs.smithi089.rarddb=up:active,1=cephfs.smithi131.uasrkg=up:active} 2024-09-13T03:00:46.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:45 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:00:46.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:45 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T03:00:46.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:45 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T03:00:46.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:45 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:00:46.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:45 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:00:46.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:45 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:00:46.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:45 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:00:46.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:45 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:00:46.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:45 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:00:46.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:45 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:00:46.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:45 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]: dispatch 2024-09-13T03:00:47.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:46 smithi089 ceph-mon[91553]: Upgrade: Scaling down filesystem cephfs 2024-09-13T03:00:47.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:46 smithi089 ceph-mon[91553]: pgmap v157: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 306 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s; 54/357 objects degraded (15.126%) 2024-09-13T03:00:47.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:46 smithi089 ceph-mon[91553]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T03:00:47.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:46 smithi089 ceph-mon[91553]: osd.5 [v2:172.21.15.131:6816/3578092108,v1:172.21.15.131:6817/3578092108] boot 2024-09-13T03:00:47.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:46 smithi089 ceph-mon[91553]: osdmap e77: 6 total, 6 up, 6 in 2024-09-13T03:00:47.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:46 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T03:00:47.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:46 smithi089 ceph-mon[91553]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-09-13T03:00:47.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:46 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-09-13T03:00:47.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:46 smithi089 ceph-mon[91553]: mds.? [v2:172.21.15.131:6826/1074022424,v1:172.21.15.131:6827/1074022424] up:boot 2024-09-13T03:00:47.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:46 smithi089 ceph-mon[91553]: mds.? [v2:172.21.15.89:6826/3159647567,v1:172.21.15.89:6827/3159647567] up:boot 2024-09-13T03:00:47.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:46 smithi089 ceph-mon[91553]: stopping daemon mds.cephfs.smithi131.uasrkg 2024-09-13T03:00:47.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:46 smithi089 ceph-mon[91553]: fsmap cephfs:2 {0=cephfs.smithi089.rarddb=up:active,1=cephfs.smithi131.uasrkg=up:active} 2 up:standby 2024-09-13T03:00:47.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:46 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi089.qjoitb"}]: dispatch 2024-09-13T03:00:47.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:46 smithi089 ceph-mon[91553]: fsmap cephfs:2 {0=cephfs.smithi089.rarddb=up:active,1=cephfs.smithi131.uasrkg=up:stopping} 2 up:standby 2024-09-13T03:00:47.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:46 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi131.rbovzc"}]: dispatch 2024-09-13T03:00:47.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:46 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:00:47.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:46 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi089.qjoitb"}]: dispatch 2024-09-13T03:00:47.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:46 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T03:00:47.037 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:46 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T03:00:47.037 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:46 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:00:47.037 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:46 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:00:47.037 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:46 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:00:47.037 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:46 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:00:47.037 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:46 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:00:47.037 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:46 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:00:47.037 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:46 smithi089 ceph-mon[91553]: osdmap e78: 6 total, 6 up, 6 in 2024-09-13T03:00:47.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:46 smithi131 ceph-mon[78839]: Upgrade: Scaling down filesystem cephfs 2024-09-13T03:00:47.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:46 smithi131 ceph-mon[78839]: pgmap v157: 65 pgs: 14 active+undersized, 14 active+undersized+degraded, 37 active+clean; 306 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s rd, 3 op/s; 54/357 objects degraded (15.126%) 2024-09-13T03:00:47.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:46 smithi131 ceph-mon[78839]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-09-13T03:00:47.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:46 smithi131 ceph-mon[78839]: osd.5 [v2:172.21.15.131:6816/3578092108,v1:172.21.15.131:6817/3578092108] boot 2024-09-13T03:00:47.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:46 smithi131 ceph-mon[78839]: osdmap e77: 6 total, 6 up, 6 in 2024-09-13T03:00:47.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:46 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-13T03:00:47.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:46 smithi131 ceph-mon[78839]: Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-09-13T03:00:47.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:46 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]': finished 2024-09-13T03:00:47.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:46 smithi131 ceph-mon[78839]: mds.? [v2:172.21.15.131:6826/1074022424,v1:172.21.15.131:6827/1074022424] up:boot 2024-09-13T03:00:47.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:46 smithi131 ceph-mon[78839]: mds.? [v2:172.21.15.89:6826/3159647567,v1:172.21.15.89:6827/3159647567] up:boot 2024-09-13T03:00:47.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:46 smithi131 ceph-mon[78839]: stopping daemon mds.cephfs.smithi131.uasrkg 2024-09-13T03:00:47.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:46 smithi131 ceph-mon[78839]: fsmap cephfs:2 {0=cephfs.smithi089.rarddb=up:active,1=cephfs.smithi131.uasrkg=up:active} 2 up:standby 2024-09-13T03:00:47.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:46 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi089.qjoitb"}]: dispatch 2024-09-13T03:00:47.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:46 smithi131 ceph-mon[78839]: fsmap cephfs:2 {0=cephfs.smithi089.rarddb=up:active,1=cephfs.smithi131.uasrkg=up:stopping} 2 up:standby 2024-09-13T03:00:47.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:46 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi131.rbovzc"}]: dispatch 2024-09-13T03:00:47.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:46 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:00:47.186 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:46 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi089.qjoitb"}]: dispatch 2024-09-13T03:00:47.186 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:46 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T03:00:47.186 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:46 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T03:00:47.186 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:46 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:00:47.186 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:46 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:00:47.186 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:46 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:00:47.186 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:46 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:00:47.186 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:46 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:00:47.186 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:46 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:00:47.186 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:46 smithi131 ceph-mon[78839]: osdmap e78: 6 total, 6 up, 6 in 2024-09-13T03:00:48.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:47 smithi089 ceph-mon[91553]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-09-13T03:00:48.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:47 smithi131 ceph-mon[78839]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-09-13T03:00:49.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:48 smithi089 ceph-mon[91553]: pgmap v160: 65 pgs: 7 peering, 12 active+undersized, 9 active+undersized+degraded, 37 active+clean; 306 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 4 op/s; 27/357 objects degraded (7.563%) 2024-09-13T03:00:49.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:48 smithi089 ceph-mon[91553]: Health check update: Degraded data redundancy: 27/357 objects degraded (7.563%), 9 pgs degraded (PG_DEGRADED) 2024-09-13T03:00:49.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:48 smithi131 ceph-mon[78839]: pgmap v160: 65 pgs: 7 peering, 12 active+undersized, 9 active+undersized+degraded, 37 active+clean; 306 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 2.2 KiB/s rd, 4 op/s; 27/357 objects degraded (7.563%) 2024-09-13T03:00:49.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:48 smithi131 ceph-mon[78839]: Health check update: Degraded data redundancy: 27/357 objects degraded (7.563%), 9 pgs degraded (PG_DEGRADED) 2024-09-13T03:00:51.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:50 smithi089 ceph-mon[91553]: pgmap v161: 65 pgs: 7 peering, 3 active+undersized, 2 active+undersized+degraded, 53 active+clean; 306 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 6/357 objects degraded (1.681%) 2024-09-13T03:00:51.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:50 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:00:51.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:50 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:00:51.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:50 smithi131 ceph-mon[78839]: pgmap v161: 65 pgs: 7 peering, 3 active+undersized, 2 active+undersized+degraded, 53 active+clean; 306 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 0 op/s; 6/357 objects degraded (1.681%) 2024-09-13T03:00:51.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:50 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:00:51.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:50 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:00:52.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:51 smithi089 ceph-mon[91553]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 6/357 objects degraded (1.681%), 2 pgs degraded) 2024-09-13T03:00:52.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:51 smithi089 ceph-mon[91553]: Cluster is now healthy 2024-09-13T03:00:52.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:51 smithi131 ceph-mon[78839]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 6/357 objects degraded (1.681%), 2 pgs degraded) 2024-09-13T03:00:52.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:51 smithi131 ceph-mon[78839]: Cluster is now healthy 2024-09-13T03:00:53.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:52 smithi089 ceph-mon[91553]: pgmap v162: 65 pgs: 65 active+clean; 306 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 446 B/s wr, 1 op/s 2024-09-13T03:00:53.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:52 smithi131 ceph-mon[78839]: pgmap v162: 65 pgs: 65 active+clean; 306 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 446 B/s wr, 1 op/s 2024-09-13T03:00:55.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:54 smithi089 ceph-mon[91553]: pgmap v163: 65 pgs: 65 active+clean; 306 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 383 B/s wr, 0 op/s 2024-09-13T03:00:55.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:54 smithi131 ceph-mon[78839]: pgmap v163: 65 pgs: 65 active+clean; 306 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 383 B/s wr, 0 op/s 2024-09-13T03:00:57.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:56 smithi131 ceph-mon[78839]: pgmap v164: 65 pgs: 65 active+clean; 302 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 414 B/s wr, 1 op/s 2024-09-13T03:00:57.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:56 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:00:57.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:56 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T03:00:57.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:56 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T03:00:57.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:56 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:00:57.186 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:56 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:00:57.186 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:56 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:00:57.186 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:56 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:00:57.186 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:56 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:00:57.186 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:56 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:00:57.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:56 smithi089 ceph-mon[91553]: pgmap v164: 65 pgs: 65 active+clean; 302 MiB data, 1.2 GiB used, 535 GiB / 536 GiB avail; 414 B/s wr, 1 op/s 2024-09-13T03:00:57.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:56 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:00:57.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:56 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T03:00:57.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:56 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T03:00:57.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:56 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:00:57.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:56 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:00:57.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:56 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:00:57.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:56 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:00:57.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:56 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:00:57.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:56 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:00:58.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:57 smithi131 ceph-mon[78839]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-09-13T03:00:58.186 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:57 smithi089 ceph-mon[91553]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-09-13T03:00:59.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:00:58 smithi131 ceph-mon[78839]: pgmap v165: 65 pgs: 65 active+clean; 278 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 658 B/s wr, 4 op/s 2024-09-13T03:00:59.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:00:58 smithi089 ceph-mon[91553]: pgmap v165: 65 pgs: 65 active+clean; 278 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 658 B/s wr, 4 op/s 2024-09-13T03:01:01.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:00 smithi131 ceph-mon[78839]: pgmap v166: 65 pgs: 65 active+clean; 270 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s wr, 5 op/s 2024-09-13T03:01:01.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:00 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:01:01.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:00 smithi089 ceph-mon[91553]: pgmap v166: 65 pgs: 65 active+clean; 270 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.1 KiB/s wr, 5 op/s 2024-09-13T03:01:01.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:00 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:01:03.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:02 smithi131 ceph-mon[78839]: pgmap v167: 65 pgs: 65 active+clean; 202 MiB data, 983 MiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1.1 KiB/s wr, 7 op/s 2024-09-13T03:01:03.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:02 smithi089 ceph-mon[91553]: pgmap v167: 65 pgs: 65 active+clean; 202 MiB data, 983 MiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 1.1 KiB/s wr, 7 op/s 2024-09-13T03:01:05.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:04 smithi131 ceph-mon[78839]: pgmap v168: 65 pgs: 65 active+clean; 194 MiB data, 943 MiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 853 B/s wr, 7 op/s 2024-09-13T03:01:05.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:04 smithi089 ceph-mon[91553]: pgmap v168: 65 pgs: 65 active+clean; 194 MiB data, 943 MiB used, 535 GiB / 536 GiB avail; 0 B/s rd, 853 B/s wr, 7 op/s 2024-09-13T03:01:06.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:06 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:01:06.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:06 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:01:06.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:06 smithi131 ceph-mon[78839]: pgmap v169: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1023 B/s wr, 8 op/s 2024-09-13T03:01:06.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:06 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:01:06.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:06 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T03:01:06.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:06 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T03:01:06.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:06 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:01:07.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:06 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:01:07.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:06 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:01:07.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:06 smithi089 ceph-mon[91553]: pgmap v169: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 1023 B/s wr, 8 op/s 2024-09-13T03:01:07.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:06 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:01:07.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:06 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T03:01:07.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:06 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T03:01:07.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:06 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:01:07.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:07 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:01:07.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:07 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:01:07.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:07 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:01:07.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:07 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:01:07.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:07 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:01:07.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:07 smithi131 ceph-mon[78839]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-09-13T03:01:08.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:07 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:01:08.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:07 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:01:08.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:07 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:01:08.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:07 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:01:08.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:07 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:01:08.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:07 smithi089 ceph-mon[91553]: Upgrade: Waiting for fs cephfs to scale down to reach 1 MDS 2024-09-13T03:01:08.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:08 smithi131 ceph-mon[78839]: pgmap v170: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 938 B/s wr, 7 op/s 2024-09-13T03:01:09.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:08 smithi089 ceph-mon[91553]: pgmap v170: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 938 B/s wr, 7 op/s 2024-09-13T03:01:09.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:09 smithi131 ceph-mon[78839]: daemon mds.cephfs.smithi131.uasrkg finished stopping rank 1 in filesystem cephfs (now has 1 ranks) 2024-09-13T03:01:10.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:09 smithi089 ceph-mon[91553]: daemon mds.cephfs.smithi131.uasrkg finished stopping rank 1 in filesystem cephfs (now has 1 ranks) 2024-09-13T03:01:10.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:10 smithi131 ceph-mon[78839]: pgmap v171: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 852 B/s wr, 3 op/s 2024-09-13T03:01:10.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:10 smithi131 ceph-mon[78839]: mds.1 [v2:172.21.15.131:6824/260493836,v1:172.21.15.131:6825/260493836] down:stopped 2024-09-13T03:01:10.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:10 smithi131 ceph-mon[78839]: fsmap cephfs:1 {0=cephfs.smithi089.rarddb=up:active} 2 up:standby 2024-09-13T03:01:10.947 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:10 smithi089 ceph-mon[91553]: pgmap v171: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 0 B/s rd, 852 B/s wr, 3 op/s 2024-09-13T03:01:10.947 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:10 smithi089 ceph-mon[91553]: mds.1 [v2:172.21.15.131:6824/260493836,v1:172.21.15.131:6825/260493836] down:stopped 2024-09-13T03:01:10.947 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:10 smithi089 ceph-mon[91553]: fsmap cephfs:1 {0=cephfs.smithi089.rarddb=up:active} 2 up:standby 2024-09-13T03:01:10.949 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:10.945+0000 7fe07febd640 1 -- 172.21.15.89:0/570162111 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0780fc700 msgr2=0x7fe0780fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:10.949 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:10.945+0000 7fe07febd640 1 --2- 172.21.15.89:0/570162111 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0780fc700 0x7fe0780fcb70 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fe0680048d0 tx=0x7fe068009da0 comp rx=0 tx=0).stop 2024-09-13T03:01:10.949 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:10.946+0000 7fe07febd640 1 -- 172.21.15.89:0/570162111 shutdown_connections 2024-09-13T03:01:10.949 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:10.946+0000 7fe07febd640 1 --2- 172.21.15.89:0/570162111 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0780fc700 0x7fe0780fcb70 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:10.950 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:10.946+0000 7fe07febd640 1 --2- 172.21.15.89:0/570162111 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe0780fb430 0x7fe0780fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:10.950 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:10.946+0000 7fe07febd640 1 -- 172.21.15.89:0/570162111 >> 172.21.15.89:0/570162111 conn(0x7fe0780f6c10 msgr2=0x7fe0780f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:01:10.950 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:10.946+0000 7fe07febd640 1 -- 172.21.15.89:0/570162111 shutdown_connections 2024-09-13T03:01:10.950 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:10.946+0000 7fe07febd640 1 -- 172.21.15.89:0/570162111 wait complete. 2024-09-13T03:01:10.950 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:10.946+0000 7fe07febd640 1 Processor -- start 2024-09-13T03:01:10.950 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:10.946+0000 7fe07febd640 1 -- start start 2024-09-13T03:01:10.950 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:10.946+0000 7fe07febd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0780fb430 0x7fe07810fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:10.950 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:10.946+0000 7fe07febd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe0780fc700 0x7fe0781122f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:10.950 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:10.946+0000 7fe07febd640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe078065c80 con 0x7fe0780fb430 2024-09-13T03:01:10.950 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:10.946+0000 7fe07febd640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe078065df0 con 0x7fe0780fc700 2024-09-13T03:01:10.950 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:10.947+0000 7fe07dc59640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0780fb430 0x7fe07810fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:10.950 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:10.947+0000 7fe07dc59640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0780fb430 0x7fe07810fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:48340/0 (socket says 172.21.15.89:48340) 2024-09-13T03:01:10.951 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:10.947+0000 7fe07dc59640 1 -- 172.21.15.89:0/2307137582 learned_addr learned my addr 172.21.15.89:0/2307137582 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T03:01:10.951 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:10.947+0000 7fe07d458640 1 --2- 172.21.15.89:0/2307137582 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe0780fc700 0x7fe0781122f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:10.951 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:10.947+0000 7fe07dc59640 1 -- 172.21.15.89:0/2307137582 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe0780fc700 msgr2=0x7fe0781122f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:10.951 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:10.947+0000 7fe07dc59640 1 --2- 172.21.15.89:0/2307137582 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe0780fc700 0x7fe0781122f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:10.951 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:10.947+0000 7fe07dc59640 1 -- 172.21.15.89:0/2307137582 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe068005040 con 0x7fe0780fb430 2024-09-13T03:01:10.951 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:10.947+0000 7fe07dc59640 1 --2- 172.21.15.89:0/2307137582 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0780fb430 0x7fe07810fda0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe074002a50 tx=0x7fe074004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:01:10.951 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:10.947+0000 7fe06e7fc640 1 -- 172.21.15.89:0/2307137582 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe074007c30 con 0x7fe0780fb430 2024-09-13T03:01:10.951 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:10.947+0000 7fe06e7fc640 1 -- 172.21.15.89:0/2307137582 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fe07400f040 con 0x7fe0780fb430 2024-09-13T03:01:10.951 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:10.947+0000 7fe07febd640 1 -- 172.21.15.89:0/2307137582 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe078112890 con 0x7fe0780fb430 2024-09-13T03:01:10.951 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:10.947+0000 7fe06e7fc640 1 -- 172.21.15.89:0/2307137582 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe07400da10 con 0x7fe0780fb430 2024-09-13T03:01:10.951 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:10.947+0000 7fe07febd640 1 -- 172.21.15.89:0/2307137582 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe078112e30 con 0x7fe0780fb430 2024-09-13T03:01:10.952 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:10.948+0000 7fe07febd640 1 -- 172.21.15.89:0/2307137582 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0780fa890 con 0x7fe0780fb430 2024-09-13T03:01:10.952 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:10.949+0000 7fe06e7fc640 1 -- 172.21.15.89:0/2307137582 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fe07400dbb0 con 0x7fe0780fb430 2024-09-13T03:01:10.952 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:10.949+0000 7fe06e7fc640 1 --2- 172.21.15.89:0/2307137582 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fe06406e530 0x7fe0640709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:10.952 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:10.949+0000 7fe06e7fc640 1 -- 172.21.15.89:0/2307137582 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fe07408d850 con 0x7fe0780fb430 2024-09-13T03:01:10.953 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:10.950+0000 7fe07d458640 1 --2- 172.21.15.89:0/2307137582 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fe06406e530 0x7fe0640709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:10.953 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:10.950+0000 7fe07d458640 1 --2- 172.21.15.89:0/2307137582 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fe06406e530 0x7fe0640709e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe06800b020 tx=0x7fe068035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:01:10.955 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:10.954+0000 7fe06e7fc640 1 -- 172.21.15.89:0/2307137582 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fe074056a70 con 0x7fe0780fb430 2024-09-13T03:01:11.136 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.135+0000 7fe07febd640 1 -- 172.21.15.89:0/2307137582 --> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe078100b10 con 0x7fe06406e530 2024-09-13T03:01:11.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.136+0000 7fe06e7fc640 1 -- 172.21.15.89:0/2307137582 <== mgr.34104 v2:172.21.15.89:6800/1881577856 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fe078100b10 con 0x7fe06406e530 2024-09-13T03:01:11.140 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.138+0000 7fe07febd640 1 -- 172.21.15.89:0/2307137582 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fe06406e530 msgr2=0x7fe0640709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:11.140 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.138+0000 7fe07febd640 1 --2- 172.21.15.89:0/2307137582 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fe06406e530 0x7fe0640709e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe06800b020 tx=0x7fe068035040 comp rx=0 tx=0).stop 2024-09-13T03:01:11.140 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.138+0000 7fe07febd640 1 -- 172.21.15.89:0/2307137582 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0780fb430 msgr2=0x7fe07810fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:11.140 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.138+0000 7fe07febd640 1 --2- 172.21.15.89:0/2307137582 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0780fb430 0x7fe07810fda0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fe074002a50 tx=0x7fe074004600 comp rx=0 tx=0).stop 2024-09-13T03:01:11.140 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.138+0000 7fe07febd640 1 -- 172.21.15.89:0/2307137582 shutdown_connections 2024-09-13T03:01:11.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.138+0000 7fe07febd640 1 --2- 172.21.15.89:0/2307137582 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fe06406e530 0x7fe0640709e0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:11.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.138+0000 7fe07febd640 1 --2- 172.21.15.89:0/2307137582 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fe0780fc700 0x7fe0781122f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:11.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.138+0000 7fe07febd640 1 --2- 172.21.15.89:0/2307137582 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fe0780fb430 0x7fe07810fda0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:11.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.138+0000 7fe07febd640 1 -- 172.21.15.89:0/2307137582 >> 172.21.15.89:0/2307137582 conn(0x7fe0780f6c10 msgr2=0x7fe0780f83f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:01:11.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.138+0000 7fe07febd640 1 -- 172.21.15.89:0/2307137582 shutdown_connections 2024-09-13T03:01:11.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.138+0000 7fe07febd640 1 -- 172.21.15.89:0/2307137582 wait complete. 2024-09-13T03:01:11.149 INFO:teuthology.orchestra.run.smithi089.stdout:true 2024-09-13T03:01:11.222 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.218+0000 7f31f26b9640 1 -- 172.21.15.89:0/1882660081 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f31ec0fc700 msgr2=0x7f31ec0fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:11.222 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.218+0000 7f31f26b9640 1 --2- 172.21.15.89:0/1882660081 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f31ec0fc700 0x7f31ec0fcb70 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f31e00048d0 tx=0x7f31e0009da0 comp rx=0 tx=0).stop 2024-09-13T03:01:11.222 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.218+0000 7f31f26b9640 1 -- 172.21.15.89:0/1882660081 shutdown_connections 2024-09-13T03:01:11.223 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.218+0000 7f31f26b9640 1 --2- 172.21.15.89:0/1882660081 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f31ec0fc700 0x7f31ec0fcb70 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:11.223 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.218+0000 7f31f26b9640 1 --2- 172.21.15.89:0/1882660081 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f31ec0fb430 0x7f31ec0fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:11.223 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.218+0000 7f31f26b9640 1 -- 172.21.15.89:0/1882660081 >> 172.21.15.89:0/1882660081 conn(0x7f31ec0f6c10 msgr2=0x7f31ec0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:01:11.223 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.218+0000 7f31f26b9640 1 -- 172.21.15.89:0/1882660081 shutdown_connections 2024-09-13T03:01:11.223 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.218+0000 7f31f26b9640 1 -- 172.21.15.89:0/1882660081 wait complete. 2024-09-13T03:01:11.223 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.218+0000 7f31f26b9640 1 Processor -- start 2024-09-13T03:01:11.224 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.219+0000 7f31f26b9640 1 -- start start 2024-09-13T03:01:11.224 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.219+0000 7f31f26b9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f31ec0fb430 0x7f31ec10d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:11.224 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.219+0000 7f31f26b9640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f31ec0fc700 0x7f31ec10d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:11.224 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.219+0000 7f31f26b9640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31ec10dc70 con 0x7f31ec0fb430 2024-09-13T03:01:11.224 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.219+0000 7f31f26b9640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31ec10e440 con 0x7f31ec0fc700 2024-09-13T03:01:11.224 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.219+0000 7f31ebfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f31ec0fb430 0x7f31ec10d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:11.224 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.219+0000 7f31ebfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f31ec0fb430 0x7f31ec10d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:48370/0 (socket says 172.21.15.89:48370) 2024-09-13T03:01:11.224 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.219+0000 7f31ebfff640 1 -- 172.21.15.89:0/1238070952 learned_addr learned my addr 172.21.15.89:0/1238070952 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T03:01:11.224 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.219+0000 7f31eb7fe640 1 --2- 172.21.15.89:0/1238070952 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f31ec0fc700 0x7f31ec10d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:11.224 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.219+0000 7f31ebfff640 1 -- 172.21.15.89:0/1238070952 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f31ec0fc700 msgr2=0x7f31ec10d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:11.224 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.219+0000 7f31ebfff640 1 --2- 172.21.15.89:0/1238070952 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f31ec0fc700 0x7f31ec10d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:11.225 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.219+0000 7f31ebfff640 1 -- 172.21.15.89:0/1238070952 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31e0005040 con 0x7f31ec0fb430 2024-09-13T03:01:11.225 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.220+0000 7f31ebfff640 1 --2- 172.21.15.89:0/1238070952 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f31ec0fb430 0x7f31ec10d0e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f31dc002a50 tx=0x7f31dc004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:01:11.225 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.220+0000 7f31e8ff9640 1 -- 172.21.15.89:0/1238070952 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f31dc007c30 con 0x7f31ec0fb430 2024-09-13T03:01:11.225 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.220+0000 7f31e8ff9640 1 -- 172.21.15.89:0/1238070952 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f31dc00f040 con 0x7f31ec0fb430 2024-09-13T03:01:11.225 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.220+0000 7f31f26b9640 1 -- 172.21.15.89:0/1238070952 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31ec10e6d0 con 0x7f31ec0fb430 2024-09-13T03:01:11.225 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.220+0000 7f31e8ff9640 1 -- 172.21.15.89:0/1238070952 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f31dc00da90 con 0x7f31ec0fb430 2024-09-13T03:01:11.225 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.220+0000 7f31f26b9640 1 -- 172.21.15.89:0/1238070952 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31ec10ec70 con 0x7f31ec0fb430 2024-09-13T03:01:11.225 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.221+0000 7f31f26b9640 1 -- 172.21.15.89:0/1238070952 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31ec0fa890 con 0x7f31ec0fb430 2024-09-13T03:01:11.226 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.221+0000 7f31e8ff9640 1 -- 172.21.15.89:0/1238070952 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f31dc00dcd0 con 0x7f31ec0fb430 2024-09-13T03:01:11.226 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.222+0000 7f31e8ff9640 1 --2- 172.21.15.89:0/1238070952 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f31d406e530 0x7f31d40709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:11.226 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.222+0000 7f31eb7fe640 1 --2- 172.21.15.89:0/1238070952 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f31d406e530 0x7f31d40709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:11.226 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.222+0000 7f31e8ff9640 1 -- 172.21.15.89:0/1238070952 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f31dc08d990 con 0x7f31ec0fb430 2024-09-13T03:01:11.226 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.222+0000 7f31eb7fe640 1 --2- 172.21.15.89:0/1238070952 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f31d406e530 0x7f31d40709e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f31e0000c00 tx=0x7f31e0009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:01:11.227 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.226+0000 7f31e8ff9640 1 -- 172.21.15.89:0/1238070952 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f31dc056b00 con 0x7f31ec0fb430 2024-09-13T03:01:11.413 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.411+0000 7f31f26b9640 1 -- 172.21.15.89:0/1238070952 --> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f31ec10eee0 con 0x7f31d406e530 2024-09-13T03:01:11.414 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.412+0000 7f31e8ff9640 1 -- 172.21.15.89:0/1238070952 <== mgr.34104 v2:172.21.15.89:6800/1881577856 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f31ec10eee0 con 0x7f31d406e530 2024-09-13T03:01:11.416 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.415+0000 7f31f26b9640 1 -- 172.21.15.89:0/1238070952 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f31d406e530 msgr2=0x7f31d40709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:11.416 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.415+0000 7f31f26b9640 1 --2- 172.21.15.89:0/1238070952 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f31d406e530 0x7f31d40709e0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f31e0000c00 tx=0x7f31e0009da0 comp rx=0 tx=0).stop 2024-09-13T03:01:11.416 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.415+0000 7f31f26b9640 1 -- 172.21.15.89:0/1238070952 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f31ec0fb430 msgr2=0x7f31ec10d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:11.416 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.415+0000 7f31f26b9640 1 --2- 172.21.15.89:0/1238070952 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f31ec0fb430 0x7f31ec10d0e0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f31dc002a50 tx=0x7f31dc004600 comp rx=0 tx=0).stop 2024-09-13T03:01:11.417 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.415+0000 7f31f26b9640 1 -- 172.21.15.89:0/1238070952 shutdown_connections 2024-09-13T03:01:11.417 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.415+0000 7f31f26b9640 1 --2- 172.21.15.89:0/1238070952 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f31d406e530 0x7f31d40709e0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:11.417 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.415+0000 7f31f26b9640 1 --2- 172.21.15.89:0/1238070952 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f31ec0fc700 0x7f31ec10d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:11.417 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.415+0000 7f31f26b9640 1 --2- 172.21.15.89:0/1238070952 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f31ec0fb430 0x7f31ec10d0e0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:11.417 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.415+0000 7f31f26b9640 1 -- 172.21.15.89:0/1238070952 >> 172.21.15.89:0/1238070952 conn(0x7f31ec0f6c10 msgr2=0x7f31ec0655f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:01:11.417 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.415+0000 7f31f26b9640 1 -- 172.21.15.89:0/1238070952 shutdown_connections 2024-09-13T03:01:11.417 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.415+0000 7f31f26b9640 1 -- 172.21.15.89:0/1238070952 wait complete. 2024-09-13T03:01:11.495 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.493+0000 7fd172cb1640 1 -- 172.21.15.89:0/3588224723 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd16c0fc710 msgr2=0x7fd16c0fcb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:11.495 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.493+0000 7fd172cb1640 1 --2- 172.21.15.89:0/3588224723 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd16c0fc710 0x7fd16c0fcb80 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fd1580048d0 tx=0x7fd158009da0 comp rx=0 tx=0).stop 2024-09-13T03:01:11.495 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.493+0000 7fd172cb1640 1 -- 172.21.15.89:0/3588224723 shutdown_connections 2024-09-13T03:01:11.495 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.493+0000 7fd172cb1640 1 --2- 172.21.15.89:0/3588224723 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd16c0fc710 0x7fd16c0fcb80 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:11.495 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.493+0000 7fd172cb1640 1 --2- 172.21.15.89:0/3588224723 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd16c0fb440 0x7fd16c0fb850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:11.495 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.493+0000 7fd172cb1640 1 -- 172.21.15.89:0/3588224723 >> 172.21.15.89:0/3588224723 conn(0x7fd16c0f6c00 msgr2=0x7fd16c0f9030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:01:11.495 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.493+0000 7fd172cb1640 1 -- 172.21.15.89:0/3588224723 shutdown_connections 2024-09-13T03:01:11.495 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.493+0000 7fd172cb1640 1 -- 172.21.15.89:0/3588224723 wait complete. 2024-09-13T03:01:11.496 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.493+0000 7fd172cb1640 1 Processor -- start 2024-09-13T03:01:11.496 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.494+0000 7fd172cb1640 1 -- start start 2024-09-13T03:01:11.497 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.494+0000 7fd172cb1640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd16c0fb440 0x7fd16c10d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:11.497 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.494+0000 7fd172cb1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd16c0fc710 0x7fd16c10d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:11.497 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.494+0000 7fd172cb1640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd16c10dc30 con 0x7fd16c0fc710 2024-09-13T03:01:11.497 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.494+0000 7fd172cb1640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd16c10e450 con 0x7fd16c0fb440 2024-09-13T03:01:11.497 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.494+0000 7fd16bfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd16c0fc710 0x7fd16c10d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:11.497 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.494+0000 7fd16bfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd16c0fc710 0x7fd16c10d5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:37256/0 (socket says 172.21.15.89:37256) 2024-09-13T03:01:11.497 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.494+0000 7fd16bfff640 1 -- 172.21.15.89:0/3524797198 learned_addr learned my addr 172.21.15.89:0/3524797198 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T03:01:11.498 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.494+0000 7fd170a4d640 1 --2- 172.21.15.89:0/3524797198 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd16c0fb440 0x7fd16c10d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:11.498 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.494+0000 7fd16bfff640 1 -- 172.21.15.89:0/3524797198 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd16c0fb440 msgr2=0x7fd16c10d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:11.498 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.494+0000 7fd16bfff640 1 --2- 172.21.15.89:0/3524797198 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd16c0fb440 0x7fd16c10d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:11.498 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.494+0000 7fd16bfff640 1 -- 172.21.15.89:0/3524797198 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd158005040 con 0x7fd16c0fc710 2024-09-13T03:01:11.498 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.495+0000 7fd16bfff640 1 --2- 172.21.15.89:0/3524797198 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd16c0fc710 0x7fd16c10d5e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd1580043d0 tx=0x7fd158009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:01:11.498 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.495+0000 7fd1697fa640 1 -- 172.21.15.89:0/3524797198 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd158038070 con 0x7fd16c0fc710 2024-09-13T03:01:11.498 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.495+0000 7fd1697fa640 1 -- 172.21.15.89:0/3524797198 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd15802ae90 con 0x7fd16c0fc710 2024-09-13T03:01:11.498 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.495+0000 7fd1697fa640 1 -- 172.21.15.89:0/3524797198 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd15803e670 con 0x7fd16c0fc710 2024-09-13T03:01:11.498 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.495+0000 7fd172cb1640 1 -- 172.21.15.89:0/3524797198 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd16c10e680 con 0x7fd16c0fc710 2024-09-13T03:01:11.499 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.495+0000 7fd172cb1640 1 -- 172.21.15.89:0/3524797198 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd16c10ec20 con 0x7fd16c0fc710 2024-09-13T03:01:11.499 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.496+0000 7fd172cb1640 1 -- 172.21.15.89:0/3524797198 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd16c0fa8a0 con 0x7fd16c0fc710 2024-09-13T03:01:11.500 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.496+0000 7fd1697fa640 1 -- 172.21.15.89:0/3524797198 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fd158030020 con 0x7fd16c0fc710 2024-09-13T03:01:11.500 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.497+0000 7fd1697fa640 1 --2- 172.21.15.89:0/3524797198 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fd15c06e530 0x7fd15c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:11.500 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.497+0000 7fd170a4d640 1 --2- 172.21.15.89:0/3524797198 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fd15c06e530 0x7fd15c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:11.500 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.497+0000 7fd1697fa640 1 -- 172.21.15.89:0/3524797198 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fd1580ae420 con 0x7fd16c0fc710 2024-09-13T03:01:11.500 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.498+0000 7fd170a4d640 1 --2- 172.21.15.89:0/3524797198 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fd15c06e530 0x7fd15c0709e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd160007fd0 tx=0x7fd160009e90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:01:11.503 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.501+0000 7fd1697fa640 1 -- 172.21.15.89:0/3524797198 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fd158077510 con 0x7fd16c0fc710 2024-09-13T03:01:11.678 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.677+0000 7fd172cb1640 1 -- 172.21.15.89:0/3524797198 --> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd16c103fa0 con 0x7fd15c06e530 2024-09-13T03:01:11.687 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.685+0000 7fd1697fa640 1 -- 172.21.15.89:0/3524797198 <== mgr.34104 v2:172.21.15.89:6800/1881577856 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fd16c103fa0 con 0x7fd15c06e530 2024-09-13T03:01:11.687 INFO:teuthology.orchestra.run.smithi089.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T03:01:11.687 INFO:teuthology.orchestra.run.smithi089.stdout:alertmanager.smithi089 smithi089 *:9093,9094 running (5m) 2m ago 14m 25.7M - 0.25.0 c8568f914cd2 1d2432f5479e 2024-09-13T03:01:11.687 INFO:teuthology.orchestra.run.smithi089.stdout:crash.smithi089 smithi089 running (3m) 2m ago 14m 6891k - 19.1.1-322-g7741f7f9 19dc8d659727 0ef15ca3e7f9 2024-09-13T03:01:11.687 INFO:teuthology.orchestra.run.smithi089.stdout:crash.smithi131 smithi131 running (3m) 32s ago 14m 6895k - 19.1.1-322-g7741f7f9 19dc8d659727 21e4d6fc04f7 2024-09-13T03:01:11.688 INFO:teuthology.orchestra.run.smithi089.stdout:grafana.smithi089 smithi089 *:3000 running (5m) 2m ago 14m 79.0M - 9.4.7 954c08fa6188 dee914ded1af 2024-09-13T03:01:11.688 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi089.qjoitb smithi089 running (9m) 2m ago 9m 70.3M - 17.2.7-1627-gbbdadfa3 a994b00deb3a ff9b59ec5107 2024-09-13T03:01:11.688 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi089.rarddb smithi089 running (9m) 2m ago 9m 135M - 17.2.7-1627-gbbdadfa3 a994b00deb3a db2dc502c1ba 2024-09-13T03:01:11.688 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi131.rbovzc smithi131 running (9m) 32s ago 9m 60.3M - 17.2.7-1627-gbbdadfa3 a994b00deb3a d071b6d99537 2024-09-13T03:01:11.688 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi131.uasrkg smithi131 running (9m) 32s ago 9m 112M - 17.2.7-1627-gbbdadfa3 a994b00deb3a 0b3d4ffa6ce5 2024-09-13T03:01:11.688 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.smithi089.guohvs smithi089 *:8443,9283,8765 running (5m) 2m ago 15m 498M - 19.1.1-322-g7741f7f9 19dc8d659727 1e887446f1b0 2024-09-13T03:01:11.688 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.smithi131.aunbqd smithi131 *:8443,9283,8765 running (4m) 32s ago 13m 441M - 19.1.1-322-g7741f7f9 19dc8d659727 358d7478f2ba 2024-09-13T03:01:11.688 INFO:teuthology.orchestra.run.smithi089.stdout:mon.smithi089 smithi089 running (4m) 2m ago 16m 46.4M 2048M 19.1.1-322-g7741f7f9 19dc8d659727 8a29fb65028f 2024-09-13T03:01:11.688 INFO:teuthology.orchestra.run.smithi089.stdout:mon.smithi131 smithi131 running (4m) 32s ago 13m 43.5M 2048M 19.1.1-322-g7741f7f9 19dc8d659727 506310ad8620 2024-09-13T03:01:11.688 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.smithi089 smithi089 *:9100 running (5m) 2m ago 14m 16.9M - 1.5.0 0da6a335fe13 5a9927b583e6 2024-09-13T03:01:11.688 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.smithi131 smithi131 *:9100 running (5m) 32s ago 13m 15.8M - 1.5.0 0da6a335fe13 bcfde5d1a508 2024-09-13T03:01:11.688 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0 smithi089 running (3m) 2m ago 13m 93.7M 1557M 19.1.1-322-g7741f7f9 19dc8d659727 e8038f6d52b6 2024-09-13T03:01:11.688 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1 smithi089 running (2m) 2m ago 12m 94.5M 1557M 19.1.1-322-g7741f7f9 19dc8d659727 e174144d9633 2024-09-13T03:01:11.689 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2 smithi089 running (2m) 2m ago 12m 11.2M 1557M 19.1.1-322-g7741f7f9 19dc8d659727 2d8cab08c2b3 2024-09-13T03:01:11.689 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3 smithi131 running (99s) 32s ago 11m 106M 2581M 19.1.1-322-g7741f7f9 19dc8d659727 e77cff624869 2024-09-13T03:01:11.689 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4 smithi131 running (68s) 32s ago 11m 97.6M 2581M 19.1.1-322-g7741f7f9 19dc8d659727 0317e6a4a04c 2024-09-13T03:01:11.689 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5 smithi131 running (35s) 32s ago 10m 11.4M 2581M 19.1.1-322-g7741f7f9 19dc8d659727 e7d2a780f4e0 2024-09-13T03:01:11.689 INFO:teuthology.orchestra.run.smithi089.stdout:prometheus.smithi089 smithi089 *:9095 running (4m) 2m ago 14m 56.4M - 2.43.0 a07b618ecd1d 9d336370c187 2024-09-13T03:01:11.689 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.688+0000 7fd172cb1640 1 -- 172.21.15.89:0/3524797198 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fd15c06e530 msgr2=0x7fd15c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:11.690 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.688+0000 7fd172cb1640 1 --2- 172.21.15.89:0/3524797198 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fd15c06e530 0x7fd15c0709e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd160007fd0 tx=0x7fd160009e90 comp rx=0 tx=0).stop 2024-09-13T03:01:11.690 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.688+0000 7fd172cb1640 1 -- 172.21.15.89:0/3524797198 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd16c0fc710 msgr2=0x7fd16c10d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:11.690 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.688+0000 7fd172cb1640 1 --2- 172.21.15.89:0/3524797198 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd16c0fc710 0x7fd16c10d5e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fd1580043d0 tx=0x7fd158009da0 comp rx=0 tx=0).stop 2024-09-13T03:01:11.690 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.688+0000 7fd172cb1640 1 -- 172.21.15.89:0/3524797198 shutdown_connections 2024-09-13T03:01:11.690 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.688+0000 7fd172cb1640 1 --2- 172.21.15.89:0/3524797198 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fd15c06e530 0x7fd15c0709e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:11.690 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.688+0000 7fd172cb1640 1 --2- 172.21.15.89:0/3524797198 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd16c0fc710 0x7fd16c10d5e0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:11.690 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.688+0000 7fd172cb1640 1 --2- 172.21.15.89:0/3524797198 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd16c0fb440 0x7fd16c10d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:11.690 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.688+0000 7fd172cb1640 1 -- 172.21.15.89:0/3524797198 >> 172.21.15.89:0/3524797198 conn(0x7fd16c0f6c00 msgr2=0x7fd16c066120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:01:11.690 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.688+0000 7fd172cb1640 1 -- 172.21.15.89:0/3524797198 shutdown_connections 2024-09-13T03:01:11.690 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.688+0000 7fd172cb1640 1 -- 172.21.15.89:0/3524797198 wait complete. 2024-09-13T03:01:11.767 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.766+0000 7f0cb597c640 1 -- 172.21.15.89:0/3345770633 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0cb00fe500 msgr2=0x7f0cb00fa660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:11.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.766+0000 7f0cb597c640 1 --2- 172.21.15.89:0/3345770633 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0cb00fe500 0x7f0cb00fa660 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f0ca40048d0 tx=0x7f0ca4009da0 comp rx=0 tx=0).stop 2024-09-13T03:01:11.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.766+0000 7f0cb597c640 1 -- 172.21.15.89:0/3345770633 shutdown_connections 2024-09-13T03:01:11.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.766+0000 7f0cb597c640 1 --2- 172.21.15.89:0/3345770633 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0cb00fe500 0x7f0cb00fa660 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:11.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.766+0000 7f0cb597c640 1 --2- 172.21.15.89:0/3345770633 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0cb00fdbb0 0x7f0cb00fdfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:11.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.766+0000 7f0cb597c640 1 -- 172.21.15.89:0/3345770633 >> 172.21.15.89:0/3345770633 conn(0x7f0cb00f63b0 msgr2=0x7f0cb00f87e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:01:11.768 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.766+0000 7f0cb597c640 1 -- 172.21.15.89:0/3345770633 shutdown_connections 2024-09-13T03:01:11.768 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:11 smithi089 ceph-mon[91553]: mds.? [v2:172.21.15.131:6824/833117870,v1:172.21.15.131:6825/833117870] up:boot 2024-09-13T03:01:11.768 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:11 smithi089 ceph-mon[91553]: fsmap cephfs:1 {0=cephfs.smithi089.rarddb=up:active} 3 up:standby 2024-09-13T03:01:11.769 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:11 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi131.uasrkg"}]: dispatch 2024-09-13T03:01:11.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.766+0000 7f0cb597c640 1 -- 172.21.15.89:0/3345770633 wait complete. 2024-09-13T03:01:11.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.767+0000 7f0cb597c640 1 Processor -- start 2024-09-13T03:01:11.770 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.767+0000 7f0cb597c640 1 -- start start 2024-09-13T03:01:11.771 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.767+0000 7f0cb597c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0cb00fdbb0 0x7f0cb010d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:11.771 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.767+0000 7f0cb597c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0cb00fe500 0x7f0cb010d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:11.771 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.767+0000 7f0cb597c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb010dc40 con 0x7f0cb00fe500 2024-09-13T03:01:11.771 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.767+0000 7f0cb597c640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cb010e460 con 0x7f0cb00fdbb0 2024-09-13T03:01:11.771 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.767+0000 7f0cae7fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0cb00fe500 0x7f0cb010d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:11.771 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.767+0000 7f0cae7fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0cb00fe500 0x7f0cb010d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:37270/0 (socket says 172.21.15.89:37270) 2024-09-13T03:01:11.771 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.767+0000 7f0cae7fc640 1 -- 172.21.15.89:0/1299256258 learned_addr learned my addr 172.21.15.89:0/1299256258 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T03:01:11.771 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.767+0000 7f0caeffd640 1 --2- 172.21.15.89:0/1299256258 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0cb00fdbb0 0x7f0cb010d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:11.771 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.767+0000 7f0cae7fc640 1 -- 172.21.15.89:0/1299256258 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0cb00fdbb0 msgr2=0x7f0cb010d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:11.771 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.767+0000 7f0cae7fc640 1 --2- 172.21.15.89:0/1299256258 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0cb00fdbb0 0x7f0cb010d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:11.771 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.767+0000 7f0cae7fc640 1 -- 172.21.15.89:0/1299256258 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ca4005040 con 0x7f0cb00fe500 2024-09-13T03:01:11.771 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.768+0000 7f0cae7fc640 1 --2- 172.21.15.89:0/1299256258 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0cb00fe500 0x7f0cb010d5f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0ca40043d0 tx=0x7f0ca4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:01:11.771 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.768+0000 7f0c977fe640 1 -- 172.21.15.89:0/1299256258 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ca4038070 con 0x7f0cb00fe500 2024-09-13T03:01:11.771 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.768+0000 7f0cb597c640 1 -- 172.21.15.89:0/1299256258 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cb010e690 con 0x7f0cb00fe500 2024-09-13T03:01:11.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.768+0000 7f0c977fe640 1 -- 172.21.15.89:0/1299256258 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f0ca4009800 con 0x7f0cb00fe500 2024-09-13T03:01:11.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.768+0000 7f0cb597c640 1 -- 172.21.15.89:0/1299256258 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cb010ec30 con 0x7f0cb00fe500 2024-09-13T03:01:11.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.768+0000 7f0c977fe640 1 -- 172.21.15.89:0/1299256258 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ca403e630 con 0x7f0cb00fe500 2024-09-13T03:01:11.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.769+0000 7f0cb597c640 1 -- 172.21.15.89:0/1299256258 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cb00fa050 con 0x7f0cb00fe500 2024-09-13T03:01:11.772 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.770+0000 7f0c977fe640 1 -- 172.21.15.89:0/1299256258 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f0ca4030020 con 0x7f0cb00fe500 2024-09-13T03:01:11.773 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.770+0000 7f0c977fe640 1 --2- 172.21.15.89:0/1299256258 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f0c9806e530 0x7f0c980709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:11.773 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.770+0000 7f0c977fe640 1 -- 172.21.15.89:0/1299256258 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f0ca40ae530 con 0x7f0cb00fe500 2024-09-13T03:01:11.773 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.770+0000 7f0caeffd640 1 --2- 172.21.15.89:0/1299256258 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f0c9806e530 0x7f0c980709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:11.773 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.771+0000 7f0caeffd640 1 --2- 172.21.15.89:0/1299256258 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f0c9806e530 0x7f0c980709e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0ca0007fd0 tx=0x7f0ca0009e90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:01:11.776 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:11.774+0000 7f0c977fe640 1 -- 172.21.15.89:0/1299256258 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f0ca4077620 con 0x7f0cb00fe500 2024-09-13T03:01:11.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:11 smithi131 ceph-mon[78839]: mds.? [v2:172.21.15.131:6824/833117870,v1:172.21.15.131:6825/833117870] up:boot 2024-09-13T03:01:11.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:11 smithi131 ceph-mon[78839]: fsmap cephfs:1 {0=cephfs.smithi089.rarddb=up:active} 3 up:standby 2024-09-13T03:01:11.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:11 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi131.uasrkg"}]: dispatch 2024-09-13T03:01:12.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.007+0000 7f0cb597c640 1 -- 172.21.15.89:0/1299256258 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0cb010eea0 con 0x7f0cb00fe500 2024-09-13T03:01:12.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.008+0000 7f0c977fe640 1 -- 172.21.15.89:0/1299256258 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+743 (secure 0 0 0) 0x7f0ca407ace0 con 0x7f0cb00fe500 2024-09-13T03:01:12.009 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-13T03:01:12.009 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": { 2024-09-13T03:01:12.010 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 2 2024-09-13T03:01:12.010 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T03:01:12.010 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": { 2024-09-13T03:01:12.010 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 2 2024-09-13T03:01:12.010 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T03:01:12.010 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": { 2024-09-13T03:01:12.010 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 6 2024-09-13T03:01:12.010 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T03:01:12.010 INFO:teuthology.orchestra.run.smithi089.stdout: "mds": { 2024-09-13T03:01:12.010 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 4 2024-09-13T03:01:12.010 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T03:01:12.010 INFO:teuthology.orchestra.run.smithi089.stdout: "overall": { 2024-09-13T03:01:12.010 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 4, 2024-09-13T03:01:12.011 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 10 2024-09-13T03:01:12.011 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-13T03:01:12.011 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-13T03:01:12.012 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.010+0000 7f0cb597c640 1 -- 172.21.15.89:0/1299256258 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f0c9806e530 msgr2=0x7f0c980709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:12.012 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.010+0000 7f0cb597c640 1 --2- 172.21.15.89:0/1299256258 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f0c9806e530 0x7f0c980709e0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0ca0007fd0 tx=0x7f0ca0009e90 comp rx=0 tx=0).stop 2024-09-13T03:01:12.012 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.010+0000 7f0cb597c640 1 -- 172.21.15.89:0/1299256258 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0cb00fe500 msgr2=0x7f0cb010d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:12.012 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.010+0000 7f0cb597c640 1 --2- 172.21.15.89:0/1299256258 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0cb00fe500 0x7f0cb010d5f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f0ca40043d0 tx=0x7f0ca4009da0 comp rx=0 tx=0).stop 2024-09-13T03:01:12.012 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.010+0000 7f0cb597c640 1 -- 172.21.15.89:0/1299256258 shutdown_connections 2024-09-13T03:01:12.012 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.010+0000 7f0cb597c640 1 --2- 172.21.15.89:0/1299256258 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f0c9806e530 0x7f0c980709e0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:12.012 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.010+0000 7f0cb597c640 1 --2- 172.21.15.89:0/1299256258 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f0cb00fe500 0x7f0cb010d5f0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:12.012 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.010+0000 7f0cb597c640 1 --2- 172.21.15.89:0/1299256258 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f0cb00fdbb0 0x7f0cb010d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:12.012 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.010+0000 7f0cb597c640 1 -- 172.21.15.89:0/1299256258 >> 172.21.15.89:0/1299256258 conn(0x7f0cb00f63b0 msgr2=0x7f0cb00f7b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:01:12.012 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.010+0000 7f0cb597c640 1 -- 172.21.15.89:0/1299256258 shutdown_connections 2024-09-13T03:01:12.012 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.010+0000 7f0cb597c640 1 -- 172.21.15.89:0/1299256258 wait complete. 2024-09-13T03:01:12.091 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.089+0000 7f90b06a5640 1 -- 172.21.15.89:0/3793238112 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f90a80fe480 msgr2=0x7f90a80fa5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:12.091 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.089+0000 7f90b06a5640 1 --2- 172.21.15.89:0/3793238112 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f90a80fe480 0x7f90a80fa5e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f90980048d0 tx=0x7f9098009da0 comp rx=0 tx=0).stop 2024-09-13T03:01:12.091 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.089+0000 7f90b06a5640 1 -- 172.21.15.89:0/3793238112 shutdown_connections 2024-09-13T03:01:12.091 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.089+0000 7f90b06a5640 1 --2- 172.21.15.89:0/3793238112 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f90a80fe480 0x7f90a80fa5e0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:12.091 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.089+0000 7f90b06a5640 1 --2- 172.21.15.89:0/3793238112 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f90a80fdb30 0x7f90a80fdf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:12.091 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.089+0000 7f90b06a5640 1 -- 172.21.15.89:0/3793238112 >> 172.21.15.89:0/3793238112 conn(0x7f90a80f6330 msgr2=0x7f90a80f8760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:01:12.091 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.089+0000 7f90b06a5640 1 -- 172.21.15.89:0/3793238112 shutdown_connections 2024-09-13T03:01:12.092 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.089+0000 7f90b06a5640 1 -- 172.21.15.89:0/3793238112 wait complete. 2024-09-13T03:01:12.092 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.090+0000 7f90b06a5640 1 Processor -- start 2024-09-13T03:01:12.092 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.090+0000 7f90b06a5640 1 -- start start 2024-09-13T03:01:12.093 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.090+0000 7f90b06a5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f90a80fdb30 0x7f90a810d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:12.093 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.090+0000 7f90b06a5640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f90a80fe480 0x7f90a810d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:12.094 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.090+0000 7f90b06a5640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a810dbd0 con 0x7f90a80fdb30 2024-09-13T03:01:12.094 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.090+0000 7f90b06a5640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a810e3f0 con 0x7f90a80fe480 2024-09-13T03:01:12.094 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.090+0000 7f90ae441640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f90a80fdb30 0x7f90a810d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:12.094 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.090+0000 7f90ae441640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f90a80fdb30 0x7f90a810d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:37292/0 (socket says 172.21.15.89:37292) 2024-09-13T03:01:12.094 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.090+0000 7f90ae441640 1 -- 172.21.15.89:0/3153753665 learned_addr learned my addr 172.21.15.89:0/3153753665 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T03:01:12.094 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.090+0000 7f90adc40640 1 --2- 172.21.15.89:0/3153753665 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f90a80fe480 0x7f90a810d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:12.094 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.091+0000 7f90ae441640 1 -- 172.21.15.89:0/3153753665 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f90a80fe480 msgr2=0x7f90a810d580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:12.094 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.091+0000 7f90ae441640 1 --2- 172.21.15.89:0/3153753665 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f90a80fe480 0x7f90a810d580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:12.094 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.091+0000 7f90ae441640 1 -- 172.21.15.89:0/3153753665 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9098005040 con 0x7f90a80fdb30 2024-09-13T03:01:12.094 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.091+0000 7f90adc40640 1 --2- 172.21.15.89:0/3153753665 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f90a80fe480 0x7f90a810d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T03:01:12.094 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.091+0000 7f90ae441640 1 --2- 172.21.15.89:0/3153753665 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f90a80fdb30 0x7f90a810d040 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f90a400c790 tx=0x7f90a40043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:01:12.094 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.091+0000 7f909effd640 1 -- 172.21.15.89:0/3153753665 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f90a400a820 con 0x7f90a80fdb30 2024-09-13T03:01:12.094 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.091+0000 7f909effd640 1 -- 172.21.15.89:0/3153753665 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f90a400ae20 con 0x7f90a80fdb30 2024-09-13T03:01:12.095 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.091+0000 7f909effd640 1 -- 172.21.15.89:0/3153753665 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f90a40113a0 con 0x7f90a80fdb30 2024-09-13T03:01:12.095 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.091+0000 7f90b06a5640 1 -- 172.21.15.89:0/3153753665 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90a810e680 con 0x7f90a80fdb30 2024-09-13T03:01:12.095 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.091+0000 7f90b06a5640 1 -- 172.21.15.89:0/3153753665 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90a810ec20 con 0x7f90a80fdb30 2024-09-13T03:01:12.095 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.092+0000 7f90b06a5640 1 -- 172.21.15.89:0/3153753665 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90a805ed70 con 0x7f90a80fdb30 2024-09-13T03:01:12.095 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.093+0000 7f909effd640 1 -- 172.21.15.89:0/3153753665 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f90a4012400 con 0x7f90a80fdb30 2024-09-13T03:01:12.096 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.093+0000 7f909effd640 1 --2- 172.21.15.89:0/3153753665 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f909406e530 0x7f90940709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:12.096 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.093+0000 7f909effd640 1 -- 172.21.15.89:0/3153753665 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f90a408e240 con 0x7f90a80fdb30 2024-09-13T03:01:12.096 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.093+0000 7f90adc40640 1 --2- 172.21.15.89:0/3153753665 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f909406e530 0x7f90940709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:12.096 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.094+0000 7f90adc40640 1 --2- 172.21.15.89:0/3153753665 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f909406e530 0x7f90940709e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f90a810cdf0 tx=0x7f9098035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:01:12.099 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.098+0000 7f909effd640 1 -- 172.21.15.89:0/3153753665 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f90a4057470 con 0x7f90a80fdb30 2024-09-13T03:01:12.300 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.299+0000 7f90b06a5640 1 -- 172.21.15.89:0/3153753665 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f90a804b720 con 0x7f90a80fdb30 2024-09-13T03:01:12.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.299+0000 7f909effd640 1 -- 172.21.15.89:0/3153753665 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 28 v28) v1 ==== 76+0+1927 (secure 0 0 0) 0x7f90a405ab30 con 0x7f90a80fdb30 2024-09-13T03:01:12.301 INFO:teuthology.orchestra.run.smithi089.stdout:e28 2024-09-13T03:01:12.301 INFO:teuthology.orchestra.run.smithi089.stdout:btime 2024-09-13T03:01:10:614020+0000 2024-09-13T03:01:12.301 INFO:teuthology.orchestra.run.smithi089.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T03:01:12.301 INFO:teuthology.orchestra.run.smithi089.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T03:01:12.301 INFO:teuthology.orchestra.run.smithi089.stdout:legacy client fscid: 1 2024-09-13T03:01:12.301 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T03:01:12.301 INFO:teuthology.orchestra.run.smithi089.stdout:Filesystem 'cephfs' (1) 2024-09-13T03:01:12.302 INFO:teuthology.orchestra.run.smithi089.stdout:fs_name cephfs 2024-09-13T03:01:12.302 INFO:teuthology.orchestra.run.smithi089.stdout:epoch 27 2024-09-13T03:01:12.302 INFO:teuthology.orchestra.run.smithi089.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-13T03:01:12.302 INFO:teuthology.orchestra.run.smithi089.stdout:created 2024-09-13T02:51:40.657817+0000 2024-09-13T03:01:12.302 INFO:teuthology.orchestra.run.smithi089.stdout:modified 2024-09-13T03:01:09.308801+0000 2024-09-13T03:01:12.302 INFO:teuthology.orchestra.run.smithi089.stdout:tableserver 0 2024-09-13T03:01:12.302 INFO:teuthology.orchestra.run.smithi089.stdout:root 0 2024-09-13T03:01:12.302 INFO:teuthology.orchestra.run.smithi089.stdout:session_timeout 60 2024-09-13T03:01:12.302 INFO:teuthology.orchestra.run.smithi089.stdout:session_autoclose 300 2024-09-13T03:01:12.302 INFO:teuthology.orchestra.run.smithi089.stdout:max_file_size 1099511627776 2024-09-13T03:01:12.302 INFO:teuthology.orchestra.run.smithi089.stdout:max_xattr_size 65536 2024-09-13T03:01:12.302 INFO:teuthology.orchestra.run.smithi089.stdout:required_client_features {} 2024-09-13T03:01:12.302 INFO:teuthology.orchestra.run.smithi089.stdout:last_failure 0 2024-09-13T03:01:12.303 INFO:teuthology.orchestra.run.smithi089.stdout:last_failure_osd_epoch 0 2024-09-13T03:01:12.303 INFO:teuthology.orchestra.run.smithi089.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T03:01:12.303 INFO:teuthology.orchestra.run.smithi089.stdout:max_mds 1 2024-09-13T03:01:12.303 INFO:teuthology.orchestra.run.smithi089.stdout:in 0 2024-09-13T03:01:12.303 INFO:teuthology.orchestra.run.smithi089.stdout:up {0=14480} 2024-09-13T03:01:12.303 INFO:teuthology.orchestra.run.smithi089.stdout:failed 2024-09-13T03:01:12.303 INFO:teuthology.orchestra.run.smithi089.stdout:damaged 2024-09-13T03:01:12.303 INFO:teuthology.orchestra.run.smithi089.stdout:stopped 1 2024-09-13T03:01:12.303 INFO:teuthology.orchestra.run.smithi089.stdout:data_pools [3] 2024-09-13T03:01:12.303 INFO:teuthology.orchestra.run.smithi089.stdout:metadata_pool 2 2024-09-13T03:01:12.303 INFO:teuthology.orchestra.run.smithi089.stdout:inline_data disabled 2024-09-13T03:01:12.303 INFO:teuthology.orchestra.run.smithi089.stdout:balancer 2024-09-13T03:01:12.304 INFO:teuthology.orchestra.run.smithi089.stdout:bal_rank_mask -1 2024-09-13T03:01:12.304 INFO:teuthology.orchestra.run.smithi089.stdout:standby_count_wanted 1 2024-09-13T03:01:12.304 INFO:teuthology.orchestra.run.smithi089.stdout:qdb_cluster leader: 14480 members: 14480 2024-09-13T03:01:12.304 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi089.rarddb{0:14480} state up:active seq 6 join_fscid=1 addr [v2:172.21.15.89:6828/1561365213,v1:172.21.15.89:6829/1561365213] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T03:01:12.304 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T03:01:12.304 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T03:01:12.304 INFO:teuthology.orchestra.run.smithi089.stdout:Standby daemons: 2024-09-13T03:01:12.304 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T03:01:12.304 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi089.qjoitb{-1:34380} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.89:6826/3159647567,v1:172.21.15.89:6827/3159647567] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T03:01:12.304 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi131.rbovzc{-1:44293} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.131:6826/1074022424,v1:172.21.15.131:6827/1074022424] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T03:01:12.304 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi131.uasrkg{-1:44301} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.131:6824/833117870,v1:172.21.15.131:6825/833117870] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T03:01:12.305 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 28 2024-09-13T03:01:12.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.302+0000 7f90b06a5640 1 -- 172.21.15.89:0/3153753665 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f909406e530 msgr2=0x7f90940709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:12.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.302+0000 7f90b06a5640 1 --2- 172.21.15.89:0/3153753665 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f909406e530 0x7f90940709e0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f90a810cdf0 tx=0x7f9098035040 comp rx=0 tx=0).stop 2024-09-13T03:01:12.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.302+0000 7f90b06a5640 1 -- 172.21.15.89:0/3153753665 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f90a80fdb30 msgr2=0x7f90a810d040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:12.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.302+0000 7f90b06a5640 1 --2- 172.21.15.89:0/3153753665 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f90a80fdb30 0x7f90a810d040 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f90a400c790 tx=0x7f90a40043c0 comp rx=0 tx=0).stop 2024-09-13T03:01:12.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.302+0000 7f90b06a5640 1 -- 172.21.15.89:0/3153753665 shutdown_connections 2024-09-13T03:01:12.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.302+0000 7f90b06a5640 1 --2- 172.21.15.89:0/3153753665 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f909406e530 0x7f90940709e0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:12.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.302+0000 7f90b06a5640 1 --2- 172.21.15.89:0/3153753665 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f90a80fe480 0x7f90a810d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:12.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.302+0000 7f90b06a5640 1 --2- 172.21.15.89:0/3153753665 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f90a80fdb30 0x7f90a810d040 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:12.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.302+0000 7f90b06a5640 1 -- 172.21.15.89:0/3153753665 >> 172.21.15.89:0/3153753665 conn(0x7f90a80f6330 msgr2=0x7f90a80f7ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:01:12.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.302+0000 7f90b06a5640 1 -- 172.21.15.89:0/3153753665 shutdown_connections 2024-09-13T03:01:12.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.302+0000 7f90b06a5640 1 -- 172.21.15.89:0/3153753665 wait complete. 2024-09-13T03:01:12.383 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.381+0000 7f7b62a90640 1 -- 172.21.15.89:0/542103541 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b5c0fe500 msgr2=0x7f7b5c0fa660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:12.383 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.381+0000 7f7b62a90640 1 --2- 172.21.15.89:0/542103541 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b5c0fe500 0x7f7b5c0fa660 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f7b480048d0 tx=0x7f7b48009da0 comp rx=0 tx=0).stop 2024-09-13T03:01:12.383 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.381+0000 7f7b62a90640 1 -- 172.21.15.89:0/542103541 shutdown_connections 2024-09-13T03:01:12.383 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.381+0000 7f7b62a90640 1 --2- 172.21.15.89:0/542103541 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b5c0fe500 0x7f7b5c0fa660 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:12.383 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.381+0000 7f7b62a90640 1 --2- 172.21.15.89:0/542103541 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7b5c0fdbb0 0x7f7b5c0fdfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:12.383 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.381+0000 7f7b62a90640 1 -- 172.21.15.89:0/542103541 >> 172.21.15.89:0/542103541 conn(0x7f7b5c0f63b0 msgr2=0x7f7b5c0f87e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:01:12.384 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.381+0000 7f7b62a90640 1 -- 172.21.15.89:0/542103541 shutdown_connections 2024-09-13T03:01:12.384 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.381+0000 7f7b62a90640 1 -- 172.21.15.89:0/542103541 wait complete. 2024-09-13T03:01:12.384 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.382+0000 7f7b62a90640 1 Processor -- start 2024-09-13T03:01:12.384 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.382+0000 7f7b62a90640 1 -- start start 2024-09-13T03:01:12.385 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.382+0000 7f7b62a90640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b5c0fdbb0 0x7f7b5c10d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:12.385 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.382+0000 7f7b62a90640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7b5c0fe500 0x7f7b5c10d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:12.385 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.382+0000 7f7b62a90640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b5c10dc20 con 0x7f7b5c0fdbb0 2024-09-13T03:01:12.385 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.382+0000 7f7b62a90640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b5c10e440 con 0x7f7b5c0fe500 2024-09-13T03:01:12.385 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.382+0000 7f7b6082c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b5c0fdbb0 0x7f7b5c10d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:12.386 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.382+0000 7f7b6082c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b5c0fdbb0 0x7f7b5c10d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:37302/0 (socket says 172.21.15.89:37302) 2024-09-13T03:01:12.386 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.382+0000 7f7b6082c640 1 -- 172.21.15.89:0/2634407257 learned_addr learned my addr 172.21.15.89:0/2634407257 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T03:01:12.386 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.382+0000 7f7b5bfff640 1 --2- 172.21.15.89:0/2634407257 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7b5c0fe500 0x7f7b5c10d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:12.386 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.383+0000 7f7b6082c640 1 -- 172.21.15.89:0/2634407257 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7b5c0fe500 msgr2=0x7f7b5c10d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:12.386 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.383+0000 7f7b6082c640 1 --2- 172.21.15.89:0/2634407257 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7b5c0fe500 0x7f7b5c10d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:12.386 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.383+0000 7f7b6082c640 1 -- 172.21.15.89:0/2634407257 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b48005040 con 0x7f7b5c0fdbb0 2024-09-13T03:01:12.386 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.383+0000 7f7b6082c640 1 --2- 172.21.15.89:0/2634407257 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b5c0fdbb0 0x7f7b5c10d090 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7b5000c810 tx=0x7f7b500043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:01:12.386 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.383+0000 7f7b597fa640 1 -- 172.21.15.89:0/2634407257 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b5000a820 con 0x7f7b5c0fdbb0 2024-09-13T03:01:12.386 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.383+0000 7f7b62a90640 1 -- 172.21.15.89:0/2634407257 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b5c10e6d0 con 0x7f7b5c0fdbb0 2024-09-13T03:01:12.386 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.383+0000 7f7b597fa640 1 -- 172.21.15.89:0/2634407257 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f7b5000ae20 con 0x7f7b5c0fdbb0 2024-09-13T03:01:12.386 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.383+0000 7f7b597fa640 1 -- 172.21.15.89:0/2634407257 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7b500115c0 con 0x7f7b5c0fdbb0 2024-09-13T03:01:12.387 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.383+0000 7f7b62a90640 1 -- 172.21.15.89:0/2634407257 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b5c10eb90 con 0x7f7b5c0fdbb0 2024-09-13T03:01:12.387 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.384+0000 7f7b62a90640 1 -- 172.21.15.89:0/2634407257 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b5c0fa050 con 0x7f7b5c0fdbb0 2024-09-13T03:01:12.387 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.385+0000 7f7b597fa640 1 -- 172.21.15.89:0/2634407257 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f7b50012840 con 0x7f7b5c0fdbb0 2024-09-13T03:01:12.387 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.385+0000 7f7b597fa640 1 --2- 172.21.15.89:0/2634407257 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f7b4c06e530 0x7f7b4c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:12.387 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.385+0000 7f7b597fa640 1 -- 172.21.15.89:0/2634407257 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6496+0+0 (secure 0 0 0) 0x7f7b5008e740 con 0x7f7b5c0fdbb0 2024-09-13T03:01:12.388 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.385+0000 7f7b5bfff640 1 --2- 172.21.15.89:0/2634407257 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f7b4c06e530 0x7f7b4c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:12.388 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.386+0000 7f7b5bfff640 1 --2- 172.21.15.89:0/2634407257 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f7b4c06e530 0x7f7b4c0709e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c10ce40 tx=0x7f7b48035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:01:12.391 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.390+0000 7f7b597fa640 1 -- 172.21.15.89:0/2634407257 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f7b5005b360 con 0x7f7b5c0fdbb0 2024-09-13T03:01:12.581 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.579+0000 7f7b62a90640 1 -- 172.21.15.89:0/2634407257 --> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7b5c10f0b0 con 0x7f7b4c06e530 2024-09-13T03:01:12.582 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.580+0000 7f7b597fa640 1 -- 172.21.15.89:0/2634407257 <== mgr.34104 v2:172.21.15.89:6800/1881577856 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f7b5c10f0b0 con 0x7f7b4c06e530 2024-09-13T03:01:12.582 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-13T03:01:12.582 INFO:teuthology.orchestra.run.smithi089.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d", 2024-09-13T03:01:12.582 INFO:teuthology.orchestra.run.smithi089.stdout: "in_progress": true, 2024-09-13T03:01:12.582 INFO:teuthology.orchestra.run.smithi089.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T03:01:12.582 INFO:teuthology.orchestra.run.smithi089.stdout: "services_complete": [ 2024-09-13T03:01:12.582 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr", 2024-09-13T03:01:12.582 INFO:teuthology.orchestra.run.smithi089.stdout: "osd", 2024-09-13T03:01:12.583 INFO:teuthology.orchestra.run.smithi089.stdout: "crash", 2024-09-13T03:01:12.583 INFO:teuthology.orchestra.run.smithi089.stdout: "mon" 2024-09-13T03:01:12.583 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-13T03:01:12.583 INFO:teuthology.orchestra.run.smithi089.stdout: "progress": "12/21 daemons upgraded", 2024-09-13T03:01:12.583 INFO:teuthology.orchestra.run.smithi089.stdout: "message": "Currently upgrading osd daemons", 2024-09-13T03:01:12.583 INFO:teuthology.orchestra.run.smithi089.stdout: "is_paused": false 2024-09-13T03:01:12.583 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-13T03:01:12.584 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.582+0000 7f7b62a90640 1 -- 172.21.15.89:0/2634407257 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f7b4c06e530 msgr2=0x7f7b4c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:12.584 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.582+0000 7f7b62a90640 1 --2- 172.21.15.89:0/2634407257 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f7b4c06e530 0x7f7b4c0709e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f7b5c10ce40 tx=0x7f7b48035040 comp rx=0 tx=0).stop 2024-09-13T03:01:12.584 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.582+0000 7f7b62a90640 1 -- 172.21.15.89:0/2634407257 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b5c0fdbb0 msgr2=0x7f7b5c10d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:12.584 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.582+0000 7f7b62a90640 1 --2- 172.21.15.89:0/2634407257 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b5c0fdbb0 0x7f7b5c10d090 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f7b5000c810 tx=0x7f7b500043c0 comp rx=0 tx=0).stop 2024-09-13T03:01:12.585 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.583+0000 7f7b62a90640 1 -- 172.21.15.89:0/2634407257 shutdown_connections 2024-09-13T03:01:12.585 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.583+0000 7f7b62a90640 1 --2- 172.21.15.89:0/2634407257 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f7b4c06e530 0x7f7b4c0709e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:12.585 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.583+0000 7f7b62a90640 1 --2- 172.21.15.89:0/2634407257 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7b5c0fe500 0x7f7b5c10d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:12.585 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.583+0000 7f7b62a90640 1 --2- 172.21.15.89:0/2634407257 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7b5c0fdbb0 0x7f7b5c10d090 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:12.585 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.583+0000 7f7b62a90640 1 -- 172.21.15.89:0/2634407257 >> 172.21.15.89:0/2634407257 conn(0x7f7b5c0f63b0 msgr2=0x7f7b5c0f7b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:01:12.585 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.583+0000 7f7b62a90640 1 -- 172.21.15.89:0/2634407257 shutdown_connections 2024-09-13T03:01:12.585 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.583+0000 7f7b62a90640 1 -- 172.21.15.89:0/2634407257 wait complete. 2024-09-13T03:01:12.663 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.661+0000 7fc93c2bf640 1 -- 172.21.15.89:0/1535340459 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9340fc520 msgr2=0x7fc9340fc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:12.663 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.661+0000 7fc93c2bf640 1 --2- 172.21.15.89:0/1535340459 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9340fc520 0x7fc9340fc930 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc92c0048d0 tx=0x7fc92c009da0 comp rx=0 tx=0).stop 2024-09-13T03:01:12.663 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:12 smithi089 ceph-mon[91553]: from='client.34388 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T03:01:12.664 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:12 smithi089 ceph-mon[91553]: from='client.34392 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T03:01:12.664 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:12 smithi089 ceph-mon[91553]: pgmap v172: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 341 B/s wr, 2 op/s 2024-09-13T03:01:12.664 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:12 smithi089 ceph-mon[91553]: from='client.34396 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T03:01:12.664 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:12 smithi089 ceph-mon[91553]: from='client.? 172.21.15.89:0/1299256258' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:01:12.664 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:12 smithi089 ceph-mon[91553]: from='client.? 172.21.15.89:0/3153753665' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T03:01:12.666 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.662+0000 7fc93c2bf640 1 -- 172.21.15.89:0/1535340459 shutdown_connections 2024-09-13T03:01:12.666 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.662+0000 7fc93c2bf640 1 --2- 172.21.15.89:0/1535340459 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9340fd7f0 0x7fc9340fdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:12.666 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.662+0000 7fc93c2bf640 1 --2- 172.21.15.89:0/1535340459 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9340fc520 0x7fc9340fc930 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:12.666 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.662+0000 7fc93c2bf640 1 -- 172.21.15.89:0/1535340459 >> 172.21.15.89:0/1535340459 conn(0x7fc9340f7ce0 msgr2=0x7fc9340fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:01:12.666 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.662+0000 7fc93c2bf640 1 -- 172.21.15.89:0/1535340459 shutdown_connections 2024-09-13T03:01:12.666 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.662+0000 7fc93c2bf640 1 -- 172.21.15.89:0/1535340459 wait complete. 2024-09-13T03:01:12.666 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.662+0000 7fc93c2bf640 1 Processor -- start 2024-09-13T03:01:12.666 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.663+0000 7fc93c2bf640 1 -- start start 2024-09-13T03:01:12.666 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.663+0000 7fc93c2bf640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9340fc520 0x7fc93410d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:12.666 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.663+0000 7fc93c2bf640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9340fd7f0 0x7fc93410d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:12.666 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.663+0000 7fc93c2bf640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc93410dc10 con 0x7fc9340fc520 2024-09-13T03:01:12.667 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.663+0000 7fc93c2bf640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc93410e430 con 0x7fc9340fd7f0 2024-09-13T03:01:12.667 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.663+0000 7fc93a05b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9340fc520 0x7fc93410d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:12.667 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.663+0000 7fc93a05b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9340fc520 0x7fc93410d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:37320/0 (socket says 172.21.15.89:37320) 2024-09-13T03:01:12.667 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.663+0000 7fc93a05b640 1 -- 172.21.15.89:0/4155271854 learned_addr learned my addr 172.21.15.89:0/4155271854 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T03:01:12.667 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.663+0000 7fc93985a640 1 --2- 172.21.15.89:0/4155271854 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9340fd7f0 0x7fc93410d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:12.667 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.663+0000 7fc93a05b640 1 -- 172.21.15.89:0/4155271854 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9340fd7f0 msgr2=0x7fc93410d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:12.667 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.663+0000 7fc93a05b640 1 --2- 172.21.15.89:0/4155271854 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9340fd7f0 0x7fc93410d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:12.667 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.663+0000 7fc93a05b640 1 -- 172.21.15.89:0/4155271854 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc92c005040 con 0x7fc9340fc520 2024-09-13T03:01:12.667 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.663+0000 7fc93a05b640 1 --2- 172.21.15.89:0/4155271854 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9340fc520 0x7fc93410d080 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc92c0043d0 tx=0x7fc92c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:01:12.667 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.664+0000 7fc932ffd640 1 -- 172.21.15.89:0/4155271854 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc92c038070 con 0x7fc9340fc520 2024-09-13T03:01:12.667 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.664+0000 7fc932ffd640 1 -- 172.21.15.89:0/4155271854 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc92c02ae90 con 0x7fc9340fc520 2024-09-13T03:01:12.667 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.664+0000 7fc93c2bf640 1 -- 172.21.15.89:0/4155271854 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc93410e660 con 0x7fc9340fc520 2024-09-13T03:01:12.668 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.664+0000 7fc932ffd640 1 -- 172.21.15.89:0/4155271854 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc92c03e670 con 0x7fc9340fc520 2024-09-13T03:01:12.668 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.664+0000 7fc93c2bf640 1 -- 172.21.15.89:0/4155271854 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc93410ec00 con 0x7fc9340fc520 2024-09-13T03:01:12.669 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.665+0000 7fc93c2bf640 1 -- 172.21.15.89:0/4155271854 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9340fb980 con 0x7fc9340fc520 2024-09-13T03:01:12.669 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.665+0000 7fc932ffd640 1 -- 172.21.15.89:0/4155271854 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fc92c030020 con 0x7fc9340fc520 2024-09-13T03:01:12.669 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.665+0000 7fc932ffd640 1 --2- 172.21.15.89:0/4155271854 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fc91c06e530 0x7fc91c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:12.669 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.666+0000 7fc932ffd640 1 -- 172.21.15.89:0/4155271854 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 6496+0+0 (secure 0 0 0) 0x7fc92c0ae330 con 0x7fc9340fc520 2024-09-13T03:01:12.669 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.666+0000 7fc93985a640 1 --2- 172.21.15.89:0/4155271854 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fc91c06e530 0x7fc91c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:12.669 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.666+0000 7fc93985a640 1 --2- 172.21.15.89:0/4155271854 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fc91c06e530 0x7fc91c0709e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc93410ce30 tx=0x7fc92800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:01:12.671 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.670+0000 7fc932ffd640 1 -- 172.21.15.89:0/4155271854 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fc92c0774d0 con 0x7fc9340fc520 2024-09-13T03:01:12.905 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.903+0000 7fc93c2bf640 1 -- 172.21.15.89:0/4155271854 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fc93404b720 con 0x7fc9340fc520 2024-09-13T03:01:12.905 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.904+0000 7fc932ffd640 1 -- 172.21.15.89:0/4155271854 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fc92c07ab90 con 0x7fc9340fc520 2024-09-13T03:01:12.905 INFO:teuthology.orchestra.run.smithi089.stdout:HEALTH_OK 2024-09-13T03:01:12.907 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.906+0000 7fc93c2bf640 1 -- 172.21.15.89:0/4155271854 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fc91c06e530 msgr2=0x7fc91c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:12.907 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.906+0000 7fc93c2bf640 1 --2- 172.21.15.89:0/4155271854 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fc91c06e530 0x7fc91c0709e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fc93410ce30 tx=0x7fc92800b040 comp rx=0 tx=0).stop 2024-09-13T03:01:12.907 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.906+0000 7fc93c2bf640 1 -- 172.21.15.89:0/4155271854 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9340fc520 msgr2=0x7fc93410d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:12.907 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.906+0000 7fc93c2bf640 1 --2- 172.21.15.89:0/4155271854 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9340fc520 0x7fc93410d080 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc92c0043d0 tx=0x7fc92c009da0 comp rx=0 tx=0).stop 2024-09-13T03:01:12.907 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.906+0000 7fc93c2bf640 1 -- 172.21.15.89:0/4155271854 shutdown_connections 2024-09-13T03:01:12.908 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.906+0000 7fc93c2bf640 1 --2- 172.21.15.89:0/4155271854 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fc91c06e530 0x7fc91c0709e0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:12.908 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.906+0000 7fc93c2bf640 1 --2- 172.21.15.89:0/4155271854 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc9340fd7f0 0x7fc93410d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:12.908 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.906+0000 7fc93c2bf640 1 --2- 172.21.15.89:0/4155271854 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc9340fc520 0x7fc93410d080 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:12.908 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.906+0000 7fc93c2bf640 1 -- 172.21.15.89:0/4155271854 >> 172.21.15.89:0/4155271854 conn(0x7fc9340f7ce0 msgr2=0x7fc9340f9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:01:12.908 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.906+0000 7fc93c2bf640 1 -- 172.21.15.89:0/4155271854 shutdown_connections 2024-09-13T03:01:12.908 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:12.906+0000 7fc93c2bf640 1 -- 172.21.15.89:0/4155271854 wait complete. 2024-09-13T03:01:12.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:12 smithi131 ceph-mon[78839]: from='client.34388 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T03:01:12.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:12 smithi131 ceph-mon[78839]: from='client.34392 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T03:01:12.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:12 smithi131 ceph-mon[78839]: pgmap v172: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 341 B/s wr, 2 op/s 2024-09-13T03:01:12.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:12 smithi131 ceph-mon[78839]: from='client.34396 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T03:01:12.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:12 smithi131 ceph-mon[78839]: from='client.? 172.21.15.89:0/1299256258' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:01:12.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:12 smithi131 ceph-mon[78839]: from='client.? 172.21.15.89:0/3153753665' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T03:01:13.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:13 smithi131 ceph-mon[78839]: from='client.34408 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T03:01:13.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:13 smithi131 ceph-mon[78839]: from='client.? 172.21.15.89:0/4155271854' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T03:01:14.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:13 smithi089 ceph-mon[91553]: from='client.34408 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T03:01:14.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:13 smithi089 ceph-mon[91553]: from='client.? 172.21.15.89:0/4155271854' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T03:01:14.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:14 smithi131 ceph-mon[78839]: pgmap v173: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-09-13T03:01:15.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:14 smithi089 ceph-mon[91553]: pgmap v173: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-09-13T03:01:16.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:16 smithi131 ceph-mon[78839]: pgmap v174: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-09-13T03:01:17.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:16 smithi089 ceph-mon[91553]: pgmap v174: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-09-13T03:01:17.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:17 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:01:17.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:17 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T03:01:17.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:17 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T03:01:17.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:17 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:01:17.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:17 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:01:17.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:17 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:01:17.786 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:17 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:01:17.786 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:17 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:01:17.786 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:17 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:01:17.786 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:17 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi089.qjoitb"]}]: dispatch 2024-09-13T03:01:17.786 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:17 smithi089 ceph-mon[91553]: Upgrade: It appears safe to stop mds.cephfs.smithi089.qjoitb 2024-09-13T03:01:17.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:17 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:01:17.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:17 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T03:01:17.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:17 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T03:01:17.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:17 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:01:17.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:17 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:01:17.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:17 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:01:17.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:17 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:01:17.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:17 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:01:17.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:17 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:01:17.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:17 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi089.qjoitb"]}]: dispatch 2024-09-13T03:01:17.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:17 smithi131 ceph-mon[78839]: Upgrade: It appears safe to stop mds.cephfs.smithi089.qjoitb 2024-09-13T03:01:18.914 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:18 smithi089 ceph-mon[91553]: pgmap v175: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-09-13T03:01:18.914 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:18 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:01:18.914 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:18 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi089.qjoitb", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T03:01:18.915 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:18 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T03:01:18.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:18 smithi131 ceph-mon[78839]: pgmap v175: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-09-13T03:01:18.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:18 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:01:18.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:18 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi089.qjoitb", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T03:01:18.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:18 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T03:01:19.886 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:19 smithi089 ceph-mon[91553]: Upgrade: Updating mds.cephfs.smithi089.qjoitb 2024-09-13T03:01:19.886 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:19 smithi089 ceph-mon[91553]: Deploying daemon mds.cephfs.smithi089.qjoitb on smithi089 2024-09-13T03:01:19.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:19 smithi131 ceph-mon[78839]: Upgrade: Updating mds.cephfs.smithi089.qjoitb 2024-09-13T03:01:19.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:19 smithi131 ceph-mon[78839]: Deploying daemon mds.cephfs.smithi089.qjoitb on smithi089 2024-09-13T03:01:20.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:20 smithi131 ceph-mon[78839]: pgmap v176: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-09-13T03:01:20.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:20 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:01:21.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:20 smithi089 ceph-mon[91553]: pgmap v176: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-09-13T03:01:21.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:20 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:01:21.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:21 smithi131 ceph-mon[78839]: osdmap e79: 6 total, 6 up, 6 in 2024-09-13T03:01:21.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:21 smithi131 ceph-mon[78839]: fsmap cephfs:1 {0=cephfs.smithi089.rarddb=up:active} 2 up:standby 2024-09-13T03:01:21.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:21 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi089.qjoitb"}]: dispatch 2024-09-13T03:01:22.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:21 smithi089 ceph-mon[91553]: osdmap e79: 6 total, 6 up, 6 in 2024-09-13T03:01:22.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:21 smithi089 ceph-mon[91553]: fsmap cephfs:1 {0=cephfs.smithi089.rarddb=up:active} 2 up:standby 2024-09-13T03:01:22.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:21 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi089.qjoitb"}]: dispatch 2024-09-13T03:01:23.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:22 smithi089 ceph-mon[91553]: pgmap v178: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:01:23.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:22 smithi131 ceph-mon[78839]: pgmap v178: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:01:25.017 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:24 smithi089 ceph-mon[91553]: pgmap v179: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:01:25.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:24 smithi131 ceph-mon[78839]: pgmap v179: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:01:27.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:26 smithi089 ceph-mon[91553]: pgmap v180: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:01:27.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:26 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:01:27.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:26 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:01:27.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:26 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:01:27.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:26 smithi131 ceph-mon[78839]: pgmap v180: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:01:27.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:26 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:01:27.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:26 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:01:27.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:26 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:01:28.025 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:27 smithi089 ceph-mon[91553]: mds.? [v2:172.21.15.89:6826/2439422546,v1:172.21.15.89:6827/2439422546] up:boot 2024-09-13T03:01:28.025 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:27 smithi089 ceph-mon[91553]: fsmap cephfs:1 {0=cephfs.smithi089.rarddb=up:active} 3 up:standby 2024-09-13T03:01:28.025 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:27 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi089.qjoitb"}]: dispatch 2024-09-13T03:01:28.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:27 smithi131 ceph-mon[78839]: mds.? [v2:172.21.15.89:6826/2439422546,v1:172.21.15.89:6827/2439422546] up:boot 2024-09-13T03:01:28.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:27 smithi131 ceph-mon[78839]: fsmap cephfs:1 {0=cephfs.smithi089.rarddb=up:active} 3 up:standby 2024-09-13T03:01:28.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:27 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi089.qjoitb"}]: dispatch 2024-09-13T03:01:29.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:28 smithi089 ceph-mon[91553]: pgmap v181: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:01:29.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:28 smithi131 ceph-mon[78839]: pgmap v181: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:01:31.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:30 smithi089 ceph-mon[91553]: pgmap v182: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:01:31.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:30 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:01:31.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:30 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:01:31.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:30 smithi131 ceph-mon[78839]: pgmap v182: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:01:31.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:30 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:01:31.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:30 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:01:32.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:32 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:01:32.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:32 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:01:32.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:32 smithi089 ceph-mon[91553]: pgmap v183: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:01:32.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:32 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:01:32.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:32 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:01:32.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:32 smithi131 ceph-mon[78839]: pgmap v183: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:01:34.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:34 smithi131 ceph-mon[78839]: pgmap v184: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:01:34.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:34 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:01:34.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:34 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:01:34.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:34 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T03:01:34.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:34 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T03:01:34.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:34 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:01:34.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:34 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:01:34.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:34 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:01:34.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:34 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:01:34.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:34 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:01:34.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:34 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:01:34.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:34 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi089.rarddb"]}]: dispatch 2024-09-13T03:01:35.024 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:34 smithi089 ceph-mon[91553]: pgmap v184: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:01:35.024 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:34 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:01:35.024 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:34 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:01:35.024 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:34 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T03:01:35.024 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:34 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T03:01:35.024 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:34 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:01:35.024 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:34 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:01:35.024 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:34 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:01:35.024 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:34 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:01:35.025 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:34 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:01:35.025 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:34 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:01:35.025 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:34 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi089.rarddb"]}]: dispatch 2024-09-13T03:01:35.933 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:35 smithi131 ceph-mon[78839]: Detected new or changed devices on smithi089 2024-09-13T03:01:35.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:35 smithi131 ceph-mon[78839]: Upgrade: It appears safe to stop mds.cephfs.smithi089.rarddb 2024-09-13T03:01:35.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:35 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:01:35.965 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:35 smithi089 ceph-mon[91553]: Detected new or changed devices on smithi089 2024-09-13T03:01:35.965 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:35 smithi089 ceph-mon[91553]: Upgrade: It appears safe to stop mds.cephfs.smithi089.rarddb 2024-09-13T03:01:35.965 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:35 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:01:36.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:36 smithi131 ceph-mon[78839]: pgmap v185: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:01:36.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:36 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:01:36.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:36 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi089.rarddb", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T03:01:36.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:36 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T03:01:37.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:36 smithi089 ceph-mon[91553]: pgmap v185: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:01:37.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:36 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:01:37.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:36 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi089.rarddb", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T03:01:37.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:36 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T03:01:37.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:37 smithi131 ceph-mon[78839]: Upgrade: Updating mds.cephfs.smithi089.rarddb 2024-09-13T03:01:37.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:37 smithi131 ceph-mon[78839]: Deploying daemon mds.cephfs.smithi089.rarddb on smithi089 2024-09-13T03:01:37.944 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:37 smithi089 ceph-mon[91553]: Upgrade: Updating mds.cephfs.smithi089.rarddb 2024-09-13T03:01:37.945 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:37 smithi089 ceph-mon[91553]: Deploying daemon mds.cephfs.smithi089.rarddb on smithi089 2024-09-13T03:01:38.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:37 smithi089 ceph-12cdb164-717a-11ef-bceb-c7b262605968-mon-smithi089[91549]: 2024-09-13T03:01:37.942+0000 7f8d97f97640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T03:01:38.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:38 smithi131 ceph-mon[78839]: pgmap v186: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:01:38.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:38 smithi131 ceph-mon[78839]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-13T03:01:38.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:38 smithi131 ceph-mon[78839]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T03:01:38.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:38 smithi131 ceph-mon[78839]: osdmap e80: 6 total, 6 up, 6 in 2024-09-13T03:01:38.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:38 smithi131 ceph-mon[78839]: Standby daemon mds.cephfs.smithi089.qjoitb assigned to filesystem cephfs as rank 0 2024-09-13T03:01:38.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:38 smithi131 ceph-mon[78839]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-13T03:01:38.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:38 smithi131 ceph-mon[78839]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-13T03:01:38.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:38 smithi131 ceph-mon[78839]: fsmap cephfs:1/1 {0=cephfs.smithi089.qjoitb=up:replay} 2 up:standby 2024-09-13T03:01:39.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:38 smithi089 ceph-mon[91553]: pgmap v186: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:01:39.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:38 smithi089 ceph-mon[91553]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-13T03:01:39.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:38 smithi089 ceph-mon[91553]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-13T03:01:39.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:38 smithi089 ceph-mon[91553]: osdmap e80: 6 total, 6 up, 6 in 2024-09-13T03:01:39.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:38 smithi089 ceph-mon[91553]: Standby daemon mds.cephfs.smithi089.qjoitb assigned to filesystem cephfs as rank 0 2024-09-13T03:01:39.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:38 smithi089 ceph-mon[91553]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-13T03:01:39.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:38 smithi089 ceph-mon[91553]: fsmap cephfs:0/1 3 up:standby, 1 failed 2024-09-13T03:01:39.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:38 smithi089 ceph-mon[91553]: fsmap cephfs:1/1 {0=cephfs.smithi089.qjoitb=up:replay} 2 up:standby 2024-09-13T03:01:40.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:40 smithi131 ceph-mon[78839]: pgmap v188: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 1.6 MiB/s rd, 0 op/s 2024-09-13T03:01:41.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:40 smithi089 ceph-mon[91553]: pgmap v188: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 1.6 MiB/s rd, 0 op/s 2024-09-13T03:01:41.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:41 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi089.rarddb"}]: dispatch 2024-09-13T03:01:42.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:41 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi089.rarddb"}]: dispatch 2024-09-13T03:01:42.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:42 smithi131 ceph-mon[78839]: pgmap v189: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 3 op/s 2024-09-13T03:01:42.990 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:42 smithi089 ceph-mon[91553]: pgmap v189: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 3 op/s 2024-09-13T03:01:42.991 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:42.989+0000 7fb7df5d7640 1 -- 172.21.15.89:0/4009569453 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb7d80ff700 msgr2=0x7fb7d8101ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:42.992 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:42.989+0000 7fb7df5d7640 1 --2- 172.21.15.89:0/4009569453 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb7d80ff700 0x7fb7d8101ae0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fb7c80048d0 tx=0x7fb7c8009da0 comp rx=0 tx=0).stop 2024-09-13T03:01:42.992 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:42.989+0000 7fb7df5d7640 1 -- 172.21.15.89:0/4009569453 shutdown_connections 2024-09-13T03:01:42.992 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:42.989+0000 7fb7df5d7640 1 --2- 172.21.15.89:0/4009569453 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb7d80ff700 0x7fb7d8101ae0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:42.992 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:42.989+0000 7fb7df5d7640 1 --2- 172.21.15.89:0/4009569453 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb7d8065bc0 0x7fb7d80ff1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:42.992 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:42.989+0000 7fb7df5d7640 1 -- 172.21.15.89:0/4009569453 >> 172.21.15.89:0/4009569453 conn(0x7fb7d80f6c10 msgr2=0x7fb7d80f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:01:42.992 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:42.989+0000 7fb7df5d7640 1 -- 172.21.15.89:0/4009569453 shutdown_connections 2024-09-13T03:01:42.992 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:42.989+0000 7fb7df5d7640 1 -- 172.21.15.89:0/4009569453 wait complete. 2024-09-13T03:01:42.992 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:42.989+0000 7fb7df5d7640 1 Processor -- start 2024-09-13T03:01:42.992 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:42.989+0000 7fb7df5d7640 1 -- start start 2024-09-13T03:01:42.992 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:42.990+0000 7fb7df5d7640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb7d8065bc0 0x7fb7d810d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:42.993 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:42.990+0000 7fb7df5d7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb7d80ff700 0x7fb7d810d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:42.993 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:42.990+0000 7fb7df5d7640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d810dcb0 con 0x7fb7d80ff700 2024-09-13T03:01:42.993 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:42.990+0000 7fb7df5d7640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7d810e480 con 0x7fb7d8065bc0 2024-09-13T03:01:42.993 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:42.990+0000 7fb7dcb72640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb7d80ff700 0x7fb7d810d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:42.993 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:42.990+0000 7fb7dcb72640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb7d80ff700 0x7fb7d810d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:58594/0 (socket says 172.21.15.89:58594) 2024-09-13T03:01:42.993 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:42.990+0000 7fb7dcb72640 1 -- 172.21.15.89:0/2808356681 learned_addr learned my addr 172.21.15.89:0/2808356681 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T03:01:42.993 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:42.990+0000 7fb7dd373640 1 --2- 172.21.15.89:0/2808356681 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb7d8065bc0 0x7fb7d810d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:42.993 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:42.990+0000 7fb7dcb72640 1 -- 172.21.15.89:0/2808356681 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb7d8065bc0 msgr2=0x7fb7d810d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:42.993 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:42.990+0000 7fb7dcb72640 1 --2- 172.21.15.89:0/2808356681 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb7d8065bc0 0x7fb7d810d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:42.993 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:42.990+0000 7fb7dcb72640 1 -- 172.21.15.89:0/2808356681 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7c8005040 con 0x7fb7d80ff700 2024-09-13T03:01:42.993 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:42.990+0000 7fb7dcb72640 1 --2- 172.21.15.89:0/2808356681 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb7d80ff700 0x7fb7d810d660 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb7c80043d0 tx=0x7fb7c8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:01:42.995 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:42.991+0000 7fb7cdffb640 1 -- 172.21.15.89:0/2808356681 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb7c8038070 con 0x7fb7d80ff700 2024-09-13T03:01:42.995 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:42.991+0000 7fb7cdffb640 1 -- 172.21.15.89:0/2808356681 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb7c802ae90 con 0x7fb7d80ff700 2024-09-13T03:01:42.995 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:42.991+0000 7fb7cdffb640 1 -- 172.21.15.89:0/2808356681 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb7c803e670 con 0x7fb7d80ff700 2024-09-13T03:01:42.995 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:42.991+0000 7fb7df5d7640 1 -- 172.21.15.89:0/2808356681 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7d810e6b0 con 0x7fb7d80ff700 2024-09-13T03:01:42.995 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:42.991+0000 7fb7df5d7640 1 -- 172.21.15.89:0/2808356681 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7d810ec50 con 0x7fb7d80ff700 2024-09-13T03:01:42.995 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:42.992+0000 7fb7cdffb640 1 -- 172.21.15.89:0/2808356681 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fb7c8030020 con 0x7fb7d80ff700 2024-09-13T03:01:42.995 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:42.992+0000 7fb7df5d7640 1 -- 172.21.15.89:0/2808356681 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7d80fa890 con 0x7fb7d80ff700 2024-09-13T03:01:42.995 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:42.993+0000 7fb7cdffb640 1 --2- 172.21.15.89:0/2808356681 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fb7c406e530 0x7fb7c40709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:42.995 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:42.993+0000 7fb7cdffb640 1 -- 172.21.15.89:0/2808356681 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fb7c80ae380 con 0x7fb7d80ff700 2024-09-13T03:01:42.996 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:42.993+0000 7fb7dd373640 1 --2- 172.21.15.89:0/2808356681 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fb7c406e530 0x7fb7c40709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:42.996 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:42.994+0000 7fb7dd373640 1 --2- 172.21.15.89:0/2808356681 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fb7c406e530 0x7fb7c40709e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb7d4009fd0 tx=0x7fb7d4009e50 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:01:42.999 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:42.998+0000 7fb7cdffb640 1 -- 172.21.15.89:0/2808356681 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fb7c8077640 con 0x7fb7d80ff700 2024-09-13T03:01:43.191 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.190+0000 7fb7df5d7640 1 -- 172.21.15.89:0/2808356681 --> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb7d810efd0 con 0x7fb7c406e530 2024-09-13T03:01:43.192 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.191+0000 7fb7cdffb640 1 -- 172.21.15.89:0/2808356681 <== mgr.34104 v2:172.21.15.89:6800/1881577856 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fb7d810efd0 con 0x7fb7c406e530 2024-09-13T03:01:43.196 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.194+0000 7fb7df5d7640 1 -- 172.21.15.89:0/2808356681 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fb7c406e530 msgr2=0x7fb7c40709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:43.196 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.194+0000 7fb7df5d7640 1 --2- 172.21.15.89:0/2808356681 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fb7c406e530 0x7fb7c40709e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb7d4009fd0 tx=0x7fb7d4009e50 comp rx=0 tx=0).stop 2024-09-13T03:01:43.196 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.194+0000 7fb7df5d7640 1 -- 172.21.15.89:0/2808356681 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb7d80ff700 msgr2=0x7fb7d810d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:43.196 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.194+0000 7fb7df5d7640 1 --2- 172.21.15.89:0/2808356681 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb7d80ff700 0x7fb7d810d660 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb7c80043d0 tx=0x7fb7c8009da0 comp rx=0 tx=0).stop 2024-09-13T03:01:43.196 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.194+0000 7fb7df5d7640 1 -- 172.21.15.89:0/2808356681 shutdown_connections 2024-09-13T03:01:43.196 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.194+0000 7fb7df5d7640 1 --2- 172.21.15.89:0/2808356681 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fb7c406e530 0x7fb7c40709e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:43.196 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.194+0000 7fb7df5d7640 1 --2- 172.21.15.89:0/2808356681 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb7d80ff700 0x7fb7d810d660 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:43.196 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.194+0000 7fb7df5d7640 1 --2- 172.21.15.89:0/2808356681 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb7d8065bc0 0x7fb7d810d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:43.197 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.194+0000 7fb7df5d7640 1 -- 172.21.15.89:0/2808356681 >> 172.21.15.89:0/2808356681 conn(0x7fb7d80f6c10 msgr2=0x7fb7d80f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:01:43.197 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.194+0000 7fb7df5d7640 1 -- 172.21.15.89:0/2808356681 shutdown_connections 2024-09-13T03:01:43.197 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.194+0000 7fb7df5d7640 1 -- 172.21.15.89:0/2808356681 wait complete. 2024-09-13T03:01:43.204 INFO:teuthology.orchestra.run.smithi089.stdout:true 2024-09-13T03:01:43.291 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.289+0000 7fb1ac4ca640 1 -- 172.21.15.89:0/4060473375 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1a40fd7f0 msgr2=0x7fb1a40fdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:43.291 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.289+0000 7fb1ac4ca640 1 --2- 172.21.15.89:0/4060473375 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1a40fd7f0 0x7fb1a40fdc60 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fb1940048d0 tx=0x7fb194009da0 comp rx=0 tx=0).stop 2024-09-13T03:01:43.291 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.289+0000 7fb1ac4ca640 1 -- 172.21.15.89:0/4060473375 shutdown_connections 2024-09-13T03:01:43.291 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.289+0000 7fb1ac4ca640 1 --2- 172.21.15.89:0/4060473375 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1a40fd7f0 0x7fb1a40fdc60 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:43.291 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.289+0000 7fb1ac4ca640 1 --2- 172.21.15.89:0/4060473375 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb1a40fc520 0x7fb1a40fc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:43.291 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.289+0000 7fb1ac4ca640 1 -- 172.21.15.89:0/4060473375 >> 172.21.15.89:0/4060473375 conn(0x7fb1a40f7ce0 msgr2=0x7fb1a40fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:01:43.291 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.289+0000 7fb1ac4ca640 1 -- 172.21.15.89:0/4060473375 shutdown_connections 2024-09-13T03:01:43.291 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.289+0000 7fb1ac4ca640 1 -- 172.21.15.89:0/4060473375 wait complete. 2024-09-13T03:01:43.293 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.290+0000 7fb1ac4ca640 1 Processor -- start 2024-09-13T03:01:43.293 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.290+0000 7fb1ac4ca640 1 -- start start 2024-09-13T03:01:43.293 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.290+0000 7fb1ac4ca640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1a40fc520 0x7fb1a410d0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:43.293 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.290+0000 7fb1ac4ca640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb1a40fd7f0 0x7fb1a410d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:43.293 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.290+0000 7fb1ac4ca640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a410e490 con 0x7fb1a40fc520 2024-09-13T03:01:43.293 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.290+0000 7fb1ac4ca640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a410e600 con 0x7fb1a40fd7f0 2024-09-13T03:01:43.293 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.290+0000 7fb1aa266640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1a40fc520 0x7fb1a410d0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:43.293 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.290+0000 7fb1aa266640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1a40fc520 0x7fb1a410d0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:58604/0 (socket says 172.21.15.89:58604) 2024-09-13T03:01:43.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.290+0000 7fb1aa266640 1 -- 172.21.15.89:0/1554729650 learned_addr learned my addr 172.21.15.89:0/1554729650 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T03:01:43.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.290+0000 7fb1a9a65640 1 --2- 172.21.15.89:0/1554729650 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb1a40fd7f0 0x7fb1a410d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:43.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.291+0000 7fb1aa266640 1 -- 172.21.15.89:0/1554729650 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb1a40fd7f0 msgr2=0x7fb1a410d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:43.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.291+0000 7fb1aa266640 1 --2- 172.21.15.89:0/1554729650 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb1a40fd7f0 0x7fb1a410d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:43.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.291+0000 7fb1aa266640 1 -- 172.21.15.89:0/1554729650 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb194005040 con 0x7fb1a40fc520 2024-09-13T03:01:43.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.291+0000 7fb1aa266640 1 --2- 172.21.15.89:0/1554729650 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1a40fc520 0x7fb1a410d0e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb1a000b790 tx=0x7fb1a00091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:01:43.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.291+0000 7fb19affd640 1 -- 172.21.15.89:0/1554729650 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb1a000c700 con 0x7fb1a40fc520 2024-09-13T03:01:43.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.291+0000 7fb19affd640 1 -- 172.21.15.89:0/1554729650 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb1a000cd00 con 0x7fb1a40fc520 2024-09-13T03:01:43.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.291+0000 7fb1ac4ca640 1 -- 172.21.15.89:0/1554729650 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1a410e8e0 con 0x7fb1a40fc520 2024-09-13T03:01:43.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.291+0000 7fb19affd640 1 -- 172.21.15.89:0/1554729650 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb1a0015e80 con 0x7fb1a40fc520 2024-09-13T03:01:43.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.291+0000 7fb1ac4ca640 1 -- 172.21.15.89:0/1554729650 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1a410ee00 con 0x7fb1a40fc520 2024-09-13T03:01:43.295 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.292+0000 7fb1ac4ca640 1 -- 172.21.15.89:0/1554729650 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1a41057b0 con 0x7fb1a40fc520 2024-09-13T03:01:43.295 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.293+0000 7fb19affd640 1 -- 172.21.15.89:0/1554729650 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fb1a0012070 con 0x7fb1a40fc520 2024-09-13T03:01:43.295 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.293+0000 7fb19affd640 1 --2- 172.21.15.89:0/1554729650 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fb19006e530 0x7fb1900709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:43.296 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.293+0000 7fb19affd640 1 -- 172.21.15.89:0/1554729650 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fb1a008da10 con 0x7fb1a40fc520 2024-09-13T03:01:43.296 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.293+0000 7fb1a9a65640 1 --2- 172.21.15.89:0/1554729650 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fb19006e530 0x7fb1900709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:43.296 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.294+0000 7fb1a9a65640 1 --2- 172.21.15.89:0/1554729650 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fb19006e530 0x7fb1900709e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb1a410ce90 tx=0x7fb194035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:01:43.299 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.298+0000 7fb19affd640 1 -- 172.21.15.89:0/1554729650 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fb1a0056b20 con 0x7fb1a40fc520 2024-09-13T03:01:43.489 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.487+0000 7fb1ac4ca640 1 -- 172.21.15.89:0/1554729650 --> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb1a410f080 con 0x7fb19006e530 2024-09-13T03:01:43.490 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.489+0000 7fb19affd640 1 -- 172.21.15.89:0/1554729650 <== mgr.34104 v2:172.21.15.89:6800/1881577856 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fb1a410f080 con 0x7fb19006e530 2024-09-13T03:01:43.492 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.491+0000 7fb1ac4ca640 1 -- 172.21.15.89:0/1554729650 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fb19006e530 msgr2=0x7fb1900709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:43.492 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.491+0000 7fb1ac4ca640 1 --2- 172.21.15.89:0/1554729650 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fb19006e530 0x7fb1900709e0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb1a410ce90 tx=0x7fb194035040 comp rx=0 tx=0).stop 2024-09-13T03:01:43.492 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.491+0000 7fb1ac4ca640 1 -- 172.21.15.89:0/1554729650 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1a40fc520 msgr2=0x7fb1a410d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:43.492 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.491+0000 7fb1ac4ca640 1 --2- 172.21.15.89:0/1554729650 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1a40fc520 0x7fb1a410d0e0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb1a000b790 tx=0x7fb1a00091d0 comp rx=0 tx=0).stop 2024-09-13T03:01:43.493 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.491+0000 7fb1ac4ca640 1 -- 172.21.15.89:0/1554729650 shutdown_connections 2024-09-13T03:01:43.493 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.491+0000 7fb1ac4ca640 1 --2- 172.21.15.89:0/1554729650 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fb19006e530 0x7fb1900709e0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:43.493 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.491+0000 7fb1ac4ca640 1 --2- 172.21.15.89:0/1554729650 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb1a40fd7f0 0x7fb1a410d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:43.493 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.491+0000 7fb1ac4ca640 1 --2- 172.21.15.89:0/1554729650 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb1a40fc520 0x7fb1a410d0e0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:43.493 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.491+0000 7fb1ac4ca640 1 -- 172.21.15.89:0/1554729650 >> 172.21.15.89:0/1554729650 conn(0x7fb1a40f7ce0 msgr2=0x7fb1a40f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:01:43.493 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.491+0000 7fb1ac4ca640 1 -- 172.21.15.89:0/1554729650 shutdown_connections 2024-09-13T03:01:43.493 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.491+0000 7fb1ac4ca640 1 -- 172.21.15.89:0/1554729650 wait complete. 2024-09-13T03:01:43.574 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.570+0000 7fdb7cf69640 1 -- 172.21.15.89:0/164872649 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb78065bc0 msgr2=0x7fdb780ff1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:43.574 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.570+0000 7fdb7cf69640 1 --2- 172.21.15.89:0/164872649 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb78065bc0 0x7fdb780ff1c0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fdb680048d0 tx=0x7fdb68009da0 comp rx=0 tx=0).stop 2024-09-13T03:01:43.574 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.571+0000 7fdb7cf69640 1 -- 172.21.15.89:0/164872649 shutdown_connections 2024-09-13T03:01:43.575 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.571+0000 7fdb7cf69640 1 --2- 172.21.15.89:0/164872649 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdb780ff700 0x7fdb78101ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:43.575 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.571+0000 7fdb7cf69640 1 --2- 172.21.15.89:0/164872649 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb78065bc0 0x7fdb780ff1c0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:43.575 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.571+0000 7fdb7cf69640 1 -- 172.21.15.89:0/164872649 >> 172.21.15.89:0/164872649 conn(0x7fdb780f6c10 msgr2=0x7fdb780f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:01:43.575 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.571+0000 7fdb7cf69640 1 -- 172.21.15.89:0/164872649 shutdown_connections 2024-09-13T03:01:43.575 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.571+0000 7fdb7cf69640 1 -- 172.21.15.89:0/164872649 wait complete. 2024-09-13T03:01:43.575 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.571+0000 7fdb7cf69640 1 Processor -- start 2024-09-13T03:01:43.575 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.571+0000 7fdb7cf69640 1 -- start start 2024-09-13T03:01:43.575 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.572+0000 7fdb7cf69640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdb78065bc0 0x7fdb780fcb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:43.575 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.572+0000 7fdb7cf69640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb780ff700 0x7fdb780fb0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:43.576 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.572+0000 7fdb7cf69640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb780fb600 con 0x7fdb780ff700 2024-09-13T03:01:43.576 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.572+0000 7fdb7cf69640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb780fb740 con 0x7fdb78065bc0 2024-09-13T03:01:43.576 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.572+0000 7fdb75d9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb780ff700 0x7fdb780fb0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:43.576 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.572+0000 7fdb75d9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb780ff700 0x7fdb780fb0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:58626/0 (socket says 172.21.15.89:58626) 2024-09-13T03:01:43.576 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.572+0000 7fdb75d9b640 1 -- 172.21.15.89:0/576268058 learned_addr learned my addr 172.21.15.89:0/576268058 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T03:01:43.576 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.572+0000 7fdb7659c640 1 --2- 172.21.15.89:0/576268058 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdb78065bc0 0x7fdb780fcb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:43.576 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.572+0000 7fdb75d9b640 1 -- 172.21.15.89:0/576268058 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdb78065bc0 msgr2=0x7fdb780fcb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:43.576 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.572+0000 7fdb75d9b640 1 --2- 172.21.15.89:0/576268058 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdb78065bc0 0x7fdb780fcb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:43.576 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.572+0000 7fdb75d9b640 1 -- 172.21.15.89:0/576268058 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb68005040 con 0x7fdb780ff700 2024-09-13T03:01:43.577 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.572+0000 7fdb75d9b640 1 --2- 172.21.15.89:0/576268058 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb780ff700 0x7fdb780fb0c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c002840 tx=0x7fdb6c004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:01:43.577 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.573+0000 7fdb66ffd640 1 -- 172.21.15.89:0/576268058 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdb6c007c30 con 0x7fdb780ff700 2024-09-13T03:01:43.577 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.573+0000 7fdb66ffd640 1 -- 172.21.15.89:0/576268058 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fdb6c00f040 con 0x7fdb780ff700 2024-09-13T03:01:43.577 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.573+0000 7fdb66ffd640 1 -- 172.21.15.89:0/576268058 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdb6c00d990 con 0x7fdb780ff700 2024-09-13T03:01:43.577 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.573+0000 7fdb7cf69640 1 -- 172.21.15.89:0/576268058 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb780fba20 con 0x7fdb780ff700 2024-09-13T03:01:43.577 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.573+0000 7fdb7cf69640 1 -- 172.21.15.89:0/576268058 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb78115140 con 0x7fdb780ff700 2024-09-13T03:01:43.578 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.574+0000 7fdb7cf69640 1 -- 172.21.15.89:0/576268058 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb780fa890 con 0x7fdb780ff700 2024-09-13T03:01:43.578 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.575+0000 7fdb66ffd640 1 -- 172.21.15.89:0/576268058 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fdb6c009600 con 0x7fdb780ff700 2024-09-13T03:01:43.578 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.575+0000 7fdb66ffd640 1 --2- 172.21.15.89:0/576268058 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fdb6006e530 0x7fdb600709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:43.578 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.576+0000 7fdb7659c640 1 --2- 172.21.15.89:0/576268058 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fdb6006e530 0x7fdb600709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:43.578 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.576+0000 7fdb66ffd640 1 -- 172.21.15.89:0/576268058 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fdb6c08dfb0 con 0x7fdb780ff700 2024-09-13T03:01:43.579 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.576+0000 7fdb7659c640 1 --2- 172.21.15.89:0/576268058 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fdb6006e530 0x7fdb600709e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fdb780fc930 tx=0x7fdb68035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:01:43.582 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.581+0000 7fdb66ffd640 1 -- 172.21.15.89:0/576268058 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fdb6c057040 con 0x7fdb780ff700 2024-09-13T03:01:43.795 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.793+0000 7fdb7cf69640 1 -- 172.21.15.89:0/576268058 --> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fdb780f8700 con 0x7fdb6006e530 2024-09-13T03:01:43.803 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.802+0000 7fdb66ffd640 1 -- 172.21.15.89:0/576268058 <== mgr.34104 v2:172.21.15.89:6800/1881577856 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7fdb780f8700 con 0x7fdb6006e530 2024-09-13T03:01:43.804 INFO:teuthology.orchestra.run.smithi089.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T03:01:43.804 INFO:teuthology.orchestra.run.smithi089.stdout:alertmanager.smithi089 smithi089 *:9093,9094 running (6m) 13s ago 15m 24.2M - 0.25.0 c8568f914cd2 1d2432f5479e 2024-09-13T03:01:43.804 INFO:teuthology.orchestra.run.smithi089.stdout:crash.smithi089 smithi089 running (4m) 13s ago 15m 6891k - 19.1.1-322-g7741f7f9 19dc8d659727 0ef15ca3e7f9 2024-09-13T03:01:43.804 INFO:teuthology.orchestra.run.smithi089.stdout:crash.smithi131 smithi131 running (4m) 64s ago 14m 6895k - 19.1.1-322-g7741f7f9 19dc8d659727 21e4d6fc04f7 2024-09-13T03:01:43.804 INFO:teuthology.orchestra.run.smithi089.stdout:grafana.smithi089 smithi089 *:3000 running (6m) 13s ago 15m 87.5M - 9.4.7 954c08fa6188 dee914ded1af 2024-09-13T03:01:43.804 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi089.qjoitb smithi089 running (18s) 13s ago 9m 11.8M - 19.1.1-322-g7741f7f9 19dc8d659727 e79bfdab021a 2024-09-13T03:01:43.805 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi089.rarddb smithi089 running (9m) 13s ago 9m 135M - 17.2.7-1627-gbbdadfa3 a994b00deb3a db2dc502c1ba 2024-09-13T03:01:43.805 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi131.rbovzc smithi131 running (9m) 64s ago 9m 60.3M - 17.2.7-1627-gbbdadfa3 a994b00deb3a d071b6d99537 2024-09-13T03:01:43.805 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi131.uasrkg smithi131 running (9m) 64s ago 9m 112M - 17.2.7-1627-gbbdadfa3 a994b00deb3a 0b3d4ffa6ce5 2024-09-13T03:01:43.805 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.smithi089.guohvs smithi089 *:8443,9283,8765 running (5m) 13s ago 16m 504M - 19.1.1-322-g7741f7f9 19dc8d659727 1e887446f1b0 2024-09-13T03:01:43.805 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.smithi131.aunbqd smithi131 *:8443,9283,8765 running (5m) 64s ago 14m 441M - 19.1.1-322-g7741f7f9 19dc8d659727 358d7478f2ba 2024-09-13T03:01:43.805 INFO:teuthology.orchestra.run.smithi089.stdout:mon.smithi089 smithi089 running (5m) 13s ago 16m 50.4M 2048M 19.1.1-322-g7741f7f9 19dc8d659727 8a29fb65028f 2024-09-13T03:01:43.805 INFO:teuthology.orchestra.run.smithi089.stdout:mon.smithi131 smithi131 running (4m) 64s ago 14m 43.5M 2048M 19.1.1-322-g7741f7f9 19dc8d659727 506310ad8620 2024-09-13T03:01:43.805 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.smithi089 smithi089 *:9100 running (6m) 13s ago 15m 16.7M - 1.5.0 0da6a335fe13 5a9927b583e6 2024-09-13T03:01:43.805 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.smithi131 smithi131 *:9100 running (6m) 64s ago 14m 15.8M - 1.5.0 0da6a335fe13 bcfde5d1a508 2024-09-13T03:01:43.806 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0 smithi089 running (3m) 13s ago 13m 101M 1557M 19.1.1-322-g7741f7f9 19dc8d659727 e8038f6d52b6 2024-09-13T03:01:43.806 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1 smithi089 running (3m) 13s ago 13m 101M 1557M 19.1.1-322-g7741f7f9 19dc8d659727 e174144d9633 2024-09-13T03:01:43.806 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2 smithi089 running (2m) 13s ago 12m 90.9M 1557M 19.1.1-322-g7741f7f9 19dc8d659727 2d8cab08c2b3 2024-09-13T03:01:43.806 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3 smithi131 running (2m) 64s ago 12m 106M 2581M 19.1.1-322-g7741f7f9 19dc8d659727 e77cff624869 2024-09-13T03:01:43.806 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4 smithi131 running (100s) 64s ago 11m 97.6M 2581M 19.1.1-322-g7741f7f9 19dc8d659727 0317e6a4a04c 2024-09-13T03:01:43.806 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5 smithi131 running (68s) 64s ago 11m 11.4M 2581M 19.1.1-322-g7741f7f9 19dc8d659727 e7d2a780f4e0 2024-09-13T03:01:43.806 INFO:teuthology.orchestra.run.smithi089.stdout:prometheus.smithi089 smithi089 *:9095 running (5m) 13s ago 14m 67.5M - 2.43.0 a07b618ecd1d 9d336370c187 2024-09-13T03:01:43.807 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.804+0000 7fdb7cf69640 1 -- 172.21.15.89:0/576268058 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fdb6006e530 msgr2=0x7fdb600709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:43.807 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.804+0000 7fdb7cf69640 1 --2- 172.21.15.89:0/576268058 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fdb6006e530 0x7fdb600709e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fdb780fc930 tx=0x7fdb68035040 comp rx=0 tx=0).stop 2024-09-13T03:01:43.807 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.804+0000 7fdb7cf69640 1 -- 172.21.15.89:0/576268058 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb780ff700 msgr2=0x7fdb780fb0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:43.807 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.804+0000 7fdb7cf69640 1 --2- 172.21.15.89:0/576268058 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb780ff700 0x7fdb780fb0c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fdb6c002840 tx=0x7fdb6c004570 comp rx=0 tx=0).stop 2024-09-13T03:01:43.808 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.804+0000 7fdb7cf69640 1 -- 172.21.15.89:0/576268058 shutdown_connections 2024-09-13T03:01:43.808 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.804+0000 7fdb7cf69640 1 --2- 172.21.15.89:0/576268058 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fdb6006e530 0x7fdb600709e0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:43.808 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.804+0000 7fdb7cf69640 1 --2- 172.21.15.89:0/576268058 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdb780ff700 0x7fdb780fb0c0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:43.808 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.804+0000 7fdb7cf69640 1 --2- 172.21.15.89:0/576268058 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdb78065bc0 0x7fdb780fcb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:43.808 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.804+0000 7fdb7cf69640 1 -- 172.21.15.89:0/576268058 >> 172.21.15.89:0/576268058 conn(0x7fdb780f6c10 msgr2=0x7fdb780f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:01:43.808 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.805+0000 7fdb7cf69640 1 -- 172.21.15.89:0/576268058 shutdown_connections 2024-09-13T03:01:43.808 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.805+0000 7fdb7cf69640 1 -- 172.21.15.89:0/576268058 wait complete. 2024-09-13T03:01:43.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.884+0000 7fc74cd39640 1 -- 172.21.15.89:0/2578388069 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc7480ff680 msgr2=0x7fc748101a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:43.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.884+0000 7fc74cd39640 1 --2- 172.21.15.89:0/2578388069 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc7480ff680 0x7fc748101a60 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fc73c0048d0 tx=0x7fc73c009da0 comp rx=0 tx=0).stop 2024-09-13T03:01:43.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.884+0000 7fc74cd39640 1 -- 172.21.15.89:0/2578388069 shutdown_connections 2024-09-13T03:01:43.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.884+0000 7fc74cd39640 1 --2- 172.21.15.89:0/2578388069 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc7480ff680 0x7fc748101a60 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:43.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.884+0000 7fc74cd39640 1 --2- 172.21.15.89:0/2578388069 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc748065c40 0x7fc7480ff140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:43.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.884+0000 7fc74cd39640 1 -- 172.21.15.89:0/2578388069 >> 172.21.15.89:0/2578388069 conn(0x7fc7480f6c10 msgr2=0x7fc7480f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:01:43.888 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.884+0000 7fc74cd39640 1 -- 172.21.15.89:0/2578388069 shutdown_connections 2024-09-13T03:01:43.889 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.884+0000 7fc74cd39640 1 -- 172.21.15.89:0/2578388069 wait complete. 2024-09-13T03:01:43.889 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.885+0000 7fc74cd39640 1 Processor -- start 2024-09-13T03:01:43.889 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.885+0000 7fc74cd39640 1 -- start start 2024-09-13T03:01:43.889 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.885+0000 7fc74cd39640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc748065c40 0x7fc74810d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:43.889 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.885+0000 7fc74cd39640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc7480ff680 0x7fc74810d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:43.889 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.885+0000 7fc74cd39640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc74810dc00 con 0x7fc7480ff680 2024-09-13T03:01:43.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.885+0000 7fc74cd39640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc74810e420 con 0x7fc748065c40 2024-09-13T03:01:43.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.885+0000 7fc745d9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc7480ff680 0x7fc74810d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:43.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.885+0000 7fc745d9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc7480ff680 0x7fc74810d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:58646/0 (socket says 172.21.15.89:58646) 2024-09-13T03:01:43.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.885+0000 7fc745d9b640 1 -- 172.21.15.89:0/2334191528 learned_addr learned my addr 172.21.15.89:0/2334191528 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T03:01:43.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.886+0000 7fc745d9b640 1 -- 172.21.15.89:0/2334191528 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc748065c40 msgr2=0x7fc74810d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:43.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.886+0000 7fc745d9b640 1 --2- 172.21.15.89:0/2334191528 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc748065c40 0x7fc74810d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:43.891 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.886+0000 7fc745d9b640 1 -- 172.21.15.89:0/2334191528 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc73c005040 con 0x7fc7480ff680 2024-09-13T03:01:43.891 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.886+0000 7fc745d9b640 1 --2- 172.21.15.89:0/2334191528 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc7480ff680 0x7fc74810d5b0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc73c0048a0 tx=0x7fc73c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:01:43.891 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.886+0000 7fc736ffd640 1 -- 172.21.15.89:0/2334191528 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc73c038070 con 0x7fc7480ff680 2024-09-13T03:01:43.891 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.886+0000 7fc74cd39640 1 -- 172.21.15.89:0/2334191528 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc74810e650 con 0x7fc7480ff680 2024-09-13T03:01:43.891 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.886+0000 7fc736ffd640 1 -- 172.21.15.89:0/2334191528 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fc73c004290 con 0x7fc7480ff680 2024-09-13T03:01:43.891 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.886+0000 7fc74cd39640 1 -- 172.21.15.89:0/2334191528 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc74810ebf0 con 0x7fc7480ff680 2024-09-13T03:01:43.891 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.886+0000 7fc736ffd640 1 -- 172.21.15.89:0/2334191528 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc73c033660 con 0x7fc7480ff680 2024-09-13T03:01:43.892 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.887+0000 7fc74cd39640 1 -- 172.21.15.89:0/2334191528 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7480fa890 con 0x7fc7480ff680 2024-09-13T03:01:43.892 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.888+0000 7fc736ffd640 1 -- 172.21.15.89:0/2334191528 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fc73c030020 con 0x7fc7480ff680 2024-09-13T03:01:43.892 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.889+0000 7fc736ffd640 1 --2- 172.21.15.89:0/2334191528 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fc73006e530 0x7fc7300709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:43.893 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.889+0000 7fc736ffd640 1 -- 172.21.15.89:0/2334191528 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fc73c0ae3a0 con 0x7fc7480ff680 2024-09-13T03:01:43.893 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.889+0000 7fc74659c640 1 --2- 172.21.15.89:0/2334191528 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fc73006e530 0x7fc7300709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:43.893 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.889+0000 7fc74659c640 1 --2- 172.21.15.89:0/2334191528 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fc73006e530 0x7fc7300709e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc7480659a0 tx=0x7fc73800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:01:43.897 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:43.896+0000 7fc736ffd640 1 -- 172.21.15.89:0/2334191528 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fc73c0774b0 con 0x7fc7480ff680 2024-09-13T03:01:44.134 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.132+0000 7fc74cd39640 1 -- 172.21.15.89:0/2334191528 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc74810e7e0 con 0x7fc7480ff680 2024-09-13T03:01:44.134 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.133+0000 7fc736ffd640 1 -- 172.21.15.89:0/2334191528 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+849 (secure 0 0 0) 0x7fc74810e7e0 con 0x7fc7480ff680 2024-09-13T03:01:44.134 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-13T03:01:44.134 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": { 2024-09-13T03:01:44.135 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 2 2024-09-13T03:01:44.135 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T03:01:44.135 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": { 2024-09-13T03:01:44.135 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 2 2024-09-13T03:01:44.135 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T03:01:44.135 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": { 2024-09-13T03:01:44.135 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 6 2024-09-13T03:01:44.135 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T03:01:44.135 INFO:teuthology.orchestra.run.smithi089.stdout: "mds": { 2024-09-13T03:01:44.135 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 2, 2024-09-13T03:01:44.135 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 1 2024-09-13T03:01:44.135 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T03:01:44.135 INFO:teuthology.orchestra.run.smithi089.stdout: "overall": { 2024-09-13T03:01:44.136 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 2, 2024-09-13T03:01:44.136 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 11 2024-09-13T03:01:44.136 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-13T03:01:44.136 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-13T03:01:44.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.135+0000 7fc74cd39640 1 -- 172.21.15.89:0/2334191528 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fc73006e530 msgr2=0x7fc7300709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:44.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.135+0000 7fc74cd39640 1 --2- 172.21.15.89:0/2334191528 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fc73006e530 0x7fc7300709e0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc7480659a0 tx=0x7fc73800b040 comp rx=0 tx=0).stop 2024-09-13T03:01:44.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.135+0000 7fc74cd39640 1 -- 172.21.15.89:0/2334191528 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc7480ff680 msgr2=0x7fc74810d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:44.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.135+0000 7fc74cd39640 1 --2- 172.21.15.89:0/2334191528 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc7480ff680 0x7fc74810d5b0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fc73c0048a0 tx=0x7fc73c009da0 comp rx=0 tx=0).stop 2024-09-13T03:01:44.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.135+0000 7fc74cd39640 1 -- 172.21.15.89:0/2334191528 shutdown_connections 2024-09-13T03:01:44.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.135+0000 7fc74cd39640 1 --2- 172.21.15.89:0/2334191528 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fc73006e530 0x7fc7300709e0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:44.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.135+0000 7fc74cd39640 1 --2- 172.21.15.89:0/2334191528 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fc7480ff680 0x7fc74810d5b0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:44.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.135+0000 7fc74cd39640 1 --2- 172.21.15.89:0/2334191528 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fc748065c40 0x7fc74810d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:44.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.135+0000 7fc74cd39640 1 -- 172.21.15.89:0/2334191528 >> 172.21.15.89:0/2334191528 conn(0x7fc7480f6c10 msgr2=0x7fc7480f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:01:44.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.135+0000 7fc74cd39640 1 -- 172.21.15.89:0/2334191528 shutdown_connections 2024-09-13T03:01:44.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.135+0000 7fc74cd39640 1 -- 172.21.15.89:0/2334191528 wait complete. 2024-09-13T03:01:44.217 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.213+0000 7f840072a640 1 -- 172.21.15.89:0/2586039576 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83f80fc700 msgr2=0x7f83f80fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:44.217 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.213+0000 7f840072a640 1 --2- 172.21.15.89:0/2586039576 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83f80fc700 0x7f83f80fcb70 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f83f40048d0 tx=0x7f83f4009da0 comp rx=0 tx=0).stop 2024-09-13T03:01:44.217 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.214+0000 7f840072a640 1 -- 172.21.15.89:0/2586039576 shutdown_connections 2024-09-13T03:01:44.217 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.214+0000 7f840072a640 1 --2- 172.21.15.89:0/2586039576 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83f80fc700 0x7f83f80fcb70 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:44.217 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.214+0000 7f840072a640 1 --2- 172.21.15.89:0/2586039576 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f83f80fb430 0x7f83f80fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:44.217 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.214+0000 7f840072a640 1 -- 172.21.15.89:0/2586039576 >> 172.21.15.89:0/2586039576 conn(0x7f83f80f6c10 msgr2=0x7f83f80f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:01:44.217 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.214+0000 7f840072a640 1 -- 172.21.15.89:0/2586039576 shutdown_connections 2024-09-13T03:01:44.218 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.214+0000 7f840072a640 1 -- 172.21.15.89:0/2586039576 wait complete. 2024-09-13T03:01:44.218 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.214+0000 7f840072a640 1 Processor -- start 2024-09-13T03:01:44.218 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.214+0000 7f840072a640 1 -- start start 2024-09-13T03:01:44.218 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.214+0000 7f840072a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83f80fb430 0x7f83f810d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:44.218 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.214+0000 7f840072a640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f83f80fc700 0x7f83f810d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:44.218 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.214+0000 7f840072a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83f810dc10 con 0x7f83f80fb430 2024-09-13T03:01:44.218 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.214+0000 7f840072a640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83f810e430 con 0x7f83f80fc700 2024-09-13T03:01:44.218 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.214+0000 7f83fe4c6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83f80fb430 0x7f83f810d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:44.218 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.214+0000 7f83fe4c6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83f80fb430 0x7f83f810d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:58656/0 (socket says 172.21.15.89:58656) 2024-09-13T03:01:44.218 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.214+0000 7f83fe4c6640 1 -- 172.21.15.89:0/1548182329 learned_addr learned my addr 172.21.15.89:0/1548182329 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T03:01:44.218 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.215+0000 7f83fdcc5640 1 --2- 172.21.15.89:0/1548182329 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f83f80fc700 0x7f83f810d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:44.218 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.215+0000 7f83fe4c6640 1 -- 172.21.15.89:0/1548182329 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f83f80fc700 msgr2=0x7f83f810d5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:44.219 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.215+0000 7f83fe4c6640 1 --2- 172.21.15.89:0/1548182329 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f83f80fc700 0x7f83f810d5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:44.219 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.215+0000 7f83fe4c6640 1 -- 172.21.15.89:0/1548182329 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83f4005040 con 0x7f83f80fb430 2024-09-13T03:01:44.219 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.215+0000 7f83fe4c6640 1 --2- 172.21.15.89:0/1548182329 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83f80fb430 0x7f83f810d080 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f83ec00eb70 tx=0x7f83ec00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:01:44.219 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.215+0000 7f83eaffd640 1 -- 172.21.15.89:0/1548182329 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f83ec007c30 con 0x7f83f80fb430 2024-09-13T03:01:44.219 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.215+0000 7f83eaffd640 1 -- 172.21.15.89:0/1548182329 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f83ec00f040 con 0x7f83f80fb430 2024-09-13T03:01:44.219 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.215+0000 7f840072a640 1 -- 172.21.15.89:0/1548182329 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83f810e660 con 0x7f83f80fb430 2024-09-13T03:01:44.219 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.215+0000 7f83eaffd640 1 -- 172.21.15.89:0/1548182329 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f83ec00ca60 con 0x7f83f80fb430 2024-09-13T03:01:44.219 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.215+0000 7f840072a640 1 -- 172.21.15.89:0/1548182329 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83f810ec00 con 0x7f83f80fb430 2024-09-13T03:01:44.220 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.216+0000 7f840072a640 1 -- 172.21.15.89:0/1548182329 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83f80fa890 con 0x7f83f80fb430 2024-09-13T03:01:44.220 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.217+0000 7f83eaffd640 1 -- 172.21.15.89:0/1548182329 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f83ec00cbc0 con 0x7f83f80fb430 2024-09-13T03:01:44.220 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.217+0000 7f83eaffd640 1 --2- 172.21.15.89:0/1548182329 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f83e406e530 0x7f83e40709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:44.220 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.217+0000 7f83eaffd640 1 -- 172.21.15.89:0/1548182329 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f83ec08dd50 con 0x7f83f80fb430 2024-09-13T03:01:44.220 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.217+0000 7f83fdcc5640 1 --2- 172.21.15.89:0/1548182329 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f83e406e530 0x7f83e40709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:44.221 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.218+0000 7f83fdcc5640 1 --2- 172.21.15.89:0/1548182329 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f83e406e530 0x7f83e40709e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f83f810ce30 tx=0x7f83f4035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:01:44.223 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.222+0000 7f83eaffd640 1 -- 172.21.15.89:0/1548182329 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f83ec056f10 con 0x7f83f80fb430 2024-09-13T03:01:44.424 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.422+0000 7f840072a640 1 -- 172.21.15.89:0/1548182329 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f83f8101200 con 0x7f83f80fb430 2024-09-13T03:01:44.424 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.423+0000 7f83eaffd640 1 -- 172.21.15.89:0/1548182329 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 32 v32) v1 ==== 76+0+1788 (secure 0 0 0) 0x7f83ec019710 con 0x7f83f80fb430 2024-09-13T03:01:44.425 INFO:teuthology.orchestra.run.smithi089.stdout:e32 2024-09-13T03:01:44.425 INFO:teuthology.orchestra.run.smithi089.stdout:btime 2024-09-13T03:01:37:948066+0000 2024-09-13T03:01:44.425 INFO:teuthology.orchestra.run.smithi089.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T03:01:44.425 INFO:teuthology.orchestra.run.smithi089.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T03:01:44.425 INFO:teuthology.orchestra.run.smithi089.stdout:legacy client fscid: 1 2024-09-13T03:01:44.425 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T03:01:44.425 INFO:teuthology.orchestra.run.smithi089.stdout:Filesystem 'cephfs' (1) 2024-09-13T03:01:44.425 INFO:teuthology.orchestra.run.smithi089.stdout:fs_name cephfs 2024-09-13T03:01:44.426 INFO:teuthology.orchestra.run.smithi089.stdout:epoch 32 2024-09-13T03:01:44.426 INFO:teuthology.orchestra.run.smithi089.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-13T03:01:44.426 INFO:teuthology.orchestra.run.smithi089.stdout:created 2024-09-13T02:51:40.657817+0000 2024-09-13T03:01:44.426 INFO:teuthology.orchestra.run.smithi089.stdout:modified 2024-09-13T03:01:37.948057+0000 2024-09-13T03:01:44.426 INFO:teuthology.orchestra.run.smithi089.stdout:tableserver 0 2024-09-13T03:01:44.426 INFO:teuthology.orchestra.run.smithi089.stdout:root 0 2024-09-13T03:01:44.426 INFO:teuthology.orchestra.run.smithi089.stdout:session_timeout 60 2024-09-13T03:01:44.426 INFO:teuthology.orchestra.run.smithi089.stdout:session_autoclose 300 2024-09-13T03:01:44.426 INFO:teuthology.orchestra.run.smithi089.stdout:max_file_size 1099511627776 2024-09-13T03:01:44.426 INFO:teuthology.orchestra.run.smithi089.stdout:max_xattr_size 65536 2024-09-13T03:01:44.427 INFO:teuthology.orchestra.run.smithi089.stdout:required_client_features {} 2024-09-13T03:01:44.427 INFO:teuthology.orchestra.run.smithi089.stdout:last_failure 0 2024-09-13T03:01:44.427 INFO:teuthology.orchestra.run.smithi089.stdout:last_failure_osd_epoch 80 2024-09-13T03:01:44.427 INFO:teuthology.orchestra.run.smithi089.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-13T03:01:44.427 INFO:teuthology.orchestra.run.smithi089.stdout:max_mds 1 2024-09-13T03:01:44.427 INFO:teuthology.orchestra.run.smithi089.stdout:in 0 2024-09-13T03:01:44.427 INFO:teuthology.orchestra.run.smithi089.stdout:up {0=34416} 2024-09-13T03:01:44.427 INFO:teuthology.orchestra.run.smithi089.stdout:failed 2024-09-13T03:01:44.427 INFO:teuthology.orchestra.run.smithi089.stdout:damaged 2024-09-13T03:01:44.427 INFO:teuthology.orchestra.run.smithi089.stdout:stopped 1 2024-09-13T03:01:44.428 INFO:teuthology.orchestra.run.smithi089.stdout:data_pools [3] 2024-09-13T03:01:44.428 INFO:teuthology.orchestra.run.smithi089.stdout:metadata_pool 2 2024-09-13T03:01:44.428 INFO:teuthology.orchestra.run.smithi089.stdout:inline_data disabled 2024-09-13T03:01:44.428 INFO:teuthology.orchestra.run.smithi089.stdout:balancer 2024-09-13T03:01:44.428 INFO:teuthology.orchestra.run.smithi089.stdout:bal_rank_mask -1 2024-09-13T03:01:44.428 INFO:teuthology.orchestra.run.smithi089.stdout:standby_count_wanted 1 2024-09-13T03:01:44.428 INFO:teuthology.orchestra.run.smithi089.stdout:qdb_cluster leader: 0 members: 2024-09-13T03:01:44.428 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi089.qjoitb{0:34416} state up:replay seq 1 join_fscid=1 addr [v2:172.21.15.89:6826/2439422546,v1:172.21.15.89:6827/2439422546] compat {c=[1],r=[1],i=[1fff]}] 2024-09-13T03:01:44.428 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T03:01:44.428 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T03:01:44.428 INFO:teuthology.orchestra.run.smithi089.stdout:Standby daemons: 2024-09-13T03:01:44.428 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T03:01:44.429 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi131.rbovzc{-1:44293} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.131:6826/1074022424,v1:172.21.15.131:6827/1074022424] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T03:01:44.429 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi131.uasrkg{-1:44301} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.131:6824/833117870,v1:172.21.15.131:6825/833117870] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T03:01:44.430 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 32 2024-09-13T03:01:44.430 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.425+0000 7f840072a640 1 -- 172.21.15.89:0/1548182329 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f83e406e530 msgr2=0x7f83e40709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:44.430 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.425+0000 7f840072a640 1 --2- 172.21.15.89:0/1548182329 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f83e406e530 0x7f83e40709e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f83f810ce30 tx=0x7f83f4035040 comp rx=0 tx=0).stop 2024-09-13T03:01:44.430 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.425+0000 7f840072a640 1 -- 172.21.15.89:0/1548182329 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83f80fb430 msgr2=0x7f83f810d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:44.430 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.425+0000 7f840072a640 1 --2- 172.21.15.89:0/1548182329 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83f80fb430 0x7f83f810d080 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f83ec00eb70 tx=0x7f83ec00b040 comp rx=0 tx=0).stop 2024-09-13T03:01:44.430 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.425+0000 7f840072a640 1 -- 172.21.15.89:0/1548182329 shutdown_connections 2024-09-13T03:01:44.430 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.425+0000 7f840072a640 1 --2- 172.21.15.89:0/1548182329 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f83e406e530 0x7f83e40709e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:44.431 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.425+0000 7f840072a640 1 --2- 172.21.15.89:0/1548182329 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f83f80fc700 0x7f83f810d5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:44.431 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.425+0000 7f840072a640 1 --2- 172.21.15.89:0/1548182329 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83f80fb430 0x7f83f810d080 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:44.431 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.425+0000 7f840072a640 1 -- 172.21.15.89:0/1548182329 >> 172.21.15.89:0/1548182329 conn(0x7f83f80f6c10 msgr2=0x7f83f8065560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:01:44.431 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.425+0000 7f840072a640 1 -- 172.21.15.89:0/1548182329 shutdown_connections 2024-09-13T03:01:44.431 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.425+0000 7f840072a640 1 -- 172.21.15.89:0/1548182329 wait complete. 2024-09-13T03:01:44.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.503+0000 7f66739bd640 1 -- 172.21.15.89:0/2665205138 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f666c0fc520 msgr2=0x7f666c0fc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:44.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.503+0000 7f66739bd640 1 --2- 172.21.15.89:0/2665205138 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f666c0fc520 0x7f666c0fc930 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f66680048d0 tx=0x7f6668009da0 comp rx=0 tx=0).stop 2024-09-13T03:01:44.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.504+0000 7f66739bd640 1 -- 172.21.15.89:0/2665205138 shutdown_connections 2024-09-13T03:01:44.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.504+0000 7f66739bd640 1 --2- 172.21.15.89:0/2665205138 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f666c0fd7f0 0x7f666c0fdc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:44.508 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.504+0000 7f66739bd640 1 --2- 172.21.15.89:0/2665205138 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f666c0fc520 0x7f666c0fc930 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:44.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.504+0000 7f66739bd640 1 -- 172.21.15.89:0/2665205138 >> 172.21.15.89:0/2665205138 conn(0x7f666c0f7ce0 msgr2=0x7f666c0fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:01:44.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.504+0000 7f66739bd640 1 -- 172.21.15.89:0/2665205138 shutdown_connections 2024-09-13T03:01:44.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.504+0000 7f66739bd640 1 -- 172.21.15.89:0/2665205138 wait complete. 2024-09-13T03:01:44.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.504+0000 7f66739bd640 1 Processor -- start 2024-09-13T03:01:44.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.504+0000 7f66739bd640 1 -- start start 2024-09-13T03:01:44.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.504+0000 7f66739bd640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f666c0fc520 0x7f666c10d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:44.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.504+0000 7f66739bd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f666c0fd7f0 0x7f666c10d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:44.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.504+0000 7f66739bd640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f666c10dc40 con 0x7f666c0fd7f0 2024-09-13T03:01:44.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.504+0000 7f66739bd640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f666c10e460 con 0x7f666c0fc520 2024-09-13T03:01:44.509 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.504+0000 7f6670f58640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f666c0fd7f0 0x7f666c10d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:44.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.504+0000 7f6670f58640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f666c0fd7f0 0x7f666c10d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:58678/0 (socket says 172.21.15.89:58678) 2024-09-13T03:01:44.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.504+0000 7f6670f58640 1 -- 172.21.15.89:0/3083514834 learned_addr learned my addr 172.21.15.89:0/3083514834 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T03:01:44.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.505+0000 7f6671759640 1 --2- 172.21.15.89:0/3083514834 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f666c0fc520 0x7f666c10d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:44.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.505+0000 7f6670f58640 1 -- 172.21.15.89:0/3083514834 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f666c0fc520 msgr2=0x7f666c10d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:44.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.505+0000 7f6670f58640 1 --2- 172.21.15.89:0/3083514834 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f666c0fc520 0x7f666c10d0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:44.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.505+0000 7f6670f58640 1 -- 172.21.15.89:0/3083514834 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6668005040 con 0x7f666c0fd7f0 2024-09-13T03:01:44.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.505+0000 7f6670f58640 1 --2- 172.21.15.89:0/3083514834 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f666c0fd7f0 0x7f666c10d5f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f6660002a50 tx=0x7f6660004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:01:44.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.505+0000 7f665dffb640 1 -- 172.21.15.89:0/3083514834 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6660007c30 con 0x7f666c0fd7f0 2024-09-13T03:01:44.510 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.505+0000 7f665dffb640 1 -- 172.21.15.89:0/3083514834 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f666000f040 con 0x7f666c0fd7f0 2024-09-13T03:01:44.511 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.505+0000 7f66739bd640 1 -- 172.21.15.89:0/3083514834 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f666c10e6f0 con 0x7f666c0fd7f0 2024-09-13T03:01:44.511 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.505+0000 7f665dffb640 1 -- 172.21.15.89:0/3083514834 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f666000da10 con 0x7f666c0fd7f0 2024-09-13T03:01:44.511 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.505+0000 7f66739bd640 1 -- 172.21.15.89:0/3083514834 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f666c10ec90 con 0x7f666c0fd7f0 2024-09-13T03:01:44.511 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.506+0000 7f66739bd640 1 -- 172.21.15.89:0/3083514834 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f666c0fb980 con 0x7f666c0fd7f0 2024-09-13T03:01:44.511 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.507+0000 7f665dffb640 1 -- 172.21.15.89:0/3083514834 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f666000dc80 con 0x7f666c0fd7f0 2024-09-13T03:01:44.512 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.507+0000 7f665dffb640 1 --2- 172.21.15.89:0/3083514834 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f665806e530 0x7f66580709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:44.512 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.507+0000 7f665dffb640 1 -- 172.21.15.89:0/3083514834 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f666008da40 con 0x7f666c0fd7f0 2024-09-13T03:01:44.512 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.507+0000 7f6671759640 1 --2- 172.21.15.89:0/3083514834 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f665806e530 0x7f66580709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:44.512 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.507+0000 7f6671759640 1 --2- 172.21.15.89:0/3083514834 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f665806e530 0x7f66580709e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f666800b020 tx=0x7f6668035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:01:44.513 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.511+0000 7f665dffb640 1 -- 172.21.15.89:0/3083514834 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f6660056ad0 con 0x7f666c0fd7f0 2024-09-13T03:01:44.700 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.699+0000 7f66739bd640 1 -- 172.21.15.89:0/3083514834 --> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f666c10efc0 con 0x7f665806e530 2024-09-13T03:01:44.701 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.700+0000 7f665dffb640 1 -- 172.21.15.89:0/3083514834 <== mgr.34104 v2:172.21.15.89:6800/1881577856 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f666c10efc0 con 0x7f665806e530 2024-09-13T03:01:44.701 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-13T03:01:44.701 INFO:teuthology.orchestra.run.smithi089.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d", 2024-09-13T03:01:44.701 INFO:teuthology.orchestra.run.smithi089.stdout: "in_progress": true, 2024-09-13T03:01:44.701 INFO:teuthology.orchestra.run.smithi089.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T03:01:44.702 INFO:teuthology.orchestra.run.smithi089.stdout: "services_complete": [ 2024-09-13T03:01:44.702 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr", 2024-09-13T03:01:44.702 INFO:teuthology.orchestra.run.smithi089.stdout: "osd", 2024-09-13T03:01:44.702 INFO:teuthology.orchestra.run.smithi089.stdout: "crash", 2024-09-13T03:01:44.702 INFO:teuthology.orchestra.run.smithi089.stdout: "mon" 2024-09-13T03:01:44.702 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-13T03:01:44.702 INFO:teuthology.orchestra.run.smithi089.stdout: "progress": "13/21 daemons upgraded", 2024-09-13T03:01:44.702 INFO:teuthology.orchestra.run.smithi089.stdout: "message": "Currently upgrading mds daemons", 2024-09-13T03:01:44.702 INFO:teuthology.orchestra.run.smithi089.stdout: "is_paused": false 2024-09-13T03:01:44.702 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-13T03:01:44.704 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.702+0000 7f66739bd640 1 -- 172.21.15.89:0/3083514834 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f665806e530 msgr2=0x7f66580709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:44.704 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.702+0000 7f66739bd640 1 --2- 172.21.15.89:0/3083514834 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f665806e530 0x7f66580709e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f666800b020 tx=0x7f6668035040 comp rx=0 tx=0).stop 2024-09-13T03:01:44.704 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.702+0000 7f66739bd640 1 -- 172.21.15.89:0/3083514834 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f666c0fd7f0 msgr2=0x7f666c10d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:44.704 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.702+0000 7f66739bd640 1 --2- 172.21.15.89:0/3083514834 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f666c0fd7f0 0x7f666c10d5f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f6660002a50 tx=0x7f6660004600 comp rx=0 tx=0).stop 2024-09-13T03:01:44.704 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.702+0000 7f66739bd640 1 -- 172.21.15.89:0/3083514834 shutdown_connections 2024-09-13T03:01:44.704 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.702+0000 7f66739bd640 1 --2- 172.21.15.89:0/3083514834 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f665806e530 0x7f66580709e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:44.704 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.702+0000 7f66739bd640 1 --2- 172.21.15.89:0/3083514834 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f666c0fd7f0 0x7f666c10d5f0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:44.704 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.702+0000 7f66739bd640 1 --2- 172.21.15.89:0/3083514834 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f666c0fc520 0x7f666c10d0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:44.705 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.702+0000 7f66739bd640 1 -- 172.21.15.89:0/3083514834 >> 172.21.15.89:0/3083514834 conn(0x7f666c0f7ce0 msgr2=0x7f666c0f9500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:01:44.705 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.702+0000 7f66739bd640 1 -- 172.21.15.89:0/3083514834 shutdown_connections 2024-09-13T03:01:44.705 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.702+0000 7f66739bd640 1 -- 172.21.15.89:0/3083514834 wait complete. 2024-09-13T03:01:44.783 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.779+0000 7fa510823640 1 -- 172.21.15.89:0/87381252 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa50c0fb430 msgr2=0x7fa50c0fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:44.783 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.779+0000 7fa510823640 1 --2- 172.21.15.89:0/87381252 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa50c0fb430 0x7fa50c0fb840 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc0048d0 tx=0x7fa4fc009da0 comp rx=0 tx=0).stop 2024-09-13T03:01:44.783 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.780+0000 7fa510823640 1 -- 172.21.15.89:0/87381252 shutdown_connections 2024-09-13T03:01:44.783 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.780+0000 7fa510823640 1 --2- 172.21.15.89:0/87381252 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa50c0fc700 0x7fa50c0fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:44.784 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.780+0000 7fa510823640 1 --2- 172.21.15.89:0/87381252 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa50c0fb430 0x7fa50c0fb840 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:44.784 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.780+0000 7fa510823640 1 -- 172.21.15.89:0/87381252 >> 172.21.15.89:0/87381252 conn(0x7fa50c0f6c10 msgr2=0x7fa50c0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:01:44.784 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.780+0000 7fa510823640 1 -- 172.21.15.89:0/87381252 shutdown_connections 2024-09-13T03:01:44.784 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.780+0000 7fa510823640 1 -- 172.21.15.89:0/87381252 wait complete. 2024-09-13T03:01:44.784 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.780+0000 7fa510823640 1 Processor -- start 2024-09-13T03:01:44.784 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.780+0000 7fa510823640 1 -- start start 2024-09-13T03:01:44.784 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.780+0000 7fa510823640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa50c0fb430 0x7fa50c10fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:44.784 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.780+0000 7fa510823640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa50c0fc700 0x7fa50c1122f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:44.784 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.780+0000 7fa510823640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa50c065c80 con 0x7fa50c0fb430 2024-09-13T03:01:44.784 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.780+0000 7fa510823640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa50c065df0 con 0x7fa50c0fc700 2024-09-13T03:01:44.784 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.780+0000 7fa50a59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa50c0fb430 0x7fa50c10fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:44.784 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.780+0000 7fa50a59c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa50c0fb430 0x7fa50c10fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:58690/0 (socket says 172.21.15.89:58690) 2024-09-13T03:01:44.785 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.780+0000 7fa50a59c640 1 -- 172.21.15.89:0/3205744019 learned_addr learned my addr 172.21.15.89:0/3205744019 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T03:01:44.785 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.781+0000 7fa509d9b640 1 --2- 172.21.15.89:0/3205744019 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa50c0fc700 0x7fa50c1122f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:44.785 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.781+0000 7fa50a59c640 1 -- 172.21.15.89:0/3205744019 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa50c0fc700 msgr2=0x7fa50c1122f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:44.785 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.781+0000 7fa50a59c640 1 --2- 172.21.15.89:0/3205744019 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa50c0fc700 0x7fa50c1122f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:44.785 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.781+0000 7fa50a59c640 1 -- 172.21.15.89:0/3205744019 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4fc005040 con 0x7fa50c0fb430 2024-09-13T03:01:44.785 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.781+0000 7fa50a59c640 1 --2- 172.21.15.89:0/3205744019 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa50c0fb430 0x7fa50c10fda0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc0043d0 tx=0x7fa4fc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:01:44.785 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.781+0000 7fa4faffd640 1 -- 172.21.15.89:0/3205744019 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa4fc038070 con 0x7fa50c0fb430 2024-09-13T03:01:44.785 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.781+0000 7fa4faffd640 1 -- 172.21.15.89:0/3205744019 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa4fc02ae90 con 0x7fa50c0fb430 2024-09-13T03:01:44.785 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.781+0000 7fa510823640 1 -- 172.21.15.89:0/3205744019 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa50c112830 con 0x7fa50c0fb430 2024-09-13T03:01:44.785 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.781+0000 7fa4faffd640 1 -- 172.21.15.89:0/3205744019 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa4fc03e670 con 0x7fa50c0fb430 2024-09-13T03:01:44.785 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.781+0000 7fa510823640 1 -- 172.21.15.89:0/3205744019 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa50c112dd0 con 0x7fa50c0fb430 2024-09-13T03:01:44.786 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.782+0000 7fa510823640 1 -- 172.21.15.89:0/3205744019 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa50c0fa890 con 0x7fa50c0fb430 2024-09-13T03:01:44.786 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.783+0000 7fa4faffd640 1 -- 172.21.15.89:0/3205744019 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fa4fc030020 con 0x7fa50c0fb430 2024-09-13T03:01:44.786 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.783+0000 7fa4faffd640 1 --2- 172.21.15.89:0/3205744019 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fa4f406e530 0x7fa4f40709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:01:44.786 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.783+0000 7fa4faffd640 1 -- 172.21.15.89:0/3205744019 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fa4fc0ae410 con 0x7fa50c0fb430 2024-09-13T03:01:44.786 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.783+0000 7fa509d9b640 1 --2- 172.21.15.89:0/3205744019 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fa4f406e530 0x7fa4f40709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:01:44.786 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.783+0000 7fa509d9b640 1 --2- 172.21.15.89:0/3205744019 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fa4f406e530 0x7fa4f40709e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa500004ce0 tx=0x7fa50000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:01:44.789 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:44.787+0000 7fa4faffd640 1 -- 172.21.15.89:0/3205744019 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fa4fc077520 con 0x7fa50c0fb430 2024-09-13T03:01:44.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:44 smithi131 ceph-mon[78839]: from='client.34420 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T03:01:44.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:44 smithi131 ceph-mon[78839]: from='client.34424 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T03:01:44.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:44 smithi131 ceph-mon[78839]: pgmap v190: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 4 op/s 2024-09-13T03:01:44.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:44 smithi131 ceph-mon[78839]: from='client.34428 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T03:01:44.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:44 smithi131 ceph-mon[78839]: from='client.? 172.21.15.89:0/2334191528' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:01:44.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:44 smithi131 ceph-mon[78839]: from='client.? 172.21.15.89:0/1548182329' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T03:01:45.021 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:45.019+0000 7fa510823640 1 -- 172.21.15.89:0/3205744019 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fa50c04b720 con 0x7fa50c0fb430 2024-09-13T03:01:45.021 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:44 smithi089 ceph-mon[91553]: from='client.34420 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T03:01:45.021 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:44 smithi089 ceph-mon[91553]: from='client.34424 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T03:01:45.021 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:44 smithi089 ceph-mon[91553]: pgmap v190: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 4 op/s 2024-09-13T03:01:45.021 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:44 smithi089 ceph-mon[91553]: from='client.34428 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T03:01:45.021 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:44 smithi089 ceph-mon[91553]: from='client.? 172.21.15.89:0/2334191528' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:01:45.021 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:44 smithi089 ceph-mon[91553]: from='client.? 172.21.15.89:0/1548182329' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T03:01:45.022 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:45.020+0000 7fa4faffd640 1 -- 172.21.15.89:0/3205744019 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+107 (secure 0 0 0) 0x7fa4fc07abe0 con 0x7fa50c0fb430 2024-09-13T03:01:45.022 INFO:teuthology.orchestra.run.smithi089.stdout:HEALTH_WARN 1 filesystem is degraded 2024-09-13T03:01:45.022 INFO:teuthology.orchestra.run.smithi089.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-09-13T03:01:45.022 INFO:teuthology.orchestra.run.smithi089.stdout: fs cephfs is degraded 2024-09-13T03:01:45.024 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:45.021+0000 7fa510823640 1 -- 172.21.15.89:0/3205744019 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fa4f406e530 msgr2=0x7fa4f40709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:45.024 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:45.021+0000 7fa510823640 1 --2- 172.21.15.89:0/3205744019 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fa4f406e530 0x7fa4f40709e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa500004ce0 tx=0x7fa50000b040 comp rx=0 tx=0).stop 2024-09-13T03:01:45.024 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:45.021+0000 7fa510823640 1 -- 172.21.15.89:0/3205744019 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa50c0fb430 msgr2=0x7fa50c10fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:01:45.024 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:45.021+0000 7fa510823640 1 --2- 172.21.15.89:0/3205744019 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa50c0fb430 0x7fa50c10fda0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc0043d0 tx=0x7fa4fc009da0 comp rx=0 tx=0).stop 2024-09-13T03:01:45.024 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:45.022+0000 7fa510823640 1 -- 172.21.15.89:0/3205744019 shutdown_connections 2024-09-13T03:01:45.024 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:45.022+0000 7fa510823640 1 --2- 172.21.15.89:0/3205744019 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fa4f406e530 0x7fa4f40709e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:45.024 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:45.022+0000 7fa510823640 1 --2- 172.21.15.89:0/3205744019 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa50c0fc700 0x7fa50c1122f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:45.024 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:45.022+0000 7fa510823640 1 --2- 172.21.15.89:0/3205744019 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa50c0fb430 0x7fa50c10fda0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:01:45.024 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:45.022+0000 7fa510823640 1 -- 172.21.15.89:0/3205744019 >> 172.21.15.89:0/3205744019 conn(0x7fa50c0f6c10 msgr2=0x7fa50c0f83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:01:45.024 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:45.022+0000 7fa510823640 1 -- 172.21.15.89:0/3205744019 shutdown_connections 2024-09-13T03:01:45.024 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:01:45.022+0000 7fa510823640 1 -- 172.21.15.89:0/3205744019 wait complete. 2024-09-13T03:01:46.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:45 smithi089 ceph-mon[91553]: reconnect by client.14506 v1:192.168.0.1:0/3576310256 after 0 2024-09-13T03:01:46.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:45 smithi089 ceph-mon[91553]: reconnect by client.14512 v1:172.21.15.131:0/4197080413 after 0.000999978 2024-09-13T03:01:46.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:45 smithi089 ceph-mon[91553]: mds.? [v2:172.21.15.89:6826/2439422546,v1:172.21.15.89:6827/2439422546] up:reconnect 2024-09-13T03:01:46.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:45 smithi089 ceph-mon[91553]: fsmap cephfs:1/1 {0=cephfs.smithi089.qjoitb=up:reconnect} 2 up:standby 2024-09-13T03:01:46.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:45 smithi089 ceph-mon[91553]: from='client.34440 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T03:01:46.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:45 smithi089 ceph-mon[91553]: from='client.? 172.21.15.89:0/3205744019' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T03:01:46.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:45 smithi131 ceph-mon[78839]: reconnect by client.14506 v1:192.168.0.1:0/3576310256 after 0 2024-09-13T03:01:46.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:45 smithi131 ceph-mon[78839]: reconnect by client.14512 v1:172.21.15.131:0/4197080413 after 0.000999978 2024-09-13T03:01:46.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:45 smithi131 ceph-mon[78839]: mds.? [v2:172.21.15.89:6826/2439422546,v1:172.21.15.89:6827/2439422546] up:reconnect 2024-09-13T03:01:46.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:45 smithi131 ceph-mon[78839]: fsmap cephfs:1/1 {0=cephfs.smithi089.qjoitb=up:reconnect} 2 up:standby 2024-09-13T03:01:46.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:45 smithi131 ceph-mon[78839]: from='client.34440 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T03:01:46.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:45 smithi131 ceph-mon[78839]: from='client.? 172.21.15.89:0/3205744019' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T03:01:47.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:46 smithi089 ceph-mon[91553]: pgmap v191: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 4 op/s 2024-09-13T03:01:47.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:46 smithi089 ceph-mon[91553]: mds.? [v2:172.21.15.89:6826/2439422546,v1:172.21.15.89:6827/2439422546] up:rejoin 2024-09-13T03:01:47.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:46 smithi089 ceph-mon[91553]: fsmap cephfs:1/1 {0=cephfs.smithi089.qjoitb=up:rejoin} 2 up:standby 2024-09-13T03:01:47.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:46 smithi089 ceph-mon[91553]: daemon mds.cephfs.smithi089.qjoitb is now active in filesystem cephfs as rank 0 2024-09-13T03:01:47.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:46 smithi131 ceph-mon[78839]: pgmap v191: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 4 op/s 2024-09-13T03:01:47.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:46 smithi131 ceph-mon[78839]: mds.? [v2:172.21.15.89:6826/2439422546,v1:172.21.15.89:6827/2439422546] up:rejoin 2024-09-13T03:01:47.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:46 smithi131 ceph-mon[78839]: fsmap cephfs:1/1 {0=cephfs.smithi089.qjoitb=up:rejoin} 2 up:standby 2024-09-13T03:01:47.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:46 smithi131 ceph-mon[78839]: daemon mds.cephfs.smithi089.qjoitb is now active in filesystem cephfs as rank 0 2024-09-13T03:01:48.027 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:47 smithi089 ceph-mon[91553]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-13T03:01:48.028 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:47 smithi089 ceph-mon[91553]: Cluster is now healthy 2024-09-13T03:01:48.028 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:47 smithi089 ceph-mon[91553]: mds.? [v2:172.21.15.89:6826/2439422546,v1:172.21.15.89:6827/2439422546] up:active 2024-09-13T03:01:48.028 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:47 smithi089 ceph-mon[91553]: fsmap cephfs:1 {0=cephfs.smithi089.qjoitb=up:active} 2 up:standby 2024-09-13T03:01:48.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:47 smithi131 ceph-mon[78839]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-13T03:01:48.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:47 smithi131 ceph-mon[78839]: Cluster is now healthy 2024-09-13T03:01:48.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:47 smithi131 ceph-mon[78839]: mds.? [v2:172.21.15.89:6826/2439422546,v1:172.21.15.89:6827/2439422546] up:active 2024-09-13T03:01:48.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:47 smithi131 ceph-mon[78839]: fsmap cephfs:1 {0=cephfs.smithi089.qjoitb=up:active} 2 up:standby 2024-09-13T03:01:48.969 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:48 smithi089 ceph-mon[91553]: pgmap v192: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 102 B/s wr, 5 op/s 2024-09-13T03:01:49.183 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:48 smithi131 ceph-mon[78839]: pgmap v192: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 17 MiB/s rd, 102 B/s wr, 5 op/s 2024-09-13T03:01:50.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:50 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:01:50.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:50 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:01:50.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:50 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:01:50.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:50 smithi131 ceph-mon[78839]: pgmap v193: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 87 B/s wr, 5 op/s 2024-09-13T03:01:50.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:50 smithi131 ceph-mon[78839]: mds.? [v2:172.21.15.89:6828/177758677,v1:172.21.15.89:6829/177758677] up:boot 2024-09-13T03:01:50.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:50 smithi131 ceph-mon[78839]: fsmap cephfs:1 {0=cephfs.smithi089.qjoitb=up:active} 3 up:standby 2024-09-13T03:01:50.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:50 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi089.rarddb"}]: dispatch 2024-09-13T03:01:50.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:50 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:01:50.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:50 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:01:50.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:50 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:01:50.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:50 smithi089 ceph-mon[91553]: pgmap v193: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 15 MiB/s rd, 87 B/s wr, 5 op/s 2024-09-13T03:01:50.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:50 smithi089 ceph-mon[91553]: mds.? [v2:172.21.15.89:6828/177758677,v1:172.21.15.89:6829/177758677] up:boot 2024-09-13T03:01:50.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:50 smithi089 ceph-mon[91553]: fsmap cephfs:1 {0=cephfs.smithi089.qjoitb=up:active} 3 up:standby 2024-09-13T03:01:50.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:50 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi089.rarddb"}]: dispatch 2024-09-13T03:01:51.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:51 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:01:51.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:51 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:01:52.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:52 smithi131 ceph-mon[78839]: pgmap v194: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T03:01:52.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:52 smithi089 ceph-mon[91553]: pgmap v194: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 13 MiB/s rd, 426 B/s wr, 7 op/s 2024-09-13T03:01:54.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:54 smithi089 ceph-mon[91553]: pgmap v195: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 5.3 MiB/s rd, 426 B/s wr, 5 op/s 2024-09-13T03:01:54.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:54 smithi131 ceph-mon[78839]: pgmap v195: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 5.3 MiB/s rd, 426 B/s wr, 5 op/s 2024-09-13T03:01:56.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:56 smithi131 ceph-mon[78839]: pgmap v196: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 4.6 MiB/s rd, 4.7 KiB/s wr, 6 op/s 2024-09-13T03:01:57.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:56 smithi089 ceph-mon[91553]: pgmap v196: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 4.6 MiB/s rd, 4.7 KiB/s wr, 6 op/s 2024-09-13T03:01:58.273 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:58 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:01:58.273 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:58 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:01:58.273 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:58 smithi089 ceph-mon[91553]: pgmap v197: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.0 MiB/s rd, 4.7 KiB/s wr, 6 op/s 2024-09-13T03:01:58.273 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:58 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:01:58.273 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:01:58 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:01:58.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:58 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:01:58.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:58 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:01:58.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:58 smithi131 ceph-mon[78839]: pgmap v197: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.0 MiB/s rd, 4.7 KiB/s wr, 6 op/s 2024-09-13T03:01:58.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:58 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:01:58.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:01:58 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:02:00.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:00 smithi089 ceph-mon[91553]: pgmap v198: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 3.3 KiB/s rd, 4.7 KiB/s wr, 5 op/s 2024-09-13T03:02:00.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:00 smithi131 ceph-mon[78839]: pgmap v198: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 3.3 KiB/s rd, 4.7 KiB/s wr, 5 op/s 2024-09-13T03:02:02.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:01 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:02:02.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:01 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:02:02.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:01 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T03:02:02.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:01 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T03:02:02.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:01 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:02:02.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:01 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:02:02.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:01 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:02.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:01 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:02.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:01 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:02.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:01 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:02.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:01 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi131.uasrkg"]}]: dispatch 2024-09-13T03:02:02.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:01 smithi131 ceph-mon[78839]: Upgrade: It appears safe to stop mds.cephfs.smithi131.uasrkg 2024-09-13T03:02:02.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:01 smithi131 ceph-mon[78839]: pgmap v199: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 3.1 KiB/s rd, 4.7 KiB/s wr, 5 op/s 2024-09-13T03:02:02.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:01 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:02:02.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:01 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:02:02.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:01 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T03:02:02.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:01 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T03:02:02.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:01 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:02:02.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:01 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:02:02.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:01 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:02.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:01 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:02.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:01 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:02.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:01 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:02.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:01 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi131.uasrkg"]}]: dispatch 2024-09-13T03:02:02.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:01 smithi089 ceph-mon[91553]: Upgrade: It appears safe to stop mds.cephfs.smithi131.uasrkg 2024-09-13T03:02:02.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:01 smithi089 ceph-mon[91553]: pgmap v199: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 3.1 KiB/s rd, 4.7 KiB/s wr, 5 op/s 2024-09-13T03:02:03.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:03 smithi089 ceph-mon[91553]: Upgrade: Updating mds.cephfs.smithi131.uasrkg 2024-09-13T03:02:03.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:03 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:02:03.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:03 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi131.uasrkg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T03:02:03.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:03 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T03:02:03.786 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:03 smithi089 ceph-mon[91553]: Deploying daemon mds.cephfs.smithi131.uasrkg on smithi131 2024-09-13T03:02:03.834 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:03 smithi131 ceph-mon[78839]: Upgrade: Updating mds.cephfs.smithi131.uasrkg 2024-09-13T03:02:03.834 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:03 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:02:03.834 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:03 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi131.uasrkg", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T03:02:03.834 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:03 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T03:02:03.835 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:03 smithi131 ceph-mon[78839]: Deploying daemon mds.cephfs.smithi131.uasrkg on smithi131 2024-09-13T03:02:04.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:04 smithi089 ceph-mon[91553]: pgmap v200: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 4.3 KiB/s wr, 1 op/s 2024-09-13T03:02:04.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:04 smithi131 ceph-mon[78839]: pgmap v200: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 4.3 KiB/s wr, 1 op/s 2024-09-13T03:02:05.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:05 smithi089 ceph-mon[91553]: osdmap e81: 6 total, 6 up, 6 in 2024-09-13T03:02:05.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:05 smithi089 ceph-mon[91553]: fsmap cephfs:1 {0=cephfs.smithi089.qjoitb=up:active} 2 up:standby 2024-09-13T03:02:05.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:05 smithi131 ceph-mon[78839]: osdmap e81: 6 total, 6 up, 6 in 2024-09-13T03:02:05.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:05 smithi131 ceph-mon[78839]: fsmap cephfs:1 {0=cephfs.smithi089.qjoitb=up:active} 2 up:standby 2024-09-13T03:02:06.661 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:06 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:02:06.661 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:06 smithi131 ceph-mon[78839]: pgmap v202: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:02:06.661 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:06 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi131.uasrkg"}]: dispatch 2024-09-13T03:02:06.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:06 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:02:06.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:06 smithi089 ceph-mon[91553]: pgmap v202: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:02:06.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:06 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi131.uasrkg"}]: dispatch 2024-09-13T03:02:08.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:08 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:02:08.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:08 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:02:08.536 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:08 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:02:08.536 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:08 smithi089 ceph-mon[91553]: mds.? [v2:172.21.15.131:6824/2298563432,v1:172.21.15.131:6825/2298563432] up:boot 2024-09-13T03:02:08.536 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:08 smithi089 ceph-mon[91553]: fsmap cephfs:1 {0=cephfs.smithi089.qjoitb=up:active} 3 up:standby 2024-09-13T03:02:08.536 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:08 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi131.uasrkg"}]: dispatch 2024-09-13T03:02:08.536 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:08 smithi089 ceph-mon[91553]: pgmap v203: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:02:08.637 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:08 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:02:08.637 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:08 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:02:08.637 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:08 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:02:08.637 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:08 smithi131 ceph-mon[78839]: mds.? [v2:172.21.15.131:6824/2298563432,v1:172.21.15.131:6825/2298563432] up:boot 2024-09-13T03:02:08.637 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:08 smithi131 ceph-mon[78839]: fsmap cephfs:1 {0=cephfs.smithi089.qjoitb=up:active} 3 up:standby 2024-09-13T03:02:08.637 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:08 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi131.uasrkg"}]: dispatch 2024-09-13T03:02:08.637 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:08 smithi131 ceph-mon[78839]: pgmap v203: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:02:11.059 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:10 smithi131 ceph-mon[78839]: pgmap v204: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:02:11.059 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:10 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:02:11.059 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:10 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:02:11.059 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:10 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:02:11.059 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:10 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:02:11.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:10 smithi089 ceph-mon[91553]: pgmap v204: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:02:11.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:10 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:02:11.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:10 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:02:11.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:10 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:02:11.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:10 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:02:13.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:12 smithi131 ceph-mon[78839]: pgmap v205: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:02:13.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:12 smithi089 ceph-mon[91553]: pgmap v205: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:02:14.820 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:14 smithi131 ceph-mon[78839]: pgmap v206: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:02:14.820 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:14 smithi131 ceph-mon[78839]: Detected new or changed devices on smithi131 2024-09-13T03:02:14.820 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:14 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:02:14.820 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:14 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:02:14.820 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:14 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T03:02:14.820 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:14 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T03:02:14.820 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:14 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:02:14.820 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:14 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:02:14.820 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:14 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:14.821 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:14 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:14.821 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:14 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:14.821 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:14 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:14.821 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:14 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi131.rbovzc"]}]: dispatch 2024-09-13T03:02:14.821 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:14 smithi131 ceph-mon[78839]: Upgrade: It appears safe to stop mds.cephfs.smithi131.rbovzc 2024-09-13T03:02:15.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:14 smithi089 ceph-mon[91553]: pgmap v206: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:02:15.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:14 smithi089 ceph-mon[91553]: Detected new or changed devices on smithi131 2024-09-13T03:02:15.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:14 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:02:15.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:14 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:02:15.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:14 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T03:02:15.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:14 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T03:02:15.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:14 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:02:15.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:14 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:02:15.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:14 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:15.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:14 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:15.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:14 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:15.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:14 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:15.037 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:14 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mds ok-to-stop", "ids": ["cephfs.smithi131.rbovzc"]}]: dispatch 2024-09-13T03:02:15.037 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:14 smithi089 ceph-mon[91553]: Upgrade: It appears safe to stop mds.cephfs.smithi131.rbovzc 2024-09-13T03:02:15.115 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.112+0000 7f799c3d9640 1 -- 172.21.15.89:0/872464374 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7994065c40 msgr2=0x7f79940ff140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:15.116 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.112+0000 7f799c3d9640 1 --2- 172.21.15.89:0/872464374 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7994065c40 0x7f79940ff140 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f79840048d0 tx=0x7f7984009da0 comp rx=0 tx=0).stop 2024-09-13T03:02:15.116 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.112+0000 7f799c3d9640 1 -- 172.21.15.89:0/872464374 shutdown_connections 2024-09-13T03:02:15.116 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.112+0000 7f799c3d9640 1 --2- 172.21.15.89:0/872464374 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f79940ff680 0x7f7994101a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:15.116 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.112+0000 7f799c3d9640 1 --2- 172.21.15.89:0/872464374 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7994065c40 0x7f79940ff140 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:15.116 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.112+0000 7f799c3d9640 1 -- 172.21.15.89:0/872464374 >> 172.21.15.89:0/872464374 conn(0x7f79940f6c10 msgr2=0x7f79940f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:02:15.116 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.112+0000 7f799c3d9640 1 -- 172.21.15.89:0/872464374 shutdown_connections 2024-09-13T03:02:15.116 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.112+0000 7f799c3d9640 1 -- 172.21.15.89:0/872464374 wait complete. 2024-09-13T03:02:15.116 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.113+0000 7f799c3d9640 1 Processor -- start 2024-09-13T03:02:15.116 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.113+0000 7f799c3d9640 1 -- start start 2024-09-13T03:02:15.116 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.113+0000 7f799c3d9640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7994065c40 0x7f799410d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:02:15.116 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.113+0000 7f799c3d9640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79940ff680 0x7f799410d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:02:15.116 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.113+0000 7f799c3d9640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f799410dc80 con 0x7f79940ff680 2024-09-13T03:02:15.117 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.113+0000 7f799c3d9640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f799410e450 con 0x7f7994065c40 2024-09-13T03:02:15.117 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.113+0000 7f7999974640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79940ff680 0x7f799410d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:02:15.117 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.113+0000 7f7999974640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79940ff680 0x7f799410d630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:46618/0 (socket says 172.21.15.89:46618) 2024-09-13T03:02:15.117 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.113+0000 7f7999974640 1 -- 172.21.15.89:0/171614393 learned_addr learned my addr 172.21.15.89:0/171614393 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T03:02:15.117 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.113+0000 7f799a175640 1 --2- 172.21.15.89:0/171614393 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7994065c40 0x7f799410d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:02:15.117 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.113+0000 7f7999974640 1 -- 172.21.15.89:0/171614393 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7994065c40 msgr2=0x7f799410d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:15.117 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.113+0000 7f7999974640 1 --2- 172.21.15.89:0/171614393 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7994065c40 0x7f799410d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:15.117 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.113+0000 7f7999974640 1 -- 172.21.15.89:0/171614393 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7984005040 con 0x7f79940ff680 2024-09-13T03:02:15.117 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.114+0000 7f7999974640 1 --2- 172.21.15.89:0/171614393 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79940ff680 0x7f799410d630 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f798800c830 tx=0x7f7988004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:02:15.117 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.114+0000 7f7992ffd640 1 -- 172.21.15.89:0/171614393 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f798800a7d0 con 0x7f79940ff680 2024-09-13T03:02:15.117 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.114+0000 7f799c3d9640 1 -- 172.21.15.89:0/171614393 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f799410e6e0 con 0x7f79940ff680 2024-09-13T03:02:15.117 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.114+0000 7f7992ffd640 1 -- 172.21.15.89:0/171614393 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f798800add0 con 0x7f79940ff680 2024-09-13T03:02:15.117 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.114+0000 7f7992ffd640 1 -- 172.21.15.89:0/171614393 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f79880113a0 con 0x7f79940ff680 2024-09-13T03:02:15.118 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.114+0000 7f799c3d9640 1 -- 172.21.15.89:0/171614393 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f799410ec80 con 0x7f79940ff680 2024-09-13T03:02:15.118 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.115+0000 7f799c3d9640 1 -- 172.21.15.89:0/171614393 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79940fa890 con 0x7f79940ff680 2024-09-13T03:02:15.119 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.115+0000 7f7992ffd640 1 -- 172.21.15.89:0/171614393 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f7988012400 con 0x7f79940ff680 2024-09-13T03:02:15.119 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.116+0000 7f7992ffd640 1 --2- 172.21.15.89:0/171614393 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f797c06e530 0x7f797c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:02:15.119 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.116+0000 7f7992ffd640 1 -- 172.21.15.89:0/171614393 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f798808e2e0 con 0x7f79940ff680 2024-09-13T03:02:15.119 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.116+0000 7f799a175640 1 --2- 172.21.15.89:0/171614393 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f797c06e530 0x7f797c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:02:15.119 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.117+0000 7f799a175640 1 --2- 172.21.15.89:0/171614393 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f797c06e530 0x7f797c0709e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7984000c00 tx=0x7f7984035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:02:15.122 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.120+0000 7f7992ffd640 1 -- 172.21.15.89:0/171614393 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f79880573f0 con 0x7f79940ff680 2024-09-13T03:02:15.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.305+0000 7f799c3d9640 1 -- 172.21.15.89:0/171614393 --> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f799410efa0 con 0x7f797c06e530 2024-09-13T03:02:15.307 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.306+0000 7f7992ffd640 1 -- 172.21.15.89:0/171614393 <== mgr.34104 v2:172.21.15.89:6800/1881577856 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f799410efa0 con 0x7f797c06e530 2024-09-13T03:02:15.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.308+0000 7f799c3d9640 1 -- 172.21.15.89:0/171614393 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f797c06e530 msgr2=0x7f797c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:15.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.308+0000 7f799c3d9640 1 --2- 172.21.15.89:0/171614393 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f797c06e530 0x7f797c0709e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7984000c00 tx=0x7f7984035040 comp rx=0 tx=0).stop 2024-09-13T03:02:15.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.308+0000 7f799c3d9640 1 -- 172.21.15.89:0/171614393 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79940ff680 msgr2=0x7f799410d630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:15.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.308+0000 7f799c3d9640 1 --2- 172.21.15.89:0/171614393 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79940ff680 0x7f799410d630 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f798800c830 tx=0x7f7988004430 comp rx=0 tx=0).stop 2024-09-13T03:02:15.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.308+0000 7f799c3d9640 1 -- 172.21.15.89:0/171614393 shutdown_connections 2024-09-13T03:02:15.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.308+0000 7f799c3d9640 1 --2- 172.21.15.89:0/171614393 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f797c06e530 0x7f797c0709e0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:15.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.308+0000 7f799c3d9640 1 --2- 172.21.15.89:0/171614393 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f79940ff680 0x7f799410d630 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:15.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.309+0000 7f799c3d9640 1 --2- 172.21.15.89:0/171614393 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7994065c40 0x7f799410d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:15.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.309+0000 7f799c3d9640 1 -- 172.21.15.89:0/171614393 >> 172.21.15.89:0/171614393 conn(0x7f79940f6c10 msgr2=0x7f79940f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:02:15.311 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.309+0000 7f799c3d9640 1 -- 172.21.15.89:0/171614393 shutdown_connections 2024-09-13T03:02:15.311 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.309+0000 7f799c3d9640 1 -- 172.21.15.89:0/171614393 wait complete. 2024-09-13T03:02:15.319 INFO:teuthology.orchestra.run.smithi089.stdout:true 2024-09-13T03:02:15.391 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.388+0000 7fd0b1b42640 1 -- 172.21.15.89:0/945459868 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0ac0fb480 msgr2=0x7fd0ac0fb890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:15.391 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.388+0000 7fd0b1b42640 1 --2- 172.21.15.89:0/945459868 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0ac0fb480 0x7fd0ac0fb890 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fd09c0048d0 tx=0x7fd09c009da0 comp rx=0 tx=0).stop 2024-09-13T03:02:15.392 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.388+0000 7fd0b1b42640 1 -- 172.21.15.89:0/945459868 shutdown_connections 2024-09-13T03:02:15.392 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.388+0000 7fd0b1b42640 1 --2- 172.21.15.89:0/945459868 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd0ac0fc750 0x7fd0ac0fcbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:15.392 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.388+0000 7fd0b1b42640 1 --2- 172.21.15.89:0/945459868 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0ac0fb480 0x7fd0ac0fb890 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:15.392 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.388+0000 7fd0b1b42640 1 -- 172.21.15.89:0/945459868 >> 172.21.15.89:0/945459868 conn(0x7fd0ac0f6c40 msgr2=0x7fd0ac0f9070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:02:15.392 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.388+0000 7fd0b1b42640 1 -- 172.21.15.89:0/945459868 shutdown_connections 2024-09-13T03:02:15.392 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.388+0000 7fd0b1b42640 1 -- 172.21.15.89:0/945459868 wait complete. 2024-09-13T03:02:15.392 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.389+0000 7fd0b1b42640 1 Processor -- start 2024-09-13T03:02:15.392 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.389+0000 7fd0b1b42640 1 -- start start 2024-09-13T03:02:15.392 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.389+0000 7fd0b1b42640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd0ac0fb480 0x7fd0ac10c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:02:15.392 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.389+0000 7fd0b1b42640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0ac0fc750 0x7fd0ac10c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:02:15.392 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.389+0000 7fd0b1b42640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0ac10cb90 con 0x7fd0ac0fc750 2024-09-13T03:02:15.393 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.389+0000 7fd0b1b42640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0ac10d3b0 con 0x7fd0ac0fb480 2024-09-13T03:02:15.393 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.389+0000 7fd0a3fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0ac0fc750 0x7fd0ac10c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:02:15.393 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.389+0000 7fd0a3fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0ac0fc750 0x7fd0ac10c540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:46638/0 (socket says 172.21.15.89:46638) 2024-09-13T03:02:15.393 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.389+0000 7fd0a3fff640 1 -- 172.21.15.89:0/2076456954 learned_addr learned my addr 172.21.15.89:0/2076456954 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T03:02:15.393 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.389+0000 7fd0ab7fe640 1 --2- 172.21.15.89:0/2076456954 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd0ac0fb480 0x7fd0ac10c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:02:15.393 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.389+0000 7fd0a3fff640 1 -- 172.21.15.89:0/2076456954 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd0ac0fb480 msgr2=0x7fd0ac10c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:15.393 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.389+0000 7fd0a3fff640 1 --2- 172.21.15.89:0/2076456954 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd0ac0fb480 0x7fd0ac10c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:15.393 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.389+0000 7fd0a3fff640 1 -- 172.21.15.89:0/2076456954 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd09c005040 con 0x7fd0ac0fc750 2024-09-13T03:02:15.393 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.390+0000 7fd0a3fff640 1 --2- 172.21.15.89:0/2076456954 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0ac0fc750 0x7fd0ac10c540 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd09400fce0 tx=0x7fd094004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:02:15.394 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.390+0000 7fd0a8ff9640 1 -- 172.21.15.89:0/2076456954 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd09400de30 con 0x7fd0ac0fc750 2024-09-13T03:02:15.394 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.390+0000 7fd0a8ff9640 1 -- 172.21.15.89:0/2076456954 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd0940090d0 con 0x7fd0ac0fc750 2024-09-13T03:02:15.394 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.390+0000 7fd0b1b42640 1 -- 172.21.15.89:0/2076456954 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0ac10d5e0 con 0x7fd0ac0fc750 2024-09-13T03:02:15.394 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.390+0000 7fd0a8ff9640 1 -- 172.21.15.89:0/2076456954 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd0940126a0 con 0x7fd0ac0fc750 2024-09-13T03:02:15.394 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.390+0000 7fd0b1b42640 1 -- 172.21.15.89:0/2076456954 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0ac10db80 con 0x7fd0ac0fc750 2024-09-13T03:02:15.395 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.391+0000 7fd0b1b42640 1 -- 172.21.15.89:0/2076456954 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0ac0fa8e0 con 0x7fd0ac0fc750 2024-09-13T03:02:15.395 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.392+0000 7fd0a8ff9640 1 -- 172.21.15.89:0/2076456954 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fd094009240 con 0x7fd0ac0fc750 2024-09-13T03:02:15.395 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.393+0000 7fd0a8ff9640 1 --2- 172.21.15.89:0/2076456954 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fd09806e530 0x7fd0980709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:02:15.396 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.393+0000 7fd0a8ff9640 1 -- 172.21.15.89:0/2076456954 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fd094090980 con 0x7fd0ac0fc750 2024-09-13T03:02:15.396 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.393+0000 7fd0ab7fe640 1 --2- 172.21.15.89:0/2076456954 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fd09806e530 0x7fd0980709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:02:15.396 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.393+0000 7fd0ab7fe640 1 --2- 172.21.15.89:0/2076456954 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fd09806e530 0x7fd0980709e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd09c007ac0 tx=0x7fd09c035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:02:15.397 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.396+0000 7fd0a8ff9640 1 -- 172.21.15.89:0/2076456954 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fd094059be0 con 0x7fd0ac0fc750 2024-09-13T03:02:15.581 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.580+0000 7fd0b1b42640 1 -- 172.21.15.89:0/2076456954 --> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd0ac10dff0 con 0x7fd09806e530 2024-09-13T03:02:15.582 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.581+0000 7fd0a8ff9640 1 -- 172.21.15.89:0/2076456954 <== mgr.34104 v2:172.21.15.89:6800/1881577856 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fd0ac10dff0 con 0x7fd09806e530 2024-09-13T03:02:15.586 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.583+0000 7fd0b1b42640 1 -- 172.21.15.89:0/2076456954 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fd09806e530 msgr2=0x7fd0980709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:15.586 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.583+0000 7fd0b1b42640 1 --2- 172.21.15.89:0/2076456954 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fd09806e530 0x7fd0980709e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd09c007ac0 tx=0x7fd09c035040 comp rx=0 tx=0).stop 2024-09-13T03:02:15.586 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.583+0000 7fd0b1b42640 1 -- 172.21.15.89:0/2076456954 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0ac0fc750 msgr2=0x7fd0ac10c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:15.586 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.583+0000 7fd0b1b42640 1 --2- 172.21.15.89:0/2076456954 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0ac0fc750 0x7fd0ac10c540 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fd09400fce0 tx=0x7fd094004600 comp rx=0 tx=0).stop 2024-09-13T03:02:15.586 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.583+0000 7fd0b1b42640 1 -- 172.21.15.89:0/2076456954 shutdown_connections 2024-09-13T03:02:15.586 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.583+0000 7fd0b1b42640 1 --2- 172.21.15.89:0/2076456954 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fd09806e530 0x7fd0980709e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:15.586 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.583+0000 7fd0b1b42640 1 --2- 172.21.15.89:0/2076456954 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd0ac0fc750 0x7fd0ac10c540 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:15.586 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.583+0000 7fd0b1b42640 1 --2- 172.21.15.89:0/2076456954 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd0ac0fb480 0x7fd0ac10c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:15.586 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.583+0000 7fd0b1b42640 1 -- 172.21.15.89:0/2076456954 >> 172.21.15.89:0/2076456954 conn(0x7fd0ac0f6c40 msgr2=0x7fd0ac0f8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:02:15.586 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.583+0000 7fd0b1b42640 1 -- 172.21.15.89:0/2076456954 shutdown_connections 2024-09-13T03:02:15.586 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.583+0000 7fd0b1b42640 1 -- 172.21.15.89:0/2076456954 wait complete. 2024-09-13T03:02:15.664 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.662+0000 7f56b9e8a640 1 -- 172.21.15.89:0/3291804410 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f56b40fb2b0 msgr2=0x7f56b40fdb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:15.664 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.662+0000 7f56b9e8a640 1 --2- 172.21.15.89:0/3291804410 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f56b40fb2b0 0x7f56b40fdb30 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f56a80048d0 tx=0x7f56a8009da0 comp rx=0 tx=0).stop 2024-09-13T03:02:15.664 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.662+0000 7f56b9e8a640 1 -- 172.21.15.89:0/3291804410 shutdown_connections 2024-09-13T03:02:15.664 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.662+0000 7f56b9e8a640 1 --2- 172.21.15.89:0/3291804410 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f56b40fb2b0 0x7f56b40fdb30 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:15.664 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.662+0000 7f56b9e8a640 1 --2- 172.21.15.89:0/3291804410 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f56b40fa960 0x7f56b40fad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:15.664 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.662+0000 7f56b9e8a640 1 -- 172.21.15.89:0/3291804410 >> 172.21.15.89:0/3291804410 conn(0x7f56b40f63a0 msgr2=0x7f56b40f87d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:02:15.664 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.662+0000 7f56b9e8a640 1 -- 172.21.15.89:0/3291804410 shutdown_connections 2024-09-13T03:02:15.664 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.662+0000 7f56b9e8a640 1 -- 172.21.15.89:0/3291804410 wait complete. 2024-09-13T03:02:15.666 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.663+0000 7f56b9e8a640 1 Processor -- start 2024-09-13T03:02:15.666 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.663+0000 7f56b9e8a640 1 -- start start 2024-09-13T03:02:15.666 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.663+0000 7f56b9e8a640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f56b40fa960 0x7f56b410d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:02:15.666 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.663+0000 7f56b9e8a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f56b40fb2b0 0x7f56b410d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:02:15.666 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.663+0000 7f56b9e8a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56b410dec0 con 0x7f56b40fb2b0 2024-09-13T03:02:15.666 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.663+0000 7f56b9e8a640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56b410e6e0 con 0x7f56b40fa960 2024-09-13T03:02:15.666 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.664+0000 7f56b2ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f56b40fb2b0 0x7f56b410d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:02:15.667 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.664+0000 7f56b2ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f56b40fb2b0 0x7f56b410d870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:46654/0 (socket says 172.21.15.89:46654) 2024-09-13T03:02:15.667 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.664+0000 7f56b2ffd640 1 -- 172.21.15.89:0/1190275661 learned_addr learned my addr 172.21.15.89:0/1190275661 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T03:02:15.667 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.664+0000 7f56b37fe640 1 --2- 172.21.15.89:0/1190275661 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f56b40fa960 0x7f56b410d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:02:15.667 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.664+0000 7f56b2ffd640 1 -- 172.21.15.89:0/1190275661 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f56b40fa960 msgr2=0x7f56b410d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:15.667 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.664+0000 7f56b2ffd640 1 --2- 172.21.15.89:0/1190275661 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f56b40fa960 0x7f56b410d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:15.667 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.664+0000 7f56b2ffd640 1 -- 172.21.15.89:0/1190275661 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56a8005040 con 0x7f56b40fb2b0 2024-09-13T03:02:15.667 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.664+0000 7f56b2ffd640 1 --2- 172.21.15.89:0/1190275661 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f56b40fb2b0 0x7f56b410d870 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f56a80043d0 tx=0x7f56a8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:02:15.667 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.664+0000 7f569bfff640 1 -- 172.21.15.89:0/1190275661 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f56a8038070 con 0x7f56b40fb2b0 2024-09-13T03:02:15.667 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.664+0000 7f569bfff640 1 -- 172.21.15.89:0/1190275661 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f56a802ae90 con 0x7f56b40fb2b0 2024-09-13T03:02:15.667 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.664+0000 7f56b9e8a640 1 -- 172.21.15.89:0/1190275661 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56b410e910 con 0x7f56b40fb2b0 2024-09-13T03:02:15.667 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.664+0000 7f569bfff640 1 -- 172.21.15.89:0/1190275661 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f56a803e670 con 0x7f56b40fb2b0 2024-09-13T03:02:15.668 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.664+0000 7f56b9e8a640 1 -- 172.21.15.89:0/1190275661 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56b410eeb0 con 0x7f56b40fb2b0 2024-09-13T03:02:15.668 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.666+0000 7f56b9e8a640 1 -- 172.21.15.89:0/1190275661 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56b40fa040 con 0x7f56b40fb2b0 2024-09-13T03:02:15.669 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.666+0000 7f569bfff640 1 -- 172.21.15.89:0/1190275661 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f56a8030020 con 0x7f56b40fb2b0 2024-09-13T03:02:15.669 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.666+0000 7f569bfff640 1 --2- 172.21.15.89:0/1190275661 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f569c06e530 0x7f569c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:02:15.669 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.667+0000 7f569bfff640 1 -- 172.21.15.89:0/1190275661 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f56a80ae350 con 0x7f56b40fb2b0 2024-09-13T03:02:15.669 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.667+0000 7f56b37fe640 1 --2- 172.21.15.89:0/1190275661 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f569c06e530 0x7f569c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:02:15.669 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.667+0000 7f56b37fe640 1 --2- 172.21.15.89:0/1190275661 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f569c06e530 0x7f569c0709e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f56a4004ed0 tx=0x7f56a400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:02:15.672 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.671+0000 7f569bfff640 1 -- 172.21.15.89:0/1190275661 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f56a8077490 con 0x7f56b40fb2b0 2024-09-13T03:02:15.845 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.844+0000 7f56b9e8a640 1 -- 172.21.15.89:0/1190275661 --> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f56b41052e0 con 0x7f569c06e530 2024-09-13T03:02:15.854 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.853+0000 7f569bfff640 1 -- 172.21.15.89:0/1190275661 <== mgr.34104 v2:172.21.15.89:6800/1881577856 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3520 (secure 0 0 0) 0x7f56b41052e0 con 0x7f569c06e530 2024-09-13T03:02:15.854 INFO:teuthology.orchestra.run.smithi089.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T03:02:15.854 INFO:teuthology.orchestra.run.smithi089.stdout:alertmanager.smithi089 smithi089 *:9093,9094 running (6m) 18s ago 15m 24.1M - 0.25.0 c8568f914cd2 1d2432f5479e 2024-09-13T03:02:15.854 INFO:teuthology.orchestra.run.smithi089.stdout:crash.smithi089 smithi089 running (4m) 18s ago 15m 6891k - 19.1.1-322-g7741f7f9 19dc8d659727 0ef15ca3e7f9 2024-09-13T03:02:15.854 INFO:teuthology.orchestra.run.smithi089.stdout:crash.smithi131 smithi131 running (4m) 6s ago 15m 6895k - 19.1.1-322-g7741f7f9 19dc8d659727 21e4d6fc04f7 2024-09-13T03:02:15.854 INFO:teuthology.orchestra.run.smithi089.stdout:grafana.smithi089 smithi089 *:3000 running (6m) 18s ago 15m 87.5M - 9.4.7 954c08fa6188 dee914ded1af 2024-09-13T03:02:15.854 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi089.qjoitb smithi089 running (50s) 18s ago 10m 69.9M - 19.1.1-322-g7741f7f9 19dc8d659727 e79bfdab021a 2024-09-13T03:02:15.855 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi089.rarddb smithi089 running (26s) 18s ago 10m 11.0M - 19.1.1-322-g7741f7f9 19dc8d659727 40413b0e466c 2024-09-13T03:02:15.855 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi131.rbovzc smithi131 running (10m) 6s ago 10m 11.4M - 17.2.7-1627-gbbdadfa3 a994b00deb3a d071b6d99537 2024-09-13T03:02:15.855 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi131.uasrkg smithi131 running (9s) 6s ago 10m 12.1M - 19.1.1-322-g7741f7f9 19dc8d659727 95f4ff9e971a 2024-09-13T03:02:15.855 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.smithi089.guohvs smithi089 *:8443,9283,8765 running (6m) 18s ago 17m 505M - 19.1.1-322-g7741f7f9 19dc8d659727 1e887446f1b0 2024-09-13T03:02:15.855 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.smithi131.aunbqd smithi131 *:8443,9283,8765 running (5m) 6s ago 14m 441M - 19.1.1-322-g7741f7f9 19dc8d659727 358d7478f2ba 2024-09-13T03:02:15.855 INFO:teuthology.orchestra.run.smithi089.stdout:mon.smithi089 smithi089 running (5m) 18s ago 17m 51.4M 2048M 19.1.1-322-g7741f7f9 19dc8d659727 8a29fb65028f 2024-09-13T03:02:15.855 INFO:teuthology.orchestra.run.smithi089.stdout:mon.smithi131 smithi131 running (5m) 6s ago 14m 41.9M 2048M 19.1.1-322-g7741f7f9 19dc8d659727 506310ad8620 2024-09-13T03:02:15.855 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.smithi089 smithi089 *:9100 running (7m) 18s ago 15m 16.8M - 1.5.0 0da6a335fe13 5a9927b583e6 2024-09-13T03:02:15.855 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.smithi131 smithi131 *:9100 running (6m) 6s ago 15m 15.6M - 1.5.0 0da6a335fe13 bcfde5d1a508 2024-09-13T03:02:15.855 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0 smithi089 running (4m) 18s ago 14m 105M 1557M 19.1.1-322-g7741f7f9 19dc8d659727 e8038f6d52b6 2024-09-13T03:02:15.855 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1 smithi089 running (3m) 18s ago 13m 107M 1557M 19.1.1-322-g7741f7f9 19dc8d659727 e174144d9633 2024-09-13T03:02:15.855 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2 smithi089 running (3m) 18s ago 13m 96.0M 1557M 19.1.1-322-g7741f7f9 19dc8d659727 2d8cab08c2b3 2024-09-13T03:02:15.855 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3 smithi131 running (2m) 6s ago 12m 116M 2581M 19.1.1-322-g7741f7f9 19dc8d659727 e77cff624869 2024-09-13T03:02:15.856 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4 smithi131 running (2m) 6s ago 12m 104M 2581M 19.1.1-322-g7741f7f9 19dc8d659727 0317e6a4a04c 2024-09-13T03:02:15.856 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5 smithi131 running (100s) 6s ago 11m 91.2M 2581M 19.1.1-322-g7741f7f9 19dc8d659727 e7d2a780f4e0 2024-09-13T03:02:15.856 INFO:teuthology.orchestra.run.smithi089.stdout:prometheus.smithi089 smithi089 *:9095 running (6m) 18s ago 15m 67.5M - 2.43.0 a07b618ecd1d 9d336370c187 2024-09-13T03:02:15.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.855+0000 7f56b9e8a640 1 -- 172.21.15.89:0/1190275661 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f569c06e530 msgr2=0x7f569c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:15.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.855+0000 7f56b9e8a640 1 --2- 172.21.15.89:0/1190275661 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f569c06e530 0x7f569c0709e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f56a4004ed0 tx=0x7f56a400b040 comp rx=0 tx=0).stop 2024-09-13T03:02:15.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.855+0000 7f56b9e8a640 1 -- 172.21.15.89:0/1190275661 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f56b40fb2b0 msgr2=0x7f56b410d870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:15.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.855+0000 7f56b9e8a640 1 --2- 172.21.15.89:0/1190275661 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f56b40fb2b0 0x7f56b410d870 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f56a80043d0 tx=0x7f56a8009da0 comp rx=0 tx=0).stop 2024-09-13T03:02:15.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.855+0000 7f56b9e8a640 1 -- 172.21.15.89:0/1190275661 shutdown_connections 2024-09-13T03:02:15.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.855+0000 7f56b9e8a640 1 --2- 172.21.15.89:0/1190275661 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f569c06e530 0x7f569c0709e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:15.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.855+0000 7f56b9e8a640 1 --2- 172.21.15.89:0/1190275661 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f56b40fb2b0 0x7f56b410d870 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:15.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.855+0000 7f56b9e8a640 1 --2- 172.21.15.89:0/1190275661 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f56b40fa960 0x7f56b410d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:15.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.855+0000 7f56b9e8a640 1 -- 172.21.15.89:0/1190275661 >> 172.21.15.89:0/1190275661 conn(0x7f56b40f63a0 msgr2=0x7f56b40f7f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:02:15.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.855+0000 7f56b9e8a640 1 -- 172.21.15.89:0/1190275661 shutdown_connections 2024-09-13T03:02:15.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.855+0000 7f56b9e8a640 1 -- 172.21.15.89:0/1190275661 wait complete. 2024-09-13T03:02:15.934 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.932+0000 7f83c3422640 1 -- 172.21.15.89:0/1041396909 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83bc0fb420 msgr2=0x7f83bc0fb830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:15.934 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.932+0000 7f83c3422640 1 --2- 172.21.15.89:0/1041396909 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83bc0fb420 0x7f83bc0fb830 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f83b80048d0 tx=0x7f83b8009da0 comp rx=0 tx=0).stop 2024-09-13T03:02:15.934 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.932+0000 7f83c3422640 1 -- 172.21.15.89:0/1041396909 shutdown_connections 2024-09-13T03:02:15.934 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.932+0000 7f83c3422640 1 --2- 172.21.15.89:0/1041396909 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f83bc0fc6f0 0x7f83bc0fcb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:15.934 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.932+0000 7f83c3422640 1 --2- 172.21.15.89:0/1041396909 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83bc0fb420 0x7f83bc0fb830 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:15.934 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.932+0000 7f83c3422640 1 -- 172.21.15.89:0/1041396909 >> 172.21.15.89:0/1041396909 conn(0x7f83bc0f6c00 msgr2=0x7f83bc0f9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:02:15.934 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.933+0000 7f83c3422640 1 -- 172.21.15.89:0/1041396909 shutdown_connections 2024-09-13T03:02:15.934 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.933+0000 7f83c3422640 1 -- 172.21.15.89:0/1041396909 wait complete. 2024-09-13T03:02:15.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.933+0000 7f83c3422640 1 Processor -- start 2024-09-13T03:02:15.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.933+0000 7f83c3422640 1 -- start start 2024-09-13T03:02:15.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.933+0000 7f83c3422640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83bc0fb420 0x7f83bc0ff540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:02:15.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.933+0000 7f83c3422640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f83bc0fc6f0 0x7f83bc0fda30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:02:15.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.933+0000 7f83c3422640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83bc0fdfc0 con 0x7f83bc0fb420 2024-09-13T03:02:15.936 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.933+0000 7f83c3422640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83bc0fe100 con 0x7f83bc0fc6f0 2024-09-13T03:02:15.937 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.933+0000 7f83c11be640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83bc0fb420 0x7f83bc0ff540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:02:15.937 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.933+0000 7f83c11be640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83bc0fb420 0x7f83bc0ff540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:46668/0 (socket says 172.21.15.89:46668) 2024-09-13T03:02:15.937 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.933+0000 7f83c11be640 1 -- 172.21.15.89:0/711951174 learned_addr learned my addr 172.21.15.89:0/711951174 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T03:02:15.937 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.934+0000 7f83c09bd640 1 --2- 172.21.15.89:0/711951174 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f83bc0fc6f0 0x7f83bc0fda30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:02:15.937 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.934+0000 7f83c11be640 1 -- 172.21.15.89:0/711951174 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f83bc0fc6f0 msgr2=0x7f83bc0fda30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:15.937 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.934+0000 7f83c11be640 1 --2- 172.21.15.89:0/711951174 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f83bc0fc6f0 0x7f83bc0fda30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:15.937 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.934+0000 7f83c11be640 1 -- 172.21.15.89:0/711951174 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83b8005040 con 0x7f83bc0fb420 2024-09-13T03:02:15.937 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.934+0000 7f83c11be640 1 --2- 172.21.15.89:0/711951174 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83bc0fb420 0x7f83bc0ff540 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f83b80048a0 tx=0x7f83b8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:02:15.937 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.934+0000 7f83b1ffb640 1 -- 172.21.15.89:0/711951174 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f83b8038070 con 0x7f83bc0fb420 2024-09-13T03:02:15.937 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.934+0000 7f83b1ffb640 1 -- 172.21.15.89:0/711951174 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f83b8004290 con 0x7f83bc0fb420 2024-09-13T03:02:15.937 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.934+0000 7f83c3422640 1 -- 172.21.15.89:0/711951174 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83bc0fe380 con 0x7f83bc0fb420 2024-09-13T03:02:15.937 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.934+0000 7f83b1ffb640 1 -- 172.21.15.89:0/711951174 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f83b8033660 con 0x7f83bc0fb420 2024-09-13T03:02:15.938 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.935+0000 7f83c3422640 1 -- 172.21.15.89:0/711951174 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83bc1150f0 con 0x7f83bc0fb420 2024-09-13T03:02:15.941 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.936+0000 7f83c3422640 1 -- 172.21.15.89:0/711951174 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83bc0fa880 con 0x7f83bc0fb420 2024-09-13T03:02:15.941 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.936+0000 7f83b1ffb640 1 -- 172.21.15.89:0/711951174 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f83b8030020 con 0x7f83bc0fb420 2024-09-13T03:02:15.941 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.936+0000 7f83b1ffb640 1 --2- 172.21.15.89:0/711951174 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f83a806e530 0x7f83a80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:02:15.941 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.937+0000 7f83b1ffb640 1 -- 172.21.15.89:0/711951174 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f83b80ae260 con 0x7f83bc0fb420 2024-09-13T03:02:15.941 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.937+0000 7f83c09bd640 1 --2- 172.21.15.89:0/711951174 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f83a806e530 0x7f83a80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:02:15.941 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.937+0000 7f83c09bd640 1 --2- 172.21.15.89:0/711951174 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f83a806e530 0x7f83a80709e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f83ac009af0 tx=0x7f83ac00b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:02:15.942 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:15.941+0000 7f83b1ffb640 1 -- 172.21.15.89:0/711951174 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f83b8077420 con 0x7f83bc0fb420 2024-09-13T03:02:16.174 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.172+0000 7f83c3422640 1 -- 172.21.15.89:0/711951174 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f83bc103f40 con 0x7f83bc0fb420 2024-09-13T03:02:16.174 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.173+0000 7f83b1ffb640 1 -- 172.21.15.89:0/711951174 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+849 (secure 0 0 0) 0x7f83b802c870 con 0x7f83bc0fb420 2024-09-13T03:02:16.174 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-13T03:02:16.174 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": { 2024-09-13T03:02:16.175 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 2 2024-09-13T03:02:16.175 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T03:02:16.175 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": { 2024-09-13T03:02:16.175 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 2 2024-09-13T03:02:16.175 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T03:02:16.175 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": { 2024-09-13T03:02:16.175 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 6 2024-09-13T03:02:16.175 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T03:02:16.175 INFO:teuthology.orchestra.run.smithi089.stdout: "mds": { 2024-09-13T03:02:16.175 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 1, 2024-09-13T03:02:16.175 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 3 2024-09-13T03:02:16.176 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T03:02:16.176 INFO:teuthology.orchestra.run.smithi089.stdout: "overall": { 2024-09-13T03:02:16.176 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 17.2.7-1627-gbbdadfa3 (bbdadfa31f8fb9afaa389358d138cac49bd69e56) quincy (stable)": 1, 2024-09-13T03:02:16.176 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 13 2024-09-13T03:02:16.176 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-13T03:02:16.176 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-13T03:02:16.177 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.175+0000 7f83c3422640 1 -- 172.21.15.89:0/711951174 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f83a806e530 msgr2=0x7f83a80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:16.177 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.175+0000 7f83c3422640 1 --2- 172.21.15.89:0/711951174 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f83a806e530 0x7f83a80709e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f83ac009af0 tx=0x7f83ac00b040 comp rx=0 tx=0).stop 2024-09-13T03:02:16.177 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.175+0000 7f83c3422640 1 -- 172.21.15.89:0/711951174 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83bc0fb420 msgr2=0x7f83bc0ff540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:16.177 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.175+0000 7f83c3422640 1 --2- 172.21.15.89:0/711951174 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83bc0fb420 0x7f83bc0ff540 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f83b80048a0 tx=0x7f83b8009da0 comp rx=0 tx=0).stop 2024-09-13T03:02:16.177 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.175+0000 7f83c3422640 1 -- 172.21.15.89:0/711951174 shutdown_connections 2024-09-13T03:02:16.177 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.175+0000 7f83c3422640 1 --2- 172.21.15.89:0/711951174 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f83a806e530 0x7f83a80709e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:16.177 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.175+0000 7f83c3422640 1 --2- 172.21.15.89:0/711951174 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f83bc0fc6f0 0x7f83bc0fda30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:16.177 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.175+0000 7f83c3422640 1 --2- 172.21.15.89:0/711951174 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f83bc0fb420 0x7f83bc0ff540 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:16.177 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.175+0000 7f83c3422640 1 -- 172.21.15.89:0/711951174 >> 172.21.15.89:0/711951174 conn(0x7f83bc0f6c00 msgr2=0x7f83bc065ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:02:16.177 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.175+0000 7f83c3422640 1 -- 172.21.15.89:0/711951174 shutdown_connections 2024-09-13T03:02:16.177 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.175+0000 7f83c3422640 1 -- 172.21.15.89:0/711951174 wait complete. 2024-09-13T03:02:16.257 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.254+0000 7f30365d8640 1 -- 172.21.15.89:0/1317290100 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f30300fc720 msgr2=0x7f30300fcb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:16.257 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.254+0000 7f30365d8640 1 --2- 172.21.15.89:0/1317290100 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f30300fc720 0x7f30300fcb90 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f30180048d0 tx=0x7f3018009da0 comp rx=0 tx=0).stop 2024-09-13T03:02:16.257 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.254+0000 7f30365d8640 1 -- 172.21.15.89:0/1317290100 shutdown_connections 2024-09-13T03:02:16.258 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.254+0000 7f30365d8640 1 --2- 172.21.15.89:0/1317290100 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f30300fc720 0x7f30300fcb90 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:16.258 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.254+0000 7f30365d8640 1 --2- 172.21.15.89:0/1317290100 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f30300fb450 0x7f30300fb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:16.258 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.254+0000 7f30365d8640 1 -- 172.21.15.89:0/1317290100 >> 172.21.15.89:0/1317290100 conn(0x7f30300f6c30 msgr2=0x7f30300f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:02:16.258 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.254+0000 7f30365d8640 1 -- 172.21.15.89:0/1317290100 shutdown_connections 2024-09-13T03:02:16.258 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.254+0000 7f30365d8640 1 -- 172.21.15.89:0/1317290100 wait complete. 2024-09-13T03:02:16.258 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.255+0000 7f30365d8640 1 Processor -- start 2024-09-13T03:02:16.258 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.255+0000 7f30365d8640 1 -- start start 2024-09-13T03:02:16.258 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.255+0000 7f30365d8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f30300fb450 0x7f303010d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:02:16.258 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.255+0000 7f30365d8640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f30300fc720 0x7f303010d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:02:16.258 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.255+0000 7f30365d8640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f303010dcc0 con 0x7f30300fb450 2024-09-13T03:02:16.258 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.255+0000 7f30365d8640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f303010e4e0 con 0x7f30300fc720 2024-09-13T03:02:16.259 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.255+0000 7f302ffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f30300fb450 0x7f303010d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:02:16.259 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.255+0000 7f302ffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f30300fb450 0x7f303010d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:46678/0 (socket says 172.21.15.89:46678) 2024-09-13T03:02:16.259 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.255+0000 7f302ffff640 1 -- 172.21.15.89:0/1839004140 learned_addr learned my addr 172.21.15.89:0/1839004140 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T03:02:16.259 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.255+0000 7f3027fff640 1 --2- 172.21.15.89:0/1839004140 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f30300fc720 0x7f303010d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:02:16.259 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.255+0000 7f302ffff640 1 -- 172.21.15.89:0/1839004140 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f30300fc720 msgr2=0x7f303010d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:16.259 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.255+0000 7f302ffff640 1 --2- 172.21.15.89:0/1839004140 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f30300fc720 0x7f303010d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:16.259 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.255+0000 7f302ffff640 1 -- 172.21.15.89:0/1839004140 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3018005040 con 0x7f30300fb450 2024-09-13T03:02:16.259 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.255+0000 7f302ffff640 1 --2- 172.21.15.89:0/1839004140 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f30300fb450 0x7f303010d130 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f302000eb70 tx=0x7f302000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:02:16.259 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.256+0000 7f302d7fa640 1 -- 172.21.15.89:0/1839004140 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3020007c30 con 0x7f30300fb450 2024-09-13T03:02:16.259 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.256+0000 7f302d7fa640 1 -- 172.21.15.89:0/1839004140 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f302000f040 con 0x7f30300fb450 2024-09-13T03:02:16.260 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.256+0000 7f30365d8640 1 -- 172.21.15.89:0/1839004140 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f303010e710 con 0x7f30300fb450 2024-09-13T03:02:16.260 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.256+0000 7f302d7fa640 1 -- 172.21.15.89:0/1839004140 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f302000ca60 con 0x7f30300fb450 2024-09-13T03:02:16.260 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.256+0000 7f30365d8640 1 -- 172.21.15.89:0/1839004140 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f303010ecb0 con 0x7f30300fb450 2024-09-13T03:02:16.261 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.257+0000 7f30365d8640 1 -- 172.21.15.89:0/1839004140 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30300fa8b0 con 0x7f30300fb450 2024-09-13T03:02:16.261 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.257+0000 7f302d7fa640 1 -- 172.21.15.89:0/1839004140 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f302000cbc0 con 0x7f30300fb450 2024-09-13T03:02:16.261 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.258+0000 7f302d7fa640 1 --2- 172.21.15.89:0/1839004140 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f301c06e530 0x7f301c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:02:16.261 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.258+0000 7f302d7fa640 1 -- 172.21.15.89:0/1839004140 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f302008de30 con 0x7f30300fb450 2024-09-13T03:02:16.261 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.258+0000 7f3027fff640 1 --2- 172.21.15.89:0/1839004140 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f301c06e530 0x7f301c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:02:16.261 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.258+0000 7f3027fff640 1 --2- 172.21.15.89:0/1839004140 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f301c06e530 0x7f301c0709e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f303010cee0 tx=0x7f3018035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:02:16.263 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.262+0000 7f302d7fa640 1 -- 172.21.15.89:0/1839004140 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f3020056f70 con 0x7f30300fb450 2024-09-13T03:02:16.467 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.465+0000 7f30365d8640 1 -- 172.21.15.89:0/1839004140 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f3030103fb0 con 0x7f30300fb450 2024-09-13T03:02:16.467 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:16 smithi089 ceph-mon[91553]: Upgrade: Updating mds.cephfs.smithi131.rbovzc 2024-09-13T03:02:16.467 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:16 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:02:16.468 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:16 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi131.rbovzc", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T03:02:16.468 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:16 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T03:02:16.468 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:16 smithi089 ceph-mon[91553]: Deploying daemon mds.cephfs.smithi131.rbovzc on smithi131 2024-09-13T03:02:16.468 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:16 smithi089 ceph-mon[91553]: from='client.34452 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T03:02:16.468 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:16 smithi089 ceph-mon[91553]: from='client.34456 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T03:02:16.468 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:16 smithi089 ceph-mon[91553]: pgmap v207: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:02:16.468 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:16 smithi089 ceph-mon[91553]: from='client.34460 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T03:02:16.468 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:16 smithi089 ceph-mon[91553]: from='client.? 172.21.15.89:0/711951174' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:16.468 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.466+0000 7f302d7fa640 1 -- 172.21.15.89:0/1839004140 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 38 v38) v1 ==== 76+0+1975 (secure 0 0 0) 0x7f302005a630 con 0x7f30300fb450 2024-09-13T03:02:16.469 INFO:teuthology.orchestra.run.smithi089.stdout:e38 2024-09-13T03:02:16.469 INFO:teuthology.orchestra.run.smithi089.stdout:btime 2024-09-13T03:02:07:506201+0000 2024-09-13T03:02:16.469 INFO:teuthology.orchestra.run.smithi089.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T03:02:16.469 INFO:teuthology.orchestra.run.smithi089.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T03:02:16.469 INFO:teuthology.orchestra.run.smithi089.stdout:legacy client fscid: 1 2024-09-13T03:02:16.469 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T03:02:16.469 INFO:teuthology.orchestra.run.smithi089.stdout:Filesystem 'cephfs' (1) 2024-09-13T03:02:16.469 INFO:teuthology.orchestra.run.smithi089.stdout:fs_name cephfs 2024-09-13T03:02:16.470 INFO:teuthology.orchestra.run.smithi089.stdout:epoch 35 2024-09-13T03:02:16.470 INFO:teuthology.orchestra.run.smithi089.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-09-13T03:02:16.470 INFO:teuthology.orchestra.run.smithi089.stdout:created 2024-09-13T02:51:40.657817+0000 2024-09-13T03:02:16.470 INFO:teuthology.orchestra.run.smithi089.stdout:modified 2024-09-13T03:01:46.692911+0000 2024-09-13T03:02:16.470 INFO:teuthology.orchestra.run.smithi089.stdout:tableserver 0 2024-09-13T03:02:16.470 INFO:teuthology.orchestra.run.smithi089.stdout:root 0 2024-09-13T03:02:16.470 INFO:teuthology.orchestra.run.smithi089.stdout:session_timeout 60 2024-09-13T03:02:16.470 INFO:teuthology.orchestra.run.smithi089.stdout:session_autoclose 300 2024-09-13T03:02:16.470 INFO:teuthology.orchestra.run.smithi089.stdout:max_file_size 1099511627776 2024-09-13T03:02:16.470 INFO:teuthology.orchestra.run.smithi089.stdout:max_xattr_size 65536 2024-09-13T03:02:16.471 INFO:teuthology.orchestra.run.smithi089.stdout:required_client_features {} 2024-09-13T03:02:16.471 INFO:teuthology.orchestra.run.smithi089.stdout:last_failure 0 2024-09-13T03:02:16.471 INFO:teuthology.orchestra.run.smithi089.stdout:last_failure_osd_epoch 80 2024-09-13T03:02:16.471 INFO:teuthology.orchestra.run.smithi089.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-13T03:02:16.471 INFO:teuthology.orchestra.run.smithi089.stdout:max_mds 1 2024-09-13T03:02:16.471 INFO:teuthology.orchestra.run.smithi089.stdout:in 0 2024-09-13T03:02:16.471 INFO:teuthology.orchestra.run.smithi089.stdout:up {0=34416} 2024-09-13T03:02:16.471 INFO:teuthology.orchestra.run.smithi089.stdout:failed 2024-09-13T03:02:16.471 INFO:teuthology.orchestra.run.smithi089.stdout:damaged 2024-09-13T03:02:16.471 INFO:teuthology.orchestra.run.smithi089.stdout:stopped 1 2024-09-13T03:02:16.471 INFO:teuthology.orchestra.run.smithi089.stdout:data_pools [3] 2024-09-13T03:02:16.472 INFO:teuthology.orchestra.run.smithi089.stdout:metadata_pool 2 2024-09-13T03:02:16.472 INFO:teuthology.orchestra.run.smithi089.stdout:inline_data disabled 2024-09-13T03:02:16.472 INFO:teuthology.orchestra.run.smithi089.stdout:balancer 2024-09-13T03:02:16.472 INFO:teuthology.orchestra.run.smithi089.stdout:bal_rank_mask -1 2024-09-13T03:02:16.472 INFO:teuthology.orchestra.run.smithi089.stdout:standby_count_wanted 1 2024-09-13T03:02:16.472 INFO:teuthology.orchestra.run.smithi089.stdout:qdb_cluster leader: 34416 members: 34416 2024-09-13T03:02:16.472 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi089.qjoitb{0:34416} state up:active seq 8 join_fscid=1 addr [v2:172.21.15.89:6826/2439422546,v1:172.21.15.89:6827/2439422546] compat {c=[1],r=[1],i=[1fff]}] 2024-09-13T03:02:16.472 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T03:02:16.472 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T03:02:16.473 INFO:teuthology.orchestra.run.smithi089.stdout:Standby daemons: 2024-09-13T03:02:16.473 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T03:02:16.473 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi089.rarddb{-1:34448} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.89:6828/177758677,v1:172.21.15.89:6829/177758677] compat {c=[1],r=[1],i=[1fff]}] 2024-09-13T03:02:16.473 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi131.rbovzc{-1:44293} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.131:6826/1074022424,v1:172.21.15.131:6827/1074022424] compat {c=[1],r=[1],i=[7ff]}] 2024-09-13T03:02:16.473 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi131.uasrkg{-1:44355} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.131:6824/2298563432,v1:172.21.15.131:6825/2298563432] compat {c=[1],r=[1],i=[1fff]}] 2024-09-13T03:02:16.474 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 38 2024-09-13T03:02:16.474 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.468+0000 7f30365d8640 1 -- 172.21.15.89:0/1839004140 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f301c06e530 msgr2=0x7f301c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:16.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.468+0000 7f30365d8640 1 --2- 172.21.15.89:0/1839004140 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f301c06e530 0x7f301c0709e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f303010cee0 tx=0x7f3018035040 comp rx=0 tx=0).stop 2024-09-13T03:02:16.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.468+0000 7f30365d8640 1 -- 172.21.15.89:0/1839004140 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f30300fb450 msgr2=0x7f303010d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:16.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.468+0000 7f30365d8640 1 --2- 172.21.15.89:0/1839004140 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f30300fb450 0x7f303010d130 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f302000eb70 tx=0x7f302000b040 comp rx=0 tx=0).stop 2024-09-13T03:02:16.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.468+0000 7f30365d8640 1 -- 172.21.15.89:0/1839004140 shutdown_connections 2024-09-13T03:02:16.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.468+0000 7f30365d8640 1 --2- 172.21.15.89:0/1839004140 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f301c06e530 0x7f301c0709e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:16.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.468+0000 7f30365d8640 1 --2- 172.21.15.89:0/1839004140 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f30300fc720 0x7f303010d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:16.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.468+0000 7f30365d8640 1 --2- 172.21.15.89:0/1839004140 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f30300fb450 0x7f303010d130 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:16.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.468+0000 7f30365d8640 1 -- 172.21.15.89:0/1839004140 >> 172.21.15.89:0/1839004140 conn(0x7f30300f6c30 msgr2=0x7f30300661c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:02:16.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.468+0000 7f30365d8640 1 -- 172.21.15.89:0/1839004140 shutdown_connections 2024-09-13T03:02:16.475 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.468+0000 7f30365d8640 1 -- 172.21.15.89:0/1839004140 wait complete. 2024-09-13T03:02:16.550 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.547+0000 7fa19c15a640 1 -- 172.21.15.89:0/144696440 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa1940fd840 msgr2=0x7fa1940fdcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:16.550 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.547+0000 7fa19c15a640 1 --2- 172.21.15.89:0/144696440 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa1940fd840 0x7fa1940fdcb0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fa1900048d0 tx=0x7fa190009da0 comp rx=0 tx=0).stop 2024-09-13T03:02:16.551 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.547+0000 7fa19c15a640 1 -- 172.21.15.89:0/144696440 shutdown_connections 2024-09-13T03:02:16.551 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.547+0000 7fa19c15a640 1 --2- 172.21.15.89:0/144696440 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa1940fd840 0x7fa1940fdcb0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:16.551 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.547+0000 7fa19c15a640 1 --2- 172.21.15.89:0/144696440 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa1940fc570 0x7fa1940fc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:16.551 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.547+0000 7fa19c15a640 1 -- 172.21.15.89:0/144696440 >> 172.21.15.89:0/144696440 conn(0x7fa1940f7d30 msgr2=0x7fa1940fa160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:02:16.551 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.547+0000 7fa19c15a640 1 -- 172.21.15.89:0/144696440 shutdown_connections 2024-09-13T03:02:16.551 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.547+0000 7fa19c15a640 1 -- 172.21.15.89:0/144696440 wait complete. 2024-09-13T03:02:16.551 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.548+0000 7fa19c15a640 1 Processor -- start 2024-09-13T03:02:16.551 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.548+0000 7fa19c15a640 1 -- start start 2024-09-13T03:02:16.551 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.548+0000 7fa19c15a640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa1940fc570 0x7fa19410d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:02:16.551 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.548+0000 7fa19c15a640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa1940fd840 0x7fa19410d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:02:16.551 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.548+0000 7fa19c15a640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa19410dc30 con 0x7fa1940fc570 2024-09-13T03:02:16.552 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.548+0000 7fa19c15a640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa19410e450 con 0x7fa1940fd840 2024-09-13T03:02:16.552 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.548+0000 7fa199ef6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa1940fc570 0x7fa19410d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:02:16.552 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.548+0000 7fa199ef6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa1940fc570 0x7fa19410d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:46690/0 (socket says 172.21.15.89:46690) 2024-09-13T03:02:16.552 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.548+0000 7fa199ef6640 1 -- 172.21.15.89:0/882763909 learned_addr learned my addr 172.21.15.89:0/882763909 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T03:02:16.552 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.548+0000 7fa1996f5640 1 --2- 172.21.15.89:0/882763909 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa1940fd840 0x7fa19410d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:02:16.552 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.548+0000 7fa199ef6640 1 -- 172.21.15.89:0/882763909 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa1940fd840 msgr2=0x7fa19410d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:16.552 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.548+0000 7fa199ef6640 1 --2- 172.21.15.89:0/882763909 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa1940fd840 0x7fa19410d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:16.552 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.548+0000 7fa199ef6640 1 -- 172.21.15.89:0/882763909 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa190005040 con 0x7fa1940fc570 2024-09-13T03:02:16.552 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.548+0000 7fa199ef6640 1 --2- 172.21.15.89:0/882763909 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa1940fc570 0x7fa19410d0a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa188002a50 tx=0x7fa188004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:02:16.552 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.549+0000 7fa1867fc640 1 -- 172.21.15.89:0/882763909 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa188007c30 con 0x7fa1940fc570 2024-09-13T03:02:16.552 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.549+0000 7fa19c15a640 1 -- 172.21.15.89:0/882763909 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa19410e6e0 con 0x7fa1940fc570 2024-09-13T03:02:16.553 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.549+0000 7fa1867fc640 1 -- 172.21.15.89:0/882763909 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa18800f040 con 0x7fa1940fc570 2024-09-13T03:02:16.553 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.549+0000 7fa1867fc640 1 -- 172.21.15.89:0/882763909 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa18800da10 con 0x7fa1940fc570 2024-09-13T03:02:16.553 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.549+0000 7fa19c15a640 1 -- 172.21.15.89:0/882763909 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa19410ec80 con 0x7fa1940fc570 2024-09-13T03:02:16.554 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.550+0000 7fa19c15a640 1 -- 172.21.15.89:0/882763909 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1940fb9d0 con 0x7fa1940fc570 2024-09-13T03:02:16.554 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.550+0000 7fa1867fc640 1 -- 172.21.15.89:0/882763909 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fa18800dc80 con 0x7fa1940fc570 2024-09-13T03:02:16.554 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.550+0000 7fa1867fc640 1 --2- 172.21.15.89:0/882763909 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fa18006e530 0x7fa1800709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:02:16.554 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.551+0000 7fa1996f5640 1 --2- 172.21.15.89:0/882763909 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fa18006e530 0x7fa1800709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:02:16.554 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.551+0000 7fa1867fc640 1 -- 172.21.15.89:0/882763909 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fa18808d9d0 con 0x7fa1940fc570 2024-09-13T03:02:16.554 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.551+0000 7fa1996f5640 1 --2- 172.21.15.89:0/882763909 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fa18006e530 0x7fa1800709e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa19410ce50 tx=0x7fa190035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:02:16.556 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.555+0000 7fa1867fc640 1 -- 172.21.15.89:0/882763909 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fa188056b10 con 0x7fa1940fc570 2024-09-13T03:02:16.563 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:16 smithi131 ceph-mon[78839]: Upgrade: Updating mds.cephfs.smithi131.rbovzc 2024-09-13T03:02:16.563 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:16 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:02:16.563 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:16 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi131.rbovzc", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-13T03:02:16.563 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:16 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T03:02:16.563 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:16 smithi131 ceph-mon[78839]: Deploying daemon mds.cephfs.smithi131.rbovzc on smithi131 2024-09-13T03:02:16.563 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:16 smithi131 ceph-mon[78839]: from='client.34452 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T03:02:16.563 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:16 smithi131 ceph-mon[78839]: from='client.34456 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T03:02:16.563 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:16 smithi131 ceph-mon[78839]: pgmap v207: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:02:16.563 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:16 smithi131 ceph-mon[78839]: from='client.34460 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T03:02:16.564 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:16 smithi131 ceph-mon[78839]: from='client.? 172.21.15.89:0/711951174' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:16.747 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.745+0000 7fa19c15a640 1 -- 172.21.15.89:0/882763909 --> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa19410efd0 con 0x7fa18006e530 2024-09-13T03:02:16.747 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.746+0000 7fa1867fc640 1 -- 172.21.15.89:0/882763909 <== mgr.34104 v2:172.21.15.89:6800/1881577856 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fa19410efd0 con 0x7fa18006e530 2024-09-13T03:02:16.748 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-13T03:02:16.748 INFO:teuthology.orchestra.run.smithi089.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d", 2024-09-13T03:02:16.748 INFO:teuthology.orchestra.run.smithi089.stdout: "in_progress": true, 2024-09-13T03:02:16.748 INFO:teuthology.orchestra.run.smithi089.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T03:02:16.748 INFO:teuthology.orchestra.run.smithi089.stdout: "services_complete": [ 2024-09-13T03:02:16.748 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr", 2024-09-13T03:02:16.748 INFO:teuthology.orchestra.run.smithi089.stdout: "osd", 2024-09-13T03:02:16.748 INFO:teuthology.orchestra.run.smithi089.stdout: "crash", 2024-09-13T03:02:16.749 INFO:teuthology.orchestra.run.smithi089.stdout: "mon" 2024-09-13T03:02:16.749 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-13T03:02:16.749 INFO:teuthology.orchestra.run.smithi089.stdout: "progress": "15/21 daemons upgraded", 2024-09-13T03:02:16.749 INFO:teuthology.orchestra.run.smithi089.stdout: "message": "Currently upgrading mds daemons", 2024-09-13T03:02:16.749 INFO:teuthology.orchestra.run.smithi089.stdout: "is_paused": false 2024-09-13T03:02:16.749 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-13T03:02:16.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.748+0000 7fa19c15a640 1 -- 172.21.15.89:0/882763909 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fa18006e530 msgr2=0x7fa1800709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:16.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.748+0000 7fa19c15a640 1 --2- 172.21.15.89:0/882763909 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fa18006e530 0x7fa1800709e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fa19410ce50 tx=0x7fa190035040 comp rx=0 tx=0).stop 2024-09-13T03:02:16.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.748+0000 7fa19c15a640 1 -- 172.21.15.89:0/882763909 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa1940fc570 msgr2=0x7fa19410d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:16.750 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.748+0000 7fa19c15a640 1 --2- 172.21.15.89:0/882763909 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa1940fc570 0x7fa19410d0a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fa188002a50 tx=0x7fa188004600 comp rx=0 tx=0).stop 2024-09-13T03:02:16.751 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.748+0000 7fa19c15a640 1 -- 172.21.15.89:0/882763909 shutdown_connections 2024-09-13T03:02:16.751 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.748+0000 7fa19c15a640 1 --2- 172.21.15.89:0/882763909 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fa18006e530 0x7fa1800709e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:16.751 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.748+0000 7fa19c15a640 1 --2- 172.21.15.89:0/882763909 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa1940fd840 0x7fa19410d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:16.751 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.748+0000 7fa19c15a640 1 --2- 172.21.15.89:0/882763909 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa1940fc570 0x7fa19410d0a0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:16.751 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.748+0000 7fa19c15a640 1 -- 172.21.15.89:0/882763909 >> 172.21.15.89:0/882763909 conn(0x7fa1940f7d30 msgr2=0x7fa1940f94d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:02:16.751 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.748+0000 7fa19c15a640 1 -- 172.21.15.89:0/882763909 shutdown_connections 2024-09-13T03:02:16.751 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.748+0000 7fa19c15a640 1 -- 172.21.15.89:0/882763909 wait complete. 2024-09-13T03:02:16.831 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.827+0000 7fcaa0d20640 1 -- 172.21.15.89:0/3958839430 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca9c0fb420 msgr2=0x7fca9c0fb830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:16.831 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.827+0000 7fcaa0d20640 1 --2- 172.21.15.89:0/3958839430 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca9c0fb420 0x7fca9c0fb830 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fca8c009c50 tx=0x7fca8c004d10 comp rx=0 tx=0).stop 2024-09-13T03:02:16.831 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.828+0000 7fcaa0d20640 1 -- 172.21.15.89:0/3958839430 shutdown_connections 2024-09-13T03:02:16.831 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.828+0000 7fcaa0d20640 1 --2- 172.21.15.89:0/3958839430 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fca9c0fc6f0 0x7fca9c0fcb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:16.831 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.828+0000 7fcaa0d20640 1 --2- 172.21.15.89:0/3958839430 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca9c0fb420 0x7fca9c0fb830 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:16.831 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.828+0000 7fcaa0d20640 1 -- 172.21.15.89:0/3958839430 >> 172.21.15.89:0/3958839430 conn(0x7fca9c0f6c00 msgr2=0x7fca9c0f9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:02:16.831 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.828+0000 7fcaa0d20640 1 -- 172.21.15.89:0/3958839430 shutdown_connections 2024-09-13T03:02:16.831 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.828+0000 7fcaa0d20640 1 -- 172.21.15.89:0/3958839430 wait complete. 2024-09-13T03:02:16.831 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.828+0000 7fcaa0d20640 1 Processor -- start 2024-09-13T03:02:16.831 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.828+0000 7fcaa0d20640 1 -- start start 2024-09-13T03:02:16.831 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.828+0000 7fcaa0d20640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fca9c0fb420 0x7fca9c10fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:02:16.832 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.828+0000 7fcaa0d20640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca9c0fc6f0 0x7fca9c1122e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:02:16.832 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.828+0000 7fcaa0d20640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca9c066510 con 0x7fca9c0fc6f0 2024-09-13T03:02:16.832 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.828+0000 7fcaa0d20640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca9c066680 con 0x7fca9c0fb420 2024-09-13T03:02:16.832 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.829+0000 7fca99d9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca9c0fc6f0 0x7fca9c1122e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:02:16.832 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.829+0000 7fca99d9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca9c0fc6f0 0x7fca9c1122e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:46710/0 (socket says 172.21.15.89:46710) 2024-09-13T03:02:16.832 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.829+0000 7fca99d9b640 1 -- 172.21.15.89:0/3676262548 learned_addr learned my addr 172.21.15.89:0/3676262548 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T03:02:16.832 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.829+0000 7fca9a59c640 1 --2- 172.21.15.89:0/3676262548 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fca9c0fb420 0x7fca9c10fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:02:16.832 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.829+0000 7fca99d9b640 1 -- 172.21.15.89:0/3676262548 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fca9c0fb420 msgr2=0x7fca9c10fd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:16.832 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.829+0000 7fca99d9b640 1 --2- 172.21.15.89:0/3676262548 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fca9c0fb420 0x7fca9c10fd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:16.832 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.829+0000 7fca99d9b640 1 -- 172.21.15.89:0/3676262548 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca8c0098b0 con 0x7fca9c0fc6f0 2024-09-13T03:02:16.832 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.829+0000 7fca99d9b640 1 --2- 172.21.15.89:0/3676262548 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca9c0fc6f0 0x7fca9c1122e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fca8400eb70 tx=0x7fca8400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:02:16.832 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.829+0000 7fca92ffd640 1 -- 172.21.15.89:0/3676262548 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca84007c30 con 0x7fca9c0fc6f0 2024-09-13T03:02:16.833 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.829+0000 7fca92ffd640 1 -- 172.21.15.89:0/3676262548 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fca8400f040 con 0x7fca9c0fc6f0 2024-09-13T03:02:16.833 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.829+0000 7fcaa0d20640 1 -- 172.21.15.89:0/3676262548 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca9c112820 con 0x7fca9c0fc6f0 2024-09-13T03:02:16.833 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.829+0000 7fca92ffd640 1 -- 172.21.15.89:0/3676262548 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca840094e0 con 0x7fca9c0fc6f0 2024-09-13T03:02:16.833 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.829+0000 7fcaa0d20640 1 -- 172.21.15.89:0/3676262548 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca9c112d90 con 0x7fca9c0fc6f0 2024-09-13T03:02:16.834 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.830+0000 7fcaa0d20640 1 -- 172.21.15.89:0/3676262548 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca9c0fa880 con 0x7fca9c0fc6f0 2024-09-13T03:02:16.834 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.831+0000 7fca92ffd640 1 -- 172.21.15.89:0/3676262548 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fca84009640 con 0x7fca9c0fc6f0 2024-09-13T03:02:16.834 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.831+0000 7fca92ffd640 1 --2- 172.21.15.89:0/3676262548 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fca8806e530 0x7fca880709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:02:16.834 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.831+0000 7fca92ffd640 1 -- 172.21.15.89:0/3676262548 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fca8408ddc0 con 0x7fca9c0fc6f0 2024-09-13T03:02:16.834 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.831+0000 7fca9a59c640 1 --2- 172.21.15.89:0/3676262548 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fca8806e530 0x7fca880709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:02:16.834 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.832+0000 7fca9a59c640 1 --2- 172.21.15.89:0/3676262548 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fca8806e530 0x7fca880709e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fca8c000f80 tx=0x7fca8c004d10 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:02:16.837 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:16.836+0000 7fca92ffd640 1 -- 172.21.15.89:0/3676262548 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fca84056f80 con 0x7fca9c0fc6f0 2024-09-13T03:02:17.072 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:17.070+0000 7fcaa0d20640 1 -- 172.21.15.89:0/3676262548 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fca9c04b720 con 0x7fca9c0fc6f0 2024-09-13T03:02:17.072 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:17.071+0000 7fca92ffd640 1 -- 172.21.15.89:0/3676262548 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fca84061070 con 0x7fca9c0fc6f0 2024-09-13T03:02:17.073 INFO:teuthology.orchestra.run.smithi089.stdout:HEALTH_OK 2024-09-13T03:02:17.074 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:17.073+0000 7fcaa0d20640 1 -- 172.21.15.89:0/3676262548 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fca8806e530 msgr2=0x7fca880709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:17.074 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:17.073+0000 7fcaa0d20640 1 --2- 172.21.15.89:0/3676262548 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fca8806e530 0x7fca880709e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fca8c000f80 tx=0x7fca8c004d10 comp rx=0 tx=0).stop 2024-09-13T03:02:17.074 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:17.073+0000 7fcaa0d20640 1 -- 172.21.15.89:0/3676262548 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca9c0fc6f0 msgr2=0x7fca9c1122e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:17.075 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:17.073+0000 7fcaa0d20640 1 --2- 172.21.15.89:0/3676262548 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca9c0fc6f0 0x7fca9c1122e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fca8400eb70 tx=0x7fca8400b040 comp rx=0 tx=0).stop 2024-09-13T03:02:17.075 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:17.073+0000 7fcaa0d20640 1 -- 172.21.15.89:0/3676262548 shutdown_connections 2024-09-13T03:02:17.075 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:17.073+0000 7fcaa0d20640 1 --2- 172.21.15.89:0/3676262548 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fca8806e530 0x7fca880709e0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:17.075 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:17.073+0000 7fcaa0d20640 1 --2- 172.21.15.89:0/3676262548 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fca9c0fc6f0 0x7fca9c1122e0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:17.075 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:17.073+0000 7fcaa0d20640 1 --2- 172.21.15.89:0/3676262548 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fca9c0fb420 0x7fca9c10fd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:17.075 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:17.073+0000 7fcaa0d20640 1 -- 172.21.15.89:0/3676262548 >> 172.21.15.89:0/3676262548 conn(0x7fca9c0f6c00 msgr2=0x7fca9c0f83a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:02:17.075 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:17.073+0000 7fcaa0d20640 1 -- 172.21.15.89:0/3676262548 shutdown_connections 2024-09-13T03:02:17.075 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:17.073+0000 7fcaa0d20640 1 -- 172.21.15.89:0/3676262548 wait complete. 2024-09-13T03:02:17.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:17 smithi131 ceph-mon[78839]: from='client.? 172.21.15.89:0/1839004140' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T03:02:17.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:17 smithi131 ceph-mon[78839]: from='client.34472 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T03:02:17.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:17 smithi131 ceph-mon[78839]: from='client.? 172.21.15.89:0/3676262548' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T03:02:17.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:17 smithi089 ceph-mon[91553]: from='client.? 172.21.15.89:0/1839004140' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T03:02:17.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:17 smithi089 ceph-mon[91553]: from='client.34472 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T03:02:17.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:17 smithi089 ceph-mon[91553]: from='client.? 172.21.15.89:0/3676262548' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T03:02:18.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:18 smithi089 ceph-mon[91553]: osdmap e82: 6 total, 6 up, 6 in 2024-09-13T03:02:18.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:18 smithi089 ceph-mon[91553]: fsmap cephfs:1 {0=cephfs.smithi089.qjoitb=up:active} 2 up:standby 2024-09-13T03:02:18.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:18 smithi089 ceph-mon[91553]: pgmap v209: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:02:18.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:18 smithi131 ceph-mon[78839]: osdmap e82: 6 total, 6 up, 6 in 2024-09-13T03:02:18.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:18 smithi131 ceph-mon[78839]: fsmap cephfs:1 {0=cephfs.smithi089.qjoitb=up:active} 2 up:standby 2024-09-13T03:02:18.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:18 smithi131 ceph-mon[78839]: pgmap v209: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:02:20.933 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:20 smithi131 ceph-mon[78839]: pgmap v210: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:02:20.933 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:20 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:02:21.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:20 smithi089 ceph-mon[91553]: pgmap v210: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:02:21.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:20 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:02:22.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:22 smithi131 ceph-mon[78839]: pgmap v211: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:02:22.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:22 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:02:22.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:22 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:02:22.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:22 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:02:23.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:22 smithi089 ceph-mon[91553]: pgmap v211: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:02:23.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:22 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:02:23.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:22 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:02:23.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:22 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:02:23.829 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:23 smithi131 ceph-mon[78839]: mds.? [v2:172.21.15.131:6826/2680433683,v1:172.21.15.131:6827/2680433683] up:boot 2024-09-13T03:02:23.829 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:23 smithi131 ceph-mon[78839]: fsmap cephfs:1 {0=cephfs.smithi089.qjoitb=up:active} 3 up:standby 2024-09-13T03:02:23.829 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:23 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi131.rbovzc"}]: dispatch 2024-09-13T03:02:24.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:23 smithi089 ceph-mon[91553]: mds.? [v2:172.21.15.131:6826/2680433683,v1:172.21.15.131:6827/2680433683] up:boot 2024-09-13T03:02:24.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:23 smithi089 ceph-mon[91553]: fsmap cephfs:1 {0=cephfs.smithi089.qjoitb=up:active} 3 up:standby 2024-09-13T03:02:24.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:23 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi131.rbovzc"}]: dispatch 2024-09-13T03:02:25.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:24 smithi089 ceph-mon[91553]: pgmap v212: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:02:25.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:24 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:02:25.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:24 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:02:25.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:24 smithi131 ceph-mon[78839]: pgmap v212: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:02:25.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:24 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:02:25.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:24 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:02:26.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:26 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:02:26.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:26 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:02:26.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:26 smithi131 ceph-mon[78839]: pgmap v213: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:02:26.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:26 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:02:26.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:26 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:02:26.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:26 smithi089 ceph-mon[91553]: pgmap v213: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:02:28.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:28 smithi131 ceph-mon[78839]: pgmap v214: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:02:28.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:28 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:02:28.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:28 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:02:28.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:28 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T03:02:28.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:28 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T03:02:28.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:28 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:02:28.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:28 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:02:28.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:28 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:28.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:28 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:28.936 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:28 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:28.936 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:28 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:28.936 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:28 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:28.936 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:28 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:02:28.936 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:28 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi089.qjoitb"}]: dispatch 2024-09-13T03:02:28.936 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:28 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi089.qjoitb"}]': finished 2024-09-13T03:02:28.936 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:28 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi089.rarddb"}]: dispatch 2024-09-13T03:02:28.936 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:28 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi089.rarddb"}]': finished 2024-09-13T03:02:28.937 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:28 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi131.rbovzc"}]: dispatch 2024-09-13T03:02:28.937 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:28 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi131.rbovzc"}]': finished 2024-09-13T03:02:28.937 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:28 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi131.uasrkg"}]: dispatch 2024-09-13T03:02:28.937 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:28 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi131.uasrkg"}]': finished 2024-09-13T03:02:28.937 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:28 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-09-13T03:02:29.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:28 smithi089 ceph-mon[91553]: pgmap v214: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:02:29.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:28 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:02:29.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:28 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:02:29.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:28 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T03:02:29.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:28 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T03:02:29.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:28 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:02:29.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:28 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:02:29.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:28 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:29.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:28 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:29.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:28 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:29.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:28 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:29.037 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:28 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:29.037 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:28 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:02:29.037 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:28 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi089.qjoitb"}]: dispatch 2024-09-13T03:02:29.037 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:28 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi089.qjoitb"}]': finished 2024-09-13T03:02:29.037 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:28 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi089.rarddb"}]: dispatch 2024-09-13T03:02:29.037 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:28 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi089.rarddb"}]': finished 2024-09-13T03:02:29.037 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:28 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi131.rbovzc"}]: dispatch 2024-09-13T03:02:29.037 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:28 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi131.rbovzc"}]': finished 2024-09-13T03:02:29.037 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:28 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi131.uasrkg"}]: dispatch 2024-09-13T03:02:29.037 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:28 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi131.uasrkg"}]': finished 2024-09-13T03:02:29.037 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:28 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-09-13T03:02:29.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:29 smithi131 ceph-mon[78839]: Upgrade: Setting container_image for all mds 2024-09-13T03:02:29.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:29 smithi131 ceph-mon[78839]: Upgrade: Scaling up filesystem cephfs max_mds to 2 2024-09-13T03:02:29.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:29 smithi131 ceph-mon[78839]: daemon mds.cephfs.smithi089.rarddb assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-13T03:02:29.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:29 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-09-13T03:02:29.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:29 smithi131 ceph-mon[78839]: fsmap cephfs:2 {0=cephfs.smithi089.qjoitb=up:active,1=cephfs.smithi089.rarddb=up:starting} 2 up:standby 2024-09-13T03:02:29.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:29 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:02:29.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:29 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]: dispatch 2024-09-13T03:02:29.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:29 smithi131 ceph-mon[78839]: daemon mds.cephfs.smithi089.rarddb is now active in filesystem cephfs as rank 1 2024-09-13T03:02:30.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:29 smithi089 ceph-mon[91553]: Upgrade: Setting container_image for all mds 2024-09-13T03:02:30.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:29 smithi089 ceph-mon[91553]: Upgrade: Scaling up filesystem cephfs max_mds to 2 2024-09-13T03:02:30.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:29 smithi089 ceph-mon[91553]: daemon mds.cephfs.smithi089.rarddb assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-13T03:02:30.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:29 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-09-13T03:02:30.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:29 smithi089 ceph-mon[91553]: fsmap cephfs:2 {0=cephfs.smithi089.qjoitb=up:active,1=cephfs.smithi089.rarddb=up:starting} 2 up:standby 2024-09-13T03:02:30.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:29 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:02:30.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:29 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]: dispatch 2024-09-13T03:02:30.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:29 smithi089 ceph-mon[91553]: daemon mds.cephfs.smithi089.rarddb is now active in filesystem cephfs as rank 1 2024-09-13T03:02:30.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:30 smithi131 ceph-mon[78839]: Upgrade: Enabling allow_standby_replay on filesystem cephfs 2024-09-13T03:02:30.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:30 smithi131 ceph-mon[78839]: pgmap v215: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:02:30.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:30 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]': finished 2024-09-13T03:02:30.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:30 smithi131 ceph-mon[78839]: mds.? [v2:172.21.15.89:6828/177758677,v1:172.21.15.89:6829/177758677] up:active 2024-09-13T03:02:30.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:30 smithi131 ceph-mon[78839]: fsmap cephfs:2 {0=cephfs.smithi089.qjoitb=up:active,1=cephfs.smithi089.rarddb=up:active} 2 up:standby 2024-09-13T03:02:30.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:30 smithi131 ceph-mon[78839]: fsmap cephfs:2 {0=cephfs.smithi089.qjoitb=up:active,1=cephfs.smithi089.rarddb=up:active} 2 up:standby-replay 2024-09-13T03:02:30.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:30 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:02:30.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:30 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:30.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:30 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:02:30.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:30 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:30.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:30 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:02:30.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:30 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:30.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:30 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:30.935 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:30 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:02:30.936 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:30 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:30.936 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:30 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:02:30.936 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:30 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:30.936 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:30 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:02:30.936 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:30 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:30.936 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:30 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:02:30.936 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:30 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:30.936 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:30 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:30.936 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:30 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:30.961 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:30 smithi089 ceph-mon[91553]: Upgrade: Enabling allow_standby_replay on filesystem cephfs 2024-09-13T03:02:30.961 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:30 smithi089 ceph-mon[91553]: pgmap v215: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail 2024-09-13T03:02:30.961 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:30 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "1"}]': finished 2024-09-13T03:02:30.961 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:30 smithi089 ceph-mon[91553]: mds.? [v2:172.21.15.89:6828/177758677,v1:172.21.15.89:6829/177758677] up:active 2024-09-13T03:02:30.961 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:30 smithi089 ceph-mon[91553]: fsmap cephfs:2 {0=cephfs.smithi089.qjoitb=up:active,1=cephfs.smithi089.rarddb=up:active} 2 up:standby 2024-09-13T03:02:30.961 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:30 smithi089 ceph-mon[91553]: fsmap cephfs:2 {0=cephfs.smithi089.qjoitb=up:active,1=cephfs.smithi089.rarddb=up:active} 2 up:standby-replay 2024-09-13T03:02:30.962 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:30 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:02:30.962 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:30 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:30.962 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:30 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:02:30.962 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:30 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:30.962 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:30 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:02:30.962 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:30 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:30.962 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:30 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:30.962 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:30 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:02:30.962 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:30 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:30.962 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:30 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:02:30.962 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:30 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:30.963 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:30 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:02:30.963 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:30 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:30.963 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:30 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:02:30.963 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:30 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:30.963 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:30 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:30.963 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:30 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:31.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:31 smithi131 ceph-mon[78839]: Upgrade: Setting container_image for all rgw 2024-09-13T03:02:31.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:31 smithi131 ceph-mon[78839]: Upgrade: Setting container_image for all rbd-mirror 2024-09-13T03:02:31.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:31 smithi131 ceph-mon[78839]: Upgrade: Setting container_image for all ceph-exporter 2024-09-13T03:02:31.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:31 smithi131 ceph-mon[78839]: Upgrade: Setting container_image for all iscsi 2024-09-13T03:02:31.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:31 smithi131 ceph-mon[78839]: Upgrade: Setting container_image for all nfs 2024-09-13T03:02:31.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:31 smithi131 ceph-mon[78839]: Upgrade: Setting container_image for all nvmeof 2024-09-13T03:02:32.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:31 smithi089 ceph-mon[91553]: Upgrade: Setting container_image for all rgw 2024-09-13T03:02:32.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:31 smithi089 ceph-mon[91553]: Upgrade: Setting container_image for all rbd-mirror 2024-09-13T03:02:32.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:31 smithi089 ceph-mon[91553]: Upgrade: Setting container_image for all ceph-exporter 2024-09-13T03:02:32.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:31 smithi089 ceph-mon[91553]: Upgrade: Setting container_image for all iscsi 2024-09-13T03:02:32.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:31 smithi089 ceph-mon[91553]: Upgrade: Setting container_image for all nfs 2024-09-13T03:02:32.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:31 smithi089 ceph-mon[91553]: Upgrade: Setting container_image for all nvmeof 2024-09-13T03:02:32.933 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:32 smithi131 ceph-mon[78839]: pgmap v216: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.7 MiB/s rd, 85 B/s wr, 5 op/s 2024-09-13T03:02:33.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:32 smithi089 ceph-mon[91553]: pgmap v216: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.7 MiB/s rd, 85 B/s wr, 5 op/s 2024-09-13T03:02:33.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:33 smithi131 ceph-mon[78839]: Upgrade: Updating grafana.smithi089 2024-09-13T03:02:33.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:33 smithi131 ceph-mon[78839]: Deploying daemon grafana.smithi089 on smithi089 2024-09-13T03:02:34.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:33 smithi089 ceph-mon[91553]: Upgrade: Updating grafana.smithi089 2024-09-13T03:02:34.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:33 smithi089 ceph-mon[91553]: Deploying daemon grafana.smithi089 on smithi089 2024-09-13T03:02:35.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:34 smithi089 ceph-mon[91553]: pgmap v217: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 3.3 MiB/s rd, 85 B/s wr, 5 op/s 2024-09-13T03:02:35.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:34 smithi131 ceph-mon[78839]: pgmap v217: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 3.3 MiB/s rd, 85 B/s wr, 5 op/s 2024-09-13T03:02:36.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:35 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:02:36.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:35 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:02:37.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:36 smithi089 ceph-mon[91553]: pgmap v218: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 8.3 MiB/s rd, 170 B/s wr, 9 op/s 2024-09-13T03:02:37.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:36 smithi131 ceph-mon[78839]: pgmap v218: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 8.3 MiB/s rd, 170 B/s wr, 9 op/s 2024-09-13T03:02:39.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:38 smithi089 ceph-mon[91553]: pgmap v219: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 170 B/s wr, 11 op/s 2024-09-13T03:02:39.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:38 smithi131 ceph-mon[78839]: pgmap v219: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 170 B/s wr, 11 op/s 2024-09-13T03:02:40.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:40 smithi089 ceph-mon[91553]: pgmap v220: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 170 B/s wr, 12 op/s 2024-09-13T03:02:41.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:40 smithi131 ceph-mon[78839]: pgmap v220: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 170 B/s wr, 12 op/s 2024-09-13T03:02:42.962 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:42 smithi089 ceph-mon[91553]: pgmap v221: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 170 B/s wr, 13 op/s 2024-09-13T03:02:43.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:42 smithi131 ceph-mon[78839]: pgmap v221: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 14 MiB/s rd, 170 B/s wr, 13 op/s 2024-09-13T03:02:45.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:44 smithi089 ceph-mon[91553]: pgmap v222: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 85 B/s wr, 8 op/s 2024-09-13T03:02:45.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:44 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:02:45.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:44 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:02:45.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:44 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:02:45.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:44 smithi131 ceph-mon[78839]: pgmap v222: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 12 MiB/s rd, 85 B/s wr, 8 op/s 2024-09-13T03:02:45.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:44 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:02:45.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:44 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:02:45.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:44 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:02:47.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:46 smithi089 ceph-mon[91553]: pgmap v223: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 85 B/s wr, 8 op/s 2024-09-13T03:02:47.162 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.160+0000 7f9f3703f640 1 -- 172.21.15.89:0/597717506 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9f300fdbb0 msgr2=0x7f9f300fdfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:47.162 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.160+0000 7f9f3703f640 1 --2- 172.21.15.89:0/597717506 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9f300fdbb0 0x7f9f300fdfc0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f9f240048d0 tx=0x7f9f24009da0 comp rx=0 tx=0).stop 2024-09-13T03:02:47.162 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.160+0000 7f9f3703f640 1 -- 172.21.15.89:0/597717506 shutdown_connections 2024-09-13T03:02:47.162 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.160+0000 7f9f3703f640 1 --2- 172.21.15.89:0/597717506 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9f300fe500 0x7f9f300fa660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:47.162 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.160+0000 7f9f3703f640 1 --2- 172.21.15.89:0/597717506 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9f300fdbb0 0x7f9f300fdfc0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:47.162 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.160+0000 7f9f3703f640 1 -- 172.21.15.89:0/597717506 >> 172.21.15.89:0/597717506 conn(0x7f9f300f63b0 msgr2=0x7f9f300f87e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:02:47.163 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.160+0000 7f9f3703f640 1 -- 172.21.15.89:0/597717506 shutdown_connections 2024-09-13T03:02:47.163 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.161+0000 7f9f3703f640 1 -- 172.21.15.89:0/597717506 wait complete. 2024-09-13T03:02:47.164 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.161+0000 7f9f3703f640 1 Processor -- start 2024-09-13T03:02:47.164 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.161+0000 7f9f3703f640 1 -- start start 2024-09-13T03:02:47.164 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.162+0000 7f9f3703f640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9f300fdbb0 0x7f9f300fd3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:02:47.165 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.162+0000 7f9f3703f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9f300fe500 0x7f9f300fb890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:02:47.165 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.162+0000 7f9f3703f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f300fbeb0 con 0x7f9f300fe500 2024-09-13T03:02:47.165 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.162+0000 7f9f3703f640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f300fbff0 con 0x7f9f300fdbb0 2024-09-13T03:02:47.165 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.162+0000 7f9f2ffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9f300fe500 0x7f9f300fb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:02:47.165 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.162+0000 7f9f2ffff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9f300fe500 0x7f9f300fb890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:46860/0 (socket says 172.21.15.89:46860) 2024-09-13T03:02:47.165 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.162+0000 7f9f2ffff640 1 -- 172.21.15.89:0/2939178993 learned_addr learned my addr 172.21.15.89:0/2939178993 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T03:02:47.165 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.162+0000 7f9f34ddb640 1 --2- 172.21.15.89:0/2939178993 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9f300fdbb0 0x7f9f300fd3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:02:47.165 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.162+0000 7f9f2ffff640 1 -- 172.21.15.89:0/2939178993 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9f300fdbb0 msgr2=0x7f9f300fd3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:47.165 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.162+0000 7f9f2ffff640 1 --2- 172.21.15.89:0/2939178993 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9f300fdbb0 0x7f9f300fd3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:47.165 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.162+0000 7f9f2ffff640 1 -- 172.21.15.89:0/2939178993 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f24005040 con 0x7f9f300fe500 2024-09-13T03:02:47.165 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.163+0000 7f9f2ffff640 1 --2- 172.21.15.89:0/2939178993 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9f300fe500 0x7f9f300fb890 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c00b580 tx=0x7f9f1c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:02:47.165 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.163+0000 7f9f2d7fa640 1 -- 172.21.15.89:0/2939178993 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f1c00f6f0 con 0x7f9f300fe500 2024-09-13T03:02:47.165 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.163+0000 7f9f2d7fa640 1 -- 172.21.15.89:0/2939178993 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f9f1c00fcf0 con 0x7f9f300fe500 2024-09-13T03:02:47.166 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.163+0000 7f9f3703f640 1 -- 172.21.15.89:0/2939178993 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f300fc2d0 con 0x7f9f300fe500 2024-09-13T03:02:47.166 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.163+0000 7f9f2d7fa640 1 -- 172.21.15.89:0/2939178993 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9f1c0103a0 con 0x7f9f300fe500 2024-09-13T03:02:47.166 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.163+0000 7f9f3703f640 1 -- 172.21.15.89:0/2939178993 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f30115150 con 0x7f9f300fe500 2024-09-13T03:02:47.166 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.164+0000 7f9f3703f640 1 -- 172.21.15.89:0/2939178993 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f300fa050 con 0x7f9f300fe500 2024-09-13T03:02:47.166 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.165+0000 7f9f2d7fa640 1 -- 172.21.15.89:0/2939178993 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f9f1c0116b0 con 0x7f9f300fe500 2024-09-13T03:02:47.167 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.165+0000 7f9f2d7fa640 1 --2- 172.21.15.89:0/2939178993 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f9f2006e530 0x7f9f200709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:02:47.167 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.165+0000 7f9f2d7fa640 1 -- 172.21.15.89:0/2939178993 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f9f1c08e030 con 0x7f9f300fe500 2024-09-13T03:02:47.167 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.166+0000 7f9f34ddb640 1 --2- 172.21.15.89:0/2939178993 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f9f2006e530 0x7f9f200709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:02:47.167 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.166+0000 7f9f34ddb640 1 --2- 172.21.15.89:0/2939178993 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f9f2006e530 0x7f9f200709e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9f24000c00 tx=0x7f9f24035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:02:47.171 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.170+0000 7f9f2d7fa640 1 -- 172.21.15.89:0/2939178993 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f9f1c05ac70 con 0x7f9f300fe500 2024-09-13T03:02:47.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:46 smithi131 ceph-mon[78839]: pgmap v223: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 11 MiB/s rd, 85 B/s wr, 8 op/s 2024-09-13T03:02:47.359 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.358+0000 7f9f3703f640 1 -- 172.21.15.89:0/2939178993 --> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9f30101d50 con 0x7f9f2006e530 2024-09-13T03:02:47.360 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.359+0000 7f9f2d7fa640 1 -- 172.21.15.89:0/2939178993 <== mgr.34104 v2:172.21.15.89:6800/1881577856 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+435 (secure 0 0 0) 0x7f9f30101d50 con 0x7f9f2006e530 2024-09-13T03:02:47.362 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.361+0000 7f9f3703f640 1 -- 172.21.15.89:0/2939178993 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f9f2006e530 msgr2=0x7f9f200709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:47.362 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.361+0000 7f9f3703f640 1 --2- 172.21.15.89:0/2939178993 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f9f2006e530 0x7f9f200709e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9f24000c00 tx=0x7f9f24035040 comp rx=0 tx=0).stop 2024-09-13T03:02:47.363 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.361+0000 7f9f3703f640 1 -- 172.21.15.89:0/2939178993 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9f300fe500 msgr2=0x7f9f300fb890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:47.363 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.361+0000 7f9f3703f640 1 --2- 172.21.15.89:0/2939178993 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9f300fe500 0x7f9f300fb890 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9f1c00b580 tx=0x7f9f1c0091a0 comp rx=0 tx=0).stop 2024-09-13T03:02:47.363 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.361+0000 7f9f3703f640 1 -- 172.21.15.89:0/2939178993 shutdown_connections 2024-09-13T03:02:47.363 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.361+0000 7f9f3703f640 1 --2- 172.21.15.89:0/2939178993 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f9f2006e530 0x7f9f200709e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:47.363 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.361+0000 7f9f3703f640 1 --2- 172.21.15.89:0/2939178993 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9f300fe500 0x7f9f300fb890 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:47.363 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.361+0000 7f9f3703f640 1 --2- 172.21.15.89:0/2939178993 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9f300fdbb0 0x7f9f300fd3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:47.363 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.361+0000 7f9f3703f640 1 -- 172.21.15.89:0/2939178993 >> 172.21.15.89:0/2939178993 conn(0x7f9f300f63b0 msgr2=0x7f9f300f7b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:02:47.363 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.361+0000 7f9f3703f640 1 -- 172.21.15.89:0/2939178993 shutdown_connections 2024-09-13T03:02:47.363 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.361+0000 7f9f3703f640 1 -- 172.21.15.89:0/2939178993 wait complete. 2024-09-13T03:02:47.371 INFO:teuthology.orchestra.run.smithi089.stdout:true 2024-09-13T03:02:47.444 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.441+0000 7f525efc8640 1 -- 172.21.15.89:0/4080820819 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f52580fc720 msgr2=0x7f52580fcb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:47.444 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.441+0000 7f525efc8640 1 --2- 172.21.15.89:0/4080820819 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f52580fc720 0x7f52580fcb90 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5248009c50 tx=0x7f5248004d10 comp rx=0 tx=0).stop 2024-09-13T03:02:47.444 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.441+0000 7f525efc8640 1 -- 172.21.15.89:0/4080820819 shutdown_connections 2024-09-13T03:02:47.444 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.441+0000 7f525efc8640 1 --2- 172.21.15.89:0/4080820819 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f52580fc720 0x7f52580fcb90 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:47.444 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.441+0000 7f525efc8640 1 --2- 172.21.15.89:0/4080820819 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f52580fb450 0x7f52580fb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:47.444 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.441+0000 7f525efc8640 1 -- 172.21.15.89:0/4080820819 >> 172.21.15.89:0/4080820819 conn(0x7f52580f6c10 msgr2=0x7f52580f9040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:02:47.444 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.441+0000 7f525efc8640 1 -- 172.21.15.89:0/4080820819 shutdown_connections 2024-09-13T03:02:47.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.441+0000 7f525efc8640 1 -- 172.21.15.89:0/4080820819 wait complete. 2024-09-13T03:02:47.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.441+0000 7f525efc8640 1 Processor -- start 2024-09-13T03:02:47.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.441+0000 7f525efc8640 1 -- start start 2024-09-13T03:02:47.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.442+0000 7f525efc8640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f52580fb450 0x7f525810bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:02:47.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.442+0000 7f525efc8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f52580fc720 0x7f525810c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:02:47.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.442+0000 7f525efc8640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f525810cb50 con 0x7f52580fc720 2024-09-13T03:02:47.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.442+0000 7f525efc8640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f525810d370 con 0x7f52580fb450 2024-09-13T03:02:47.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.442+0000 7f5257fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f52580fc720 0x7f525810c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:02:47.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.442+0000 7f5257fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f52580fc720 0x7f525810c500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:46882/0 (socket says 172.21.15.89:46882) 2024-09-13T03:02:47.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.442+0000 7f5257fff640 1 -- 172.21.15.89:0/3732913024 learned_addr learned my addr 172.21.15.89:0/3732913024 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T03:02:47.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.442+0000 7f525cd64640 1 --2- 172.21.15.89:0/3732913024 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f52580fb450 0x7f525810bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:02:47.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.442+0000 7f5257fff640 1 -- 172.21.15.89:0/3732913024 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f52580fb450 msgr2=0x7f525810bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:47.445 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.442+0000 7f5257fff640 1 --2- 172.21.15.89:0/3732913024 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f52580fb450 0x7f525810bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:47.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.442+0000 7f5257fff640 1 -- 172.21.15.89:0/3732913024 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52480098b0 con 0x7f52580fc720 2024-09-13T03:02:47.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.442+0000 7f525cd64640 1 --2- 172.21.15.89:0/3732913024 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f52580fb450 0x7f525810bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T03:02:47.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.442+0000 7f5257fff640 1 --2- 172.21.15.89:0/3732913024 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f52580fc720 0x7f525810c500 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5248004750 tx=0x7f5248004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:02:47.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.442+0000 7f52557fa640 1 -- 172.21.15.89:0/3732913024 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5248009710 con 0x7f52580fc720 2024-09-13T03:02:47.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.442+0000 7f52557fa640 1 -- 172.21.15.89:0/3732913024 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f5248032b10 con 0x7f52580fc720 2024-09-13T03:02:47.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.442+0000 7f525efc8640 1 -- 172.21.15.89:0/3732913024 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f525810d5a0 con 0x7f52580fc720 2024-09-13T03:02:47.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.442+0000 7f52557fa640 1 -- 172.21.15.89:0/3732913024 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5248044ac0 con 0x7f52580fc720 2024-09-13T03:02:47.446 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.443+0000 7f525efc8640 1 -- 172.21.15.89:0/3732913024 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f525810da60 con 0x7f52580fc720 2024-09-13T03:02:47.447 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.444+0000 7f525efc8640 1 -- 172.21.15.89:0/3732913024 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52580fa8b0 con 0x7f52580fc720 2024-09-13T03:02:47.447 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.444+0000 7f52557fa640 1 -- 172.21.15.89:0/3732913024 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f524802f030 con 0x7f52580fc720 2024-09-13T03:02:47.447 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.444+0000 7f52557fa640 1 --2- 172.21.15.89:0/3732913024 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f524406e530 0x7f52440709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:02:47.447 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.444+0000 7f52557fa640 1 -- 172.21.15.89:0/3732913024 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f52480b14b0 con 0x7f52580fc720 2024-09-13T03:02:47.447 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.444+0000 7f525cd64640 1 --2- 172.21.15.89:0/3732913024 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f524406e530 0x7f52440709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:02:47.447 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.445+0000 7f525cd64640 1 --2- 172.21.15.89:0/3732913024 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f524406e530 0x7f52440709e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5240009af0 tx=0x7f524000b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:02:47.450 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.449+0000 7f52557fa640 1 -- 172.21.15.89:0/3732913024 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f524807a540 con 0x7f52580fc720 2024-09-13T03:02:47.642 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.641+0000 7f525efc8640 1 -- 172.21.15.89:0/3732913024 --> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f525810dd90 con 0x7f524406e530 2024-09-13T03:02:47.643 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.642+0000 7f52557fa640 1 -- 172.21.15.89:0/3732913024 <== mgr.34104 v2:172.21.15.89:6800/1881577856 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+435 (secure 0 0 0) 0x7f525810dd90 con 0x7f524406e530 2024-09-13T03:02:47.646 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.644+0000 7f525efc8640 1 -- 172.21.15.89:0/3732913024 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f524406e530 msgr2=0x7f52440709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:47.646 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.644+0000 7f525efc8640 1 --2- 172.21.15.89:0/3732913024 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f524406e530 0x7f52440709e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f5240009af0 tx=0x7f524000b040 comp rx=0 tx=0).stop 2024-09-13T03:02:47.646 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.644+0000 7f525efc8640 1 -- 172.21.15.89:0/3732913024 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f52580fc720 msgr2=0x7f525810c500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:47.646 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.644+0000 7f525efc8640 1 --2- 172.21.15.89:0/3732913024 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f52580fc720 0x7f525810c500 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f5248004750 tx=0x7f5248004d10 comp rx=0 tx=0).stop 2024-09-13T03:02:47.646 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.644+0000 7f525efc8640 1 -- 172.21.15.89:0/3732913024 shutdown_connections 2024-09-13T03:02:47.646 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.644+0000 7f525efc8640 1 --2- 172.21.15.89:0/3732913024 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f524406e530 0x7f52440709e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:47.646 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.644+0000 7f525efc8640 1 --2- 172.21.15.89:0/3732913024 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f52580fc720 0x7f525810c500 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:47.646 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.644+0000 7f525efc8640 1 --2- 172.21.15.89:0/3732913024 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f52580fb450 0x7f525810bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:47.646 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.644+0000 7f525efc8640 1 -- 172.21.15.89:0/3732913024 >> 172.21.15.89:0/3732913024 conn(0x7f52580f6c10 msgr2=0x7f52580f8410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:02:47.646 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.644+0000 7f525efc8640 1 -- 172.21.15.89:0/3732913024 shutdown_connections 2024-09-13T03:02:47.647 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.644+0000 7f525efc8640 1 -- 172.21.15.89:0/3732913024 wait complete. 2024-09-13T03:02:47.725 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.723+0000 7f87c1168640 1 -- 172.21.15.89:0/1589090069 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f87bc065bc0 msgr2=0x7f87bc0ff1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:47.725 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.723+0000 7f87c1168640 1 --2- 172.21.15.89:0/1589090069 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f87bc065bc0 0x7f87bc0ff1c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f87b40048d0 tx=0x7f87b4009da0 comp rx=0 tx=0).stop 2024-09-13T03:02:47.725 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.723+0000 7f87c1168640 1 -- 172.21.15.89:0/1589090069 shutdown_connections 2024-09-13T03:02:47.725 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.723+0000 7f87c1168640 1 --2- 172.21.15.89:0/1589090069 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f87bc0ff700 0x7f87bc101ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:47.725 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.723+0000 7f87c1168640 1 --2- 172.21.15.89:0/1589090069 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f87bc065bc0 0x7f87bc0ff1c0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:47.726 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.723+0000 7f87c1168640 1 -- 172.21.15.89:0/1589090069 >> 172.21.15.89:0/1589090069 conn(0x7f87bc0f6c10 msgr2=0x7f87bc0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:02:47.726 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.723+0000 7f87c1168640 1 -- 172.21.15.89:0/1589090069 shutdown_connections 2024-09-13T03:02:47.726 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.723+0000 7f87c1168640 1 -- 172.21.15.89:0/1589090069 wait complete. 2024-09-13T03:02:47.726 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.724+0000 7f87c1168640 1 Processor -- start 2024-09-13T03:02:47.726 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.724+0000 7f87c1168640 1 -- start start 2024-09-13T03:02:47.727 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.724+0000 7f87c1168640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f87bc065bc0 0x7f87bc10d160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:02:47.727 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.724+0000 7f87c1168640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f87bc0ff700 0x7f87bc10d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:02:47.728 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.724+0000 7f87c1168640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87bc10e450 con 0x7f87bc065bc0 2024-09-13T03:02:47.728 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.724+0000 7f87c1168640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87bc10e5c0 con 0x7f87bc0ff700 2024-09-13T03:02:47.728 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.724+0000 7f87bad9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f87bc065bc0 0x7f87bc10d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:02:47.728 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.724+0000 7f87bad9d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f87bc065bc0 0x7f87bc10d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:46896/0 (socket says 172.21.15.89:46896) 2024-09-13T03:02:47.728 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.724+0000 7f87bad9d640 1 -- 172.21.15.89:0/2303094477 learned_addr learned my addr 172.21.15.89:0/2303094477 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T03:02:47.728 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.725+0000 7f87ba59c640 1 --2- 172.21.15.89:0/2303094477 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f87bc0ff700 0x7f87bc10d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:02:47.728 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.725+0000 7f87bad9d640 1 -- 172.21.15.89:0/2303094477 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f87bc0ff700 msgr2=0x7f87bc10d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:47.728 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.725+0000 7f87bad9d640 1 --2- 172.21.15.89:0/2303094477 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f87bc0ff700 0x7f87bc10d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:47.728 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.725+0000 7f87bad9d640 1 -- 172.21.15.89:0/2303094477 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87b4005040 con 0x7f87bc065bc0 2024-09-13T03:02:47.728 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.725+0000 7f87bad9d640 1 --2- 172.21.15.89:0/2303094477 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f87bc065bc0 0x7f87bc10d160 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f87b40048a0 tx=0x7f87b4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:02:47.728 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.725+0000 7f87b37fe640 1 -- 172.21.15.89:0/2303094477 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f87b4038070 con 0x7f87bc065bc0 2024-09-13T03:02:47.728 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.725+0000 7f87c1168640 1 -- 172.21.15.89:0/2303094477 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87bc10e840 con 0x7f87bc065bc0 2024-09-13T03:02:47.728 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.725+0000 7f87b37fe640 1 -- 172.21.15.89:0/2303094477 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f87b402abd0 con 0x7f87bc065bc0 2024-09-13T03:02:47.729 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.725+0000 7f87b37fe640 1 -- 172.21.15.89:0/2303094477 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f87b4033640 con 0x7f87bc065bc0 2024-09-13T03:02:47.729 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.725+0000 7f87c1168640 1 -- 172.21.15.89:0/2303094477 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87bc10ed60 con 0x7f87bc065bc0 2024-09-13T03:02:47.729 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.726+0000 7f87c1168640 1 -- 172.21.15.89:0/2303094477 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87bc1057f0 con 0x7f87bc065bc0 2024-09-13T03:02:47.729 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.727+0000 7f87b37fe640 1 -- 172.21.15.89:0/2303094477 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f87b4030020 con 0x7f87bc065bc0 2024-09-13T03:02:47.729 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.727+0000 7f87b37fe640 1 --2- 172.21.15.89:0/2303094477 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f87a806e530 0x7f87a80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:02:47.730 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.727+0000 7f87b37fe640 1 -- 172.21.15.89:0/2303094477 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f87b40ae580 con 0x7f87bc065bc0 2024-09-13T03:02:47.730 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.727+0000 7f87ba59c640 1 --2- 172.21.15.89:0/2303094477 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f87a806e530 0x7f87a80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:02:47.730 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.727+0000 7f87ba59c640 1 --2- 172.21.15.89:0/2303094477 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f87a806e530 0x7f87a80709e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f87a4006fd0 tx=0x7f87a4008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:02:47.733 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.732+0000 7f87b37fe640 1 -- 172.21.15.89:0/2303094477 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f87b4077610 con 0x7f87bc065bc0 2024-09-13T03:02:47.910 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.908+0000 7f87c1168640 1 -- 172.21.15.89:0/2303094477 --> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f87bc10ef80 con 0x7f87a806e530 2024-09-13T03:02:47.919 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.917+0000 7f87b37fe640 1 -- 172.21.15.89:0/2303094477 <== mgr.34104 v2:172.21.15.89:6800/1881577856 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7f87bc10ef80 con 0x7f87a806e530 2024-09-13T03:02:47.919 INFO:teuthology.orchestra.run.smithi089.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T03:02:47.919 INFO:teuthology.orchestra.run.smithi089.stdout:alertmanager.smithi089 smithi089 *:9093,9094 running (7m) 50s ago 16m 24.1M - 0.25.0 c8568f914cd2 1d2432f5479e 2024-09-13T03:02:47.919 INFO:teuthology.orchestra.run.smithi089.stdout:crash.smithi089 smithi089 running (5m) 50s ago 16m 6891k - 19.1.1-322-g7741f7f9 19dc8d659727 0ef15ca3e7f9 2024-09-13T03:02:47.919 INFO:teuthology.orchestra.run.smithi089.stdout:crash.smithi131 smithi131 running (5m) 23s ago 15m 6895k - 19.1.1-322-g7741f7f9 19dc8d659727 21e4d6fc04f7 2024-09-13T03:02:47.919 INFO:teuthology.orchestra.run.smithi089.stdout:grafana.smithi089 smithi089 *:3000 starting - - - - 2024-09-13T03:02:47.919 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi089.qjoitb smithi089 running (82s) 50s ago 11m 69.9M - 19.1.1-322-g7741f7f9 19dc8d659727 e79bfdab021a 2024-09-13T03:02:47.919 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi089.rarddb smithi089 running (59s) 50s ago 10m 11.0M - 19.1.1-322-g7741f7f9 19dc8d659727 40413b0e466c 2024-09-13T03:02:47.920 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi131.rbovzc smithi131 running (25s) 23s ago 10m 12.9M - 19.1.1-322-g7741f7f9 19dc8d659727 3461afdce9c5 2024-09-13T03:02:47.920 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi131.uasrkg smithi131 running (41s) 23s ago 10m 12.2M - 19.1.1-322-g7741f7f9 19dc8d659727 95f4ff9e971a 2024-09-13T03:02:47.920 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.smithi089.guohvs smithi089 *:8443,9283,8765 running (7m) 50s ago 17m 505M - 19.1.1-322-g7741f7f9 19dc8d659727 1e887446f1b0 2024-09-13T03:02:47.920 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.smithi131.aunbqd smithi131 *:8443,9283,8765 running (6m) 23s ago 15m 441M - 19.1.1-322-g7741f7f9 19dc8d659727 358d7478f2ba 2024-09-13T03:02:47.920 INFO:teuthology.orchestra.run.smithi089.stdout:mon.smithi089 smithi089 running (6m) 50s ago 17m 51.4M 2048M 19.1.1-322-g7741f7f9 19dc8d659727 8a29fb65028f 2024-09-13T03:02:47.920 INFO:teuthology.orchestra.run.smithi089.stdout:mon.smithi131 smithi131 running (6m) 23s ago 15m 41.9M 2048M 19.1.1-322-g7741f7f9 19dc8d659727 506310ad8620 2024-09-13T03:02:47.920 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.smithi089 smithi089 *:9100 running (7m) 50s ago 16m 16.8M - 1.5.0 0da6a335fe13 5a9927b583e6 2024-09-13T03:02:47.920 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.smithi131 smithi131 *:9100 running (7m) 23s ago 15m 15.5M - 1.5.0 0da6a335fe13 bcfde5d1a508 2024-09-13T03:02:47.920 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0 smithi089 running (5m) 50s ago 14m 105M 1557M 19.1.1-322-g7741f7f9 19dc8d659727 e8038f6d52b6 2024-09-13T03:02:47.920 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1 smithi089 running (4m) 50s ago 14m 107M 1557M 19.1.1-322-g7741f7f9 19dc8d659727 e174144d9633 2024-09-13T03:02:47.920 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2 smithi089 running (3m) 50s ago 13m 96.0M 1557M 19.1.1-322-g7741f7f9 19dc8d659727 2d8cab08c2b3 2024-09-13T03:02:47.920 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3 smithi131 running (3m) 23s ago 13m 116M 2581M 19.1.1-322-g7741f7f9 19dc8d659727 e77cff624869 2024-09-13T03:02:47.920 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4 smithi131 running (2m) 23s ago 12m 104M 2581M 19.1.1-322-g7741f7f9 19dc8d659727 0317e6a4a04c 2024-09-13T03:02:47.920 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5 smithi131 running (2m) 23s ago 12m 91.3M 2581M 19.1.1-322-g7741f7f9 19dc8d659727 e7d2a780f4e0 2024-09-13T03:02:47.921 INFO:teuthology.orchestra.run.smithi089.stdout:prometheus.smithi089 smithi089 *:9095 running (6m) 50s ago 15m 67.5M - 2.43.0 a07b618ecd1d 9d336370c187 2024-09-13T03:02:47.921 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.920+0000 7f87c1168640 1 -- 172.21.15.89:0/2303094477 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f87a806e530 msgr2=0x7f87a80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:47.921 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.920+0000 7f87c1168640 1 --2- 172.21.15.89:0/2303094477 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f87a806e530 0x7f87a80709e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f87a4006fd0 tx=0x7f87a4008040 comp rx=0 tx=0).stop 2024-09-13T03:02:47.921 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.920+0000 7f87c1168640 1 -- 172.21.15.89:0/2303094477 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f87bc065bc0 msgr2=0x7f87bc10d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:47.922 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.920+0000 7f87c1168640 1 --2- 172.21.15.89:0/2303094477 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f87bc065bc0 0x7f87bc10d160 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f87b40048a0 tx=0x7f87b4009da0 comp rx=0 tx=0).stop 2024-09-13T03:02:47.922 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.920+0000 7f87c1168640 1 -- 172.21.15.89:0/2303094477 shutdown_connections 2024-09-13T03:02:47.922 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.920+0000 7f87c1168640 1 --2- 172.21.15.89:0/2303094477 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f87a806e530 0x7f87a80709e0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:47.922 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.920+0000 7f87c1168640 1 --2- 172.21.15.89:0/2303094477 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f87bc0ff700 0x7f87bc10d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:47.922 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.920+0000 7f87c1168640 1 --2- 172.21.15.89:0/2303094477 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f87bc065bc0 0x7f87bc10d160 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:47.922 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.920+0000 7f87c1168640 1 -- 172.21.15.89:0/2303094477 >> 172.21.15.89:0/2303094477 conn(0x7f87bc0f6c10 msgr2=0x7f87bc0f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:02:47.922 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.920+0000 7f87c1168640 1 -- 172.21.15.89:0/2303094477 shutdown_connections 2024-09-13T03:02:47.922 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:47.920+0000 7f87c1168640 1 -- 172.21.15.89:0/2303094477 wait complete. 2024-09-13T03:02:48.005 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.003+0000 7fb604256640 1 -- 172.21.15.89:0/437462280 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb5fc0fc540 msgr2=0x7fb5fc0fc950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:48.005 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.003+0000 7fb604256640 1 --2- 172.21.15.89:0/437462280 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb5fc0fc540 0x7fb5fc0fc950 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec0048d0 tx=0x7fb5ec009da0 comp rx=0 tx=0).stop 2024-09-13T03:02:48.005 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.003+0000 7fb604256640 1 -- 172.21.15.89:0/437462280 shutdown_connections 2024-09-13T03:02:48.005 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.003+0000 7fb604256640 1 --2- 172.21.15.89:0/437462280 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb5fc0fd810 0x7fb5fc0fdc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:48.006 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.003+0000 7fb604256640 1 --2- 172.21.15.89:0/437462280 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb5fc0fc540 0x7fb5fc0fc950 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:48.006 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.003+0000 7fb604256640 1 -- 172.21.15.89:0/437462280 >> 172.21.15.89:0/437462280 conn(0x7fb5fc0f7d00 msgr2=0x7fb5fc0fa130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:02:48.006 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.003+0000 7fb604256640 1 -- 172.21.15.89:0/437462280 shutdown_connections 2024-09-13T03:02:48.006 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.003+0000 7fb604256640 1 -- 172.21.15.89:0/437462280 wait complete. 2024-09-13T03:02:48.006 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.003+0000 7fb604256640 1 Processor -- start 2024-09-13T03:02:48.006 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.003+0000 7fb604256640 1 -- start start 2024-09-13T03:02:48.006 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.004+0000 7fb604256640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb5fc0fc540 0x7fb5fc071570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:02:48.006 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.004+0000 7fb604256640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb5fc0fd810 0x7fb5fc06fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:02:48.006 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.004+0000 7fb604256640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5fc06fff0 con 0x7fb5fc0fd810 2024-09-13T03:02:48.006 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.004+0000 7fb604256640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5fc070130 con 0x7fb5fc0fc540 2024-09-13T03:02:48.006 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.004+0000 7fb6017f1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb5fc0fd810 0x7fb5fc06fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:02:48.006 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.004+0000 7fb6017f1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb5fc0fd810 0x7fb5fc06fa60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:46908/0 (socket says 172.21.15.89:46908) 2024-09-13T03:02:48.006 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.004+0000 7fb6017f1640 1 -- 172.21.15.89:0/1585565743 learned_addr learned my addr 172.21.15.89:0/1585565743 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T03:02:48.006 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.004+0000 7fb601ff2640 1 --2- 172.21.15.89:0/1585565743 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb5fc0fc540 0x7fb5fc071570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:02:48.007 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.004+0000 7fb6017f1640 1 -- 172.21.15.89:0/1585565743 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb5fc0fc540 msgr2=0x7fb5fc071570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:48.007 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.004+0000 7fb6017f1640 1 --2- 172.21.15.89:0/1585565743 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb5fc0fc540 0x7fb5fc071570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:48.007 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.004+0000 7fb6017f1640 1 -- 172.21.15.89:0/1585565743 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5ec005040 con 0x7fb5fc0fd810 2024-09-13T03:02:48.008 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.004+0000 7fb6017f1640 1 --2- 172.21.15.89:0/1585565743 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb5fc0fd810 0x7fb5fc06fa60 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb5f800c810 tx=0x7fb5f80043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:02:48.008 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.004+0000 7fb5f27fc640 1 -- 172.21.15.89:0/1585565743 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb5f800a7a0 con 0x7fb5fc0fd810 2024-09-13T03:02:48.008 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.005+0000 7fb5f27fc640 1 -- 172.21.15.89:0/1585565743 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fb5f800ada0 con 0x7fb5fc0fd810 2024-09-13T03:02:48.008 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.005+0000 7fb604256640 1 -- 172.21.15.89:0/1585565743 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5fc070410 con 0x7fb5fc0fd810 2024-09-13T03:02:48.008 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.005+0000 7fb5f27fc640 1 -- 172.21.15.89:0/1585565743 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb5f8011380 con 0x7fb5fc0fd810 2024-09-13T03:02:48.008 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.005+0000 7fb604256640 1 -- 172.21.15.89:0/1585565743 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5fc1150a0 con 0x7fb5fc0fd810 2024-09-13T03:02:48.008 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.006+0000 7fb604256640 1 -- 172.21.15.89:0/1585565743 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5fc0fb9a0 con 0x7fb5fc0fd810 2024-09-13T03:02:48.008 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.006+0000 7fb5f27fc640 1 -- 172.21.15.89:0/1585565743 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fb5f80127d0 con 0x7fb5fc0fd810 2024-09-13T03:02:48.008 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.006+0000 7fb5f27fc640 1 --2- 172.21.15.89:0/1585565743 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fb5e806e530 0x7fb5e80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:02:48.008 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.007+0000 7fb5f27fc640 1 -- 172.21.15.89:0/1585565743 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fb5f808e640 con 0x7fb5fc0fd810 2024-09-13T03:02:48.008 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.007+0000 7fb601ff2640 1 --2- 172.21.15.89:0/1585565743 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fb5e806e530 0x7fb5e80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:02:48.009 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.007+0000 7fb601ff2640 1 --2- 172.21.15.89:0/1585565743 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fb5e806e530 0x7fb5e80709e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec000c00 tx=0x7fb5ec035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:02:48.012 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.011+0000 7fb5f27fc640 1 -- 172.21.15.89:0/1585565743 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fb5f805b280 con 0x7fb5fc0fd810 2024-09-13T03:02:48.276 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.274+0000 7fb604256640 1 -- 172.21.15.89:0/1585565743 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb5fc04b720 con 0x7fb5fc0fd810 2024-09-13T03:02:48.276 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.275+0000 7fb5f27fc640 1 -- 172.21.15.89:0/1585565743 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7fb5f805ae10 con 0x7fb5fc0fd810 2024-09-13T03:02:48.277 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-13T03:02:48.277 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": { 2024-09-13T03:02:48.277 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 2 2024-09-13T03:02:48.277 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T03:02:48.277 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": { 2024-09-13T03:02:48.277 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 2 2024-09-13T03:02:48.277 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T03:02:48.277 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": { 2024-09-13T03:02:48.277 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 6 2024-09-13T03:02:48.277 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T03:02:48.277 INFO:teuthology.orchestra.run.smithi089.stdout: "mds": { 2024-09-13T03:02:48.277 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 4 2024-09-13T03:02:48.278 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T03:02:48.278 INFO:teuthology.orchestra.run.smithi089.stdout: "overall": { 2024-09-13T03:02:48.278 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 14 2024-09-13T03:02:48.278 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-13T03:02:48.278 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-13T03:02:48.279 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.277+0000 7fb604256640 1 -- 172.21.15.89:0/1585565743 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fb5e806e530 msgr2=0x7fb5e80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:48.279 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.277+0000 7fb604256640 1 --2- 172.21.15.89:0/1585565743 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fb5e806e530 0x7fb5e80709e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fb5ec000c00 tx=0x7fb5ec035040 comp rx=0 tx=0).stop 2024-09-13T03:02:48.279 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.278+0000 7fb604256640 1 -- 172.21.15.89:0/1585565743 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb5fc0fd810 msgr2=0x7fb5fc06fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:48.279 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.278+0000 7fb604256640 1 --2- 172.21.15.89:0/1585565743 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb5fc0fd810 0x7fb5fc06fa60 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fb5f800c810 tx=0x7fb5f80043c0 comp rx=0 tx=0).stop 2024-09-13T03:02:48.279 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.278+0000 7fb604256640 1 -- 172.21.15.89:0/1585565743 shutdown_connections 2024-09-13T03:02:48.279 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.278+0000 7fb604256640 1 --2- 172.21.15.89:0/1585565743 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fb5e806e530 0x7fb5e80709e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:48.279 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.278+0000 7fb604256640 1 --2- 172.21.15.89:0/1585565743 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fb5fc0fd810 0x7fb5fc06fa60 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:48.280 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.278+0000 7fb604256640 1 --2- 172.21.15.89:0/1585565743 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fb5fc0fc540 0x7fb5fc071570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:48.280 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.278+0000 7fb604256640 1 -- 172.21.15.89:0/1585565743 >> 172.21.15.89:0/1585565743 conn(0x7fb5fc0f7d00 msgr2=0x7fb5fc0f94e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:02:48.280 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.278+0000 7fb604256640 1 -- 172.21.15.89:0/1585565743 shutdown_connections 2024-09-13T03:02:48.280 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.278+0000 7fb604256640 1 -- 172.21.15.89:0/1585565743 wait complete. 2024-09-13T03:02:48.360 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.358+0000 7f08f1617640 1 -- 172.21.15.89:0/4250217366 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f08ec0fc700 msgr2=0x7f08ec0fcb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:48.360 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.358+0000 7f08f1617640 1 --2- 172.21.15.89:0/4250217366 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f08ec0fc700 0x7f08ec0fcb70 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f08e00048d0 tx=0x7f08e0009da0 comp rx=0 tx=0).stop 2024-09-13T03:02:48.360 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.358+0000 7f08f1617640 1 -- 172.21.15.89:0/4250217366 shutdown_connections 2024-09-13T03:02:48.360 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.358+0000 7f08f1617640 1 --2- 172.21.15.89:0/4250217366 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f08ec0fc700 0x7f08ec0fcb70 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:48.361 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.358+0000 7f08f1617640 1 --2- 172.21.15.89:0/4250217366 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f08ec0fb430 0x7f08ec0fb840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:48.361 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.358+0000 7f08f1617640 1 -- 172.21.15.89:0/4250217366 >> 172.21.15.89:0/4250217366 conn(0x7f08ec0f6c10 msgr2=0x7f08ec0f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:02:48.361 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.358+0000 7f08f1617640 1 -- 172.21.15.89:0/4250217366 shutdown_connections 2024-09-13T03:02:48.361 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.358+0000 7f08f1617640 1 -- 172.21.15.89:0/4250217366 wait complete. 2024-09-13T03:02:48.361 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.359+0000 7f08f1617640 1 Processor -- start 2024-09-13T03:02:48.361 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.359+0000 7f08f1617640 1 -- start start 2024-09-13T03:02:48.363 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.359+0000 7f08f1617640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f08ec0fb430 0x7f08ec10bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:02:48.364 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.359+0000 7f08f1617640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f08ec0fc700 0x7f08ec10c500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:02:48.364 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.359+0000 7f08f1617640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08ec10d370 con 0x7f08ec0fc700 2024-09-13T03:02:48.364 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.359+0000 7f08f1617640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08ec10d4e0 con 0x7f08ec0fb430 2024-09-13T03:02:48.364 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.359+0000 7f08ea7fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f08ec0fc700 0x7f08ec10c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:02:48.364 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.359+0000 7f08ea7fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f08ec0fc700 0x7f08ec10c500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:46932/0 (socket says 172.21.15.89:46932) 2024-09-13T03:02:48.364 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.359+0000 7f08ea7fc640 1 -- 172.21.15.89:0/3488816779 learned_addr learned my addr 172.21.15.89:0/3488816779 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T03:02:48.364 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.360+0000 7f08eaffd640 1 --2- 172.21.15.89:0/3488816779 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f08ec0fb430 0x7f08ec10bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:02:48.364 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.360+0000 7f08ea7fc640 1 -- 172.21.15.89:0/3488816779 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f08ec0fb430 msgr2=0x7f08ec10bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:48.364 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.360+0000 7f08ea7fc640 1 --2- 172.21.15.89:0/3488816779 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f08ec0fb430 0x7f08ec10bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:48.364 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.360+0000 7f08ea7fc640 1 -- 172.21.15.89:0/3488816779 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08e0005040 con 0x7f08ec0fc700 2024-09-13T03:02:48.364 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.360+0000 7f08eaffd640 1 --2- 172.21.15.89:0/3488816779 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f08ec0fb430 0x7f08ec10bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T03:02:48.365 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.360+0000 7f08ea7fc640 1 --2- 172.21.15.89:0/3488816779 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f08ec0fc700 0x7f08ec10c500 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f08e0003080 tx=0x7f08e0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:02:48.365 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.360+0000 7f08d37fe640 1 -- 172.21.15.89:0/3488816779 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f08e0038070 con 0x7f08ec0fc700 2024-09-13T03:02:48.365 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.360+0000 7f08d37fe640 1 -- 172.21.15.89:0/3488816779 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f08e002abd0 con 0x7f08ec0fc700 2024-09-13T03:02:48.365 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.360+0000 7f08f1617640 1 -- 172.21.15.89:0/3488816779 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08ec10d760 con 0x7f08ec0fc700 2024-09-13T03:02:48.365 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.360+0000 7f08d37fe640 1 -- 172.21.15.89:0/3488816779 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f08e003e670 con 0x7f08ec0fc700 2024-09-13T03:02:48.365 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.360+0000 7f08f1617640 1 -- 172.21.15.89:0/3488816779 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08ec10dc80 con 0x7f08ec0fc700 2024-09-13T03:02:48.365 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.361+0000 7f08f1617640 1 -- 172.21.15.89:0/3488816779 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08ec0fa890 con 0x7f08ec0fc700 2024-09-13T03:02:48.365 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.362+0000 7f08d37fe640 1 -- 172.21.15.89:0/3488816779 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f08e0030020 con 0x7f08ec0fc700 2024-09-13T03:02:48.365 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.362+0000 7f08d37fe640 1 --2- 172.21.15.89:0/3488816779 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f08d406e530 0x7f08d40709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:02:48.365 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.362+0000 7f08d37fe640 1 -- 172.21.15.89:0/3488816779 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f08e00ae5b0 con 0x7f08ec0fc700 2024-09-13T03:02:48.365 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.362+0000 7f08eaffd640 1 --2- 172.21.15.89:0/3488816779 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f08d406e530 0x7f08d40709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:02:48.366 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.363+0000 7f08eaffd640 1 --2- 172.21.15.89:0/3488816779 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f08d406e530 0x7f08d40709e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f08dc009a80 tx=0x7f08dc008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:02:48.368 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.367+0000 7f08d37fe640 1 -- 172.21.15.89:0/3488816779 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f08e0077640 con 0x7f08ec0fc700 2024-09-13T03:02:48.584 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.583+0000 7f08f1617640 1 -- 172.21.15.89:0/3488816779 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f08ec04b720 con 0x7f08ec0fc700 2024-09-13T03:02:48.584 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.583+0000 7f08d37fe640 1 -- 172.21.15.89:0/3488816779 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 43 v43) v1 ==== 76+0+2004 (secure 0 0 0) 0x7f08e007ad00 con 0x7f08ec0fc700 2024-09-13T03:02:48.585 INFO:teuthology.orchestra.run.smithi089.stdout:e43 2024-09-13T03:02:48.585 INFO:teuthology.orchestra.run.smithi089.stdout:btime 2024-09-13T03:02:30:387200+0000 2024-09-13T03:02:48.585 INFO:teuthology.orchestra.run.smithi089.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T03:02:48.585 INFO:teuthology.orchestra.run.smithi089.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T03:02:48.585 INFO:teuthology.orchestra.run.smithi089.stdout:legacy client fscid: 1 2024-09-13T03:02:48.585 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T03:02:48.585 INFO:teuthology.orchestra.run.smithi089.stdout:Filesystem 'cephfs' (1) 2024-09-13T03:02:48.585 INFO:teuthology.orchestra.run.smithi089.stdout:fs_name cephfs 2024-09-13T03:02:48.585 INFO:teuthology.orchestra.run.smithi089.stdout:epoch 43 2024-09-13T03:02:48.585 INFO:teuthology.orchestra.run.smithi089.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T03:02:48.585 INFO:teuthology.orchestra.run.smithi089.stdout:created 2024-09-13T02:51:40.657817+0000 2024-09-13T03:02:48.586 INFO:teuthology.orchestra.run.smithi089.stdout:modified 2024-09-13T03:02:30.387186+0000 2024-09-13T03:02:48.586 INFO:teuthology.orchestra.run.smithi089.stdout:tableserver 0 2024-09-13T03:02:48.586 INFO:teuthology.orchestra.run.smithi089.stdout:root 0 2024-09-13T03:02:48.586 INFO:teuthology.orchestra.run.smithi089.stdout:session_timeout 60 2024-09-13T03:02:48.586 INFO:teuthology.orchestra.run.smithi089.stdout:session_autoclose 300 2024-09-13T03:02:48.586 INFO:teuthology.orchestra.run.smithi089.stdout:max_file_size 1099511627776 2024-09-13T03:02:48.586 INFO:teuthology.orchestra.run.smithi089.stdout:max_xattr_size 65536 2024-09-13T03:02:48.586 INFO:teuthology.orchestra.run.smithi089.stdout:required_client_features {} 2024-09-13T03:02:48.586 INFO:teuthology.orchestra.run.smithi089.stdout:last_failure 0 2024-09-13T03:02:48.586 INFO:teuthology.orchestra.run.smithi089.stdout:last_failure_osd_epoch 80 2024-09-13T03:02:48.586 INFO:teuthology.orchestra.run.smithi089.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-13T03:02:48.586 INFO:teuthology.orchestra.run.smithi089.stdout:max_mds 2 2024-09-13T03:02:48.586 INFO:teuthology.orchestra.run.smithi089.stdout:in 0,1 2024-09-13T03:02:48.586 INFO:teuthology.orchestra.run.smithi089.stdout:up {0=34416,1=34448} 2024-09-13T03:02:48.587 INFO:teuthology.orchestra.run.smithi089.stdout:failed 2024-09-13T03:02:48.587 INFO:teuthology.orchestra.run.smithi089.stdout:damaged 2024-09-13T03:02:48.587 INFO:teuthology.orchestra.run.smithi089.stdout:stopped 2024-09-13T03:02:48.587 INFO:teuthology.orchestra.run.smithi089.stdout:data_pools [3] 2024-09-13T03:02:48.587 INFO:teuthology.orchestra.run.smithi089.stdout:metadata_pool 2 2024-09-13T03:02:48.587 INFO:teuthology.orchestra.run.smithi089.stdout:inline_data disabled 2024-09-13T03:02:48.587 INFO:teuthology.orchestra.run.smithi089.stdout:balancer 2024-09-13T03:02:48.587 INFO:teuthology.orchestra.run.smithi089.stdout:bal_rank_mask -1 2024-09-13T03:02:48.587 INFO:teuthology.orchestra.run.smithi089.stdout:standby_count_wanted 1 2024-09-13T03:02:48.587 INFO:teuthology.orchestra.run.smithi089.stdout:qdb_cluster leader: 34416 members: 34448,34416 2024-09-13T03:02:48.587 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi089.qjoitb{0:34416} state up:active seq 8 join_fscid=1 addr [v2:172.21.15.89:6826/2439422546,v1:172.21.15.89:6827/2439422546] compat {c=[1],r=[1],i=[1fff]}] 2024-09-13T03:02:48.587 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi131.uasrkg{0:44355} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.131:6824/2298563432,v1:172.21.15.131:6825/2298563432] compat {c=[1],r=[1],i=[1fff]}] 2024-09-13T03:02:48.587 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi089.rarddb{1:34448} state up:active seq 12 join_fscid=1 addr [v2:172.21.15.89:6828/177758677,v1:172.21.15.89:6829/177758677] compat {c=[1],r=[1],i=[1fff]}] 2024-09-13T03:02:48.588 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi131.rbovzc{1:44385} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.131:6826/2680433683,v1:172.21.15.131:6827/2680433683] compat {c=[1],r=[1],i=[1fff]}] 2024-09-13T03:02:48.588 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T03:02:48.588 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T03:02:48.588 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 43 2024-09-13T03:02:48.588 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.585+0000 7f08f1617640 1 -- 172.21.15.89:0/3488816779 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f08d406e530 msgr2=0x7f08d40709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:48.588 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.585+0000 7f08f1617640 1 --2- 172.21.15.89:0/3488816779 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f08d406e530 0x7f08d40709e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f08dc009a80 tx=0x7f08dc008040 comp rx=0 tx=0).stop 2024-09-13T03:02:48.589 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.585+0000 7f08f1617640 1 -- 172.21.15.89:0/3488816779 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f08ec0fc700 msgr2=0x7f08ec10c500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:48.589 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.585+0000 7f08f1617640 1 --2- 172.21.15.89:0/3488816779 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f08ec0fc700 0x7f08ec10c500 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f08e0003080 tx=0x7f08e0009da0 comp rx=0 tx=0).stop 2024-09-13T03:02:48.589 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.585+0000 7f08f1617640 1 -- 172.21.15.89:0/3488816779 shutdown_connections 2024-09-13T03:02:48.589 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.585+0000 7f08f1617640 1 --2- 172.21.15.89:0/3488816779 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f08d406e530 0x7f08d40709e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:48.589 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.585+0000 7f08f1617640 1 --2- 172.21.15.89:0/3488816779 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f08ec0fc700 0x7f08ec10c500 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:48.589 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.585+0000 7f08f1617640 1 --2- 172.21.15.89:0/3488816779 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f08ec0fb430 0x7f08ec10bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:48.589 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.585+0000 7f08f1617640 1 -- 172.21.15.89:0/3488816779 >> 172.21.15.89:0/3488816779 conn(0x7f08ec0f6c10 msgr2=0x7f08ec0f83a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:02:48.589 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.585+0000 7f08f1617640 1 -- 172.21.15.89:0/3488816779 shutdown_connections 2024-09-13T03:02:48.589 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.585+0000 7f08f1617640 1 -- 172.21.15.89:0/3488816779 wait complete. 2024-09-13T03:02:48.671 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.668+0000 7f46b44ad640 1 -- 172.21.15.89:0/1005778038 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f46ac0fd7f0 msgr2=0x7f46ac0fdc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:48.671 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.668+0000 7f46b44ad640 1 --2- 172.21.15.89:0/1005778038 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f46ac0fd7f0 0x7f46ac0fdc60 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f469c0048d0 tx=0x7f469c009da0 comp rx=0 tx=0).stop 2024-09-13T03:02:48.672 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.668+0000 7f46b44ad640 1 -- 172.21.15.89:0/1005778038 shutdown_connections 2024-09-13T03:02:48.672 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.668+0000 7f46b44ad640 1 --2- 172.21.15.89:0/1005778038 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f46ac0fd7f0 0x7f46ac0fdc60 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:48.672 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.668+0000 7f46b44ad640 1 --2- 172.21.15.89:0/1005778038 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46ac0fc520 0x7f46ac0fc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:48.672 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.668+0000 7f46b44ad640 1 -- 172.21.15.89:0/1005778038 >> 172.21.15.89:0/1005778038 conn(0x7f46ac0f7ce0 msgr2=0x7f46ac0fa110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:02:48.672 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.668+0000 7f46b44ad640 1 -- 172.21.15.89:0/1005778038 shutdown_connections 2024-09-13T03:02:48.672 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.668+0000 7f46b44ad640 1 -- 172.21.15.89:0/1005778038 wait complete. 2024-09-13T03:02:48.672 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.669+0000 7f46b44ad640 1 Processor -- start 2024-09-13T03:02:48.672 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.669+0000 7f46b44ad640 1 -- start start 2024-09-13T03:02:48.672 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.669+0000 7f46b44ad640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46ac0fc520 0x7f46ac10d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:02:48.672 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.669+0000 7f46b44ad640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f46ac0fd7f0 0x7f46ac10d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:02:48.672 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.669+0000 7f46b44ad640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46ac10dbf0 con 0x7f46ac0fd7f0 2024-09-13T03:02:48.673 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.669+0000 7f46b44ad640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46ac10e410 con 0x7f46ac0fc520 2024-09-13T03:02:48.673 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.669+0000 7f46b1a48640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f46ac0fd7f0 0x7f46ac10d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:02:48.673 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.669+0000 7f46b1a48640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f46ac0fd7f0 0x7f46ac10d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:46948/0 (socket says 172.21.15.89:46948) 2024-09-13T03:02:48.673 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.669+0000 7f46b1a48640 1 -- 172.21.15.89:0/1415686675 learned_addr learned my addr 172.21.15.89:0/1415686675 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T03:02:48.673 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.670+0000 7f46b2249640 1 --2- 172.21.15.89:0/1415686675 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46ac0fc520 0x7f46ac10d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:02:48.673 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.670+0000 7f46b1a48640 1 -- 172.21.15.89:0/1415686675 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46ac0fc520 msgr2=0x7f46ac10d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:48.673 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.670+0000 7f46b1a48640 1 --2- 172.21.15.89:0/1415686675 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46ac0fc520 0x7f46ac10d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:48.673 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.670+0000 7f46b1a48640 1 -- 172.21.15.89:0/1415686675 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f469c005040 con 0x7f46ac0fd7f0 2024-09-13T03:02:48.673 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.670+0000 7f46b2249640 1 --2- 172.21.15.89:0/1415686675 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46ac0fc520 0x7f46ac10d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T03:02:48.673 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.670+0000 7f46b1a48640 1 --2- 172.21.15.89:0/1415686675 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f46ac0fd7f0 0x7f46ac10d5a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f469c0043d0 tx=0x7f469c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:02:48.673 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.670+0000 7f46a2ffd640 1 -- 172.21.15.89:0/1415686675 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f469c038070 con 0x7f46ac0fd7f0 2024-09-13T03:02:48.673 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.670+0000 7f46b44ad640 1 -- 172.21.15.89:0/1415686675 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46ac10e640 con 0x7f46ac0fd7f0 2024-09-13T03:02:48.674 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.670+0000 7f46a2ffd640 1 -- 172.21.15.89:0/1415686675 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f469c02ae90 con 0x7f46ac0fd7f0 2024-09-13T03:02:48.674 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.670+0000 7f46a2ffd640 1 -- 172.21.15.89:0/1415686675 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f469c03e670 con 0x7f46ac0fd7f0 2024-09-13T03:02:48.674 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.670+0000 7f46b44ad640 1 -- 172.21.15.89:0/1415686675 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46ac10ebe0 con 0x7f46ac0fd7f0 2024-09-13T03:02:48.675 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.671+0000 7f46b44ad640 1 -- 172.21.15.89:0/1415686675 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46ac0fb980 con 0x7f46ac0fd7f0 2024-09-13T03:02:48.675 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.672+0000 7f46a2ffd640 1 -- 172.21.15.89:0/1415686675 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f469c030020 con 0x7f46ac0fd7f0 2024-09-13T03:02:48.675 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.672+0000 7f46a2ffd640 1 --2- 172.21.15.89:0/1415686675 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f469806e530 0x7f46980709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:02:48.675 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.672+0000 7f46a2ffd640 1 -- 172.21.15.89:0/1415686675 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f469c0ae3d0 con 0x7f46ac0fd7f0 2024-09-13T03:02:48.675 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.672+0000 7f46b2249640 1 --2- 172.21.15.89:0/1415686675 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f469806e530 0x7f46980709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:02:48.675 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.673+0000 7f46b2249640 1 --2- 172.21.15.89:0/1415686675 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f469806e530 0x7f46980709e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f46a8004d60 tx=0x7f46a800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:02:48.677 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.676+0000 7f46a2ffd640 1 -- 172.21.15.89:0/1415686675 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f469c0774e0 con 0x7f46ac0fd7f0 2024-09-13T03:02:48.877 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.875+0000 7f46b44ad640 1 -- 172.21.15.89:0/1415686675 --> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f46ac10efb0 con 0x7f469806e530 2024-09-13T03:02:48.877 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:48 smithi089 ceph-mon[91553]: from='client.34480 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T03:02:48.877 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:48 smithi089 ceph-mon[91553]: pgmap v224: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 6.0 MiB/s rd, 0 B/s wr, 5 op/s 2024-09-13T03:02:48.877 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:48 smithi089 ceph-mon[91553]: from='client.34484 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T03:02:48.877 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:48 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:02:48.877 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:48 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:02:48.878 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:48 smithi089 ceph-mon[91553]: from='client.? 172.21.15.89:0/1585565743' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:48.878 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:48 smithi089 ceph-mon[91553]: from='client.? 172.21.15.89:0/3488816779' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T03:02:48.878 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.877+0000 7f46a2ffd640 1 -- 172.21.15.89:0/1415686675 <== mgr.34104 v2:172.21.15.89:6800/1881577856 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+435 (secure 0 0 0) 0x7f46ac10efb0 con 0x7f469806e530 2024-09-13T03:02:48.878 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-13T03:02:48.878 INFO:teuthology.orchestra.run.smithi089.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d", 2024-09-13T03:02:48.878 INFO:teuthology.orchestra.run.smithi089.stdout: "in_progress": true, 2024-09-13T03:02:48.878 INFO:teuthology.orchestra.run.smithi089.stdout: "which": "Upgrading all daemon types on all hosts", 2024-09-13T03:02:48.879 INFO:teuthology.orchestra.run.smithi089.stdout: "services_complete": [ 2024-09-13T03:02:48.879 INFO:teuthology.orchestra.run.smithi089.stdout: "osd", 2024-09-13T03:02:48.879 INFO:teuthology.orchestra.run.smithi089.stdout: "crash", 2024-09-13T03:02:48.879 INFO:teuthology.orchestra.run.smithi089.stdout: "mon", 2024-09-13T03:02:48.879 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr", 2024-09-13T03:02:48.879 INFO:teuthology.orchestra.run.smithi089.stdout: "mds" 2024-09-13T03:02:48.879 INFO:teuthology.orchestra.run.smithi089.stdout: ], 2024-09-13T03:02:48.879 INFO:teuthology.orchestra.run.smithi089.stdout: "progress": "16/21 daemons upgraded", 2024-09-13T03:02:48.879 INFO:teuthology.orchestra.run.smithi089.stdout: "message": "Currently upgrading grafana daemons", 2024-09-13T03:02:48.879 INFO:teuthology.orchestra.run.smithi089.stdout: "is_paused": false 2024-09-13T03:02:48.879 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-13T03:02:48.881 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.880+0000 7f46b44ad640 1 -- 172.21.15.89:0/1415686675 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f469806e530 msgr2=0x7f46980709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:48.881 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.880+0000 7f46b44ad640 1 --2- 172.21.15.89:0/1415686675 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f469806e530 0x7f46980709e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f46a8004d60 tx=0x7f46a800b040 comp rx=0 tx=0).stop 2024-09-13T03:02:48.882 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.880+0000 7f46b44ad640 1 -- 172.21.15.89:0/1415686675 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f46ac0fd7f0 msgr2=0x7f46ac10d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:48.882 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.880+0000 7f46b44ad640 1 --2- 172.21.15.89:0/1415686675 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f46ac0fd7f0 0x7f46ac10d5a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f469c0043d0 tx=0x7f469c009da0 comp rx=0 tx=0).stop 2024-09-13T03:02:48.882 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.880+0000 7f46b44ad640 1 -- 172.21.15.89:0/1415686675 shutdown_connections 2024-09-13T03:02:48.882 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.880+0000 7f46b44ad640 1 --2- 172.21.15.89:0/1415686675 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f469806e530 0x7f46980709e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:48.882 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.880+0000 7f46b44ad640 1 --2- 172.21.15.89:0/1415686675 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f46ac0fd7f0 0x7f46ac10d5a0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:48.882 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.880+0000 7f46b44ad640 1 --2- 172.21.15.89:0/1415686675 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46ac0fc520 0x7f46ac10d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:48.882 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.880+0000 7f46b44ad640 1 -- 172.21.15.89:0/1415686675 >> 172.21.15.89:0/1415686675 conn(0x7f46ac0f7ce0 msgr2=0x7f46ac0f94b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:02:48.882 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.880+0000 7f46b44ad640 1 -- 172.21.15.89:0/1415686675 shutdown_connections 2024-09-13T03:02:48.882 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.880+0000 7f46b44ad640 1 -- 172.21.15.89:0/1415686675 wait complete. 2024-09-13T03:02:48.963 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.962+0000 7f46cf915640 1 -- 172.21.15.89:0/338017329 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f46c8065c40 msgr2=0x7f46c80ff140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:48.963 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.962+0000 7f46cf915640 1 --2- 172.21.15.89:0/338017329 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f46c8065c40 0x7f46c80ff140 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f46c40048d0 tx=0x7f46c4009da0 comp rx=0 tx=0).stop 2024-09-13T03:02:48.963 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.962+0000 7f46cf915640 1 -- 172.21.15.89:0/338017329 shutdown_connections 2024-09-13T03:02:48.963 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.962+0000 7f46cf915640 1 --2- 172.21.15.89:0/338017329 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46c80ff680 0x7f46c8101a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:48.963 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.962+0000 7f46cf915640 1 --2- 172.21.15.89:0/338017329 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f46c8065c40 0x7f46c80ff140 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:48.963 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.962+0000 7f46cf915640 1 -- 172.21.15.89:0/338017329 >> 172.21.15.89:0/338017329 conn(0x7f46c80f6c10 msgr2=0x7f46c80f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:02:48.964 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.962+0000 7f46cf915640 1 -- 172.21.15.89:0/338017329 shutdown_connections 2024-09-13T03:02:48.964 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.962+0000 7f46cf915640 1 -- 172.21.15.89:0/338017329 wait complete. 2024-09-13T03:02:48.965 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.962+0000 7f46cf915640 1 Processor -- start 2024-09-13T03:02:48.966 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.962+0000 7f46cf915640 1 -- start start 2024-09-13T03:02:48.966 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.963+0000 7f46cf915640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f46c8065c40 0x7f46c80fcb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:02:48.966 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.963+0000 7f46cf915640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46c80ff680 0x7f46c80fb040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:02:48.966 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.963+0000 7f46cf915640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c80fb610 con 0x7f46c8065c40 2024-09-13T03:02:48.966 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.963+0000 7f46cf915640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46c80fb750 con 0x7f46c80ff680 2024-09-13T03:02:48.966 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.963+0000 7f46cd6b1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f46c8065c40 0x7f46c80fcb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:02:48.966 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.963+0000 7f46cd6b1640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f46c8065c40 0x7f46c80fcb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:46958/0 (socket says 172.21.15.89:46958) 2024-09-13T03:02:48.966 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.963+0000 7f46cd6b1640 1 -- 172.21.15.89:0/2069487829 learned_addr learned my addr 172.21.15.89:0/2069487829 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T03:02:48.966 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.963+0000 7f46cceb0640 1 --2- 172.21.15.89:0/2069487829 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46c80ff680 0x7f46c80fb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:02:48.966 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.963+0000 7f46cd6b1640 1 -- 172.21.15.89:0/2069487829 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46c80ff680 msgr2=0x7f46c80fb040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:48.966 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.963+0000 7f46cd6b1640 1 --2- 172.21.15.89:0/2069487829 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46c80ff680 0x7f46c80fb040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:48.966 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.963+0000 7f46cd6b1640 1 -- 172.21.15.89:0/2069487829 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46c4005040 con 0x7f46c8065c40 2024-09-13T03:02:48.967 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.963+0000 7f46cd6b1640 1 --2- 172.21.15.89:0/2069487829 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f46c8065c40 0x7f46c80fcb00 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f46c4003080 tx=0x7f46c4009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:02:48.967 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.963+0000 7f46bdffb640 1 -- 172.21.15.89:0/2069487829 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f46c4038070 con 0x7f46c8065c40 2024-09-13T03:02:48.967 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.963+0000 7f46cf915640 1 -- 172.21.15.89:0/2069487829 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46c80fb9d0 con 0x7f46c8065c40 2024-09-13T03:02:48.967 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.963+0000 7f46bdffb640 1 -- 172.21.15.89:0/2069487829 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f46c4033cb0 con 0x7f46c8065c40 2024-09-13T03:02:48.967 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.963+0000 7f46bdffb640 1 -- 172.21.15.89:0/2069487829 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f46c403da90 con 0x7f46c8065c40 2024-09-13T03:02:48.967 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.964+0000 7f46cf915640 1 -- 172.21.15.89:0/2069487829 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46c81151a0 con 0x7f46c8065c40 2024-09-13T03:02:48.968 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.965+0000 7f46cf915640 1 -- 172.21.15.89:0/2069487829 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46c80fa890 con 0x7f46c8065c40 2024-09-13T03:02:48.968 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.965+0000 7f46bdffb640 1 -- 172.21.15.89:0/2069487829 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f46c4030020 con 0x7f46c8065c40 2024-09-13T03:02:48.968 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.966+0000 7f46bdffb640 1 --2- 172.21.15.89:0/2069487829 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f46b406e530 0x7f46b40709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:02:48.968 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.966+0000 7f46bdffb640 1 -- 172.21.15.89:0/2069487829 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f46c40ae940 con 0x7f46c8065c40 2024-09-13T03:02:48.968 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.966+0000 7f46cceb0640 1 --2- 172.21.15.89:0/2069487829 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f46b406e530 0x7f46b40709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:02:48.968 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.966+0000 7f46cceb0640 1 --2- 172.21.15.89:0/2069487829 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f46b406e530 0x7f46b40709e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f46b8009950 tx=0x7f46b8008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:02:48.971 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:48.970+0000 7f46bdffb640 1 -- 172.21.15.89:0/2069487829 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f46c40779d0 con 0x7f46c8065c40 2024-09-13T03:02:49.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:48 smithi131 ceph-mon[78839]: from='client.34480 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T03:02:49.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:48 smithi131 ceph-mon[78839]: pgmap v224: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 6.0 MiB/s rd, 0 B/s wr, 5 op/s 2024-09-13T03:02:49.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:48 smithi131 ceph-mon[78839]: from='client.34484 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T03:02:49.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:48 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:02:49.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:48 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:02:49.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:48 smithi131 ceph-mon[78839]: from='client.? 172.21.15.89:0/1585565743' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:49.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:48 smithi131 ceph-mon[78839]: from='client.? 172.21.15.89:0/3488816779' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T03:02:49.230 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:49.229+0000 7f46cf915640 1 -- 172.21.15.89:0/2069487829 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f46c8115330 con 0x7f46c8065c40 2024-09-13T03:02:49.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:49.229+0000 7f46bdffb640 1 -- 172.21.15.89:0/2069487829 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f46c407b090 con 0x7f46c8065c40 2024-09-13T03:02:49.231 INFO:teuthology.orchestra.run.smithi089.stdout:HEALTH_OK 2024-09-13T03:02:49.233 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:49.232+0000 7f46cf915640 1 -- 172.21.15.89:0/2069487829 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f46b406e530 msgr2=0x7f46b40709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:49.234 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:49.232+0000 7f46cf915640 1 --2- 172.21.15.89:0/2069487829 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f46b406e530 0x7f46b40709e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f46b8009950 tx=0x7f46b8008040 comp rx=0 tx=0).stop 2024-09-13T03:02:49.234 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:49.232+0000 7f46cf915640 1 -- 172.21.15.89:0/2069487829 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f46c8065c40 msgr2=0x7f46c80fcb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:02:49.234 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:49.232+0000 7f46cf915640 1 --2- 172.21.15.89:0/2069487829 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f46c8065c40 0x7f46c80fcb00 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f46c4003080 tx=0x7f46c4009da0 comp rx=0 tx=0).stop 2024-09-13T03:02:49.234 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:49.232+0000 7f46cf915640 1 -- 172.21.15.89:0/2069487829 shutdown_connections 2024-09-13T03:02:49.234 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:49.232+0000 7f46cf915640 1 --2- 172.21.15.89:0/2069487829 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f46b406e530 0x7f46b40709e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:49.234 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:49.232+0000 7f46cf915640 1 --2- 172.21.15.89:0/2069487829 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f46c80ff680 0x7f46c80fb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:49.234 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:49.232+0000 7f46cf915640 1 --2- 172.21.15.89:0/2069487829 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f46c8065c40 0x7f46c80fcb00 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:02:49.234 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:49.232+0000 7f46cf915640 1 -- 172.21.15.89:0/2069487829 >> 172.21.15.89:0/2069487829 conn(0x7f46c80f6c10 msgr2=0x7f46c80f6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:02:49.234 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:49.232+0000 7f46cf915640 1 -- 172.21.15.89:0/2069487829 shutdown_connections 2024-09-13T03:02:49.234 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:02:49.232+0000 7f46cf915640 1 -- 172.21.15.89:0/2069487829 wait complete. 2024-09-13T03:02:50.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:49 smithi131 ceph-mon[78839]: from='client.34488 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T03:02:50.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:49 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:02:50.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:49 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:02:50.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:49 smithi131 ceph-mon[78839]: from='client.? 172.21.15.89:0/2069487829' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T03:02:50.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:49 smithi089 ceph-mon[91553]: from='client.34488 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T03:02:50.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:49 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:02:50.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:49 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:02:50.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:49 smithi089 ceph-mon[91553]: from='client.? 172.21.15.89:0/2069487829' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T03:02:51.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:50 smithi131 ceph-mon[78839]: from='client.34500 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T03:02:51.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:50 smithi131 ceph-mon[78839]: pgmap v225: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 685 KiB/s rd, 3 op/s 2024-09-13T03:02:51.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:50 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:02:51.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:50 smithi089 ceph-mon[91553]: from='client.34500 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T03:02:51.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:50 smithi089 ceph-mon[91553]: pgmap v225: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 685 KiB/s rd, 3 op/s 2024-09-13T03:02:51.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:50 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:02:53.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:52 smithi131 ceph-mon[78839]: pgmap v226: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-09-13T03:02:53.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:52 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:02:53.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:52 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:02:53.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:52 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T03:02:53.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:52 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T03:02:53.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:52 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:02:53.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:52 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-13T03:02:53.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:52 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:02:53.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:52 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:53.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:52 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:53.185 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:52 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:53.186 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:52 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:53.186 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:52 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:53.186 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:52 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:53.186 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:52 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:53.186 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:52 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:53.186 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:52 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:53.186 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:52 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:53.186 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:52 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:53.186 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:52 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:53.186 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:52 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:53.186 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:52 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:53.186 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:52 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:53.187 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:52 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:53.187 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:52 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:53.187 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:52 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:53.187 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:52 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:02:53.187 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:52 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-13T03:02:53.187 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:52 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-13T03:02:53.187 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:52 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T03:02:53.187 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:52 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-13T03:02:53.187 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:52 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-13T03:02:53.187 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:52 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-13T03:02:53.187 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:52 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-13T03:02:53.187 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:52 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-09-13T03:02:53.187 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:52 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-13T03:02:53.188 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:52 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-13T03:02:53.188 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:52 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-13T03:02:53.188 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:52 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-13T03:02:53.188 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:52 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-13T03:02:53.188 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:52 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-13T03:02:53.188 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:52 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T03:02:53.188 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:52 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-13T03:02:53.188 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:52 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-13T03:02:53.188 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:52 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-13T03:02:53.188 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:52 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-13T03:02:53.188 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:52 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-13T03:02:53.188 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:52 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-13T03:02:53.188 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:52 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-13T03:02:53.189 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:52 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-13T03:02:53.189 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:52 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T03:02:53.189 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:52 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T03:02:53.189 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:52 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T03:02:53.189 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:52 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T03:02:53.189 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:52 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T03:02:53.189 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:52 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T03:02:53.189 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:52 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-13T03:02:53.189 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:52 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-13T03:02:53.189 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:52 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:02:53.189 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:52 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T03:02:53.189 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:52 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T03:02:53.189 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:52 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:02:53.189 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:52 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:02:53.190 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:52 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T03:02:53.190 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:52 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T03:02:53.190 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:52 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:02:53.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:52 smithi089 ceph-mon[91553]: pgmap v226: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.0 KiB/s rd, 4 op/s 2024-09-13T03:02:53.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:52 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:02:53.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:52 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:02:53.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:52 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T03:02:53.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:52 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T03:02:53.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:52 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:02:53.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:52 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-13T03:02:53.286 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:52 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:02:53.287 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:52 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:53.287 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:52 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:53.287 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:52 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:53.287 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:52 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:53.287 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:52 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:53.287 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:52 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:53.287 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:52 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:53.287 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:52 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:53.287 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:52 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:53.287 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:52 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:53.287 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:52 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:53.287 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:52 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:53.288 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:52 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:53.288 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:52 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:53.288 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:52 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:53.288 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:52 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:53.288 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:52 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:53.288 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:52 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:02:53.288 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:52 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:02:53.288 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:52 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-09-13T03:02:53.288 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:52 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-09-13T03:02:53.288 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:52 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T03:02:53.288 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:52 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-09-13T03:02:53.288 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:52 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-09-13T03:02:53.288 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:52 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-09-13T03:02:53.289 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:52 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-09-13T03:02:53.289 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:52 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-09-13T03:02:53.289 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:52 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-09-13T03:02:53.289 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:52 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-09-13T03:02:53.289 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:52 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-09-13T03:02:53.289 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:52 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-09-13T03:02:53.289 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:52 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-09-13T03:02:53.289 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:52 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-09-13T03:02:53.289 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:52 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T03:02:53.289 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:52 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-09-13T03:02:53.289 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:52 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-09-13T03:02:53.289 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:52 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-09-13T03:02:53.290 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:52 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-09-13T03:02:53.290 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:52 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-09-13T03:02:53.290 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:52 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-09-13T03:02:53.290 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:52 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-09-13T03:02:53.290 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:52 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-09-13T03:02:53.290 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:52 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T03:02:53.290 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:52 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T03:02:53.290 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:52 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T03:02:53.290 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:52 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T03:02:53.290 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:52 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T03:02:53.290 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:52 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-09-13T03:02:53.290 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:52 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-09-13T03:02:53.290 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:52 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-09-13T03:02:53.291 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:52 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:02:53.291 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:52 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T03:02:53.291 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:52 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T03:02:53.291 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:52 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:02:53.291 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:52 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:02:53.291 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:52 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T03:02:53.291 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:52 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T03:02:53.291 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:52 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:02:54.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:53 smithi131 ceph-mon[78839]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-13T03:02:54.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:53 smithi131 ceph-mon[78839]: Upgrade: Finalizing container_image settings 2024-09-13T03:02:54.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:53 smithi131 ceph-mon[78839]: Upgrade: Complete! 2024-09-13T03:02:54.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:53 smithi089 ceph-mon[91553]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-09-13T03:02:54.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:53 smithi089 ceph-mon[91553]: Upgrade: Finalizing container_image settings 2024-09-13T03:02:54.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:53 smithi089 ceph-mon[91553]: Upgrade: Complete! 2024-09-13T03:02:55.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:54 smithi131 ceph-mon[78839]: pgmap v227: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T03:02:55.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:54 smithi089 ceph-mon[91553]: pgmap v227: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T03:02:56.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:56 smithi131 ceph-mon[78839]: pgmap v228: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:02:56.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:56 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:02:57.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:56 smithi089 ceph-mon[91553]: pgmap v228: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:02:57.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:56 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:02:58.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:02:58 smithi131 ceph-mon[78839]: pgmap v229: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:02:59.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:02:58 smithi089 ceph-mon[91553]: pgmap v229: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:03:00.535 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:03:00 smithi089 ceph-mon[91553]: pgmap v230: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T03:03:00.684 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:03:00 smithi131 ceph-mon[78839]: pgmap v230: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T03:03:02.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:03:02 smithi131 ceph-mon[78839]: pgmap v231: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:03:03.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:03:02 smithi089 ceph-mon[91553]: pgmap v231: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:03:04.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:03:04 smithi131 ceph-mon[78839]: pgmap v232: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T03:03:05.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:03:04 smithi089 ceph-mon[91553]: pgmap v232: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T03:03:06.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:03:05 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:03:06.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:03:05 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:03:07.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:03:06 smithi089 ceph-mon[91553]: pgmap v233: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:03:07.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:03:06 smithi131 ceph-mon[78839]: pgmap v233: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:03:09.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:03:08 smithi089 ceph-mon[91553]: pgmap v234: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:03:09.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:03:08 smithi131 ceph-mon[78839]: pgmap v234: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:03:11.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:03:10 smithi089 ceph-mon[91553]: pgmap v235: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T03:03:11.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:03:10 smithi131 ceph-mon[78839]: pgmap v235: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T03:03:13.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:03:12 smithi089 ceph-mon[91553]: pgmap v236: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:03:13.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:03:12 smithi131 ceph-mon[78839]: pgmap v236: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:03:14.986 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:03:14 smithi131 ceph-mon[78839]: pgmap v237: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T03:03:15.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:03:14 smithi089 ceph-mon[91553]: pgmap v237: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T03:03:17.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:03:16 smithi089 ceph-mon[91553]: pgmap v238: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:03:17.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:03:16 smithi131 ceph-mon[78839]: pgmap v238: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:03:19.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:03:18 smithi089 ceph-mon[91553]: pgmap v239: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:03:19.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:03:18 smithi131 ceph-mon[78839]: pgmap v239: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:03:19.327 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:19.322+0000 7ff5389f7640 1 -- 172.21.15.89:0/3342211595 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff5340fb430 msgr2=0x7ff5340fb840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:03:19.327 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:19.322+0000 7ff5389f7640 1 --2- 172.21.15.89:0/3342211595 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff5340fb430 0x7ff5340fb840 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7ff5240048d0 tx=0x7ff524009da0 comp rx=0 tx=0).stop 2024-09-13T03:03:19.327 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:19.322+0000 7ff5389f7640 1 -- 172.21.15.89:0/3342211595 shutdown_connections 2024-09-13T03:03:19.327 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:19.322+0000 7ff5389f7640 1 --2- 172.21.15.89:0/3342211595 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5340fc700 0x7ff5340fcb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:03:19.327 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:19.322+0000 7ff5389f7640 1 --2- 172.21.15.89:0/3342211595 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff5340fb430 0x7ff5340fb840 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:03:19.327 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:19.322+0000 7ff5389f7640 1 -- 172.21.15.89:0/3342211595 >> 172.21.15.89:0/3342211595 conn(0x7ff5340f6c10 msgr2=0x7ff5340f9020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:03:19.327 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:19.322+0000 7ff5389f7640 1 -- 172.21.15.89:0/3342211595 shutdown_connections 2024-09-13T03:03:19.327 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:19.322+0000 7ff5389f7640 1 -- 172.21.15.89:0/3342211595 wait complete. 2024-09-13T03:03:19.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:19.323+0000 7ff5389f7640 1 Processor -- start 2024-09-13T03:03:19.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:19.323+0000 7ff5389f7640 1 -- start start 2024-09-13T03:03:19.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:19.323+0000 7ff5389f7640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5340fb430 0x7ff53410d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:03:19.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:19.323+0000 7ff5389f7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff5340fc700 0x7ff53410d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:03:19.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:19.323+0000 7ff5389f7640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff53410dc10 con 0x7ff5340fc700 2024-09-13T03:03:19.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:19.323+0000 7ff5389f7640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff53410e430 con 0x7ff5340fb430 2024-09-13T03:03:19.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:19.323+0000 7ff531d9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff5340fc700 0x7ff53410d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:03:19.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:19.323+0000 7ff531d9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff5340fc700 0x7ff53410d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:34288/0 (socket says 172.21.15.89:34288) 2024-09-13T03:03:19.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:19.323+0000 7ff531d9b640 1 -- 172.21.15.89:0/2279617495 learned_addr learned my addr 172.21.15.89:0/2279617495 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T03:03:19.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:19.323+0000 7ff53259c640 1 --2- 172.21.15.89:0/2279617495 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5340fb430 0x7ff53410d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:03:19.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:19.324+0000 7ff531d9b640 1 -- 172.21.15.89:0/2279617495 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5340fb430 msgr2=0x7ff53410d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:03:19.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:19.324+0000 7ff531d9b640 1 --2- 172.21.15.89:0/2279617495 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5340fb430 0x7ff53410d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:03:19.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:19.324+0000 7ff531d9b640 1 -- 172.21.15.89:0/2279617495 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff524005040 con 0x7ff5340fc700 2024-09-13T03:03:19.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:19.324+0000 7ff531d9b640 1 --2- 172.21.15.89:0/2279617495 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff5340fc700 0x7ff53410d5c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff51c002a50 tx=0x7ff51c004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:03:19.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:19.324+0000 7ff52affd640 1 -- 172.21.15.89:0/2279617495 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff51c007c30 con 0x7ff5340fc700 2024-09-13T03:03:19.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:19.324+0000 7ff5389f7640 1 -- 172.21.15.89:0/2279617495 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff53410e6c0 con 0x7ff5340fc700 2024-09-13T03:03:19.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:19.324+0000 7ff52affd640 1 -- 172.21.15.89:0/2279617495 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff51c00f040 con 0x7ff5340fc700 2024-09-13T03:03:19.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:19.324+0000 7ff52affd640 1 -- 172.21.15.89:0/2279617495 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff51c00da10 con 0x7ff5340fc700 2024-09-13T03:03:19.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:19.324+0000 7ff5389f7640 1 -- 172.21.15.89:0/2279617495 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff53410ec60 con 0x7ff5340fc700 2024-09-13T03:03:19.330 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:19.325+0000 7ff5389f7640 1 -- 172.21.15.89:0/2279617495 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5340fa890 con 0x7ff5340fc700 2024-09-13T03:03:19.330 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:19.326+0000 7ff52affd640 1 -- 172.21.15.89:0/2279617495 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7ff51c00dc80 con 0x7ff5340fc700 2024-09-13T03:03:19.330 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:19.326+0000 7ff52affd640 1 --2- 172.21.15.89:0/2279617495 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7ff52006e530 0x7ff5200709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:03:19.330 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:19.326+0000 7ff52affd640 1 -- 172.21.15.89:0/2279617495 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6582+0+0 (secure 0 0 0) 0x7ff51c08d990 con 0x7ff5340fc700 2024-09-13T03:03:19.330 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:19.326+0000 7ff53259c640 1 --2- 172.21.15.89:0/2279617495 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7ff52006e530 0x7ff5200709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:03:19.330 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:19.327+0000 7ff53259c640 1 --2- 172.21.15.89:0/2279617495 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7ff52006e530 0x7ff5200709e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff52400b020 tx=0x7ff524035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:03:19.333 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:19.331+0000 7ff52affd640 1 -- 172.21.15.89:0/2279617495 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7ff51c056ad0 con 0x7ff5340fc700 2024-09-13T03:03:19.515 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:19.512+0000 7ff5389f7640 1 -- 172.21.15.89:0/2279617495 --> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff534104000 con 0x7ff52006e530 2024-09-13T03:03:19.516 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:19.513+0000 7ff52affd640 1 -- 172.21.15.89:0/2279617495 <== mgr.34104 v2:172.21.15.89:6800/1881577856 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7ff524039040 con 0x7ff52006e530 2024-09-13T03:03:19.518 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:19.515+0000 7ff5389f7640 1 -- 172.21.15.89:0/2279617495 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7ff52006e530 msgr2=0x7ff5200709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:03:19.518 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:19.515+0000 7ff5389f7640 1 --2- 172.21.15.89:0/2279617495 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7ff52006e530 0x7ff5200709e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff52400b020 tx=0x7ff524035040 comp rx=0 tx=0).stop 2024-09-13T03:03:19.518 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:19.515+0000 7ff5389f7640 1 -- 172.21.15.89:0/2279617495 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff5340fc700 msgr2=0x7ff53410d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:03:19.519 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:19.515+0000 7ff5389f7640 1 --2- 172.21.15.89:0/2279617495 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff5340fc700 0x7ff53410d5c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff51c002a50 tx=0x7ff51c004600 comp rx=0 tx=0).stop 2024-09-13T03:03:19.519 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:19.516+0000 7ff5389f7640 1 -- 172.21.15.89:0/2279617495 shutdown_connections 2024-09-13T03:03:19.519 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:19.516+0000 7ff5389f7640 1 --2- 172.21.15.89:0/2279617495 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7ff52006e530 0x7ff5200709e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:03:19.519 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:19.516+0000 7ff5389f7640 1 --2- 172.21.15.89:0/2279617495 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff5340fc700 0x7ff53410d5c0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:03:19.519 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:19.516+0000 7ff5389f7640 1 --2- 172.21.15.89:0/2279617495 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5340fb430 0x7ff53410d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:03:19.519 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:19.516+0000 7ff5389f7640 1 -- 172.21.15.89:0/2279617495 >> 172.21.15.89:0/2279617495 conn(0x7ff5340f6c10 msgr2=0x7ff5340655f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:03:19.519 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:19.516+0000 7ff5389f7640 1 -- 172.21.15.89:0/2279617495 shutdown_connections 2024-09-13T03:03:19.519 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:19.516+0000 7ff5389f7640 1 -- 172.21.15.89:0/2279617495 wait complete. 2024-09-13T03:03:20.267 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -e sha1=7741f7f9ee20524f89b8f61d1609b32fb3b1570a -- bash -c 'ceph orch ps' 2024-09-13T03:03:20.560 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T03:03:20.936 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:03:20 smithi089 ceph-mon[91553]: from='client.34508 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T03:03:20.937 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:03:20 smithi089 ceph-mon[91553]: pgmap v240: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T03:03:20.937 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:03:20 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:03:21.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:03:20 smithi131 ceph-mon[78839]: from='client.34508 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T03:03:21.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:03:20 smithi131 ceph-mon[78839]: pgmap v240: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T03:03:21.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:03:20 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:03:22.327 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:22.302+0000 7f4f5fde6640 1 -- 172.21.15.89:0/1967563590 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4f58102620 msgr2=0x7f4f581029f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:03:22.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:22.302+0000 7f4f5fde6640 1 --2- 172.21.15.89:0/1967563590 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4f58102620 0x7f4f581029f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f4f540048d0 tx=0x7f4f54009da0 comp rx=0 tx=0).stop 2024-09-13T03:03:22.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:22.302+0000 7f4f5fde6640 1 -- 172.21.15.89:0/1967563590 shutdown_connections 2024-09-13T03:03:22.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:22.302+0000 7f4f5fde6640 1 --2- 172.21.15.89:0/1967563590 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4f580fac80 0x7f4f580fb0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:03:22.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:22.302+0000 7f4f5fde6640 1 --2- 172.21.15.89:0/1967563590 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4f58102620 0x7f4f581029f0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:03:22.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:22.302+0000 7f4f5fde6640 1 -- 172.21.15.89:0/1967563590 >> 172.21.15.89:0/1967563590 conn(0x7f4f58070ce0 msgr2=0x7f4f580710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:03:22.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:22.302+0000 7f4f5fde6640 1 -- 172.21.15.89:0/1967563590 shutdown_connections 2024-09-13T03:03:22.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:22.302+0000 7f4f5fde6640 1 -- 172.21.15.89:0/1967563590 wait complete. 2024-09-13T03:03:22.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:22.302+0000 7f4f5fde6640 1 Processor -- start 2024-09-13T03:03:22.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:22.302+0000 7f4f5fde6640 1 -- start start 2024-09-13T03:03:22.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:22.302+0000 7f4f5fde6640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4f580fac80 0x7f4f581153c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:03:22.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:22.302+0000 7f4f5fde6640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4f58102620 0x7f4f58115900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:03:22.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:22.302+0000 7f4f5fde6640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f58115f00 con 0x7f4f58102620 2024-09-13T03:03:22.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:22.302+0000 7f4f5fde6640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f5810f340 con 0x7f4f580fac80 2024-09-13T03:03:22.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:22.302+0000 7f4f5d381640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4f58102620 0x7f4f58115900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:03:22.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:22.302+0000 7f4f5d381640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4f58102620 0x7f4f58115900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40050/0 (socket says 172.21.15.89:40050) 2024-09-13T03:03:22.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:22.303+0000 7f4f5d381640 1 -- 172.21.15.89:0/2350099362 learned_addr learned my addr 172.21.15.89:0/2350099362 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T03:03:22.330 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:22.303+0000 7f4f5db82640 1 --2- 172.21.15.89:0/2350099362 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4f580fac80 0x7f4f581153c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:03:22.330 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:22.303+0000 7f4f5d381640 1 -- 172.21.15.89:0/2350099362 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4f580fac80 msgr2=0x7f4f581153c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:03:22.330 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:22.303+0000 7f4f5d381640 1 --2- 172.21.15.89:0/2350099362 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4f580fac80 0x7f4f581153c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:03:22.330 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:22.303+0000 7f4f5d381640 1 -- 172.21.15.89:0/2350099362 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f54005040 con 0x7f4f58102620 2024-09-13T03:03:22.330 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:22.303+0000 7f4f5db82640 1 --2- 172.21.15.89:0/2350099362 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4f580fac80 0x7f4f581153c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T03:03:22.330 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:22.303+0000 7f4f5d381640 1 --2- 172.21.15.89:0/2350099362 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4f58102620 0x7f4f58115900 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f4f4800c830 tx=0x7f4f48004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:03:22.330 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:22.303+0000 7f4f4e7fc640 1 -- 172.21.15.89:0/2350099362 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f4800a850 con 0x7f4f58102620 2024-09-13T03:03:22.330 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:22.303+0000 7f4f4e7fc640 1 -- 172.21.15.89:0/2350099362 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4f4800ae50 con 0x7f4f58102620 2024-09-13T03:03:22.330 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:22.303+0000 7f4f5fde6640 1 -- 172.21.15.89:0/2350099362 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f5810f620 con 0x7f4f58102620 2024-09-13T03:03:22.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:22.303+0000 7f4f4e7fc640 1 -- 172.21.15.89:0/2350099362 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f480113a0 con 0x7f4f58102620 2024-09-13T03:03:22.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:22.303+0000 7f4f5fde6640 1 -- 172.21.15.89:0/2350099362 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f5810fbc0 con 0x7f4f58102620 2024-09-13T03:03:22.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:22.304+0000 7f4f5fde6640 1 -- 172.21.15.89:0/2350099362 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f580657b0 con 0x7f4f58102620 2024-09-13T03:03:22.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:22.305+0000 7f4f4e7fc640 1 -- 172.21.15.89:0/2350099362 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f4f48012400 con 0x7f4f58102620 2024-09-13T03:03:22.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:22.305+0000 7f4f4e7fc640 1 --2- 172.21.15.89:0/2350099362 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f4f4406e530 0x7f4f440709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:03:22.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:22.305+0000 7f4f4e7fc640 1 -- 172.21.15.89:0/2350099362 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f4f4808e410 con 0x7f4f58102620 2024-09-13T03:03:22.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:22.305+0000 7f4f5db82640 1 --2- 172.21.15.89:0/2350099362 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f4f4406e530 0x7f4f440709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:03:22.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:22.306+0000 7f4f5db82640 1 --2- 172.21.15.89:0/2350099362 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f4f4406e530 0x7f4f440709e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4f5400b020 tx=0x7f4f54009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:03:22.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:22.310+0000 7f4f4e7fc640 1 -- 172.21.15.89:0/2350099362 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f4f48057520 con 0x7f4f58102620 2024-09-13T03:03:22.486 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:22.485+0000 7f4f5fde6640 1 -- 172.21.15.89:0/2350099362 --> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f4f58109570 con 0x7f4f4406e530 2024-09-13T03:03:22.495 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:22.494+0000 7f4f4e7fc640 1 -- 172.21.15.89:0/2350099362 <== mgr.34104 v2:172.21.15.89:6800/1881577856 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f4f58109570 con 0x7f4f4406e530 2024-09-13T03:03:22.495 INFO:teuthology.orchestra.run.smithi089.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T03:03:22.495 INFO:teuthology.orchestra.run.smithi089.stdout:alertmanager.smithi089 smithi089 *:9093,9094 running (7m) 34s ago 16m 24.1M - 0.25.0 c8568f914cd2 1d2432f5479e 2024-09-13T03:03:22.495 INFO:teuthology.orchestra.run.smithi089.stdout:crash.smithi089 smithi089 running (6m) 34s ago 17m 6891k - 19.1.1-322-g7741f7f9 19dc8d659727 0ef15ca3e7f9 2024-09-13T03:03:22.495 INFO:teuthology.orchestra.run.smithi089.stdout:crash.smithi131 smithi131 running (5m) 58s ago 16m 6895k - 19.1.1-322-g7741f7f9 19dc8d659727 21e4d6fc04f7 2024-09-13T03:03:22.495 INFO:teuthology.orchestra.run.smithi089.stdout:grafana.smithi089 smithi089 *:3000 running (39s) 34s ago 16m 47.7M - 9.4.12 2bacad6d85d8 9655be7633c3 2024-09-13T03:03:22.496 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi089.qjoitb smithi089 running (117s) 34s ago 11m 70.2M - 19.1.1-322-g7741f7f9 19dc8d659727 e79bfdab021a 2024-09-13T03:03:22.496 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi089.rarddb smithi089 running (93s) 34s ago 11m 15.1M - 19.1.1-322-g7741f7f9 19dc8d659727 40413b0e466c 2024-09-13T03:03:22.496 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi131.rbovzc smithi131 running (60s) 58s ago 11m 12.9M - 19.1.1-322-g7741f7f9 19dc8d659727 3461afdce9c5 2024-09-13T03:03:22.496 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi131.uasrkg smithi131 running (75s) 58s ago 11m 12.2M - 19.1.1-322-g7741f7f9 19dc8d659727 95f4ff9e971a 2024-09-13T03:03:22.496 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.smithi089.guohvs smithi089 *:8443,9283,8765 running (7m) 34s ago 18m 514M - 19.1.1-322-g7741f7f9 19dc8d659727 1e887446f1b0 2024-09-13T03:03:22.496 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.smithi131.aunbqd smithi131 *:8443,9283,8765 running (7m) 58s ago 16m 441M - 19.1.1-322-g7741f7f9 19dc8d659727 358d7478f2ba 2024-09-13T03:03:22.496 INFO:teuthology.orchestra.run.smithi089.stdout:mon.smithi089 smithi089 running (6m) 34s ago 18m 52.8M 2048M 19.1.1-322-g7741f7f9 19dc8d659727 8a29fb65028f 2024-09-13T03:03:22.496 INFO:teuthology.orchestra.run.smithi089.stdout:mon.smithi131 smithi131 running (6m) 58s ago 15m 41.9M 2048M 19.1.1-322-g7741f7f9 19dc8d659727 506310ad8620 2024-09-13T03:03:22.496 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.smithi089 smithi089 *:9100 running (8m) 34s ago 17m 16.7M - 1.5.0 0da6a335fe13 5a9927b583e6 2024-09-13T03:03:22.496 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.smithi131 smithi131 *:9100 running (7m) 58s ago 16m 15.5M - 1.5.0 0da6a335fe13 bcfde5d1a508 2024-09-13T03:03:22.497 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0 smithi089 running (5m) 34s ago 15m 107M 1557M 19.1.1-322-g7741f7f9 19dc8d659727 e8038f6d52b6 2024-09-13T03:03:22.497 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1 smithi089 running (5m) 34s ago 14m 109M 1557M 19.1.1-322-g7741f7f9 19dc8d659727 e174144d9633 2024-09-13T03:03:22.497 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2 smithi089 running (4m) 34s ago 14m 96.8M 1557M 19.1.1-322-g7741f7f9 19dc8d659727 2d8cab08c2b3 2024-09-13T03:03:22.497 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3 smithi131 running (3m) 58s ago 13m 116M 2581M 19.1.1-322-g7741f7f9 19dc8d659727 e77cff624869 2024-09-13T03:03:22.497 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4 smithi131 running (3m) 58s ago 13m 104M 2581M 19.1.1-322-g7741f7f9 19dc8d659727 0317e6a4a04c 2024-09-13T03:03:22.497 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5 smithi131 running (2m) 58s ago 13m 91.3M 2581M 19.1.1-322-g7741f7f9 19dc8d659727 e7d2a780f4e0 2024-09-13T03:03:22.497 INFO:teuthology.orchestra.run.smithi089.stdout:prometheus.smithi089 smithi089 *:9095 running (7m) 34s ago 16m 67.5M - 2.43.0 a07b618ecd1d 9d336370c187 2024-09-13T03:03:22.498 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:22.496+0000 7f4f5fde6640 1 -- 172.21.15.89:0/2350099362 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f4f4406e530 msgr2=0x7f4f440709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:03:22.498 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:22.496+0000 7f4f5fde6640 1 --2- 172.21.15.89:0/2350099362 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f4f4406e530 0x7f4f440709e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f4f5400b020 tx=0x7f4f54009da0 comp rx=0 tx=0).stop 2024-09-13T03:03:22.498 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:22.496+0000 7f4f5fde6640 1 -- 172.21.15.89:0/2350099362 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4f58102620 msgr2=0x7f4f58115900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:03:22.498 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:22.496+0000 7f4f5fde6640 1 --2- 172.21.15.89:0/2350099362 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4f58102620 0x7f4f58115900 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f4f4800c830 tx=0x7f4f48004430 comp rx=0 tx=0).stop 2024-09-13T03:03:22.498 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:22.496+0000 7f4f5fde6640 1 -- 172.21.15.89:0/2350099362 shutdown_connections 2024-09-13T03:03:22.498 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:22.496+0000 7f4f5fde6640 1 --2- 172.21.15.89:0/2350099362 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f4f4406e530 0x7f4f440709e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:03:22.498 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:22.496+0000 7f4f5fde6640 1 --2- 172.21.15.89:0/2350099362 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4f58102620 0x7f4f58115900 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:03:22.498 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:22.496+0000 7f4f5fde6640 1 --2- 172.21.15.89:0/2350099362 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4f580fac80 0x7f4f581153c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:03:22.499 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:22.496+0000 7f4f5fde6640 1 -- 172.21.15.89:0/2350099362 >> 172.21.15.89:0/2350099362 conn(0x7f4f58070ce0 msgr2=0x7f4f58103360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:03:22.499 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:22.496+0000 7f4f5fde6640 1 -- 172.21.15.89:0/2350099362 shutdown_connections 2024-09-13T03:03:22.499 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:22.496+0000 7f4f5fde6640 1 -- 172.21.15.89:0/2350099362 wait complete. 2024-09-13T03:03:22.779 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:03:22 smithi089 ceph-mon[91553]: pgmap v241: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:03:23.156 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -e sha1=7741f7f9ee20524f89b8f61d1609b32fb3b1570a -- bash -c 'ceph orch upgrade status' 2024-09-13T03:03:23.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:03:22 smithi131 ceph-mon[78839]: pgmap v241: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:03:23.412 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T03:03:23.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:03:23 smithi089 ceph-mon[91553]: from='client.34512 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T03:03:24.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:03:23 smithi131 ceph-mon[78839]: from='client.34512 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T03:03:24.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:03:24 smithi089 ceph-mon[91553]: pgmap v242: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T03:03:25.059 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:25.037+0000 7fed76e67640 1 -- 172.21.15.89:0/1145173233 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed700fb810 msgr2=0x7fed700fbbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:03:25.059 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:25.037+0000 7fed76e67640 1 --2- 172.21.15.89:0/1145173233 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed700fb810 0x7fed700fbbe0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fed6c0048d0 tx=0x7fed6c009da0 comp rx=0 tx=0).stop 2024-09-13T03:03:25.059 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:25.037+0000 7fed76e67640 1 -- 172.21.15.89:0/1145173233 shutdown_connections 2024-09-13T03:03:25.059 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:25.037+0000 7fed76e67640 1 --2- 172.21.15.89:0/1145173233 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed700fcf80 0x7fed700fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:03:25.059 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:25.037+0000 7fed76e67640 1 --2- 172.21.15.89:0/1145173233 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed700fb810 0x7fed700fbbe0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:03:25.059 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:25.037+0000 7fed76e67640 1 -- 172.21.15.89:0/1145173233 >> 172.21.15.89:0/1145173233 conn(0x7fed700723b0 msgr2=0x7fed700727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:03:25.060 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:25.037+0000 7fed76e67640 1 -- 172.21.15.89:0/1145173233 shutdown_connections 2024-09-13T03:03:25.060 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:25.037+0000 7fed76e67640 1 -- 172.21.15.89:0/1145173233 wait complete. 2024-09-13T03:03:25.060 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:25.038+0000 7fed76e67640 1 Processor -- start 2024-09-13T03:03:25.060 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:25.038+0000 7fed76e67640 1 -- start start 2024-09-13T03:03:25.060 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:25.038+0000 7fed76e67640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed700fb810 0x7fed7010e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:03:25.060 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:25.038+0000 7fed76e67640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed700fcf80 0x7fed7010e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:03:25.060 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:25.038+0000 7fed76e67640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed7010ecd0 con 0x7fed700fcf80 2024-09-13T03:03:25.060 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:25.038+0000 7fed76e67640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed7010ee40 con 0x7fed700fb810 2024-09-13T03:03:25.060 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:25.038+0000 7fed67fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed700fcf80 0x7fed7010e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:03:25.060 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:25.038+0000 7fed67fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed700fcf80 0x7fed7010e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40078/0 (socket says 172.21.15.89:40078) 2024-09-13T03:03:25.060 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:25.038+0000 7fed67fff640 1 -- 172.21.15.89:0/4099261197 learned_addr learned my addr 172.21.15.89:0/4099261197 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T03:03:25.060 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:25.038+0000 7fed74c03640 1 --2- 172.21.15.89:0/4099261197 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed700fb810 0x7fed7010e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:03:25.060 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:25.038+0000 7fed67fff640 1 -- 172.21.15.89:0/4099261197 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed700fb810 msgr2=0x7fed7010e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:03:25.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:25.038+0000 7fed67fff640 1 --2- 172.21.15.89:0/4099261197 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed700fb810 0x7fed7010e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:03:25.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:25.038+0000 7fed67fff640 1 -- 172.21.15.89:0/4099261197 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed6c005040 con 0x7fed700fcf80 2024-09-13T03:03:25.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:25.038+0000 7fed74c03640 1 --2- 172.21.15.89:0/4099261197 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed700fb810 0x7fed7010e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T03:03:25.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:25.039+0000 7fed67fff640 1 --2- 172.21.15.89:0/4099261197 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed700fcf80 0x7fed7010e6d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fed60002a50 tx=0x7fed60004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:03:25.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:25.039+0000 7fed657fa640 1 -- 172.21.15.89:0/4099261197 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed60007c30 con 0x7fed700fcf80 2024-09-13T03:03:25.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:25.039+0000 7fed657fa640 1 -- 172.21.15.89:0/4099261197 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fed6000f040 con 0x7fed700fcf80 2024-09-13T03:03:25.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:25.039+0000 7fed76e67640 1 -- 172.21.15.89:0/4099261197 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed70117200 con 0x7fed700fcf80 2024-09-13T03:03:25.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:25.039+0000 7fed657fa640 1 -- 172.21.15.89:0/4099261197 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fed6000da90 con 0x7fed700fcf80 2024-09-13T03:03:25.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:25.039+0000 7fed76e67640 1 -- 172.21.15.89:0/4099261197 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed70117740 con 0x7fed700fcf80 2024-09-13T03:03:25.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:25.040+0000 7fed76e67640 1 -- 172.21.15.89:0/4099261197 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed700fcbc0 con 0x7fed700fcf80 2024-09-13T03:03:25.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:25.040+0000 7fed657fa640 1 -- 172.21.15.89:0/4099261197 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fed6000dc30 con 0x7fed700fcf80 2024-09-13T03:03:25.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:25.041+0000 7fed657fa640 1 --2- 172.21.15.89:0/4099261197 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fed5806e530 0x7fed580709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:03:25.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:25.041+0000 7fed74c03640 1 --2- 172.21.15.89:0/4099261197 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fed5806e530 0x7fed580709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:03:25.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:25.041+0000 7fed657fa640 1 -- 172.21.15.89:0/4099261197 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fed6008d9f0 con 0x7fed700fcf80 2024-09-13T03:03:25.062 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:25.041+0000 7fed74c03640 1 --2- 172.21.15.89:0/4099261197 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fed5806e530 0x7fed580709e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fed6c00b020 tx=0x7fed6c009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:03:25.062 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:25.045+0000 7fed657fa640 1 -- 172.21.15.89:0/4099261197 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fed6008fe60 con 0x7fed700fcf80 2024-09-13T03:03:25.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:03:24 smithi131 ceph-mon[78839]: pgmap v242: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T03:03:25.230 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:25.229+0000 7fed76e67640 1 -- 172.21.15.89:0/4099261197 --> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fed7004b720 con 0x7fed5806e530 2024-09-13T03:03:25.231 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:25.230+0000 7fed657fa640 1 -- 172.21.15.89:0/4099261197 <== mgr.34104 v2:172.21.15.89:6800/1881577856 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7fed7004b720 con 0x7fed5806e530 2024-09-13T03:03:25.231 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-13T03:03:25.232 INFO:teuthology.orchestra.run.smithi089.stdout: "target_image": null, 2024-09-13T03:03:25.232 INFO:teuthology.orchestra.run.smithi089.stdout: "in_progress": false, 2024-09-13T03:03:25.232 INFO:teuthology.orchestra.run.smithi089.stdout: "which": "", 2024-09-13T03:03:25.232 INFO:teuthology.orchestra.run.smithi089.stdout: "services_complete": [], 2024-09-13T03:03:25.232 INFO:teuthology.orchestra.run.smithi089.stdout: "progress": null, 2024-09-13T03:03:25.232 INFO:teuthology.orchestra.run.smithi089.stdout: "message": "", 2024-09-13T03:03:25.232 INFO:teuthology.orchestra.run.smithi089.stdout: "is_paused": false 2024-09-13T03:03:25.232 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-13T03:03:25.234 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:25.232+0000 7fed76e67640 1 -- 172.21.15.89:0/4099261197 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fed5806e530 msgr2=0x7fed580709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:03:25.234 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:25.232+0000 7fed76e67640 1 --2- 172.21.15.89:0/4099261197 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fed5806e530 0x7fed580709e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fed6c00b020 tx=0x7fed6c009da0 comp rx=0 tx=0).stop 2024-09-13T03:03:25.234 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:25.232+0000 7fed76e67640 1 -- 172.21.15.89:0/4099261197 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed700fcf80 msgr2=0x7fed7010e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:03:25.234 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:25.232+0000 7fed76e67640 1 --2- 172.21.15.89:0/4099261197 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed700fcf80 0x7fed7010e6d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fed60002a50 tx=0x7fed60004600 comp rx=0 tx=0).stop 2024-09-13T03:03:25.234 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:25.233+0000 7fed76e67640 1 -- 172.21.15.89:0/4099261197 shutdown_connections 2024-09-13T03:03:25.234 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:25.233+0000 7fed76e67640 1 --2- 172.21.15.89:0/4099261197 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fed5806e530 0x7fed580709e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:03:25.234 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:25.233+0000 7fed76e67640 1 --2- 172.21.15.89:0/4099261197 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fed700fcf80 0x7fed7010e6d0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:03:25.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:25.233+0000 7fed76e67640 1 --2- 172.21.15.89:0/4099261197 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fed700fb810 0x7fed7010e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:03:25.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:25.233+0000 7fed76e67640 1 -- 172.21.15.89:0/4099261197 >> 172.21.15.89:0/4099261197 conn(0x7fed700723b0 msgr2=0x7fed700fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:03:25.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:25.233+0000 7fed76e67640 1 -- 172.21.15.89:0/4099261197 shutdown_connections 2024-09-13T03:03:25.235 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:25.233+0000 7fed76e67640 1 -- 172.21.15.89:0/4099261197 wait complete. 2024-09-13T03:03:25.891 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -e sha1=7741f7f9ee20524f89b8f61d1609b32fb3b1570a -- bash -c 'ceph health detail' 2024-09-13T03:03:26.144 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T03:03:26.953 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:03:26 smithi089 ceph-mon[91553]: from='client.34516 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T03:03:26.953 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:03:26 smithi089 ceph-mon[91553]: pgmap v243: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:03:27.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:03:26 smithi131 ceph-mon[78839]: from='client.34516 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T03:03:27.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:03:26 smithi131 ceph-mon[78839]: pgmap v243: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:03:27.833 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:27.825+0000 7f6e47abf640 1 -- 172.21.15.89:0/1363788495 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e40102550 msgr2=0x7f6e40102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:03:27.833 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:27.825+0000 7f6e47abf640 1 --2- 172.21.15.89:0/1363788495 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e40102550 0x7f6e40102920 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c0048d0 tx=0x7f6e3c009da0 comp rx=0 tx=0).stop 2024-09-13T03:03:27.833 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:27.825+0000 7f6e47abf640 1 -- 172.21.15.89:0/1363788495 shutdown_connections 2024-09-13T03:03:27.833 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:27.825+0000 7f6e47abf640 1 --2- 172.21.15.89:0/1363788495 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e40102ef0 0x7f6e400fc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:03:27.833 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:27.825+0000 7f6e47abf640 1 --2- 172.21.15.89:0/1363788495 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e40102550 0x7f6e40102920 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:03:27.833 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:27.825+0000 7f6e47abf640 1 -- 172.21.15.89:0/1363788495 >> 172.21.15.89:0/1363788495 conn(0x7f6e400f80f0 msgr2=0x7f6e400fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:03:27.833 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:27.825+0000 7f6e47abf640 1 -- 172.21.15.89:0/1363788495 shutdown_connections 2024-09-13T03:03:27.834 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:27.825+0000 7f6e47abf640 1 -- 172.21.15.89:0/1363788495 wait complete. 2024-09-13T03:03:27.834 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:27.826+0000 7f6e47abf640 1 Processor -- start 2024-09-13T03:03:27.834 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:27.826+0000 7f6e47abf640 1 -- start start 2024-09-13T03:03:27.834 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:27.826+0000 7f6e47abf640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e40102550 0x7f6e401135b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:03:27.834 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:27.826+0000 7f6e47abf640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e40102ef0 0x7f6e40113af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:03:27.834 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:27.826+0000 7f6e47abf640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e401141d0 con 0x7f6e40102550 2024-09-13T03:03:27.834 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:27.826+0000 7f6e47abf640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e4010d550 con 0x7f6e40102ef0 2024-09-13T03:03:27.834 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:27.826+0000 7f6e4585b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e40102550 0x7f6e401135b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:03:27.834 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:27.826+0000 7f6e4585b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e40102550 0x7f6e401135b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40098/0 (socket says 172.21.15.89:40098) 2024-09-13T03:03:27.834 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:27.826+0000 7f6e4585b640 1 -- 172.21.15.89:0/357082074 learned_addr learned my addr 172.21.15.89:0/357082074 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T03:03:27.834 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:27.826+0000 7f6e4505a640 1 --2- 172.21.15.89:0/357082074 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e40102ef0 0x7f6e40113af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:03:27.834 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:27.826+0000 7f6e4585b640 1 -- 172.21.15.89:0/357082074 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e40102ef0 msgr2=0x7f6e40113af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:03:27.834 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:27.826+0000 7f6e4585b640 1 --2- 172.21.15.89:0/357082074 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e40102ef0 0x7f6e40113af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:03:27.835 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:27.826+0000 7f6e4585b640 1 -- 172.21.15.89:0/357082074 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e3c005040 con 0x7f6e40102550 2024-09-13T03:03:27.835 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:27.827+0000 7f6e4585b640 1 --2- 172.21.15.89:0/357082074 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e40102550 0x7f6e401135b0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c000c00 tx=0x7f6e3c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:03:27.835 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:27.827+0000 7f6e367fc640 1 -- 172.21.15.89:0/357082074 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e3c038070 con 0x7f6e40102550 2024-09-13T03:03:27.835 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:27.827+0000 7f6e367fc640 1 -- 172.21.15.89:0/357082074 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f6e3c03daf0 con 0x7f6e40102550 2024-09-13T03:03:27.835 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:27.827+0000 7f6e367fc640 1 -- 172.21.15.89:0/357082074 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6e3c033b20 con 0x7f6e40102550 2024-09-13T03:03:27.835 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:27.827+0000 7f6e47abf640 1 -- 172.21.15.89:0/357082074 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e4010d780 con 0x7f6e40102550 2024-09-13T03:03:27.835 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:27.827+0000 7f6e47abf640 1 -- 172.21.15.89:0/357082074 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e4010dca0 con 0x7f6e40102550 2024-09-13T03:03:27.835 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:27.828+0000 7f6e47abf640 1 -- 172.21.15.89:0/357082074 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e400fdcd0 con 0x7f6e40102550 2024-09-13T03:03:27.835 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:27.828+0000 7f6e367fc640 1 -- 172.21.15.89:0/357082074 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f6e3c030020 con 0x7f6e40102550 2024-09-13T03:03:27.835 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:27.829+0000 7f6e367fc640 1 --2- 172.21.15.89:0/357082074 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f6e2c06e530 0x7f6e2c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:03:27.835 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:27.829+0000 7f6e4505a640 1 --2- 172.21.15.89:0/357082074 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f6e2c06e530 0x7f6e2c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:03:27.836 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:27.829+0000 7f6e367fc640 1 -- 172.21.15.89:0/357082074 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f6e3c0ae350 con 0x7f6e40102550 2024-09-13T03:03:27.836 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:27.829+0000 7f6e4505a640 1 --2- 172.21.15.89:0/357082074 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f6e2c06e530 0x7f6e2c0709e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6e30006fd0 tx=0x7f6e30008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:03:27.836 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:27.834+0000 7f6e367fc640 1 -- 172.21.15.89:0/357082074 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f6e3c0773e0 con 0x7f6e40102550 2024-09-13T03:03:28.068 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:28.066+0000 7f6e47abf640 1 -- 172.21.15.89:0/357082074 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f6e4010ec20 con 0x7f6e40102550 2024-09-13T03:03:28.068 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:28.067+0000 7f6e367fc640 1 -- 172.21.15.89:0/357082074 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f6e3c07aaa0 con 0x7f6e40102550 2024-09-13T03:03:28.068 INFO:teuthology.orchestra.run.smithi089.stdout:HEALTH_OK 2024-09-13T03:03:28.070 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:28.068+0000 7f6e47abf640 1 -- 172.21.15.89:0/357082074 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f6e2c06e530 msgr2=0x7f6e2c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:03:28.070 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:28.068+0000 7f6e47abf640 1 --2- 172.21.15.89:0/357082074 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f6e2c06e530 0x7f6e2c0709e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f6e30006fd0 tx=0x7f6e30008040 comp rx=0 tx=0).stop 2024-09-13T03:03:28.070 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:28.068+0000 7f6e47abf640 1 -- 172.21.15.89:0/357082074 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e40102550 msgr2=0x7f6e401135b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:03:28.070 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:28.068+0000 7f6e47abf640 1 --2- 172.21.15.89:0/357082074 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e40102550 0x7f6e401135b0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c000c00 tx=0x7f6e3c009da0 comp rx=0 tx=0).stop 2024-09-13T03:03:28.070 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:28.069+0000 7f6e47abf640 1 -- 172.21.15.89:0/357082074 shutdown_connections 2024-09-13T03:03:28.070 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:28.069+0000 7f6e47abf640 1 --2- 172.21.15.89:0/357082074 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f6e2c06e530 0x7f6e2c0709e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:03:28.071 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:28.069+0000 7f6e47abf640 1 --2- 172.21.15.89:0/357082074 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6e40102ef0 0x7f6e40113af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:03:28.071 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:28.069+0000 7f6e47abf640 1 --2- 172.21.15.89:0/357082074 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6e40102550 0x7f6e401135b0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:03:28.071 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:28.069+0000 7f6e47abf640 1 -- 172.21.15.89:0/357082074 >> 172.21.15.89:0/357082074 conn(0x7f6e400f80f0 msgr2=0x7f6e400f9180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:03:28.071 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:28.069+0000 7f6e47abf640 1 -- 172.21.15.89:0/357082074 shutdown_connections 2024-09-13T03:03:28.071 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:28.069+0000 7f6e47abf640 1 -- 172.21.15.89:0/357082074 wait complete. 2024-09-13T03:03:28.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:03:28 smithi089 ceph-mon[91553]: pgmap v244: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:03:28.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:03:28 smithi089 ceph-mon[91553]: from='client.? 172.21.15.89:0/357082074' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T03:03:28.851 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -e sha1=7741f7f9ee20524f89b8f61d1609b32fb3b1570a -- bash -c 'ceph versions' 2024-09-13T03:03:29.102 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T03:03:29.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:03:28 smithi131 ceph-mon[78839]: pgmap v244: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:03:29.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:03:28 smithi131 ceph-mon[78839]: from='client.? 172.21.15.89:0/357082074' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-09-13T03:03:30.873 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:30.847+0000 7f450cd4b640 1 -- 172.21.15.89:0/1007738970 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45081014e0 msgr2=0x7f45081018b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:03:30.873 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:30.847+0000 7f450cd4b640 1 --2- 172.21.15.89:0/1007738970 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45081014e0 0x7f45081018b0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f44f80048d0 tx=0x7f44f8009da0 comp rx=0 tx=0).stop 2024-09-13T03:03:30.873 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:30.847+0000 7f450cd4b640 1 -- 172.21.15.89:0/1007738970 shutdown_connections 2024-09-13T03:03:30.873 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:30.847+0000 7f450cd4b640 1 --2- 172.21.15.89:0/1007738970 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f45080fb4a0 0x7f45080fb910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:03:30.873 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:30.847+0000 7f450cd4b640 1 --2- 172.21.15.89:0/1007738970 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45081014e0 0x7f45081018b0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:03:30.873 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:30.847+0000 7f450cd4b640 1 -- 172.21.15.89:0/1007738970 >> 172.21.15.89:0/1007738970 conn(0x7f45080f7060 msgr2=0x7f45080f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:03:30.873 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:30.847+0000 7f450cd4b640 1 -- 172.21.15.89:0/1007738970 shutdown_connections 2024-09-13T03:03:30.874 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:30.847+0000 7f450cd4b640 1 -- 172.21.15.89:0/1007738970 wait complete. 2024-09-13T03:03:30.874 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:30.848+0000 7f450cd4b640 1 Processor -- start 2024-09-13T03:03:30.874 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:30.848+0000 7f450cd4b640 1 -- start start 2024-09-13T03:03:30.874 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:30.848+0000 7f450cd4b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f45080fb4a0 0x7f45081120a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:03:30.874 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:30.848+0000 7f450cd4b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45081014e0 0x7f45081125e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:03:30.874 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:30.848+0000 7f450cd4b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4508112be0 con 0x7f45081014e0 2024-09-13T03:03:30.874 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:30.848+0000 7f450cd4b640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f450810c020 con 0x7f45080fb4a0 2024-09-13T03:03:30.874 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:30.848+0000 7f4505d9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45081014e0 0x7f45081125e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:03:30.874 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:30.848+0000 7f4505d9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45081014e0 0x7f45081125e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40120/0 (socket says 172.21.15.89:40120) 2024-09-13T03:03:30.874 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:30.848+0000 7f4505d9b640 1 -- 172.21.15.89:0/922144346 learned_addr learned my addr 172.21.15.89:0/922144346 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T03:03:30.874 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:30.848+0000 7f450659c640 1 --2- 172.21.15.89:0/922144346 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f45080fb4a0 0x7f45081120a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:03:30.874 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:30.848+0000 7f4505d9b640 1 -- 172.21.15.89:0/922144346 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f45080fb4a0 msgr2=0x7f45081120a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:03:30.874 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:30.848+0000 7f4505d9b640 1 --2- 172.21.15.89:0/922144346 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f45080fb4a0 0x7f45081120a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:03:30.874 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:30.849+0000 7f4505d9b640 1 -- 172.21.15.89:0/922144346 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44f8005040 con 0x7f45081014e0 2024-09-13T03:03:30.875 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:30.849+0000 7f4505d9b640 1 --2- 172.21.15.89:0/922144346 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45081014e0 0x7f45081125e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f44f000c830 tx=0x7f44f0004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:03:30.875 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:30.849+0000 7f44feffd640 1 -- 172.21.15.89:0/922144346 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f44f000a7d0 con 0x7f45081014e0 2024-09-13T03:03:30.875 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:30.849+0000 7f44feffd640 1 -- 172.21.15.89:0/922144346 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f44f000add0 con 0x7f45081014e0 2024-09-13T03:03:30.875 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:30.849+0000 7f450cd4b640 1 -- 172.21.15.89:0/922144346 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f450810c300 con 0x7f45081014e0 2024-09-13T03:03:30.875 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:30.849+0000 7f44feffd640 1 -- 172.21.15.89:0/922144346 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f44f00113a0 con 0x7f45081014e0 2024-09-13T03:03:30.875 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:30.849+0000 7f450cd4b640 1 -- 172.21.15.89:0/922144346 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f450810c8a0 con 0x7f45081014e0 2024-09-13T03:03:30.875 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:30.850+0000 7f450cd4b640 1 -- 172.21.15.89:0/922144346 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45080fcbe0 con 0x7f45081014e0 2024-09-13T03:03:30.875 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:30.850+0000 7f44feffd640 1 -- 172.21.15.89:0/922144346 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f44f0012400 con 0x7f45081014e0 2024-09-13T03:03:30.875 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:30.851+0000 7f44feffd640 1 --2- 172.21.15.89:0/922144346 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f44f406e530 0x7f44f40709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:03:30.875 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:30.851+0000 7f44feffd640 1 -- 172.21.15.89:0/922144346 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f44f008e340 con 0x7f45081014e0 2024-09-13T03:03:30.875 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:30.851+0000 7f450659c640 1 --2- 172.21.15.89:0/922144346 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f44f406e530 0x7f44f40709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:03:30.875 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:30.851+0000 7f450659c640 1 --2- 172.21.15.89:0/922144346 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f44f406e530 0x7f44f40709e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f44f8009ac0 tx=0x7f44f8035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:03:30.875 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:30.855+0000 7f44feffd640 1 -- 172.21.15.89:0/922144346 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f44f00573f0 con 0x7f45081014e0 2024-09-13T03:03:31.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:03:30 smithi089 ceph-mon[91553]: pgmap v245: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T03:03:31.090 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:31.089+0000 7f450cd4b640 1 -- 172.21.15.89:0/922144346 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f45080fac60 con 0x7f45081014e0 2024-09-13T03:03:31.091 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:31.090+0000 7f44feffd640 1 -- 172.21.15.89:0/922144346 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7f44f005aab0 con 0x7f45081014e0 2024-09-13T03:03:31.091 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-13T03:03:31.091 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": { 2024-09-13T03:03:31.091 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 2 2024-09-13T03:03:31.092 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T03:03:31.092 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": { 2024-09-13T03:03:31.092 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 2 2024-09-13T03:03:31.092 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T03:03:31.092 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": { 2024-09-13T03:03:31.092 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 6 2024-09-13T03:03:31.092 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T03:03:31.092 INFO:teuthology.orchestra.run.smithi089.stdout: "mds": { 2024-09-13T03:03:31.092 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 4 2024-09-13T03:03:31.092 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T03:03:31.092 INFO:teuthology.orchestra.run.smithi089.stdout: "overall": { 2024-09-13T03:03:31.092 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 14 2024-09-13T03:03:31.092 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-13T03:03:31.092 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-13T03:03:31.093 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:31.092+0000 7f450cd4b640 1 -- 172.21.15.89:0/922144346 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f44f406e530 msgr2=0x7f44f40709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:03:31.094 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:31.092+0000 7f450cd4b640 1 --2- 172.21.15.89:0/922144346 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f44f406e530 0x7f44f40709e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f44f8009ac0 tx=0x7f44f8035040 comp rx=0 tx=0).stop 2024-09-13T03:03:31.094 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:31.092+0000 7f450cd4b640 1 -- 172.21.15.89:0/922144346 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45081014e0 msgr2=0x7f45081125e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:03:31.094 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:31.092+0000 7f450cd4b640 1 --2- 172.21.15.89:0/922144346 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45081014e0 0x7f45081125e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f44f000c830 tx=0x7f44f0004430 comp rx=0 tx=0).stop 2024-09-13T03:03:31.094 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:31.092+0000 7f450cd4b640 1 -- 172.21.15.89:0/922144346 shutdown_connections 2024-09-13T03:03:31.094 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:31.092+0000 7f450cd4b640 1 --2- 172.21.15.89:0/922144346 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f44f406e530 0x7f44f40709e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:03:31.094 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:31.092+0000 7f450cd4b640 1 --2- 172.21.15.89:0/922144346 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f45081014e0 0x7f45081125e0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:03:31.094 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:31.092+0000 7f450cd4b640 1 --2- 172.21.15.89:0/922144346 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f45080fb4a0 0x7f45081120a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:03:31.094 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:31.092+0000 7f450cd4b640 1 -- 172.21.15.89:0/922144346 >> 172.21.15.89:0/922144346 conn(0x7f45080f7060 msgr2=0x7f45080f7430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:03:31.094 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:31.092+0000 7f450cd4b640 1 -- 172.21.15.89:0/922144346 shutdown_connections 2024-09-13T03:03:31.094 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:03:31.092+0000 7f450cd4b640 1 -- 172.21.15.89:0/922144346 wait complete. 2024-09-13T03:03:31.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:03:30 smithi131 ceph-mon[78839]: pgmap v245: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T03:03:31.734 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -e sha1=7741f7f9ee20524f89b8f61d1609b32fb3b1570a -- bash -c 'echo "wait for servicemap items w/ changing names to refresh"' 2024-09-13T03:03:31.981 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T03:03:32.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:03:31 smithi089 ceph-mon[91553]: from='client.? 172.21.15.89:0/922144346' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:03:32.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:03:31 smithi131 ceph-mon[78839]: from='client.? 172.21.15.89:0/922144346' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:03:33.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:03:32 smithi089 ceph-mon[91553]: pgmap v246: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:03:33.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:03:32 smithi131 ceph-mon[78839]: pgmap v246: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:03:33.747 INFO:teuthology.orchestra.run.smithi089.stdout:wait for servicemap items w/ changing names to refresh 2024-09-13T03:03:34.435 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -e sha1=7741f7f9ee20524f89b8f61d1609b32fb3b1570a -- bash -c 'sleep 60' 2024-09-13T03:03:34.682 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T03:03:35.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:03:34 smithi089 ceph-mon[91553]: pgmap v247: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T03:03:35.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:03:34 smithi131 ceph-mon[78839]: pgmap v247: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T03:03:35.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:03:35 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:03:36.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:03:35 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:03:37.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:03:36 smithi089 ceph-mon[91553]: pgmap v248: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:03:37.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:03:36 smithi131 ceph-mon[78839]: pgmap v248: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:03:39.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:03:38 smithi089 ceph-mon[91553]: pgmap v249: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:03:39.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:03:38 smithi131 ceph-mon[78839]: pgmap v249: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:03:41.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:03:40 smithi089 ceph-mon[91553]: pgmap v250: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T03:03:41.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:03:40 smithi131 ceph-mon[78839]: pgmap v250: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T03:03:43.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:03:42 smithi089 ceph-mon[91553]: pgmap v251: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:03:43.183 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:03:42 smithi131 ceph-mon[78839]: pgmap v251: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:03:45.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:03:44 smithi089 ceph-mon[91553]: pgmap v252: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T03:03:45.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:03:44 smithi131 ceph-mon[78839]: pgmap v252: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T03:03:47.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:03:46 smithi089 ceph-mon[91553]: pgmap v253: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:03:47.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:03:46 smithi131 ceph-mon[78839]: pgmap v253: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:03:49.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:03:48 smithi089 ceph-mon[91553]: pgmap v254: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:03:49.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:03:48 smithi131 ceph-mon[78839]: pgmap v254: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:03:51.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:03:50 smithi089 ceph-mon[91553]: pgmap v255: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T03:03:51.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:03:50 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:03:51.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:03:50 smithi131 ceph-mon[78839]: pgmap v255: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T03:03:51.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:03:50 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:03:53.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:03:52 smithi089 ceph-mon[91553]: pgmap v256: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:03:53.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:03:52 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:03:53.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:03:52 smithi131 ceph-mon[78839]: pgmap v256: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:03:53.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:03:52 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:03:54.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:03:53 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T03:03:54.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:03:53 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T03:03:54.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:03:53 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:03:54.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:03:53 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T03:03:54.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:03:53 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T03:03:54.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:03:53 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:03:55.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:03:54 smithi089 ceph-mon[91553]: pgmap v257: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T03:03:55.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:03:54 smithi131 ceph-mon[78839]: pgmap v257: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T03:03:57.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:03:56 smithi089 ceph-mon[91553]: pgmap v258: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:03:57.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:03:56 smithi131 ceph-mon[78839]: pgmap v258: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:03:59.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:03:58 smithi089 ceph-mon[91553]: pgmap v259: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:03:59.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:03:58 smithi131 ceph-mon[78839]: pgmap v259: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:04:01.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:04:00 smithi089 ceph-mon[91553]: pgmap v260: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T03:04:01.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:04:00 smithi131 ceph-mon[78839]: pgmap v260: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T03:04:03.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:04:02 smithi131 ceph-mon[78839]: pgmap v261: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:04:03.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:04:02 smithi089 ceph-mon[91553]: pgmap v261: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:04:05.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:04:04 smithi131 ceph-mon[78839]: pgmap v262: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T03:04:05.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:04:04 smithi089 ceph-mon[91553]: pgmap v262: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T03:04:06.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:04:05 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:04:06.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:04:05 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:04:07.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:04:06 smithi131 ceph-mon[78839]: pgmap v263: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:04:07.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:04:06 smithi089 ceph-mon[91553]: pgmap v263: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:04:09.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:04:08 smithi131 ceph-mon[78839]: pgmap v264: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:04:09.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:04:08 smithi089 ceph-mon[91553]: pgmap v264: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:04:11.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:04:10 smithi131 ceph-mon[78839]: pgmap v265: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T03:04:11.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:04:10 smithi089 ceph-mon[91553]: pgmap v265: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T03:04:13.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:04:12 smithi131 ceph-mon[78839]: pgmap v266: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:04:13.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:04:12 smithi089 ceph-mon[91553]: pgmap v266: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:04:15.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:04:14 smithi131 ceph-mon[78839]: pgmap v267: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T03:04:15.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:04:14 smithi089 ceph-mon[91553]: pgmap v267: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T03:04:17.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:04:16 smithi131 ceph-mon[78839]: pgmap v268: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:04:17.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:04:16 smithi089 ceph-mon[91553]: pgmap v268: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:04:19.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:04:18 smithi131 ceph-mon[78839]: pgmap v269: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:04:19.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:04:18 smithi089 ceph-mon[91553]: pgmap v269: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:04:21.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:04:20 smithi131 ceph-mon[78839]: pgmap v270: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T03:04:21.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:04:20 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:04:21.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:04:20 smithi089 ceph-mon[91553]: pgmap v270: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T03:04:21.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:04:20 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:04:23.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:04:22 smithi131 ceph-mon[78839]: pgmap v271: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:04:23.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:04:22 smithi089 ceph-mon[91553]: pgmap v271: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:04:25.183 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:04:24 smithi131 ceph-mon[78839]: pgmap v272: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T03:04:25.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:04:24 smithi089 ceph-mon[91553]: pgmap v272: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T03:04:27.183 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:04:26 smithi131 ceph-mon[78839]: pgmap v273: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:04:27.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:04:26 smithi089 ceph-mon[91553]: pgmap v273: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:04:29.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:04:28 smithi131 ceph-mon[78839]: pgmap v274: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:04:29.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:04:28 smithi089 ceph-mon[91553]: pgmap v274: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:04:31.086 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:04:30 smithi089 ceph-mon[91553]: pgmap v275: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T03:04:31.183 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:04:30 smithi131 ceph-mon[78839]: pgmap v275: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T03:04:33.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:04:32 smithi131 ceph-mon[78839]: pgmap v276: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:04:33.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:04:32 smithi089 ceph-mon[91553]: pgmap v276: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:04:35.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:04:34 smithi131 ceph-mon[78839]: pgmap v277: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T03:04:35.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:04:34 smithi089 ceph-mon[91553]: pgmap v277: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T03:04:36.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:04:35 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:04:36.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:04:35 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:04:37.122 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:04:36 smithi089 ceph-mon[91553]: pgmap v278: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:04:37.153 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -e sha1=7741f7f9ee20524f89b8f61d1609b32fb3b1570a -- bash -c 'ceph orch ps' 2024-09-13T03:04:37.183 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:04:36 smithi131 ceph-mon[78839]: pgmap v278: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:04:37.407 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T03:04:39.118 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:04:38 smithi089 ceph-mon[91553]: pgmap v279: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:04:39.140 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:39.117+0000 7fd5abc4f640 1 -- 172.21.15.89:0/3286836602 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd5a40fb810 msgr2=0x7fd5a40fbbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:04:39.140 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:39.117+0000 7fd5abc4f640 1 --2- 172.21.15.89:0/3286836602 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd5a40fb810 0x7fd5a40fbbe0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd594009c50 tx=0x7fd594004d10 comp rx=0 tx=0).stop 2024-09-13T03:04:39.140 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:39.117+0000 7fd5abc4f640 1 -- 172.21.15.89:0/3286836602 shutdown_connections 2024-09-13T03:04:39.140 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:39.117+0000 7fd5abc4f640 1 --2- 172.21.15.89:0/3286836602 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd5a40fcf80 0x7fd5a40fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:39.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:39.117+0000 7fd5abc4f640 1 --2- 172.21.15.89:0/3286836602 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd5a40fb810 0x7fd5a40fbbe0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:39.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:39.117+0000 7fd5abc4f640 1 -- 172.21.15.89:0/3286836602 >> 172.21.15.89:0/3286836602 conn(0x7fd5a40723b0 msgr2=0x7fd5a40727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:04:39.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:39.117+0000 7fd5abc4f640 1 -- 172.21.15.89:0/3286836602 shutdown_connections 2024-09-13T03:04:39.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:39.117+0000 7fd5abc4f640 1 -- 172.21.15.89:0/3286836602 wait complete. 2024-09-13T03:04:39.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:39.117+0000 7fd5abc4f640 1 Processor -- start 2024-09-13T03:04:39.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:39.118+0000 7fd5abc4f640 1 -- start start 2024-09-13T03:04:39.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:39.118+0000 7fd5abc4f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd5a40fb810 0x7fd5a4115400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:04:39.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:39.118+0000 7fd5abc4f640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd5a40fcf80 0x7fd5a4115940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:04:39.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:39.118+0000 7fd5abc4f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a4115fd0 con 0x7fd5a40fb810 2024-09-13T03:04:39.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:39.118+0000 7fd5abc4f640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5a410f410 con 0x7fd5a40fcf80 2024-09-13T03:04:39.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:39.118+0000 7fd5a99eb640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd5a40fb810 0x7fd5a4115400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:04:39.141 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:39.118+0000 7fd5a99eb640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd5a40fb810 0x7fd5a4115400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:58398/0 (socket says 172.21.15.89:58398) 2024-09-13T03:04:39.142 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:39.118+0000 7fd5a99eb640 1 -- 172.21.15.89:0/740838158 learned_addr learned my addr 172.21.15.89:0/740838158 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T03:04:39.142 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:39.118+0000 7fd5a91ea640 1 --2- 172.21.15.89:0/740838158 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd5a40fcf80 0x7fd5a4115940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:04:39.142 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:39.118+0000 7fd5a99eb640 1 -- 172.21.15.89:0/740838158 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd5a40fcf80 msgr2=0x7fd5a4115940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:04:39.142 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:39.118+0000 7fd5a99eb640 1 --2- 172.21.15.89:0/740838158 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd5a40fcf80 0x7fd5a4115940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:39.142 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:39.118+0000 7fd5a99eb640 1 -- 172.21.15.89:0/740838158 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5940098b0 con 0x7fd5a40fb810 2024-09-13T03:04:39.142 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:39.118+0000 7fd5a99eb640 1 --2- 172.21.15.89:0/740838158 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd5a40fb810 0x7fd5a4115400 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd594004a30 tx=0x7fd594004d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:04:39.142 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:39.118+0000 7fd5a27fc640 1 -- 172.21.15.89:0/740838158 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd594009690 con 0x7fd5a40fb810 2024-09-13T03:04:39.142 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:39.119+0000 7fd5a27fc640 1 -- 172.21.15.89:0/740838158 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd594032b10 con 0x7fd5a40fb810 2024-09-13T03:04:39.142 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:39.119+0000 7fd5abc4f640 1 -- 172.21.15.89:0/740838158 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5a410f690 con 0x7fd5a40fb810 2024-09-13T03:04:39.142 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:39.119+0000 7fd5a27fc640 1 -- 172.21.15.89:0/740838158 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd59403daa0 con 0x7fd5a40fb810 2024-09-13T03:04:39.142 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:39.119+0000 7fd5abc4f640 1 -- 172.21.15.89:0/740838158 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5a410fbb0 con 0x7fd5a40fb810 2024-09-13T03:04:39.142 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:39.120+0000 7fd5abc4f640 1 -- 172.21.15.89:0/740838158 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5a40fcbc0 con 0x7fd5a40fb810 2024-09-13T03:04:39.142 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:39.120+0000 7fd5a27fc640 1 -- 172.21.15.89:0/740838158 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fd59402f030 con 0x7fd5a40fb810 2024-09-13T03:04:39.143 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:39.121+0000 7fd5a27fc640 1 --2- 172.21.15.89:0/740838158 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fd58c06e530 0x7fd58c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:04:39.143 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:39.121+0000 7fd5a27fc640 1 -- 172.21.15.89:0/740838158 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fd5940af2a0 con 0x7fd5a40fb810 2024-09-13T03:04:39.143 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:39.121+0000 7fd5a91ea640 1 --2- 172.21.15.89:0/740838158 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fd58c06e530 0x7fd58c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:04:39.143 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:39.121+0000 7fd5a91ea640 1 --2- 172.21.15.89:0/740838158 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fd58c06e530 0x7fd58c0709e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd5a4110d00 tx=0x7fd598009120 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:04:39.143 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:39.125+0000 7fd5a27fc640 1 -- 172.21.15.89:0/740838158 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fd594078330 con 0x7fd5a40fb810 2024-09-13T03:04:39.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:04:38 smithi131 ceph-mon[78839]: pgmap v279: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:04:39.301 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:39.299+0000 7fd5abc4f640 1 -- 172.21.15.89:0/740838158 --> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd5a404b750 con 0x7fd58c06e530 2024-09-13T03:04:39.309 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:39.308+0000 7fd5a27fc640 1 -- 172.21.15.89:0/740838158 <== mgr.34104 v2:172.21.15.89:6800/1881577856 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fd5a404b750 con 0x7fd58c06e530 2024-09-13T03:04:39.309 INFO:teuthology.orchestra.run.smithi089.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-13T03:04:39.310 INFO:teuthology.orchestra.run.smithi089.stdout:alertmanager.smithi089 smithi089 *:9093,9094 running (9m) 111s ago 18m 24.1M - 0.25.0 c8568f914cd2 1d2432f5479e 2024-09-13T03:04:39.310 INFO:teuthology.orchestra.run.smithi089.stdout:crash.smithi089 smithi089 running (7m) 111s ago 18m 6891k - 19.1.1-322-g7741f7f9 19dc8d659727 0ef15ca3e7f9 2024-09-13T03:04:39.310 INFO:teuthology.orchestra.run.smithi089.stdout:crash.smithi131 smithi131 running (7m) 2m ago 17m 6895k - 19.1.1-322-g7741f7f9 19dc8d659727 21e4d6fc04f7 2024-09-13T03:04:39.310 INFO:teuthology.orchestra.run.smithi089.stdout:grafana.smithi089 smithi089 *:3000 running (116s) 111s ago 17m 47.7M - 9.4.12 2bacad6d85d8 9655be7633c3 2024-09-13T03:04:39.310 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi089.qjoitb smithi089 running (3m) 111s ago 12m 70.2M - 19.1.1-322-g7741f7f9 19dc8d659727 e79bfdab021a 2024-09-13T03:04:39.310 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi089.rarddb smithi089 running (2m) 111s ago 12m 15.1M - 19.1.1-322-g7741f7f9 19dc8d659727 40413b0e466c 2024-09-13T03:04:39.310 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi131.rbovzc smithi131 running (2m) 2m ago 12m 12.9M - 19.1.1-322-g7741f7f9 19dc8d659727 3461afdce9c5 2024-09-13T03:04:39.310 INFO:teuthology.orchestra.run.smithi089.stdout:mds.cephfs.smithi131.uasrkg smithi131 running (2m) 2m ago 12m 12.2M - 19.1.1-322-g7741f7f9 19dc8d659727 95f4ff9e971a 2024-09-13T03:04:39.310 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.smithi089.guohvs smithi089 *:8443,9283,8765 running (8m) 111s ago 19m 514M - 19.1.1-322-g7741f7f9 19dc8d659727 1e887446f1b0 2024-09-13T03:04:39.310 INFO:teuthology.orchestra.run.smithi089.stdout:mgr.smithi131.aunbqd smithi131 *:8443,9283,8765 running (8m) 2m ago 17m 441M - 19.1.1-322-g7741f7f9 19dc8d659727 358d7478f2ba 2024-09-13T03:04:39.310 INFO:teuthology.orchestra.run.smithi089.stdout:mon.smithi089 smithi089 running (8m) 111s ago 19m 52.8M 2048M 19.1.1-322-g7741f7f9 19dc8d659727 8a29fb65028f 2024-09-13T03:04:39.310 INFO:teuthology.orchestra.run.smithi089.stdout:mon.smithi131 smithi131 running (7m) 2m ago 17m 41.9M 2048M 19.1.1-322-g7741f7f9 19dc8d659727 506310ad8620 2024-09-13T03:04:39.311 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.smithi089 smithi089 *:9100 running (9m) 111s ago 18m 16.7M - 1.5.0 0da6a335fe13 5a9927b583e6 2024-09-13T03:04:39.311 INFO:teuthology.orchestra.run.smithi089.stdout:node-exporter.smithi131 smithi131 *:9100 running (8m) 2m ago 17m 15.5M - 1.5.0 0da6a335fe13 bcfde5d1a508 2024-09-13T03:04:39.311 INFO:teuthology.orchestra.run.smithi089.stdout:osd.0 smithi089 running (6m) 111s ago 16m 107M 1557M 19.1.1-322-g7741f7f9 19dc8d659727 e8038f6d52b6 2024-09-13T03:04:39.311 INFO:teuthology.orchestra.run.smithi089.stdout:osd.1 smithi089 running (6m) 111s ago 16m 109M 1557M 19.1.1-322-g7741f7f9 19dc8d659727 e174144d9633 2024-09-13T03:04:39.311 INFO:teuthology.orchestra.run.smithi089.stdout:osd.2 smithi089 running (5m) 111s ago 15m 96.8M 1557M 19.1.1-322-g7741f7f9 19dc8d659727 2d8cab08c2b3 2024-09-13T03:04:39.311 INFO:teuthology.orchestra.run.smithi089.stdout:osd.3 smithi131 running (5m) 2m ago 15m 116M 2581M 19.1.1-322-g7741f7f9 19dc8d659727 e77cff624869 2024-09-13T03:04:39.311 INFO:teuthology.orchestra.run.smithi089.stdout:osd.4 smithi131 running (4m) 2m ago 14m 104M 2581M 19.1.1-322-g7741f7f9 19dc8d659727 0317e6a4a04c 2024-09-13T03:04:39.311 INFO:teuthology.orchestra.run.smithi089.stdout:osd.5 smithi131 running (4m) 2m ago 14m 91.3M 2581M 19.1.1-322-g7741f7f9 19dc8d659727 e7d2a780f4e0 2024-09-13T03:04:39.311 INFO:teuthology.orchestra.run.smithi089.stdout:prometheus.smithi089 smithi089 *:9095 running (8m) 111s ago 17m 67.5M - 2.43.0 a07b618ecd1d 9d336370c187 2024-09-13T03:04:39.312 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:39.310+0000 7fd5abc4f640 1 -- 172.21.15.89:0/740838158 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fd58c06e530 msgr2=0x7fd58c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:04:39.312 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:39.310+0000 7fd5abc4f640 1 --2- 172.21.15.89:0/740838158 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fd58c06e530 0x7fd58c0709e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fd5a4110d00 tx=0x7fd598009120 comp rx=0 tx=0).stop 2024-09-13T03:04:39.312 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:39.310+0000 7fd5abc4f640 1 -- 172.21.15.89:0/740838158 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd5a40fb810 msgr2=0x7fd5a4115400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:04:39.312 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:39.310+0000 7fd5abc4f640 1 --2- 172.21.15.89:0/740838158 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd5a40fb810 0x7fd5a4115400 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fd594004a30 tx=0x7fd594004d10 comp rx=0 tx=0).stop 2024-09-13T03:04:39.312 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:39.310+0000 7fd5abc4f640 1 -- 172.21.15.89:0/740838158 shutdown_connections 2024-09-13T03:04:39.312 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:39.310+0000 7fd5abc4f640 1 --2- 172.21.15.89:0/740838158 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fd58c06e530 0x7fd58c0709e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:39.312 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:39.310+0000 7fd5abc4f640 1 --2- 172.21.15.89:0/740838158 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd5a40fcf80 0x7fd5a4115940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:39.312 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:39.310+0000 7fd5abc4f640 1 --2- 172.21.15.89:0/740838158 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd5a40fb810 0x7fd5a4115400 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:39.313 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:39.310+0000 7fd5abc4f640 1 -- 172.21.15.89:0/740838158 >> 172.21.15.89:0/740838158 conn(0x7fd5a40723b0 msgr2=0x7fd5a4064f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:04:39.313 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:39.310+0000 7fd5abc4f640 1 -- 172.21.15.89:0/740838158 shutdown_connections 2024-09-13T03:04:39.313 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:39.310+0000 7fd5abc4f640 1 -- 172.21.15.89:0/740838158 wait complete. 2024-09-13T03:04:39.936 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -e sha1=7741f7f9ee20524f89b8f61d1609b32fb3b1570a -- bash -c 'ceph versions' 2024-09-13T03:04:40.194 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T03:04:41.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:04:40 smithi131 ceph-mon[78839]: from='client.34528 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T03:04:41.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:04:40 smithi131 ceph-mon[78839]: pgmap v280: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T03:04:41.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:04:40 smithi089 ceph-mon[91553]: from='client.34528 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-13T03:04:41.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:04:40 smithi089 ceph-mon[91553]: pgmap v280: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T03:04:41.855 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:41.841+0000 7ff26a766640 1 -- 172.21.15.89:0/2144047394 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff264102530 msgr2=0x7ff264102900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:04:41.855 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:41.841+0000 7ff26a766640 1 --2- 172.21.15.89:0/2144047394 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff264102530 0x7ff264102900 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7ff2540048d0 tx=0x7ff254009da0 comp rx=0 tx=0).stop 2024-09-13T03:04:41.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:41.841+0000 7ff26a766640 1 -- 172.21.15.89:0/2144047394 shutdown_connections 2024-09-13T03:04:41.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:41.841+0000 7ff26a766640 1 --2- 172.21.15.89:0/2144047394 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff264102ed0 0x7ff2640fc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:41.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:41.841+0000 7ff26a766640 1 --2- 172.21.15.89:0/2144047394 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff264102530 0x7ff264102900 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:41.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:41.841+0000 7ff26a766640 1 -- 172.21.15.89:0/2144047394 >> 172.21.15.89:0/2144047394 conn(0x7ff2640f80f0 msgr2=0x7ff2640fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:04:41.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:41.841+0000 7ff26a766640 1 -- 172.21.15.89:0/2144047394 shutdown_connections 2024-09-13T03:04:41.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:41.841+0000 7ff26a766640 1 -- 172.21.15.89:0/2144047394 wait complete. 2024-09-13T03:04:41.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:41.841+0000 7ff26a766640 1 Processor -- start 2024-09-13T03:04:41.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:41.842+0000 7ff26a766640 1 -- start start 2024-09-13T03:04:41.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:41.842+0000 7ff26a766640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff264102530 0x7ff264113240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:04:41.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:41.842+0000 7ff26a766640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff264102ed0 0x7ff264113780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:04:41.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:41.842+0000 7ff26a766640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff264113d80 con 0x7ff264102ed0 2024-09-13T03:04:41.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:41.842+0000 7ff26a766640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff26410d1c0 con 0x7ff264102530 2024-09-13T03:04:41.856 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:41.842+0000 7ff2637fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff264102ed0 0x7ff264113780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:04:41.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:41.842+0000 7ff2637fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff264102ed0 0x7ff264113780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:38908/0 (socket says 172.21.15.89:38908) 2024-09-13T03:04:41.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:41.842+0000 7ff2637fe640 1 -- 172.21.15.89:0/882958139 learned_addr learned my addr 172.21.15.89:0/882958139 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T03:04:41.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:41.842+0000 7ff263fff640 1 --2- 172.21.15.89:0/882958139 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff264102530 0x7ff264113240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:04:41.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:41.842+0000 7ff2637fe640 1 -- 172.21.15.89:0/882958139 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff264102530 msgr2=0x7ff264113240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:04:41.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:41.842+0000 7ff2637fe640 1 --2- 172.21.15.89:0/882958139 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff264102530 0x7ff264113240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:41.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:41.842+0000 7ff2637fe640 1 -- 172.21.15.89:0/882958139 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff254005040 con 0x7ff264102ed0 2024-09-13T03:04:41.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:41.842+0000 7ff2637fe640 1 --2- 172.21.15.89:0/882958139 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff264102ed0 0x7ff264113780 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff258002840 tx=0x7ff258004570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:04:41.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:41.843+0000 7ff260ff9640 1 -- 172.21.15.89:0/882958139 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff258007c30 con 0x7ff264102ed0 2024-09-13T03:04:41.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:41.843+0000 7ff260ff9640 1 -- 172.21.15.89:0/882958139 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff25800f040 con 0x7ff264102ed0 2024-09-13T03:04:41.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:41.843+0000 7ff26a766640 1 -- 172.21.15.89:0/882958139 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff26410d4a0 con 0x7ff264102ed0 2024-09-13T03:04:41.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:41.843+0000 7ff260ff9640 1 -- 172.21.15.89:0/882958139 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff25800d990 con 0x7ff264102ed0 2024-09-13T03:04:41.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:41.843+0000 7ff26a766640 1 -- 172.21.15.89:0/882958139 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff26410da40 con 0x7ff264102ed0 2024-09-13T03:04:41.857 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:41.844+0000 7ff26a766640 1 -- 172.21.15.89:0/882958139 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2640fdcb0 con 0x7ff264102ed0 2024-09-13T03:04:41.858 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:41.844+0000 7ff260ff9640 1 -- 172.21.15.89:0/882958139 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7ff25800dbc0 con 0x7ff264102ed0 2024-09-13T03:04:41.858 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:41.845+0000 7ff260ff9640 1 --2- 172.21.15.89:0/882958139 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7ff24c06e530 0x7ff24c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:04:41.858 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:41.845+0000 7ff263fff640 1 --2- 172.21.15.89:0/882958139 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7ff24c06e530 0x7ff24c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:04:41.858 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:41.845+0000 7ff260ff9640 1 -- 172.21.15.89:0/882958139 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6582+0+0 (secure 0 0 0) 0x7ff25808d910 con 0x7ff264102ed0 2024-09-13T03:04:41.858 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:41.845+0000 7ff263fff640 1 --2- 172.21.15.89:0/882958139 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7ff24c06e530 0x7ff24c0709e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff254009ac0 tx=0x7ff254035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:04:41.858 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:41.849+0000 7ff260ff9640 1 -- 172.21.15.89:0/882958139 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7ff258056a50 con 0x7ff264102ed0 2024-09-13T03:04:42.086 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:42.085+0000 7ff26a766640 1 -- 172.21.15.89:0/882958139 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff2641095a0 con 0x7ff264102ed0 2024-09-13T03:04:42.087 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:42.085+0000 7ff260ff9640 1 -- 172.21.15.89:0/882958139 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7ff25805a110 con 0x7ff264102ed0 2024-09-13T03:04:42.087 INFO:teuthology.orchestra.run.smithi089.stdout:{ 2024-09-13T03:04:42.087 INFO:teuthology.orchestra.run.smithi089.stdout: "mon": { 2024-09-13T03:04:42.087 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 2 2024-09-13T03:04:42.087 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T03:04:42.087 INFO:teuthology.orchestra.run.smithi089.stdout: "mgr": { 2024-09-13T03:04:42.087 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 2 2024-09-13T03:04:42.087 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T03:04:42.087 INFO:teuthology.orchestra.run.smithi089.stdout: "osd": { 2024-09-13T03:04:42.087 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 6 2024-09-13T03:04:42.087 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T03:04:42.088 INFO:teuthology.orchestra.run.smithi089.stdout: "mds": { 2024-09-13T03:04:42.088 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 4 2024-09-13T03:04:42.088 INFO:teuthology.orchestra.run.smithi089.stdout: }, 2024-09-13T03:04:42.088 INFO:teuthology.orchestra.run.smithi089.stdout: "overall": { 2024-09-13T03:04:42.088 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)": 14 2024-09-13T03:04:42.088 INFO:teuthology.orchestra.run.smithi089.stdout: } 2024-09-13T03:04:42.088 INFO:teuthology.orchestra.run.smithi089.stdout:} 2024-09-13T03:04:42.089 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:42.087+0000 7ff26a766640 1 -- 172.21.15.89:0/882958139 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7ff24c06e530 msgr2=0x7ff24c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:04:42.089 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:42.087+0000 7ff26a766640 1 --2- 172.21.15.89:0/882958139 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7ff24c06e530 0x7ff24c0709e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7ff254009ac0 tx=0x7ff254035040 comp rx=0 tx=0).stop 2024-09-13T03:04:42.089 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:42.087+0000 7ff26a766640 1 -- 172.21.15.89:0/882958139 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff264102ed0 msgr2=0x7ff264113780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:04:42.089 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:42.087+0000 7ff26a766640 1 --2- 172.21.15.89:0/882958139 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff264102ed0 0x7ff264113780 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ff258002840 tx=0x7ff258004570 comp rx=0 tx=0).stop 2024-09-13T03:04:42.089 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:42.087+0000 7ff26a766640 1 -- 172.21.15.89:0/882958139 shutdown_connections 2024-09-13T03:04:42.089 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:42.087+0000 7ff26a766640 1 --2- 172.21.15.89:0/882958139 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7ff24c06e530 0x7ff24c0709e0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:42.089 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:42.087+0000 7ff26a766640 1 --2- 172.21.15.89:0/882958139 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff264102ed0 0x7ff264113780 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:42.089 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:42.087+0000 7ff26a766640 1 --2- 172.21.15.89:0/882958139 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff264102530 0x7ff264113240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:42.089 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:42.087+0000 7ff26a766640 1 -- 172.21.15.89:0/882958139 >> 172.21.15.89:0/882958139 conn(0x7ff2640f80f0 msgr2=0x7ff2640f90f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:04:42.089 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:42.088+0000 7ff26a766640 1 -- 172.21.15.89:0/882958139 shutdown_connections 2024-09-13T03:04:42.090 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:42.088+0000 7ff26a766640 1 -- 172.21.15.89:0/882958139 wait complete. 2024-09-13T03:04:42.810 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -e sha1=7741f7f9ee20524f89b8f61d1609b32fb3b1570a -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2024-09-13T03:04:43.059 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T03:04:43.179 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:04:42 smithi089 ceph-mon[91553]: pgmap v281: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:04:43.179 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:04:42 smithi089 ceph-mon[91553]: from='client.? 172.21.15.89:0/882958139' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:04:43.183 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:04:42 smithi131 ceph-mon[78839]: pgmap v281: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:04:43.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:04:42 smithi131 ceph-mon[78839]: from='client.? 172.21.15.89:0/882958139' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:04:44.745 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:44.716+0000 7f87f20c5640 1 -- 172.21.15.89:0/1250428186 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f87ec1014b0 msgr2=0x7f87ec101880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:04:44.745 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:44.716+0000 7f87f20c5640 1 --2- 172.21.15.89:0/1250428186 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f87ec1014b0 0x7f87ec101880 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f87dc0048d0 tx=0x7f87dc009da0 comp rx=0 tx=0).stop 2024-09-13T03:04:44.745 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:44.716+0000 7f87f20c5640 1 -- 172.21.15.89:0/1250428186 shutdown_connections 2024-09-13T03:04:44.746 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:44.716+0000 7f87f20c5640 1 --2- 172.21.15.89:0/1250428186 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f87ec0fb470 0x7f87ec0fb8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:44.746 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:44.716+0000 7f87f20c5640 1 --2- 172.21.15.89:0/1250428186 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f87ec1014b0 0x7f87ec101880 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:44.746 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:44.716+0000 7f87f20c5640 1 -- 172.21.15.89:0/1250428186 >> 172.21.15.89:0/1250428186 conn(0x7f87ec0f7030 msgr2=0x7f87ec0f9440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:04:44.746 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:44.716+0000 7f87f20c5640 1 -- 172.21.15.89:0/1250428186 shutdown_connections 2024-09-13T03:04:44.746 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:44.716+0000 7f87f20c5640 1 -- 172.21.15.89:0/1250428186 wait complete. 2024-09-13T03:04:44.746 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:44.716+0000 7f87f20c5640 1 Processor -- start 2024-09-13T03:04:44.746 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:44.716+0000 7f87f20c5640 1 -- start start 2024-09-13T03:04:44.746 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:44.717+0000 7f87f20c5640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f87ec0fb470 0x7f87ec1131a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:04:44.746 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:44.717+0000 7f87f20c5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f87ec1014b0 0x7f87ec1136e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:04:44.746 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:44.717+0000 7f87f20c5640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87ec113ce0 con 0x7f87ec1014b0 2024-09-13T03:04:44.746 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:44.717+0000 7f87f20c5640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87ec10d120 con 0x7f87ec0fb470 2024-09-13T03:04:44.747 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:44.717+0000 7f87eaffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f87ec1014b0 0x7f87ec1136e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:04:44.747 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:44.717+0000 7f87eaffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f87ec1014b0 0x7f87ec1136e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:38924/0 (socket says 172.21.15.89:38924) 2024-09-13T03:04:44.747 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:44.717+0000 7f87eaffd640 1 -- 172.21.15.89:0/3979438164 learned_addr learned my addr 172.21.15.89:0/3979438164 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T03:04:44.747 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:44.717+0000 7f87eb7fe640 1 --2- 172.21.15.89:0/3979438164 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f87ec0fb470 0x7f87ec1131a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:04:44.747 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:44.717+0000 7f87eaffd640 1 -- 172.21.15.89:0/3979438164 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f87ec0fb470 msgr2=0x7f87ec1131a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:04:44.747 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:44.717+0000 7f87eaffd640 1 --2- 172.21.15.89:0/3979438164 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f87ec0fb470 0x7f87ec1131a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:44.747 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:44.717+0000 7f87eaffd640 1 -- 172.21.15.89:0/3979438164 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87dc005040 con 0x7f87ec1014b0 2024-09-13T03:04:44.747 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:44.717+0000 7f87eaffd640 1 --2- 172.21.15.89:0/3979438164 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f87ec1014b0 0x7f87ec1136e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f87e000c790 tx=0x7f87e00043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:04:44.747 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:44.717+0000 7f87d3fff640 1 -- 172.21.15.89:0/3979438164 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f87e000a7a0 con 0x7f87ec1014b0 2024-09-13T03:04:44.747 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:44.717+0000 7f87f20c5640 1 -- 172.21.15.89:0/3979438164 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87ec10d400 con 0x7f87ec1014b0 2024-09-13T03:04:44.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:44.717+0000 7f87d3fff640 1 -- 172.21.15.89:0/3979438164 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f87e000ada0 con 0x7f87ec1014b0 2024-09-13T03:04:44.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:44.717+0000 7f87d3fff640 1 -- 172.21.15.89:0/3979438164 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f87e00113a0 con 0x7f87ec1014b0 2024-09-13T03:04:44.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:44.717+0000 7f87f20c5640 1 -- 172.21.15.89:0/3979438164 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87ec10d9a0 con 0x7f87ec1014b0 2024-09-13T03:04:44.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:44.718+0000 7f87f20c5640 1 -- 172.21.15.89:0/3979438164 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87ec0fcbb0 con 0x7f87ec1014b0 2024-09-13T03:04:44.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:44.719+0000 7f87d3fff640 1 -- 172.21.15.89:0/3979438164 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f87e000a900 con 0x7f87ec1014b0 2024-09-13T03:04:44.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:44.719+0000 7f87d3fff640 1 --2- 172.21.15.89:0/3979438164 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f87d406e530 0x7f87d40709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:04:44.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:44.719+0000 7f87d3fff640 1 -- 172.21.15.89:0/3979438164 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f87e008e2a0 con 0x7f87ec1014b0 2024-09-13T03:04:44.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:44.719+0000 7f87eb7fe640 1 --2- 172.21.15.89:0/3979438164 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f87d406e530 0x7f87d40709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:04:44.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:44.720+0000 7f87eb7fe640 1 --2- 172.21.15.89:0/3979438164 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f87d406e530 0x7f87d40709e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f87dc009ac0 tx=0x7f87dc035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:04:44.748 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:44.724+0000 7f87d3fff640 1 -- 172.21.15.89:0/3979438164 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f87e00573b0 con 0x7f87ec1014b0 2024-09-13T03:04:44.961 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:44.960+0000 7f87f20c5640 1 -- 172.21.15.89:0/3979438164 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f87ec108450 con 0x7f87ec1014b0 2024-09-13T03:04:44.962 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:44.960+0000 7f87d3fff640 1 -- 172.21.15.89:0/3979438164 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7f87e005aa70 con 0x7f87ec1014b0 2024-09-13T03:04:44.963 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:44.962+0000 7f87f20c5640 1 -- 172.21.15.89:0/3979438164 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f87d406e530 msgr2=0x7f87d40709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:04:44.964 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:44.962+0000 7f87f20c5640 1 --2- 172.21.15.89:0/3979438164 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f87d406e530 0x7f87d40709e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f87dc009ac0 tx=0x7f87dc035040 comp rx=0 tx=0).stop 2024-09-13T03:04:44.964 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:44.962+0000 7f87f20c5640 1 -- 172.21.15.89:0/3979438164 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f87ec1014b0 msgr2=0x7f87ec1136e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:04:44.964 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:44.962+0000 7f87f20c5640 1 --2- 172.21.15.89:0/3979438164 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f87ec1014b0 0x7f87ec1136e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f87e000c790 tx=0x7f87e00043c0 comp rx=0 tx=0).stop 2024-09-13T03:04:44.964 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:44.962+0000 7f87f20c5640 1 -- 172.21.15.89:0/3979438164 shutdown_connections 2024-09-13T03:04:44.964 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:44.962+0000 7f87f20c5640 1 --2- 172.21.15.89:0/3979438164 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f87d406e530 0x7f87d40709e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:44.964 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:44.962+0000 7f87f20c5640 1 --2- 172.21.15.89:0/3979438164 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f87ec1014b0 0x7f87ec1136e0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:44.964 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:44.962+0000 7f87f20c5640 1 --2- 172.21.15.89:0/3979438164 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f87ec0fb470 0x7f87ec1131a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:44.964 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:44.962+0000 7f87f20c5640 1 -- 172.21.15.89:0/3979438164 >> 172.21.15.89:0/3979438164 conn(0x7f87ec0f7030 msgr2=0x7f87ec0f7400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:04:44.964 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:44.963+0000 7f87f20c5640 1 -- 172.21.15.89:0/3979438164 shutdown_connections 2024-09-13T03:04:44.964 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:44.963+0000 7f87f20c5640 1 -- 172.21.15.89:0/3979438164 wait complete. 2024-09-13T03:04:44.972 INFO:teuthology.orchestra.run.smithi089.stdout:true 2024-09-13T03:04:45.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:04:44 smithi089 ceph-mon[91553]: pgmap v282: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T03:04:45.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:04:44 smithi131 ceph-mon[78839]: pgmap v282: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T03:04:45.686 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -e sha1=7741f7f9ee20524f89b8f61d1609b32fb3b1570a -- bash -c 'ceph versions | jq -e '"'"'.overall | keys'"'"' | grep $sha1' 2024-09-13T03:04:45.931 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T03:04:46.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:04:45 smithi089 ceph-mon[91553]: from='client.? 172.21.15.89:0/3979438164' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:04:46.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:04:45 smithi131 ceph-mon[78839]: from='client.? 172.21.15.89:0/3979438164' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:04:47.141 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:04:46 smithi089 ceph-mon[91553]: pgmap v283: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:04:47.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:04:46 smithi131 ceph-mon[78839]: pgmap v283: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:04:47.686 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:47.682+0000 7f5833044640 1 -- 172.21.15.89:0/614425330 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f582c0fcf80 msgr2=0x7f582c0fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:04:47.686 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:47.682+0000 7f5833044640 1 --2- 172.21.15.89:0/614425330 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f582c0fcf80 0x7f582c0fd3d0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f58140048d0 tx=0x7f5814009da0 comp rx=0 tx=0).stop 2024-09-13T03:04:47.686 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:47.682+0000 7f5833044640 1 -- 172.21.15.89:0/614425330 shutdown_connections 2024-09-13T03:04:47.686 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:47.682+0000 7f5833044640 1 --2- 172.21.15.89:0/614425330 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f582c0fcf80 0x7f582c0fd3d0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:47.686 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:47.682+0000 7f5833044640 1 --2- 172.21.15.89:0/614425330 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f582c0fb810 0x7f582c0fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:47.687 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:47.682+0000 7f5833044640 1 -- 172.21.15.89:0/614425330 >> 172.21.15.89:0/614425330 conn(0x7f582c0723b0 msgr2=0x7f582c0727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:04:47.687 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:47.682+0000 7f5833044640 1 -- 172.21.15.89:0/614425330 shutdown_connections 2024-09-13T03:04:47.687 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:47.682+0000 7f5833044640 1 -- 172.21.15.89:0/614425330 wait complete. 2024-09-13T03:04:47.687 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:47.683+0000 7f5833044640 1 Processor -- start 2024-09-13T03:04:47.687 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:47.683+0000 7f5833044640 1 -- start start 2024-09-13T03:04:47.687 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:47.683+0000 7f5833044640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f582c0fb810 0x7f582c1131b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:04:47.687 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:47.683+0000 7f5833044640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f582c0fcf80 0x7f582c1136f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:04:47.687 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:47.683+0000 7f5833044640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f582c113cf0 con 0x7f582c0fcf80 2024-09-13T03:04:47.687 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:47.683+0000 7f5833044640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f582c10d130 con 0x7f582c0fb810 2024-09-13T03:04:47.687 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:47.684+0000 7f582bfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f582c0fcf80 0x7f582c1136f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:04:47.687 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:47.684+0000 7f582bfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f582c0fcf80 0x7f582c1136f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:38938/0 (socket says 172.21.15.89:38938) 2024-09-13T03:04:47.687 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:47.684+0000 7f582bfff640 1 -- 172.21.15.89:0/1945207186 learned_addr learned my addr 172.21.15.89:0/1945207186 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T03:04:47.687 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:47.684+0000 7f5830de0640 1 --2- 172.21.15.89:0/1945207186 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f582c0fb810 0x7f582c1131b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:04:47.687 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:47.684+0000 7f582bfff640 1 -- 172.21.15.89:0/1945207186 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f582c0fb810 msgr2=0x7f582c1131b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:04:47.688 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:47.684+0000 7f582bfff640 1 --2- 172.21.15.89:0/1945207186 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f582c0fb810 0x7f582c1131b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:47.688 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:47.684+0000 7f582bfff640 1 -- 172.21.15.89:0/1945207186 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5814005040 con 0x7f582c0fcf80 2024-09-13T03:04:47.688 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:47.684+0000 7f582bfff640 1 --2- 172.21.15.89:0/1945207186 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f582c0fcf80 0x7f582c1136f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5814000c00 tx=0x7f5814009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:04:47.689 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:47.684+0000 7f58297fa640 1 -- 172.21.15.89:0/1945207186 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5814038070 con 0x7f582c0fcf80 2024-09-13T03:04:47.689 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:47.684+0000 7f5833044640 1 -- 172.21.15.89:0/1945207186 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f582c10d3b0 con 0x7f582c0fcf80 2024-09-13T03:04:47.689 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:47.684+0000 7f58297fa640 1 -- 172.21.15.89:0/1945207186 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f581402ade0 con 0x7f582c0fcf80 2024-09-13T03:04:47.689 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:47.684+0000 7f58297fa640 1 -- 172.21.15.89:0/1945207186 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f581402c7b0 con 0x7f582c0fcf80 2024-09-13T03:04:47.689 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:47.684+0000 7f5833044640 1 -- 172.21.15.89:0/1945207186 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f582c10d8f0 con 0x7f582c0fcf80 2024-09-13T03:04:47.690 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:47.685+0000 7f5833044640 1 -- 172.21.15.89:0/1945207186 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f582c0fcbc0 con 0x7f582c0fcf80 2024-09-13T03:04:47.690 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:47.686+0000 7f58297fa640 1 -- 172.21.15.89:0/1945207186 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f5814030020 con 0x7f582c0fcf80 2024-09-13T03:04:47.690 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:47.686+0000 7f58297fa640 1 --2- 172.21.15.89:0/1945207186 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f581806e530 0x7f58180709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:04:47.690 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:47.687+0000 7f58297fa640 1 -- 172.21.15.89:0/1945207186 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f58140ae620 con 0x7f582c0fcf80 2024-09-13T03:04:47.690 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:47.687+0000 7f5830de0640 1 --2- 172.21.15.89:0/1945207186 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f581806e530 0x7f58180709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:04:47.690 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:47.687+0000 7f5830de0640 1 --2- 172.21.15.89:0/1945207186 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f581806e530 0x7f58180709e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5824009af0 tx=0x7f582400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:04:47.693 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:47.691+0000 7f58297fa640 1 -- 172.21.15.89:0/1945207186 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f58140776b0 con 0x7f582c0fcf80 2024-09-13T03:04:47.927 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:47.925+0000 7f5833044640 1 -- 172.21.15.89:0/1945207186 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f582c10e820 con 0x7f582c0fcf80 2024-09-13T03:04:47.927 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:47.925+0000 7f58297fa640 1 -- 172.21.15.89:0/1945207186 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+633 (secure 0 0 0) 0x7f581407ad70 con 0x7f582c0fcf80 2024-09-13T03:04:47.932 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:47.927+0000 7f5833044640 1 -- 172.21.15.89:0/1945207186 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f581806e530 msgr2=0x7f58180709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:04:47.932 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:47.927+0000 7f5833044640 1 --2- 172.21.15.89:0/1945207186 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f581806e530 0x7f58180709e0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f5824009af0 tx=0x7f582400b040 comp rx=0 tx=0).stop 2024-09-13T03:04:47.932 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:47.927+0000 7f5833044640 1 -- 172.21.15.89:0/1945207186 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f582c0fcf80 msgr2=0x7f582c1136f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:04:47.932 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:47.927+0000 7f5833044640 1 --2- 172.21.15.89:0/1945207186 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f582c0fcf80 0x7f582c1136f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5814000c00 tx=0x7f5814009da0 comp rx=0 tx=0).stop 2024-09-13T03:04:47.932 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:47.927+0000 7f5833044640 1 -- 172.21.15.89:0/1945207186 shutdown_connections 2024-09-13T03:04:47.932 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:47.927+0000 7f5833044640 1 --2- 172.21.15.89:0/1945207186 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f581806e530 0x7f58180709e0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:47.933 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:47.927+0000 7f5833044640 1 --2- 172.21.15.89:0/1945207186 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f582c0fcf80 0x7f582c1136f0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:47.933 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:47.927+0000 7f5833044640 1 --2- 172.21.15.89:0/1945207186 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f582c0fb810 0x7f582c1131b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:47.933 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:47.927+0000 7f5833044640 1 -- 172.21.15.89:0/1945207186 >> 172.21.15.89:0/1945207186 conn(0x7f582c0723b0 msgr2=0x7f582c0fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:04:47.933 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:47.927+0000 7f5833044640 1 -- 172.21.15.89:0/1945207186 shutdown_connections 2024-09-13T03:04:47.933 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:47.927+0000 7f5833044640 1 -- 172.21.15.89:0/1945207186 wait complete. 2024-09-13T03:04:47.938 INFO:teuthology.orchestra.run.smithi089.stdout: "ceph version 19.1.1-322-g7741f7f9 (7741f7f9ee20524f89b8f61d1609b32fb3b1570a) squid (stable)" 2024-09-13T03:04:48.615 DEBUG:teuthology.parallel:result is None 2024-09-13T03:04:48.615 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-13T03:04:48.626 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi089.front.sepia.ceph.com 2024-09-13T03:04:48.626 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-13T03:04:48.874 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T03:04:49.121 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:04:48 smithi089 ceph-mon[91553]: pgmap v284: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:04:49.121 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:04:48 smithi089 ceph-mon[91553]: from='client.? 172.21.15.89:0/1945207186' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:04:49.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:04:48 smithi131 ceph-mon[78839]: pgmap v284: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:04:49.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:04:48 smithi131 ceph-mon[78839]: from='client.? 172.21.15.89:0/1945207186' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-09-13T03:04:50.557 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:50.549+0000 7f4f2c39d640 1 -- 172.21.15.89:0/4223230276 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4f24102530 msgr2=0x7f4f24102900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:04:50.558 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:50.549+0000 7f4f2c39d640 1 --2- 172.21.15.89:0/4223230276 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4f24102530 0x7f4f24102900 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f4f200048d0 tx=0x7f4f20009da0 comp rx=0 tx=0).stop 2024-09-13T03:04:50.558 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:50.549+0000 7f4f2c39d640 1 -- 172.21.15.89:0/4223230276 shutdown_connections 2024-09-13T03:04:50.558 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:50.549+0000 7f4f2c39d640 1 --2- 172.21.15.89:0/4223230276 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4f24102ed0 0x7f4f240fc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:50.558 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:50.549+0000 7f4f2c39d640 1 --2- 172.21.15.89:0/4223230276 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4f24102530 0x7f4f24102900 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:50.558 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:50.549+0000 7f4f2c39d640 1 -- 172.21.15.89:0/4223230276 >> 172.21.15.89:0/4223230276 conn(0x7f4f240f80f0 msgr2=0x7f4f240fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:04:50.558 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:50.549+0000 7f4f2c39d640 1 -- 172.21.15.89:0/4223230276 shutdown_connections 2024-09-13T03:04:50.558 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:50.549+0000 7f4f2c39d640 1 -- 172.21.15.89:0/4223230276 wait complete. 2024-09-13T03:04:50.558 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:50.550+0000 7f4f2c39d640 1 Processor -- start 2024-09-13T03:04:50.558 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:50.550+0000 7f4f2c39d640 1 -- start start 2024-09-13T03:04:50.558 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:50.550+0000 7f4f2c39d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4f24102530 0x7f4f24113210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:04:50.558 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:50.550+0000 7f4f2c39d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4f24102ed0 0x7f4f24113750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:04:50.558 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:50.550+0000 7f4f2c39d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f24113d50 con 0x7f4f24102530 2024-09-13T03:04:50.559 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:50.550+0000 7f4f2c39d640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f2410d190 con 0x7f4f24102ed0 2024-09-13T03:04:50.559 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:50.550+0000 7f4f2a139640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4f24102530 0x7f4f24113210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:04:50.559 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:50.550+0000 7f4f2a139640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4f24102530 0x7f4f24113210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:38964/0 (socket says 172.21.15.89:38964) 2024-09-13T03:04:50.559 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:50.550+0000 7f4f2a139640 1 -- 172.21.15.89:0/232882546 learned_addr learned my addr 172.21.15.89:0/232882546 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T03:04:50.559 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:50.550+0000 7f4f29938640 1 --2- 172.21.15.89:0/232882546 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4f24102ed0 0x7f4f24113750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:04:50.559 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:50.550+0000 7f4f2a139640 1 -- 172.21.15.89:0/232882546 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4f24102ed0 msgr2=0x7f4f24113750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:04:50.559 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:50.550+0000 7f4f2a139640 1 --2- 172.21.15.89:0/232882546 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4f24102ed0 0x7f4f24113750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:50.559 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:50.550+0000 7f4f2a139640 1 -- 172.21.15.89:0/232882546 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f20005040 con 0x7f4f24102530 2024-09-13T03:04:50.559 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:50.550+0000 7f4f2a139640 1 --2- 172.21.15.89:0/232882546 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4f24102530 0x7f4f24113210 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f4f20003080 tx=0x7f4f20009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:04:50.559 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:50.551+0000 7f4f16ffd640 1 -- 172.21.15.89:0/232882546 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f20038070 con 0x7f4f24102530 2024-09-13T03:04:50.559 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:50.551+0000 7f4f2c39d640 1 -- 172.21.15.89:0/232882546 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f2410d410 con 0x7f4f24102530 2024-09-13T03:04:50.559 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:50.551+0000 7f4f16ffd640 1 -- 172.21.15.89:0/232882546 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4f200097e0 con 0x7f4f24102530 2024-09-13T03:04:50.559 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:50.551+0000 7f4f16ffd640 1 -- 172.21.15.89:0/232882546 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4f2003d420 con 0x7f4f24102530 2024-09-13T03:04:50.560 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:50.551+0000 7f4f2c39d640 1 -- 172.21.15.89:0/232882546 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f2410d950 con 0x7f4f24102530 2024-09-13T03:04:50.560 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:50.552+0000 7f4f2c39d640 1 -- 172.21.15.89:0/232882546 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f240fdcb0 con 0x7f4f24102530 2024-09-13T03:04:50.560 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:50.552+0000 7f4f16ffd640 1 -- 172.21.15.89:0/232882546 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f4f20030020 con 0x7f4f24102530 2024-09-13T03:04:50.560 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:50.552+0000 7f4f16ffd640 1 --2- 172.21.15.89:0/232882546 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f4f1006e530 0x7f4f100709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:04:50.560 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:50.553+0000 7f4f16ffd640 1 -- 172.21.15.89:0/232882546 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f4f200ae780 con 0x7f4f24102530 2024-09-13T03:04:50.560 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:50.553+0000 7f4f29938640 1 --2- 172.21.15.89:0/232882546 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f4f1006e530 0x7f4f100709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:04:50.560 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:50.553+0000 7f4f29938640 1 --2- 172.21.15.89:0/232882546 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f4f1006e530 0x7f4f100709e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4f2410ead0 tx=0x7f4f18009040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:04:50.560 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:50.557+0000 7f4f16ffd640 1 -- 172.21.15.89:0/232882546 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f4f20077810 con 0x7f4f24102530 2024-09-13T03:04:50.773 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:50.771+0000 7f4f2c39d640 1 -- 172.21.15.89:0/232882546 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f4f2404b720 con 0x7f4f24102530 2024-09-13T03:04:50.774 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:50.771+0000 7f4f16ffd640 1 -- 172.21.15.89:0/232882546 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 43 v43) v1 ==== 76+0+2004 (secure 0 0 0) 0x7f4f2007aed0 con 0x7f4f24102530 2024-09-13T03:04:50.774 INFO:teuthology.orchestra.run.smithi089.stdout:e43 2024-09-13T03:04:50.774 INFO:teuthology.orchestra.run.smithi089.stdout:btime 2024-09-13T03:02:30:387200+0000 2024-09-13T03:04:50.774 INFO:teuthology.orchestra.run.smithi089.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-13T03:04:50.774 INFO:teuthology.orchestra.run.smithi089.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-09-13T03:04:50.774 INFO:teuthology.orchestra.run.smithi089.stdout:legacy client fscid: 1 2024-09-13T03:04:50.774 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T03:04:50.774 INFO:teuthology.orchestra.run.smithi089.stdout:Filesystem 'cephfs' (1) 2024-09-13T03:04:50.775 INFO:teuthology.orchestra.run.smithi089.stdout:fs_name cephfs 2024-09-13T03:04:50.775 INFO:teuthology.orchestra.run.smithi089.stdout:epoch 43 2024-09-13T03:04:50.775 INFO:teuthology.orchestra.run.smithi089.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-13T03:04:50.775 INFO:teuthology.orchestra.run.smithi089.stdout:created 2024-09-13T02:51:40.657817+0000 2024-09-13T03:04:50.775 INFO:teuthology.orchestra.run.smithi089.stdout:modified 2024-09-13T03:02:30.387186+0000 2024-09-13T03:04:50.775 INFO:teuthology.orchestra.run.smithi089.stdout:tableserver 0 2024-09-13T03:04:50.775 INFO:teuthology.orchestra.run.smithi089.stdout:root 0 2024-09-13T03:04:50.775 INFO:teuthology.orchestra.run.smithi089.stdout:session_timeout 60 2024-09-13T03:04:50.775 INFO:teuthology.orchestra.run.smithi089.stdout:session_autoclose 300 2024-09-13T03:04:50.775 INFO:teuthology.orchestra.run.smithi089.stdout:max_file_size 1099511627776 2024-09-13T03:04:50.775 INFO:teuthology.orchestra.run.smithi089.stdout:max_xattr_size 65536 2024-09-13T03:04:50.775 INFO:teuthology.orchestra.run.smithi089.stdout:required_client_features {} 2024-09-13T03:04:50.775 INFO:teuthology.orchestra.run.smithi089.stdout:last_failure 0 2024-09-13T03:04:50.775 INFO:teuthology.orchestra.run.smithi089.stdout:last_failure_osd_epoch 80 2024-09-13T03:04:50.775 INFO:teuthology.orchestra.run.smithi089.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-13T03:04:50.776 INFO:teuthology.orchestra.run.smithi089.stdout:max_mds 2 2024-09-13T03:04:50.776 INFO:teuthology.orchestra.run.smithi089.stdout:in 0,1 2024-09-13T03:04:50.776 INFO:teuthology.orchestra.run.smithi089.stdout:up {0=34416,1=34448} 2024-09-13T03:04:50.776 INFO:teuthology.orchestra.run.smithi089.stdout:failed 2024-09-13T03:04:50.776 INFO:teuthology.orchestra.run.smithi089.stdout:damaged 2024-09-13T03:04:50.776 INFO:teuthology.orchestra.run.smithi089.stdout:stopped 2024-09-13T03:04:50.776 INFO:teuthology.orchestra.run.smithi089.stdout:data_pools [3] 2024-09-13T03:04:50.776 INFO:teuthology.orchestra.run.smithi089.stdout:metadata_pool 2 2024-09-13T03:04:50.776 INFO:teuthology.orchestra.run.smithi089.stdout:inline_data disabled 2024-09-13T03:04:50.776 INFO:teuthology.orchestra.run.smithi089.stdout:balancer 2024-09-13T03:04:50.776 INFO:teuthology.orchestra.run.smithi089.stdout:bal_rank_mask -1 2024-09-13T03:04:50.776 INFO:teuthology.orchestra.run.smithi089.stdout:standby_count_wanted 1 2024-09-13T03:04:50.776 INFO:teuthology.orchestra.run.smithi089.stdout:qdb_cluster leader: 34416 members: 34448,34416 2024-09-13T03:04:50.777 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi089.qjoitb{0:34416} state up:active seq 8 join_fscid=1 addr [v2:172.21.15.89:6826/2439422546,v1:172.21.15.89:6827/2439422546] compat {c=[1],r=[1],i=[1fff]}] 2024-09-13T03:04:50.777 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi131.uasrkg{0:44355} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.131:6824/2298563432,v1:172.21.15.131:6825/2298563432] compat {c=[1],r=[1],i=[1fff]}] 2024-09-13T03:04:50.777 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi089.rarddb{1:34448} state up:active seq 12 join_fscid=1 addr [v2:172.21.15.89:6828/177758677,v1:172.21.15.89:6829/177758677] compat {c=[1],r=[1],i=[1fff]}] 2024-09-13T03:04:50.777 INFO:teuthology.orchestra.run.smithi089.stdout:[mds.cephfs.smithi131.rbovzc{1:44385} state up:standby-replay seq 1 join_fscid=1 addr [v2:172.21.15.131:6826/2680433683,v1:172.21.15.131:6827/2680433683] compat {c=[1],r=[1],i=[1fff]}] 2024-09-13T03:04:50.777 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T03:04:50.777 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T03:04:50.777 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 43 2024-09-13T03:04:50.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:50.773+0000 7f4f2c39d640 1 -- 172.21.15.89:0/232882546 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f4f1006e530 msgr2=0x7f4f100709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:04:50.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:50.773+0000 7f4f2c39d640 1 --2- 172.21.15.89:0/232882546 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f4f1006e530 0x7f4f100709e0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4f2410ead0 tx=0x7f4f18009040 comp rx=0 tx=0).stop 2024-09-13T03:04:50.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:50.773+0000 7f4f2c39d640 1 -- 172.21.15.89:0/232882546 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4f24102530 msgr2=0x7f4f24113210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:04:50.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:50.773+0000 7f4f2c39d640 1 --2- 172.21.15.89:0/232882546 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4f24102530 0x7f4f24113210 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f4f20003080 tx=0x7f4f20009da0 comp rx=0 tx=0).stop 2024-09-13T03:04:50.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:50.773+0000 7f4f2c39d640 1 -- 172.21.15.89:0/232882546 shutdown_connections 2024-09-13T03:04:50.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:50.773+0000 7f4f2c39d640 1 --2- 172.21.15.89:0/232882546 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f4f1006e530 0x7f4f100709e0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:50.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:50.773+0000 7f4f2c39d640 1 --2- 172.21.15.89:0/232882546 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4f24102ed0 0x7f4f24113750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:50.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:50.773+0000 7f4f2c39d640 1 --2- 172.21.15.89:0/232882546 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4f24102530 0x7f4f24113210 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:50.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:50.774+0000 7f4f2c39d640 1 -- 172.21.15.89:0/232882546 >> 172.21.15.89:0/232882546 conn(0x7f4f240f80f0 msgr2=0x7f4f240f9100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:04:50.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:50.774+0000 7f4f2c39d640 1 -- 172.21.15.89:0/232882546 shutdown_connections 2024-09-13T03:04:50.778 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:50.774+0000 7f4f2c39d640 1 -- 172.21.15.89:0/232882546 wait complete. 2024-09-13T03:04:51.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:04:50 smithi089 ceph-mon[91553]: pgmap v285: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T03:04:51.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:04:50 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:04:51.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:04:50 smithi089 ceph-mon[91553]: from='client.? 172.21.15.89:0/232882546' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T03:04:51.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:04:50 smithi131 ceph-mon[78839]: pgmap v285: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T03:04:51.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:04:50 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:04:51.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:04:50 smithi131 ceph-mon[78839]: from='client.? 172.21.15.89:0/232882546' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-13T03:04:51.413 INFO:teuthology.run_tasks:Running task fs.post_upgrade_checks... 2024-09-13T03:04:51.426 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-13T03:04:51.673 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T03:04:53.146 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:04:52 smithi089 ceph-mon[91553]: pgmap v286: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:04:53.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:04:52 smithi131 ceph-mon[78839]: pgmap v286: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:04:53.420 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:53.392+0000 7ff5db28d640 1 -- 172.21.15.89:0/1786764677 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff5d40fcf80 msgr2=0x7ff5d40fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:04:53.420 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:53.392+0000 7ff5db28d640 1 --2- 172.21.15.89:0/1786764677 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff5d40fcf80 0x7ff5d40fd3d0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff5c80048d0 tx=0x7ff5c8009da0 comp rx=0 tx=0).stop 2024-09-13T03:04:53.420 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:53.392+0000 7ff5db28d640 1 -- 172.21.15.89:0/1786764677 shutdown_connections 2024-09-13T03:04:53.421 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:53.392+0000 7ff5db28d640 1 --2- 172.21.15.89:0/1786764677 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff5d40fcf80 0x7ff5d40fd3d0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:53.421 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:53.392+0000 7ff5db28d640 1 --2- 172.21.15.89:0/1786764677 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5d40fb810 0x7ff5d40fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:53.421 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:53.392+0000 7ff5db28d640 1 -- 172.21.15.89:0/1786764677 >> 172.21.15.89:0/1786764677 conn(0x7ff5d40723b0 msgr2=0x7ff5d40727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:04:53.421 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:53.392+0000 7ff5db28d640 1 -- 172.21.15.89:0/1786764677 shutdown_connections 2024-09-13T03:04:53.421 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:53.392+0000 7ff5db28d640 1 -- 172.21.15.89:0/1786764677 wait complete. 2024-09-13T03:04:53.421 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:53.392+0000 7ff5db28d640 1 Processor -- start 2024-09-13T03:04:53.421 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:53.392+0000 7ff5db28d640 1 -- start start 2024-09-13T03:04:53.421 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:53.393+0000 7ff5db28d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff5d40fb810 0x7ff5d41120d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:04:53.421 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:53.393+0000 7ff5db28d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5d40fcf80 0x7ff5d4112610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:04:53.421 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:53.393+0000 7ff5db28d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d4112c10 con 0x7ff5d40fb810 2024-09-13T03:04:53.421 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:53.393+0000 7ff5db28d640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5d410c050 con 0x7ff5d40fcf80 2024-09-13T03:04:53.422 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:53.393+0000 7ff5d9029640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff5d40fb810 0x7ff5d41120d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:04:53.422 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:53.393+0000 7ff5d9029640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff5d40fb810 0x7ff5d41120d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40166/0 (socket says 172.21.15.89:40166) 2024-09-13T03:04:53.422 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:53.393+0000 7ff5d9029640 1 -- 172.21.15.89:0/2447338800 learned_addr learned my addr 172.21.15.89:0/2447338800 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T03:04:53.422 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:53.393+0000 7ff5d8828640 1 --2- 172.21.15.89:0/2447338800 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5d40fcf80 0x7ff5d4112610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:04:53.422 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:53.393+0000 7ff5d9029640 1 -- 172.21.15.89:0/2447338800 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5d40fcf80 msgr2=0x7ff5d4112610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:04:53.422 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:53.393+0000 7ff5d9029640 1 --2- 172.21.15.89:0/2447338800 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5d40fcf80 0x7ff5d4112610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:53.422 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:53.393+0000 7ff5d9029640 1 -- 172.21.15.89:0/2447338800 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5c8005040 con 0x7ff5d40fb810 2024-09-13T03:04:53.422 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:53.393+0000 7ff5d9029640 1 --2- 172.21.15.89:0/2447338800 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff5d40fb810 0x7ff5d41120d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff5c400fce0 tx=0x7ff5c4004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:04:53.422 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:53.393+0000 7ff5d1ffb640 1 -- 172.21.15.89:0/2447338800 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff5c400de30 con 0x7ff5d40fb810 2024-09-13T03:04:53.422 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:53.393+0000 7ff5d1ffb640 1 -- 172.21.15.89:0/2447338800 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff5c40090d0 con 0x7ff5d40fb810 2024-09-13T03:04:53.422 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:53.393+0000 7ff5db28d640 1 -- 172.21.15.89:0/2447338800 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5d410c2d0 con 0x7ff5d40fb810 2024-09-13T03:04:53.422 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:53.393+0000 7ff5d1ffb640 1 -- 172.21.15.89:0/2447338800 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff5c40126a0 con 0x7ff5d40fb810 2024-09-13T03:04:53.422 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:53.394+0000 7ff5db28d640 1 -- 172.21.15.89:0/2447338800 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5d410c840 con 0x7ff5d40fb810 2024-09-13T03:04:53.422 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:53.395+0000 7ff5db28d640 1 -- 172.21.15.89:0/2447338800 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5d40fcbc0 con 0x7ff5d40fb810 2024-09-13T03:04:53.422 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:53.395+0000 7ff5d1ffb640 1 -- 172.21.15.89:0/2447338800 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7ff5c4009240 con 0x7ff5d40fb810 2024-09-13T03:04:53.423 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:53.395+0000 7ff5d1ffb640 1 --2- 172.21.15.89:0/2447338800 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7ff5bc06e530 0x7ff5bc0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:04:53.423 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:53.396+0000 7ff5d1ffb640 1 -- 172.21.15.89:0/2447338800 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6582+0+0 (secure 0 0 0) 0x7ff5c4090640 con 0x7ff5d40fb810 2024-09-13T03:04:53.423 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:53.396+0000 7ff5d8828640 1 --2- 172.21.15.89:0/2447338800 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7ff5bc06e530 0x7ff5bc0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:04:53.423 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:53.396+0000 7ff5d8828640 1 --2- 172.21.15.89:0/2447338800 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7ff5bc06e530 0x7ff5bc0709e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff5c8009ac0 tx=0x7ff5c8035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:04:53.423 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:53.400+0000 7ff5d1ffb640 1 -- 172.21.15.89:0/2447338800 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7ff5c4059800 con 0x7ff5d40fb810 2024-09-13T03:04:53.620 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:53.619+0000 7ff5db28d640 1 -- 172.21.15.89:0/2447338800 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff5d410d740 con 0x7ff5d40fb810 2024-09-13T03:04:53.621 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:53.620+0000 7ff5d1ffb640 1 -- 172.21.15.89:0/2447338800 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+5290 (secure 0 0 0) 0x7ff5c405cec0 con 0x7ff5d40fb810 2024-09-13T03:04:53.621 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T03:04:53.622 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":43,"btime":"2024-09-13T03:02:30:387200+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":43,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T02:51:40.657817+0000","modified":"2024-09-13T03:02:30.387186+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34416,"mds_1":34448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34416":{"gid":34416,"name":"cephfs.smithi089.qjoitb","rank":0,"incarnation":32,"state":"up:active","state_seq":8,"addr":"172.21.15.89:6827/2439422546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2439422546},{"type":"v1","addr":"172.21.15.89:6827","nonce":2439422546}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34448":{"gid":34448,"name":"cephfs.smithi089.rarddb","rank":1,"incarnation":41,"state":"up:active","state_seq":12,"addr":"172.21.15.89:6829/177758677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":177758677},{"type":"v1","addr":"172.21.15.89:6829","nonce":177758677}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_44355":{"gid":44355,"name":"cephfs.smithi131.uasrkg","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6825/2298563432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":2298563432},{"type":"v1","addr":"172.21.15.131:6825","nonce":2298563432}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_44385":{"gid":44385,"name":"cephfs.smithi131.rbovzc","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.131:6827/2680433683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":2680433683},{"type":"v1","addr":"172.21.15.131:6827","nonce":2680433683}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34416,"qdb_cluster":[34448,34416]},"id":1}]} 2024-09-13T03:04:53.622 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 43 2024-09-13T03:04:53.623 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:53.622+0000 7ff5db28d640 1 -- 172.21.15.89:0/2447338800 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7ff5bc06e530 msgr2=0x7ff5bc0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:04:53.624 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:53.622+0000 7ff5db28d640 1 --2- 172.21.15.89:0/2447338800 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7ff5bc06e530 0x7ff5bc0709e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7ff5c8009ac0 tx=0x7ff5c8035040 comp rx=0 tx=0).stop 2024-09-13T03:04:53.624 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:53.622+0000 7ff5db28d640 1 -- 172.21.15.89:0/2447338800 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff5d40fb810 msgr2=0x7ff5d41120d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:04:53.624 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:53.622+0000 7ff5db28d640 1 --2- 172.21.15.89:0/2447338800 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff5d40fb810 0x7ff5d41120d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7ff5c400fce0 tx=0x7ff5c4004600 comp rx=0 tx=0).stop 2024-09-13T03:04:53.624 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:53.622+0000 7ff5db28d640 1 -- 172.21.15.89:0/2447338800 shutdown_connections 2024-09-13T03:04:53.624 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:53.622+0000 7ff5db28d640 1 --2- 172.21.15.89:0/2447338800 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7ff5bc06e530 0x7ff5bc0709e0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:53.624 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:53.622+0000 7ff5db28d640 1 --2- 172.21.15.89:0/2447338800 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff5d40fcf80 0x7ff5d4112610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:53.624 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:53.622+0000 7ff5db28d640 1 --2- 172.21.15.89:0/2447338800 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff5d40fb810 0x7ff5d41120d0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:53.624 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:53.622+0000 7ff5db28d640 1 -- 172.21.15.89:0/2447338800 >> 172.21.15.89:0/2447338800 conn(0x7ff5d40723b0 msgr2=0x7ff5d40fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:04:53.624 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:53.622+0000 7ff5db28d640 1 -- 172.21.15.89:0/2447338800 shutdown_connections 2024-09-13T03:04:53.624 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:53.622+0000 7ff5db28d640 1 -- 172.21.15.89:0/2447338800 wait complete. 2024-09-13T03:04:54.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:04:53 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:04:54.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:04:53 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T03:04:54.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:04:53 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T03:04:54.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:04:53 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:04:54.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:04:53 smithi131 ceph-mon[78839]: from='client.? 172.21.15.89:0/2447338800' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T03:04:54.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:04:53 smithi131 ceph-mon[78839]: pgmap v287: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T03:04:54.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:04:53 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:04:54.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:04:53 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T03:04:54.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:04:53 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T03:04:54.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:04:53 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:04:54.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:04:53 smithi089 ceph-mon[91553]: from='client.? 172.21.15.89:0/2447338800' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-13T03:04:54.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:04:53 smithi089 ceph-mon[91553]: pgmap v287: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T03:04:54.336 DEBUG:tasks.fs:checking fs fscid=1,name=cephfs state = {'epoch': 19, 'max_mds': 2, 'flags': 50} 2024-09-13T03:04:54.336 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 20 2024-09-13T03:04:54.582 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T03:04:56.187 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:56.162+0000 7f1e6c302640 1 -- 172.21.15.89:0/1573741380 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1e64102530 msgr2=0x7f1e64102900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:04:56.188 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:56.162+0000 7f1e6c302640 1 --2- 172.21.15.89:0/1573741380 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1e64102530 0x7f1e64102900 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f1e600048d0 tx=0x7f1e60009da0 comp rx=0 tx=0).stop 2024-09-13T03:04:56.188 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:56.162+0000 7f1e6c302640 1 -- 172.21.15.89:0/1573741380 shutdown_connections 2024-09-13T03:04:56.188 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:56.162+0000 7f1e6c302640 1 --2- 172.21.15.89:0/1573741380 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1e64102ed0 0x7f1e640fc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:56.188 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:56.162+0000 7f1e6c302640 1 --2- 172.21.15.89:0/1573741380 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1e64102530 0x7f1e64102900 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:56.188 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:56.162+0000 7f1e6c302640 1 -- 172.21.15.89:0/1573741380 >> 172.21.15.89:0/1573741380 conn(0x7f1e640f80f0 msgr2=0x7f1e640fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:04:56.188 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:56.162+0000 7f1e6c302640 1 -- 172.21.15.89:0/1573741380 shutdown_connections 2024-09-13T03:04:56.188 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:56.162+0000 7f1e6c302640 1 -- 172.21.15.89:0/1573741380 wait complete. 2024-09-13T03:04:56.189 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:56.163+0000 7f1e6c302640 1 Processor -- start 2024-09-13T03:04:56.189 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:56.163+0000 7f1e6c302640 1 -- start start 2024-09-13T03:04:56.189 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:56.163+0000 7f1e6c302640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1e64102530 0x7f1e64113250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:04:56.189 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:56.163+0000 7f1e6c302640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1e64102ed0 0x7f1e64113790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:04:56.189 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:56.163+0000 7f1e6c302640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e64113e20 con 0x7f1e64102530 2024-09-13T03:04:56.189 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:56.163+0000 7f1e6c302640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6410d1d0 con 0x7f1e64102ed0 2024-09-13T03:04:56.189 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:56.163+0000 7f1e6a09e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1e64102530 0x7f1e64113250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:04:56.189 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:56.163+0000 7f1e6a09e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1e64102530 0x7f1e64113250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40190/0 (socket says 172.21.15.89:40190) 2024-09-13T03:04:56.189 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:56.163+0000 7f1e6a09e640 1 -- 172.21.15.89:0/1569705107 learned_addr learned my addr 172.21.15.89:0/1569705107 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T03:04:56.190 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:56.163+0000 7f1e6a09e640 1 -- 172.21.15.89:0/1569705107 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1e64102ed0 msgr2=0x7f1e64113790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:04:56.190 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:56.163+0000 7f1e6a09e640 1 --2- 172.21.15.89:0/1569705107 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1e64102ed0 0x7f1e64113790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:56.190 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:56.163+0000 7f1e6a09e640 1 -- 172.21.15.89:0/1569705107 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e60005040 con 0x7f1e64102530 2024-09-13T03:04:56.190 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:56.163+0000 7f1e6a09e640 1 --2- 172.21.15.89:0/1569705107 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1e64102530 0x7f1e64113250 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f1e60000c00 tx=0x7f1e60009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:04:56.190 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:56.164+0000 7f1e5affd640 1 -- 172.21.15.89:0/1569705107 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e60038070 con 0x7f1e64102530 2024-09-13T03:04:56.190 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:56.164+0000 7f1e5affd640 1 -- 172.21.15.89:0/1569705107 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f1e6003daf0 con 0x7f1e64102530 2024-09-13T03:04:56.190 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:56.164+0000 7f1e6c302640 1 -- 172.21.15.89:0/1569705107 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e6410d450 con 0x7f1e64102530 2024-09-13T03:04:56.190 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:56.164+0000 7f1e5affd640 1 -- 172.21.15.89:0/1569705107 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1e60033b20 con 0x7f1e64102530 2024-09-13T03:04:56.190 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:56.164+0000 7f1e6c302640 1 -- 172.21.15.89:0/1569705107 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e6410d970 con 0x7f1e64102530 2024-09-13T03:04:56.191 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:56.165+0000 7f1e6c302640 1 -- 172.21.15.89:0/1569705107 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e640fdcb0 con 0x7f1e64102530 2024-09-13T03:04:56.191 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:56.165+0000 7f1e5affd640 1 -- 172.21.15.89:0/1569705107 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f1e60030020 con 0x7f1e64102530 2024-09-13T03:04:56.191 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:56.166+0000 7f1e5affd640 1 --2- 172.21.15.89:0/1569705107 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f1e5006e530 0x7f1e500709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:04:56.191 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:56.166+0000 7f1e6989d640 1 --2- 172.21.15.89:0/1569705107 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f1e5006e530 0x7f1e500709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:04:56.191 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:56.166+0000 7f1e5affd640 1 -- 172.21.15.89:0/1569705107 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f1e600ae430 con 0x7f1e64102530 2024-09-13T03:04:56.191 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:56.166+0000 7f1e6989d640 1 --2- 172.21.15.89:0/1569705107 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f1e5006e530 0x7f1e500709e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1e6410eb10 tx=0x7f1e54006d20 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:04:56.191 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:56.170+0000 7f1e5affd640 1 -- 172.21.15.89:0/1569705107 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f1e60077570 con 0x7f1e64102530 2024-09-13T03:04:56.372 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:56.370+0000 7f1e6c302640 1 -- 172.21.15.89:0/1569705107 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 20, "format": "json"} v 0) v1 -- 0x7f1e640fbd30 con 0x7f1e64102530 2024-09-13T03:04:56.372 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:56.371+0000 7f1e5affd640 1 -- 172.21.15.89:0/1569705107 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 20, "format": "json"}]=0 dumped fsmap epoch 20 v43) v1 ==== 107+0+4931 (secure 0 0 0) 0x7f1e6007ac30 con 0x7f1e64102530 2024-09-13T03:04:56.373 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T03:04:56.373 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":20,"btime":"1970-01-01T00:00:00:000000+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":20,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T02:51:40.657817+0000","modified":"2024-09-13T02:53:29.634977+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":44,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14480,"mds_1":24257},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14480":{"gid":14480,"name":"cephfs.smithi089.rarddb","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.89:6829/1561365213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1561365213},{"type":"v1","addr":"172.21.15.89:6829","nonce":1561365213}]},"join_fscid":1,"export_targets":[1],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14488":{"gid":14488,"name":"cephfs.smithi089.qjoitb","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.89:6827/1464393547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1464393547},{"type":"v1","addr":"172.21.15.89:6827","nonce":1464393547}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24257":{"gid":24257,"name":"cephfs.smithi131.uasrkg","rank":1,"incarnation":7,"state":"up:active","state_seq":4,"addr":"172.21.15.131:6825/260493836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":260493836},{"type":"v1","addr":"172.21.15.131:6825","nonce":260493836}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24265":{"gid":24265,"name":"cephfs.smithi131.rbovzc","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":2,"addr":"172.21.15.131:6827/665579373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":665579373},{"type":"v1","addr":"172.21.15.131:6827","nonce":665579373}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-13T03:04:56.373 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 20 2024-09-13T03:04:56.374 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:56.373+0000 7f1e6c302640 1 -- 172.21.15.89:0/1569705107 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f1e5006e530 msgr2=0x7f1e500709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:04:56.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:56.373+0000 7f1e6c302640 1 --2- 172.21.15.89:0/1569705107 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f1e5006e530 0x7f1e500709e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f1e6410eb10 tx=0x7f1e54006d20 comp rx=0 tx=0).stop 2024-09-13T03:04:56.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:56.373+0000 7f1e6c302640 1 -- 172.21.15.89:0/1569705107 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1e64102530 msgr2=0x7f1e64113250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:04:56.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:56.373+0000 7f1e6c302640 1 --2- 172.21.15.89:0/1569705107 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1e64102530 0x7f1e64113250 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f1e60000c00 tx=0x7f1e60009da0 comp rx=0 tx=0).stop 2024-09-13T03:04:56.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:56.373+0000 7f1e6c302640 1 -- 172.21.15.89:0/1569705107 shutdown_connections 2024-09-13T03:04:56.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:56.373+0000 7f1e6c302640 1 --2- 172.21.15.89:0/1569705107 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f1e5006e530 0x7f1e500709e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:56.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:56.373+0000 7f1e6c302640 1 --2- 172.21.15.89:0/1569705107 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f1e64102ed0 0x7f1e64113790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:56.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:56.373+0000 7f1e6c302640 1 --2- 172.21.15.89:0/1569705107 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f1e64102530 0x7f1e64113250 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:56.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:56.373+0000 7f1e6c302640 1 -- 172.21.15.89:0/1569705107 >> 172.21.15.89:0/1569705107 conn(0x7f1e640f80f0 msgr2=0x7f1e640f9140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:04:56.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:56.373+0000 7f1e6c302640 1 -- 172.21.15.89:0/1569705107 shutdown_connections 2024-09-13T03:04:56.375 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:56.373+0000 7f1e6c302640 1 -- 172.21.15.89:0/1569705107 wait complete. 2024-09-13T03:04:57.024 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:04:56 smithi089 ceph-mon[91553]: pgmap v288: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:04:57.024 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:04:56 smithi089 ceph-mon[91553]: from='client.? 172.21.15.89:0/1569705107' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-09-13T03:04:57.049 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 21 2024-09-13T03:04:57.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:04:56 smithi131 ceph-mon[78839]: pgmap v288: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:04:57.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:04:56 smithi131 ceph-mon[78839]: from='client.? 172.21.15.89:0/1569705107' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-09-13T03:04:57.296 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T03:04:58.962 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:04:58 smithi089 ceph-mon[91553]: pgmap v289: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:04:58.992 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:58.959+0000 7f913e11b640 1 -- 172.21.15.89:0/2319624251 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9138102ef0 msgr2=0x7f91380fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:04:58.993 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:58.959+0000 7f913e11b640 1 --2- 172.21.15.89:0/2319624251 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9138102ef0 0x7f91380fc5b0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f912c0048d0 tx=0x7f912c009da0 comp rx=0 tx=0).stop 2024-09-13T03:04:58.993 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:58.959+0000 7f913e11b640 1 -- 172.21.15.89:0/2319624251 shutdown_connections 2024-09-13T03:04:58.993 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:58.959+0000 7f913e11b640 1 --2- 172.21.15.89:0/2319624251 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9138102ef0 0x7f91380fc5b0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:58.993 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:58.959+0000 7f913e11b640 1 --2- 172.21.15.89:0/2319624251 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9138102550 0x7f9138102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:58.993 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:58.959+0000 7f913e11b640 1 -- 172.21.15.89:0/2319624251 >> 172.21.15.89:0/2319624251 conn(0x7f91380f80f0 msgr2=0x7f91380fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:04:58.993 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:58.959+0000 7f913e11b640 1 -- 172.21.15.89:0/2319624251 shutdown_connections 2024-09-13T03:04:58.993 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:58.959+0000 7f913e11b640 1 -- 172.21.15.89:0/2319624251 wait complete. 2024-09-13T03:04:58.993 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:58.960+0000 7f913e11b640 1 Processor -- start 2024-09-13T03:04:58.993 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:58.960+0000 7f913e11b640 1 -- start start 2024-09-13T03:04:58.993 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:58.960+0000 7f913e11b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9138102550 0x7f913806fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:04:58.993 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:58.960+0000 7f913e11b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9138102ef0 0x7f913806ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:04:58.993 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:58.960+0000 7f913e11b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9138070520 con 0x7f9138102ef0 2024-09-13T03:04:58.993 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:58.960+0000 7f913e11b640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9138070690 con 0x7f9138102550 2024-09-13T03:04:58.994 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:58.960+0000 7f9136ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9138102ef0 0x7f913806ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:04:58.994 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:58.960+0000 7f9136ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9138102ef0 0x7f913806ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:40204/0 (socket says 172.21.15.89:40204) 2024-09-13T03:04:58.994 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:58.960+0000 7f9136ffd640 1 -- 172.21.15.89:0/2227062914 learned_addr learned my addr 172.21.15.89:0/2227062914 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T03:04:58.994 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:58.961+0000 7f91377fe640 1 --2- 172.21.15.89:0/2227062914 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9138102550 0x7f913806fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:04:58.994 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:58.961+0000 7f9136ffd640 1 -- 172.21.15.89:0/2227062914 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9138102550 msgr2=0x7f913806fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:04:58.994 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:58.961+0000 7f9136ffd640 1 --2- 172.21.15.89:0/2227062914 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9138102550 0x7f913806fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:58.994 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:58.961+0000 7f9136ffd640 1 -- 172.21.15.89:0/2227062914 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f912c005040 con 0x7f9138102ef0 2024-09-13T03:04:58.994 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:58.961+0000 7f91377fe640 1 --2- 172.21.15.89:0/2227062914 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9138102550 0x7f913806fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T03:04:58.994 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:58.961+0000 7f9136ffd640 1 --2- 172.21.15.89:0/2227062914 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9138102ef0 0x7f913806ff50 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f912c003080 tx=0x7f912c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:04:58.994 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:58.961+0000 7f911ffff640 1 -- 172.21.15.89:0/2227062914 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f912c038070 con 0x7f9138102ef0 2024-09-13T03:04:58.994 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:58.961+0000 7f911ffff640 1 -- 172.21.15.89:0/2227062914 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f912c009760 con 0x7f9138102ef0 2024-09-13T03:04:58.994 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:58.961+0000 7f913e11b640 1 -- 172.21.15.89:0/2227062914 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91381198d0 con 0x7f9138102ef0 2024-09-13T03:04:58.994 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:58.961+0000 7f911ffff640 1 -- 172.21.15.89:0/2227062914 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f912c03d420 con 0x7f9138102ef0 2024-09-13T03:04:58.994 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:58.961+0000 7f913e11b640 1 -- 172.21.15.89:0/2227062914 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9138119c50 con 0x7f9138102ef0 2024-09-13T03:04:58.995 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:58.962+0000 7f913e11b640 1 -- 172.21.15.89:0/2227062914 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91380fdcd0 con 0x7f9138102ef0 2024-09-13T03:04:58.995 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:58.963+0000 7f911ffff640 1 -- 172.21.15.89:0/2227062914 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f912c030020 con 0x7f9138102ef0 2024-09-13T03:04:58.995 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:58.964+0000 7f911ffff640 1 --2- 172.21.15.89:0/2227062914 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f912006e530 0x7f91200709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:04:58.995 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:58.964+0000 7f91377fe640 1 --2- 172.21.15.89:0/2227062914 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f912006e530 0x7f91200709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:04:58.995 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:58.964+0000 7f911ffff640 1 -- 172.21.15.89:0/2227062914 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f912c0ae620 con 0x7f9138102ef0 2024-09-13T03:04:58.995 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:58.964+0000 7f91377fe640 1 --2- 172.21.15.89:0/2227062914 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f912006e530 0x7f91200709e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9128006fd0 tx=0x7f9128008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:04:58.995 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:58.968+0000 7f911ffff640 1 -- 172.21.15.89:0/2227062914 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f912c077730 con 0x7f9138102ef0 2024-09-13T03:04:59.170 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:59.168+0000 7f913e11b640 1 -- 172.21.15.89:0/2227062914 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 21, "format": "json"} v 0) v1 -- 0x7f9138109640 con 0x7f9138102ef0 2024-09-13T03:04:59.170 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:59.169+0000 7f911ffff640 1 -- 172.21.15.89:0/2227062914 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 21, "format": "json"}]=0 dumped fsmap epoch 21 v43) v1 ==== 107+0+4932 (secure 0 0 0) 0x7f912c07adf0 con 0x7f9138102ef0 2024-09-13T03:04:59.171 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T03:04:59.171 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":21,"btime":"1970-01-01T00:00:00:000000+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":21,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T02:51:40.657817+0000","modified":"2024-09-13T02:54:05.118633+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":44,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14480,"mds_1":24257},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14480":{"gid":14480,"name":"cephfs.smithi089.rarddb","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.89:6829/1561365213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1561365213},{"type":"v1","addr":"172.21.15.89:6829","nonce":1561365213}]},"join_fscid":1,"export_targets":[1],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14488":{"gid":14488,"name":"cephfs.smithi089.qjoitb","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.89:6827/1464393547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1464393547},{"type":"v1","addr":"172.21.15.89:6827","nonce":1464393547}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24257":{"gid":24257,"name":"cephfs.smithi131.uasrkg","rank":1,"incarnation":7,"state":"up:active","state_seq":4,"addr":"172.21.15.131:6825/260493836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":260493836},{"type":"v1","addr":"172.21.15.131:6825","nonce":260493836}]},"join_fscid":1,"export_targets":[0],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24265":{"gid":24265,"name":"cephfs.smithi131.rbovzc","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":2,"addr":"172.21.15.131:6827/665579373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":665579373},{"type":"v1","addr":"172.21.15.131:6827","nonce":665579373}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-13T03:04:59.171 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 21 2024-09-13T03:04:59.172 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:59.171+0000 7f913e11b640 1 -- 172.21.15.89:0/2227062914 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f912006e530 msgr2=0x7f91200709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:04:59.173 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:59.171+0000 7f913e11b640 1 --2- 172.21.15.89:0/2227062914 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f912006e530 0x7f91200709e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9128006fd0 tx=0x7f9128008040 comp rx=0 tx=0).stop 2024-09-13T03:04:59.173 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:59.171+0000 7f913e11b640 1 -- 172.21.15.89:0/2227062914 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9138102ef0 msgr2=0x7f913806ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:04:59.173 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:59.171+0000 7f913e11b640 1 --2- 172.21.15.89:0/2227062914 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9138102ef0 0x7f913806ff50 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f912c003080 tx=0x7f912c009da0 comp rx=0 tx=0).stop 2024-09-13T03:04:59.173 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:59.171+0000 7f913e11b640 1 -- 172.21.15.89:0/2227062914 shutdown_connections 2024-09-13T03:04:59.173 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:59.171+0000 7f913e11b640 1 --2- 172.21.15.89:0/2227062914 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f912006e530 0x7f91200709e0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:59.173 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:59.171+0000 7f913e11b640 1 --2- 172.21.15.89:0/2227062914 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f9138102ef0 0x7f913806ff50 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:59.173 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:59.171+0000 7f913e11b640 1 --2- 172.21.15.89:0/2227062914 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f9138102550 0x7f913806fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:04:59.173 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:59.171+0000 7f913e11b640 1 -- 172.21.15.89:0/2227062914 >> 172.21.15.89:0/2227062914 conn(0x7f91380f80f0 msgr2=0x7f91380f91a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:04:59.173 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:59.171+0000 7f913e11b640 1 -- 172.21.15.89:0/2227062914 shutdown_connections 2024-09-13T03:04:59.173 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:04:59.171+0000 7f913e11b640 1 -- 172.21.15.89:0/2227062914 wait complete. 2024-09-13T03:04:59.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:04:58 smithi131 ceph-mon[78839]: pgmap v289: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:04:59.830 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:04:59 smithi089 ceph-mon[91553]: from='client.? 172.21.15.89:0/2227062914' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-09-13T03:04:59.855 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 22 2024-09-13T03:05:00.102 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T03:05:00.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:04:59 smithi131 ceph-mon[78839]: from='client.? 172.21.15.89:0/2227062914' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-09-13T03:05:00.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:05:00 smithi089 ceph-mon[91553]: pgmap v290: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T03:05:01.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:05:00 smithi131 ceph-mon[78839]: pgmap v290: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T03:05:01.790 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:01.775+0000 7efdde3c8640 1 -- 172.21.15.89:0/1458338944 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efdd8102ea0 msgr2=0x7efdd80fabf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:01.791 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:01.775+0000 7efdde3c8640 1 --2- 172.21.15.89:0/1458338944 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efdd8102ea0 0x7efdd80fabf0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7efdc00048d0 tx=0x7efdc0009da0 comp rx=0 tx=0).stop 2024-09-13T03:05:01.791 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:01.775+0000 7efdde3c8640 1 -- 172.21.15.89:0/1458338944 shutdown_connections 2024-09-13T03:05:01.791 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:01.775+0000 7efdde3c8640 1 --2- 172.21.15.89:0/1458338944 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efdd8102ea0 0x7efdd80fabf0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:01.791 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:01.775+0000 7efdde3c8640 1 --2- 172.21.15.89:0/1458338944 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efdd8102500 0x7efdd81028d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:01.791 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:01.775+0000 7efdde3c8640 1 -- 172.21.15.89:0/1458338944 >> 172.21.15.89:0/1458338944 conn(0x7efdd8070c10 msgr2=0x7efdd8071010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:05:01.791 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:01.775+0000 7efdde3c8640 1 -- 172.21.15.89:0/1458338944 shutdown_connections 2024-09-13T03:05:01.791 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:01.775+0000 7efdde3c8640 1 -- 172.21.15.89:0/1458338944 wait complete. 2024-09-13T03:05:01.792 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:01.776+0000 7efdde3c8640 1 Processor -- start 2024-09-13T03:05:01.792 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:01.776+0000 7efdde3c8640 1 -- start start 2024-09-13T03:05:01.792 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:01.776+0000 7efdde3c8640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efdd8102500 0x7efdd80fbdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:01.792 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:01.776+0000 7efdde3c8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efdd8102ea0 0x7efdd80fc310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:01.792 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:01.776+0000 7efdde3c8640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdd80fc8e0 con 0x7efdd8102ea0 2024-09-13T03:05:01.792 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:01.776+0000 7efdde3c8640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdd80fca50 con 0x7efdd8102500 2024-09-13T03:05:01.792 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:01.776+0000 7efdd77fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efdd8102ea0 0x7efdd80fc310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:01.792 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:01.777+0000 7efdd77fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efdd8102ea0 0x7efdd80fc310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:47902/0 (socket says 172.21.15.89:47902) 2024-09-13T03:05:01.792 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:01.777+0000 7efdd77fe640 1 -- 172.21.15.89:0/729984846 learned_addr learned my addr 172.21.15.89:0/729984846 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T03:05:01.792 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:01.777+0000 7efdd7fff640 1 --2- 172.21.15.89:0/729984846 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efdd8102500 0x7efdd80fbdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:01.792 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:01.777+0000 7efdd77fe640 1 -- 172.21.15.89:0/729984846 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efdd8102500 msgr2=0x7efdd80fbdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:01.793 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:01.777+0000 7efdd77fe640 1 --2- 172.21.15.89:0/729984846 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efdd8102500 0x7efdd80fbdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:01.793 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:01.777+0000 7efdd77fe640 1 -- 172.21.15.89:0/729984846 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdc0005040 con 0x7efdd8102ea0 2024-09-13T03:05:01.793 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:01.777+0000 7efdd7fff640 1 --2- 172.21.15.89:0/729984846 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efdd8102500 0x7efdd80fbdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T03:05:01.793 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:01.777+0000 7efdd77fe640 1 --2- 172.21.15.89:0/729984846 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efdd8102ea0 0x7efdd80fc310 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7efdc0003080 tx=0x7efdc0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:05:01.793 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:01.777+0000 7efdd4ff9640 1 -- 172.21.15.89:0/729984846 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efdc0038070 con 0x7efdd8102ea0 2024-09-13T03:05:01.793 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:01.777+0000 7efdd4ff9640 1 -- 172.21.15.89:0/729984846 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7efdc0009760 con 0x7efdd8102ea0 2024-09-13T03:05:01.793 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:01.777+0000 7efdde3c8640 1 -- 172.21.15.89:0/729984846 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdd8119510 con 0x7efdd8102ea0 2024-09-13T03:05:01.793 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:01.777+0000 7efdd4ff9640 1 -- 172.21.15.89:0/729984846 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efdc0033420 con 0x7efdd8102ea0 2024-09-13T03:05:01.793 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:01.777+0000 7efdde3c8640 1 -- 172.21.15.89:0/729984846 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdd8119840 con 0x7efdd8102ea0 2024-09-13T03:05:01.793 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:01.778+0000 7efdde3c8640 1 -- 172.21.15.89:0/729984846 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdd80656c0 con 0x7efdd8102ea0 2024-09-13T03:05:01.793 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:01.779+0000 7efdd4ff9640 1 -- 172.21.15.89:0/729984846 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7efdc0030020 con 0x7efdd8102ea0 2024-09-13T03:05:01.794 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:01.779+0000 7efdd4ff9640 1 --2- 172.21.15.89:0/729984846 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7efdc406e530 0x7efdc40709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:01.794 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:01.779+0000 7efdd4ff9640 1 -- 172.21.15.89:0/729984846 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6582+0+0 (secure 0 0 0) 0x7efdc00ade80 con 0x7efdd8102ea0 2024-09-13T03:05:01.794 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:01.780+0000 7efdd7fff640 1 --2- 172.21.15.89:0/729984846 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7efdc406e530 0x7efdc40709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:01.794 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:01.780+0000 7efdd7fff640 1 --2- 172.21.15.89:0/729984846 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7efdc406e530 0x7efdc40709e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7efdc8006fd0 tx=0x7efdc8008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:05:01.794 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:01.784+0000 7efdd4ff9640 1 -- 172.21.15.89:0/729984846 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7efdc0076f30 con 0x7efdd8102ea0 2024-09-13T03:05:01.987 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:01.985+0000 7efdde3c8640 1 -- 172.21.15.89:0/729984846 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 22, "format": "json"} v 0) v1 -- 0x7efdd804b720 con 0x7efdd8102ea0 2024-09-13T03:05:01.987 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:01.985+0000 7efdd4ff9640 1 -- 172.21.15.89:0/729984846 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 22, "format": "json"}]=0 dumped fsmap epoch 22 v43) v1 ==== 107+0+4946 (secure 0 0 0) 0x7efdc007a5f0 con 0x7efdd8102ea0 2024-09-13T03:05:01.987 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T03:05:01.987 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":22,"btime":"2024-09-13T02:57:39:637363+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":22,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T02:51:40.657817+0000","modified":"2024-09-13T02:57:39.637360+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":44,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14480,"mds_1":24257},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14480":{"gid":14480,"name":"cephfs.smithi089.rarddb","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.89:6829/1561365213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1561365213},{"type":"v1","addr":"172.21.15.89:6829","nonce":1561365213}]},"join_fscid":1,"export_targets":[1],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14488":{"gid":14488,"name":"cephfs.smithi089.qjoitb","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.89:6827/1464393547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1464393547},{"type":"v1","addr":"172.21.15.89:6827","nonce":1464393547}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24257":{"gid":24257,"name":"cephfs.smithi131.uasrkg","rank":1,"incarnation":7,"state":"up:active","state_seq":4,"addr":"172.21.15.131:6825/260493836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":260493836},{"type":"v1","addr":"172.21.15.131:6825","nonce":260493836}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24265":{"gid":24265,"name":"cephfs.smithi131.rbovzc","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":2,"addr":"172.21.15.131:6827/665579373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":665579373},{"type":"v1","addr":"172.21.15.131:6827","nonce":665579373}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14480,"qdb_cluster":[14480,24257]},"id":1}]} 2024-09-13T03:05:01.988 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 22 2024-09-13T03:05:01.989 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:01.988+0000 7efdde3c8640 1 -- 172.21.15.89:0/729984846 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7efdc406e530 msgr2=0x7efdc40709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:01.989 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:01.988+0000 7efdde3c8640 1 --2- 172.21.15.89:0/729984846 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7efdc406e530 0x7efdc40709e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7efdc8006fd0 tx=0x7efdc8008040 comp rx=0 tx=0).stop 2024-09-13T03:05:01.989 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:01.988+0000 7efdde3c8640 1 -- 172.21.15.89:0/729984846 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efdd8102ea0 msgr2=0x7efdd80fc310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:01.989 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:01.988+0000 7efdde3c8640 1 --2- 172.21.15.89:0/729984846 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efdd8102ea0 0x7efdd80fc310 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7efdc0003080 tx=0x7efdc0009da0 comp rx=0 tx=0).stop 2024-09-13T03:05:01.989 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:01.988+0000 7efdde3c8640 1 -- 172.21.15.89:0/729984846 shutdown_connections 2024-09-13T03:05:01.989 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:01.988+0000 7efdde3c8640 1 --2- 172.21.15.89:0/729984846 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7efdc406e530 0x7efdc40709e0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:01.989 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:01.988+0000 7efdde3c8640 1 --2- 172.21.15.89:0/729984846 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7efdd8102ea0 0x7efdd80fc310 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:01.990 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:01.988+0000 7efdde3c8640 1 --2- 172.21.15.89:0/729984846 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7efdd8102500 0x7efdd80fbdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:01.990 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:01.988+0000 7efdde3c8640 1 -- 172.21.15.89:0/729984846 >> 172.21.15.89:0/729984846 conn(0x7efdd8070c10 msgr2=0x7efdd80f95d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:05:01.990 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:01.988+0000 7efdde3c8640 1 -- 172.21.15.89:0/729984846 shutdown_connections 2024-09-13T03:05:01.990 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:01.988+0000 7efdde3c8640 1 -- 172.21.15.89:0/729984846 wait complete. 2024-09-13T03:05:02.679 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 23 2024-09-13T03:05:02.943 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T03:05:03.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:05:02 smithi089 ceph-mon[91553]: pgmap v291: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:05:03.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:05:02 smithi089 ceph-mon[91553]: from='client.? 172.21.15.89:0/729984846' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-09-13T03:05:03.183 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:05:02 smithi131 ceph-mon[78839]: pgmap v291: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:05:03.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:05:02 smithi131 ceph-mon[78839]: from='client.? 172.21.15.89:0/729984846' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-09-13T03:05:04.638 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:04.623+0000 7f986bef5640 1 -- 172.21.15.89:0/3771155168 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98641025f0 msgr2=0x7f98641029c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:04.639 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:04.623+0000 7f986bef5640 1 --2- 172.21.15.89:0/3771155168 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98641025f0 0x7f98641029c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f98540048d0 tx=0x7f9854009da0 comp rx=0 tx=0).stop 2024-09-13T03:05:04.639 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:04.623+0000 7f986bef5640 1 -- 172.21.15.89:0/3771155168 shutdown_connections 2024-09-13T03:05:04.639 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:04.623+0000 7f986bef5640 1 --2- 172.21.15.89:0/3771155168 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f98640fac60 0x7f98640fb0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:04.639 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:04.623+0000 7f986bef5640 1 --2- 172.21.15.89:0/3771155168 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98641025f0 0x7f98641029c0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:04.639 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:04.623+0000 7f986bef5640 1 -- 172.21.15.89:0/3771155168 >> 172.21.15.89:0/3771155168 conn(0x7f9864070c80 msgr2=0x7f9864071080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:05:04.639 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:04.623+0000 7f986bef5640 1 -- 172.21.15.89:0/3771155168 shutdown_connections 2024-09-13T03:05:04.639 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:04.623+0000 7f986bef5640 1 -- 172.21.15.89:0/3771155168 wait complete. 2024-09-13T03:05:04.639 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:04.624+0000 7f986bef5640 1 Processor -- start 2024-09-13T03:05:04.639 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:04.624+0000 7f986bef5640 1 -- start start 2024-09-13T03:05:04.639 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:04.624+0000 7f986bef5640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f98640fac60 0x7f98641131d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:04.639 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:04.624+0000 7f986bef5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98641025f0 0x7f9864113710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:04.639 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:04.624+0000 7f986bef5640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9864113d10 con 0x7f98641025f0 2024-09-13T03:05:04.640 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:04.624+0000 7f986bef5640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f986410d150 con 0x7f98640fac60 2024-09-13T03:05:04.640 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:04.624+0000 7f9869490640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98641025f0 0x7f9864113710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:04.640 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:04.624+0000 7f9869490640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98641025f0 0x7f9864113710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:47912/0 (socket says 172.21.15.89:47912) 2024-09-13T03:05:04.640 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:04.624+0000 7f9869490640 1 -- 172.21.15.89:0/2690569410 learned_addr learned my addr 172.21.15.89:0/2690569410 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T03:05:04.640 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:04.624+0000 7f9869c91640 1 --2- 172.21.15.89:0/2690569410 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f98640fac60 0x7f98641131d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:04.640 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:04.625+0000 7f9869490640 1 -- 172.21.15.89:0/2690569410 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f98640fac60 msgr2=0x7f98641131d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:04.640 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:04.625+0000 7f9869490640 1 --2- 172.21.15.89:0/2690569410 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f98640fac60 0x7f98641131d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:04.640 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:04.625+0000 7f9869490640 1 -- 172.21.15.89:0/2690569410 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9854005040 con 0x7f98641025f0 2024-09-13T03:05:04.640 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:04.625+0000 7f9869490640 1 --2- 172.21.15.89:0/2690569410 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98641025f0 0x7f9864113710 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f986000cae0 tx=0x7f9860007e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:05:04.640 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:04.625+0000 7f985a7fc640 1 -- 172.21.15.89:0/2690569410 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f986000aa80 con 0x7f98641025f0 2024-09-13T03:05:04.640 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:04.625+0000 7f985a7fc640 1 -- 172.21.15.89:0/2690569410 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f986000abe0 con 0x7f98641025f0 2024-09-13T03:05:04.640 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:04.625+0000 7f986bef5640 1 -- 172.21.15.89:0/2690569410 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f986410d430 con 0x7f98641025f0 2024-09-13T03:05:04.640 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:04.625+0000 7f985a7fc640 1 -- 172.21.15.89:0/2690569410 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98600115e0 con 0x7f98641025f0 2024-09-13T03:05:04.640 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:04.625+0000 7f986bef5640 1 -- 172.21.15.89:0/2690569410 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f986410d9d0 con 0x7f98641025f0 2024-09-13T03:05:04.641 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:04.626+0000 7f986bef5640 1 -- 172.21.15.89:0/2690569410 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9864065810 con 0x7f98641025f0 2024-09-13T03:05:04.641 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:04.626+0000 7f985a7fc640 1 -- 172.21.15.89:0/2690569410 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f986000ad50 con 0x7f98641025f0 2024-09-13T03:05:04.641 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:04.627+0000 7f985a7fc640 1 --2- 172.21.15.89:0/2690569410 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f985006e530 0x7f98500709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:04.641 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:04.627+0000 7f985a7fc640 1 -- 172.21.15.89:0/2690569410 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f986008e8d0 con 0x7f98641025f0 2024-09-13T03:05:04.641 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:04.627+0000 7f9869c91640 1 --2- 172.21.15.89:0/2690569410 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f985006e530 0x7f98500709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:04.641 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:04.627+0000 7f9869c91640 1 --2- 172.21.15.89:0/2690569410 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f985006e530 0x7f98500709e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9854009ac0 tx=0x7f9854035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:05:04.641 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:04.631+0000 7f985a7fc640 1 -- 172.21.15.89:0/2690569410 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f98600579e0 con 0x7f98641025f0 2024-09-13T03:05:04.838 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:04.836+0000 7f986bef5640 1 -- 172.21.15.89:0/2690569410 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 23, "format": "json"} v 0) v1 -- 0x7f9864109600 con 0x7f98641025f0 2024-09-13T03:05:04.838 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:04.836+0000 7f985a7fc640 1 -- 172.21.15.89:0/2690569410 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 23, "format": "json"}]=0 dumped fsmap epoch 23 v43) v1 ==== 107+0+4945 (secure 0 0 0) 0x7f986005b0a0 con 0x7f98641025f0 2024-09-13T03:05:04.838 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T03:05:04.838 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":23,"btime":"2024-09-13T02:58:04:980780+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T02:51:40.657817+0000","modified":"2024-09-13T02:58:04.067950+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":44,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14480,"mds_1":24257},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14480":{"gid":14480,"name":"cephfs.smithi089.rarddb","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.89:6829/1561365213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1561365213},{"type":"v1","addr":"172.21.15.89:6829","nonce":1561365213}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_14488":{"gid":14488,"name":"cephfs.smithi089.qjoitb","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.89:6827/1464393547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":1464393547},{"type":"v1","addr":"172.21.15.89:6827","nonce":1464393547}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24257":{"gid":24257,"name":"cephfs.smithi131.uasrkg","rank":1,"incarnation":7,"state":"up:active","state_seq":4,"addr":"172.21.15.131:6825/260493836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":260493836},{"type":"v1","addr":"172.21.15.131:6825","nonce":260493836}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24265":{"gid":24265,"name":"cephfs.smithi131.rbovzc","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":2,"addr":"172.21.15.131:6827/665579373","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":665579373},{"type":"v1","addr":"172.21.15.131:6827","nonce":665579373}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14480,"qdb_cluster":[24257,14480]},"id":1}]} 2024-09-13T03:05:04.838 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 23 2024-09-13T03:05:04.840 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:04.838+0000 7f986bef5640 1 -- 172.21.15.89:0/2690569410 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f985006e530 msgr2=0x7f98500709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:04.840 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:04.838+0000 7f986bef5640 1 --2- 172.21.15.89:0/2690569410 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f985006e530 0x7f98500709e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f9854009ac0 tx=0x7f9854035040 comp rx=0 tx=0).stop 2024-09-13T03:05:04.840 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:04.838+0000 7f986bef5640 1 -- 172.21.15.89:0/2690569410 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98641025f0 msgr2=0x7f9864113710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:04.840 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:04.838+0000 7f986bef5640 1 --2- 172.21.15.89:0/2690569410 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98641025f0 0x7f9864113710 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f986000cae0 tx=0x7f9860007e50 comp rx=0 tx=0).stop 2024-09-13T03:05:04.840 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:04.838+0000 7f986bef5640 1 -- 172.21.15.89:0/2690569410 shutdown_connections 2024-09-13T03:05:04.840 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:04.838+0000 7f986bef5640 1 --2- 172.21.15.89:0/2690569410 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f985006e530 0x7f98500709e0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:04.840 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:04.839+0000 7f986bef5640 1 --2- 172.21.15.89:0/2690569410 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f98641025f0 0x7f9864113710 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:04.840 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:04.839+0000 7f986bef5640 1 --2- 172.21.15.89:0/2690569410 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f98640fac60 0x7f98641131d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:04.840 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:04.839+0000 7f986bef5640 1 -- 172.21.15.89:0/2690569410 >> 172.21.15.89:0/2690569410 conn(0x7f9864070c80 msgr2=0x7f98640f9f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:05:04.840 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:04.839+0000 7f986bef5640 1 -- 172.21.15.89:0/2690569410 shutdown_connections 2024-09-13T03:05:04.841 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:04.839+0000 7f986bef5640 1 -- 172.21.15.89:0/2690569410 wait complete. 2024-09-13T03:05:05.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:05:04 smithi089 ceph-mon[91553]: pgmap v292: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T03:05:05.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:05:04 smithi131 ceph-mon[78839]: pgmap v292: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T03:05:05.444 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 24 2024-09-13T03:05:05.692 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T03:05:06.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:05:05 smithi089 ceph-mon[91553]: from='client.? 172.21.15.89:0/2690569410' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-09-13T03:05:06.036 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:05:05 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:05:06.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:05:05 smithi131 ceph-mon[78839]: from='client.? 172.21.15.89:0/2690569410' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-09-13T03:05:06.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:05:05 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:05:06.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:05:06 smithi089 ceph-mon[91553]: pgmap v293: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:05:07.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:05:06 smithi131 ceph-mon[78839]: pgmap v293: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:05:07.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:07.543+0000 7fdf0a491640 1 -- 172.21.15.89:0/3247895932 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdf041014e0 msgr2=0x7fdf041018b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:07.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:07.543+0000 7fdf0a491640 1 --2- 172.21.15.89:0/3247895932 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdf041014e0 0x7fdf041018b0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fdef40048d0 tx=0x7fdef4009da0 comp rx=0 tx=0).stop 2024-09-13T03:05:07.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:07.543+0000 7fdf0a491640 1 -- 172.21.15.89:0/3247895932 shutdown_connections 2024-09-13T03:05:07.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:07.543+0000 7fdf0a491640 1 --2- 172.21.15.89:0/3247895932 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf040fb4a0 0x7fdf040fb910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:07.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:07.543+0000 7fdf0a491640 1 --2- 172.21.15.89:0/3247895932 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdf041014e0 0x7fdf041018b0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:07.571 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:07.543+0000 7fdf0a491640 1 -- 172.21.15.89:0/3247895932 >> 172.21.15.89:0/3247895932 conn(0x7fdf040f7060 msgr2=0x7fdf040f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:05:07.571 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:07.543+0000 7fdf0a491640 1 -- 172.21.15.89:0/3247895932 shutdown_connections 2024-09-13T03:05:07.571 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:07.543+0000 7fdf0a491640 1 -- 172.21.15.89:0/3247895932 wait complete. 2024-09-13T03:05:07.571 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:07.544+0000 7fdf0a491640 1 Processor -- start 2024-09-13T03:05:07.571 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:07.544+0000 7fdf0a491640 1 -- start start 2024-09-13T03:05:07.571 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:07.544+0000 7fdf0a491640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf040fb4a0 0x7fdf04113210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:07.571 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:07.544+0000 7fdf0a491640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdf041014e0 0x7fdf04113750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:07.571 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:07.544+0000 7fdf0a491640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf04113de0 con 0x7fdf041014e0 2024-09-13T03:05:07.571 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:07.544+0000 7fdf0a491640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf0410d190 con 0x7fdf040fb4a0 2024-09-13T03:05:07.571 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:07.544+0000 7fdf037fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdf041014e0 0x7fdf04113750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:07.571 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:07.544+0000 7fdf037fe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdf041014e0 0x7fdf04113750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:47928/0 (socket says 172.21.15.89:47928) 2024-09-13T03:05:07.571 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:07.544+0000 7fdf037fe640 1 -- 172.21.15.89:0/1810627623 learned_addr learned my addr 172.21.15.89:0/1810627623 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T03:05:07.571 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:07.545+0000 7fdf03fff640 1 --2- 172.21.15.89:0/1810627623 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf040fb4a0 0x7fdf04113210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:07.571 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:07.545+0000 7fdf037fe640 1 -- 172.21.15.89:0/1810627623 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf040fb4a0 msgr2=0x7fdf04113210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:07.572 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:07.545+0000 7fdf037fe640 1 --2- 172.21.15.89:0/1810627623 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf040fb4a0 0x7fdf04113210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:07.572 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:07.545+0000 7fdf037fe640 1 -- 172.21.15.89:0/1810627623 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdef4005040 con 0x7fdf041014e0 2024-09-13T03:05:07.572 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:07.545+0000 7fdf037fe640 1 --2- 172.21.15.89:0/1810627623 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdf041014e0 0x7fdf04113750 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fdef800b790 tx=0x7fdef80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:05:07.572 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:07.545+0000 7fdf00ff9640 1 -- 172.21.15.89:0/1810627623 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdef800c700 con 0x7fdf041014e0 2024-09-13T03:05:07.572 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:07.545+0000 7fdf00ff9640 1 -- 172.21.15.89:0/1810627623 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fdef800cd00 con 0x7fdf041014e0 2024-09-13T03:05:07.572 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:07.545+0000 7fdf0a491640 1 -- 172.21.15.89:0/1810627623 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf0410d470 con 0x7fdf041014e0 2024-09-13T03:05:07.572 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:07.545+0000 7fdf00ff9640 1 -- 172.21.15.89:0/1810627623 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdef8015e70 con 0x7fdf041014e0 2024-09-13T03:05:07.572 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:07.545+0000 7fdf0a491640 1 -- 172.21.15.89:0/1810627623 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf0410d990 con 0x7fdf041014e0 2024-09-13T03:05:07.572 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:07.546+0000 7fdf0a491640 1 -- 172.21.15.89:0/1810627623 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf040fcbe0 con 0x7fdf041014e0 2024-09-13T03:05:07.572 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:07.547+0000 7fdf00ff9640 1 -- 172.21.15.89:0/1810627623 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fdef8012070 con 0x7fdf041014e0 2024-09-13T03:05:07.572 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:07.547+0000 7fdf00ff9640 1 --2- 172.21.15.89:0/1810627623 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fdeec06e530 0x7fdeec0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:07.572 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:07.547+0000 7fdf00ff9640 1 -- 172.21.15.89:0/1810627623 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fdef808dde0 con 0x7fdf041014e0 2024-09-13T03:05:07.572 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:07.547+0000 7fdf03fff640 1 --2- 172.21.15.89:0/1810627623 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fdeec06e530 0x7fdeec0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:07.573 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:07.548+0000 7fdf03fff640 1 --2- 172.21.15.89:0/1810627623 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fdeec06e530 0x7fdeec0709e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fdef4004540 tx=0x7fdef4009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:05:07.573 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:07.551+0000 7fdf00ff9640 1 -- 172.21.15.89:0/1810627623 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fdef8056e70 con 0x7fdf041014e0 2024-09-13T03:05:07.754 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:07.753+0000 7fdf0a491640 1 -- 172.21.15.89:0/1810627623 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 24, "format": "json"} v 0) v1 -- 0x7fdf04108540 con 0x7fdf041014e0 2024-09-13T03:05:07.755 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:07.753+0000 7fdf00ff9640 1 -- 172.21.15.89:0/1810627623 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 24, "format": "json"}]=0 dumped fsmap epoch 24 v43) v1 ==== 107+0+3373 (secure 0 0 0) 0x7fdef805a530 con 0x7fdf041014e0 2024-09-13T03:05:07.755 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T03:05:07.756 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":24,"btime":"2024-09-13T03:00:44:871900+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[{"mdsmap":{"epoch":24,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T02:51:40.657817+0000","modified":"2024-09-13T03:00:43.874852+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14480,"mds_1":24257},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14480":{"gid":14480,"name":"cephfs.smithi089.rarddb","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.89:6829/1561365213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1561365213},{"type":"v1","addr":"172.21.15.89:6829","nonce":1561365213}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24257":{"gid":24257,"name":"cephfs.smithi131.uasrkg","rank":1,"incarnation":7,"state":"up:active","state_seq":4,"addr":"172.21.15.131:6825/260493836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":260493836},{"type":"v1","addr":"172.21.15.131:6825","nonce":260493836}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14480,"qdb_cluster":[14480,24257]},"id":1}]} 2024-09-13T03:05:07.756 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 24 2024-09-13T03:05:07.757 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:07.756+0000 7fdf0a491640 1 -- 172.21.15.89:0/1810627623 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fdeec06e530 msgr2=0x7fdeec0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:07.757 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:07.756+0000 7fdf0a491640 1 --2- 172.21.15.89:0/1810627623 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fdeec06e530 0x7fdeec0709e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fdef4004540 tx=0x7fdef4009da0 comp rx=0 tx=0).stop 2024-09-13T03:05:07.757 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:07.756+0000 7fdf0a491640 1 -- 172.21.15.89:0/1810627623 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdf041014e0 msgr2=0x7fdf04113750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:07.757 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:07.756+0000 7fdf0a491640 1 --2- 172.21.15.89:0/1810627623 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdf041014e0 0x7fdf04113750 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fdef800b790 tx=0x7fdef80091d0 comp rx=0 tx=0).stop 2024-09-13T03:05:07.758 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:07.756+0000 7fdf0a491640 1 -- 172.21.15.89:0/1810627623 shutdown_connections 2024-09-13T03:05:07.758 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:07.756+0000 7fdf0a491640 1 --2- 172.21.15.89:0/1810627623 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fdeec06e530 0x7fdeec0709e0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:07.758 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:07.756+0000 7fdf0a491640 1 --2- 172.21.15.89:0/1810627623 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fdf041014e0 0x7fdf04113750 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:07.758 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:07.756+0000 7fdf0a491640 1 --2- 172.21.15.89:0/1810627623 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fdf040fb4a0 0x7fdf04113210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:07.758 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:07.756+0000 7fdf0a491640 1 -- 172.21.15.89:0/1810627623 >> 172.21.15.89:0/1810627623 conn(0x7fdf040f7060 msgr2=0x7fdf04065a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:05:07.758 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:07.756+0000 7fdf0a491640 1 -- 172.21.15.89:0/1810627623 shutdown_connections 2024-09-13T03:05:07.758 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:07.756+0000 7fdf0a491640 1 -- 172.21.15.89:0/1810627623 wait complete. 2024-09-13T03:05:08.458 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 24 2024-09-13T03:05:08.458 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 25 2024-09-13T03:05:08.707 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T03:05:09.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:05:08 smithi089 ceph-mon[91553]: pgmap v294: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:05:09.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:05:08 smithi089 ceph-mon[91553]: from='client.? 172.21.15.89:0/1810627623' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-09-13T03:05:09.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:05:08 smithi131 ceph-mon[78839]: pgmap v294: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:05:09.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:05:08 smithi131 ceph-mon[78839]: from='client.? 172.21.15.89:0/1810627623' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-09-13T03:05:10.434 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:10.392+0000 7f81d91ff640 1 -- 172.21.15.89:0/1579409998 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81d4102550 msgr2=0x7f81d4102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:10.434 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:10.392+0000 7f81d91ff640 1 --2- 172.21.15.89:0/1579409998 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81d4102550 0x7f81d4102920 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f81c40048d0 tx=0x7f81c4009da0 comp rx=0 tx=0).stop 2024-09-13T03:05:10.435 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:10.393+0000 7f81d91ff640 1 -- 172.21.15.89:0/1579409998 shutdown_connections 2024-09-13T03:05:10.435 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:10.393+0000 7f81d91ff640 1 --2- 172.21.15.89:0/1579409998 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81d4102ef0 0x7f81d40fc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:10.435 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:10.393+0000 7f81d91ff640 1 --2- 172.21.15.89:0/1579409998 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81d4102550 0x7f81d4102920 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:10.435 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:10.393+0000 7f81d91ff640 1 -- 172.21.15.89:0/1579409998 >> 172.21.15.89:0/1579409998 conn(0x7f81d40f80f0 msgr2=0x7f81d40fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:05:10.435 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:10.393+0000 7f81d91ff640 1 -- 172.21.15.89:0/1579409998 shutdown_connections 2024-09-13T03:05:10.435 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:10.393+0000 7f81d91ff640 1 -- 172.21.15.89:0/1579409998 wait complete. 2024-09-13T03:05:10.435 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:10.393+0000 7f81d91ff640 1 Processor -- start 2024-09-13T03:05:10.435 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:10.393+0000 7f81d91ff640 1 -- start start 2024-09-13T03:05:10.435 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:10.393+0000 7f81d91ff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81d4102550 0x7f81d4113570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:10.435 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:10.393+0000 7f81d91ff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81d4102ef0 0x7f81d4113ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:10.435 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:10.393+0000 7f81d91ff640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81d4114100 con 0x7f81d4102ef0 2024-09-13T03:05:10.435 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:10.393+0000 7f81d91ff640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81d410d510 con 0x7f81d4102550 2024-09-13T03:05:10.436 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:10.394+0000 7f81d259c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81d4102ef0 0x7f81d4113ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:10.436 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:10.394+0000 7f81d259c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81d4102ef0 0x7f81d4113ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:47944/0 (socket says 172.21.15.89:47944) 2024-09-13T03:05:10.436 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:10.394+0000 7f81d259c640 1 -- 172.21.15.89:0/3211697221 learned_addr learned my addr 172.21.15.89:0/3211697221 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T03:05:10.436 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:10.394+0000 7f81d2d9d640 1 --2- 172.21.15.89:0/3211697221 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81d4102550 0x7f81d4113570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:10.436 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:10.394+0000 7f81d259c640 1 -- 172.21.15.89:0/3211697221 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81d4102550 msgr2=0x7f81d4113570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:10.436 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:10.394+0000 7f81d259c640 1 --2- 172.21.15.89:0/3211697221 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81d4102550 0x7f81d4113570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:10.436 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:10.394+0000 7f81d259c640 1 -- 172.21.15.89:0/3211697221 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81c4005040 con 0x7f81d4102ef0 2024-09-13T03:05:10.436 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:10.394+0000 7f81d259c640 1 --2- 172.21.15.89:0/3211697221 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81d4102ef0 0x7f81d4113ab0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f81bc00c740 tx=0x7f81bc0043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:05:10.436 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:10.394+0000 7f81cb7fe640 1 -- 172.21.15.89:0/3211697221 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f81bc012810 con 0x7f81d4102ef0 2024-09-13T03:05:10.436 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:10.394+0000 7f81cb7fe640 1 -- 172.21.15.89:0/3211697221 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f81bc012e10 con 0x7f81d4102ef0 2024-09-13T03:05:10.437 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:10.394+0000 7f81d91ff640 1 -- 172.21.15.89:0/3211697221 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81d410d7f0 con 0x7f81d4102ef0 2024-09-13T03:05:10.437 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:10.394+0000 7f81cb7fe640 1 -- 172.21.15.89:0/3211697221 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f81bc00a2f0 con 0x7f81d4102ef0 2024-09-13T03:05:10.437 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:10.394+0000 7f81d91ff640 1 -- 172.21.15.89:0/3211697221 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81d410dd90 con 0x7f81d4102ef0 2024-09-13T03:05:10.437 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:10.395+0000 7f81d91ff640 1 -- 172.21.15.89:0/3211697221 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81d40fdcd0 con 0x7f81d4102ef0 2024-09-13T03:05:10.437 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:10.396+0000 7f81cb7fe640 1 -- 172.21.15.89:0/3211697221 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f81bc011380 con 0x7f81d4102ef0 2024-09-13T03:05:10.437 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:10.396+0000 7f81cb7fe640 1 --2- 172.21.15.89:0/3211697221 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f81c006e530 0x7f81c00709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:10.437 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:10.396+0000 7f81cb7fe640 1 -- 172.21.15.89:0/3211697221 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f81bc08e660 con 0x7f81d4102ef0 2024-09-13T03:05:10.437 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:10.396+0000 7f81d2d9d640 1 --2- 172.21.15.89:0/3211697221 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f81c006e530 0x7f81c00709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:10.437 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:10.397+0000 7f81d2d9d640 1 --2- 172.21.15.89:0/3211697221 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f81c006e530 0x7f81c00709e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f81c4009ac0 tx=0x7f81c4035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:05:10.437 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:10.401+0000 7f81cb7fe640 1 -- 172.21.15.89:0/3211697221 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f81bc0576f0 con 0x7f81d4102ef0 2024-09-13T03:05:10.603 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:10.602+0000 7f81d91ff640 1 -- 172.21.15.89:0/3211697221 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 25, "format": "json"} v 0) v1 -- 0x7f81d40fbd50 con 0x7f81d4102ef0 2024-09-13T03:05:10.604 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:10.602+0000 7f81cb7fe640 1 -- 172.21.15.89:0/3211697221 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 25, "format": "json"}]=0 dumped fsmap epoch 25 v43) v1 ==== 107+0+4933 (secure 0 0 0) 0x7f81bc05adb0 con 0x7f81d4102ef0 2024-09-13T03:05:10.604 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T03:05:10.604 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":25,"btime":"2024-09-13T03:00:45:886350+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34380,"name":"cephfs.smithi089.qjoitb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6827/3159647567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":3159647567},{"type":"v1","addr":"172.21.15.89:6827","nonce":3159647567}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":44293,"name":"cephfs.smithi131.rbovzc","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6827/1074022424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":1074022424},{"type":"v1","addr":"172.21.15.131:6827","nonce":1074022424}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":25,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T02:51:40.657817+0000","modified":"2024-09-13T03:00:45.012251+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":14480,"mds_1":24257},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14480":{"gid":14480,"name":"cephfs.smithi089.rarddb","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.89:6829/1561365213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1561365213},{"type":"v1","addr":"172.21.15.89:6829","nonce":1561365213}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24257":{"gid":24257,"name":"cephfs.smithi131.uasrkg","rank":1,"incarnation":7,"state":"up:active","state_seq":4,"addr":"172.21.15.131:6825/260493836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":260493836},{"type":"v1","addr":"172.21.15.131:6825","nonce":260493836}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14480,"qdb_cluster":[24257,14480]},"id":1}]} 2024-09-13T03:05:10.604 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 25 2024-09-13T03:05:10.606 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:10.605+0000 7f81d91ff640 1 -- 172.21.15.89:0/3211697221 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f81c006e530 msgr2=0x7f81c00709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:10.606 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:10.605+0000 7f81d91ff640 1 --2- 172.21.15.89:0/3211697221 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f81c006e530 0x7f81c00709e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f81c4009ac0 tx=0x7f81c4035040 comp rx=0 tx=0).stop 2024-09-13T03:05:10.606 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:10.605+0000 7f81d91ff640 1 -- 172.21.15.89:0/3211697221 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81d4102ef0 msgr2=0x7f81d4113ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:10.607 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:10.605+0000 7f81d91ff640 1 --2- 172.21.15.89:0/3211697221 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81d4102ef0 0x7f81d4113ab0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f81bc00c740 tx=0x7f81bc0043c0 comp rx=0 tx=0).stop 2024-09-13T03:05:10.607 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:10.605+0000 7f81d91ff640 1 -- 172.21.15.89:0/3211697221 shutdown_connections 2024-09-13T03:05:10.607 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:10.605+0000 7f81d91ff640 1 --2- 172.21.15.89:0/3211697221 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f81c006e530 0x7f81c00709e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:10.607 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:10.605+0000 7f81d91ff640 1 --2- 172.21.15.89:0/3211697221 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f81d4102ef0 0x7f81d4113ab0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:10.607 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:10.605+0000 7f81d91ff640 1 --2- 172.21.15.89:0/3211697221 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f81d4102550 0x7f81d4113570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:10.607 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:10.605+0000 7f81d91ff640 1 -- 172.21.15.89:0/3211697221 >> 172.21.15.89:0/3211697221 conn(0x7f81d40f80f0 msgr2=0x7f81d40f90b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:05:10.607 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:10.605+0000 7f81d91ff640 1 -- 172.21.15.89:0/3211697221 shutdown_connections 2024-09-13T03:05:10.607 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:10.605+0000 7f81d91ff640 1 -- 172.21.15.89:0/3211697221 wait complete. 2024-09-13T03:05:10.971 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:05:10 smithi089 ceph-mon[91553]: pgmap v295: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T03:05:10.972 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:05:10 smithi089 ceph-mon[91553]: from='client.? 172.21.15.89:0/3211697221' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-09-13T03:05:11.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:05:10 smithi131 ceph-mon[78839]: pgmap v295: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T03:05:11.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:05:10 smithi131 ceph-mon[78839]: from='client.? 172.21.15.89:0/3211697221' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-09-13T03:05:11.295 DEBUG:tasks.fs:max_mds reduced in epoch 25 2024-09-13T03:05:11.296 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 25 2024-09-13T03:05:11.296 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 26 2024-09-13T03:05:11.542 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T03:05:13.005 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:05:12 smithi089 ceph-mon[91553]: pgmap v296: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:05:13.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:05:12 smithi131 ceph-mon[78839]: pgmap v296: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:05:13.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:13.308+0000 7f80032ef640 1 -- 172.21.15.89:0/1023356124 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7ffc0fb3a0 msgr2=0x7f7ffc1063e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:13.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:13.308+0000 7f80032ef640 1 --2- 172.21.15.89:0/1023356124 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7ffc0fb3a0 0x7f7ffc1063e0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f7fec004900 tx=0x7f7fec009da0 comp rx=0 tx=0).stop 2024-09-13T03:05:13.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:13.308+0000 7f80032ef640 1 -- 172.21.15.89:0/1023356124 shutdown_connections 2024-09-13T03:05:13.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:13.308+0000 7f80032ef640 1 --2- 172.21.15.89:0/1023356124 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7ffc0fb3a0 0x7f7ffc1063e0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:13.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:13.308+0000 7f80032ef640 1 --2- 172.21.15.89:0/1023356124 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7ffc0faa00 0x7f7ffc0fadd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:13.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:13.308+0000 7f80032ef640 1 -- 172.21.15.89:0/1023356124 >> 172.21.15.89:0/1023356124 conn(0x7f7ffc072740 msgr2=0x7f7ffc072b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:05:13.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:13.308+0000 7f80032ef640 1 -- 172.21.15.89:0/1023356124 shutdown_connections 2024-09-13T03:05:13.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:13.308+0000 7f80032ef640 1 -- 172.21.15.89:0/1023356124 wait complete. 2024-09-13T03:05:13.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:13.308+0000 7f80032ef640 1 Processor -- start 2024-09-13T03:05:13.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:13.308+0000 7f80032ef640 1 -- start start 2024-09-13T03:05:13.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:13.309+0000 7f80032ef640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7ffc0faa00 0x7f7ffc1132a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:13.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:13.309+0000 7f80032ef640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7ffc0fb3a0 0x7f7ffc1137e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:13.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:13.309+0000 7f80032ef640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ffc113e70 con 0x7f7ffc0faa00 2024-09-13T03:05:13.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:13.309+0000 7f80032ef640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ffc10d260 con 0x7f7ffc0fb3a0 2024-09-13T03:05:13.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:13.309+0000 7f800108b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7ffc0faa00 0x7f7ffc1132a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:13.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:13.309+0000 7f800108b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7ffc0faa00 0x7f7ffc1132a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:41476/0 (socket says 172.21.15.89:41476) 2024-09-13T03:05:13.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:13.309+0000 7f800108b640 1 -- 172.21.15.89:0/2757518763 learned_addr learned my addr 172.21.15.89:0/2757518763 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T03:05:13.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:13.309+0000 7f800088a640 1 --2- 172.21.15.89:0/2757518763 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7ffc0fb3a0 0x7f7ffc1137e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:13.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:13.309+0000 7f800108b640 1 -- 172.21.15.89:0/2757518763 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7ffc0fb3a0 msgr2=0x7f7ffc1137e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:13.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:13.309+0000 7f800108b640 1 --2- 172.21.15.89:0/2757518763 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7ffc0fb3a0 0x7f7ffc1137e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:13.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:13.309+0000 7f800108b640 1 -- 172.21.15.89:0/2757518763 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fec005040 con 0x7f7ffc0faa00 2024-09-13T03:05:13.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:13.309+0000 7f800108b640 1 --2- 172.21.15.89:0/2757518763 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7ffc0faa00 0x7f7ffc1132a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f7ff800b790 tx=0x7f7ff80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:05:13.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:13.309+0000 7f7ff1ffb640 1 -- 172.21.15.89:0/2757518763 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ff800c700 con 0x7f7ffc0faa00 2024-09-13T03:05:13.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:13.309+0000 7f80032ef640 1 -- 172.21.15.89:0/2757518763 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ffc10d540 con 0x7f7ffc0faa00 2024-09-13T03:05:13.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:13.309+0000 7f7ff1ffb640 1 -- 172.21.15.89:0/2757518763 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f7ff800cd00 con 0x7f7ffc0faa00 2024-09-13T03:05:13.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:13.309+0000 7f7ff1ffb640 1 -- 172.21.15.89:0/2757518763 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ff8015e70 con 0x7f7ffc0faa00 2024-09-13T03:05:13.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:13.310+0000 7f80032ef640 1 -- 172.21.15.89:0/2757518763 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ffc10da60 con 0x7f7ffc0faa00 2024-09-13T03:05:13.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:13.311+0000 7f80032ef640 1 -- 172.21.15.89:0/2757518763 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ffc0fbab0 con 0x7f7ffc0faa00 2024-09-13T03:05:13.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:13.311+0000 7f7ff1ffb640 1 -- 172.21.15.89:0/2757518763 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f7ff8012070 con 0x7f7ffc0faa00 2024-09-13T03:05:13.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:13.311+0000 7f7ff1ffb640 1 --2- 172.21.15.89:0/2757518763 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f7fe806e530 0x7f7fe80709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:13.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:13.311+0000 7f7ff1ffb640 1 -- 172.21.15.89:0/2757518763 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f7ff808dde0 con 0x7f7ffc0faa00 2024-09-13T03:05:13.327 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:13.311+0000 7f800088a640 1 --2- 172.21.15.89:0/2757518763 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f7fe806e530 0x7f7fe80709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:13.327 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:13.312+0000 7f800088a640 1 --2- 172.21.15.89:0/2757518763 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f7fe806e530 0x7f7fe80709e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7fec004540 tx=0x7f7fec035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:05:13.327 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:13.316+0000 7f7ff1ffb640 1 -- 172.21.15.89:0/2757518763 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f7ff8056e70 con 0x7f7ffc0faa00 2024-09-13T03:05:13.519 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:13.518+0000 7f80032ef640 1 -- 172.21.15.89:0/2757518763 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 26, "format": "json"} v 0) v1 -- 0x7f7ffc04b750 con 0x7f7ffc0faa00 2024-09-13T03:05:13.520 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:13.518+0000 7f7ff1ffb640 1 -- 172.21.15.89:0/2757518763 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 26, "format": "json"}]=0 dumped fsmap epoch 26 v43) v1 ==== 107+0+4929 (secure 0 0 0) 0x7f7ff805a530 con 0x7f7ffc0faa00 2024-09-13T03:05:13.520 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T03:05:13.520 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":26,"btime":"2024-09-13T03:00:45:890351+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34380,"name":"cephfs.smithi089.qjoitb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6827/3159647567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":3159647567},{"type":"v1","addr":"172.21.15.89:6827","nonce":3159647567}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":44293,"name":"cephfs.smithi131.rbovzc","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6827/1074022424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":1074022424},{"type":"v1","addr":"172.21.15.131:6827","nonce":1074022424}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T02:51:40.657817+0000","modified":"2024-09-13T03:00:45.890349+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":14480,"mds_1":24257},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14480":{"gid":14480,"name":"cephfs.smithi089.rarddb","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.89:6829/1561365213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1561365213},{"type":"v1","addr":"172.21.15.89:6829","nonce":1561365213}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24257":{"gid":24257,"name":"cephfs.smithi131.uasrkg","rank":1,"incarnation":7,"state":"up:stopping","state_seq":4,"addr":"172.21.15.131:6825/260493836","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":260493836},{"type":"v1","addr":"172.21.15.131:6825","nonce":260493836}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14480,"qdb_cluster":[14480]},"id":1}]} 2024-09-13T03:05:13.520 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 26 2024-09-13T03:05:13.522 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:13.521+0000 7f80032ef640 1 -- 172.21.15.89:0/2757518763 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f7fe806e530 msgr2=0x7f7fe80709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:13.522 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:13.521+0000 7f80032ef640 1 --2- 172.21.15.89:0/2757518763 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f7fe806e530 0x7f7fe80709e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f7fec004540 tx=0x7f7fec035040 comp rx=0 tx=0).stop 2024-09-13T03:05:13.522 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:13.521+0000 7f80032ef640 1 -- 172.21.15.89:0/2757518763 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7ffc0faa00 msgr2=0x7f7ffc1132a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:13.522 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:13.521+0000 7f80032ef640 1 --2- 172.21.15.89:0/2757518763 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7ffc0faa00 0x7f7ffc1132a0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f7ff800b790 tx=0x7f7ff80091d0 comp rx=0 tx=0).stop 2024-09-13T03:05:13.523 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:13.521+0000 7f80032ef640 1 -- 172.21.15.89:0/2757518763 shutdown_connections 2024-09-13T03:05:13.523 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:13.521+0000 7f80032ef640 1 --2- 172.21.15.89:0/2757518763 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f7fe806e530 0x7f7fe80709e0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:13.523 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:13.521+0000 7f80032ef640 1 --2- 172.21.15.89:0/2757518763 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f7ffc0fb3a0 0x7f7ffc1137e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:13.523 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:13.521+0000 7f80032ef640 1 --2- 172.21.15.89:0/2757518763 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f7ffc0faa00 0x7f7ffc1132a0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:13.523 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:13.521+0000 7f80032ef640 1 -- 172.21.15.89:0/2757518763 >> 172.21.15.89:0/2757518763 conn(0x7f7ffc072740 msgr2=0x7f7ffc0f92f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:05:13.523 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:13.521+0000 7f80032ef640 1 -- 172.21.15.89:0/2757518763 shutdown_connections 2024-09-13T03:05:13.523 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:13.521+0000 7f80032ef640 1 -- 172.21.15.89:0/2757518763 wait complete. 2024-09-13T03:05:14.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:05:13 smithi089 ceph-mon[91553]: from='client.? 172.21.15.89:0/2757518763' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-09-13T03:05:14.085 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:05:13 smithi131 ceph-mon[78839]: from='client.? 172.21.15.89:0/2757518763' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-09-13T03:05:14.209 DEBUG:tasks.fs:max_mds reduced in epoch 26 2024-09-13T03:05:14.209 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 26 2024-09-13T03:05:14.210 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 27 2024-09-13T03:05:14.453 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T03:05:14.915 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:05:14 smithi089 ceph-mon[91553]: pgmap v297: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T03:05:15.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:05:14 smithi131 ceph-mon[78839]: pgmap v297: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T03:05:16.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:16.082+0000 7f70b74a8640 1 -- 172.21.15.89:0/1891902992 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f70b00fe460 msgr2=0x7f70b00fe830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:16.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:16.082+0000 7f70b74a8640 1 --2- 172.21.15.89:0/1891902992 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f70b00fe460 0x7f70b00fe830 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f70ac0048d0 tx=0x7f70ac009da0 comp rx=0 tx=0).stop 2024-09-13T03:05:16.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:16.082+0000 7f70b74a8640 1 -- 172.21.15.89:0/1891902992 shutdown_connections 2024-09-13T03:05:16.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:16.082+0000 7f70b74a8640 1 --2- 172.21.15.89:0/1891902992 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f70b0064fc0 0x7f70b0065430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:16.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:16.082+0000 7f70b74a8640 1 --2- 172.21.15.89:0/1891902992 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f70b00fe460 0x7f70b00fe830 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:16.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:16.082+0000 7f70b74a8640 1 -- 172.21.15.89:0/1891902992 >> 172.21.15.89:0/1891902992 conn(0x7f70b00723b0 msgr2=0x7f70b00727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:05:16.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:16.082+0000 7f70b74a8640 1 -- 172.21.15.89:0/1891902992 shutdown_connections 2024-09-13T03:05:16.086 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:16.082+0000 7f70b74a8640 1 -- 172.21.15.89:0/1891902992 wait complete. 2024-09-13T03:05:16.086 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:16.082+0000 7f70b74a8640 1 Processor -- start 2024-09-13T03:05:16.086 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:16.082+0000 7f70b74a8640 1 -- start start 2024-09-13T03:05:16.086 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:16.082+0000 7f70b74a8640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f70b0064fc0 0x7f70b01131b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:16.086 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:16.082+0000 7f70b74a8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f70b00fe460 0x7f70b01136f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:16.086 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:16.082+0000 7f70b74a8640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70b0113cf0 con 0x7f70b00fe460 2024-09-13T03:05:16.086 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:16.082+0000 7f70b74a8640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70b010d130 con 0x7f70b0064fc0 2024-09-13T03:05:16.086 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:16.083+0000 7f70b4a43640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f70b00fe460 0x7f70b01136f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:16.086 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:16.083+0000 7f70b4a43640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f70b00fe460 0x7f70b01136f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:41500/0 (socket says 172.21.15.89:41500) 2024-09-13T03:05:16.086 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:16.083+0000 7f70b4a43640 1 -- 172.21.15.89:0/2739875922 learned_addr learned my addr 172.21.15.89:0/2739875922 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T03:05:16.086 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:16.083+0000 7f70b5244640 1 --2- 172.21.15.89:0/2739875922 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f70b0064fc0 0x7f70b01131b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:16.087 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:16.083+0000 7f70b4a43640 1 -- 172.21.15.89:0/2739875922 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f70b0064fc0 msgr2=0x7f70b01131b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:16.087 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:16.083+0000 7f70b4a43640 1 --2- 172.21.15.89:0/2739875922 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f70b0064fc0 0x7f70b01131b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:16.087 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:16.083+0000 7f70b4a43640 1 -- 172.21.15.89:0/2739875922 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70ac005040 con 0x7f70b00fe460 2024-09-13T03:05:16.087 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:16.083+0000 7f70b4a43640 1 --2- 172.21.15.89:0/2739875922 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f70b00fe460 0x7f70b01136f0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f70a0002a50 tx=0x7f70a0004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:05:16.087 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:16.083+0000 7f70a5ffb640 1 -- 172.21.15.89:0/2739875922 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f70a0007c30 con 0x7f70b00fe460 2024-09-13T03:05:16.087 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:16.083+0000 7f70b74a8640 1 -- 172.21.15.89:0/2739875922 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70b010d410 con 0x7f70b00fe460 2024-09-13T03:05:16.087 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:16.083+0000 7f70a5ffb640 1 -- 172.21.15.89:0/2739875922 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f70a000f040 con 0x7f70b00fe460 2024-09-13T03:05:16.087 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:16.083+0000 7f70a5ffb640 1 -- 172.21.15.89:0/2739875922 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f70a000da10 con 0x7f70b00fe460 2024-09-13T03:05:16.087 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:16.084+0000 7f70b74a8640 1 -- 172.21.15.89:0/2739875922 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70b010d9b0 con 0x7f70b00fe460 2024-09-13T03:05:16.088 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:16.085+0000 7f70b74a8640 1 -- 172.21.15.89:0/2739875922 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70b00fdcf0 con 0x7f70b00fe460 2024-09-13T03:05:16.088 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:16.085+0000 7f70a5ffb640 1 -- 172.21.15.89:0/2739875922 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f70a000dc80 con 0x7f70b00fe460 2024-09-13T03:05:16.088 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:16.085+0000 7f70a5ffb640 1 --2- 172.21.15.89:0/2739875922 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f709c06e530 0x7f709c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:16.088 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:16.085+0000 7f70a5ffb640 1 -- 172.21.15.89:0/2739875922 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f70a008d990 con 0x7f70b00fe460 2024-09-13T03:05:16.089 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:16.086+0000 7f70b5244640 1 --2- 172.21.15.89:0/2739875922 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f709c06e530 0x7f709c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:16.089 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:16.086+0000 7f70b5244640 1 --2- 172.21.15.89:0/2739875922 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f709c06e530 0x7f709c0709e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f70ac009ac0 tx=0x7f70ac035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:05:16.091 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:16.090+0000 7f70a5ffb640 1 -- 172.21.15.89:0/2739875922 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f70a0056ad0 con 0x7f70b00fe460 2024-09-13T03:05:16.290 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:16.289+0000 7f70b74a8640 1 -- 172.21.15.89:0/2739875922 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 27, "format": "json"} v 0) v1 -- 0x7f70b010e850 con 0x7f70b00fe460 2024-09-13T03:05:16.291 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:16.290+0000 7f70a5ffb640 1 -- 172.21.15.89:0/2739875922 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 27, "format": "json"}]=0 dumped fsmap epoch 27 v43) v1 ==== 107+0+4134 (secure 0 0 0) 0x7f70a005a190 con 0x7f70b00fe460 2024-09-13T03:05:16.291 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T03:05:16.291 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":27,"btime":"2024-09-13T03:01:09:600912+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34380,"name":"cephfs.smithi089.qjoitb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6827/3159647567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":3159647567},{"type":"v1","addr":"172.21.15.89:6827","nonce":3159647567}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":44293,"name":"cephfs.smithi131.rbovzc","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6827/1074022424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":1074022424},{"type":"v1","addr":"172.21.15.131:6827","nonce":1074022424}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T02:51:40.657817+0000","modified":"2024-09-13T03:01:09.308801+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14480},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_14480":{"gid":14480,"name":"cephfs.smithi089.rarddb","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.89:6829/1561365213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1561365213},{"type":"v1","addr":"172.21.15.89:6829","nonce":1561365213}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14480,"qdb_cluster":[14480]},"id":1}]} 2024-09-13T03:05:16.291 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 27 2024-09-13T03:05:16.293 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:16.292+0000 7f70b74a8640 1 -- 172.21.15.89:0/2739875922 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f709c06e530 msgr2=0x7f709c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:16.293 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:16.292+0000 7f70b74a8640 1 --2- 172.21.15.89:0/2739875922 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f709c06e530 0x7f709c0709e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f70ac009ac0 tx=0x7f70ac035040 comp rx=0 tx=0).stop 2024-09-13T03:05:16.293 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:16.292+0000 7f70b74a8640 1 -- 172.21.15.89:0/2739875922 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f70b00fe460 msgr2=0x7f70b01136f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:16.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:16.292+0000 7f70b74a8640 1 --2- 172.21.15.89:0/2739875922 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f70b00fe460 0x7f70b01136f0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f70a0002a50 tx=0x7f70a0004600 comp rx=0 tx=0).stop 2024-09-13T03:05:16.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:16.292+0000 7f70b74a8640 1 -- 172.21.15.89:0/2739875922 shutdown_connections 2024-09-13T03:05:16.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:16.292+0000 7f70b74a8640 1 --2- 172.21.15.89:0/2739875922 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f709c06e530 0x7f709c0709e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:16.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:16.292+0000 7f70b74a8640 1 --2- 172.21.15.89:0/2739875922 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f70b00fe460 0x7f70b01136f0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:16.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:16.292+0000 7f70b74a8640 1 --2- 172.21.15.89:0/2739875922 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f70b0064fc0 0x7f70b01131b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:16.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:16.292+0000 7f70b74a8640 1 -- 172.21.15.89:0/2739875922 >> 172.21.15.89:0/2739875922 conn(0x7f70b00723b0 msgr2=0x7f70b0105410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:05:16.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:16.292+0000 7f70b74a8640 1 -- 172.21.15.89:0/2739875922 shutdown_connections 2024-09-13T03:05:16.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:16.292+0000 7f70b74a8640 1 -- 172.21.15.89:0/2739875922 wait complete. 2024-09-13T03:05:16.943 DEBUG:tasks.fs:max_mds reduced in epoch 27 2024-09-13T03:05:16.943 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 27 2024-09-13T03:05:16.943 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 28 2024-09-13T03:05:17.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:05:16 smithi089 ceph-mon[91553]: pgmap v298: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:05:17.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:05:16 smithi089 ceph-mon[91553]: from='client.? 172.21.15.89:0/2739875922' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-09-13T03:05:17.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:05:16 smithi131 ceph-mon[78839]: pgmap v298: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:05:17.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:05:16 smithi131 ceph-mon[78839]: from='client.? 172.21.15.89:0/2739875922' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-09-13T03:05:17.188 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T03:05:18.926 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:18.922+0000 7f565f660640 1 -- 172.21.15.89:0/2413866181 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5658102550 msgr2=0x7f5658102920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:18.926 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:18.922+0000 7f565f660640 1 --2- 172.21.15.89:0/2413866181 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5658102550 0x7f5658102920 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f56540048d0 tx=0x7f5654009da0 comp rx=0 tx=0).stop 2024-09-13T03:05:18.926 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:18.923+0000 7f565f660640 1 -- 172.21.15.89:0/2413866181 shutdown_connections 2024-09-13T03:05:18.927 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:18.923+0000 7f565f660640 1 --2- 172.21.15.89:0/2413866181 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5658102ef0 0x7f56580fc5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:18.927 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:18.923+0000 7f565f660640 1 --2- 172.21.15.89:0/2413866181 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5658102550 0x7f5658102920 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:18.927 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:18.923+0000 7f565f660640 1 -- 172.21.15.89:0/2413866181 >> 172.21.15.89:0/2413866181 conn(0x7f56580f80f0 msgr2=0x7f56580fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:05:18.927 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:18.923+0000 7f565f660640 1 -- 172.21.15.89:0/2413866181 shutdown_connections 2024-09-13T03:05:18.927 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:18.923+0000 7f565f660640 1 -- 172.21.15.89:0/2413866181 wait complete. 2024-09-13T03:05:18.927 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:18.923+0000 7f565f660640 1 Processor -- start 2024-09-13T03:05:18.927 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:18.923+0000 7f565f660640 1 -- start start 2024-09-13T03:05:18.927 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:18.923+0000 7f565f660640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5658102550 0x7f5658113530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:18.927 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:18.923+0000 7f565f660640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5658102ef0 0x7f5658113a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:18.927 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:18.923+0000 7f565f660640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56581140c0 con 0x7f5658102550 2024-09-13T03:05:18.927 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:18.923+0000 7f565f660640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f565810d4d0 con 0x7f5658102ef0 2024-09-13T03:05:18.927 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:18.924+0000 7f565d3fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5658102550 0x7f5658113530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:18.927 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:18.924+0000 7f565d3fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5658102550 0x7f5658113530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:41524/0 (socket says 172.21.15.89:41524) 2024-09-13T03:05:18.928 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:18.924+0000 7f565d3fc640 1 -- 172.21.15.89:0/1925363970 learned_addr learned my addr 172.21.15.89:0/1925363970 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T03:05:18.928 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:18.924+0000 7f565cbfb640 1 --2- 172.21.15.89:0/1925363970 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5658102ef0 0x7f5658113a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:18.928 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:18.924+0000 7f565d3fc640 1 -- 172.21.15.89:0/1925363970 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5658102ef0 msgr2=0x7f5658113a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:18.928 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:18.924+0000 7f565d3fc640 1 --2- 172.21.15.89:0/1925363970 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5658102ef0 0x7f5658113a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:18.928 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:18.924+0000 7f565d3fc640 1 -- 172.21.15.89:0/1925363970 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5654005040 con 0x7f5658102550 2024-09-13T03:05:18.928 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:18.924+0000 7f565d3fc640 1 --2- 172.21.15.89:0/1925363970 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5658102550 0x7f5658113530 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f5654000c00 tx=0x7f5654009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:05:18.928 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:18.924+0000 7f564dffb640 1 -- 172.21.15.89:0/1925363970 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5654038070 con 0x7f5658102550 2024-09-13T03:05:18.928 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:18.924+0000 7f565f660640 1 -- 172.21.15.89:0/1925363970 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f565810d750 con 0x7f5658102550 2024-09-13T03:05:18.928 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:18.924+0000 7f564dffb640 1 -- 172.21.15.89:0/1925363970 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f565402ade0 con 0x7f5658102550 2024-09-13T03:05:18.928 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:18.924+0000 7f564dffb640 1 -- 172.21.15.89:0/1925363970 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f565402c7b0 con 0x7f5658102550 2024-09-13T03:05:18.928 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:18.925+0000 7f565f660640 1 -- 172.21.15.89:0/1925363970 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f565810dc90 con 0x7f5658102550 2024-09-13T03:05:18.929 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:18.926+0000 7f565f660640 1 -- 172.21.15.89:0/1925363970 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56580fdcd0 con 0x7f5658102550 2024-09-13T03:05:18.929 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:18.926+0000 7f564dffb640 1 -- 172.21.15.89:0/1925363970 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f5654030020 con 0x7f5658102550 2024-09-13T03:05:18.929 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:18.926+0000 7f564dffb640 1 --2- 172.21.15.89:0/1925363970 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f564406e530 0x7f56440709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:18.929 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:18.926+0000 7f564dffb640 1 -- 172.21.15.89:0/1925363970 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f56540ae5a0 con 0x7f5658102550 2024-09-13T03:05:18.929 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:18.926+0000 7f565cbfb640 1 --2- 172.21.15.89:0/1925363970 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f564406e530 0x7f56440709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:18.930 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:18.927+0000 7f565cbfb640 1 --2- 172.21.15.89:0/1925363970 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f564406e530 0x7f56440709e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5648007fd0 tx=0x7f564800b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:05:18.932 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:18.931+0000 7f564dffb640 1 -- 172.21.15.89:0/1925363970 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f5654077720 con 0x7f5658102550 2024-09-13T03:05:19.034 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:05:18 smithi089 ceph-mon[91553]: pgmap v299: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:05:19.134 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:19.132+0000 7f565f660640 1 -- 172.21.15.89:0/1925363970 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 28, "format": "json"} v 0) v1 -- 0x7f565804b750 con 0x7f5658102550 2024-09-13T03:05:19.134 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:19.133+0000 7f564dffb640 1 -- 172.21.15.89:0/1925363970 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 28, "format": "json"}]=0 dumped fsmap epoch 28 v43) v1 ==== 107+0+4913 (secure 0 0 0) 0x7f565407ade0 con 0x7f5658102550 2024-09-13T03:05:19.135 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T03:05:19.135 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":28,"btime":"2024-09-13T03:01:10:614020+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34380,"name":"cephfs.smithi089.qjoitb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6827/3159647567","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":3159647567},{"type":"v1","addr":"172.21.15.89:6827","nonce":3159647567}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":44293,"name":"cephfs.smithi131.rbovzc","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6827/1074022424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":1074022424},{"type":"v1","addr":"172.21.15.131:6827","nonce":1074022424}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":44301,"name":"cephfs.smithi131.uasrkg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6825/833117870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":833117870},{"type":"v1","addr":"172.21.15.131:6825","nonce":833117870}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T02:51:40.657817+0000","modified":"2024-09-13T03:01:09.308801+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14480},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_14480":{"gid":14480,"name":"cephfs.smithi089.rarddb","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.89:6829/1561365213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1561365213},{"type":"v1","addr":"172.21.15.89:6829","nonce":1561365213}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14480,"qdb_cluster":[14480]},"id":1}]} 2024-09-13T03:05:19.135 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 28 2024-09-13T03:05:19.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:19.135+0000 7f565f660640 1 -- 172.21.15.89:0/1925363970 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f564406e530 msgr2=0x7f56440709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:19.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:19.135+0000 7f565f660640 1 --2- 172.21.15.89:0/1925363970 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f564406e530 0x7f56440709e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f5648007fd0 tx=0x7f564800b040 comp rx=0 tx=0).stop 2024-09-13T03:05:19.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:19.135+0000 7f565f660640 1 -- 172.21.15.89:0/1925363970 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5658102550 msgr2=0x7f5658113530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:19.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:19.135+0000 7f565f660640 1 --2- 172.21.15.89:0/1925363970 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5658102550 0x7f5658113530 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f5654000c00 tx=0x7f5654009da0 comp rx=0 tx=0).stop 2024-09-13T03:05:19.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:19.135+0000 7f565f660640 1 -- 172.21.15.89:0/1925363970 shutdown_connections 2024-09-13T03:05:19.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:19.135+0000 7f565f660640 1 --2- 172.21.15.89:0/1925363970 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f564406e530 0x7f56440709e0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:19.137 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:19.135+0000 7f565f660640 1 --2- 172.21.15.89:0/1925363970 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f5658102ef0 0x7f5658113a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:19.138 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:19.135+0000 7f565f660640 1 --2- 172.21.15.89:0/1925363970 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f5658102550 0x7f5658113530 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:19.138 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:19.135+0000 7f565f660640 1 -- 172.21.15.89:0/1925363970 >> 172.21.15.89:0/1925363970 conn(0x7f56580f80f0 msgr2=0x7f56580f90a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:05:19.138 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:19.135+0000 7f565f660640 1 -- 172.21.15.89:0/1925363970 shutdown_connections 2024-09-13T03:05:19.138 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:19.135+0000 7f565f660640 1 -- 172.21.15.89:0/1925363970 wait complete. 2024-09-13T03:05:19.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:05:18 smithi131 ceph-mon[78839]: pgmap v299: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:05:19.748 DEBUG:tasks.fs:max_mds reduced in epoch 28 2024-09-13T03:05:19.748 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 28 2024-09-13T03:05:19.748 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 29 2024-09-13T03:05:19.993 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T03:05:20.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:05:19 smithi089 ceph-mon[91553]: from='client.? 172.21.15.89:0/1925363970' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-09-13T03:05:20.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:05:19 smithi131 ceph-mon[78839]: from='client.? 172.21.15.89:0/1925363970' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-09-13T03:05:21.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:05:20 smithi089 ceph-mon[91553]: pgmap v300: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T03:05:21.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:05:20 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:05:21.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:05:20 smithi131 ceph-mon[78839]: pgmap v300: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T03:05:21.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:05:20 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:05:21.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:21.694+0000 7fbcccc4b640 1 -- 172.21.15.89:0/1531374911 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbcc80fcf80 msgr2=0x7fbcc80fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:21.697 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:21.694+0000 7fbcccc4b640 1 --2- 172.21.15.89:0/1531374911 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbcc80fcf80 0x7fbcc80fd3d0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc0048d0 tx=0x7fbcbc009da0 comp rx=0 tx=0).stop 2024-09-13T03:05:21.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:21.695+0000 7fbcccc4b640 1 -- 172.21.15.89:0/1531374911 shutdown_connections 2024-09-13T03:05:21.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:21.695+0000 7fbcccc4b640 1 --2- 172.21.15.89:0/1531374911 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbcc80fcf80 0x7fbcc80fd3d0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:21.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:21.695+0000 7fbcccc4b640 1 --2- 172.21.15.89:0/1531374911 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbcc80fb810 0x7fbcc80fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:21.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:21.695+0000 7fbcccc4b640 1 -- 172.21.15.89:0/1531374911 >> 172.21.15.89:0/1531374911 conn(0x7fbcc80723b0 msgr2=0x7fbcc80727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:05:21.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:21.695+0000 7fbcccc4b640 1 -- 172.21.15.89:0/1531374911 shutdown_connections 2024-09-13T03:05:21.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:21.695+0000 7fbcccc4b640 1 -- 172.21.15.89:0/1531374911 wait complete. 2024-09-13T03:05:21.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:21.695+0000 7fbcccc4b640 1 Processor -- start 2024-09-13T03:05:21.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:21.695+0000 7fbcccc4b640 1 -- start start 2024-09-13T03:05:21.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:21.695+0000 7fbcccc4b640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbcc80fb810 0x7fbcc810e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:21.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:21.695+0000 7fbcccc4b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbcc80fcf80 0x7fbcc810e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:21.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:21.695+0000 7fbcccc4b640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcc810ecb0 con 0x7fbcc80fcf80 2024-09-13T03:05:21.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:21.695+0000 7fbcccc4b640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcc810ee20 con 0x7fbcc80fb810 2024-09-13T03:05:21.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:21.695+0000 7fbcc5d9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbcc80fcf80 0x7fbcc810e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:21.698 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:21.695+0000 7fbcc5d9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbcc80fcf80 0x7fbcc810e6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:44006/0 (socket says 172.21.15.89:44006) 2024-09-13T03:05:21.699 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:21.695+0000 7fbcc5d9b640 1 -- 172.21.15.89:0/99655811 learned_addr learned my addr 172.21.15.89:0/99655811 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T03:05:21.699 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:21.696+0000 7fbcc659c640 1 --2- 172.21.15.89:0/99655811 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbcc80fb810 0x7fbcc810e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:21.699 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:21.696+0000 7fbcc5d9b640 1 -- 172.21.15.89:0/99655811 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbcc80fb810 msgr2=0x7fbcc810e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:21.699 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:21.696+0000 7fbcc5d9b640 1 --2- 172.21.15.89:0/99655811 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbcc80fb810 0x7fbcc810e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:21.699 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:21.696+0000 7fbcc5d9b640 1 -- 172.21.15.89:0/99655811 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcbc005040 con 0x7fbcc80fcf80 2024-09-13T03:05:21.699 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:21.696+0000 7fbcc5d9b640 1 --2- 172.21.15.89:0/99655811 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbcc80fcf80 0x7fbcc810e6b0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc0043d0 tx=0x7fbcbc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:05:21.699 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:21.696+0000 7fbcb6ffd640 1 -- 172.21.15.89:0/99655811 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbcbc038070 con 0x7fbcc80fcf80 2024-09-13T03:05:21.699 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:21.696+0000 7fbcb6ffd640 1 -- 172.21.15.89:0/99655811 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fbcbc0096e0 con 0x7fbcc80fcf80 2024-09-13T03:05:21.699 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:21.696+0000 7fbcb6ffd640 1 -- 172.21.15.89:0/99655811 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbcbc03d420 con 0x7fbcc80fcf80 2024-09-13T03:05:21.699 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:21.696+0000 7fbcccc4b640 1 -- 172.21.15.89:0/99655811 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcc81171e0 con 0x7fbcc80fcf80 2024-09-13T03:05:21.699 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:21.696+0000 7fbcccc4b640 1 -- 172.21.15.89:0/99655811 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcc81176a0 con 0x7fbcc80fcf80 2024-09-13T03:05:21.700 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:21.697+0000 7fbcccc4b640 1 -- 172.21.15.89:0/99655811 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcc80fcbc0 con 0x7fbcc80fcf80 2024-09-13T03:05:21.700 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:21.698+0000 7fbcb6ffd640 1 -- 172.21.15.89:0/99655811 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fbcbc030020 con 0x7fbcc80fcf80 2024-09-13T03:05:21.700 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:21.698+0000 7fbcb6ffd640 1 --2- 172.21.15.89:0/99655811 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fbcb006e530 0x7fbcb00709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:21.701 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:21.698+0000 7fbcb6ffd640 1 -- 172.21.15.89:0/99655811 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fbcbc0ae790 con 0x7fbcc80fcf80 2024-09-13T03:05:21.701 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:21.698+0000 7fbcc659c640 1 --2- 172.21.15.89:0/99655811 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fbcb006e530 0x7fbcb00709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:21.701 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:21.699+0000 7fbcc659c640 1 --2- 172.21.15.89:0/99655811 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fbcb006e530 0x7fbcb00709e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fbcb8007fd0 tx=0x7fbcb8009e90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:05:21.705 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:21.704+0000 7fbcb6ffd640 1 -- 172.21.15.89:0/99655811 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fbcbc077820 con 0x7fbcc80fcf80 2024-09-13T03:05:21.904 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:21.903+0000 7fbcccc4b640 1 -- 172.21.15.89:0/99655811 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 29, "format": "json"} v 0) v1 -- 0x7fbcc804b720 con 0x7fbcc80fcf80 2024-09-13T03:05:21.905 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:21.904+0000 7fbcb6ffd640 1 -- 172.21.15.89:0/99655811 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 29, "format": "json"}]=0 dumped fsmap epoch 29 v43) v1 ==== 107+0+4134 (secure 0 0 0) 0x7fbcbc07aee0 con 0x7fbcc80fcf80 2024-09-13T03:05:21.905 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T03:05:21.905 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":29,"btime":"2024-09-13T03:01:20:678925+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44293,"name":"cephfs.smithi131.rbovzc","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6827/1074022424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":1074022424},{"type":"v1","addr":"172.21.15.131:6827","nonce":1074022424}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":44301,"name":"cephfs.smithi131.uasrkg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6825/833117870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":833117870},{"type":"v1","addr":"172.21.15.131:6825","nonce":833117870}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T02:51:40.657817+0000","modified":"2024-09-13T03:01:09.308801+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14480},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_14480":{"gid":14480,"name":"cephfs.smithi089.rarddb","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.89:6829/1561365213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1561365213},{"type":"v1","addr":"172.21.15.89:6829","nonce":1561365213}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14480,"qdb_cluster":[14480]},"id":1}]} 2024-09-13T03:05:21.905 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 29 2024-09-13T03:05:21.907 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:21.906+0000 7fbcccc4b640 1 -- 172.21.15.89:0/99655811 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fbcb006e530 msgr2=0x7fbcb00709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:21.907 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:21.906+0000 7fbcccc4b640 1 --2- 172.21.15.89:0/99655811 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fbcb006e530 0x7fbcb00709e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fbcb8007fd0 tx=0x7fbcb8009e90 comp rx=0 tx=0).stop 2024-09-13T03:05:21.907 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:21.906+0000 7fbcccc4b640 1 -- 172.21.15.89:0/99655811 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbcc80fcf80 msgr2=0x7fbcc810e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:21.907 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:21.906+0000 7fbcccc4b640 1 --2- 172.21.15.89:0/99655811 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbcc80fcf80 0x7fbcc810e6b0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fbcbc0043d0 tx=0x7fbcbc009da0 comp rx=0 tx=0).stop 2024-09-13T03:05:21.907 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:21.906+0000 7fbcccc4b640 1 -- 172.21.15.89:0/99655811 shutdown_connections 2024-09-13T03:05:21.907 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:21.906+0000 7fbcccc4b640 1 --2- 172.21.15.89:0/99655811 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fbcb006e530 0x7fbcb00709e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:21.908 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:21.906+0000 7fbcccc4b640 1 --2- 172.21.15.89:0/99655811 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fbcc80fcf80 0x7fbcc810e6b0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:21.908 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:21.906+0000 7fbcccc4b640 1 --2- 172.21.15.89:0/99655811 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fbcc80fb810 0x7fbcc810e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:21.908 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:21.906+0000 7fbcccc4b640 1 -- 172.21.15.89:0/99655811 >> 172.21.15.89:0/99655811 conn(0x7fbcc80723b0 msgr2=0x7fbcc80fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:05:21.908 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:21.906+0000 7fbcccc4b640 1 -- 172.21.15.89:0/99655811 shutdown_connections 2024-09-13T03:05:21.908 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:21.906+0000 7fbcccc4b640 1 -- 172.21.15.89:0/99655811 wait complete. 2024-09-13T03:05:22.540 DEBUG:tasks.fs:max_mds reduced in epoch 29 2024-09-13T03:05:22.540 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 29 2024-09-13T03:05:22.540 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 30 2024-09-13T03:05:22.786 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T03:05:23.021 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:05:22 smithi089 ceph-mon[91553]: pgmap v301: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:05:23.021 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:05:22 smithi089 ceph-mon[91553]: from='client.? 172.21.15.89:0/99655811' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-09-13T03:05:23.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:05:22 smithi131 ceph-mon[78839]: pgmap v301: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:05:23.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:05:22 smithi131 ceph-mon[78839]: from='client.? 172.21.15.89:0/99655811' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-09-13T03:05:24.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:24.301+0000 7f23efe59640 1 -- 172.21.15.89:0/586948208 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23e8065c10 msgr2=0x7f23e80fe0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:24.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:24.301+0000 7f23efe59640 1 --2- 172.21.15.89:0/586948208 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23e8065c10 0x7f23e80fe0d0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f23dc0048d0 tx=0x7f23dc009da0 comp rx=0 tx=0).stop 2024-09-13T03:05:24.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:24.301+0000 7f23efe59640 1 -- 172.21.15.89:0/586948208 shutdown_connections 2024-09-13T03:05:24.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:24.301+0000 7f23efe59640 1 --2- 172.21.15.89:0/586948208 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23e8065c10 0x7f23e80fe0d0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:24.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:24.301+0000 7f23efe59640 1 --2- 172.21.15.89:0/586948208 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f23e8065300 0x7f23e80656d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:24.304 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:24.301+0000 7f23efe59640 1 -- 172.21.15.89:0/586948208 >> 172.21.15.89:0/586948208 conn(0x7f23e80723b0 msgr2=0x7f23e80727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:05:24.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:24.301+0000 7f23efe59640 1 -- 172.21.15.89:0/586948208 shutdown_connections 2024-09-13T03:05:24.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:24.301+0000 7f23efe59640 1 -- 172.21.15.89:0/586948208 wait complete. 2024-09-13T03:05:24.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:24.301+0000 7f23efe59640 1 Processor -- start 2024-09-13T03:05:24.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:24.301+0000 7f23efe59640 1 -- start start 2024-09-13T03:05:24.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:24.302+0000 7f23efe59640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23e8065300 0x7f23e8113290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:24.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:24.302+0000 7f23efe59640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f23e8065c10 0x7f23e81137d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:24.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:24.302+0000 7f23efe59640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23e8113e60 con 0x7f23e8065300 2024-09-13T03:05:24.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:24.302+0000 7f23efe59640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23e810d210 con 0x7f23e8065c10 2024-09-13T03:05:24.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:24.302+0000 7f23edbf5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23e8065300 0x7f23e8113290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:24.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:24.302+0000 7f23edbf5640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23e8065300 0x7f23e8113290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:44026/0 (socket says 172.21.15.89:44026) 2024-09-13T03:05:24.305 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:24.302+0000 7f23edbf5640 1 -- 172.21.15.89:0/609897053 learned_addr learned my addr 172.21.15.89:0/609897053 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T03:05:24.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:24.302+0000 7f23ed3f4640 1 --2- 172.21.15.89:0/609897053 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f23e8065c10 0x7f23e81137d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:24.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:24.302+0000 7f23edbf5640 1 -- 172.21.15.89:0/609897053 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f23e8065c10 msgr2=0x7f23e81137d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:24.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:24.302+0000 7f23edbf5640 1 --2- 172.21.15.89:0/609897053 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f23e8065c10 0x7f23e81137d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:24.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:24.302+0000 7f23edbf5640 1 -- 172.21.15.89:0/609897053 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23dc005040 con 0x7f23e8065300 2024-09-13T03:05:24.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:24.302+0000 7f23edbf5640 1 --2- 172.21.15.89:0/609897053 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23e8065300 0x7f23e8113290 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f23d800bbb0 tx=0x7f23d8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:05:24.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:24.302+0000 7f23e67fc640 1 -- 172.21.15.89:0/609897053 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f23d800c940 con 0x7f23e8065300 2024-09-13T03:05:24.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:24.302+0000 7f23efe59640 1 -- 172.21.15.89:0/609897053 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23e810d4f0 con 0x7f23e8065300 2024-09-13T03:05:24.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:24.302+0000 7f23e67fc640 1 -- 172.21.15.89:0/609897053 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f23d80092e0 con 0x7f23e8065300 2024-09-13T03:05:24.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:24.303+0000 7f23e67fc640 1 -- 172.21.15.89:0/609897053 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f23d8007640 con 0x7f23e8065300 2024-09-13T03:05:24.306 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:24.303+0000 7f23efe59640 1 -- 172.21.15.89:0/609897053 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23e810d9e0 con 0x7f23e8065300 2024-09-13T03:05:24.307 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:24.304+0000 7f23efe59640 1 -- 172.21.15.89:0/609897053 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23e80fdce0 con 0x7f23e8065300 2024-09-13T03:05:24.307 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:24.304+0000 7f23e67fc640 1 -- 172.21.15.89:0/609897053 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f23d8012070 con 0x7f23e8065300 2024-09-13T03:05:24.307 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:24.305+0000 7f23e67fc640 1 --2- 172.21.15.89:0/609897053 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f23d006e530 0x7f23d00709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:24.307 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:24.305+0000 7f23e67fc640 1 -- 172.21.15.89:0/609897053 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f23d808e2b0 con 0x7f23e8065300 2024-09-13T03:05:24.307 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:24.305+0000 7f23ed3f4640 1 --2- 172.21.15.89:0/609897053 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f23d006e530 0x7f23d00709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:24.308 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:24.305+0000 7f23ed3f4640 1 --2- 172.21.15.89:0/609897053 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f23d006e530 0x7f23d00709e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f23dc009ac0 tx=0x7f23dc035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:05:24.310 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:24.309+0000 7f23e67fc640 1 -- 172.21.15.89:0/609897053 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f23d8057340 con 0x7f23e8065300 2024-09-13T03:05:24.511 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:24.510+0000 7f23efe59640 1 -- 172.21.15.89:0/609897053 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 30, "format": "json"} v 0) v1 -- 0x7f23e804b720 con 0x7f23e8065300 2024-09-13T03:05:24.512 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:24.511+0000 7f23e67fc640 1 -- 172.21.15.89:0/609897053 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 30, "format": "json"}]=0 dumped fsmap epoch 30 v43) v1 ==== 107+0+4981 (secure 0 0 0) 0x7f23d805aa00 con 0x7f23e8065300 2024-09-13T03:05:24.512 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T03:05:24.512 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":30,"btime":"2024-09-13T03:01:26:692249+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34416,"name":"cephfs.smithi089.qjoitb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6827/2439422546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2439422546},{"type":"v1","addr":"172.21.15.89:6827","nonce":2439422546}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":44293,"name":"cephfs.smithi131.rbovzc","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6827/1074022424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":1074022424},{"type":"v1","addr":"172.21.15.131:6827","nonce":1074022424}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":44301,"name":"cephfs.smithi131.uasrkg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6825/833117870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":833117870},{"type":"v1","addr":"172.21.15.131:6825","nonce":833117870}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T02:51:40.657817+0000","modified":"2024-09-13T03:01:09.308801+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14480},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_14480":{"gid":14480,"name":"cephfs.smithi089.rarddb","rank":0,"incarnation":14,"state":"up:active","state_seq":6,"addr":"172.21.15.89:6829/1561365213","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":1561365213},{"type":"v1","addr":"172.21.15.89:6829","nonce":1561365213}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":14480,"qdb_cluster":[14480]},"id":1}]} 2024-09-13T03:05:24.513 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 30 2024-09-13T03:05:24.515 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:24.513+0000 7f23efe59640 1 -- 172.21.15.89:0/609897053 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f23d006e530 msgr2=0x7f23d00709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:24.515 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:24.513+0000 7f23efe59640 1 --2- 172.21.15.89:0/609897053 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f23d006e530 0x7f23d00709e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f23dc009ac0 tx=0x7f23dc035040 comp rx=0 tx=0).stop 2024-09-13T03:05:24.515 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:24.513+0000 7f23efe59640 1 -- 172.21.15.89:0/609897053 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23e8065300 msgr2=0x7f23e8113290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:24.515 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:24.513+0000 7f23efe59640 1 --2- 172.21.15.89:0/609897053 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23e8065300 0x7f23e8113290 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f23d800bbb0 tx=0x7f23d8009840 comp rx=0 tx=0).stop 2024-09-13T03:05:24.515 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:24.513+0000 7f23efe59640 1 -- 172.21.15.89:0/609897053 shutdown_connections 2024-09-13T03:05:24.515 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:24.513+0000 7f23efe59640 1 --2- 172.21.15.89:0/609897053 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f23d006e530 0x7f23d00709e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:24.515 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:24.513+0000 7f23efe59640 1 --2- 172.21.15.89:0/609897053 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f23e8065c10 0x7f23e81137d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:24.515 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:24.513+0000 7f23efe59640 1 --2- 172.21.15.89:0/609897053 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f23e8065300 0x7f23e8113290 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:24.515 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:24.513+0000 7f23efe59640 1 -- 172.21.15.89:0/609897053 >> 172.21.15.89:0/609897053 conn(0x7f23e80723b0 msgr2=0x7f23e80fa2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:05:24.515 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:24.513+0000 7f23efe59640 1 -- 172.21.15.89:0/609897053 shutdown_connections 2024-09-13T03:05:24.515 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:24.513+0000 7f23efe59640 1 -- 172.21.15.89:0/609897053 wait complete. 2024-09-13T03:05:25.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:05:24 smithi089 ceph-mon[91553]: pgmap v302: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T03:05:25.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:05:24 smithi089 ceph-mon[91553]: from='client.? 172.21.15.89:0/609897053' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-09-13T03:05:25.114 DEBUG:tasks.fs:max_mds reduced in epoch 30 2024-09-13T03:05:25.114 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 30 2024-09-13T03:05:25.114 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 31 2024-09-13T03:05:25.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:05:24 smithi131 ceph-mon[78839]: pgmap v302: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T03:05:25.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:05:24 smithi131 ceph-mon[78839]: from='client.? 172.21.15.89:0/609897053' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-09-13T03:05:25.360 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T03:05:26.785 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:05:26 smithi089 ceph-mon[91553]: pgmap v303: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:05:27.089 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:27.083+0000 7f4eef809640 1 -- 172.21.15.89:0/4236260350 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ee80fcf80 msgr2=0x7f4ee80fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:27.089 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:27.083+0000 7f4eef809640 1 --2- 172.21.15.89:0/4236260350 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ee80fcf80 0x7f4ee80fd3d0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f4edc0048d0 tx=0x7f4edc009da0 comp rx=0 tx=0).stop 2024-09-13T03:05:27.090 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:27.083+0000 7f4eef809640 1 -- 172.21.15.89:0/4236260350 shutdown_connections 2024-09-13T03:05:27.090 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:27.083+0000 7f4eef809640 1 --2- 172.21.15.89:0/4236260350 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ee80fcf80 0x7f4ee80fd3d0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:27.090 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:27.083+0000 7f4eef809640 1 --2- 172.21.15.89:0/4236260350 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4ee80fb810 0x7f4ee80fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:27.090 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:27.083+0000 7f4eef809640 1 -- 172.21.15.89:0/4236260350 >> 172.21.15.89:0/4236260350 conn(0x7f4ee80723b0 msgr2=0x7f4ee80727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:05:27.090 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:27.083+0000 7f4eef809640 1 -- 172.21.15.89:0/4236260350 shutdown_connections 2024-09-13T03:05:27.090 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:27.083+0000 7f4eef809640 1 -- 172.21.15.89:0/4236260350 wait complete. 2024-09-13T03:05:27.090 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:27.083+0000 7f4eef809640 1 Processor -- start 2024-09-13T03:05:27.090 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:27.083+0000 7f4eef809640 1 -- start start 2024-09-13T03:05:27.090 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:27.084+0000 7f4eef809640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4ee80fb810 0x7f4ee810e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:27.090 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:27.084+0000 7f4eef809640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ee80fcf80 0x7f4ee810e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:27.090 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:27.084+0000 7f4eef809640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee810ed20 con 0x7f4ee80fcf80 2024-09-13T03:05:27.090 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:27.084+0000 7f4eef809640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ee810ee90 con 0x7f4ee80fb810 2024-09-13T03:05:27.090 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:27.084+0000 7f4eecda4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ee80fcf80 0x7f4ee810e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:27.091 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:27.084+0000 7f4eecda4640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ee80fcf80 0x7f4ee810e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:44038/0 (socket says 172.21.15.89:44038) 2024-09-13T03:05:27.091 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:27.084+0000 7f4eecda4640 1 -- 172.21.15.89:0/3380373499 learned_addr learned my addr 172.21.15.89:0/3380373499 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T03:05:27.091 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:27.084+0000 7f4eed5a5640 1 --2- 172.21.15.89:0/3380373499 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4ee80fb810 0x7f4ee810e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:27.091 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:27.084+0000 7f4eecda4640 1 -- 172.21.15.89:0/3380373499 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4ee80fb810 msgr2=0x7f4ee810e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:27.091 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:27.084+0000 7f4eecda4640 1 --2- 172.21.15.89:0/3380373499 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4ee80fb810 0x7f4ee810e190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:27.091 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:27.084+0000 7f4eecda4640 1 -- 172.21.15.89:0/3380373499 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4edc005040 con 0x7f4ee80fcf80 2024-09-13T03:05:27.091 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:27.084+0000 7f4eecda4640 1 --2- 172.21.15.89:0/3380373499 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ee80fcf80 0x7f4ee810e6d0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f4edc000c00 tx=0x7f4edc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:05:27.091 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:27.084+0000 7f4ee5ffb640 1 -- 172.21.15.89:0/3380373499 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4edc038070 con 0x7f4ee80fcf80 2024-09-13T03:05:27.091 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:27.084+0000 7f4eef809640 1 -- 172.21.15.89:0/3380373499 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ee8117200 con 0x7f4ee80fcf80 2024-09-13T03:05:27.091 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:27.084+0000 7f4ee5ffb640 1 -- 172.21.15.89:0/3380373499 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f4edc02ade0 con 0x7f4ee80fcf80 2024-09-13T03:05:27.091 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:27.084+0000 7f4ee5ffb640 1 -- 172.21.15.89:0/3380373499 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4edc02c7e0 con 0x7f4ee80fcf80 2024-09-13T03:05:27.091 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:27.085+0000 7f4eef809640 1 -- 172.21.15.89:0/3380373499 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ee8117660 con 0x7f4ee80fcf80 2024-09-13T03:05:27.091 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:27.085+0000 7f4eef809640 1 -- 172.21.15.89:0/3380373499 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ee80fcbc0 con 0x7f4ee80fcf80 2024-09-13T03:05:27.091 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:27.086+0000 7f4ee5ffb640 1 -- 172.21.15.89:0/3380373499 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f4edc030020 con 0x7f4ee80fcf80 2024-09-13T03:05:27.092 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:27.086+0000 7f4ee5ffb640 1 --2- 172.21.15.89:0/3380373499 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f4ed006e530 0x7f4ed00709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:27.092 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:27.087+0000 7f4ee5ffb640 1 -- 172.21.15.89:0/3380373499 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f4edc0ade50 con 0x7f4ee80fcf80 2024-09-13T03:05:27.092 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:27.087+0000 7f4eed5a5640 1 --2- 172.21.15.89:0/3380373499 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f4ed006e530 0x7f4ed00709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:27.092 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:27.087+0000 7f4eed5a5640 1 --2- 172.21.15.89:0/3380373499 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f4ed006e530 0x7f4ed00709e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4ed8007fa0 tx=0x7f4ed8004c70 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:05:27.092 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:27.091+0000 7f4ee5ffb640 1 -- 172.21.15.89:0/3380373499 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f4edc076f90 con 0x7f4ee80fcf80 2024-09-13T03:05:27.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:05:26 smithi131 ceph-mon[78839]: pgmap v303: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:05:27.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:27.293+0000 7f4eef809640 1 -- 172.21.15.89:0/3380373499 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 31, "format": "json"} v 0) v1 -- 0x7f4ee8072ec0 con 0x7f4ee80fcf80 2024-09-13T03:05:27.295 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:27.293+0000 7f4ee5ffb640 1 -- 172.21.15.89:0/3380373499 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 31, "format": "json"}]=0 dumped fsmap epoch 31 v43) v1 ==== 107+0+4183 (secure 0 0 0) 0x7f4edc07a650 con 0x7f4ee80fcf80 2024-09-13T03:05:27.295 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T03:05:27.295 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":31,"btime":"2024-09-13T03:01:37:943762+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34416,"name":"cephfs.smithi089.qjoitb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6827/2439422546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2439422546},{"type":"v1","addr":"172.21.15.89:6827","nonce":2439422546}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":30},{"gid":44293,"name":"cephfs.smithi131.rbovzc","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6827/1074022424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":1074022424},{"type":"v1","addr":"172.21.15.131:6827","nonce":1074022424}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":44301,"name":"cephfs.smithi131.uasrkg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6825/833117870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":833117870},{"type":"v1","addr":"172.21.15.131:6825","nonce":833117870}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T02:51:40.657817+0000","modified":"2024-09-13T03:01:37.943760+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{},"failed":[0],"damaged":[],"stopped":[1],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-13T03:05:27.295 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 31 2024-09-13T03:05:27.297 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:27.296+0000 7f4eef809640 1 -- 172.21.15.89:0/3380373499 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f4ed006e530 msgr2=0x7f4ed00709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:27.297 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:27.296+0000 7f4eef809640 1 --2- 172.21.15.89:0/3380373499 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f4ed006e530 0x7f4ed00709e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f4ed8007fa0 tx=0x7f4ed8004c70 comp rx=0 tx=0).stop 2024-09-13T03:05:27.297 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:27.296+0000 7f4eef809640 1 -- 172.21.15.89:0/3380373499 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ee80fcf80 msgr2=0x7f4ee810e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:27.298 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:27.296+0000 7f4eef809640 1 --2- 172.21.15.89:0/3380373499 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ee80fcf80 0x7f4ee810e6d0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f4edc000c00 tx=0x7f4edc009da0 comp rx=0 tx=0).stop 2024-09-13T03:05:27.298 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:27.296+0000 7f4eef809640 1 -- 172.21.15.89:0/3380373499 shutdown_connections 2024-09-13T03:05:27.298 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:27.296+0000 7f4eef809640 1 --2- 172.21.15.89:0/3380373499 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f4ed006e530 0x7f4ed00709e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:27.298 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:27.296+0000 7f4eef809640 1 --2- 172.21.15.89:0/3380373499 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f4ee80fcf80 0x7f4ee810e6d0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:27.298 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:27.296+0000 7f4eef809640 1 --2- 172.21.15.89:0/3380373499 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f4ee80fb810 0x7f4ee810e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:27.298 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:27.296+0000 7f4eef809640 1 -- 172.21.15.89:0/3380373499 >> 172.21.15.89:0/3380373499 conn(0x7f4ee80723b0 msgr2=0x7f4ee80fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:05:27.298 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:27.296+0000 7f4eef809640 1 -- 172.21.15.89:0/3380373499 shutdown_connections 2024-09-13T03:05:27.298 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:27.296+0000 7f4eef809640 1 -- 172.21.15.89:0/3380373499 wait complete. 2024-09-13T03:05:27.985 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:05:27 smithi089 ceph-mon[91553]: from='client.? 172.21.15.89:0/3380373499' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-09-13T03:05:28.011 DEBUG:tasks.fs:max_mds reduced in epoch 31 2024-09-13T03:05:28.011 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 31 2024-09-13T03:05:28.012 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 32 2024-09-13T03:05:28.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:05:27 smithi131 ceph-mon[78839]: from='client.? 172.21.15.89:0/3380373499' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-09-13T03:05:28.258 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T03:05:29.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:05:28 smithi089 ceph-mon[91553]: pgmap v304: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:05:29.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:05:28 smithi131 ceph-mon[78839]: pgmap v304: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:05:29.865 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:29.862+0000 7f6c7c29e640 1 -- 172.21.15.89:0/1002242902 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6c740fd560 msgr2=0x7f6c740fd930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:29.865 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:29.862+0000 7f6c7c29e640 1 --2- 172.21.15.89:0/1002242902 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6c740fd560 0x7f6c740fd930 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f6c64009c80 tx=0x7f6c64004d10 comp rx=0 tx=0).stop 2024-09-13T03:05:29.865 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:29.862+0000 7f6c7c29e640 1 -- 172.21.15.89:0/1002242902 shutdown_connections 2024-09-13T03:05:29.865 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:29.862+0000 7f6c7c29e640 1 --2- 172.21.15.89:0/1002242902 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6c740fdf00 0x7f6c741065d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:29.865 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:29.862+0000 7f6c7c29e640 1 --2- 172.21.15.89:0/1002242902 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6c740fd560 0x7f6c740fd930 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:29.865 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:29.862+0000 7f6c7c29e640 1 -- 172.21.15.89:0/1002242902 >> 172.21.15.89:0/1002242902 conn(0x7f6c740f7000 msgr2=0x7f6c740f9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:05:29.866 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:29.862+0000 7f6c7c29e640 1 -- 172.21.15.89:0/1002242902 shutdown_connections 2024-09-13T03:05:29.866 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:29.862+0000 7f6c7c29e640 1 -- 172.21.15.89:0/1002242902 wait complete. 2024-09-13T03:05:29.866 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:29.862+0000 7f6c7c29e640 1 Processor -- start 2024-09-13T03:05:29.866 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:29.862+0000 7f6c7c29e640 1 -- start start 2024-09-13T03:05:29.866 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:29.862+0000 7f6c7c29e640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6c740fd560 0x7f6c741132f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:29.866 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:29.862+0000 7f6c7c29e640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6c740fdf00 0x7f6c74113830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:29.866 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:29.863+0000 7f6c7c29e640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c74113ec0 con 0x7f6c740fdf00 2024-09-13T03:05:29.866 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:29.863+0000 7f6c7c29e640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c7410d270 con 0x7f6c740fd560 2024-09-13T03:05:29.866 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:29.863+0000 7f6c79839640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6c740fdf00 0x7f6c74113830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:29.866 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:29.863+0000 7f6c79839640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6c740fdf00 0x7f6c74113830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:44054/0 (socket says 172.21.15.89:44054) 2024-09-13T03:05:29.866 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:29.863+0000 7f6c79839640 1 -- 172.21.15.89:0/1227794938 learned_addr learned my addr 172.21.15.89:0/1227794938 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T03:05:29.867 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:29.863+0000 7f6c7a03a640 1 --2- 172.21.15.89:0/1227794938 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6c740fd560 0x7f6c741132f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:29.867 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:29.863+0000 7f6c79839640 1 -- 172.21.15.89:0/1227794938 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6c740fd560 msgr2=0x7f6c741132f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:29.867 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:29.863+0000 7f6c79839640 1 --2- 172.21.15.89:0/1227794938 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6c740fd560 0x7f6c741132f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:29.867 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:29.863+0000 7f6c79839640 1 -- 172.21.15.89:0/1227794938 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c640098b0 con 0x7f6c740fdf00 2024-09-13T03:05:29.867 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:29.863+0000 7f6c79839640 1 --2- 172.21.15.89:0/1227794938 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6c740fdf00 0x7f6c74113830 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f6c6800b790 tx=0x7f6c680091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:05:29.867 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:29.863+0000 7f6c72ffd640 1 -- 172.21.15.89:0/1227794938 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6c6800c700 con 0x7f6c740fdf00 2024-09-13T03:05:29.867 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:29.863+0000 7f6c7c29e640 1 -- 172.21.15.89:0/1227794938 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c7410d550 con 0x7f6c740fdf00 2024-09-13T03:05:29.867 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:29.863+0000 7f6c72ffd640 1 -- 172.21.15.89:0/1227794938 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f6c6800cd00 con 0x7f6c740fdf00 2024-09-13T03:05:29.867 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:29.863+0000 7f6c72ffd640 1 -- 172.21.15.89:0/1227794938 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6c68015e70 con 0x7f6c740fdf00 2024-09-13T03:05:29.867 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:29.863+0000 7f6c7c29e640 1 -- 172.21.15.89:0/1227794938 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c7410da70 con 0x7f6c740fdf00 2024-09-13T03:05:29.868 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:29.864+0000 7f6c7c29e640 1 -- 172.21.15.89:0/1227794938 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c740662b0 con 0x7f6c740fdf00 2024-09-13T03:05:29.868 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:29.865+0000 7f6c72ffd640 1 -- 172.21.15.89:0/1227794938 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f6c68012070 con 0x7f6c740fdf00 2024-09-13T03:05:29.868 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:29.865+0000 7f6c72ffd640 1 --2- 172.21.15.89:0/1227794938 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f6c5c06e530 0x7f6c5c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:29.869 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:29.865+0000 7f6c72ffd640 1 -- 172.21.15.89:0/1227794938 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f6c6808db10 con 0x7f6c740fdf00 2024-09-13T03:05:29.869 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:29.865+0000 7f6c7a03a640 1 --2- 172.21.15.89:0/1227794938 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f6c5c06e530 0x7f6c5c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:29.869 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:29.866+0000 7f6c7a03a640 1 --2- 172.21.15.89:0/1227794938 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f6c5c06e530 0x7f6c5c0709e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6c64004a30 tx=0x7f6c64004d10 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:05:29.871 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:29.870+0000 7f6c72ffd640 1 -- 172.21.15.89:0/1227794938 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f6c68056c20 con 0x7f6c740fdf00 2024-09-13T03:05:30.072 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:30.071+0000 7f6c7c29e640 1 -- 172.21.15.89:0/1227794938 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 32, "format": "json"} v 0) v1 -- 0x7f6c740fac40 con 0x7f6c740fdf00 2024-09-13T03:05:30.073 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:30.072+0000 7f6c72ffd640 1 -- 172.21.15.89:0/1227794938 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 32, "format": "json"}]=0 dumped fsmap epoch 32 v43) v1 ==== 107+0+4262 (secure 0 0 0) 0x7f6c6805a2e0 con 0x7f6c740fdf00 2024-09-13T03:05:30.073 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T03:05:30.074 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":32,"btime":"2024-09-13T03:01:37:948066+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44293,"name":"cephfs.smithi131.rbovzc","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6827/1074022424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":1074022424},{"type":"v1","addr":"172.21.15.131:6827","nonce":1074022424}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":44301,"name":"cephfs.smithi131.uasrkg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6825/833117870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":833117870},{"type":"v1","addr":"172.21.15.131:6825","nonce":833117870}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T02:51:40.657817+0000","modified":"2024-09-13T03:01:37.948057+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34416},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34416":{"gid":34416,"name":"cephfs.smithi089.qjoitb","rank":0,"incarnation":32,"state":"up:replay","state_seq":1,"addr":"172.21.15.89:6827/2439422546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2439422546},{"type":"v1","addr":"172.21.15.89:6827","nonce":2439422546}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-13T03:05:30.074 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 32 2024-09-13T03:05:30.075 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:30.074+0000 7f6c7c29e640 1 -- 172.21.15.89:0/1227794938 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f6c5c06e530 msgr2=0x7f6c5c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:30.075 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:30.074+0000 7f6c7c29e640 1 --2- 172.21.15.89:0/1227794938 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f6c5c06e530 0x7f6c5c0709e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6c64004a30 tx=0x7f6c64004d10 comp rx=0 tx=0).stop 2024-09-13T03:05:30.075 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:30.074+0000 7f6c7c29e640 1 -- 172.21.15.89:0/1227794938 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6c740fdf00 msgr2=0x7f6c74113830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:30.076 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:30.074+0000 7f6c7c29e640 1 --2- 172.21.15.89:0/1227794938 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6c740fdf00 0x7f6c74113830 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f6c6800b790 tx=0x7f6c680091d0 comp rx=0 tx=0).stop 2024-09-13T03:05:30.076 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:30.074+0000 7f6c7c29e640 1 -- 172.21.15.89:0/1227794938 shutdown_connections 2024-09-13T03:05:30.076 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:30.074+0000 7f6c7c29e640 1 --2- 172.21.15.89:0/1227794938 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f6c5c06e530 0x7f6c5c0709e0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:30.076 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:30.074+0000 7f6c7c29e640 1 --2- 172.21.15.89:0/1227794938 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f6c740fdf00 0x7f6c74113830 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:30.076 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:30.074+0000 7f6c7c29e640 1 --2- 172.21.15.89:0/1227794938 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f6c740fd560 0x7f6c741132f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:30.076 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:30.074+0000 7f6c7c29e640 1 -- 172.21.15.89:0/1227794938 >> 172.21.15.89:0/1227794938 conn(0x7f6c740f7000 msgr2=0x7f6c740f8580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:05:30.076 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:30.074+0000 7f6c7c29e640 1 -- 172.21.15.89:0/1227794938 shutdown_connections 2024-09-13T03:05:30.076 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:30.074+0000 7f6c7c29e640 1 -- 172.21.15.89:0/1227794938 wait complete. 2024-09-13T03:05:30.775 DEBUG:tasks.fs:max_mds reduced in epoch 32 2024-09-13T03:05:30.775 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 32 2024-09-13T03:05:30.775 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 33 2024-09-13T03:05:31.021 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T03:05:31.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:05:30 smithi089 ceph-mon[91553]: pgmap v305: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T03:05:31.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:05:30 smithi089 ceph-mon[91553]: from='client.? 172.21.15.89:0/1227794938' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-09-13T03:05:31.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:05:30 smithi131 ceph-mon[78839]: pgmap v305: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T03:05:31.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:05:30 smithi131 ceph-mon[78839]: from='client.? 172.21.15.89:0/1227794938' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-09-13T03:05:32.737 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:32.732+0000 7ff06959d640 1 -- 172.21.15.89:0/3204091541 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff064102ef0 msgr2=0x7ff0640fc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:32.737 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:32.732+0000 7ff06959d640 1 --2- 172.21.15.89:0/3204091541 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff064102ef0 0x7ff0640fc5b0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7ff04c0048d0 tx=0x7ff04c009da0 comp rx=0 tx=0).stop 2024-09-13T03:05:32.737 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:32.732+0000 7ff06959d640 1 -- 172.21.15.89:0/3204091541 shutdown_connections 2024-09-13T03:05:32.737 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:32.732+0000 7ff06959d640 1 --2- 172.21.15.89:0/3204091541 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff064102ef0 0x7ff0640fc5b0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:32.737 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:32.732+0000 7ff06959d640 1 --2- 172.21.15.89:0/3204091541 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff064102550 0x7ff064102920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:32.737 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:32.732+0000 7ff06959d640 1 -- 172.21.15.89:0/3204091541 >> 172.21.15.89:0/3204091541 conn(0x7ff0640f80f0 msgr2=0x7ff0640fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:05:32.737 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:32.732+0000 7ff06959d640 1 -- 172.21.15.89:0/3204091541 shutdown_connections 2024-09-13T03:05:32.737 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:32.732+0000 7ff06959d640 1 -- 172.21.15.89:0/3204091541 wait complete. 2024-09-13T03:05:32.737 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:32.733+0000 7ff06959d640 1 Processor -- start 2024-09-13T03:05:32.738 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:32.733+0000 7ff06959d640 1 -- start start 2024-09-13T03:05:32.738 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:32.733+0000 7ff06959d640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff064102550 0x7ff06406fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:32.738 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:32.733+0000 7ff06959d640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff064102ef0 0x7ff06406ff50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:32.738 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:32.733+0000 7ff06959d640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff064070490 con 0x7ff064102550 2024-09-13T03:05:32.738 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:32.733+0000 7ff06959d640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff064070600 con 0x7ff064102ef0 2024-09-13T03:05:32.738 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:32.733+0000 7ff062ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff064102550 0x7ff06406fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:32.738 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:32.733+0000 7ff062ffd640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff064102550 0x7ff06406fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:45318/0 (socket says 172.21.15.89:45318) 2024-09-13T03:05:32.738 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:32.733+0000 7ff062ffd640 1 -- 172.21.15.89:0/1912223084 learned_addr learned my addr 172.21.15.89:0/1912223084 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T03:05:32.738 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:32.733+0000 7ff05bfff640 1 --2- 172.21.15.89:0/1912223084 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff064102ef0 0x7ff06406ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:32.738 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:32.733+0000 7ff062ffd640 1 -- 172.21.15.89:0/1912223084 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff064102ef0 msgr2=0x7ff06406ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:32.738 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:32.733+0000 7ff062ffd640 1 --2- 172.21.15.89:0/1912223084 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff064102ef0 0x7ff06406ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:32.738 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:32.733+0000 7ff062ffd640 1 -- 172.21.15.89:0/1912223084 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff04c005040 con 0x7ff064102550 2024-09-13T03:05:32.739 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:32.733+0000 7ff05bfff640 1 --2- 172.21.15.89:0/1912223084 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff064102ef0 0x7ff06406ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T03:05:32.739 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:32.734+0000 7ff062ffd640 1 --2- 172.21.15.89:0/1912223084 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff064102550 0x7ff06406fa10 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ff054002a50 tx=0x7ff054004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:05:32.739 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:32.734+0000 7ff05b7fe640 1 -- 172.21.15.89:0/1912223084 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff054007c30 con 0x7ff064102550 2024-09-13T03:05:32.739 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:32.734+0000 7ff05b7fe640 1 -- 172.21.15.89:0/1912223084 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7ff05400f040 con 0x7ff064102550 2024-09-13T03:05:32.739 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:32.734+0000 7ff05b7fe640 1 -- 172.21.15.89:0/1912223084 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff05400da90 con 0x7ff064102550 2024-09-13T03:05:32.739 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:32.734+0000 7ff06959d640 1 -- 172.21.15.89:0/1912223084 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff064070890 con 0x7ff064102550 2024-09-13T03:05:32.739 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:32.734+0000 7ff06959d640 1 -- 172.21.15.89:0/1912223084 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff064119c20 con 0x7ff064102550 2024-09-13T03:05:32.740 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:32.735+0000 7ff06959d640 1 -- 172.21.15.89:0/1912223084 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0640fdcd0 con 0x7ff064102550 2024-09-13T03:05:32.740 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:32.735+0000 7ff05b7fe640 1 -- 172.21.15.89:0/1912223084 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7ff05400dd00 con 0x7ff064102550 2024-09-13T03:05:32.740 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:32.736+0000 7ff05b7fe640 1 --2- 172.21.15.89:0/1912223084 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7ff05006e530 0x7ff0500709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:32.740 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:32.736+0000 7ff05b7fe640 1 -- 172.21.15.89:0/1912223084 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6582+0+0 (secure 0 0 0) 0x7ff05408dad0 con 0x7ff064102550 2024-09-13T03:05:32.740 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:32.736+0000 7ff05bfff640 1 --2- 172.21.15.89:0/1912223084 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7ff05006e530 0x7ff0500709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:32.740 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:32.737+0000 7ff05bfff640 1 --2- 172.21.15.89:0/1912223084 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7ff05006e530 0x7ff0500709e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff04c000c00 tx=0x7ff04c035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:05:32.742 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:32.740+0000 7ff05b7fe640 1 -- 172.21.15.89:0/1912223084 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7ff054056b60 con 0x7ff064102550 2024-09-13T03:05:32.952 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:32.949+0000 7ff06959d640 1 -- 172.21.15.89:0/1912223084 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 33, "format": "json"} v 0) v1 -- 0x7ff0640fbd50 con 0x7ff064102550 2024-09-13T03:05:32.952 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:32.950+0000 7ff05b7fe640 1 -- 172.21.15.89:0/1912223084 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 33, "format": "json"}]=0 dumped fsmap epoch 33 v43) v1 ==== 107+0+4265 (secure 0 0 0) 0x7ff05405a220 con 0x7ff064102550 2024-09-13T03:05:32.953 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T03:05:32.953 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":33,"btime":"2024-09-13T03:01:44:679687+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44293,"name":"cephfs.smithi131.rbovzc","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6827/1074022424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":1074022424},{"type":"v1","addr":"172.21.15.131:6827","nonce":1074022424}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":44301,"name":"cephfs.smithi131.uasrkg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6825/833117870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":833117870},{"type":"v1","addr":"172.21.15.131:6825","nonce":833117870}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T02:51:40.657817+0000","modified":"2024-09-13T03:01:43.962927+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34416},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34416":{"gid":34416,"name":"cephfs.smithi089.qjoitb","rank":0,"incarnation":32,"state":"up:reconnect","state_seq":6,"addr":"172.21.15.89:6827/2439422546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2439422546},{"type":"v1","addr":"172.21.15.89:6827","nonce":2439422546}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-13T03:05:32.953 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 33 2024-09-13T03:05:32.955 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:32.952+0000 7ff06959d640 1 -- 172.21.15.89:0/1912223084 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7ff05006e530 msgr2=0x7ff0500709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:32.955 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:32.952+0000 7ff06959d640 1 --2- 172.21.15.89:0/1912223084 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7ff05006e530 0x7ff0500709e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7ff04c000c00 tx=0x7ff04c035040 comp rx=0 tx=0).stop 2024-09-13T03:05:32.955 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:32.952+0000 7ff06959d640 1 -- 172.21.15.89:0/1912223084 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff064102550 msgr2=0x7ff06406fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:32.955 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:32.952+0000 7ff06959d640 1 --2- 172.21.15.89:0/1912223084 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff064102550 0x7ff06406fa10 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ff054002a50 tx=0x7ff054004600 comp rx=0 tx=0).stop 2024-09-13T03:05:32.955 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:32.952+0000 7ff06959d640 1 -- 172.21.15.89:0/1912223084 shutdown_connections 2024-09-13T03:05:32.955 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:32.952+0000 7ff06959d640 1 --2- 172.21.15.89:0/1912223084 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7ff05006e530 0x7ff0500709e0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:32.955 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:32.952+0000 7ff06959d640 1 --2- 172.21.15.89:0/1912223084 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7ff064102ef0 0x7ff06406ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:32.955 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:32.952+0000 7ff06959d640 1 --2- 172.21.15.89:0/1912223084 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7ff064102550 0x7ff06406fa10 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:32.955 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:32.952+0000 7ff06959d640 1 -- 172.21.15.89:0/1912223084 >> 172.21.15.89:0/1912223084 conn(0x7ff0640f80f0 msgr2=0x7ff0640f9150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:05:32.956 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:32.953+0000 7ff06959d640 1 -- 172.21.15.89:0/1912223084 shutdown_connections 2024-09-13T03:05:32.956 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:32.953+0000 7ff06959d640 1 -- 172.21.15.89:0/1912223084 wait complete. 2024-09-13T03:05:33.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:05:32 smithi089 ceph-mon[91553]: pgmap v306: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:05:33.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:05:32 smithi131 ceph-mon[78839]: pgmap v306: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:05:33.648 DEBUG:tasks.fs:max_mds reduced in epoch 33 2024-09-13T03:05:33.649 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 33 2024-09-13T03:05:33.649 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 34 2024-09-13T03:05:33.898 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T03:05:34.019 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:05:33 smithi089 ceph-mon[91553]: from='client.? 172.21.15.89:0/1912223084' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2024-09-13T03:05:34.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:05:33 smithi131 ceph-mon[78839]: from='client.? 172.21.15.89:0/1912223084' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 33, "format": "json"}]: dispatch 2024-09-13T03:05:35.014 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:05:34 smithi089 ceph-mon[91553]: pgmap v307: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T03:05:35.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:05:34 smithi131 ceph-mon[78839]: pgmap v307: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T03:05:35.569 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:35.567+0000 7fa4cd9be640 1 -- 172.21.15.89:0/4259072872 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4c8064fe0 msgr2=0x7fa4c8065430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:35.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:35.567+0000 7fa4cd9be640 1 --2- 172.21.15.89:0/4259072872 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4c8064fe0 0x7fa4c8065430 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc0048d0 tx=0x7fa4bc009da0 comp rx=0 tx=0).stop 2024-09-13T03:05:35.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:35.567+0000 7fa4cd9be640 1 -- 172.21.15.89:0/4259072872 shutdown_connections 2024-09-13T03:05:35.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:35.567+0000 7fa4cd9be640 1 --2- 172.21.15.89:0/4259072872 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4c8064fe0 0x7fa4c8065430 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:35.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:35.567+0000 7fa4cd9be640 1 --2- 172.21.15.89:0/4259072872 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa4c80fe450 0x7fa4c80fe820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:35.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:35.567+0000 7fa4cd9be640 1 -- 172.21.15.89:0/4259072872 >> 172.21.15.89:0/4259072872 conn(0x7fa4c80723b0 msgr2=0x7fa4c80727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:05:35.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:35.567+0000 7fa4cd9be640 1 -- 172.21.15.89:0/4259072872 shutdown_connections 2024-09-13T03:05:35.570 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:35.567+0000 7fa4cd9be640 1 -- 172.21.15.89:0/4259072872 wait complete. 2024-09-13T03:05:35.572 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:35.568+0000 7fa4cd9be640 1 Processor -- start 2024-09-13T03:05:35.572 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:35.568+0000 7fa4cd9be640 1 -- start start 2024-09-13T03:05:35.572 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:35.568+0000 7fa4cd9be640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa4c8064fe0 0x7fa4c8115490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:35.573 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:35.568+0000 7fa4cd9be640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4c80fe450 0x7fa4c81159d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:35.573 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:35.568+0000 7fa4cd9be640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c8115fd0 con 0x7fa4c80fe450 2024-09-13T03:05:35.573 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:35.568+0000 7fa4cd9be640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4c810f3e0 con 0x7fa4c8064fe0 2024-09-13T03:05:35.573 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:35.568+0000 7fa4c67fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4c80fe450 0x7fa4c81159d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:35.573 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:35.568+0000 7fa4c67fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4c80fe450 0x7fa4c81159d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:45332/0 (socket says 172.21.15.89:45332) 2024-09-13T03:05:35.573 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:35.568+0000 7fa4c67fc640 1 -- 172.21.15.89:0/1358115143 learned_addr learned my addr 172.21.15.89:0/1358115143 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T03:05:35.573 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:35.568+0000 7fa4c6ffd640 1 --2- 172.21.15.89:0/1358115143 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa4c8064fe0 0x7fa4c8115490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:35.573 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:35.568+0000 7fa4c67fc640 1 -- 172.21.15.89:0/1358115143 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa4c8064fe0 msgr2=0x7fa4c8115490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:35.573 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:35.568+0000 7fa4c67fc640 1 --2- 172.21.15.89:0/1358115143 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa4c8064fe0 0x7fa4c8115490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:35.573 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:35.568+0000 7fa4c67fc640 1 -- 172.21.15.89:0/1358115143 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4bc005040 con 0x7fa4c80fe450 2024-09-13T03:05:35.573 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:35.569+0000 7fa4c67fc640 1 --2- 172.21.15.89:0/1358115143 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4c80fe450 0x7fa4c81159d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc000c00 tx=0x7fa4bc009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:05:35.574 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:35.569+0000 7fa4af7fe640 1 -- 172.21.15.89:0/1358115143 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa4bc038070 con 0x7fa4c80fe450 2024-09-13T03:05:35.574 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:35.569+0000 7fa4af7fe640 1 -- 172.21.15.89:0/1358115143 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa4bc02ade0 con 0x7fa4c80fe450 2024-09-13T03:05:35.574 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:35.569+0000 7fa4cd9be640 1 -- 172.21.15.89:0/1358115143 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4c810f660 con 0x7fa4c80fe450 2024-09-13T03:05:35.574 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:35.569+0000 7fa4af7fe640 1 -- 172.21.15.89:0/1358115143 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa4bc02c7e0 con 0x7fa4c80fe450 2024-09-13T03:05:35.574 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:35.569+0000 7fa4cd9be640 1 -- 172.21.15.89:0/1358115143 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4c810fb20 con 0x7fa4c80fe450 2024-09-13T03:05:35.574 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:35.570+0000 7fa4cd9be640 1 -- 172.21.15.89:0/1358115143 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4c80fdce0 con 0x7fa4c80fe450 2024-09-13T03:05:35.574 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:35.570+0000 7fa4af7fe640 1 -- 172.21.15.89:0/1358115143 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fa4bc030020 con 0x7fa4c80fe450 2024-09-13T03:05:35.575 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:35.571+0000 7fa4af7fe640 1 --2- 172.21.15.89:0/1358115143 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fa4b006e530 0x7fa4b00709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:35.575 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:35.571+0000 7fa4af7fe640 1 -- 172.21.15.89:0/1358115143 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fa4bc0adda0 con 0x7fa4c80fe450 2024-09-13T03:05:35.575 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:35.571+0000 7fa4c6ffd640 1 --2- 172.21.15.89:0/1358115143 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fa4b006e530 0x7fa4b00709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:35.575 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:35.571+0000 7fa4c6ffd640 1 --2- 172.21.15.89:0/1358115143 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fa4b006e530 0x7fa4b00709e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa4b8007e60 tx=0x7fa4b8004bb0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:05:35.577 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:35.575+0000 7fa4af7fe640 1 -- 172.21.15.89:0/1358115143 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fa4bc076f60 con 0x7fa4c80fe450 2024-09-13T03:05:35.795 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:35.792+0000 7fa4cd9be640 1 -- 172.21.15.89:0/1358115143 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 34, "format": "json"} v 0) v1 -- 0x7fa4c8110ad0 con 0x7fa4c80fe450 2024-09-13T03:05:35.796 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:35.794+0000 7fa4af7fe640 1 -- 172.21.15.89:0/1358115143 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 34, "format": "json"}]=0 dumped fsmap epoch 34 v43) v1 ==== 107+0+4262 (secure 0 0 0) 0x7fa4bc07a620 con 0x7fa4c80fe450 2024-09-13T03:05:35.797 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T03:05:35.797 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":34,"btime":"2024-09-13T03:01:45:687620+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44293,"name":"cephfs.smithi131.rbovzc","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6827/1074022424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":1074022424},{"type":"v1","addr":"172.21.15.131:6827","nonce":1074022424}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":44301,"name":"cephfs.smithi131.uasrkg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6825/833117870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":833117870},{"type":"v1","addr":"172.21.15.131:6825","nonce":833117870}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":34,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T02:51:40.657817+0000","modified":"2024-09-13T03:01:44.689390+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34416},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34416":{"gid":34416,"name":"cephfs.smithi089.qjoitb","rank":0,"incarnation":32,"state":"up:rejoin","state_seq":7,"addr":"172.21.15.89:6827/2439422546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2439422546},{"type":"v1","addr":"172.21.15.89:6827","nonce":2439422546}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-09-13T03:05:35.797 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 34 2024-09-13T03:05:35.799 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:35.796+0000 7fa4cd9be640 1 -- 172.21.15.89:0/1358115143 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fa4b006e530 msgr2=0x7fa4b00709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:35.799 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:35.796+0000 7fa4cd9be640 1 --2- 172.21.15.89:0/1358115143 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fa4b006e530 0x7fa4b00709e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fa4b8007e60 tx=0x7fa4b8004bb0 comp rx=0 tx=0).stop 2024-09-13T03:05:35.799 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:35.796+0000 7fa4cd9be640 1 -- 172.21.15.89:0/1358115143 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4c80fe450 msgr2=0x7fa4c81159d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:35.799 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:35.796+0000 7fa4cd9be640 1 --2- 172.21.15.89:0/1358115143 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4c80fe450 0x7fa4c81159d0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa4bc000c00 tx=0x7fa4bc009da0 comp rx=0 tx=0).stop 2024-09-13T03:05:35.799 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:35.796+0000 7fa4cd9be640 1 -- 172.21.15.89:0/1358115143 shutdown_connections 2024-09-13T03:05:35.800 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:35.796+0000 7fa4cd9be640 1 --2- 172.21.15.89:0/1358115143 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fa4b006e530 0x7fa4b00709e0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:35.800 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:35.796+0000 7fa4cd9be640 1 --2- 172.21.15.89:0/1358115143 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa4c80fe450 0x7fa4c81159d0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:35.800 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:35.796+0000 7fa4cd9be640 1 --2- 172.21.15.89:0/1358115143 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa4c8064fe0 0x7fa4c8115490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:35.800 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:35.796+0000 7fa4cd9be640 1 -- 172.21.15.89:0/1358115143 >> 172.21.15.89:0/1358115143 conn(0x7fa4c80723b0 msgr2=0x7fa4c8103380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:05:35.800 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:35.796+0000 7fa4cd9be640 1 -- 172.21.15.89:0/1358115143 shutdown_connections 2024-09-13T03:05:35.800 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:35.797+0000 7fa4cd9be640 1 -- 172.21.15.89:0/1358115143 wait complete. 2024-09-13T03:05:36.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:05:35 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:05:36.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:05:35 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:05:36.422 DEBUG:tasks.fs:max_mds reduced in epoch 34 2024-09-13T03:05:36.422 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 34 2024-09-13T03:05:36.422 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 35 2024-09-13T03:05:36.667 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T03:05:37.065 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:05:36 smithi089 ceph-mon[91553]: pgmap v308: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:05:37.065 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:05:36 smithi089 ceph-mon[91553]: from='client.? 172.21.15.89:0/1358115143' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 34, "format": "json"}]: dispatch 2024-09-13T03:05:37.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:05:36 smithi131 ceph-mon[78839]: pgmap v308: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:05:37.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:05:36 smithi131 ceph-mon[78839]: from='client.? 172.21.15.89:0/1358115143' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 34, "format": "json"}]: dispatch 2024-09-13T03:05:38.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:38.323+0000 7f49ac74c640 1 -- 172.21.15.89:0/125204980 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49a40fb490 msgr2=0x7f49a40fb900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:38.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:38.323+0000 7f49ac74c640 1 --2- 172.21.15.89:0/125204980 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49a40fb490 0x7f49a40fb900 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f49a00048d0 tx=0x7f49a0009da0 comp rx=0 tx=0).stop 2024-09-13T03:05:38.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:38.323+0000 7f49ac74c640 1 -- 172.21.15.89:0/125204980 shutdown_connections 2024-09-13T03:05:38.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:38.323+0000 7f49ac74c640 1 --2- 172.21.15.89:0/125204980 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49a40fb490 0x7f49a40fb900 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:38.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:38.323+0000 7f49ac74c640 1 --2- 172.21.15.89:0/125204980 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f49a41014d0 0x7f49a41018a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:38.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:38.323+0000 7f49ac74c640 1 -- 172.21.15.89:0/125204980 >> 172.21.15.89:0/125204980 conn(0x7f49a40f7050 msgr2=0x7f49a40f9460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:05:38.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:38.323+0000 7f49ac74c640 1 -- 172.21.15.89:0/125204980 shutdown_connections 2024-09-13T03:05:38.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:38.323+0000 7f49ac74c640 1 -- 172.21.15.89:0/125204980 wait complete. 2024-09-13T03:05:38.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:38.324+0000 7f49ac74c640 1 Processor -- start 2024-09-13T03:05:38.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:38.324+0000 7f49ac74c640 1 -- start start 2024-09-13T03:05:38.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:38.324+0000 7f49ac74c640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f49a40fb490 0x7f49a410e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:38.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:38.324+0000 7f49ac74c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49a41014d0 0x7f49a410e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:38.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:38.324+0000 7f49ac74c640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49a410edb0 con 0x7f49a41014d0 2024-09-13T03:05:38.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:38.324+0000 7f49ac74c640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49a410ef20 con 0x7f49a40fb490 2024-09-13T03:05:38.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:38.324+0000 7f49a9ce7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49a41014d0 0x7f49a410e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:38.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:38.324+0000 7f49a9ce7640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49a41014d0 0x7f49a410e870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:45346/0 (socket says 172.21.15.89:45346) 2024-09-13T03:05:38.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:38.324+0000 7f49a9ce7640 1 -- 172.21.15.89:0/3524041536 learned_addr learned my addr 172.21.15.89:0/3524041536 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T03:05:38.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:38.325+0000 7f49aa4e8640 1 --2- 172.21.15.89:0/3524041536 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f49a40fb490 0x7f49a410e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:38.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:38.325+0000 7f49a9ce7640 1 -- 172.21.15.89:0/3524041536 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f49a40fb490 msgr2=0x7f49a410e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:38.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:38.325+0000 7f49a9ce7640 1 --2- 172.21.15.89:0/3524041536 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f49a40fb490 0x7f49a410e330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:38.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:38.325+0000 7f49a9ce7640 1 -- 172.21.15.89:0/3524041536 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49a0005040 con 0x7f49a41014d0 2024-09-13T03:05:38.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:38.325+0000 7f49a9ce7640 1 --2- 172.21.15.89:0/3524041536 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49a41014d0 0x7f49a410e870 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f49a0003080 tx=0x7f49a0009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:05:38.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:38.325+0000 7f499affd640 1 -- 172.21.15.89:0/3524041536 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49a0038070 con 0x7f49a41014d0 2024-09-13T03:05:38.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:38.325+0000 7f499affd640 1 -- 172.21.15.89:0/3524041536 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f49a00097e0 con 0x7f49a41014d0 2024-09-13T03:05:38.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:38.325+0000 7f499affd640 1 -- 172.21.15.89:0/3524041536 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49a003d420 con 0x7f49a41014d0 2024-09-13T03:05:38.329 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:38.325+0000 7f49ac74c640 1 -- 172.21.15.89:0/3524041536 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49a4117200 con 0x7f49a41014d0 2024-09-13T03:05:38.330 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:38.325+0000 7f49ac74c640 1 -- 172.21.15.89:0/3524041536 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49a41176c0 con 0x7f49a41014d0 2024-09-13T03:05:38.330 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:38.326+0000 7f49ac74c640 1 -- 172.21.15.89:0/3524041536 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49a40fcbd0 con 0x7f49a41014d0 2024-09-13T03:05:38.330 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:38.327+0000 7f499affd640 1 -- 172.21.15.89:0/3524041536 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f49a0030020 con 0x7f49a41014d0 2024-09-13T03:05:38.330 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:38.327+0000 7f499affd640 1 --2- 172.21.15.89:0/3524041536 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f499006e530 0x7f49900709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:38.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:38.327+0000 7f499affd640 1 -- 172.21.15.89:0/3524041536 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f49a00ae760 con 0x7f49a41014d0 2024-09-13T03:05:38.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:38.327+0000 7f49aa4e8640 1 --2- 172.21.15.89:0/3524041536 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f499006e530 0x7f49900709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:38.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:38.328+0000 7f49aa4e8640 1 --2- 172.21.15.89:0/3524041536 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f499006e530 0x7f49900709e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4994006fd0 tx=0x7f4994008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:05:38.333 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:38.331+0000 7f499affd640 1 -- 172.21.15.89:0/3524041536 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f49a0077870 con 0x7f49a41014d0 2024-09-13T03:05:38.534 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:38.533+0000 7f49ac74c640 1 -- 172.21.15.89:0/3524041536 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 35, "format": "json"} v 0) v1 -- 0x7f49a40fac50 con 0x7f49a41014d0 2024-09-13T03:05:38.535 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:38.533+0000 7f499affd640 1 -- 172.21.15.89:0/3524041536 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 35, "format": "json"}]=0 dumped fsmap epoch 35 v43) v1 ==== 107+0+4271 (secure 0 0 0) 0x7f49a007af30 con 0x7f49a41014d0 2024-09-13T03:05:38.535 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T03:05:38.535 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":35,"btime":"2024-09-13T03:01:46:692917+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44293,"name":"cephfs.smithi131.rbovzc","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6827/1074022424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":1074022424},{"type":"v1","addr":"172.21.15.131:6827","nonce":1074022424}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":44301,"name":"cephfs.smithi131.uasrkg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6825/833117870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":833117870},{"type":"v1","addr":"172.21.15.131:6825","nonce":833117870}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T02:51:40.657817+0000","modified":"2024-09-13T03:01:46.692911+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34416},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34416":{"gid":34416,"name":"cephfs.smithi089.qjoitb","rank":0,"incarnation":32,"state":"up:active","state_seq":8,"addr":"172.21.15.89:6827/2439422546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2439422546},{"type":"v1","addr":"172.21.15.89:6827","nonce":2439422546}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34416,"qdb_cluster":[34416]},"id":1}]} 2024-09-13T03:05:38.535 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 35 2024-09-13T03:05:38.537 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:38.535+0000 7f49ac74c640 1 -- 172.21.15.89:0/3524041536 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f499006e530 msgr2=0x7f49900709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:38.537 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:38.535+0000 7f49ac74c640 1 --2- 172.21.15.89:0/3524041536 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f499006e530 0x7f49900709e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f4994006fd0 tx=0x7f4994008040 comp rx=0 tx=0).stop 2024-09-13T03:05:38.537 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:38.535+0000 7f49ac74c640 1 -- 172.21.15.89:0/3524041536 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49a41014d0 msgr2=0x7f49a410e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:38.537 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:38.535+0000 7f49ac74c640 1 --2- 172.21.15.89:0/3524041536 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49a41014d0 0x7f49a410e870 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f49a0003080 tx=0x7f49a0009da0 comp rx=0 tx=0).stop 2024-09-13T03:05:38.537 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:38.535+0000 7f49ac74c640 1 -- 172.21.15.89:0/3524041536 shutdown_connections 2024-09-13T03:05:38.537 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:38.535+0000 7f49ac74c640 1 --2- 172.21.15.89:0/3524041536 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f499006e530 0x7f49900709e0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:38.537 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:38.535+0000 7f49ac74c640 1 --2- 172.21.15.89:0/3524041536 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f49a41014d0 0x7f49a410e870 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:38.538 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:38.536+0000 7f49ac74c640 1 --2- 172.21.15.89:0/3524041536 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f49a40fb490 0x7f49a410e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:38.538 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:38.536+0000 7f49ac74c640 1 -- 172.21.15.89:0/3524041536 >> 172.21.15.89:0/3524041536 conn(0x7f49a40f7050 msgr2=0x7f49a40f88d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:05:38.538 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:38.536+0000 7f49ac74c640 1 -- 172.21.15.89:0/3524041536 shutdown_connections 2024-09-13T03:05:38.538 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:38.536+0000 7f49ac74c640 1 -- 172.21.15.89:0/3524041536 wait complete. 2024-09-13T03:05:39.168 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:05:38 smithi089 ceph-mon[91553]: pgmap v309: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:05:39.169 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:05:38 smithi089 ceph-mon[91553]: from='client.? 172.21.15.89:0/3524041536' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 35, "format": "json"}]: dispatch 2024-09-13T03:05:39.183 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:05:38 smithi131 ceph-mon[78839]: pgmap v309: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:05:39.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:05:38 smithi131 ceph-mon[78839]: from='client.? 172.21.15.89:0/3524041536' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 35, "format": "json"}]: dispatch 2024-09-13T03:05:39.193 DEBUG:tasks.fs:max_mds reduced in epoch 35 2024-09-13T03:05:39.193 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 35 2024-09-13T03:05:39.193 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 36 2024-09-13T03:05:39.441 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T03:05:40.871 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:05:40 smithi089 ceph-mon[91553]: pgmap v310: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T03:05:41.084 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:41.081+0000 7f85c2c08640 1 -- 172.21.15.89:0/2104076543 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f85bc0fb810 msgr2=0x7f85bc0fbbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:41.084 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:41.081+0000 7f85c2c08640 1 --2- 172.21.15.89:0/2104076543 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f85bc0fb810 0x7f85bc0fbbe0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f85b00048d0 tx=0x7f85b0009da0 comp rx=0 tx=0).stop 2024-09-13T03:05:41.084 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:41.081+0000 7f85c2c08640 1 -- 172.21.15.89:0/2104076543 shutdown_connections 2024-09-13T03:05:41.084 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:41.081+0000 7f85c2c08640 1 --2- 172.21.15.89:0/2104076543 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f85bc0fcf80 0x7f85bc0fd3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:41.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:41.081+0000 7f85c2c08640 1 --2- 172.21.15.89:0/2104076543 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f85bc0fb810 0x7f85bc0fbbe0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:41.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:41.081+0000 7f85c2c08640 1 -- 172.21.15.89:0/2104076543 >> 172.21.15.89:0/2104076543 conn(0x7f85bc0723b0 msgr2=0x7f85bc0727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:05:41.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:41.081+0000 7f85c2c08640 1 -- 172.21.15.89:0/2104076543 shutdown_connections 2024-09-13T03:05:41.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:41.081+0000 7f85c2c08640 1 -- 172.21.15.89:0/2104076543 wait complete. 2024-09-13T03:05:41.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:41.081+0000 7f85c2c08640 1 Processor -- start 2024-09-13T03:05:41.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:41.081+0000 7f85c2c08640 1 -- start start 2024-09-13T03:05:41.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:41.082+0000 7f85c2c08640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f85bc0fb810 0x7f85bc10e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:41.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:41.082+0000 7f85c2c08640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f85bc0fcf80 0x7f85bc10e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:41.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:41.082+0000 7f85c2c08640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85bc10ede0 con 0x7f85bc0fcf80 2024-09-13T03:05:41.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:41.082+0000 7f85c2c08640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85bc10ef50 con 0x7f85bc0fb810 2024-09-13T03:05:41.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:41.082+0000 7f85bbfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f85bc0fcf80 0x7f85bc10e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:41.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:41.082+0000 7f85bbfff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f85bc0fcf80 0x7f85bc10e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:45376/0 (socket says 172.21.15.89:45376) 2024-09-13T03:05:41.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:41.082+0000 7f85bbfff640 1 -- 172.21.15.89:0/3263220736 learned_addr learned my addr 172.21.15.89:0/3263220736 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T03:05:41.085 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:41.082+0000 7f85c09a4640 1 --2- 172.21.15.89:0/3263220736 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f85bc0fb810 0x7f85bc10e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:41.086 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:41.082+0000 7f85bbfff640 1 -- 172.21.15.89:0/3263220736 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f85bc0fb810 msgr2=0x7f85bc10e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:41.086 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:41.082+0000 7f85bbfff640 1 --2- 172.21.15.89:0/3263220736 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f85bc0fb810 0x7f85bc10e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:41.086 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:41.082+0000 7f85bbfff640 1 -- 172.21.15.89:0/3263220736 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85b0005040 con 0x7f85bc0fcf80 2024-09-13T03:05:41.086 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:41.083+0000 7f85bbfff640 1 --2- 172.21.15.89:0/3263220736 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f85bc0fcf80 0x7f85bc10e700 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f85a800b790 tx=0x7f85a80091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:05:41.086 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:41.083+0000 7f85b97fa640 1 -- 172.21.15.89:0/3263220736 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f85a800c700 con 0x7f85bc0fcf80 2024-09-13T03:05:41.086 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:41.083+0000 7f85b97fa640 1 -- 172.21.15.89:0/3263220736 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f85a800cd00 con 0x7f85bc0fcf80 2024-09-13T03:05:41.086 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:41.083+0000 7f85c2c08640 1 -- 172.21.15.89:0/3263220736 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85bc117230 con 0x7f85bc0fcf80 2024-09-13T03:05:41.086 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:41.083+0000 7f85b97fa640 1 -- 172.21.15.89:0/3263220736 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f85a8015e80 con 0x7f85bc0fcf80 2024-09-13T03:05:41.086 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:41.083+0000 7f85c2c08640 1 -- 172.21.15.89:0/3263220736 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85bc117750 con 0x7f85bc0fcf80 2024-09-13T03:05:41.087 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:41.084+0000 7f85c2c08640 1 -- 172.21.15.89:0/3263220736 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85bc0fcbc0 con 0x7f85bc0fcf80 2024-09-13T03:05:41.087 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:41.084+0000 7f85b97fa640 1 -- 172.21.15.89:0/3263220736 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f85a8012070 con 0x7f85bc0fcf80 2024-09-13T03:05:41.087 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:41.085+0000 7f85b97fa640 1 --2- 172.21.15.89:0/3263220736 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f85ac06e530 0x7f85ac0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:41.087 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:41.085+0000 7f85b97fa640 1 -- 172.21.15.89:0/3263220736 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f85a808da40 con 0x7f85bc0fcf80 2024-09-13T03:05:41.087 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:41.085+0000 7f85c09a4640 1 --2- 172.21.15.89:0/3263220736 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f85ac06e530 0x7f85ac0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:41.087 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:41.085+0000 7f85c09a4640 1 --2- 172.21.15.89:0/3263220736 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f85ac06e530 0x7f85ac0709e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f85b0009ac0 tx=0x7f85b0035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:05:41.090 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:41.089+0000 7f85b97fa640 1 -- 172.21.15.89:0/3263220736 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f85a8056b50 con 0x7f85bc0fcf80 2024-09-13T03:05:41.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:05:40 smithi131 ceph-mon[78839]: pgmap v310: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T03:05:41.290 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:41.289+0000 7f85c2c08640 1 -- 172.21.15.89:0/3263220736 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 36, "format": "json"} v 0) v1 -- 0x7f85bc065730 con 0x7f85bc0fcf80 2024-09-13T03:05:41.290 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:41.289+0000 7f85b97fa640 1 -- 172.21.15.89:0/3263220736 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 36, "format": "json"}]=0 dumped fsmap epoch 36 v43) v1 ==== 107+0+5115 (secure 0 0 0) 0x7f85a805a210 con 0x7f85bc0fcf80 2024-09-13T03:05:41.291 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T03:05:41.291 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":36,"btime":"2024-09-13T03:01:49:705403+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34448,"name":"cephfs.smithi089.rarddb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6829/177758677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":177758677},{"type":"v1","addr":"172.21.15.89:6829","nonce":177758677}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":44293,"name":"cephfs.smithi131.rbovzc","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6827/1074022424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":1074022424},{"type":"v1","addr":"172.21.15.131:6827","nonce":1074022424}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":44301,"name":"cephfs.smithi131.uasrkg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6825/833117870","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":833117870},{"type":"v1","addr":"172.21.15.131:6825","nonce":833117870}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T02:51:40.657817+0000","modified":"2024-09-13T03:01:46.692911+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34416},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34416":{"gid":34416,"name":"cephfs.smithi089.qjoitb","rank":0,"incarnation":32,"state":"up:active","state_seq":8,"addr":"172.21.15.89:6827/2439422546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2439422546},{"type":"v1","addr":"172.21.15.89:6827","nonce":2439422546}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34416,"qdb_cluster":[34416]},"id":1}]} 2024-09-13T03:05:41.291 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 36 2024-09-13T03:05:41.292 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:41.291+0000 7f85c2c08640 1 -- 172.21.15.89:0/3263220736 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f85ac06e530 msgr2=0x7f85ac0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:41.293 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:41.291+0000 7f85c2c08640 1 --2- 172.21.15.89:0/3263220736 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f85ac06e530 0x7f85ac0709e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f85b0009ac0 tx=0x7f85b0035040 comp rx=0 tx=0).stop 2024-09-13T03:05:41.293 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:41.291+0000 7f85c2c08640 1 -- 172.21.15.89:0/3263220736 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f85bc0fcf80 msgr2=0x7f85bc10e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:41.293 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:41.291+0000 7f85c2c08640 1 --2- 172.21.15.89:0/3263220736 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f85bc0fcf80 0x7f85bc10e700 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f85a800b790 tx=0x7f85a80091d0 comp rx=0 tx=0).stop 2024-09-13T03:05:41.293 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:41.291+0000 7f85c2c08640 1 -- 172.21.15.89:0/3263220736 shutdown_connections 2024-09-13T03:05:41.293 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:41.291+0000 7f85c2c08640 1 --2- 172.21.15.89:0/3263220736 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f85ac06e530 0x7f85ac0709e0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:41.293 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:41.291+0000 7f85c2c08640 1 --2- 172.21.15.89:0/3263220736 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f85bc0fcf80 0x7f85bc10e700 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:41.293 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:41.291+0000 7f85c2c08640 1 --2- 172.21.15.89:0/3263220736 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f85bc0fb810 0x7f85bc10e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:41.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:41.291+0000 7f85c2c08640 1 -- 172.21.15.89:0/3263220736 >> 172.21.15.89:0/3263220736 conn(0x7f85bc0723b0 msgr2=0x7f85bc0fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:05:41.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:41.292+0000 7f85c2c08640 1 -- 172.21.15.89:0/3263220736 shutdown_connections 2024-09-13T03:05:41.294 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:41.292+0000 7f85c2c08640 1 -- 172.21.15.89:0/3263220736 wait complete. 2024-09-13T03:05:41.917 DEBUG:tasks.fs:max_mds reduced in epoch 36 2024-09-13T03:05:41.917 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 36 2024-09-13T03:05:41.918 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 37 2024-09-13T03:05:42.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:05:41 smithi089 ceph-mon[91553]: from='client.? 172.21.15.89:0/3263220736' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 36, "format": "json"}]: dispatch 2024-09-13T03:05:42.166 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T03:05:42.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:05:41 smithi131 ceph-mon[78839]: from='client.? 172.21.15.89:0/3263220736' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 36, "format": "json"}]: dispatch 2024-09-13T03:05:43.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:05:42 smithi131 ceph-mon[78839]: pgmap v311: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:05:43.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:05:42 smithi089 ceph-mon[91553]: pgmap v311: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:05:43.852 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:43.845+0000 7f55f8c94640 1 -- 172.21.15.89:0/841426960 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55f40fcf80 msgr2=0x7f55f40fd3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:43.852 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:43.845+0000 7f55f8c94640 1 --2- 172.21.15.89:0/841426960 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55f40fcf80 0x7f55f40fd3d0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f55e80048d0 tx=0x7f55e8009da0 comp rx=0 tx=0).stop 2024-09-13T03:05:43.852 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:43.845+0000 7f55f8c94640 1 -- 172.21.15.89:0/841426960 shutdown_connections 2024-09-13T03:05:43.852 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:43.845+0000 7f55f8c94640 1 --2- 172.21.15.89:0/841426960 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55f40fcf80 0x7f55f40fd3d0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:43.853 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:43.845+0000 7f55f8c94640 1 --2- 172.21.15.89:0/841426960 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f55f40fb810 0x7f55f40fbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:43.853 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:43.845+0000 7f55f8c94640 1 -- 172.21.15.89:0/841426960 >> 172.21.15.89:0/841426960 conn(0x7f55f40723b0 msgr2=0x7f55f40727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:05:43.853 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:43.845+0000 7f55f8c94640 1 -- 172.21.15.89:0/841426960 shutdown_connections 2024-09-13T03:05:43.853 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:43.845+0000 7f55f8c94640 1 -- 172.21.15.89:0/841426960 wait complete. 2024-09-13T03:05:43.853 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:43.846+0000 7f55f8c94640 1 Processor -- start 2024-09-13T03:05:43.853 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:43.846+0000 7f55f8c94640 1 -- start start 2024-09-13T03:05:43.853 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:43.846+0000 7f55f8c94640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f55f40fb810 0x7f55f41120d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:43.853 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:43.846+0000 7f55f8c94640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55f40fcf80 0x7f55f4112610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:43.853 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:43.846+0000 7f55f8c94640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55f4112c10 con 0x7f55f40fcf80 2024-09-13T03:05:43.853 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:43.846+0000 7f55f8c94640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55f410c050 con 0x7f55f40fb810 2024-09-13T03:05:43.853 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:43.846+0000 7f55f1d9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55f40fcf80 0x7f55f4112610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:43.853 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:43.846+0000 7f55f1d9b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55f40fcf80 0x7f55f4112610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:32770/0 (socket says 172.21.15.89:32770) 2024-09-13T03:05:43.854 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:43.846+0000 7f55f1d9b640 1 -- 172.21.15.89:0/3561245402 learned_addr learned my addr 172.21.15.89:0/3561245402 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T03:05:43.854 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:43.846+0000 7f55f259c640 1 --2- 172.21.15.89:0/3561245402 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f55f40fb810 0x7f55f41120d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:43.854 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:43.846+0000 7f55f1d9b640 1 -- 172.21.15.89:0/3561245402 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f55f40fb810 msgr2=0x7f55f41120d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:43.854 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:43.846+0000 7f55f1d9b640 1 --2- 172.21.15.89:0/3561245402 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f55f40fb810 0x7f55f41120d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:43.854 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:43.846+0000 7f55f1d9b640 1 -- 172.21.15.89:0/3561245402 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55e8005040 con 0x7f55f40fcf80 2024-09-13T03:05:43.854 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:43.847+0000 7f55f1d9b640 1 --2- 172.21.15.89:0/3561245402 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55f40fcf80 0x7f55f4112610 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f55e8000c00 tx=0x7f55e8009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:05:43.854 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:43.847+0000 7f55e2ffd640 1 -- 172.21.15.89:0/3561245402 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f55e8038070 con 0x7f55f40fcf80 2024-09-13T03:05:43.854 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:43.847+0000 7f55e2ffd640 1 -- 172.21.15.89:0/3561245402 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f55e802ade0 con 0x7f55f40fcf80 2024-09-13T03:05:43.854 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:43.847+0000 7f55e2ffd640 1 -- 172.21.15.89:0/3561245402 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f55e802c7e0 con 0x7f55f40fcf80 2024-09-13T03:05:43.854 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:43.847+0000 7f55f8c94640 1 -- 172.21.15.89:0/3561245402 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55f410c2d0 con 0x7f55f40fcf80 2024-09-13T03:05:43.854 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:43.847+0000 7f55f8c94640 1 -- 172.21.15.89:0/3561245402 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55f410c810 con 0x7f55f40fcf80 2024-09-13T03:05:43.854 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:43.848+0000 7f55f8c94640 1 -- 172.21.15.89:0/3561245402 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55f40fcbc0 con 0x7f55f40fcf80 2024-09-13T03:05:43.854 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:43.848+0000 7f55e2ffd640 1 -- 172.21.15.89:0/3561245402 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f55e8030020 con 0x7f55f40fcf80 2024-09-13T03:05:43.855 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:43.849+0000 7f55e2ffd640 1 --2- 172.21.15.89:0/3561245402 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f55dc06e530 0x7f55dc0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:43.855 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:43.849+0000 7f55e2ffd640 1 -- 172.21.15.89:0/3561245402 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f55e80addb0 con 0x7f55f40fcf80 2024-09-13T03:05:43.855 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:43.849+0000 7f55f259c640 1 --2- 172.21.15.89:0/3561245402 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f55dc06e530 0x7f55dc0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:43.855 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:43.849+0000 7f55f259c640 1 --2- 172.21.15.89:0/3561245402 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f55dc06e530 0x7f55dc0709e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f55e4004ce0 tx=0x7f55e400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:05:43.855 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:43.853+0000 7f55e2ffd640 1 -- 172.21.15.89:0/3561245402 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f55e8076f70 con 0x7f55f40fcf80 2024-09-13T03:05:44.058 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:44.057+0000 7f55f8c94640 1 -- 172.21.15.89:0/3561245402 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 37, "format": "json"} v 0) v1 -- 0x7f55f410d770 con 0x7f55f40fcf80 2024-09-13T03:05:44.059 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:44.057+0000 7f55e2ffd640 1 -- 172.21.15.89:0/3561245402 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 37, "format": "json"}]=0 dumped fsmap epoch 37 v43) v1 ==== 107+0+4336 (secure 0 0 0) 0x7f55e807a630 con 0x7f55f40fcf80 2024-09-13T03:05:44.059 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T03:05:44.059 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":37,"btime":"2024-09-13T03:02:04:494447+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34448,"name":"cephfs.smithi089.rarddb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6829/177758677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":177758677},{"type":"v1","addr":"172.21.15.89:6829","nonce":177758677}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":44293,"name":"cephfs.smithi131.rbovzc","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6827/1074022424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":1074022424},{"type":"v1","addr":"172.21.15.131:6827","nonce":1074022424}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T02:51:40.657817+0000","modified":"2024-09-13T03:01:46.692911+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34416},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34416":{"gid":34416,"name":"cephfs.smithi089.qjoitb","rank":0,"incarnation":32,"state":"up:active","state_seq":8,"addr":"172.21.15.89:6827/2439422546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2439422546},{"type":"v1","addr":"172.21.15.89:6827","nonce":2439422546}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34416,"qdb_cluster":[34416]},"id":1}]} 2024-09-13T03:05:44.059 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 37 2024-09-13T03:05:44.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:44.059+0000 7f55f8c94640 1 -- 172.21.15.89:0/3561245402 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f55dc06e530 msgr2=0x7f55dc0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:44.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:44.059+0000 7f55f8c94640 1 --2- 172.21.15.89:0/3561245402 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f55dc06e530 0x7f55dc0709e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f55e4004ce0 tx=0x7f55e400b040 comp rx=0 tx=0).stop 2024-09-13T03:05:44.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:44.059+0000 7f55f8c94640 1 -- 172.21.15.89:0/3561245402 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55f40fcf80 msgr2=0x7f55f4112610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:44.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:44.059+0000 7f55f8c94640 1 --2- 172.21.15.89:0/3561245402 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55f40fcf80 0x7f55f4112610 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f55e8000c00 tx=0x7f55e8009da0 comp rx=0 tx=0).stop 2024-09-13T03:05:44.061 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:44.059+0000 7f55f8c94640 1 -- 172.21.15.89:0/3561245402 shutdown_connections 2024-09-13T03:05:44.062 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:44.059+0000 7f55f8c94640 1 --2- 172.21.15.89:0/3561245402 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f55dc06e530 0x7f55dc0709e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:44.062 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:44.059+0000 7f55f8c94640 1 --2- 172.21.15.89:0/3561245402 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f55f40fcf80 0x7f55f4112610 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:44.062 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:44.059+0000 7f55f8c94640 1 --2- 172.21.15.89:0/3561245402 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f55f40fb810 0x7f55f41120d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:44.062 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:44.059+0000 7f55f8c94640 1 -- 172.21.15.89:0/3561245402 >> 172.21.15.89:0/3561245402 conn(0x7f55f40723b0 msgr2=0x7f55f40fa480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:05:44.062 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:44.060+0000 7f55f8c94640 1 -- 172.21.15.89:0/3561245402 shutdown_connections 2024-09-13T03:05:44.062 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:44.060+0000 7f55f8c94640 1 -- 172.21.15.89:0/3561245402 wait complete. 2024-09-13T03:05:44.773 DEBUG:tasks.fs:max_mds reduced in epoch 37 2024-09-13T03:05:44.773 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 37 2024-09-13T03:05:44.774 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 38 2024-09-13T03:05:45.020 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T03:05:45.034 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:05:44 smithi089 ceph-mon[91553]: pgmap v312: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T03:05:45.034 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:05:44 smithi089 ceph-mon[91553]: from='client.? 172.21.15.89:0/3561245402' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 37, "format": "json"}]: dispatch 2024-09-13T03:05:45.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:05:44 smithi131 ceph-mon[78839]: pgmap v312: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T03:05:45.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:05:44 smithi131 ceph-mon[78839]: from='client.? 172.21.15.89:0/3561245402' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 37, "format": "json"}]: dispatch 2024-09-13T03:05:46.793 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:46.772+0000 7fa6b6aa8640 1 -- 172.21.15.89:0/829838676 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6b00fdf00 msgr2=0x7fa6b01065d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:46.793 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:46.772+0000 7fa6b6aa8640 1 --2- 172.21.15.89:0/829838676 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6b00fdf00 0x7fa6b01065d0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fa6a0009c80 tx=0x7fa6a0004d10 comp rx=0 tx=0).stop 2024-09-13T03:05:46.793 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:46.772+0000 7fa6b6aa8640 1 -- 172.21.15.89:0/829838676 shutdown_connections 2024-09-13T03:05:46.793 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:46.772+0000 7fa6b6aa8640 1 --2- 172.21.15.89:0/829838676 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6b00fdf00 0x7fa6b01065d0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:46.793 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:46.772+0000 7fa6b6aa8640 1 --2- 172.21.15.89:0/829838676 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6b00fd560 0x7fa6b00fd930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:46.793 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:46.772+0000 7fa6b6aa8640 1 -- 172.21.15.89:0/829838676 >> 172.21.15.89:0/829838676 conn(0x7fa6b00f7000 msgr2=0x7fa6b00f9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:05:46.793 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:46.772+0000 7fa6b6aa8640 1 -- 172.21.15.89:0/829838676 shutdown_connections 2024-09-13T03:05:46.793 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:46.772+0000 7fa6b6aa8640 1 -- 172.21.15.89:0/829838676 wait complete. 2024-09-13T03:05:46.793 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:46.773+0000 7fa6b6aa8640 1 Processor -- start 2024-09-13T03:05:46.793 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:46.773+0000 7fa6b6aa8640 1 -- start start 2024-09-13T03:05:46.793 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:46.773+0000 7fa6b6aa8640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6b00fd560 0x7fa6b01132d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:46.794 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:46.773+0000 7fa6b6aa8640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6b00fdf00 0x7fa6b0113810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:46.794 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:46.773+0000 7fa6b6aa8640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b0113e10 con 0x7fa6b00fd560 2024-09-13T03:05:46.794 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:46.773+0000 7fa6b6aa8640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6b0113f80 con 0x7fa6b00fdf00 2024-09-13T03:05:46.794 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:46.773+0000 7fa6b4844640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6b00fd560 0x7fa6b01132d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:46.794 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:46.773+0000 7fa6b4844640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6b00fd560 0x7fa6b01132d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:32790/0 (socket says 172.21.15.89:32790) 2024-09-13T03:05:46.794 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:46.773+0000 7fa6b4844640 1 -- 172.21.15.89:0/2254541220 learned_addr learned my addr 172.21.15.89:0/2254541220 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T03:05:46.794 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:46.773+0000 7fa6affff640 1 --2- 172.21.15.89:0/2254541220 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6b00fdf00 0x7fa6b0113810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:46.794 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:46.774+0000 7fa6b4844640 1 -- 172.21.15.89:0/2254541220 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6b00fdf00 msgr2=0x7fa6b0113810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:46.794 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:46.774+0000 7fa6b4844640 1 --2- 172.21.15.89:0/2254541220 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6b00fdf00 0x7fa6b0113810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:46.794 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:46.774+0000 7fa6b4844640 1 -- 172.21.15.89:0/2254541220 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6a00098b0 con 0x7fa6b00fd560 2024-09-13T03:05:46.794 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:46.774+0000 7fa6b4844640 1 --2- 172.21.15.89:0/2254541220 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6b00fd560 0x7fa6b01132d0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fa6a8002a50 tx=0x7fa6a8004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:05:46.794 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:46.774+0000 7fa6ad7fa640 1 -- 172.21.15.89:0/2254541220 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa6a8007c30 con 0x7fa6b00fd560 2024-09-13T03:05:46.795 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:46.774+0000 7fa6b6aa8640 1 -- 172.21.15.89:0/2254541220 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6b010d400 con 0x7fa6b00fd560 2024-09-13T03:05:46.795 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:46.774+0000 7fa6ad7fa640 1 -- 172.21.15.89:0/2254541220 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa6a800f040 con 0x7fa6b00fd560 2024-09-13T03:05:46.795 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:46.774+0000 7fa6ad7fa640 1 -- 172.21.15.89:0/2254541220 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa6a800da90 con 0x7fa6b00fd560 2024-09-13T03:05:46.795 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:46.774+0000 7fa6b6aa8640 1 -- 172.21.15.89:0/2254541220 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6b010d8f0 con 0x7fa6b00fd560 2024-09-13T03:05:46.795 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:46.775+0000 7fa6b6aa8640 1 -- 172.21.15.89:0/2254541220 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6b00662b0 con 0x7fa6b00fd560 2024-09-13T03:05:46.795 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:46.776+0000 7fa6ad7fa640 1 -- 172.21.15.89:0/2254541220 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fa6a800dc30 con 0x7fa6b00fd560 2024-09-13T03:05:46.795 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:46.776+0000 7fa6ad7fa640 1 --2- 172.21.15.89:0/2254541220 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fa69c06e530 0x7fa69c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:46.795 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:46.776+0000 7fa6affff640 1 --2- 172.21.15.89:0/2254541220 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fa69c06e530 0x7fa69c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:46.795 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:46.776+0000 7fa6ad7fa640 1 -- 172.21.15.89:0/2254541220 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fa6a808d940 con 0x7fa6b00fd560 2024-09-13T03:05:46.795 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:46.777+0000 7fa6affff640 1 --2- 172.21.15.89:0/2254541220 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fa69c06e530 0x7fa69c0709e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa6a0004a30 tx=0x7fa6a0004d10 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:05:46.795 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:46.781+0000 7fa6ad7fa640 1 -- 172.21.15.89:0/2254541220 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fa6a8056b00 con 0x7fa6b00fd560 2024-09-13T03:05:46.985 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:46.983+0000 7fa6b6aa8640 1 -- 172.21.15.89:0/2254541220 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 38, "format": "json"} v 0) v1 -- 0x7fa6b00fac40 con 0x7fa6b00fd560 2024-09-13T03:05:46.985 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:46.984+0000 7fa6ad7fa640 1 -- 172.21.15.89:0/2254541220 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 38, "format": "json"}]=0 dumped fsmap epoch 38 v43) v1 ==== 107+0+5186 (secure 0 0 0) 0x7fa6a805a1c0 con 0x7fa6b00fd560 2024-09-13T03:05:46.986 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T03:05:46.986 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":38,"btime":"2024-09-13T03:02:07:506201+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34448,"name":"cephfs.smithi089.rarddb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6829/177758677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":177758677},{"type":"v1","addr":"172.21.15.89:6829","nonce":177758677}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":44293,"name":"cephfs.smithi131.rbovzc","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6827/1074022424","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":1074022424},{"type":"v1","addr":"172.21.15.131:6827","nonce":1074022424}]},"join_fscid":1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":44355,"name":"cephfs.smithi131.uasrkg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6825/2298563432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":2298563432},{"type":"v1","addr":"172.21.15.131:6825","nonce":2298563432}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T02:51:40.657817+0000","modified":"2024-09-13T03:01:46.692911+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34416},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34416":{"gid":34416,"name":"cephfs.smithi089.qjoitb","rank":0,"incarnation":32,"state":"up:active","state_seq":8,"addr":"172.21.15.89:6827/2439422546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2439422546},{"type":"v1","addr":"172.21.15.89:6827","nonce":2439422546}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34416,"qdb_cluster":[34416]},"id":1}]} 2024-09-13T03:05:46.986 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 38 2024-09-13T03:05:46.987 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:46.986+0000 7fa6b6aa8640 1 -- 172.21.15.89:0/2254541220 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fa69c06e530 msgr2=0x7fa69c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:46.987 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:46.986+0000 7fa6b6aa8640 1 --2- 172.21.15.89:0/2254541220 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fa69c06e530 0x7fa69c0709e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fa6a0004a30 tx=0x7fa6a0004d10 comp rx=0 tx=0).stop 2024-09-13T03:05:46.987 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:46.986+0000 7fa6b6aa8640 1 -- 172.21.15.89:0/2254541220 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6b00fd560 msgr2=0x7fa6b01132d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:46.987 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:46.986+0000 7fa6b6aa8640 1 --2- 172.21.15.89:0/2254541220 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6b00fd560 0x7fa6b01132d0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fa6a8002a50 tx=0x7fa6a8004600 comp rx=0 tx=0).stop 2024-09-13T03:05:46.988 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:46.986+0000 7fa6b6aa8640 1 -- 172.21.15.89:0/2254541220 shutdown_connections 2024-09-13T03:05:46.988 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:46.986+0000 7fa6b6aa8640 1 --2- 172.21.15.89:0/2254541220 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fa69c06e530 0x7fa69c0709e0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:46.988 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:46.986+0000 7fa6b6aa8640 1 --2- 172.21.15.89:0/2254541220 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6b00fdf00 0x7fa6b0113810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:46.988 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:46.986+0000 7fa6b6aa8640 1 --2- 172.21.15.89:0/2254541220 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6b00fd560 0x7fa6b01132d0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:46.988 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:46.986+0000 7fa6b6aa8640 1 -- 172.21.15.89:0/2254541220 >> 172.21.15.89:0/2254541220 conn(0x7fa6b00f7000 msgr2=0x7fa6b00f8510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:05:46.988 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:46.986+0000 7fa6b6aa8640 1 -- 172.21.15.89:0/2254541220 shutdown_connections 2024-09-13T03:05:46.988 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:46.986+0000 7fa6b6aa8640 1 -- 172.21.15.89:0/2254541220 wait complete. 2024-09-13T03:05:47.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:05:46 smithi089 ceph-mon[91553]: pgmap v313: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:05:47.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:05:46 smithi131 ceph-mon[78839]: pgmap v313: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:05:47.612 DEBUG:tasks.fs:max_mds reduced in epoch 38 2024-09-13T03:05:47.612 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 38 2024-09-13T03:05:47.612 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 39 2024-09-13T03:05:47.860 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T03:05:47.981 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:05:47 smithi089 ceph-mon[91553]: from='client.? 172.21.15.89:0/2254541220' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 38, "format": "json"}]: dispatch 2024-09-13T03:05:48.183 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:05:47 smithi131 ceph-mon[78839]: from='client.? 172.21.15.89:0/2254541220' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 38, "format": "json"}]: dispatch 2024-09-13T03:05:49.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:05:48 smithi089 ceph-mon[91553]: pgmap v314: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:05:49.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:05:48 smithi131 ceph-mon[78839]: pgmap v314: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:05:49.594 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:49.590+0000 7fa24eeef640 1 -- 172.21.15.89:0/3722861285 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2481014c0 msgr2=0x7fa248101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:49.594 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:49.590+0000 7fa24eeef640 1 --2- 172.21.15.89:0/3722861285 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2481014c0 0x7fa248101890 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fa23c0048d0 tx=0x7fa23c009da0 comp rx=0 tx=0).stop 2024-09-13T03:05:49.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:49.590+0000 7fa24eeef640 1 -- 172.21.15.89:0/3722861285 shutdown_connections 2024-09-13T03:05:49.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:49.590+0000 7fa24eeef640 1 --2- 172.21.15.89:0/3722861285 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa2480fb480 0x7fa2480fb8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:49.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:49.590+0000 7fa24eeef640 1 --2- 172.21.15.89:0/3722861285 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2481014c0 0x7fa248101890 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:49.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:49.590+0000 7fa24eeef640 1 -- 172.21.15.89:0/3722861285 >> 172.21.15.89:0/3722861285 conn(0x7fa2480f7000 msgr2=0x7fa2480f9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:05:49.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:49.590+0000 7fa24eeef640 1 -- 172.21.15.89:0/3722861285 shutdown_connections 2024-09-13T03:05:49.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:49.590+0000 7fa24eeef640 1 -- 172.21.15.89:0/3722861285 wait complete. 2024-09-13T03:05:49.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:49.591+0000 7fa24eeef640 1 Processor -- start 2024-09-13T03:05:49.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:49.591+0000 7fa24eeef640 1 -- start start 2024-09-13T03:05:49.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:49.591+0000 7fa24eeef640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2480fb480 0x7fa248112120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:49.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:49.591+0000 7fa24eeef640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa2481014c0 0x7fa248112660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:49.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:49.591+0000 7fa24eeef640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa248112cf0 con 0x7fa2480fb480 2024-09-13T03:05:49.595 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:49.591+0000 7fa24eeef640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa24810c0a0 con 0x7fa2481014c0 2024-09-13T03:05:49.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:49.591+0000 7fa24cc8b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2480fb480 0x7fa248112120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:49.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:49.592+0000 7fa24cc8b640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2480fb480 0x7fa248112120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:32798/0 (socket says 172.21.15.89:32798) 2024-09-13T03:05:49.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:49.592+0000 7fa24cc8b640 1 -- 172.21.15.89:0/1492496517 learned_addr learned my addr 172.21.15.89:0/1492496517 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T03:05:49.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:49.592+0000 7fa247fff640 1 --2- 172.21.15.89:0/1492496517 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa2481014c0 0x7fa248112660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:49.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:49.592+0000 7fa24cc8b640 1 -- 172.21.15.89:0/1492496517 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa2481014c0 msgr2=0x7fa248112660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:49.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:49.592+0000 7fa24cc8b640 1 --2- 172.21.15.89:0/1492496517 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa2481014c0 0x7fa248112660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:49.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:49.592+0000 7fa24cc8b640 1 -- 172.21.15.89:0/1492496517 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa23c005040 con 0x7fa2480fb480 2024-09-13T03:05:49.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:49.592+0000 7fa247fff640 1 --2- 172.21.15.89:0/1492496517 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa2481014c0 0x7fa248112660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T03:05:49.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:49.592+0000 7fa24cc8b640 1 --2- 172.21.15.89:0/1492496517 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2480fb480 0x7fa248112120 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fa23c003080 tx=0x7fa23c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:05:49.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:49.592+0000 7fa2457fa640 1 -- 172.21.15.89:0/1492496517 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa23c038070 con 0x7fa2480fb480 2024-09-13T03:05:49.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:49.592+0000 7fa2457fa640 1 -- 172.21.15.89:0/1492496517 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa23c0097e0 con 0x7fa2480fb480 2024-09-13T03:05:49.596 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:49.592+0000 7fa24eeef640 1 -- 172.21.15.89:0/1492496517 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa24810c320 con 0x7fa2480fb480 2024-09-13T03:05:49.597 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:49.592+0000 7fa2457fa640 1 -- 172.21.15.89:0/1492496517 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa23c03d420 con 0x7fa2480fb480 2024-09-13T03:05:49.597 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:49.592+0000 7fa24eeef640 1 -- 172.21.15.89:0/1492496517 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa24810c7e0 con 0x7fa2480fb480 2024-09-13T03:05:49.597 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:49.593+0000 7fa24eeef640 1 -- 172.21.15.89:0/1492496517 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2480fcbc0 con 0x7fa2480fb480 2024-09-13T03:05:49.597 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:49.594+0000 7fa2457fa640 1 -- 172.21.15.89:0/1492496517 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fa23c030020 con 0x7fa2480fb480 2024-09-13T03:05:49.598 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:49.594+0000 7fa2457fa640 1 --2- 172.21.15.89:0/1492496517 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fa23806e530 0x7fa2380709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:49.598 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:49.594+0000 7fa2457fa640 1 -- 172.21.15.89:0/1492496517 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fa23c0ae6a0 con 0x7fa2480fb480 2024-09-13T03:05:49.598 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:49.594+0000 7fa247fff640 1 --2- 172.21.15.89:0/1492496517 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fa23806e530 0x7fa2380709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:49.598 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:49.595+0000 7fa247fff640 1 --2- 172.21.15.89:0/1492496517 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fa23806e530 0x7fa2380709e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa234006fd0 tx=0x7fa234008040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:05:49.600 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:49.599+0000 7fa2457fa640 1 -- 172.21.15.89:0/1492496517 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fa23c0777b0 con 0x7fa2480fb480 2024-09-13T03:05:49.804 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:49.803+0000 7fa24eeef640 1 -- 172.21.15.89:0/1492496517 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 39, "format": "json"} v 0) v1 -- 0x7fa24804b770 con 0x7fa2480fb480 2024-09-13T03:05:49.805 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:49.803+0000 7fa2457fa640 1 -- 172.21.15.89:0/1492496517 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 39, "format": "json"}]=0 dumped fsmap epoch 39 v43) v1 ==== 107+0+4404 (secure 0 0 0) 0x7fa23c07ae70 con 0x7fa2480fb480 2024-09-13T03:05:49.805 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T03:05:49.805 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":39,"btime":"2024-09-13T03:02:17:188265+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34448,"name":"cephfs.smithi089.rarddb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6829/177758677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":177758677},{"type":"v1","addr":"172.21.15.89:6829","nonce":177758677}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":44355,"name":"cephfs.smithi131.uasrkg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6825/2298563432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":2298563432},{"type":"v1","addr":"172.21.15.131:6825","nonce":2298563432}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T02:51:40.657817+0000","modified":"2024-09-13T03:01:46.692911+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34416},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34416":{"gid":34416,"name":"cephfs.smithi089.qjoitb","rank":0,"incarnation":32,"state":"up:active","state_seq":8,"addr":"172.21.15.89:6827/2439422546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2439422546},{"type":"v1","addr":"172.21.15.89:6827","nonce":2439422546}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34416,"qdb_cluster":[34416]},"id":1}]} 2024-09-13T03:05:49.806 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 39 2024-09-13T03:05:49.807 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:49.806+0000 7fa24eeef640 1 -- 172.21.15.89:0/1492496517 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fa23806e530 msgr2=0x7fa2380709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:49.807 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:49.806+0000 7fa24eeef640 1 --2- 172.21.15.89:0/1492496517 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fa23806e530 0x7fa2380709e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fa234006fd0 tx=0x7fa234008040 comp rx=0 tx=0).stop 2024-09-13T03:05:49.807 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:49.806+0000 7fa24eeef640 1 -- 172.21.15.89:0/1492496517 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2480fb480 msgr2=0x7fa248112120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:49.807 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:49.806+0000 7fa24eeef640 1 --2- 172.21.15.89:0/1492496517 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2480fb480 0x7fa248112120 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fa23c003080 tx=0x7fa23c009da0 comp rx=0 tx=0).stop 2024-09-13T03:05:49.808 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:49.806+0000 7fa24eeef640 1 -- 172.21.15.89:0/1492496517 shutdown_connections 2024-09-13T03:05:49.808 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:49.806+0000 7fa24eeef640 1 --2- 172.21.15.89:0/1492496517 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fa23806e530 0x7fa2380709e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:49.808 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:49.806+0000 7fa24eeef640 1 --2- 172.21.15.89:0/1492496517 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa2481014c0 0x7fa248112660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:49.808 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:49.806+0000 7fa24eeef640 1 --2- 172.21.15.89:0/1492496517 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa2480fb480 0x7fa248112120 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:49.808 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:49.806+0000 7fa24eeef640 1 -- 172.21.15.89:0/1492496517 >> 172.21.15.89:0/1492496517 conn(0x7fa2480f7000 msgr2=0x7fa2480f88b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:05:49.808 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:49.806+0000 7fa24eeef640 1 -- 172.21.15.89:0/1492496517 shutdown_connections 2024-09-13T03:05:49.808 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:49.806+0000 7fa24eeef640 1 -- 172.21.15.89:0/1492496517 wait complete. 2024-09-13T03:05:50.101 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:05:49 smithi089 ceph-mon[91553]: from='client.? 172.21.15.89:0/1492496517' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 39, "format": "json"}]: dispatch 2024-09-13T03:05:50.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:05:49 smithi131 ceph-mon[78839]: from='client.? 172.21.15.89:0/1492496517' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 39, "format": "json"}]: dispatch 2024-09-13T03:05:50.426 DEBUG:tasks.fs:max_mds reduced in epoch 39 2024-09-13T03:05:50.426 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 39 2024-09-13T03:05:50.426 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 40 2024-09-13T03:05:50.679 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T03:05:51.071 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:05:50 smithi089 ceph-mon[91553]: pgmap v315: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T03:05:51.072 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:05:50 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:05:51.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:05:50 smithi131 ceph-mon[78839]: pgmap v315: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T03:05:51.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:05:50 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-09-13T03:05:52.324 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:52.321+0000 7f91895bb640 1 -- 172.21.15.89:0/1739901723 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91840fdf70 msgr2=0x7f91841065b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:52.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:52.321+0000 7f91895bb640 1 --2- 172.21.15.89:0/1739901723 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91840fdf70 0x7f91841065b0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f9178004900 tx=0x7f9178009da0 comp rx=0 tx=0).stop 2024-09-13T03:05:52.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:52.321+0000 7f91895bb640 1 -- 172.21.15.89:0/1739901723 shutdown_connections 2024-09-13T03:05:52.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:52.321+0000 7f91895bb640 1 --2- 172.21.15.89:0/1739901723 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91840fdf70 0x7f91841065b0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:52.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:52.321+0000 7f91895bb640 1 --2- 172.21.15.89:0/1739901723 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f91840fd5d0 0x7f91840fd9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:52.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:52.321+0000 7f91895bb640 1 -- 172.21.15.89:0/1739901723 >> 172.21.15.89:0/1739901723 conn(0x7f91840f7060 msgr2=0x7f91840f9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:05:52.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:52.321+0000 7f91895bb640 1 -- 172.21.15.89:0/1739901723 shutdown_connections 2024-09-13T03:05:52.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:52.321+0000 7f91895bb640 1 -- 172.21.15.89:0/1739901723 wait complete. 2024-09-13T03:05:52.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:52.322+0000 7f91895bb640 1 Processor -- start 2024-09-13T03:05:52.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:52.322+0000 7f91895bb640 1 -- start start 2024-09-13T03:05:52.325 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:52.322+0000 7f91895bb640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f91840fd5d0 0x7f9184113200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:52.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:52.322+0000 7f91895bb640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91840fdf70 0x7f9184113740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:52.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:52.322+0000 7f91895bb640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9184113d40 con 0x7f91840fdf70 2024-09-13T03:05:52.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:52.322+0000 7f91895bb640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f918410d180 con 0x7f91840fd5d0 2024-09-13T03:05:52.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:52.322+0000 7f91827fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91840fdf70 0x7f9184113740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:52.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:52.322+0000 7f91827fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91840fdf70 0x7f9184113740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36604/0 (socket says 172.21.15.89:36604) 2024-09-13T03:05:52.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:52.322+0000 7f91827fc640 1 -- 172.21.15.89:0/3615181159 learned_addr learned my addr 172.21.15.89:0/3615181159 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T03:05:52.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:52.323+0000 7f9182ffd640 1 --2- 172.21.15.89:0/3615181159 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f91840fd5d0 0x7f9184113200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:52.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:52.323+0000 7f91827fc640 1 -- 172.21.15.89:0/3615181159 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f91840fd5d0 msgr2=0x7f9184113200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:52.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:52.323+0000 7f91827fc640 1 --2- 172.21.15.89:0/3615181159 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f91840fd5d0 0x7f9184113200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:52.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:52.323+0000 7f91827fc640 1 -- 172.21.15.89:0/3615181159 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9178005040 con 0x7f91840fdf70 2024-09-13T03:05:52.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:52.323+0000 7f9182ffd640 1 --2- 172.21.15.89:0/3615181159 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f91840fd5d0 0x7f9184113200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-13T03:05:52.326 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:52.323+0000 7f91827fc640 1 --2- 172.21.15.89:0/3615181159 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91840fdf70 0x7f9184113740 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f917802a630 tx=0x7f9178009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:05:52.327 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:52.323+0000 7f916b7fe640 1 -- 172.21.15.89:0/3615181159 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9178038070 con 0x7f91840fdf70 2024-09-13T03:05:52.327 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:52.323+0000 7f91895bb640 1 -- 172.21.15.89:0/3615181159 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f918410d400 con 0x7f91840fdf70 2024-09-13T03:05:52.327 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:52.323+0000 7f916b7fe640 1 -- 172.21.15.89:0/3615181159 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f917802ae80 con 0x7f91840fdf70 2024-09-13T03:05:52.327 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:52.323+0000 7f916b7fe640 1 -- 172.21.15.89:0/3615181159 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9178032b00 con 0x7f91840fdf70 2024-09-13T03:05:52.327 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:52.323+0000 7f91895bb640 1 -- 172.21.15.89:0/3615181159 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f918410d860 con 0x7f91840fdf70 2024-09-13T03:05:52.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:52.324+0000 7f91895bb640 1 -- 172.21.15.89:0/3615181159 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9184066310 con 0x7f91840fdf70 2024-09-13T03:05:52.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:52.325+0000 7f916b7fe640 1 -- 172.21.15.89:0/3615181159 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f9178030020 con 0x7f91840fdf70 2024-09-13T03:05:52.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:52.325+0000 7f916b7fe640 1 --2- 172.21.15.89:0/3615181159 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f916c06e530 0x7f916c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:52.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:52.325+0000 7f916b7fe640 1 -- 172.21.15.89:0/3615181159 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f91780addd0 con 0x7f91840fdf70 2024-09-13T03:05:52.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:52.325+0000 7f9182ffd640 1 --2- 172.21.15.89:0/3615181159 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f916c06e530 0x7f916c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:52.328 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:52.326+0000 7f9182ffd640 1 --2- 172.21.15.89:0/3615181159 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f916c06e530 0x7f916c0709e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9174007fd0 tx=0x7f9174009e90 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:05:52.331 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:52.330+0000 7f916b7fe640 1 -- 172.21.15.89:0/3615181159 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f9178076ee0 con 0x7f91840fdf70 2024-09-13T03:05:52.531 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:52.530+0000 7f91895bb640 1 -- 172.21.15.89:0/3615181159 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 40, "format": "json"} v 0) v1 -- 0x7f91841095d0 con 0x7f91840fdf70 2024-09-13T03:05:52.532 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:52.531+0000 7f916b7fe640 1 -- 172.21.15.89:0/3615181159 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 40, "format": "json"}]=0 dumped fsmap epoch 40 v43) v1 ==== 107+0+5254 (secure 0 0 0) 0x7f917807a5a0 con 0x7f91840fdf70 2024-09-13T03:05:52.532 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T03:05:52.532 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":40,"btime":"2024-09-13T03:02:22:669547+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34448,"name":"cephfs.smithi089.rarddb","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.89:6829/177758677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":177758677},{"type":"v1","addr":"172.21.15.89:6829","nonce":177758677}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":44355,"name":"cephfs.smithi131.uasrkg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6825/2298563432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":2298563432},{"type":"v1","addr":"172.21.15.131:6825","nonce":2298563432}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":44385,"name":"cephfs.smithi131.rbovzc","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6827/2680433683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":2680433683},{"type":"v1","addr":"172.21.15.131:6827","nonce":2680433683}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":35,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T02:51:40.657817+0000","modified":"2024-09-13T03:01:46.692911+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":34416},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_34416":{"gid":34416,"name":"cephfs.smithi089.qjoitb","rank":0,"incarnation":32,"state":"up:active","state_seq":8,"addr":"172.21.15.89:6827/2439422546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2439422546},{"type":"v1","addr":"172.21.15.89:6827","nonce":2439422546}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34416,"qdb_cluster":[34416]},"id":1}]} 2024-09-13T03:05:52.533 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 40 2024-09-13T03:05:52.534 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:52.533+0000 7f91895bb640 1 -- 172.21.15.89:0/3615181159 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f916c06e530 msgr2=0x7f916c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:52.534 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:52.533+0000 7f91895bb640 1 --2- 172.21.15.89:0/3615181159 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f916c06e530 0x7f916c0709e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f9174007fd0 tx=0x7f9174009e90 comp rx=0 tx=0).stop 2024-09-13T03:05:52.534 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:52.533+0000 7f91895bb640 1 -- 172.21.15.89:0/3615181159 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91840fdf70 msgr2=0x7f9184113740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:52.534 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:52.533+0000 7f91895bb640 1 --2- 172.21.15.89:0/3615181159 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91840fdf70 0x7f9184113740 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f917802a630 tx=0x7f9178009da0 comp rx=0 tx=0).stop 2024-09-13T03:05:52.534 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:52.533+0000 7f91895bb640 1 -- 172.21.15.89:0/3615181159 shutdown_connections 2024-09-13T03:05:52.535 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:52.533+0000 7f91895bb640 1 --2- 172.21.15.89:0/3615181159 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f916c06e530 0x7f916c0709e0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:52.535 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:52.533+0000 7f91895bb640 1 --2- 172.21.15.89:0/3615181159 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f91840fdf70 0x7f9184113740 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:52.535 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:52.533+0000 7f91895bb640 1 --2- 172.21.15.89:0/3615181159 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f91840fd5d0 0x7f9184113200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:52.535 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:52.533+0000 7f91895bb640 1 -- 172.21.15.89:0/3615181159 >> 172.21.15.89:0/3615181159 conn(0x7f91840f7060 msgr2=0x7f91840f85b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:05:52.535 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:52.533+0000 7f91895bb640 1 -- 172.21.15.89:0/3615181159 shutdown_connections 2024-09-13T03:05:52.535 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:52.533+0000 7f91895bb640 1 -- 172.21.15.89:0/3615181159 wait complete. 2024-09-13T03:05:53.107 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:05:52 smithi089 ceph-mon[91553]: pgmap v316: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:05:53.107 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:05:52 smithi089 ceph-mon[91553]: from='client.? 172.21.15.89:0/3615181159' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 40, "format": "json"}]: dispatch 2024-09-13T03:05:53.134 DEBUG:tasks.fs:max_mds reduced in epoch 40 2024-09-13T03:05:53.134 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 40 2024-09-13T03:05:53.134 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 41 2024-09-13T03:05:53.183 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:05:52 smithi131 ceph-mon[78839]: pgmap v316: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:05:53.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:05:52 smithi131 ceph-mon[78839]: from='client.? 172.21.15.89:0/3615181159' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 40, "format": "json"}]: dispatch 2024-09-13T03:05:53.380 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T03:05:54.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:05:53 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:05:54.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:05:53 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-13T03:05:55.130 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:05:54 smithi089 ceph-mon[91553]: pgmap v317: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T03:05:55.130 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:05:54 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:05:55.130 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:05:54 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:05:55.130 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:05:54 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T03:05:55.130 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:05:54 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T03:05:55.130 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:05:54 smithi089 ceph-mon[91553]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:05:55.162 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:55.128+0000 7f3091994640 1 -- 172.21.15.89:0/2304408084 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f308c1014c0 msgr2=0x7f308c101890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:55.162 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:55.128+0000 7f3091994640 1 --2- 172.21.15.89:0/2304408084 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f308c1014c0 0x7f308c101890 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f307c0048d0 tx=0x7f307c009da0 comp rx=0 tx=0).stop 2024-09-13T03:05:55.163 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:55.128+0000 7f3091994640 1 -- 172.21.15.89:0/2304408084 shutdown_connections 2024-09-13T03:05:55.163 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:55.128+0000 7f3091994640 1 --2- 172.21.15.89:0/2304408084 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f308c0fb480 0x7f308c0fb8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:55.163 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:55.128+0000 7f3091994640 1 --2- 172.21.15.89:0/2304408084 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f308c1014c0 0x7f308c101890 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:55.163 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:55.128+0000 7f3091994640 1 -- 172.21.15.89:0/2304408084 >> 172.21.15.89:0/2304408084 conn(0x7f308c0f7000 msgr2=0x7f308c0f9410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:05:55.163 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:55.128+0000 7f3091994640 1 -- 172.21.15.89:0/2304408084 shutdown_connections 2024-09-13T03:05:55.163 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:55.128+0000 7f3091994640 1 -- 172.21.15.89:0/2304408084 wait complete. 2024-09-13T03:05:55.163 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:55.129+0000 7f3091994640 1 Processor -- start 2024-09-13T03:05:55.163 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:55.129+0000 7f3091994640 1 -- start start 2024-09-13T03:05:55.164 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:55.129+0000 7f3091994640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f308c0fb480 0x7f308c1131e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:55.164 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:55.129+0000 7f3091994640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f308c1014c0 0x7f308c113720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:55.164 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:55.129+0000 7f3091994640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f308c113d20 con 0x7f308c1014c0 2024-09-13T03:05:55.164 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:55.129+0000 7f3091994640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f308c10d160 con 0x7f308c0fb480 2024-09-13T03:05:55.164 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:55.129+0000 7f308a7fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f308c1014c0 0x7f308c113720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:55.164 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:55.129+0000 7f308a7fc640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f308c1014c0 0x7f308c113720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36628/0 (socket says 172.21.15.89:36628) 2024-09-13T03:05:55.164 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:55.129+0000 7f308a7fc640 1 -- 172.21.15.89:0/1005023747 learned_addr learned my addr 172.21.15.89:0/1005023747 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T03:05:55.165 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:55.129+0000 7f308affd640 1 --2- 172.21.15.89:0/1005023747 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f308c0fb480 0x7f308c1131e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:55.165 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:55.129+0000 7f308a7fc640 1 -- 172.21.15.89:0/1005023747 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f308c0fb480 msgr2=0x7f308c1131e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:55.165 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:55.129+0000 7f308a7fc640 1 --2- 172.21.15.89:0/1005023747 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f308c0fb480 0x7f308c1131e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:55.165 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:55.129+0000 7f308a7fc640 1 -- 172.21.15.89:0/1005023747 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f307c005040 con 0x7f308c1014c0 2024-09-13T03:05:55.165 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:55.129+0000 7f308affd640 1 --2- 172.21.15.89:0/1005023747 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f308c0fb480 0x7f308c1131e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-13T03:05:55.165 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:55.129+0000 7f308a7fc640 1 --2- 172.21.15.89:0/1005023747 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f308c1014c0 0x7f308c113720 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f3074002a50 tx=0x7f3074004600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:05:55.165 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:55.130+0000 7f30837fe640 1 -- 172.21.15.89:0/1005023747 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3074007c30 con 0x7f308c1014c0 2024-09-13T03:05:55.165 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:55.130+0000 7f30837fe640 1 -- 172.21.15.89:0/1005023747 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f307400f040 con 0x7f308c1014c0 2024-09-13T03:05:55.165 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:55.130+0000 7f3091994640 1 -- 172.21.15.89:0/1005023747 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f308c10d440 con 0x7f308c1014c0 2024-09-13T03:05:55.165 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:55.130+0000 7f30837fe640 1 -- 172.21.15.89:0/1005023747 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f307400da90 con 0x7f308c1014c0 2024-09-13T03:05:55.165 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:55.130+0000 7f3091994640 1 -- 172.21.15.89:0/1005023747 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f308c10d9e0 con 0x7f308c1014c0 2024-09-13T03:05:55.165 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:55.131+0000 7f3091994640 1 -- 172.21.15.89:0/1005023747 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f308c0fcbc0 con 0x7f308c1014c0 2024-09-13T03:05:55.165 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:55.131+0000 7f30837fe640 1 -- 172.21.15.89:0/1005023747 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f307400dd00 con 0x7f308c1014c0 2024-09-13T03:05:55.165 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:55.132+0000 7f30837fe640 1 --2- 172.21.15.89:0/1005023747 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f307806e530 0x7f30780709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:55.166 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:55.132+0000 7f30837fe640 1 -- 172.21.15.89:0/1005023747 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f307408dad0 con 0x7f308c1014c0 2024-09-13T03:05:55.166 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:55.132+0000 7f308affd640 1 --2- 172.21.15.89:0/1005023747 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f307806e530 0x7f30780709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:55.166 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:55.132+0000 7f308affd640 1 --2- 172.21.15.89:0/1005023747 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f307806e530 0x7f30780709e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f307c00b020 tx=0x7f307c009da0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:05:55.166 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:55.136+0000 7f30837fe640 1 -- 172.21.15.89:0/1005023747 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f3074056b60 con 0x7f308c1014c0 2024-09-13T03:05:55.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:05:54 smithi131 ceph-mon[78839]: pgmap v317: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T03:05:55.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:05:54 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:05:55.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:05:54 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:05:55.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:05:54 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-13T03:05:55.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:05:54 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-13T03:05:55.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:05:54 smithi131 ceph-mon[78839]: from='mgr.34104 172.21.15.89:0/2409364056' entity='mgr.smithi089.guohvs' 2024-09-13T03:05:55.338 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:55.336+0000 7f3091994640 1 -- 172.21.15.89:0/1005023747 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 41, "format": "json"} v 0) v1 -- 0x7f308c1084c0 con 0x7f308c1014c0 2024-09-13T03:05:55.338 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:55.337+0000 7f30837fe640 1 -- 172.21.15.89:0/1005023747 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 41, "format": "json"}]=0 dumped fsmap epoch 41 v43) v1 ==== 107+0+5271 (secure 0 0 0) 0x7f307405a220 con 0x7f308c1014c0 2024-09-13T03:05:55.339 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T03:05:55.339 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":41,"btime":"2024-09-13T03:02:29:370027+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44355,"name":"cephfs.smithi131.uasrkg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6825/2298563432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":2298563432},{"type":"v1","addr":"172.21.15.131:6825","nonce":2298563432}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":44385,"name":"cephfs.smithi131.rbovzc","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6827/2680433683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":2680433683},{"type":"v1","addr":"172.21.15.131:6827","nonce":2680433683}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":41,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T02:51:40.657817+0000","modified":"2024-09-13T03:02:29.370002+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34416,"mds_1":34448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34416":{"gid":34416,"name":"cephfs.smithi089.qjoitb","rank":0,"incarnation":32,"state":"up:active","state_seq":8,"addr":"172.21.15.89:6827/2439422546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2439422546},{"type":"v1","addr":"172.21.15.89:6827","nonce":2439422546}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34448":{"gid":34448,"name":"cephfs.smithi089.rarddb","rank":1,"incarnation":41,"state":"up:starting","state_seq":1,"addr":"172.21.15.89:6829/177758677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":177758677},{"type":"v1","addr":"172.21.15.89:6829","nonce":177758677}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34416,"qdb_cluster":[34416]},"id":1}]} 2024-09-13T03:05:55.339 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 41 2024-09-13T03:05:55.341 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:55.339+0000 7f3091994640 1 -- 172.21.15.89:0/1005023747 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f307806e530 msgr2=0x7f30780709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:55.341 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:55.339+0000 7f3091994640 1 --2- 172.21.15.89:0/1005023747 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f307806e530 0x7f30780709e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f307c00b020 tx=0x7f307c009da0 comp rx=0 tx=0).stop 2024-09-13T03:05:55.341 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:55.339+0000 7f3091994640 1 -- 172.21.15.89:0/1005023747 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f308c1014c0 msgr2=0x7f308c113720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:55.341 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:55.339+0000 7f3091994640 1 --2- 172.21.15.89:0/1005023747 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f308c1014c0 0x7f308c113720 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f3074002a50 tx=0x7f3074004600 comp rx=0 tx=0).stop 2024-09-13T03:05:55.341 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:55.339+0000 7f3091994640 1 -- 172.21.15.89:0/1005023747 shutdown_connections 2024-09-13T03:05:55.341 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:55.339+0000 7f3091994640 1 --2- 172.21.15.89:0/1005023747 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f307806e530 0x7f30780709e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:55.341 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:55.339+0000 7f3091994640 1 --2- 172.21.15.89:0/1005023747 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f308c1014c0 0x7f308c113720 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:55.342 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:55.339+0000 7f3091994640 1 --2- 172.21.15.89:0/1005023747 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f308c0fb480 0x7f308c1131e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:55.342 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:55.339+0000 7f3091994640 1 -- 172.21.15.89:0/1005023747 >> 172.21.15.89:0/1005023747 conn(0x7f308c0f7000 msgr2=0x7f308c065a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:05:55.342 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:55.339+0000 7f3091994640 1 -- 172.21.15.89:0/1005023747 shutdown_connections 2024-09-13T03:05:55.342 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:55.339+0000 7f3091994640 1 -- 172.21.15.89:0/1005023747 wait complete. 2024-09-13T03:05:55.997 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:05:55 smithi089 ceph-mon[91553]: from='client.? 172.21.15.89:0/1005023747' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 41, "format": "json"}]: dispatch 2024-09-13T03:05:56.023 DEBUG:tasks.fs:allow_standby_replay disabled in epoch 41 2024-09-13T03:05:56.023 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 42 2024-09-13T03:05:56.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:05:55 smithi131 ceph-mon[78839]: from='client.? 172.21.15.89:0/1005023747' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 41, "format": "json"}]: dispatch 2024-09-13T03:05:56.269 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T03:05:57.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:05:56 smithi089 ceph-mon[91553]: pgmap v318: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:05:57.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:05:56 smithi131 ceph-mon[78839]: pgmap v318: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:05:57.889 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:57.885+0000 7fd91f663640 1 -- 172.21.15.89:0/3204442601 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9180fb470 msgr2=0x7fd9180fb8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:57.889 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:57.885+0000 7fd91f663640 1 --2- 172.21.15.89:0/3204442601 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9180fb470 0x7fd9180fb8c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fd9080048d0 tx=0x7fd908009da0 comp rx=0 tx=0).stop 2024-09-13T03:05:57.889 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:57.885+0000 7fd91f663640 1 -- 172.21.15.89:0/3204442601 shutdown_connections 2024-09-13T03:05:57.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:57.885+0000 7fd91f663640 1 --2- 172.21.15.89:0/3204442601 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd9180fb470 0x7fd9180fb8c0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:57.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:57.885+0000 7fd91f663640 1 --2- 172.21.15.89:0/3204442601 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd918101490 0x7fd918101860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:57.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:57.885+0000 7fd91f663640 1 -- 172.21.15.89:0/3204442601 >> 172.21.15.89:0/3204442601 conn(0x7fd918071450 msgr2=0x7fd918071850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:05:57.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:57.886+0000 7fd91f663640 1 -- 172.21.15.89:0/3204442601 shutdown_connections 2024-09-13T03:05:57.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:57.886+0000 7fd91f663640 1 -- 172.21.15.89:0/3204442601 wait complete. 2024-09-13T03:05:57.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:57.886+0000 7fd91f663640 1 Processor -- start 2024-09-13T03:05:57.890 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:57.886+0000 7fd91f663640 1 -- start start 2024-09-13T03:05:57.891 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:57.886+0000 7fd91f663640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd9180fb470 0x7fd9180fd080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:57.891 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:57.886+0000 7fd91f663640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd918101490 0x7fd9180fd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:57.891 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:57.886+0000 7fd91f663640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9180fdb00 con 0x7fd918101490 2024-09-13T03:05:57.891 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:57.886+0000 7fd91f663640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9180fdc70 con 0x7fd9180fb470 2024-09-13T03:05:57.891 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:57.887+0000 7fd91cbfe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd918101490 0x7fd9180fd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:57.891 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:57.887+0000 7fd91cbfe640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd918101490 0x7fd9180fd5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36648/0 (socket says 172.21.15.89:36648) 2024-09-13T03:05:57.891 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:57.887+0000 7fd91d3ff640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd9180fb470 0x7fd9180fd080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:57.891 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:57.887+0000 7fd91cbfe640 1 -- 172.21.15.89:0/3114846377 learned_addr learned my addr 172.21.15.89:0/3114846377 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T03:05:57.891 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:57.887+0000 7fd91cbfe640 1 -- 172.21.15.89:0/3114846377 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd9180fb470 msgr2=0x7fd9180fd080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:57.892 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:57.887+0000 7fd91cbfe640 1 --2- 172.21.15.89:0/3114846377 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd9180fb470 0x7fd9180fd080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:57.892 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:57.887+0000 7fd91cbfe640 1 -- 172.21.15.89:0/3114846377 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd908005040 con 0x7fd918101490 2024-09-13T03:05:57.892 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:57.887+0000 7fd91cbfe640 1 --2- 172.21.15.89:0/3114846377 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd918101490 0x7fd9180fd5c0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fd9080043d0 tx=0x7fd908009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:05:57.892 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:57.887+0000 7fd90dffb640 1 -- 172.21.15.89:0/3114846377 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd908038070 con 0x7fd918101490 2024-09-13T03:05:57.892 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:57.887+0000 7fd90dffb640 1 -- 172.21.15.89:0/3114846377 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fd908032b20 con 0x7fd918101490 2024-09-13T03:05:57.892 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:57.887+0000 7fd91f663640 1 -- 172.21.15.89:0/3114846377 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9180fdea0 con 0x7fd918101490 2024-09-13T03:05:57.892 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:57.888+0000 7fd90dffb640 1 -- 172.21.15.89:0/3114846377 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd90803d960 con 0x7fd918101490 2024-09-13T03:05:57.892 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:57.888+0000 7fd91f663640 1 -- 172.21.15.89:0/3114846377 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9181197c0 con 0x7fd918101490 2024-09-13T03:05:57.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:57.889+0000 7fd91f663640 1 -- 172.21.15.89:0/3114846377 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9180fcb50 con 0x7fd918101490 2024-09-13T03:05:57.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:57.889+0000 7fd90dffb640 1 -- 172.21.15.89:0/3114846377 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fd908030020 con 0x7fd918101490 2024-09-13T03:05:57.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:57.890+0000 7fd90dffb640 1 --2- 172.21.15.89:0/3114846377 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fd90406e530 0x7fd9040709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:05:57.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:57.890+0000 7fd90dffb640 1 -- 172.21.15.89:0/3114846377 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fd9080aea80 con 0x7fd918101490 2024-09-13T03:05:57.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:57.890+0000 7fd91d3ff640 1 --2- 172.21.15.89:0/3114846377 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fd90406e530 0x7fd9040709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:05:57.894 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:57.890+0000 7fd91d3ff640 1 --2- 172.21.15.89:0/3114846377 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fd90406e530 0x7fd9040709e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd914004ed0 tx=0x7fd91400b040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:05:57.895 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:57.894+0000 7fd90dffb640 1 -- 172.21.15.89:0/3114846377 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fd908077b80 con 0x7fd918101490 2024-09-13T03:05:58.095 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:58.093+0000 7fd91f663640 1 -- 172.21.15.89:0/3114846377 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 42, "format": "json"} v 0) v1 -- 0x7fd91805ed70 con 0x7fd918101490 2024-09-13T03:05:58.095 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:58.094+0000 7fd90dffb640 1 -- 172.21.15.89:0/3114846377 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 42, "format": "json"}]=0 dumped fsmap epoch 42 v43) v1 ==== 107+0+5275 (secure 0 0 0) 0x7fd90807b240 con 0x7fd918101490 2024-09-13T03:05:58.096 INFO:teuthology.orchestra.run.smithi089.stdout: 2024-09-13T03:05:58.096 INFO:teuthology.orchestra.run.smithi089.stdout:{"epoch":42,"btime":"2024-09-13T03:02:30:379252+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44355,"name":"cephfs.smithi131.uasrkg","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6825/2298563432","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6824","nonce":2298563432},{"type":"v1","addr":"172.21.15.131:6825","nonce":2298563432}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":38},{"gid":44385,"name":"cephfs.smithi131.rbovzc","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.131:6827/2680433683","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.131:6826","nonce":2680433683},{"type":"v1","addr":"172.21.15.131:6827","nonce":2680433683}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":40}],"filesystems":[{"mdsmap":{"epoch":42,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-13T02:51:40.657817+0000","modified":"2024-09-13T03:02:30.379250+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":80,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34416,"mds_1":34448},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34416":{"gid":34416,"name":"cephfs.smithi089.qjoitb","rank":0,"incarnation":32,"state":"up:active","state_seq":8,"addr":"172.21.15.89:6827/2439422546","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6826","nonce":2439422546},{"type":"v1","addr":"172.21.15.89:6827","nonce":2439422546}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_34448":{"gid":34448,"name":"cephfs.smithi089.rarddb","rank":1,"incarnation":41,"state":"up:active","state_seq":12,"addr":"172.21.15.89:6829/177758677","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.89:6828","nonce":177758677},{"type":"v1","addr":"172.21.15.89:6829","nonce":177758677}]},"join_fscid":1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":34416,"qdb_cluster":[34416,34448]},"id":1}]} 2024-09-13T03:05:58.096 INFO:teuthology.orchestra.run.smithi089.stderr:dumped fsmap epoch 42 2024-09-13T03:05:58.097 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:58.096+0000 7fd91f663640 1 -- 172.21.15.89:0/3114846377 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fd90406e530 msgr2=0x7fd9040709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:58.098 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:58.096+0000 7fd91f663640 1 --2- 172.21.15.89:0/3114846377 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fd90406e530 0x7fd9040709e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd914004ed0 tx=0x7fd91400b040 comp rx=0 tx=0).stop 2024-09-13T03:05:58.098 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:58.096+0000 7fd91f663640 1 -- 172.21.15.89:0/3114846377 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd918101490 msgr2=0x7fd9180fd5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:05:58.098 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:58.096+0000 7fd91f663640 1 --2- 172.21.15.89:0/3114846377 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd918101490 0x7fd9180fd5c0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fd9080043d0 tx=0x7fd908009da0 comp rx=0 tx=0).stop 2024-09-13T03:05:58.098 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:58.096+0000 7fd91f663640 1 -- 172.21.15.89:0/3114846377 shutdown_connections 2024-09-13T03:05:58.098 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:58.096+0000 7fd91f663640 1 --2- 172.21.15.89:0/3114846377 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fd90406e530 0x7fd9040709e0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:58.098 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:58.096+0000 7fd91f663640 1 --2- 172.21.15.89:0/3114846377 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fd918101490 0x7fd9180fd5c0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:58.098 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:58.096+0000 7fd91f663640 1 --2- 172.21.15.89:0/3114846377 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fd9180fb470 0x7fd9180fd080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:05:58.098 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:58.096+0000 7fd91f663640 1 -- 172.21.15.89:0/3114846377 >> 172.21.15.89:0/3114846377 conn(0x7fd918071450 msgr2=0x7fd918064f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:05:58.098 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:58.096+0000 7fd91f663640 1 -- 172.21.15.89:0/3114846377 shutdown_connections 2024-09-13T03:05:58.098 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:05:58.096+0000 7fd91f663640 1 -- 172.21.15.89:0/3114846377 wait complete. 2024-09-13T03:05:58.880 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-09-13T03:05:58.893 INFO:tasks.kclient:Unmounting kernel clients... 2024-09-13T03:05:58.893 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-13T03:05:58.893 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T03:05:58.912 DEBUG:teuthology.orchestra.run.smithi089:> set -ex 2024-09-13T03:05:58.912 DEBUG:teuthology.orchestra.run.smithi089:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T03:05:58.970 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-13T03:05:59.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:05:58 smithi131 ceph-mon[78839]: pgmap v319: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:05:59.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:05:58 smithi131 ceph-mon[78839]: from='client.? 172.21.15.89:0/3114846377' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 42, "format": "json"}]: dispatch 2024-09-13T03:05:59.256 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T03:05:59.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:05:58 smithi089 ceph-mon[91553]: pgmap v319: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:05:59.285 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:05:58 smithi089 ceph-mon[91553]: from='client.? 172.21.15.89:0/3114846377' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 42, "format": "json"}]: dispatch 2024-09-13T03:06:00.825 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:06:00.822+0000 7fa668aba640 1 -- 172.21.15.89:0/2796952494 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6640fe450 msgr2=0x7fa6640fe820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:06:00.825 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:06:00.822+0000 7fa668aba640 1 --2- 172.21.15.89:0/2796952494 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6640fe450 0x7fa6640fe820 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fa65c0048d0 tx=0x7fa65c009da0 comp rx=0 tx=0).stop 2024-09-13T03:06:00.825 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:06:00.822+0000 7fa668aba640 1 -- 172.21.15.89:0/2796952494 shutdown_connections 2024-09-13T03:06:00.825 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:06:00.822+0000 7fa668aba640 1 --2- 172.21.15.89:0/2796952494 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa664064fe0 0x7fa664065430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:06:00.825 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:06:00.822+0000 7fa668aba640 1 --2- 172.21.15.89:0/2796952494 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa6640fe450 0x7fa6640fe820 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:06:00.825 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:06:00.822+0000 7fa668aba640 1 -- 172.21.15.89:0/2796952494 >> 172.21.15.89:0/2796952494 conn(0x7fa6640723b0 msgr2=0x7fa6640727b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:06:00.825 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:06:00.822+0000 7fa668aba640 1 -- 172.21.15.89:0/2796952494 shutdown_connections 2024-09-13T03:06:00.825 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:06:00.822+0000 7fa668aba640 1 -- 172.21.15.89:0/2796952494 wait complete. 2024-09-13T03:06:00.825 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:06:00.822+0000 7fa668aba640 1 Processor -- start 2024-09-13T03:06:00.825 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:06:00.822+0000 7fa668aba640 1 -- start start 2024-09-13T03:06:00.825 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:06:00.823+0000 7fa668aba640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa664064fe0 0x7fa664113210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:06:00.826 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:06:00.823+0000 7fa668aba640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6640fe450 0x7fa664113750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:06:00.826 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:06:00.823+0000 7fa668aba640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa664113d50 con 0x7fa664064fe0 2024-09-13T03:06:00.826 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:06:00.823+0000 7fa668aba640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa66410d190 con 0x7fa6640fe450 2024-09-13T03:06:00.826 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:06:00.823+0000 7fa66259c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa664064fe0 0x7fa664113210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:06:00.826 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:06:00.823+0000 7fa66259c640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa664064fe0 0x7fa664113210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:36656/0 (socket says 172.21.15.89:36656) 2024-09-13T03:06:00.826 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:06:00.823+0000 7fa66259c640 1 -- 172.21.15.89:0/3872246087 learned_addr learned my addr 172.21.15.89:0/3872246087 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T03:06:00.826 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:06:00.823+0000 7fa661d9b640 1 --2- 172.21.15.89:0/3872246087 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6640fe450 0x7fa664113750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:06:00.826 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:06:00.823+0000 7fa66259c640 1 -- 172.21.15.89:0/3872246087 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6640fe450 msgr2=0x7fa664113750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:06:00.826 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:06:00.823+0000 7fa66259c640 1 --2- 172.21.15.89:0/3872246087 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6640fe450 0x7fa664113750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:06:00.826 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:06:00.823+0000 7fa66259c640 1 -- 172.21.15.89:0/3872246087 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa65c005040 con 0x7fa664064fe0 2024-09-13T03:06:00.826 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:06:00.823+0000 7fa66259c640 1 --2- 172.21.15.89:0/3872246087 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa664064fe0 0x7fa664113210 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fa65c0043d0 tx=0x7fa65c009da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:06:00.826 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:06:00.823+0000 7fa652ffd640 1 -- 172.21.15.89:0/3872246087 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa65c038070 con 0x7fa664064fe0 2024-09-13T03:06:00.826 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:06:00.823+0000 7fa652ffd640 1 -- 172.21.15.89:0/3872246087 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7fa65c0096e0 con 0x7fa664064fe0 2024-09-13T03:06:00.827 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:06:00.823+0000 7fa668aba640 1 -- 172.21.15.89:0/3872246087 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa66410d410 con 0x7fa664064fe0 2024-09-13T03:06:00.827 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:06:00.823+0000 7fa652ffd640 1 -- 172.21.15.89:0/3872246087 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa65c03d420 con 0x7fa664064fe0 2024-09-13T03:06:00.827 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:06:00.823+0000 7fa668aba640 1 -- 172.21.15.89:0/3872246087 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa66410d930 con 0x7fa664064fe0 2024-09-13T03:06:00.827 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:06:00.824+0000 7fa668aba640 1 -- 172.21.15.89:0/3872246087 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6640fdce0 con 0x7fa664064fe0 2024-09-13T03:06:00.828 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:06:00.825+0000 7fa652ffd640 1 -- 172.21.15.89:0/3872246087 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7fa65c030020 con 0x7fa664064fe0 2024-09-13T03:06:00.828 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:06:00.825+0000 7fa652ffd640 1 --2- 172.21.15.89:0/3872246087 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fa64c06e530 0x7fa64c0709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:06:00.828 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:06:00.826+0000 7fa661d9b640 1 --2- 172.21.15.89:0/3872246087 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fa64c06e530 0x7fa64c0709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:06:00.828 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:06:00.826+0000 7fa652ffd640 1 -- 172.21.15.89:0/3872246087 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6582+0+0 (secure 0 0 0) 0x7fa65c0ae790 con 0x7fa664064fe0 2024-09-13T03:06:00.828 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:06:00.826+0000 7fa661d9b640 1 --2- 172.21.15.89:0/3872246087 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fa64c06e530 0x7fa64c0709e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa66410ead0 tx=0x7fa658004bb0 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:06:00.831 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:06:00.830+0000 7fa652ffd640 1 -- 172.21.15.89:0/3872246087 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7fa65c077820 con 0x7fa664064fe0 2024-09-13T03:06:01.010 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:06:01.009+0000 7fa668aba640 1 -- 172.21.15.89:0/3872246087 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa66404b720 con 0x7fa664064fe0 2024-09-13T03:06:01.011 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:06:00 smithi089 ceph-mon[91553]: pgmap v320: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T03:06:01.011 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:06:01.010+0000 7fa652ffd640 1 -- 172.21.15.89:0/3872246087 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 41 entries v82) v1 ==== 81+0+2423 (secure 0 0 0) 0x7fa65c07aee0 con 0x7fa664064fe0 2024-09-13T03:06:01.011 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:6829/1561365213 2024-09-14T03:01:37.943546+0000 2024-09-13T03:06:01.011 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:6800/4290496884 2024-09-14T02:56:35.519196+0000 2024-09-13T03:06:01.012 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:0/4056725854 2024-09-14T02:56:35.519196+0000 2024-09-13T03:06:01.012 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:6828/1561365213 2024-09-14T03:01:37.943546+0000 2024-09-13T03:06:01.012 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:0/535522645 2024-09-14T02:56:35.519196+0000 2024-09-13T03:06:01.012 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:0/1637405766 2024-09-14T02:56:35.519196+0000 2024-09-13T03:06:01.012 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:0/2429089058 2024-09-14T02:56:35.519196+0000 2024-09-13T03:06:01.012 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:6801/3169313021 2024-09-14T02:46:58.936239+0000 2024-09-13T03:06:01.012 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:0/1271337803 2024-09-14T02:56:35.519196+0000 2024-09-13T03:06:01.012 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:6800/3169313021 2024-09-14T02:46:58.936239+0000 2024-09-13T03:06:01.012 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:0/1988451185 2024-09-14T02:45:32.668116+0000 2024-09-13T03:06:01.012 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:0/1584789409 2024-09-14T02:54:36.059477+0000 2024-09-13T03:06:01.012 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.131:6829/2180703853 2024-09-14T02:55:56.608187+0000 2024-09-13T03:06:01.012 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:0/541675685 2024-09-14T02:46:00.949227+0000 2024-09-13T03:06:01.013 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.131:6828/2180703853 2024-09-14T02:55:56.608187+0000 2024-09-13T03:06:01.013 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:0/3043630910 2024-09-14T02:46:00.949227+0000 2024-09-13T03:06:01.013 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:6801/3982028315 2024-09-14T02:45:32.668116+0000 2024-09-13T03:06:01.013 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.131:0/1662334780 2024-09-14T02:55:56.608187+0000 2024-09-13T03:06:01.013 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:6801/4290496884 2024-09-14T02:56:35.519196+0000 2024-09-13T03:06:01.013 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:0/3491543082 2024-09-14T02:54:36.059477+0000 2024-09-13T03:06:01.013 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:6801/702640100 2024-09-14T02:46:00.949227+0000 2024-09-13T03:06:01.013 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:0/833000689 2024-09-14T02:46:00.949227+0000 2024-09-13T03:06:01.013 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:6800/3982028315 2024-09-14T02:45:32.668116+0000 2024-09-13T03:06:01.013 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.131:0/2024594656 2024-09-14T02:55:56.608187+0000 2024-09-13T03:06:01.013 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:0/559661592 2024-09-14T02:54:36.059477+0000 2024-09-13T03:06:01.013 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:0/1261668205 2024-09-14T02:45:32.668116+0000 2024-09-13T03:06:01.013 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:6800/1506060926 2024-09-14T02:54:36.059477+0000 2024-09-13T03:06:01.014 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.131:0/1594930192 2024-09-14T02:55:56.608187+0000 2024-09-13T03:06:01.014 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:0/293445085 2024-09-14T02:46:58.936239+0000 2024-09-13T03:06:01.014 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:0/698101816 2024-09-14T02:56:35.519196+0000 2024-09-13T03:06:01.014 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.131:0/523890444 2024-09-14T02:55:56.608187+0000 2024-09-13T03:06:01.014 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:6801/1506060926 2024-09-14T02:54:36.059477+0000 2024-09-13T03:06:01.014 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:0/507534695 2024-09-14T02:45:32.668116+0000 2024-09-13T03:06:01.014 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:0/1545508492 2024-09-14T02:46:58.936239+0000 2024-09-13T03:06:01.014 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.131:0/3248187288 2024-09-14T02:55:56.608187+0000 2024-09-13T03:06:01.014 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:0/4150204320 2024-09-14T02:54:36.059477+0000 2024-09-13T03:06:01.014 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.131:0/3075136182 2024-09-14T02:55:56.608187+0000 2024-09-13T03:06:01.014 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:6826/3243844531 2024-09-14T02:51:58.549400+0000 2024-09-13T03:06:01.014 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:6827/3243844531 2024-09-14T02:51:58.549400+0000 2024-09-13T03:06:01.014 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:0/431063769 2024-09-14T02:46:58.936239+0000 2024-09-13T03:06:01.015 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:6800/702640100 2024-09-14T02:46:00.949227+0000 2024-09-13T03:06:01.015 INFO:teuthology.orchestra.run.smithi089.stderr:listed 41 entries 2024-09-13T03:06:01.015 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:06:01.013+0000 7fa668aba640 1 -- 172.21.15.89:0/3872246087 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fa64c06e530 msgr2=0x7fa64c0709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:06:01.016 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:06:01.013+0000 7fa668aba640 1 --2- 172.21.15.89:0/3872246087 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fa64c06e530 0x7fa64c0709e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa66410ead0 tx=0x7fa658004bb0 comp rx=0 tx=0).stop 2024-09-13T03:06:01.016 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:06:01.013+0000 7fa668aba640 1 -- 172.21.15.89:0/3872246087 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa664064fe0 msgr2=0x7fa664113210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:06:01.016 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:06:01.013+0000 7fa668aba640 1 --2- 172.21.15.89:0/3872246087 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa664064fe0 0x7fa664113210 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fa65c0043d0 tx=0x7fa65c009da0 comp rx=0 tx=0).stop 2024-09-13T03:06:01.016 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:06:01.013+0000 7fa668aba640 1 -- 172.21.15.89:0/3872246087 shutdown_connections 2024-09-13T03:06:01.016 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:06:01.013+0000 7fa668aba640 1 --2- 172.21.15.89:0/3872246087 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7fa64c06e530 0x7fa64c0709e0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:06:01.016 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:06:01.013+0000 7fa668aba640 1 --2- 172.21.15.89:0/3872246087 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7fa6640fe450 0x7fa664113750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:06:01.016 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:06:01.013+0000 7fa668aba640 1 --2- 172.21.15.89:0/3872246087 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7fa664064fe0 0x7fa664113210 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:06:01.016 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:06:01.013+0000 7fa668aba640 1 -- 172.21.15.89:0/3872246087 >> 172.21.15.89:0/3872246087 conn(0x7fa6640723b0 msgr2=0x7fa6640fa2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:06:01.016 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:06:01.013+0000 7fa668aba640 1 -- 172.21.15.89:0/3872246087 shutdown_connections 2024-09-13T03:06:01.016 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:06:01.013+0000 7fa668aba640 1 -- 172.21.15.89:0/3872246087 wait complete. 2024-09-13T03:06:01.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:06:00 smithi131 ceph-mon[78839]: pgmap v320: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 3 op/s 2024-09-13T03:06:01.668 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-09-13T03:06:01.668 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T03:06:01.668 DEBUG:teuthology.orchestra.run.smithi089:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-09-13T03:06:01.698 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi089.front.sepia.ceph.com 2024-09-13T03:06:01.698 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T03:06:01.698 DEBUG:teuthology.orchestra.run.smithi089:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-13T03:06:01.772 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-13T03:06:01.772 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T03:06:01.793 DEBUG:teuthology.orchestra.run.smithi131:> set -ex 2024-09-13T03:06:01.793 DEBUG:teuthology.orchestra.run.smithi131:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-13T03:06:01.853 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:quincy shell --fsid 12cdb164-717a-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-13T03:06:02.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:06:01 smithi089 ceph-mon[91553]: from='client.? 172.21.15.89:0/3872246087' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-13T03:06:02.105 INFO:teuthology.orchestra.run.smithi089.stderr:Inferring config /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/mon.smithi089/config 2024-09-13T03:06:02.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:06:01 smithi131 ceph-mon[78839]: from='client.? 172.21.15.89:0/3872246087' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-13T03:06:03.184 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:06:02 smithi131 ceph-mon[78839]: pgmap v321: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:06:03.209 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:06:02 smithi089 ceph-mon[91553]: pgmap v321: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 2.1 KiB/s rd, 4 op/s 2024-09-13T03:06:03.754 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:06:03.739+0000 7f8dae44f640 1 -- 172.21.15.89:0/4143057209 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8da80703c0 msgr2=0x7f8da8108870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:06:03.754 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:06:03.739+0000 7f8dae44f640 1 --2- 172.21.15.89:0/4143057209 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8da80703c0 0x7f8da8108870 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c0048d0 tx=0x7f8d9c009da0 comp rx=0 tx=0).stop 2024-09-13T03:06:03.754 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:06:03.739+0000 7f8dae44f640 1 -- 172.21.15.89:0/4143057209 shutdown_connections 2024-09-13T03:06:03.754 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:06:03.739+0000 7f8dae44f640 1 --2- 172.21.15.89:0/4143057209 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8da80703c0 0x7f8da8108870 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:06:03.754 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:06:03.739+0000 7f8dae44f640 1 --2- 172.21.15.89:0/4143057209 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8da806fab0 0x7f8da806fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:06:03.754 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:06:03.739+0000 7f8dae44f640 1 -- 172.21.15.89:0/4143057209 >> 172.21.15.89:0/4143057209 conn(0x7f8da80f80f0 msgr2=0x7f8da80fa500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:06:03.754 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:06:03.739+0000 7f8dae44f640 1 -- 172.21.15.89:0/4143057209 shutdown_connections 2024-09-13T03:06:03.755 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:06:03.739+0000 7f8dae44f640 1 -- 172.21.15.89:0/4143057209 wait complete. 2024-09-13T03:06:03.755 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:06:03.740+0000 7f8dae44f640 1 Processor -- start 2024-09-13T03:06:03.755 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:06:03.740+0000 7f8dae44f640 1 -- start start 2024-09-13T03:06:03.755 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:06:03.740+0000 7f8dae44f640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8da806fab0 0x7f8da8115560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:06:03.755 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:06:03.740+0000 7f8dae44f640 1 --2- >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8da80703c0 0x7f8da8115aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:06:03.755 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:06:03.740+0000 7f8dae44f640 1 -- --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8da8116180 con 0x7f8da806fab0 2024-09-13T03:06:03.755 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:06:03.740+0000 7f8dae44f640 1 -- --> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8da810f500 con 0x7f8da80703c0 2024-09-13T03:06:03.755 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:06:03.740+0000 7f8da7fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8da806fab0 0x7f8da8115560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:06:03.755 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:06:03.740+0000 7f8da7fff640 1 --2- >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8da806fab0 0x7f8da8115560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.89:3300/0 says I am v2:172.21.15.89:43170/0 (socket says 172.21.15.89:43170) 2024-09-13T03:06:03.755 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:06:03.740+0000 7f8da7fff640 1 -- 172.21.15.89:0/4272768463 learned_addr learned my addr 172.21.15.89:0/4272768463 (peer_addr_for_me v2:172.21.15.89:0/0) 2024-09-13T03:06:03.755 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:06:03.741+0000 7f8da77fe640 1 --2- 172.21.15.89:0/4272768463 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8da80703c0 0x7f8da8115aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:06:03.755 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:06:03.741+0000 7f8da7fff640 1 -- 172.21.15.89:0/4272768463 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8da80703c0 msgr2=0x7f8da8115aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:06:03.756 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:06:03.741+0000 7f8da7fff640 1 --2- 172.21.15.89:0/4272768463 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8da80703c0 0x7f8da8115aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:06:03.756 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:06:03.741+0000 7f8da7fff640 1 -- 172.21.15.89:0/4272768463 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d9c005040 con 0x7f8da806fab0 2024-09-13T03:06:03.756 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:06:03.741+0000 7f8da7fff640 1 --2- 172.21.15.89:0/4272768463 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8da806fab0 0x7f8da8115560 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f8d9800b790 tx=0x7f8d980091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:06:03.756 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:06:03.741+0000 7f8da4ff9640 1 -- 172.21.15.89:0/4272768463 <== mon.0 v2:172.21.15.89:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d9800c700 con 0x7f8da806fab0 2024-09-13T03:06:03.756 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:06:03.741+0000 7f8da4ff9640 1 -- 172.21.15.89:0/4272768463 <== mon.0 v2:172.21.15.89:3300/0 2 ==== config(26 keys) v1 ==== 1070+0+0 (secure 0 0 0) 0x7f8d9800cd00 con 0x7f8da806fab0 2024-09-13T03:06:03.756 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:06:03.741+0000 7f8da4ff9640 1 -- 172.21.15.89:0/4272768463 <== mon.0 v2:172.21.15.89:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8d98015e80 con 0x7f8da806fab0 2024-09-13T03:06:03.756 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:06:03.741+0000 7f8dae44f640 1 -- 172.21.15.89:0/4272768463 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8da810f790 con 0x7f8da806fab0 2024-09-13T03:06:03.756 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:06:03.741+0000 7f8dae44f640 1 -- 172.21.15.89:0/4272768463 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8da810fc30 con 0x7f8da806fab0 2024-09-13T03:06:03.756 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:06:03.742+0000 7f8dae44f640 1 -- 172.21.15.89:0/4272768463 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8da80711f0 con 0x7f8da806fab0 2024-09-13T03:06:03.756 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:06:03.743+0000 7f8da4ff9640 1 -- 172.21.15.89:0/4272768463 <== mon.0 v2:172.21.15.89:3300/0 4 ==== mgrmap(e 38) v1 ==== 92551+0+0 (secure 0 0 0) 0x7f8d98012070 con 0x7f8da806fab0 2024-09-13T03:06:03.756 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:06:03.743+0000 7f8da4ff9640 1 --2- 172.21.15.89:0/4272768463 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f8d9006e530 0x7f8d900709e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-13T03:06:03.756 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:06:03.743+0000 7f8da4ff9640 1 -- 172.21.15.89:0/4272768463 <== mon.0 v2:172.21.15.89:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6582+0+0 (secure 0 0 0) 0x7f8d9808daf0 con 0x7f8da806fab0 2024-09-13T03:06:03.757 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:06:03.743+0000 7f8da77fe640 1 --2- 172.21.15.89:0/4272768463 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f8d9006e530 0x7f8d900709e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-13T03:06:03.757 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:06:03.744+0000 7f8da77fe640 1 --2- 172.21.15.89:0/4272768463 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f8d9006e530 0x7f8d900709e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c009ac0 tx=0x7f8d9c035040 comp rx=0 tx=0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-13T03:06:03.757 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:06:03.748+0000 7f8da4ff9640 1 -- 172.21.15.89:0/4272768463 <== mon.0 v2:172.21.15.89:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+188821 (secure 0 0 0) 0x7f8d98056b80 con 0x7f8da806fab0 2024-09-13T03:06:03.929 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:06:03.927+0000 7f8dae44f640 1 -- 172.21.15.89:0/4272768463 --> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f8da810b800 con 0x7f8da806fab0 2024-09-13T03:06:03.929 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:06:03.928+0000 7f8da4ff9640 1 -- 172.21.15.89:0/4272768463 <== mon.0 v2:172.21.15.89:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 41 entries v82) v1 ==== 81+0+2423 (secure 0 0 0) 0x7f8d9805a240 con 0x7f8da806fab0 2024-09-13T03:06:03.929 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:6829/1561365213 2024-09-14T03:01:37.943546+0000 2024-09-13T03:06:03.930 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:6800/4290496884 2024-09-14T02:56:35.519196+0000 2024-09-13T03:06:03.930 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:0/4056725854 2024-09-14T02:56:35.519196+0000 2024-09-13T03:06:03.930 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:6828/1561365213 2024-09-14T03:01:37.943546+0000 2024-09-13T03:06:03.930 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:0/535522645 2024-09-14T02:56:35.519196+0000 2024-09-13T03:06:03.930 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:0/1637405766 2024-09-14T02:56:35.519196+0000 2024-09-13T03:06:03.930 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:0/2429089058 2024-09-14T02:56:35.519196+0000 2024-09-13T03:06:03.930 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:6801/3169313021 2024-09-14T02:46:58.936239+0000 2024-09-13T03:06:03.930 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:0/1271337803 2024-09-14T02:56:35.519196+0000 2024-09-13T03:06:03.930 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:6800/3169313021 2024-09-14T02:46:58.936239+0000 2024-09-13T03:06:03.930 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:0/1988451185 2024-09-14T02:45:32.668116+0000 2024-09-13T03:06:03.930 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:0/1584789409 2024-09-14T02:54:36.059477+0000 2024-09-13T03:06:03.930 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.131:6829/2180703853 2024-09-14T02:55:56.608187+0000 2024-09-13T03:06:03.931 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:0/541675685 2024-09-14T02:46:00.949227+0000 2024-09-13T03:06:03.931 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.131:6828/2180703853 2024-09-14T02:55:56.608187+0000 2024-09-13T03:06:03.931 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:0/3043630910 2024-09-14T02:46:00.949227+0000 2024-09-13T03:06:03.931 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:6801/3982028315 2024-09-14T02:45:32.668116+0000 2024-09-13T03:06:03.931 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.131:0/1662334780 2024-09-14T02:55:56.608187+0000 2024-09-13T03:06:03.931 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:6801/4290496884 2024-09-14T02:56:35.519196+0000 2024-09-13T03:06:03.931 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:0/3491543082 2024-09-14T02:54:36.059477+0000 2024-09-13T03:06:03.931 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:6801/702640100 2024-09-14T02:46:00.949227+0000 2024-09-13T03:06:03.931 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:0/833000689 2024-09-14T02:46:00.949227+0000 2024-09-13T03:06:03.931 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:6800/3982028315 2024-09-14T02:45:32.668116+0000 2024-09-13T03:06:03.931 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.131:0/2024594656 2024-09-14T02:55:56.608187+0000 2024-09-13T03:06:03.931 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:0/559661592 2024-09-14T02:54:36.059477+0000 2024-09-13T03:06:03.931 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:0/1261668205 2024-09-14T02:45:32.668116+0000 2024-09-13T03:06:03.932 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:6800/1506060926 2024-09-14T02:54:36.059477+0000 2024-09-13T03:06:03.932 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.131:0/1594930192 2024-09-14T02:55:56.608187+0000 2024-09-13T03:06:03.932 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:0/293445085 2024-09-14T02:46:58.936239+0000 2024-09-13T03:06:03.932 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:0/698101816 2024-09-14T02:56:35.519196+0000 2024-09-13T03:06:03.932 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.131:0/523890444 2024-09-14T02:55:56.608187+0000 2024-09-13T03:06:03.932 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:6801/1506060926 2024-09-14T02:54:36.059477+0000 2024-09-13T03:06:03.932 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:0/507534695 2024-09-14T02:45:32.668116+0000 2024-09-13T03:06:03.932 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:0/1545508492 2024-09-14T02:46:58.936239+0000 2024-09-13T03:06:03.932 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.131:0/3248187288 2024-09-14T02:55:56.608187+0000 2024-09-13T03:06:03.932 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:0/4150204320 2024-09-14T02:54:36.059477+0000 2024-09-13T03:06:03.932 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.131:0/3075136182 2024-09-14T02:55:56.608187+0000 2024-09-13T03:06:03.932 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:6826/3243844531 2024-09-14T02:51:58.549400+0000 2024-09-13T03:06:03.932 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:6827/3243844531 2024-09-14T02:51:58.549400+0000 2024-09-13T03:06:03.932 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:0/431063769 2024-09-14T02:46:58.936239+0000 2024-09-13T03:06:03.933 INFO:teuthology.orchestra.run.smithi089.stdout:172.21.15.89:6800/702640100 2024-09-14T02:46:00.949227+0000 2024-09-13T03:06:03.933 INFO:teuthology.orchestra.run.smithi089.stderr:listed 41 entries 2024-09-13T03:06:03.933 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:06:03.930+0000 7f8dae44f640 1 -- 172.21.15.89:0/4272768463 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f8d9006e530 msgr2=0x7f8d900709e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:06:03.933 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:06:03.930+0000 7f8dae44f640 1 --2- 172.21.15.89:0/4272768463 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f8d9006e530 0x7f8d900709e0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8d9c009ac0 tx=0x7f8d9c035040 comp rx=0 tx=0).stop 2024-09-13T03:06:03.934 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:06:03.930+0000 7f8dae44f640 1 -- 172.21.15.89:0/4272768463 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8da806fab0 msgr2=0x7f8da8115560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-13T03:06:03.934 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:06:03.930+0000 7f8dae44f640 1 --2- 172.21.15.89:0/4272768463 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8da806fab0 0x7f8da8115560 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f8d9800b790 tx=0x7f8d980091d0 comp rx=0 tx=0).stop 2024-09-13T03:06:03.934 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:06:03.930+0000 7f8dae44f640 1 -- 172.21.15.89:0/4272768463 shutdown_connections 2024-09-13T03:06:03.934 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:06:03.930+0000 7f8dae44f640 1 --2- 172.21.15.89:0/4272768463 >> [v2:172.21.15.89:6800/1881577856,v1:172.21.15.89:6801/1881577856] conn(0x7f8d9006e530 0x7f8d900709e0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:06:03.934 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:06:03.930+0000 7f8dae44f640 1 --2- 172.21.15.89:0/4272768463 >> [v2:172.21.15.131:3300/0,v1:172.21.15.131:6789/0] conn(0x7f8da80703c0 0x7f8da8115aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:06:03.934 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:06:03.930+0000 7f8dae44f640 1 --2- 172.21.15.89:0/4272768463 >> [v2:172.21.15.89:3300/0,v1:172.21.15.89:6789/0] conn(0x7f8da806fab0 0x7f8da8115560 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-13T03:06:03.934 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:06:03.930+0000 7f8dae44f640 1 -- 172.21.15.89:0/4272768463 >> 172.21.15.89:0/4272768463 conn(0x7f8da80f80f0 msgr2=0x7f8da80f9610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-13T03:06:03.934 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:06:03.930+0000 7f8dae44f640 1 -- 172.21.15.89:0/4272768463 shutdown_connections 2024-09-13T03:06:03.934 INFO:teuthology.orchestra.run.smithi089.stderr:2024-09-13T03:06:03.930+0000 7f8dae44f640 1 -- 172.21.15.89:0/4272768463 wait complete. 2024-09-13T03:06:04.573 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2024-09-13T03:06:04.573 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T03:06:04.574 DEBUG:teuthology.orchestra.run.smithi131:> sudo umount /home/ubuntu/cephtest/mnt.1 2024-09-13T03:06:04.608 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi131.front.sepia.ceph.com 2024-09-13T03:06:04.608 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T03:06:04.608 DEBUG:teuthology.orchestra.run.smithi131:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-13T03:06:04.683 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T03:06:04.683 DEBUG:teuthology.orchestra.run.smithi089:> ip netns list 2024-09-13T03:06:04.699 INFO:teuthology.orchestra.run.smithi089.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-13T03:06:04.699 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T03:06:04.700 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-13T03:06:04.766 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T03:06:04.766 DEBUG:teuthology.orchestra.run.smithi089:> sudo ip link delete ceph-brx 2024-09-13T03:06:04.863 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T03:06:04.863 DEBUG:teuthology.orchestra.run.smithi131:> ip netns list 2024-09-13T03:06:04.884 INFO:teuthology.orchestra.run.smithi131.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-13T03:06:04.884 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T03:06:04.884 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-13T03:06:04.956 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-13T03:06:04.956 DEBUG:teuthology.orchestra.run.smithi131:> sudo ip link delete ceph-brx 2024-09-13T03:06:05.063 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-13T03:06:05.073 INFO:tasks.cephadm:Teardown begin 2024-09-13T03:06:05.074 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-13T03:06:05.097 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:06:04 smithi089 ceph-mon[91553]: pgmap v322: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T03:06:05.097 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:06:04 smithi089 ceph-mon[91553]: from='client.? 172.21.15.89:0/4272768463' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-13T03:06:05.100 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-13T03:06:05.124 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:06:04 smithi131 ceph-mon[78839]: pgmap v322: 65 pgs: 65 active+clean; 178 MiB data, 807 MiB used, 536 GiB / 536 GiB avail; 1.7 KiB/s rd, 3 op/s 2024-09-13T03:06:05.125 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:06:04 smithi131 ceph-mon[78839]: from='client.? 172.21.15.89:0/4272768463' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-13T03:06:05.129 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-13T03:06:05.129 DEBUG:teuthology.orchestra.run.smithi089:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-13T03:06:05.156 DEBUG:teuthology.orchestra.run.smithi131:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-13T03:06:05.185 INFO:tasks.cephadm:Stopping all daemons... 2024-09-13T03:06:05.185 INFO:tasks.cephadm.mon.smithi089:Stopping mon.smithi089... 2024-09-13T03:06:05.185 DEBUG:teuthology.orchestra.run.smithi089:> sudo systemctl stop ceph-12cdb164-717a-11ef-bceb-c7b262605968@mon.smithi089 2024-09-13T03:06:05.505 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:06:05 smithi089 systemd[1]: Stopping Ceph mon.smithi089 for 12cdb164-717a-11ef-bceb-c7b262605968... 2024-09-13T03:06:05.760 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:06:05 smithi089 ceph-12cdb164-717a-11ef-bceb-c7b262605968-mon-smithi089[91549]: 2024-09-13T03:06:05.503+0000 7f8d9d7a2640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi089 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T03:06:05.760 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:06:05 smithi089 ceph-12cdb164-717a-11ef-bceb-c7b262605968-mon-smithi089[91549]: 2024-09-13T03:06:05.504+0000 7f8d9d7a2640 -1 mon.smithi089@0(leader) e3 *** Got Signal Terminated *** 2024-09-13T03:06:06.035 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:06:05 smithi089 podman[136380]: 2024-09-13 03:06:05.759588594 +0000 UTC m=+0.373438708 container died 8a29fb65028ffa278e3b6a3671fa8e0db870691b89be174d6ed87e62cc0c273b (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-mon-smithi089, RELEASE=squid-7741f7f, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, CEPH_POINT_RELEASE=) 2024-09-13T03:06:06.381 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:06:06 smithi089 podman[136380]: 2024-09-13 03:06:06.138094527 +0000 UTC m=+0.751944597 container cleanup 8a29fb65028ffa278e3b6a3671fa8e0db870691b89be174d6ed87e62cc0c273b (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-mon-smithi089, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-7741f7f, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=) 2024-09-13T03:06:06.381 INFO:journalctl@ceph.mon.smithi089.smithi089.stdout:Sep 13 03:06:06 smithi089 bash[136380]: ceph-12cdb164-717a-11ef-bceb-c7b262605968-mon-smithi089 2024-09-13T03:06:06.527 DEBUG:teuthology.orchestra.run.smithi089:> sudo pkill -f 'journalctl -f -n 0 -u ceph-12cdb164-717a-11ef-bceb-c7b262605968@mon.smithi089.service' 2024-09-13T03:06:06.574 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T03:06:06.575 INFO:tasks.cephadm.mon.smithi089:Stopped mon.smithi089 2024-09-13T03:06:06.575 INFO:tasks.cephadm.mon.smithi131:Stopping mon.smithi131... 2024-09-13T03:06:06.575 DEBUG:teuthology.orchestra.run.smithi131:> sudo systemctl stop ceph-12cdb164-717a-11ef-bceb-c7b262605968@mon.smithi131 2024-09-13T03:06:06.934 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:06:06 smithi131 systemd[1]: Stopping Ceph mon.smithi131 for 12cdb164-717a-11ef-bceb-c7b262605968... 2024-09-13T03:06:07.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:06:07 smithi131 ceph-12cdb164-717a-11ef-bceb-c7b262605968-mon-smithi131[78835]: 2024-09-13T03:06:07.052+0000 7f1b03169640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi131 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T03:06:07.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:06:07 smithi131 ceph-12cdb164-717a-11ef-bceb-c7b262605968-mon-smithi131[78835]: 2024-09-13T03:06:07.052+0000 7f1b03169640 -1 mon.smithi131@1(peon) e3 *** Got Signal Terminated *** 2024-09-13T03:06:07.434 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:06:07 smithi131 podman[112133]: 2024-09-13 03:06:07.226237065 +0000 UTC m=+0.428427307 container died 506310ad86204c45c4619d6903672a4bfe0a284455a3c7e55361345d837d7042 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-mon-smithi131, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, RELEASE=squid-7741f7f, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T03:06:07.973 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:06:07 smithi131 podman[112133]: 2024-09-13 03:06:07.69579571 +0000 UTC m=+0.897985993 container cleanup 506310ad86204c45c4619d6903672a4bfe0a284455a3c7e55361345d837d7042 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-mon-smithi131, ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-7741f7f, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0) 2024-09-13T03:06:07.974 INFO:journalctl@ceph.mon.smithi131.smithi131.stdout:Sep 13 03:06:07 smithi131 bash[112133]: ceph-12cdb164-717a-11ef-bceb-c7b262605968-mon-smithi131 2024-09-13T03:06:08.105 DEBUG:teuthology.orchestra.run.smithi131:> sudo pkill -f 'journalctl -f -n 0 -u ceph-12cdb164-717a-11ef-bceb-c7b262605968@mon.smithi131.service' 2024-09-13T03:06:08.152 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T03:06:08.152 INFO:tasks.cephadm.mon.smithi131:Stopped mon.smithi131 2024-09-13T03:06:08.153 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-13T03:06:08.153 DEBUG:teuthology.orchestra.run.smithi089:> sudo systemctl stop ceph-12cdb164-717a-11ef-bceb-c7b262605968@osd.0 2024-09-13T03:06:08.460 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 03:06:08 smithi089 systemd[1]: Stopping Ceph osd.0 for 12cdb164-717a-11ef-bceb-c7b262605968... 2024-09-13T03:06:08.785 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 03:06:08 smithi089 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-0[99786]: 2024-09-13T03:06:08.458+0000 7f7c9abee640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T03:06:08.785 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 03:06:08 smithi089 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-0[99786]: 2024-09-13T03:06:08.458+0000 7f7c9abee640 -1 osd.0 82 *** Got signal Terminated *** 2024-09-13T03:06:08.785 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 03:06:08 smithi089 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-0[99786]: 2024-09-13T03:06:08.458+0000 7f7c9abee640 -1 osd.0 82 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T03:06:14.202 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 03:06:13 smithi089 podman[136514]: 2024-09-13 03:06:13.930787741 +0000 UTC m=+5.589426626 container died e8038f6d52b6a1b1ec33a5b4abe9fff27c7333012e3d4fd6f522e1ef0f185a87 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-0, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, RELEASE=squid-7741f7f, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-13T03:06:14.535 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 03:06:14 smithi089 podman[136514]: 2024-09-13 03:06:14.283325533 +0000 UTC m=+5.941964418 container cleanup e8038f6d52b6a1b1ec33a5b4abe9fff27c7333012e3d4fd6f522e1ef0f185a87 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-0, io.buildah.version=1.37.2, RELEASE=squid-7741f7f, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T03:06:14.535 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 03:06:14 smithi089 bash[136514]: ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-0 2024-09-13T03:06:14.904 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 03:06:14 smithi089 podman[136531]: 2024-09-13 03:06:14.593329318 +0000 UTC m=+0.662239043 container remove e8038f6d52b6a1b1ec33a5b4abe9fff27c7333012e3d4fd6f522e1ef0f185a87 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-0, RELEASE=squid-7741f7f, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-09-13T03:06:15.160 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 03:06:14 smithi089 podman[136620]: 2024-09-13 03:06:14.851851586 +0000 UTC m=+0.016177349 image pull 19dc8d6597273a47b0b4862f1d0e037b0157b908a02acd63baceec3ee94fbd6c quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d 2024-09-13T03:06:15.160 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 03:06:15 smithi089 podman[136620]: 2024-09-13 03:06:15.01926399 +0000 UTC m=+0.183589744 container create 442d8fa785599f4a4a45edb0767f01035b13adcb56ab561e8922c17dde1c1536 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-0-deactivate, RELEASE=squid-7741f7f, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T03:06:15.462 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 03:06:15 smithi089 podman[136620]: 2024-09-13 03:06:15.263693167 +0000 UTC m=+0.428018921 container init 442d8fa785599f4a4a45edb0767f01035b13adcb56ab561e8922c17dde1c1536 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-0-deactivate, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-7741f7f, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0) 2024-09-13T03:06:15.462 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 03:06:15 smithi089 podman[136620]: 2024-09-13 03:06:15.266905716 +0000 UTC m=+0.431231472 container start 442d8fa785599f4a4a45edb0767f01035b13adcb56ab561e8922c17dde1c1536 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=squid-7741f7f, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , ceph=True) 2024-09-13T03:06:15.462 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 03:06:15 smithi089 podman[136620]: 2024-09-13 03:06:15.363564463 +0000 UTC m=+0.527890236 container attach 442d8fa785599f4a4a45edb0767f01035b13adcb56ab561e8922c17dde1c1536 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-0-deactivate, RELEASE=squid-7741f7f, GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD) 2024-09-13T03:06:15.785 INFO:journalctl@ceph.osd.0.smithi089.stdout:Sep 13 03:06:15 smithi089 podman[136620]: 2024-09-13 03:06:15.46207535 +0000 UTC m=+0.626401117 container died 442d8fa785599f4a4a45edb0767f01035b13adcb56ab561e8922c17dde1c1536 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-7741f7f, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux ) 2024-09-13T03:06:16.133 DEBUG:teuthology.orchestra.run.smithi089:> sudo pkill -f 'journalctl -f -n 0 -u ceph-12cdb164-717a-11ef-bceb-c7b262605968@osd.0.service' 2024-09-13T03:06:16.175 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T03:06:16.175 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-13T03:06:16.175 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-13T03:06:16.176 DEBUG:teuthology.orchestra.run.smithi089:> sudo systemctl stop ceph-12cdb164-717a-11ef-bceb-c7b262605968@osd.1 2024-09-13T03:06:16.388 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 03:06:16 smithi089 systemd[1]: Stopping Ceph osd.1 for 12cdb164-717a-11ef-bceb-c7b262605968... 2024-09-13T03:06:16.785 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 03:06:16 smithi089 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-1[105133]: 2024-09-13T03:06:16.495+0000 7f3fbde66640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T03:06:16.785 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 03:06:16 smithi089 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-1[105133]: 2024-09-13T03:06:16.495+0000 7f3fbde66640 -1 osd.1 82 *** Got signal Terminated *** 2024-09-13T03:06:16.785 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 03:06:16 smithi089 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-1[105133]: 2024-09-13T03:06:16.495+0000 7f3fbde66640 -1 osd.1 82 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T03:06:22.298 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 03:06:22 smithi089 podman[136723]: 2024-09-13 03:06:22.040591771 +0000 UTC m=+5.639878475 container died e174144d9633cbada52f87617925c09773941c4bedf8e297fee80a37c48021a7 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-1, io.buildah.version=1.37.2, RELEASE=squid-7741f7f, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2) 2024-09-13T03:06:22.690 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 03:06:22 smithi089 podman[136723]: 2024-09-13 03:06:22.479273036 +0000 UTC m=+6.078559773 container cleanup e174144d9633cbada52f87617925c09773941c4bedf8e297fee80a37c48021a7 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-1, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-7741f7f, org.label-schema.vendor=CentOS) 2024-09-13T03:06:22.690 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 03:06:22 smithi089 bash[136723]: ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-1 2024-09-13T03:06:23.035 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 03:06:22 smithi089 podman[136749]: 2024-09-13 03:06:22.689351234 +0000 UTC m=+0.641898036 container remove e174144d9633cbada52f87617925c09773941c4bedf8e297fee80a37c48021a7 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-1, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=squid-7741f7f, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-13T03:06:23.346 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 03:06:23 smithi089 podman[136838]: 2024-09-13 03:06:22.997752583 +0000 UTC m=+0.015536393 image pull 19dc8d6597273a47b0b4862f1d0e037b0157b908a02acd63baceec3ee94fbd6c quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d 2024-09-13T03:06:23.346 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 03:06:23 smithi089 podman[136838]: 2024-09-13 03:06:23.106909318 +0000 UTC m=+0.124693113 container create 67b7aa26e970efc1b2af331d2f90f9c245fa371d1ac9a746e46538e23e61fb62 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-1-deactivate, RELEASE=squid-7741f7f, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-13T03:06:23.346 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 03:06:23 smithi089 podman[136838]: 2024-09-13 03:06:23.342585646 +0000 UTC m=+0.360369440 container init 67b7aa26e970efc1b2af331d2f90f9c245fa371d1ac9a746e46538e23e61fb62 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=squid-7741f7f, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T03:06:23.346 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 03:06:23 smithi089 podman[136838]: 2024-09-13 03:06:23.345818904 +0000 UTC m=+0.363602709 container start 67b7aa26e970efc1b2af331d2f90f9c245fa371d1ac9a746e46538e23e61fb62 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_BRANCH=HEAD, RELEASE=squid-7741f7f, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T03:06:23.785 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 03:06:23 smithi089 podman[136838]: 2024-09-13 03:06:23.45102933 +0000 UTC m=+0.468813132 container attach 67b7aa26e970efc1b2af331d2f90f9c245fa371d1ac9a746e46538e23e61fb62 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=squid-7741f7f, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-13T03:06:23.785 INFO:journalctl@ceph.osd.1.smithi089.stdout:Sep 13 03:06:23 smithi089 podman[136838]: 2024-09-13 03:06:23.540163404 +0000 UTC m=+0.557947208 container died 67b7aa26e970efc1b2af331d2f90f9c245fa371d1ac9a746e46538e23e61fb62 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-7741f7f, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-13T03:06:24.139 DEBUG:teuthology.orchestra.run.smithi089:> sudo pkill -f 'journalctl -f -n 0 -u ceph-12cdb164-717a-11ef-bceb-c7b262605968@osd.1.service' 2024-09-13T03:06:24.179 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T03:06:24.179 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-13T03:06:24.179 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-13T03:06:24.179 DEBUG:teuthology.orchestra.run.smithi089:> sudo systemctl stop ceph-12cdb164-717a-11ef-bceb-c7b262605968@osd.2 2024-09-13T03:06:24.517 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 03:06:24 smithi089 systemd[1]: Stopping Ceph osd.2 for 12cdb164-717a-11ef-bceb-c7b262605968... 2024-09-13T03:06:24.785 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 03:06:24 smithi089 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-2[110777]: 2024-09-13T03:06:24.515+0000 7f9471fc8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T03:06:24.785 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 03:06:24 smithi089 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-2[110777]: 2024-09-13T03:06:24.515+0000 7f9471fc8640 -1 osd.2 82 *** Got signal Terminated *** 2024-09-13T03:06:24.785 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 03:06:24 smithi089 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-2[110777]: 2024-09-13T03:06:24.515+0000 7f9471fc8640 -1 osd.2 82 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T03:06:30.160 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 03:06:29 smithi089 podman[136941]: 2024-09-13 03:06:29.887214396 +0000 UTC m=+5.486369663 container died 2d8cab08c2b3f3d62b780c9307168b9e877136751fa454307ace42a2affdf478 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-7741f7f, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T03:06:30.535 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 03:06:30 smithi089 podman[136941]: 2024-09-13 03:06:30.349388257 +0000 UTC m=+5.948543585 container cleanup 2d8cab08c2b3f3d62b780c9307168b9e877136751fa454307ace42a2affdf478 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-2, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-7741f7f, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T03:06:30.535 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 03:06:30 smithi089 bash[136941]: ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-2 2024-09-13T03:06:30.945 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 03:06:30 smithi089 podman[136956]: 2024-09-13 03:06:30.609252287 +0000 UTC m=+0.724919346 container remove 2d8cab08c2b3f3d62b780c9307168b9e877136751fa454307ace42a2affdf478 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-7741f7f, GIT_CLEAN=True, ceph=True) 2024-09-13T03:06:31.196 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 03:06:30 smithi089 podman[137048]: 2024-09-13 03:06:30.847562543 +0000 UTC m=+0.016198591 image pull 19dc8d6597273a47b0b4862f1d0e037b0157b908a02acd63baceec3ee94fbd6c quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d 2024-09-13T03:06:31.197 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 03:06:30 smithi089 podman[137048]: 2024-09-13 03:06:30.960158986 +0000 UTC m=+0.128795029 container create 1d886794c332076700dc168b3ccd427fc3e7719a036fe313f1d651520346daa8 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=squid-7741f7f, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD) 2024-09-13T03:06:31.197 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 03:06:31 smithi089 podman[137048]: 2024-09-13 03:06:31.196150869 +0000 UTC m=+0.364786921 container init 1d886794c332076700dc168b3ccd427fc3e7719a036fe313f1d651520346daa8 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-7741f7f, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=) 2024-09-13T03:06:31.535 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 03:06:31 smithi089 podman[137048]: 2024-09-13 03:06:31.1995053 +0000 UTC m=+0.368141345 container start 1d886794c332076700dc168b3ccd427fc3e7719a036fe313f1d651520346daa8 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, RELEASE=squid-7741f7f, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-13T03:06:31.535 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 03:06:31 smithi089 podman[137048]: 2024-09-13 03:06:31.27927907 +0000 UTC m=+0.447915113 container attach 1d886794c332076700dc168b3ccd427fc3e7719a036fe313f1d651520346daa8 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=squid-7741f7f, GIT_BRANCH=HEAD) 2024-09-13T03:06:31.535 INFO:journalctl@ceph.osd.2.smithi089.stdout:Sep 13 03:06:31 smithi089 podman[137048]: 2024-09-13 03:06:31.384507173 +0000 UTC m=+0.553143216 container died 1d886794c332076700dc168b3ccd427fc3e7719a036fe313f1d651520346daa8 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=squid-7741f7f, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T03:06:32.111 DEBUG:teuthology.orchestra.run.smithi089:> sudo pkill -f 'journalctl -f -n 0 -u ceph-12cdb164-717a-11ef-bceb-c7b262605968@osd.2.service' 2024-09-13T03:06:32.151 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T03:06:32.151 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-13T03:06:32.151 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-13T03:06:32.151 DEBUG:teuthology.orchestra.run.smithi131:> sudo systemctl stop ceph-12cdb164-717a-11ef-bceb-c7b262605968@osd.3 2024-09-13T03:06:32.434 INFO:journalctl@ceph.osd.3.smithi131.stdout:Sep 13 03:06:32 smithi131 systemd[1]: Stopping Ceph osd.3 for 12cdb164-717a-11ef-bceb-c7b262605968... 2024-09-13T03:06:32.934 INFO:journalctl@ceph.osd.3.smithi131.stdout:Sep 13 03:06:32 smithi131 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-3[88212]: 2024-09-13T03:06:32.456+0000 7f3dc2b7d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T03:06:32.934 INFO:journalctl@ceph.osd.3.smithi131.stdout:Sep 13 03:06:32 smithi131 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-3[88212]: 2024-09-13T03:06:32.456+0000 7f3dc2b7d640 -1 osd.3 82 *** Got signal Terminated *** 2024-09-13T03:06:32.934 INFO:journalctl@ceph.osd.3.smithi131.stdout:Sep 13 03:06:32 smithi131 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-3[88212]: 2024-09-13T03:06:32.456+0000 7f3dc2b7d640 -1 osd.3 82 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T03:06:35.684 INFO:journalctl@ceph.osd.3.smithi131.stdout:Sep 13 03:06:35 smithi131 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-3[88212]: 2024-09-13T03:06:35.307+0000 7f3dbb17a640 -1 osd.3 82 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-13T03:06:11.029333+0000 front 2024-09-13T03:06:11.029368+0000 (oldest deadline 2024-09-13T03:06:34.529155+0000) 2024-09-13T03:06:36.684 INFO:journalctl@ceph.osd.3.smithi131.stdout:Sep 13 03:06:36 smithi131 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-3[88212]: 2024-09-13T03:06:36.315+0000 7f3dbb17a640 -1 osd.3 82 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-13T03:06:11.029333+0000 front 2024-09-13T03:06:11.029368+0000 (oldest deadline 2024-09-13T03:06:34.529155+0000) 2024-09-13T03:06:37.684 INFO:journalctl@ceph.osd.3.smithi131.stdout:Sep 13 03:06:37 smithi131 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-3[88212]: 2024-09-13T03:06:37.320+0000 7f3dbb17a640 -1 osd.3 82 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-13T03:06:11.029333+0000 front 2024-09-13T03:06:11.029368+0000 (oldest deadline 2024-09-13T03:06:34.529155+0000) 2024-09-13T03:06:38.184 INFO:journalctl@ceph.osd.3.smithi131.stdout:Sep 13 03:06:38 smithi131 podman[112260]: 2024-09-13 03:06:38.020231997 +0000 UTC m=+5.672467561 container died e77cff6248696cd631f551696c190b3b5ad28a5a22e37c666bc7654902e05995 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-3, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-7741f7f, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-13T03:06:38.184 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 13 03:06:37 smithi131 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-4[93514]: 2024-09-13T03:06:37.804+0000 7efeab41e640 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-13T03:06:09.754019+0000 front 2024-09-13T03:06:09.753913+0000 (oldest deadline 2024-09-13T03:06:37.354064+0000) 2024-09-13T03:06:38.185 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 03:06:38 smithi131 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-5[98656]: 2024-09-13T03:06:38.041+0000 7f05eeb95640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-13T03:06:12.542996+0000 front 2024-09-13T03:06:12.543043+0000 (oldest deadline 2024-09-13T03:06:37.242963+0000) 2024-09-13T03:06:38.643 INFO:journalctl@ceph.osd.3.smithi131.stdout:Sep 13 03:06:38 smithi131 podman[112260]: 2024-09-13 03:06:38.415807374 +0000 UTC m=+6.068042939 container cleanup e77cff6248696cd631f551696c190b3b5ad28a5a22e37c666bc7654902e05995 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-3, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-7741f7f, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-13T03:06:38.643 INFO:journalctl@ceph.osd.3.smithi131.stdout:Sep 13 03:06:38 smithi131 bash[112260]: ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-3 2024-09-13T03:06:38.934 INFO:journalctl@ceph.osd.3.smithi131.stdout:Sep 13 03:06:38 smithi131 podman[112276]: 2024-09-13 03:06:38.642501193 +0000 UTC m=+0.619939194 container remove e77cff6248696cd631f551696c190b3b5ad28a5a22e37c666bc7654902e05995 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-3, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-7741f7f, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-13T03:06:38.934 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 13 03:06:38 smithi131 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-4[93514]: 2024-09-13T03:06:38.803+0000 7efeab41e640 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-13T03:06:09.754019+0000 front 2024-09-13T03:06:09.753913+0000 (oldest deadline 2024-09-13T03:06:37.354064+0000) 2024-09-13T03:06:39.280 INFO:journalctl@ceph.osd.3.smithi131.stdout:Sep 13 03:06:38 smithi131 podman[112366]: 2024-09-13 03:06:38.866879608 +0000 UTC m=+0.015835284 image pull 19dc8d6597273a47b0b4862f1d0e037b0157b908a02acd63baceec3ee94fbd6c quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d 2024-09-13T03:06:39.280 INFO:journalctl@ceph.osd.3.smithi131.stdout:Sep 13 03:06:38 smithi131 podman[112366]: 2024-09-13 03:06:38.985164654 +0000 UTC m=+0.134120325 container create ba6d29e49b07b9d93e8b783dba8223e2012b9e7dd8052834bf4d1e251a538710 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-3-deactivate, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=squid-7741f7f, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-13T03:06:39.280 INFO:journalctl@ceph.osd.3.smithi131.stdout:Sep 13 03:06:39 smithi131 podman[112366]: 2024-09-13 03:06:39.196039599 +0000 UTC m=+0.344995269 container init ba6d29e49b07b9d93e8b783dba8223e2012b9e7dd8052834bf4d1e251a538710 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-7741f7f, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T03:06:39.281 INFO:journalctl@ceph.osd.3.smithi131.stdout:Sep 13 03:06:39 smithi131 podman[112366]: 2024-09-13 03:06:39.199278083 +0000 UTC m=+0.348233761 container start ba6d29e49b07b9d93e8b783dba8223e2012b9e7dd8052834bf4d1e251a538710 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-7741f7f, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-13T03:06:39.281 INFO:journalctl@ceph.osd.3.smithi131.stdout:Sep 13 03:06:39 smithi131 podman[112366]: 2024-09-13 03:06:39.279473089 +0000 UTC m=+0.428428767 container attach ba6d29e49b07b9d93e8b783dba8223e2012b9e7dd8052834bf4d1e251a538710 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-3-deactivate, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-7741f7f, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS) 2024-09-13T03:06:39.281 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 03:06:39 smithi131 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-5[98656]: 2024-09-13T03:06:39.004+0000 7f05eeb95640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-13T03:06:12.542996+0000 front 2024-09-13T03:06:12.543043+0000 (oldest deadline 2024-09-13T03:06:37.242963+0000) 2024-09-13T03:06:39.684 INFO:journalctl@ceph.osd.3.smithi131.stdout:Sep 13 03:06:39 smithi131 podman[112366]: 2024-09-13 03:06:39.389146377 +0000 UTC m=+0.538102049 container died ba6d29e49b07b9d93e8b783dba8223e2012b9e7dd8052834bf4d1e251a538710 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-7741f7f, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T03:06:39.981 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 13 03:06:39 smithi131 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-4[93514]: 2024-09-13T03:06:39.762+0000 7efeab41e640 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-13T03:06:09.754019+0000 front 2024-09-13T03:06:09.753913+0000 (oldest deadline 2024-09-13T03:06:37.354064+0000) 2024-09-13T03:06:39.982 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 03:06:39 smithi131 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-5[98656]: 2024-09-13T03:06:39.965+0000 7f05eeb95640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-13T03:06:12.542996+0000 front 2024-09-13T03:06:12.543043+0000 (oldest deadline 2024-09-13T03:06:37.242963+0000) 2024-09-13T03:06:39.982 INFO:journalctl@ceph.osd.3.smithi131.stdout:Sep 13 03:06:39 smithi131 podman[112390]: 2024-09-13 03:06:39.966953903 +0000 UTC m=+0.568077764 container remove ba6d29e49b07b9d93e8b783dba8223e2012b9e7dd8052834bf4d1e251a538710 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, RELEASE=squid-7741f7f) 2024-09-13T03:06:39.986 DEBUG:teuthology.orchestra.run.smithi131:> sudo pkill -f 'journalctl -f -n 0 -u ceph-12cdb164-717a-11ef-bceb-c7b262605968@osd.3.service' 2024-09-13T03:06:40.024 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T03:06:40.024 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-13T03:06:40.025 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-13T03:06:40.025 DEBUG:teuthology.orchestra.run.smithi131:> sudo systemctl stop ceph-12cdb164-717a-11ef-bceb-c7b262605968@osd.4 2024-09-13T03:06:40.338 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 13 03:06:40 smithi131 systemd[1]: Stopping Ceph osd.4 for 12cdb164-717a-11ef-bceb-c7b262605968... 2024-09-13T03:06:40.338 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 13 03:06:40 smithi131 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-4[93514]: 2024-09-13T03:06:40.336+0000 7efeaee19640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T03:06:40.338 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 13 03:06:40 smithi131 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-4[93514]: 2024-09-13T03:06:40.336+0000 7efeaee19640 -1 osd.4 82 *** Got signal Terminated *** 2024-09-13T03:06:40.338 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 13 03:06:40 smithi131 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-4[93514]: 2024-09-13T03:06:40.336+0000 7efeaee19640 -1 osd.4 82 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T03:06:41.184 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 13 03:06:40 smithi131 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-4[93514]: 2024-09-13T03:06:40.802+0000 7efeab41e640 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-13T03:06:09.754019+0000 front 2024-09-13T03:06:09.753913+0000 (oldest deadline 2024-09-13T03:06:37.354064+0000) 2024-09-13T03:06:41.184 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 03:06:40 smithi131 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-5[98656]: 2024-09-13T03:06:40.981+0000 7f05eeb95640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-13T03:06:12.542996+0000 front 2024-09-13T03:06:12.543043+0000 (oldest deadline 2024-09-13T03:06:37.242963+0000) 2024-09-13T03:06:42.184 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 13 03:06:41 smithi131 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-4[93514]: 2024-09-13T03:06:41.765+0000 7efeab41e640 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-13T03:06:09.754019+0000 front 2024-09-13T03:06:09.753913+0000 (oldest deadline 2024-09-13T03:06:37.354064+0000) 2024-09-13T03:06:42.184 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 03:06:41 smithi131 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-5[98656]: 2024-09-13T03:06:41.953+0000 7f05eeb95640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-13T03:06:12.542996+0000 front 2024-09-13T03:06:12.543043+0000 (oldest deadline 2024-09-13T03:06:37.242963+0000) 2024-09-13T03:06:43.184 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 13 03:06:42 smithi131 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-4[93514]: 2024-09-13T03:06:42.786+0000 7efeab41e640 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-13T03:06:09.754019+0000 front 2024-09-13T03:06:09.753913+0000 (oldest deadline 2024-09-13T03:06:37.354064+0000) 2024-09-13T03:06:43.184 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 03:06:42 smithi131 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-5[98656]: 2024-09-13T03:06:42.936+0000 7f05eeb95640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-13T03:06:12.542996+0000 front 2024-09-13T03:06:12.543043+0000 (oldest deadline 2024-09-13T03:06:37.242963+0000) 2024-09-13T03:06:44.184 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 13 03:06:43 smithi131 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-4[93514]: 2024-09-13T03:06:43.822+0000 7efeab41e640 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-13T03:06:09.754019+0000 front 2024-09-13T03:06:09.753913+0000 (oldest deadline 2024-09-13T03:06:37.354064+0000) 2024-09-13T03:06:44.184 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 03:06:43 smithi131 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-5[98656]: 2024-09-13T03:06:43.925+0000 7f05eeb95640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-13T03:06:12.542996+0000 front 2024-09-13T03:06:12.543043+0000 (oldest deadline 2024-09-13T03:06:37.242963+0000) 2024-09-13T03:06:45.085 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 13 03:06:44 smithi131 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-4[93514]: 2024-09-13T03:06:44.801+0000 7efeab41e640 -1 osd.4 82 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-13T03:06:09.754019+0000 front 2024-09-13T03:06:09.753913+0000 (oldest deadline 2024-09-13T03:06:37.354064+0000) 2024-09-13T03:06:45.085 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 03:06:44 smithi131 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-5[98656]: 2024-09-13T03:06:44.971+0000 7f05eeb95640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-13T03:06:12.542996+0000 front 2024-09-13T03:06:12.543043+0000 (oldest deadline 2024-09-13T03:06:37.242963+0000) 2024-09-13T03:06:46.055 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 13 03:06:45 smithi131 podman[112469]: 2024-09-13 03:06:45.787270188 +0000 UTC m=+5.540629583 container died 0317e6a4a04c9e7adc3f2b7f1ba69c3b34d4248213783c2db5cab6d3d708e377 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-4, ceph=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-7741f7f, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-09-13T03:06:46.056 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 03:06:45 smithi131 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-5[98656]: 2024-09-13T03:06:45.936+0000 7f05eeb95640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-13T03:06:12.542996+0000 front 2024-09-13T03:06:12.543043+0000 (oldest deadline 2024-09-13T03:06:37.242963+0000) 2024-09-13T03:06:46.414 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 13 03:06:46 smithi131 podman[112469]: 2024-09-13 03:06:46.153539602 +0000 UTC m=+5.906898995 container cleanup 0317e6a4a04c9e7adc3f2b7f1ba69c3b34d4248213783c2db5cab6d3d708e377 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-4, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=squid-7741f7f, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-09-13T03:06:46.414 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 13 03:06:46 smithi131 bash[112469]: ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-4 2024-09-13T03:06:46.684 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 13 03:06:46 smithi131 podman[112486]: 2024-09-13 03:06:46.41336755 +0000 UTC m=+0.622796551 container remove 0317e6a4a04c9e7adc3f2b7f1ba69c3b34d4248213783c2db5cab6d3d708e377 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-4, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=squid-7741f7f) 2024-09-13T03:06:47.059 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 03:06:46 smithi131 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-5[98656]: 2024-09-13T03:06:46.985+0000 7f05eeb95640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-13T03:06:12.542996+0000 front 2024-09-13T03:06:12.543043+0000 (oldest deadline 2024-09-13T03:06:37.242963+0000) 2024-09-13T03:06:47.059 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 03:06:46 smithi131 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-5[98656]: 2024-09-13T03:06:46.985+0000 7f05eeb95640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.89:6814 osd.1 since back 2024-09-13T03:06:17.243482+0000 front 2024-09-13T03:06:17.243494+0000 (oldest deadline 2024-09-13T03:06:46.643759+0000) 2024-09-13T03:06:47.060 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 13 03:06:46 smithi131 podman[112581]: 2024-09-13 03:06:46.654579933 +0000 UTC m=+0.016065542 image pull 19dc8d6597273a47b0b4862f1d0e037b0157b908a02acd63baceec3ee94fbd6c quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d 2024-09-13T03:06:47.060 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 13 03:06:46 smithi131 podman[112581]: 2024-09-13 03:06:46.772764857 +0000 UTC m=+0.134250466 container create 69b7dffed02ec9000d0c1ea6ed2a662162adfc8ce2974851f17bca39a30ea5c2 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-7741f7f, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-09-13T03:06:47.060 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 13 03:06:46 smithi131 podman[112581]: 2024-09-13 03:06:46.967070467 +0000 UTC m=+0.328556091 container init 69b7dffed02ec9000d0c1ea6ed2a662162adfc8ce2974851f17bca39a30ea5c2 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-7741f7f, org.label-schema.build-date=20240731, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-09-13T03:06:47.060 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 13 03:06:46 smithi131 podman[112581]: 2024-09-13 03:06:46.970296263 +0000 UTC m=+0.331781879 container start 69b7dffed02ec9000d0c1ea6ed2a662162adfc8ce2974851f17bca39a30ea5c2 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.build-date=20240731, RELEASE=squid-7741f7f, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T03:06:47.060 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 13 03:06:47 smithi131 podman[112581]: 2024-09-13 03:06:47.058857068 +0000 UTC m=+0.420342677 container attach 69b7dffed02ec9000d0c1ea6ed2a662162adfc8ce2974851f17bca39a30ea5c2 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-7741f7f, ceph=True, CEPH_POINT_RELEASE=) 2024-09-13T03:06:47.434 INFO:journalctl@ceph.osd.4.smithi131.stdout:Sep 13 03:06:47 smithi131 podman[112581]: 2024-09-13 03:06:47.168549048 +0000 UTC m=+0.530034658 container died 69b7dffed02ec9000d0c1ea6ed2a662162adfc8ce2974851f17bca39a30ea5c2 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-4-deactivate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-7741f7f, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-13T03:06:47.843 DEBUG:teuthology.orchestra.run.smithi131:> sudo pkill -f 'journalctl -f -n 0 -u ceph-12cdb164-717a-11ef-bceb-c7b262605968@osd.4.service' 2024-09-13T03:06:47.883 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T03:06:47.884 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-13T03:06:47.884 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-13T03:06:47.884 DEBUG:teuthology.orchestra.run.smithi131:> sudo systemctl stop ceph-12cdb164-717a-11ef-bceb-c7b262605968@osd.5 2024-09-13T03:06:48.184 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 03:06:47 smithi131 systemd[1]: Stopping Ceph osd.5 for 12cdb164-717a-11ef-bceb-c7b262605968... 2024-09-13T03:06:48.184 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 03:06:48 smithi131 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-5[98656]: 2024-09-13T03:06:48.010+0000 7f05eeb95640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-13T03:06:12.542996+0000 front 2024-09-13T03:06:12.543043+0000 (oldest deadline 2024-09-13T03:06:37.242963+0000) 2024-09-13T03:06:48.184 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 03:06:48 smithi131 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-5[98656]: 2024-09-13T03:06:48.010+0000 7f05eeb95640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.89:6814 osd.1 since back 2024-09-13T03:06:17.243482+0000 front 2024-09-13T03:06:17.243494+0000 (oldest deadline 2024-09-13T03:06:46.643759+0000) 2024-09-13T03:06:48.684 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 03:06:48 smithi131 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-5[98656]: 2024-09-13T03:06:48.224+0000 7f05f2590640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-13T03:06:48.684 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 03:06:48 smithi131 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-5[98656]: 2024-09-13T03:06:48.224+0000 7f05f2590640 -1 osd.5 82 *** Got signal Terminated *** 2024-09-13T03:06:48.684 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 03:06:48 smithi131 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-5[98656]: 2024-09-13T03:06:48.224+0000 7f05f2590640 -1 osd.5 82 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-13T03:06:49.434 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 03:06:49 smithi131 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-5[98656]: 2024-09-13T03:06:49.015+0000 7f05eeb95640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-13T03:06:12.542996+0000 front 2024-09-13T03:06:12.543043+0000 (oldest deadline 2024-09-13T03:06:37.242963+0000) 2024-09-13T03:06:49.434 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 03:06:49 smithi131 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-5[98656]: 2024-09-13T03:06:49.015+0000 7f05eeb95640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.89:6814 osd.1 since back 2024-09-13T03:06:17.243482+0000 front 2024-09-13T03:06:17.243494+0000 (oldest deadline 2024-09-13T03:06:46.643759+0000) 2024-09-13T03:06:50.434 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 03:06:50 smithi131 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-5[98656]: 2024-09-13T03:06:50.023+0000 7f05eeb95640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-13T03:06:12.542996+0000 front 2024-09-13T03:06:12.543043+0000 (oldest deadline 2024-09-13T03:06:37.242963+0000) 2024-09-13T03:06:50.434 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 03:06:50 smithi131 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-5[98656]: 2024-09-13T03:06:50.023+0000 7f05eeb95640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.89:6814 osd.1 since back 2024-09-13T03:06:17.243482+0000 front 2024-09-13T03:06:17.243494+0000 (oldest deadline 2024-09-13T03:06:46.643759+0000) 2024-09-13T03:06:51.434 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 03:06:51 smithi131 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-5[98656]: 2024-09-13T03:06:51.052+0000 7f05eeb95640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-13T03:06:12.542996+0000 front 2024-09-13T03:06:12.543043+0000 (oldest deadline 2024-09-13T03:06:37.242963+0000) 2024-09-13T03:06:51.434 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 03:06:51 smithi131 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-5[98656]: 2024-09-13T03:06:51.052+0000 7f05eeb95640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.89:6814 osd.1 since back 2024-09-13T03:06:17.243482+0000 front 2024-09-13T03:06:17.243494+0000 (oldest deadline 2024-09-13T03:06:46.643759+0000) 2024-09-13T03:06:51.434 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 03:06:51 smithi131 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-5[98656]: 2024-09-13T03:06:51.052+0000 7f05eeb95640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.89:6822 osd.2 since back 2024-09-13T03:06:26.645051+0000 front 2024-09-13T03:06:26.645074+0000 (oldest deadline 2024-09-13T03:06:50.743993+0000) 2024-09-13T03:06:52.434 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 03:06:52 smithi131 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-5[98656]: 2024-09-13T03:06:52.030+0000 7f05eeb95640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-13T03:06:12.542996+0000 front 2024-09-13T03:06:12.543043+0000 (oldest deadline 2024-09-13T03:06:37.242963+0000) 2024-09-13T03:06:52.434 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 03:06:52 smithi131 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-5[98656]: 2024-09-13T03:06:52.030+0000 7f05eeb95640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.89:6814 osd.1 since back 2024-09-13T03:06:17.243482+0000 front 2024-09-13T03:06:17.243494+0000 (oldest deadline 2024-09-13T03:06:46.643759+0000) 2024-09-13T03:06:52.434 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 03:06:52 smithi131 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-5[98656]: 2024-09-13T03:06:52.030+0000 7f05eeb95640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.89:6822 osd.2 since back 2024-09-13T03:06:26.645051+0000 front 2024-09-13T03:06:26.645074+0000 (oldest deadline 2024-09-13T03:06:50.743993+0000) 2024-09-13T03:06:53.434 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 03:06:52 smithi131 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-5[98656]: 2024-09-13T03:06:52.992+0000 7f05eeb95640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.89:6806 osd.0 since back 2024-09-13T03:06:12.542996+0000 front 2024-09-13T03:06:12.543043+0000 (oldest deadline 2024-09-13T03:06:37.242963+0000) 2024-09-13T03:06:53.434 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 03:06:52 smithi131 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-5[98656]: 2024-09-13T03:06:52.992+0000 7f05eeb95640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.89:6814 osd.1 since back 2024-09-13T03:06:17.243482+0000 front 2024-09-13T03:06:17.243494+0000 (oldest deadline 2024-09-13T03:06:46.643759+0000) 2024-09-13T03:06:53.434 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 03:06:52 smithi131 ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-5[98656]: 2024-09-13T03:06:52.992+0000 7f05eeb95640 -1 osd.5 82 heartbeat_check: no reply from 172.21.15.89:6822 osd.2 since back 2024-09-13T03:06:26.645051+0000 front 2024-09-13T03:06:26.645074+0000 (oldest deadline 2024-09-13T03:06:50.743993+0000) 2024-09-13T03:06:53.917 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 03:06:53 smithi131 podman[112685]: 2024-09-13 03:06:53.62562933 +0000 UTC m=+5.524167045 container died e7d2a780f4e044a5db36d9d2ecd26729578bed4b7ff4e2c0573d9f65fb3c48bb (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-5, GIT_CLEAN=True, RELEASE=squid-7741f7f, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-13T03:06:54.213 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 03:06:53 smithi131 podman[112685]: 2024-09-13 03:06:53.916493085 +0000 UTC m=+5.815030800 container cleanup e7d2a780f4e044a5db36d9d2ecd26729578bed4b7ff4e2c0573d9f65fb3c48bb (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-5, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-7741f7f, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-13T03:06:54.214 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 03:06:53 smithi131 bash[112685]: ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-5 2024-09-13T03:06:54.214 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 03:06:54 smithi131 podman[112700]: 2024-09-13 03:06:54.125957029 +0000 UTC m=+0.500536478 container remove e7d2a780f4e044a5db36d9d2ecd26729578bed4b7ff4e2c0573d9f65fb3c48bb (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-5, org.label-schema.build-date=20240731, ceph=True, RELEASE=squid-7741f7f, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True) 2024-09-13T03:06:54.822 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 03:06:54 smithi131 podman[112786]: 2024-09-13 03:06:54.364936431 +0000 UTC m=+0.015863841 image pull 19dc8d6597273a47b0b4862f1d0e037b0157b908a02acd63baceec3ee94fbd6c quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d 2024-09-13T03:06:54.822 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 03:06:54 smithi131 podman[112786]: 2024-09-13 03:06:54.468626228 +0000 UTC m=+0.119553621 container create 944cc3a47efd8f8955bbe1779cc2a0a84bd69fa30c438e09690739f6e3fa47c4 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-7741f7f, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-13T03:06:54.822 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 03:06:54 smithi131 podman[112786]: 2024-09-13 03:06:54.704451468 +0000 UTC m=+0.355378868 container init 944cc3a47efd8f8955bbe1779cc2a0a84bd69fa30c438e09690739f6e3fa47c4 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-5-deactivate, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-7741f7f, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-13T03:06:54.822 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 03:06:54 smithi131 podman[112786]: 2024-09-13 03:06:54.707850579 +0000 UTC m=+0.358777981 container start 944cc3a47efd8f8955bbe1779cc2a0a84bd69fa30c438e09690739f6e3fa47c4 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-5-deactivate, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=squid-7741f7f, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-13T03:06:54.822 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 03:06:54 smithi131 podman[112786]: 2024-09-13 03:06:54.821195647 +0000 UTC m=+0.472123057 container attach 944cc3a47efd8f8955bbe1779cc2a0a84bd69fa30c438e09690739f6e3fa47c4 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.37.2, RELEASE=squid-7741f7f) 2024-09-13T03:06:55.175 INFO:journalctl@ceph.osd.5.smithi131.stdout:Sep 13 03:06:54 smithi131 podman[112786]: 2024-09-13 03:06:54.894142449 +0000 UTC m=+0.545069851 container died 944cc3a47efd8f8955bbe1779cc2a0a84bd69fa30c438e09690739f6e3fa47c4 (image=quay.ceph.io/ceph-ci/ceph@sha256:871a6b4fae5c81e253eb203817fc39d575846074b65609ada12c4d6670071c5d, name=ceph-12cdb164-717a-11ef-bceb-c7b262605968-osd-5-deactivate, GIT_CLEAN=True, RELEASE=squid-7741f7f, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-13T03:06:55.459 DEBUG:teuthology.orchestra.run.smithi131:> sudo pkill -f 'journalctl -f -n 0 -u ceph-12cdb164-717a-11ef-bceb-c7b262605968@osd.5.service' 2024-09-13T03:06:55.498 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-13T03:06:55.498 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-13T03:06:55.499 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 12cdb164-717a-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-13T03:07:20.050 DEBUG:teuthology.orchestra.run.smithi131:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 12cdb164-717a-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-13T03:07:32.105 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-13T03:07:32.138 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-13T03:07:32.166 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-13T03:07:32.168 DEBUG:teuthology.misc:Transferring archived files from smithi089:/var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-13_02:08:15-upgrade-squid-distro-default-smithi/7903088/remote/smithi089/crash 2024-09-13T03:07:32.168 DEBUG:teuthology.orchestra.run.smithi089:> sudo tar c -f - -C /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/crash -- . 2024-09-13T03:07:32.208 INFO:teuthology.orchestra.run.smithi089.stderr:tar: /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-13T03:07:32.208 INFO:teuthology.orchestra.run.smithi089.stderr:tar: Error is not recoverable: exiting now 2024-09-13T03:07:32.210 DEBUG:teuthology.misc:Transferring archived files from smithi131:/var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-13_02:08:15-upgrade-squid-distro-default-smithi/7903088/remote/smithi131/crash 2024-09-13T03:07:32.210 DEBUG:teuthology.orchestra.run.smithi131:> sudo tar c -f - -C /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/crash -- . 2024-09-13T03:07:32.234 INFO:teuthology.orchestra.run.smithi131.stderr:tar: /var/lib/ceph/12cdb164-717a-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-13T03:07:32.234 INFO:teuthology.orchestra.run.smithi131.stderr:tar: Error is not recoverable: exiting now 2024-09-13T03:07:32.236 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-13T03:07:32.237 DEBUG:teuthology.orchestra.run.smithi089:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/12cdb164-717a-11ef-bceb-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v OSD_DOWN | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-13T03:07:32.294 INFO:teuthology.orchestra.run.smithi089.stdout:2024-09-13T03:00:00.000122+0000 mon.smithi089 (mon.0) 435 : cluster [WRN] Health detail: HEALTH_WARN 1 osds down 2024-09-13T03:07:32.295 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2024-09-13T03:07:32.295 DEBUG:teuthology.orchestra.run.smithi089:> sudo egrep '\[SEC\]' /var/log/ceph/12cdb164-717a-11ef-bceb-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v OSD_DOWN | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-13T03:07:32.330 DEBUG:teuthology.orchestra.run.smithi089:> sudo egrep '\[ERR\]' /var/log/ceph/12cdb164-717a-11ef-bceb-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v OSD_DOWN | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-13T03:07:32.406 DEBUG:teuthology.orchestra.run.smithi089:> sudo egrep '\[WRN\]' /var/log/ceph/12cdb164-717a-11ef-bceb-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v OSD_DOWN | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | head -n 1 2024-09-13T03:07:32.481 INFO:teuthology.orchestra.run.smithi089.stdout:2024-09-13T03:00:00.000122+0000 mon.smithi089 (mon.0) 435 : cluster [WRN] Health detail: HEALTH_WARN 1 osds down 2024-09-13T03:07:32.482 INFO:tasks.cephadm:Compressing logs... 2024-09-13T03:07:32.482 DEBUG:teuthology.orchestra.run.smithi089:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-13T03:07:32.524 DEBUG:teuthology.orchestra.run.smithi131:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-13T03:07:32.547 INFO:teuthology.orchestra.run.smithi089.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/12cdb164-717a-11ef-bceb-c7b262605968/ceph-osd.0.log 2024-09-13T03:07:32.547 INFO:teuthology.orchestra.run.smithi089.stderr:: No such file or directory 2024-09-13T03:07:32.547 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/12cdb164-717a-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi089.rarddb.log 2024-09-13T03:07:32.547 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/12cdb164-717a-11ef-bceb-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/12cdb164-717a-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi089.qjoitb.log 2024-09-13T03:07:32.547 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/12cdb164-717a-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi089.rarddb.log: gzip -5 --verbose -- /var/log/ceph/12cdb164-717a-11ef-bceb-c7b262605968/ceph-osd.1.log 2024-09-13T03:07:32.548 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/12cdb164-717a-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi089.qjoitb.log: gzip -5 --verbose -- /var/log/ceph/12cdb164-717a-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-13T03:07:32.548 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/12cdb164-717a-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-13T03:07:32.549 INFO:teuthology.orchestra.run.smithi131.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/12cdb164-717a-11ef-bceb-c7b262605968/ceph-mgr.smithi131.aunbqd.log 2024-09-13T03:07:32.549 INFO:teuthology.orchestra.run.smithi131.stderr:: No such file or directory 2024-09-13T03:07:32.549 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/12cdb164-717a-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-13T03:07:32.550 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/12cdb164-717a-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi131.rbovzc.log 2024-09-13T03:07:32.550 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/12cdb164-717a-11ef-bceb-c7b262605968/ceph-mgr.smithi131.aunbqd.log: /var/log/ceph/12cdb164-717a-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/12cdb164-717a-11ef-bceb-c7b262605968/ceph-osd.4.log 2024-09-13T03:07:32.550 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/12cdb164-717a-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi131.rbovzc.log: gzip -5 --verbose -- /var/log/ceph/12cdb164-717a-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-13T03:07:32.551 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/12cdb164-717a-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi131.uasrkg.log 2024-09-13T03:07:32.552 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/12cdb164-717a-11ef-bceb-c7b262605968/ceph-osd.4.log: /var/log/ceph/12cdb164-717a-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/12cdb164-717a-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-13T03:07:32.552 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/12cdb164-717a-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi131.uasrkg.log: gzip -5 --verbose -- /var/log/ceph/12cdb164-717a-11ef-bceb-c7b262605968/ceph-mon.smithi131.log 2024-09-13T03:07:32.552 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/12cdb164-717a-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/12cdb164-717a-11ef-bceb-c7b262605968/ceph-osd.5.log 2024-09-13T03:07:32.552 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/12cdb164-717a-11ef-bceb-c7b262605968/ceph-mon.smithi131.log: 85.1% -- replaced with /var/log/ceph/12cdb164-717a-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-13T03:07:32.553 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/12cdb164-717a-11ef-bceb-c7b262605968/ceph-osd.1.log: /var/log/ceph/12cdb164-717a-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/12cdb164-717a-11ef-bceb-c7b262605968/ceph-mon.smithi089.log 2024-09-13T03:07:32.553 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/12cdb164-717a-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/12cdb164-717a-11ef-bceb-c7b262605968/ceph-mgr.smithi089.guohvs.log 2024-09-13T03:07:32.553 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/12cdb164-717a-11ef-bceb-c7b262605968/ceph-mon.smithi089.log: 91.1% -- replaced with /var/log/ceph/12cdb164-717a-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-13T03:07:32.554 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/12cdb164-717a-11ef-bceb-c7b262605968/ceph.log 2024-09-13T03:07:32.555 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/12cdb164-717a-11ef-bceb-c7b262605968/ceph-osd.5.log: 91.3% -- replaced with /var/log/ceph/12cdb164-717a-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-13T03:07:32.557 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/12cdb164-717a-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-13T03:07:32.568 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/12cdb164-717a-11ef-bceb-c7b262605968/ceph-mgr.smithi089.guohvs.log: 91.0% -- replaced with /var/log/ceph/12cdb164-717a-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-13T03:07:32.570 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/12cdb164-717a-11ef-bceb-c7b262605968/ceph-osd.2.log 2024-09-13T03:07:32.570 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/12cdb164-717a-11ef-bceb-c7b262605968/ceph.cephadm.log: 86.3% -- replaced with /var/log/ceph/12cdb164-717a-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-13T03:07:32.571 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/12cdb164-717a-11ef-bceb-c7b262605968/ceph-osd.3.log 2024-09-13T03:07:32.571 INFO:teuthology.orchestra.run.smithi131.stderr: 91.0% -- replaced with /var/log/ceph/12cdb164-717a-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-13T03:07:32.574 INFO:teuthology.orchestra.run.smithi089.stderr:gzip -5 --verbose -- /var/log/ceph/12cdb164-717a-11ef-bceb-c7b262605968/ceph.log 2024-09-13T03:07:32.574 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/12cdb164-717a-11ef-bceb-c7b262605968/ceph.log: 87.7% -- replaced with /var/log/ceph/12cdb164-717a-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-13T03:07:32.583 INFO:teuthology.orchestra.run.smithi131.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-13T03:07:32.584 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/12cdb164-717a-11ef-bceb-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-13T03:07:32.586 INFO:teuthology.orchestra.run.smithi131.stderr:/var/log/ceph/12cdb164-717a-11ef-bceb-c7b262605968/ceph-osd.3.log: /var/log/ceph/cephadm.log: 92.3% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-13T03:07:32.587 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/12cdb164-717a-11ef-bceb-c7b262605968/ceph.log: 87.6% -- replaced with /var/log/ceph/12cdb164-717a-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-13T03:07:32.614 INFO:teuthology.orchestra.run.smithi131.stderr: 89.8% -- replaced with /var/log/ceph/12cdb164-717a-11ef-bceb-c7b262605968/ceph-mgr.smithi131.aunbqd.log.gz 2024-09-13T03:07:32.661 INFO:teuthology.orchestra.run.smithi089.stderr:/var/log/ceph/cephadm.log: 92.4% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-13T03:07:32.897 INFO:teuthology.orchestra.run.smithi089.stderr: 88.8% -- replaced with /var/log/ceph/12cdb164-717a-11ef-bceb-c7b262605968/ceph-mgr.smithi089.guohvs.log.gz 2024-09-13T03:07:32.905 INFO:teuthology.orchestra.run.smithi131.stderr: 92.5% -- replaced with /var/log/ceph/12cdb164-717a-11ef-bceb-c7b262605968/ceph-mon.smithi131.log.gz 2024-09-13T03:07:33.577 INFO:teuthology.orchestra.run.smithi089.stderr: 90.5% -- replaced with /var/log/ceph/12cdb164-717a-11ef-bceb-c7b262605968/ceph-mon.smithi089.log.gz 2024-09-13T03:07:36.371 INFO:teuthology.orchestra.run.smithi131.stderr: 95.1% -- replaced with /var/log/ceph/12cdb164-717a-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi131.rbovzc.log.gz 2024-09-13T03:07:36.415 INFO:teuthology.orchestra.run.smithi131.stderr: 93.4% -- replaced with /var/log/ceph/12cdb164-717a-11ef-bceb-c7b262605968/ceph-osd.4.log.gz 2024-09-13T03:07:37.354 INFO:teuthology.orchestra.run.smithi089.stderr: 93.3% -- replaced with /var/log/ceph/12cdb164-717a-11ef-bceb-c7b262605968/ceph-osd.0.log.gz 2024-09-13T03:07:37.764 INFO:teuthology.orchestra.run.smithi089.stderr: 93.4% -- replaced with /var/log/ceph/12cdb164-717a-11ef-bceb-c7b262605968/ceph-osd.1.log.gz 2024-09-13T03:07:37.898 INFO:teuthology.orchestra.run.smithi131.stderr: 93.4% -- replaced with /var/log/ceph/12cdb164-717a-11ef-bceb-c7b262605968/ceph-osd.5.log.gz 2024-09-13T03:07:37.961 INFO:teuthology.orchestra.run.smithi089.stderr: 93.4% -- replaced with /var/log/ceph/12cdb164-717a-11ef-bceb-c7b262605968/ceph-osd.2.log.gz 2024-09-13T03:07:39.527 INFO:teuthology.orchestra.run.smithi131.stderr: 93.4% -- replaced with /var/log/ceph/12cdb164-717a-11ef-bceb-c7b262605968/ceph-osd.3.log.gz 2024-09-13T03:07:43.326 INFO:teuthology.orchestra.run.smithi089.stderr: 95.2% -- replaced with /var/log/ceph/12cdb164-717a-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi089.qjoitb.log.gz 2024-09-13T03:08:16.991 INFO:teuthology.orchestra.run.smithi131.stderr: 93.6% -- replaced with /var/log/ceph/12cdb164-717a-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi131.uasrkg.log.gz 2024-09-13T03:08:16.991 INFO:teuthology.orchestra.run.smithi131.stderr: 2024-09-13T03:08:16.992 INFO:teuthology.orchestra.run.smithi131.stderr:real 0m44.452s 2024-09-13T03:08:16.992 INFO:teuthology.orchestra.run.smithi131.stderr:user 1m2.608s 2024-09-13T03:08:16.992 INFO:teuthology.orchestra.run.smithi131.stderr:sys 0m2.158s 2024-09-13T03:08:21.551 INFO:teuthology.orchestra.run.smithi089.stderr: 93.0% -- replaced with /var/log/ceph/12cdb164-717a-11ef-bceb-c7b262605968/ceph-mds.cephfs.smithi089.rarddb.log.gz 2024-09-13T03:08:21.553 INFO:teuthology.orchestra.run.smithi089.stderr: 2024-09-13T03:08:21.553 INFO:teuthology.orchestra.run.smithi089.stderr:real 0m49.017s 2024-09-13T03:08:21.553 INFO:teuthology.orchestra.run.smithi089.stderr:user 1m14.008s 2024-09-13T03:08:21.554 INFO:teuthology.orchestra.run.smithi089.stderr:sys 0m2.452s 2024-09-13T03:08:21.554 INFO:tasks.cephadm:Archiving logs... 2024-09-13T03:08:21.554 DEBUG:teuthology.misc:Transferring archived files from smithi089:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-13_02:08:15-upgrade-squid-distro-default-smithi/7903088/remote/smithi089/log 2024-09-13T03:08:21.555 DEBUG:teuthology.orchestra.run.smithi089:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-13T03:08:31.832 DEBUG:teuthology.misc:Transferring archived files from smithi131:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-13_02:08:15-upgrade-squid-distro-default-smithi/7903088/remote/smithi131/log 2024-09-13T03:08:31.833 DEBUG:teuthology.orchestra.run.smithi131:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-13T03:08:40.742 INFO:tasks.cephadm:Removing cluster... 2024-09-13T03:08:40.742 DEBUG:teuthology.orchestra.run.smithi089:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 12cdb164-717a-11ef-bceb-c7b262605968 --force 2024-09-13T03:08:41.294 DEBUG:teuthology.orchestra.run.smithi131:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 12cdb164-717a-11ef-bceb-c7b262605968 --force 2024-09-13T03:08:41.841 INFO:tasks.cephadm:Removing cephadm ... 2024-09-13T03:08:41.842 DEBUG:teuthology.orchestra.run.smithi089:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-13T03:08:41.858 DEBUG:teuthology.orchestra.run.smithi131:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-13T03:08:41.874 INFO:tasks.cephadm:Teardown complete 2024-09-13T03:08:41.874 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-13T03:08:41.885 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-13T03:08:41.885 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-13T03:08:41.902 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-13T03:08:41.985 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-13T03:08:41.999 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-13T03:08:41.999 DEBUG:teuthology.orchestra.run.smithi089:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T03:08:42.002 DEBUG:teuthology.orchestra.run.smithi131:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-13T03:08:42.014 INFO:teuthology.orchestra.run.smithi089.stderr:bash: line 1: ntpq: command not found 2024-09-13T03:08:42.016 INFO:teuthology.orchestra.run.smithi131.stderr:bash: line 1: ntpq: command not found 2024-09-13T03:08:42.020 INFO:teuthology.orchestra.run.smithi089.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T03:08:42.020 INFO:teuthology.orchestra.run.smithi089.stdout:=============================================================================== 2024-09-13T03:08:42.020 INFO:teuthology.orchestra.run.smithi089.stdout:^* hv01.front.sepia.ceph.com 3 6 377 32 +179us[ +189us] +/- 40ms 2024-09-13T03:08:42.020 INFO:teuthology.orchestra.run.smithi089.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 30 -272us[ -272us] +/- 58ms 2024-09-13T03:08:42.020 INFO:teuthology.orchestra.run.smithi089.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 32 +54us[ +65us] +/- 89ms 2024-09-13T03:08:42.020 INFO:teuthology.orchestra.run.smithi089.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T03:08:42.021 INFO:teuthology.orchestra.run.smithi131.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-13T03:08:42.021 INFO:teuthology.orchestra.run.smithi131.stdout:=============================================================================== 2024-09-13T03:08:42.021 INFO:teuthology.orchestra.run.smithi131.stdout:^* hv01.front.sepia.ceph.com 3 6 377 29 +175us[ +190us] +/- 40ms 2024-09-13T03:08:42.021 INFO:teuthology.orchestra.run.smithi131.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 28 -273us[ -273us] +/- 58ms 2024-09-13T03:08:42.021 INFO:teuthology.orchestra.run.smithi131.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 31 +37us[ +52us] +/- 89ms 2024-09-13T03:08:42.022 INFO:teuthology.orchestra.run.smithi131.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-13T03:08:42.022 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-13T03:08:42.032 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-13T03:08:42.032 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-13T03:08:42.057 DEBUG:teuthology.orchestra.run.smithi089:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-13T03:08:42.140 DEBUG:teuthology.orchestra.run.smithi131:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-13T03:08:42.215 DEBUG:teuthology.orchestra.run.smithi089:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-13T03:08:42.243 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T03:08:42.244 DEBUG:teuthology.orchestra.run.smithi131:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-13T03:08:42.272 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T03:08:42.273 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-13T03:08:42.284 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-13T03:08:42.310 INFO:teuthology.task.internal:Duration was 1813.637510 seconds 2024-09-13T03:08:42.311 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-13T03:08:42.389 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-13T03:08:42.389 DEBUG:teuthology.orchestra.run.smithi089:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-13T03:08:42.391 DEBUG:teuthology.orchestra.run.smithi131:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-13T03:08:42.428 INFO:teuthology.orchestra.run.smithi089.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T03:08:42.431 INFO:teuthology.orchestra.run.smithi131.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-13T03:08:42.723 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-13T03:08:42.723 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi089.front.sepia.ceph.com 2024-09-13T03:08:42.723 DEBUG:teuthology.orchestra.run.smithi089:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-13T03:08:42.743 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi131.front.sepia.ceph.com 2024-09-13T03:08:42.744 DEBUG:teuthology.orchestra.run.smithi131:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-13T03:08:42.789 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-13T03:08:42.789 DEBUG:teuthology.orchestra.run.smithi089:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T03:08:42.792 DEBUG:teuthology.orchestra.run.smithi131:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-13T03:08:42.855 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-13T03:08:42.856 DEBUG:teuthology.orchestra.run.smithi089:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-13T03:08:42.858 DEBUG:teuthology.orchestra.run.smithi131:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-13T03:08:43.509 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-13T03:08:43.522 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-13T03:08:43.522 DEBUG:teuthology.orchestra.run.smithi089:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-13T03:08:43.547 DEBUG:teuthology.orchestra.run.smithi131:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-13T03:08:43.574 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-13T03:08:43.593 DEBUG:teuthology.orchestra.run.smithi089:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-13T03:08:43.596 DEBUG:teuthology.orchestra.run.smithi131:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-13T03:08:43.616 INFO:teuthology.orchestra.run.smithi089.stdout:kernel.core_pattern = core 2024-09-13T03:08:43.638 INFO:teuthology.orchestra.run.smithi131.stdout:kernel.core_pattern = core 2024-09-13T03:08:43.652 DEBUG:teuthology.orchestra.run.smithi089:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-13T03:08:43.688 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T03:08:43.689 DEBUG:teuthology.orchestra.run.smithi131:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-13T03:08:43.711 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-13T03:08:43.712 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-13T03:08:43.723 INFO:teuthology.task.internal:Transferring archived files... 2024-09-13T03:08:43.725 DEBUG:teuthology.misc:Transferring archived files from smithi089:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-13_02:08:15-upgrade-squid-distro-default-smithi/7903088/remote/smithi089 2024-09-13T03:08:43.725 DEBUG:teuthology.orchestra.run.smithi089:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-13T03:08:43.780 DEBUG:teuthology.misc:Transferring archived files from smithi131:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-13_02:08:15-upgrade-squid-distro-default-smithi/7903088/remote/smithi131 2024-09-13T03:08:43.781 DEBUG:teuthology.orchestra.run.smithi131:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-13T03:08:43.821 INFO:teuthology.task.internal:Removing archive directory... 2024-09-13T03:08:43.821 DEBUG:teuthology.orchestra.run.smithi089:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-13T03:08:43.824 DEBUG:teuthology.orchestra.run.smithi131:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-13T03:08:43.869 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-13T03:08:43.884 INFO:teuthology.task.internal:Not uploading archives. 2024-09-13T03:08:43.885 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-13T03:08:44.011 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-13T03:08:44.012 DEBUG:teuthology.orchestra.run.smithi089:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-13T03:08:44.014 DEBUG:teuthology.orchestra.run.smithi131:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-13T03:08:44.027 INFO:teuthology.orchestra.run.smithi089.stdout: 265324 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 13 03:08 /home/ubuntu/cephtest 2024-09-13T03:08:44.029 INFO:teuthology.orchestra.run.smithi131.stdout: 265324 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 13 03:08 /home/ubuntu/cephtest 2024-09-13T03:08:44.030 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-13T03:08:44.049 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-13T03:08:44.152 INFO:teuthology.run:Summary data: description: upgrade/cephfs/mds_upgrade_sequence/{bluestore-bitmap centos_9.stream conf/{client mds mgr mon osd} fail_fs/no overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn pg_health syntax} roles tasks/{0-from/quincy 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client/kclient 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} duration: 1813.6375095844269 failure_reason: '"2024-09-13T03:00:00.000122+0000 mon.smithi089 (mon.0) 435 : cluster [WRN] Health detail: HEALTH_WARN 1 osds down" in cluster log' flavor: default owner: scheduled_teuthology@teuthology success: false 2024-09-13T03:08:44.153 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-13T03:08:44.272 INFO:teuthology.run:FAIL